-- Logs begin at Wed 2022-07-20 02:32:59 UTC, end at Wed 2022-07-20 06:05:50 UTC. -- Jul 20 03:59:30.589091 n-d-764485-11 systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 03:59:30.598716 n-d-764485-11 devstack@n-api.service[104450]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 03:59:30.600320 n-d-764485-11 devstack@n-api.service[104450]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 03:59:30 2022] *** Jul 20 03:59:30.600320 n-d-764485-11 devstack@n-api.service[104450]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 03:59:30.600320 n-d-764485-11 devstack@n-api.service[104450]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 03:59:30.600320 n-d-764485-11 devstack@n-api.service[104450]: nodename: n-d-764485-11 Jul 20 03:59:30.600320 n-d-764485-11 devstack@n-api.service[104450]: machine: x86_64 Jul 20 03:59:30.600320 n-d-764485-11 devstack@n-api.service[104450]: clock source: unix Jul 20 03:59:30.600320 n-d-764485-11 devstack@n-api.service[104450]: pcre jit disabled Jul 20 03:59:30.600320 n-d-764485-11 devstack@n-api.service[104450]: detected number of CPU cores: 4 Jul 20 03:59:30.600320 n-d-764485-11 devstack@n-api.service[104450]: current working directory: / Jul 20 03:59:30.600320 n-d-764485-11 devstack@n-api.service[104450]: detected binary path: /usr/bin/uwsgi-core Jul 20 03:59:30.600981 n-d-764485-11 devstack@n-api.service[104450]: your processes number limit is 47680 Jul 20 03:59:30.600981 n-d-764485-11 devstack@n-api.service[104450]: your memory page size is 4096 bytes Jul 20 03:59:30.600981 n-d-764485-11 devstack@n-api.service[104450]: detected max file descriptor number: 2048 Jul 20 03:59:30.600981 n-d-764485-11 devstack@n-api.service[104450]: lock engine: pthread robust mutexes Jul 20 03:59:30.600981 n-d-764485-11 devstack@n-api.service[104450]: thunder lock: enabled Jul 20 03:59:30.600981 n-d-764485-11 devstack@n-api.service[104450]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 03:59:30.600981 n-d-764485-11 devstack@n-api.service[104450]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 03:59:30.644266 n-d-764485-11 devstack@n-api.service[104450]: Python main interpreter initialized at 0x55970454e9c0 Jul 20 03:59:30.644266 n-d-764485-11 devstack@n-api.service[104450]: python threads support enabled Jul 20 03:59:30.644266 n-d-764485-11 devstack@n-api.service[104450]: your server socket listen backlog is limited to 100 connections Jul 20 03:59:30.644266 n-d-764485-11 devstack@n-api.service[104450]: your mercy for graceful operations on workers is 90 seconds Jul 20 03:59:30.644605 n-d-764485-11 devstack@n-api.service[104450]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 03:59:30.644679 n-d-764485-11 devstack@n-api.service[104450]: *** Operational MODE: preforking *** Jul 20 03:59:30.644927 n-d-764485-11 devstack@n-api.service[104450]: *** uWSGI is running in multiple interpreter mode *** Jul 20 03:59:30.644927 n-d-764485-11 devstack@n-api.service[104450]: spawned uWSGI master process (pid: 104450) Jul 20 03:59:30.645110 n-d-764485-11 systemd[1]: Started Devstack devstack@n-api.service. Jul 20 03:59:30.649673 n-d-764485-11 devstack@n-api.service[104450]: spawned uWSGI worker 1 (pid: 104451, cores: 1) Jul 20 03:59:30.649673 n-d-764485-11 devstack@n-api.service[104450]: spawned uWSGI worker 2 (pid: 104452, cores: 1) Jul 20 03:59:30.649673 n-d-764485-11 devstack@n-api.service[104450]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 03:59:31.302954 n-d-764485-11 devstack@n-api.service[104451]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 03:59:31.304242 n-d-764485-11 devstack@n-api.service[104452]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 03:59:32.434154 n-d-764485-11 devstack@n-api.service[104452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 03:59:32.434154 n-d-764485-11 devstack@n-api.service[104452]: from cryptography.utils import int_from_bytes Jul 20 03:59:32.434841 n-d-764485-11 devstack@n-api.service[104452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 03:59:32.434841 n-d-764485-11 devstack@n-api.service[104452]: from cryptography.utils import int_from_bytes Jul 20 03:59:32.439047 n-d-764485-11 devstack@n-api.service[104451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 03:59:32.439047 n-d-764485-11 devstack@n-api.service[104451]: from cryptography.utils import int_from_bytes Jul 20 03:59:32.439474 n-d-764485-11 devstack@n-api.service[104451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 03:59:32.439474 n-d-764485-11 devstack@n-api.service[104451]: from cryptography.utils import int_from_bytes Jul 20 03:59:34.925320 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 03:59:34.926005 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 03:59:34.926100 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 03:59:34.926425 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 03:59:34.926676 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 03:59:34.927062 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.927385 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.927735 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.928050 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.928375 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.928469 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 03:59:34.928822 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 03:59:34.928913 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.929007 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.929140 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 03:59:34.929285 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.929502 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 03:59:34.929615 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.929755 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 03:59:34.929872 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.930142 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.930235 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.930465 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.930557 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-764485-11 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.930782 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.930868 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.931089 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.931173 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.931395 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.931489 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.931733 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.931869 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.932032 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.932160 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.932351 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.932488 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.932654 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.932780 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.932909 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.933155 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.933318 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.934487 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-764485-11 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.934654 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.934783 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.934903 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.935033 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.935166 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.935301 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.935413 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.935570 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.935697 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.935819 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.935939 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.936061 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.936188 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.936317 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.936440 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.936440 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.936677 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.936812 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.936935 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.936935 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.937288 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-764485-11 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.937475 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.937633 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.937633 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.937928 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.938591 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.938783 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.938956 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.939123 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.939285 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.939432 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.939634 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.939813 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.939969 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.940154 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.940304 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.940437 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.940581 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.940787 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-764485-11 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.940966 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.941123 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.941276 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.941429 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.941593 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.941759 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.941921 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.942094 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.942281 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.942440 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.942611 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.942784 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.942938 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.943101 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.943255 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.943409 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.943596 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.943596 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.943944 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.944082 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.944241 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.944408 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.944573 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.944737 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.944891 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.945044 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.945207 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.945372 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.945555 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.945734 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.945893 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.946057 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.946225 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.946388 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.946544 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.946697 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.946869 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.947051 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.947197 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.947338 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.947471 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.947642 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.947767 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.947891 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.948020 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.948151 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.948282 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.948411 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.948534 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.948657 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.948787 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.948912 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.949043 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.949177 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.949306 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.949436 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.949568 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.949691 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.949812 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.949939 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.950063 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.950185 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.950315 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.950315 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.950544 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.950679 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.950815 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.951016 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.951143 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.951265 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.951386 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.951529 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.951653 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.951788 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.951921 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.952044 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.952173 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.952296 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.952416 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.952559 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.952692 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.953329 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.953452 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.953452 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.953680 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.953680 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.953932 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.954061 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.954184 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.954184 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.954489 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.954612 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.954612 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.954845 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.954965 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.955085 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.955215 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.955337 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.955457 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.955622 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.955744 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.955881 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.956012 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.956134 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.956262 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.956384 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.956518 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.956721 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.956856 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.956980 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.957114 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.957237 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.957359 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.957488 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.957619 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.957749 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.957879 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.958009 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.958131 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.958262 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.958387 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.958509 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.958629 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.958751 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.958883 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.959015 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.959137 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.959269 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.959393 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.959538 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.959662 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.959801 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.959925 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.960048 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.960218 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.960346 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.960534 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.960669 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.960833 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.960959 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.961133 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.961261 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.961429 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.961578 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.961757 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.961883 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.962026 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.962151 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.962337 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.962470 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.962635 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.962768 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.962931 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.963304 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.963481 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.963663 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.963800 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.963923 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.964097 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.964222 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.964393 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.964529 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.964690 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.964818 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.964989 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.965122 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.965288 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.965416 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.965588 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.965715 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.965888 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.966016 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.966188 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.966313 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.966484 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.966608 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.966782 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.966917 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.967075 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.967200 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.967375 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.967501 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.967712 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.967840 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.968012 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.968148 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.968311 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.969136 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.969257 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.969458 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.969583 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.969808 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.970048 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.970183 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.970389 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.970530 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.970711 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.970837 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.971015 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.971149 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.971314 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.971449 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.971660 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.971788 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.971981 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.972117 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.972286 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.972422 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.972589 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.972715 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.972889 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.973023 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.973203 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:59:34.973331 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.973508 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.973634 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.973819 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.973946 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.974132 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.974261 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.974447 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.974581 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.974774 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.974902 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.975090 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.975218 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.975404 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.975564 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.975738 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.975877 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.976057 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.976183 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.976325 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.976458 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.976652 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.976785 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.976960 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.977087 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.977267 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.977398 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.977576 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.977692 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.977888 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.978021 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.978213 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.978346 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.978526 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.978660 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.978839 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.978961 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.979148 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.979271 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.979454 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.979617 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.979787 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.979922 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.980110 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.980232 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.980425 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.980567 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.980730 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.980853 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.981043 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.981171 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.981337 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.981475 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.981642 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.981777 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.981948 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.982077 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.982255 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.982383 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.982560 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.982688 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.982868 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.982992 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.983173 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.983307 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.983485 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.983653 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.983818 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.983957 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.984158 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.984292 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.984573 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.984734 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.984883 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.985082 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.985228 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.985401 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.985535 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.985713 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.985840 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.986024 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.986152 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.986320 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.986451 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.986639 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.986766 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.986951 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.987084 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.987264 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.987419 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.987582 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.987719 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.987904 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.988037 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.988212 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.988340 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.988521 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.988646 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.988826 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.988965 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.989130 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.989257 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.989432 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.989570 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.989732 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.989857 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.990037 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.990164 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.990339 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.990481 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.990657 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.990791 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.990965 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.991092 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.991269 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.991397 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.991609 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.991740 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.991916 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.992043 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.992219 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.992428 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.992560 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.992683 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.992813 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.992949 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.993109 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.993244 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.993415 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.993540 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.993722 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.993847 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.994029 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.994169 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.994338 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.994471 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.994646 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.994773 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.994949 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.995076 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.995273 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.995400 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.995600 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.995728 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.995907 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.996036 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.996220 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.996347 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.996528 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.996668 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.996829 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.996954 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.997134 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.997259 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.997432 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.997567 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.997733 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.997860 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.998035 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.998170 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.998340 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.998474 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.998639 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.998764 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.998941 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.999068 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.999243 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.999379 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.999567 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.999779 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:34.999958 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.000121 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.000303 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.000532 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.000661 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.000844 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.000979 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.001152 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.001287 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.001451 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.001578 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.001753 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.001887 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.002059 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.002195 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.002370 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.002499 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.002675 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.002801 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.002979 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.003117 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.003284 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.003410 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.003610 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.003740 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.003915 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.004043 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.004236 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.004370 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.004542 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.004667 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.004841 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.004975 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.005145 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.005279 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.005446 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.005573 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.005752 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.005878 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.006068 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.006194 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.006376 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.006503 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.006698 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.006827 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.007003 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.007131 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.007321 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.007448 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.007632 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.007759 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.007946 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.008073 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.008252 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.008387 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.008562 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.008690 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.008869 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.008996 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.009177 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.009318 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.009494 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.009620 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.009800 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.009927 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.010113 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.010250 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.010417 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.010542 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.010721 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.010847 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.011026 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.011162 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.011340 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.011473 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.011664 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.011789 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.011978 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.012104 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.012285 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.012412 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.012604 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.012733 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.012909 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.013037 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.013222 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.013348 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.013522 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.013649 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.013831 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.013957 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.014140 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.014266 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.014449 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.014575 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.014756 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.014879 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.015061 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.015185 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.015922 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.016175 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.016317 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.016575 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.016701 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.016948 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.017085 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.017252 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.017389 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.017555 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.017682 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.017863 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.017997 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.018173 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.018301 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.018481 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.018609 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.018787 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.018916 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.019091 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.019227 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.019401 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.019551 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.019731 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.019859 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.020033 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.020161 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.020336 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.020463 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.020651 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.020795 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.020957 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.021082 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.021263 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.021389 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.021563 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.021766 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.021892 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.022015 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.022141 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.022263 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.022452 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.022588 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.022759 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.022894 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.023064 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.023191 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.023364 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.023500 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.023686 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.023812 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.023985 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.024112 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.024284 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.024420 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.024588 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.024723 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.024895 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.025013 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.025211 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.025337 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.025515 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.025640 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.025829 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.025953 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.026142 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.026270 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.026439 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.026557 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.026741 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.026869 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.027060 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.027185 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.027362 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.027495 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.027686 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.027825 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.027986 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.028113 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.028285 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.028412 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.028585 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.028724 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.028890 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.029018 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.029205 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.029330 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.029510 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.029644 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.029817 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.029943 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.030122 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.030249 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.030423 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.030568 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.030727 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.030869 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.031674 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.031806 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.032331 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.032471 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.032596 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.032719 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.032905 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.033034 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.033215 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.033344 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.033527 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.033658 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.033835 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.033964 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.034143 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.034271 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.034474 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.034644 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.034770 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.034894 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.035063 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.035208 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.035369 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.035497 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.035699 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.035839 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.036010 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.036149 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.036323 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.036451 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.036628 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.036884 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.037012 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.037213 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.037348 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.037519 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.037644 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.037823 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.037959 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.038125 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.038260 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.038428 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.038564 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.038732 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.038867 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.039046 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.039181 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.039349 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.039476 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.039684 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.039821 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.039987 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.040114 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.040290 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.040413 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.040594 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.040719 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.040895 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.041019 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.041196 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.041331 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.041496 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.041620 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.041798 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.041920 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.042105 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.042230 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.042409 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.042545 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.042712 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.042845 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.043014 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.043139 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.043318 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.043452 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.043651 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.043779 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.043954 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.044079 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.044261 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.044400 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.044563 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.044688 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.044861 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.044990 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.045168 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.045308 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.045466 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.045591 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.045765 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.045890 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.046088 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.046213 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.046364 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.046515 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.046706 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.046865 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.047015 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.047302 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.047433 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.047631 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.047773 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.047936 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.048076 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.048250 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.048377 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.048557 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.048685 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.048861 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.049006 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.049162 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.049289 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.049469 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.049597 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.049774 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.049902 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.050074 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.050201 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.050380 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.050508 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.050684 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.050812 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.050995 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.051122 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.051296 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.051423 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.051620 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.051750 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.051922 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.052042 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.052220 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.052345 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.052524 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.052651 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.052823 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.052956 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.053134 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.053269 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.053436 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.053562 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.053736 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.053862 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.054035 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.054173 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.054339 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.054464 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.054637 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.054762 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.054934 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.055067 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.055236 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.055368 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.055554 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.055683 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.055870 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.056011 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.056170 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.056297 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.056469 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.056596 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.056773 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.056901 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.057076 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.057210 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.057376 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.057502 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.057674 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.057799 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.057972 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.058098 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.058272 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.058399 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.058571 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.058697 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.058868 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.058994 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.059167 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.059301 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.059463 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.059604 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.059788 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.059915 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.060088 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.060231 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.060395 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.060521 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.060692 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.060819 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.060989 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.061128 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.061294 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.061420 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.061592 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.061718 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.061892 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.062027 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.062768 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.062899 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.063087 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.063397 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.063665 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.063805 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.063931 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.064053 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.064184 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.064309 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.064440 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.064614 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.064742 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.064922 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.065048 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.065231 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.065373 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.065532 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.065659 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.065832 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.065959 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.066139 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.066273 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.066438 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.066574 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.066743 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.066870 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.067063 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.067199 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.067384 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.067530 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.067730 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.067858 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.068034 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.068165 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.068341 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.068477 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.068647 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.068771 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.068951 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.069077 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.069256 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.069384 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.069555 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.069689 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.069858 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.069985 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.070162 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.070287 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.070472 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.070609 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.070772 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.070908 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.071073 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.071208 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.071373 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.071499 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.071704 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.071833 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.072008 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.072133 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.072310 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.072448 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.072633 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.072759 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.072938 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.073063 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.073241 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.073376 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.073546 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.073681 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.073850 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.073968 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.074154 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.074290 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.074454 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.074581 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.074755 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.074881 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.075059 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.075259 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.075384 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.075497 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.075686 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.075815 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.075997 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.076126 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.076301 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.076436 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.076603 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.076737 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.076907 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.077035 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.077213 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.077341 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.077515 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.077642 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.078045 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.078213 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.078337 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.078583 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.078708 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.078888 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.079024 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.079190 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.079325 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.079496 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.079663 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.079839 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.079968 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.080142 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.080275 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.080448 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.080575 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.080748 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.080883 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.081069 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.081205 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.081369 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.081496 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.081688 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.081816 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.082027 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.082165 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.082340 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.082466 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.082651 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.082778 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.082953 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.083081 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.083367 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.083540 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.083702 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.083831 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.084011 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.084138 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.084319 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.084454 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.084622 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.084749 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.084922 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.085049 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.085229 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.085369 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.085532 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.085650 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.085839 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.085963 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.086145 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.086314 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.086441 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.086564 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.086752 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.086878 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.087052 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.087179 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.087368 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.087492 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.087710 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.087854 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.088266 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.088399 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.088595 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.088723 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.089006 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.089134 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.089327 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.089455 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.089632 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.089759 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.089949 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.090076 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.090266 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.090391 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.090569 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.090703 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.090872 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.091002 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.091179 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.091304 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.091481 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.091626 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.091808 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.091936 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.092130 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.092268 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.092432 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.092560 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.092742 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.092868 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.093042 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.093179 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.093841 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.093975 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.094264 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.094400 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.094576 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.094844 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.094972 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.095146 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.095273 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.095540 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.095681 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.095841 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.095983 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.096164 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.096292 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.096488 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.096629 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.096793 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.096929 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.097109 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.097235 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.097413 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.097549 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.097715 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.097843 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.098016 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.098141 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.098316 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.098451 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.098636 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.098762 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.098940 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.099067 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.099247 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.099384 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.099576 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.099705 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.099886 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.100015 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.100192 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.100320 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.100495 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.100621 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.100817 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.100958 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.101120 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.101248 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.101441 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.101575 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.101750 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.101877 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.102056 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.102183 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.102356 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.102485 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.102664 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.102791 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.102992 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.103126 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.103249 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.103372 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.103578 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.103723 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.103879 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.104005 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.104180 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.104305 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.104482 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.104619 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.104785 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.104926 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.105107 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.105236 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.105410 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.105546 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.105730 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.105859 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.106036 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.106163 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.106339 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.106478 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.106640 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.106767 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.106939 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.107067 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.107272 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.107407 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.107593 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.107722 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.107911 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.108029 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.108212 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.108342 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.108517 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.108644 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.108818 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.108953 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.109679 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.109952 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.110156 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.110374 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.110570 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.110740 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.110876 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.111022 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.111328 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.111664 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.111990 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.112294 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.112602 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.112740 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.112912 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.113038 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.113215 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.113356 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.113517 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.113653 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.113817 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.113945 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.114158 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.114294 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.114459 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.114605 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.114779 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.114906 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.115088 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.115223 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.115407 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.115630 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.115761 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.115961 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.116102 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.116281 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.116409 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.116597 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.116726 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.116917 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.117098 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.117224 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.117348 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.117531 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.117660 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.117845 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.117982 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.118155 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.118281 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.118465 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.118591 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.118768 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.118896 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.119080 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.119202 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.119390 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.119566 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.119727 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.119844 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.120063 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.120249 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.120365 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.120581 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.120704 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.120898 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.121020 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.121208 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.121339 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.121526 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.121655 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.121838 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.121967 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.122150 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.122284 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.122462 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.122599 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.122774 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.122901 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.123085 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.123212 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.123392 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.123547 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.123725 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.123853 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.124038 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.124242 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.124370 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.124508 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.124745 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.124875 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.125076 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.125215 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.125394 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.125664 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.125797 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.125984 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.126113 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.126299 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.126431 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.126653 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.126779 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.126970 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.127104 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.127277 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.127405 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.127616 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.127744 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.127931 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.128133 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.128264 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.128447 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.128575 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.128779 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.128916 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.129101 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.129236 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.129424 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.129551 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.129733 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.129866 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.130043 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.130179 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.130356 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.130484 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.130660 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.130795 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.130964 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.131092 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.131273 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.131401 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.131606 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.131814 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.131947 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.132078 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.132223 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.132351 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.132532 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.132661 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.132835 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.133047 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.133174 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.133363 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.133499 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.133695 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.133966 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.134094 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.134314 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.134441 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.134624 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.134750 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.134937 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.135064 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.135260 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.135394 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.135587 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.135718 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.135891 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.136018 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.136198 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.136344 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.136505 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.136633 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.136807 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.136934 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.137120 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.137268 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.137426 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.137551 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.137726 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.137853 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.138027 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.138163 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.138336 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.138465 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.138645 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.138864 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.139000 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.139208 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.139335 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.139532 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.139663 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.139858 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.140002 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.140162 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.140465 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.140600 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.140724 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.140846 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.141079 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.141211 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.141381 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.141506 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.141683 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.141809 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.141986 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.142113 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.142287 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.142421 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.142594 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.142735 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.142895 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.143019 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.143197 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.143322 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.143497 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.143658 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.143824 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.143952 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.144126 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.144258 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.144429 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.144563 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.144730 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.144861 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.145053 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.145178 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.145357 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.145495 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.145659 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.145792 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.145961 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.146087 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.146267 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.146405 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.146566 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.146698 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.146871 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.146996 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.147174 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.147300 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.147474 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.147651 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.147787 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.147912 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.148094 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.148349 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.148476 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.148681 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.148808 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.148984 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.149119 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.149285 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.149423 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.149590 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.149725 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.149925 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.150060 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.150230 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.150368 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.150532 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.150658 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.150833 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.150960 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.151142 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.151276 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.151451 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.151595 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.151787 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.151916 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.152093 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.152226 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.152399 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.152525 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.152706 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.152834 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.153011 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.153146 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.153318 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.153548 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.153675 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.153879 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.154007 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.154195 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.154322 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.154500 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.154628 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.154805 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.154933 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.155113 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.155241 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.155418 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.155567 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.155746 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.156388 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.156645 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.156791 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.157017 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.157228 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.157354 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.157567 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.157694 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.157880 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.158008 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.158194 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.158320 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.158504 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.158644 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.158812 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.158947 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.159119 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.159254 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.159427 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.159582 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.159751 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.159886 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.160056 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.160183 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.160363 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.160499 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.160671 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.160798 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.160978 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.161105 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.161287 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.161487 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.161620 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.161745 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.161938 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.162089 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.162243 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.162381 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.162555 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.162683 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.162866 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.162994 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.163175 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.163303 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.163483 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.163637 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.163813 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.163953 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.164121 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.164250 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.164434 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.164561 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.164733 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.164867 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.165036 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.165165 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.165344 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.165471 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.165661 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.165801 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.165969 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.166097 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.166269 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.166397 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.166575 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.166711 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.166882 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.167012 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.167183 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.167310 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.167482 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.167663 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.167798 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.167923 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.168096 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.168224 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.168402 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.168530 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.168701 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.168836 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.169002 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.169130 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.169301 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.169438 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.169600 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.169720 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.169899 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.170026 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.170197 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.170326 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.170501 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.170630 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.170800 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.170929 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.171098 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.171235 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.171397 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.172301 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.172436 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.172571 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.172696 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.172877 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.173004 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.173194 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.173321 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.173500 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.173630 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.173804 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.173931 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.174109 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.174244 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.174412 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.174540 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.174719 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.174854 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.175019 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.175154 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.175319 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.175500 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.175706 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.175833 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.175966 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.176098 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.176231 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.176354 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.176503 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.176630 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.176807 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.176943 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.177106 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.177233 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.177412 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.177540 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.177712 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.177848 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.178011 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.178138 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.178311 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.178438 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.178817 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.178955 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.178955 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.179155 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.179279 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.179409 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.179596 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.179727 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.179917 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.180046 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.180233 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.180368 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.180544 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.180674 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.180873 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.180994 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.181184 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.181298 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.181494 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.181610 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.181801 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.181913 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.182108 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.182231 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.182419 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.182534 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.182728 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.182840 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.183022 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.183146 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.183328 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.183452 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.183661 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.183775 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.183972 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.184101 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.184298 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.184423 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.184621 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.184734 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.184923 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.185045 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.185246 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.185364 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.185560 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.185676 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.186378 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.186511 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.186636 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.186758 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.186883 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.187017 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.187167 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.187299 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.187431 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.187573 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.187699 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.187836 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.188143 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.188269 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.188392 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 03:59:35.188523 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.188771 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.189087 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.189398 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.189710 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.190023 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.190338 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.190666 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.190992 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.191303 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.191655 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.191984 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.192329 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.192639 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.192981 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.193308 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.193622 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.193932 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.194236 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:59:35.194478 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 03:59:35.250934 n-d-764485-11 devstack@n-api.service[104451]: INFO dbcounter [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Registered counter for database nova_api Jul 20 03:59:35.260238 n-d-764485-11 devstack@n-api.service[104452]: INFO dbcounter [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] Registered counter for database nova_api Jul 20 03:59:35.366352 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_db.sqlalchemy.engines [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:59:35.372859 n-d-764485-11 devstack@n-api.service[104451]: DEBUG dbcounter [-] [104451] Writer thread running {{(pid=104451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:59:35.374013 n-d-764485-11 devstack@n-api.service[104452]: DEBUG oslo_db.sqlalchemy.engines [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:59:35.381279 n-d-764485-11 devstack@n-api.service[104452]: DEBUG dbcounter [-] [104452] Writer thread running {{(pid=104452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:59:35.428372 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.context [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) {{(pid=104451) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 03:59:35.432248 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_concurrency.lockutils [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 03:59:35.433838 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_concurrency.lockutils [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 03:59:35.434629 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_concurrency.lockutils [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 03:59:35.436914 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_concurrency.lockutils [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 03:59:35.437021 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.context [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) {{(pid=104452) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 03:59:35.439440 n-d-764485-11 devstack@n-api.service[104451]: INFO dbcounter [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Registered counter for database nova_cell0 Jul 20 03:59:35.442100 n-d-764485-11 devstack@n-api.service[104452]: DEBUG oslo_concurrency.lockutils [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 03:59:35.443248 n-d-764485-11 devstack@n-api.service[104451]: INFO dbcounter [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Registered counter for database nova_cell1 Jul 20 03:59:35.443716 n-d-764485-11 devstack@n-api.service[104452]: DEBUG oslo_concurrency.lockutils [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 03:59:35.444511 n-d-764485-11 devstack@n-api.service[104452]: DEBUG oslo_concurrency.lockutils [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 03:59:35.446626 n-d-764485-11 devstack@n-api.service[104452]: DEBUG oslo_concurrency.lockutils [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 03:59:35.448630 n-d-764485-11 devstack@n-api.service[104452]: INFO dbcounter [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] Registered counter for database nova_cell0 Jul 20 03:59:35.450538 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_db.sqlalchemy.engines [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:59:35.452644 n-d-764485-11 devstack@n-api.service[104452]: INFO dbcounter [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] Registered counter for database nova_cell1 Jul 20 03:59:35.453457 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_db.sqlalchemy.engines [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:59:35.458440 n-d-764485-11 devstack@n-api.service[104451]: DEBUG dbcounter [-] [104451] Writer thread running {{(pid=104451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:59:35.460927 n-d-764485-11 devstack@n-api.service[104451]: DEBUG dbcounter [-] [104451] Writer thread running {{(pid=104451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:59:35.461356 n-d-764485-11 devstack@n-api.service[104452]: DEBUG oslo_db.sqlalchemy.engines [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:59:35.466251 n-d-764485-11 devstack@n-api.service[104452]: DEBUG oslo_db.sqlalchemy.engines [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:59:35.466889 n-d-764485-11 devstack@n-api.service[104452]: DEBUG dbcounter [-] [104452] Writer thread running {{(pid=104452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:59:35.605210 n-d-764485-11 devstack@n-api.service[104451]: INFO dbcounter [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Registered counter for database nova_cell0 Jul 20 03:59:35.610110 n-d-764485-11 devstack@n-api.service[104452]: DEBUG dbcounter [-] [104452] Writer thread running {{(pid=104452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:59:35.614577 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_db.sqlalchemy.engines [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:59:35.618992 n-d-764485-11 devstack@n-api.service[104451]: DEBUG dbcounter [-] [104451] Writer thread running {{(pid=104451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:59:35.619585 n-d-764485-11 devstack@n-api.service[104452]: INFO dbcounter [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] Registered counter for database nova_cell0 Jul 20 03:59:35.626934 n-d-764485-11 devstack@n-api.service[104452]: DEBUG oslo_db.sqlalchemy.engines [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:59:35.631421 n-d-764485-11 devstack@n-api.service[104452]: DEBUG dbcounter [-] [104452] Writer thread running {{(pid=104452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:59:35.961370 n-d-764485-11 devstack@n-api.service[104451]: WARNING keystonemiddleware.auth_token [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 03:59:35.967811 n-d-764485-11 devstack@n-api.service[104452]: WARNING keystonemiddleware.auth_token [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 03:59:35.969261 n-d-764485-11 devstack@n-api.service[104451]: WARNING keystonemiddleware.auth_token [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 03:59:35.975664 n-d-764485-11 devstack@n-api.service[104452]: WARNING keystonemiddleware.auth_token [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 03:59:36.312040 n-d-764485-11 devstack@n-api.service[104451]: WARNING keystonemiddleware.auth_token [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 03:59:36.318880 n-d-764485-11 devstack@n-api.service[104451]: WARNING keystonemiddleware.auth_token [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 03:59:36.322883 n-d-764485-11 devstack@n-api.service[104452]: WARNING keystonemiddleware.auth_token [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 03:59:36.324287 n-d-764485-11 devstack@n-api.service[104451]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55970454e9c0 pid: 104451 (default app) Jul 20 03:59:36.326341 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:36.327537 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Jul 20 03:59:36.328140 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Wed Jul 20 03:59:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:59:36.329350 n-d-764485-11 devstack@n-api.service[104452]: WARNING keystonemiddleware.auth_token [None req-81b5c2d5-6db2-4a1f-8d2a-3b2104d5e4a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 03:59:36.334597 n-d-764485-11 devstack@n-api.service[104452]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55970454e9c0 pid: 104452 (default app) Jul 20 04:00:53.085821 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:53.086904 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jul 20 04:00:53.087294 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:00:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:53.100664 n-d-764485-11 devstack@n-api.service[104452]: DEBUG dbcounter [-] [104452] Writing DB stats nova_api:SELECT=3 {{(pid=104452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:53.101829 n-d-764485-11 devstack@n-api.service[104452]: DEBUG dbcounter [-] [104452] Writing DB stats nova_cell0:SELECT=3 {{(pid=104452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:53.102659 n-d-764485-11 devstack@n-api.service[104452]: DEBUG dbcounter [-] [104452] Writing DB stats nova_cell1:SELECT=3 {{(pid=104452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:53.103543 n-d-764485-11 devstack@n-api.service[104452]: DEBUG dbcounter [-] [104452] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:53.994176 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-564617df-dff7-4611-9794-719bc65ae1a7 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:54.024957 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-564617df-dff7-4611-9794-719bc65ae1a7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.929838 Jul 20 04:00:54.025948 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 20 04:00:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:00:56.302746 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:56.303835 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-6242bf0e-9ea2-414d-9922-8954cc908b31 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 20 04:00:56.304392 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:00:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:00:56.764678 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-32cccddc-b875-4cf8-b208-aa3adaa13548 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:56.783923 n-d-764485-11 devstack@n-api.service[104452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:00:56.783923 n-d-764485-11 devstack@n-api.service[104452]: warnings.warn(msg) Jul 20 04:00:56.812982 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-32cccddc-b875-4cf8-b208-aa3adaa13548 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502215 Jul 20 04:00:56.813555 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 20 04:00:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:00:56.827808 n-d-764485-11 devstack@n-api.service[104451]: DEBUG dbcounter [-] [104451] Writing DB stats nova_api:SELECT=3 {{(pid=104451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:56.829426 n-d-764485-11 devstack@n-api.service[104451]: DEBUG dbcounter [-] [104451] Writing DB stats nova_cell0:SELECT=3 {{(pid=104451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:56.830671 n-d-764485-11 devstack@n-api.service[104451]: DEBUG dbcounter [-] [104451] Writing DB stats nova_cell1:SELECT=3 {{(pid=104451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:56.831705 n-d-764485-11 devstack@n-api.service[104451]: DEBUG dbcounter [-] [104451] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:57.042966 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-57ae32f1-0845-4028-a174-503399223396 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:00:57.045417 n-d-764485-11 devstack@n-api.service[104451]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:00:57.045417 n-d-764485-11 devstack@n-api.service[104451]: warnings.warn(msg) Jul 20 04:00:57.108487 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-57ae32f1-0845-4028-a174-503399223396 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286365 Jul 20 04:00:57.109240 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jul 20 04:00:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:00:59.443261 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-32cccddc-b875-4cf8-b208-aa3adaa13548 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:59.444345 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-32cccddc-b875-4cf8-b208-aa3adaa13548 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 20 04:00:59.444749 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:00:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:00.241527 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-8c79837e-93a8-46dc-a63a-4ed1a82e3fda admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "disk": 5, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:00.262218 n-d-764485-11 devstack@n-api.service[104451]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:01:00.262218 n-d-764485-11 devstack@n-api.service[104451]: warnings.warn(msg) Jul 20 04:01:00.286960 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-8c79837e-93a8-46dc-a63a-4ed1a82e3fda admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.835719 Jul 20 04:01:00.288350 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 20 04:00:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:01:00.306004 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-562c431c-232d-436a-b6c5-858975015f7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:00.308390 n-d-764485-11 devstack@n-api.service[104452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:01:00.308390 n-d-764485-11 devstack@n-api.service[104452]: warnings.warn(msg) Jul 20 04:01:00.346031 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-562c431c-232d-436a-b6c5-858975015f7b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045039 Jul 20 04:01:00.347640 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jul 20 04:01:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:01:02.957031 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-8c79837e-93a8-46dc-a63a-4ed1a82e3fda admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:02.958623 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-8c79837e-93a8-46dc-a63a-4ed1a82e3fda admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Jul 20 04:01:02.959299 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:01:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:01:03.423899 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-cedacaa6-08b6-4c8b-868c-c262846c22f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "disk": 10, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:03.445590 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-cedacaa6-08b6-4c8b-868c-c262846c22f8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478959 Jul 20 04:01:03.459248 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 20 04:01:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:01:03.460532 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-c0d051ea-f084-4d0e-aad7-cd64beca84d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:03.491195 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-c0d051ea-f084-4d0e-aad7-cd64beca84d6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034593 Jul 20 04:01:03.500644 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jul 20 04:01:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:01:05.949940 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-cedacaa6-08b6-4c8b-868c-c262846c22f8 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:05.950992 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-cedacaa6-08b6-4c8b-868c-c262846c22f8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 20 04:01:05.951400 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:06.330855 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-04decd97-ff65-4d1d-8a2c-5b32dff0cb15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "disk": 10, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:06.352191 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-04decd97-ff65-4d1d-8a2c-5b32dff0cb15 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.393858 Jul 20 04:01:06.358123 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 20 04:01:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:01:06.366542 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-25af3616-3299-4b8a-9708-6c75f15e80be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:06.412400 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-25af3616-3299-4b8a-9708-6c75f15e80be admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050648 Jul 20 04:01:06.413452 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jul 20 04:01:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:01:08.731887 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-04decd97-ff65-4d1d-8a2c-5b32dff0cb15 admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:08.732824 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-04decd97-ff65-4d1d-8a2c-5b32dff0cb15 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 20 04:01:08.733961 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:01:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:09.261220 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-1459868e-5693-4660-84c1-36096925ab05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:09.282016 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-1459868e-5693-4660-84c1-36096925ab05 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.542211 Jul 20 04:01:09.289685 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 20 04:01:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:01:09.294728 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-a45d1327-2e4e-4ef7-8f21-61fac93d47f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:09.320203 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-a45d1327-2e4e-4ef7-8f21-61fac93d47f2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029141 Jul 20 04:01:09.331563 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Jul 20 04:01:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:01:11.700524 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-1459868e-5693-4660-84c1-36096925ab05 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:11.703744 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-1459868e-5693-4660-84c1-36096925ab05 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003824 Jul 20 04:01:11.704839 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:01:11 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:12.219762 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-e4545d0b-61de-45f1-94a3-13bf79062394 admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:12.245050 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-e4545d0b-61de-45f1-94a3-13bf79062394 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.533851 Jul 20 04:01:12.245873 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 20 04:01:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:01:14.565710 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-1459868e-5693-4660-84c1-36096925ab05 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:14.566755 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-1459868e-5693-4660-84c1-36096925ab05 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 20 04:01:14.567180 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:01:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:14.995901 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-3dd09c03-86db-4427-ad5d-307bfedb3ce7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "name": "m1.tiny"}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:15.017186 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-3dd09c03-86db-4427-ad5d-307bfedb3ce7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.443784 Jul 20 04:01:15.017916 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 20 04:01:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:01:15.029914 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-586b4efc-3566-4429-9213-1d08c5fb87d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:15.054211 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-586b4efc-3566-4429-9213-1d08c5fb87d2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028184 Jul 20 04:01:15.054805 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jul 20 04:01:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:01:17.566746 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-3dd09c03-86db-4427-ad5d-307bfedb3ce7 admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:17.567624 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-3dd09c03-86db-4427-ad5d-307bfedb3ce7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 20 04:01:17.568029 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:01:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:17.989687 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-ef9948ad-7bd0-4755-b06f-721ac637778a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small"}} {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:18.011494 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-ef9948ad-7bd0-4755-b06f-721ac637778a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.437484 Jul 20 04:01:18.012395 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 20 04:01:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:01:18.028021 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-5d449db3-b0f8-4dd0-9c2f-da3c97170263 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:18.054089 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-5d449db3-b0f8-4dd0-9c2f-da3c97170263 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029726 Jul 20 04:01:18.054622 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jul 20 04:01:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:01:20.325474 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-ef9948ad-7bd0-4755-b06f-721ac637778a admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:20.327054 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-ef9948ad-7bd0-4755-b06f-721ac637778a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 20 04:01:20.327351 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:01:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:20.728730 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-2720f916-c0c6-4791-9043-8deaa9468207 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:20.746729 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-2720f916-c0c6-4791-9043-8deaa9468207 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.413456 Jul 20 04:01:20.747268 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 20 04:01:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:01:20.760425 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-95d4e646-d9b8-490e-bab9-3c0d7794d92c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:20.783233 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-95d4e646-d9b8-490e-bab9-3c0d7794d92c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026438 Jul 20 04:01:20.783837 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jul 20 04:01:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:01:23.051558 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-2720f916-c0c6-4791-9043-8deaa9468207 admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:23.052474 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-2720f916-c0c6-4791-9043-8deaa9468207 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 20 04:01:23.053056 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:01:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:23.429789 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-f78aa904-e951-4885-b669-3e88ebd80936 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "id": "4", "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:23.434617 n-d-764485-11 devstack@n-api.service[104452]: DEBUG dbcounter [-] [104452] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:01:23.449117 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-f78aa904-e951-4885-b669-3e88ebd80936 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.390334 Jul 20 04:01:23.449826 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 20 04:01:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:01:23.461979 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-6ec0b1e1-35aa-4520-876b-d9b87f92dae4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:23.485545 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-6ec0b1e1-35aa-4520-876b-d9b87f92dae4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027148 Jul 20 04:01:23.486124 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jul 20 04:01:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:01:25.755085 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-f78aa904-e951-4885-b669-3e88ebd80936 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:25.756117 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-f78aa904-e951-4885-b669-3e88ebd80936 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 20 04:01:25.756974 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:01:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:26.202048 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-4a00c9c6-5a8e-4d8a-9175-f10fba2d09ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "disk": 160}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:26.221736 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-4a00c9c6-5a8e-4d8a-9175-f10fba2d09ba admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458936 Jul 20 04:01:26.222321 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Jul 20 04:01:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:01:26.237081 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-e4a4b15b-b34d-4b75-bc5e-152d55d77625 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:26.262731 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-e4a4b15b-b34d-4b75-bc5e-152d55d77625 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032113 Jul 20 04:01:26.276400 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Jul 20 04:01:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:01:49.864726 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-4a00c9c6-5a8e-4d8a-9175-f10fba2d09ba admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:49.865802 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-4a00c9c6-5a8e-4d8a-9175-f10fba2d09ba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 20 04:01:49.866203 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:01:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:01:49.877080 n-d-764485-11 devstack@n-api.service[104452]: DEBUG dbcounter [-] [104452] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:01:50.261257 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-0fccb34f-030d-4957-b489-c2cd5c62b2b6 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:50.278154 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-0fccb34f-030d-4957-b489-c2cd5c62b2b6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406056 Jul 20 04:01:50.279231 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 20 04:01:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:01:51.348005 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-4a00c9c6-5a8e-4d8a-9175-f10fba2d09ba admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:51.349003 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-4a00c9c6-5a8e-4d8a-9175-f10fba2d09ba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 20 04:01:51.349396 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 20 04:01:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:51.897834 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-8abab342-a182-4125-99ca-b850e5bf813d admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:51.903728 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.wsgi [None req-8abab342-a182-4125-99ca-b850e5bf813d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-8abab342-a182-4125-99ca-b850e5bf813d admin admin] Request method failure captured: Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: Accept: application/json Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: Accept-Encoding: gzip, deflate Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: Connection: keep-alive Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: Content-Length: 0 Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: Host: 10.222.0.20 Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: Openstack-Api-Version: compute 2.90 Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: Openstack-System-Scope: None Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: User-Agent: python-novaclient Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: X-Auth-Token: gAAAAABi134vUfRBvquPzdFQdM1aB-Hy6mjKMFx2QbnhpbniiUyaXGywpD64JjU_V6izPntUAYzjEzjb-HUQjmPA_-8ygb0-71BMQjyby0HzlPZ0OyjS_EEwUbr4RVxNiuhamcrTJ8a-ceh0qTP8vFrjE2BfpOyBJXAT-b6ZjFxdB5C-UUW5ens Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: X-Domain-Id: None Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: X-Domain-Name: None Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: X-Identity-Status: Confirmed Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: X-Is-Admin-Project: True Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: X-Project-Domain-Id: default Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: X-Project-Domain-Name: Default Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: X-Project-Id: fd0ede87f057490da6921676f9536588 Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: X-Project-Name: admin Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: X-Role: reader,member,admin Jul 20 04:01:51.907061 n-d-764485-11 devstack@n-api.service[104452]: X-Roles: reader,member,admin Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd0ede87f057490da6921676f9536588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd0ede87f057490da6921676f9536588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd0ede87f057490da6921676f9536588", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd0ede87f057490da6921676f9536588"}]}] Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: X-Tenant: admin Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: X-Tenant-Id: fd0ede87f057490da6921676f9536588 Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: X-Tenant-Name: admin Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: X-User: admin Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: X-User-Domain-Id: default Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: X-User-Domain-Name: Default Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: X-User-Id: b641733aa54f40419a8c2bd5d4c90e70 Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: X-User-Name: admin Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: method: > Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: exception: Flavor 42 could not be found. Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: action_args: {'id': '42'} Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:01:51.908576 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:01:51.909533 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:51.910841 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-8abab342-a182-4125-99ca-b850e5bf813d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:01:51.911956 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-8abab342-a182-4125-99ca-b850e5bf813d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.401218 Jul 20 04:01:51.911956 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:01:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:01:51.920561 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-828f1f7e-70ad-4607-ac38-f72a9cd39ef8 admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:51.926497 n-d-764485-11 devstack@n-api.service[104451]: DEBUG dbcounter [-] [104451] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:01:51.951335 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-828f1f7e-70ad-4607-ac38-f72a9cd39ef8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035767 Jul 20 04:01:51.952315 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 20 04:01:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:01:51.965280 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-39b2d5b7-bb41-496d-aab7-b89c7d0a65ba admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:51.991385 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-39b2d5b7-bb41-496d-aab7-b89c7d0a65ba admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029813 Jul 20 04:01:51.992464 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 20 04:01:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:01:52.003108 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-3b279471-0b74-4140-83f6-4113bf58ea5d admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:52.009883 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.wsgi [None req-3b279471-0b74-4140-83f6-4113bf58ea5d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-3b279471-0b74-4140-83f6-4113bf58ea5d admin admin] Request method failure captured: Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: Accept: application/json Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: Accept-Encoding: gzip, deflate Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: Connection: keep-alive Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: Content-Length: 0 Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: Host: 10.222.0.20 Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: Openstack-Api-Version: compute 2.90 Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: Openstack-System-Scope: None Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: User-Agent: python-novaclient Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: X-Auth-Token: gAAAAABi134vUfRBvquPzdFQdM1aB-Hy6mjKMFx2QbnhpbniiUyaXGywpD64JjU_V6izPntUAYzjEzjb-HUQjmPA_-8ygb0-71BMQjyby0HzlPZ0OyjS_EEwUbr4RVxNiuhamcrTJ8a-ceh0qTP8vFrjE2BfpOyBJXAT-b6ZjFxdB5C-UUW5ens Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: X-Domain-Id: None Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: X-Domain-Name: None Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: X-Identity-Status: Confirmed Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: X-Is-Admin-Project: True Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: X-Project-Domain-Id: default Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: X-Project-Domain-Name: Default Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: X-Project-Id: fd0ede87f057490da6921676f9536588 Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: X-Project-Name: admin Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: X-Role: reader,member,admin Jul 20 04:01:52.014215 n-d-764485-11 devstack@n-api.service[104451]: X-Roles: reader,member,admin Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd0ede87f057490da6921676f9536588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd0ede87f057490da6921676f9536588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd0ede87f057490da6921676f9536588", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd0ede87f057490da6921676f9536588"}]}] Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: X-Tenant: admin Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: X-Tenant-Id: fd0ede87f057490da6921676f9536588 Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: X-Tenant-Name: admin Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: X-User: admin Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: X-User-Domain-Id: default Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: X-User-Domain-Name: Default Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: X-User-Id: b641733aa54f40419a8c2bd5d4c90e70 Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: X-User-Name: admin Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: method: > Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: exception: Flavor 42 could not be found. Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: action_args: {'id': '42'} Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:01:52.016136 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:01:52.017190 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:52.018578 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-3b279471-0b74-4140-83f6-4113bf58ea5d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:01:52.019860 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-3b279471-0b74-4140-83f6-4113bf58ea5d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016928 Jul 20 04:01:52.027841 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:01:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 04:01:53.046126 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-39b2d5b7-bb41-496d-aab7-b89c7d0a65ba admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:53.047125 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-39b2d5b7-bb41-496d-aab7-b89c7d0a65ba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jul 20 04:01:53.047536 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 20 04:01:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:53.572809 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-e5125720-bc41-495e-bab8-37da32318384 admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:53.578869 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.wsgi [None req-e5125720-bc41-495e-bab8-37da32318384 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-e5125720-bc41-495e-bab8-37da32318384 admin admin] Request method failure captured: Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: Accept: application/json Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: Accept-Encoding: gzip, deflate Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: Connection: keep-alive Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: Content-Length: 0 Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: Host: 10.222.0.20 Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: Openstack-Api-Version: compute 2.90 Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: Openstack-System-Scope: None Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: User-Agent: python-novaclient Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: X-Auth-Token: gAAAAABi134wWtaQ1kYnk9D-N7nzG3J9qbBntKXZUwFXfDQ6CitAR76V4aHYmhT9X1xZ-0t0-zr66MMl1IT6JRKhJGyWpVwh3CReDHoz3IfUbawB7eiW6-iX3k8DYNwNxLKDtmjhs0L1h0aOXeEJ5t-bulzH2gQXFffhPyRGevk1PDIIvIqvHrA Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: X-Domain-Id: None Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: X-Domain-Name: None Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: X-Identity-Status: Confirmed Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: X-Is-Admin-Project: True Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: X-Project-Domain-Id: default Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: X-Project-Domain-Name: Default Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: X-Project-Id: fd0ede87f057490da6921676f9536588 Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: X-Project-Name: admin Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: X-Role: reader,member,admin Jul 20 04:01:53.580403 n-d-764485-11 devstack@n-api.service[104451]: X-Roles: reader,member,admin Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd0ede87f057490da6921676f9536588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd0ede87f057490da6921676f9536588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd0ede87f057490da6921676f9536588", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd0ede87f057490da6921676f9536588"}]}] Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: X-Tenant: admin Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: X-Tenant-Id: fd0ede87f057490da6921676f9536588 Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: X-Tenant-Name: admin Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: X-User: admin Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: X-User-Domain-Id: default Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: X-User-Domain-Name: Default Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: X-User-Id: b641733aa54f40419a8c2bd5d4c90e70 Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: X-User-Name: admin Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: method: > Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: exception: Flavor 84 could not be found. Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: action_args: {'id': '84'} Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:01:53.581963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:01:53.582963 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:53.584456 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-e5125720-bc41-495e-bab8-37da32318384 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:01:53.585691 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-e5125720-bc41-495e-bab8-37da32318384 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398803 Jul 20 04:01:53.585691 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:01:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:01:53.592385 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-7f7a163a-2fd1-4d73-98b7-29193794da51 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:53.605764 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-7f7a163a-2fd1-4d73-98b7-29193794da51 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017956 Jul 20 04:01:53.606283 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 20 04:01:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:01:53.615812 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-974d4005-66b3-48f5-a937-1469ab702b0b admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:53.629171 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-974d4005-66b3-48f5-a937-1469ab702b0b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016826 Jul 20 04:01:53.629688 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 20 04:01:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:01:53.639164 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-e2aaff46-7c7b-40a0-bfae-2a1e67ccdefb admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:53.644466 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.wsgi [None req-e2aaff46-7c7b-40a0-bfae-2a1e67ccdefb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-e2aaff46-7c7b-40a0-bfae-2a1e67ccdefb admin admin] Request method failure captured: Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: Accept: application/json Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: Accept-Encoding: gzip, deflate Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: Connection: keep-alive Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: Content-Length: 0 Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: Host: 10.222.0.20 Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: Openstack-Api-Version: compute 2.90 Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: Openstack-System-Scope: None Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: User-Agent: python-novaclient Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: X-Auth-Token: gAAAAABi134wWtaQ1kYnk9D-N7nzG3J9qbBntKXZUwFXfDQ6CitAR76V4aHYmhT9X1xZ-0t0-zr66MMl1IT6JRKhJGyWpVwh3CReDHoz3IfUbawB7eiW6-iX3k8DYNwNxLKDtmjhs0L1h0aOXeEJ5t-bulzH2gQXFffhPyRGevk1PDIIvIqvHrA Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: X-Domain-Id: None Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: X-Domain-Name: None Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: X-Identity-Status: Confirmed Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: X-Is-Admin-Project: True Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: X-Project-Domain-Id: default Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: X-Project-Domain-Name: Default Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: X-Project-Id: fd0ede87f057490da6921676f9536588 Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: X-Project-Name: admin Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: X-Role: reader,member,admin Jul 20 04:01:53.645949 n-d-764485-11 devstack@n-api.service[104452]: X-Roles: reader,member,admin Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd0ede87f057490da6921676f9536588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd0ede87f057490da6921676f9536588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd0ede87f057490da6921676f9536588", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd0ede87f057490da6921676f9536588"}]}] Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: X-Tenant: admin Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: X-Tenant-Id: fd0ede87f057490da6921676f9536588 Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: X-Tenant-Name: admin Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: X-User: admin Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: X-User-Domain-Id: default Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: X-User-Domain-Name: Default Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: X-User-Id: b641733aa54f40419a8c2bd5d4c90e70 Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: X-User-Name: admin Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: method: > Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: exception: Flavor 84 could not be found. Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: action_args: {'id': '84'} Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:01:53.647247 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:01:53.648178 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:53.649275 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-e2aaff46-7c7b-40a0-bfae-2a1e67ccdefb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:01:53.650251 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-e2aaff46-7c7b-40a0-bfae-2a1e67ccdefb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012181 Jul 20 04:01:53.650251 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:01:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:01:54.609144 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-974d4005-66b3-48f5-a937-1469ab702b0b admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:54.610141 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-974d4005-66b3-48f5-a937-1469ab702b0b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 20 04:01:54.610538 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 20 04:01:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:55.141490 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-4b1fbbb7-d4d6-4492-9eb1-0be3523ee568 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:55.147155 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.wsgi [None req-4b1fbbb7-d4d6-4492-9eb1-0be3523ee568 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-4b1fbbb7-d4d6-4492-9eb1-0be3523ee568 admin admin] Request method failure captured: Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: Accept: application/json Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: Accept-Encoding: gzip, deflate Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: Connection: keep-alive Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: Content-Length: 0 Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: Host: 10.222.0.20 Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: Openstack-Api-Version: compute 2.90 Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: Openstack-System-Scope: None Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: User-Agent: python-novaclient Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: X-Auth-Token: gAAAAABi134yp5RIJpfjtKo1bUjXMZpbyqT0dSSMFAfH6DFB7dTdw7UXErp9mzhxgDyR8Z-f0-HpAMkf6tplUXQ5WduftH4JR6IEUfyFvmVNEQIkdQDOKnse0AH29cqLUNpnnN8tPNMXXHhkSX58xgFlGopbjgdIsYS_J4cetCBiyFAkvf82084 Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: X-Domain-Id: None Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: X-Domain-Name: None Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: X-Identity-Status: Confirmed Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: X-Is-Admin-Project: True Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: X-Project-Domain-Id: default Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: X-Project-Domain-Name: Default Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: X-Project-Id: fd0ede87f057490da6921676f9536588 Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: X-Project-Name: admin Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: X-Role: reader,member,admin Jul 20 04:01:55.148696 n-d-764485-11 devstack@n-api.service[104452]: X-Roles: reader,member,admin Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd0ede87f057490da6921676f9536588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd0ede87f057490da6921676f9536588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd0ede87f057490da6921676f9536588", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd0ede87f057490da6921676f9536588"}]}] Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: X-Tenant: admin Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: X-Tenant-Id: fd0ede87f057490da6921676f9536588 Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: X-Tenant-Name: admin Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: X-User: admin Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: X-User-Domain-Id: default Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: X-User-Domain-Name: Default Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: X-User-Id: b641733aa54f40419a8c2bd5d4c90e70 Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: X-User-Name: admin Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: method: > Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: exception: Flavor 451 could not be found. Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: action_args: {'id': '451'} Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:01:55.150262 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:01:55.151349 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: ERROR nova.api.openstack.wsgi Jul 20 04:01:55.152730 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-4b1fbbb7-d4d6-4492-9eb1-0be3523ee568 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:01:55.154270 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-4b1fbbb7-d4d6-4492-9eb1-0be3523ee568 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.399679 Jul 20 04:01:55.154270 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:01:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:01:55.159785 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-eb155e19-0450-404c-9009-a3c464d6a034 admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:55.173710 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-eb155e19-0450-404c-9009-a3c464d6a034 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017418 Jul 20 04:01:55.174261 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 20 04:01:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:01:55.183349 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:55.199012 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019114 Jul 20 04:01:55.199578 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 20 04:01:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:01:55.208970 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-6f130ec5-fb15-4b52-8351-aca9977b9865 admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:55.214504 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.wsgi [None req-6f130ec5-fb15-4b52-8351-aca9977b9865 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-6f130ec5-fb15-4b52-8351-aca9977b9865 admin admin] Request method failure captured: Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: Accept: application/json Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: Accept-Encoding: gzip, deflate Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: Connection: keep-alive Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: Content-Length: 0 Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: Host: 10.222.0.20 Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: Openstack-Api-Version: compute 2.90 Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: Openstack-System-Scope: None Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: User-Agent: python-novaclient Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: X-Auth-Token: gAAAAABi134yp5RIJpfjtKo1bUjXMZpbyqT0dSSMFAfH6DFB7dTdw7UXErp9mzhxgDyR8Z-f0-HpAMkf6tplUXQ5WduftH4JR6IEUfyFvmVNEQIkdQDOKnse0AH29cqLUNpnnN8tPNMXXHhkSX58xgFlGopbjgdIsYS_J4cetCBiyFAkvf82084 Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: X-Domain-Id: None Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: X-Domain-Name: None Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: X-Identity-Status: Confirmed Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: X-Is-Admin-Project: True Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: X-Project-Domain-Id: default Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: X-Project-Domain-Name: Default Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: X-Project-Id: fd0ede87f057490da6921676f9536588 Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: X-Project-Name: admin Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: X-Role: reader,member,admin Jul 20 04:01:55.216069 n-d-764485-11 devstack@n-api.service[104451]: X-Roles: reader,member,admin Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd0ede87f057490da6921676f9536588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd0ede87f057490da6921676f9536588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd0ede87f057490da6921676f9536588", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd0ede87f057490da6921676f9536588"}]}] Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: X-Tenant: admin Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: X-Tenant-Id: fd0ede87f057490da6921676f9536588 Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: X-Tenant-Name: admin Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: X-User: admin Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: X-User-Domain-Id: default Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: X-User-Domain-Name: Default Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: X-User-Id: b641733aa54f40419a8c2bd5d4c90e70 Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: X-User-Name: admin Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: method: > Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: exception: Flavor 451 could not be found. Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: action_args: {'id': '451'} Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:01:55.217868 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:01:55.218685 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: ERROR nova.api.openstack.wsgi Jul 20 04:01:55.219800 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-6f130ec5-fb15-4b52-8351-aca9977b9865 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:01:55.220804 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-6f130ec5-fb15-4b52-8351-aca9977b9865 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012010 Jul 20 04:01:55.220804 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:01:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:01:56.189175 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:56.190121 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 20 04:01:56.190518 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 20 04:01:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:56.727015 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-5865f967-972a-45eb-9466-f3ad34152437 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:56.743943 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-5865f967-972a-45eb-9466-f3ad34152437 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406218 Jul 20 04:01:56.744470 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Jul 20 04:01:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:01:57.710930 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:57.711965 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 20 04:01:57.712366 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 20 04:01:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:58.237518 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-ba34e7f1-4dfc-48d8-90c9-86b71097a3ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:58.254734 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-ba34e7f1-4dfc-48d8-90c9-86b71097a3ec admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.405412 Jul 20 04:01:58.255276 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Jul 20 04:01:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:01:59.243186 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:01:59.244203 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 20 04:01:59.244628 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 20 04:01:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:01:59.761207 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-28c272a2-1c52-415a-a7e7-07530bdc350e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:01:59.778151 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-28c272a2-1c52-415a-a7e7-07530bdc350e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.397113 Jul 20 04:01:59.779349 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Jul 20 04:01:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:02:00.766380 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:02:00.767407 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 20 04:02:00.767850 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 20 04:02:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:02:01.299981 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-3f46c81c-249b-4776-98e9-a5cd88bc963c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:02:01.317869 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-3f46c81c-249b-4776-98e9-a5cd88bc963c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.409961 Jul 20 04:02:01.318416 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Jul 20 04:02:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:02:02.283094 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:02:02.284583 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Jul 20 04:02:02.285155 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 20 04:02:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:02:02.813525 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-fe61caec-36f3-4cac-a167-b156f66bde4f admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:02:02.833055 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-fe61caec-36f3-4cac-a167-b156f66bde4f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403014 Jul 20 04:02:02.833678 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Wed Jul 20 04:02:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:02:55.203475 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:02:55.204503 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-d9c945fe-793a-4550-a1b2-1a7f7f5b237a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 20 04:02:55.204900 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Wed Jul 20 04:02:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:02:55.216420 n-d-764485-11 devstack@n-api.service[104451]: DEBUG dbcounter [-] [104451] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:02:55.598675 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-96a2bd85-09f2-48e7-8ddb-dfb07c110bb7 admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:02:55.617546 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-96a2bd85-09f2-48e7-8ddb-dfb07c110bb7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406615 Jul 20 04:02:55.618016 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 20 04:02:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:02:55.639600 n-d-764485-11 devstack@n-api.service[104452]: DEBUG dbcounter [-] [104452] Writing DB stats nova_api:SELECT=14 {{(pid=104452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:02:55.644234 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-a780ab69-8afa-4721-85a7-d3fcb5952ae3 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:02:55.652076 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-a780ab69-8afa-4721-85a7-d3fcb5952ae3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013819 Jul 20 04:02:55.652593 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Wed Jul 20 04:02:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:02:55.664346 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-894b33cb-e674-4428-a3b9-4996493f5d01 admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:02:55.672625 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-894b33cb-e674-4428-a3b9-4996493f5d01 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011901 Jul 20 04:02:55.673150 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Wed Jul 20 04:02:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:02:55.685323 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-5cb17a22-0c50-4f15-9a7d-abc363c56587 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:02:55.692876 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-5cb17a22-0c50-4f15-9a7d-abc363c56587 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011833 Jul 20 04:02:55.693405 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Wed Jul 20 04:02:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:02:55.705116 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-24c0ae41-7d1b-42d4-a8f4-8aa268069994 admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:02:55.712717 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-24c0ae41-7d1b-42d4-a8f4-8aa268069994 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011244 Jul 20 04:02:55.713231 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Wed Jul 20 04:02:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:35.556502 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-5cb17a22-0c50-4f15-9a7d-abc363c56587 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:35.557500 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-5cb17a22-0c50-4f15-9a7d-abc363c56587 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 20 04:08:35.557893 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 20 04:08:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:35.701508 n-d-764485-11 devstack@n-api.service[104451]: DEBUG dbcounter [-] [104451] Writing DB stats nova_api:SELECT=6 {{(pid=104451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:35.841725 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-bc9f2104-0320-47bc-ac40-955060a89f11 admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:35.842892 n-d-764485-11 devstack@n-api.service[104451]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:35.842892 n-d-764485-11 devstack@n-api.service[104451]: warnings.warn(msg) Jul 20 04:08:35.844290 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_concurrency.lockutils [None req-bc9f2104-0320-47bc-ac40-955060a89f11 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.844727 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_concurrency.lockutils [None req-bc9f2104-0320-47bc-ac40-955060a89f11 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.845534 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_concurrency.lockutils [None req-bc9f2104-0320-47bc-ac40-955060a89f11 admin admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.845999 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_concurrency.lockutils [None req-bc9f2104-0320-47bc-ac40-955060a89f11 admin admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.885938 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-bc9f2104-0320-47bc-ac40-955060a89f11 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.185773 Jul 20 04:08:35.886494 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:08:35 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:36.726189 n-d-764485-11 devstack@n-api.service[104452]: DEBUG nova.api.openstack.wsgi [None req-5cb17a22-0c50-4f15-9a7d-abc363c56587 admin admin] Calling method '>' {{(pid=104452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:36.727269 n-d-764485-11 devstack@n-api.service[104452]: INFO nova.api.openstack.requestlog [None req-5cb17a22-0c50-4f15-9a7d-abc363c56587 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 20 04:08:36.727690 n-d-764485-11 devstack@n-api.service[104452]: [pid: 104452|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Jul 20 04:08:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:36.917736 n-d-764485-11 devstack@n-api.service[104451]: DEBUG nova.api.openstack.wsgi [None req-accea623-ace7-4165-9c7f-37fcc03c1acb admin admin] Calling method '>' {{(pid=104451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:36.918893 n-d-764485-11 devstack@n-api.service[104451]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:36.918893 n-d-764485-11 devstack@n-api.service[104451]: warnings.warn(msg) Jul 20 04:08:36.920092 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_concurrency.lockutils [None req-accea623-ace7-4165-9c7f-37fcc03c1acb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.920525 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_concurrency.lockutils [None req-accea623-ace7-4165-9c7f-37fcc03c1acb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.921292 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_concurrency.lockutils [None req-accea623-ace7-4165-9c7f-37fcc03c1acb admin admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.922536 n-d-764485-11 devstack@n-api.service[104451]: DEBUG oslo_concurrency.lockutils [None req-accea623-ace7-4165-9c7f-37fcc03c1acb admin admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.944378 n-d-764485-11 devstack@n-api.service[104451]: INFO nova.api.openstack.requestlog [None req-accea623-ace7-4165-9c7f-37fcc03c1acb admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.077916 Jul 20 04:08:36.944850 n-d-764485-11 devstack@n-api.service[104451]: [pid: 104451|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:08:36 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:20.088957 n-d-764485-11 devstack@n-api.service[104450]: Wed Jul 20 04:09:20 2022 - graceful shutdown triggered... Jul 20 04:09:20.089496 n-d-764485-11 devstack@n-api.service[104451]: Gracefully killing worker 1 (pid: 104451)... Jul 20 04:09:20.093691 n-d-764485-11 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 04:09:20.095653 n-d-764485-11 devstack@n-api.service[104452]: Gracefully killing worker 2 (pid: 104452)... Jul 20 04:09:21.089831 n-d-764485-11 devstack@n-api.service[104450]: worker 1 buried after 1 seconds Jul 20 04:09:21.089831 n-d-764485-11 devstack@n-api.service[104450]: worker 2 buried after 1 seconds Jul 20 04:09:21.089831 n-d-764485-11 devstack@n-api.service[104450]: goodbye to uWSGI. Jul 20 04:09:21.091639 n-d-764485-11 systemd[1]: devstack@n-api.service: Succeeded. Jul 20 04:09:21.092198 n-d-764485-11 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 04:09:21.095123 n-d-764485-11 systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 04:09:21.143383 n-d-764485-11 devstack@n-api.service[119796]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 04:09:21 2022] *** Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: nodename: n-d-764485-11 Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: machine: x86_64 Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: clock source: unix Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: pcre jit disabled Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: detected number of CPU cores: 4 Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: current working directory: / Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: detected binary path: /usr/bin/uwsgi-core Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: your processes number limit is 47680 Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: your memory page size is 4096 bytes Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: detected max file descriptor number: 2048 Jul 20 04:09:21.172522 n-d-764485-11 devstack@n-api.service[119796]: lock engine: pthread robust mutexes Jul 20 04:09:21.173668 n-d-764485-11 devstack@n-api.service[119796]: thunder lock: enabled Jul 20 04:09:21.173668 n-d-764485-11 devstack@n-api.service[119796]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 04:09:21.173668 n-d-764485-11 devstack@n-api.service[119796]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 04:09:21.222137 n-d-764485-11 devstack@n-api.service[119796]: Python main interpreter initialized at 0x5642898279c0 Jul 20 04:09:21.222137 n-d-764485-11 devstack@n-api.service[119796]: python threads support enabled Jul 20 04:09:21.222137 n-d-764485-11 devstack@n-api.service[119796]: your server socket listen backlog is limited to 100 connections Jul 20 04:09:21.222137 n-d-764485-11 devstack@n-api.service[119796]: your mercy for graceful operations on workers is 90 seconds Jul 20 04:09:21.222580 n-d-764485-11 devstack@n-api.service[119796]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 04:09:21.222580 n-d-764485-11 devstack@n-api.service[119796]: *** Operational MODE: preforking *** Jul 20 04:09:21.222849 n-d-764485-11 devstack@n-api.service[119796]: *** uWSGI is running in multiple interpreter mode *** Jul 20 04:09:21.222849 n-d-764485-11 devstack@n-api.service[119796]: spawned uWSGI master process (pid: 119796) Jul 20 04:09:21.223059 n-d-764485-11 systemd[1]: Started Devstack devstack@n-api.service. Jul 20 04:09:21.223686 n-d-764485-11 devstack@n-api.service[119796]: spawned uWSGI worker 1 (pid: 119807, cores: 1) Jul 20 04:09:21.224243 n-d-764485-11 devstack@n-api.service[119796]: spawned uWSGI worker 2 (pid: 119808, cores: 1) Jul 20 04:09:21.224585 n-d-764485-11 devstack@n-api.service[119796]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 04:09:21.886371 n-d-764485-11 devstack@n-api.service[119807]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 04:09:21.900517 n-d-764485-11 devstack@n-api.service[119808]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 04:09:23.105678 n-d-764485-11 devstack@n-api.service[119807]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:09:23.105678 n-d-764485-11 devstack@n-api.service[119807]: from cryptography.utils import int_from_bytes Jul 20 04:09:23.106312 n-d-764485-11 devstack@n-api.service[119807]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:09:23.106312 n-d-764485-11 devstack@n-api.service[119807]: from cryptography.utils import int_from_bytes Jul 20 04:09:23.132048 n-d-764485-11 devstack@n-api.service[119808]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:09:23.132048 n-d-764485-11 devstack@n-api.service[119808]: from cryptography.utils import int_from_bytes Jul 20 04:09:23.132536 n-d-764485-11 devstack@n-api.service[119808]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:09:23.132536 n-d-764485-11 devstack@n-api.service[119808]: from cryptography.utils import int_from_bytes Jul 20 04:09:25.452977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 04:09:25.453533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 04:09:25.453904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 04:09:25.454007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 04:09:25.454112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 04:09:25.454209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 04:09:25.454302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 04:09:25.454388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 04:09:25.454481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 04:09:25.454576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 04:09:25.454676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.454769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.454937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.455077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.455254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.455378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.455592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.455715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.455925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.456045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.456237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.456375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.456554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.456665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.456870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.456964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.457196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.457298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.457454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.457548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.457766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.457872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.458090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-764485-11 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.458197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-764485-11 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.458411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.458517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.458715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.458817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.459027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.459140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.459341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.459452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.459674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.459796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.459993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.460099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.460296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.460400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.460792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.460989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.461235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.461359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.461538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.461671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.461839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.461990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.462171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.462324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.462501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.462640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.462845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.463001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.463150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.463300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.463452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.463639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.463787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.463937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.464072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.464214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.464424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-764485-11 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.464596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-764485-11 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.464777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.464910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.465049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.465189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.465332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.465474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.465735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.465885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.466607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.466745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.466890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.467014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.467156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.467298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.467956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.468118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.468264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.468414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.468414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.468678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.468897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.469047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.469216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.469360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.469541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.469692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.469827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.469970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.470119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.470263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.470430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.470568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.470751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.470888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.471054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.471197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.471340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.471482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.471665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.471801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.471945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.472080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.472220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.472362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.472511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.472705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.472993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.473141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.473280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.473426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.473561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.473696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.473839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.474067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.474218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.474368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.474515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.474656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.474790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.474930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.475073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.475207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.475355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.475524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.475674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.475817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.475960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.476100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.476240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.476374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.476522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.476663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.476806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.476950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.477085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.477225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.477367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.477516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.477653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.477786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.477918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.478061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.478231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.478379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.478515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.478655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.478787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.478920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.479100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.479253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.479417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.479591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.479753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.479900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.480072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.480222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.480389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.480531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.480696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.480843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.480985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.481125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.481290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.481443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.481607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.481754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.481939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.482078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.482241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.482379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.482523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.482656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.482805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.483046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.483902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.484048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.484194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.484407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.484558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.484701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.484844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.484991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.485133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.485277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.485421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.485555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.485745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.485891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.486080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.486232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.486401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.486537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.486706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.486851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.487016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.487168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.487324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.487469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.487646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.487792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.487933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.488082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.488253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.488404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.488570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.488709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.488879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.489034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.489182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.489325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.489465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.489608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.489829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.489973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.490107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.490241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.490391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.490525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.490658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.490809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.490951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.491085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.491242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.491388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.491598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.491736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.491869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.492014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.492158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.492293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.492439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.492580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.492756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.492895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.493116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.493245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.493421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.493583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.493726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.493870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.494014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.494155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.494324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.494476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.494619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.494760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.494903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.495037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.495205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.495345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.495491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.495652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.495822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.495973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.496109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.496254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.496396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.496538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.496710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.496862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.497028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.497174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.497317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.497451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.497623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.497769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.497910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.498052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.498228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.498374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.498579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.498761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.498952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:09:25.499157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.499351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.499563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.499761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.499910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.500099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.500255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.500428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.500565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.500749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.500889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.501060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.501206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.501373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.501510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.501699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.501827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.502012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.502177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.502325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.502492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.502636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.502773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.502939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.503091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.503314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.503460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.503656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.503810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.503954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.504112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.504693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.504837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.504988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.505131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.505274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.505406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.505546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.505689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.505832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.505968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.506100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.506241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.506383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.506516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.506662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.506807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.506951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.507320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.507463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.507635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.507780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.507915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.508057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.508199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.508341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.508488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.508630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.508772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.508918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.509053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.509193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.509336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.509477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.509618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.509752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.509885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.510024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.510173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.510310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.510451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.510592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.510726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.510877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.511013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.511146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.511279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.511411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.511581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.511728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.511863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.512008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.512149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.512303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.512445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.512588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.512723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.512855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.512998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.513130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.513372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.513529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.513672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.513820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.513954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.514086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.514227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.514371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.514513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.514678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.514892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.515137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.515362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.515530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.515682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.515826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.515961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.516101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.516245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.516380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.516514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.516655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.516790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.516931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.517075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.517210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.517388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.517527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.517725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.517863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.518037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.518185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.518352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.518504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.518667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.518813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.518981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.519119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.519289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.519436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.519694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.519842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.519986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.520120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.520253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.520395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.520534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.520682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.520826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.520961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.521093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.521271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.521416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.521560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.521695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.521829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.521961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.522103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.522281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.522420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.522592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.522739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.522903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.523042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.523230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.523375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.523556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.523711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.523880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.524018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.524195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.524344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.524494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.524636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.524814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.524951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.525101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.525244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.525411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.525549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.525714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.525862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.525997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.526131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.526303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.526440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.526611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.526760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.526904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.527039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.527203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.527340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.527549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.527711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.527848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.527983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.528117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.528250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.528430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.528576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.528754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.528891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.529033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.529175 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.529318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.529467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.529609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.529752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.530585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.530793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.530942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.531120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.531259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.531445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.531620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.531787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.531940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.532084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.532226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.533003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.533168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.533309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.533457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.533457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.533733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.533877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.534011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.534154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.534322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.534466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.534609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.534743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.534876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.535018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.535152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.535287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.535420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.535586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.535735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.535885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.536028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.536162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.536297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.536430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.536571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.536715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.536861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.536996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.537128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.537261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.537398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.537545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.537681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.537822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.537964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.538099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.538247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.538390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.538532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.538666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.538799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.538932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.539075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.539211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.539353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.539488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.539662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.539805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.539949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.540092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.540235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.540383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.540545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.540683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.540861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.541008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.541177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.541324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.541493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.541644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.541809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.541947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.542131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.542270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.542448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.542597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.542770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.542916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.543086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.543224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.543399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.543578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.543718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.543864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.544042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.544189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.544353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.544581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.544720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.544861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.545003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.545138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.545283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.545426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.545571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.546319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.546455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.546711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.546860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.547150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.547288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.547473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.547723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.547870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.548019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.548164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.548299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.548440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.548582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.548716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.548860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.549002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.549142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.549304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.549442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.549623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.549773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.549933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.550077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.550239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.550375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.550559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.550696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.550864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.551003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.551166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.551313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.551466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.551668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.551806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.551940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.552082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.552226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.552370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.552504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.552671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.552817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.553013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.553160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.553307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.553441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.553611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.553749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.553926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.554079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.554246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.554391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.554553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.554704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.555294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.555448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.555665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.555803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.555803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.556095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.556232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.556376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.556519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.556662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.556796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.556928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.557070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.557217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.557365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.557500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.557640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.557782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.557931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.558066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.558208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.558344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.558484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.558626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.558773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.558908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.559042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.559184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.559317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.559451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.559612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.559749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.559882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.560023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.560023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.560307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.560460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.560649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.560794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.560959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.561103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.561296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.561436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.561816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.561963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.562245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.562390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.562584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.562723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.562914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.563165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.563302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.563534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.563695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.563832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.563965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.564164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.564317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.564453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.564594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.564766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.564904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.565073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.565211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.565379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.565525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.565669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.565818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.565966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.566114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.566269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.566422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.566565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.566701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.566863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.567004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.567166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.567355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.567500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.567666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.567800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.567947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.568083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.568230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.568388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.568534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.568709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.568858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.569000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.569143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.569308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.569446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.569610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.569763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.569909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.570043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.570216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.570353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.570529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.570676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.570825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.570969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.571146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.571292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.571459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.571639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.571797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.571941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.572084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.572234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.572371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.572519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.572705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.572842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.573009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.573151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.573311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.573463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.573621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.573758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.574005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.574160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.574295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.574503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.574640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.574781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.574916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.575058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.575201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.575345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.575480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.575644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.575792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.575935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.576080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.576223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.576358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.576490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.576623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.576756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.576995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.577141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.577411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.577654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.577898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.578035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.578183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.578328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.578471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.578607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.578747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.578932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.579102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.579253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.579438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.579626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.579921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.580236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.580562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.580728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.580880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.581037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.581195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.581353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.581504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.581661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.581819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.581976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.582133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.582376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.582528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.582676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.582824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.582971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.583127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.583285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.583441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.583651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.583803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.583951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.584127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.584278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.584438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.584595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.584753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.584902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.585064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.585213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.585403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.585559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.585716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.585866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.586024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.586181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.586338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.586497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.586655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.586803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.586960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.587118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.587268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.587427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.587596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.587766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.587916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.588064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.588212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.588370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.588519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.588677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.588827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.588975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.589124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.589271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.589419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.589581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.589731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.589888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.590044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.590202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.590360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.590522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.590672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.590821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.590970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.591118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.591587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.591746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.591904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.592061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.592061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.592341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.593270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.593446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.593446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.593748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.593898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.594055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.594219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.594219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.594519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.594675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.594835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.594992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.595151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.595300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.595477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.595663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.595814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.595977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.596127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.596274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.596429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.596578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.596725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.596887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.597045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.597195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.597343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.597513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.597662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.597819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.597969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.598117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.598274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.598423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.598579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.598741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.598890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.599037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.599193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.599353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.599502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.600287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.600460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.600611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.600759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.600917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.601082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.601242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.601401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.601557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.601716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.601865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.602033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.602183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.602331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.602479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.602626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.602781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.602939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.603095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.603254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.603413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.603593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.603748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.603911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.604078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.604228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.604389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.604539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.604710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.604865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.605023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.605173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.605321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.605476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.605635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.605785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.605934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.606102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.606102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.606394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.606552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.606701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.606849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.607012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.607161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.607316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.607475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.607651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.607651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.607943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.608890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.609067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.609298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.609458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.609616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.609767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.609767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.610071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.610221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.610370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.610517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.610665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.610825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.610988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.611146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.611304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.611304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.611646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.611797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.611958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.612116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.612274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.612431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.612580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.612745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.612907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.613064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.613212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.613360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.613515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.613739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.613891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.614051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.614200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.614200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.615045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.615207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.615358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.615545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.615712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.615879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.616029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.616187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.616345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.616494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.616643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.616798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.616961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.617111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.617257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.617423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.617581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.617730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.617897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.618047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.618195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.618343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.618490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.618648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.618806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.618956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.619111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.619261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.619432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.619647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.619807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.619807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.620089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.620249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.620409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.620558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.620713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.620861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.621016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.621164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.621322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.621322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.621623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.621771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.621927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.622090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.622239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.622396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.622551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.622708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.622865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.622865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.623170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.623338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.623495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.623691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.623856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.624022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.624181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.624331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.624479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.624642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.624794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.624951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.625101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.625249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.625424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.625583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.625746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.625904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.625904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.626201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.626359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.626516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.626674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.626824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.626978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.627127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.627283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.627450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.627655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.627814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.627964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.628120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.628277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.628434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.628597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.628747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.628904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.629054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.629211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.629375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.629534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.629691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.629848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.629998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.630153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.630311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.630460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.630624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.630781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.630929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.631076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.631233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.631392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.631561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.631719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.631879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.632028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.632195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.632360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.632511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.632667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.632824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.632988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.633145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.633305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.633473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.633623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.633771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.633934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.634098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.634248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.634396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.634558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.634721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.634884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.635035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.635183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.635331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.635489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.635661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.635898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.636051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.636206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.636363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.636513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.636670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.636820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.636978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.637134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.637291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.637458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.637623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.637781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.637930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.638079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.638235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.638384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.638546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.638704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.638862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.639011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.639159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.639335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.639654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.639858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.640009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.640160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.640309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.640472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.640623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.640781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.640931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.641078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.641226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.641386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.643586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.643772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.643931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.644089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.644244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.644414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.644579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.644743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.644900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.645055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.645217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.645384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.645549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.645712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.645879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.646043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.646208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.646373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.646537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.646696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.646852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.647015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.647179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.647335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.647491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.647491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.647848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.648016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.648189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.648354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.648519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.648676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.648839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.648994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.649163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.649320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.649482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.649482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.649777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.649962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.650120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.650283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.650448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.650606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.650761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.650925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.651082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.651236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.651391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.651391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.651724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.651906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.652072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.652238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.652404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.652568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.652738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.652896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.653059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.653216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.653371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.653534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.653700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.653857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.654034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.654195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.654350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.654519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.654675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.654831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.654831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.655722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.655882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.656056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.656213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.656383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.656550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.656705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.656872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.657036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.657200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.657200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.657492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.657648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.657811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.657976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.658131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.658296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.658458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.658613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.658778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.658943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.659114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.659270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.659433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.659623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.659623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.659949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.660107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.660273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.660427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.660591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.660747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.660747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.661049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.661206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.661367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.661534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.661534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.661838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.662001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.662166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.662340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.662505 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.662662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.662817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.662971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.663125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.663294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.663450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.663642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.663809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.663967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.664131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.664298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.664464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.664626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.664790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.664959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.665116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.665287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.665443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.665598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.665759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.665923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.666079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.666247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.666417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.666591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.666756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.666913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.667083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.667239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.667394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.667577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.667750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.667909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.668150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.668317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.668482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.668657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.668813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.668968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.669133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.669290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.669446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.669600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.669754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.669917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.670082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.670239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.670400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.670580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.671269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.671536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.671711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.671879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.672046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.672331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.672623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.672874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.673042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.673206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.673371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.673527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.673692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.673872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.674030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.674184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.674338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.674502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.674667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.674833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.674989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.675143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.675305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.675476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.675694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.675694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.676015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.676178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.676343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.676501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.676665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.676841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.676999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.677154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.677318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.677482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.677651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.677808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.677987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.678152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.678317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.678482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.678652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.678808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.678972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.679128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.679282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.679447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.679628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.679785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.679941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.680106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.680272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.680438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.680604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.680770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.680935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.681098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.681254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.681423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.681588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.681752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.681917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.682081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.682252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.682416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.682580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.682744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.682908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.683065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.683249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.683406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.683620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.683620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.683922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.684315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.684499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.684665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.684829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.684986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.685149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.685306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.685509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.685678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.685834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.685998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.686154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.686425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.686615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.686828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.687258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.687422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.687611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.687782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.687952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.688117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.688275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.688430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.688585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.688749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.688905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.689069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.689243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.689401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.689558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.689723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.689880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.690043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.690207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.690363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.692857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.693057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.693271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.694513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.695794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.695976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.696156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.696315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.696479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.696644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.696813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.696978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.697145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.699456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.699664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.699835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.700013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.700185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.700185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.700496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.700651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.700651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.700954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.701120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.726245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.726604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.726793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.727885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.728124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.728466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.731078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.731784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.732250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.732652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.732971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.732971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.733279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.733279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.733559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.733705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.733845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.733999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.734137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.734273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.734409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.734556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.734693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.734829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.734965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.735100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.735324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.735465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.735653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.735842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.736025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.736916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.737876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.738364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.738966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.739555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.739988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.740388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.741150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.741335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.741477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.741616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.741788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.741929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.742066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.742203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.742339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.742476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.742621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.742760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.742898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.743034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.743171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.743307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.743452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.743734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.743876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.744013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.744150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.744368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.744509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.744646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.744782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.744919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.745057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.745202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.745341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.745490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.745628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.745764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.745901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.746048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.746361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.746511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.746648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.746786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.746923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.747071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.747211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.747349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.747536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.747943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.749415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.749785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.750219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.750219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.751833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.752087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.752229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.752369 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.752726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.752880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.753021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.753176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.753317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.753454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.753602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.753741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.753879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.754017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.754153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.754290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.754437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.754576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.754713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.754713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.754984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.755129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.755268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.755405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.755756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.756169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.756326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.756326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.756326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.756326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.756851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.757032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.757188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.757327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.757472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.757614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.757752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.758210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.758361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.759380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.759740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.760056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.760203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.760344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.760485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.760910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.761619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.761990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.762139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.762278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.762418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.762567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.762709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.762849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.762988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.763125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.763263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.763426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.763596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.763739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.763739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.764003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.764154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.764830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.764981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.765120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.765258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.765396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.765543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.765543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.765543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.765945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.765945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.766207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.766353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.766493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.766631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.766768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.766906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.767055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.767195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.767332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.767483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.767678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.767827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.767977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.768384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.768532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.768671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.768808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.768945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.769094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.769236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.769373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.769525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.769685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.769936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.770090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.770232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.770371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.770520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.770659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 04:09:25.771127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.771127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.771127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:09:25.771127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 04:09:25.885913 n-d-764485-11 devstack@n-api.service[119808]: INFO dbcounter [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] Registered counter for database nova_api Jul 20 04:09:25.892014 n-d-764485-11 devstack@n-api.service[119807]: INFO dbcounter [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] Registered counter for database nova_api Jul 20 04:09:25.908065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_db.sqlalchemy.engines [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:09:25.913161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_db.sqlalchemy.engines [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119807) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:09:25.914924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writer thread running {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:09:25.920090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writer thread running {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:09:25.974303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.context [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) {{(pid=119808) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 04:09:25.978351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.979060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.context [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) {{(pid=119807) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 04:09:25.979973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.980792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.982776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.983162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.984910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.985931 n-d-764485-11 devstack@n-api.service[119808]: INFO dbcounter [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] Registered counter for database nova_cell0 Jul 20 04:09:25.986031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.987880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.989390 n-d-764485-11 devstack@n-api.service[119808]: INFO dbcounter [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] Registered counter for database nova_cell1 Jul 20 04:09:25.989886 n-d-764485-11 devstack@n-api.service[119807]: INFO dbcounter [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] Registered counter for database nova_cell0 Jul 20 04:09:25.995561 n-d-764485-11 devstack@n-api.service[119807]: INFO dbcounter [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] Registered counter for database nova_cell1 Jul 20 04:09:26.001533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_db.sqlalchemy.engines [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119807) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:09:26.002895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_db.sqlalchemy.engines [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119807) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:09:26.003058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_db.sqlalchemy.engines [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:09:26.006099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_db.sqlalchemy.engines [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:09:26.010425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writer thread running {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:09:26.010852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writer thread running {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:09:26.011186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writer thread running {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:09:26.158085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writer thread running {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:09:26.163094 n-d-764485-11 devstack@n-api.service[119807]: INFO dbcounter [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] Registered counter for database nova_cell0 Jul 20 04:09:26.167663 n-d-764485-11 devstack@n-api.service[119808]: INFO dbcounter [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] Registered counter for database nova_cell0 Jul 20 04:09:26.169878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_db.sqlalchemy.engines [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119807) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:09:26.176705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_db.sqlalchemy.engines [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:09:26.179874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writer thread running {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:09:26.181837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writer thread running {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:09:26.509775 n-d-764485-11 devstack@n-api.service[119807]: WARNING keystonemiddleware.auth_token [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:09:26.510811 n-d-764485-11 devstack@n-api.service[119808]: WARNING keystonemiddleware.auth_token [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:09:26.517168 n-d-764485-11 devstack@n-api.service[119807]: WARNING keystonemiddleware.auth_token [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:09:26.518476 n-d-764485-11 devstack@n-api.service[119808]: WARNING keystonemiddleware.auth_token [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:09:26.870273 n-d-764485-11 devstack@n-api.service[119808]: WARNING keystonemiddleware.auth_token [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:09:26.875631 n-d-764485-11 devstack@n-api.service[119807]: WARNING keystonemiddleware.auth_token [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:09:26.876846 n-d-764485-11 devstack@n-api.service[119808]: WARNING keystonemiddleware.auth_token [None req-5f0da4c0-d8ef-4acb-a400-70fbf46b4adb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:09:26.882019 n-d-764485-11 devstack@n-api.service[119807]: WARNING keystonemiddleware.auth_token [None req-a32e4441-5d5c-461c-8cf7-cf3486fff35f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:09:26.883181 n-d-764485-11 devstack@n-api.service[119808]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5642898279c0 pid: 119808 (default app) Jul 20 04:09:26.888706 n-d-764485-11 devstack@n-api.service[119807]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5642898279c0 pid: 119807 (default app) Jul 20 04:10:13.296242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:13.301264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:13.302481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:13.303773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:13.311764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:13.312871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:13.313609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:13.314358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:14.446430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2196373-10b2-4b77-a4ac-643f24250394 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Calling method '.version_select at 0x7fbfa0006ca0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:14.454541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c15c3bdd-c1ec-47d6-a3f4-bd92a60056fc tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:14.461239 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:14.461239 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:14.467737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c15c3bdd-c1ec-47d6-a3f4-bd92a60056fc tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:14.469146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c15c3bdd-c1ec-47d6-a3f4-bd92a60056fc tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:14.470312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c15c3bdd-c1ec-47d6-a3f4-bd92a60056fc tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:14.470749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c15c3bdd-c1ec-47d6-a3f4-bd92a60056fc tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:14.544299 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c15c3bdd-c1ec-47d6-a3f4-bd92a60056fc tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 1.262974 Jul 20 04:10:14.547028 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1/1] 10.222.0.20 () {58 vars in 1175 bytes} [Wed Jul 20 04:10:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:14.893482 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2196373-10b2-4b77-a4ac-643f24250394 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68" status: 200 len: 371 microversion: 2.1 time: 1.600313 Jul 20 04:10:14.904255 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1241 bytes} [Wed Jul 20 04:10:13 2022] GET /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68 => generated 371 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:14.990626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6ab36659-24f2-450d-bc07-98ad961c315a tempest-FlavorsV255TestJSON-1780822592 tempest-FlavorsV255TestJSON-1780822592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1617846069", "id": 303705227, "os-flavor-access:is_public": "True"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:15.028727 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:15.028727 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:15.082231 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6ab36659-24f2-450d-bc07-98ad961c315a tempest-FlavorsV255TestJSON-1780822592 tempest-FlavorsV255TestJSON-1780822592-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.533035 Jul 20 04:10:15.083667 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2/3] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:10:14 2022] POST /compute/v2.1/flavors => generated 446 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:15.133539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4d63217c-fbb7-409b-9d96-0da9ee35c0ff tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Calling method '.version_select at 0x7fbf9ff8f820>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:15.135562 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:15.135562 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:15.148051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4d63217c-fbb7-409b-9d96-0da9ee35c0ff tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) {{(pid=119807) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 20 04:10:15.152410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d63217c-fbb7-409b-9d96-0da9ee35c0ff tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.161421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d63217c-fbb7-409b-9d96-0da9ee35c0ff tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.217536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d63217c-fbb7-409b-9d96-0da9ee35c0ff tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.218323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d63217c-fbb7-409b-9d96-0da9ee35c0ff tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.241241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d63217c-fbb7-409b-9d96-0da9ee35c0ff tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.242237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d63217c-fbb7-409b-9d96-0da9ee35c0ff tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.250665 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4d63217c-fbb7-409b-9d96-0da9ee35c0ff tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.345013 Jul 20 04:10:15.257460 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2/4] 10.222.0.20 () {60 vars in 1207 bytes} [Wed Jul 20 04:10:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:15.373827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-47aa635d-962f-46d5-ae56-e8010b748e43 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '.version_select at 0x7fbf9ffce550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:15.374781 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:15.374781 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:15.388066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-47aa635d-962f-46d5-ae56-e8010b748e43 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) {{(pid=119808) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 20 04:10:15.389156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47aa635d-962f-46d5-ae56-e8010b748e43 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.393257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47aa635d-962f-46d5-ae56-e8010b748e43 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.459295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47aa635d-962f-46d5-ae56-e8010b748e43 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.459964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47aa635d-962f-46d5-ae56-e8010b748e43 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.476772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47aa635d-962f-46d5-ae56-e8010b748e43 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.477738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47aa635d-962f-46d5-ae56-e8010b748e43 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.487063 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-47aa635d-962f-46d5-ae56-e8010b748e43 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.402281 Jul 20 04:10:15.488043 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1166 bytes} [Wed Jul 20 04:10:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:15.494389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f59a2d68-e579-493a-8c67-f03284a09c2d tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-755970198"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:15.496155 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:15.496155 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:15.497913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.aggregate [None req-f59a2d68-e579-493a-8c67-f03284a09c2d tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Generated uuid c700d9df-0a2b-4a96-bc30-677e87f074a6 for aggregate {{(pid=119808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:10:15.593814 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f59a2d68-e579-493a-8c67-f03284a09c2d tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.104180 Jul 20 04:10:15.595207 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 4/6] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:10:15 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:15.602712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02ab54c6-eb5e-469b-8b9c-819becfbb172 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9f6185e0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:15.656162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1882166706", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:15.894609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02ab54c6-eb5e-469b-8b9c-819becfbb172 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.895156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02ab54c6-eb5e-469b-8b9c-819becfbb172 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.896069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02ab54c6-eb5e-469b-8b9c-819becfbb172 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.896575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02ab54c6-eb5e-469b-8b9c-819becfbb172 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.973697 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-02ab54c6-eb5e-469b-8b9c-819becfbb172 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68" status: 200 len: 328 microversion: 2.1 time: 0.375570 Jul 20 04:10:15.974809 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 5/7] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:15 2022] PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68 => generated 328 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:16.107284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:16.112642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-25afcec4-eba4-4e96-9341-0aa9657fefb7 tempest-FlavorsV255TestJSON-827092065 tempest-FlavorsV255TestJSON-827092065-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:16.135677 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-25afcec4-eba4-4e96-9341-0aa9657fefb7 tempest-FlavorsV255TestJSON-827092065 tempest-FlavorsV255TestJSON-827092065-project] 10.222.0.20 "GET /compute/v2.1/flavors/303705227" status: 200 len: 446 microversion: 2.55 time: 0.159497 Jul 20 04:10:16.136834 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 6/8] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Jul 20 04:10:15 2022] GET /compute/v2.1/flavors/303705227 => generated 446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:16.142581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-144339b8-f895-4b22-b353-005cf679f633 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:16.144386 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:16.144386 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:16.154595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-144339b8-f895-4b22-b353-005cf679f633 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:16.155443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-144339b8-f895-4b22-b353-005cf679f633 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.478462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:16.479147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:16.479810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:16.480423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:16.480973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:16.538802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:16.542058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.545052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:16.546033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.610746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Getting quotas for project 5ec3ed035cec44ee9c3a79a57782507f. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:16.616116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Getting quotas for user dc805052a58e462b8560b1754e36e5bd and project 5ec3ed035cec44ee9c3a79a57782507f. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:16.630899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:10:16.633995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:10:16.753986 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-944ee9c8-ff6e-4dc4-b445-9bf483a563af tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.486388 Jul 20 04:10:16.758205 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3/9] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:10:16.789381 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-144339b8-f895-4b22-b353-005cf679f633 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.650862 Jul 20 04:10:16.797164 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 7/10] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:10:16 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:16.803675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b026ff0-b177-42b0-8940-641af3ebd01e tempest-FlavorsV255TestJSON-1780822592 tempest-FlavorsV255TestJSON-1780822592-project-admin] Action: 'update', calling method: .version_select at 0x7fbfa03d0310>, body: {"flavor": {"description": "new"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:16.817215 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:16.817215 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:16.848672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-346270e1-1566-4f9f-a138-d9ec20d9298b tempest-AZAdminV2TestJSON-1264616380 tempest-AZAdminV2TestJSON-1264616380-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:16.850817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-346270e1-1566-4f9f-a138-d9ec20d9298b tempest-AZAdminV2TestJSON-1264616380 tempest-AZAdminV2TestJSON-1264616380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:16.852125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-346270e1-1566-4f9f-a138-d9ec20d9298b tempest-AZAdminV2TestJSON-1264616380 tempest-AZAdminV2TestJSON-1264616380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.853021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-346270e1-1566-4f9f-a138-d9ec20d9298b tempest-AZAdminV2TestJSON-1264616380 tempest-AZAdminV2TestJSON-1264616380-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:16.853563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-346270e1-1566-4f9f-a138-d9ec20d9298b tempest-AZAdminV2TestJSON-1264616380 tempest-AZAdminV2TestJSON-1264616380-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.863993 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b026ff0-b177-42b0-8940-641af3ebd01e tempest-FlavorsV255TestJSON-1780822592 tempest-FlavorsV255TestJSON-1780822592-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/303705227" status: 200 len: 447 microversion: 2.55 time: 0.064462 Jul 20 04:10:16.864659 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 8/11] 10.222.0.20 () {62 vars in 1215 bytes} [Wed Jul 20 04:10:16 2022] PUT /compute/v2.1/flavors/303705227 => generated 447 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:16.935382 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-346270e1-1566-4f9f-a138-d9ec20d9298b tempest-AZAdminV2TestJSON-1264616380 tempest-AZAdminV2TestJSON-1264616380-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.173510 Jul 20 04:10:16.945361 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 4/12] 10.222.0.20 () {58 vars in 1163 bytes} [Wed Jul 20 04:10:16 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:16.951653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7009032-ca4f-48ed-a1b7-9a0f65a49d61 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:16.952703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c7009032-ca4f-48ed-a1b7-9a0f65a49d61 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:16.963915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-125383726", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:17.056892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c7009032-ca4f-48ed-a1b7-9a0f65a49d61 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:17.097972 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c7009032-ca4f-48ed-a1b7-9a0f65a49d61 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1220 microversion: 2.1 time: 0.151184 Jul 20 04:10:17.099579 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 5/13] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:16 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1220 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:17.108561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-285e3c5f-b30b-4d28-86c9-242629ca714b tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-764485-11"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:17.110598 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:17.110598 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:17.159813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-285e3c5f-b30b-4d28-86c9-242629ca714b tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.160722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-285e3c5f-b30b-4d28-86c9-242629ca714b tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.237278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:17.244373 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-285e3c5f-b30b-4d28-86c9-242629ca714b tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-764485-11. Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-285e3c5f-b30b-4d28-86c9-242629ca714b tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Request method failure captured: Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 40 Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AlkGCXnfxc4AXX1u7MrmYgpSFGYyhagntX5BdrefHGYNBjEykF6vWpG19XtHrjHT3sGkE2TxD4Z5tQqX6ZNnnNLxQYpEHXqwHRcHV14GhlifRgOY3E-_IrGpEur1-RZvyWn6WfJABtBr0wvMCXWrmCRg6OaKCo6I0q7BdqnV_00PU Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:10:17.264280 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5bcc08aebde45b69064b587428b1a1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}] Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 419ac8874da648cc8c6a40d03cf4fd94 Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: {"add_host": {"host": "n-h1-764485-11"}} Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:10:17.265754 n-d-764485-11 devstack@n-api.service[119807]: exception: Aggregate 1 already has host n-h1-764485-11. Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-764485-11'}}} Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:10:17.266537 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-764485-11-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 04:10:17.267465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 04:10:17.268561 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:10:17.269418 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-764485-11-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 4, 10, 17, 223116), 'updated_at': None, 'host': 'n-h1-764485-11', 'aggregate_id': 1}] Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:17.270278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-764485-11. Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.271086 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-764485-11. Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:17.272098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:17.273299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-764485-11. Jul 20 04:10:17.273299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.273299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-285e3c5f-b30b-4d28-86c9-242629ca714b tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-764485-11. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:17.273299 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-285e3c5f-b30b-4d28-86c9-242629ca714b tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.165136 Jul 20 04:10:17.273299 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 6/14] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:10:17 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 166 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 20 04:10:17.273299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3ea1c746-11e7-4106-966c-b7c44d684223 tempest-FlavorsV255TestJSON-827092065 tempest-FlavorsV255TestJSON-827092065-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:17.303405 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3ea1c746-11e7-4106-966c-b7c44d684223 tempest-FlavorsV255TestJSON-827092065 tempest-FlavorsV255TestJSON-827092065-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.035735 Jul 20 04:10:17.304112 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 7/15] 10.222.0.20 () {60 vars in 1186 bytes} [Wed Jul 20 04:10:17 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:17.313379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-195b4e91-b10b-41a1-9c88-bc58ebc5edcf tempest-AZAdminV2TestJSON-1264616380 tempest-AZAdminV2TestJSON-1264616380-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:17.314214 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:17.314214 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:17.315616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-195b4e91-b10b-41a1-9c88-bc58ebc5edcf tempest-AZAdminV2TestJSON-1264616380 tempest-AZAdminV2TestJSON-1264616380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.316075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-195b4e91-b10b-41a1-9c88-bc58ebc5edcf tempest-AZAdminV2TestJSON-1264616380 tempest-AZAdminV2TestJSON-1264616380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.319660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-195b4e91-b10b-41a1-9c88-bc58ebc5edcf tempest-AZAdminV2TestJSON-1264616380 tempest-AZAdminV2TestJSON-1264616380-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.320122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-195b4e91-b10b-41a1-9c88-bc58ebc5edcf tempest-AZAdminV2TestJSON-1264616380 tempest-AZAdminV2TestJSON-1264616380-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.360571 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-195b4e91-b10b-41a1-9c88-bc58ebc5edcf tempest-AZAdminV2TestJSON-1264616380 tempest-AZAdminV2TestJSON-1264616380-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.051804 Jul 20 04:10:17.369448 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1184 bytes} [Wed Jul 20 04:10:17 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:17.379952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0dde0bf-7cc8-4384-aa27-14094f4ebfd5 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-764485-11"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:17.381463 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:17.381463 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:17.412205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0dde0bf-7cc8-4384-aa27-14094f4ebfd5 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.413343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0dde0bf-7cc8-4384-aa27-14094f4ebfd5 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.673594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:17.674199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:17.674861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:17.675421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:17.676014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:17.691711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.692302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.693108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.693710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.714899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Getting quotas for project ecbaffa64c734b698ef7b07eeda83a68. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:17.720655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Getting quotas for user 79c8da84ee4d4a019ad77e195f00a5de and project ecbaffa64c734b698ef7b07eeda83a68. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:17.734944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.utils [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] cores quota exceeded for ecbaffa64c734b698ef7b07eeda83a68, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119808) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 04:10:17.743204 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Request method failure captured: Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 144 Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AiXZHUFRmKap16yIAtbGP_Gv5g4vn2lsf8whLTuCBiKjDm4mj-7EawZ4wDwRqBraNn5kiwo338B2e1LEfQNgQyJw9sETFGl5LXzw11fP2oBrrpd_I5u3xbxjex8LoI_3NzGAvsTIrYjLmcyguqUm9IjA2ZsE-jUiX74Tpz9VuQT5g Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ecbaffa64c734b698ef7b07eeda83a68 Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-QuotasAdminNegativeTest-958476175 Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:17.763836 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:17.764936 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ecbaffa64c734b698ef7b07eeda83a68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ecbaffa64c734b698ef7b07eeda83a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ecbaffa64c734b698ef7b07eeda83a68", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ecbaffa64c734b698ef7b07eeda83a68"}]}] Jul 20 04:10:17.764936 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-QuotasAdminNegativeTest-958476175 Jul 20 04:10:17.764936 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ecbaffa64c734b698ef7b07eeda83a68 Jul 20 04:10:17.764936 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-958476175 Jul 20 04:10:17.764936 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-QuotasAdminNegativeTest-958476175-project Jul 20 04:10:17.764936 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:17.764936 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:17.764936 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 79c8da84ee4d4a019ad77e195f00a5de Jul 20 04:10:17.764936 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-QuotasAdminNegativeTest-958476175-project Jul 20 04:10:17.764936 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:10:17.764936 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-125383726", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} Jul 20 04:10:17.764936 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-125383726', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452'}}} Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:10:17.765557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:17.766438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.767458 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:17.771059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:17.771059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:17.771059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:17.771059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:17.771059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:10:17.771059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:17.771059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:17.771059 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-82b2bc69-06f2-44e4-b5de-7e874a8dec68 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.899940 Jul 20 04:10:17.771059 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 9/17] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:16 2022] POST /compute/v2.1/servers => generated 111 bytes in 901 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:17.781003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2a3cf5c4-4a27-4eea-9b42-2262ca423386 tempest-FlavorsV255TestJSON-827092065 tempest-FlavorsV255TestJSON-827092065-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:17.826846 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2a3cf5c4-4a27-4eea-9b42-2262ca423386 tempest-FlavorsV255TestJSON-827092065 tempest-FlavorsV255TestJSON-827092065-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.058661 Jul 20 04:10:17.828305 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 10/18] 10.222.0.20 () {60 vars in 1165 bytes} [Wed Jul 20 04:10:17 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:17.833401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ad1bfe5-9563-4cf1-a2fe-6bf1c9457409 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9e3ee8b0>, body: {"quota_set": {"cores": 20}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:17.939478 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0dde0bf-7cc8-4384-aa27-14094f4ebfd5 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.568640 Jul 20 04:10:17.941150 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 9/19] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:10:17 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:17.954707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-04ff83f6-be9e-4ea0-bc3f-e01a82d83335 tempest-FlavorsV255TestJSON-1780822592 tempest-FlavorsV255TestJSON-1780822592-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:17.955873 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:17.955873 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:18.012505 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-04ff83f6-be9e-4ea0-bc3f-e01a82d83335 tempest-FlavorsV255TestJSON-1780822592 tempest-FlavorsV255TestJSON-1780822592-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/303705227" status: 202 len: 0 microversion: 2.55 time: 0.063793 Jul 20 04:10:18.020250 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1198 bytes} [Wed Jul 20 04:10:17 2022] DELETE /compute/v2.1/flavors/303705227 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:10:18.026650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-50b770ec-273d-45d3-bfea-2923dbbd954c tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:18.027396 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:18.027396 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:18.071532 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-50b770ec-273d-45d3-bfea-2923dbbd954c tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.049951 Jul 20 04:10:18.080486 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 11/21] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:10:18 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:10:18.088017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6182dec4-7f3a-4552-847a-9ef91fcb4b90 tempest-FlavorsV255TestJSON-1780822592 tempest-FlavorsV255TestJSON-1780822592-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:18.148226 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6182dec4-7f3a-4552-847a-9ef91fcb4b90 tempest-FlavorsV255TestJSON-1780822592 tempest-FlavorsV255TestJSON-1780822592-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.066535 Jul 20 04:10:18.148822 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 12/22] 10.222.0.20 () {60 vars in 1186 bytes} [Wed Jul 20 04:10:18 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:18.171674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8ae80454-5893-4459-99f0-d40106c55412 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1818858537"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:18.176001 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:18.176001 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:18.181700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.aggregate [None req-8ae80454-5893-4459-99f0-d40106c55412 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Generated uuid 06a65b3a-f025-4c5a-85ee-6f1978ddc820 for aggregate {{(pid=119807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:10:18.229229 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8ae80454-5893-4459-99f0-d40106c55412 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064634 Jul 20 04:10:18.230864 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 13/23] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:10:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:18.248131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e4317bb2-c632-4985-98df-acc3befd3d37 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:18.251790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e4317bb2-c632-4985-98df-acc3befd3d37 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:18.269459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4317bb2-c632-4985-98df-acc3befd3d37 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.270041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4317bb2-c632-4985-98df-acc3befd3d37 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.271662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4317bb2-c632-4985-98df-acc3befd3d37 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.273597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4317bb2-c632-4985-98df-acc3befd3d37 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.284269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ad1bfe5-9563-4cf1-a2fe-6bf1c9457409 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.300694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ad1bfe5-9563-4cf1-a2fe-6bf1c9457409 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.301885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ad1bfe5-9563-4cf1-a2fe-6bf1c9457409 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.305245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ad1bfe5-9563-4cf1-a2fe-6bf1c9457409 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.477714 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8ad1bfe5-9563-4cf1-a2fe-6bf1c9457409 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68" status: 200 len: 329 microversion: 2.1 time: 0.648165 Jul 20 04:10:18.482340 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 11/24] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:17 2022] PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68 => generated 329 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:18.499041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-90bda4fd-b60c-4597-85d7-cadf140973ad tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1767755694"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:18.507379 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:18.507379 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:18.513396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.aggregate [None req-90bda4fd-b60c-4597-85d7-cadf140973ad tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Generated uuid c5585d8c-1b41-4a81-8e66-0964d5c6aa33 for aggregate {{(pid=119808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:10:18.575964 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-90bda4fd-b60c-4597-85d7-cadf140973ad tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.084631 Jul 20 04:10:18.582836 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 12/25] 10.222.0.20 () {62 vars in 1204 bytes} [Wed Jul 20 04:10:18 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:18.598549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e4317bb2-c632-4985-98df-acc3befd3d37 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:18.620353 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e4317bb2-c632-4985-98df-acc3befd3d37 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1224 microversion: 2.1 time: 0.387394 Jul 20 04:10:18.628303 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 14/26] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:18 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1224 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:18.628303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9fcb477-98e5-44a1-9451-da71980b009c tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Calling method '.version_select at 0x7fbf9e1a0670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:18.952165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db27d3e9-a790-421d-b5ab-01b96af8f751 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:18.953578 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:18.953578 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:18.955058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-db27d3e9-a790-421d-b5ab-01b96af8f751 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '076950d75573493cb2c19df8ddb2a420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d81c61c20641b29fa821c6ab641d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db27d3e9-a790-421d-b5ab-01b96af8f751 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Request method failure captured: Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 40 Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AiViJC-ZSHrLQWnsBcxj_wMbB9UigDgj8O6ngXnVovZu2Lfn2lLvd5hWxt00zQjCVgc6N1IGYxJwHXTpRxsG_bGeTbYnv8ePFlX4zNIVe7kIQXI6_m_NWcVKf5GWqatQKKM2ay7F3dkAsANUxdhAPtpzKFPvF5veOOoxRzpBZrTkk Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: e1d81c61c20641b29fa821c6ab641d78 Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:18.959178 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1d81c61c20641b29fa821c6ab641d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1d81c61c20641b29fa821c6ab641d78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1d81c61c20641b29fa821c6ab641d78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1d81c61c20641b29fa821c6ab641d78"}]}] Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: e1d81c61c20641b29fa821c6ab641d78 Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AggregatesAdminNegativeTestJSON-374559130-project Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 076950d75573493cb2c19df8ddb2a420 Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-374559130-project Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: {"add_host": {"host": "n-h1-764485-11"}} Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:18.960501 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-764485-11'}}} Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:18.961735 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 04:10:18.963265 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:18.965313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db27d3e9-a790-421d-b5ab-01b96af8f751 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:18.967209 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-db27d3e9-a790-421d-b5ab-01b96af8f751 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.389400 Jul 20 04:10:18.967807 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 13/27] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:10:18 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 391 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:18.973077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b375c0ee-88ff-4a82-8fe1-26e505b4749f tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-417891687"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:19.064553 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:19.064553 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:19.106894 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b375c0ee-88ff-4a82-8fe1-26e505b4749f tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.136984 Jul 20 04:10:19.108232 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 14/28] 10.222.0.20 () {62 vars in 1209 bytes} [Wed Jul 20 04:10:18 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:19.114885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-351f09c9-9e6a-4ea0-9202-7cb6d2ae402d tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:19.115895 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:19.115895 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:19.140781 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-351f09c9-9e6a-4ea0-9202-7cb6d2ae402d tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.030423 Jul 20 04:10:19.141988 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 15/29] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:10:19 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:10:19.147651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9fe0dd6d-759c-419a-a33e-8cfd2ff12904 tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:19.148858 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:19.148858 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:19.159385 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9fe0dd6d-759c-419a-a33e-8cfd2ff12904 tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.015945 Jul 20 04:10:19.160174 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 16/30] 10.222.0.20 () {60 vars in 1189 bytes} [Wed Jul 20 04:10:19 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:19.165403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2713f29d-fbd7-46c8-86d5-b603100277f8 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1036782692"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:19.166978 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:19.166978 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:19.168136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.aggregate [None req-2713f29d-fbd7-46c8-86d5-b603100277f8 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Generated uuid 0a2e6525-9cf7-41e8-9815-aaa82bff40aa for aggregate {{(pid=119808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:10:19.175732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:19.204094 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2713f29d-fbd7-46c8-86d5-b603100277f8 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042709 Jul 20 04:10:19.205021 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 17/31] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:10:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:19.212461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d0301e11-cca2-4c36-addc-3d3358aafa73 tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:19.213797 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:19.213797 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:19.233540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0301e11-cca2-4c36-addc-3d3358aafa73 tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.234062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0301e11-cca2-4c36-addc-3d3358aafa73 tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.362658 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e9fcb477-98e5-44a1-9451-da71980b009c tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68" status: 200 len: 371 microversion: 2.1 time: 0.739583 Jul 20 04:10:19.378242 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 15/32] 10.222.0.20 () {58 vars in 1241 bytes} [Wed Jul 20 04:10:18 2022] GET /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68 => generated 371 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:19.385379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b7dd178a-6eda-4de3-8b35-ca4dd5554db6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-302215618"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:19.391803 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:19.391803 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:19.414961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b7dd178a-6eda-4de3-8b35-ca4dd5554db6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.415754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b7dd178a-6eda-4de3-8b35-ca4dd5554db6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.441446 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d0301e11-cca2-4c36-addc-3d3358aafa73 tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 0.235072 Jul 20 04:10:19.441899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b7dd178a-6eda-4de3-8b35-ca4dd5554db6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.442577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b7dd178a-6eda-4de3-8b35-ca4dd5554db6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.442687 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 18/33] 10.222.0.20 () {62 vars in 1231 bytes} [Wed Jul 20 04:10:19 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:19.449839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a5cde38c-735f-4484-98f8-82f1afe22cf1 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9e394ca0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:19.465785 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b7dd178a-6eda-4de3-8b35-ca4dd5554db6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-302215618 could not be found. Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b7dd178a-6eda-4de3-8b35-ca4dd5554db6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Request method failure captured: Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 57 Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AlkGCXnfxc4AXX1u7MrmYgpSFGYyhagntX5BdrefHGYNBjEykF6vWpG19XtHrjHT3sGkE2TxD4Z5tQqX6ZNnnNLxQYpEHXqwHRcHV14GhlifRgOY3E-_IrGpEur1-RZvyWn6WfJABtBr0wvMCXWrmCRg6OaKCo6I0q7BdqnV_00PU Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:10:19.471790 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5bcc08aebde45b69064b587428b1a1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}] Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 419ac8874da648cc8c6a40d03cf4fd94 Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: {"add_host": {"host": "tempest-nonexist_host-302215618"}} Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:10:19.473197 n-d-764485-11 devstack@n-api.service[119807]: exception: Compute host tempest-nonexist_host-302215618 could not be found. Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-302215618'}}} Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-302215618' is not mapped to any cell Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:19.473884 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 20 04:10:19.474802 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-302215618 could not be found. Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-302215618 could not be found. Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:19.476692 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:19.478769 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:19.478769 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:19.478769 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:19.478769 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:19.478769 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:19.478769 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-302215618 could not be found. Jul 20 04:10:19.478769 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:19.481655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b7dd178a-6eda-4de3-8b35-ca4dd5554db6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-302215618 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:19.485195 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b7dd178a-6eda-4de3-8b35-ca4dd5554db6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.105524 Jul 20 04:10:19.489268 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 16/34] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:10:19 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:19.498602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1023f1c3-223b-4446-8782-17340823c5a9 tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-764485-11"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:19.508132 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:19.508132 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:19.527065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1023f1c3-223b-4446-8782-17340823c5a9 tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.531067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1023f1c3-223b-4446-8782-17340823c5a9 tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.710180 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1023f1c3-223b-4446-8782-17340823c5a9 tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 0.217751 Jul 20 04:10:19.715623 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 17/35] 10.222.0.20 () {62 vars in 1231 bytes} [Wed Jul 20 04:10:19 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:19.722886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e3d39742-9b73-4c32-b821-c4c7f635bdfe tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:19.723896 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:19.723896 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:19.776037 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e3d39742-9b73-4c32-b821-c4c7f635bdfe tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.058133 Jul 20 04:10:19.776834 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 18/36] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:10:19 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:10:19.788130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ba07a112-7bbb-4d86-b044-1252c9435959 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:19.790388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ba07a112-7bbb-4d86-b044-1252c9435959 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:19.805796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba07a112-7bbb-4d86-b044-1252c9435959 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.806481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba07a112-7bbb-4d86-b044-1252c9435959 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.807460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba07a112-7bbb-4d86-b044-1252c9435959 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.808120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba07a112-7bbb-4d86-b044-1252c9435959 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.988236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ba07a112-7bbb-4d86-b044-1252c9435959 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:20.003649 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ba07a112-7bbb-4d86-b044-1252c9435959 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1278 microversion: 2.1 time: 0.225342 Jul 20 04:10:20.012389 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 19/37] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:19 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1278 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:20.015762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aa4118d4-5500-455b-b287-2c10f122bc58 tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.016553 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.016553 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:20.037334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=5,nova_api:DELETE=11 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:20.058076 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aa4118d4-5500-455b-b287-2c10f122bc58 tempest-AggregatesAdminTestV241-339714770 tempest-AggregatesAdminTestV241-339714770-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.052579 Jul 20 04:10:20.061516 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 20/38] 10.222.0.20 () {60 vars in 1192 bytes} [Wed Jul 20 04:10:20 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:20.070510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6be63356-c211-4d28-ba03-3727e46c5aa6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6be63356-c211-4d28-ba03-3727e46c5aa6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Request method failure captured: Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 283 Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AlkGCXnfxc4AXX1u7MrmYgpSFGYyhagntX5BdrefHGYNBjEykF6vWpG19XtHrjHT3sGkE2TxD4Z5tQqX6ZNnnNLxQYpEHXqwHRcHV14GhlifRgOY3E-_IrGpEur1-RZvyWn6WfJABtBr0wvMCXWrmCRg6OaKCo6I0q7BdqnV_00PU Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:10:20.092324 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:10:20.093535 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5bcc08aebde45b69064b587428b1a1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}] Jul 20 04:10:20.093535 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.093535 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:20.093535 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.093535 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:20.093535 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:20.093535 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:20.093535 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 419ac8874da648cc8c6a40d03cf4fd94 Jul 20 04:10:20.093535 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:20.093535 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:20.093535 n-d-764485-11 devstack@n-api.service[119807]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 04:10:20.094094 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:10:20.094094 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:10:20.094094 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 04:10:20.094094 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:20.094094 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.094094 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:10:20.094094 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:10:20.094094 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:10:20.094094 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:10:20.094094 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:10:20.094094 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:10:20.094716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:10:20.096309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:10:20.097185 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:10:20.097185 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.100607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6be63356-c211-4d28-ba03-3727e46c5aa6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:20.102413 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6be63356-c211-4d28-ba03-3727e46c5aa6 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.039969 Jul 20 04:10:20.110182 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 21/39] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Jul 20 04:10:20 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:10:20.119284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eab19194-2d13-41d1-81a6-183354e1bb72 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eab19194-2d13-41d1-81a6-183354e1bb72 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Request method failure captured: Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 27 Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AlkGCXnfxc4AXX1u7MrmYgpSFGYyhagntX5BdrefHGYNBjEykF6vWpG19XtHrjHT3sGkE2TxD4Z5tQqX6ZNnnNLxQYpEHXqwHRcHV14GhlifRgOY3E-_IrGpEur1-RZvyWn6WfJABtBr0wvMCXWrmCRg6OaKCo6I0q7BdqnV_00PU Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:10:20.123907 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5bcc08aebde45b69064b587428b1a1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}] Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 419ac8874da648cc8c6a40d03cf4fd94 Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: {"aggregate": {"name": ""}} Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:10:20.125035 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi '' Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:20.125948 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:10:20.127071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.132638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eab19194-2d13-41d1-81a6-183354e1bb72 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:20.133522 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eab19194-2d13-41d1-81a6-183354e1bb72 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.021790 Jul 20 04:10:20.134105 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 22/40] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:10:20 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:10:20.144727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0415b7d3-0e80-48b6-a4e3-aa48f0dcfec6 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-636644017"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:20.151316 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.151316 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:20.155240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0415b7d3-0e80-48b6-a4e3-aa48f0dcfec6 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '076950d75573493cb2c19df8ddb2a420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d81c61c20641b29fa821c6ab641d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0415b7d3-0e80-48b6-a4e3-aa48f0dcfec6 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Request method failure captured: Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 59 Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AiViJC-ZSHrLQWnsBcxj_wMbB9UigDgj8O6ngXnVovZu2Lfn2lLvd5hWxt00zQjCVgc6N1IGYxJwHXTpRxsG_bGeTbYnv8ePFlX4zNIVe7kIQXI6_m_NWcVKf5GWqatQKKM2ay7F3dkAsANUxdhAPtpzKFPvF5veOOoxRzpBZrTkk Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: e1d81c61c20641b29fa821c6ab641d78 Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:10:20.164168 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1d81c61c20641b29fa821c6ab641d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1d81c61c20641b29fa821c6ab641d78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1d81c61c20641b29fa821c6ab641d78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1d81c61c20641b29fa821c6ab641d78"}]}] Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: e1d81c61c20641b29fa821c6ab641d78 Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminNegativeTestJSON-374559130-project Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 076950d75573493cb2c19df8ddb2a420 Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-374559130-project Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: {"aggregate": {"name": "tempest-test_aggregate-636644017"}} Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:10:20.165519 n-d-764485-11 devstack@n-api.service[119807]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-636644017'}}} Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:20.166365 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:20.167616 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 04:10:20.169448 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.171305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0415b7d3-0e80-48b6-a4e3-aa48f0dcfec6 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:20.172390 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0415b7d3-0e80-48b6-a4e3-aa48f0dcfec6 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.032000 Jul 20 04:10:20.175576 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 23/41] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:10:20 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:20.193868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dd7d1a9f-c2d1-4fca-b3f9-ddea6f89c7e2 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-665951692", "name": "tempest-test_aggregate-1032311482"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:20.230016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.aggregate [None req-dd7d1a9f-c2d1-4fca-b3f9-ddea6f89c7e2 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Generated uuid 8661887b-6d5f-4169-b49f-a6b320e82911 for aggregate {{(pid=119807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:10:20.301645 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dd7d1a9f-c2d1-4fca-b3f9-ddea6f89c7e2 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.124575 Jul 20 04:10:20.302836 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 24/42] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Jul 20 04:10:20 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:20.312655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c34266f0-046e-4acb-b378-f9df33d95664 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1328382733"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:20.315350 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.315350 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:20.316452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.aggregate [None req-c34266f0-046e-4acb-b378-f9df33d95664 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Generated uuid 613200e2-f42b-4fe0-a9a0-085f8251b52f for aggregate {{(pid=119807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:10:20.334396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a5cde38c-735f-4484-98f8-82f1afe22cf1 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.340183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a5cde38c-735f-4484-98f8-82f1afe22cf1 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.342092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a5cde38c-735f-4484-98f8-82f1afe22cf1 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.354182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a5cde38c-735f-4484-98f8-82f1afe22cf1 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.387240 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c34266f0-046e-4acb-b378-f9df33d95664 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.083163 Jul 20 04:10:20.389040 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 25/43] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:10:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:20.393563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0282e55e-fdf7-4d53-9704-8cdf4a861563 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.401133 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.401133 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:20.433195 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0282e55e-fdf7-4d53-9704-8cdf4a861563 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.042915 Jul 20 04:10:20.435811 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 26/44] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:10:20 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:20.447126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ef06a4b-9847-4736-8c70-ad32d1665d60 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1328382733"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:20.450763 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.450763 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:20.456303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.aggregate [None req-1ef06a4b-9847-4736-8c70-ad32d1665d60 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Generated uuid 432addfa-09ea-4d81-af89-08b84fa4bd15 for aggregate {{(pid=119807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:10:20.483240 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-1ef06a4b-9847-4736-8c70-ad32d1665d60 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1328382733 already exists. Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ef06a4b-9847-4736-8c70-ad32d1665d60 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Request method failure captured: Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 60 Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AlkGCXnfxc4AXX1u7MrmYgpSFGYyhagntX5BdrefHGYNBjEykF6vWpG19XtHrjHT3sGkE2TxD4Z5tQqX6ZNnnNLxQYpEHXqwHRcHV14GhlifRgOY3E-_IrGpEur1-RZvyWn6WfJABtBr0wvMCXWrmCRg6OaKCo6I0q7BdqnV_00PU Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:10:20.491897 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5bcc08aebde45b69064b587428b1a1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}] Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 419ac8874da648cc8c6a40d03cf4fd94 Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: {"aggregate": {"name": "tempest-test_aggregate-1328382733"}} Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:10:20.493199 n-d-764485-11 devstack@n-api.service[119807]: exception: Aggregate tempest-test_aggregate-1328382733 already exists. Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1328382733'}}} Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 20 04:10:20.493852 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1328382733 already exists. Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:20.495028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1328382733 already exists. Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1328382733 already exists. Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ef06a4b-9847-4736-8c70-ad32d1665d60 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1328382733 already exists. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:20.496036 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ef06a4b-9847-4736-8c70-ad32d1665d60 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.055414 Jul 20 04:10:20.498537 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a5cde38c-735f-4484-98f8-82f1afe22cf1 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68" status: 200 len: 328 microversion: 2.1 time: 1.049336 Jul 20 04:10:20.498667 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 27/45] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:10:20 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:20.507806 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 19/46] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:19 2022] PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68 => generated 328 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:20.517608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ace9e83-d533-4d00-b86f-1c8f629f2bfd tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-764485-11"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:20.518981 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.518981 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:20.522468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d85c007-5b35-4141-bdbf-04fdbf0d3c7e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.523849 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.523849 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:20.546533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ace9e83-d533-4d00-b86f-1c8f629f2bfd tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.548427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ace9e83-d533-4d00-b86f-1c8f629f2bfd tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.582986 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d85c007-5b35-4141-bdbf-04fdbf0d3c7e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.073636 Jul 20 04:10:20.584254 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 20/47] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:10:20 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:10:20.598708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b211270b-62ad-4e0b-bb8b-01663503745e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-826638137"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:20.602780 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.602780 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:20.604158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.aggregate [None req-b211270b-62ad-4e0b-bb8b-01663503745e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Generated uuid 53150cd6-9664-4bb1-b717-741fb845dd90 for aggregate {{(pid=119808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:10:20.636315 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b211270b-62ad-4e0b-bb8b-01663503745e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.046789 Jul 20 04:10:20.638137 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 21/48] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:10:20 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:20.656708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2a56d7cf-592c-4b20-8c64-42f4336cca25 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.658279 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.658279 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:20.659422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2a56d7cf-592c-4b20-8c64-42f4336cca25 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '076950d75573493cb2c19df8ddb2a420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d81c61c20641b29fa821c6ab641d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2a56d7cf-592c-4b20-8c64-42f4336cca25 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Request method failure captured: Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AiViJC-ZSHrLQWnsBcxj_wMbB9UigDgj8O6ngXnVovZu2Lfn2lLvd5hWxt00zQjCVgc6N1IGYxJwHXTpRxsG_bGeTbYnv8ePFlX4zNIVe7kIQXI6_m_NWcVKf5GWqatQKKM2ay7F3dkAsANUxdhAPtpzKFPvF5veOOoxRzpBZrTkk Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: e1d81c61c20641b29fa821c6ab641d78 Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:20.661217 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:20.662300 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1d81c61c20641b29fa821c6ab641d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1d81c61c20641b29fa821c6ab641d78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1d81c61c20641b29fa821c6ab641d78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1d81c61c20641b29fa821c6ab641d78"}]}] Jul 20 04:10:20.662300 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:20.662300 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: e1d81c61c20641b29fa821c6ab641d78 Jul 20 04:10:20.662300 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:20.662300 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AggregatesAdminNegativeTestJSON-374559130-project Jul 20 04:10:20.662300 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:20.662300 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:20.662300 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 076950d75573493cb2c19df8ddb2a420 Jul 20 04:10:20.662300 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-374559130-project Jul 20 04:10:20.662300 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:20.662300 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 04:10:20.662300 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '7'} Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:20.662918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 04:10:20.663895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.666172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2a56d7cf-592c-4b20-8c64-42f4336cca25 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:20.667459 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2a56d7cf-592c-4b20-8c64-42f4336cca25 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.022262 Jul 20 04:10:20.672475 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 22/49] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:10:20 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:10:20.677905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a2e082f4-64e1-466c-97ad-f84e015494c1 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.704726 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a2e082f4-64e1-466c-97ad-f84e015494c1 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.030357 Jul 20 04:10:20.711206 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 23/50] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:10:20 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:10:20.719207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4d79c74e-8db9-42a2-a937-0046679719aa tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.720443 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.720443 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:20.762020 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-4d79c74e-8db9-42a2-a937-0046679719aa tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4d79c74e-8db9-42a2-a937-0046679719aa tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Request method failure captured: Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AlkGCXnfxc4AXX1u7MrmYgpSFGYyhagntX5BdrefHGYNBjEykF6vWpG19XtHrjHT3sGkE2TxD4Z5tQqX6ZNnnNLxQYpEHXqwHRcHV14GhlifRgOY3E-_IrGpEur1-RZvyWn6WfJABtBr0wvMCXWrmCRg6OaKCo6I0q7BdqnV_00PU Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:10:20.765490 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:10:20.766619 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5bcc08aebde45b69064b587428b1a1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}] Jul 20 04:10:20.766619 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.766619 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:20.766619 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.766619 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:20.766619 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:20.766619 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:20.766619 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 419ac8874da648cc8c6a40d03cf4fd94 Jul 20 04:10:20.766619 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:20.766619 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:20.766619 n-d-764485-11 devstack@n-api.service[119808]: exception: Aggregate -1 could not be found. Jul 20 04:10:20.766619 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '-1'} Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:10:20.767247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.768247 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.769329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.769329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.769329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:20.769329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:20.769329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 20 04:10:20.769329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.769329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4d79c74e-8db9-42a2-a937-0046679719aa tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:20.769329 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4d79c74e-8db9-42a2-a937-0046679719aa tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.053994 Jul 20 04:10:20.771583 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 24/51] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:10:20 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:20.782762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d382b55-6fcd-4d58-8790-6303c05c44b5 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1066394528"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:20.784124 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.784124 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:20.785302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.aggregate [None req-2d382b55-6fcd-4d58-8790-6303c05c44b5 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Generated uuid 4c854355-e168-431b-9ce9-46f60d818b64 for aggregate {{(pid=119808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:10:20.799635 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ace9e83-d533-4d00-b86f-1c8f629f2bfd tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 314 microversion: 2.1 time: 0.302266 Jul 20 04:10:20.815151 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 28/52] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:10:20 2022] POST /compute/v2.1/os-aggregates/5/action => generated 314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:20.834669 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d382b55-6fcd-4d58-8790-6303c05c44b5 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061582 Jul 20 04:10:20.841366 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 25/53] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:10:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:20.844176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-121126319", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:20.846947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-efe5927a-c138-4bed-9a22-2128a48cd9c6 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.851131 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.851131 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:20.860720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-efe5927a-c138-4bed-9a22-2128a48cd9c6 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '076950d75573493cb2c19df8ddb2a420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d81c61c20641b29fa821c6ab641d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-efe5927a-c138-4bed-9a22-2128a48cd9c6 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Request method failure captured: Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AiViJC-ZSHrLQWnsBcxj_wMbB9UigDgj8O6ngXnVovZu2Lfn2lLvd5hWxt00zQjCVgc6N1IGYxJwHXTpRxsG_bGeTbYnv8ePFlX4zNIVe7kIQXI6_m_NWcVKf5GWqatQKKM2ay7F3dkAsANUxdhAPtpzKFPvF5veOOoxRzpBZrTkk Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: e1d81c61c20641b29fa821c6ab641d78 Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:20.862885 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:20.864199 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1d81c61c20641b29fa821c6ab641d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1d81c61c20641b29fa821c6ab641d78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1d81c61c20641b29fa821c6ab641d78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1d81c61c20641b29fa821c6ab641d78"}]}] Jul 20 04:10:20.864199 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:20.864199 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: e1d81c61c20641b29fa821c6ab641d78 Jul 20 04:10:20.864199 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:20.864199 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AggregatesAdminNegativeTestJSON-374559130-project Jul 20 04:10:20.864199 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:20.864199 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:20.864199 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 076950d75573493cb2c19df8ddb2a420 Jul 20 04:10:20.864199 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-374559130-project Jul 20 04:10:20.864199 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:20.864199 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 04:10:20.864199 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '8'} Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:20.864856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.866141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-efe5927a-c138-4bed-9a22-2128a48cd9c6 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:20.866991 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-efe5927a-c138-4bed-9a22-2128a48cd9c6 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.021542 Jul 20 04:10:20.866991 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 26/54] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Jul 20 04:10:20 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:20.875989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1be0c936-ad4a-4675-81f3-5810fa069e6a tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.876739 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.876739 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:20.942875 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1be0c936-ad4a-4675-81f3-5810fa069e6a tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.071122 Jul 20 04:10:20.947533 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 27/55] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:10:20 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:10:20.960794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:20.968330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1677400a-c57a-4726-825a-cd913b89a412 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.969196 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.969196 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:20.976553 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-1677400a-c57a-4726-825a-cd913b89a412 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1677400a-c57a-4726-825a-cd913b89a412 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Request method failure captured: Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AlkGCXnfxc4AXX1u7MrmYgpSFGYyhagntX5BdrefHGYNBjEykF6vWpG19XtHrjHT3sGkE2TxD4Z5tQqX6ZNnnNLxQYpEHXqwHRcHV14GhlifRgOY3E-_IrGpEur1-RZvyWn6WfJABtBr0wvMCXWrmCRg6OaKCo6I0q7BdqnV_00PU Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:10:20.978381 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:10:20.979467 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5bcc08aebde45b69064b587428b1a1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}] Jul 20 04:10:20.979467 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.979467 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:10:20.979467 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:10:20.979467 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:20.979467 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:20.979467 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:20.979467 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 419ac8874da648cc8c6a40d03cf4fd94 Jul 20 04:10:20.979467 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:10:20.979467 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:20.979467 n-d-764485-11 devstack@n-api.service[119808]: exception: Aggregate -1 could not be found. Jul 20 04:10:20.979467 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '-1'} Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.980149 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 20 04:10:20.981141 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:20.984378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1677400a-c57a-4726-825a-cd913b89a412 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:20.985487 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1677400a-c57a-4726-825a-cd913b89a412 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.036982 Jul 20 04:10:20.990609 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 28/56] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:10:20 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:20.995638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3142f64b-8b91-4e43-8892-4922b61d7a33 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.996658 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:20.996658 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:20.998482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3142f64b-8b91-4e43-8892-4922b61d7a33 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '076950d75573493cb2c19df8ddb2a420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d81c61c20641b29fa821c6ab641d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3142f64b-8b91-4e43-8892-4922b61d7a33 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Request method failure captured: Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AiViJC-ZSHrLQWnsBcxj_wMbB9UigDgj8O6ngXnVovZu2Lfn2lLvd5hWxt00zQjCVgc6N1IGYxJwHXTpRxsG_bGeTbYnv8ePFlX4zNIVe7kIQXI6_m_NWcVKf5GWqatQKKM2ay7F3dkAsANUxdhAPtpzKFPvF5veOOoxRzpBZrTkk Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: e1d81c61c20641b29fa821c6ab641d78 Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:21.000343 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:21.001420 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1d81c61c20641b29fa821c6ab641d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1d81c61c20641b29fa821c6ab641d78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1d81c61c20641b29fa821c6ab641d78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1d81c61c20641b29fa821c6ab641d78"}]}] Jul 20 04:10:21.001420 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:21.001420 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: e1d81c61c20641b29fa821c6ab641d78 Jul 20 04:10:21.001420 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:10:21.001420 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AggregatesAdminNegativeTestJSON-374559130-project Jul 20 04:10:21.001420 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:21.001420 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:21.001420 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 076950d75573493cb2c19df8ddb2a420 Jul 20 04:10:21.001420 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-374559130-project Jul 20 04:10:21.001420 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:21.001420 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 04:10:21.001420 n-d-764485-11 devstack@n-api.service[119808]: action_args: {} Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:21.002015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 04:10:21.002933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:21.005023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3142f64b-8b91-4e43-8892-4922b61d7a33 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:21.006056 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3142f64b-8b91-4e43-8892-4922b61d7a33 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.014212 Jul 20 04:10:21.006791 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 29/57] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:10:20 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:21.026500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5889956c-cd9c-4c5a-88d5-a9293bb9c419 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:21.027890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5889956c-cd9c-4c5a-88d5-a9293bb9c419 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:21.046432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5889956c-cd9c-4c5a-88d5-a9293bb9c419 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.047261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5889956c-cd9c-4c5a-88d5-a9293bb9c419 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.048615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5889956c-cd9c-4c5a-88d5-a9293bb9c419 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.049537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5889956c-cd9c-4c5a-88d5-a9293bb9c419 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.536842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5889956c-cd9c-4c5a-88d5-a9293bb9c419 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:21.572786 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5889956c-cd9c-4c5a-88d5-a9293bb9c419 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1299 microversion: 2.1 time: 0.553851 Jul 20 04:10:21.575982 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 30/58] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:21 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1299 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:22.732438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1756510019", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "availability_zone": "tempest-test_az-665951692"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:22.804636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.812502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.818883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.822662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:23.087691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:23.984898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:23.985438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:23.986839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:23.987350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:23.988136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:24.014138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.015090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.018196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.018898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.109386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Getting quotas for project ecbaffa64c734b698ef7b07eeda83a68. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:24.126326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Getting quotas for user 79c8da84ee4d4a019ad77e195f00a5de and project ecbaffa64c734b698ef7b07eeda83a68. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:24.170044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.utils [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] instances quota exceeded for ecbaffa64c734b698ef7b07eeda83a68, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119807) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 04:10:24.179048 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Request method failure captured: Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 144 Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AiXZHUFRmKap16yIAtbGP_Gv5g4vn2lsf8whLTuCBiKjDm4mj-7EawZ4wDwRqBraNn5kiwo338B2e1LEfQNgQyJw9sETFGl5LXzw11fP2oBrrpd_I5u3xbxjex8LoI_3NzGAvsTIrYjLmcyguqUm9IjA2ZsE-jUiX74Tpz9VuQT5g Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: ecbaffa64c734b698ef7b07eeda83a68 Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-QuotasAdminNegativeTest-958476175 Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:10:24.199881 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:10:24.201209 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ecbaffa64c734b698ef7b07eeda83a68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ecbaffa64c734b698ef7b07eeda83a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ecbaffa64c734b698ef7b07eeda83a68", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ecbaffa64c734b698ef7b07eeda83a68"}]}] Jul 20 04:10:24.201209 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-QuotasAdminNegativeTest-958476175 Jul 20 04:10:24.201209 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: ecbaffa64c734b698ef7b07eeda83a68 Jul 20 04:10:24.201209 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-958476175 Jul 20 04:10:24.201209 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-QuotasAdminNegativeTest-958476175-project Jul 20 04:10:24.201209 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:24.201209 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:24.201209 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 79c8da84ee4d4a019ad77e195f00a5de Jul 20 04:10:24.201209 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-QuotasAdminNegativeTest-958476175-project Jul 20 04:10:24.201209 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:24.201209 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-121126319", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} Jul 20 04:10:24.201209 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-121126319', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452'}}} Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:10:24.201872 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:24.202792 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:24.204166 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:24.206421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:24.206421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:24.206421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:24.206421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:24.206421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:10:24.206421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:24.206421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:24.208487 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4c7d8e43-fa5e-4712-ba34-5ddcdbf3285e tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 3.369339 Jul 20 04:10:24.210781 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 29/59] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:20 2022] POST /compute/v2.1/servers => generated 119 bytes in 3374 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:24.218496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-71c86b6b-7c25-41a5-aec1-076215498f5a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:24.221673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-71c86b6b-7c25-41a5-aec1-076215498f5a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:24.246086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71c86b6b-7c25-41a5-aec1-076215498f5a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.248811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71c86b6b-7c25-41a5-aec1-076215498f5a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.251173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71c86b6b-7c25-41a5-aec1-076215498f5a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.252098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71c86b6b-7c25-41a5-aec1-076215498f5a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.954642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:24.955260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:24.956026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:24.957194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:24.957960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:24.999746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:25.002649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:25.006601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:25.011026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:25.100091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Getting quotas for project 49ca615bc66e4b3484501f12382935d3. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:25.116451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Getting quotas for user 1c3684a008394684804d848903b195b4 and project 49ca615bc66e4b3484501f12382935d3. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:25.125212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-71c86b6b-7c25-41a5-aec1-076215498f5a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:25.143171 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-71c86b6b-7c25-41a5-aec1-076215498f5a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 0.929765 Jul 20 04:10:25.147298 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 30/60] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:24 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:25.163041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b36f477-b301-453c-b695-0760c9e99959 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9e03a160>, body: {"quota_set": {"instances": 10}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:25.175394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:10:25.194199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:10:25.454788 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bcbeb0b0-80db-4d0f-8432-1f1987015e97 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.814183 Jul 20 04:10:25.455547 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 31/61] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:10:25.471329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2deef97b-7867-4160-8df2-a3de7bf1e7e6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:25.472208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2deef97b-7867-4160-8df2-a3de7bf1e7e6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:25.767453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2deef97b-7867-4160-8df2-a3de7bf1e7e6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:25.792327 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2deef97b-7867-4160-8df2-a3de7bf1e7e6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1242 microversion: 2.1 time: 0.329675 Jul 20 04:10:25.796057 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 32/62] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:25 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1242 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:26.173443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b97c4a65-c198-43b1-b0e2-a14700c1ab60 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:26.174507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b97c4a65-c198-43b1-b0e2-a14700c1ab60 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:26.196315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b97c4a65-c198-43b1-b0e2-a14700c1ab60 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:26.197289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b97c4a65-c198-43b1-b0e2-a14700c1ab60 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:26.198901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b97c4a65-c198-43b1-b0e2-a14700c1ab60 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:26.203079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b97c4a65-c198-43b1-b0e2-a14700c1ab60 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:26.500057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b36f477-b301-453c-b695-0760c9e99959 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:26.502915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b36f477-b301-453c-b695-0760c9e99959 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:26.503975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b36f477-b301-453c-b695-0760c9e99959 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:26.504697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b36f477-b301-453c-b695-0760c9e99959 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:26.673043 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0b36f477-b301-453c-b695-0760c9e99959 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68" status: 200 len: 329 microversion: 2.1 time: 1.521873 Jul 20 04:10:26.673782 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 31/63] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:25 2022] PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68 => generated 329 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:26.685369 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2bdcedfa-9625-4fb6-ae0d-9054182e8c00 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Calling method '.version_select at 0x7fbf9dfc6d30>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:27.264354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b97c4a65-c198-43b1-b0e2-a14700c1ab60 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:27.279405 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b97c4a65-c198-43b1-b0e2-a14700c1ab60 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 1.118144 Jul 20 04:10:27.284513 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 33/64] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:26 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:27.305008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5729cbe3-894f-4bf7-8bbd-6eaf13e584c9 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:27.305643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5729cbe3-894f-4bf7-8bbd-6eaf13e584c9 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:27.475928 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2bdcedfa-9625-4fb6-ae0d-9054182e8c00 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68" status: 200 len: 371 microversion: 2.1 time: 0.794581 Jul 20 04:10:27.479347 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 32/65] 10.222.0.20 () {58 vars in 1241 bytes} [Wed Jul 20 04:10:26 2022] GET /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68 => generated 371 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:27.532311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5729cbe3-894f-4bf7-8bbd-6eaf13e584c9 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:27.552651 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5729cbe3-894f-4bf7-8bbd-6eaf13e584c9 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1242 microversion: 2.1 time: 0.266790 Jul 20 04:10:27.553250 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 34/66] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:27 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1242 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:27.793393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-014a4e94-f273-4a04-8237-a73b20602526 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Calling method '.version_select at 0x7fbf9e228790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:27.794572 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:27.794572 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:27.796358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-014a4e94-f273-4a04-8237-a73b20602526 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:27.797046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-014a4e94-f273-4a04-8237-a73b20602526 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:27.842133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-da5eae9f-fcbc-4c65-943a-29ec06c578d6 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Calling method '.version_select at 0x7fbf9dfd1310>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:27.843484 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:27.843484 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:27.845098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da5eae9f-fcbc-4c65-943a-29ec06c578d6 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:27.845846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-014a4e94-f273-4a04-8237-a73b20602526 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:27.847077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-014a4e94-f273-4a04-8237-a73b20602526 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:27.852513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da5eae9f-fcbc-4c65-943a-29ec06c578d6 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:27.854037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da5eae9f-fcbc-4c65-943a-29ec06c578d6 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:27.854829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da5eae9f-fcbc-4c65-943a-29ec06c578d6 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:27.891828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-014a4e94-f273-4a04-8237-a73b20602526 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:27.893907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-014a4e94-f273-4a04-8237-a73b20602526 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:27.914480 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-014a4e94-f273-4a04-8237-a73b20602526 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.353914 Jul 20 04:10:27.925243 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:27 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:27.934263 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-da5eae9f-fcbc-4c65-943a-29ec06c578d6 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 0.450646 Jul 20 04:10:27.936319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2e7b2ec3-300c-4bd0-83dd-d289cda5834e tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9e25f160>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:27.941451 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 33/68] 10.222.0.20 () {58 vars in 1127 bytes} [Wed Jul 20 04:10:27 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:27.960941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9a8c922-9c3c-4ae1-8dc1-5e9dfec96063 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Calling method '.version_select at 0x7fbf9e17b8b0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:27.972534 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:27.972534 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:27.972933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9a8c922-9c3c-4ae1-8dc1-5e9dfec96063 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:27.973395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9a8c922-9c3c-4ae1-8dc1-5e9dfec96063 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.045229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9a8c922-9c3c-4ae1-8dc1-5e9dfec96063 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.046077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9a8c922-9c3c-4ae1-8dc1-5e9dfec96063 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.100332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9a8c922-9c3c-4ae1-8dc1-5e9dfec96063 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.101792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9a8c922-9c3c-4ae1-8dc1-5e9dfec96063 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.129540 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a9a8c922-9c3c-4ae1-8dc1-5e9dfec96063 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1508 microversion: 2.1 time: 0.182519 Jul 20 04:10:28.133096 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 34/69] 10.222.0.20 () {58 vars in 1166 bytes} [Wed Jul 20 04:10:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:28.158732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e7b2ec3-300c-4bd0-83dd-d289cda5834e tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.159474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e7b2ec3-300c-4bd0-83dd-d289cda5834e tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.167935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e7b2ec3-300c-4bd0-83dd-d289cda5834e tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.181782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e7b2ec3-300c-4bd0-83dd-d289cda5834e tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.283906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:28.360295 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2e7b2ec3-300c-4bd0-83dd-d289cda5834e tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68" status: 200 len: 325 microversion: 2.1 time: 0.433492 Jul 20 04:10:28.370755 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:27 2022] PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68 => generated 325 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:28.387120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c62b08f-270a-4d83-84b1-23b2ab6eb560 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Calling method '.version_select at 0x7fbf9e228e50>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:28.393524 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:28.393524 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:28.396504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c62b08f-270a-4d83-84b1-23b2ab6eb560 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.400100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c62b08f-270a-4d83-84b1-23b2ab6eb560 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.474472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c62b08f-270a-4d83-84b1-23b2ab6eb560 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.490268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c62b08f-270a-4d83-84b1-23b2ab6eb560 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.540134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c62b08f-270a-4d83-84b1-23b2ab6eb560 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.543020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c62b08f-270a-4d83-84b1-23b2ab6eb560 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.550764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5d7a32b2-164e-47f3-a1dc-c8f3cae86b48 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Calling method '.version_select at 0x7fbf9dfd1ca0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:28.552303 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:28.552303 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:28.554135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5d7a32b2-164e-47f3-a1dc-c8f3cae86b48 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'e4c2673a0b3c4c048981060fcbe70407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662113ad43924977bc1fa697a2627e91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5d7a32b2-164e-47f3-a1dc-c8f3cae86b48 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Request method failure captured: Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AvPrOodYGlDuLO2_ILejsA7-qK9cmMnj_P4ob1jqFc1vlZ3HVXI-VDZyj8DM5oOsf8z9dd4duL8Rdy8HDqxSVqJlQ7qHPxl-FmaZhgI12WTRk9EyE5a190y2CbOgj8n6Ch8vYtjhDRFBsepVyaNpnAbtULNtGylD9E58QJXZY3tkE Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 662113ad43924977bc1fa697a2627e91 Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:10:28.561223 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/662113ad43924977bc1fa697a2627e91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/662113ad43924977bc1fa697a2627e91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_662113ad43924977bc1fa697a2627e91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/662113ad43924977bc1fa697a2627e91"}]}] Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 662113ad43924977bc1fa697a2627e91 Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-HostsAdminNegativeTestJSON-1528767884-project Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: e4c2673a0b3c4c048981060fcbe70407 Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1528767884-project Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: action_args: {} Jul 20 04:10:28.562676 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:28.563494 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 04:10:28.564668 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:28.565642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5d7a32b2-164e-47f3-a1dc-c8f3cae86b48 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:28.565642 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5d7a32b2-164e-47f3-a1dc-c8f3cae86b48 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.430444 Jul 20 04:10:28.571819 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 35/71] 10.222.0.20 () {58 vars in 1127 bytes} [Wed Jul 20 04:10:28 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 438 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:28.598403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-583b0765-ebb9-43c5-b179-a38104ef1f2e tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:28.599077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-583b0765-ebb9-43c5-b179-a38104ef1f2e tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:28.603211 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0c62b08f-270a-4d83-84b1-23b2ab6eb560 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.230351 Jul 20 04:10:28.605528 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 37/72] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:28 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:28.628380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8208cf2f-1cac-4861-b913-4568f2ac39a1 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:28.629123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8208cf2f-1cac-4861-b913-4568f2ac39a1 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:28.640005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-583b0765-ebb9-43c5-b179-a38104ef1f2e tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.640459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-583b0765-ebb9-43c5-b179-a38104ef1f2e tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.647882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-583b0765-ebb9-43c5-b179-a38104ef1f2e tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.650454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-583b0765-ebb9-43c5-b179-a38104ef1f2e tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.662108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8208cf2f-1cac-4861-b913-4568f2ac39a1 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.662571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8208cf2f-1cac-4861-b913-4568f2ac39a1 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.669452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8208cf2f-1cac-4861-b913-4568f2ac39a1 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.671597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8208cf2f-1cac-4861-b913-4568f2ac39a1 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:29.094703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8208cf2f-1cac-4861-b913-4568f2ac39a1 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:29.110817 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8208cf2f-1cac-4861-b913-4568f2ac39a1 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1290 microversion: 2.1 time: 0.504153 Jul 20 04:10:29.111542 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 38/73] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:28 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1290 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:29.141907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-738bf5a0-1cdd-4224-9577-bd8a48802270 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Calling method '.version_select at 0x7fbf9e228f70>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:29.152595 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:29.152595 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:29.152595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-738bf5a0-1cdd-4224-9577-bd8a48802270 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'e4c2673a0b3c4c048981060fcbe70407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662113ad43924977bc1fa697a2627e91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-738bf5a0-1cdd-4224-9577-bd8a48802270 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Request method failure captured: Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-hosts/n-d-764485-11/reboot HTTP/1.1 Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AvPrOodYGlDuLO2_ILejsA7-qK9cmMnj_P4ob1jqFc1vlZ3HVXI-VDZyj8DM5oOsf8z9dd4duL8Rdy8HDqxSVqJlQ7qHPxl-FmaZhgI12WTRk9EyE5a190y2CbOgj8n6Ch8vYtjhDRFBsepVyaNpnAbtULNtGylD9E58QJXZY3tkE Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 662113ad43924977bc1fa697a2627e91 Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:29.159130 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/662113ad43924977bc1fa697a2627e91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/662113ad43924977bc1fa697a2627e91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_662113ad43924977bc1fa697a2627e91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/662113ad43924977bc1fa697a2627e91"}]}] Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 662113ad43924977bc1fa697a2627e91 Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HostsAdminNegativeTestJSON-1528767884-project Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: e4c2673a0b3c4c048981060fcbe70407 Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1528767884-project Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'n-d-764485-11'} Jul 20 04:10:29.160575 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:29.161260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 04:10:29.162200 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:29.163068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-738bf5a0-1cdd-4224-9577-bd8a48802270 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:29.163454 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-738bf5a0-1cdd-4224-9577-bd8a48802270 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-764485-11/reboot" status: 403 len: 111 microversion: 2.1 time: 0.048278 Jul 20 04:10:29.167876 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 39/74] 10.222.0.20 () {58 vars in 1190 bytes} [Wed Jul 20 04:10:29 2022] GET /compute/v2.1/os-hosts/n-d-764485-11/reboot => generated 111 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:29.184410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6060d019-4881-42c8-bec7-25956b83d369 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Calling method '.version_select at 0x7fbf9e1e3430>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:29.189707 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:29.189707 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:29.194928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6060d019-4881-42c8-bec7-25956b83d369 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:29.196620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6060d019-4881-42c8-bec7-25956b83d369 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:29.271794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6060d019-4881-42c8-bec7-25956b83d369 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:29.281806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6060d019-4881-42c8-bec7-25956b83d369 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:29.296143 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6060d019-4881-42c8-bec7-25956b83d369 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.126239 Jul 20 04:10:29.306136 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 40/75] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:10:29 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:29.317178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-632447139", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:29.488862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:30.404006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-583b0765-ebb9-43c5-b179-a38104ef1f2e tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:30.421060 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-583b0765-ebb9-43c5-b179-a38104ef1f2e tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 1.846854 Jul 20 04:10:30.424782 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 36/76] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:28 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:30.845256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b259f262-3847-4667-857e-9b4eb434b0b2 req-57f61a7c-46a0-4594-93f9-fe579bd6bff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff00481-daa9-41ee-a128-2684117e0c50", "tag": "670aa06e-f892-4ef8-a4e3-6587fb3c3c90"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:30.879010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b259f262-3847-4667-857e-9b4eb434b0b2 req-57f61a7c-46a0-4594-93f9-fe579bd6bff2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:30.880531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b259f262-3847-4667-857e-9b4eb434b0b2 req-57f61a7c-46a0-4594-93f9-fe579bd6bff2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:30.966992 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b259f262-3847-4667-857e-9b4eb434b0b2 req-57f61a7c-46a0-4594-93f9-fe579bd6bff2 service nova] Creating event network-changed:670aa06e-f892-4ef8-a4e3-6587fb3c3c90 for instance 6ff00481-daa9-41ee-a128-2684117e0c50 on n-h1-764485-11 Jul 20 04:10:30.967765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b259f262-3847-4667-857e-9b4eb434b0b2 req-57f61a7c-46a0-4594-93f9-fe579bd6bff2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:10:30.971284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76c69001-ae4a-4bac-8a10-5a495ef0fe2e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:30.972973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76c69001-ae4a-4bac-8a10-5a495ef0fe2e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:30.975144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76c69001-ae4a-4bac-8a10-5a495ef0fe2e None None] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:30.975677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76c69001-ae4a-4bac-8a10-5a495ef0fe2e None None] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.006097 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.compute.rpcapi [None req-76c69001-ae4a-4bac-8a10-5a495ef0fe2e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 04:10:31.008985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76c69001-ae4a-4bac-8a10-5a495ef0fe2e None None] Releasing lock "compute-rpcapi-router" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:10:31.058677 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-76c69001-ae4a-4bac-8a10-5a495ef0fe2e None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.631839 Jul 20 04:10:31.059400 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 37/77] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:31.067937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-98a28644-c026-4708-9344-9a00dc707272 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Calling method '.version_select at 0x7fbf9dfdf040>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:31.071563 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:31.071563 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:31.098499 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-98a28644-c026-4708-9344-9a00dc707272 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-98a28644-c026-4708-9344-9a00dc707272 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Request method failure captured: Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AynTj1DeSvOXgNJRblUfVY-GhYCRo2PgxnF-nJcMzBYZ0qewz6bl40EbMrE5kEgbP4rytwLa3sPM0DXqZ1c30M_ndLnJotRMqnXUf16IBrIPyyozuJHBfW0b-A9YaDUQM5YwEfuVucPuGBcWNl3t5FBGRDG0lU740bzLPUbMcEIEs Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:10:31.111970 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52e2e7cb20a24cf6a4a23f7285e7975f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}] Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 12f7e0b94c6a4083be24a53a412ec865 Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:10:31.113261 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:31.113955 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 04:10:31.114953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-98a28644-c026-4708-9344-9a00dc707272 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:31.116875 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-98a28644-c026-4708-9344-9a00dc707272 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.052404 Jul 20 04:10:31.119660 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 38/78] 10.222.0.20 () {58 vars in 1211 bytes} [Wed Jul 20 04:10:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:31.129283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-620cc554-c30d-4894-b890-135d31a52f7d tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Calling method '.version_select at 0x7fbf9dfc6d30>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:31.134690 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:31.134690 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:31.142360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-620cc554-c30d-4894-b890-135d31a52f7d tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.146242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-620cc554-c30d-4894-b890-135d31a52f7d tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.218807 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-620cc554-c30d-4894-b890-135d31a52f7d tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.097816 Jul 20 04:10:31.219805 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 39/79] 10.222.0.20 () {58 vars in 1178 bytes} [Wed Jul 20 04:10:31 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:31.247249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a38eaf88-129b-4e6e-ba55-0a700fcdcd74 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:31.248058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a38eaf88-129b-4e6e-ba55-0a700fcdcd74 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:31.274580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a38eaf88-129b-4e6e-ba55-0a700fcdcd74 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.275032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a38eaf88-129b-4e6e-ba55-0a700fcdcd74 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.286259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a38eaf88-129b-4e6e-ba55-0a700fcdcd74 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.287342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a38eaf88-129b-4e6e-ba55-0a700fcdcd74 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.365018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:31.365753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:31.366633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:31.367110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:31.368017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:31.414871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.440663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.441713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.447569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.475434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a38eaf88-129b-4e6e-ba55-0a700fcdcd74 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:31.489751 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a38eaf88-129b-4e6e-ba55-0a700fcdcd74 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1296 microversion: 2.1 time: 0.265735 Jul 20 04:10:31.490783 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 40/80] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:31 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1296 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:31.503468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-978aa304-c094-49b6-9ad5-1ba3abc00b36 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Calling method '.version_select at 0x7fbf9dfd14c0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:31.504625 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:31.504625 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:31.506279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-978aa304-c094-49b6-9ad5-1ba3abc00b36 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'e4c2673a0b3c4c048981060fcbe70407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662113ad43924977bc1fa697a2627e91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-978aa304-c094-49b6-9ad5-1ba3abc00b36 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Request method failure captured: Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-hosts/n-d-764485-11 HTTP/1.1 Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AvPrOodYGlDuLO2_ILejsA7-qK9cmMnj_P4ob1jqFc1vlZ3HVXI-VDZyj8DM5oOsf8z9dd4duL8Rdy8HDqxSVqJlQ7qHPxl-FmaZhgI12WTRk9EyE5a190y2CbOgj8n6Ch8vYtjhDRFBsepVyaNpnAbtULNtGylD9E58QJXZY3tkE Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 662113ad43924977bc1fa697a2627e91 Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:10:31.507966 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/662113ad43924977bc1fa697a2627e91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/662113ad43924977bc1fa697a2627e91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_662113ad43924977bc1fa697a2627e91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/662113ad43924977bc1fa697a2627e91"}]}] Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 662113ad43924977bc1fa697a2627e91 Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-HostsAdminNegativeTestJSON-1528767884-project Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: e4c2673a0b3c4c048981060fcbe70407 Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1528767884-project Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'n-d-764485-11'} Jul 20 04:10:31.509312 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:31.510230 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 04:10:31.511485 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.515103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-978aa304-c094-49b6-9ad5-1ba3abc00b36 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:31.519745 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-978aa304-c094-49b6-9ad5-1ba3abc00b36 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-764485-11" status: 403 len: 109 microversion: 2.1 time: 0.024301 Jul 20 04:10:31.526190 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 41/81] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Jul 20 04:10:31 2022] GET /compute/v2.1/os-hosts/n-d-764485-11 => generated 109 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:31.526611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Getting quotas for project ecbaffa64c734b698ef7b07eeda83a68. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:31.536626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-48ab1ed5-05a3-4ce0-adb1-810eedd9d4b5 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Calling method '.version_select at 0x7fbf9dfb0d30>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:31.539202 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:31.539202 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:31.540763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48ab1ed5-05a3-4ce0-adb1-810eedd9d4b5 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.542441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Getting quotas for user 79c8da84ee4d4a019ad77e195f00a5de and project ecbaffa64c734b698ef7b07eeda83a68. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:31.543036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48ab1ed5-05a3-4ce0-adb1-810eedd9d4b5 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.582695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.utils [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] ram quota exceeded for ecbaffa64c734b698ef7b07eeda83a68, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119808) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 04:10:31.583161 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Request method failure captured: Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 144 Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AiXZHUFRmKap16yIAtbGP_Gv5g4vn2lsf8whLTuCBiKjDm4mj-7EawZ4wDwRqBraNn5kiwo338B2e1LEfQNgQyJw9sETFGl5LXzw11fP2oBrrpd_I5u3xbxjex8LoI_3NzGAvsTIrYjLmcyguqUm9IjA2ZsE-jUiX74Tpz9VuQT5g Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ecbaffa64c734b698ef7b07eeda83a68 Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-QuotasAdminNegativeTest-958476175 Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:31.589921 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:31.592357 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ecbaffa64c734b698ef7b07eeda83a68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ecbaffa64c734b698ef7b07eeda83a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ecbaffa64c734b698ef7b07eeda83a68", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ecbaffa64c734b698ef7b07eeda83a68"}]}] Jul 20 04:10:31.592357 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-QuotasAdminNegativeTest-958476175 Jul 20 04:10:31.592357 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ecbaffa64c734b698ef7b07eeda83a68 Jul 20 04:10:31.592357 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-958476175 Jul 20 04:10:31.592357 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-QuotasAdminNegativeTest-958476175-project Jul 20 04:10:31.592357 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:31.592357 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:31.592357 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 79c8da84ee4d4a019ad77e195f00a5de Jul 20 04:10:31.592357 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-QuotasAdminNegativeTest-958476175-project Jul 20 04:10:31.592357 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:10:31.592357 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-632447139", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} Jul 20 04:10:31.592357 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-632447139', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452'}}} Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:10:31.593055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:31.594144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.595329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:31.596897 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:31.596897 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:31.596897 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:31.596897 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:31.596897 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:10:31.596897 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.598528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:31.600197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48ab1ed5-05a3-4ce0-adb1-810eedd9d4b5 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.604166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48ab1ed5-05a3-4ce0-adb1-810eedd9d4b5 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.608209 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a3b1d640-3f1b-4eb8-83a2-ac7300ba55ae tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 2.289152 Jul 20 04:10:31.609178 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 41/82] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:29 2022] POST /compute/v2.1/servers => generated 110 bytes in 2302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:31.625427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cb80f832-1f5f-43de-a2e8-5d7341e7a41a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:31.629055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cb80f832-1f5f-43de-a2e8-5d7341e7a41a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:31.635356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48ab1ed5-05a3-4ce0-adb1-810eedd9d4b5 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.639110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48ab1ed5-05a3-4ce0-adb1-810eedd9d4b5 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.653328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb80f832-1f5f-43de-a2e8-5d7341e7a41a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.654988 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-48ab1ed5-05a3-4ce0-adb1-810eedd9d4b5 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.127354 Jul 20 04:10:31.655194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb80f832-1f5f-43de-a2e8-5d7341e7a41a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.657242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb80f832-1f5f-43de-a2e8-5d7341e7a41a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:31.657729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb80f832-1f5f-43de-a2e8-5d7341e7a41a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:31.658476 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 42/83] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:31 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:31.666221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-72f7beac-b7c1-4cd5-af48-7e29a5e9f417 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Calling method '.version_select at 0x7fbf9dfb0700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:31.667831 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:31.667831 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:31.675302 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-72f7beac-b7c1-4cd5-af48-7e29a5e9f417 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-72f7beac-b7c1-4cd5-af48-7e29a5e9f417 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Request method failure captured: Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AynTj1DeSvOXgNJRblUfVY-GhYCRo2PgxnF-nJcMzBYZ0qewz6bl40EbMrE5kEgbP4rytwLa3sPM0DXqZ1c30M_ndLnJotRMqnXUf16IBrIPyyozuJHBfW0b-A9YaDUQM5YwEfuVucPuGBcWNl3t5FBGRDG0lU740bzLPUbMcEIEs Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:10:31.677113 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52e2e7cb20a24cf6a4a23f7285e7975f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}] Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 12f7e0b94c6a4083be24a53a412ec865 Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:10:31.678216 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:31.678868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:31.681449 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:31.683925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-72f7beac-b7c1-4cd5-af48-7e29a5e9f417 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:31.685252 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-72f7beac-b7c1-4cd5-af48-7e29a5e9f417 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025405 Jul 20 04:10:31.692443 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 43/84] 10.222.0.20 () {58 vars in 1190 bytes} [Wed Jul 20 04:10:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:31.698023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-11b6b755-f248-4c68-a42d-2fff56e61b62 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9dfd1310>, body: {"quota_set": {"ram": 51200}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:32.002379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11b6b755-f248-4c68-a42d-2fff56e61b62 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.002984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11b6b755-f248-4c68-a42d-2fff56e61b62 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.010368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11b6b755-f248-4c68-a42d-2fff56e61b62 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.011066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11b6b755-f248-4c68-a42d-2fff56e61b62 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.094668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:32.162057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cb80f832-1f5f-43de-a2e8-5d7341e7a41a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:32.180780 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-11b6b755-f248-4c68-a42d-2fff56e61b62 tempest-QuotasAdminNegativeTest-800524597 tempest-QuotasAdminNegativeTest-800524597-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68" status: 200 len: 329 microversion: 2.1 time: 0.486759 Jul 20 04:10:32.189748 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 44/85] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:31 2022] PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68 => generated 329 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:32.197224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0977e0f8-12d1-4fca-bece-4ba99a1b4086 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Calling method '.version_select at 0x7fbf9dfb0f70>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:32.213482 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:32.213482 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:32.215302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0977e0f8-12d1-4fca-bece-4ba99a1b4086 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.221058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0977e0f8-12d1-4fca-bece-4ba99a1b4086 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.226241 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cb80f832-1f5f-43de-a2e8-5d7341e7a41a tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 0.611657 Jul 20 04:10:32.230890 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 42/86] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:31 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:32.266105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bd237918-974d-4f3b-8fee-05e845edd650 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Calling method '.version_select at 0x7fbf9e25f700>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:32.292059 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:32.292059 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:32.293439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bd237918-974d-4f3b-8fee-05e845edd650 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'e4c2673a0b3c4c048981060fcbe70407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662113ad43924977bc1fa697a2627e91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bd237918-974d-4f3b-8fee-05e845edd650 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Request method failure captured: Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-hosts/n-d-764485-11/shutdown HTTP/1.1 Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AvPrOodYGlDuLO2_ILejsA7-qK9cmMnj_P4ob1jqFc1vlZ3HVXI-VDZyj8DM5oOsf8z9dd4duL8Rdy8HDqxSVqJlQ7qHPxl-FmaZhgI12WTRk9EyE5a190y2CbOgj8n6Ch8vYtjhDRFBsepVyaNpnAbtULNtGylD9E58QJXZY3tkE Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 662113ad43924977bc1fa697a2627e91 Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:32.296681 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/662113ad43924977bc1fa697a2627e91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/662113ad43924977bc1fa697a2627e91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_662113ad43924977bc1fa697a2627e91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/662113ad43924977bc1fa697a2627e91"}]}] Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 662113ad43924977bc1fa697a2627e91 Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HostsAdminNegativeTestJSON-1528767884-project Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: e4c2673a0b3c4c048981060fcbe70407 Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1528767884-project Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'n-d-764485-11'} Jul 20 04:10:32.298038 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:32.298691 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 04:10:32.299682 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.300821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bd237918-974d-4f3b-8fee-05e845edd650 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:32.300821 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bd237918-974d-4f3b-8fee-05e845edd650 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-764485-11/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.064544 Jul 20 04:10:32.300821 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 43/87] 10.222.0.20 () {58 vars in 1196 bytes} [Wed Jul 20 04:10:32 2022] GET /compute/v2.1/os-hosts/n-d-764485-11/shutdown => generated 113 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:32.314446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0245c6ce-60df-420b-89fb-32c73a10def9 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Action: 'update', calling method: .version_select at 0x7fbf9e1e3430>, body: {"quota_set": {"ram": 0}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:32.317384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0245c6ce-60df-420b-89fb-32c73a10def9 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '79c8da84ee4d4a019ad77e195f00a5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbaffa64c734b698ef7b07eeda83a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:32.322539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0977e0f8-12d1-4fca-bece-4ba99a1b4086 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.323007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0977e0f8-12d1-4fca-bece-4ba99a1b4086 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0245c6ce-60df-420b-89fb-32c73a10def9 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Request method failure captured: Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: request: PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68 HTTP/1.1 Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 25 Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AiXZHUFRmKap16yIAtbGP_Gv5g4vn2lsf8whLTuCBiKjDm4mj-7EawZ4wDwRqBraNn5kiwo338B2e1LEfQNgQyJw9sETFGl5LXzw11fP2oBrrpd_I5u3xbxjex8LoI_3NzGAvsTIrYjLmcyguqUm9IjA2ZsE-jUiX74Tpz9VuQT5g Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ecbaffa64c734b698ef7b07eeda83a68 Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-QuotasAdminNegativeTest-958476175 Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:32.345374 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ecbaffa64c734b698ef7b07eeda83a68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ecbaffa64c734b698ef7b07eeda83a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ecbaffa64c734b698ef7b07eeda83a68", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ecbaffa64c734b698ef7b07eeda83a68"}]}] Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-QuotasAdminNegativeTest-958476175 Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ecbaffa64c734b698ef7b07eeda83a68 Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-958476175 Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-QuotasAdminNegativeTest-958476175-project Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 79c8da84ee4d4a019ad77e195f00a5de Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-QuotasAdminNegativeTest-958476175-project Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: {"quota_set": {"ram": 0}} Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 04:10:32.346706 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ecbaffa64c734b698ef7b07eeda83a68', 'body': {'quota_set': {'ram': 0}}} Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:32.347582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.348772 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.349956 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:32.349956 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:32.349956 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:32.349956 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:32.349956 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 04:10:32.349956 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.349956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0245c6ce-60df-420b-89fb-32c73a10def9 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:32.349956 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0245c6ce-60df-420b-89fb-32c73a10def9 tempest-QuotasAdminNegativeTest-958476175 tempest-QuotasAdminNegativeTest-958476175-project] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68" status: 403 len: 116 microversion: 2.1 time: 0.047759 Jul 20 04:10:32.355601 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 44/88] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:10:32 2022] PUT /compute/v2.1/os-quota-sets/ecbaffa64c734b698ef7b07eeda83a68 => generated 116 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:32.362672 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0977e0f8-12d1-4fca-bece-4ba99a1b4086 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.156224 Jul 20 04:10:32.365075 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 45/89] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:10:32 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:32.376546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b527325b-fe87-4376-a050-03d840996220 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Calling method '.version_select at 0x7fbf9e1e3f70>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:32.385460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-15b04a8e-0a38-4c11-9de3-2afd1e108430 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Calling method '.version_select at 0x7fbf9dfb0670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:32.388817 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-b527325b-fe87-4376-a050-03d840996220 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:32.389378 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:32.389378 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b527325b-fe87-4376-a050-03d840996220 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Request method failure captured: Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AynTj1DeSvOXgNJRblUfVY-GhYCRo2PgxnF-nJcMzBYZ0qewz6bl40EbMrE5kEgbP4rytwLa3sPM0DXqZ1c30M_ndLnJotRMqnXUf16IBrIPyyozuJHBfW0b-A9YaDUQM5YwEfuVucPuGBcWNl3t5FBGRDG0lU740bzLPUbMcEIEs Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:10:32.393149 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52e2e7cb20a24cf6a4a23f7285e7975f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}] Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 12f7e0b94c6a4083be24a53a412ec865 Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:10:32.394507 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:32.395263 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 04:10:32.396669 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:32.397992 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:32.397992 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.397992 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:32.397992 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.397992 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.397992 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:32.397992 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:32.397992 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:32.397992 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:32.397992 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:32.397992 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.400542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b527325b-fe87-4376-a050-03d840996220 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:32.401658 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b527325b-fe87-4376-a050-03d840996220 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.044992 Jul 20 04:10:32.404580 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 45/90] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 20 04:10:32 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:32.414543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15b04a8e-0a38-4c11-9de3-2afd1e108430 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.417019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15b04a8e-0a38-4c11-9de3-2afd1e108430 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.439048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a029aca7-6aed-4929-9b51-d141cc421710 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Calling method '.version_select at 0x7fbf9e228f70>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:32.440128 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:32.440128 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:32.442111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a029aca7-6aed-4929-9b51-d141cc421710 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'e4c2673a0b3c4c048981060fcbe70407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662113ad43924977bc1fa697a2627e91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a029aca7-6aed-4929-9b51-d141cc421710 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Request method failure captured: Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-hosts/n-d-764485-11/startup HTTP/1.1 Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AvPrOodYGlDuLO2_ILejsA7-qK9cmMnj_P4ob1jqFc1vlZ3HVXI-VDZyj8DM5oOsf8z9dd4duL8Rdy8HDqxSVqJlQ7qHPxl-FmaZhgI12WTRk9EyE5a190y2CbOgj8n6Ch8vYtjhDRFBsepVyaNpnAbtULNtGylD9E58QJXZY3tkE Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 662113ad43924977bc1fa697a2627e91 Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:32.444216 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/662113ad43924977bc1fa697a2627e91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/662113ad43924977bc1fa697a2627e91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_662113ad43924977bc1fa697a2627e91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/662113ad43924977bc1fa697a2627e91"}]}] Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 662113ad43924977bc1fa697a2627e91 Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HostsAdminNegativeTestJSON-1528767884-project Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: e4c2673a0b3c4c048981060fcbe70407 Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1528767884-project Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'n-d-764485-11'} Jul 20 04:10:32.445297 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:32.445985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 04:10:32.447153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.452062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a029aca7-6aed-4929-9b51-d141cc421710 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:32.452062 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a029aca7-6aed-4929-9b51-d141cc421710 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-764485-11/startup" status: 403 len: 110 microversion: 2.1 time: 0.034185 Jul 20 04:10:32.465846 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 46/91] 10.222.0.20 () {58 vars in 1193 bytes} [Wed Jul 20 04:10:32 2022] GET /compute/v2.1/os-hosts/n-d-764485-11/startup => generated 110 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:32.480123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15b04a8e-0a38-4c11-9de3-2afd1e108430 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.480761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15b04a8e-0a38-4c11-9de3-2afd1e108430 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.483108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0aba2010-d53d-4a56-b9df-38498c18b85b tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Calling method '.version_select at 0x7fbf9e1d30d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:32.510543 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-15b04a8e-0a38-4c11-9de3-2afd1e108430 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.135508 Jul 20 04:10:32.511161 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 46/92] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:10:32 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:32.535097 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-0aba2010-d53d-4a56-b9df-38498c18b85b tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0aba2010-d53d-4a56-b9df-38498c18b85b tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Request method failure captured: Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AynTj1DeSvOXgNJRblUfVY-GhYCRo2PgxnF-nJcMzBYZ0qewz6bl40EbMrE5kEgbP4rytwLa3sPM0DXqZ1c30M_ndLnJotRMqnXUf16IBrIPyyozuJHBfW0b-A9YaDUQM5YwEfuVucPuGBcWNl3t5FBGRDG0lU740bzLPUbMcEIEs Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:10:32.536975 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52e2e7cb20a24cf6a4a23f7285e7975f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}] Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 12f7e0b94c6a4083be24a53a412ec865 Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:10:32.538079 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:32.538866 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 04:10:32.539864 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:32.540810 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:32.540810 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.540810 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:32.540810 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.540810 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.540810 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:32.540810 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:32.540810 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:32.540810 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:32.540810 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:32.540810 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.545539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0aba2010-d53d-4a56-b9df-38498c18b85b tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:32.545972 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0aba2010-d53d-4a56-b9df-38498c18b85b tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.077787 Jul 20 04:10:32.552307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2b07618a-add0-46ea-bdc7-c9dd265e631c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:32.552760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2b07618a-add0-46ea-bdc7-c9dd265e631c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:32.553222 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 47/93] 10.222.0.20 () {58 vars in 1214 bytes} [Wed Jul 20 04:10:32 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:32.576843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f925b268-4b9a-4f21-b1ff-4d01fb8f2551 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Calling method '.version_select at 0x7fbf9e228f70>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:32.578080 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:32.578080 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:32.579394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f925b268-4b9a-4f21-b1ff-4d01fb8f2551 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.594599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b07618a-add0-46ea-bdc7-c9dd265e631c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.599429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f925b268-4b9a-4f21-b1ff-4d01fb8f2551 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.600433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b07618a-add0-46ea-bdc7-c9dd265e631c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.606977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b07618a-add0-46ea-bdc7-c9dd265e631c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.607788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b07618a-add0-46ea-bdc7-c9dd265e631c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.673432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f925b268-4b9a-4f21-b1ff-4d01fb8f2551 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.675679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f925b268-4b9a-4f21-b1ff-4d01fb8f2551 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.734223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f925b268-4b9a-4f21-b1ff-4d01fb8f2551 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.734698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f925b268-4b9a-4f21-b1ff-4d01fb8f2551 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.766221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f925b268-4b9a-4f21-b1ff-4d01fb8f2551 tempest-HypervisorAdminTestJSON-1569008210 tempest-HypervisorAdminTestJSON-1569008210-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=119808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:10:32.767385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fd2327f-5157-4811-bf7d-73544e1566dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.782904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fd2327f-5157-4811-bf7d-73544e1566dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.784444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fd2327f-5157-4811-bf7d-73544e1566dd None None] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.787467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fd2327f-5157-4811-bf7d-73544e1566dd None None] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.818159 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.compute.rpcapi [None req-3fd2327f-5157-4811-bf7d-73544e1566dd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 04:10:32.828282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fd2327f-5157-4811-bf7d-73544e1566dd None None] Releasing lock "compute-rpcapi-router" {{(pid=119808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:10:32.906597 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3fd2327f-5157-4811-bf7d-73544e1566dd None None] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.351436 Jul 20 04:10:32.909367 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 48/94] 10.222.0.20 () {58 vars in 1172 bytes} [Wed Jul 20 04:10:32 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:32.920878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5878f199-c93e-4f94-808f-279ad152d356 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9e25f0d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5878f199-c93e-4f94-808f-279ad152d356 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Request method failure captured: Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: request: PUT /compute/v2.1/os-hosts/n-d-764485-11 HTTP/1.1 Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 51 Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AynTj1DeSvOXgNJRblUfVY-GhYCRo2PgxnF-nJcMzBYZ0qewz6bl40EbMrE5kEgbP4rytwLa3sPM0DXqZ1c30M_ndLnJotRMqnXUf16IBrIPyyozuJHBfW0b-A9YaDUQM5YwEfuVucPuGBcWNl3t5FBGRDG0lU740bzLPUbMcEIEs Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:10:32.925351 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52e2e7cb20a24cf6a4a23f7285e7975f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}] Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 12f7e0b94c6a4083be24a53a412ec865 Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: {"status": "enable", "maintenance_mode": "invalid"} Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:10:32.926665 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'n-d-764485-11', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.927441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:32.929121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:32.930350 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:32.930350 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:10:32.930350 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:10:32.930350 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:10:32.930350 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:32.940245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5878f199-c93e-4f94-808f-279ad152d356 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:32.947223 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5878f199-c93e-4f94-808f-279ad152d356 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-764485-11" status: 400 len: 199 microversion: 2.1 time: 0.031911 Jul 20 04:10:32.948898 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 49/95] 10.222.0.20 () {60 vars in 1189 bytes} [Wed Jul 20 04:10:32 2022] PUT /compute/v2.1/os-hosts/n-d-764485-11 => generated 199 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:10:33.018853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2b07618a-add0-46ea-bdc7-c9dd265e631c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:33.047108 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2b07618a-add0-46ea-bdc7-c9dd265e631c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1296 microversion: 2.1 time: 0.516087 Jul 20 04:10:33.065377 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 47/96] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:32 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1296 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:33.065377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0502eb87-952c-4c90-a0e6-88f6c3f06a77 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9dfd13a0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0502eb87-952c-4c90-a0e6-88f6c3f06a77 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Request method failure captured: Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: request: PUT /compute/v2.1/os-hosts/n-d-764485-11 HTTP/1.1 Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 51 Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AynTj1DeSvOXgNJRblUfVY-GhYCRo2PgxnF-nJcMzBYZ0qewz6bl40EbMrE5kEgbP4rytwLa3sPM0DXqZ1c30M_ndLnJotRMqnXUf16IBrIPyyozuJHBfW0b-A9YaDUQM5YwEfuVucPuGBcWNl3t5FBGRDG0lU740bzLPUbMcEIEs Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:10:33.102877 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52e2e7cb20a24cf6a4a23f7285e7975f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}] Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 12f7e0b94c6a4083be24a53a412ec865 Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: {"status": "invalid", "maintenance_mode": "enable"} Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:10:33.104821 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'n-d-764485-11', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:33.105745 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:33.108098 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:33.109309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:33.109309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:10:33.109309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:10:33.109309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:10:33.109309 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.111551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0502eb87-952c-4c90-a0e6-88f6c3f06a77 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:33.111551 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0502eb87-952c-4c90-a0e6-88f6c3f06a77 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-764485-11" status: 400 len: 189 microversion: 2.1 time: 0.053004 Jul 20 04:10:33.111937 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 48/97] 10.222.0.20 () {60 vars in 1189 bytes} [Wed Jul 20 04:10:33 2022] PUT /compute/v2.1/os-hosts/n-d-764485-11 => generated 189 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:10:33.135776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4afbfd62-e7a6-4036-82fe-ca7beca1e1b8 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Action: 'update', calling method: .version_select at 0x7fbf9dfb0c10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:33.137022 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:33.137022 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:33.154357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4afbfd62-e7a6-4036-82fe-ca7beca1e1b8 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'e4c2673a0b3c4c048981060fcbe70407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662113ad43924977bc1fa697a2627e91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4afbfd62-e7a6-4036-82fe-ca7beca1e1b8 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Request method failure captured: Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: request: PUT /compute/v2.1/os-hosts/n-d-764485-11 HTTP/1.1 Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 50 Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AvPrOodYGlDuLO2_ILejsA7-qK9cmMnj_P4ob1jqFc1vlZ3HVXI-VDZyj8DM5oOsf8z9dd4duL8Rdy8HDqxSVqJlQ7qHPxl-FmaZhgI12WTRk9EyE5a190y2CbOgj8n6Ch8vYtjhDRFBsepVyaNpnAbtULNtGylD9E58QJXZY3tkE Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 662113ad43924977bc1fa697a2627e91 Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:10:33.156175 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/662113ad43924977bc1fa697a2627e91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/662113ad43924977bc1fa697a2627e91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_662113ad43924977bc1fa697a2627e91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/662113ad43924977bc1fa697a2627e91"}]}] Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 662113ad43924977bc1fa697a2627e91 Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1528767884 Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-HostsAdminNegativeTestJSON-1528767884-project Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: e4c2673a0b3c4c048981060fcbe70407 Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1528767884-project Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: {"status": "enable", "maintenance_mode": "enable"} Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 04:10:33.157702 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'n-d-764485-11', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:33.158622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 04:10:33.160281 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.161339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4afbfd62-e7a6-4036-82fe-ca7beca1e1b8 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:33.161339 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4afbfd62-e7a6-4036-82fe-ca7beca1e1b8 tempest-HostsAdminNegativeTestJSON-1528767884 tempest-HostsAdminNegativeTestJSON-1528767884-project] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-764485-11" status: 403 len: 111 microversion: 2.1 time: 0.038821 Jul 20 04:10:33.177803 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 49/98] 10.222.0.20 () {60 vars in 1189 bytes} [Wed Jul 20 04:10:33 2022] PUT /compute/v2.1/os-hosts/n-d-764485-11 => generated 111 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:33.205074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-baabedab-5dc3-4fd3-80b1-cf33fcbe7468 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9e17b8b0>, body: {"status": null, "maintenance_mode": null} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-baabedab-5dc3-4fd3-80b1-cf33fcbe7468 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Request method failure captured: Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: request: PUT /compute/v2.1/os-hosts/n-d-764485-11 HTTP/1.1 Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 42 Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AynTj1DeSvOXgNJRblUfVY-GhYCRo2PgxnF-nJcMzBYZ0qewz6bl40EbMrE5kEgbP4rytwLa3sPM0DXqZ1c30M_ndLnJotRMqnXUf16IBrIPyyozuJHBfW0b-A9YaDUQM5YwEfuVucPuGBcWNl3t5FBGRDG0lU740bzLPUbMcEIEs Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:10:33.207434 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52e2e7cb20a24cf6a4a23f7285e7975f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}] Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 12f7e0b94c6a4083be24a53a412ec865 Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: {"status": null, "maintenance_mode": null} Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 04:10:33.208918 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'n-d-764485-11', 'body': {'status': None, 'maintenance_mode': None}} Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi None Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:33.209928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:33.211549 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:33.212953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:10:33.212953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:10:33.212953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 04:10:33.212953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.214801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-baabedab-5dc3-4fd3-80b1-cf33fcbe7468 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:33.215858 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-baabedab-5dc3-4fd3-80b1-cf33fcbe7468 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-764485-11" status: 400 len: 127 microversion: 2.1 time: 0.036750 Jul 20 04:10:33.216438 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 50/99] 10.222.0.20 () {60 vars in 1189 bytes} [Wed Jul 20 04:10:33 2022] PUT /compute/v2.1/os-hosts/n-d-764485-11 => generated 127 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:10:33.233051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f445f5f3-f3ae-44f8-a5a4-4245f87e4434 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9e03adc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:33.248779 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.hosts [None req-f445f5f3-f3ae-44f8-a5a4-4245f87e4434 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Enabling host nonexistent_hostname. Jul 20 04:10:33.291585 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f445f5f3-f3ae-44f8-a5a4-4245f87e4434 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f445f5f3-f3ae-44f8-a5a4-4245f87e4434 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Request method failure captured: Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 50 Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AynTj1DeSvOXgNJRblUfVY-GhYCRo2PgxnF-nJcMzBYZ0qewz6bl40EbMrE5kEgbP4rytwLa3sPM0DXqZ1c30M_ndLnJotRMqnXUf16IBrIPyyozuJHBfW0b-A9YaDUQM5YwEfuVucPuGBcWNl3t5FBGRDG0lU740bzLPUbMcEIEs Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:10:33.299442 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52e2e7cb20a24cf6a4a23f7285e7975f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52e2e7cb20a24cf6a4a23f7285e7975f"}]}] Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 52e2e7cb20a24cf6a4a23f7285e7975f Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-680862950 Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 12f7e0b94c6a4083be24a53a412ec865 Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-680862950-project-admin Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: {"status": "enable", "maintenance_mode": "enable"} Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:33.300843 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:10:33.301688 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:33.304490 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:10:33.306024 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:33.312321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f445f5f3-f3ae-44f8-a5a4-4245f87e4434 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:33.314470 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f445f5f3-f3ae-44f8-a5a4-4245f87e4434 tempest-HostsAdminNegativeTestJSON-680862950 tempest-HostsAdminNegativeTestJSON-680862950-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.088797 Jul 20 04:10:33.318853 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 51/100] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 20 04:10:33 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:33.339337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dd272c9e-26ca-4f85-919e-4992ae52e89b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:33.349382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dd272c9e-26ca-4f85-919e-4992ae52e89b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:33.373794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd272c9e-26ca-4f85-919e-4992ae52e89b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:33.381051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd272c9e-26ca-4f85-919e-4992ae52e89b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:33.385241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd272c9e-26ca-4f85-919e-4992ae52e89b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:33.385728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd272c9e-26ca-4f85-919e-4992ae52e89b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:33.404278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:33.757261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8a421c3a-9a28-4180-af64-76c597349998 tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2123370278", "id": 46454086, "os-flavor-access:is_public": "False"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:33.761068 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:33.761068 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:33.794975 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8a421c3a-9a28-4180-af64-76c597349998 tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.844532 Jul 20 04:10:33.796767 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 50/101] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:32 2022] POST /compute/v2.1/flavors => generated 425 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:33.810705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e23c7c64-eda3-4843-b826-e383c0bc942a tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "526a65617a54473e9ee87ce53a820250"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:33.813683 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:33.813683 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:34.574673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dd272c9e-26ca-4f85-919e-4992ae52e89b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:34.583334 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dd272c9e-26ca-4f85-919e-4992ae52e89b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 1.262091 Jul 20 04:10:34.603601 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 52/102] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:33 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:34.609300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-11e8bfdd-4650-4bf3-a108-517c1352cfbf tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:34.625229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-11e8bfdd-4650-4bf3-a108-517c1352cfbf tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:34.648140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11e8bfdd-4650-4bf3-a108-517c1352cfbf tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:34.648596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11e8bfdd-4650-4bf3-a108-517c1352cfbf tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:34.649376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11e8bfdd-4650-4bf3-a108-517c1352cfbf tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:34.649810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11e8bfdd-4650-4bf3-a108-517c1352cfbf tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:34.823829 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e23c7c64-eda3-4843-b826-e383c0bc942a tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/46454086/action" status: 200 len: 95 microversion: 2.1 time: 1.014062 Jul 20 04:10:34.826108 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 51/103] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:10:33 2022] POST /compute/v2.1/flavors/46454086/action => generated 95 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:34.873104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-11e8bfdd-4650-4bf3-a108-517c1352cfbf tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:34.910204 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-11e8bfdd-4650-4bf3-a108-517c1352cfbf tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1296 microversion: 2.1 time: 0.296518 Jul 20 04:10:34.931358 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 53/104] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:34 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1296 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:35.087709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6abcbb45-9e5d-471e-8501-434f7f847c9c tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.105278 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6abcbb45-9e5d-471e-8501-434f7f847c9c tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.277097 Jul 20 04:10:35.106105 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 52/105] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:10:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:35.176373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6ba177dc-552e-4e76-8f8a-53668a1be58d tempest-FlavorsAccessTestJSON-437387745 tempest-FlavorsAccessTestJSON-437387745-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.217359 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6ba177dc-552e-4e76-8f8a-53668a1be58d tempest-FlavorsAccessTestJSON-437387745 tempest-FlavorsAccessTestJSON-437387745-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.284379 Jul 20 04:10:35.218576 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 54/106] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:34 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:35.253727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4b2a9385-2ab7-4611-a23f-5a3c7a739531 tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "526a65617a54473e9ee87ce53a820250"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:35.255307 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:35.255307 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:35.328576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1fbf9811-8ede-4070-9cd0-3613eed1b07f tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-471013157", "id": 732991214, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:35.358244 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1fbf9811-8ede-4070-9cd0-3613eed1b07f tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.241819 Jul 20 04:10:35.360146 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 53/107] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:35 2022] POST /compute/v2.1/flavors => generated 421 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:35.369928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6d9351a-6cbe-465b-89bb-63d2135accd2 tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.385055 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c6d9351a-6cbe-465b-89bb-63d2135accd2 tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018905 Jul 20 04:10:35.388409 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 54/108] 10.222.0.20 () {58 vars in 1181 bytes} [Wed Jul 20 04:10:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:35.397629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e844ae78-466b-4aca-b319-ed2cd68617b2 tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1140046914", "id": 374739863, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:35.412036 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4b2a9385-2ab7-4611-a23f-5a3c7a739531 tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/46454086/action" status: 200 len: 21 microversion: 2.1 time: 0.179286 Jul 20 04:10:35.416927 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 55/109] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:10:35 2022] POST /compute/v2.1/flavors/46454086/action => generated 21 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:35.422455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cdafc631-76c5-4c44-a3bf-9dd5049ae407 tempest-FlavorsAccessTestJSON-437387745 tempest-FlavorsAccessTestJSON-437387745-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.432118 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e844ae78-466b-4aca-b319-ed2cd68617b2 tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.038709 Jul 20 04:10:35.432949 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 55/110] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:35 2022] POST /compute/v2.1/flavors => generated 422 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:35.453392 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cdafc631-76c5-4c44-a3bf-9dd5049ae407 tempest-FlavorsAccessTestJSON-437387745 tempest-FlavorsAccessTestJSON-437387745-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.035421 Jul 20 04:10:35.454668 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 56/111] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:35 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:35.460556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9d9b8aba-51ff-435f-b2c5-79364bd4864a tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.469747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f06dd1c-d96f-4a79-81ff-ed887f72c3c7 tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.470954 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:35.470954 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:35.472318 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9d9b8aba-51ff-435f-b2c5-79364bd4864a tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032544 Jul 20 04:10:35.474105 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 56/112] 10.222.0.20 () {58 vars in 1181 bytes} [Wed Jul 20 04:10:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:10:35.494345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8f16c00f-2148-4189-8d37-c311c965e13f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Action: 'create', calling method: .version_select at 0x7fbf9e140040>, body: {"keypair": {"name": "tempest-keypair-1375586087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3Je2M0dVsfPK2eXsgw3XdCXQK48BlwjWaUR+ioABin2WBDDZwYyi6VRS5ya0D4Z6T1LD/ADwAqohLjeCfbPlqHc82GFUxSiWu79ftYObEfsvSWOYsSJ1nbUl8mIM3oZw=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:35.525574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-8f16c00f-2148-4189-8d37-c311c965e13f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Getting quotas for project 8300f36d34c9455aabd936f5d69e130f. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:35.532415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-8f16c00f-2148-4189-8d37-c311c965e13f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Getting quotas for user 8aa6cffe813a43769950e2e05c45c82b and project 8300f36d34c9455aabd936f5d69e130f. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:35.536578 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f06dd1c-d96f-4a79-81ff-ed887f72c3c7 tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/46454086" status: 202 len: 0 microversion: 2.1 time: 0.070638 Jul 20 04:10:35.538645 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 57/113] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:10:35 2022] DELETE /compute/v2.1/flavors/46454086 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:35.549286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7ef3b5bb-ac9b-4ab8-807f-f8edb1157c75 tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.589662 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8f16c00f-2148-4189-8d37-c311c965e13f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102791 Jul 20 04:10:35.599136 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 57/114] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:10:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:35.611477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6ac174bf-648b-4d39-8c26-a7f97a1f38d8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.613375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6ac174bf-648b-4d39-8c26-a7f97a1f38d8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:35.628838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ac174bf-648b-4d39-8c26-a7f97a1f38d8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:35.629261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ac174bf-648b-4d39-8c26-a7f97a1f38d8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:35.632034 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7ef3b5bb-ac9b-4ab8-807f-f8edb1157c75 tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.088258 Jul 20 04:10:35.633210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ac174bf-648b-4d39-8c26-a7f97a1f38d8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:35.633644 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 58/115] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:35 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:35.634102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ac174bf-648b-4d39-8c26-a7f97a1f38d8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:35.658864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-05ed23b4-92d1-4b77-9c8a-fc4f81e1b3be tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-368687563", "id": 156704101, "os-flavor-access:is_public": "False"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:35.661117 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:35.661117 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:35.688343 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-05ed23b4-92d1-4b77-9c8a-fc4f81e1b3be tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.033674 Jul 20 04:10:35.690816 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 59/116] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:35 2022] POST /compute/v2.1/flavors => generated 427 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:35.711360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2bf685ca-4aca-4b8e-a647-df53ca3f7a6a tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.712346 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:35.712346 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:35.743291 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2bf685ca-4aca-4b8e-a647-df53ca3f7a6a tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/156704101/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.037671 Jul 20 04:10:35.744671 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 60/117] 10.222.0.20 () {58 vars in 1205 bytes} [Wed Jul 20 04:10:35 2022] GET /compute/v2.1/flavors/156704101/os-flavor-access => generated 21 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:35.756471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cc0d323e-3cd4-49b8-8ff6-5663aad72ad5 tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.777067 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cc0d323e-3cd4-49b8-8ff6-5663aad72ad5 tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/156704101" status: 202 len: 0 microversion: 2.1 time: 0.025479 Jul 20 04:10:35.777987 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 61/118] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:10:35 2022] DELETE /compute/v2.1/flavors/156704101 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:35.787150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2ba6ba5-095f-467e-b79e-39bc06714864 tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.817300 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2ba6ba5-095f-467e-b79e-39bc06714864 tempest-FlavorsAccessTestJSON-2136832334 tempest-FlavorsAccessTestJSON-2136832334-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.033758 Jul 20 04:10:35.819141 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 62/119] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:35 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:35.932312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6eb9df22-297a-40b9-a9a2-a3336723dc79 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.932412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6eb9df22-297a-40b9-a9a2-a3336723dc79 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:35.941162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6eb9df22-297a-40b9-a9a2-a3336723dc79 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:35.942540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6eb9df22-297a-40b9-a9a2-a3336723dc79 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:35.943328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6eb9df22-297a-40b9-a9a2-a3336723dc79 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:35.943785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6eb9df22-297a-40b9-a9a2-a3336723dc79 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:35.979147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6ac174bf-648b-4d39-8c26-a7f97a1f38d8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:35.987703 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6ac174bf-648b-4d39-8c26-a7f97a1f38d8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 0.386897 Jul 20 04:10:35.988295 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 58/120] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:35 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:36.192515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6eb9df22-297a-40b9-a9a2-a3336723dc79 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:36.214722 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6eb9df22-297a-40b9-a9a2-a3336723dc79 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1338 microversion: 2.1 time: 0.288228 Jul 20 04:10:36.217290 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 63/121] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:35 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1338 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:37.007876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-83fa97e6-7ee5-4999-9ce3-cd8c7ab4416b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:37.009122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-83fa97e6-7ee5-4999-9ce3-cd8c7ab4416b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:37.026708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83fa97e6-7ee5-4999-9ce3-cd8c7ab4416b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:37.029375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83fa97e6-7ee5-4999-9ce3-cd8c7ab4416b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:37.030668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83fa97e6-7ee5-4999-9ce3-cd8c7ab4416b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:37.033129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83fa97e6-7ee5-4999-9ce3-cd8c7ab4416b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:37.244525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-13e2e511-dba7-4ddd-9dd4-00d36b3c9b47 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:37.246074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-13e2e511-dba7-4ddd-9dd4-00d36b3c9b47 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:37.265436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-13e2e511-dba7-4ddd-9dd4-00d36b3c9b47 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:37.268404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-13e2e511-dba7-4ddd-9dd4-00d36b3c9b47 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:37.272501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-13e2e511-dba7-4ddd-9dd4-00d36b3c9b47 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:37.273872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-13e2e511-dba7-4ddd-9dd4-00d36b3c9b47 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:37.430695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-83fa97e6-7ee5-4999-9ce3-cd8c7ab4416b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:37.447478 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-83fa97e6-7ee5-4999-9ce3-cd8c7ab4416b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 0.444779 Jul 20 04:10:37.448426 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 59/122] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:37 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:38.063104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-13e2e511-dba7-4ddd-9dd4-00d36b3c9b47 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:38.078037 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-13e2e511-dba7-4ddd-9dd4-00d36b3c9b47 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1338 microversion: 2.1 time: 0.845543 Jul 20 04:10:38.081876 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 64/123] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:37 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1338 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:38.468254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d46fc8a1-225d-40a9-9480-916b2ff05c93 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:38.469842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d46fc8a1-225d-40a9-9480-916b2ff05c93 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:38.491421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d46fc8a1-225d-40a9-9480-916b2ff05c93 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:38.494859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d46fc8a1-225d-40a9-9480-916b2ff05c93 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:38.502439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d46fc8a1-225d-40a9-9480-916b2ff05c93 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:38.503851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d46fc8a1-225d-40a9-9480-916b2ff05c93 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:38.535531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f71b6d50-89a5-49b8-a09a-c1599a4473eb req-cbd6f332-211e-42c5-9b2c-265121500c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce6e616a-479d-497e-a6ff-89c5e2965e0f", "tag": "bae5f4bb-fd5b-4873-be2c-8f0099a89282"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:38.557798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f71b6d50-89a5-49b8-a09a-c1599a4473eb req-cbd6f332-211e-42c5-9b2c-265121500c7c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:38.559850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f71b6d50-89a5-49b8-a09a-c1599a4473eb req-cbd6f332-211e-42c5-9b2c-265121500c7c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:38.613177 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f71b6d50-89a5-49b8-a09a-c1599a4473eb req-cbd6f332-211e-42c5-9b2c-265121500c7c service nova] Creating event network-changed:bae5f4bb-fd5b-4873-be2c-8f0099a89282 for instance ce6e616a-479d-497e-a6ff-89c5e2965e0f on n-h1-764485-11 Jul 20 04:10:38.624213 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f71b6d50-89a5-49b8-a09a-c1599a4473eb req-cbd6f332-211e-42c5-9b2c-265121500c7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092019 Jul 20 04:10:38.625232 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 65/124] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:39.033735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d46fc8a1-225d-40a9-9480-916b2ff05c93 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:39.044496 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d46fc8a1-225d-40a9-9480-916b2ff05c93 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 0.579936 Jul 20 04:10:39.048856 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 60/125] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:38 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:39.100421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-20ccd941-798e-48d8-b6b8-4e3f0f7f81ae tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:39.101988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-20ccd941-798e-48d8-b6b8-4e3f0f7f81ae tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:39.115018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20ccd941-798e-48d8-b6b8-4e3f0f7f81ae tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:39.115497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20ccd941-798e-48d8-b6b8-4e3f0f7f81ae tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:39.116337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20ccd941-798e-48d8-b6b8-4e3f0f7f81ae tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:39.116785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20ccd941-798e-48d8-b6b8-4e3f0f7f81ae tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:39.379537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-20ccd941-798e-48d8-b6b8-4e3f0f7f81ae tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:39.389186 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-20ccd941-798e-48d8-b6b8-4e3f0f7f81ae tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1338 microversion: 2.1 time: 0.295300 Jul 20 04:10:39.391802 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 66/126] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:39 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1338 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:39.797169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2107542743", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "374739863", "adminPass": "***", "networks": [{"uuid": "2fbd62ae-21ae-4a6f-8124-aa6b740a976d"}], "security_groups": [{"name": "tempest-securitygroup--36669340"}], "key_name": "tempest-keypair-1375586087", "user_data": "}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:40.064494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-201f4642-4970-4f28-8b41-ba7f073368e5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:40.065005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-201f4642-4970-4f28-8b41-ba7f073368e5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:40.072681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-201f4642-4970-4f28-8b41-ba7f073368e5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:40.073634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-201f4642-4970-4f28-8b41-ba7f073368e5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:40.075125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-201f4642-4970-4f28-8b41-ba7f073368e5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:40.075911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-201f4642-4970-4f28-8b41-ba7f073368e5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:40.108455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] validate_networks() for [('2fbd62ae-21ae-4a6f-8124-aa6b740a976d', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:40.579051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-201f4642-4970-4f28-8b41-ba7f073368e5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:40.587225 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-201f4642-4970-4f28-8b41-ba7f073368e5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 0.526957 Jul 20 04:10:40.587837 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 67/127] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:40 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:40.604970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-275e6913-73ef-4ea8-9c5e-e6d8f94d8358 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:40.612642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-275e6913-73ef-4ea8-9c5e-e6d8f94d8358 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:40.625664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-275e6913-73ef-4ea8-9c5e-e6d8f94d8358 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:40.626086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-275e6913-73ef-4ea8-9c5e-e6d8f94d8358 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:40.626858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-275e6913-73ef-4ea8-9c5e-e6d8f94d8358 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:40.627283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-275e6913-73ef-4ea8-9c5e-e6d8f94d8358 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.032066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-275e6913-73ef-4ea8-9c5e-e6d8f94d8358 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:41.040601 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-275e6913-73ef-4ea8-9c5e-e6d8f94d8358 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1338 microversion: 2.1 time: 0.447915 Jul 20 04:10:41.042106 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 68/128] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:40 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1338 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:41.409508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-94d49533-1b59-454d-8423-4f4c7e597ca8 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Calling method '.version_select at 0x7fbf9df5c160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:41.411351 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:41.411351 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:41.412794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94d49533-1b59-454d-8423-4f4c7e597ca8 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.413575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94d49533-1b59-454d-8423-4f4c7e597ca8 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.430002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94d49533-1b59-454d-8423-4f4c7e597ca8 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.430774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94d49533-1b59-454d-8423-4f4c7e597ca8 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.475607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94d49533-1b59-454d-8423-4f4c7e597ca8 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.476413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94d49533-1b59-454d-8423-4f4c7e597ca8 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.488259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94d49533-1b59-454d-8423-4f4c7e597ca8 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.488911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94d49533-1b59-454d-8423-4f4c7e597ca8 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.503452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94d49533-1b59-454d-8423-4f4c7e597ca8 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.504093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94d49533-1b59-454d-8423-4f4c7e597ca8 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.511131 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-94d49533-1b59-454d-8423-4f4c7e597ca8 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1747 microversion: 2.53 time: 0.463687 Jul 20 04:10:41.512775 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 69/129] 10.222.0.20 () {60 vars in 1242 bytes} [Wed Jul 20 04:10:41 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1747 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:10:41.525594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2bc64f67-4732-4da3-b0e5-f47cc612126a tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Calling method '.version_select at 0x7fbf9df5c3a0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:41.527339 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:41.527339 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:41.529786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bc64f67-4732-4da3-b0e5-f47cc612126a tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.530438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bc64f67-4732-4da3-b0e5-f47cc612126a tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.548532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bc64f67-4732-4da3-b0e5-f47cc612126a tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.549204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bc64f67-4732-4da3-b0e5-f47cc612126a tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.579665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bc64f67-4732-4da3-b0e5-f47cc612126a tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.580644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bc64f67-4732-4da3-b0e5-f47cc612126a tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.595600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bc64f67-4732-4da3-b0e5-f47cc612126a tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.596233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bc64f67-4732-4da3-b0e5-f47cc612126a tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.616598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bc64f67-4732-4da3-b0e5-f47cc612126a tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.617259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bc64f67-4732-4da3-b0e5-f47cc612126a tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.624601 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2bc64f67-4732-4da3-b0e5-f47cc612126a tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 438 microversion: 2.53 time: 0.102677 Jul 20 04:10:41.625679 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 70/130] 10.222.0.20 () {60 vars in 1221 bytes} [Wed Jul 20 04:10:41 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 438 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:41.630571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f31cc398-d2f8-4934-9361-1a157212c013 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:41.631497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f31cc398-d2f8-4934-9361-1a157212c013 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:41.638389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f31cc398-d2f8-4934-9361-1a157212c013 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.639094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f31cc398-d2f8-4934-9361-1a157212c013 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.640081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f31cc398-d2f8-4934-9361-1a157212c013 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.640721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f31cc398-d2f8-4934-9361-1a157212c013 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.814383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:41.817473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:41.819314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:41.820115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:41.821804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:41.837315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.837944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.838879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.839317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.845453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f31cc398-d2f8-4934-9361-1a157212c013 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:41.850104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:41.854419 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f31cc398-d2f8-4934-9361-1a157212c013 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 0.227574 Jul 20 04:10:41.855631 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 71/131] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:41 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:41.855631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1d952d8d-f7a0-47a5-9cca-db3ef96a1e67 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Calling method '.version_select at 0x7fbf9dfb0f70>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:41.855631 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:41.855631 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:41.855631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d952d8d-f7a0-47a5-9cca-db3ef96a1e67 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.864692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d952d8d-f7a0-47a5-9cca-db3ef96a1e67 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.878184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Getting quotas for project 8300f36d34c9455aabd936f5d69e130f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:41.883543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Getting quotas for user 8aa6cffe813a43769950e2e05c45c82b and project 8300f36d34c9455aabd936f5d69e130f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:41.888504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d952d8d-f7a0-47a5-9cca-db3ef96a1e67 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.888960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d952d8d-f7a0-47a5-9cca-db3ef96a1e67 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.895721 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1d952d8d-f7a0-47a5-9cca-db3ef96a1e67 tempest-HypervisorAdminV253TestBase-1513869148 tempest-HypervisorAdminV253TestBase-1513869148-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/05e97dc5-250e-46cb-beb9-deb45e4e20e3" status: 200 len: 794 microversion: 2.53 time: 0.038650 Jul 20 04:10:41.898680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:41.900828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:10:41.905421 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 72/132] 10.222.0.20 () {60 vars in 1297 bytes} [Wed Jul 20 04:10:41 2022] GET /compute/v2.1/os-hypervisors/05e97dc5-250e-46cb-beb9-deb45e4e20e3 => generated 794 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:41.906722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:10:41.976417 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ca81ce9b-1675-4889-acb2-035e03bd981a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.185803 Jul 20 04:10:41.977498 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 61/133] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:39 2022] POST /compute/v2.1/servers => generated 400 bytes in 2187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:10:41.987877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7778f6dc-5d4a-4ae6-962c-53bcdcbfe25a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:41.988494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7778f6dc-5d4a-4ae6-962c-53bcdcbfe25a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:42.025442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=18 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:42.069934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7778f6dc-5d4a-4ae6-962c-53bcdcbfe25a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:42.080028 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7778f6dc-5d4a-4ae6-962c-53bcdcbfe25a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1263 microversion: 2.1 time: 0.095991 Jul 20 04:10:42.082366 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 62/134] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:41 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1263 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:42.089035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e5fabc6f-6a0e-4426-832f-a465c701d874 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:42.089723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e5fabc6f-6a0e-4426-832f-a465c701d874 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:42.111989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5fabc6f-6a0e-4426-832f-a465c701d874 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:42.112817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5fabc6f-6a0e-4426-832f-a465c701d874 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:42.114537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5fabc6f-6a0e-4426-832f-a465c701d874 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:42.115091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5fabc6f-6a0e-4426-832f-a465c701d874 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:42.154517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=36 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:42.315825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e5fabc6f-6a0e-4426-832f-a465c701d874 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:42.328857 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e5fabc6f-6a0e-4426-832f-a465c701d874 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1338 microversion: 2.1 time: 0.245161 Jul 20 04:10:42.339016 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 63/135] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:42 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1338 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:42.432609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a078251c-e58b-41af-b058-ee2f9ba7f297 tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066 tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:42.434513 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:42.434513 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:42.438358 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a078251c-e58b-41af-b058-ee2f9ba7f297 tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066 tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a078251c-e58b-41af-b058-ee2f9ba7f297 tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066 tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066-project-admin] Request method failure captured: Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BBqKRKzr0Q7ySevmi2ZZsfip5ZB4XUnwsnDaF6fDL3eX26pUQ-RbPx61fzISUGCS0nOvTNG4quUXYaZxUfrlmJiMPY4LjebVwFrHGa8DRvV95TbsaYLp0TOxRkm67JGaFOn_7wB_8KJF9VORyWW6QPbZj4QXXYmWF1WvPEqAZD7Xo Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 9e7e8307b0ff401db01c840edf0364dc Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066 Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:10:42.445488 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:10:42.446793 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7e8307b0ff401db01c840edf0364dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e8307b0ff401db01c840edf0364dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7e8307b0ff401db01c840edf0364dc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e8307b0ff401db01c840edf0364dc"}]}] Jul 20 04:10:42.446793 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066 Jul 20 04:10:42.446793 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 9e7e8307b0ff401db01c840edf0364dc Jul 20 04:10:42.446793 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066 Jul 20 04:10:42.446793 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066-project-admin Jul 20 04:10:42.446793 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:42.446793 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:42.446793 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: df953616b77b473b983970bf5b9432a0 Jul 20 04:10:42.446793 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066-project-admin Jul 20 04:10:42.446793 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:10:42.446793 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid timestamp for date invalid_time Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'invalid_time'} Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:42.447465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 20 04:10:42.448818 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.451765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a078251c-e58b-41af-b058-ee2f9ba7f297 tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066 tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:42.453450 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a078251c-e58b-41af-b058-ee2f9ba7f297 tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066 tempest-InstanceUsageAuditLogNegativeTestJSON-2116746066-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.546573 Jul 20 04:10:42.459456 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 73/136] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 04:10:41 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 553 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:10:42.710755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d853ec05-6135-42da-90d9-4254c916258e tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:42.712813 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:42.712813 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:42.716131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d853ec05-6135-42da-90d9-4254c916258e tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '3a3616d5e39b4d3598bdca8ecaa42d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd2be2231194e6c9c47e7568f012c3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d853ec05-6135-42da-90d9-4254c916258e tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project] Request method failure captured: Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14A_349IV9rJc5mggbmxvIU8F0vI_QdMeLJ3o40iB4sNlDIcTv1CfHpTt7P0YWJQKhR00LZfaS1cY2ylwXNQ1rEwI2DkvuyJ9ue8YKRfvQunGPrAsxD8ztEww3YYrJQk0vDEfJqoIC2U311IumOHiiSeuQHamS2WiQUmfCB7ls19SgA Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: acd2be2231194e6c9c47e7568f012c3e Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:42.718610 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:42.720063 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/acd2be2231194e6c9c47e7568f012c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/acd2be2231194e6c9c47e7568f012c3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_acd2be2231194e6c9c47e7568f012c3e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/acd2be2231194e6c9c47e7568f012c3e"}]}] Jul 20 04:10:42.720063 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 Jul 20 04:10:42.720063 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: acd2be2231194e6c9c47e7568f012c3e Jul 20 04:10:42.720063 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 Jul 20 04:10:42.720063 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project Jul 20 04:10:42.720063 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:42.720063 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:42.720063 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3a3616d5e39b4d3598bdca8ecaa42d6a Jul 20 04:10:42.720063 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project Jul 20 04:10:42.720063 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:42.720063 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: action_args: {} Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:42.720765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 04:10:42.721900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.724489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d853ec05-6135-42da-90d9-4254c916258e tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:42.725515 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d853ec05-6135-42da-90d9-4254c916258e tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.257545 Jul 20 04:10:42.730161 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 64/137] 10.222.0.20 () {58 vars in 1184 bytes} [Wed Jul 20 04:10:42 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:42.735776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2b0358e1-57c5-40e4-ad06-78073ddfab9f tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:42.737635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2b0358e1-57c5-40e4-ad06-78073ddfab9f tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '3a3616d5e39b4d3598bdca8ecaa42d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd2be2231194e6c9c47e7568f012c3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2b0358e1-57c5-40e4-ad06-78073ddfab9f tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project] Request method failure captured: Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2004:10:42 HTTP/1.1 Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14A_349IV9rJc5mggbmxvIU8F0vI_QdMeLJ3o40iB4sNlDIcTv1CfHpTt7P0YWJQKhR00LZfaS1cY2ylwXNQ1rEwI2DkvuyJ9ue8YKRfvQunGPrAsxD8ztEww3YYrJQk0vDEfJqoIC2U311IumOHiiSeuQHamS2WiQUmfCB7ls19SgA Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: acd2be2231194e6c9c47e7568f012c3e Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:10:42.739258 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:10:42.740635 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/acd2be2231194e6c9c47e7568f012c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/acd2be2231194e6c9c47e7568f012c3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_acd2be2231194e6c9c47e7568f012c3e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/acd2be2231194e6c9c47e7568f012c3e"}]}] Jul 20 04:10:42.740635 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 Jul 20 04:10:42.740635 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: acd2be2231194e6c9c47e7568f012c3e Jul 20 04:10:42.740635 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 Jul 20 04:10:42.740635 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project Jul 20 04:10:42.740635 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:42.740635 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:42.740635 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 3a3616d5e39b4d3598bdca8ecaa42d6a Jul 20 04:10:42.740635 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project Jul 20 04:10:42.740635 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:10:42.740635 n-d-764485-11 devstack@n-api.service[119807]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '2022-07-20 04:10:42'} Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:42.745380 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.746559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2b0358e1-57c5-40e4-ad06-78073ddfab9f tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:42.747477 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2b0358e1-57c5-40e4-ad06-78073ddfab9f tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851 tempest-InstanceUsageAuditLogNegativeTestJSON-1665072851-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20 04:10:42" status: 403 len: 128 microversion: 2.1 time: 0.008950 Jul 20 04:10:42.747477 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 74/138] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 04:10:42 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2004%3A10%3A42 => generated 128 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:42.873168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d31c0ab1-517c-4631-8ab9-eb975e90ca4b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:42.874400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d31c0ab1-517c-4631-8ab9-eb975e90ca4b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:42.887067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d31c0ab1-517c-4631-8ab9-eb975e90ca4b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:42.888415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d31c0ab1-517c-4631-8ab9-eb975e90ca4b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:42.890091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d31c0ab1-517c-4631-8ab9-eb975e90ca4b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:42.890540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d31c0ab1-517c-4631-8ab9-eb975e90ca4b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.101342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2504060f-ec3d-4183-99c9-baf7fbbb29df tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:43.102323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2504060f-ec3d-4183-99c9-baf7fbbb29df tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:43.114687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2504060f-ec3d-4183-99c9-baf7fbbb29df tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.116319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2504060f-ec3d-4183-99c9-baf7fbbb29df tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.118637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2504060f-ec3d-4183-99c9-baf7fbbb29df tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.122568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2504060f-ec3d-4183-99c9-baf7fbbb29df tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.134212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d31c0ab1-517c-4631-8ab9-eb975e90ca4b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:43.146877 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d31c0ab1-517c-4631-8ab9-eb975e90ca4b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 0.278451 Jul 20 04:10:43.148067 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 65/139] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:42 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:43.270326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2504060f-ec3d-4183-99c9-baf7fbbb29df tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:43.280252 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2504060f-ec3d-4183-99c9-baf7fbbb29df tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1315 microversion: 2.1 time: 0.184220 Jul 20 04:10:43.281593 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 75/140] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:43 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:43.350148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10f8da77-3b48-46b2-b996-fb05adcf9096 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:43.351572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-10f8da77-3b48-46b2-b996-fb05adcf9096 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:43.360702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10f8da77-3b48-46b2-b996-fb05adcf9096 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.361637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10f8da77-3b48-46b2-b996-fb05adcf9096 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.363231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10f8da77-3b48-46b2-b996-fb05adcf9096 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.363728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10f8da77-3b48-46b2-b996-fb05adcf9096 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.665565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10f8da77-3b48-46b2-b996-fb05adcf9096 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:43.676866 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-10f8da77-3b48-46b2-b996-fb05adcf9096 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1338 microversion: 2.1 time: 0.333151 Jul 20 04:10:43.695449 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 66/141] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:43 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1338 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:44.165977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3a2c621b-290f-42ab-9c3a-a5ed61d43469 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:44.167592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3a2c621b-290f-42ab-9c3a-a5ed61d43469 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:44.177330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a2c621b-290f-42ab-9c3a-a5ed61d43469 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.178033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a2c621b-290f-42ab-9c3a-a5ed61d43469 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.179139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a2c621b-290f-42ab-9c3a-a5ed61d43469 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.179814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a2c621b-290f-42ab-9c3a-a5ed61d43469 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.300879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e2f2ddf0-ce9a-4119-ac57-3db9dddc7ee2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:44.302146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e2f2ddf0-ce9a-4119-ac57-3db9dddc7ee2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:44.319689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2f2ddf0-ce9a-4119-ac57-3db9dddc7ee2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.320308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2f2ddf0-ce9a-4119-ac57-3db9dddc7ee2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.326114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2f2ddf0-ce9a-4119-ac57-3db9dddc7ee2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.326826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2f2ddf0-ce9a-4119-ac57-3db9dddc7ee2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.500731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e2f2ddf0-ce9a-4119-ac57-3db9dddc7ee2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:44.510491 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e2f2ddf0-ce9a-4119-ac57-3db9dddc7ee2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1321 microversion: 2.1 time: 0.215647 Jul 20 04:10:44.531673 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 67/142] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:44 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:44.659277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3a2c621b-290f-42ab-9c3a-a5ed61d43469 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:44.671229 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3a2c621b-290f-42ab-9c3a-a5ed61d43469 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 0.509944 Jul 20 04:10:44.671868 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 76/143] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:44 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:44.695160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e3cd3a2-57b8-4f47-96e6-8b425f39d317 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:44.695813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3e3cd3a2-57b8-4f47-96e6-8b425f39d317 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:44.705894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e3cd3a2-57b8-4f47-96e6-8b425f39d317 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.706370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e3cd3a2-57b8-4f47-96e6-8b425f39d317 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.707010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e3cd3a2-57b8-4f47-96e6-8b425f39d317 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.707452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e3cd3a2-57b8-4f47-96e6-8b425f39d317 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.981815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3e3cd3a2-57b8-4f47-96e6-8b425f39d317 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:44.994738 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3e3cd3a2-57b8-4f47-96e6-8b425f39d317 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1338 microversion: 2.1 time: 0.303564 Jul 20 04:10:45.000948 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 68/144] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:44 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1338 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:45.104702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-4068a264-000e-47a8-ac29-e8ef8d521ec3 req-8ee0a38a-e740-40d6-b053-e3f1d78bb0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff00481-daa9-41ee-a128-2684117e0c50", "name": "network-vif-plugged", "status": "completed", "tag": "670aa06e-f892-4ef8-a4e3-6587fb3c3c90"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:45.122760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4068a264-000e-47a8-ac29-e8ef8d521ec3 req-8ee0a38a-e740-40d6-b053-e3f1d78bb0c4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:45.123242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4068a264-000e-47a8-ac29-e8ef8d521ec3 req-8ee0a38a-e740-40d6-b053-e3f1d78bb0c4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:45.148327 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-4068a264-000e-47a8-ac29-e8ef8d521ec3 req-8ee0a38a-e740-40d6-b053-e3f1d78bb0c4 service nova] Creating event network-vif-plugged:670aa06e-f892-4ef8-a4e3-6587fb3c3c90 for instance 6ff00481-daa9-41ee-a128-2684117e0c50 on n-h1-764485-11 Jul 20 04:10:45.160677 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-4068a264-000e-47a8-ac29-e8ef8d521ec3 req-8ee0a38a-e740-40d6-b053-e3f1d78bb0c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.396737 Jul 20 04:10:45.161479 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 77/145] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:45.546665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fea76202-6fbd-4a68-9d7e-08d426d644a2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:45.547448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fea76202-6fbd-4a68-9d7e-08d426d644a2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:45.551828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=7,nova_api:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:45.566465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fea76202-6fbd-4a68-9d7e-08d426d644a2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:45.570659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fea76202-6fbd-4a68-9d7e-08d426d644a2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:45.572274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fea76202-6fbd-4a68-9d7e-08d426d644a2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:45.572803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fea76202-6fbd-4a68-9d7e-08d426d644a2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:45.698161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fea76202-6fbd-4a68-9d7e-08d426d644a2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:45.708369 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fea76202-6fbd-4a68-9d7e-08d426d644a2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1321 microversion: 2.1 time: 0.171482 Jul 20 04:10:45.709145 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 78/146] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:45 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:45.726006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-884379f6-1d94-4993-8a23-c062c227437b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:45.726704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-884379f6-1d94-4993-8a23-c062c227437b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:45.733594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-884379f6-1d94-4993-8a23-c062c227437b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:45.734052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-884379f6-1d94-4993-8a23-c062c227437b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:45.734836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-884379f6-1d94-4993-8a23-c062c227437b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:45.735273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-884379f6-1d94-4993-8a23-c062c227437b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:45.756864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:45.759055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c3c4e45-c798-45b2-880b-6acf160e710d tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1508033592", "id": 531678008, "os-flavor-access:is_public": "False"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:45.761251 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:45.761251 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:45.787113 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8c3c4e45-c798-45b2-880b-6acf160e710d tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.472325 Jul 20 04:10:45.788126 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 69/147] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:45 2022] POST /compute/v2.1/flavors => generated 436 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:45.802061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16cae860-a6e9-4c84-8383-e77c64674ca3 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8ee0fef66fb642668bbcdc91a0e5cb03"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:45.803603 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:45.803603 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:45.908875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-884379f6-1d94-4993-8a23-c062c227437b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:45.917871 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-884379f6-1d94-4993-8a23-c062c227437b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 0.196160 Jul 20 04:10:45.929373 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 79/148] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:45 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:46.021990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5bd836bf-cf4f-44c1-a790-eeb473f0a8ac tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:46.023096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5bd836bf-cf4f-44c1-a790-eeb473f0a8ac tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:46.031235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5bd836bf-cf4f-44c1-a790-eeb473f0a8ac tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:46.033157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5bd836bf-cf4f-44c1-a790-eeb473f0a8ac tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:46.034336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5bd836bf-cf4f-44c1-a790-eeb473f0a8ac tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:46.035765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5bd836bf-cf4f-44c1-a790-eeb473f0a8ac tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:46.297738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5bd836bf-cf4f-44c1-a790-eeb473f0a8ac tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:46.307100 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5bd836bf-cf4f-44c1-a790-eeb473f0a8ac tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1338 microversion: 2.1 time: 0.296771 Jul 20 04:10:46.319814 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 80/149] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:46 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1338 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:46.453918 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-16cae860-a6e9-4c84-8383-e77c64674ca3 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/531678008/action" status: 200 len: 96 microversion: 2.1 time: 0.657930 Jul 20 04:10:46.454529 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 70/150] 10.222.0.20 () {60 vars in 1196 bytes} [Wed Jul 20 04:10:45 2022] POST /compute/v2.1/flavors/531678008/action => generated 96 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:10:46.465872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f7f2357e-554c-4ba6-b741-4d3f04b0d476 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8ee0fef66fb642668bbcdc91a0e5cb03"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:46.467833 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:46.467833 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:46.726346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-24c92691-4382-4369-bfc1-491e611e8e70 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:46.727007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-24c92691-4382-4369-bfc1-491e611e8e70 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:46.737028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24c92691-4382-4369-bfc1-491e611e8e70 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:46.737969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24c92691-4382-4369-bfc1-491e611e8e70 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:46.741093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24c92691-4382-4369-bfc1-491e611e8e70 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:46.741671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24c92691-4382-4369-bfc1-491e611e8e70 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:46.828711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-24c92691-4382-4369-bfc1-491e611e8e70 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:46.836840 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f7f2357e-554c-4ba6-b741-4d3f04b0d476 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] HTTP exception thrown: Flavor access already exists for flavor 20 and project 8ee0fef66fb642668bbcdc91a0e5cb03 combination. Jul 20 04:10:46.837338 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-24c92691-4382-4369-bfc1-491e611e8e70 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1321 microversion: 2.1 time: 0.115102 Jul 20 04:10:46.837915 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 71/151] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:46 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1321 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f7f2357e-554c-4ba6-b741-4d3f04b0d476 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Request method failure captured: Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/flavors/531678008/action HTTP/1.1 Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 67 Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BDkIhhkHMiTvbyw0v_0XjyozfQs0_mqRX6tYchgkqFxz54XGYjEuUd1VFBWbi9uV83Sdoz7dBMbn6aQmaGkHkxI-D5wc8rd4XiCxIBca6cjXBcyNBQ_6DV39i77QwhpJ6fBZ_AqZeYEFRuxnYkZ00Grc8FyyNIKLsLOunKKEReu_M Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 657ea770ff504417986c88de1b4e5b5b Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1866966528 Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:10:46.843713 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:10:46.845224 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/657ea770ff504417986c88de1b4e5b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/657ea770ff504417986c88de1b4e5b5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_657ea770ff504417986c88de1b4e5b5b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/657ea770ff504417986c88de1b4e5b5b"}]}] Jul 20 04:10:46.845224 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1866966528 Jul 20 04:10:46.845224 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 657ea770ff504417986c88de1b4e5b5b Jul 20 04:10:46.845224 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1866966528 Jul 20 04:10:46.845224 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin Jul 20 04:10:46.845224 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:46.845224 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:46.845224 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 8fb60a2ae1784dcb94e351ec6596dffb Jul 20 04:10:46.845224 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin Jul 20 04:10:46.845224 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:46.845224 n-d-764485-11 devstack@n-api.service[119807]: {"addTenantAccess": {"tenant": "8ee0fef66fb642668bbcdc91a0e5cb03"}} Jul 20 04:10:46.845224 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: exception: Flavor access already exists for flavor 20 and project 8ee0fef66fb642668bbcdc91a0e5cb03 combination. Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '531678008', 'body': {'addTenantAccess': {'tenant': '8ee0fef66fb642668bbcdc91a0e5cb03'}}} Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:10:46.846040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '20-8ee0fef66fb642668bbcdc91a0e5cb03' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 04:10:46.847274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 04:10:46.848492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:10:46.849538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '20-8ee0fef66fb642668bbcdc91a0e5cb03' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 4, 10, 46, 832163), 'updated_at': None, 'flavor_id': 20, 'project_id': '8ee0fef66fb642668bbcdc91a0e5cb03'}] Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:46.850655 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 20 and project 8ee0fef66fb642668bbcdc91a0e5cb03 combination. Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:46.851987 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 20 and project 8ee0fef66fb642668bbcdc91a0e5cb03 combination. Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:46.854023 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:46.864091 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 20 and project 8ee0fef66fb642668bbcdc91a0e5cb03 combination. Jul 20 04:10:46.864091 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:46.864091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f7f2357e-554c-4ba6-b741-4d3f04b0d476 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Returning 409 to user: Flavor access already exists for flavor 20 and project 8ee0fef66fb642668bbcdc91a0e5cb03 combination. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:46.864091 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f7f2357e-554c-4ba6-b741-4d3f04b0d476 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/531678008/action" status: 409 len: 152 microversion: 2.1 time: 0.391379 Jul 20 04:10:46.864091 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 81/152] 10.222.0.20 () {60 vars in 1196 bytes} [Wed Jul 20 04:10:46 2022] POST /compute/v2.1/flavors/531678008/action => generated 152 bytes in 393 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:46.864621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-38f45c9f-4487-48ef-bc2d-13f2c3f7a8dc tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8ee0fef66fb642668bbcdc91a0e5cb03"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:46.864991 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:46.864991 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:46.950606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-51447e86-5311-4511-91dd-457a8f34faa7 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:46.951426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-51447e86-5311-4511-91dd-457a8f34faa7 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:46.959253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51447e86-5311-4511-91dd-457a8f34faa7 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:46.960716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51447e86-5311-4511-91dd-457a8f34faa7 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:46.962477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51447e86-5311-4511-91dd-457a8f34faa7 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:46.963761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51447e86-5311-4511-91dd-457a8f34faa7 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:47.158432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-51447e86-5311-4511-91dd-457a8f34faa7 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:47.168543 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-51447e86-5311-4511-91dd-457a8f34faa7 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1341 microversion: 2.1 time: 0.229708 Jul 20 04:10:47.169325 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 82/153] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:46 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1341 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:47.258800 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-38f45c9f-4487-48ef-bc2d-13f2c3f7a8dc tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/531678008/action" status: 200 len: 21 microversion: 2.1 time: 0.400721 Jul 20 04:10:47.260213 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 72/154] 10.222.0.20 () {60 vars in 1196 bytes} [Wed Jul 20 04:10:46 2022] POST /compute/v2.1/flavors/531678008/action => generated 21 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:10:47.272587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-475a2468-5261-4c34-b3f0-f076520adee1 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:47.273653 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:47.273653 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:47.302290 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-475a2468-5261-4c34-b3f0-f076520adee1 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/531678008" status: 202 len: 0 microversion: 2.1 time: 0.033597 Jul 20 04:10:47.320160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39abab60-6d2d-4c46-8b66-0feb76f7d0c2 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:47.324165 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 83/155] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:10:47 2022] DELETE /compute/v2.1/flavors/531678008 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:47.335854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c116fe3e-9b7a-430c-95c0-7cb0c2cb7f22 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:47.339842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c116fe3e-9b7a-430c-95c0-7cb0c2cb7f22 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:47.369464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c116fe3e-9b7a-430c-95c0-7cb0c2cb7f22 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.372483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c116fe3e-9b7a-430c-95c0-7cb0c2cb7f22 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:47.373709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c116fe3e-9b7a-430c-95c0-7cb0c2cb7f22 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.376017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c116fe3e-9b7a-430c-95c0-7cb0c2cb7f22 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:47.402789 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39abab60-6d2d-4c46-8b66-0feb76f7d0c2 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.086960 Jul 20 04:10:47.424477 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 73/156] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:47 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:47.433297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5a740fc-8cb5-45db-ab8c-1192231bb6fa tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1966849360", "id": 1784806099, "os-flavor-access:is_public": "True"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:47.436364 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:47.436364 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:47.473845 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d5a740fc-8cb5-45db-ab8c-1192231bb6fa tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.047850 Jul 20 04:10:47.485385 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 74/157] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:47 2022] POST /compute/v2.1/flavors => generated 438 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:47.497921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e08f2a2b-fbf6-4d0d-969a-17957e386c5c tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:47.499016 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:47.499016 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:47.507160 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-e08f2a2b-fbf6-4d0d-969a-17957e386c5c tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e08f2a2b-fbf6-4d0d-969a-17957e386c5c tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Request method failure captured: Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/flavors/1784806099/os-flavor-access HTTP/1.1 Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BDkIhhkHMiTvbyw0v_0XjyozfQs0_mqRX6tYchgkqFxz54XGYjEuUd1VFBWbi9uV83Sdoz7dBMbn6aQmaGkHkxI-D5wc8rd4XiCxIBca6cjXBcyNBQ_6DV39i77QwhpJ6fBZ_AqZeYEFRuxnYkZ00Grc8FyyNIKLsLOunKKEReu_M Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 657ea770ff504417986c88de1b4e5b5b Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1866966528 Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:10:47.509499 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:10:47.510731 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/657ea770ff504417986c88de1b4e5b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/657ea770ff504417986c88de1b4e5b5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_657ea770ff504417986c88de1b4e5b5b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/657ea770ff504417986c88de1b4e5b5b"}]}] Jul 20 04:10:47.510731 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1866966528 Jul 20 04:10:47.510731 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 657ea770ff504417986c88de1b4e5b5b Jul 20 04:10:47.510731 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1866966528 Jul 20 04:10:47.510731 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin Jul 20 04:10:47.510731 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:47.510731 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:47.510731 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8fb60a2ae1784dcb94e351ec6596dffb Jul 20 04:10:47.510731 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin Jul 20 04:10:47.510731 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:47.510731 n-d-764485-11 devstack@n-api.service[119808]: exception: Access list not available for public flavors. Jul 20 04:10:47.510731 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'flavor_id': '1784806099'} Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 20 04:10:47.511400 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:47.514624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e08f2a2b-fbf6-4d0d-969a-17957e386c5c tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:47.517080 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e08f2a2b-fbf6-4d0d-969a-17957e386c5c tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1784806099/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029747 Jul 20 04:10:47.522123 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 75/158] 10.222.0.20 () {58 vars in 1208 bytes} [Wed Jul 20 04:10:47 2022] GET /compute/v2.1/flavors/1784806099/os-flavor-access => generated 91 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:47.530783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-509cc4ec-570f-4248-a925-a1032317d638 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:47.533115 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:47.533115 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:47.618374 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-509cc4ec-570f-4248-a925-a1032317d638 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1784806099" status: 202 len: 0 microversion: 2.1 time: 0.094049 Jul 20 04:10:47.618963 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 76/159] 10.222.0.20 () {58 vars in 1160 bytes} [Wed Jul 20 04:10:47 2022] DELETE /compute/v2.1/flavors/1784806099 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:47.629173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5018c780-44ef-4928-9668-610ab52c323d tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:47.630348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c116fe3e-9b7a-430c-95c0-7cb0c2cb7f22 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:47.647932 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c116fe3e-9b7a-430c-95c0-7cb0c2cb7f22 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1338 microversion: 2.1 time: 0.320868 Jul 20 04:10:47.648537 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 84/160] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:47 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1338 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:47.662667 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5018c780-44ef-4928-9668-610ab52c323d tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.038371 Jul 20 04:10:47.663898 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 77/161] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:47 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:47.683628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-80e1ae34-ae44-4f33-ac32-9a593d4f5556 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1113066337", "id": 134215173, "os-flavor-access:is_public": "False"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:47.686189 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:47.686189 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:47.709108 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-80e1ae34-ae44-4f33-ac32-9a593d4f5556 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.031107 Jul 20 04:10:47.715789 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 85/162] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:47 2022] POST /compute/v2.1/flavors => generated 436 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:47.858259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-55713a22-efa9-4e39-b4f5-f58914897bab tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:47.859321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-55713a22-efa9-4e39-b4f5-f58914897bab tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:47.873969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55713a22-efa9-4e39-b4f5-f58914897bab tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.876111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55713a22-efa9-4e39-b4f5-f58914897bab tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:47.878057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55713a22-efa9-4e39-b4f5-f58914897bab tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.879321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55713a22-efa9-4e39-b4f5-f58914897bab tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:48.095736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-55713a22-efa9-4e39-b4f5-f58914897bab tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:48.112399 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-55713a22-efa9-4e39-b4f5-f58914897bab tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1321 microversion: 2.1 time: 0.261599 Jul 20 04:10:48.113287 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 86/163] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:47 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:48.128507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9ba312c-2677-4d46-bc43-c00186c4e8f3 tempest-FlavorsAccessNegativeTestJSON-575687560 tempest-FlavorsAccessNegativeTestJSON-575687560-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8ee0fef66fb642668bbcdc91a0e5cb03"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:48.130406 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:48.130406 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:48.131892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9ba312c-2677-4d46-bc43-c00186c4e8f3 tempest-FlavorsAccessNegativeTestJSON-575687560 tempest-FlavorsAccessNegativeTestJSON-575687560-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd86020975cc84780bc46dceef260d309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0fef66fb642668bbcdc91a0e5cb03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9ba312c-2677-4d46-bc43-c00186c4e8f3 tempest-FlavorsAccessNegativeTestJSON-575687560 tempest-FlavorsAccessNegativeTestJSON-575687560-project] Request method failure captured: Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/flavors/134215173/action HTTP/1.1 Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 67 Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BB2Un9rqbbj-vLGeGBnN-bWf_nwVxev3da9uLBaUOUIz3BQEzvVVSfxrq6Ur7dvuudGHqMR42sj-Sp9WNoLEO_sFOpxIstWHSLqrFIl0OgsGfrHl89c31zvyarSpLHVGbywGQlPx8a_dEERq4phmR9fgaGLgZFiYUm8k_4tYVmRpE Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 8ee0fef66fb642668bbcdc91a0e5cb03 Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-575687560 Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:48.134274 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:48.135466 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ee0fef66fb642668bbcdc91a0e5cb03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ee0fef66fb642668bbcdc91a0e5cb03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ee0fef66fb642668bbcdc91a0e5cb03", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ee0fef66fb642668bbcdc91a0e5cb03"}]}] Jul 20 04:10:48.135466 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-575687560 Jul 20 04:10:48.135466 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 8ee0fef66fb642668bbcdc91a0e5cb03 Jul 20 04:10:48.135466 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-575687560 Jul 20 04:10:48.135466 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FlavorsAccessNegativeTestJSON-575687560-project Jul 20 04:10:48.135466 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:48.135466 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:48.135466 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: d86020975cc84780bc46dceef260d309 Jul 20 04:10:48.135466 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-575687560-project Jul 20 04:10:48.135466 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:10:48.135466 n-d-764485-11 devstack@n-api.service[119808]: {"addTenantAccess": {"tenant": "8ee0fef66fb642668bbcdc91a0e5cb03"}} Jul 20 04:10:48.135466 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '134215173', 'body': {'addTenantAccess': {'tenant': '8ee0fef66fb642668bbcdc91a0e5cb03'}}} Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:48.136191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 04:10:48.137584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:48.146455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9ba312c-2677-4d46-bc43-c00186c4e8f3 tempest-FlavorsAccessNegativeTestJSON-575687560 tempest-FlavorsAccessNegativeTestJSON-575687560-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:48.147563 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9ba312c-2677-4d46-bc43-c00186c4e8f3 tempest-FlavorsAccessNegativeTestJSON-575687560 tempest-FlavorsAccessNegativeTestJSON-575687560-project] 10.222.0.20 "POST /compute/v2.1/flavors/134215173/action" status: 403 len: 130 microversion: 2.1 time: 0.429990 Jul 20 04:10:48.149250 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 78/164] 10.222.0.20 () {60 vars in 1196 bytes} [Wed Jul 20 04:10:47 2022] POST /compute/v2.1/flavors/134215173/action => generated 130 bytes in 433 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:48.158412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c67b1877-25f6-40cd-a35b-c6eb82e44961 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:48.159025 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:48.159025 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:48.189158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f5a7c7c7-bda0-4a40-867e-8f0ad2e71b85 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:48.189360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f5a7c7c7-bda0-4a40-867e-8f0ad2e71b85 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:48.200495 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c67b1877-25f6-40cd-a35b-c6eb82e44961 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/134215173" status: 202 len: 0 microversion: 2.1 time: 0.042813 Jul 20 04:10:48.201490 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 87/165] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:10:48 2022] DELETE /compute/v2.1/flavors/134215173 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:48.203447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f5a7c7c7-bda0-4a40-867e-8f0ad2e71b85 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:48.204256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f5a7c7c7-bda0-4a40-867e-8f0ad2e71b85 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:48.211710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f5a7c7c7-bda0-4a40-867e-8f0ad2e71b85 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:48.214235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f5a7c7c7-bda0-4a40-867e-8f0ad2e71b85 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:48.218099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f56a3987-a291-422f-8738-50a61f8536a0 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:48.272985 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f56a3987-a291-422f-8738-50a61f8536a0 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.061685 Jul 20 04:10:48.274295 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 88/166] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:48 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:48.282987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ff769f97-3e5b-46ce-88ea-d053df54e674 req-550e49b8-f4da-421f-8723-25336be89598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6e616a-479d-497e-a6ff-89c5e2965e0f", "name": "network-vif-plugged", "status": "completed", "tag": "bae5f4bb-fd5b-4873-be2c-8f0099a89282"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:48.305868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ff769f97-3e5b-46ce-88ea-d053df54e674 req-550e49b8-f4da-421f-8723-25336be89598 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:48.306311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ff769f97-3e5b-46ce-88ea-d053df54e674 req-550e49b8-f4da-421f-8723-25336be89598 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:48.332479 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ff769f97-3e5b-46ce-88ea-d053df54e674 req-550e49b8-f4da-421f-8723-25336be89598 service nova] Creating event network-vif-plugged:bae5f4bb-fd5b-4873-be2c-8f0099a89282 for instance ce6e616a-479d-497e-a6ff-89c5e2965e0f on n-h1-764485-11 Jul 20 04:10:48.343116 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ff769f97-3e5b-46ce-88ea-d053df54e674 req-550e49b8-f4da-421f-8723-25336be89598 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067137 Jul 20 04:10:48.344408 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 89/167] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:48.359131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-789d6fa4-3175-4007-86b8-966e44691185 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1107153552", "id": 406556319, "os-flavor-access:is_public": "False"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:48.363758 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:48.363758 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:48.399140 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-789d6fa4-3175-4007-86b8-966e44691185 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.047495 Jul 20 04:10:48.400277 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 90/168] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:48 2022] POST /compute/v2.1/flavors => generated 436 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:48.412341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e28dc3b5-3c26-42b2-b624-c7f915f33125 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8ee0fef66fb642668bbcdc91a0e5cb03"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:48.414301 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:48.414301 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:48.686034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f5a7c7c7-bda0-4a40-867e-8f0ad2e71b85 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:48.694562 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f5a7c7c7-bda0-4a40-867e-8f0ad2e71b85 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1491 microversion: 2.1 time: 0.512322 Jul 20 04:10:48.697980 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 79/169] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:48 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1491 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:48.704041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1dd44597-8250-47c9-b39d-ea1da7051570 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:48.705104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1dd44597-8250-47c9-b39d-ea1da7051570 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:48.732327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dd44597-8250-47c9-b39d-ea1da7051570 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:48.733977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dd44597-8250-47c9-b39d-ea1da7051570 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:48.735315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dd44597-8250-47c9-b39d-ea1da7051570 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:48.736442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dd44597-8250-47c9-b39d-ea1da7051570 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:48.912958 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e28dc3b5-3c26-42b2-b624-c7f915f33125 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/406556319/action" status: 200 len: 96 microversion: 2.1 time: 0.504363 Jul 20 04:10:48.914586 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 91/170] 10.222.0.20 () {60 vars in 1196 bytes} [Wed Jul 20 04:10:48 2022] POST /compute/v2.1/flavors/406556319/action => generated 96 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:49.103003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1dd44597-8250-47c9-b39d-ea1da7051570 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:49.127231 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1dd44597-8250-47c9-b39d-ea1da7051570 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1338 microversion: 2.1 time: 0.427367 Jul 20 04:10:49.129699 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 80/171] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:48 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1338 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:49.390057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bb321cf8-4a2b-4243-8186-5a4e0856078b tempest-SecurityGroupsTestAdminJSON-828669229 tempest-SecurityGroupsTestAdminJSON-828669229-project] Action: 'create', calling method: .version_select at 0x7fbf9e1f5280>, body: {"security_group": {"name": "tempest-securitygroup-711957408", "description": "tempest-description-1763099184"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:49.396067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-94f64b03-62a1-4ad4-8a5d-b9b51e919242 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:49.396947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-94f64b03-62a1-4ad4-8a5d-b9b51e919242 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:49.410037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94f64b03-62a1-4ad4-8a5d-b9b51e919242 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:49.411696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94f64b03-62a1-4ad4-8a5d-b9b51e919242 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:49.413211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94f64b03-62a1-4ad4-8a5d-b9b51e919242 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:49.414071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94f64b03-62a1-4ad4-8a5d-b9b51e919242 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:49.749484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-94f64b03-62a1-4ad4-8a5d-b9b51e919242 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:10:49.911421 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-94f64b03-62a1-4ad4-8a5d-b9b51e919242 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 204 len: 0 microversion: 2.1 time: 0.995233 Jul 20 04:10:49.912289 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 92/172] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:10:48 2022] DELETE /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 0 bytes in 997 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:10:49.921466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-af9abdcd-8af3-465c-824b-c5a1df63ce6c tempest-FlavorsAccessNegativeTestJSON-575687560 tempest-FlavorsAccessNegativeTestJSON-575687560-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8ee0fef66fb642668bbcdc91a0e5cb03"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:49.922765 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:49.922765 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:49.923634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-af9abdcd-8af3-465c-824b-c5a1df63ce6c tempest-FlavorsAccessNegativeTestJSON-575687560 tempest-FlavorsAccessNegativeTestJSON-575687560-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd86020975cc84780bc46dceef260d309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee0fef66fb642668bbcdc91a0e5cb03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-af9abdcd-8af3-465c-824b-c5a1df63ce6c tempest-FlavorsAccessNegativeTestJSON-575687560 tempest-FlavorsAccessNegativeTestJSON-575687560-project] Request method failure captured: Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/flavors/406556319/action HTTP/1.1 Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 70 Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BB2Un9rqbbj-vLGeGBnN-bWf_nwVxev3da9uLBaUOUIz3BQEzvVVSfxrq6Ur7dvuudGHqMR42sj-Sp9WNoLEO_sFOpxIstWHSLqrFIl0OgsGfrHl89c31zvyarSpLHVGbywGQlPx8a_dEERq4phmR9fgaGLgZFiYUm8k_4tYVmRpE Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 8ee0fef66fb642668bbcdc91a0e5cb03 Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-575687560 Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:10:49.925643 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:10:49.926928 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8ee0fef66fb642668bbcdc91a0e5cb03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ee0fef66fb642668bbcdc91a0e5cb03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8ee0fef66fb642668bbcdc91a0e5cb03", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8ee0fef66fb642668bbcdc91a0e5cb03"}]}] Jul 20 04:10:49.926928 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-575687560 Jul 20 04:10:49.926928 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 8ee0fef66fb642668bbcdc91a0e5cb03 Jul 20 04:10:49.926928 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-575687560 Jul 20 04:10:49.926928 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-FlavorsAccessNegativeTestJSON-575687560-project Jul 20 04:10:49.926928 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:49.926928 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:49.926928 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: d86020975cc84780bc46dceef260d309 Jul 20 04:10:49.926928 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-575687560-project Jul 20 04:10:49.926928 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:10:49.926928 n-d-764485-11 devstack@n-api.service[119807]: {"removeTenantAccess": {"tenant": "8ee0fef66fb642668bbcdc91a0e5cb03"}} Jul 20 04:10:49.926928 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '406556319', 'body': {'removeTenantAccess': {'tenant': '8ee0fef66fb642668bbcdc91a0e5cb03'}}} Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi context.can( Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:49.931096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 04:10:49.932275 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:49.933307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-af9abdcd-8af3-465c-824b-c5a1df63ce6c tempest-FlavorsAccessNegativeTestJSON-575687560 tempest-FlavorsAccessNegativeTestJSON-575687560-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:49.933307 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-af9abdcd-8af3-465c-824b-c5a1df63ce6c tempest-FlavorsAccessNegativeTestJSON-575687560 tempest-FlavorsAccessNegativeTestJSON-575687560-project] 10.222.0.20 "POST /compute/v2.1/flavors/406556319/action" status: 403 len: 133 microversion: 2.1 time: 0.013293 Jul 20 04:10:49.933307 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 93/173] 10.222.0.20 () {60 vars in 1196 bytes} [Wed Jul 20 04:10:49 2022] POST /compute/v2.1/flavors/406556319/action => generated 133 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:49.934999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-db84522c-a422-47bb-915d-ddd9c5d4dd63 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:49.939915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-db84522c-a422-47bb-915d-ddd9c5d4dd63 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:49.947761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db84522c-a422-47bb-915d-ddd9c5d4dd63 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:49.948184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db84522c-a422-47bb-915d-ddd9c5d4dd63 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:49.949348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db84522c-a422-47bb-915d-ddd9c5d4dd63 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:49.949867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db84522c-a422-47bb-915d-ddd9c5d4dd63 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:50.039566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-db84522c-a422-47bb-915d-ddd9c5d4dd63 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:50.047921 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-db84522c-a422-47bb-915d-ddd9c5d4dd63 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1321 microversion: 2.1 time: 0.118413 Jul 20 04:10:50.048476 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 94/174] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:49 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1321 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:50.118781 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bb321cf8-4a2b-4243-8186-5a4e0856078b tempest-SecurityGroupsTestAdminJSON-828669229 tempest-SecurityGroupsTestAdminJSON-828669229-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.971155 Jul 20 04:10:50.119276 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 81/175] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:10:49 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:50.125147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-29dd4340-2b6a-4960-adcd-571e3b1e4731 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:50.125944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-29dd4340-2b6a-4960-adcd-571e3b1e4731 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:50.136258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29dd4340-2b6a-4960-adcd-571e3b1e4731 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:50.137157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29dd4340-2b6a-4960-adcd-571e3b1e4731 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:50.137984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29dd4340-2b6a-4960-adcd-571e3b1e4731 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:50.138377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29dd4340-2b6a-4960-adcd-571e3b1e4731 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:50.207244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a75ad0b7-ab7f-4c1c-b683-3147a1a9d482 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Action: 'create', calling method: .version_select at 0x7fbf9e2ecf70>, body: {"keypair": {"name": "tempest-keypair-2018546515", "type": "ssh", "user_id": "cc2f2eae73d441f794498bb25849e26b", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4VGxVDyC5Df4wiHg6cgbjv3g+Owv/0LdvbmFjYxFeoXxvn4I5UIu6libPCMk1nV7NCgWwEhpsrty8kA2/KkssZ4flxvOqDNVP9KNeouXUM/sa/M+cC71W3vqFMm47WsQ=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:50.242760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-a75ad0b7-ab7f-4c1c-b683-3147a1a9d482 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Getting quotas for project 6dc132e8440945a6a12669fa03eeb613. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:50.247073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-a75ad0b7-ab7f-4c1c-b683-3147a1a9d482 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Getting quotas for user b9eb54861dab470c9dafaf994bb73289 and project 6dc132e8440945a6a12669fa03eeb613. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:50.275583 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a75ad0b7-ab7f-4c1c-b683-3147a1a9d482 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.225785 Jul 20 04:10:50.276641 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 95/176] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jul 20 04:10:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 227 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:10:50.289408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a874158f-ec26-4e2b-9676-1e3f543ea041 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8ee0fef66fb642668bbcdc91a0e5cb03"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:50.291099 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:50.291099 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:50.420503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-29dd4340-2b6a-4960-adcd-571e3b1e4731 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:50.431423 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-29dd4340-2b6a-4960-adcd-571e3b1e4731 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1497 microversion: 2.1 time: 0.310193 Jul 20 04:10:50.442487 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 82/177] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:50 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1497 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:50.450999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4a866807-bea6-42d5-9b65-43378ca9dad5 tempest-SecurityGroupsTestAdminJSON-828669229 tempest-SecurityGroupsTestAdminJSON-828669229-project] Action: 'create', calling method: .version_select at 0x7fbf9e25f1f0>, body: {"security_group": {"name": "tempest-securitygroup-1719026025", "description": "tempest-description-1303459403"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:50.474426 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a874158f-ec26-4e2b-9676-1e3f543ea041 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/406556319/action" status: 200 len: 21 microversion: 2.1 time: 0.194568 Jul 20 04:10:50.479327 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 96/178] 10.222.0.20 () {60 vars in 1196 bytes} [Wed Jul 20 04:10:50 2022] POST /compute/v2.1/flavors/406556319/action => generated 21 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:50.481206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b3d1c466-2b5d-4732-868d-c19646c16ff8 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:50.481971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b3d1c466-2b5d-4732-868d-c19646c16ff8 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:50.489356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3d1c466-2b5d-4732-868d-c19646c16ff8 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:50.489782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3d1c466-2b5d-4732-868d-c19646c16ff8 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:50.490475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3d1c466-2b5d-4732-868d-c19646c16ff8 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:50.491137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3d1c466-2b5d-4732-868d-c19646c16ff8 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:50.793205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b3d1c466-2b5d-4732-868d-c19646c16ff8 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:50.816458 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b3d1c466-2b5d-4732-868d-c19646c16ff8 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1338 microversion: 2.1 time: 0.339775 Jul 20 04:10:50.818166 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 97/179] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:50 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1338 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:50.823205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3d70d4df-978b-4e5a-bd1f-72b15c82281e tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Action: 'create', calling method: .version_select at 0x7fbf9e1a05e0>, body: {"keypair": {"name": "tempest-keypair-377669808", "type": "ssh", "user_id": "cc2f2eae73d441f794498bb25849e26b", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhRiCC+Ei5rh0SA3HoF6hqHhhgi/QqA76mwxvL7n278luFl+6X9FyIQgHWdbsbtJ1d5DDLTKEm88YGNdXfK2xQTB/G8XCKi8wPyzr7MyJFwDEXhwpdDeIK7etjv827Kdg=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:50.842253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-3d70d4df-978b-4e5a-bd1f-72b15c82281e tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Getting quotas for project 6dc132e8440945a6a12669fa03eeb613. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:50.847457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-3d70d4df-978b-4e5a-bd1f-72b15c82281e tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Getting quotas for user b9eb54861dab470c9dafaf994bb73289 and project 6dc132e8440945a6a12669fa03eeb613. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:50.885461 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4a866807-bea6-42d5-9b65-43378ca9dad5 tempest-SecurityGroupsTestAdminJSON-828669229 tempest-SecurityGroupsTestAdminJSON-828669229-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.441786 Jul 20 04:10:50.886062 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 83/180] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:10:50 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:50.892041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2ceb7e0a-82b9-498c-9d06-3d3d0341cf30 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:50.894011 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:50.894011 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:50.894206 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3d70d4df-978b-4e5a-bd1f-72b15c82281e tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.072978 Jul 20 04:10:50.899345 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 98/181] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jul 20 04:10:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:10:50.945166 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2ceb7e0a-82b9-498c-9d06-3d3d0341cf30 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/406556319" status: 202 len: 0 microversion: 2.1 time: 0.056708 Jul 20 04:10:50.947490 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 84/182] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:10:50 2022] DELETE /compute/v2.1/flavors/406556319 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:50.968788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-236b534e-7b33-4e4d-ad39-03cee71bdd23 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Calling method '.version_select at 0x7fbf9e1458b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:50.983114 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-236b534e-7b33-4e4d-ad39-03cee71bdd23 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-2018546515?user_id=cc2f2eae73d441f794498bb25849e26b" status: 200 len: 512 microversion: 2.10 time: 0.022755 Jul 20 04:10:50.987610 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 85/183] 10.222.0.20 () {60 vars in 1339 bytes} [Wed Jul 20 04:10:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2018546515?user_id=cc2f2eae73d441f794498bb25849e26b => generated 512 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:50.994852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-76056991-2e30-475c-9e37-96ee6ad31ef0 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.020589 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-76056991-2e30-475c-9e37-96ee6ad31ef0 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.031778 Jul 20 04:10:51.021548 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 86/184] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:50 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:51.026949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b43db3a-f600-4026-beb6-965ced56cc62 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Action: 'create', calling method: .version_select at 0x7fbf9e111700>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-668024085", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYPfi5l/Ikmz+bzHdNwMywWyNLeN161Qw6IK52792ZVw1tEs/WZohIwh3+UJ1Qu2Mo9QRejKpoiWf3qixNtmBB3UP3tBSRLTo6RO49u35xCauQOlerK4TlndNX2UD9H5Q=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:51.043180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=67 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:51.047178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0b43db3a-f600-4026-beb6-965ced56cc62 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Getting quotas for project 6dc132e8440945a6a12669fa03eeb613. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:51.053691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0b43db3a-f600-4026-beb6-965ced56cc62 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Getting quotas for user b9eb54861dab470c9dafaf994bb73289 and project 6dc132e8440945a6a12669fa03eeb613. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:51.083294 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b43db3a-f600-4026-beb6-965ced56cc62 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.060370 Jul 20 04:10:51.084689 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 87/185] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jul 20 04:10:51 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:10:51.091329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-81c667d3-d47e-42fb-a844-2570bfb4171e tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-420778399", "id": 1216677452, "os-flavor-access:is_public": "False"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:51.094304 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:51.094304 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:51.122816 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-81c667d3-d47e-42fb-a844-2570bfb4171e tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.036454 Jul 20 04:10:51.124682 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 88/186] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:51 2022] POST /compute/v2.1/flavors => generated 438 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:51.130491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-47be1ad5-661f-48f8-aab0-a60b8f8be8d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.131499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-47be1ad5-661f-48f8-aab0-a60b8f8be8d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:51.139574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47be1ad5-661f-48f8-aab0-a60b8f8be8d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.140692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47be1ad5-661f-48f8-aab0-a60b8f8be8d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.141672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47be1ad5-661f-48f8-aab0-a60b8f8be8d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.142345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47be1ad5-661f-48f8-aab0-a60b8f8be8d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.143551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0db8483-cd0f-4448-bdde-d0d6a0631617 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] Action: 'create', calling method: .version_select at 0x7fbf9dea4d30>, body: {"security_group": {"name": "tempest-securitygroup-1019107795", "description": "tempest-description-419571507"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:51.233233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-47be1ad5-661f-48f8-aab0-a60b8f8be8d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:51.243203 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-47be1ad5-661f-48f8-aab0-a60b8f8be8d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1321 microversion: 2.1 time: 0.116427 Jul 20 04:10:51.244463 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 89/187] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:51 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1321 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:51.257766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e0449b25-557f-44a1-93df-e3b8ec820557 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Calling method '.version_select at 0x7fbf9e1f5430>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.261808 n-d-764485-11 devstack@n-api.service[119808]: WARNING oslo_db.sqlalchemy.utils [None req-e0449b25-557f-44a1-93df-e3b8ec820557 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:10:51.269369 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e0449b25-557f-44a1-93df-e3b8ec820557 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs?user_id=cc2f2eae73d441f794498bb25849e26b" status: 200 len: 725 microversion: 2.10 time: 0.023532 Jul 20 04:10:51.270181 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 90/188] 10.222.0.20 () {60 vars in 1258 bytes} [Wed Jul 20 04:10:51 2022] GET /compute/v2.1/os-keypairs?user_id=cc2f2eae73d441f794498bb25849e26b => generated 725 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:51.281118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1a06b73f-a18e-434f-a43e-77af45531a4e tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7714d9ea0b3c438a85da12cd802835c3"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:51.282671 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:51.282671 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:51.347841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:51.352324 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-1a06b73f-a18e-434f-a43e-77af45531a4e tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] HTTP exception thrown: Flavor access not found for 24 / 7714d9ea0b3c438a85da12cd802835c3 combination. Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1a06b73f-a18e-434f-a43e-77af45531a4e tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Request method failure captured: Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/flavors/1216677452/action HTTP/1.1 Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 70 Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BDkIhhkHMiTvbyw0v_0XjyozfQs0_mqRX6tYchgkqFxz54XGYjEuUd1VFBWbi9uV83Sdoz7dBMbn6aQmaGkHkxI-D5wc8rd4XiCxIBca6cjXBcyNBQ_6DV39i77QwhpJ6fBZ_AqZeYEFRuxnYkZ00Grc8FyyNIKLsLOunKKEReu_M Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 657ea770ff504417986c88de1b4e5b5b Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1866966528 Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:10:51.356959 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:10:51.358469 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/657ea770ff504417986c88de1b4e5b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/657ea770ff504417986c88de1b4e5b5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_657ea770ff504417986c88de1b4e5b5b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/657ea770ff504417986c88de1b4e5b5b"}]}] Jul 20 04:10:51.358469 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1866966528 Jul 20 04:10:51.358469 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 657ea770ff504417986c88de1b4e5b5b Jul 20 04:10:51.358469 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1866966528 Jul 20 04:10:51.358469 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin Jul 20 04:10:51.358469 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:51.358469 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:51.358469 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8fb60a2ae1784dcb94e351ec6596dffb Jul 20 04:10:51.358469 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin Jul 20 04:10:51.358469 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:10:51.358469 n-d-764485-11 devstack@n-api.service[119808]: {"removeTenantAccess": {"tenant": "7714d9ea0b3c438a85da12cd802835c3"}} Jul 20 04:10:51.358469 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: exception: Flavor access not found for 24 / 7714d9ea0b3c438a85da12cd802835c3 combination. Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1216677452', 'body': {'removeTenantAccess': {'tenant': '7714d9ea0b3c438a85da12cd802835c3'}}} Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 20 04:10:51.359176 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 24 / 7714d9ea0b3c438a85da12cd802835c3 combination. Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 24 / 7714d9ea0b3c438a85da12cd802835c3 combination. Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.360217 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:51.361321 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:51.361321 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:51.361321 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:51.361321 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:51.361321 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 24 / 7714d9ea0b3c438a85da12cd802835c3 combination. Jul 20 04:10:51.361321 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.364046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1a06b73f-a18e-434f-a43e-77af45531a4e tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Returning 404 to user: Flavor access not found for 24 / 7714d9ea0b3c438a85da12cd802835c3 combination. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:51.365457 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1a06b73f-a18e-434f-a43e-77af45531a4e tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1216677452/action" status: 404 len: 124 microversion: 2.1 time: 0.088841 Jul 20 04:10:51.366071 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 91/189] 10.222.0.20 () {60 vars in 1199 bytes} [Wed Jul 20 04:10:51 2022] POST /compute/v2.1/flavors/1216677452/action => generated 124 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:51.371739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c68736ec-5320-4333-95ce-b5d2c5178942 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Calling method '.version_select at 0x7fbf9e111550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.394124 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c68736ec-5320-4333-95ce-b5d2c5178942 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-668024085" status: 204 len: 0 microversion: 2.10 time: 0.026614 Jul 20 04:10:51.397983 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 92/190] 10.222.0.20 () {60 vars in 1321 bytes} [Wed Jul 20 04:10:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-668024085 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:10:51.403084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-85281621-db42-40c3-91b6-62e1392d1cf7 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.403866 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:51.403866 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:10:51.423019 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-85281621-db42-40c3-91b6-62e1392d1cf7 tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1216677452" status: 202 len: 0 microversion: 2.1 time: 0.023884 Jul 20 04:10:51.424396 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 93/191] 10.222.0.20 () {58 vars in 1160 bytes} [Wed Jul 20 04:10:51 2022] DELETE /compute/v2.1/flavors/1216677452 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:51.430926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a40b68d4-1dec-4e22-a38d-8ce8edff7837 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Calling method '.version_select at 0x7fbf9e111f70>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.456581 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a40b68d4-1dec-4e22-a38d-8ce8edff7837 tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-377669808?user_id=cc2f2eae73d441f794498bb25849e26b" status: 204 len: 0 microversion: 2.10 time: 0.030829 Jul 20 04:10:51.457293 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 94/192] 10.222.0.20 () {60 vars in 1339 bytes} [Wed Jul 20 04:10:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-377669808?user_id=cc2f2eae73d441f794498bb25849e26b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:10:51.464121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-64f012c2-be7c-4209-ae02-0d127768664a tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.485354 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-64f012c2-be7c-4209-ae02-0d127768664a tempest-FlavorsAccessNegativeTestJSON-1866966528 tempest-FlavorsAccessNegativeTestJSON-1866966528-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.027105 Jul 20 04:10:51.486444 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 95/193] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:51 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:51.505423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-72903080-76a5-4295-a522-8b1bb2389598 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.506338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-72903080-76a5-4295-a522-8b1bb2389598 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:51.515525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72903080-76a5-4295-a522-8b1bb2389598 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.516396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72903080-76a5-4295-a522-8b1bb2389598 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.517393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72903080-76a5-4295-a522-8b1bb2389598 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.518219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72903080-76a5-4295-a522-8b1bb2389598 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.850497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=22 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:52.044081 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0db8483-cd0f-4448-bdde-d0d6a0631617 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.148230 Jul 20 04:10:52.044699 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 99/194] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:10:50 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:52.054454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e5c9cf98-d38a-48e8-841d-4255fbecbb5c tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] Calling method '.version_select at 0x7fbf9de18430>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:52.097741 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e5c9cf98-d38a-48e8-841d-4255fbecbb5c tempest-KeyPairsV210TestJSON-4627098 tempest-KeyPairsV210TestJSON-4627098-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018546515?user_id=cc2f2eae73d441f794498bb25849e26b" status: 204 len: 0 microversion: 2.10 time: 0.051952 Jul 20 04:10:52.098419 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 100/195] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018546515?user_id=cc2f2eae73d441f794498bb25849e26b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:10:52.109625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95d3848d-27ec-48fc-9a71-0abd1cc4572c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:52.110446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95d3848d-27ec-48fc-9a71-0abd1cc4572c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:52.119817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95d3848d-27ec-48fc-9a71-0abd1cc4572c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.120457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95d3848d-27ec-48fc-9a71-0abd1cc4572c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.121572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95d3848d-27ec-48fc-9a71-0abd1cc4572c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.122498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95d3848d-27ec-48fc-9a71-0abd1cc4572c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.169324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-72903080-76a5-4295-a522-8b1bb2389598 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:52.178299 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-72903080-76a5-4295-a522-8b1bb2389598 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1497 microversion: 2.1 time: 0.690519 Jul 20 04:10:52.190653 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 96/196] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:51 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1497 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:52.204190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0884d8d3-5a0e-4860-b565-c980ca4e0a0a tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] Action: 'create', calling method: .version_select at 0x7fbf9e111550>, body: {"security_group": {"name": "tempest-securitygroup-1702826278", "description": "tempest-description-1754711848"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:52.536487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95d3848d-27ec-48fc-9a71-0abd1cc4572c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:52.548073 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95d3848d-27ec-48fc-9a71-0abd1cc4572c tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1488 microversion: 2.1 time: 0.446983 Jul 20 04:10:52.549591 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 101/197] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:52 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1488 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:52.558932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0591fe07-65c7-43d1-bdb1-d574c104c9d2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:52.563408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0591fe07-65c7-43d1-bdb1-d574c104c9d2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:52.570614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:52.578770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0591fe07-65c7-43d1-bdb1-d574c104c9d2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.579218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0591fe07-65c7-43d1-bdb1-d574c104c9d2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.582760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0591fe07-65c7-43d1-bdb1-d574c104c9d2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.584076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0591fe07-65c7-43d1-bdb1-d574c104c9d2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.717724 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0884d8d3-5a0e-4860-b565-c980ca4e0a0a tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.525877 Jul 20 04:10:52.718772 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 97/198] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:10:52 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:52.729580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6a8713b-0035-43b2-90fc-c293aa9596d5 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:52.730911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c6a8713b-0035-43b2-90fc-c293aa9596d5 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:52.745547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6a8713b-0035-43b2-90fc-c293aa9596d5 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.749888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6a8713b-0035-43b2-90fc-c293aa9596d5 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.754015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6a8713b-0035-43b2-90fc-c293aa9596d5 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.754015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6a8713b-0035-43b2-90fc-c293aa9596d5 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:53.073076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0591fe07-65c7-43d1-bdb1-d574c104c9d2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:53.084618 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0591fe07-65c7-43d1-bdb1-d574c104c9d2 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1387 microversion: 2.1 time: 0.533043 Jul 20 04:10:53.092743 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 102/199] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:52 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1387 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:53.106194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c0b51342-fd02-468f-84f3-94548b713842 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] Calling method '.version_select at 0x7fbf9ddeaee0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:53.784929 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c6a8713b-0035-43b2-90fc-c293aa9596d5 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1641 microversion: 2.1 time: 1.065019 Jul 20 04:10:53.790873 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 98/200] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:52 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1641 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:53.800807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91fbc2e8-8746-470d-8039-09507b8c4f8f tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:53.801666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91fbc2e8-8746-470d-8039-09507b8c4f8f tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:53.846754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91fbc2e8-8746-470d-8039-09507b8c4f8f tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:53.847454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91fbc2e8-8746-470d-8039-09507b8c4f8f tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:53.848783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91fbc2e8-8746-470d-8039-09507b8c4f8f tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:53.849412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91fbc2e8-8746-470d-8039-09507b8c4f8f tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:53.920274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91fbc2e8-8746-470d-8039-09507b8c4f8f tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:53.924333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91fbc2e8-8746-470d-8039-09507b8c4f8f tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:53.924856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-91fbc2e8-8746-470d-8039-09507b8c4f8f tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lazy-loading 'fault' on Instance uuid 6ff00481-daa9-41ee-a128-2684117e0c50 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:54.108433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91fbc2e8-8746-470d-8039-09507b8c4f8f tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:54.120546 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91fbc2e8-8746-470d-8039-09507b8c4f8f tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 200 len: 1331 microversion: 2.1 time: 0.328310 Jul 20 04:10:54.121856 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 99/201] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:53 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 1331 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:54.132326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-10496229-e561-4f9f-a764-3cb46e6d74d1 req-3f22855c-6ccc-4683-8055-ddb1dc8b5652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff00481-daa9-41ee-a128-2684117e0c50", "name": "network-vif-deleted", "tag": "670aa06e-f892-4ef8-a4e3-6587fb3c3c90"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:54.164371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-10496229-e561-4f9f-a764-3cb46e6d74d1 req-3f22855c-6ccc-4683-8055-ddb1dc8b5652 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:54.165075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-10496229-e561-4f9f-a764-3cb46e6d74d1 req-3f22855c-6ccc-4683-8055-ddb1dc8b5652 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:54.199788 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-10496229-e561-4f9f-a764-3cb46e6d74d1 req-3f22855c-6ccc-4683-8055-ddb1dc8b5652 service nova] Creating event network-vif-deleted:670aa06e-f892-4ef8-a4e3-6587fb3c3c90 for instance 6ff00481-daa9-41ee-a128-2684117e0c50 on n-h1-764485-11 Jul 20 04:10:54.208132 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-10496229-e561-4f9f-a764-3cb46e6d74d1 req-3f22855c-6ccc-4683-8055-ddb1dc8b5652 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083913 Jul 20 04:10:54.210150 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 100/202] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:54.225335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c640ae1-9242-43fc-a799-84aa99d011f5 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:54.226234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6c640ae1-9242-43fc-a799-84aa99d011f5 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:54.254980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c640ae1-9242-43fc-a799-84aa99d011f5 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:54.256778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c640ae1-9242-43fc-a799-84aa99d011f5 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:54.259421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c640ae1-9242-43fc-a799-84aa99d011f5 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:54.259890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c640ae1-9242-43fc-a799-84aa99d011f5 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:54.334461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6c640ae1-9242-43fc-a799-84aa99d011f5 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:10:54.938174 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6c640ae1-9242-43fc-a799-84aa99d011f5 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 204 len: 0 microversion: 2.1 time: 0.724416 Jul 20 04:10:54.938864 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 101/203] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:10:54 2022] DELETE /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 0 bytes in 728 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:10:54.954197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-153d3597-e361-461a-ac4b-b731e35a1df3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:54.954708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-153d3597-e361-461a-ac4b-b731e35a1df3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:54.976825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-153d3597-e361-461a-ac4b-b731e35a1df3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:54.977348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-153d3597-e361-461a-ac4b-b731e35a1df3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:54.979620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-153d3597-e361-461a-ac4b-b731e35a1df3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:54.981691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-153d3597-e361-461a-ac4b-b731e35a1df3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:54.993709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:55.332492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-153d3597-e361-461a-ac4b-b731e35a1df3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:55.342810 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-153d3597-e361-461a-ac4b-b731e35a1df3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1387 microversion: 2.1 time: 0.402614 Jul 20 04:10:55.348307 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 102/204] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:54 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1387 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:55.357332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b5a034fb-c6d8-4de1-b078-fc46e66c652a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:55.357960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b5a034fb-c6d8-4de1-b078-fc46e66c652a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:55.380758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5a034fb-c6d8-4de1-b078-fc46e66c652a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.381225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5a034fb-c6d8-4de1-b078-fc46e66c652a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.382017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5a034fb-c6d8-4de1-b078-fc46e66c652a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.382474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5a034fb-c6d8-4de1-b078-fc46e66c652a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.698223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b5a034fb-c6d8-4de1-b078-fc46e66c652a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:55.713243 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b5a034fb-c6d8-4de1-b078-fc46e66c652a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1494 microversion: 2.1 time: 0.363765 Jul 20 04:10:55.717036 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 103/205] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:55 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1494 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:55.726158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eee798c7-0241-45d0-a0af-c1ef3a801b48 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:55.728319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eee798c7-0241-45d0-a0af-c1ef3a801b48 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:55.742883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eee798c7-0241-45d0-a0af-c1ef3a801b48 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.743807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eee798c7-0241-45d0-a0af-c1ef3a801b48 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.745494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eee798c7-0241-45d0-a0af-c1ef3a801b48 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.747227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eee798c7-0241-45d0-a0af-c1ef3a801b48 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.773530 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-eee798c7-0241-45d0-a0af-c1ef3a801b48 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] HTTP exception thrown: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eee798c7-0241-45d0-a0af-c1ef3a801b48 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Request method failure captured: Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 HTTP/1.1 Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Ajz0rjS1XRiDD0KeIBjGxGkKn9lQqbJCIG3F_LKJaFzFftYZgLaPpZ6bqV0Aro4yM_edAWWmZxM6XDybSni9Omm3ju_T47CNVor7BRYYTruEKAmKDy3aTI23nKK61Fjj3PYS3flWEogiYecO3u9-qol0r0o8n2ItiVDEIr9KZu2TI Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5ec3ed035cec44ee9c3a79a57782507f Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:10:55.779410 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:10:55.780838 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5ec3ed035cec44ee9c3a79a57782507f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ec3ed035cec44ee9c3a79a57782507f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5ec3ed035cec44ee9c3a79a57782507f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ec3ed035cec44ee9c3a79a57782507f"}]}] Jul 20 04:10:55.780838 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:10:55.780838 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5ec3ed035cec44ee9c3a79a57782507f Jul 20 04:10:55.780838 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:10:55.780838 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersAdminTestJSON-2088718138-project Jul 20 04:10:55.780838 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:10:55.780838 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:10:55.780838 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: dc805052a58e462b8560b1754e36e5bd Jul 20 04:10:55.780838 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersAdminTestJSON-2088718138-project Jul 20 04:10:55.780838 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:10:55.780838 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:10:55.780838 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '6ff00481-daa9-41ee-a128-2684117e0c50'} Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:55.781672 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:10:55.782994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:10:55.785616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eee798c7-0241-45d0-a0af-c1ef3a801b48 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Returning 404 to user: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:55.785616 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eee798c7-0241-45d0-a0af-c1ef3a801b48 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 404 len: 111 microversion: 2.1 time: 0.067033 Jul 20 04:10:55.787973 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 104/206] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:55 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:55.983088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-c0b51342-fd02-468f-84f3-94548b713842 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ccb23e2d-1660-4b69-9b49-d0f8ae6796bd does not exist", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:10:55.983811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.security_group_api [None req-c0b51342-fd02-468f-84f3-94548b713842 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] Neutron security group ccb23e2d-1660-4b69-9b49-d0f8ae6796bd not found {{(pid=119807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:10:55.984573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.compute.security_groups [None req-c0b51342-fd02-468f-84f3-94548b713842 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] Security Group ID ccb23e2d-1660-4b69-9b49-d0f8ae6796bd does not exist {{(pid=119807) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 20 04:10:56.039162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-c0b51342-fd02-468f-84f3-94548b713842 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ccb23e2d-1660-4b69-9b49-d0f8ae6796bd does not exist", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:10:56.041344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.security_group_api [None req-c0b51342-fd02-468f-84f3-94548b713842 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] Neutron security group ccb23e2d-1660-4b69-9b49-d0f8ae6796bd not found {{(pid=119807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:10:56.042825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.compute.security_groups [None req-c0b51342-fd02-468f-84f3-94548b713842 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] Security Group ID ccb23e2d-1660-4b69-9b49-d0f8ae6796bd does not exist {{(pid=119807) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 20 04:10:56.062599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ccc29cba-39e3-411f-b1a4-41c7dd3d3e06 req-2faae68d-b809-4719-9d23-7b35b9d5f7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50659bf-f42b-4cb4-899f-20eeaf84e5c1", "tag": "81234abf-cf0a-4b1c-aace-641cfdd0a454"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:56.081872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ccc29cba-39e3-411f-b1a4-41c7dd3d3e06 req-2faae68d-b809-4719-9d23-7b35b9d5f7c2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.082542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ccc29cba-39e3-411f-b1a4-41c7dd3d3e06 req-2faae68d-b809-4719-9d23-7b35b9d5f7c2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:56.097851 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ccc29cba-39e3-411f-b1a4-41c7dd3d3e06 req-2faae68d-b809-4719-9d23-7b35b9d5f7c2 service nova] Creating event network-changed:81234abf-cf0a-4b1c-aace-641cfdd0a454 for instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 on n-h2-764485-11 Jul 20 04:10:56.104448 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ccc29cba-39e3-411f-b1a4-41c7dd3d3e06 req-2faae68d-b809-4719-9d23-7b35b9d5f7c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.284328 Jul 20 04:10:56.105732 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 105/207] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:10:56.118301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1054279938", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:56.189315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:56.269695 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c0b51342-fd02-468f-84f3-94548b713842 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8481 microversion: 2.1 time: 3.175040 Jul 20 04:10:56.271135 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 103/208] 10.222.0.20 () {58 vars in 1190 bytes} [Wed Jul 20 04:10:53 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8481 bytes in 3178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:56.287223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c11d5ab4-a25a-4893-8c7f-2b5bef4f8076 tempest-SecurityGroupsTestAdminJSON-828669229 tempest-SecurityGroupsTestAdminJSON-828669229-project] Calling method '.version_select at 0x7fbf9de18ca0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:56.969187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:56.970147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:56.970895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:56.971528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:56.972215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:56.991463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.992219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:56.993218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.994021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:57.015311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Getting quotas for project 5ec3ed035cec44ee9c3a79a57782507f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:57.020260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Getting quotas for user dc805052a58e462b8560b1754e36e5bd and project 5ec3ed035cec44ee9c3a79a57782507f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:57.043623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:10:57.046623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:10:57.122480 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-324845e9-b711-4466-a432-0f19a43422b0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009987 Jul 20 04:10:57.124213 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 106/209] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:10:57.130424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e10ba655-ee98-40eb-9a09-3b0ac2a1c528 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:57.133258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e10ba655-ee98-40eb-9a09-3b0ac2a1c528 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:57.144931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e10ba655-ee98-40eb-9a09-3b0ac2a1c528 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:57.145946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e10ba655-ee98-40eb-9a09-3b0ac2a1c528 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:57.146918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e10ba655-ee98-40eb-9a09-3b0ac2a1c528 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:57.147979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e10ba655-ee98-40eb-9a09-3b0ac2a1c528 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:57.344343 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c11d5ab4-a25a-4893-8c7f-2b5bef4f8076 tempest-SecurityGroupsTestAdminJSON-828669229 tempest-SecurityGroupsTestAdminJSON-828669229-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 1.060956 Jul 20 04:10:57.346059 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 104/210] 10.222.0.20 () {58 vars in 1190 bytes} [Wed Jul 20 04:10:56 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:57.351832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6815c8e8-4aaa-4e73-8460-711e1efc9f28 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:57.353600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6815c8e8-4aaa-4e73-8460-711e1efc9f28 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:57.373047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6815c8e8-4aaa-4e73-8460-711e1efc9f28 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:57.378115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6815c8e8-4aaa-4e73-8460-711e1efc9f28 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:57.379590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6815c8e8-4aaa-4e73-8460-711e1efc9f28 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:57.382384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6815c8e8-4aaa-4e73-8460-711e1efc9f28 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:58.032302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6815c8e8-4aaa-4e73-8460-711e1efc9f28 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3684a008394684804d848903b195b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ca615bc66e4b3484501f12382935d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:58.044000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e10ba655-ee98-40eb-9a09-3b0ac2a1c528 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:58.054809 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e10ba655-ee98-40eb-9a09-3b0ac2a1c528 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1387 microversion: 2.1 time: 0.928107 Jul 20 04:10:58.056315 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 107/211] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:57 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1387 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:58.063551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-13afc7dc-d233-4148-9fbf-7e315e734c02 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:58.064147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-13afc7dc-d233-4148-9fbf-7e315e734c02 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:58.065614 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6815c8e8-4aaa-4e73-8460-711e1efc9f28 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 200 len: 1494 microversion: 2.1 time: 0.707743 Jul 20 04:10:58.079660 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 105/212] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:57 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 1494 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:58.083185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13afc7dc-d233-4148-9fbf-7e315e734c02 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:58.090391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13afc7dc-d233-4148-9fbf-7e315e734c02 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:58.091557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13afc7dc-d233-4148-9fbf-7e315e734c02 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:58.092393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13afc7dc-d233-4148-9fbf-7e315e734c02 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:58.092538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6d86504e-d844-406b-8c2b-c0d0c4ad1ba7 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] Calling method '.version_select at 0x7fbf9dd7f040>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:58.235493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-13afc7dc-d233-4148-9fbf-7e315e734c02 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:58.243912 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-13afc7dc-d233-4148-9fbf-7e315e734c02 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1237 microversion: 2.1 time: 0.186349 Jul 20 04:10:58.244906 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 108/213] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:58 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1237 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:58.498122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9791aa7d-4eb8-4ac4-b195-f3ccb643b565 req-41661c7d-efbe-4a9b-9900-ee795a564c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6e616a-479d-497e-a6ff-89c5e2965e0f", "name": "network-vif-deleted", "tag": "bae5f4bb-fd5b-4873-be2c-8f0099a89282"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:58.522967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9791aa7d-4eb8-4ac4-b195-f3ccb643b565 req-41661c7d-efbe-4a9b-9900-ee795a564c0a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:58.524992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9791aa7d-4eb8-4ac4-b195-f3ccb643b565 req-41661c7d-efbe-4a9b-9900-ee795a564c0a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:58.585901 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9791aa7d-4eb8-4ac4-b195-f3ccb643b565 req-41661c7d-efbe-4a9b-9900-ee795a564c0a service nova] Creating event network-vif-deleted:bae5f4bb-fd5b-4873-be2c-8f0099a89282 for instance ce6e616a-479d-497e-a6ff-89c5e2965e0f on n-h1-764485-11 Jul 20 04:10:58.604724 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9791aa7d-4eb8-4ac4-b195-f3ccb643b565 req-41661c7d-efbe-4a9b-9900-ee795a564c0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111672 Jul 20 04:10:58.614406 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 109/214] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:10:58.712126 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6d86504e-d844-406b-8c2b-c0d0c4ad1ba7 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/1c54f5ce-0477-4883-a83d-ca13b1620112" status: 202 len: 0 microversion: 2.1 time: 0.628656 Jul 20 04:10:58.716012 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 106/215] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:10:58 2022] DELETE /compute/v2.1/os-security-groups/1c54f5ce-0477-4883-a83d-ca13b1620112 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:58.726206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2cb7f7e2-d8ba-4570-98e8-4b386185df24 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] Calling method '.version_select at 0x7fbf9e1450d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:59.071951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2f4b4d1-6f80-4f78-be47-66cdbd1f4511 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:59.073158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2f4b4d1-6f80-4f78-be47-66cdbd1f4511 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:59.082283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2f4b4d1-6f80-4f78-be47-66cdbd1f4511 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:59.082926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2f4b4d1-6f80-4f78-be47-66cdbd1f4511 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.083918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2f4b4d1-6f80-4f78-be47-66cdbd1f4511 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:59.084508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2f4b4d1-6f80-4f78-be47-66cdbd1f4511 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.578744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c2f4b4d1-6f80-4f78-be47-66cdbd1f4511 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:59.592072 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2f4b4d1-6f80-4f78-be47-66cdbd1f4511 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1387 microversion: 2.1 time: 0.523409 Jul 20 04:10:59.596831 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 107/216] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:59 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1387 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:59.602685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-257f9cb8-47ef-4b86-a2a7-4acefe669319 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:59.609941 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2cb7f7e2-d8ba-4570-98e8-4b386185df24 tempest-SecurityGroupsTestAdminJSON-331645020 tempest-SecurityGroupsTestAdminJSON-331645020-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/af14d105-be4f-4086-a6ad-b4953bdfc0b7" status: 202 len: 0 microversion: 2.1 time: 0.890276 Jul 20 04:10:59.610740 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 110/217] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:10:58 2022] DELETE /compute/v2.1/os-security-groups/af14d105-be4f-4086-a6ad-b4953bdfc0b7 => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:59.615816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d2730f5c-f76c-4da9-a066-9de031738389 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:59.616509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-257f9cb8-47ef-4b86-a2a7-4acefe669319 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:59.616624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d2730f5c-f76c-4da9-a066-9de031738389 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:59.630802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-257f9cb8-47ef-4b86-a2a7-4acefe669319 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:59.631579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2730f5c-f76c-4da9-a066-9de031738389 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:59.632035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2730f5c-f76c-4da9-a066-9de031738389 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.632769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-257f9cb8-47ef-4b86-a2a7-4acefe669319 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.635826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-257f9cb8-47ef-4b86-a2a7-4acefe669319 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:59.636517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-257f9cb8-47ef-4b86-a2a7-4acefe669319 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.636648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2730f5c-f76c-4da9-a066-9de031738389 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:59.637017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2730f5c-f76c-4da9-a066-9de031738389 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:59.687969 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-257f9cb8-47ef-4b86-a2a7-4acefe669319 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] HTTP exception thrown: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-257f9cb8-47ef-4b86-a2a7-4acefe669319 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Request method failure captured: Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f HTTP/1.1 Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Ai8tIPkr2rh39_XDF0lyszPHAu0JVnJ6iKKqHCyMxG2BNfROolM-aIVMu4nLYbOdt2R2O3IZ0JrQdKFvYcjUT-vsvey96_CtNgKU22adpxdEwLHH3Uvbdzwpr1SRij6qOenkuptmcF8E20i-IWYwYPPa3GAcV8aAMw3G0GfeqM4U0 Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 49ca615bc66e4b3484501f12382935d3 Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminTestJSON-1913133297 Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:10:59.698168 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:10:59.699953 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/49ca615bc66e4b3484501f12382935d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/49ca615bc66e4b3484501f12382935d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_49ca615bc66e4b3484501f12382935d3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/49ca615bc66e4b3484501f12382935d3"}]}] Jul 20 04:10:59.699953 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminTestJSON-1913133297 Jul 20 04:10:59.699953 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 49ca615bc66e4b3484501f12382935d3 Jul 20 04:10:59.699953 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1913133297 Jul 20 04:10:59.699953 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminTestJSON-1913133297-project Jul 20 04:10:59.699953 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:10:59.699953 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:10:59.699953 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1c3684a008394684804d848903b195b4 Jul 20 04:10:59.699953 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminTestJSON-1913133297-project Jul 20 04:10:59.699953 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:10:59.699953 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:10:59.699953 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'ce6e616a-479d-497e-a6ff-89c5e2965e0f'} Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:59.700813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:10:59.702939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:10:59.704257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-257f9cb8-47ef-4b86-a2a7-4acefe669319 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Returning 404 to user: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:59.704257 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-257f9cb8-47ef-4b86-a2a7-4acefe669319 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 404 len: 111 microversion: 2.1 time: 0.101815 Jul 20 04:10:59.705494 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 108/218] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:59 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:59.769230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d2730f5c-f76c-4da9-a066-9de031738389 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:59.787889 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d2730f5c-f76c-4da9-a066-9de031738389 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1299 microversion: 2.1 time: 0.175796 Jul 20 04:10:59.788514 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 111/219] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:59 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1299 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:59.802853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0d232729-aeb1-4271-89c1-904dad57a462 tempest-SecurityGroupsTestAdminJSON-828669229 tempest-SecurityGroupsTestAdminJSON-828669229-project] Calling method '.version_select at 0x7fbf9e145ee0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:59.936613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-df0aaad0-1dbb-4f8a-bad1-d5fd1048fe8b tempest-FlavorsV261TestJSON-350955046 tempest-FlavorsV261TestJSON-350955046-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1889699008", "id": 612409707, "os-flavor-access:is_public": "True"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:59.938373 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:59.938373 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:10:59.971377 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-df0aaad0-1dbb-4f8a-bad1-d5fd1048fe8b tempest-FlavorsV261TestJSON-350955046 tempest-FlavorsV261TestJSON-350955046-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.264585 Jul 20 04:10:59.972179 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 109/220] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:10:59 2022] POST /compute/v2.1/flavors => generated 465 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:10:59.982023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5ac958a5-7459-4bc9-b7bb-d7fe6e60ba5b tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-764485-11"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:59.984466 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:59.984466 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:00.006990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ac958a5-7459-4bc9-b7bb-d7fe6e60ba5b tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:00.008462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ac958a5-7459-4bc9-b7bb-d7fe6e60ba5b tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:00.228285 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5ac958a5-7459-4bc9-b7bb-d7fe6e60ba5b tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 298 microversion: 2.1 time: 0.254759 Jul 20 04:11:00.242187 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 110/221] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:10:59 2022] POST /compute/v2.1/os-aggregates/5/action => generated 298 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:00.515016 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0d232729-aeb1-4271-89c1-904dad57a462 tempest-SecurityGroupsTestAdminJSON-828669229 tempest-SecurityGroupsTestAdminJSON-828669229-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/44470d8c-fc04-45ec-870d-7ad0629764c2" status: 202 len: 0 microversion: 2.1 time: 0.722548 Jul 20 04:11:00.518209 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 112/222] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:10:59 2022] DELETE /compute/v2.1/os-security-groups/44470d8c-fc04-45ec-870d-7ad0629764c2 => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:00.525071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6755e1f-92b8-4242-8ea4-d04760b71385 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:00.526011 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:00.526011 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:00.567619 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f6755e1f-92b8-4242-8ea4-d04760b71385 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.048262 Jul 20 04:11:00.568527 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 113/223] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:11:00 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:11:00.590559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6af1d9e0-92ef-463d-acda-a15a92f8356c tempest-SecurityGroupsTestAdminJSON-828669229 tempest-SecurityGroupsTestAdminJSON-828669229-project] Calling method '.version_select at 0x7fbf9df80310>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:00.784938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ca314ca-bc17-4057-9bd9-c2628203c204 tempest-FlavorsV261TestJSON-1863402502 tempest-FlavorsV261TestJSON-1863402502-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:00.811417 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ca314ca-bc17-4057-9bd9-c2628203c204 tempest-FlavorsV261TestJSON-1863402502 tempest-FlavorsV261TestJSON-1863402502-project] 10.222.0.20 "GET /compute/v2.1/flavors/612409707" status: 200 len: 465 microversion: 2.61 time: 0.566701 Jul 20 04:11:00.813371 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 111/224] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Jul 20 04:11:00 2022] GET /compute/v2.1/flavors/612409707 => generated 465 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:11:00.832570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-685878d4-c193-4f37-95f6-6c1bbc8aab09 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1530306073"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:00.843860 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:00.843860 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:00.849738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.aggregate [None req-685878d4-c193-4f37-95f6-6c1bbc8aab09 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Generated uuid e133eb12-5ccf-435b-afb8-194bd2a0be10 for aggregate {{(pid=119807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:11:00.860358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:00.920863 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-685878d4-c193-4f37-95f6-6c1bbc8aab09 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.104768 Jul 20 04:11:00.921571 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 112/225] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:11:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:00.936229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8f3c117b-7bd6-4250-ad11-3f5926595b27 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:00.936914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8f3c117b-7bd6-4250-ad11-3f5926595b27 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:00.955586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f3c117b-7bd6-4250-ad11-3f5926595b27 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:00.958112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f3c117b-7bd6-4250-ad11-3f5926595b27 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:00.962267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f3c117b-7bd6-4250-ad11-3f5926595b27 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:00.963922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f3c117b-7bd6-4250-ad11-3f5926595b27 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:01.223729 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6af1d9e0-92ef-463d-acda-a15a92f8356c tempest-SecurityGroupsTestAdminJSON-828669229 tempest-SecurityGroupsTestAdminJSON-828669229-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/465700f6-7b02-4cbc-bb25-3ec3f4b95aeb" status: 202 len: 0 microversion: 2.1 time: 0.654292 Jul 20 04:11:01.224895 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 114/226] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:11:00 2022] DELETE /compute/v2.1/os-security-groups/465700f6-7b02-4cbc-bb25-3ec3f4b95aeb => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:01.238227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d208c6e-817a-4641-84f9-1ae68408e75d tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:01.239452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5d208c6e-817a-4641-84f9-1ae68408e75d tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:01.256794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d208c6e-817a-4641-84f9-1ae68408e75d tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:01.257254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d208c6e-817a-4641-84f9-1ae68408e75d tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:01.258046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d208c6e-817a-4641-84f9-1ae68408e75d tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:01.258497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d208c6e-817a-4641-84f9-1ae68408e75d tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:01.595880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8f3c117b-7bd6-4250-ad11-3f5926595b27 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:01.608107 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8f3c117b-7bd6-4250-ad11-3f5926595b27 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1387 microversion: 2.1 time: 0.684588 Jul 20 04:11:01.608795 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 113/227] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:00 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1387 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:01.617463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-03da306e-ae3e-4890-8fa4-928278d6974d tempest-FlavorsV261TestJSON-350955046 tempest-FlavorsV261TestJSON-350955046-project-admin] Action: 'update', calling method: .version_select at 0x7fbfa03d03a0>, body: {"flavor": {"description": "new"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:01.649379 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:01.649379 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:01.676231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5d208c6e-817a-4641-84f9-1ae68408e75d tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:01.694619 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5d208c6e-817a-4641-84f9-1ae68408e75d tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1320 microversion: 2.1 time: 0.468400 Jul 20 04:11:01.696920 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 115/228] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:01 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1320 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:01.697607 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-03da306e-ae3e-4890-8fa4-928278d6974d tempest-FlavorsV261TestJSON-350955046 tempest-FlavorsV261TestJSON-350955046-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/612409707" status: 200 len: 466 microversion: 2.61 time: 0.086613 Jul 20 04:11:01.699374 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 114/229] 10.222.0.20 () {62 vars in 1215 bytes} [Wed Jul 20 04:11:01 2022] PUT /compute/v2.1/flavors/612409707 => generated 466 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:11:01.712070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04f0ab75-659a-4c22-bb26-30630264c16e tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:01.715280 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:01.715280 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:01.724520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04f0ab75-659a-4c22-bb26-30630264c16e tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:01.733001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04f0ab75-659a-4c22-bb26-30630264c16e tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:01.956363 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-04f0ab75-659a-4c22-bb26-30630264c16e tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 243 microversion: 2.1 time: 0.254909 Jul 20 04:11:01.957617 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 116/230] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:11:01 2022] POST /compute/v2.1/os-aggregates/9/action => generated 243 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:01.968642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0ae3e55a-338b-4e4f-bd83-ff075d0e3edf tempest-FlavorsV261TestJSON-1863402502 tempest-FlavorsV261TestJSON-1863402502-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:02.009984 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0ae3e55a-338b-4e4f-bd83-ff075d0e3edf tempest-FlavorsV261TestJSON-1863402502 tempest-FlavorsV261TestJSON-1863402502-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 7150 microversion: 2.61 time: 0.050987 Jul 20 04:11:02.012323 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 117/231] 10.222.0.20 () {60 vars in 1186 bytes} [Wed Jul 20 04:11:01 2022] GET /compute/v2.1/flavors/detail => generated 7150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:02.017569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d640aa0-9014-4ce4-830b-34876aee8e15 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:02.018674 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:02.018674 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:02.038641 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5d640aa0-9014-4ce4-830b-34876aee8e15 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 243 microversion: 2.1 time: 0.024829 Jul 20 04:11:02.044983 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 118/232] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Jul 20 04:11:02 2022] GET /compute/v2.1/os-aggregates/9 => generated 243 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:02.052859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-55f282e6-24f0-49a4-a334-285452e08d2e tempest-FlavorsV261TestJSON-1863402502 tempest-FlavorsV261TestJSON-1863402502-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:02.068221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1824200634", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:02.098345 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-55f282e6-24f0-49a4-a334-285452e08d2e tempest-FlavorsV261TestJSON-1863402502 tempest-FlavorsV261TestJSON-1863402502-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3677 microversion: 2.61 time: 0.051633 Jul 20 04:11:02.099733 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 119/233] 10.222.0.20 () {60 vars in 1165 bytes} [Wed Jul 20 04:11:02 2022] GET /compute/v2.1/flavors => generated 3677 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:02.105352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e2e11583-0792-493d-bc3d-482f805bd28c tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:02.107320 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:02.107320 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:02.118648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2e11583-0792-493d-bc3d-482f805bd28c tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.119381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2e11583-0792-493d-bc3d-482f805bd28c tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.194875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:02.276048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:02.293660 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e2e11583-0792-493d-bc3d-482f805bd28c tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.191241 Jul 20 04:11:02.297675 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 120/234] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Jul 20 04:11:02 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:02.308514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b85f64e0-5979-41c7-9981-8ac7faac4036 tempest-FlavorsV261TestJSON-350955046 tempest-FlavorsV261TestJSON-350955046-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:02.313066 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:02.313066 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:02.343791 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b85f64e0-5979-41c7-9981-8ac7faac4036 tempest-FlavorsV261TestJSON-350955046 tempest-FlavorsV261TestJSON-350955046-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/612409707" status: 202 len: 0 microversion: 2.61 time: 0.044455 Jul 20 04:11:02.347170 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 121/235] 10.222.0.20 () {60 vars in 1198 bytes} [Wed Jul 20 04:11:02 2022] DELETE /compute/v2.1/flavors/612409707 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:02.357496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-96de4969-f760-45b1-adcf-cfb6d2900b7b tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:02.358633 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:02.358633 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:02.390242 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-96de4969-f760-45b1-adcf-cfb6d2900b7b tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.041466 Jul 20 04:11:02.392742 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 122/236] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:11:02 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:11:02.401249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c0f71e08-3986-4122-8479-53c6644157cf tempest-FlavorsV261TestJSON-350955046 tempest-FlavorsV261TestJSON-350955046-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:02.437587 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c0f71e08-3986-4122-8479-53c6644157cf tempest-FlavorsV261TestJSON-350955046 tempest-FlavorsV261TestJSON-350955046-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.042562 Jul 20 04:11:02.440491 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 123/237] 10.222.0.20 () {60 vars in 1186 bytes} [Wed Jul 20 04:11:02 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:02.448910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3f6f5fe6-3d37-45ac-992c-ff635f141c59 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1518630994"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:02.454641 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:02.454641 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:02.456540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.aggregate [None req-3f6f5fe6-3d37-45ac-992c-ff635f141c59 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Generated uuid f5c79995-efe0-47e2-a064-20e228405949 for aggregate {{(pid=119808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:11:02.507942 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3f6f5fe6-3d37-45ac-992c-ff635f141c59 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064677 Jul 20 04:11:02.510267 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 124/238] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:11:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:02.523363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fb0d4673-e164-4916-bf76-d28642410d84 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:02.526996 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:02.526996 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:02.543816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb0d4673-e164-4916-bf76-d28642410d84 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.545161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb0d4673-e164-4916-bf76-d28642410d84 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.726714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:02.727068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:02.727845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:02.728415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:02.729086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:02.741533 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fb0d4673-e164-4916-bf76-d28642410d84 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 244 microversion: 2.1 time: 0.224442 Jul 20 04:11:02.748756 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 125/239] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:11:02 2022] POST /compute/v2.1/os-aggregates/10/action => generated 244 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:02.753071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.753671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.754660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.755095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.763840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-342f15e8-4bf3-42fa-8399-212e46f22e59 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:02.768479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-342f15e8-4bf3-42fa-8399-212e46f22e59 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:02.793820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-342f15e8-4bf3-42fa-8399-212e46f22e59 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.798951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-342f15e8-4bf3-42fa-8399-212e46f22e59 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.799158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Getting quotas for project 41ba023317344d3490bdb01aa8b1e01b. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:02.805942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-342f15e8-4bf3-42fa-8399-212e46f22e59 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.807030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-342f15e8-4bf3-42fa-8399-212e46f22e59 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.814188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Getting quotas for user 9aa79203e62546cea351116b153afee5 and project 41ba023317344d3490bdb01aa8b1e01b. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:02.843724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:02.846072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:02.942592 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ff8d89e0-0ec7-4186-b671-20c9bf1e0d17 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236523 Jul 20 04:11:02.943752 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 115/240] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:02.950138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5232bb0f-eeeb-418c-85fe-e45d99072f00 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:02.950981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5232bb0f-eeeb-418c-85fe-e45d99072f00 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:02.960536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5232bb0f-eeeb-418c-85fe-e45d99072f00 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.961309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5232bb0f-eeeb-418c-85fe-e45d99072f00 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.962243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5232bb0f-eeeb-418c-85fe-e45d99072f00 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.962830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5232bb0f-eeeb-418c-85fe-e45d99072f00 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:03.678292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-342f15e8-4bf3-42fa-8399-212e46f22e59 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:03.690803 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-342f15e8-4bf3-42fa-8399-212e46f22e59 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1387 microversion: 2.1 time: 0.946707 Jul 20 04:11:03.693165 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 126/241] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:02 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1387 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:03.705212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f86afb7-19b8-4f95-a662-ef8c8dd0952d tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:03.711348 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:03.711348 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:03.731166 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f86afb7-19b8-4f95-a662-ef8c8dd0952d tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.1 time: 0.035932 Jul 20 04:11:03.732499 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 127/242] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:11:03 2022] GET /compute/v2.1/os-aggregates => generated 247 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:03.747275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da9c8a9b-2b3f-47a4-8425-475132389b1d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:03.748798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-da9c8a9b-2b3f-47a4-8425-475132389b1d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:03.762531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da9c8a9b-2b3f-47a4-8425-475132389b1d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:03.763244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da9c8a9b-2b3f-47a4-8425-475132389b1d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:03.765217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da9c8a9b-2b3f-47a4-8425-475132389b1d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:03.765832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da9c8a9b-2b3f-47a4-8425-475132389b1d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:03.781734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5232bb0f-eeeb-418c-85fe-e45d99072f00 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:03.785708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:03.812385 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5232bb0f-eeeb-418c-85fe-e45d99072f00 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1320 microversion: 2.1 time: 0.867150 Jul 20 04:11:03.813132 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 116/243] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:02 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1320 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:03.817999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a6060257-566b-472a-a326-4f0ac83fc60a req-fab2ce50-0288-474a-9d71-fe3ef71f0c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50659bf-f42b-4cb4-899f-20eeaf84e5c1", "name": "network-vif-plugged", "status": "completed", "tag": "81234abf-cf0a-4b1c-aace-641cfdd0a454"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:03.844425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a6060257-566b-472a-a326-4f0ac83fc60a req-fab2ce50-0288-474a-9d71-fe3ef71f0c7c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:03.845089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a6060257-566b-472a-a326-4f0ac83fc60a req-fab2ce50-0288-474a-9d71-fe3ef71f0c7c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:03.875852 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a6060257-566b-472a-a326-4f0ac83fc60a req-fab2ce50-0288-474a-9d71-fe3ef71f0c7c service nova] Creating event network-vif-plugged:81234abf-cf0a-4b1c-aace-641cfdd0a454 for instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 on n-h2-764485-11 Jul 20 04:11:03.879865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-da9c8a9b-2b3f-47a4-8425-475132389b1d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:03.890030 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da9c8a9b-2b3f-47a4-8425-475132389b1d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1217 microversion: 2.1 time: 0.155915 Jul 20 04:11:03.895665 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 128/244] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:03 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:03.896566 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a6060257-566b-472a-a326-4f0ac83fc60a req-fab2ce50-0288-474a-9d71-fe3ef71f0c7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082400 Jul 20 04:11:03.897168 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 117/245] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:03.909310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-64ef3e5d-fb32-4d04-9fa7-12fa4fb341f2 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:03.910622 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:03.910622 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:03.934900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64ef3e5d-fb32-4d04-9fa7-12fa4fb341f2 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:03.936213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64ef3e5d-fb32-4d04-9fa7-12fa4fb341f2 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.127610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-90efee10-513e-40a4-a517-cc60809200ee req-54450e03-3e8e-4a11-88f2-3ea9dc7cc7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6676ea5-1699-463c-9d13-00747d0688ed", "tag": "c18844f5-107d-4b19-95f1-b7386256d826"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:04.131782 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-64ef3e5d-fb32-4d04-9fa7-12fa4fb341f2 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.225939 Jul 20 04:11:04.134152 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 129/246] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:11:03 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:04.150306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-90efee10-513e-40a4-a517-cc60809200ee req-54450e03-3e8e-4a11-88f2-3ea9dc7cc7fa service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.151171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-90efee10-513e-40a4-a517-cc60809200ee req-54450e03-3e8e-4a11-88f2-3ea9dc7cc7fa service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.152347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-873dc9e5-353e-4b1b-b001-7c480d05c574 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:04.154004 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:04.154004 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:04.183731 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-90efee10-513e-40a4-a517-cc60809200ee req-54450e03-3e8e-4a11-88f2-3ea9dc7cc7fa service nova] Creating event network-changed:c18844f5-107d-4b19-95f1-b7386256d826 for instance c6676ea5-1699-463c-9d13-00747d0688ed on n-h1-764485-11 Jul 20 04:11:04.200281 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-873dc9e5-353e-4b1b-b001-7c480d05c574 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.058779 Jul 20 04:11:04.201594 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 130/247] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:11:04 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:11:04.209236 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-90efee10-513e-40a4-a517-cc60809200ee req-54450e03-3e8e-4a11-88f2-3ea9dc7cc7fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080889 Jul 20 04:11:04.210223 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 118/248] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:04.215134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-acd93a74-6ea6-41c7-a36d-9e5f41d486ea tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1434183673"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:04.222465 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:04.222465 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:04.224700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.aggregate [None req-acd93a74-6ea6-41c7-a36d-9e5f41d486ea tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Generated uuid e71a4aae-b71a-4eda-b95b-a82d29cd412a for aggregate {{(pid=119808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:11:04.273630 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-acd93a74-6ea6-41c7-a36d-9e5f41d486ea tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062509 Jul 20 04:11:04.278439 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 131/249] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:11:04 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:04.290827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eb21783e-9b26-4731-b8b3-25f3cc08d69f tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-764485-11"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:04.294558 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:04.294558 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:04.331864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb21783e-9b26-4731-b8b3-25f3cc08d69f tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.332424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb21783e-9b26-4731-b8b3-25f3cc08d69f tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.543399 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eb21783e-9b26-4731-b8b3-25f3cc08d69f tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 244 microversion: 2.1 time: 0.259142 Jul 20 04:11:04.549705 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 119/250] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:11:04 2022] POST /compute/v2.1/os-aggregates/11/action => generated 244 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:04.555393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4f79c812-bf5f-4844-8f60-cb162ad1eea7 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:04.556740 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:04.556740 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:04.575343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f79c812-bf5f-4844-8f60-cb162ad1eea7 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.576406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f79c812-bf5f-4844-8f60-cb162ad1eea7 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.711408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b02d0189-156d-4dcf-9c07-d78547cbcdc3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:04.712366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b02d0189-156d-4dcf-9c07-d78547cbcdc3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:04.735417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b02d0189-156d-4dcf-9c07-d78547cbcdc3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.737298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b02d0189-156d-4dcf-9c07-d78547cbcdc3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.738336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b02d0189-156d-4dcf-9c07-d78547cbcdc3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.740382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b02d0189-156d-4dcf-9c07-d78547cbcdc3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.852193 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4f79c812-bf5f-4844-8f60-cb162ad1eea7 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.301299 Jul 20 04:11:04.861128 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 132/251] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:11:04 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:04.877238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-89002e6c-03eb-4d6b-ac71-ca1b85d1e116 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:04.883759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-89002e6c-03eb-4d6b-ac71-ca1b85d1e116 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:04.907731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89002e6c-03eb-4d6b-ac71-ca1b85d1e116 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.907731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89002e6c-03eb-4d6b-ac71-ca1b85d1e116 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.914285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89002e6c-03eb-4d6b-ac71-ca1b85d1e116 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.915232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89002e6c-03eb-4d6b-ac71-ca1b85d1e116 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:05.686217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-89002e6c-03eb-4d6b-ac71-ca1b85d1e116 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:05.704902 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-89002e6c-03eb-4d6b-ac71-ca1b85d1e116 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1320 microversion: 2.1 time: 0.842237 Jul 20 04:11:05.718235 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 133/252] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:04 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1320 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:05.723392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c89a0436-c115-40f8-9067-dcb2c0107ee1 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:05.724647 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:05.724647 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:05.769345 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c89a0436-c115-40f8-9067-dcb2c0107ee1 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.049525 Jul 20 04:11:05.770794 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 134/253] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:11:05 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:11:05.788574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-07187447-6fcf-42c4-b72c-5a702519e524 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:05.789385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-07187447-6fcf-42c4-b72c-5a702519e524 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:05.805796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-07187447-6fcf-42c4-b72c-5a702519e524 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:05.806896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-07187447-6fcf-42c4-b72c-5a702519e524 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:05.810363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-07187447-6fcf-42c4-b72c-5a702519e524 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:05.811053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-07187447-6fcf-42c4-b72c-5a702519e524 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:05.856829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b02d0189-156d-4dcf-9c07-d78547cbcdc3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:05.873880 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b02d0189-156d-4dcf-9c07-d78547cbcdc3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1387 microversion: 2.1 time: 1.167509 Jul 20 04:11:05.883600 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 120/254] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:04 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1387 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:05.898688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ec50f26-0ac2-4713-9700-fdc254af96c4 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-264274608"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:05.908309 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:05.908309 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:05.911793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.aggregate [None req-9ec50f26-0ac2-4713-9700-fdc254af96c4 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Generated uuid 8e5e0f3f-b0bb-440a-aed0-5d676fe50a51 for aggregate {{(pid=119807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:11:05.947753 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ec50f26-0ac2-4713-9700-fdc254af96c4 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062438 Jul 20 04:11:05.950365 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 121/255] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:11:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:05.957132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7c5dfaae-3c66-40a4-aa58-9f9676c8d1ee tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1655589238"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:05.970279 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:05.970279 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:05.972021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.aggregate [None req-7c5dfaae-3c66-40a4-aa58-9f9676c8d1ee tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Generated uuid dbaeab96-360a-466b-9f12-371198a2672a for aggregate {{(pid=119807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:11:05.991156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-07187447-6fcf-42c4-b72c-5a702519e524 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:06.006211 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-07187447-6fcf-42c4-b72c-5a702519e524 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1271 microversion: 2.1 time: 0.234023 Jul 20 04:11:06.007492 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 135/256] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:05 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:06.027434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-851b2c44-c6e4-4d5a-b49a-091ac7de5125 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:06.035762 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7c5dfaae-3c66-40a4-aa58-9f9676c8d1ee tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.081830 Jul 20 04:11:06.036793 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.036793 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:06.043722 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 122/257] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:11:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:06.061335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ae84ec37-2c89-431b-95d4-d1e9cf5dacca tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.062709 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.062709 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:06.064149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-851b2c44-c6e4-4d5a-b49a-091ac7de5125 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:06.066824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-851b2c44-c6e4-4d5a-b49a-091ac7de5125 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:06.124557 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ae84ec37-2c89-431b-95d4-d1e9cf5dacca tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.073397 Jul 20 04:11:06.129530 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 123/258] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:11:06 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 20 04:11:06.146688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f117043b-1745-4bfe-9830-837ec5f22edd tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.149658 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.149658 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:06.185039 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f117043b-1745-4bfe-9830-837ec5f22edd tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f117043b-1745-4bfe-9830-837ec5f22edd tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Request method failure captured: Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AlewHYRRJWXRE8mK4UMmbaqsxpT9PaD6LBIbqIQ9oB0626M85z8nTJRVV2RRShzJEKvKVTYlqsZalE6Bj0uHjE6aS_DWM4hreeFwEfXSS2L2KWXkSmZE3MvvHnZoLzzupMO-fKGJkVVrdj-5NTvDOgL656kn-p_YJqVMa56R1HCgs Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: b610f4996b124c2195ca3e374a374385 Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminTestJSON-513834060 Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:11:06.190606 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b610f4996b124c2195ca3e374a374385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b610f4996b124c2195ca3e374a374385"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b610f4996b124c2195ca3e374a374385", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b610f4996b124c2195ca3e374a374385"}]}] Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminTestJSON-513834060 Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: b610f4996b124c2195ca3e374a374385 Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-513834060 Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminTestJSON-513834060-project-admin Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c844c7973c3748b78083390cee2ff5ac Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminTestJSON-513834060-project-admin Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: exception: Aggregate 13 could not be found. Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '13'} Jul 20 04:11:06.192154 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.193082 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Jul 20 04:11:06.194994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.198972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f117043b-1745-4bfe-9830-837ec5f22edd tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:06.200438 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f117043b-1745-4bfe-9830-837ec5f22edd tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.066767 Jul 20 04:11:06.204417 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 124/259] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:11:06 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:11:06.224316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-adcf00b1-c423-4dc5-9df2-01c06a46a86a tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.225913 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.225913 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:06.268769 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-adcf00b1-c423-4dc5-9df2-01c06a46a86a tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-adcf00b1-c423-4dc5-9df2-01c06a46a86a tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Request method failure captured: Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AlewHYRRJWXRE8mK4UMmbaqsxpT9PaD6LBIbqIQ9oB0626M85z8nTJRVV2RRShzJEKvKVTYlqsZalE6Bj0uHjE6aS_DWM4hreeFwEfXSS2L2KWXkSmZE3MvvHnZoLzzupMO-fKGJkVVrdj-5NTvDOgL656kn-p_YJqVMa56R1HCgs Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: b610f4996b124c2195ca3e374a374385 Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminTestJSON-513834060 Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:11:06.275202 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b610f4996b124c2195ca3e374a374385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b610f4996b124c2195ca3e374a374385"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b610f4996b124c2195ca3e374a374385", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b610f4996b124c2195ca3e374a374385"}]}] Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminTestJSON-513834060 Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: b610f4996b124c2195ca3e374a374385 Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-513834060 Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminTestJSON-513834060-project-admin Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c844c7973c3748b78083390cee2ff5ac Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminTestJSON-513834060-project-admin Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: exception: Aggregate 13 could not be found. Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '13'} Jul 20 04:11:06.276891 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:11:06.277789 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.279180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:06.280523 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:06.280523 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:06.280523 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:06.280523 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Jul 20 04:11:06.280523 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.282760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-adcf00b1-c423-4dc5-9df2-01c06a46a86a tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:06.285703 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-adcf00b1-c423-4dc5-9df2-01c06a46a86a tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.076020 Jul 20 04:11:06.288762 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 125/260] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:11:06 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:11:06.299374 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-851b2c44-c6e4-4d5a-b49a-091ac7de5125 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.280387 Jul 20 04:11:06.300060 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 136/261] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:11:06 2022] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:06.306119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3f076301-865e-4132-9ab8-4a78eb5a14a8 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-862579961", "name": "tempest-test_aggregate-1804426632"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:06.307645 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.307645 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:06.311923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f081678-f35a-4f42-a053-9842a06ac225 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:06.313405 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.313405 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:06.314518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1f081678-f35a-4f42-a053-9842a06ac225 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '076950d75573493cb2c19df8ddb2a420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d81c61c20641b29fa821c6ab641d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:06.316367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.aggregate [None req-3f076301-865e-4132-9ab8-4a78eb5a14a8 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Generated uuid 6cbf54f6-ebbf-4c3e-8e4e-684231ac8d4b for aggregate {{(pid=119807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f081678-f35a-4f42-a053-9842a06ac225 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Request method failure captured: Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 43 Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AiViJC-ZSHrLQWnsBcxj_wMbB9UigDgj8O6ngXnVovZu2Lfn2lLvd5hWxt00zQjCVgc6N1IGYxJwHXTpRxsG_bGeTbYnv8ePFlX4zNIVe7kIQXI6_m_NWcVKf5GWqatQKKM2ay7F3dkAsANUxdhAPtpzKFPvF5veOOoxRzpBZrTkk Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: e1d81c61c20641b29fa821c6ab641d78 Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:11:06.318500 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1d81c61c20641b29fa821c6ab641d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1d81c61c20641b29fa821c6ab641d78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1d81c61c20641b29fa821c6ab641d78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1d81c61c20641b29fa821c6ab641d78"}]}] Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: e1d81c61c20641b29fa821c6ab641d78 Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-374559130 Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AggregatesAdminNegativeTestJSON-374559130-project Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 076950d75573493cb2c19df8ddb2a420 Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-374559130-project Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: {"remove_host": {"host": "n-h1-764485-11"}} Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:11:06.320070 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h1-764485-11'}}} Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:06.320959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 04:11:06.322281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.327008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f081678-f35a-4f42-a053-9842a06ac225 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:06.328120 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f081678-f35a-4f42-a053-9842a06ac225 tempest-AggregatesAdminNegativeTestJSON-374559130 tempest-AggregatesAdminNegativeTestJSON-374559130-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.021924 Jul 20 04:11:06.328704 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 137/262] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:11:06 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:11:06.338887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5e3d2ea7-0a98-4114-8012-a0235fa71ad5 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:06.362266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e3d2ea7-0a98-4114-8012-a0235fa71ad5 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:06.365083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e3d2ea7-0a98-4114-8012-a0235fa71ad5 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:06.379945 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3f076301-865e-4132-9ab8-4a78eb5a14a8 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.084657 Jul 20 04:11:06.385886 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 126/263] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Jul 20 04:11:06 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:06.392881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a8d83621-c76c-4209-b728-805dd4ab0858 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.394013 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.394013 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:06.419322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=10,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:06.435987 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a8d83621-c76c-4209-b728-805dd4ab0858 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.048735 Jul 20 04:11:06.437437 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 127/264] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:11:06 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:11:06.474792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e62b4bde-1e9d-400c-be35-59d79e531999 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.476854 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.476854 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:06.498294 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e62b4bde-1e9d-400c-be35-59d79e531999 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e62b4bde-1e9d-400c-be35-59d79e531999 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Request method failure captured: Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AlewHYRRJWXRE8mK4UMmbaqsxpT9PaD6LBIbqIQ9oB0626M85z8nTJRVV2RRShzJEKvKVTYlqsZalE6Bj0uHjE6aS_DWM4hreeFwEfXSS2L2KWXkSmZE3MvvHnZoLzzupMO-fKGJkVVrdj-5NTvDOgL656kn-p_YJqVMa56R1HCgs Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: b610f4996b124c2195ca3e374a374385 Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminTestJSON-513834060 Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:11:06.500155 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b610f4996b124c2195ca3e374a374385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b610f4996b124c2195ca3e374a374385"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b610f4996b124c2195ca3e374a374385", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b610f4996b124c2195ca3e374a374385"}]}] Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminTestJSON-513834060 Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: b610f4996b124c2195ca3e374a374385 Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-513834060 Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminTestJSON-513834060-project-admin Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c844c7973c3748b78083390cee2ff5ac Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminTestJSON-513834060-project-admin Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: exception: Aggregate 14 could not be found. Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '14'} Jul 20 04:11:06.501620 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.502486 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 20 04:11:06.503747 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.507742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e62b4bde-1e9d-400c-be35-59d79e531999 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:06.508987 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e62b4bde-1e9d-400c-be35-59d79e531999 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.067672 Jul 20 04:11:06.509717 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 128/265] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:11:06 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:11:06.533680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-73412b7e-e005-425e-9dcb-b3564a417d07 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.535960 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.535960 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:06.561951 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-73412b7e-e005-425e-9dcb-b3564a417d07 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-73412b7e-e005-425e-9dcb-b3564a417d07 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Request method failure captured: Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AlewHYRRJWXRE8mK4UMmbaqsxpT9PaD6LBIbqIQ9oB0626M85z8nTJRVV2RRShzJEKvKVTYlqsZalE6Bj0uHjE6aS_DWM4hreeFwEfXSS2L2KWXkSmZE3MvvHnZoLzzupMO-fKGJkVVrdj-5NTvDOgL656kn-p_YJqVMa56R1HCgs Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: b610f4996b124c2195ca3e374a374385 Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminTestJSON-513834060 Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:11:06.564592 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b610f4996b124c2195ca3e374a374385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b610f4996b124c2195ca3e374a374385"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b610f4996b124c2195ca3e374a374385", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b610f4996b124c2195ca3e374a374385"}]}] Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminTestJSON-513834060 Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: b610f4996b124c2195ca3e374a374385 Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-513834060 Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminTestJSON-513834060-project-admin Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c844c7973c3748b78083390cee2ff5ac Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminTestJSON-513834060-project-admin Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: exception: Aggregate 14 could not be found. Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '14'} Jul 20 04:11:06.566029 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:11:06.566963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:06.568853 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:06.570159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:06.570159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:06.570159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:06.570159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 20 04:11:06.570159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:06.573370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-73412b7e-e005-425e-9dcb-b3564a417d07 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:06.576251 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-73412b7e-e005-425e-9dcb-b3564a417d07 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.061221 Jul 20 04:11:06.588092 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 129/266] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:11:06 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:11:06.614310 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5e3d2ea7-0a98-4114-8012-a0235fa71ad5 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.277421 Jul 20 04:11:06.615957 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 138/267] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:11:06 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:06.617259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8119d81f-9469-49c4-91e7-09a7e07aa2f6 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-471045414"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:06.622714 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.622714 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:06.634213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.aggregate [None req-8119d81f-9469-49c4-91e7-09a7e07aa2f6 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Generated uuid 94086468-7654-4746-870f-0bf07110668b for aggregate {{(pid=119807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:11:06.639533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b72cc961-34ce-40d1-b9a3-a93d5c163d94 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.642589 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.642589 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:06.718631 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8119d81f-9469-49c4-91e7-09a7e07aa2f6 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.128016 Jul 20 04:11:06.721035 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b72cc961-34ce-40d1-b9a3-a93d5c163d94 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.095509 Jul 20 04:11:06.721555 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 139/268] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:11:06 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:11:06.723160 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 130/269] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:11:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:06.736262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02e774ac-5206-47a7-8198-fa852275c96c tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.741709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-78dd414c-b62b-4563-8e5a-9bc94c0336fe tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.745328 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.745328 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:06.751265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-78dd414c-b62b-4563-8e5a-9bc94c0336fe tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:06.768616 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-02e774ac-5206-47a7-8198-fa852275c96c tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.041009 Jul 20 04:11:06.769474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78dd414c-b62b-4563-8e5a-9bc94c0336fe tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:06.769919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78dd414c-b62b-4563-8e5a-9bc94c0336fe tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:06.770716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78dd414c-b62b-4563-8e5a-9bc94c0336fe tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:06.771204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78dd414c-b62b-4563-8e5a-9bc94c0336fe tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:06.771934 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 140/270] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:11:06 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:06.777765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a2d04881-f865-4d2c-ab64-078003f4721a tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-919042411"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:06.797449 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.797449 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:06.798520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.aggregate [None req-a2d04881-f865-4d2c-ab64-078003f4721a tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Generated uuid 0ab27875-9792-4a19-9896-010c1e8c3f4b for aggregate {{(pid=119808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:11:06.866420 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a2d04881-f865-4d2c-ab64-078003f4721a tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.093137 Jul 20 04:11:06.867448 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 141/271] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:11:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:06.877714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8b640065-670b-45f8-849f-dd94f1c74deb tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:06.884710 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.884710 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:06.961618 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8b640065-670b-45f8-849f-dd94f1c74deb tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.092273 Jul 20 04:11:06.962513 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 142/272] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:11:06 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:06.975703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4720b6fa-004a-4b3e-9b4d-8444335e722e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:06.977857 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:06.977857 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:06.992123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=14,nova_api:INSERT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:07.012313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:07.021116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4720b6fa-004a-4b3e-9b4d-8444335e722e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.023221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4720b6fa-004a-4b3e-9b4d-8444335e722e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.050304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=9 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:07.054659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4720b6fa-004a-4b3e-9b4d-8444335e722e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.057187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4720b6fa-004a-4b3e-9b4d-8444335e722e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.075181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.compute.aggregates [None req-4720b6fa-004a-4b3e-9b4d-8444335e722e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 20 04:11:07.077696 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-4720b6fa-004a-4b3e-9b4d-8444335e722e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4720b6fa-004a-4b3e-9b4d-8444335e722e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Request method failure captured: Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 42 Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AlkGCXnfxc4AXX1u7MrmYgpSFGYyhagntX5BdrefHGYNBjEykF6vWpG19XtHrjHT3sGkE2TxD4Z5tQqX6ZNnnNLxQYpEHXqwHRcHV14GhlifRgOY3E-_IrGpEur1-RZvyWn6WfJABtBr0wvMCXWrmCRg6OaKCo6I0q7BdqnV_00PU Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:11:07.080813 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5bcc08aebde45b69064b587428b1a1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5bcc08aebde45b69064b587428b1a1a"}]}] Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: f5bcc08aebde45b69064b587428b1a1a Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-228431943 Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 419ac8874da648cc8c6a40d03cf4fd94 Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: {"remove_host": {"host": "nonexist_host"}} Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:11:07.082184 n-d-764485-11 devstack@n-api.service[119808]: exception: Cannot remove host nonexist_host in aggregate 16 Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 20 04:11:07.083052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 20 04:11:07.084394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.085702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:07.087062 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:07.087062 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:07.087062 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:07.087062 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:07.087062 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Jul 20 04:11:07.087062 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:07.092958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4720b6fa-004a-4b3e-9b4d-8444335e722e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:07.094079 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4720b6fa-004a-4b3e-9b4d-8444335e722e tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.127877 Jul 20 04:11:07.095280 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 143/273] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:11:06 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:11:07.102577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-06e9f8ec-b479-4315-bb36-adfdfcadff81 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:07.106254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-06e9f8ec-b479-4315-bb36-adfdfcadff81 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:07.115614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06e9f8ec-b479-4315-bb36-adfdfcadff81 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.116368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06e9f8ec-b479-4315-bb36-adfdfcadff81 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.117336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06e9f8ec-b479-4315-bb36-adfdfcadff81 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.117934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06e9f8ec-b479-4315-bb36-adfdfcadff81 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.148647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:07.474466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-78dd414c-b62b-4563-8e5a-9bc94c0336fe tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:07.483972 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-78dd414c-b62b-4563-8e5a-9bc94c0336fe tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1320 microversion: 2.1 time: 0.757344 Jul 20 04:11:07.490987 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 131/274] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:06 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1320 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:07.505323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5b08cdd-8eb2-4c9f-acca-c6995deea5ee tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:07.506136 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:07.506136 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:07.520708 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5b08cdd-8eb2-4c9f-acca-c6995deea5ee tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.028152 Jul 20 04:11:07.523690 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 132/275] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:11:07 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:07.537587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-91921665-aff1-4098-9cc4-e3f55f502601 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:07.538610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-91921665-aff1-4098-9cc4-e3f55f502601 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:07.552767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91921665-aff1-4098-9cc4-e3f55f502601 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.556515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91921665-aff1-4098-9cc4-e3f55f502601 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.561571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91921665-aff1-4098-9cc4-e3f55f502601 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.564189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91921665-aff1-4098-9cc4-e3f55f502601 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.567171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-06e9f8ec-b479-4315-bb36-adfdfcadff81 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:07.577926 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-06e9f8ec-b479-4315-bb36-adfdfcadff81 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1586 microversion: 2.1 time: 0.479643 Jul 20 04:11:07.579188 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 144/276] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:07 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1586 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:07.585381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0bbdb6f-2481-4567-bd1d-c592b08a9030 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:07.587777 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:07.587777 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:07.632935 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b0bbdb6f-2481-4567-bd1d-c592b08a9030 tempest-AggregatesAdminNegativeTestJSON-228431943 tempest-AggregatesAdminNegativeTestJSON-228431943-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.052224 Jul 20 04:11:07.634208 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 145/277] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:11:07 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:11:07.821161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-91921665-aff1-4098-9cc4-e3f55f502601 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:07.830827 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-91921665-aff1-4098-9cc4-e3f55f502601 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1313 microversion: 2.1 time: 0.304904 Jul 20 04:11:07.831778 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 133/278] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:07 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:07.836752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e531408f-ae1f-4132-b3bb-cf27b037c3d1 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:07.837681 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:07.837681 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:07.871763 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e531408f-ae1f-4132-b3bb-cf27b037c3d1 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.038624 Jul 20 04:11:07.872967 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 134/279] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:11:07 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:11:07.879002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-624771f8-ce3b-4c70-9a97-6de27704d1bc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:07.881311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-624771f8-ce3b-4c70-9a97-6de27704d1bc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:07.896245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-624771f8-ce3b-4c70-9a97-6de27704d1bc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.898080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-624771f8-ce3b-4c70-9a97-6de27704d1bc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.899553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-624771f8-ce3b-4c70-9a97-6de27704d1bc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.903034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-624771f8-ce3b-4c70-9a97-6de27704d1bc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.013359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-13014f8c-5a39-41a3-a486-b820ac7d5418 tempest-FlavorsV2NegativeTest-1275923012 tempest-FlavorsV2NegativeTest-1275923012-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.039463 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-13014f8c-5a39-41a3-a486-b820ac7d5418 tempest-FlavorsV2NegativeTest-1275923012 tempest-FlavorsV2NegativeTest-1275923012-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.403909 Jul 20 04:11:08.045316 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 146/280] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:11:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:08.049950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f0fbc9be-1452-415f-99bd-3767ecbadd21 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-406292479", "availability_zone": "tempest-test_az-1033653531"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:08.147900 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:08.147900 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:08.153818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.aggregate [None req-f0fbc9be-1452-415f-99bd-3767ecbadd21 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Generated uuid 0e97015c-88c3-403f-b9ae-a9abc72946e9 for aggregate {{(pid=119808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:11:08.242912 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f0fbc9be-1452-415f-99bd-3767ecbadd21 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.196471 Jul 20 04:11:08.244180 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 147/281] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Jul 20 04:11:08 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:08.255907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ae98b307-5737-4af1-9fdf-14faf44834c8 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-406292479_new", "availability_zone": "tempest-test_az-1033653531_new"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:08.257736 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:08.257736 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:08.309690 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-624771f8-ce3b-4c70-9a97-6de27704d1bc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.435494 Jul 20 04:11:08.313211 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 135/282] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:11:07 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1/os-interface => generated 284 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:08.339491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae98b307-5737-4af1-9fdf-14faf44834c8 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.349969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae98b307-5737-4af1-9fdf-14faf44834c8 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.463908 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ae98b307-5737-4af1-9fdf-14faf44834c8 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.213262 Jul 20 04:11:08.465630 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 148/283] 10.222.0.20 () {60 vars in 1172 bytes} [Wed Jul 20 04:11:08 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:08.476371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b1b8d5a7-91ff-4ce4-b137-0dac6d827b4d tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.483992 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:08.483992 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:08.498597 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b1b8d5a7-91ff-4ce4-b137-0dac6d827b4d tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.026566 Jul 20 04:11:08.513157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a372000f-4190-4a3f-a80a-4e626bbc8703 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.513782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a372000f-4190-4a3f-a80a-4e626bbc8703 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:08.521812 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 136/284] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:11:08 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:08.544817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6b6c03e5-d6d5-4502-b2b2-d4ad3d4ef7a6 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.545762 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:08.545762 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:08.566814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a372000f-4190-4a3f-a80a-4e626bbc8703 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.567279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a372000f-4190-4a3f-a80a-4e626bbc8703 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.580738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a372000f-4190-4a3f-a80a-4e626bbc8703 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.581706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a372000f-4190-4a3f-a80a-4e626bbc8703 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.640745 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6b6c03e5-d6d5-4502-b2b2-d4ad3d4ef7a6 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.115821 Jul 20 04:11:08.641446 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 137/285] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:11:08 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:11:08.671890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7bf1ef8b-1c93-4f25-acde-692db8d45f61 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1759953394"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:08.676533 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:08.676533 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:08.679318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.aggregate [None req-7bf1ef8b-1c93-4f25-acde-692db8d45f61 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Generated uuid de869ecd-1138-4236-afb9-7d5c44937858 for aggregate {{(pid=119807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:11:08.719913 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7bf1ef8b-1c93-4f25-acde-692db8d45f61 tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.070434 Jul 20 04:11:08.720802 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 138/286] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:11:08 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:08.731830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ad8e1ef-55b3-490d-8307-085e292a18bb tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.733065 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:08.733065 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:08.763843 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ad8e1ef-55b3-490d-8307-085e292a18bb tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.033931 Jul 20 04:11:08.766277 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 139/287] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:11:08 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:08.777405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bc6b2923-a7d7-49c1-aba8-849334f1108b tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.779353 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:08.779353 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:08.835701 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bc6b2923-a7d7-49c1-aba8-849334f1108b tempest-AggregatesAdminTestJSON-513834060 tempest-AggregatesAdminTestJSON-513834060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.064027 Jul 20 04:11:08.836678 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 140/288] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:11:08 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:11:08.850979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59192ed6-13a2-4c65-833d-7254c343cf8a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.852731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-59192ed6-13a2-4c65-833d-7254c343cf8a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:08.876053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59192ed6-13a2-4c65-833d-7254c343cf8a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.876522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59192ed6-13a2-4c65-833d-7254c343cf8a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.878750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59192ed6-13a2-4c65-833d-7254c343cf8a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.879978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59192ed6-13a2-4c65-833d-7254c343cf8a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.916679 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-59192ed6-13a2-4c65-833d-7254c343cf8a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] HTTP exception thrown: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59192ed6-13a2-4c65-833d-7254c343cf8a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Request method failure captured: Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f HTTP/1.1 Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Ai8tIPkr2rh39_XDF0lyszPHAu0JVnJ6iKKqHCyMxG2BNfROolM-aIVMu4nLYbOdt2R2O3IZ0JrQdKFvYcjUT-vsvey96_CtNgKU22adpxdEwLHH3Uvbdzwpr1SRij6qOenkuptmcF8E20i-IWYwYPPa3GAcV8aAMw3G0GfeqM4U0 Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 49ca615bc66e4b3484501f12382935d3 Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminTestJSON-1913133297 Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:11:08.921529 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:11:08.922854 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/49ca615bc66e4b3484501f12382935d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/49ca615bc66e4b3484501f12382935d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_49ca615bc66e4b3484501f12382935d3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/49ca615bc66e4b3484501f12382935d3"}]}] Jul 20 04:11:08.922854 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminTestJSON-1913133297 Jul 20 04:11:08.922854 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 49ca615bc66e4b3484501f12382935d3 Jul 20 04:11:08.922854 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1913133297 Jul 20 04:11:08.922854 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminTestJSON-1913133297-project Jul 20 04:11:08.922854 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:11:08.922854 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:11:08.922854 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1c3684a008394684804d848903b195b4 Jul 20 04:11:08.922854 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminTestJSON-1913133297-project Jul 20 04:11:08.922854 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:11:08.922854 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:11:08.922854 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'ce6e616a-479d-497e-a6ff-89c5e2965e0f'} Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:08.923557 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:11:08.924634 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:08.925753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59192ed6-13a2-4c65-833d-7254c343cf8a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Returning 404 to user: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:08.927040 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-59192ed6-13a2-4c65-833d-7254c343cf8a tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 404 len: 111 microversion: 2.1 time: 0.082680 Jul 20 04:11:08.929291 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 141/289] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:08 2022] DELETE /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:11:08.943492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cfee918e-ac82-4cb9-b1f7-ab03bf2c9b73 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.944153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cfee918e-ac82-4cb9-b1f7-ab03bf2c9b73 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:08.960035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfee918e-ac82-4cb9-b1f7-ab03bf2c9b73 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.961280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfee918e-ac82-4cb9-b1f7-ab03bf2c9b73 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.965557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfee918e-ac82-4cb9-b1f7-ab03bf2c9b73 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.966106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfee918e-ac82-4cb9-b1f7-ab03bf2c9b73 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.051094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cfee918e-ac82-4cb9-b1f7-ab03bf2c9b73 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:10.061792 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cfee918e-ac82-4cb9-b1f7-ab03bf2c9b73 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1313 microversion: 2.1 time: 1.129221 Jul 20 04:11:10.062695 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 142/290] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:08 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1313 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:10.067975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c232cb79-bc2e-419b-a0e9-056bb0fa7ed6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:10.068755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c232cb79-bc2e-419b-a0e9-056bb0fa7ed6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] [instance: ce6e616a-479d-497e-a6ff-89c5e2965e0f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:10.078340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c232cb79-bc2e-419b-a0e9-056bb0fa7ed6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.079241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c232cb79-bc2e-419b-a0e9-056bb0fa7ed6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.080525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c232cb79-bc2e-419b-a0e9-056bb0fa7ed6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.081102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c232cb79-bc2e-419b-a0e9-056bb0fa7ed6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.102413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a372000f-4190-4a3f-a80a-4e626bbc8703 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:10.104573 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-c232cb79-bc2e-419b-a0e9-056bb0fa7ed6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] HTTP exception thrown: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c232cb79-bc2e-419b-a0e9-056bb0fa7ed6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Request method failure captured: Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f HTTP/1.1 Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Ai8tIPkr2rh39_XDF0lyszPHAu0JVnJ6iKKqHCyMxG2BNfROolM-aIVMu4nLYbOdt2R2O3IZ0JrQdKFvYcjUT-vsvey96_CtNgKU22adpxdEwLHH3Uvbdzwpr1SRij6qOenkuptmcF8E20i-IWYwYPPa3GAcV8aAMw3G0GfeqM4U0 Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 49ca615bc66e4b3484501f12382935d3 Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AggregatesAdminTestJSON-1913133297 Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:11:10.106473 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:11:10.108057 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/49ca615bc66e4b3484501f12382935d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/49ca615bc66e4b3484501f12382935d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_49ca615bc66e4b3484501f12382935d3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/49ca615bc66e4b3484501f12382935d3"}]}] Jul 20 04:11:10.108057 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AggregatesAdminTestJSON-1913133297 Jul 20 04:11:10.108057 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 49ca615bc66e4b3484501f12382935d3 Jul 20 04:11:10.108057 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1913133297 Jul 20 04:11:10.108057 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AggregatesAdminTestJSON-1913133297-project Jul 20 04:11:10.108057 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:11:10.108057 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:11:10.108057 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1c3684a008394684804d848903b195b4 Jul 20 04:11:10.108057 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AggregatesAdminTestJSON-1913133297-project Jul 20 04:11:10.108057 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:11:10.108057 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:11:10.108057 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'ce6e616a-479d-497e-a6ff-89c5e2965e0f'} Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:10.108968 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. Jul 20 04:11:10.110245 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:10.111415 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a372000f-4190-4a3f-a80a-4e626bbc8703 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1320 microversion: 2.1 time: 1.607071 Jul 20 04:11:10.112613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c232cb79-bc2e-419b-a0e9-056bb0fa7ed6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] Returning 404 to user: Instance ce6e616a-479d-497e-a6ff-89c5e2965e0f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:10.113689 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c232cb79-bc2e-419b-a0e9-056bb0fa7ed6 tempest-AggregatesAdminTestJSON-1913133297 tempest-AggregatesAdminTestJSON-1913133297-project] 10.222.0.20 "GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f" status: 404 len: 111 microversion: 2.1 time: 0.049771 Jul 20 04:11:10.114385 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 143/291] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:10 2022] GET /compute/v2.1/servers/ce6e616a-479d-497e-a6ff-89c5e2965e0f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:10.123892 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 149/292] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:08 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1320 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:10.129010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5774f5b-fa1e-4343-8ada-4ccc1ad87c56 tempest-FlavorsV2NegativeTest-1275923012 tempest-FlavorsV2NegativeTest-1275923012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-288801703", "imageRef": "d808a1c7-1bc6-4fa1-ba43-8549d52bef1d", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:10.217499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-d5774f5b-fa1e-4343-8ada-4ccc1ad87c56 tempest-FlavorsV2NegativeTest-1275923012 tempest-FlavorsV2NegativeTest-1275923012-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:10.648037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1001722934", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "bcbfb113-dc60-430e-be79-be98f4f2973e"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:10.740682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] validate_networks() for [('bcbfb113-dc60-430e-be79-be98f4f2973e', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:11.233097 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-d5774f5b-fa1e-4343-8ada-4ccc1ad87c56 tempest-FlavorsV2NegativeTest-1275923012 tempest-FlavorsV2NegativeTest-1275923012-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5774f5b-fa1e-4343-8ada-4ccc1ad87c56 tempest-FlavorsV2NegativeTest-1275923012 tempest-FlavorsV2NegativeTest-1275923012-project] Request method failure captured: Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 142 Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BakhxJJxJ4nNcpt-FtfbgIOeiZVel_KRWROuzkqMletuR2MroW_bzFvM9qUDQ4vPsnfSRTf9Ne3fseeTA4bV8e2CKijNxixLXC6hLfibXL5GoA-9sckussSz7jwutdWF4ZqSOAExlSJ_8Fm974VLVop5KlrtJkrWSMHbkfVbT7170 Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5e83808a92f941bd84fa7e4eb0a87e00 Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FlavorsV2NegativeTest-1275923012 Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:11:11.235351 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5e83808a92f941bd84fa7e4eb0a87e00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e83808a92f941bd84fa7e4eb0a87e00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5e83808a92f941bd84fa7e4eb0a87e00", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e83808a92f941bd84fa7e4eb0a87e00"}]}] Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FlavorsV2NegativeTest-1275923012 Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5e83808a92f941bd84fa7e4eb0a87e00 Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1275923012 Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FlavorsV2NegativeTest-1275923012-project Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 1659524c8f1047f3a6a52bb786467b17 Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FlavorsV2NegativeTest-1275923012-project Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-288801703", "imageRef": "d808a1c7-1bc6-4fa1-ba43-8549d52bef1d", "flavorRef": "452"}} Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:11:11.237054 n-d-764485-11 devstack@n-api.service[119808]: exception: Flavor's memory is too small for requested image. Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-288801703', 'imageRef': 'd808a1c7-1bc6-4fa1-ba43-8549d52bef1d', 'flavorRef': '452'}}} Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:11.238083 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:11.239591 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:11.241412 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:11.241412 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:11.241412 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:11.241412 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:11.241412 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 20 04:11:11.241412 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:11.241412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5774f5b-fa1e-4343-8ada-4ccc1ad87c56 tempest-FlavorsV2NegativeTest-1275923012 tempest-FlavorsV2NegativeTest-1275923012-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:11.241412 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d5774f5b-fa1e-4343-8ada-4ccc1ad87c56 tempest-FlavorsV2NegativeTest-1275923012 tempest-FlavorsV2NegativeTest-1275923012-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.112190 Jul 20 04:11:11.241412 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 150/293] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:10 2022] POST /compute/v2.1/servers => generated 93 bytes in 1115 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:11:11.279303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be8ab2bf-dec1-4483-8151-edfc44a825ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:11.283492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-be8ab2bf-dec1-4483-8151-edfc44a825ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:11.325898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be8ab2bf-dec1-4483-8151-edfc44a825ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:11.327488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be8ab2bf-dec1-4483-8151-edfc44a825ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:11.331362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be8ab2bf-dec1-4483-8151-edfc44a825ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:11.334895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be8ab2bf-dec1-4483-8151-edfc44a825ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:11.906827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-be8ab2bf-dec1-4483-8151-edfc44a825ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:11.921428 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-be8ab2bf-dec1-4483-8151-edfc44a825ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1313 microversion: 2.1 time: 0.680845 Jul 20 04:11:11.923437 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 151/294] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:11 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1313 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:12.512523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1436283317", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:12.645959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:12.780742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:12.833172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:13.389222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:13.390111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:13.390782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:13.391394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:13.392060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:13.411091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.414495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.416806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.419593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.487769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:13.489381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:13.490180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:13.490851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:13.491432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:13.500496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Getting quotas for project 9624de6b85e44fac9ab44c11d6cde04b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:13.506782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.508022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.510420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Getting quotas for user f96042a516bf425287c5b71cc3389cf0 and project 9624de6b85e44fac9ab44c11d6cde04b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:13.511817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.514536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.540803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:13.544722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:13.560025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Getting quotas for project 14ab6d1260864919b0f1b6d536fe65ae. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:13.574237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Getting quotas for user f94d458feafa4ec28c50a04fc2b2a1f4 and project 14ab6d1260864919b0f1b6d536fe65ae. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:13.598734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:13.610177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:13.649926 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7f2a39b2-6a33-4ea5-9adc-33590198b49c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723309 Jul 20 04:11:13.656808 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 152/295] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:13.666774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-70381752-0e56-4805-ba3b-8cd98a9279a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:13.674387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-70381752-0e56-4805-ba3b-8cd98a9279a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:13.694653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70381752-0e56-4805-ba3b-8cd98a9279a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.695425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70381752-0e56-4805-ba3b-8cd98a9279a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.696445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70381752-0e56-4805-ba3b-8cd98a9279a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.697125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70381752-0e56-4805-ba3b-8cd98a9279a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.766770 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-86e6f68c-1a6e-4981-ab91-c19746e0229f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.650990 Jul 20 04:11:13.767432 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 144/296] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:13.786492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-327127b3-1635-4b74-9cac-fb3ea5adfd19 req-470ce5f5-fa63-4642-81e4-4248804aeb52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3434c2d3-9cb3-4688-8374-91f655cb9214", "tag": "44b6c604-ac5e-4cec-9cac-9977a72935b5"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:13.838224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-327127b3-1635-4b74-9cac-fb3ea5adfd19 req-470ce5f5-fa63-4642-81e4-4248804aeb52 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.838708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-327127b3-1635-4b74-9cac-fb3ea5adfd19 req-470ce5f5-fa63-4642-81e4-4248804aeb52 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.889160 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-327127b3-1635-4b74-9cac-fb3ea5adfd19 req-470ce5f5-fa63-4642-81e4-4248804aeb52 service nova] Creating event network-changed:44b6c604-ac5e-4cec-9cac-9977a72935b5 for instance 3434c2d3-9cb3-4688-8374-91f655cb9214 on n-h1-764485-11 Jul 20 04:11:13.910358 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-327127b3-1635-4b74-9cac-fb3ea5adfd19 req-470ce5f5-fa63-4642-81e4-4248804aeb52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139479 Jul 20 04:11:13.922747 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 145/297] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:13.941234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e05c3653-b7a3-4ddf-9fba-c992f9804ec5 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:13.948525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e05c3653-b7a3-4ddf-9fba-c992f9804ec5 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:13.967881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e05c3653-b7a3-4ddf-9fba-c992f9804ec5 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.969475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e05c3653-b7a3-4ddf-9fba-c992f9804ec5 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.970812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e05c3653-b7a3-4ddf-9fba-c992f9804ec5 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.973484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e05c3653-b7a3-4ddf-9fba-c992f9804ec5 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.451685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e05c3653-b7a3-4ddf-9fba-c992f9804ec5 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:14.464971 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e05c3653-b7a3-4ddf-9fba-c992f9804ec5 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 200 len: 1586 microversion: 2.1 time: 0.539169 Jul 20 04:11:14.465750 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 146/298] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:13 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 1586 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:14.478452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-671a1760-bf0d-4c5c-8964-e4694f233368 req-bde91fba-91f0-4c7d-8c3c-8c278c7722c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6676ea5-1699-463c-9d13-00747d0688ed", "name": "network-vif-plugged", "status": "completed", "tag": "c18844f5-107d-4b19-95f1-b7386256d826"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:14.504430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-671a1760-bf0d-4c5c-8964-e4694f233368 req-bde91fba-91f0-4c7d-8c3c-8c278c7722c3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.506691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-671a1760-bf0d-4c5c-8964-e4694f233368 req-bde91fba-91f0-4c7d-8c3c-8c278c7722c3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.530202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-70381752-0e56-4805-ba3b-8cd98a9279a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:14.554390 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-671a1760-bf0d-4c5c-8964-e4694f233368 req-bde91fba-91f0-4c7d-8c3c-8c278c7722c3 service nova] Creating event network-vif-plugged:c18844f5-107d-4b19-95f1-b7386256d826 for instance c6676ea5-1699-463c-9d13-00747d0688ed on n-h1-764485-11 Jul 20 04:11:14.566035 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-671a1760-bf0d-4c5c-8964-e4694f233368 req-bde91fba-91f0-4c7d-8c3c-8c278c7722c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098323 Jul 20 04:11:14.567139 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 147/299] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:14.568149 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-70381752-0e56-4805-ba3b-8cd98a9279a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1320 microversion: 2.1 time: 0.910019 Jul 20 04:11:14.568646 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 153/300] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:13 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1320 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:14.584838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec41d565-e008-4f51-b34c-37358f7adcd0 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:14.591445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-409c8b91-1e03-408c-812a-60dee27abf72 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:14.592776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ec41d565-e008-4f51-b34c-37358f7adcd0 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:14.593104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-409c8b91-1e03-408c-812a-60dee27abf72 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:14.602195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-409c8b91-1e03-408c-812a-60dee27abf72 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.603048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-409c8b91-1e03-408c-812a-60dee27abf72 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.604382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-409c8b91-1e03-408c-812a-60dee27abf72 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.605235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-409c8b91-1e03-408c-812a-60dee27abf72 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.711791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ec41d565-e008-4f51-b34c-37358f7adcd0 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:14.722667 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ec41d565-e008-4f51-b34c-37358f7adcd0 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1219 microversion: 2.1 time: 0.151350 Jul 20 04:11:14.723276 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 154/301] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:14 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:14.745585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-76fa50c4-e3c1-4925-8ee9-42a431564903 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:14.746223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-76fa50c4-e3c1-4925-8ee9-42a431564903 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:14.878685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-76fa50c4-e3c1-4925-8ee9-42a431564903 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:14.891459 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-76fa50c4-e3c1-4925-8ee9-42a431564903 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1211 microversion: 2.1 time: 0.157077 Jul 20 04:11:14.892484 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 155/302] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:14 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1211 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:15.041181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-409c8b91-1e03-408c-812a-60dee27abf72 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:15.056253 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-409c8b91-1e03-408c-812a-60dee27abf72 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1313 microversion: 2.1 time: 0.487773 Jul 20 04:11:15.068631 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 148/303] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:14 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1313 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:15.429195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d6806e6a-564c-4f3d-b3a7-b390e768b73a tempest-InstanceUsageAuditLogTestJSON-578102228 tempest-InstanceUsageAuditLogTestJSON-578102228-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:15.430265 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:15.430265 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:15.463470 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d6806e6a-564c-4f3d-b3a7-b390e768b73a tempest-InstanceUsageAuditLogTestJSON-578102228 tempest-InstanceUsageAuditLogTestJSON-578102228-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20 04:11:14" status: 200 len: 318 microversion: 2.1 time: 0.569674 Jul 20 04:11:15.478826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4b74b67d-f7c3-48ea-998f-2ad32f2561e1 tempest-InstanceUsageAuditLogTestJSON-578102228 tempest-InstanceUsageAuditLogTestJSON-578102228-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:15.479062 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:15.479062 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:15.486750 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 156/304] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 04:11:14 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2004%3A11%3A14 => generated 318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:15.501199 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4b74b67d-f7c3-48ea-998f-2ad32f2561e1 tempest-InstanceUsageAuditLogTestJSON-578102228 tempest-InstanceUsageAuditLogTestJSON-578102228-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.027538 Jul 20 04:11:15.508760 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 149/305] 10.222.0.20 () {58 vars in 1184 bytes} [Wed Jul 20 04:11:15 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:15.585665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a04b2cb-d51c-461f-a941-f022e914db43 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:15.586908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3a04b2cb-d51c-461f-a941-f022e914db43 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:15.597238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a04b2cb-d51c-461f-a941-f022e914db43 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.598886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a04b2cb-d51c-461f-a941-f022e914db43 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.599803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a04b2cb-d51c-461f-a941-f022e914db43 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.601413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a04b2cb-d51c-461f-a941-f022e914db43 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.743995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5a5efa2b-ffc0-4e63-9630-7cebd9c101a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:15.746073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a5efa2b-ffc0-4e63-9630-7cebd9c101a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:15.754571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a5efa2b-ffc0-4e63-9630-7cebd9c101a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.755555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a5efa2b-ffc0-4e63-9630-7cebd9c101a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.758400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a5efa2b-ffc0-4e63-9630-7cebd9c101a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.759101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a5efa2b-ffc0-4e63-9630-7cebd9c101a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.012173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a5efa2b-ffc0-4e63-9630-7cebd9c101a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:16.020680 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5a5efa2b-ffc0-4e63-9630-7cebd9c101a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1271 microversion: 2.1 time: 0.282958 Jul 20 04:11:16.023675 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 150/306] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:15 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1271 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:16.036004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-20e6a16e-34f1-4713-af85-4bbd34cd4d7e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:16.037785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-20e6a16e-34f1-4713-af85-4bbd34cd4d7e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:16.047907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20e6a16e-34f1-4713-af85-4bbd34cd4d7e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.047907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20e6a16e-34f1-4713-af85-4bbd34cd4d7e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.048669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20e6a16e-34f1-4713-af85-4bbd34cd4d7e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.049169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20e6a16e-34f1-4713-af85-4bbd34cd4d7e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.128539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3a04b2cb-d51c-461f-a941-f022e914db43 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:16.139748 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a04b2cb-d51c-461f-a941-f022e914db43 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1320 microversion: 2.1 time: 0.556809 Jul 20 04:11:16.142428 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 157/307] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:15 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1320 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:16.152144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-11297552-62a2-4176-bf7e-827525d307c7 req-986fd88e-6528-476e-969a-75e9856b9680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50659bf-f42b-4cb4-899f-20eeaf84e5c1", "tag": "81234abf-cf0a-4b1c-aace-641cfdd0a454"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:16.186473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-11297552-62a2-4176-bf7e-827525d307c7 req-986fd88e-6528-476e-969a-75e9856b9680 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.188275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-11297552-62a2-4176-bf7e-827525d307c7 req-986fd88e-6528-476e-969a-75e9856b9680 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.244958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-11297552-62a2-4176-bf7e-827525d307c7 req-986fd88e-6528-476e-969a-75e9856b9680 service nova] Creating event network-changed:81234abf-cf0a-4b1c-aace-641cfdd0a454 for instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 on n-h2-764485-11 Jul 20 04:11:16.264886 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-11297552-62a2-4176-bf7e-827525d307c7 req-986fd88e-6528-476e-969a-75e9856b9680 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119980 Jul 20 04:11:16.271065 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 158/308] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:16.288844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-122857a5-656a-4207-b27f-fb17e257962e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:16.290028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-122857a5-656a-4207-b27f-fb17e257962e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:16.306147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-122857a5-656a-4207-b27f-fb17e257962e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.310352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-122857a5-656a-4207-b27f-fb17e257962e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.311379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-122857a5-656a-4207-b27f-fb17e257962e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.313614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-122857a5-656a-4207-b27f-fb17e257962e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.316126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-20e6a16e-34f1-4713-af85-4bbd34cd4d7e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:16.327644 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-20e6a16e-34f1-4713-af85-4bbd34cd4d7e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1263 microversion: 2.1 time: 0.299802 Jul 20 04:11:16.335894 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 151/309] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:16 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1263 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:16.878108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8410963b-35cf-46ed-a1dc-c94dae1c0376 tempest-AZAdminNegativeTestJSON-1973697289 tempest-AZAdminNegativeTestJSON-1973697289-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:16.879866 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:16.879866 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:16.882029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8410963b-35cf-46ed-a1dc-c94dae1c0376 tempest-AZAdminNegativeTestJSON-1973697289 tempest-AZAdminNegativeTestJSON-1973697289-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'f527e04c98a54181a3f82475ddd7c869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49777fbd6bd4d14842d0f833d90d76e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8410963b-35cf-46ed-a1dc-c94dae1c0376 tempest-AZAdminNegativeTestJSON-1973697289 tempest-AZAdminNegativeTestJSON-1973697289-project] Request method failure captured: Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BiTMzgkhxf-MH7Zef2veliQfzr4sQTcMAPOQm9eNCApmp7qM972ud2R5MtrnXQzfRGQLehNWjC_cxw5_mLFLv2vMJsIwu3qEAfB2zuImtLp2-qGSsKOuHaSOrw-3dsu1lHRWyvSLtwZ4HqFvuZGTlM6g4YpBWv71YXKrEry0DRkE8 Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: f49777fbd6bd4d14842d0f833d90d76e Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1973697289 Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:11:16.886110 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:11:16.887398 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f49777fbd6bd4d14842d0f833d90d76e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f49777fbd6bd4d14842d0f833d90d76e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f49777fbd6bd4d14842d0f833d90d76e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f49777fbd6bd4d14842d0f833d90d76e"}]}] Jul 20 04:11:16.887398 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AZAdminNegativeTestJSON-1973697289 Jul 20 04:11:16.887398 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: f49777fbd6bd4d14842d0f833d90d76e Jul 20 04:11:16.887398 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1973697289 Jul 20 04:11:16.887398 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AZAdminNegativeTestJSON-1973697289-project Jul 20 04:11:16.887398 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:11:16.887398 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:11:16.887398 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: f527e04c98a54181a3f82475ddd7c869 Jul 20 04:11:16.887398 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AZAdminNegativeTestJSON-1973697289-project Jul 20 04:11:16.887398 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:11:16.887398 n-d-764485-11 devstack@n-api.service[119807]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 04:11:16.887398 n-d-764485-11 devstack@n-api.service[119807]: action_args: {} Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:16.888167 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 04:11:16.889223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:16.893148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8410963b-35cf-46ed-a1dc-c94dae1c0376 tempest-AZAdminNegativeTestJSON-1973697289 tempest-AZAdminNegativeTestJSON-1973697289-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:16.894044 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8410963b-35cf-46ed-a1dc-c94dae1c0376 tempest-AZAdminNegativeTestJSON-1973697289 tempest-AZAdminNegativeTestJSON-1973697289-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.526595 Jul 20 04:11:16.895108 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 152/310] 10.222.0.20 () {58 vars in 1184 bytes} [Wed Jul 20 04:11:16 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 528 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:11:17.000633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-122857a5-656a-4207-b27f-fb17e257962e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:17.009206 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-122857a5-656a-4207-b27f-fb17e257962e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1313 microversion: 2.1 time: 0.732645 Jul 20 04:11:17.014856 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 159/311] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:16 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:17.046267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1afbcfb1-2d20-4f96-aec2-817b2741c3a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:17.047101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1afbcfb1-2d20-4f96-aec2-817b2741c3a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:17.059990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1afbcfb1-2d20-4f96-aec2-817b2741c3a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.065038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1afbcfb1-2d20-4f96-aec2-817b2741c3a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.065972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1afbcfb1-2d20-4f96-aec2-817b2741c3a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.066415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1afbcfb1-2d20-4f96-aec2-817b2741c3a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.159421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fb83c526-a457-46bb-83cc-80c8ffc25db0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:17.160096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fb83c526-a457-46bb-83cc-80c8ffc25db0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:17.160218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1afbcfb1-2d20-4f96-aec2-817b2741c3a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:17.168910 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1afbcfb1-2d20-4f96-aec2-817b2741c3a6 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1277 microversion: 2.1 time: 0.130938 Jul 20 04:11:17.183653 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 153/312] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:17 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:17.193164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb83c526-a457-46bb-83cc-80c8ffc25db0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.193624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb83c526-a457-46bb-83cc-80c8ffc25db0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.195316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb83c526-a457-46bb-83cc-80c8ffc25db0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.195800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb83c526-a457-46bb-83cc-80c8ffc25db0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.346595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-033a3756-454e-4a04-858e-35f98d2b2ad5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:17.347365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-033a3756-454e-4a04-858e-35f98d2b2ad5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:17.357508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-033a3756-454e-4a04-858e-35f98d2b2ad5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.361630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-033a3756-454e-4a04-858e-35f98d2b2ad5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.362599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-033a3756-454e-4a04-858e-35f98d2b2ad5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.363188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-033a3756-454e-4a04-858e-35f98d2b2ad5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.507290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-033a3756-454e-4a04-858e-35f98d2b2ad5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:17.521012 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-033a3756-454e-4a04-858e-35f98d2b2ad5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1269 microversion: 2.1 time: 0.178245 Jul 20 04:11:17.522373 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 154/313] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:17 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:17.581163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fb83c526-a457-46bb-83cc-80c8ffc25db0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:17.589823 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fb83c526-a457-46bb-83cc-80c8ffc25db0 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1320 microversion: 2.1 time: 0.433915 Jul 20 04:11:17.594901 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 160/314] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:17 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1320 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:18.030246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dbb314e0-01cf-4fb9-9698-ba167ffb18f6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:18.031225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dbb314e0-01cf-4fb9-9698-ba167ffb18f6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:18.037770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbb314e0-01cf-4fb9-9698-ba167ffb18f6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.038600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbb314e0-01cf-4fb9-9698-ba167ffb18f6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.039648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbb314e0-01cf-4fb9-9698-ba167ffb18f6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.040556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbb314e0-01cf-4fb9-9698-ba167ffb18f6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.193652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4025376b-6275-429e-88e5-a1dccc993718 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:18.194269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4025376b-6275-429e-88e5-a1dccc993718 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:18.201741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4025376b-6275-429e-88e5-a1dccc993718 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.202425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4025376b-6275-429e-88e5-a1dccc993718 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.203384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4025376b-6275-429e-88e5-a1dccc993718 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.203989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4025376b-6275-429e-88e5-a1dccc993718 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.346139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4025376b-6275-429e-88e5-a1dccc993718 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:18.354161 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4025376b-6275-429e-88e5-a1dccc993718 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1277 microversion: 2.1 time: 0.164491 Jul 20 04:11:18.365558 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 161/315] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:18 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:18.382972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dbb314e0-01cf-4fb9-9698-ba167ffb18f6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:18.392468 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dbb314e0-01cf-4fb9-9698-ba167ffb18f6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1313 microversion: 2.1 time: 0.366105 Jul 20 04:11:18.393153 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 155/316] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:18 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:18.435762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9660c734-2e57-4a5b-9b7a-0e8c9a56ccf3 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9df1d040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:18.494174 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9660c734-2e57-4a5b-9b7a-0e8c9a56ccf3 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/c4be3b05-f993-4f22-9f45-7ad275f8093e" status: 200 len: 662 microversion: 2.1 time: 0.062861 Jul 20 04:11:18.494752 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 162/317] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:18 2022] GET /compute/v2.1/images/c4be3b05-f993-4f22-9f45-7ad275f8093e => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:18.512443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dfabe4bf-56d7-4fd7-bd3e-4c866ecc1b62 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dd240d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:18.552288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df08571f-ff6c-4f85-973a-e5d07f10e9ad tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:18.552923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df08571f-ff6c-4f85-973a-e5d07f10e9ad tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:18.602605 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dfabe4bf-56d7-4fd7-bd3e-4c866ecc1b62 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/c4be3b05-f993-4f22-9f45-7ad275f8093e" status: 200 len: 662 microversion: 2.1 time: 0.097838 Jul 20 04:11:18.605126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df08571f-ff6c-4f85-973a-e5d07f10e9ad tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.607166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df08571f-ff6c-4f85-973a-e5d07f10e9ad tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.611686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df08571f-ff6c-4f85-973a-e5d07f10e9ad tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.612608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df08571f-ff6c-4f85-973a-e5d07f10e9ad tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.613580 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 156/318] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:18 2022] GET /compute/v2.1/images/c4be3b05-f993-4f22-9f45-7ad275f8093e => generated 662 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:18.621423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-913033e0-046b-4a2e-a667-fb2d0a7be2bf tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:18.622350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-913033e0-046b-4a2e-a667-fb2d0a7be2bf tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:18.629744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-913033e0-046b-4a2e-a667-fb2d0a7be2bf tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.630514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-913033e0-046b-4a2e-a667-fb2d0a7be2bf tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.631584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-913033e0-046b-4a2e-a667-fb2d0a7be2bf tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.632242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-913033e0-046b-4a2e-a667-fb2d0a7be2bf tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.124002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-913033e0-046b-4a2e-a667-fb2d0a7be2bf tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:19.131838 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-913033e0-046b-4a2e-a667-fb2d0a7be2bf tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1470 microversion: 2.1 time: 0.516176 Jul 20 04:11:19.135187 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 157/319] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:18 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1470 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:19.145539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df08571f-ff6c-4f85-973a-e5d07f10e9ad tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:19.151691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-35361382-bdac-4c72-9420-eb5c4c51fb00 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:19.152825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-35361382-bdac-4c72-9420-eb5c4c51fb00 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:19.159919 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df08571f-ff6c-4f85-973a-e5d07f10e9ad tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1311 microversion: 2.1 time: 0.623510 Jul 20 04:11:19.160674 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 163/320] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:18 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1311 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:19.168269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35361382-bdac-4c72-9420-eb5c4c51fb00 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.168909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35361382-bdac-4c72-9420-eb5c4c51fb00 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.169507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35361382-bdac-4c72-9420-eb5c4c51fb00 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.169944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35361382-bdac-4c72-9420-eb5c4c51fb00 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.235883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:19.389260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d0e3e460-f4b8-45f7-8349-e5e6fe9ca325 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.391287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d0e3e460-f4b8-45f7-8349-e5e6fe9ca325 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:19.398207 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-35361382-bdac-4c72-9420-eb5c4c51fb00 tempest-DeleteServersAdminTestJSON-1709391986 tempest-DeleteServersAdminTestJSON-1709391986-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed/action" status: 202 len: 0 microversion: 2.1 time: 0.250191 Jul 20 04:11:19.399299 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 158/321] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:11:19 2022] POST /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:11:19.408520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-657611b5-9ffb-4999-b8ab-432d1d9f08b5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.409121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-657611b5-9ffb-4999-b8ab-432d1d9f08b5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:19.411174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0e3e460-f4b8-45f7-8349-e5e6fe9ca325 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.414163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0e3e460-f4b8-45f7-8349-e5e6fe9ca325 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.416001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0e3e460-f4b8-45f7-8349-e5e6fe9ca325 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.417908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0e3e460-f4b8-45f7-8349-e5e6fe9ca325 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.431188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-657611b5-9ffb-4999-b8ab-432d1d9f08b5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.432060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-657611b5-9ffb-4999-b8ab-432d1d9f08b5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.434430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-657611b5-9ffb-4999-b8ab-432d1d9f08b5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.435122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-657611b5-9ffb-4999-b8ab-432d1d9f08b5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.494528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-657611b5-9ffb-4999-b8ab-432d1d9f08b5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.495571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-657611b5-9ffb-4999-b8ab-432d1d9f08b5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.496383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-657611b5-9ffb-4999-b8ab-432d1d9f08b5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lazy-loading 'fault' on Instance uuid c6676ea5-1699-463c-9d13-00747d0688ed {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:19.848835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d0e3e460-f4b8-45f7-8349-e5e6fe9ca325 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:19.876463 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d0e3e460-f4b8-45f7-8349-e5e6fe9ca325 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1319 microversion: 2.1 time: 0.497601 Jul 20 04:11:19.877232 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 164/322] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:19.895467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0134fea3-f9c5-4ba2-937a-907abd7b5cbc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.900379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0134fea3-f9c5-4ba2-937a-907abd7b5cbc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:19.920834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0134fea3-f9c5-4ba2-937a-907abd7b5cbc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.921283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0134fea3-f9c5-4ba2-937a-907abd7b5cbc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.922079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0134fea3-f9c5-4ba2-937a-907abd7b5cbc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.922512 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0134fea3-f9c5-4ba2-937a-907abd7b5cbc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.983786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-657611b5-9ffb-4999-b8ab-432d1d9f08b5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:19.998541 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-657611b5-9ffb-4999-b8ab-432d1d9f08b5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1453 microversion: 2.1 time: 0.588228 Jul 20 04:11:19.999745 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 159/323] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1453 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:20.017587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-91e39baf-0445-461d-ba04-65fe4bc9f73b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.018086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-91e39baf-0445-461d-ba04-65fe4bc9f73b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:20.041117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91e39baf-0445-461d-ba04-65fe4bc9f73b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.041772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91e39baf-0445-461d-ba04-65fe4bc9f73b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.043246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91e39baf-0445-461d-ba04-65fe4bc9f73b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.046986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91e39baf-0445-461d-ba04-65fe4bc9f73b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.094534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-91e39baf-0445-461d-ba04-65fe4bc9f73b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:11:20.216451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:20.248270 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-91e39baf-0445-461d-ba04-65fe4bc9f73b tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 204 len: 0 microversion: 2.1 time: 0.234475 Jul 20 04:11:20.249525 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 160/324] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:20 2022] DELETE /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:11:20.260498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-068454e0-409d-4a4f-84c4-8202e57dbf34 req-11042dfe-253e-4ff3-83d3-9f490555bcfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9df925-6109-4e21-a875-7d16c10d0b80", "tag": "c7162384-17f5-4ea8-95c6-748ce045c8bb"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:20.293853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-068454e0-409d-4a4f-84c4-8202e57dbf34 req-11042dfe-253e-4ff3-83d3-9f490555bcfb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.294497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-068454e0-409d-4a4f-84c4-8202e57dbf34 req-11042dfe-253e-4ff3-83d3-9f490555bcfb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.311050 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-068454e0-409d-4a4f-84c4-8202e57dbf34 req-11042dfe-253e-4ff3-83d3-9f490555bcfb service nova] Creating event network-changed:c7162384-17f5-4ea8-95c6-748ce045c8bb for instance 2d9df925-6109-4e21-a875-7d16c10d0b80 on n-h2-764485-11 Jul 20 04:11:20.332213 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-068454e0-409d-4a4f-84c4-8202e57dbf34 req-11042dfe-253e-4ff3-83d3-9f490555bcfb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072019 Jul 20 04:11:20.333689 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 161/325] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:20.352462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dc2a0b91-8db0-41c0-b2a3-e9a353fd10e1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.356777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dc2a0b91-8db0-41c0-b2a3-e9a353fd10e1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:20.400597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc2a0b91-8db0-41c0-b2a3-e9a353fd10e1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.401741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc2a0b91-8db0-41c0-b2a3-e9a353fd10e1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.403061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc2a0b91-8db0-41c0-b2a3-e9a353fd10e1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.403564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc2a0b91-8db0-41c0-b2a3-e9a353fd10e1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.641221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0134fea3-f9c5-4ba2-937a-907abd7b5cbc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:20.649364 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0134fea3-f9c5-4ba2-937a-907abd7b5cbc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1313 microversion: 2.1 time: 0.760925 Jul 20 04:11:20.649962 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 165/326] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:20.655385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c29c1ac6-c033-433e-ad0a-830714448315 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.656045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c29c1ac6-c033-433e-ad0a-830714448315 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:20.662616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c29c1ac6-c033-433e-ad0a-830714448315 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.663072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c29c1ac6-c033-433e-ad0a-830714448315 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.663868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c29c1ac6-c033-433e-ad0a-830714448315 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.664478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c29c1ac6-c033-433e-ad0a-830714448315 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.706685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c29c1ac6-c033-433e-ad0a-830714448315 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.707394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c29c1ac6-c033-433e-ad0a-830714448315 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.708031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-c29c1ac6-c033-433e-ad0a-830714448315 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lazy-loading 'fault' on Instance uuid c6676ea5-1699-463c-9d13-00747d0688ed {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:20.744707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dc2a0b91-8db0-41c0-b2a3-e9a353fd10e1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:20.754457 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dc2a0b91-8db0-41c0-b2a3-e9a353fd10e1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1311 microversion: 2.1 time: 0.410385 Jul 20 04:11:20.755578 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 162/327] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:20 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1311 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:20.768031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fb1d3813-494d-4f8f-9d52-f7bcf5da81d2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc8d700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.864110 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fb1d3813-494d-4f8f-9d52-f7bcf5da81d2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/827708cb-c9ec-4d88-9734-f1e84f99c64a" status: 200 len: 662 microversion: 2.1 time: 0.106819 Jul 20 04:11:20.864868 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 163/328] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:20 2022] GET /compute/v2.1/images/827708cb-c9ec-4d88-9734-f1e84f99c64a => generated 662 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:20.882023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-7082f5b1-4892-48f7-bdb3-df6222effd94 req-bb5f1e2d-d9e2-4705-9a20-c50c6f58c633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3434c2d3-9cb3-4688-8374-91f655cb9214", "name": "network-vif-plugged", "status": "completed", "tag": "44b6c604-ac5e-4cec-9cac-9977a72935b5"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:20.904124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7082f5b1-4892-48f7-bdb3-df6222effd94 req-bb5f1e2d-d9e2-4705-9a20-c50c6f58c633 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.907371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7082f5b1-4892-48f7-bdb3-df6222effd94 req-bb5f1e2d-d9e2-4705-9a20-c50c6f58c633 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.932176 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-7082f5b1-4892-48f7-bdb3-df6222effd94 req-bb5f1e2d-d9e2-4705-9a20-c50c6f58c633 service nova] Creating event network-vif-plugged:44b6c604-ac5e-4cec-9cac-9977a72935b5 for instance 3434c2d3-9cb3-4688-8374-91f655cb9214 on n-h1-764485-11 Jul 20 04:11:20.941117 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-7082f5b1-4892-48f7-bdb3-df6222effd94 req-bb5f1e2d-d9e2-4705-9a20-c50c6f58c633 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073794 Jul 20 04:11:20.942274 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 164/329] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:20.952944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-23c6a70a-1f47-4cd7-be1f-06e6c15892d8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dcdd700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.986807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c29c1ac6-c033-433e-ad0a-830714448315 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:21.010133 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c29c1ac6-c033-433e-ad0a-830714448315 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1459 microversion: 2.1 time: 0.349428 Jul 20 04:11:21.016665 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 166/330] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:20 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1459 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:21.021654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3c5e8dcc-99f6-44c0-8904-46d4f5c71a33 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.022275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3c5e8dcc-99f6-44c0-8904-46d4f5c71a33 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:21.030174 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-23c6a70a-1f47-4cd7-be1f-06e6c15892d8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/827708cb-c9ec-4d88-9734-f1e84f99c64a" status: 200 len: 662 microversion: 2.1 time: 0.081715 Jul 20 04:11:21.030902 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 165/331] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:20 2022] GET /compute/v2.1/images/827708cb-c9ec-4d88-9734-f1e84f99c64a => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:21.045040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3c5e8dcc-99f6-44c0-8904-46d4f5c71a33 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.045595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-105d3bfa-3e5a-4fe2-a4fc-df90369be4f8 req-8764faca-84b0-4597-aba9-3a0cd62a3a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9665e973-184b-48eb-92a4-1cbc4934ccbd", "tag": "b9525bbb-abed-4357-a15a-95f7e2b2780b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:21.052242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3c5e8dcc-99f6-44c0-8904-46d4f5c71a33 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.053082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3c5e8dcc-99f6-44c0-8904-46d4f5c71a33 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.053536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3c5e8dcc-99f6-44c0-8904-46d4f5c71a33 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.073226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-105d3bfa-3e5a-4fe2-a4fc-df90369be4f8 req-8764faca-84b0-4597-aba9-3a0cd62a3a80 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.074835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-105d3bfa-3e5a-4fe2-a4fc-df90369be4f8 req-8764faca-84b0-4597-aba9-3a0cd62a3a80 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.106268 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-105d3bfa-3e5a-4fe2-a4fc-df90369be4f8 req-8764faca-84b0-4597-aba9-3a0cd62a3a80 service nova] Creating event network-changed:b9525bbb-abed-4357-a15a-95f7e2b2780b for instance 9665e973-184b-48eb-92a4-1cbc4934ccbd on n-h2-764485-11 Jul 20 04:11:21.118416 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-105d3bfa-3e5a-4fe2-a4fc-df90369be4f8 req-8764faca-84b0-4597-aba9-3a0cd62a3a80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086288 Jul 20 04:11:21.120972 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 166/332] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:21.265843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3c5e8dcc-99f6-44c0-8904-46d4f5c71a33 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:21.275779 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3c5e8dcc-99f6-44c0-8904-46d4f5c71a33 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1319 microversion: 2.1 time: 0.257884 Jul 20 04:11:21.276445 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 167/333] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:21 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:21.666415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6e88464-a00d-4163-a109-22f8ae738ec4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.667692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a6e88464-a00d-4163-a109-22f8ae738ec4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:21.674002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6e88464-a00d-4163-a109-22f8ae738ec4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.674732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6e88464-a00d-4163-a109-22f8ae738ec4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.675542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6e88464-a00d-4163-a109-22f8ae738ec4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.676310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6e88464-a00d-4163-a109-22f8ae738ec4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.844912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a6e88464-a00d-4163-a109-22f8ae738ec4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:21.853131 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a6e88464-a00d-4163-a109-22f8ae738ec4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1313 microversion: 2.1 time: 0.190802 Jul 20 04:11:21.854446 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 167/334] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:21 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:21.860882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fb25a010-641e-431c-bb3e-c52550764bb0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.861727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fb25a010-641e-431c-bb3e-c52550764bb0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:21.869363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb25a010-641e-431c-bb3e-c52550764bb0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.870738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb25a010-641e-431c-bb3e-c52550764bb0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.871758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb25a010-641e-431c-bb3e-c52550764bb0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.872199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb25a010-641e-431c-bb3e-c52550764bb0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.015129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fb25a010-641e-431c-bb3e-c52550764bb0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:22.022945 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fb25a010-641e-431c-bb3e-c52550764bb0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1311 microversion: 2.1 time: 0.166310 Jul 20 04:11:22.023666 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 168/335] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:21 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1311 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:22.029115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-45b35657-dd19-4ad8-8ca8-28d7666ddc44 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.029813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-45b35657-dd19-4ad8-8ca8-28d7666ddc44 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:22.035929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45b35657-dd19-4ad8-8ca8-28d7666ddc44 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.036591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45b35657-dd19-4ad8-8ca8-28d7666ddc44 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.037550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45b35657-dd19-4ad8-8ca8-28d7666ddc44 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.038381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45b35657-dd19-4ad8-8ca8-28d7666ddc44 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.044137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-928983015", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:22.073434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45b35657-dd19-4ad8-8ca8-28d7666ddc44 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.074248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45b35657-dd19-4ad8-8ca8-28d7666ddc44 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.075069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-45b35657-dd19-4ad8-8ca8-28d7666ddc44 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lazy-loading 'fault' on Instance uuid c6676ea5-1699-463c-9d13-00747d0688ed {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:22.098006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:22.291628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-45b35657-dd19-4ad8-8ca8-28d7666ddc44 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:22.300472 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-45b35657-dd19-4ad8-8ca8-28d7666ddc44 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1459 microversion: 2.1 time: 0.275599 Jul 20 04:11:22.301633 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 169/336] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1459 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:22.306387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e8faa419-6da0-422f-80a9-1f53ae972e67 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.308156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e8faa419-6da0-422f-80a9-1f53ae972e67 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:22.320248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8faa419-6da0-422f-80a9-1f53ae972e67 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.321037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8faa419-6da0-422f-80a9-1f53ae972e67 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.322170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8faa419-6da0-422f-80a9-1f53ae972e67 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.322825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8faa419-6da0-422f-80a9-1f53ae972e67 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.636012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:22.636645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:22.637138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:22.642301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:22.642746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:22.657203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.657959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.658762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.659182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.681160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:22.685195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:22.687447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:22.708929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:22.711285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:22.783621 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023091 Jul 20 04:11:22.784562 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 168/337] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:22.785855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.787000 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bf0c2f1b-240b-490c-9c2d-f551af122bdc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001452 Jul 20 04:11:22.787492 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 169/338] 10.222.0.20 () {56 vars in 885 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:11:22.799221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e8faa419-6da0-422f-80a9-1f53ae972e67 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:22.813019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-500e50f9-a3d8-4707-86d6-0bb7ba987024 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9df371f0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.818785 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e8faa419-6da0-422f-80a9-1f53ae972e67 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1319 microversion: 2.1 time: 0.515831 Jul 20 04:11:22.822445 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 170/339] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:22.836380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3fbd16be-ad0e-4589-9b82-9f3077eca250 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.837139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3fbd16be-ad0e-4589-9b82-9f3077eca250 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:22.896568 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-500e50f9-a3d8-4707-86d6-0bb7ba987024 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/47390548-7f3e-40b6-bedc-e9cd7c80100a" status: 200 len: 662 microversion: 2.1 time: 0.089614 Jul 20 04:11:22.897456 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 170/340] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/images/47390548-7f3e-40b6-bedc-e9cd7c80100a => generated 662 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:22.902951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-12c437be-2fd2-4223-976f-59d04fd0082d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.903753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-12c437be-2fd2-4223-976f-59d04fd0082d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:22.915375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12c437be-2fd2-4223-976f-59d04fd0082d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.916059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12c437be-2fd2-4223-976f-59d04fd0082d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.917022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12c437be-2fd2-4223-976f-59d04fd0082d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.917673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12c437be-2fd2-4223-976f-59d04fd0082d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.937374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3fbd16be-ad0e-4589-9b82-9f3077eca250 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:22.944110 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3fbd16be-ad0e-4589-9b82-9f3077eca250 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1216 microversion: 2.1 time: 0.119676 Jul 20 04:11:22.944860 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 171/341] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:22.951087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fd4f32d2-0d89-4ee0-85a3-ed235c4d71b3 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc8d310>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:23.038981 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fd4f32d2-0d89-4ee0-85a3-ed235c4d71b3 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/47390548-7f3e-40b6-bedc-e9cd7c80100a" status: 200 len: 662 microversion: 2.1 time: 0.092288 Jul 20 04:11:23.040111 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 172/342] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/images/47390548-7f3e-40b6-bedc-e9cd7c80100a => generated 662 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:23.044955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-38ad8ef6-36bb-42e0-aa1d-67a2023f929c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:23.045893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-38ad8ef6-36bb-42e0-aa1d-67a2023f929c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:23.070156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38ad8ef6-36bb-42e0-aa1d-67a2023f929c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.071283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38ad8ef6-36bb-42e0-aa1d-67a2023f929c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:23.072707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38ad8ef6-36bb-42e0-aa1d-67a2023f929c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.076658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38ad8ef6-36bb-42e0-aa1d-67a2023f929c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:23.240267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-12c437be-2fd2-4223-976f-59d04fd0082d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:23.261682 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-12c437be-2fd2-4223-976f-59d04fd0082d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1463 microversion: 2.1 time: 0.359050 Jul 20 04:11:23.262373 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 171/343] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1463 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:23.280785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-974296642", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:23.346935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:23.440199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-38ad8ef6-36bb-42e0-aa1d-67a2023f929c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:23.456935 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-38ad8ef6-36bb-42e0-aa1d-67a2023f929c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1311 microversion: 2.1 time: 0.413962 Jul 20 04:11:23.469094 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 173/344] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:23 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1311 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:23.528944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:23.756761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9634e332-a139-44e0-92ff-705200f8674d tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:23.757485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9634e332-a139-44e0-92ff-705200f8674d tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:23.764972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9634e332-a139-44e0-92ff-705200f8674d tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.765706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9634e332-a139-44e0-92ff-705200f8674d tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:23.766706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9634e332-a139-44e0-92ff-705200f8674d tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.767458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9634e332-a139-44e0-92ff-705200f8674d tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.154864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:24.155667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:24.156155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:24.156567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:24.156980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:24.180005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.180553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.188567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.188567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.217428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Getting quotas for project 9dd02283590e49b8a869ff0f94f2884a. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:24.232253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Getting quotas for user 17824778e95f4fd1afb0a3c679b9be7f and project 9dd02283590e49b8a869ff0f94f2884a. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:24.271728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:24.277018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:24.333517 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9806737-9e31-495e-8b1b-1bd16a6bd5bb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057425 Jul 20 04:11:24.334431 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 172/345] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:24.339760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3f4a01a7-ba40-4ecb-8419-e741b00c1051 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:24.340625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3f4a01a7-ba40-4ecb-8419-e741b00c1051 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:24.348063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f4a01a7-ba40-4ecb-8419-e741b00c1051 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.348784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f4a01a7-ba40-4ecb-8419-e741b00c1051 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.349716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f4a01a7-ba40-4ecb-8419-e741b00c1051 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.350299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f4a01a7-ba40-4ecb-8419-e741b00c1051 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.383096 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9634e332-a139-44e0-92ff-705200f8674d tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1616 microversion: 2.1 time: 0.912544 Jul 20 04:11:24.386016 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 174/346] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:23 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1616 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:24.402999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f851858c-604a-4818-b2c0-ed322b6cce34 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:24.406446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f851858c-604a-4818-b2c0-ed322b6cce34 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:24.420858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f851858c-604a-4818-b2c0-ed322b6cce34 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.421416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f851858c-604a-4818-b2c0-ed322b6cce34 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.423682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f851858c-604a-4818-b2c0-ed322b6cce34 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.424428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f851858c-604a-4818-b2c0-ed322b6cce34 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.427270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f4a01a7-ba40-4ecb-8419-e741b00c1051 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.433580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f4a01a7-ba40-4ecb-8419-e741b00c1051 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.434417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-3f4a01a7-ba40-4ecb-8419-e741b00c1051 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lazy-loading 'fault' on Instance uuid c6676ea5-1699-463c-9d13-00747d0688ed {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:24.569966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3f4a01a7-ba40-4ecb-8419-e741b00c1051 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc805052a58e462b8560b1754e36e5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec3ed035cec44ee9c3a79a57782507f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:24.574154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:24.588018 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3f4a01a7-ba40-4ecb-8419-e741b00c1051 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 200 len: 1310 microversion: 2.1 time: 0.252017 Jul 20 04:11:24.592362 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 173/347] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:24 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 1310 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:24.602488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a2746325-bfe9-4bef-90e0-e40f08388f72 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:24.605402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a2746325-bfe9-4bef-90e0-e40f08388f72 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:24.632494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2746325-bfe9-4bef-90e0-e40f08388f72 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.633895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2746325-bfe9-4bef-90e0-e40f08388f72 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.636205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2746325-bfe9-4bef-90e0-e40f08388f72 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.636986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2746325-bfe9-4bef-90e0-e40f08388f72 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.766648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a2746325-bfe9-4bef-90e0-e40f08388f72 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:24.776381 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a2746325-bfe9-4bef-90e0-e40f08388f72 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1274 microversion: 2.1 time: 0.182861 Jul 20 04:11:24.777534 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 174/348] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:24 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:24.782746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-8a2531c2-5730-4f63-985c-6bef97ed77ca req-45504e22-9ece-46b8-9b5e-4e97c4248800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6676ea5-1699-463c-9d13-00747d0688ed", "name": "network-vif-deleted", "tag": "c18844f5-107d-4b19-95f1-b7386256d826"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:24.792170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-8a2531c2-5730-4f63-985c-6bef97ed77ca req-45504e22-9ece-46b8-9b5e-4e97c4248800 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.793095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-8a2531c2-5730-4f63-985c-6bef97ed77ca req-45504e22-9ece-46b8-9b5e-4e97c4248800 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.807788 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-8a2531c2-5730-4f63-985c-6bef97ed77ca req-45504e22-9ece-46b8-9b5e-4e97c4248800 service nova] Creating event network-vif-deleted:c18844f5-107d-4b19-95f1-b7386256d826 for instance c6676ea5-1699-463c-9d13-00747d0688ed on n-h1-764485-11 Jul 20 04:11:24.815998 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-8a2531c2-5730-4f63-985c-6bef97ed77ca req-45504e22-9ece-46b8-9b5e-4e97c4248800 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036257 Jul 20 04:11:24.817640 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 175/349] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:24.825096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8f5631fa-f721-43a8-9053-539d4c740387 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:24.826471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8f5631fa-f721-43a8-9053-539d4c740387 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:24.835339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f5631fa-f721-43a8-9053-539d4c740387 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.835991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f5631fa-f721-43a8-9053-539d4c740387 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.836945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f5631fa-f721-43a8-9053-539d4c740387 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.837579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f5631fa-f721-43a8-9053-539d4c740387 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.935142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f851858c-604a-4818-b2c0-ed322b6cce34 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:24.946131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8f5631fa-f721-43a8-9053-539d4c740387 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3c64cc1266264ac5b665950c0c6167d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871d4eff31f34766adc724f52d5eea0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:24.946772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8f5631fa-f721-43a8-9053-539d4c740387 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] flavor_id is None. Assuming migration. {{(pid=119808) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:11:24.947281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8f5631fa-f721-43a8-9053-539d4c740387 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119808) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:11:24.950783 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f851858c-604a-4818-b2c0-ed322b6cce34 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1319 microversion: 2.1 time: 0.562938 Jul 20 04:11:24.980825 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 175/350] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:24 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1319 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:24.996104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ebe4458-51b8-40c8-bd0b-baaa5c2fd719 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:24.997017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ebe4458-51b8-40c8-bd0b-baaa5c2fd719 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:25.013694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ebe4458-51b8-40c8-bd0b-baaa5c2fd719 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.014370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ebe4458-51b8-40c8-bd0b-baaa5c2fd719 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.016241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ebe4458-51b8-40c8-bd0b-baaa5c2fd719 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.017155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ebe4458-51b8-40c8-bd0b-baaa5c2fd719 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.464656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ebe4458-51b8-40c8-bd0b-baaa5c2fd719 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:25.484115 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ebe4458-51b8-40c8-bd0b-baaa5c2fd719 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1311 microversion: 2.1 time: 0.501527 Jul 20 04:11:25.485669 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 176/351] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:24 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1311 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:25.490389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-307787683", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:25.517568 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8f5631fa-f721-43a8-9053-539d4c740387 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214/action" status: 202 len: 0 microversion: 2.1 time: 0.698027 Jul 20 04:11:25.519595 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 176/352] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:11:24 2022] POST /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214/action => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:25.529225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-108ac508-b060-4d8e-b4ef-336354c59817 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:25.530363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-108ac508-b060-4d8e-b4ef-336354c59817 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:25.543370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-108ac508-b060-4d8e-b4ef-336354c59817 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.544219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-108ac508-b060-4d8e-b4ef-336354c59817 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.545199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-108ac508-b060-4d8e-b4ef-336354c59817 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.545836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-108ac508-b060-4d8e-b4ef-336354c59817 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.597932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:25.979570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-108ac508-b060-4d8e-b4ef-336354c59817 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:25.989687 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-108ac508-b060-4d8e-b4ef-336354c59817 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1472 microversion: 2.1 time: 0.465981 Jul 20 04:11:25.991072 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 177/353] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:25 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1472 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:25.998436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-536417c2-8163-43b1-88bb-80d615d5f1c8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:25.999663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-536417c2-8163-43b1-88bb-80d615d5f1c8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:26.009190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-536417c2-8163-43b1-88bb-80d615d5f1c8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.009948 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-536417c2-8163-43b1-88bb-80d615d5f1c8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.011497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-536417c2-8163-43b1-88bb-80d615d5f1c8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.012549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-536417c2-8163-43b1-88bb-80d615d5f1c8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.032894 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-536417c2-8163-43b1-88bb-80d615d5f1c8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] HTTP exception thrown: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-536417c2-8163-43b1-88bb-80d615d5f1c8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Request method failure captured: Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed HTTP/1.1 Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Ajz0rjS1XRiDD0KeIBjGxGkKn9lQqbJCIG3F_LKJaFzFftYZgLaPpZ6bqV0Aro4yM_edAWWmZxM6XDybSni9Omm3ju_T47CNVor7BRYYTruEKAmKDy3aTI23nKK61Fjj3PYS3flWEogiYecO3u9-qol0r0o8n2ItiVDEIr9KZu2TI Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5ec3ed035cec44ee9c3a79a57782507f Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:11:26.035090 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:11:26.036603 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5ec3ed035cec44ee9c3a79a57782507f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ec3ed035cec44ee9c3a79a57782507f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5ec3ed035cec44ee9c3a79a57782507f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ec3ed035cec44ee9c3a79a57782507f"}]}] Jul 20 04:11:26.036603 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:26.036603 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5ec3ed035cec44ee9c3a79a57782507f Jul 20 04:11:26.036603 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:26.036603 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersAdminTestJSON-2088718138-project Jul 20 04:11:26.036603 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:11:26.036603 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:11:26.036603 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: dc805052a58e462b8560b1754e36e5bd Jul 20 04:11:26.036603 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersAdminTestJSON-2088718138-project Jul 20 04:11:26.036603 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:11:26.036603 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:26.036603 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'c6676ea5-1699-463c-9d13-00747d0688ed'} Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:26.037441 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:26.038904 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:26.040140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-536417c2-8163-43b1-88bb-80d615d5f1c8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Returning 404 to user: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:26.041287 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-536417c2-8163-43b1-88bb-80d615d5f1c8 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 404 len: 111 microversion: 2.1 time: 0.049171 Jul 20 04:11:26.042935 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 178/354] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:25 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:26.052650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4706c35c-0dfa-4cb0-89cf-8306755e677d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:26.053341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4706c35c-0dfa-4cb0-89cf-8306755e677d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:26.062112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4706c35c-0dfa-4cb0-89cf-8306755e677d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.062657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4706c35c-0dfa-4cb0-89cf-8306755e677d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.063775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4706c35c-0dfa-4cb0-89cf-8306755e677d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.064411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4706c35c-0dfa-4cb0-89cf-8306755e677d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.206752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:26.207179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:26.207690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:26.208270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:26.208843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:26.231119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.231611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.232423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.232874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.278267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Getting quotas for project 9dd02283590e49b8a869ff0f94f2884a. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:26.282797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Getting quotas for user 17824778e95f4fd1afb0a3c679b9be7f and project 9dd02283590e49b8a869ff0f94f2884a. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:26.312462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:26.314780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:26.379214 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2a5f428-08ac-4702-b9c6-ca41bf30e643 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892188 Jul 20 04:11:26.380376 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 177/355] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:26.388126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-92a81185-c93d-4247-94f0-d448d456c00b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:26.390309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92a81185-c93d-4247-94f0-d448d456c00b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:26.397983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92a81185-c93d-4247-94f0-d448d456c00b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.398783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92a81185-c93d-4247-94f0-d448d456c00b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.400528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92a81185-c93d-4247-94f0-d448d456c00b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.401566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92a81185-c93d-4247-94f0-d448d456c00b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.433434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:27.377305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4706c35c-0dfa-4cb0-89cf-8306755e677d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:27.388475 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4706c35c-0dfa-4cb0-89cf-8306755e677d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1316 microversion: 2.1 time: 1.344222 Jul 20 04:11:27.389051 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 179/356] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:26 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1316 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:27.400371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9078abd5-9f96-45f3-b0e1-f494bd1f85a1 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:27.400819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9078abd5-9f96-45f3-b0e1-f494bd1f85a1 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:27.415246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9078abd5-9f96-45f3-b0e1-f494bd1f85a1 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.415737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9078abd5-9f96-45f3-b0e1-f494bd1f85a1 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.417050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9078abd5-9f96-45f3-b0e1-f494bd1f85a1 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.417493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9078abd5-9f96-45f3-b0e1-f494bd1f85a1 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.455094 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-9078abd5-9f96-45f3-b0e1-f494bd1f85a1 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] HTTP exception thrown: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9078abd5-9f96-45f3-b0e1-f494bd1f85a1 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Request method failure captured: Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed HTTP/1.1 Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Ajz0rjS1XRiDD0KeIBjGxGkKn9lQqbJCIG3F_LKJaFzFftYZgLaPpZ6bqV0Aro4yM_edAWWmZxM6XDybSni9Omm3ju_T47CNVor7BRYYTruEKAmKDy3aTI23nKK61Fjj3PYS3flWEogiYecO3u9-qol0r0o8n2ItiVDEIr9KZu2TI Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5ec3ed035cec44ee9c3a79a57782507f Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:11:27.462400 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:11:27.464109 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5ec3ed035cec44ee9c3a79a57782507f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ec3ed035cec44ee9c3a79a57782507f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5ec3ed035cec44ee9c3a79a57782507f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ec3ed035cec44ee9c3a79a57782507f"}]}] Jul 20 04:11:27.464109 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:27.464109 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5ec3ed035cec44ee9c3a79a57782507f Jul 20 04:11:27.464109 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:27.464109 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersAdminTestJSON-2088718138-project Jul 20 04:11:27.464109 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:11:27.464109 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:11:27.464109 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: dc805052a58e462b8560b1754e36e5bd Jul 20 04:11:27.464109 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersAdminTestJSON-2088718138-project Jul 20 04:11:27.464109 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:11:27.464109 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:27.464109 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'c6676ea5-1699-463c-9d13-00747d0688ed'} Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:27.464912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:27.466029 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:27.467355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9078abd5-9f96-45f3-b0e1-f494bd1f85a1 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Returning 404 to user: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:27.467355 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9078abd5-9f96-45f3-b0e1-f494bd1f85a1 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 404 len: 111 microversion: 2.1 time: 0.074114 Jul 20 04:11:27.467355 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 180/357] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:27 2022] DELETE /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:27.485428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-84f6667e-5141-4277-9db5-b61e011d252c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:27.486054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-84f6667e-5141-4277-9db5-b61e011d252c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:27.509309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-84f6667e-5141-4277-9db5-b61e011d252c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.513559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-84f6667e-5141-4277-9db5-b61e011d252c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.516811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-84f6667e-5141-4277-9db5-b61e011d252c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.517281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-84f6667e-5141-4277-9db5-b61e011d252c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.645698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-92a81185-c93d-4247-94f0-d448d456c00b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:27.666930 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-92a81185-c93d-4247-94f0-d448d456c00b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1319 microversion: 2.1 time: 1.284507 Jul 20 04:11:27.671143 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 178/358] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:26 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1319 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:27.691267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fd330713-1697-4325-b9ad-d6e356ad36ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:27.692484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fd330713-1697-4325-b9ad-d6e356ad36ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:27.706620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd330713-1697-4325-b9ad-d6e356ad36ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.709203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd330713-1697-4325-b9ad-d6e356ad36ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.710404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd330713-1697-4325-b9ad-d6e356ad36ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.714151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd330713-1697-4325-b9ad-d6e356ad36ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.753116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-84f6667e-5141-4277-9db5-b61e011d252c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:27.765428 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-84f6667e-5141-4277-9db5-b61e011d252c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1213 microversion: 2.1 time: 0.299187 Jul 20 04:11:27.777179 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 181/359] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:27 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1213 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:27.782458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9298fdf-be0d-492c-9c6a-6e7aff35ad74 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:27.783256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9298fdf-be0d-492c-9c6a-6e7aff35ad74 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:27.790080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9298fdf-be0d-492c-9c6a-6e7aff35ad74 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.790768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9298fdf-be0d-492c-9c6a-6e7aff35ad74 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.792022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9298fdf-be0d-492c-9c6a-6e7aff35ad74 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.792699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9298fdf-be0d-492c-9c6a-6e7aff35ad74 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.137981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fd330713-1697-4325-b9ad-d6e356ad36ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:28.145480 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fd330713-1697-4325-b9ad-d6e356ad36ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1311 microversion: 2.1 time: 0.471648 Jul 20 04:11:28.146245 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 179/360] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:27 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1311 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:28.281265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9298fdf-be0d-492c-9c6a-6e7aff35ad74 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:28.292493 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9298fdf-be0d-492c-9c6a-6e7aff35ad74 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1472 microversion: 2.1 time: 0.513156 Jul 20 04:11:28.302734 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 182/361] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:27 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1472 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:28.314734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ce55924a-8ec1-408d-84f9-fb70985a4e47 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:28.315620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ce55924a-8ec1-408d-84f9-fb70985a4e47 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: c6676ea5-1699-463c-9d13-00747d0688ed] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:28.335363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce55924a-8ec1-408d-84f9-fb70985a4e47 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.336099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce55924a-8ec1-408d-84f9-fb70985a4e47 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.337022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce55924a-8ec1-408d-84f9-fb70985a4e47 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.337607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce55924a-8ec1-408d-84f9-fb70985a4e47 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.364536 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-ce55924a-8ec1-408d-84f9-fb70985a4e47 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] HTTP exception thrown: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ce55924a-8ec1-408d-84f9-fb70985a4e47 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Request method failure captured: Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed HTTP/1.1 Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Ajz0rjS1XRiDD0KeIBjGxGkKn9lQqbJCIG3F_LKJaFzFftYZgLaPpZ6bqV0Aro4yM_edAWWmZxM6XDybSni9Omm3ju_T47CNVor7BRYYTruEKAmKDy3aTI23nKK61Fjj3PYS3flWEogiYecO3u9-qol0r0o8n2ItiVDEIr9KZu2TI Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5ec3ed035cec44ee9c3a79a57782507f Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:11:28.366282 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:11:28.367728 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5ec3ed035cec44ee9c3a79a57782507f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ec3ed035cec44ee9c3a79a57782507f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5ec3ed035cec44ee9c3a79a57782507f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ec3ed035cec44ee9c3a79a57782507f"}]}] Jul 20 04:11:28.367728 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:28.367728 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5ec3ed035cec44ee9c3a79a57782507f Jul 20 04:11:28.367728 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:28.367728 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersAdminTestJSON-2088718138-project Jul 20 04:11:28.367728 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:11:28.367728 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:11:28.367728 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: dc805052a58e462b8560b1754e36e5bd Jul 20 04:11:28.367728 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersAdminTestJSON-2088718138-project Jul 20 04:11:28.367728 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:11:28.367728 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:28.367728 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'c6676ea5-1699-463c-9d13-00747d0688ed'} Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:28.368626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. Jul 20 04:11:28.369895 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.381343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ce55924a-8ec1-408d-84f9-fb70985a4e47 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Returning 404 to user: Instance c6676ea5-1699-463c-9d13-00747d0688ed could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:28.384749 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ce55924a-8ec1-408d-84f9-fb70985a4e47 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed" status: 404 len: 111 microversion: 2.1 time: 0.080975 Jul 20 04:11:28.386012 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 183/362] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:28 2022] GET /compute/v2.1/servers/c6676ea5-1699-463c-9d13-00747d0688ed => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:28.391335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6b2d5319-8b69-401f-9ca4-f6419398609a req-7d3a0ce8-37ad-4016-837d-0a77f6199c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9df925-6109-4e21-a875-7d16c10d0b80", "name": "network-vif-plugged", "status": "completed", "tag": "c7162384-17f5-4ea8-95c6-748ce045c8bb"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:28.415788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6b2d5319-8b69-401f-9ca4-f6419398609a req-7d3a0ce8-37ad-4016-837d-0a77f6199c3e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.417082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6b2d5319-8b69-401f-9ca4-f6419398609a req-7d3a0ce8-37ad-4016-837d-0a77f6199c3e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.425270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-34b375ef-89b0-412f-a25a-3c4b36b4c39c tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Calling method '.version_select at 0x7fbf9dea4280>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:28.426237 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:28.426237 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:28.427409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34b375ef-89b0-412f-a25a-3c4b36b4c39c tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.427996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34b375ef-89b0-412f-a25a-3c4b36b4c39c tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.444150 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6b2d5319-8b69-401f-9ca4-f6419398609a req-7d3a0ce8-37ad-4016-837d-0a77f6199c3e service nova] Creating event network-vif-plugged:c7162384-17f5-4ea8-95c6-748ce045c8bb for instance 2d9df925-6109-4e21-a875-7d16c10d0b80 on n-h2-764485-11 Jul 20 04:11:28.457361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34b375ef-89b0-412f-a25a-3c4b36b4c39c tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.457815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34b375ef-89b0-412f-a25a-3c4b36b4c39c tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.458930 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6b2d5319-8b69-401f-9ca4-f6419398609a req-7d3a0ce8-37ad-4016-837d-0a77f6199c3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071321 Jul 20 04:11:28.459802 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 184/363] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:28.467321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02560b86-b13c-4250-ba09-14e01e486526 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:28.480621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-02560b86-b13c-4250-ba09-14e01e486526 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:28.486759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34b375ef-89b0-412f-a25a-3c4b36b4c39c tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.487628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34b375ef-89b0-412f-a25a-3c4b36b4c39c tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.488295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02560b86-b13c-4250-ba09-14e01e486526 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.489183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02560b86-b13c-4250-ba09-14e01e486526 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.490242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02560b86-b13c-4250-ba09-14e01e486526 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.490797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02560b86-b13c-4250-ba09-14e01e486526 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.500827 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-34b375ef-89b0-412f-a25a-3c4b36b4c39c tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.343366 Jul 20 04:11:28.501637 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 180/364] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:28 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:28.511012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a0f64b3d-35ac-41a7-9cfd-d5898e17cfd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:28.512535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a0f64b3d-35ac-41a7-9cfd-d5898e17cfd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:28.519740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0f64b3d-35ac-41a7-9cfd-d5898e17cfd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.520240 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-02560b86-b13c-4250-ba09-14e01e486526 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] HTTP exception thrown: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:11:28.520768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0f64b3d-35ac-41a7-9cfd-d5898e17cfd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.522323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0f64b3d-35ac-41a7-9cfd-d5898e17cfd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.523025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0f64b3d-35ac-41a7-9cfd-d5898e17cfd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02560b86-b13c-4250-ba09-14e01e486526 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Request method failure captured: Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 HTTP/1.1 Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Ajz0rjS1XRiDD0KeIBjGxGkKn9lQqbJCIG3F_LKJaFzFftYZgLaPpZ6bqV0Aro4yM_edAWWmZxM6XDybSni9Omm3ju_T47CNVor7BRYYTruEKAmKDy3aTI23nKK61Fjj3PYS3flWEogiYecO3u9-qol0r0o8n2ItiVDEIr9KZu2TI Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5ec3ed035cec44ee9c3a79a57782507f Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:11:28.529076 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:11:28.530499 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5ec3ed035cec44ee9c3a79a57782507f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ec3ed035cec44ee9c3a79a57782507f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5ec3ed035cec44ee9c3a79a57782507f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ec3ed035cec44ee9c3a79a57782507f"}]}] Jul 20 04:11:28.530499 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:28.530499 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5ec3ed035cec44ee9c3a79a57782507f Jul 20 04:11:28.530499 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:28.530499 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersAdminTestJSON-2088718138-project Jul 20 04:11:28.530499 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:11:28.530499 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:11:28.530499 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: dc805052a58e462b8560b1754e36e5bd Jul 20 04:11:28.530499 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersAdminTestJSON-2088718138-project Jul 20 04:11:28.530499 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:11:28.530499 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:11:28.530499 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '6ff00481-daa9-41ee-a128-2684117e0c50'} Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:28.531382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:11:28.532946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.534267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02560b86-b13c-4250-ba09-14e01e486526 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Returning 404 to user: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:28.534503 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-02560b86-b13c-4250-ba09-14e01e486526 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 404 len: 111 microversion: 2.1 time: 0.072713 Jul 20 04:11:28.535446 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 185/365] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:28 2022] DELETE /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:28.738229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d42168a-2058-4dcb-a985-fe65265be831 tempest-HypervisorAdminNegativeUnderV252Test-878454271 tempest-HypervisorAdminNegativeUnderV252Test-878454271-project] Calling method '.version_select at 0x7fbf9e0e1040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:28.744668 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:28.744668 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:28.751722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5d42168a-2058-4dcb-a985-fe65265be831 tempest-HypervisorAdminNegativeUnderV252Test-878454271 tempest-HypervisorAdminNegativeUnderV252Test-878454271-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '956ff620724d4b4faf35a88336f280ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8f72503b824873ab7241e1d151bea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d42168a-2058-4dcb-a985-fe65265be831 tempest-HypervisorAdminNegativeUnderV252Test-878454271 tempest-HypervisorAdminNegativeUnderV252Test-878454271-project] Request method failure captured: Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-hypervisors/n-h1-764485-11/search HTTP/1.1 Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Bu_c44d5PVrc__lpM1xgKzq697jD0fwKFWOSaQBSUICmt5AzqBTLOEP1f7N8Qgmea66OaHjzgoOZOgI9mcSyl4Yeq-mnwjZjng37lNJoVB28kCMjH33FZHEjE0ZUbeI7fXYOMhlASGKbsAty5554coacqyKMq1vz6DzFtP_ztQ2AQ Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 0d8f72503b824873ab7241e1d151bea1 Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-878454271 Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:11:28.759722 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:11:28.761462 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0d8f72503b824873ab7241e1d151bea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0d8f72503b824873ab7241e1d151bea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0d8f72503b824873ab7241e1d151bea1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0d8f72503b824873ab7241e1d151bea1"}]}] Jul 20 04:11:28.761462 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-878454271 Jul 20 04:11:28.761462 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 0d8f72503b824873ab7241e1d151bea1 Jul 20 04:11:28.761462 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-878454271 Jul 20 04:11:28.761462 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-878454271-project Jul 20 04:11:28.761462 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:11:28.761462 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:11:28.761462 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 956ff620724d4b4faf35a88336f280ea Jul 20 04:11:28.761462 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-878454271-project Jul 20 04:11:28.761462 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:11:28.761462 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 04:11:28.761462 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'n-h1-764485-11'} Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:28.762340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 04:11:28.763431 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.764586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d42168a-2058-4dcb-a985-fe65265be831 tempest-HypervisorAdminNegativeUnderV252Test-878454271 tempest-HypervisorAdminNegativeUnderV252Test-878454271-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:28.764586 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5d42168a-2058-4dcb-a985-fe65265be831 tempest-HypervisorAdminNegativeUnderV252Test-878454271 tempest-HypervisorAdminNegativeUnderV252Test-878454271-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-764485-11/search" status: 403 len: 117 microversion: 2.1 time: 0.225054 Jul 20 04:11:28.764586 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 186/366] 10.222.0.20 () {58 vars in 1211 bytes} [Wed Jul 20 04:11:28 2022] GET /compute/v2.1/os-hypervisors/n-h1-764485-11/search => generated 117 bytes in 227 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:28.771328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f32ddb2-1a4f-48f5-8d8c-936efe1f65a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:28.771987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1f32ddb2-1a4f-48f5-8d8c-936efe1f65a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] [instance: 6ff00481-daa9-41ee-a128-2684117e0c50] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:28.782322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f32ddb2-1a4f-48f5-8d8c-936efe1f65a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.782787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f32ddb2-1a4f-48f5-8d8c-936efe1f65a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.783626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f32ddb2-1a4f-48f5-8d8c-936efe1f65a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.784489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f32ddb2-1a4f-48f5-8d8c-936efe1f65a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.800941 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-1f32ddb2-1a4f-48f5-8d8c-936efe1f65a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] HTTP exception thrown: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f32ddb2-1a4f-48f5-8d8c-936efe1f65a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Request method failure captured: Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 HTTP/1.1 Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Ajz0rjS1XRiDD0KeIBjGxGkKn9lQqbJCIG3F_LKJaFzFftYZgLaPpZ6bqV0Aro4yM_edAWWmZxM6XDybSni9Omm3ju_T47CNVor7BRYYTruEKAmKDy3aTI23nKK61Fjj3PYS3flWEogiYecO3u9-qol0r0o8n2ItiVDEIr9KZu2TI Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5ec3ed035cec44ee9c3a79a57782507f Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:11:28.802508 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:11:28.803746 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5ec3ed035cec44ee9c3a79a57782507f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ec3ed035cec44ee9c3a79a57782507f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5ec3ed035cec44ee9c3a79a57782507f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ec3ed035cec44ee9c3a79a57782507f"}]}] Jul 20 04:11:28.803746 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:28.803746 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5ec3ed035cec44ee9c3a79a57782507f Jul 20 04:11:28.803746 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2088718138 Jul 20 04:11:28.803746 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersAdminTestJSON-2088718138-project Jul 20 04:11:28.803746 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:11:28.803746 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:11:28.803746 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: dc805052a58e462b8560b1754e36e5bd Jul 20 04:11:28.803746 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersAdminTestJSON-2088718138-project Jul 20 04:11:28.803746 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:11:28.803746 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:11:28.803746 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '6ff00481-daa9-41ee-a128-2684117e0c50'} Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:28.804393 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. Jul 20 04:11:28.805500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:28.806495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f32ddb2-1a4f-48f5-8d8c-936efe1f65a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] Returning 404 to user: Instance 6ff00481-daa9-41ee-a128-2684117e0c50 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:28.806495 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f32ddb2-1a4f-48f5-8d8c-936efe1f65a5 tempest-DeleteServersAdminTestJSON-2088718138 tempest-DeleteServersAdminTestJSON-2088718138-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50" status: 404 len: 111 microversion: 2.1 time: 0.040095 Jul 20 04:11:28.806495 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 187/367] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:28 2022] GET /compute/v2.1/servers/6ff00481-daa9-41ee-a128-2684117e0c50 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:28.809974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0314abfe-4331-469f-a83e-c49a202d16e2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:28.810600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0314abfe-4331-469f-a83e-c49a202d16e2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:28.817799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0314abfe-4331-469f-a83e-c49a202d16e2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.818248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0314abfe-4331-469f-a83e-c49a202d16e2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.819023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0314abfe-4331-469f-a83e-c49a202d16e2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:28.819461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0314abfe-4331-469f-a83e-c49a202d16e2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.064568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a0f64b3d-35ac-41a7-9cfd-d5898e17cfd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:29.078885 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a0f64b3d-35ac-41a7-9cfd-d5898e17cfd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1316 microversion: 2.1 time: 0.576000 Jul 20 04:11:29.079576 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 181/368] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:28 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1316 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:29.094271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8dad3472-23f0-4f03-9ca4-f9c708fd506f tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Calling method '.version_select at 0x7fbf9dd249d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:29.095262 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:29.095262 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:29.098471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8dad3472-23f0-4f03-9ca4-f9c708fd506f tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.099807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8dad3472-23f0-4f03-9ca4-f9c708fd506f tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.110515 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-8dad3472-23f0-4f03-9ca4-f9c708fd506f tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8dad3472-23f0-4f03-9ca4-f9c708fd506f tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Request method failure captured: Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Bv9amYzSB_JZueILhLKWCKVr8QrgGUGOYA_1wCVEs3tLlxfRhYZNKmwlEVQ-FFToOhdHxJHqIS4pZJui08G457zQ8dw-xc144YPFIxkfQx76VkEHQ27Pgz6mg-dqw8jait45Oxxb8P40bgeBxzMS6D-8DghTtBmiAjyu41GrAZzqc Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 0859b4a9473d42b79fca491c57e4adf5 Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1655521273 Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:11:29.112619 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:11:29.113900 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0859b4a9473d42b79fca491c57e4adf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0859b4a9473d42b79fca491c57e4adf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0859b4a9473d42b79fca491c57e4adf5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0859b4a9473d42b79fca491c57e4adf5"}]}] Jul 20 04:11:29.113900 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1655521273 Jul 20 04:11:29.113900 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 0859b4a9473d42b79fca491c57e4adf5 Jul 20 04:11:29.113900 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1655521273 Jul 20 04:11:29.113900 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin Jul 20 04:11:29.113900 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:11:29.113900 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:11:29.113900 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 53660b95ea374bc9919cd1daa416edc8 Jul 20 04:11:29.113900 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin Jul 20 04:11:29.113900 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:11:29.113900 n-d-764485-11 devstack@n-api.service[119807]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:11:29.113900 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:29.114684 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:29.116051 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:29.116051 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:29.116051 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:29.116051 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:11:29.116051 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:29.117831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8dad3472-23f0-4f03-9ca4-f9c708fd506f tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:29.120309 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8dad3472-23f0-4f03-9ca4-f9c708fd506f tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.037953 Jul 20 04:11:29.122614 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 182/369] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 04:11:29 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:29.133167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c8bfa18f-c2df-46c9-91b7-c07ab2112d24 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:29.134047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c8bfa18f-c2df-46c9-91b7-c07ab2112d24 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:29.143732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8bfa18f-c2df-46c9-91b7-c07ab2112d24 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.144518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8bfa18f-c2df-46c9-91b7-c07ab2112d24 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.145465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8bfa18f-c2df-46c9-91b7-c07ab2112d24 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.146047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8bfa18f-c2df-46c9-91b7-c07ab2112d24 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.316050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c8bfa18f-c2df-46c9-91b7-c07ab2112d24 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:29.326003 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c8bfa18f-c2df-46c9-91b7-c07ab2112d24 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1275 microversion: 2.1 time: 0.197948 Jul 20 04:11:29.326882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0314abfe-4331-469f-a83e-c49a202d16e2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:29.339429 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 183/370] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:29 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1275 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:29.342780 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0314abfe-4331-469f-a83e-c49a202d16e2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1319 microversion: 2.1 time: 0.537230 Jul 20 04:11:29.343364 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 188/371] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:28 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:29.345851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6afa209c-3f8a-44cc-81af-ffb287ac1199 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Calling method '.version_select at 0x7fbf9dfb0670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:29.346817 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:29.346817 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:29.348859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6afa209c-3f8a-44cc-81af-ffb287ac1199 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.349831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6afa209c-3f8a-44cc-81af-ffb287ac1199 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.351058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67e4e7be-c7b0-43b2-93c4-bc30d8991e27 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:29.351723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67e4e7be-c7b0-43b2-93c4-bc30d8991e27 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:29.364514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67e4e7be-c7b0-43b2-93c4-bc30d8991e27 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.364959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67e4e7be-c7b0-43b2-93c4-bc30d8991e27 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.368923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67e4e7be-c7b0-43b2-93c4-bc30d8991e27 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.369372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67e4e7be-c7b0-43b2-93c4-bc30d8991e27 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.373475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6afa209c-3f8a-44cc-81af-ffb287ac1199 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.374234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6afa209c-3f8a-44cc-81af-ffb287ac1199 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.389333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6afa209c-3f8a-44cc-81af-ffb287ac1199 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.390030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6afa209c-3f8a-44cc-81af-ffb287ac1199 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.397621 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6afa209c-3f8a-44cc-81af-ffb287ac1199 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.056811 Jul 20 04:11:29.398434 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 184/372] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:29 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:29.406724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-df1a0f0e-94a8-4b47-8979-732280c956bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:29.407803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-df1a0f0e-94a8-4b47-8979-732280c956bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:29.418056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df1a0f0e-94a8-4b47-8979-732280c956bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.418827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df1a0f0e-94a8-4b47-8979-732280c956bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:29.420156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df1a0f0e-94a8-4b47-8979-732280c956bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:29.420740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df1a0f0e-94a8-4b47-8979-732280c956bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.121376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-df1a0f0e-94a8-4b47-8979-732280c956bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:30.134156 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-df1a0f0e-94a8-4b47-8979-732280c956bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1472 microversion: 2.1 time: 0.734170 Jul 20 04:11:30.145244 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 185/373] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:29 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1472 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:30.156749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-645083a4-aa65-498e-958f-3bf316610c30 tempest-HypervisorAdminNegativeUnderV252Test-878454271 tempest-HypervisorAdminNegativeUnderV252Test-878454271-project] Calling method '.version_select at 0x7fbf9dfb0700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:30.158113 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:30.158113 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:30.159495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-645083a4-aa65-498e-958f-3bf316610c30 tempest-HypervisorAdminNegativeUnderV252Test-878454271 tempest-HypervisorAdminNegativeUnderV252Test-878454271-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '956ff620724d4b4faf35a88336f280ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8f72503b824873ab7241e1d151bea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-645083a4-aa65-498e-958f-3bf316610c30 tempest-HypervisorAdminNegativeUnderV252Test-878454271 tempest-HypervisorAdminNegativeUnderV252Test-878454271-project] Request method failure captured: Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Bu_c44d5PVrc__lpM1xgKzq697jD0fwKFWOSaQBSUICmt5AzqBTLOEP1f7N8Qgmea66OaHjzgoOZOgI9mcSyl4Yeq-mnwjZjng37lNJoVB28kCMjH33FZHEjE0ZUbeI7fXYOMhlASGKbsAty5554coacqyKMq1vz6DzFtP_ztQ2AQ Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 0d8f72503b824873ab7241e1d151bea1 Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-878454271 Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:11:30.161893 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0d8f72503b824873ab7241e1d151bea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0d8f72503b824873ab7241e1d151bea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0d8f72503b824873ab7241e1d151bea1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0d8f72503b824873ab7241e1d151bea1"}]}] Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-878454271 Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 0d8f72503b824873ab7241e1d151bea1 Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-878454271 Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-878454271-project Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 956ff620724d4b4faf35a88336f280ea Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-878454271-project Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '1'} Jul 20 04:11:30.163439 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:30.164361 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 04:11:30.165959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:30.170700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-645083a4-aa65-498e-958f-3bf316610c30 tempest-HypervisorAdminNegativeUnderV252Test-878454271 tempest-HypervisorAdminNegativeUnderV252Test-878454271-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:30.172463 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-645083a4-aa65-498e-958f-3bf316610c30 tempest-HypervisorAdminNegativeUnderV252Test-878454271 tempest-HypervisorAdminNegativeUnderV252Test-878454271-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.025805 Jul 20 04:11:30.173787 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 186/374] 10.222.0.20 () {58 vars in 1175 bytes} [Wed Jul 20 04:11:30 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:30.204220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0e881f9f-ce06-4a8a-88c0-204cd7b8c391 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:30.205769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0e881f9f-ce06-4a8a-88c0-204cd7b8c391 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:30.221950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e881f9f-ce06-4a8a-88c0-204cd7b8c391 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.223672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e881f9f-ce06-4a8a-88c0-204cd7b8c391 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.224946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67e4e7be-c7b0-43b2-93c4-bc30d8991e27 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:30.226583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e881f9f-ce06-4a8a-88c0-204cd7b8c391 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.227213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e881f9f-ce06-4a8a-88c0-204cd7b8c391 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.233122 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67e4e7be-c7b0-43b2-93c4-bc30d8991e27 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1311 microversion: 2.1 time: 0.888705 Jul 20 04:11:30.235333 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 189/375] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:29 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1311 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:30.247475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-d74e1096-c71d-4f50-9797-22c7a37c6248 req-ea0111d4-d973-4eca-8c77-a17390a0df5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f32f3c69-0926-47e2-9498-38ca38aa5035", "tag": "68b20988-ab90-4e07-8ec9-d18b65a6edbc"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:30.267629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d74e1096-c71d-4f50-9797-22c7a37c6248 req-ea0111d4-d973-4eca-8c77-a17390a0df5c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.272630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d74e1096-c71d-4f50-9797-22c7a37c6248 req-ea0111d4-d973-4eca-8c77-a17390a0df5c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.296184 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-d74e1096-c71d-4f50-9797-22c7a37c6248 req-ea0111d4-d973-4eca-8c77-a17390a0df5c service nova] Creating event network-changed:68b20988-ab90-4e07-8ec9-d18b65a6edbc for instance f32f3c69-0926-47e2-9498-38ca38aa5035 on n-h1-764485-11 Jul 20 04:11:30.312902 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-d74e1096-c71d-4f50-9797-22c7a37c6248 req-ea0111d4-d973-4eca-8c77-a17390a0df5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075409 Jul 20 04:11:30.314039 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 190/376] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:30.322501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57707f7d-fad9-4bd3-832b-38830394b919 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Calling method '.version_select at 0x7fbf9dddef70>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:30.324170 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:30.324170 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:30.326244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57707f7d-fad9-4bd3-832b-38830394b919 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.326752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57707f7d-fad9-4bd3-832b-38830394b919 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.344362 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-57707f7d-fad9-4bd3-832b-38830394b919 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] HTTP exception thrown: No hypervisor matching '2dc693c5-8b77-44e2-9df3-9aa78c17eeda' could be found. Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57707f7d-fad9-4bd3-832b-38830394b919 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Request method failure captured: Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-hypervisors/2dc693c5-8b77-44e2-9df3-9aa78c17eeda/servers HTTP/1.1 Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Bv9amYzSB_JZueILhLKWCKVr8QrgGUGOYA_1wCVEs3tLlxfRhYZNKmwlEVQ-FFToOhdHxJHqIS4pZJui08G457zQ8dw-xc144YPFIxkfQx76VkEHQ27Pgz6mg-dqw8jait45Oxxb8P40bgeBxzMS6D-8DghTtBmiAjyu41GrAZzqc Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 0859b4a9473d42b79fca491c57e4adf5 Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1655521273 Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:11:30.346461 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:11:30.348051 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0859b4a9473d42b79fca491c57e4adf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0859b4a9473d42b79fca491c57e4adf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0859b4a9473d42b79fca491c57e4adf5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0859b4a9473d42b79fca491c57e4adf5"}]}] Jul 20 04:11:30.348051 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1655521273 Jul 20 04:11:30.348051 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 0859b4a9473d42b79fca491c57e4adf5 Jul 20 04:11:30.348051 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1655521273 Jul 20 04:11:30.348051 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin Jul 20 04:11:30.348051 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:11:30.348051 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:11:30.348051 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 53660b95ea374bc9919cd1daa416edc8 Jul 20 04:11:30.348051 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin Jul 20 04:11:30.348051 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:11:30.348051 n-d-764485-11 devstack@n-api.service[119808]: exception: No hypervisor matching '2dc693c5-8b77-44e2-9df3-9aa78c17eeda' could be found. Jul 20 04:11:30.348051 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2dc693c5-8b77-44e2-9df3-9aa78c17eeda'} Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '2dc693c5-8b77-44e2-9df3-9aa78c17eeda' could be found. Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:30.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:30.350061 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:30.350061 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:30.350061 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:30.350061 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:30.350061 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '2dc693c5-8b77-44e2-9df3-9aa78c17eeda' could be found. Jul 20 04:11:30.350061 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:30.350061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57707f7d-fad9-4bd3-832b-38830394b919 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] Returning 404 to user: No hypervisor matching '2dc693c5-8b77-44e2-9df3-9aa78c17eeda' could be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:30.350061 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57707f7d-fad9-4bd3-832b-38830394b919 tempest-HypervisorAdminNegativeUnderV252Test-1655521273 tempest-HypervisorAdminNegativeUnderV252Test-1655521273-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/2dc693c5-8b77-44e2-9df3-9aa78c17eeda/servers" status: 404 len: 123 microversion: 2.1 time: 0.031505 Jul 20 04:11:30.350061 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 191/377] 10.222.0.20 () {58 vars in 1280 bytes} [Wed Jul 20 04:11:30 2022] GET /compute/v2.1/os-hypervisors/2dc693c5-8b77-44e2-9df3-9aa78c17eeda/servers => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:30.362156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b1b12685-ba7d-4aec-baf6-c3df8ccd5fa7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:30.362909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b1b12685-ba7d-4aec-baf6-c3df8ccd5fa7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:30.370440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1b12685-ba7d-4aec-baf6-c3df8ccd5fa7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.370897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1b12685-ba7d-4aec-baf6-c3df8ccd5fa7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.371724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1b12685-ba7d-4aec-baf6-c3df8ccd5fa7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.372169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1b12685-ba7d-4aec-baf6-c3df8ccd5fa7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.555527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b1b12685-ba7d-4aec-baf6-c3df8ccd5fa7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:30.567546 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b1b12685-ba7d-4aec-baf6-c3df8ccd5fa7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1275 microversion: 2.1 time: 0.213263 Jul 20 04:11:30.570542 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 192/378] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:30 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:30.583996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9119f67-f5f8-439e-b800-963322d521e1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:30.591351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a9119f67-f5f8-439e-b800-963322d521e1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:30.606106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9119f67-f5f8-439e-b800-963322d521e1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.606961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9119f67-f5f8-439e-b800-963322d521e1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.608210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9119f67-f5f8-439e-b800-963322d521e1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.608912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9119f67-f5f8-439e-b800-963322d521e1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.787803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0e881f9f-ce06-4a8a-88c0-204cd7b8c391 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:30.800460 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0e881f9f-ce06-4a8a-88c0-204cd7b8c391 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1316 microversion: 2.1 time: 0.625069 Jul 20 04:11:30.815878 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 187/379] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:30 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1316 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:31.157347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aed4eee5-1b72-42cb-a495-beb537664f48 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:31.158638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aed4eee5-1b72-42cb-a495-beb537664f48 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:31.165494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aed4eee5-1b72-42cb-a495-beb537664f48 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.166370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aed4eee5-1b72-42cb-a495-beb537664f48 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.167933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aed4eee5-1b72-42cb-a495-beb537664f48 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.168599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aed4eee5-1b72-42cb-a495-beb537664f48 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.189170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9119f67-f5f8-439e-b800-963322d521e1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:31.202331 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a9119f67-f5f8-439e-b800-963322d521e1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1319 microversion: 2.1 time: 0.630533 Jul 20 04:11:31.212253 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 193/380] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:30 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1319 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:31.251900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b9381106-46da-4c35-b204-64acedd520a8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:31.252583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b9381106-46da-4c35-b204-64acedd520a8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:31.263388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9381106-46da-4c35-b204-64acedd520a8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.263679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9381106-46da-4c35-b204-64acedd520a8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.264703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9381106-46da-4c35-b204-64acedd520a8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.265235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9381106-46da-4c35-b204-64acedd520a8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.669164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aed4eee5-1b72-42cb-a495-beb537664f48 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:31.672088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b9381106-46da-4c35-b204-64acedd520a8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:31.679610 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aed4eee5-1b72-42cb-a495-beb537664f48 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.525764 Jul 20 04:11:31.680249 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 188/381] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:31 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:31.688790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0ffb45f4-93b3-4279-a46e-6d1f5f01f2b4 req-f410064d-7ef7-4624-8f5f-c7f0a0b50052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9665e973-184b-48eb-92a4-1cbc4934ccbd", "name": "network-vif-plugged", "status": "completed", "tag": "b9525bbb-abed-4357-a15a-95f7e2b2780b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:31.694544 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b9381106-46da-4c35-b204-64acedd520a8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1494 microversion: 2.1 time: 0.446880 Jul 20 04:11:31.695870 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 194/382] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:31 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1494 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:31.700844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0ffb45f4-93b3-4279-a46e-6d1f5f01f2b4 req-f410064d-7ef7-4624-8f5f-c7f0a0b50052 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.701358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0ffb45f4-93b3-4279-a46e-6d1f5f01f2b4 req-f410064d-7ef7-4624-8f5f-c7f0a0b50052 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.711342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6088fe1d-7e9b-4704-810c-a3582adda8cd tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:31.712221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6088fe1d-7e9b-4704-810c-a3582adda8cd tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:31.723908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6088fe1d-7e9b-4704-810c-a3582adda8cd tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.724366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6088fe1d-7e9b-4704-810c-a3582adda8cd tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.725152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6088fe1d-7e9b-4704-810c-a3582adda8cd tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.725757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6088fe1d-7e9b-4704-810c-a3582adda8cd tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.736820 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0ffb45f4-93b3-4279-a46e-6d1f5f01f2b4 req-f410064d-7ef7-4624-8f5f-c7f0a0b50052 service nova] Creating event network-vif-plugged:b9525bbb-abed-4357-a15a-95f7e2b2780b for instance 9665e973-184b-48eb-92a4-1cbc4934ccbd on n-h2-764485-11 Jul 20 04:11:31.743015 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0ffb45f4-93b3-4279-a46e-6d1f5f01f2b4 req-f410064d-7ef7-4624-8f5f-c7f0a0b50052 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060519 Jul 20 04:11:31.744270 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 189/383] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:32.114716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6088fe1d-7e9b-4704-810c-a3582adda8cd tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:32.126648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:32.137424 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6088fe1d-7e9b-4704-810c-a3582adda8cd tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1317 microversion: 2.1 time: 0.438179 Jul 20 04:11:32.138036 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 195/384] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:31 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:32.147970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a920a581-25a5-4202-9237-18c0da474663 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.150239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a920a581-25a5-4202-9237-18c0da474663 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.165693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a920a581-25a5-4202-9237-18c0da474663 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.166796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a920a581-25a5-4202-9237-18c0da474663 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.168287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a920a581-25a5-4202-9237-18c0da474663 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.170283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a920a581-25a5-4202-9237-18c0da474663 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.272387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0ed39ee4-37df-4f44-b293-4f4f8908a3b0 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.274099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0ed39ee4-37df-4f44-b293-4f4f8908a3b0 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.282360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ed39ee4-37df-4f44-b293-4f4f8908a3b0 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.282822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ed39ee4-37df-4f44-b293-4f4f8908a3b0 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.283681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ed39ee4-37df-4f44-b293-4f4f8908a3b0 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.284285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ed39ee4-37df-4f44-b293-4f4f8908a3b0 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.551790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a920a581-25a5-4202-9237-18c0da474663 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:32.562345 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a920a581-25a5-4202-9237-18c0da474663 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1316 microversion: 2.1 time: 0.420315 Jul 20 04:11:32.562733 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 196/385] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:32 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:32.568842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cf3083b0-47fa-42a3-b83f-70ea2bbd33d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.570088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cf3083b0-47fa-42a3-b83f-70ea2bbd33d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.589785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf3083b0-47fa-42a3-b83f-70ea2bbd33d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.590746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf3083b0-47fa-42a3-b83f-70ea2bbd33d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.591648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf3083b0-47fa-42a3-b83f-70ea2bbd33d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.593074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf3083b0-47fa-42a3-b83f-70ea2bbd33d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.598890 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0ed39ee4-37df-4f44-b293-4f4f8908a3b0 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1647 microversion: 2.1 time: 0.852856 Jul 20 04:11:32.599475 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 190/386] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:31 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1647 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:32.612847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-2870bd87-68f0-4cd4-aa56-effac26401dd req-86bbaf97-e1d4-426c-a3ee-4add5df96064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec531648-d3ee-43c8-8fda-89ae7282e4ef", "tag": "cbfa0b20-ec79-4d11-a450-6d6c8705b3b2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:32.630286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2870bd87-68f0-4cd4-aa56-effac26401dd req-86bbaf97-e1d4-426c-a3ee-4add5df96064 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.631077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2870bd87-68f0-4cd4-aa56-effac26401dd req-86bbaf97-e1d4-426c-a3ee-4add5df96064 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.645031 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-2870bd87-68f0-4cd4-aa56-effac26401dd req-86bbaf97-e1d4-426c-a3ee-4add5df96064 service nova] Creating event network-changed:cbfa0b20-ec79-4d11-a450-6d6c8705b3b2 for instance ec531648-d3ee-43c8-8fda-89ae7282e4ef on n-h1-764485-11 Jul 20 04:11:32.654476 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-2870bd87-68f0-4cd4-aa56-effac26401dd req-86bbaf97-e1d4-426c-a3ee-4add5df96064 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050123 Jul 20 04:11:32.655486 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 191/387] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:32.662551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d515c060-b83b-428a-ab57-8e1b11e512b7 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.663552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d515c060-b83b-428a-ab57-8e1b11e512b7 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.671237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d515c060-b83b-428a-ab57-8e1b11e512b7 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.671809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d515c060-b83b-428a-ab57-8e1b11e512b7 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.672838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d515c060-b83b-428a-ab57-8e1b11e512b7 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.673575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d515c060-b83b-428a-ab57-8e1b11e512b7 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.848898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cf3083b0-47fa-42a3-b83f-70ea2bbd33d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:32.864411 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cf3083b0-47fa-42a3-b83f-70ea2bbd33d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1319 microversion: 2.1 time: 0.298850 Jul 20 04:11:32.867600 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 197/388] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:32 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:32.879486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-595e8719-d2fc-436e-ac30-1ef1bcd527b4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.881339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-595e8719-d2fc-436e-ac30-1ef1bcd527b4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.896295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-595e8719-d2fc-436e-ac30-1ef1bcd527b4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.896754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-595e8719-d2fc-436e-ac30-1ef1bcd527b4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.897544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-595e8719-d2fc-436e-ac30-1ef1bcd527b4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.901788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-595e8719-d2fc-436e-ac30-1ef1bcd527b4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.927135 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d515c060-b83b-428a-ab57-8e1b11e512b7 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1647 microversion: 2.1 time: 0.268489 Jul 20 04:11:32.933253 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 192/389] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:32 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1647 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:32.942086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d37c8bb1-ce89-42bf-86fa-623ddcfbc58f req-d0858800-2b63-47e5-95a8-c2d24da44606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b5ae40-24a9-4b37-8920-8f32fd165dd8", "tag": "f1ae2766-bf4e-4f6c-b66b-eb30f89c64f2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:32.951760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d37c8bb1-ce89-42bf-86fa-623ddcfbc58f req-d0858800-2b63-47e5-95a8-c2d24da44606 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.952276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d37c8bb1-ce89-42bf-86fa-623ddcfbc58f req-d0858800-2b63-47e5-95a8-c2d24da44606 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.981929 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d37c8bb1-ce89-42bf-86fa-623ddcfbc58f req-d0858800-2b63-47e5-95a8-c2d24da44606 service nova] Creating event network-changed:f1ae2766-bf4e-4f6c-b66b-eb30f89c64f2 for instance 02b5ae40-24a9-4b37-8920-8f32fd165dd8 on n-h2-764485-11 Jul 20 04:11:32.999088 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d37c8bb1-ce89-42bf-86fa-623ddcfbc58f req-d0858800-2b63-47e5-95a8-c2d24da44606 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058981 Jul 20 04:11:33.000441 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 193/390] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:33.014666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59329102-894d-45e3-a2a5-e5d85346580d tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:33.016031 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:33.016031 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:33.017270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59329102-894d-45e3-a2a5-e5d85346580d tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.017726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59329102-894d-45e3-a2a5-e5d85346580d tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.018533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59329102-894d-45e3-a2a5-e5d85346580d tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.019000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59329102-894d-45e3-a2a5-e5d85346580d tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.064947 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-59329102-894d-45e3-a2a5-e5d85346580d tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.063036 Jul 20 04:11:33.066890 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 194/391] 10.222.0.20 () {58 vars in 1175 bytes} [Wed Jul 20 04:11:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:33.081038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9d3fd396-fb4a-4600-8c9d-82f761a5db9c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-764485-11", "block_migration": true, "disk_over_commit": false}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:33.083132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9d3fd396-fb4a-4600-8c9d-82f761a5db9c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:33.099657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d3fd396-fb4a-4600-8c9d-82f761a5db9c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.099999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d3fd396-fb4a-4600-8c9d-82f761a5db9c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.100777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d3fd396-fb4a-4600-8c9d-82f761a5db9c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.101211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d3fd396-fb4a-4600-8c9d-82f761a5db9c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.167801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-595e8719-d2fc-436e-ac30-1ef1bcd527b4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:33.176728 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-595e8719-d2fc-436e-ac30-1ef1bcd527b4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.307928 Jul 20 04:11:33.177308 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 198/392] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:32 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:33.193869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d1076991-3beb-4b5b-ad1b-4b2459187db3 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:33.194550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d1076991-3beb-4b5b-ad1b-4b2459187db3 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:33.207378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1076991-3beb-4b5b-ad1b-4b2459187db3 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.207852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1076991-3beb-4b5b-ad1b-4b2459187db3 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.208619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1076991-3beb-4b5b-ad1b-4b2459187db3 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.209048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1076991-3beb-4b5b-ad1b-4b2459187db3 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.224900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-9d3fd396-fb4a-4600-8c9d-82f761a5db9c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lazy-loading 'flavor' on Instance uuid 2d9df925-6109-4e21-a875-7d16c10d0b80 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:33.298956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9d3fd396-fb4a-4600-8c9d-82f761a5db9c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Going to try to live migrate instance to n-h1-764485-11 {{(pid=119807) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:11:33.427136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d1076991-3beb-4b5b-ad1b-4b2459187db3 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:33.439575 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d1076991-3beb-4b5b-ad1b-4b2459187db3 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1317 microversion: 2.1 time: 0.260054 Jul 20 04:11:33.440852 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 199/393] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:33 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:33.579104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9173cb6e-6bab-4ae6-aea8-0197bf0434f5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:33.579959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9173cb6e-6bab-4ae6-aea8-0197bf0434f5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:33.590604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9173cb6e-6bab-4ae6-aea8-0197bf0434f5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.594314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9173cb6e-6bab-4ae6-aea8-0197bf0434f5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.594314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9173cb6e-6bab-4ae6-aea8-0197bf0434f5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.594314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9173cb6e-6bab-4ae6-aea8-0197bf0434f5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.872477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9173cb6e-6bab-4ae6-aea8-0197bf0434f5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:33.882760 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9173cb6e-6bab-4ae6-aea8-0197bf0434f5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1316 microversion: 2.1 time: 0.307926 Jul 20 04:11:33.885375 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 200/394] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:33 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:33.896035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a18b76ef-0028-4205-bfc2-e0900e9a3953 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:33.898897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a18b76ef-0028-4205-bfc2-e0900e9a3953 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:33.921540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a18b76ef-0028-4205-bfc2-e0900e9a3953 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.922244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a18b76ef-0028-4205-bfc2-e0900e9a3953 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.924165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a18b76ef-0028-4205-bfc2-e0900e9a3953 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.925489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a18b76ef-0028-4205-bfc2-e0900e9a3953 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.206201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:34.247407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=26 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:34.542092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a18b76ef-0028-4205-bfc2-e0900e9a3953 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:34.550222 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a18b76ef-0028-4205-bfc2-e0900e9a3953 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1469 microversion: 2.1 time: 0.662805 Jul 20 04:11:34.560484 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 201/395] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:33 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1469 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:34.566210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-236e0e77-8e1e-4185-abf4-05480a0d106a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:34.566912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-236e0e77-8e1e-4185-abf4-05480a0d106a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:34.581784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-236e0e77-8e1e-4185-abf4-05480a0d106a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.583728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-236e0e77-8e1e-4185-abf4-05480a0d106a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.584999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-236e0e77-8e1e-4185-abf4-05480a0d106a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.587051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-236e0e77-8e1e-4185-abf4-05480a0d106a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.042090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-236e0e77-8e1e-4185-abf4-05480a0d106a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:35.050026 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-236e0e77-8e1e-4185-abf4-05480a0d106a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.487544 Jul 20 04:11:35.062366 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 202/396] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:34 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:35.323382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b1a0ede0-e76a-4b9b-bf90-de32b3241eb4 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-420176607", "id": 1141201965, "os-flavor-access:is_public": "True"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:35.325358 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:35.325358 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:35.343383 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b1a0ede0-e76a-4b9b-bf90-de32b3241eb4 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.279168 Jul 20 04:11:35.344033 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 203/397] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:35 2022] POST /compute/v2.1/flavors => generated 429 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:35.352876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-effb918b-e14c-4154-82bf-b3ab59df2df7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:35.353587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-effb918b-e14c-4154-82bf-b3ab59df2df7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:35.360863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-effb918b-e14c-4154-82bf-b3ab59df2df7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.361653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-effb918b-e14c-4154-82bf-b3ab59df2df7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.362570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-effb918b-e14c-4154-82bf-b3ab59df2df7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.363071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-effb918b-e14c-4154-82bf-b3ab59df2df7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.522133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-effb918b-e14c-4154-82bf-b3ab59df2df7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:35.530382 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-effb918b-e14c-4154-82bf-b3ab59df2df7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1317 microversion: 2.1 time: 0.184988 Jul 20 04:11:35.530957 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 204/398] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:35 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:35.669177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aed2b0ae-0f0c-4fcc-97b8-e323494d195f tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1978662900", "block_migration": true, "disk_over_commit": false}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:35.670414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aed2b0ae-0f0c-4fcc-97b8-e323494d195f tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:35.677195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aed2b0ae-0f0c-4fcc-97b8-e323494d195f tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.677832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aed2b0ae-0f0c-4fcc-97b8-e323494d195f tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.678730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aed2b0ae-0f0c-4fcc-97b8-e323494d195f tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.679292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aed2b0ae-0f0c-4fcc-97b8-e323494d195f tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.748471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-aed2b0ae-0f0c-4fcc-97b8-e323494d195f tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lazy-loading 'flavor' on Instance uuid 9665e973-184b-48eb-92a4-1cbc4934ccbd {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:35.797194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aed2b0ae-0f0c-4fcc-97b8-e323494d195f tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Going to try to live migrate instance to tempest-host-1978662900 {{(pid=119808) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:11:35.804998 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-aed2b0ae-0f0c-4fcc-97b8-e323494d195f tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] HTTP exception thrown: Compute host tempest-host-1978662900 could not be found. Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aed2b0ae-0f0c-4fcc-97b8-e323494d195f tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Request method failure captured: Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd/action HTTP/1.1 Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 107 Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BejMNysIVCWGEtpeWhhGSldZyhTCJaduCPX8TYE5RLYg58ejZS9lk7_5PlYD9PReUuy3IwtHx17l1n7qzmrc5XJqBGYhggNZe8jXCSaO5SaUH3UPlPi1quvUQwfV2_SZitlCsHKrZS0wK0a1TX3JsrtcuvHd0tChFFwfk1K7sdZIY Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: f123f18fd9b44f1a8585fe82d72a1581 Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-LiveMigrationNegativeTest-661888177 Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:11:35.809743 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:11:35.811340 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f123f18fd9b44f1a8585fe82d72a1581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f123f18fd9b44f1a8585fe82d72a1581"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f123f18fd9b44f1a8585fe82d72a1581", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f123f18fd9b44f1a8585fe82d72a1581"}]}] Jul 20 04:11:35.811340 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-LiveMigrationNegativeTest-661888177 Jul 20 04:11:35.811340 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: f123f18fd9b44f1a8585fe82d72a1581 Jul 20 04:11:35.811340 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-661888177 Jul 20 04:11:35.811340 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-LiveMigrationNegativeTest-661888177-project-admin Jul 20 04:11:35.811340 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:11:35.811340 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:11:35.811340 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3f951fb77288470ba7cdc65c1259c129 Jul 20 04:11:35.811340 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-LiveMigrationNegativeTest-661888177-project-admin Jul 20 04:11:35.811340 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:11:35.811340 n-d-764485-11 devstack@n-api.service[119808]: {"os-migrateLive": {"host": "tempest-host-1978662900", "block_migration": true, "disk_over_commit": false}} Jul 20 04:11:35.811340 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: exception: Compute host tempest-host-1978662900 could not be found. Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '9665e973-184b-48eb-92a4-1cbc4934ccbd', 'body': {'os-migrateLive': {'host': 'tempest-host-1978662900', 'block_migration': True, 'disk_over_commit': False}}} Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:11:35.813268 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1978662900 could not be found. Jul 20 04:11:35.814645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1978662900 could not be found. Jul 20 04:11:35.816975 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.820375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.820375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.820375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.820375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:35.820375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:35.820375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:35.820375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:35.820375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1978662900 could not be found. Jul 20 04:11:35.820375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.820375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aed2b0ae-0f0c-4fcc-97b8-e323494d195f tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Returning 400 to user: Compute host tempest-host-1978662900 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:35.820375 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aed2b0ae-0f0c-4fcc-97b8-e323494d195f tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd/action" status: 400 len: 100 microversion: 2.1 time: 0.278963 Jul 20 04:11:35.820375 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 205/399] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Jul 20 04:11:35 2022] POST /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd/action => generated 100 bytes in 280 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:11:35.822395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7679cbc4-a660-43b7-9088-84797c1895de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:35.822395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7679cbc4-a660-43b7-9088-84797c1895de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:35.827169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7679cbc4-a660-43b7-9088-84797c1895de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.827696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7679cbc4-a660-43b7-9088-84797c1895de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.828561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7679cbc4-a660-43b7-9088-84797c1895de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.829721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7679cbc4-a660-43b7-9088-84797c1895de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.987173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7679cbc4-a660-43b7-9088-84797c1895de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:35.996388 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7679cbc4-a660-43b7-9088-84797c1895de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1316 microversion: 2.1 time: 0.182360 Jul 20 04:11:35.996986 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 206/400] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:35 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:36.014301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3bd0fb31-6adc-408f-9a96-e9cef5ae5b6e tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:36.015295 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:36.015295 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:36.018707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:36.037366 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3bd0fb31-6adc-408f-9a96-e9cef5ae5b6e tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1141201965" status: 202 len: 0 microversion: 2.1 time: 0.028747 Jul 20 04:11:36.042312 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 207/401] 10.222.0.20 () {58 vars in 1160 bytes} [Wed Jul 20 04:11:36 2022] DELETE /compute/v2.1/flavors/1141201965 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:36.048619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4ba707fa-c515-4030-80cf-af45fc7699ce tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:36.049418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4ba707fa-c515-4030-80cf-af45fc7699ce tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:36.056449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ba707fa-c515-4030-80cf-af45fc7699ce tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:36.056987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ba707fa-c515-4030-80cf-af45fc7699ce tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.058026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ba707fa-c515-4030-80cf-af45fc7699ce tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:36.058866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ba707fa-c515-4030-80cf-af45fc7699ce tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.219294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4ba707fa-c515-4030-80cf-af45fc7699ce tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:36.227448 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4ba707fa-c515-4030-80cf-af45fc7699ce tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1469 microversion: 2.1 time: 0.186479 Jul 20 04:11:36.228148 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 208/402] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:36 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:36.232470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74854e35-1578-4172-aa0e-fc982df20a54 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:36.257496 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74854e35-1578-4172-aa0e-fc982df20a54 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.028330 Jul 20 04:11:36.258273 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 209/403] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:36 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:36.272698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-788caf94-4399-4cc1-b808-87ea7992aaaa tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:36.273743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-788caf94-4399-4cc1-b808-87ea7992aaaa tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:36.293096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-788caf94-4399-4cc1-b808-87ea7992aaaa tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:36.293553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-788caf94-4399-4cc1-b808-87ea7992aaaa tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.294345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-788caf94-4399-4cc1-b808-87ea7992aaaa tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:36.294787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-788caf94-4399-4cc1-b808-87ea7992aaaa tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.308065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=18 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:36.544897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-788caf94-4399-4cc1-b808-87ea7992aaaa tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:36.553886 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-788caf94-4399-4cc1-b808-87ea7992aaaa tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.294335 Jul 20 04:11:36.555226 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 210/404] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:36 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:36.571941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a064d40f-a254-4831-af9e-0a35f6a6f872 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1809114057", "id": 1899958118, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:36.575473 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:36.575473 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:36.602667 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a064d40f-a254-4831-af9e-0a35f6a6f872 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.046127 Jul 20 04:11:36.608814 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 211/405] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:36 2022] POST /compute/v2.1/flavors => generated 417 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:36.609895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2086349600", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:36.673747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:36.920583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:36.921328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:36.926291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:36.926939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:36.927367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:36.937521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:36.938250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.939046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:36.939727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.974631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Getting quotas for project 9624de6b85e44fac9ab44c11d6cde04b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:36.980512 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Getting quotas for user f96042a516bf425287c5b71cc3389cf0 and project 9624de6b85e44fac9ab44c11d6cde04b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:36.993171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:36.996214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:37.070924 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3f7a568f-810f-4224-9141-85e57a6dbdcd tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.465794 Jul 20 04:11:37.072805 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 212/406] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:37.086938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16e04734-baf6-4748-990d-7d3eb720eab0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:37.092111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-16e04734-baf6-4748-990d-7d3eb720eab0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:37.100796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16e04734-baf6-4748-990d-7d3eb720eab0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.101388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16e04734-baf6-4748-990d-7d3eb720eab0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.106844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16e04734-baf6-4748-990d-7d3eb720eab0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.108019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16e04734-baf6-4748-990d-7d3eb720eab0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.459876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-16e04734-baf6-4748-990d-7d3eb720eab0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:37.471662 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-16e04734-baf6-4748-990d-7d3eb720eab0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1317 microversion: 2.1 time: 0.397444 Jul 20 04:11:37.488443 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 213/407] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:37 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:37.514610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5384ec13-7775-4cc5-9497-3f99863c0953 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:37.562235 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5384ec13-7775-4cc5-9497-3f99863c0953 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.059131 Jul 20 04:11:37.563901 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 214/408] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:37 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:37.569165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6949b147-0abc-4989-8f63-7020be318ea4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:37.569943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6949b147-0abc-4989-8f63-7020be318ea4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:37.577339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6949b147-0abc-4989-8f63-7020be318ea4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.578057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6949b147-0abc-4989-8f63-7020be318ea4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.579014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6949b147-0abc-4989-8f63-7020be318ea4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.579633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6949b147-0abc-4989-8f63-7020be318ea4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.899050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6949b147-0abc-4989-8f63-7020be318ea4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:37.912742 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6949b147-0abc-4989-8f63-7020be318ea4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1316 microversion: 2.1 time: 0.347171 Jul 20 04:11:37.913769 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 215/409] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:37 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:37.924540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5923ef5c-efbb-4598-9e70-3e06cd22ca04 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:37.925162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5923ef5c-efbb-4598-9e70-3e06cd22ca04 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:37.953741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5923ef5c-efbb-4598-9e70-3e06cd22ca04 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.954619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5923ef5c-efbb-4598-9e70-3e06cd22ca04 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.955793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5923ef5c-efbb-4598-9e70-3e06cd22ca04 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.956418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5923ef5c-efbb-4598-9e70-3e06cd22ca04 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.081555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5923ef5c-efbb-4598-9e70-3e06cd22ca04 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:38.101555 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5923ef5c-efbb-4598-9e70-3e06cd22ca04 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1215 microversion: 2.1 time: 0.186636 Jul 20 04:11:38.102396 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 216/410] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:37 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:38.114022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1d8a78ae-53f2-43d7-9ed4-59abdc9f3bf5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:38.115346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1d8a78ae-53f2-43d7-9ed4-59abdc9f3bf5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:38.123502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d8a78ae-53f2-43d7-9ed4-59abdc9f3bf5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.123982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d8a78ae-53f2-43d7-9ed4-59abdc9f3bf5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.124926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d8a78ae-53f2-43d7-9ed4-59abdc9f3bf5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.125796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d8a78ae-53f2-43d7-9ed4-59abdc9f3bf5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.275284 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9d3fd396-fb4a-4600-8c9d-82f761a5db9c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80/action" status: 202 len: 0 microversion: 2.1 time: 5.200233 Jul 20 04:11:38.277727 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 195/411] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:11:33 2022] POST /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80/action => generated 0 bytes in 5204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:38.285093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4df4510b-1200-4ae9-98be-47c70b25b584 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:38.286176 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:38.286176 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:38.311361 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4df4510b-1200-4ae9-98be-47c70b25b584 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1899958118" status: 202 len: 0 microversion: 2.1 time: 0.031863 Jul 20 04:11:38.315597 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 196/412] 10.222.0.20 () {58 vars in 1160 bytes} [Wed Jul 20 04:11:38 2022] DELETE /compute/v2.1/flavors/1899958118 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:38.322069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ba80dbe0-7158-4654-8b72-0d81eae9c97b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:38.324079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ba80dbe0-7158-4654-8b72-0d81eae9c97b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:38.333557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:38.336428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba80dbe0-7158-4654-8b72-0d81eae9c97b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.337348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba80dbe0-7158-4654-8b72-0d81eae9c97b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.339309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba80dbe0-7158-4654-8b72-0d81eae9c97b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.340193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba80dbe0-7158-4654-8b72-0d81eae9c97b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.719732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1d8a78ae-53f2-43d7-9ed4-59abdc9f3bf5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:38.735534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:38.747660 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1d8a78ae-53f2-43d7-9ed4-59abdc9f3bf5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.643989 Jul 20 04:11:38.758332 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 217/413] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:38 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:38.765491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c687d6f4-50d1-4d8c-8b3e-03fcbcec0598 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:38.792752 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c687d6f4-50d1-4d8c-8b3e-03fcbcec0598 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.032545 Jul 20 04:11:38.797675 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 218/414] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:38 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:38.815533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc9cd587-57ce-447c-afd3-fc32b3d1267d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:38.816180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc9cd587-57ce-447c-afd3-fc32b3d1267d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:38.824226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc9cd587-57ce-447c-afd3-fc32b3d1267d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.825673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc9cd587-57ce-447c-afd3-fc32b3d1267d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.827413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc9cd587-57ce-447c-afd3-fc32b3d1267d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.828774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc9cd587-57ce-447c-afd3-fc32b3d1267d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.272316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ba80dbe0-7158-4654-8b72-0d81eae9c97b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:39.285384 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ba80dbe0-7158-4654-8b72-0d81eae9c97b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.968176 Jul 20 04:11:39.286530 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 197/415] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:38 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:39.299202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-05a96ea2-606f-43bd-a611-a8e5f145090c req-745f6d76-210b-4ce6-9acd-43e2c2d94bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f32f3c69-0926-47e2-9498-38ca38aa5035", "name": "network-vif-plugged", "status": "completed", "tag": "68b20988-ab90-4e07-8ec9-d18b65a6edbc"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:39.309189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-05a96ea2-606f-43bd-a611-a8e5f145090c req-745f6d76-210b-4ce6-9acd-43e2c2d94bdd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.309897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-05a96ea2-606f-43bd-a611-a8e5f145090c req-745f6d76-210b-4ce6-9acd-43e2c2d94bdd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.323001 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-05a96ea2-606f-43bd-a611-a8e5f145090c req-745f6d76-210b-4ce6-9acd-43e2c2d94bdd service nova] Creating event network-vif-plugged:68b20988-ab90-4e07-8ec9-d18b65a6edbc for instance f32f3c69-0926-47e2-9498-38ca38aa5035 on n-h1-764485-11 Jul 20 04:11:39.328497 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-05a96ea2-606f-43bd-a611-a8e5f145090c req-745f6d76-210b-4ce6-9acd-43e2c2d94bdd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040220 Jul 20 04:11:39.329499 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 198/416] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:39.336006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e74dd5a9-ed53-44c5-b762-b7872e787d3b tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-870945622", "id": 1946386412, "os-flavor-access:is_public": "True"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:39.337881 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:39.337881 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:39.360249 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e74dd5a9-ed53-44c5-b762-b7872e787d3b tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.029260 Jul 20 04:11:39.361496 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 199/417] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:39 2022] POST /compute/v2.1/flavors => generated 428 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:39.373292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-324fc513-bdbd-460b-b42b-23bb81fd9590 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.374292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-324fc513-bdbd-460b-b42b-23bb81fd9590 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:39.401713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-324fc513-bdbd-460b-b42b-23bb81fd9590 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.402805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-324fc513-bdbd-460b-b42b-23bb81fd9590 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.403893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-324fc513-bdbd-460b-b42b-23bb81fd9590 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.404555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-324fc513-bdbd-460b-b42b-23bb81fd9590 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.409511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:39.617685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cc9cd587-57ce-447c-afd3-fc32b3d1267d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:39.626059 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cc9cd587-57ce-447c-afd3-fc32b3d1267d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1317 microversion: 2.1 time: 0.827219 Jul 20 04:11:39.627003 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 219/418] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:38 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1317 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:39.632239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e308e5d-c2dc-421c-bb29-213d0d6a209d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.633103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6e308e5d-c2dc-421c-bb29-213d0d6a209d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:39.642458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e308e5d-c2dc-421c-bb29-213d0d6a209d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.642915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e308e5d-c2dc-421c-bb29-213d0d6a209d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.643736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e308e5d-c2dc-421c-bb29-213d0d6a209d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.644177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e308e5d-c2dc-421c-bb29-213d0d6a209d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.758306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6e308e5d-c2dc-421c-bb29-213d0d6a209d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:39.766835 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6e308e5d-c2dc-421c-bb29-213d0d6a209d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1277 microversion: 2.1 time: 0.138581 Jul 20 04:11:39.767408 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 220/419] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:39 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:39.781177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-59b2db93-11e1-4c1f-be83-363b2a58d315 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.782088 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:39.782088 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:39.789995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-324fc513-bdbd-460b-b42b-23bb81fd9590 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:39.799326 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-59b2db93-11e1-4c1f-be83-363b2a58d315 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1946386412" status: 202 len: 0 microversion: 2.1 time: 0.021721 Jul 20 04:11:39.799954 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 221/420] 10.222.0.20 () {58 vars in 1160 bytes} [Wed Jul 20 04:11:39 2022] DELETE /compute/v2.1/flavors/1946386412 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:39.804976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-952905be-5773-4639-ae6a-0ea41344e7ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.805812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-952905be-5773-4639-ae6a-0ea41344e7ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:39.806967 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-324fc513-bdbd-460b-b42b-23bb81fd9590 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1316 microversion: 2.1 time: 0.444069 Jul 20 04:11:39.807582 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 200/421] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:39 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:39.821687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-952905be-5773-4639-ae6a-0ea41344e7ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.822446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-952905be-5773-4639-ae6a-0ea41344e7ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.823540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-952905be-5773-4639-ae6a-0ea41344e7ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.823953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e5649ec6-7c4d-442b-8dce-3f4cecc5345d tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.824710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-952905be-5773-4639-ae6a-0ea41344e7ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.846168 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e5649ec6-7c4d-442b-8dce-3f4cecc5345d tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.033257 Jul 20 04:11:39.846763 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 201/422] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:39 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:39.864242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7187c644-909f-4070-974c-c79c984c0421 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-933861936", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:39.865953 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:39.865953 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:39.882256 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7187c644-909f-4070-974c-c79c984c0421 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.021415 Jul 20 04:11:39.882930 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 202/423] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:39 2022] POST /compute/v2.1/flavors => generated 506 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:39.894345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b55d7493-695b-4192-8186-0c1d5beb7f65 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.895157 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:39.895157 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:39.916845 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b55d7493-695b-4192-8186-0c1d5beb7f65 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/d14c7579-4871-435b-be6a-d6dce4e261c2" status: 202 len: 0 microversion: 2.1 time: 0.024948 Jul 20 04:11:39.922810 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 203/424] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:39 2022] DELETE /compute/v2.1/flavors/d14c7579-4871-435b-be6a-d6dce4e261c2 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:11:39.929109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3927cac7-b977-4ceb-bcae-46b32c72eb63 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.950615 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3927cac7-b977-4ceb-bcae-46b32c72eb63 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026317 Jul 20 04:11:39.959569 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 204/425] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:39 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:39.970202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95548f81-9b1c-42c6-ab06-76499cc10a9b tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2135837110", "id": "7017f1e5-e713-441b-bd37-8b43d627e0a9", "os-flavor-access:is_public": "True"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:39.990100 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95548f81-9b1c-42c6-ab06-76499cc10a9b tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.024370 Jul 20 04:11:39.991642 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 205/426] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:39 2022] POST /compute/v2.1/flavors => generated 507 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:40.001601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f85723ed-4a94-425d-97d8-42b159428051 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.024626 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f85723ed-4a94-425d-97d8-42b159428051 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/7017f1e5-e713-441b-bd37-8b43d627e0a9" status: 202 len: 0 microversion: 2.1 time: 0.026457 Jul 20 04:11:40.026211 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 206/427] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:39 2022] DELETE /compute/v2.1/flavors/7017f1e5-e713-441b-bd37-8b43d627e0a9 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:40.034767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a7176acc-763a-4c52-8547-e0e2819174d3 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.066726 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a7176acc-763a-4c52-8547-e0e2819174d3 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.035929 Jul 20 04:11:40.067851 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 207/428] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:40.091616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9a71bf5-c842-4b40-8dc9-7a35ead0848a tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1202199205", "id": 2135211225, "os-flavor-access:is_public": "True"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:40.113732 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e9a71bf5-c842-4b40-8dc9-7a35ead0848a tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.030216 Jul 20 04:11:40.115387 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 208/429] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:40 2022] POST /compute/v2.1/flavors => generated 414 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:40.125208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-29707a1b-87e8-4a54-b641-d85fb0b625c2 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.133632 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-29707a1b-87e8-4a54-b641-d85fb0b625c2 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/2135211225" status: 200 len: 414 microversion: 2.1 time: 0.011917 Jul 20 04:11:40.136253 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 209/430] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/flavors/2135211225 => generated 414 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:40.292652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d685a976-3044-4b1f-9486-b2a0c6390548 tempest-FlavorsAdminTestJSON-142965633 tempest-FlavorsAdminTestJSON-142965633-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.294418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-952905be-5773-4639-ae6a-0ea41344e7ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:40.314449 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-952905be-5773-4639-ae6a-0ea41344e7ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.513216 Jul 20 04:11:40.324705 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 222/431] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:39 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:40.326643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9ed9e15d-1057-40fa-8ea9-16381413bc97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.331414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9ed9e15d-1057-40fa-8ea9-16381413bc97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:40.343830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ed9e15d-1057-40fa-8ea9-16381413bc97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.344626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ed9e15d-1057-40fa-8ea9-16381413bc97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.344922 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d685a976-3044-4b1f-9486-b2a0c6390548 tempest-FlavorsAdminTestJSON-142965633 tempest-FlavorsAdminTestJSON-142965633-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.200964 Jul 20 04:11:40.345855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ed9e15d-1057-40fa-8ea9-16381413bc97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.346356 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 210/432] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:40.346850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ed9e15d-1057-40fa-8ea9-16381413bc97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.365684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3e771660-c6ce-4a82-94a9-0e0b053ef5cc tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.398777 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3e771660-c6ce-4a82-94a9-0e0b053ef5cc tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2135211225" status: 202 len: 0 microversion: 2.1 time: 0.039485 Jul 20 04:11:40.402932 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 211/433] 10.222.0.20 () {58 vars in 1160 bytes} [Wed Jul 20 04:11:40 2022] DELETE /compute/v2.1/flavors/2135211225 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:40.407829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3a085891-ad10-4511-a76d-0dd876ad332c tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.430667 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3a085891-ad10-4511-a76d-0dd876ad332c tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.025012 Jul 20 04:11:40.432236 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 212/434] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:40.452228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0912911b-7573-481e-92fd-ec35800628ff tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-852780967", "id": 1215158046, "os-flavor-access:is_public": "False"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:40.475350 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0912911b-7573-481e-92fd-ec35800628ff tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.028987 Jul 20 04:11:40.482119 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 213/435] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:40 2022] POST /compute/v2.1/flavors => generated 429 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:40.488150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-02fe06c0-b3ab-41a7-8013-54981a37c195 tempest-FlavorsAdminTestJSON-142965633 tempest-FlavorsAdminTestJSON-142965633-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "1215158046"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:40.498146 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-02fe06c0-b3ab-41a7-8013-54981a37c195 tempest-FlavorsAdminTestJSON-142965633 tempest-FlavorsAdminTestJSON-142965633-project] HTTP exception thrown: Flavor 1215158046 could not be found. Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-02fe06c0-b3ab-41a7-8013-54981a37c195 tempest-FlavorsAdminTestJSON-142965633 tempest-FlavorsAdminTestJSON-142965633-project] Request method failure captured: Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 107 Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14B12N0GTwdX-ZX3hBIqf1-GXsGw4aS8mT_R4gbk6HnKJMJ8yQvPZBPkv1QB2SjxOOz64UEx2ihVjPDbRxMUe9A3B-fZneRiUDHfB1SA26NBFuxJnlSQ5QddSY8AgcGvYKVzW8W4-sd5REprowPb5hUhFGnOzFVQhZExPIvswSU0F68 Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: e02e205162bf44dcaf8020ff1928bf2c Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-FlavorsAdminTestJSON-142965633 Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:11:40.501439 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e02e205162bf44dcaf8020ff1928bf2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e02e205162bf44dcaf8020ff1928bf2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e02e205162bf44dcaf8020ff1928bf2c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e02e205162bf44dcaf8020ff1928bf2c"}]}] Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-FlavorsAdminTestJSON-142965633 Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: e02e205162bf44dcaf8020ff1928bf2c Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-142965633 Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-FlavorsAdminTestJSON-142965633-project Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 82292a6f2feb422fbbe78026e2777572 Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-FlavorsAdminTestJSON-142965633-project Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "test", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "1215158046"}} Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:11:40.502831 n-d-764485-11 devstack@n-api.service[119807]: exception: Flavor 1215158046 could not be found. Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '1215158046'}}} Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1215158046 could not be found. Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:40.503642 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1215158046 could not be found. Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:40.505481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:40.508606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:40.508606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:40.508606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:40.508606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1215158046 could not be found. Jul 20 04:11:40.508606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:11:40.508606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-02fe06c0-b3ab-41a7-8013-54981a37c195 tempest-FlavorsAdminTestJSON-142965633 tempest-FlavorsAdminTestJSON-142965633-project] Returning 400 to user: Flavor 1215158046 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:40.508606 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-02fe06c0-b3ab-41a7-8013-54981a37c195 tempest-FlavorsAdminTestJSON-142965633 tempest-FlavorsAdminTestJSON-142965633-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.018754 Jul 20 04:11:40.508606 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 214/436] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:40 2022] POST /compute/v2.1/servers => generated 81 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:11:40.516743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b3300106-e3ac-46af-9ebd-add51791082d tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.545395 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b3300106-e3ac-46af-9ebd-add51791082d tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1215158046" status: 202 len: 0 microversion: 2.1 time: 0.032652 Jul 20 04:11:40.546746 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 215/437] 10.222.0.20 () {58 vars in 1160 bytes} [Wed Jul 20 04:11:40 2022] DELETE /compute/v2.1/flavors/1215158046 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:40.569049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1b723f84-c1f4-477d-ac8c-1a985bd93db2 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.594330 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1b723f84-c1f4-477d-ac8c-1a985bd93db2 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.043198 Jul 20 04:11:40.595076 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 216/438] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:40.614732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d8133415-dbcb-450e-9bf4-02b886d17d04 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-531754077", "id": 44236251, "os-flavor-access:is_public": "False"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:40.646580 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d8133415-dbcb-450e-9bf4-02b886d17d04 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.036757 Jul 20 04:11:40.647193 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 217/439] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:40.654565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ea340846-6022-4fbd-bb66-fef4f44d0acf tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.655188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ea340846-6022-4fbd-bb66-fef4f44d0acf tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:40.666963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea340846-6022-4fbd-bb66-fef4f44d0acf tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.668294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea340846-6022-4fbd-bb66-fef4f44d0acf tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.669129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea340846-6022-4fbd-bb66-fef4f44d0acf tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.669571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea340846-6022-4fbd-bb66-fef4f44d0acf tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.788658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9ed9e15d-1057-40fa-8ea9-16381413bc97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:40.799375 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9ed9e15d-1057-40fa-8ea9-16381413bc97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.481137 Jul 20 04:11:40.800716 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 223/440] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:40.805779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9496c386-56cd-4d55-9909-64f4eda95881 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-589453176", "id": 1550260839, "os-flavor-access:is_public": "True"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:40.809762 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:40.809762 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:40.829546 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9496c386-56cd-4d55-9909-64f4eda95881 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.027457 Jul 20 04:11:40.830339 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 224/441] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:40 2022] POST /compute/v2.1/flavors => generated 413 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:40.857630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c66a1a89-3513-42be-b910-ea1aa9898ec9 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.858433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c66a1a89-3513-42be-b910-ea1aa9898ec9 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:40.867835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c66a1a89-3513-42be-b910-ea1aa9898ec9 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.868410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c66a1a89-3513-42be-b910-ea1aa9898ec9 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.869382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c66a1a89-3513-42be-b910-ea1aa9898ec9 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.870620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c66a1a89-3513-42be-b910-ea1aa9898ec9 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.430477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ea340846-6022-4fbd-bb66-fef4f44d0acf tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:41.442111 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ea340846-6022-4fbd-bb66-fef4f44d0acf tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1317 microversion: 2.1 time: 0.793738 Jul 20 04:11:41.456346 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 218/442] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1317 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:41.461260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d13e7c38-c4cc-4ae0-9eaf-2793e7983851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.461913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d13e7c38-c4cc-4ae0-9eaf-2793e7983851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:41.469592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d13e7c38-c4cc-4ae0-9eaf-2793e7983851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.470282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d13e7c38-c4cc-4ae0-9eaf-2793e7983851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.471320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d13e7c38-c4cc-4ae0-9eaf-2793e7983851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.472083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d13e7c38-c4cc-4ae0-9eaf-2793e7983851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.624497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c66a1a89-3513-42be-b910-ea1aa9898ec9 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:41.637969 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c66a1a89-3513-42be-b910-ea1aa9898ec9 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1319 microversion: 2.1 time: 0.792708 Jul 20 04:11:41.648589 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 225/443] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1319 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:41.653080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4a866115-afff-48e6-a1d1-baeb9106b32f tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.677116 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4a866115-afff-48e6-a1d1-baeb9106b32f tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 411 microversion: 2.1 time: 0.028854 Jul 20 04:11:41.678093 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 226/444] 10.222.0.20 () {58 vars in 1168 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 411 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:41.689320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1e9ac7dd-6c56-4976-9192-3c80f9ca1a24 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.690026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1e9ac7dd-6c56-4976-9192-3c80f9ca1a24 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:41.698390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e9ac7dd-6c56-4976-9192-3c80f9ca1a24 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.698951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e9ac7dd-6c56-4976-9192-3c80f9ca1a24 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.699897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e9ac7dd-6c56-4976-9192-3c80f9ca1a24 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.700376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e9ac7dd-6c56-4976-9192-3c80f9ca1a24 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.915399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d13e7c38-c4cc-4ae0-9eaf-2793e7983851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:41.927973 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d13e7c38-c4cc-4ae0-9eaf-2793e7983851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1466 microversion: 2.1 time: 0.469996 Jul 20 04:11:41.928997 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 219/445] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1466 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:41.936988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-60cd1d70-5576-4702-b604-013cd9daeafb req-19af075b-8920-4d59-8d62-0d05af8ee281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b5ae40-24a9-4b37-8920-8f32fd165dd8", "name": "network-vif-plugged", "status": "completed", "tag": "f1ae2766-bf4e-4f6c-b66b-eb30f89c64f2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:41.945498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-60cd1d70-5576-4702-b604-013cd9daeafb req-19af075b-8920-4d59-8d62-0d05af8ee281 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.945925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-60cd1d70-5576-4702-b604-013cd9daeafb req-19af075b-8920-4d59-8d62-0d05af8ee281 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.962260 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-60cd1d70-5576-4702-b604-013cd9daeafb req-19af075b-8920-4d59-8d62-0d05af8ee281 service nova] Creating event network-vif-plugged:f1ae2766-bf4e-4f6c-b66b-eb30f89c64f2 for instance 02b5ae40-24a9-4b37-8920-8f32fd165dd8 on n-h2-764485-11 Jul 20 04:11:41.969193 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-60cd1d70-5576-4702-b604-013cd9daeafb req-19af075b-8920-4d59-8d62-0d05af8ee281 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038414 Jul 20 04:11:41.970099 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 220/446] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:41.976519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5dd492a9-f300-4f02-9b93-f25f024983c7 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.992786 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5dd492a9-f300-4f02-9b93-f25f024983c7 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 411 microversion: 2.1 time: 0.021216 Jul 20 04:11:41.993366 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 221/447] 10.222.0.20 () {58 vars in 1176 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 411 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:41.998986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8bdb7c81-ec14-4d47-bd95-aeb994ccf344 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.999902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8bdb7c81-ec14-4d47-bd95-aeb994ccf344 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:42.006120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8bdb7c81-ec14-4d47-bd95-aeb994ccf344 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.006570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8bdb7c81-ec14-4d47-bd95-aeb994ccf344 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.008355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8bdb7c81-ec14-4d47-bd95-aeb994ccf344 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.009146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8bdb7c81-ec14-4d47-bd95-aeb994ccf344 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.200269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1e9ac7dd-6c56-4976-9192-3c80f9ca1a24 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:42.207696 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1e9ac7dd-6c56-4976-9192-3c80f9ca1a24 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.528212 Jul 20 04:11:42.208202 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 227/448] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:42.322249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-090b3eb6-b7aa-48ac-b061-a2410dc2c527 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:42.322249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-090b3eb6-b7aa-48ac-b061-a2410dc2c527 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:42.328202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-090b3eb6-b7aa-48ac-b061-a2410dc2c527 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.328660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-090b3eb6-b7aa-48ac-b061-a2410dc2c527 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.329430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-090b3eb6-b7aa-48ac-b061-a2410dc2c527 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.329871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-090b3eb6-b7aa-48ac-b061-a2410dc2c527 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.486719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8bdb7c81-ec14-4d47-bd95-aeb994ccf344 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:42.495580 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8bdb7c81-ec14-4d47-bd95-aeb994ccf344 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.501108 Jul 20 04:11:42.496420 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 222/449] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:42.501040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-da9ff74c-3387-4f0b-99ec-ebd274505bbf tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:42.509617 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-da9ff74c-3387-4f0b-99ec-ebd274505bbf tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 411 microversion: 2.1 time: 0.011999 Jul 20 04:11:42.510820 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 223/450] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Jul 20 04:11:42 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 411 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:42.520665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6583b8a3-1647-4c18-ab4d-1f024c787d80 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:42.521472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6583b8a3-1647-4c18-ab4d-1f024c787d80 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:42.531785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6583b8a3-1647-4c18-ab4d-1f024c787d80 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.538937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6583b8a3-1647-4c18-ab4d-1f024c787d80 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.539810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6583b8a3-1647-4c18-ab4d-1f024c787d80 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.540249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6583b8a3-1647-4c18-ab4d-1f024c787d80 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.001681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6583b8a3-1647-4c18-ab4d-1f024c787d80 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:43.020225 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6583b8a3-1647-4c18-ab4d-1f024c787d80 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1317 microversion: 2.1 time: 0.508154 Jul 20 04:11:43.021262 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 224/451] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:42 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:43.030637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3708de24-61c4-414d-a1b1-1886d4c353e2 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:43.054990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:43.063405 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3708de24-61c4-414d-a1b1-1886d4c353e2 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 411 microversion: 2.1 time: 0.035075 Jul 20 04:11:43.067603 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 225/452] 10.222.0.20 () {58 vars in 1168 bytes} [Wed Jul 20 04:11:43 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 411 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:43.082748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6cf2df8f-5694-463c-bcda-c656dc64c34d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:43.084262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6cf2df8f-5694-463c-bcda-c656dc64c34d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:43.095674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6cf2df8f-5694-463c-bcda-c656dc64c34d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.098850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6cf2df8f-5694-463c-bcda-c656dc64c34d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.100009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6cf2df8f-5694-463c-bcda-c656dc64c34d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.100520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6cf2df8f-5694-463c-bcda-c656dc64c34d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.241350 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-090b3eb6-b7aa-48ac-b061-a2410dc2c527 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1619 microversion: 2.1 time: 1.031455 Jul 20 04:11:43.243828 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 228/453] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:42 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1619 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:43.249469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e0aac3a-64c0-4063-a394-3ecd59650060 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:43.281133 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6e0aac3a-64c0-4063-a394-3ecd59650060 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6217 microversion: 2.1 time: 0.035261 Jul 20 04:11:43.282145 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 229/454] 10.222.0.20 () {58 vars in 1168 bytes} [Wed Jul 20 04:11:43 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6217 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:43.289588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-bd3a5c66-c9a9-4bb9-90fa-279784b05598 req-ebbd0992-6aa9-4b1c-a091-b7de41c4e540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9df925-6109-4e21-a875-7d16c10d0b80", "name": "network-vif-unplugged", "status": "completed", "tag": "c7162384-17f5-4ea8-95c6-748ce045c8bb"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:43.300861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-bd3a5c66-c9a9-4bb9-90fa-279784b05598 req-ebbd0992-6aa9-4b1c-a091-b7de41c4e540 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.301495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-bd3a5c66-c9a9-4bb9-90fa-279784b05598 req-ebbd0992-6aa9-4b1c-a091-b7de41c4e540 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.317122 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-bd3a5c66-c9a9-4bb9-90fa-279784b05598 req-ebbd0992-6aa9-4b1c-a091-b7de41c4e540 service nova] Creating event network-vif-unplugged:c7162384-17f5-4ea8-95c6-748ce045c8bb for instance 2d9df925-6109-4e21-a875-7d16c10d0b80 on n-h2-764485-11 Jul 20 04:11:43.323786 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-bd3a5c66-c9a9-4bb9-90fa-279784b05598 req-ebbd0992-6aa9-4b1c-a091-b7de41c4e540 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040036 Jul 20 04:11:43.325097 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 230/455] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:43.331633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5cdc7574-83d2-4d40-8f7f-4650238e31da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:43.332795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5cdc7574-83d2-4d40-8f7f-4650238e31da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:43.344254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5cdc7574-83d2-4d40-8f7f-4650238e31da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.345065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5cdc7574-83d2-4d40-8f7f-4650238e31da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.346005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5cdc7574-83d2-4d40-8f7f-4650238e31da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.346630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5cdc7574-83d2-4d40-8f7f-4650238e31da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.970510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6cf2df8f-5694-463c-bcda-c656dc64c34d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:43.982727 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6cf2df8f-5694-463c-bcda-c656dc64c34d tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1319 microversion: 2.1 time: 0.912421 Jul 20 04:11:43.984290 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 226/456] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:43 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1319 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:43.990234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4d3591da-e9b6-47be-88c2-8bc18835e5d1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Action: 'create', calling method: .version_select at 0x7fbf9df0e1f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1455095073", "policies": ["affinity"]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:44.037207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-4d3591da-e9b6-47be-88c2-8bc18835e5d1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:44.043964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-4d3591da-e9b6-47be-88c2-8bc18835e5d1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:44.060166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:DELETE=12 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:44.125458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-4d3591da-e9b6-47be-88c2-8bc18835e5d1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:44.130927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-4d3591da-e9b6-47be-88c2-8bc18835e5d1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:44.151000 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4d3591da-e9b6-47be-88c2-8bc18835e5d1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.164196 Jul 20 04:11:44.205300 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 227/457] 10.222.0.20 () {60 vars in 1173 bytes} [Wed Jul 20 04:11:43 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:44.222271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b42f992-6f48-4de3-9f64-5e194dd71b58 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:44.282851 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7b42f992-6f48-4de3-9f64-5e194dd71b58 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6217 microversion: 2.1 time: 0.077058 Jul 20 04:11:44.294764 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 228/458] 10.222.0.20 () {58 vars in 1174 bytes} [Wed Jul 20 04:11:44 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:44.298544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5cdc7574-83d2-4d40-8f7f-4650238e31da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:44.299135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-997e477e-31ec-41f5-8f1c-9bd5b49f951d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:44.303230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-997e477e-31ec-41f5-8f1c-9bd5b49f951d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:44.310697 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5cdc7574-83d2-4d40-8f7f-4650238e31da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.983055 Jul 20 04:11:44.312268 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 231/459] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:43 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:44.327397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-325d41f0-0c3a-42c8-976b-3af8954474c8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:44.332643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-325d41f0-0c3a-42c8-976b-3af8954474c8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:44.337514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-997e477e-31ec-41f5-8f1c-9bd5b49f951d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.338322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-997e477e-31ec-41f5-8f1c-9bd5b49f951d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.339122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-997e477e-31ec-41f5-8f1c-9bd5b49f951d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.347087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-997e477e-31ec-41f5-8f1c-9bd5b49f951d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.357744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-325d41f0-0c3a-42c8-976b-3af8954474c8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.359350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-325d41f0-0c3a-42c8-976b-3af8954474c8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.361284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-325d41f0-0c3a-42c8-976b-3af8954474c8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.364518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-325d41f0-0c3a-42c8-976b-3af8954474c8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.786682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-997e477e-31ec-41f5-8f1c-9bd5b49f951d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:44.799793 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-997e477e-31ec-41f5-8f1c-9bd5b49f951d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.513865 Jul 20 04:11:44.800660 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 229/460] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:44 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:44.820003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-55411eb5-29fe-4013-88be-489bdf8971ae req-b9c1cea3-5f03-4f8c-ac4d-3823037e8c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec531648-d3ee-43c8-8fda-89ae7282e4ef", "name": "network-vif-plugged", "status": "completed", "tag": "cbfa0b20-ec79-4d11-a450-6d6c8705b3b2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:44.832668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-55411eb5-29fe-4013-88be-489bdf8971ae req-b9c1cea3-5f03-4f8c-ac4d-3823037e8c37 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.833328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-55411eb5-29fe-4013-88be-489bdf8971ae req-b9c1cea3-5f03-4f8c-ac4d-3823037e8c37 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.850673 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-55411eb5-29fe-4013-88be-489bdf8971ae req-b9c1cea3-5f03-4f8c-ac4d-3823037e8c37 service nova] Creating event network-vif-plugged:cbfa0b20-ec79-4d11-a450-6d6c8705b3b2 for instance ec531648-d3ee-43c8-8fda-89ae7282e4ef on n-h1-764485-11 Jul 20 04:11:44.858049 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-55411eb5-29fe-4013-88be-489bdf8971ae req-b9c1cea3-5f03-4f8c-ac4d-3823037e8c37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056401 Jul 20 04:11:44.868551 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 230/461] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:44.874620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5d117a93-ad54-40e1-8441-e3359fbfb815 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:44.929529 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5d117a93-ad54-40e1-8441-e3359fbfb815 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6217 microversion: 2.1 time: 0.058880 Jul 20 04:11:44.940342 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 231/462] 10.222.0.20 () {58 vars in 1172 bytes} [Wed Jul 20 04:11:44 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:44.955282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-289862429", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e6ebd214-f600-47b0-91f9-9470eb79ceff"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:45.033660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-325d41f0-0c3a-42c8-976b-3af8954474c8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:45.043940 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-325d41f0-0c3a-42c8-976b-3af8954474c8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1466 microversion: 2.1 time: 0.727079 Jul 20 04:11:45.045005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:45.048833 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 232/463] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:44 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1466 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:45.055018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7680e6c2-b881-4ef8-9b43-d803b2cca21f tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:45.082785 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7680e6c2-b881-4ef8-9b43-d803b2cca21f tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6217 microversion: 2.1 time: 0.032120 Jul 20 04:11:45.083964 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 233/464] 10.222.0.20 () {58 vars in 1168 bytes} [Wed Jul 20 04:11:45 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6217 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:45.098181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-66aec223-c559-4ab9-a261-3b89419ee8d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:45.099025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-66aec223-c559-4ab9-a261-3b89419ee8d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:45.115419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66aec223-c559-4ab9-a261-3b89419ee8d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.116145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66aec223-c559-4ab9-a261-3b89419ee8d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.118383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66aec223-c559-4ab9-a261-3b89419ee8d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.120682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66aec223-c559-4ab9-a261-3b89419ee8d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.459412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-66aec223-c559-4ab9-a261-3b89419ee8d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:45.473072 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-66aec223-c559-4ab9-a261-3b89419ee8d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1319 microversion: 2.1 time: 0.387827 Jul 20 04:11:45.484219 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 234/465] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:45 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:45.489707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7b2ad5d-3a27-4c0d-8a77-3e0bd49575e2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:45.490535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a7b2ad5d-3a27-4c0d-8a77-3e0bd49575e2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:45.501744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7b2ad5d-3a27-4c0d-8a77-3e0bd49575e2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.502475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7b2ad5d-3a27-4c0d-8a77-3e0bd49575e2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.503582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7b2ad5d-3a27-4c0d-8a77-3e0bd49575e2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.504510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7b2ad5d-3a27-4c0d-8a77-3e0bd49575e2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.534869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:45.536312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:45.536971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:45.537652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:45.538322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:45.580477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.581749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.582921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.590503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.617774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:45.627432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:45.641681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Going to run 2 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:45.645084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 92c61a93-0178-4e36-b9c0-75758c21dd7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:45.692585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119807) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 20 04:11:45.725831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:45.730683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:45.771860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a7b2ad5d-3a27-4c0d-8a77-3e0bd49575e2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:45.780540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a7b2ad5d-3a27-4c0d-8a77-3e0bd49575e2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1317 microversion: 2.1 time: 0.294955 Jul 20 04:11:45.789967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:45.790767 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 235/466] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:45 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:45.795078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:45.797438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0486493e-2793-4284-aaaf-9660828c6e56 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:45.798469 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:45.798469 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:45.816121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=92c61a93-0178-4e36-b9c0-75758c21dd7d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:45.817441 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0486493e-2793-4284-aaaf-9660828c6e56 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1550260839" status: 202 len: 0 microversion: 2.1 time: 0.024082 Jul 20 04:11:45.818338 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 236/467] 10.222.0.20 () {58 vars in 1160 bytes} [Wed Jul 20 04:11:45 2022] DELETE /compute/v2.1/flavors/1550260839 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:45.828558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6d09b7a9-1f2a-45dc-8e77-36cf1169e715 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:45.829046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6d09b7a9-1f2a-45dc-8e77-36cf1169e715 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:45.838369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d09b7a9-1f2a-45dc-8e77-36cf1169e715 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.839475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d09b7a9-1f2a-45dc-8e77-36cf1169e715 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.840669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d09b7a9-1f2a-45dc-8e77-36cf1169e715 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.841264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d09b7a9-1f2a-45dc-8e77-36cf1169e715 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.880959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:45.885646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:46.002749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:46.015854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:46.099601 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bb007827-4148-44a2-9203-03967e649f36 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.157548 Jul 20 04:11:46.101603 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 232/468] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:44 2022] POST /compute/v2.1/servers => generated 32 bytes in 1160 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:11:46.107374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8580cc2b-7cea-4d4a-b95e-8907e98baec3 req-b54beaf5-a21a-4d18-8395-18a2d7fdeee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b57d94-7c6b-48e4-863b-5f03e1657a4a", "tag": "6e11e98f-90ad-425a-87e3-389a7d2b47fb"}, {"name": "network-changed", "server_uuid": "2d9df925-6109-4e21-a875-7d16c10d0b80", "tag": "c7162384-17f5-4ea8-95c6-748ce045c8bb"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:46.118191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8580cc2b-7cea-4d4a-b95e-8907e98baec3 req-b54beaf5-a21a-4d18-8395-18a2d7fdeee9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.119939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8580cc2b-7cea-4d4a-b95e-8907e98baec3 req-b54beaf5-a21a-4d18-8395-18a2d7fdeee9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.137152 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8580cc2b-7cea-4d4a-b95e-8907e98baec3 req-b54beaf5-a21a-4d18-8395-18a2d7fdeee9 service nova] Creating event network-changed:6e11e98f-90ad-425a-87e3-389a7d2b47fb for instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a on n-h1-764485-11 Jul 20 04:11:46.137907 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8580cc2b-7cea-4d4a-b95e-8907e98baec3 req-b54beaf5-a21a-4d18-8395-18a2d7fdeee9 service nova] Creating event network-changed:c7162384-17f5-4ea8-95c6-748ce045c8bb for instance 2d9df925-6109-4e21-a875-7d16c10d0b80 on n-h2-764485-11 Jul 20 04:11:46.148494 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8580cc2b-7cea-4d4a-b95e-8907e98baec3 req-b54beaf5-a21a-4d18-8395-18a2d7fdeee9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045234 Jul 20 04:11:46.149698 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 233/469] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:46.158883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e8670716-18ee-4379-8ec6-91b2e14313b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.159853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e8670716-18ee-4379-8ec6-91b2e14313b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:46.163219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:46.169446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8670716-18ee-4379-8ec6-91b2e14313b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.170299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8670716-18ee-4379-8ec6-91b2e14313b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.174341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8670716-18ee-4379-8ec6-91b2e14313b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.175125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8670716-18ee-4379-8ec6-91b2e14313b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.182811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6d09b7a9-1f2a-45dc-8e77-36cf1169e715 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:46.199736 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6d09b7a9-1f2a-45dc-8e77-36cf1169e715 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.375072 Jul 20 04:11:46.218709 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 237/470] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:45 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:46.232888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9b084dea-4ee2-4337-af34-b2b68dc3dc45 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.281169 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9b084dea-4ee2-4337-af34-b2b68dc3dc45 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.061187 Jul 20 04:11:46.291558 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 238/471] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:46.291558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9786a43a-cbc7-49bf-80d3-73fd430ba67f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.292566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9786a43a-cbc7-49bf-80d3-73fd430ba67f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:46.293385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9786a43a-cbc7-49bf-80d3-73fd430ba67f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Searching by: {'deleted': False, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:11:46.316604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9786a43a-cbc7-49bf-80d3-73fd430ba67f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.317063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9786a43a-cbc7-49bf-80d3-73fd430ba67f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.317872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9786a43a-cbc7-49bf-80d3-73fd430ba67f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.318443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9786a43a-cbc7-49bf-80d3-73fd430ba67f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.435192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e8670716-18ee-4379-8ec6-91b2e14313b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:46.452228 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e8670716-18ee-4379-8ec6-91b2e14313b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.293668 Jul 20 04:11:46.453779 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 234/472] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:46.460155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86dcf05c-e83f-49b5-8257-9d395dee1bab tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.461442 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:46.461442 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:46.492100 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-86dcf05c-e83f-49b5-8257-9d395dee1bab tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/44236251" status: 202 len: 0 microversion: 2.1 time: 0.035582 Jul 20 04:11:46.498104 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 235/473] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:11:46 2022] DELETE /compute/v2.1/flavors/44236251 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:46.511147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cdcd1160-150c-493b-b1aa-cc18d2bca3ca tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.513952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cdcd1160-150c-493b-b1aa-cc18d2bca3ca tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:46.527215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdcd1160-150c-493b-b1aa-cc18d2bca3ca tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.529694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdcd1160-150c-493b-b1aa-cc18d2bca3ca tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.530540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdcd1160-150c-493b-b1aa-cc18d2bca3ca tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.530988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdcd1160-150c-493b-b1aa-cc18d2bca3ca tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.582859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-9786a43a-cbc7-49bf-80d3-73fd430ba67f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:11:46.736088 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9786a43a-cbc7-49bf-80d3-73fd430ba67f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.449946 Jul 20 04:11:46.737215 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 239/474] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/servers => generated 1001 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:46.763128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd18e1d0-1197-4ee0-b706-e22a4f4e7225 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.826104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cdcd1160-150c-493b-b1aa-cc18d2bca3ca tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:46.830794 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dd18e1d0-1197-4ee0-b706-e22a4f4e7225 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.088897 Jul 20 04:11:46.832700 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 240/475] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:46.845912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2e1f507a-e0da-4761-a060-1a81b0e16a4c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.845912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2e1f507a-e0da-4761-a060-1a81b0e16a4c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:46.847988 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cdcd1160-150c-493b-b1aa-cc18d2bca3ca tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1319 microversion: 2.1 time: 0.348686 Jul 20 04:11:46.848581 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 236/476] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:46.853413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1556eab9-f669-40c2-bea1-f215a29e99c0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.854184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1556eab9-f669-40c2-bea1-f215a29e99c0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:46.860094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=86,nova_api:INSERT=5 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:46.867929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1556eab9-f669-40c2-bea1-f215a29e99c0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.870892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1556eab9-f669-40c2-bea1-f215a29e99c0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.875262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1556eab9-f669-40c2-bea1-f215a29e99c0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.876691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1556eab9-f669-40c2-bea1-f215a29e99c0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.988585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:47.127203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2e1f507a-e0da-4761-a060-1a81b0e16a4c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:47.136637 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2e1f507a-e0da-4761-a060-1a81b0e16a4c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1218 microversion: 2.1 time: 0.299272 Jul 20 04:11:47.138847 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 241/477] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1218 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:47.144559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5bc67acf-70bf-49f4-bb85-0ddee8175fcf tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-644051531", "id": 769561712, "os-flavor-access:is_public": "False"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:47.146327 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:47.146327 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:47.186540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5bc67acf-70bf-49f4-bb85-0ddee8175fcf tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.043801 Jul 20 04:11:47.187569 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 242/478] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:47 2022] POST /compute/v2.1/flavors => generated 411 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:47.201232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-090981e2-7abb-4613-ace1-328ccc1bced8 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.232864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1556eab9-f669-40c2-bea1-f215a29e99c0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:47.245560 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-090981e2-7abb-4613-ace1-328ccc1bced8 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.050559 Jul 20 04:11:47.248109 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 243/479] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:47 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:47.248950 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1556eab9-f669-40c2-bea1-f215a29e99c0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1317 microversion: 2.1 time: 0.394835 Jul 20 04:11:47.249788 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 237/480] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:47.263761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6a4f0a66-908a-423b-9cb8-9f5bd67e603c tempest-FlavorsAdminTestJSON-142965633 tempest-FlavorsAdminTestJSON-142965633-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.266984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-27569345-09a0-4217-9eb5-97dff535f9d6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.267742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-27569345-09a0-4217-9eb5-97dff535f9d6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:47.281618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27569345-09a0-4217-9eb5-97dff535f9d6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.285907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27569345-09a0-4217-9eb5-97dff535f9d6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.288944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27569345-09a0-4217-9eb5-97dff535f9d6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.289396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27569345-09a0-4217-9eb5-97dff535f9d6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.312263 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6a4f0a66-908a-423b-9cb8-9f5bd67e603c tempest-FlavorsAdminTestJSON-142965633 tempest-FlavorsAdminTestJSON-142965633-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.053461 Jul 20 04:11:47.324203 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 238/481] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:47 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:47.329720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9798049a-b602-4e53-a88b-e61bd1d9b875 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.330835 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:47.330835 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:47.361176 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9798049a-b602-4e53-a88b-e61bd1d9b875 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/769561712" status: 202 len: 0 microversion: 2.1 time: 0.034969 Jul 20 04:11:47.362244 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 239/482] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:11:47 2022] DELETE /compute/v2.1/flavors/769561712 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:47.379449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1a4c5b88-4e9c-4d10-aa5c-e0e37d51dfbc tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.434174 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1a4c5b88-4e9c-4d10-aa5c-e0e37d51dfbc tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.065527 Jul 20 04:11:47.446369 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 240/483] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:47 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:47.451816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7f4f82f9-615a-49be-9d52-1478734ed139 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1289431471", "id": 826228794, "os-flavor-access:is_public": "True"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:47.453341 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:47.453341 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:47.481560 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7f4f82f9-615a-49be-9d52-1478734ed139 tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.034012 Jul 20 04:11:47.490322 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 241/484] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:47 2022] POST /compute/v2.1/flavors => generated 411 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:47.496538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0cce0668-2e1d-4495-afc0-3c57561818af tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.497722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0cce0668-2e1d-4495-afc0-3c57561818af tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:47.509050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0cce0668-2e1d-4495-afc0-3c57561818af tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.515746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-27569345-09a0-4217-9eb5-97dff535f9d6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:47.516378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0cce0668-2e1d-4495-afc0-3c57561818af tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.517371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0cce0668-2e1d-4495-afc0-3c57561818af tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.517824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0cce0668-2e1d-4495-afc0-3c57561818af tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.530255 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-27569345-09a0-4217-9eb5-97dff535f9d6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.280189 Jul 20 04:11:47.535202 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 244/485] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:47 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:47.545210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-878835fb-9e1a-421b-8017-a50eb6e3a7cb tempest-FlavorsAdminTestJSON-142965633 tempest-FlavorsAdminTestJSON-142965633-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.575343 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-878835fb-9e1a-421b-8017-a50eb6e3a7cb tempest-FlavorsAdminTestJSON-142965633 tempest-FlavorsAdminTestJSON-142965633-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6215 microversion: 2.1 time: 0.032670 Jul 20 04:11:47.578365 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 245/486] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:47 2022] GET /compute/v2.1/flavors/detail => generated 6215 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:47.599049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9d072d35-285c-4d03-84b0-5356d6579edc tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.605370 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:47.605370 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:47.650761 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9d072d35-285c-4d03-84b0-5356d6579edc tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/826228794" status: 202 len: 0 microversion: 2.1 time: 0.061641 Jul 20 04:11:47.657291 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 246/487] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:11:47 2022] DELETE /compute/v2.1/flavors/826228794 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:11:47.669465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7521e7e5-8122-4bf0-83f1-98954955a24e tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.721195 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7521e7e5-8122-4bf0-83f1-98954955a24e tempest-FlavorsAdminTestJSON-1573359710 tempest-FlavorsAdminTestJSON-1573359710-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.059490 Jul 20 04:11:47.722404 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 247/488] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:47 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:47.860775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0cce0668-2e1d-4495-afc0-3c57561818af tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:47.865711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-06121ea9-6d40-4244-af96-442d51587ff1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.866402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-06121ea9-6d40-4244-af96-442d51587ff1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:47.871241 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0cce0668-2e1d-4495-afc0-3c57561818af tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.379368 Jul 20 04:11:47.872096 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 242/489] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:47 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:47.881180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06121ea9-6d40-4244-af96-442d51587ff1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.881180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06121ea9-6d40-4244-af96-442d51587ff1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.881180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06121ea9-6d40-4244-af96-442d51587ff1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.881180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06121ea9-6d40-4244-af96-442d51587ff1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.159205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dd57ffb5-b5ac-4474-8305-57c25e8943ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:48.159854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dd57ffb5-b5ac-4474-8305-57c25e8943ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:48.173867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd57ffb5-b5ac-4474-8305-57c25e8943ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.174531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd57ffb5-b5ac-4474-8305-57c25e8943ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.178426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd57ffb5-b5ac-4474-8305-57c25e8943ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.178874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd57ffb5-b5ac-4474-8305-57c25e8943ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.205815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-06121ea9-6d40-4244-af96-442d51587ff1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:48.215536 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-06121ea9-6d40-4244-af96-442d51587ff1 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1319 microversion: 2.1 time: 0.354343 Jul 20 04:11:48.225742 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 248/490] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:47 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:48.268455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5401617e-706b-40b0-9eed-66aebd5bd950 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:48.269310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5401617e-706b-40b0-9eed-66aebd5bd950 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:48.282227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5401617e-706b-40b0-9eed-66aebd5bd950 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.285491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5401617e-706b-40b0-9eed-66aebd5bd950 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.293621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5401617e-706b-40b0-9eed-66aebd5bd950 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.294452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5401617e-706b-40b0-9eed-66aebd5bd950 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.347755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dd57ffb5-b5ac-4474-8305-57c25e8943ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:48.357386 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dd57ffb5-b5ac-4474-8305-57c25e8943ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1214 microversion: 2.1 time: 0.205777 Jul 20 04:11:48.357971 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 243/491] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:48 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:48.541310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5401617e-706b-40b0-9eed-66aebd5bd950 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:48.545114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:48.552852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b95bf006-9064-422c-ac4f-f540450f5c1b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:48.553530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b95bf006-9064-422c-ac4f-f540450f5c1b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:48.554939 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5401617e-706b-40b0-9eed-66aebd5bd950 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1317 microversion: 2.1 time: 0.292030 Jul 20 04:11:48.561464 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 249/492] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:48 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:48.587115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b95bf006-9064-422c-ac4f-f540450f5c1b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.587593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b95bf006-9064-422c-ac4f-f540450f5c1b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.588987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b95bf006-9064-422c-ac4f-f540450f5c1b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.589423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b95bf006-9064-422c-ac4f-f540450f5c1b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.888761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-11798e1c-b874-4bcc-83eb-cc997e193504 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:48.889367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-11798e1c-b874-4bcc-83eb-cc997e193504 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:48.905143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b95bf006-9064-422c-ac4f-f540450f5c1b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:48.909997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11798e1c-b874-4bcc-83eb-cc997e193504 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.912356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11798e1c-b874-4bcc-83eb-cc997e193504 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.913358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11798e1c-b874-4bcc-83eb-cc997e193504 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:48.916441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11798e1c-b874-4bcc-83eb-cc997e193504 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.923139 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b95bf006-9064-422c-ac4f-f540450f5c1b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.374388 Jul 20 04:11:48.923853 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 244/493] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:48 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:49.234545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-03fa4aed-0fcf-4197-b4b2-e59b69d2a932 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:49.235075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-03fa4aed-0fcf-4197-b4b2-e59b69d2a932 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:49.251552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03fa4aed-0fcf-4197-b4b2-e59b69d2a932 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.252297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03fa4aed-0fcf-4197-b4b2-e59b69d2a932 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.253241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03fa4aed-0fcf-4197-b4b2-e59b69d2a932 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.253851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03fa4aed-0fcf-4197-b4b2-e59b69d2a932 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.359392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-11798e1c-b874-4bcc-83eb-cc997e193504 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:49.368883 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-11798e1c-b874-4bcc-83eb-cc997e193504 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.484015 Jul 20 04:11:49.385671 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 250/494] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:48 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:49.400041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b7c28f91-f968-4e3a-96ef-525a60eca0ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:49.402372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b7c28f91-f968-4e3a-96ef-525a60eca0ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:49.414221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7c28f91-f968-4e3a-96ef-525a60eca0ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.418588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7c28f91-f968-4e3a-96ef-525a60eca0ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.419673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7c28f91-f968-4e3a-96ef-525a60eca0ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.425591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7c28f91-f968-4e3a-96ef-525a60eca0ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.639233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b7c28f91-f968-4e3a-96ef-525a60eca0ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:49.652313 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b7c28f91-f968-4e3a-96ef-525a60eca0ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1278 microversion: 2.1 time: 0.265039 Jul 20 04:11:49.653948 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 251/495] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:49 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1278 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:49.658891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-40263536-2c0b-4515-be96-eb9385f7cba8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:49.659874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40263536-2c0b-4515-be96-eb9385f7cba8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:49.667819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40263536-2c0b-4515-be96-eb9385f7cba8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.668571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40263536-2c0b-4515-be96-eb9385f7cba8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.669547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40263536-2c0b-4515-be96-eb9385f7cba8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.670206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40263536-2c0b-4515-be96-eb9385f7cba8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.036164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-03fa4aed-0fcf-4197-b4b2-e59b69d2a932 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:50.058201 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-03fa4aed-0fcf-4197-b4b2-e59b69d2a932 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1319 microversion: 2.1 time: 0.827006 Jul 20 04:11:50.067467 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 245/496] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:49 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1319 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:50.067467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-66064206-4af8-4148-b2f2-963eec838da6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:50.067467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-66064206-4af8-4148-b2f2-963eec838da6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:50.079307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66064206-4af8-4148-b2f2-963eec838da6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.080620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66064206-4af8-4148-b2f2-963eec838da6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.083297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66064206-4af8-4148-b2f2-963eec838da6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.084270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66064206-4af8-4148-b2f2-963eec838da6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.302070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-40263536-2c0b-4515-be96-eb9385f7cba8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:50.315099 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-40263536-2c0b-4515-be96-eb9385f7cba8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1466 microversion: 2.1 time: 0.659718 Jul 20 04:11:50.327915 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 252/497] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:49 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1466 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:50.335815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b56ecc36-7af5-4b24-99ea-2c3e85b93cf5 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-248319125"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:50.339002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b56ecc36-7af5-4b24-99ea-2c3e85b93cf5 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:50.347128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b56ecc36-7af5-4b24-99ea-2c3e85b93cf5 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.348146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b56ecc36-7af5-4b24-99ea-2c3e85b93cf5 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.349363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b56ecc36-7af5-4b24-99ea-2c3e85b93cf5 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.349806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b56ecc36-7af5-4b24-99ea-2c3e85b93cf5 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.656850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-66064206-4af8-4148-b2f2-963eec838da6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:50.670716 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-66064206-4af8-4148-b2f2-963eec838da6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.610838 Jul 20 04:11:50.676647 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 246/498] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:50 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:50.688882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e3ddf74e-690d-4411-a044-c41d1ef6e7fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:50.690133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e3ddf74e-690d-4411-a044-c41d1ef6e7fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:50.711228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3ddf74e-690d-4411-a044-c41d1ef6e7fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.711768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3ddf74e-690d-4411-a044-c41d1ef6e7fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.712884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3ddf74e-690d-4411-a044-c41d1ef6e7fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.713454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3ddf74e-690d-4411-a044-c41d1ef6e7fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.745789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:50.876538 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b56ecc36-7af5-4b24-99ea-2c3e85b93cf5 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "POST /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef/action" status: 202 len: 0 microversion: 2.1 time: 0.545752 Jul 20 04:11:50.877226 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 253/499] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:11:50 2022] POST /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:11:50.894028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cdde769e-5b95-4003-8b10-9b6242f87959 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:50.895601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cdde769e-5b95-4003-8b10-9b6242f87959 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:50.926612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cdde769e-5b95-4003-8b10-9b6242f87959 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.927240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cdde769e-5b95-4003-8b10-9b6242f87959 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.930096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cdde769e-5b95-4003-8b10-9b6242f87959 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.932228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cdde769e-5b95-4003-8b10-9b6242f87959 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.508156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cdde769e-5b95-4003-8b10-9b6242f87959 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:51.516941 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cdde769e-5b95-4003-8b10-9b6242f87959 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1276 microversion: 2.1 time: 0.634012 Jul 20 04:11:51.526646 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 254/500] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:50 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1276 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:51.533477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e0b4a2d-c880-46a0-81d4-ec1baa18c457 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc4aa60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:51.593678 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6e0b4a2d-c880-46a0-81d4-ec1baa18c457 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.073081 Jul 20 04:11:51.600286 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 255/501] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:51 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:51.606903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a3ba6e1e-f887-4a85-946b-ab6424884049 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:51.607546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a3ba6e1e-f887-4a85-946b-ab6424884049 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:51.620427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3ba6e1e-f887-4a85-946b-ab6424884049 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.624736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3ba6e1e-f887-4a85-946b-ab6424884049 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.625256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3ba6e1e-f887-4a85-946b-ab6424884049 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.625648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3ba6e1e-f887-4a85-946b-ab6424884049 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.643178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e3ddf74e-690d-4411-a044-c41d1ef6e7fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:51.660925 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e3ddf74e-690d-4411-a044-c41d1ef6e7fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.978220 Jul 20 04:11:51.661835 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 247/502] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:50 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:51.696338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5bfa03dd-0522-4026-81b1-5d73b94bbed4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:51.704252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5bfa03dd-0522-4026-81b1-5d73b94bbed4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:51.720419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5bfa03dd-0522-4026-81b1-5d73b94bbed4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.721513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5bfa03dd-0522-4026-81b1-5d73b94bbed4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.722582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5bfa03dd-0522-4026-81b1-5d73b94bbed4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.723183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5bfa03dd-0522-4026-81b1-5d73b94bbed4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.094615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a3ba6e1e-f887-4a85-946b-ab6424884049 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:52.102689 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a3ba6e1e-f887-4a85-946b-ab6424884049 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1319 microversion: 2.1 time: 0.501007 Jul 20 04:11:52.103296 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 256/503] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:51 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:52.168086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5bfa03dd-0522-4026-81b1-5d73b94bbed4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:52.176976 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5bfa03dd-0522-4026-81b1-5d73b94bbed4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.485408 Jul 20 04:11:52.183851 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 248/504] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:51 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:52.539819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-618f9b68-7c18-486a-98f4-77c87a69856f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:52.541163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-618f9b68-7c18-486a-98f4-77c87a69856f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:52.559637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-618f9b68-7c18-486a-98f4-77c87a69856f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.560187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-618f9b68-7c18-486a-98f4-77c87a69856f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.561820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-618f9b68-7c18-486a-98f4-77c87a69856f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.562263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-618f9b68-7c18-486a-98f4-77c87a69856f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.606634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-809eb97c-6649-47b2-a85b-33cf32664103 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dae59d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:52.741092 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-809eb97c-6649-47b2-a85b-33cf32664103 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.138944 Jul 20 04:11:52.742045 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 249/505] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:52 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:52.746910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4940cd13-6dd1-44ee-92b0-3e359dd67693 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:52.747869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4940cd13-6dd1-44ee-92b0-3e359dd67693 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:52.762198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4940cd13-6dd1-44ee-92b0-3e359dd67693 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.763049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4940cd13-6dd1-44ee-92b0-3e359dd67693 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.764045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4940cd13-6dd1-44ee-92b0-3e359dd67693 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.764785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4940cd13-6dd1-44ee-92b0-3e359dd67693 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.129320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-618f9b68-7c18-486a-98f4-77c87a69856f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:53.141096 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-618f9b68-7c18-486a-98f4-77c87a69856f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1318 microversion: 2.1 time: 0.610327 Jul 20 04:11:53.143576 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 257/506] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:52 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1318 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:53.158948 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a24fef87-5a11-4750-b4dd-05774c85fc8f tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:53.164609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a24fef87-5a11-4750-b4dd-05774c85fc8f tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:53.187664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a24fef87-5a11-4750-b4dd-05774c85fc8f tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.188353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a24fef87-5a11-4750-b4dd-05774c85fc8f tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.191256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a24fef87-5a11-4750-b4dd-05774c85fc8f tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.194033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a24fef87-5a11-4750-b4dd-05774c85fc8f tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.293229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4940cd13-6dd1-44ee-92b0-3e359dd67693 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:53.308789 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4940cd13-6dd1-44ee-92b0-3e359dd67693 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.565574 Jul 20 04:11:53.309674 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 250/507] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:52 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:53.314366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e2d60529-2878-452d-b384-49d1a7fe09fc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:53.317798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e2d60529-2878-452d-b384-49d1a7fe09fc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:53.337420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2d60529-2878-452d-b384-49d1a7fe09fc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.338157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2d60529-2878-452d-b384-49d1a7fe09fc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.338982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2d60529-2878-452d-b384-49d1a7fe09fc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.339414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2d60529-2878-452d-b384-49d1a7fe09fc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.470174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a24fef87-5a11-4750-b4dd-05774c85fc8f tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:53.481649 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a24fef87-5a11-4750-b4dd-05774c85fc8f tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1319 microversion: 2.1 time: 0.332414 Jul 20 04:11:53.483677 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 258/508] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:53 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:53.660789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e2d60529-2878-452d-b384-49d1a7fe09fc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:53.670337 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e2d60529-2878-452d-b384-49d1a7fe09fc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.359496 Jul 20 04:11:53.670921 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 251/509] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:53 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:53.755421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fe11b31b-b2d8-459d-80ad-b1065f95d9e2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dcb2160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:53.844999 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fe11b31b-b2d8-459d-80ad-b1065f95d9e2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.094621 Jul 20 04:11:53.845592 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 259/510] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:53 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:54.143838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0278d00b-9295-43ad-92a9-66ffc4b8cc68 req-34bd9251-ad53-4e04-8de8-4bc364e356b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd494779-1291-4cff-bc89-8d50a706d908", "tag": "865eb090-05a9-425e-9621-afb331576722"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:54.161358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a2d10af3-38da-45ee-8e74-427e8d63fa7c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:54.161978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a2d10af3-38da-45ee-8e74-427e8d63fa7c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:54.176643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0278d00b-9295-43ad-92a9-66ffc4b8cc68 req-34bd9251-ad53-4e04-8de8-4bc364e356b5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.176643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0278d00b-9295-43ad-92a9-66ffc4b8cc68 req-34bd9251-ad53-4e04-8de8-4bc364e356b5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.179408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2d10af3-38da-45ee-8e74-427e8d63fa7c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.180055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2d10af3-38da-45ee-8e74-427e8d63fa7c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.180780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2d10af3-38da-45ee-8e74-427e8d63fa7c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.181535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2d10af3-38da-45ee-8e74-427e8d63fa7c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.221387 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0278d00b-9295-43ad-92a9-66ffc4b8cc68 req-34bd9251-ad53-4e04-8de8-4bc364e356b5 service nova] Creating event network-changed:865eb090-05a9-425e-9621-afb331576722 for instance dd494779-1291-4cff-bc89-8d50a706d908 on n-h2-764485-11 Jul 20 04:11:54.229109 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0278d00b-9295-43ad-92a9-66ffc4b8cc68 req-34bd9251-ad53-4e04-8de8-4bc364e356b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088336 Jul 20 04:11:54.238201 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 252/511] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:54.327195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ffc841b9-0a01-44d2-881b-8d457b40f2bb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:54.328626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ffc841b9-0a01-44d2-881b-8d457b40f2bb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:54.343568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffc841b9-0a01-44d2-881b-8d457b40f2bb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.344044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffc841b9-0a01-44d2-881b-8d457b40f2bb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.344888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffc841b9-0a01-44d2-881b-8d457b40f2bb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.345262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffc841b9-0a01-44d2-881b-8d457b40f2bb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.580872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a2d10af3-38da-45ee-8e74-427e8d63fa7c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:54.589848 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a2d10af3-38da-45ee-8e74-427e8d63fa7c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1318 microversion: 2.1 time: 0.432664 Jul 20 04:11:54.597739 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 260/512] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:54 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:54.602914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-582161b7-4738-41d7-84fa-d185174d6c5f req-60d47ceb-f1a7-4307-8b82-0ce46a52dcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9df925-6109-4e21-a875-7d16c10d0b80", "name": "network-vif-unplugged", "status": "completed", "tag": "c7162384-17f5-4ea8-95c6-748ce045c8bb"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:54.623073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-582161b7-4738-41d7-84fa-d185174d6c5f req-60d47ceb-f1a7-4307-8b82-0ce46a52dcb9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.623871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-582161b7-4738-41d7-84fa-d185174d6c5f req-60d47ceb-f1a7-4307-8b82-0ce46a52dcb9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.642456 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-582161b7-4738-41d7-84fa-d185174d6c5f req-60d47ceb-f1a7-4307-8b82-0ce46a52dcb9 service nova] Creating event network-vif-unplugged:c7162384-17f5-4ea8-95c6-748ce045c8bb for instance 2d9df925-6109-4e21-a875-7d16c10d0b80 on n-h2-764485-11 Jul 20 04:11:54.664082 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-582161b7-4738-41d7-84fa-d185174d6c5f req-60d47ceb-f1a7-4307-8b82-0ce46a52dcb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064395 Jul 20 04:11:54.667726 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 261/513] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:54.677262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f01e063f-39d6-4801-b38d-52815218be93 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:54.678209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f01e063f-39d6-4801-b38d-52815218be93 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:54.684975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f01e063f-39d6-4801-b38d-52815218be93 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.685634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f01e063f-39d6-4801-b38d-52815218be93 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.686569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f01e063f-39d6-4801-b38d-52815218be93 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.687358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f01e063f-39d6-4801-b38d-52815218be93 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.785478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ffc841b9-0a01-44d2-881b-8d457b40f2bb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:54.796257 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ffc841b9-0a01-44d2-881b-8d457b40f2bb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.473219 Jul 20 04:11:54.800748 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 253/514] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:54 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:55.020270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d5c0b212-feea-48ea-8983-24594cee9609 tempest-FlavorMetadataValidation-84271120 tempest-FlavorMetadataValidation-84271120-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1422486889", "id": 564864990, "os-flavor-access:is_public": "True"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:55.025866 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:55.025866 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:55.068170 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d5c0b212-feea-48ea-8983-24594cee9609 tempest-FlavorMetadataValidation-84271120 tempest-FlavorMetadataValidation-84271120-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.266159 Jul 20 04:11:55.079013 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 254/515] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:11:54 2022] POST /compute/v2.1/flavors => generated 468 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:11:55.086690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1686c591-262a-4c97-a424-11204ba8e022 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:55.089238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1686c591-262a-4c97-a424-11204ba8e022 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:55.097260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1686c591-262a-4c97-a424-11204ba8e022 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.098058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1686c591-262a-4c97-a424-11204ba8e022 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.100057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1686c591-262a-4c97-a424-11204ba8e022 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.100751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1686c591-262a-4c97-a424-11204ba8e022 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.163843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f01e063f-39d6-4801-b38d-52815218be93 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:55.178434 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f01e063f-39d6-4801-b38d-52815218be93 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1319 microversion: 2.1 time: 0.509207 Jul 20 04:11:55.191553 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 262/516] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:54 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:55.218181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fcfe7436-9091-4907-bfcd-1a35b96568dd tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9db129d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:55.272953 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fcfe7436-9091-4907-bfcd-1a35b96568dd tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.062347 Jul 20 04:11:55.273854 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 263/517] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:55 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:55.287323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-057a243d-a7fe-46a5-9c6a-87a3a7e81b5b tempest-FlavorMetadataValidation-84271120 tempest-FlavorMetadataValidation-84271120-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:55.289596 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:55.289596 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:11:55.435081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1686c591-262a-4c97-a424-11204ba8e022 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:55.455035 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1686c591-262a-4c97-a424-11204ba8e022 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.364811 Jul 20 04:11:55.457300 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 255/518] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:55 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:55.473616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-71547668-e1de-4934-9448-e648a771e98a req-df322e81-4539-4d09-abc4-f923b01cfef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b57d94-7c6b-48e4-863b-5f03e1657a4a", "name": "network-vif-plugged", "status": "completed", "tag": "6e11e98f-90ad-425a-87e3-389a7d2b47fb"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:55.496877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-71547668-e1de-4934-9448-e648a771e98a req-df322e81-4539-4d09-abc4-f923b01cfef2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.498336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-71547668-e1de-4934-9448-e648a771e98a req-df322e81-4539-4d09-abc4-f923b01cfef2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.522766 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-71547668-e1de-4934-9448-e648a771e98a req-df322e81-4539-4d09-abc4-f923b01cfef2 service nova] Creating event network-vif-plugged:6e11e98f-90ad-425a-87e3-389a7d2b47fb for instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a on n-h1-764485-11 Jul 20 04:11:55.536858 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-71547668-e1de-4934-9448-e648a771e98a req-df322e81-4539-4d09-abc4-f923b01cfef2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076259 Jul 20 04:11:55.538121 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 256/519] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:55.594986 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-057a243d-a7fe-46a5-9c6a-87a3a7e81b5b tempest-FlavorMetadataValidation-84271120 tempest-FlavorMetadataValidation-84271120-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/564864990/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.319945 Jul 20 04:11:55.596223 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 264/520] 10.222.0.20 () {62 vars in 1261 bytes} [Wed Jul 20 04:11:55 2022] POST /compute/v2.1/flavors/564864990/os-extra_specs => generated 62 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:55.612295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-81572c1e-c457-447c-8527-9abf6c1f34c4 tempest-FlavorMetadataValidation-84271120 tempest-FlavorMetadataValidation-84271120-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:55.613816 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:55.613816 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:11:55.618338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b2708e5-e38f-4a89-b6ab-a04b426831de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:55.624176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5b2708e5-e38f-4a89-b6ab-a04b426831de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:55.638190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:55.647971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b2708e5-e38f-4a89-b6ab-a04b426831de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.649353 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-81572c1e-c457-447c-8527-9abf6c1f34c4 tempest-FlavorMetadataValidation-84271120 tempest-FlavorMetadataValidation-84271120-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/564864990" status: 202 len: 0 microversion: 2.86 time: 0.043931 Jul 20 04:11:55.656488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b2708e5-e38f-4a89-b6ab-a04b426831de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.661406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b2708e5-e38f-4a89-b6ab-a04b426831de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.665053 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 257/521] 10.222.0.20 () {60 vars in 1198 bytes} [Wed Jul 20 04:11:55 2022] DELETE /compute/v2.1/flavors/564864990 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:55.667475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b2708e5-e38f-4a89-b6ab-a04b426831de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.673806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee915274-5984-4be1-ac73-95e93f2e504b tempest-FlavorMetadataValidation-84271120 tempest-FlavorMetadataValidation-84271120-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:55.709482 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ee915274-5984-4be1-ac73-95e93f2e504b tempest-FlavorMetadataValidation-84271120 tempest-FlavorMetadataValidation-84271120-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6678 microversion: 2.86 time: 0.042063 Jul 20 04:11:55.727642 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 258/522] 10.222.0.20 () {60 vars in 1186 bytes} [Wed Jul 20 04:11:55 2022] GET /compute/v2.1/flavors/detail => generated 6678 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:55.816703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ec8cc028-9d8d-4ce2-a2fd-6039f8b7dc81 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:55.817426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ec8cc028-9d8d-4ce2-a2fd-6039f8b7dc81 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:55.825503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec8cc028-9d8d-4ce2-a2fd-6039f8b7dc81 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.830979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec8cc028-9d8d-4ce2-a2fd-6039f8b7dc81 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.831845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec8cc028-9d8d-4ce2-a2fd-6039f8b7dc81 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.832527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec8cc028-9d8d-4ce2-a2fd-6039f8b7dc81 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.044069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=30 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:56.105493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ec8cc028-9d8d-4ce2-a2fd-6039f8b7dc81 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:56.109317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b2708e5-e38f-4a89-b6ab-a04b426831de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:56.118134 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5b2708e5-e38f-4a89-b6ab-a04b426831de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1318 microversion: 2.1 time: 0.507564 Jul 20 04:11:56.119112 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 265/523] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:55 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:56.119652 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ec8cc028-9d8d-4ce2-a2fd-6039f8b7dc81 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.305776 Jul 20 04:11:56.130749 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 259/524] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:55 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:56.210425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3befdf0b-8d79-4685-9b80-01b9496c4066 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:56.211080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3befdf0b-8d79-4685-9b80-01b9496c4066 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:56.220648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3befdf0b-8d79-4685-9b80-01b9496c4066 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:56.221097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3befdf0b-8d79-4685-9b80-01b9496c4066 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.221878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3befdf0b-8d79-4685-9b80-01b9496c4066 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:56.222352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3befdf0b-8d79-4685-9b80-01b9496c4066 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.286926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-38ceef3d-dbc1-40e2-9128-1d359dea1c08 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9db229d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:56.348475 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-38ceef3d-dbc1-40e2-9128-1d359dea1c08 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.065788 Jul 20 04:11:56.357315 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 260/525] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:56 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:56.457313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:56.474025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3befdf0b-8d79-4685-9b80-01b9496c4066 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:56.479624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ffe43d6-d6fc-4f01-a4b0-8aafe60c2140 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:56.481449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ffe43d6-d6fc-4f01-a4b0-8aafe60c2140 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:56.487972 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3befdf0b-8d79-4685-9b80-01b9496c4066 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1319 microversion: 2.1 time: 0.283264 Jul 20 04:11:56.492347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ffe43d6-d6fc-4f01-a4b0-8aafe60c2140 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:56.493190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ffe43d6-d6fc-4f01-a4b0-8aafe60c2140 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.495577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ffe43d6-d6fc-4f01-a4b0-8aafe60c2140 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:56.496390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ffe43d6-d6fc-4f01-a4b0-8aafe60c2140 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.501641 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 266/526] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:56 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:56.782516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-746f9376-a756-4277-a72f-be140751d764 req-0dd14781-8f75-4c20-8dda-2f97b0d97fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c61a93-0178-4e36-b9c0-75758c21dd7d", "tag": "23615810-0088-4804-b907-e616d9612905"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:56.799168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-746f9376-a756-4277-a72f-be140751d764 req-0dd14781-8f75-4c20-8dda-2f97b0d97fe9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:56.799908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-746f9376-a756-4277-a72f-be140751d764 req-0dd14781-8f75-4c20-8dda-2f97b0d97fe9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.817864 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-746f9376-a756-4277-a72f-be140751d764 req-0dd14781-8f75-4c20-8dda-2f97b0d97fe9 service nova] Creating event network-changed:23615810-0088-4804-b907-e616d9612905 for instance 92c61a93-0178-4e36-b9c0-75758c21dd7d on n-h2-764485-11 Jul 20 04:11:56.836665 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-746f9376-a756-4277-a72f-be140751d764 req-0dd14781-8f75-4c20-8dda-2f97b0d97fe9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057906 Jul 20 04:11:56.838707 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 267/527] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:56.907279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ffe43d6-d6fc-4f01-a4b0-8aafe60c2140 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:56.930632 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ffe43d6-d6fc-4f01-a4b0-8aafe60c2140 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.457846 Jul 20 04:11:56.933427 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 261/528] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:56 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:57.143373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8725e3ed-bbec-4d1d-8588-6b2fe3bf6522 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:57.144364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe1fdd4b-df46-41ae-b606-36da8ee8cc4b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:57.145715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8725e3ed-bbec-4d1d-8588-6b2fe3bf6522 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:57.146202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe1fdd4b-df46-41ae-b606-36da8ee8cc4b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:57.161609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:57.164739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe1fdd4b-df46-41ae-b606-36da8ee8cc4b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.167291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8725e3ed-bbec-4d1d-8588-6b2fe3bf6522 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.167960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe1fdd4b-df46-41ae-b606-36da8ee8cc4b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.169827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe1fdd4b-df46-41ae-b606-36da8ee8cc4b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.170404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8725e3ed-bbec-4d1d-8588-6b2fe3bf6522 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.171391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8725e3ed-bbec-4d1d-8588-6b2fe3bf6522 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.172020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe1fdd4b-df46-41ae-b606-36da8ee8cc4b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.174562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8725e3ed-bbec-4d1d-8588-6b2fe3bf6522 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.537420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe1fdd4b-df46-41ae-b606-36da8ee8cc4b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.550632 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe1fdd4b-df46-41ae-b606-36da8ee8cc4b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.418147 Jul 20 04:11:57.550931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8725e3ed-bbec-4d1d-8588-6b2fe3bf6522 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.560827 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 262/529] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:57 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:57.562360 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8725e3ed-bbec-4d1d-8588-6b2fe3bf6522 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1318 microversion: 2.1 time: 0.425501 Jul 20 04:11:57.563541 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 268/530] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:57 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:57.565672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-265f3b3b-50b3-4144-a18b-910e4b64dea0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da98b80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:57.568746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c64472a-baa6-490b-ba56-2544be11f21c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:57.569550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8c64472a-baa6-490b-ba56-2544be11f21c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:57.579667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c64472a-baa6-490b-ba56-2544be11f21c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.580605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c64472a-baa6-490b-ba56-2544be11f21c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.582019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c64472a-baa6-490b-ba56-2544be11f21c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.589478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c64472a-baa6-490b-ba56-2544be11f21c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.619340 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-265f3b3b-50b3-4144-a18b-910e4b64dea0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.057102 Jul 20 04:11:57.620581 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 263/531] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:57 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:57.783165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8c64472a-baa6-490b-ba56-2544be11f21c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.794899 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8c64472a-baa6-490b-ba56-2544be11f21c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1319 microversion: 2.1 time: 0.230095 Jul 20 04:11:57.796348 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 269/532] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:57 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:57.953174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ddf8764e-f9c5-4a96-a2cd-b3f033204b12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:57.954497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ddf8764e-f9c5-4a96-a2cd-b3f033204b12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:57.976326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddf8764e-f9c5-4a96-a2cd-b3f033204b12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.976687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddf8764e-f9c5-4a96-a2cd-b3f033204b12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.980478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddf8764e-f9c5-4a96-a2cd-b3f033204b12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.981082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddf8764e-f9c5-4a96-a2cd-b3f033204b12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.268153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ddf8764e-f9c5-4a96-a2cd-b3f033204b12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:58.283012 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ddf8764e-f9c5-4a96-a2cd-b3f033204b12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.336760 Jul 20 04:11:58.284005 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 264/533] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:57 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:58.580408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0f43e24a-aba2-4900-be83-e889e247b19c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:58.580983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0f43e24a-aba2-4900-be83-e889e247b19c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:58.581790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3aae24bd-ef9f-418d-a632-7507933458e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:58.582365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3aae24bd-ef9f-418d-a632-7507933458e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:58.616113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3aae24bd-ef9f-418d-a632-7507933458e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.616722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f43e24a-aba2-4900-be83-e889e247b19c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.617323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3aae24bd-ef9f-418d-a632-7507933458e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.618122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3aae24bd-ef9f-418d-a632-7507933458e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.618324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f43e24a-aba2-4900-be83-e889e247b19c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.621263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f43e24a-aba2-4900-be83-e889e247b19c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.622609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3aae24bd-ef9f-418d-a632-7507933458e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.624281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f43e24a-aba2-4900-be83-e889e247b19c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.709629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:59.046151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3aae24bd-ef9f-418d-a632-7507933458e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:59.064535 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3aae24bd-ef9f-418d-a632-7507933458e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1318 microversion: 2.1 time: 0.489581 Jul 20 04:11:59.065924 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 265/534] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:58 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:59.070384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-254e654b-dfe6-4f56-a39c-24dc8a891eb6 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc8d040>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:59.094165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0f43e24a-aba2-4900-be83-e889e247b19c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:59.104734 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0f43e24a-aba2-4900-be83-e889e247b19c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.540118 Jul 20 04:11:59.105342 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 270/535] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:58 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:59.121975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f068f1e1-28a6-4c2f-b510-22ce8ed84e21 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:59.122599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f068f1e1-28a6-4c2f-b510-22ce8ed84e21 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:59.146221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f068f1e1-28a6-4c2f-b510-22ce8ed84e21 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.146681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f068f1e1-28a6-4c2f-b510-22ce8ed84e21 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.147463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f068f1e1-28a6-4c2f-b510-22ce8ed84e21 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.150011 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-254e654b-dfe6-4f56-a39c-24dc8a891eb6 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.082981 Jul 20 04:11:59.152609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f068f1e1-28a6-4c2f-b510-22ce8ed84e21 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.158466 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 266/536] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:59 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:59.169253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b5a221c5-6889-41b5-aef9-26f07113137f req-2ca48183-2ace-4b67-8628-83a6993377e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec531648-d3ee-43c8-8fda-89ae7282e4ef", "name": "network-vif-plugged", "status": "completed", "tag": "cbfa0b20-ec79-4d11-a450-6d6c8705b3b2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:59.179642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b5a221c5-6889-41b5-aef9-26f07113137f req-2ca48183-2ace-4b67-8628-83a6993377e3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.180086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b5a221c5-6889-41b5-aef9-26f07113137f req-2ca48183-2ace-4b67-8628-83a6993377e3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.224109 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b5a221c5-6889-41b5-aef9-26f07113137f req-2ca48183-2ace-4b67-8628-83a6993377e3 service nova] Creating event network-vif-plugged:cbfa0b20-ec79-4d11-a450-6d6c8705b3b2 for instance ec531648-d3ee-43c8-8fda-89ae7282e4ef on n-h1-764485-11 Jul 20 04:11:59.241633 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b5a221c5-6889-41b5-aef9-26f07113137f req-2ca48183-2ace-4b67-8628-83a6993377e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068451 Jul 20 04:11:59.242674 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 267/537] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:59.305232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5008abc4-ac9b-4dd0-982a-a48142e2028f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:59.307078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5008abc4-ac9b-4dd0-982a-a48142e2028f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:59.323479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5008abc4-ac9b-4dd0-982a-a48142e2028f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.330620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5008abc4-ac9b-4dd0-982a-a48142e2028f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.333958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5008abc4-ac9b-4dd0-982a-a48142e2028f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.334943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5008abc4-ac9b-4dd0-982a-a48142e2028f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.614696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f068f1e1-28a6-4c2f-b510-22ce8ed84e21 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:59.642031 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f068f1e1-28a6-4c2f-b510-22ce8ed84e21 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1469 microversion: 2.1 time: 0.523620 Jul 20 04:11:59.642720 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 271/538] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:59 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1469 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:59.660964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c5965b2-1c59-42df-8370-3f41bfca5aa6 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:59.662242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9c5965b2-1c59-42df-8370-3f41bfca5aa6 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:59.690777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c5965b2-1c59-42df-8370-3f41bfca5aa6 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.694460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c5965b2-1c59-42df-8370-3f41bfca5aa6 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.696737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c5965b2-1c59-42df-8370-3f41bfca5aa6 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.699344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c5965b2-1c59-42df-8370-3f41bfca5aa6 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.815708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-9c5965b2-1c59-42df-8370-3f41bfca5aa6 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lazy-loading 'flavor' on Instance uuid 42b57d94-7c6b-48e4-863b-5f03e1657a4a {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:00.050299 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c5965b2-1c59-42df-8370-3f41bfca5aa6 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a/action" status: 202 len: 0 microversion: 2.1 time: 0.392344 Jul 20 04:12:00.058431 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 272/539] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:11:59 2022] POST /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:12:00.067099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d94ee3ea-1a15-4038-82d3-1868df6b5883 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:00.068046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d94ee3ea-1a15-4038-82d3-1868df6b5883 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:00.076837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d94ee3ea-1a15-4038-82d3-1868df6b5883 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.077742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d94ee3ea-1a15-4038-82d3-1868df6b5883 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.079129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d94ee3ea-1a15-4038-82d3-1868df6b5883 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.079968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d94ee3ea-1a15-4038-82d3-1868df6b5883 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.243130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5008abc4-ac9b-4dd0-982a-a48142e2028f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:00.253975 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5008abc4-ac9b-4dd0-982a-a48142e2028f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.956485 Jul 20 04:12:00.269197 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 268/540] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:59 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:00.274142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ae57a6fc-20d1-4b33-8043-8e4f851b04b2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:00.276062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ae57a6fc-20d1-4b33-8043-8e4f851b04b2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:00.314842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae57a6fc-20d1-4b33-8043-8e4f851b04b2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.316220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae57a6fc-20d1-4b33-8043-8e4f851b04b2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.316220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae57a6fc-20d1-4b33-8043-8e4f851b04b2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.316506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae57a6fc-20d1-4b33-8043-8e4f851b04b2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.558217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d94ee3ea-1a15-4038-82d3-1868df6b5883 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:00.568357 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d94ee3ea-1a15-4038-82d3-1868df6b5883 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1477 microversion: 2.1 time: 0.507429 Jul 20 04:12:00.569303 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 273/541] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:00 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1477 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:00.576296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04a8d9fc-f688-4db8-9418-338e4e2a6787 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:00.576922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-04a8d9fc-f688-4db8-9418-338e4e2a6787 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:00.600663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04a8d9fc-f688-4db8-9418-338e4e2a6787 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.607588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04a8d9fc-f688-4db8-9418-338e4e2a6787 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.607588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04a8d9fc-f688-4db8-9418-338e4e2a6787 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.607588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04a8d9fc-f688-4db8-9418-338e4e2a6787 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.702708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ae57a6fc-20d1-4b33-8043-8e4f851b04b2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:00.720312 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ae57a6fc-20d1-4b33-8043-8e4f851b04b2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1318 microversion: 2.1 time: 0.449861 Jul 20 04:12:00.721195 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 269/542] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:00 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:00.725806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e436ab4a-5f3b-4194-a66d-6563578218cf tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da829d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:00.840973 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e436ab4a-5f3b-4194-a66d-6563578218cf tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.118560 Jul 20 04:12:00.850912 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 270/543] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:00 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:00.890500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-04a8d9fc-f688-4db8-9418-338e4e2a6787 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:00.902221 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-04a8d9fc-f688-4db8-9418-338e4e2a6787 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1504 microversion: 2.1 time: 0.331816 Jul 20 04:12:00.902968 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 274/544] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:00 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:01.199535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-84110d4e-d9e1-49c9-ad10-c53affaaba89 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1648323000", "ram": 512, "vcpus": 1, "disk": 10, "id": 1946381673, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:01.201314 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:01.201314 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:12:01.226648 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-84110d4e-d9e1-49c9-ad10-c53affaaba89 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.215723 Jul 20 04:12:01.227246 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 271/545] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:01 2022] POST /compute/v2.1/flavors => generated 416 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:12:01.241124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0200015e-68f5-49e7-b797-1156479ac3ca tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:01.243086 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:01.243086 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:01.284287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-136f1e47-5493-4b2d-bd41-a6be4647ff52 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:01.285852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-136f1e47-5493-4b2d-bd41-a6be4647ff52 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:01.322183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-136f1e47-5493-4b2d-bd41-a6be4647ff52 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.322985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-136f1e47-5493-4b2d-bd41-a6be4647ff52 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.324368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-136f1e47-5493-4b2d-bd41-a6be4647ff52 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.325017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-136f1e47-5493-4b2d-bd41-a6be4647ff52 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.329219 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0200015e-68f5-49e7-b797-1156479ac3ca tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1946381673/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.089947 Jul 20 04:12:01.334393 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 275/546] 10.222.0.20 () {60 vars in 1223 bytes} [Wed Jul 20 04:12:01 2022] POST /compute/v2.1/flavors/1946381673/os-extra_specs => generated 66 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:01.529399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0d817310-51e7-454f-9b31-771ef17297d8 tempest-FlavorsExtraSpecsTestJSON-1692542511 tempest-FlavorsExtraSpecsTestJSON-1692542511-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:01.558843 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0d817310-51e7-454f-9b31-771ef17297d8 tempest-FlavorsExtraSpecsTestJSON-1692542511 tempest-FlavorsExtraSpecsTestJSON-1692542511-project] 10.222.0.20 "GET /compute/v2.1/flavors/1946381673/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.221773 Jul 20 04:12:01.560346 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 276/547] 10.222.0.20 () {58 vars in 1202 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/flavors/1946381673/os-extra_specs => generated 66 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:01.571613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-60982071-80b4-4759-9f4f-df53eb4bf878 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:01.606415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:01.617414 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-60982071-80b4-4759-9f4f-df53eb4bf878 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1946381673/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.049369 Jul 20 04:12:01.619267 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 277/548] 10.222.0.20 () {60 vars in 1223 bytes} [Wed Jul 20 04:12:01 2022] POST /compute/v2.1/flavors/1946381673/os-extra_specs => generated 66 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:01.638266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c53a1695-6165-4326-a340-ec88aeadb372 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:01.639482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c53a1695-6165-4326-a340-ec88aeadb372 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:01.648015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c53a1695-6165-4326-a340-ec88aeadb372 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.648908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c53a1695-6165-4326-a340-ec88aeadb372 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.650776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c53a1695-6165-4326-a340-ec88aeadb372 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.651419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c53a1695-6165-4326-a340-ec88aeadb372 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.657310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-136f1e47-5493-4b2d-bd41-a6be4647ff52 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:01.668464 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-136f1e47-5493-4b2d-bd41-a6be4647ff52 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.394759 Jul 20 04:12:01.680419 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 272/549] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:01.686856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a3fa2bee-5fa9-44ea-bd17-8ae6a2ddc072 tempest-FlavorsExtraSpecsTestJSON-1692542511 tempest-FlavorsExtraSpecsTestJSON-1692542511-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:01.723698 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a3fa2bee-5fa9-44ea-bd17-8ae6a2ddc072 tempest-FlavorsExtraSpecsTestJSON-1692542511 tempest-FlavorsExtraSpecsTestJSON-1692542511-project] 10.222.0.20 "GET /compute/v2.1/flavors/1946381673/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.041170 Jul 20 04:12:01.727752 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 273/550] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/flavors/1946381673/os-extra_specs/hw:numa_nodes => generated 22 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:01.739980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8d261461-59c0-498e-98af-ece959d30b52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:01.741520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8d261461-59c0-498e-98af-ece959d30b52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:01.754911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d261461-59c0-498e-98af-ece959d30b52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.755876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d261461-59c0-498e-98af-ece959d30b52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.756879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d261461-59c0-498e-98af-ece959d30b52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.757510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d261461-59c0-498e-98af-ece959d30b52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.917164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c53a1695-6165-4326-a340-ec88aeadb372 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:01.927449 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c53a1695-6165-4326-a340-ec88aeadb372 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1460 microversion: 2.1 time: 0.306686 Jul 20 04:12:01.935184 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 278/551] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1460 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:01.940497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15e8fc33-d59c-46ea-a38d-c636525c0983 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:01.942171 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:01.942171 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:01.984641 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-15e8fc33-d59c-46ea-a38d-c636525c0983 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1946381673/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047869 Jul 20 04:12:01.990900 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 279/552] 10.222.0.20 () {60 vars in 1223 bytes} [Wed Jul 20 04:12:01 2022] POST /compute/v2.1/flavors/1946381673/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:02.002968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8d261461-59c0-498e-98af-ece959d30b52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:02.004996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9629e38b-7117-4201-9374-5e1534dbebd4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc4d550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.024473 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8d261461-59c0-498e-98af-ece959d30b52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1318 microversion: 2.1 time: 0.290023 Jul 20 04:12:02.029702 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 274/553] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:02.035703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cf8ec23d-3da6-4fb5-8d8e-6aa74ba9b503 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.036666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cf8ec23d-3da6-4fb5-8d8e-6aa74ba9b503 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:02.047986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf8ec23d-3da6-4fb5-8d8e-6aa74ba9b503 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.050542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf8ec23d-3da6-4fb5-8d8e-6aa74ba9b503 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.051648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf8ec23d-3da6-4fb5-8d8e-6aa74ba9b503 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.052194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf8ec23d-3da6-4fb5-8d8e-6aa74ba9b503 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.075594 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9629e38b-7117-4201-9374-5e1534dbebd4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.083084 Jul 20 04:12:02.082565 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 280/554] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:02.088266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cec25783-68af-400a-ae66-73f8a739b35e tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.089399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cec25783-68af-400a-ae66-73f8a739b35e tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:02.108460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cec25783-68af-400a-ae66-73f8a739b35e tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.109228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cec25783-68af-400a-ae66-73f8a739b35e tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.127997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cec25783-68af-400a-ae66-73f8a739b35e tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.128826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cec25783-68af-400a-ae66-73f8a739b35e tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.326262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf8ec23d-3da6-4fb5-8d8e-6aa74ba9b503 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:02.337426 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cf8ec23d-3da6-4fb5-8d8e-6aa74ba9b503 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1494 microversion: 2.1 time: 0.306245 Jul 20 04:12:02.345629 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 275/555] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:02 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1494 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:02.362346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee3b32d7-674c-4f2e-95ff-4cd49341205d tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.386169 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ee3b32d7-674c-4f2e-95ff-4cd49341205d tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1946381673/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035313 Jul 20 04:12:02.387749 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 276/556] 10.222.0.20 () {58 vars in 1202 bytes} [Wed Jul 20 04:12:02 2022] GET /compute/v2.1/flavors/1946381673/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:02.402339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-5d5ad746-f0d3-4131-8113-5e736d5a5a66 req-6013166e-d7f9-4de2-920f-3e6bd78349b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd494779-1291-4cff-bc89-8d50a706d908", "name": "network-vif-plugged", "status": "completed", "tag": "865eb090-05a9-425e-9621-afb331576722"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:02.423484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5d5ad746-f0d3-4131-8113-5e736d5a5a66 req-6013166e-d7f9-4de2-920f-3e6bd78349b7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.424031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5d5ad746-f0d3-4131-8113-5e736d5a5a66 req-6013166e-d7f9-4de2-920f-3e6bd78349b7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.433221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:02.448696 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-5d5ad746-f0d3-4131-8113-5e736d5a5a66 req-6013166e-d7f9-4de2-920f-3e6bd78349b7 service nova] Creating event network-vif-plugged:865eb090-05a9-425e-9621-afb331576722 for instance dd494779-1291-4cff-bc89-8d50a706d908 on n-h2-764485-11 Jul 20 04:12:02.460537 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-5d5ad746-f0d3-4131-8113-5e736d5a5a66 req-6013166e-d7f9-4de2-920f-3e6bd78349b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068134 Jul 20 04:12:02.462514 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 277/557] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:02.469006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33a70d61-41ee-441f-9832-062855b37e0b tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '.version_select at 0x7fbf9db225e0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.479057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33a70d61-41ee-441f-9832-062855b37e0b tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.481625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33a70d61-41ee-441f-9832-062855b37e0b tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.553721 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cec25783-68af-400a-ae66-73f8a739b35e tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1613 microversion: 2.1 time: 0.469988 Jul 20 04:12:02.554327 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 281/558] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:02 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1613 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:02.566720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-82c6326e-c0ed-4359-aa9d-fece8f10ed2d tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:02.568448 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:02.568448 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:02.572096 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-33a70d61-41ee-441f-9832-062855b37e0b tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 799 microversion: 2.1 time: 0.107583 Jul 20 04:12:02.581771 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 278/559] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:12:02 2022] GET /compute/v2.1/os-migrations => generated 799 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:02.602453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0524c1f6-51ea-48fd-a0e7-2fd25f6a5371 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.606338 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:02.606338 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:12:02.613187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0524c1f6-51ea-48fd-a0e7-2fd25f6a5371 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.617948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0524c1f6-51ea-48fd-a0e7-2fd25f6a5371 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.623904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0524c1f6-51ea-48fd-a0e7-2fd25f6a5371 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.624489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0524c1f6-51ea-48fd-a0e7-2fd25f6a5371 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.643557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=9,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:02.661555 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0524c1f6-51ea-48fd-a0e7-2fd25f6a5371 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.084556 Jul 20 04:12:02.662205 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 279/560] 10.222.0.20 () {58 vars in 1175 bytes} [Wed Jul 20 04:12:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:02.668719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ba9317e8-2e89-4257-bca3-763370cc8256 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.668935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ba9317e8-2e89-4257-bca3-763370cc8256 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:02.672276 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-82c6326e-c0ed-4359-aa9d-fece8f10ed2d tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1946381673/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.113007 Jul 20 04:12:02.673448 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 282/561] 10.222.0.20 () {60 vars in 1264 bytes} [Wed Jul 20 04:12:02 2022] PUT /compute/v2.1/flavors/1946381673/os-extra_specs/hw:numa_nodes => generated 22 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:02.677428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba9317e8-2e89-4257-bca3-763370cc8256 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.677878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba9317e8-2e89-4257-bca3-763370cc8256 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.678650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba9317e8-2e89-4257-bca3-763370cc8256 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.679083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba9317e8-2e89-4257-bca3-763370cc8256 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.687910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d846d372-11fe-4c64-b349-5ffa41b6a734 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-764485-11", "block_migration": true, "disk_over_commit": false}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:02.689859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d846d372-11fe-4c64-b349-5ffa41b6a734 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:02.703279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d846d372-11fe-4c64-b349-5ffa41b6a734 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.704072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d846d372-11fe-4c64-b349-5ffa41b6a734 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.705100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d846d372-11fe-4c64-b349-5ffa41b6a734 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.705759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d846d372-11fe-4c64-b349-5ffa41b6a734 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.775422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-d846d372-11fe-4c64-b349-5ffa41b6a734 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Lazy-loading 'flavor' on Instance uuid 42b57d94-7c6b-48e4-863b-5f03e1657a4a {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:02.796323 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-d846d372-11fe-4c64-b349-5ffa41b6a734 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a while it is in vm_state suspended Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d846d372-11fe-4c64-b349-5ffa41b6a734 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Request method failure captured: Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a/action HTTP/1.1 Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 98 Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BejMNysIVCWGEtpeWhhGSldZyhTCJaduCPX8TYE5RLYg58ejZS9lk7_5PlYD9PReUuy3IwtHx17l1n7qzmrc5XJqBGYhggNZe8jXCSaO5SaUH3UPlPi1quvUQwfV2_SZitlCsHKrZS0wK0a1TX3JsrtcuvHd0tChFFwfk1K7sdZIY Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: f123f18fd9b44f1a8585fe82d72a1581 Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-LiveMigrationNegativeTest-661888177 Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:12:02.798330 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:12:02.799691 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f123f18fd9b44f1a8585fe82d72a1581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f123f18fd9b44f1a8585fe82d72a1581"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f123f18fd9b44f1a8585fe82d72a1581", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f123f18fd9b44f1a8585fe82d72a1581"}]}] Jul 20 04:12:02.799691 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-LiveMigrationNegativeTest-661888177 Jul 20 04:12:02.799691 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: f123f18fd9b44f1a8585fe82d72a1581 Jul 20 04:12:02.799691 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-661888177 Jul 20 04:12:02.799691 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-LiveMigrationNegativeTest-661888177-project-admin Jul 20 04:12:02.799691 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:12:02.799691 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:12:02.799691 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3f951fb77288470ba7cdc65c1259c129 Jul 20 04:12:02.799691 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-LiveMigrationNegativeTest-661888177-project-admin Jul 20 04:12:02.799691 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:12:02.799691 n-d-764485-11 devstack@n-api.service[119808]: {"os-migrateLive": {"host": "n-h2-764485-11", "block_migration": true, "disk_over_commit": false}} Jul 20 04:12:02.799691 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: exception: Cannot 'os-migrateLive' instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a while it is in vm_state suspended Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '42b57d94-7c6b-48e4-863b-5f03e1657a4a', 'body': {'os-migrateLive': {'host': 'n-h2-764485-11', 'block_migration': True, 'disk_over_commit': False}}} Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 04:12:02.800513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:02.801569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a while it is in vm_state suspended Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a while it is in vm_state suspended Jul 20 04:12:02.802751 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:02.803791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d846d372-11fe-4c64-b349-5ffa41b6a734 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a while it is in vm_state suspended {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:02.803791 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d846d372-11fe-4c64-b349-5ffa41b6a734 tempest-LiveMigrationNegativeTest-661888177 tempest-LiveMigrationNegativeTest-661888177-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a/action" status: 409 len: 155 microversion: 2.1 time: 0.124805 Jul 20 04:12:02.803791 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 283/562] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:02 2022] POST /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a/action => generated 155 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:12:02.812719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-59933cc7-7d73-48ad-943d-72584a3a0449 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.824723 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-59933cc7-7d73-48ad-943d-72584a3a0449 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1946381673/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022275 Jul 20 04:12:02.826308 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 284/563] 10.222.0.20 () {58 vars in 1202 bytes} [Wed Jul 20 04:12:02 2022] GET /compute/v2.1/flavors/1946381673/os-extra_specs => generated 66 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:02.831430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a77574d3-e3de-4bd5-ad20-2f14d052f344 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.832713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a77574d3-e3de-4bd5-ad20-2f14d052f344 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:02.842439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a77574d3-e3de-4bd5-ad20-2f14d052f344 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.843258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a77574d3-e3de-4bd5-ad20-2f14d052f344 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.844089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a77574d3-e3de-4bd5-ad20-2f14d052f344 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.844529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a77574d3-e3de-4bd5-ad20-2f14d052f344 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:03.070499 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ba9317e8-2e89-4257-bca3-763370cc8256 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1647 microversion: 2.1 time: 0.407197 Jul 20 04:12:03.080302 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 280/564] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:02 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1647 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:03.094412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-15ad3cf6-9521-4828-ac6f-d91ca75f389e tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:03.095293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-15ad3cf6-9521-4828-ac6f-d91ca75f389e tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:03.117846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15ad3cf6-9521-4828-ac6f-d91ca75f389e tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:03.121570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15ad3cf6-9521-4828-ac6f-d91ca75f389e tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:03.123639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15ad3cf6-9521-4828-ac6f-d91ca75f389e tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:03.124309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15ad3cf6-9521-4828-ac6f-d91ca75f389e tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:03.177649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-15ad3cf6-9521-4828-ac6f-d91ca75f389e tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:12:03.294747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a77574d3-e3de-4bd5-ad20-2f14d052f344 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:03.304935 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a77574d3-e3de-4bd5-ad20-2f14d052f344 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1477 microversion: 2.1 time: 0.477381 Jul 20 04:12:03.306180 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 285/565] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:02 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1477 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:03.330615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3d5cb531-5155-415d-81cd-b46e491894ee tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:03.331987 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:03.331987 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:03.380496 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-15ad3cf6-9521-4828-ac6f-d91ca75f389e tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 204 len: 0 microversion: 2.1 time: 0.295363 Jul 20 04:12:03.383239 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 281/566] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:12:03 2022] DELETE /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:12:03.396468 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3d5cb531-5155-415d-81cd-b46e491894ee tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1946381673/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.074488 Jul 20 04:12:03.400035 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 286/567] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:12:03 2022] DELETE /compute/v2.1/flavors/1946381673/os-extra_specs/hw:numa_nodes => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:12:03.406441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bc0104af-9796-404a-a297-f0dde265fe26 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc4d670>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:03.408077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-186afa5c-faf0-4690-95bc-8c6dae96d310 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:03.410156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-186afa5c-faf0-4690-95bc-8c6dae96d310 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:03.429253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-186afa5c-faf0-4690-95bc-8c6dae96d310 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:03.430067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-186afa5c-faf0-4690-95bc-8c6dae96d310 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:03.431317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-186afa5c-faf0-4690-95bc-8c6dae96d310 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:03.431960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-186afa5c-faf0-4690-95bc-8c6dae96d310 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:03.495287 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bc0104af-9796-404a-a297-f0dde265fe26 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.095563 Jul 20 04:12:03.502202 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 287/568] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:03 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:03.507400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9162c517-38ff-4913-9e56-135e0451f0a7 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:03.508050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9162c517-38ff-4913-9e56-135e0451f0a7 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:03.516645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9162c517-38ff-4913-9e56-135e0451f0a7 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:03.517293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9162c517-38ff-4913-9e56-135e0451f0a7 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:03.518132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9162c517-38ff-4913-9e56-135e0451f0a7 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:03.518570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9162c517-38ff-4913-9e56-135e0451f0a7 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:03.825321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-186afa5c-faf0-4690-95bc-8c6dae96d310 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:03.843493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9162c517-38ff-4913-9e56-135e0451f0a7 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:03.843896 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-186afa5c-faf0-4690-95bc-8c6dae96d310 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1318 microversion: 2.1 time: 0.443888 Jul 20 04:12:03.844676 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 282/569] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:03 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:03.848068 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9162c517-38ff-4913-9e56-135e0451f0a7 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1466 microversion: 2.1 time: 0.344694 Jul 20 04:12:03.848660 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 288/570] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:03 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1466 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:03.853819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1857422319", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "bcbfb113-dc60-430e-be79-be98f4f2973e"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:03.877099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8dd474e3-2ede-465e-bb2c-141eb23103f9 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:03.878046 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:03.878046 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:12:03.926574 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8dd474e3-2ede-465e-bb2c-141eb23103f9 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1946381673/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.079162 Jul 20 04:12:03.930420 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 283/571] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:12:03 2022] DELETE /compute/v2.1/flavors/1946381673/os-extra_specs/hw:cpu_policy => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:12:03.943329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0bd5193e-e1d0-4bb9-9056-23342df31d2f tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:03.961611 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0bd5193e-e1d0-4bb9-9056-23342df31d2f tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1946381673/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028362 Jul 20 04:12:03.963898 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 284/572] 10.222.0.20 () {58 vars in 1202 bytes} [Wed Jul 20 04:12:03 2022] GET /compute/v2.1/flavors/1946381673/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:03.977548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] validate_networks() for [('bcbfb113-dc60-430e-be79-be98f4f2973e', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:03.978456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0466553f-7f09-4fa3-8dc6-d0f52c1537a3 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:03.979305 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:03.979305 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:12:04.004772 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0466553f-7f09-4fa3-8dc6-d0f52c1537a3 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1946381673" status: 202 len: 0 microversion: 2.1 time: 0.029748 Jul 20 04:12:04.006892 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 285/573] 10.222.0.20 () {58 vars in 1160 bytes} [Wed Jul 20 04:12:03 2022] DELETE /compute/v2.1/flavors/1946381673 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:04.017526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0c329119-360b-407f-9ba9-1e3806d0b1a6 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:04.046908 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0c329119-360b-407f-9ba9-1e3806d0b1a6 tempest-FlavorsExtraSpecsTestJSON-780577985 tempest-FlavorsExtraSpecsTestJSON-780577985-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.033308 Jul 20 04:12:04.048251 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 286/574] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:12:04 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:04.326061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-213baad0-fe31-4d4e-b86f-9ff0fa250a41 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:04.327130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-213baad0-fe31-4d4e-b86f-9ff0fa250a41 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:04.342572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-213baad0-fe31-4d4e-b86f-9ff0fa250a41 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.344164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-213baad0-fe31-4d4e-b86f-9ff0fa250a41 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:04.347245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-213baad0-fe31-4d4e-b86f-9ff0fa250a41 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.350287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-213baad0-fe31-4d4e-b86f-9ff0fa250a41 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:04.905468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-213baad0-fe31-4d4e-b86f-9ff0fa250a41 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:04.918936 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-213baad0-fe31-4d4e-b86f-9ff0fa250a41 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1476 microversion: 2.1 time: 0.597819 Jul 20 04:12:04.935785 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 287/575] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:04 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1476 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:04.941143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-fcb8766e-29dc-4d91-b18c-e36441c20a4d req-936f0e3c-87f3-42dc-b69c-377b11061636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3434c2d3-9cb3-4688-8374-91f655cb9214", "name": "network-vif-unplugged", "status": "completed", "tag": "44b6c604-ac5e-4cec-9cac-9977a72935b5"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:04.967817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fcb8766e-29dc-4d91-b18c-e36441c20a4d req-936f0e3c-87f3-42dc-b69c-377b11061636 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.968262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fcb8766e-29dc-4d91-b18c-e36441c20a4d req-936f0e3c-87f3-42dc-b69c-377b11061636 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.023076 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-fcb8766e-29dc-4d91-b18c-e36441c20a4d req-936f0e3c-87f3-42dc-b69c-377b11061636 service nova] Creating event network-vif-unplugged:44b6c604-ac5e-4cec-9cac-9977a72935b5 for instance 3434c2d3-9cb3-4688-8374-91f655cb9214 on n-h2-764485-11 Jul 20 04:12:05.097756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-fcb8766e-29dc-4d91-b18c-e36441c20a4d req-936f0e3c-87f3-42dc-b69c-377b11061636 service nova] Instance 3434c2d3-9cb3-4688-8374-91f655cb9214 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:12:05.149925 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-fcb8766e-29dc-4d91-b18c-e36441c20a4d req-936f0e3c-87f3-42dc-b69c-377b11061636 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.211747 Jul 20 04:12:05.151953 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 288/576] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:05.168939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-842ac67e-3687-4542-a24f-df013058fb7c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da6c670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:05.263400 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-842ac67e-3687-4542-a24f-df013058fb7c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.108119 Jul 20 04:12:05.264030 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 289/577] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:05 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:05.283829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bcacddde-63e8-4b21-bf7a-7a58c4e4f189 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:05.284643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bcacddde-63e8-4b21-bf7a-7a58c4e4f189 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:05.304688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bcacddde-63e8-4b21-bf7a-7a58c4e4f189 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.305144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bcacddde-63e8-4b21-bf7a-7a58c4e4f189 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.314042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bcacddde-63e8-4b21-bf7a-7a58c4e4f189 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.314702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bcacddde-63e8-4b21-bf7a-7a58c4e4f189 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.529435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:05.529987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:05.530336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:05.530754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:05.531173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:05.551759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.553906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.556346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.559047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.604585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Getting quotas for project 14ab6d1260864919b0f1b6d536fe65ae. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:05.614221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Getting quotas for user f94d458feafa4ec28c50a04fc2b2a1f4 and project 14ab6d1260864919b0f1b6d536fe65ae. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:05.642792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:05.653892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:05.761852 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4619f828-4115-4f3a-8095-bee8bbdb50d2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.912096 Jul 20 04:12:05.770272 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 289/578] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:05.778752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-97bada47-b77f-4e40-a966-fa67afc1ed1c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:05.805397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-97bada47-b77f-4e40-a966-fa67afc1ed1c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:05.821415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97bada47-b77f-4e40-a966-fa67afc1ed1c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.832134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97bada47-b77f-4e40-a966-fa67afc1ed1c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.833223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97bada47-b77f-4e40-a966-fa67afc1ed1c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.833831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97bada47-b77f-4e40-a966-fa67afc1ed1c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:06.562077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bcacddde-63e8-4b21-bf7a-7a58c4e4f189 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:06.589066 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bcacddde-63e8-4b21-bf7a-7a58c4e4f189 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1318 microversion: 2.1 time: 1.309838 Jul 20 04:12:06.592340 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 290/579] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:05 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1318 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:06.597298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3ca85583-5144-4d5a-a839-5b451ee149b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:06.619861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3ca85583-5144-4d5a-a839-5b451ee149b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:06.639141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ca85583-5144-4d5a-a839-5b451ee149b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:06.640252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ca85583-5144-4d5a-a839-5b451ee149b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:06.641280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ca85583-5144-4d5a-a839-5b451ee149b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:06.642392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ca85583-5144-4d5a-a839-5b451ee149b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:06.777664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-97bada47-b77f-4e40-a966-fa67afc1ed1c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:06.787943 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-97bada47-b77f-4e40-a966-fa67afc1ed1c tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1466 microversion: 2.1 time: 1.016249 Jul 20 04:12:06.788920 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 290/580] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:05 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1466 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:06.805855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3323b1b2-11d4-4151-84e6-556cd528c53e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:06.806476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3323b1b2-11d4-4151-84e6-556cd528c53e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:06.815571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3323b1b2-11d4-4151-84e6-556cd528c53e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:06.819824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3323b1b2-11d4-4151-84e6-556cd528c53e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:06.820675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3323b1b2-11d4-4151-84e6-556cd528c53e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:06.821124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3323b1b2-11d4-4151-84e6-556cd528c53e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.034548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3ca85583-5144-4d5a-a839-5b451ee149b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:07.070989 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3ca85583-5144-4d5a-a839-5b451ee149b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1215 microversion: 2.1 time: 0.476850 Jul 20 04:12:07.075719 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 291/581] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:06 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1215 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:07.103621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a1f8dc44-1e18-4f3e-8937-99bc428f8def tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da6c280>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:07.211528 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a1f8dc44-1e18-4f3e-8937-99bc428f8def tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.132921 Jul 20 04:12:07.215956 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 292/582] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:07 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:07.240309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-9911f344-2e25-4f39-82fa-282fbff51ecf req-32d133d7-e620-4bf9-83b9-0658dafbbe9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b57d94-7c6b-48e4-863b-5f03e1657a4a", "name": "network-vif-unplugged", "status": "completed", "tag": "6e11e98f-90ad-425a-87e3-389a7d2b47fb"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:07.250778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9911f344-2e25-4f39-82fa-282fbff51ecf req-32d133d7-e620-4bf9-83b9-0658dafbbe9e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.251558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9911f344-2e25-4f39-82fa-282fbff51ecf req-32d133d7-e620-4bf9-83b9-0658dafbbe9e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.264792 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-9911f344-2e25-4f39-82fa-282fbff51ecf req-32d133d7-e620-4bf9-83b9-0658dafbbe9e service nova] Creating event network-vif-unplugged:6e11e98f-90ad-425a-87e3-389a7d2b47fb for instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a on n-h1-764485-11 Jul 20 04:12:07.273207 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-9911f344-2e25-4f39-82fa-282fbff51ecf req-32d133d7-e620-4bf9-83b9-0658dafbbe9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051035 Jul 20 04:12:07.275609 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 293/583] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:07.615031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-72eebbf3-b5e1-4896-af61-fc7d96ac9e8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:07.615909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-72eebbf3-b5e1-4896-af61-fc7d96ac9e8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:07.635794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72eebbf3-b5e1-4896-af61-fc7d96ac9e8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.637468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72eebbf3-b5e1-4896-af61-fc7d96ac9e8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.638499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72eebbf3-b5e1-4896-af61-fc7d96ac9e8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.640643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72eebbf3-b5e1-4896-af61-fc7d96ac9e8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.916852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3323b1b2-11d4-4151-84e6-556cd528c53e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:07.936875 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3323b1b2-11d4-4151-84e6-556cd528c53e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1476 microversion: 2.1 time: 1.145197 Jul 20 04:12:07.939567 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 291/584] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:06 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1476 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:07.955312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7f42376b-4522-4480-90af-ddd313730287 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:07.959279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7f42376b-4522-4480-90af-ddd313730287 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:07.981152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f42376b-4522-4480-90af-ddd313730287 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.994964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f42376b-4522-4480-90af-ddd313730287 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.996560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f42376b-4522-4480-90af-ddd313730287 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.997855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f42376b-4522-4480-90af-ddd313730287 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:08.811192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-72eebbf3-b5e1-4896-af61-fc7d96ac9e8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:08.833092 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-72eebbf3-b5e1-4896-af61-fc7d96ac9e8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1468 microversion: 2.1 time: 1.220560 Jul 20 04:12:08.846588 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 294/585] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:07 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1468 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:08.864932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6f9746e5-2fca-4c1c-8c63-de8252d4be9f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:08.865527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6f9746e5-2fca-4c1c-8c63-de8252d4be9f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:08.888269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f9746e5-2fca-4c1c-8c63-de8252d4be9f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:08.888666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f9746e5-2fca-4c1c-8c63-de8252d4be9f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:08.889459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f9746e5-2fca-4c1c-8c63-de8252d4be9f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:08.889902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f9746e5-2fca-4c1c-8c63-de8252d4be9f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.176197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6f9746e5-2fca-4c1c-8c63-de8252d4be9f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:09.191678 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6f9746e5-2fca-4c1c-8c63-de8252d4be9f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1269 microversion: 2.1 time: 0.347486 Jul 20 04:12:09.192274 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 295/586] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:08 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1269 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:09.212423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1e3d5c2b-59aa-4dc6-af4a-56b2e788e63f tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da04e50>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:09.281230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7f42376b-4522-4480-90af-ddd313730287 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:09.299241 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7f42376b-4522-4480-90af-ddd313730287 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 200 len: 1466 microversion: 2.1 time: 1.354021 Jul 20 04:12:09.299975 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 292/587] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:07 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 1466 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:09.318403 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1e3d5c2b-59aa-4dc6-af4a-56b2e788e63f tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.125045 Jul 20 04:12:09.319478 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 296/588] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:09 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:09.328955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-697b99b5-8c2b-484b-947f-dea33ca72354 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:09.329548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-697b99b5-8c2b-484b-947f-dea33ca72354 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 92c61a93-0178-4e36-b9c0-75758c21dd7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:09.337481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4c331783-d11d-4a68-9376-338db81bf567 req-90032fb4-9d8b-45e0-9e8a-6593c4e17c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3434c2d3-9cb3-4688-8374-91f655cb9214", "tag": "44b6c604-ac5e-4cec-9cac-9977a72935b5"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:09.379046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-697b99b5-8c2b-484b-947f-dea33ca72354 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.379535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-697b99b5-8c2b-484b-947f-dea33ca72354 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.380368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-697b99b5-8c2b-484b-947f-dea33ca72354 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.380812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-697b99b5-8c2b-484b-947f-dea33ca72354 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.392524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4c331783-d11d-4a68-9376-338db81bf567 req-90032fb4-9d8b-45e0-9e8a-6593c4e17c95 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.392902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4c331783-d11d-4a68-9376-338db81bf567 req-90032fb4-9d8b-45e0-9e8a-6593c4e17c95 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.430489 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4c331783-d11d-4a68-9376-338db81bf567 req-90032fb4-9d8b-45e0-9e8a-6593c4e17c95 service nova] Creating event network-changed:44b6c604-ac5e-4cec-9cac-9977a72935b5 for instance 3434c2d3-9cb3-4688-8374-91f655cb9214 on n-h2-764485-11 Jul 20 04:12:09.484469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-4c331783-d11d-4a68-9376-338db81bf567 req-90032fb4-9d8b-45e0-9e8a-6593c4e17c95 service nova] Instance 3434c2d3-9cb3-4688-8374-91f655cb9214 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:12:09.521856 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4c331783-d11d-4a68-9376-338db81bf567 req-90032fb4-9d8b-45e0-9e8a-6593c4e17c95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205728 Jul 20 04:12:09.526160 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 293/589] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:09.547800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ad5be828-2dca-4249-b236-4a8ccc435a62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:09.548547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ad5be828-2dca-4249-b236-4a8ccc435a62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:09.582159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad5be828-2dca-4249-b236-4a8ccc435a62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.582628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad5be828-2dca-4249-b236-4a8ccc435a62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.590555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad5be828-2dca-4249-b236-4a8ccc435a62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.592953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad5be828-2dca-4249-b236-4a8ccc435a62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:10.612818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-697b99b5-8c2b-484b-947f-dea33ca72354 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:10.634117 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-697b99b5-8c2b-484b-947f-dea33ca72354 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d" status: 200 len: 1318 microversion: 2.1 time: 1.311331 Jul 20 04:12:10.637212 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 297/590] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:09 2022] GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d => generated 1318 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:10.648904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-aff6add5-3354-4572-8a60-b4afbab9af7e req-fbd89b30-fe1e-4549-a942-eac91b3d2693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c61a93-0178-4e36-b9c0-75758c21dd7d", "name": "network-vif-plugged", "status": "completed", "tag": "23615810-0088-4804-b907-e616d9612905"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:10.684726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ad5be828-2dca-4249-b236-4a8ccc435a62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:10.703601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-aff6add5-3354-4572-8a60-b4afbab9af7e req-fbd89b30-fe1e-4549-a942-eac91b3d2693 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:10.704644 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ad5be828-2dca-4249-b236-4a8ccc435a62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1476 microversion: 2.1 time: 1.176930 Jul 20 04:12:10.716078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-aff6add5-3354-4572-8a60-b4afbab9af7e req-fbd89b30-fe1e-4549-a942-eac91b3d2693 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:10.718852 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 294/591] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:09 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1476 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:10.737703 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-aff6add5-3354-4572-8a60-b4afbab9af7e req-fbd89b30-fe1e-4549-a942-eac91b3d2693 service nova] Creating event network-vif-plugged:23615810-0088-4804-b907-e616d9612905 for instance 92c61a93-0178-4e36-b9c0-75758c21dd7d on n-h2-764485-11 Jul 20 04:12:10.762029 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-aff6add5-3354-4572-8a60-b4afbab9af7e req-fbd89b30-fe1e-4549-a942-eac91b3d2693 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121202 Jul 20 04:12:10.763594 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 298/592] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:10.778146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a1f33787-e09d-41f3-9402-e10b5db74590 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:10.779054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a1f33787-e09d-41f3-9402-e10b5db74590 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:10.786348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1f33787-e09d-41f3-9402-e10b5db74590 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:10.787209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1f33787-e09d-41f3-9402-e10b5db74590 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:10.788057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1f33787-e09d-41f3-9402-e10b5db74590 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:10.788508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1f33787-e09d-41f3-9402-e10b5db74590 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.085203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be6231ff-3a41-477f-9d97-815668ed6b0a tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1381920030", "ram": 512, "vcpus": 1, "disk": 10, "id": 195047191, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:11.091423 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:11.091423 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:11.131766 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-be6231ff-3a41-477f-9d97-815668ed6b0a tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.411030 Jul 20 04:12:11.132946 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 295/593] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:10 2022] POST /compute/v2.1/flavors => generated 413 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:11.144996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4d45a774-57f8-4f49-8efb-5f24b8d5137a tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:11.146308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4d45a774-57f8-4f49-8efb-5f24b8d5137a tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 42b57d94-7c6b-48e4-863b-5f03e1657a4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:11.159332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d45a774-57f8-4f49-8efb-5f24b8d5137a tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.160331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d45a774-57f8-4f49-8efb-5f24b8d5137a tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.161953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d45a774-57f8-4f49-8efb-5f24b8d5137a tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.162621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d45a774-57f8-4f49-8efb-5f24b8d5137a tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.196847 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-4d45a774-57f8-4f49-8efb-5f24b8d5137a tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] HTTP exception thrown: Instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a could not be found. Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4d45a774-57f8-4f49-8efb-5f24b8d5137a tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Request method failure captured: Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a HTTP/1.1 Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BdPv7y8c8tw582FCR3NLOTUP-1eR6PRyfMpAS311c48XlX26LyZZcnDZ5iSxUtrDthGfuTaXzbdtUXXc2LkzauLGMrMEl_p33AdsHCrWj3N0DhULq6XWV4JQAdIVBPWSocba8RfC68k7h3pOi9zz90tsfqMPq9Vr1LNQkQH5Yvw98 Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 9624de6b85e44fac9ab44c11d6cde04b Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-LiveMigrationNegativeTest-509597051 Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:12:11.199068 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:12:11.200513 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9624de6b85e44fac9ab44c11d6cde04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9624de6b85e44fac9ab44c11d6cde04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9624de6b85e44fac9ab44c11d6cde04b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9624de6b85e44fac9ab44c11d6cde04b"}]}] Jul 20 04:12:11.200513 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-LiveMigrationNegativeTest-509597051 Jul 20 04:12:11.200513 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 9624de6b85e44fac9ab44c11d6cde04b Jul 20 04:12:11.200513 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-509597051 Jul 20 04:12:11.200513 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-LiveMigrationNegativeTest-509597051-project Jul 20 04:12:11.200513 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:12:11.200513 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:12:11.200513 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: f96042a516bf425287c5b71cc3389cf0 Jul 20 04:12:11.200513 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-LiveMigrationNegativeTest-509597051-project Jul 20 04:12:11.200513 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:12:11.200513 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a could not be found. Jul 20 04:12:11.200513 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '42b57d94-7c6b-48e4-863b-5f03e1657a4a'} Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a could not be found. Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:11.201581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a could not be found. Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a could not be found. Jul 20 04:12:11.202742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.205349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4d45a774-57f8-4f49-8efb-5f24b8d5137a tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Returning 404 to user: Instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:11.208718 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4d45a774-57f8-4f49-8efb-5f24b8d5137a tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a" status: 404 len: 111 microversion: 2.1 time: 0.073085 Jul 20 04:12:11.209914 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 296/594] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:11 2022] GET /compute/v2.1/servers/42b57d94-7c6b-48e4-863b-5f03e1657a4a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:11.216175 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c4dc0295-5647-4afd-8e87-5fee80e6998a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc4aca0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:11.269377 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c4dc0295-5647-4afd-8e87-5fee80e6998a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.058170 Jul 20 04:12:11.270359 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 297/595] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:11 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:11.371081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a1f33787-e09d-41f3-9402-e10b5db74590 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:11.382467 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a1f33787-e09d-41f3-9402-e10b5db74590 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.611645 Jul 20 04:12:11.385745 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 299/596] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:10 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:11.397640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9d106f8-f2b8-41cc-9384-eaa5c80e2661 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:11.399366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b9d106f8-f2b8-41cc-9384-eaa5c80e2661 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:11.417094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9d106f8-f2b8-41cc-9384-eaa5c80e2661 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.419268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9d106f8-f2b8-41cc-9384-eaa5c80e2661 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.422512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9d106f8-f2b8-41cc-9384-eaa5c80e2661 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.423777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9d106f8-f2b8-41cc-9384-eaa5c80e2661 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.481440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b9d106f8-f2b8-41cc-9384-eaa5c80e2661 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:12:11.501245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b2def7e7-9ac2-4089-a0bc-ec6857343c39 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:11.519147 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-b2def7e7-9ac2-4089-a0bc-ec6857343c39 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] HTTP exception thrown: Flavor 195047191 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b2def7e7-9ac2-4089-a0bc-ec6857343c39 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Request method failure captured: Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/flavors/195047191/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14CYF_2UFX9iJyokS5OZgPpwVS3v3nxYb0mdPdovK3Q_fvYGT8kLpWhHbyO1jgvApwVtuchSao84ERzcpzfgrF6B6y2Sggqb-3LKF5a1GkegkdYG1oywRMYHqsgrTzJ6jmZB1jbC2PmvB7N6IjE7r_fGZXUH2iezujX0JHkhGJDzq2Y Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 912771713a2b441e96cff702c2c8a4aa Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:12:11.521636 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:12:11.522919 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/912771713a2b441e96cff702c2c8a4aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/912771713a2b441e96cff702c2c8a4aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_912771713a2b441e96cff702c2c8a4aa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/912771713a2b441e96cff702c2c8a4aa"}]}] Jul 20 04:12:11.522919 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 Jul 20 04:12:11.522919 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 912771713a2b441e96cff702c2c8a4aa Jul 20 04:12:11.522919 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 Jul 20 04:12:11.522919 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project Jul 20 04:12:11.522919 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:12:11.522919 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:12:11.522919 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c321a59e437249e0966ae1a2cb88ff03 Jul 20 04:12:11.522919 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project Jul 20 04:12:11.522919 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:12:11.522919 n-d-764485-11 devstack@n-api.service[119808]: exception: Flavor 195047191 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'flavor_id': '195047191', 'id': 'hw:cpu_thread_policy'} Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 195047191 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:11.523657 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.526765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:11.526765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:11.526765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:11.526765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:11.526765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:11.526765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 195047191 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:12:11.526765 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.529007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b2def7e7-9ac2-4089-a0bc-ec6857343c39 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Returning 404 to user: Flavor 195047191 has no extra specs with key hw:cpu_thread_policy. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:11.530239 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b2def7e7-9ac2-4089-a0bc-ec6857343c39 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] 10.222.0.20 "GET /compute/v2.1/flavors/195047191/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.258593 Jul 20 04:12:11.531319 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 298/597] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:12:11 2022] GET /compute/v2.1/flavors/195047191/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:11.545750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8321d11c-50ee-45d7-8b52-134a3d3e22db tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:11.548190 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:11.548190 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:11.550396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8321d11c-50ee-45d7-8b52-134a3d3e22db tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'c321a59e437249e0966ae1a2cb88ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912771713a2b441e96cff702c2c8a4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8321d11c-50ee-45d7-8b52-134a3d3e22db tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Request method failure captured: Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/flavors/195047191/os-extra_specs HTTP/1.1 Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 66 Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14CYF_2UFX9iJyokS5OZgPpwVS3v3nxYb0mdPdovK3Q_fvYGT8kLpWhHbyO1jgvApwVtuchSao84ERzcpzfgrF6B6y2Sggqb-3LKF5a1GkegkdYG1oywRMYHqsgrTzJ6jmZB1jbC2PmvB7N6IjE7r_fGZXUH2iezujX0JHkhGJDzq2Y Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 912771713a2b441e96cff702c2c8a4aa Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:12:11.552332 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:12:11.553591 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/912771713a2b441e96cff702c2c8a4aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/912771713a2b441e96cff702c2c8a4aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_912771713a2b441e96cff702c2c8a4aa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/912771713a2b441e96cff702c2c8a4aa"}]}] Jul 20 04:12:11.553591 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 Jul 20 04:12:11.553591 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 912771713a2b441e96cff702c2c8a4aa Jul 20 04:12:11.553591 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 Jul 20 04:12:11.553591 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project Jul 20 04:12:11.553591 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:12:11.553591 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:12:11.553591 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c321a59e437249e0966ae1a2cb88ff03 Jul 20 04:12:11.553591 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project Jul 20 04:12:11.553591 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:12:11.553591 n-d-764485-11 devstack@n-api.service[119808]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 20 04:12:11.553591 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'flavor_id': '195047191', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:12:11.554306 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 04:12:11.555459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.559153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8321d11c-50ee-45d7-8b52-134a3d3e22db tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:11.560548 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8321d11c-50ee-45d7-8b52-134a3d3e22db tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] 10.222.0.20 "POST /compute/v2.1/flavors/195047191/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.024288 Jul 20 04:12:11.561677 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 299/598] 10.222.0.20 () {60 vars in 1220 bytes} [Wed Jul 20 04:12:11 2022] POST /compute/v2.1/flavors/195047191/os-extra_specs => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:11.574504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c5bf9ee-de83-4976-92ee-6afdf55e3aaa tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:11.622270 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c5bf9ee-de83-4976-92ee-6afdf55e3aaa tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/195047191/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055410 Jul 20 04:12:11.624164 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 300/599] 10.222.0.20 () {60 vars in 1220 bytes} [Wed Jul 20 04:12:11 2022] POST /compute/v2.1/flavors/195047191/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:11.647121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-de712d3d-9cb5-49ab-93a9-f4ef311bc2f1 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:11.653145 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:11.653145 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:11.656031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-de712d3d-9cb5-49ab-93a9-f4ef311bc2f1 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'c321a59e437249e0966ae1a2cb88ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912771713a2b441e96cff702c2c8a4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-de712d3d-9cb5-49ab-93a9-f4ef311bc2f1 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Request method failure captured: Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/flavors/195047191/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14CYF_2UFX9iJyokS5OZgPpwVS3v3nxYb0mdPdovK3Q_fvYGT8kLpWhHbyO1jgvApwVtuchSao84ERzcpzfgrF6B6y2Sggqb-3LKF5a1GkegkdYG1oywRMYHqsgrTzJ6jmZB1jbC2PmvB7N6IjE7r_fGZXUH2iezujX0JHkhGJDzq2Y Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 912771713a2b441e96cff702c2c8a4aa Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:12:11.659410 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:12:11.660854 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/912771713a2b441e96cff702c2c8a4aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/912771713a2b441e96cff702c2c8a4aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_912771713a2b441e96cff702c2c8a4aa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/912771713a2b441e96cff702c2c8a4aa"}]}] Jul 20 04:12:11.660854 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 Jul 20 04:12:11.660854 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 912771713a2b441e96cff702c2c8a4aa Jul 20 04:12:11.660854 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 Jul 20 04:12:11.660854 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project Jul 20 04:12:11.660854 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:12:11.660854 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:12:11.660854 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c321a59e437249e0966ae1a2cb88ff03 Jul 20 04:12:11.660854 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project Jul 20 04:12:11.660854 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:12:11.660854 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'flavor_id': '195047191', 'id': 'hw:numa_nodes'} Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:12:11.661513 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 04:12:11.662876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:11.665144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-de712d3d-9cb5-49ab-93a9-f4ef311bc2f1 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:11.665940 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-de712d3d-9cb5-49ab-93a9-f4ef311bc2f1 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] 10.222.0.20 "DELETE /compute/v2.1/flavors/195047191/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.034514 Jul 20 04:12:11.669116 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 301/600] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:12:11 2022] DELETE /compute/v2.1/flavors/195047191/os-extra_specs/hw:numa_nodes => generated 124 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:11.685851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3520a7e9-0315-42aa-aba7-72907a050182 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:11.691263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3520a7e9-0315-42aa-aba7-72907a050182 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 92c61a93-0178-4e36-b9c0-75758c21dd7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:11.696034 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b9d106f8-f2b8-41cc-9384-eaa5c80e2661 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 204 len: 0 microversion: 2.1 time: 0.307773 Jul 20 04:12:11.703336 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 300/601] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:12:11 2022] DELETE /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:12:11.720293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c40920b4-ecd4-4449-8b9e-cc66ec5ef1a1 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:11.721173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3520a7e9-0315-42aa-aba7-72907a050182 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.721885 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:11.721885 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:12:11.723863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3520a7e9-0315-42aa-aba7-72907a050182 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.724684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3520a7e9-0315-42aa-aba7-72907a050182 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.725135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3520a7e9-0315-42aa-aba7-72907a050182 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.756748 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c40920b4-ecd4-4449-8b9e-cc66ec5ef1a1 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/195047191/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054356 Jul 20 04:12:11.762349 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 301/602] 10.222.0.20 () {60 vars in 1220 bytes} [Wed Jul 20 04:12:11 2022] POST /compute/v2.1/flavors/195047191/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:12:11.767686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc316dee-d1f0-45c3-b6cb-99be4aadc7c3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:11.769518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc316dee-d1f0-45c3-b6cb-99be4aadc7c3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:11.784305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc316dee-d1f0-45c3-b6cb-99be4aadc7c3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.785218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc316dee-d1f0-45c3-b6cb-99be4aadc7c3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.788922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc316dee-d1f0-45c3-b6cb-99be4aadc7c3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.789561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc316dee-d1f0-45c3-b6cb-99be4aadc7c3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.793836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:11.826038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:12.180730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3520a7e9-0315-42aa-aba7-72907a050182 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:12.188132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fc316dee-d1f0-45c3-b6cb-99be4aadc7c3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:12.190501 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3520a7e9-0315-42aa-aba7-72907a050182 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d" status: 200 len: 1318 microversion: 2.1 time: 0.519113 Jul 20 04:12:12.202781 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 302/603] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:11 2022] GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:12.220119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8bbc8f0a-28c3-4b60-9f92-47e499116130 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:12.221815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8bbc8f0a-28c3-4b60-9f92-47e499116130 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:12.233744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bbc8f0a-28c3-4b60-9f92-47e499116130 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.241707 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc316dee-d1f0-45c3-b6cb-99be4aadc7c3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1475 microversion: 2.1 time: 0.460949 Jul 20 04:12:12.245889 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 302/604] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:11 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1475 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:12.248493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bbc8f0a-28c3-4b60-9f92-47e499116130 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.250816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bbc8f0a-28c3-4b60-9f92-47e499116130 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.251664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bbc8f0a-28c3-4b60-9f92-47e499116130 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.271599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08bb35bf-2264-4598-8a80-42f5781bfabe tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:12.273198 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:12.273198 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:12:12.275925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-08bb35bf-2264-4598-8a80-42f5781bfabe tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'c321a59e437249e0966ae1a2cb88ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912771713a2b441e96cff702c2c8a4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08bb35bf-2264-4598-8a80-42f5781bfabe tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Request method failure captured: Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: request: PUT /compute/v2.1/flavors/195047191/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 22 Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14CYF_2UFX9iJyokS5OZgPpwVS3v3nxYb0mdPdovK3Q_fvYGT8kLpWhHbyO1jgvApwVtuchSao84ERzcpzfgrF6B6y2Sggqb-3LKF5a1GkegkdYG1oywRMYHqsgrTzJ6jmZB1jbC2PmvB7N6IjE7r_fGZXUH2iezujX0JHkhGJDzq2Y Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 912771713a2b441e96cff702c2c8a4aa Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:12:12.281138 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/912771713a2b441e96cff702c2c8a4aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/912771713a2b441e96cff702c2c8a4aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_912771713a2b441e96cff702c2c8a4aa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/912771713a2b441e96cff702c2c8a4aa"}]}] Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 912771713a2b441e96cff702c2c8a4aa Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c321a59e437249e0966ae1a2cb88ff03 Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: {"hw:numa_nodes": "1"} Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:12:12.282542 n-d-764485-11 devstack@n-api.service[119807]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'flavor_id': '195047191', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:12:12.283299 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 04:12:12.285878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.287002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08bb35bf-2264-4598-8a80-42f5781bfabe tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:12.287002 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-08bb35bf-2264-4598-8a80-42f5781bfabe tempest-FlavorsExtraSpecsNegativeTestJSON-873912723 tempest-FlavorsExtraSpecsNegativeTestJSON-873912723-project] 10.222.0.20 "PUT /compute/v2.1/flavors/195047191/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.035666 Jul 20 04:12:12.288300 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 303/605] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:12:12 2022] PUT /compute/v2.1/flavors/195047191/os-extra_specs/hw:numa_nodes => generated 124 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:12.294684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d7ce2477-68e9-4e44-84cf-df14ba18a12d req-3168b092-4238-4845-9562-c74795c0419c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b57d94-7c6b-48e4-863b-5f03e1657a4a", "name": "network-vif-deleted", "tag": "6e11e98f-90ad-425a-87e3-389a7d2b47fb"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:12.310008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d7ce2477-68e9-4e44-84cf-df14ba18a12d req-3168b092-4238-4845-9562-c74795c0419c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.310685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d7ce2477-68e9-4e44-84cf-df14ba18a12d req-3168b092-4238-4845-9562-c74795c0419c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.333895 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d7ce2477-68e9-4e44-84cf-df14ba18a12d req-3168b092-4238-4845-9562-c74795c0419c service nova] Creating event network-vif-deleted:6e11e98f-90ad-425a-87e3-389a7d2b47fb for instance 42b57d94-7c6b-48e4-863b-5f03e1657a4a on n-h1-764485-11 Jul 20 04:12:12.343162 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d7ce2477-68e9-4e44-84cf-df14ba18a12d req-3168b092-4238-4845-9562-c74795c0419c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053182 Jul 20 04:12:12.348311 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 304/606] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:12.354586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0798a45d-c606-4503-bc06-a59d0478bf1b req-a20678cd-bd84-4827-a9a5-2a0010a62ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e603c0-187a-46e9-a4c5-da5f3d5e9170", "tag": "bd71d3a7-7615-4097-8805-ca1d231d551c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:12.363150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0798a45d-c606-4503-bc06-a59d0478bf1b req-a20678cd-bd84-4827-a9a5-2a0010a62ca8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.363859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0798a45d-c606-4503-bc06-a59d0478bf1b req-a20678cd-bd84-4827-a9a5-2a0010a62ca8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.387835 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0798a45d-c606-4503-bc06-a59d0478bf1b req-a20678cd-bd84-4827-a9a5-2a0010a62ca8 service nova] Creating event network-changed:bd71d3a7-7615-4097-8805-ca1d231d551c for instance c7e603c0-187a-46e9-a4c5-da5f3d5e9170 on n-h2-764485-11 Jul 20 04:12:12.392858 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0798a45d-c606-4503-bc06-a59d0478bf1b req-a20678cd-bd84-4827-a9a5-2a0010a62ca8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042947 Jul 20 04:12:12.393472 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 305/607] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:12.413105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a03d02f6-c78b-4143-87d3-8fe94a02549f tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da6cca0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:12.480039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8bbc8f0a-28c3-4b60-9f92-47e499116130 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:12.487551 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8bbc8f0a-28c3-4b60-9f92-47e499116130 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1474 microversion: 2.1 time: 0.275268 Jul 20 04:12:12.490381 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 303/608] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:12 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1474 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:12.492177 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a03d02f6-c78b-4143-87d3-8fe94a02549f tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.097463 Jul 20 04:12:12.493435 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 306/609] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:12 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:12.498672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2aa5234-5797-4981-bcd3-996f7c881194 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:12.499637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2aa5234-5797-4981-bcd3-996f7c881194 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:12.505653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04a834ad-09c5-4372-a574-f73de6953934 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:12.506409 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:12.506409 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:12.506849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2aa5234-5797-4981-bcd3-996f7c881194 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.507298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2aa5234-5797-4981-bcd3-996f7c881194 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.508588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2aa5234-5797-4981-bcd3-996f7c881194 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.509559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2aa5234-5797-4981-bcd3-996f7c881194 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.526712 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-04a834ad-09c5-4372-a574-f73de6953934 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] HTTP exception thrown: Flavor 195047191 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04a834ad-09c5-4372-a574-f73de6953934 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Request method failure captured: Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/flavors/195047191/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14CZfX6r_sJ-L39QbEzZgQA6tABjAuJOBkly1Mio_TXGcSyC8wOpOaBt3jGlxTJJl9f07tl34T07t16LPgY7e5dSKDbtpKG2PgxeroMb5baWiHlcZrfsQOQUhgVqzkrHdI76CeXkXyQkUtS6excmJ-v9mRvtoryNV9MCdI6Oi7paBYQ Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: cb0ad1798cf940f59f99f2b935a8f738 Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:12:12.532663 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:12:12.533965 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cb0ad1798cf940f59f99f2b935a8f738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb0ad1798cf940f59f99f2b935a8f738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cb0ad1798cf940f59f99f2b935a8f738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb0ad1798cf940f59f99f2b935a8f738"}]}] Jul 20 04:12:12.533965 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 Jul 20 04:12:12.533965 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: cb0ad1798cf940f59f99f2b935a8f738 Jul 20 04:12:12.533965 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 Jul 20 04:12:12.533965 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin Jul 20 04:12:12.533965 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:12:12.533965 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:12:12.533965 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b741e834b1b04c2593446642554f13d3 Jul 20 04:12:12.533965 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin Jul 20 04:12:12.533965 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:12:12.533965 n-d-764485-11 devstack@n-api.service[119808]: exception: Flavor 195047191 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'flavor_id': '195047191', 'id': 'hw:cpu_thread_policy'} Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 195047191 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:12.534666 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.535977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:12.535977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:12.535977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:12.535977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:12.535977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:12.535977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 195047191 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:12:12.535977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.538535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04a834ad-09c5-4372-a574-f73de6953934 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Returning 404 to user: Flavor 195047191 has no extra specs with key hw:cpu_thread_policy. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:12.539819 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-04a834ad-09c5-4372-a574-f73de6953934 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/195047191/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.048245 Jul 20 04:12:12.541674 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 304/610] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:12:12 2022] DELETE /compute/v2.1/flavors/195047191/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:12.553991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7fc744c-e58b-44fe-98f1-ca41857986b2 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:12.555355 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:12.555355 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:12.556781 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-a7fc744c-e58b-44fe-98f1-ca41857986b2 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7fc744c-e58b-44fe-98f1-ca41857986b2 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Request method failure captured: Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: request: PUT /compute/v2.1/flavors/195047191/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 27 Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14CZfX6r_sJ-L39QbEzZgQA6tABjAuJOBkly1Mio_TXGcSyC8wOpOaBt3jGlxTJJl9f07tl34T07t16LPgY7e5dSKDbtpKG2PgxeroMb5baWiHlcZrfsQOQUhgVqzkrHdI76CeXkXyQkUtS6excmJ-v9mRvtoryNV9MCdI6Oi7paBYQ Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: cb0ad1798cf940f59f99f2b935a8f738 Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:12:12.558412 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cb0ad1798cf940f59f99f2b935a8f738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb0ad1798cf940f59f99f2b935a8f738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cb0ad1798cf940f59f99f2b935a8f738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb0ad1798cf940f59f99f2b935a8f738"}]}] Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: cb0ad1798cf940f59f99f2b935a8f738 Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b741e834b1b04c2593446642554f13d3 Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: {"hw:cpu_policy": "shared"} Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:12:12.559929 n-d-764485-11 devstack@n-api.service[119808]: exception: Request body and URI mismatch Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'flavor_id': '195047191', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:12.560701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:12.562471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:12.562471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:12.562471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 20 04:12:12.562471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.562471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7fc744c-e58b-44fe-98f1-ca41857986b2 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:12.562471 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a7fc744c-e58b-44fe-98f1-ca41857986b2 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/195047191/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.011705 Jul 20 04:12:12.562471 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 305/611] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:12:12 2022] PUT /compute/v2.1/flavors/195047191/os-extra_specs/hw:numa_nodes => generated 73 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 20 04:12:12.573704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e93ccd2c-c8f6-486a-b12d-d117aeb10648 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e93ccd2c-c8f6-486a-b12d-d117aeb10648 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Request method failure captured: Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: request: PUT /compute/v2.1/flavors/195047191/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 49 Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14CZfX6r_sJ-L39QbEzZgQA6tABjAuJOBkly1Mio_TXGcSyC8wOpOaBt3jGlxTJJl9f07tl34T07t16LPgY7e5dSKDbtpKG2PgxeroMb5baWiHlcZrfsQOQUhgVqzkrHdI76CeXkXyQkUtS6excmJ-v9mRvtoryNV9MCdI6Oi7paBYQ Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: cb0ad1798cf940f59f99f2b935a8f738 Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:12:12.577872 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:12:12.579274 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cb0ad1798cf940f59f99f2b935a8f738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb0ad1798cf940f59f99f2b935a8f738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cb0ad1798cf940f59f99f2b935a8f738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb0ad1798cf940f59f99f2b935a8f738"}]}] Jul 20 04:12:12.579274 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 Jul 20 04:12:12.579274 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: cb0ad1798cf940f59f99f2b935a8f738 Jul 20 04:12:12.579274 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 Jul 20 04:12:12.579274 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin Jul 20 04:12:12.579274 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:12:12.579274 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:12:12.579274 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b741e834b1b04c2593446642554f13d3 Jul 20 04:12:12.579274 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin Jul 20 04:12:12.579274 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:12:12.579274 n-d-764485-11 devstack@n-api.service[119808]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 20 04:12:12.579274 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'flavor_id': '195047191', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 20 04:12:12.580002 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.582290 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:12.583611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:12.583611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:12.583611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:12:12.583611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:12:12.583611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:12:12.583611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:12.583611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e93ccd2c-c8f6-486a-b12d-d117aeb10648 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:12.583611 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e93ccd2c-c8f6-486a-b12d-d117aeb10648 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/195047191/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.012233 Jul 20 04:12:12.583611 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 306/612] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:12:12 2022] PUT /compute/v2.1/flavors/195047191/os-extra_specs/hw:numa_nodes => generated 117 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:12:12.592543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a3538521-e8dc-491b-a2de-64a4c500dc9e tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:12.593470 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:12.593470 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:12.606829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SAVEPOINT=8,nova_api:RELEASE=8,nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:12.639224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:12.640044 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a3538521-e8dc-491b-a2de-64a4c500dc9e tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/195047191" status: 202 len: 0 microversion: 2.1 time: 0.052078 Jul 20 04:12:12.644259 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 307/613] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:12:12 2022] DELETE /compute/v2.1/flavors/195047191 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:12:12.652946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0a2f2b88-a821-4728-bb79-ea0d6c9fa962 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:12.678749 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0a2f2b88-a821-4728-bb79-ea0d6c9fa962 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341 tempest-FlavorsExtraSpecsNegativeTestJSON-19952341-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.030946 Jul 20 04:12:12.679733 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 308/614] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:12:12 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:12.694203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c2aa5234-5797-4981-bcd3-996f7c881194 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:12.705371 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2aa5234-5797-4981-bcd3-996f7c881194 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.210221 Jul 20 04:12:12.706313 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 307/615] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:12 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:13.215709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a23a3bea-777f-4661-953c-f305ae280612 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:13.217883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a23a3bea-777f-4661-953c-f305ae280612 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 92c61a93-0178-4e36-b9c0-75758c21dd7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:13.230105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a23a3bea-777f-4661-953c-f305ae280612 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.231859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a23a3bea-777f-4661-953c-f305ae280612 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.233371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a23a3bea-777f-4661-953c-f305ae280612 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.234074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a23a3bea-777f-4661-953c-f305ae280612 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.268734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0aa71dac-6d49-47fa-8001-bf8dcad4e4a0 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:13.270523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0aa71dac-6d49-47fa-8001-bf8dcad4e4a0 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:13.284383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0aa71dac-6d49-47fa-8001-bf8dcad4e4a0 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.285231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0aa71dac-6d49-47fa-8001-bf8dcad4e4a0 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.287246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0aa71dac-6d49-47fa-8001-bf8dcad4e4a0 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.292481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0aa71dac-6d49-47fa-8001-bf8dcad4e4a0 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.542026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a23a3bea-777f-4661-953c-f305ae280612 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:13.549506 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a23a3bea-777f-4661-953c-f305ae280612 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d" status: 200 len: 1318 microversion: 2.1 time: 0.338749 Jul 20 04:12:13.550639 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 309/616] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:13 2022] GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:13.557500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52279455-a55e-44c3-8e04-05cb8bc77e7e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da26b80>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:13.644497 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52279455-a55e-44c3-8e04-05cb8bc77e7e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.092495 Jul 20 04:12:13.654871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0aa71dac-6d49-47fa-8001-bf8dcad4e4a0 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:13.662389 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 310/617] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:13 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:13.665898 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0aa71dac-6d49-47fa-8001-bf8dcad4e4a0 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1475 microversion: 2.1 time: 0.406583 Jul 20 04:12:13.668394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c62b75a2-ed4b-47c9-ad68-8406aaaf47c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:13.669041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c62b75a2-ed4b-47c9-ad68-8406aaaf47c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:13.676131 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 308/618] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:13 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1475 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:13.682079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c62b75a2-ed4b-47c9-ad68-8406aaaf47c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.682800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c62b75a2-ed4b-47c9-ad68-8406aaaf47c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.683634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c62b75a2-ed4b-47c9-ad68-8406aaaf47c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.684417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c62b75a2-ed4b-47c9-ad68-8406aaaf47c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.722766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-356dbbc4-5396-429c-834e-22d1bf7b1997 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:13.724772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-356dbbc4-5396-429c-834e-22d1bf7b1997 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:13.752243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-356dbbc4-5396-429c-834e-22d1bf7b1997 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.752701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-356dbbc4-5396-429c-834e-22d1bf7b1997 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.756781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-356dbbc4-5396-429c-834e-22d1bf7b1997 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.757257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-356dbbc4-5396-429c-834e-22d1bf7b1997 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.051198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c62b75a2-ed4b-47c9-ad68-8406aaaf47c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:14.059235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-356dbbc4-5396-429c-834e-22d1bf7b1997 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:14.061095 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c62b75a2-ed4b-47c9-ad68-8406aaaf47c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1474 microversion: 2.1 time: 0.397563 Jul 20 04:12:14.063599 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 311/619] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:13 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1474 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:14.081636 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-356dbbc4-5396-429c-834e-22d1bf7b1997 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.363742 Jul 20 04:12:14.091800 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 309/620] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:13 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:14.567010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10552274-4d89-417e-a274-64eade11d006 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:14.568679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-10552274-4d89-417e-a274-64eade11d006 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 92c61a93-0178-4e36-b9c0-75758c21dd7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:14.582426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10552274-4d89-417e-a274-64eade11d006 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.583114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10552274-4d89-417e-a274-64eade11d006 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.584965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10552274-4d89-417e-a274-64eade11d006 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.587545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10552274-4d89-417e-a274-64eade11d006 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.673008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ce4ed29-f8a7-4f18-9447-ec408fcd63d5 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da0b9d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:14.801044 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ce4ed29-f8a7-4f18-9447-ec408fcd63d5 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.136617 Jul 20 04:12:14.801945 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 310/621] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:14 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:14.810415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7c9c379f-f02f-4887-b8de-5793b36ca663 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:14.811283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7c9c379f-f02f-4887-b8de-5793b36ca663 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:14.812732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10552274-4d89-417e-a274-64eade11d006 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:14.818694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c9c379f-f02f-4887-b8de-5793b36ca663 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.819425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c9c379f-f02f-4887-b8de-5793b36ca663 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.820650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c9c379f-f02f-4887-b8de-5793b36ca663 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.821325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c9c379f-f02f-4887-b8de-5793b36ca663 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.825162 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-10552274-4d89-417e-a274-64eade11d006 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d" status: 200 len: 1468 microversion: 2.1 time: 0.262767 Jul 20 04:12:14.831563 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 312/622] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:14 2022] GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d => generated 1468 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:14.843335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-82fa2b86-ebe5-4d8e-b0e1-15220b925af3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:14.856977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-82fa2b86-ebe5-4d8e-b0e1-15220b925af3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:14.858619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-82fa2b86-ebe5-4d8e-b0e1-15220b925af3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Searching by: {'reservation_id': 'r-wei4u9ea', 'deleted': False, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:12:14.867358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82fa2b86-ebe5-4d8e-b0e1-15220b925af3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.867935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82fa2b86-ebe5-4d8e-b0e1-15220b925af3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.870438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82fa2b86-ebe5-4d8e-b0e1-15220b925af3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.871103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82fa2b86-ebe5-4d8e-b0e1-15220b925af3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.031714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7c9c379f-f02f-4887-b8de-5793b36ca663 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:15.042946 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7c9c379f-f02f-4887-b8de-5793b36ca663 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1475 microversion: 2.1 time: 0.239745 Jul 20 04:12:15.054713 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 311/623] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:14 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1475 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:15.083973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5ba9fad-80d0-4670-83b0-c32b93626e9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:15.084879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c5ba9fad-80d0-4670-83b0-c32b93626e9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:15.094972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5ba9fad-80d0-4670-83b0-c32b93626e9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.095685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5ba9fad-80d0-4670-83b0-c32b93626e9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.097171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5ba9fad-80d0-4670-83b0-c32b93626e9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.097437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-82fa2b86-ebe5-4d8e-b0e1-15220b925af3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:12:15.097957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5ba9fad-80d0-4670-83b0-c32b93626e9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.208298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-82fa2b86-ebe5-4d8e-b0e1-15220b925af3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:15.220758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82fa2b86-ebe5-4d8e-b0e1-15220b925af3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.221488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82fa2b86-ebe5-4d8e-b0e1-15220b925af3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.394329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c5ba9fad-80d0-4670-83b0-c32b93626e9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:15.402562 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5ba9fad-80d0-4670-83b0-c32b93626e9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1474 microversion: 2.1 time: 0.322890 Jul 20 04:12:15.420684 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 312/624] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:15 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1474 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:15.429217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5d057bf-d635-472f-bf18-881359a6c5ce tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:15.430110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c5d057bf-d635-472f-bf18-881359a6c5ce tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:15.444771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5d057bf-d635-472f-bf18-881359a6c5ce tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.447184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5d057bf-d635-472f-bf18-881359a6c5ce tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.448467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5d057bf-d635-472f-bf18-881359a6c5ce tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.448927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5d057bf-d635-472f-bf18-881359a6c5ce tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.480661 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-82fa2b86-ebe5-4d8e-b0e1-15220b925af3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-wei4u9ea" status: 200 len: 2929 microversion: 2.1 time: 0.641637 Jul 20 04:12:15.481256 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 313/625] 10.222.0.20 () {58 vars in 1196 bytes} [Wed Jul 20 04:12:14 2022] GET /compute/v2.1/servers/detail?reservation_id=r-wei4u9ea => generated 2929 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:15.504705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a63cbae-de8b-4674-934f-3438b9776851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:15.581650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.compute.server_groups [None req-5a63cbae-de8b-4674-934f-3438b9776851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Querying cell de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) for 2 instances {{(pid=119808) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:12:15.583521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a63cbae-de8b-4674-934f-3438b9776851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.585848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a63cbae-de8b-4674-934f-3438b9776851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.641099 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a63cbae-de8b-4674-934f-3438b9776851 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/e6ebd214-f600-47b0-91f9-9470eb79ceff" status: 200 len: 266 microversion: 2.1 time: 0.141059 Jul 20 04:12:15.642448 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 314/626] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:12:15 2022] GET /compute/v2.1/os-server-groups/e6ebd214-f600-47b0-91f9-9470eb79ceff => generated 266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:12:15.670333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c12288f-c3a9-4d6d-8c2c-62aeb630f7dd tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:15.673935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6c12288f-c3a9-4d6d-8c2c-62aeb630f7dd tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] [instance: 92c61a93-0178-4e36-b9c0-75758c21dd7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:15.687120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c12288f-c3a9-4d6d-8c2c-62aeb630f7dd tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.688082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c12288f-c3a9-4d6d-8c2c-62aeb630f7dd tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.688911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c12288f-c3a9-4d6d-8c2c-62aeb630f7dd tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.689425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c12288f-c3a9-4d6d-8c2c-62aeb630f7dd tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.714274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c5d057bf-d635-472f-bf18-881359a6c5ce tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:15.728197 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5d057bf-d635-472f-bf18-881359a6c5ce tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.305945 Jul 20 04:12:15.729066 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 313/627] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:15 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:15.866846 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6c12288f-c3a9-4d6d-8c2c-62aeb630f7dd tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d" status: 200 len: 1621 microversion: 2.1 time: 0.206066 Jul 20 04:12:15.880500 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 315/628] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:15 2022] GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d => generated 1621 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:15.889079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1c5a8339-d6d8-46bc-87c6-0a8c0c39dc9e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d91cd30>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:15.950750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-390591053", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:15.971623 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1c5a8339-d6d8-46bc-87c6-0a8c0c39dc9e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.089325 Jul 20 04:12:15.973523 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 316/629] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:15 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:15.985561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-910406df-9e01-4fe2-b036-86036535f52e tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:15.988192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-910406df-9e01-4fe2-b036-86036535f52e tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:15.996794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-910406df-9e01-4fe2-b036-86036535f52e tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.997256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-910406df-9e01-4fe2-b036-86036535f52e tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.998149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-910406df-9e01-4fe2-b036-86036535f52e tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:15.998573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-910406df-9e01-4fe2-b036-86036535f52e tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.068736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:16.324486 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-910406df-9e01-4fe2-b036-86036535f52e tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 200 len: 1621 microversion: 2.1 time: 0.350034 Jul 20 04:12:16.328312 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 317/630] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:15 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 1621 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:16.335131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a56394a1-d6be-4a0d-83ad-6952513f24bf tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:16.335837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a56394a1-d6be-4a0d-83ad-6952513f24bf tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:16.360554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a56394a1-d6be-4a0d-83ad-6952513f24bf tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:16.361001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a56394a1-d6be-4a0d-83ad-6952513f24bf tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.361793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a56394a1-d6be-4a0d-83ad-6952513f24bf tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:16.362233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a56394a1-d6be-4a0d-83ad-6952513f24bf tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.490532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:16.491239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:16.491973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:16.492596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:16.494789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:16.504162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:16.504611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.505401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:16.506083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.538859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Getting quotas for project 017f9c01d11b4ecf9fb69d461bc624a8. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:16.545133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Getting quotas for user 9144c9cf0e9e48d38f49d3587012d74e and project 017f9c01d11b4ecf9fb69d461bc624a8. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:16.562578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:16.567320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:16.569611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a56394a1-d6be-4a0d-83ad-6952513f24bf tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:16.578710 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a56394a1-d6be-4a0d-83ad-6952513f24bf tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1475 microversion: 2.1 time: 0.249136 Jul 20 04:12:16.580567 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 318/631] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:16 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1475 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:16.581493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:16.585840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a1e7323-9415-4d3c-b1f6-3f152092a779 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Action: 'create', calling method: .version_select at 0x7fbf9d913040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1430718370", "policies": ["anti-affinity"]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:16.606837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3a1e7323-9415-4d3c-b1f6-3f152092a779 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:16.611378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3a1e7323-9415-4d3c-b1f6-3f152092a779 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:16.659128 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-346e0fd0-4e41-46ef-b284-0be07cb4006d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928869 Jul 20 04:12:16.668349 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 314/632] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:16.697117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9f61b097-724b-4b29-b8c3-eb9dc9dde6ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:16.697782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9f61b097-724b-4b29-b8c3-eb9dc9dde6ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:16.714820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f61b097-724b-4b29-b8c3-eb9dc9dde6ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:16.718202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f61b097-724b-4b29-b8c3-eb9dc9dde6ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.720236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f61b097-724b-4b29-b8c3-eb9dc9dde6ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:16.721335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3a1e7323-9415-4d3c-b1f6-3f152092a779 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:16.721953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f61b097-724b-4b29-b8c3-eb9dc9dde6ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:16.732447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3a1e7323-9415-4d3c-b1f6-3f152092a779 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:16.764198 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a1e7323-9415-4d3c-b1f6-3f152092a779 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.182277 Jul 20 04:12:16.764853 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 319/633] 10.222.0.20 () {60 vars in 1173 bytes} [Wed Jul 20 04:12:16 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:16.770211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-48e9c5c3-7591-481c-b332-3284634591f1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:16.774113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-48e9c5c3-7591-481c-b332-3284634591f1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:16.937569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-48e9c5c3-7591-481c-b332-3284634591f1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:16.959288 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-48e9c5c3-7591-481c-b332-3284634591f1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1222 microversion: 2.1 time: 0.193291 Jul 20 04:12:16.962362 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 320/634] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:16 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:16.999738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0f30ba8b-a4fe-4343-897d-91b7092565c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:17.001248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0f30ba8b-a4fe-4343-897d-91b7092565c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:17.016413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f30ba8b-a4fe-4343-897d-91b7092565c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.016957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f30ba8b-a4fe-4343-897d-91b7092565c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.017845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f30ba8b-a4fe-4343-897d-91b7092565c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.018398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f30ba8b-a4fe-4343-897d-91b7092565c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.046724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9f61b097-724b-4b29-b8c3-eb9dc9dde6ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:17.056299 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9f61b097-724b-4b29-b8c3-eb9dc9dde6ca tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1474 microversion: 2.1 time: 0.386046 Jul 20 04:12:17.057631 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 315/635] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:16 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1474 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:17.066689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dbedc068-679b-4bf5-8530-ac3af8504582 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da0bdc0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:17.150976 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dbedc068-679b-4bf5-8530-ac3af8504582 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.091997 Jul 20 04:12:17.153932 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 316/636] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:17 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:17.168126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-417305947", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "70316b04-0172-4ec0-967d-d2a8b72e190a"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:17.271928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:17.317215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0f30ba8b-a4fe-4343-897d-91b7092565c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:17.326833 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0f30ba8b-a4fe-4343-897d-91b7092565c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.358567 Jul 20 04:12:17.336065 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 321/637] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:16 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:17.679341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a2f2d2c-c5a8-4905-8cfe-9f49f9150dfb tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Calling method '.version_select at 0x7fbf9d8c0c10>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:17.680278 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:17.680278 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:17.682473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a2f2d2c-c5a8-4905-8cfe-9f49f9150dfb tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.683032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a2f2d2c-c5a8-4905-8cfe-9f49f9150dfb tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.724872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a2f2d2c-c5a8-4905-8cfe-9f49f9150dfb tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.725863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a2f2d2c-c5a8-4905-8cfe-9f49f9150dfb tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.765501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a2f2d2c-c5a8-4905-8cfe-9f49f9150dfb tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.772263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a2f2d2c-c5a8-4905-8cfe-9f49f9150dfb tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.781366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:17.782005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:17.782810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:17.783297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:17.783971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:17.788622 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a2f2d2c-c5a8-4905-8cfe-9f49f9150dfb tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.456429 Jul 20 04:12:17.799760 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 322/638] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:12:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:17.804943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7dd97517-9b15-4714-bece-a435b1cd22d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:17.812031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7dd97517-9b15-4714-bece-a435b1cd22d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:17.821469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.821952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.823367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.823865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.826532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7dd97517-9b15-4714-bece-a435b1cd22d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.826988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7dd97517-9b15-4714-bece-a435b1cd22d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.827793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7dd97517-9b15-4714-bece-a435b1cd22d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.828238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7dd97517-9b15-4714-bece-a435b1cd22d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.845531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:17.850919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:17.875720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Going to run 2 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:17.884274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 20b18bea-6f4e-458b-8c7b-94f9c18c14af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:17.947494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:17.954022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:18.037111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:18.050219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:18.081648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=20b18bea-6f4e-458b-8c7b-94f9c18c14af,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:18.176525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7dd97517-9b15-4714-bece-a435b1cd22d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:18.192081 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7dd97517-9b15-4714-bece-a435b1cd22d3 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1475 microversion: 2.1 time: 0.391104 Jul 20 04:12:18.201340 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 323/639] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:17 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1475 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:18.211172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-65548cf8-6f5b-4ab8-ad02-88aef1dba177 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Calling method '.version_select at 0x7fbf9dc4a790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:18.218339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:18.219710 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:18.219710 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:18.223480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65548cf8-6f5b-4ab8-ad02-88aef1dba177 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.223980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65548cf8-6f5b-4ab8-ad02-88aef1dba177 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.237441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:18.277385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65548cf8-6f5b-4ab8-ad02-88aef1dba177 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.277867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65548cf8-6f5b-4ab8-ad02-88aef1dba177 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.281225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:18.288542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'server_group_members'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:18.337014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65548cf8-6f5b-4ab8-ad02-88aef1dba177 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.337779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65548cf8-6f5b-4ab8-ad02-88aef1dba177 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.390519 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-65548cf8-6f5b-4ab8-ad02-88aef1dba177 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-764485-11/servers" status: 200 len: 434 microversion: 2.1 time: 0.188021 Jul 20 04:12:18.400272 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 324/640] 10.222.0.20 () {58 vars in 1214 bytes} [Wed Jul 20 04:12:18 2022] GET /compute/v2.1/os-hypervisors/n-h1-764485-11/servers => generated 434 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:18.407247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-51fd7b71-1a6d-43d3-a4ca-f963c08ddb2d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:18.408314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-51fd7b71-1a6d-43d3-a4ca-f963c08ddb2d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:18.423840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51fd7b71-1a6d-43d3-a4ca-f963c08ddb2d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.424828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51fd7b71-1a6d-43d3-a4ca-f963c08ddb2d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.425924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51fd7b71-1a6d-43d3-a4ca-f963c08ddb2d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.426665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51fd7b71-1a6d-43d3-a4ca-f963c08ddb2d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.440343 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7a517a4a-6fb5-4675-9149-f9d694e3f74e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.277900 Jul 20 04:12:18.449573 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 317/641] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:17 2022] POST /compute/v2.1/servers => generated 32 bytes in 1288 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:12:18.501205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8e561234-6713-4470-a540-65f27a88d981 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:18.512087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8e561234-6713-4470-a540-65f27a88d981 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:18.589605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e561234-6713-4470-a540-65f27a88d981 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.590060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e561234-6713-4470-a540-65f27a88d981 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.590849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e561234-6713-4470-a540-65f27a88d981 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.600227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e561234-6713-4470-a540-65f27a88d981 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.009029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-51fd7b71-1a6d-43d3-a4ca-f963c08ddb2d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:19.019996 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-51fd7b71-1a6d-43d3-a4ca-f963c08ddb2d tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1282 microversion: 2.1 time: 0.617553 Jul 20 04:12:19.023702 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 325/642] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:18 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1282 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:19.031043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b4ea408e-a482-4700-bb64-ac8726170f8b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d8be8b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:19.108176 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b4ea408e-a482-4700-bb64-ac8726170f8b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1450 microversion: 2.1 time: 0.083189 Jul 20 04:12:19.109440 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 326/643] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:19 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1450 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:19.117821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d0d6796c-405e-45c8-80c0-ee38f5c23ca5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:19.120696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d0d6796c-405e-45c8-80c0-ee38f5c23ca5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:19.131632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0d6796c-405e-45c8-80c0-ee38f5c23ca5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.132146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0d6796c-405e-45c8-80c0-ee38f5c23ca5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.137141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0d6796c-405e-45c8-80c0-ee38f5c23ca5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.137605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0d6796c-405e-45c8-80c0-ee38f5c23ca5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.561046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8e561234-6713-4470-a540-65f27a88d981 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:19.570394 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8e561234-6713-4470-a540-65f27a88d981 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1471 microversion: 2.1 time: 1.119667 Jul 20 04:12:19.577142 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 318/644] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:18 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1471 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:19.591698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-84e1c6c5-b6e0-455a-b35a-0f2005fc911d tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Calling method '.version_select at 0x7fbf9d9c4f70>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:19.594106 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:19.594106 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:12:19.597714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84e1c6c5-b6e0-455a-b35a-0f2005fc911d tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.598480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84e1c6c5-b6e0-455a-b35a-0f2005fc911d tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.630935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84e1c6c5-b6e0-455a-b35a-0f2005fc911d tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.635711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84e1c6c5-b6e0-455a-b35a-0f2005fc911d tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.670542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d0d6796c-405e-45c8-80c0-ee38f5c23ca5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:19.673602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84e1c6c5-b6e0-455a-b35a-0f2005fc911d tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.675412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84e1c6c5-b6e0-455a-b35a-0f2005fc911d tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.681059 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d0d6796c-405e-45c8-80c0-ee38f5c23ca5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.570356 Jul 20 04:12:19.681642 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 327/645] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:19 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:19.692410 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-84e1c6c5-b6e0-455a-b35a-0f2005fc911d tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.112455 Jul 20 04:12:19.692871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a6c44edb-2344-4456-b195-8fff0ea079c6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:19.693500 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 319/646] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:12:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:19.703101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a6c44edb-2344-4456-b195-8fff0ea079c6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:19.704216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a6c44edb-2344-4456-b195-8fff0ea079c6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Searching by: {'deleted': False, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:12:19.706346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d2480c94-8e8e-43e6-8d93-46f9d3116815 req-68ed0d55-10b4-4adb-b884-88b9f30d5a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3434c2d3-9cb3-4688-8374-91f655cb9214", "name": "network-vif-plugged", "status": "completed", "tag": "44b6c604-ac5e-4cec-9cac-9977a72935b5"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:19.724676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6c44edb-2344-4456-b195-8fff0ea079c6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.725295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6c44edb-2344-4456-b195-8fff0ea079c6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.726763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6c44edb-2344-4456-b195-8fff0ea079c6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.728032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6c44edb-2344-4456-b195-8fff0ea079c6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.738704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d2480c94-8e8e-43e6-8d93-46f9d3116815 req-68ed0d55-10b4-4adb-b884-88b9f30d5a37 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.739372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d2480c94-8e8e-43e6-8d93-46f9d3116815 req-68ed0d55-10b4-4adb-b884-88b9f30d5a37 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.767272 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d2480c94-8e8e-43e6-8d93-46f9d3116815 req-68ed0d55-10b4-4adb-b884-88b9f30d5a37 service nova] Creating event network-vif-plugged:44b6c604-ac5e-4cec-9cac-9977a72935b5 for instance 3434c2d3-9cb3-4688-8374-91f655cb9214 on n-h2-764485-11 Jul 20 04:12:19.782848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-d2480c94-8e8e-43e6-8d93-46f9d3116815 req-68ed0d55-10b4-4adb-b884-88b9f30d5a37 service nova] Instance 3434c2d3-9cb3-4688-8374-91f655cb9214 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:12:19.809804 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d2480c94-8e8e-43e6-8d93-46f9d3116815 req-68ed0d55-10b4-4adb-b884-88b9f30d5a37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114343 Jul 20 04:12:19.811682 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 320/647] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:19.833459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b71764ed-c02a-46c9-8968-7f6ccbebc0be tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:19.835681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b71764ed-c02a-46c9-8968-7f6ccbebc0be tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:19.858190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b71764ed-c02a-46c9-8968-7f6ccbebc0be tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.858640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b71764ed-c02a-46c9-8968-7f6ccbebc0be tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.859424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b71764ed-c02a-46c9-8968-7f6ccbebc0be tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.859891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b71764ed-c02a-46c9-8968-7f6ccbebc0be tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.996241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b71764ed-c02a-46c9-8968-7f6ccbebc0be tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:20.012931 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b71764ed-c02a-46c9-8968-7f6ccbebc0be tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1433 microversion: 2.1 time: 0.195666 Jul 20 04:12:20.013534 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 321/648] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:19 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1433 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:20.021342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e457852a-baf2-4a01-866d-98712a03c594 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:20.021877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e457852a-baf2-4a01-866d-98712a03c594 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:20.031000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:20.048463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e457852a-baf2-4a01-866d-98712a03c594 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.049204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e457852a-baf2-4a01-866d-98712a03c594 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.050302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e457852a-baf2-4a01-866d-98712a03c594 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.050749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e457852a-baf2-4a01-866d-98712a03c594 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.053538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-a6c44edb-2344-4456-b195-8fff0ea079c6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:12:20.090800 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a6c44edb-2344-4456-b195-8fff0ea079c6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1661 microversion: 2.1 time: 0.408042 Jul 20 04:12:20.092958 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 328/649] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 04:12:19 2022] GET /compute/v2.1/servers => generated 1661 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:20.099265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-1ab825e8-3f16-4e58-b6b1-c894a02fead1 req-24800ba3-3502-477a-831b-f100d3537b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9665e973-184b-48eb-92a4-1cbc4934ccbd", "name": "network-vif-deleted", "tag": "b9525bbb-abed-4357-a15a-95f7e2b2780b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:20.109610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1ab825e8-3f16-4e58-b6b1-c894a02fead1 req-24800ba3-3502-477a-831b-f100d3537b7b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.110506 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1ab825e8-3f16-4e58-b6b1-c894a02fead1 req-24800ba3-3502-477a-831b-f100d3537b7b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.122396 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-1ab825e8-3f16-4e58-b6b1-c894a02fead1 req-24800ba3-3502-477a-831b-f100d3537b7b service nova] Creating event network-vif-deleted:b9525bbb-abed-4357-a15a-95f7e2b2780b for instance 9665e973-184b-48eb-92a4-1cbc4934ccbd on n-h2-764485-11 Jul 20 04:12:20.128485 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-1ab825e8-3f16-4e58-b6b1-c894a02fead1 req-24800ba3-3502-477a-831b-f100d3537b7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033962 Jul 20 04:12:20.130044 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 329/650] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:20.136815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-af4b7998-693c-4b85-95d2-4a8bff61e340 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Calling method '.version_select at 0x7fbf9d91cca0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:20.138178 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:20.138178 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:20.139801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af4b7998-693c-4b85-95d2-4a8bff61e340 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.140598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af4b7998-693c-4b85-95d2-4a8bff61e340 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.157502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af4b7998-693c-4b85-95d2-4a8bff61e340 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.159302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af4b7998-693c-4b85-95d2-4a8bff61e340 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.171031 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e457852a-baf2-4a01-866d-98712a03c594 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "POST /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214/action" status: 204 len: 0 microversion: 2.1 time: 0.156205 Jul 20 04:12:20.172086 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 322/651] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:20 2022] POST /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214/action => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:12:20.177615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3622f12b-14b9-499d-9ee2-06b1549ba250 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:20.178663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3622f12b-14b9-499d-9ee2-06b1549ba250 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:20.181374 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-af4b7998-693c-4b85-95d2-4a8bff61e340 tempest-HypervisorAdminUnderV252Test-1945250119 tempest-HypervisorAdminUnderV252Test-1945250119-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-764485-11/search" status: 200 len: 105 microversion: 2.1 time: 0.043983 Jul 20 04:12:20.182286 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 330/652] 10.222.0.20 () {58 vars in 1211 bytes} [Wed Jul 20 04:12:20 2022] GET /compute/v2.1/os-hypervisors/n-h1-764485-11/search => generated 105 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:20.187153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5cf6de64-c8af-41e1-b8d3-d7e6f48e8147 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:20.191924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3622f12b-14b9-499d-9ee2-06b1549ba250 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.192782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3622f12b-14b9-499d-9ee2-06b1549ba250 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.193796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3622f12b-14b9-499d-9ee2-06b1549ba250 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.194458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3622f12b-14b9-499d-9ee2-06b1549ba250 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.200044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5cf6de64-c8af-41e1-b8d3-d7e6f48e8147 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:20.219241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5cf6de64-c8af-41e1-b8d3-d7e6f48e8147 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.225414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5cf6de64-c8af-41e1-b8d3-d7e6f48e8147 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.226308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5cf6de64-c8af-41e1-b8d3-d7e6f48e8147 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.226766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5cf6de64-c8af-41e1-b8d3-d7e6f48e8147 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.364707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3622f12b-14b9-499d-9ee2-06b1549ba250 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:20.374667 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3622f12b-14b9-499d-9ee2-06b1549ba250 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1280 microversion: 2.1 time: 0.201272 Jul 20 04:12:20.375245 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 323/653] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:20 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1280 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:20.381785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc33931a-9ad3-42c7-ae15-268b9dba45b5 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da829d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:20.435237 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc33931a-9ad3-42c7-ae15-268b9dba45b5 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1459 microversion: 2.1 time: 0.057943 Jul 20 04:12:20.437079 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 324/654] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:20 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1459 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:20.442645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-55a45c4e-6a80-4ac2-a995-ef7e5e3ce6fb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:20.443837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-55a45c4e-6a80-4ac2-a995-ef7e5e3ce6fb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:20.451490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55a45c4e-6a80-4ac2-a995-ef7e5e3ce6fb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.452263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55a45c4e-6a80-4ac2-a995-ef7e5e3ce6fb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.453424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55a45c4e-6a80-4ac2-a995-ef7e5e3ce6fb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.454069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55a45c4e-6a80-4ac2-a995-ef7e5e3ce6fb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.465824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5cf6de64-c8af-41e1-b8d3-d7e6f48e8147 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:20.474195 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5cf6de64-c8af-41e1-b8d3-d7e6f48e8147 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1222 microversion: 2.1 time: 0.290700 Jul 20 04:12:20.474809 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 331/655] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:20 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1222 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:20.487069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:20.487963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-53e5e0e6-197a-4990-9ed5-4617e5156bee tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d91c9d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:20.554329 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-53e5e0e6-197a-4990-9ed5-4617e5156bee tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 200 len: 1459 microversion: 2.1 time: 0.078420 Jul 20 04:12:20.554928 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 332/656] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:20 2022] GET /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 1459 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:20.567538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-564a8d5e-d528-4e77-b491-b665c3777137 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:20.568297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-564a8d5e-d528-4e77-b491-b665c3777137 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:20.581309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-564a8d5e-d528-4e77-b491-b665c3777137 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.581767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-564a8d5e-d528-4e77-b491-b665c3777137 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.582689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-564a8d5e-d528-4e77-b491-b665c3777137 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.583131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-564a8d5e-d528-4e77-b491-b665c3777137 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.817207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-55a45c4e-6a80-4ac2-a995-ef7e5e3ce6fb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:20.832400 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-55a45c4e-6a80-4ac2-a995-ef7e5e3ce6fb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1471 microversion: 2.1 time: 0.391808 Jul 20 04:12:20.833273 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 325/657] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:20 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1471 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:20.846388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-538e91e6-b937-4a57-bc82-be7e8851f2d4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:20.859985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-538e91e6-b937-4a57-bc82-be7e8851f2d4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:20.876835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-538e91e6-b937-4a57-bc82-be7e8851f2d4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.877584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-538e91e6-b937-4a57-bc82-be7e8851f2d4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.892593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-538e91e6-b937-4a57-bc82-be7e8851f2d4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.895431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-538e91e6-b937-4a57-bc82-be7e8851f2d4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.919872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-564a8d5e-d528-4e77-b491-b665c3777137 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:20.931740 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-564a8d5e-d528-4e77-b491-b665c3777137 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1466 microversion: 2.1 time: 0.364552 Jul 20 04:12:20.932385 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 333/658] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:20 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1466 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:20.948388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1136aa98-4dc6-4b8d-a1a6-5d9f57ea17a1 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1015149671"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:20.949474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1136aa98-4dc6-4b8d-a1a6-5d9f57ea17a1 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:20.962595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1136aa98-4dc6-4b8d-a1a6-5d9f57ea17a1 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.963217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1136aa98-4dc6-4b8d-a1a6-5d9f57ea17a1 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.964098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1136aa98-4dc6-4b8d-a1a6-5d9f57ea17a1 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.964544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1136aa98-4dc6-4b8d-a1a6-5d9f57ea17a1 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.371292 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1136aa98-4dc6-4b8d-a1a6-5d9f57ea17a1 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "POST /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8/action" status: 202 len: 0 microversion: 2.1 time: 0.426148 Jul 20 04:12:21.373648 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 334/659] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:20 2022] POST /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 20 04:12:21.382132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0a813e19-afb9-4b7e-94cc-23240c18e61b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:21.382882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0a813e19-afb9-4b7e-94cc-23240c18e61b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:21.392813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a813e19-afb9-4b7e-94cc-23240c18e61b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.393497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a813e19-afb9-4b7e-94cc-23240c18e61b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.394798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a813e19-afb9-4b7e-94cc-23240c18e61b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.395478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a813e19-afb9-4b7e-94cc-23240c18e61b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.494085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-538e91e6-b937-4a57-bc82-be7e8851f2d4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:21.507349 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-538e91e6-b937-4a57-bc82-be7e8851f2d4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.670488 Jul 20 04:12:21.510709 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 326/660] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:20 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:21.516329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7253621c-d0e7-4488-abc9-e15f9ce23d52 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da45040>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:21.573379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0a813e19-afb9-4b7e-94cc-23240c18e61b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:21.582093 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0a813e19-afb9-4b7e-94cc-23240c18e61b tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1433 microversion: 2.1 time: 0.206506 Jul 20 04:12:21.582676 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 335/661] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:21 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1433 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:21.588339 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7253621c-d0e7-4488-abc9-e15f9ce23d52 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.076026 Jul 20 04:12:21.596339 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 327/662] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:21 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:21.598824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0e53f470-0f9f-49f8-b2bf-525e1fd6a5c1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:21.599455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0e53f470-0f9f-49f8-b2bf-525e1fd6a5c1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:21.605381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee8c1d8d-6a25-4c1f-80b0-ec2948d29071 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:21.607194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ee8c1d8d-6a25-4c1f-80b0-ec2948d29071 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:21.617096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee8c1d8d-6a25-4c1f-80b0-ec2948d29071 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.618982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee8c1d8d-6a25-4c1f-80b0-ec2948d29071 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.620120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee8c1d8d-6a25-4c1f-80b0-ec2948d29071 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.620720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee8c1d8d-6a25-4c1f-80b0-ec2948d29071 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.623303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e53f470-0f9f-49f8-b2bf-525e1fd6a5c1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.623799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e53f470-0f9f-49f8-b2bf-525e1fd6a5c1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.624590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e53f470-0f9f-49f8-b2bf-525e1fd6a5c1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.625032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e53f470-0f9f-49f8-b2bf-525e1fd6a5c1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.748049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ee8c1d8d-6a25-4c1f-80b0-ec2948d29071 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:21.764691 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ee8c1d8d-6a25-4c1f-80b0-ec2948d29071 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1222 microversion: 2.1 time: 0.166277 Jul 20 04:12:21.765515 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 328/663] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:21 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:21.850945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6b79dbf8-0b2c-41e1-a1f2-1ce3d854a691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:21.851929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6b79dbf8-0b2c-41e1-a1f2-1ce3d854a691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:21.859425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b79dbf8-0b2c-41e1-a1f2-1ce3d854a691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.859976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b79dbf8-0b2c-41e1-a1f2-1ce3d854a691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.860834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b79dbf8-0b2c-41e1-a1f2-1ce3d854a691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.861351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b79dbf8-0b2c-41e1-a1f2-1ce3d854a691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.119446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0e53f470-0f9f-49f8-b2bf-525e1fd6a5c1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:22.136203 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0e53f470-0f9f-49f8-b2bf-525e1fd6a5c1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1322 microversion: 2.1 time: 0.544477 Jul 20 04:12:22.149963 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 336/664] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:21 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1322 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:22.452382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6b79dbf8-0b2c-41e1-a1f2-1ce3d854a691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:22.467349 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6b79dbf8-0b2c-41e1-a1f2-1ce3d854a691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1471 microversion: 2.1 time: 0.619975 Jul 20 04:12:22.468218 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 329/665] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:21 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1471 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:22.529209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-756802ce-2aca-44d9-a329-bbbfbe355a8d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:22.530548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-756802ce-2aca-44d9-a329-bbbfbe355a8d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:22.553416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-756802ce-2aca-44d9-a329-bbbfbe355a8d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.558950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-756802ce-2aca-44d9-a329-bbbfbe355a8d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.560226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-756802ce-2aca-44d9-a329-bbbfbe355a8d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.560820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-756802ce-2aca-44d9-a329-bbbfbe355a8d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.600348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-274f3a7a-2580-4734-9231-d9328e7ca8d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:22.601225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-274f3a7a-2580-4734-9231-d9328e7ca8d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:22.624696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-274f3a7a-2580-4734-9231-d9328e7ca8d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.630339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-274f3a7a-2580-4734-9231-d9328e7ca8d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.639314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-274f3a7a-2580-4734-9231-d9328e7ca8d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.641272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-274f3a7a-2580-4734-9231-d9328e7ca8d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.698226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=89 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:22.704593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-274f3a7a-2580-4734-9231-d9328e7ca8d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.705040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-274f3a7a-2580-4734-9231-d9328e7ca8d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.705681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-274f3a7a-2580-4734-9231-d9328e7ca8d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lazy-loading 'fault' on Instance uuid 9665e973-184b-48eb-92a4-1cbc4934ccbd {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:23.094015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-274f3a7a-2580-4734-9231-d9328e7ca8d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96042a516bf425287c5b71cc3389cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9624de6b85e44fac9ab44c11d6cde04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:23.104597 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-274f3a7a-2580-4734-9231-d9328e7ca8d5 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 200 len: 1309 microversion: 2.1 time: 0.508108 Jul 20 04:12:23.115486 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 330/666] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:22 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 1309 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:23.122842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd0b0ac6-ce24-476d-b260-0bab4bfe597c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da0ba60>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:23.175926 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd0b0ac6-ce24-476d-b260-0bab4bfe597c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.058941 Jul 20 04:12:23.176680 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 331/667] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:23 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:23.181777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-72e75906-d7d2-438e-bd7a-b04e168947de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:23.182379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-72e75906-d7d2-438e-bd7a-b04e168947de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:23.192980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72e75906-d7d2-438e-bd7a-b04e168947de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.193497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72e75906-d7d2-438e-bd7a-b04e168947de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.194274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72e75906-d7d2-438e-bd7a-b04e168947de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.194702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72e75906-d7d2-438e-bd7a-b04e168947de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.236962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-756802ce-2aca-44d9-a329-bbbfbe355a8d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:23.249261 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-756802ce-2aca-44d9-a329-bbbfbe355a8d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.727905 Jul 20 04:12:23.260715 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 337/668] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:22 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:23.266636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-08664ff9-ca34-4c03-bab4-3458ba69e6bf tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:23.267284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-08664ff9-ca34-4c03-bab4-3458ba69e6bf tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:23.275476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08664ff9-ca34-4c03-bab4-3458ba69e6bf tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.276228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08664ff9-ca34-4c03-bab4-3458ba69e6bf tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.277271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08664ff9-ca34-4c03-bab4-3458ba69e6bf tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.277879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08664ff9-ca34-4c03-bab4-3458ba69e6bf tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.465711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-72e75906-d7d2-438e-bd7a-b04e168947de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:23.478860 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-72e75906-d7d2-438e-bd7a-b04e168947de tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1270 microversion: 2.1 time: 0.301277 Jul 20 04:12:23.491920 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 332/669] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:23 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1270 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:23.506428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2d98ccb-14c1-4588-aaac-c6e7c907ec96 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:23.506895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2d98ccb-14c1-4588-aaac-c6e7c907ec96 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:23.519712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2d98ccb-14c1-4588-aaac-c6e7c907ec96 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.520377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2d98ccb-14c1-4588-aaac-c6e7c907ec96 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.521378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2d98ccb-14c1-4588-aaac-c6e7c907ec96 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.521964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2d98ccb-14c1-4588-aaac-c6e7c907ec96 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.968756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-08664ff9-ca34-4c03-bab4-3458ba69e6bf tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:23.980127 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-08664ff9-ca34-4c03-bab4-3458ba69e6bf tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1322 microversion: 2.1 time: 0.717600 Jul 20 04:12:23.980731 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 338/670] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:23 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1322 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:24.086041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c2d98ccb-14c1-4588-aaac-c6e7c907ec96 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.095648 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2d98ccb-14c1-4588-aaac-c6e7c907ec96 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1463 microversion: 2.1 time: 0.602404 Jul 20 04:12:24.096303 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 333/671] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:23 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1463 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:24.112705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f8feeba9-6bd8-41c4-b135-5902a39351cc tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.113324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f8feeba9-6bd8-41c4-b135-5902a39351cc tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:24.128781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8feeba9-6bd8-41c4-b135-5902a39351cc tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.129472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8feeba9-6bd8-41c4-b135-5902a39351cc tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.130260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8feeba9-6bd8-41c4-b135-5902a39351cc tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.130848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-873cccd0-4111-477e-bd2b-71f853e6f5f2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.131550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-873cccd0-4111-477e-bd2b-71f853e6f5f2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] [instance: 9665e973-184b-48eb-92a4-1cbc4934ccbd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:24.136477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8feeba9-6bd8-41c4-b135-5902a39351cc tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.145687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-873cccd0-4111-477e-bd2b-71f853e6f5f2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.146138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-873cccd0-4111-477e-bd2b-71f853e6f5f2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.146918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-873cccd0-4111-477e-bd2b-71f853e6f5f2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.147355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-873cccd0-4111-477e-bd2b-71f853e6f5f2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.202570 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-873cccd0-4111-477e-bd2b-71f853e6f5f2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] HTTP exception thrown: Instance 9665e973-184b-48eb-92a4-1cbc4934ccbd could not be found. Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-873cccd0-4111-477e-bd2b-71f853e6f5f2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Request method failure captured: Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd HTTP/1.1 Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BdPv7y8c8tw582FCR3NLOTUP-1eR6PRyfMpAS311c48XlX26LyZZcnDZ5iSxUtrDthGfuTaXzbdtUXXc2LkzauLGMrMEl_p33AdsHCrWj3N0DhULq6XWV4JQAdIVBPWSocba8RfC68k7h3pOi9zz90tsfqMPq9Vr1LNQkQH5Yvw98 Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 9624de6b85e44fac9ab44c11d6cde04b Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-LiveMigrationNegativeTest-509597051 Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:12:24.206252 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:12:24.207894 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9624de6b85e44fac9ab44c11d6cde04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9624de6b85e44fac9ab44c11d6cde04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9624de6b85e44fac9ab44c11d6cde04b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9624de6b85e44fac9ab44c11d6cde04b"}]}] Jul 20 04:12:24.207894 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-LiveMigrationNegativeTest-509597051 Jul 20 04:12:24.207894 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 9624de6b85e44fac9ab44c11d6cde04b Jul 20 04:12:24.207894 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-509597051 Jul 20 04:12:24.207894 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-LiveMigrationNegativeTest-509597051-project Jul 20 04:12:24.207894 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:12:24.207894 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:12:24.207894 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: f96042a516bf425287c5b71cc3389cf0 Jul 20 04:12:24.207894 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-LiveMigrationNegativeTest-509597051-project Jul 20 04:12:24.207894 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:12:24.207894 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 9665e973-184b-48eb-92a4-1cbc4934ccbd could not be found. Jul 20 04:12:24.207894 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '9665e973-184b-48eb-92a4-1cbc4934ccbd'} Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9665e973-184b-48eb-92a4-1cbc4934ccbd could not be found. Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:24.208809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9665e973-184b-48eb-92a4-1cbc4934ccbd could not be found. Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9665e973-184b-48eb-92a4-1cbc4934ccbd could not be found. Jul 20 04:12:24.210985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:12:24.212629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-873cccd0-4111-477e-bd2b-71f853e6f5f2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] Returning 404 to user: Instance 9665e973-184b-48eb-92a4-1cbc4934ccbd could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:24.213395 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-873cccd0-4111-477e-bd2b-71f853e6f5f2 tempest-LiveMigrationNegativeTest-509597051 tempest-LiveMigrationNegativeTest-509597051-project] 10.222.0.20 "GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd" status: 404 len: 111 microversion: 2.1 time: 0.089795 Jul 20 04:12:24.214284 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 334/672] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/servers/9665e973-184b-48eb-92a4-1cbc4934ccbd => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:24.230563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-24aa6447-0a21-4a6c-899c-ce001eecbbe1 req-d4cc7dbc-a63f-44d6-82f0-3f9cae45773d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d355750-c712-4f8f-82bb-87880f3153bc", "tag": "3a853edd-2513-410e-a5a1-bd2350967d5f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:24.250524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-24aa6447-0a21-4a6c-899c-ce001eecbbe1 req-d4cc7dbc-a63f-44d6-82f0-3f9cae45773d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.251333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-24aa6447-0a21-4a6c-899c-ce001eecbbe1 req-d4cc7dbc-a63f-44d6-82f0-3f9cae45773d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.275358 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-24aa6447-0a21-4a6c-899c-ce001eecbbe1 req-d4cc7dbc-a63f-44d6-82f0-3f9cae45773d service nova] Creating event network-changed:3a853edd-2513-410e-a5a1-bd2350967d5f for instance 1d355750-c712-4f8f-82bb-87880f3153bc on n-h1-764485-11 Jul 20 04:12:24.286732 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-24aa6447-0a21-4a6c-899c-ce001eecbbe1 req-d4cc7dbc-a63f-44d6-82f0-3f9cae45773d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070058 Jul 20 04:12:24.287351 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 335/673] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:24.309033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-42b7064a-7879-4e20-a292-7c596385a55f tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da0b8b0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.416657 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-42b7064a-7879-4e20-a292-7c596385a55f tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.126874 Jul 20 04:12:24.422833 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 336/674] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:24.431685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-670cda26-dd0a-4b82-9577-58e43005b4e4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.432439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-670cda26-dd0a-4b82-9577-58e43005b4e4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:24.452028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-670cda26-dd0a-4b82-9577-58e43005b4e4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.452402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-670cda26-dd0a-4b82-9577-58e43005b4e4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.458207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-670cda26-dd0a-4b82-9577-58e43005b4e4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.458844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-670cda26-dd0a-4b82-9577-58e43005b4e4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.672994 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f8feeba9-6bd8-41c4-b135-5902a39351cc tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1616 microversion: 2.1 time: 0.562003 Jul 20 04:12:24.689449 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 339/675] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1616 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:24.701355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4f8dd65a-d72f-48c7-839e-c3b7a3a86cde tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.701945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4f8dd65a-d72f-48c7-839e-c3b7a3a86cde tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:24.710971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f8dd65a-d72f-48c7-839e-c3b7a3a86cde tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.711896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f8dd65a-d72f-48c7-839e-c3b7a3a86cde tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.713717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f8dd65a-d72f-48c7-839e-c3b7a3a86cde tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.714347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f8dd65a-d72f-48c7-839e-c3b7a3a86cde tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.859159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4f8dd65a-d72f-48c7-839e-c3b7a3a86cde tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.875296 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4f8dd65a-d72f-48c7-839e-c3b7a3a86cde tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1276 microversion: 2.1 time: 0.181609 Jul 20 04:12:24.878712 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 340/676] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:24.886996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-670cda26-dd0a-4b82-9577-58e43005b4e4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.897530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-79f1c7a9-75aa-41ca-a63f-13b6cfeb4ceb tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Calling method '.version_select at 0x7fbf9da75790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.904182 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-670cda26-dd0a-4b82-9577-58e43005b4e4 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.479761 Jul 20 04:12:24.904780 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 337/677] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:24.906515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79f1c7a9-75aa-41ca-a63f-13b6cfeb4ceb tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.907329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79f1c7a9-75aa-41ca-a63f-13b6cfeb4ceb tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.933560 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-79f1c7a9-75aa-41ca-a63f-13b6cfeb4ceb tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 801 microversion: 2.1 time: 0.051889 Jul 20 04:12:24.935271 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 341/678] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/os-migrations => generated 801 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:24.996978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a47ce7fb-4000-401f-8364-9eef2664eda3 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.997882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a47ce7fb-4000-401f-8364-9eef2664eda3 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:25.012009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a47ce7fb-4000-401f-8364-9eef2664eda3 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.013685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a47ce7fb-4000-401f-8364-9eef2664eda3 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.016935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a47ce7fb-4000-401f-8364-9eef2664eda3 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.018418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a47ce7fb-4000-401f-8364-9eef2664eda3 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.134212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-627ea133-8ba9-4236-9e9e-284553de5398 req-49b7cf9d-4e52-4b31-b87d-253584a03f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec531648-d3ee-43c8-8fda-89ae7282e4ef", "name": "network-vif-unplugged", "status": "completed", "tag": "cbfa0b20-ec79-4d11-a450-6d6c8705b3b2"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:25.137290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:25.156457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-627ea133-8ba9-4236-9e9e-284553de5398 req-49b7cf9d-4e52-4b31-b87d-253584a03f44 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.156911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-627ea133-8ba9-4236-9e9e-284553de5398 req-49b7cf9d-4e52-4b31-b87d-253584a03f44 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.180533 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-627ea133-8ba9-4236-9e9e-284553de5398 req-49b7cf9d-4e52-4b31-b87d-253584a03f44 service nova] Creating event network-vif-unplugged:cbfa0b20-ec79-4d11-a450-6d6c8705b3b2 for instance ec531648-d3ee-43c8-8fda-89ae7282e4ef on n-h1-764485-11 Jul 20 04:12:25.191461 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-627ea133-8ba9-4236-9e9e-284553de5398 req-49b7cf9d-4e52-4b31-b87d-253584a03f44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062367 Jul 20 04:12:25.207914 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 342/679] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:12:25.230890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1600725711", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:25.313347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:25.672604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a47ce7fb-4000-401f-8364-9eef2664eda3 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:25.687287 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a47ce7fb-4000-401f-8364-9eef2664eda3 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1322 microversion: 2.1 time: 0.694189 Jul 20 04:12:25.692134 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 338/680] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1322 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:25.705110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-76d63448-4b4a-45cf-b4bb-340eaa74fc77 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9ddeab80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:25.799537 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-76d63448-4b4a-45cf-b4bb-340eaa74fc77 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.106199 Jul 20 04:12:25.800297 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 339/681] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:25 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:25.966860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:25.969672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:25.970421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:25.971217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:25.971908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:25.991462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.994575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.997605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.998139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.057752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Getting quotas for project 41ba023317344d3490bdb01aa8b1e01b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:26.067100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Getting quotas for user 9aa79203e62546cea351116b153afee5 and project 41ba023317344d3490bdb01aa8b1e01b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:26.094965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:26.099980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:26.229840 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bf200574-ca28-4bcd-a01d-2edc306f4087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003478 Jul 20 04:12:26.231562 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 343/682] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:12:26.241985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b3e07e1-52ae-4e13-abe3-45f4597b81e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:26.243908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b3e07e1-52ae-4e13-abe3-45f4597b81e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:26.275906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b3e07e1-52ae-4e13-abe3-45f4597b81e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.283762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b3e07e1-52ae-4e13-abe3-45f4597b81e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.285009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b3e07e1-52ae-4e13-abe3-45f4597b81e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.287891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b3e07e1-52ae-4e13-abe3-45f4597b81e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.494808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c270de9-4473-450d-a8ad-490aa3678537 tempest-QuotaClassesAdmin257Test-738987599 tempest-QuotaClassesAdmin257Test-738987599-project-admin] Calling method '.version_select at 0x7fbf9d9c4b80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:26.495715 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:26.495715 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:12:26.540514 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4c270de9-4473-450d-a8ad-490aa3678537 tempest-QuotaClassesAdmin257Test-738987599 tempest-QuotaClassesAdmin257Test-738987599-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.728142 Jul 20 04:12:26.565225 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 340/683] 10.222.0.20 () {60 vars in 1225 bytes} [Wed Jul 20 04:12:25 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:12:26.577059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3acd0769-0392-4646-868c-5d17e7bf29dc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:26.578232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3acd0769-0392-4646-868c-5d17e7bf29dc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:26.589839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3acd0769-0392-4646-868c-5d17e7bf29dc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.591113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3acd0769-0392-4646-868c-5d17e7bf29dc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.592668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3acd0769-0392-4646-868c-5d17e7bf29dc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.593319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3acd0769-0392-4646-868c-5d17e7bf29dc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.929423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3acd0769-0392-4646-868c-5d17e7bf29dc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.945420 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3acd0769-0392-4646-868c-5d17e7bf29dc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.374723 Jul 20 04:12:26.947590 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 341/684] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:26 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:26.963848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0b3e07e1-52ae-4e13-abe3-45f4597b81e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.969523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5954cfe9-be4f-4247-b6d2-6c68e5edf72e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:26.970136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5954cfe9-be4f-4247-b6d2-6c68e5edf72e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:26.976958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b3e07e1-52ae-4e13-abe3-45f4597b81e8 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1318 microversion: 2.1 time: 0.743884 Jul 20 04:12:26.978661 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 344/685] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:26 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1318 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:26.988085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5954cfe9-be4f-4247-b6d2-6c68e5edf72e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.989096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5954cfe9-be4f-4247-b6d2-6c68e5edf72e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.991109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5954cfe9-be4f-4247-b6d2-6c68e5edf72e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.991601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5954cfe9-be4f-4247-b6d2-6c68e5edf72e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.995553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-adfa4e10-6377-48c8-b700-2f0b3e207ffe tempest-QuotaClassesAdmin257Test-738987599 tempest-QuotaClassesAdmin257Test-738987599-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9d91c820>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:27.000176 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:27.000176 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:27.179903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5954cfe9-be4f-4247-b6d2-6c68e5edf72e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:27.196534 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5954cfe9-be4f-4247-b6d2-6c68e5edf72e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1217 microversion: 2.1 time: 0.247057 Jul 20 04:12:27.198790 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 342/686] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:26 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1217 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:27.199810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=31,nova_cell0:UPDATE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:27.214837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c1024d58-4a49-440f-84be-7db103a9c549 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.218730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c1024d58-4a49-440f-84be-7db103a9c549 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:27.240559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1024d58-4a49-440f-84be-7db103a9c549 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.241397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1024d58-4a49-440f-84be-7db103a9c549 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.245670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1024d58-4a49-440f-84be-7db103a9c549 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.246378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1024d58-4a49-440f-84be-7db103a9c549 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.497844 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-adfa4e10-6377-48c8-b700-2f0b3e207ffe tempest-QuotaClassesAdmin257Test-738987599 tempest-QuotaClassesAdmin257Test-738987599-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.517388 Jul 20 04:12:27.499387 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 345/687] 10.222.0.20 () {62 vars in 1246 bytes} [Wed Jul 20 04:12:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:12:27.506757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5166f59e-8075-419a-98c7-34de00616e00 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9db2d430>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.576543 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5166f59e-8075-419a-98c7-34de00616e00 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.075669 Jul 20 04:12:27.588396 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 346/688] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:27 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:27.600446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-827395d8-3ff6-4358-ac7a-8e4916ce0d74 req-bc6e7ab3-2a57-43a6-ba38-fdf2d95d70cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e603c0-187a-46e9-a4c5-da5f3d5e9170", "name": "network-vif-plugged", "status": "completed", "tag": "bd71d3a7-7615-4097-8805-ca1d231d551c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:27.621240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-827395d8-3ff6-4358-ac7a-8e4916ce0d74 req-bc6e7ab3-2a57-43a6-ba38-fdf2d95d70cb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.626431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-827395d8-3ff6-4358-ac7a-8e4916ce0d74 req-bc6e7ab3-2a57-43a6-ba38-fdf2d95d70cb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.652011 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-827395d8-3ff6-4358-ac7a-8e4916ce0d74 req-bc6e7ab3-2a57-43a6-ba38-fdf2d95d70cb service nova] Creating event network-vif-plugged:bd71d3a7-7615-4097-8805-ca1d231d551c for instance c7e603c0-187a-46e9-a4c5-da5f3d5e9170 on n-h2-764485-11 Jul 20 04:12:27.663922 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-827395d8-3ff6-4358-ac7a-8e4916ce0d74 req-bc6e7ab3-2a57-43a6-ba38-fdf2d95d70cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073996 Jul 20 04:12:27.669979 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 347/689] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:27.676282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0f88fd00-04ca-486a-9f25-8db47421a7cd tempest-QuotaClassesAdmin257Test-738987599 tempest-QuotaClassesAdmin257Test-738987599-project-admin] Calling method '.version_select at 0x7fbf9d91cf70>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.677554 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:27.677554 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:27.691501 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0f88fd00-04ca-486a-9f25-8db47421a7cd tempest-QuotaClassesAdmin257Test-738987599 tempest-QuotaClassesAdmin257Test-738987599-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.019580 Jul 20 04:12:27.692518 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 348/690] 10.222.0.20 () {60 vars in 1225 bytes} [Wed Jul 20 04:12:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:12:27.698038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-cfbbb9b4-f98b-40f2-bd89-3b3f93213d5e req-192d4ef1-9fc9-48e0-bd52-129230c3aa7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c2fb172-fa1a-40e0-83b2-eefc51238dad", "tag": "03823a3f-4130-4cb7-bb66-1b00475c7a36"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:27.710375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cfbbb9b4-f98b-40f2-bd89-3b3f93213d5e req-192d4ef1-9fc9-48e0-bd52-129230c3aa7b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.711210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cfbbb9b4-f98b-40f2-bd89-3b3f93213d5e req-192d4ef1-9fc9-48e0-bd52-129230c3aa7b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.725661 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-cfbbb9b4-f98b-40f2-bd89-3b3f93213d5e req-192d4ef1-9fc9-48e0-bd52-129230c3aa7b service nova] Creating event network-changed:03823a3f-4130-4cb7-bb66-1b00475c7a36 for instance 6c2fb172-fa1a-40e0-83b2-eefc51238dad on n-h2-764485-11 Jul 20 04:12:27.732362 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-cfbbb9b4-f98b-40f2-bd89-3b3f93213d5e req-192d4ef1-9fc9-48e0-bd52-129230c3aa7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038436 Jul 20 04:12:27.733587 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 349/691] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:27.739769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7214cb3-2d4d-4236-b929-bf26334191cf tempest-QuotaClassesAdmin257Test-738987599 tempest-QuotaClassesAdmin257Test-738987599-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9db124c0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:27.741704 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:27.741704 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:27.836827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:27.849326 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a7214cb3-2d4d-4236-b929-bf26334191cf tempest-QuotaClassesAdmin257Test-738987599 tempest-QuotaClassesAdmin257Test-738987599-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.113627 Jul 20 04:12:27.858438 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 350/692] 10.222.0.20 () {62 vars in 1246 bytes} [Wed Jul 20 04:12:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:12:27.865364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a165c587-c41e-4db2-bf34-eda86114b1da tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.866973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a165c587-c41e-4db2-bf34-eda86114b1da tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:27.876668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a165c587-c41e-4db2-bf34-eda86114b1da tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.877649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a165c587-c41e-4db2-bf34-eda86114b1da tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.878904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a165c587-c41e-4db2-bf34-eda86114b1da tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.879908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a165c587-c41e-4db2-bf34-eda86114b1da tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.929396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a165c587-c41e-4db2-bf34-eda86114b1da tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:12:27.997794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:28.155456 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a165c587-c41e-4db2-bf34-eda86114b1da tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 204 len: 0 microversion: 2.1 time: 0.293138 Jul 20 04:12:28.157088 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 351/693] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:12:27 2022] DELETE /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:12:28.170827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8e16e1ab-d610-4af9-8233-b75b6b647cd0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:28.179194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8e16e1ab-d610-4af9-8233-b75b6b647cd0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:28.207079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e16e1ab-d610-4af9-8233-b75b6b647cd0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.207490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e16e1ab-d610-4af9-8233-b75b6b647cd0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.211352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e16e1ab-d610-4af9-8233-b75b6b647cd0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.212053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e16e1ab-d610-4af9-8233-b75b6b647cd0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.218991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c1024d58-4a49-440f-84be-7db103a9c549 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:28.226821 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c1024d58-4a49-440f-84be-7db103a9c549 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1322 microversion: 2.1 time: 1.025740 Jul 20 04:12:28.228042 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 343/694] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:27 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1322 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:28.242519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-00dbb421-e5bc-40a7-bf6d-3af56fb2cf40 req-7985a3b5-cdba-4496-b033-2f0d8c96f809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b18bea-6f4e-458b-8c7b-94f9c18c14af", "tag": "ad6410c3-97f5-499a-940a-0b6de8d80e72"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:28.282345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-00dbb421-e5bc-40a7-bf6d-3af56fb2cf40 req-7985a3b5-cdba-4496-b033-2f0d8c96f809 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.284059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-00dbb421-e5bc-40a7-bf6d-3af56fb2cf40 req-7985a3b5-cdba-4496-b033-2f0d8c96f809 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.321214 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-00dbb421-e5bc-40a7-bf6d-3af56fb2cf40 req-7985a3b5-cdba-4496-b033-2f0d8c96f809 service nova] Creating event network-changed:ad6410c3-97f5-499a-940a-0b6de8d80e72 for instance 20b18bea-6f4e-458b-8c7b-94f9c18c14af on n-h1-764485-11 Jul 20 04:12:28.341519 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-00dbb421-e5bc-40a7-bf6d-3af56fb2cf40 req-7985a3b5-cdba-4496-b033-2f0d8c96f809 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102396 Jul 20 04:12:28.345677 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 344/695] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:28.353053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ed1b724b-f708-4099-a2ca-19c7a15d003f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:28.362110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ed1b724b-f708-4099-a2ca-19c7a15d003f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:28.381193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed1b724b-f708-4099-a2ca-19c7a15d003f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.390538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed1b724b-f708-4099-a2ca-19c7a15d003f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.400425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed1b724b-f708-4099-a2ca-19c7a15d003f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.401138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed1b724b-f708-4099-a2ca-19c7a15d003f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.535387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8e16e1ab-d610-4af9-8233-b75b6b647cd0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:28.548311 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8e16e1ab-d610-4af9-8233-b75b6b647cd0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.389944 Jul 20 04:12:28.558880 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 352/696] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:28 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:28.560645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c3e8f7b2-86f5-4ae2-84d9-bb578e944bf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:28.561280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c3e8f7b2-86f5-4ae2-84d9-bb578e944bf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:28.579025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3e8f7b2-86f5-4ae2-84d9-bb578e944bf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.579487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3e8f7b2-86f5-4ae2-84d9-bb578e944bf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.580301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3e8f7b2-86f5-4ae2-84d9-bb578e944bf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.580737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3e8f7b2-86f5-4ae2-84d9-bb578e944bf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.738880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c3e8f7b2-86f5-4ae2-84d9-bb578e944bf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:28.747763 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c3e8f7b2-86f5-4ae2-84d9-bb578e944bf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1217 microversion: 2.1 time: 0.194833 Jul 20 04:12:28.748353 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 353/697] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:28 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:28.748900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ed1b724b-f708-4099-a2ca-19c7a15d003f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:28.759545 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ed1b724b-f708-4099-a2ca-19c7a15d003f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1318 microversion: 2.1 time: 0.411066 Jul 20 04:12:28.760605 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 345/698] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:28 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:28.765832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-becc5592-4c56-4922-89b1-78c2321cb28d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da0ba60>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:28.774432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2101818166", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "732991214", "adminPass": "***", "networks": [{"uuid": "2fbd62ae-21ae-4a6f-8124-aa6b740a976d"}], "security_groups": [{"name": "tempest-securitygroup--36669340"}], "key_name": "tempest-keypair-1375586087", "user_data": "}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:28.840479 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-becc5592-4c56-4922-89b1-78c2321cb28d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.078212 Jul 20 04:12:28.846443 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 346/699] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:28 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:29.082084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] validate_networks() for [('2fbd62ae-21ae-4a6f-8124-aa6b740a976d', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:29.248760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7019fe8-e825-474d-8bcb-e5a5f33b3a03 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:29.249932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c7019fe8-e825-474d-8bcb-e5a5f33b3a03 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:29.267716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7019fe8-e825-474d-8bcb-e5a5f33b3a03 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:29.268606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7019fe8-e825-474d-8bcb-e5a5f33b3a03 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:29.271761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7019fe8-e825-474d-8bcb-e5a5f33b3a03 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:29.272278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7019fe8-e825-474d-8bcb-e5a5f33b3a03 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:29.807578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c7019fe8-e825-474d-8bcb-e5a5f33b3a03 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:29.818193 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c7019fe8-e825-474d-8bcb-e5a5f33b3a03 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1322 microversion: 2.1 time: 0.576996 Jul 20 04:12:29.819217 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 347/700] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:29 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:29.833488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dc11f2b7-565b-475d-969f-091c615f6331 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:29.834341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dc11f2b7-565b-475d-969f-091c615f6331 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:29.841788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc11f2b7-565b-475d-969f-091c615f6331 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:29.842788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc11f2b7-565b-475d-969f-091c615f6331 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:29.843739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc11f2b7-565b-475d-969f-091c615f6331 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:29.844324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc11f2b7-565b-475d-969f-091c615f6331 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.277586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dc11f2b7-565b-475d-969f-091c615f6331 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.299328 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dc11f2b7-565b-475d-969f-091c615f6331 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.477205 Jul 20 04:12:30.301801 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 348/701] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:29 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.314758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c1789fbd-cedb-4830-bf97-188318a61078 req-bffb7d1d-e877-4797-b45d-4f80eed03419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b5ae40-24a9-4b37-8920-8f32fd165dd8", "name": "network-vif-plugged", "status": "completed", "tag": "f1ae2766-bf4e-4f6c-b66b-eb30f89c64f2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:30.325116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c1789fbd-cedb-4830-bf97-188318a61078 req-bffb7d1d-e877-4797-b45d-4f80eed03419 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.326308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c1789fbd-cedb-4830-bf97-188318a61078 req-bffb7d1d-e877-4797-b45d-4f80eed03419 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.341656 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c1789fbd-cedb-4830-bf97-188318a61078 req-bffb7d1d-e877-4797-b45d-4f80eed03419 service nova] Creating event network-vif-plugged:f1ae2766-bf4e-4f6c-b66b-eb30f89c64f2 for instance 02b5ae40-24a9-4b37-8920-8f32fd165dd8 on n-h2-764485-11 Jul 20 04:12:30.347694 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c1789fbd-cedb-4830-bf97-188318a61078 req-bffb7d1d-e877-4797-b45d-4f80eed03419 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042646 Jul 20 04:12:30.352831 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 349/702] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:30.358604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3c1e2d88-bce3-4068-96a4-9b0c368e73e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.359793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3c1e2d88-bce3-4068-96a4-9b0c368e73e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:30.368588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c1e2d88-bce3-4068-96a4-9b0c368e73e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.369115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c1e2d88-bce3-4068-96a4-9b0c368e73e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.370022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c1e2d88-bce3-4068-96a4-9b0c368e73e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.370542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c1e2d88-bce3-4068-96a4-9b0c368e73e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.372133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:30.373255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:30.374120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:30.374795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:30.375429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:30.390789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.391768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.393010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.395207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.396077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:30.408493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=9 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:30.423698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Getting quotas for project 8300f36d34c9455aabd936f5d69e130f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:30.426292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=10,nova_api:UPDATE=15 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:30.431171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Getting quotas for user 8aa6cffe813a43769950e2e05c45c82b and project 8300f36d34c9455aabd936f5d69e130f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:30.456094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:30.459345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:30.506748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3c1e2d88-bce3-4068-96a4-9b0c368e73e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.519484 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b7dc2499-c7be-4563-a8e1-6240d7c37c96 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.758638 Jul 20 04:12:30.521916 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 354/703] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:28 2022] POST /compute/v2.1/servers => generated 400 bytes in 1773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:30.524684 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3c1e2d88-bce3-4068-96a4-9b0c368e73e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1271 microversion: 2.1 time: 0.169479 Jul 20 04:12:30.529968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec06a260-b5b2-4f54-83a9-52103d38a223 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.530864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ec06a260-b5b2-4f54-83a9-52103d38a223 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:30.535594 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 350/704] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.542214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec06a260-b5b2-4f54-83a9-52103d38a223 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.542811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec06a260-b5b2-4f54-83a9-52103d38a223 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.543368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9c3843d6-2341-4460-bf2b-76f72a3b7883 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d9e9550>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.543793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec06a260-b5b2-4f54-83a9-52103d38a223 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.544310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec06a260-b5b2-4f54-83a9-52103d38a223 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.626581 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9c3843d6-2341-4460-bf2b-76f72a3b7883 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.088039 Jul 20 04:12:30.638606 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 351/705] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.764275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ec06a260-b5b2-4f54-83a9-52103d38a223 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.773971 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ec06a260-b5b2-4f54-83a9-52103d38a223 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1318 microversion: 2.1 time: 0.250592 Jul 20 04:12:30.786987 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 355/706] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.792242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49f0499f-16d4-44b1-8360-a91db97a3dee tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.797310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-49f0499f-16d4-44b1-8360-a91db97a3dee tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:30.941469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-49f0499f-16d4-44b1-8360-a91db97a3dee tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.950769 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-49f0499f-16d4-44b1-8360-a91db97a3dee tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1263 microversion: 2.1 time: 0.162548 Jul 20 04:12:30.951371 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 356/707] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.974573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f54e5120-f082-4309-8a93-01ec8beabb1f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.977349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f54e5120-f082-4309-8a93-01ec8beabb1f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:31.007304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f54e5120-f082-4309-8a93-01ec8beabb1f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.007974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f54e5120-f082-4309-8a93-01ec8beabb1f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.016179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f54e5120-f082-4309-8a93-01ec8beabb1f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.019778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f54e5120-f082-4309-8a93-01ec8beabb1f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.261121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ae0f368e-1b38-453c-9bb3-4abb355478d4 tempest-QuotaClassesAdminTestJSON-673959077 tempest-QuotaClassesAdminTestJSON-673959077-project-admin] Calling method '.version_select at 0x7fbf9da45160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:31.262057 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:31.262057 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:12:31.274778 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ae0f368e-1b38-453c-9bb3-4abb355478d4 tempest-QuotaClassesAdminTestJSON-673959077 tempest-QuotaClassesAdminTestJSON-673959077-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.633749 Jul 20 04:12:31.276044 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 352/708] 10.222.0.20 () {58 vars in 1184 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:31.286200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-85d5771b-dad8-4175-bc01-bf630de34014 tempest-QuotaClassesAdminTestJSON-673959077 tempest-QuotaClassesAdminTestJSON-673959077-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9d9c4b80>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:31.289531 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:31.289531 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:12:31.416208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f54e5120-f082-4309-8a93-01ec8beabb1f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:31.438164 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f54e5120-f082-4309-8a93-01ec8beabb1f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1322 microversion: 2.1 time: 0.481318 Jul 20 04:12:31.439710 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 357/709] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:31.457828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1309c95a-b4aa-45f1-9ba6-07a0099d33f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:31.458810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1309c95a-b4aa-45f1-9ba6-07a0099d33f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:31.470507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1309c95a-b4aa-45f1-9ba6-07a0099d33f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.472618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1309c95a-b4aa-45f1-9ba6-07a0099d33f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.474882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1309c95a-b4aa-45f1-9ba6-07a0099d33f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.475889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1309c95a-b4aa-45f1-9ba6-07a0099d33f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.624328 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-85d5771b-dad8-4175-bc01-bf630de34014 tempest-QuotaClassesAdminTestJSON-673959077 tempest-QuotaClassesAdminTestJSON-673959077-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.340637 Jul 20 04:12:31.625685 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 353/710] 10.222.0.20 () {60 vars in 1205 bytes} [Wed Jul 20 04:12:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:31.634535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5bd7b1ae-6a9e-4289-ba3b-d30a8516860d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:31.635532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5bd7b1ae-6a9e-4289-ba3b-d30a8516860d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:31.645460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5bd7b1ae-6a9e-4289-ba3b-d30a8516860d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.645953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5bd7b1ae-6a9e-4289-ba3b-d30a8516860d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.651968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5bd7b1ae-6a9e-4289-ba3b-d30a8516860d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.652537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5bd7b1ae-6a9e-4289-ba3b-d30a8516860d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.060003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1309c95a-b4aa-45f1-9ba6-07a0099d33f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.069802 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1309c95a-b4aa-45f1-9ba6-07a0099d33f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.628835 Jul 20 04:12:32.071579 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 358/711] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:31 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:32.089142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2e81207c-27bc-4970-8b30-169b87d661bc tempest-QuotaClassesAdminTestJSON-673959077 tempest-QuotaClassesAdminTestJSON-673959077-project-admin] Calling method '.version_select at 0x7fbf9d91c280>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.090605 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:32.090605 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:32.107674 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2e81207c-27bc-4970-8b30-169b87d661bc tempest-QuotaClassesAdminTestJSON-673959077 tempest-QuotaClassesAdminTestJSON-673959077-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.034221 Jul 20 04:12:32.109356 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 359/712] 10.222.0.20 () {58 vars in 1184 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:32.117091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c255e636-b5df-4b1f-8390-11d0a299f451 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9ddaddc0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.141918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5bd7b1ae-6a9e-4289-ba3b-d30a8516860d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.153559 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5bd7b1ae-6a9e-4289-ba3b-d30a8516860d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1313 microversion: 2.1 time: 0.524504 Jul 20 04:12:32.160709 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 354/713] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:31 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:32.167441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-196add7d-ca96-412e-8fc5-65111cfcfefd tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.168256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-196add7d-ca96-412e-8fc5-65111cfcfefd tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:32.175476 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c255e636-b5df-4b1f-8390-11d0a299f451 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.064432 Jul 20 04:12:32.176245 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 360/714] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:32.185858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-196add7d-ca96-412e-8fc5-65111cfcfefd tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.185858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-196add7d-ca96-412e-8fc5-65111cfcfefd tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.185858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-196add7d-ca96-412e-8fc5-65111cfcfefd tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.186188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-196add7d-ca96-412e-8fc5-65111cfcfefd tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.192856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-585d9c13-d44c-4a01-9777-a55b18de48db tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.193203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-585d9c13-d44c-4a01-9777-a55b18de48db tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:32.212241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-585d9c13-d44c-4a01-9777-a55b18de48db tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.214008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-585d9c13-d44c-4a01-9777-a55b18de48db tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.216808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-585d9c13-d44c-4a01-9777-a55b18de48db tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.221222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-585d9c13-d44c-4a01-9777-a55b18de48db tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.336125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-585d9c13-d44c-4a01-9777-a55b18de48db tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.351814 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-585d9c13-d44c-4a01-9777-a55b18de48db tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1267 microversion: 2.1 time: 0.171313 Jul 20 04:12:32.353323 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 361/715] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:32.367262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ddf596f2-d698-4793-8c67-d9c4453c2e41 tempest-QuotaClassesAdminTestJSON-673959077 tempest-QuotaClassesAdminTestJSON-673959077-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9dc53dc0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:32.371170 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:32.371170 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:12:32.485916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-196add7d-ca96-412e-8fc5-65111cfcfefd tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.497109 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-196add7d-ca96-412e-8fc5-65111cfcfefd tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1318 microversion: 2.1 time: 0.335224 Jul 20 04:12:32.499083 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 355/716] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:32.504822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8349550c-9f6f-4c51-b2a1-85c5bcf88814 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.506251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8349550c-9f6f-4c51-b2a1-85c5bcf88814 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:32.516888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8349550c-9f6f-4c51-b2a1-85c5bcf88814 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.517453 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ddf596f2-d698-4793-8c67-d9c4453c2e41 tempest-QuotaClassesAdminTestJSON-673959077 tempest-QuotaClassesAdminTestJSON-673959077-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.162551 Jul 20 04:12:32.518333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8349550c-9f6f-4c51-b2a1-85c5bcf88814 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.518650 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 362/717] 10.222.0.20 () {60 vars in 1205 bytes} [Wed Jul 20 04:12:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:32.519875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8349550c-9f6f-4c51-b2a1-85c5bcf88814 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.520468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8349550c-9f6f-4c51-b2a1-85c5bcf88814 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.806784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8349550c-9f6f-4c51-b2a1-85c5bcf88814 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.814385 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8349550c-9f6f-4c51-b2a1-85c5bcf88814 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1322 microversion: 2.1 time: 0.313574 Jul 20 04:12:32.824242 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 356/718] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:32.831637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-aa7994cc-f1b8-437c-b34f-a5caeaec8b59 req-bd0392f5-830c-4323-8321-da79bef27a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50659bf-f42b-4cb4-899f-20eeaf84e5c1", "name": "network-vif-deleted", "tag": "81234abf-cf0a-4b1c-aace-641cfdd0a454"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:32.841476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-aa7994cc-f1b8-437c-b34f-a5caeaec8b59 req-bd0392f5-830c-4323-8321-da79bef27a02 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.842166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-aa7994cc-f1b8-437c-b34f-a5caeaec8b59 req-bd0392f5-830c-4323-8321-da79bef27a02 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.855686 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-aa7994cc-f1b8-437c-b34f-a5caeaec8b59 req-bd0392f5-830c-4323-8321-da79bef27a02 service nova] Creating event network-vif-deleted:81234abf-cf0a-4b1c-aace-641cfdd0a454 for instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 on n-h2-764485-11 Jul 20 04:12:32.862835 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-aa7994cc-f1b8-437c-b34f-a5caeaec8b59 req-bd0392f5-830c-4323-8321-da79bef27a02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034996 Jul 20 04:12:32.863461 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 363/719] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:33.088338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f998568f-14a5-42da-80b5-c9f28fb8654f tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9d98b790>, body: {"quota_set": {"ram": "5120"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:33.089877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d41ebaa5-805b-44d4-a082-0a02925e2459 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:33.090760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d41ebaa5-805b-44d4-a082-0a02925e2459 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:33.099478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d41ebaa5-805b-44d4-a082-0a02925e2459 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.100111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d41ebaa5-805b-44d4-a082-0a02925e2459 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.101149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d41ebaa5-805b-44d4-a082-0a02925e2459 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.101859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d41ebaa5-805b-44d4-a082-0a02925e2459 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.201498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f998568f-14a5-42da-80b5-c9f28fb8654f tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.201958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f998568f-14a5-42da-80b5-c9f28fb8654f tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.202758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f998568f-14a5-42da-80b5-c9f28fb8654f tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.203378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f998568f-14a5-42da-80b5-c9f28fb8654f tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.256608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=12,nova_api:INSERT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:33.279188 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f998568f-14a5-42da-80b5-c9f28fb8654f tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f08aac82cb784d85ad05b8170c01a215" status: 200 len: 148 microversion: 2.57 time: 0.367482 Jul 20 04:12:33.280468 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 357/720] 10.222.0.20 () {62 vars in 1302 bytes} [Wed Jul 20 04:12:32 2022] PUT /compute/v2.1/os-quota-sets/f08aac82cb784d85ad05b8170c01a215 => generated 148 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:12:33.292303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f306410b-2211-4f64-a879-bbbd1a603086 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:33.293718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f306410b-2211-4f64-a879-bbbd1a603086 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:33.300907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f306410b-2211-4f64-a879-bbbd1a603086 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.301365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f306410b-2211-4f64-a879-bbbd1a603086 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.302154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f306410b-2211-4f64-a879-bbbd1a603086 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.302600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f306410b-2211-4f64-a879-bbbd1a603086 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.512376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d41ebaa5-805b-44d4-a082-0a02925e2459 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:33.526377 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d41ebaa5-805b-44d4-a082-0a02925e2459 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.441989 Jul 20 04:12:33.528201 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 364/721] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:33 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:33.528601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f306410b-2211-4f64-a879-bbbd1a603086 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:33.536553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f14eb5c9-45e8-4068-9988-0da4f2b24d5c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9db03040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:33.537460 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f306410b-2211-4f64-a879-bbbd1a603086 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1313 microversion: 2.1 time: 0.255806 Jul 20 04:12:33.540646 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 358/722] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:33 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:33.549312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-2133f33f-3903-4160-9676-d77a731b38fd req-4b5c8eaa-27c1-498a-8038-dfbf32234132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d355750-c712-4f8f-82bb-87880f3153bc", "name": "network-vif-plugged", "status": "completed", "tag": "3a853edd-2513-410e-a5a1-bd2350967d5f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:33.570425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2133f33f-3903-4160-9676-d77a731b38fd req-4b5c8eaa-27c1-498a-8038-dfbf32234132 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.574704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2133f33f-3903-4160-9676-d77a731b38fd req-4b5c8eaa-27c1-498a-8038-dfbf32234132 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.597189 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-2133f33f-3903-4160-9676-d77a731b38fd req-4b5c8eaa-27c1-498a-8038-dfbf32234132 service nova] Creating event network-vif-plugged:3a853edd-2513-410e-a5a1-bd2350967d5f for instance 1d355750-c712-4f8f-82bb-87880f3153bc on n-h1-764485-11 Jul 20 04:12:33.609228 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-2133f33f-3903-4160-9676-d77a731b38fd req-4b5c8eaa-27c1-498a-8038-dfbf32234132 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067208 Jul 20 04:12:33.609830 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f14eb5c9-45e8-4068-9988-0da4f2b24d5c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.079526 Jul 20 04:12:33.610611 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 365/724] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:33 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:33.610732 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 359/724] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:33.639101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-edabf51f-57f5-4b3f-a52e-9f87ffb6a93f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:33.640325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-edabf51f-57f5-4b3f-a52e-9f87ffb6a93f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:33.647197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2beb82bb-517c-4bf6-9c0d-1fd475d88d52 tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Calling method '.version_select at 0x7fbf9dcb2c10>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:33.657555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edabf51f-57f5-4b3f-a52e-9f87ffb6a93f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.658035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edabf51f-57f5-4b3f-a52e-9f87ffb6a93f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.658854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edabf51f-57f5-4b3f-a52e-9f87ffb6a93f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.659480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edabf51f-57f5-4b3f-a52e-9f87ffb6a93f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.765420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2beb82bb-517c-4bf6-9c0d-1fd475d88d52 tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.765636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-edabf51f-57f5-4b3f-a52e-9f87ffb6a93f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:33.766617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2beb82bb-517c-4bf6-9c0d-1fd475d88d52 tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.767757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2beb82bb-517c-4bf6-9c0d-1fd475d88d52 tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.768451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2beb82bb-517c-4bf6-9c0d-1fd475d88d52 tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.778502 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-edabf51f-57f5-4b3f-a52e-9f87ffb6a93f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1315 microversion: 2.1 time: 0.165468 Jul 20 04:12:33.788668 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 360/725] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:33 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:33.793943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f0ef914c-151e-434a-9872-8573dacd4f43 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:33.794782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f0ef914c-151e-434a-9872-8573dacd4f43 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:33.801256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0ef914c-151e-434a-9872-8573dacd4f43 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.801960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0ef914c-151e-434a-9872-8573dacd4f43 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.802928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0ef914c-151e-434a-9872-8573dacd4f43 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.803632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0ef914c-151e-434a-9872-8573dacd4f43 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.826817 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2beb82bb-517c-4bf6-9c0d-1fd475d88d52 tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f08aac82cb784d85ad05b8170c01a215/detail" status: 200 len: 463 microversion: 2.57 time: 0.190687 Jul 20 04:12:33.828094 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 366/726] 10.222.0.20 () {60 vars in 1303 bytes} [Wed Jul 20 04:12:33 2022] GET /compute/v2.1/os-quota-sets/f08aac82cb784d85ad05b8170c01a215/detail => generated 463 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:12:33.836085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16788246-7e15-4bde-8171-8010dd5413c0 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:33.839396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-16788246-7e15-4bde-8171-8010dd5413c0 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:33.854540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16788246-7e15-4bde-8171-8010dd5413c0 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.860072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16788246-7e15-4bde-8171-8010dd5413c0 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.861998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16788246-7e15-4bde-8171-8010dd5413c0 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.862749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16788246-7e15-4bde-8171-8010dd5413c0 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.251168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f0ef914c-151e-434a-9872-8573dacd4f43 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.263929 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f0ef914c-151e-434a-9872-8573dacd4f43 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1318 microversion: 2.1 time: 0.473850 Jul 20 04:12:34.264855 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 361/727] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:33 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:34.290968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-035b7161-a90d-47f1-85c9-093cd575da8d tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9da04550>, body: {"quota_set": {"ram": "2048"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:34.387144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-16788246-7e15-4bde-8171-8010dd5413c0 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.397204 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-16788246-7e15-4bde-8171-8010dd5413c0 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1322 microversion: 2.1 time: 0.566454 Jul 20 04:12:34.413221 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 367/728] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:33 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:34.545512 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9376272f-1ce6-4528-9d70-625ec8abe6ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:34.546208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9376272f-1ce6-4528-9d70-625ec8abe6ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:34.562830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9376272f-1ce6-4528-9d70-625ec8abe6ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.574363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9376272f-1ce6-4528-9d70-625ec8abe6ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.575247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9376272f-1ce6-4528-9d70-625ec8abe6ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.575738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9376272f-1ce6-4528-9d70-625ec8abe6ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.729173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-035b7161-a90d-47f1-85c9-093cd575da8d tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.729646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-035b7161-a90d-47f1-85c9-093cd575da8d tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.730409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-035b7161-a90d-47f1-85c9-093cd575da8d tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.731026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-035b7161-a90d-47f1-85c9-093cd575da8d tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.779568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-035b7161-a90d-47f1-85c9-093cd575da8d tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.780338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-035b7161-a90d-47f1-85c9-093cd575da8d tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.781310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-035b7161-a90d-47f1-85c9-093cd575da8d tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.781911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-035b7161-a90d-47f1-85c9-093cd575da8d tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.853676 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-035b7161-a90d-47f1-85c9-093cd575da8d tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f08aac82cb784d85ad05b8170c01a215?user_id=5702e7ade23b4eb090822231b333cdcc" status: 200 len: 148 microversion: 2.57 time: 0.567744 Jul 20 04:12:34.859347 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 362/729] 10.222.0.20 () {62 vars in 1383 bytes} [Wed Jul 20 04:12:34 2022] PUT /compute/v2.1/os-quota-sets/f08aac82cb784d85ad05b8170c01a215?user_id=5702e7ade23b4eb090822231b333cdcc => generated 148 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:12:34.864103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-fd1297cb-2299-45ee-ad0b-c227283c870e req-c669f24b-8c95-47ac-a2ed-7d9284df0c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "906f54b8-7d83-4249-8ba0-338f5f9e84db", "tag": "00cbe8c3-ad37-4de6-b8a0-f0227bf8bde6"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:34.874418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fd1297cb-2299-45ee-ad0b-c227283c870e req-c669f24b-8c95-47ac-a2ed-7d9284df0c68 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.874915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fd1297cb-2299-45ee-ad0b-c227283c870e req-c669f24b-8c95-47ac-a2ed-7d9284df0c68 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.886094 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-fd1297cb-2299-45ee-ad0b-c227283c870e req-c669f24b-8c95-47ac-a2ed-7d9284df0c68 service nova] Creating event network-changed:00cbe8c3-ad37-4de6-b8a0-f0227bf8bde6 for instance 906f54b8-7d83-4249-8ba0-338f5f9e84db on n-h1-764485-11 Jul 20 04:12:34.890788 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-fd1297cb-2299-45ee-ad0b-c227283c870e req-c669f24b-8c95-47ac-a2ed-7d9284df0c68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035014 Jul 20 04:12:34.891576 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 363/730] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:34.896552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3ed2542f-9165-459f-ba5e-a004faec65ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:34.897654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3ed2542f-9165-459f-ba5e-a004faec65ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:34.903896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ed2542f-9165-459f-ba5e-a004faec65ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.904344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ed2542f-9165-459f-ba5e-a004faec65ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.905127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ed2542f-9165-459f-ba5e-a004faec65ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.905569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ed2542f-9165-459f-ba5e-a004faec65ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.913376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9376272f-1ce6-4528-9d70-625ec8abe6ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.923430 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9376272f-1ce6-4528-9d70-625ec8abe6ef tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1311 microversion: 2.1 time: 0.384329 Jul 20 04:12:34.924279 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 368/731] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:34 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1311 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:34.937115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8e46fb86-7f7a-4cb2-af96-608115ab9d95 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9ddaddc0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:34.992987 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8e46fb86-7f7a-4cb2-af96-608115ab9d95 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.066479 Jul 20 04:12:34.996185 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 369/732] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:34 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:35.002788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-374699f1-0558-4eb0-86c6-041a4f9043e6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:35.008151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-374699f1-0558-4eb0-86c6-041a4f9043e6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:35.017564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-374699f1-0558-4eb0-86c6-041a4f9043e6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.021996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-374699f1-0558-4eb0-86c6-041a4f9043e6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.023218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-374699f1-0558-4eb0-86c6-041a4f9043e6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.023797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-374699f1-0558-4eb0-86c6-041a4f9043e6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.169952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-374699f1-0558-4eb0-86c6-041a4f9043e6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:35.181386 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-374699f1-0558-4eb0-86c6-041a4f9043e6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1321 microversion: 2.1 time: 0.183774 Jul 20 04:12:35.182303 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 370/733] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:34 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:35.190049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c0384f41-457c-458d-8e51-aed6a20260eb tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] Calling method '.version_select at 0x7fbf9dcb25e0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:35.222779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3ed2542f-9165-459f-ba5e-a004faec65ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:35.235935 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3ed2542f-9165-459f-ba5e-a004faec65ec tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1313 microversion: 2.1 time: 0.343287 Jul 20 04:12:35.236989 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 364/734] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:34 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:35.282691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3b3024bf-aa85-4d87-bb46-c17452f58db9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:35.283389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3b3024bf-aa85-4d87-bb46-c17452f58db9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:35.297404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b3024bf-aa85-4d87-bb46-c17452f58db9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.298002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b3024bf-aa85-4d87-bb46-c17452f58db9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.298801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b3024bf-aa85-4d87-bb46-c17452f58db9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.299242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b3024bf-aa85-4d87-bb46-c17452f58db9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.490800 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c0384f41-457c-458d-8e51-aed6a20260eb tempest-QuotasAdminTestV257-76404101 tempest-QuotasAdminTestV257-76404101-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f08aac82cb784d85ad05b8170c01a215?user_id=5702e7ade23b4eb090822231b333cdcc" status: 200 len: 190 microversion: 2.57 time: 0.307191 Jul 20 04:12:35.491408 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 371/735] 10.222.0.20 () {60 vars in 1363 bytes} [Wed Jul 20 04:12:35 2022] GET /compute/v2.1/os-quota-sets/f08aac82cb784d85ad05b8170c01a215?user_id=5702e7ade23b4eb090822231b333cdcc => generated 190 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:12:35.499912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7821efac-4af7-48a4-a1e8-366bb0d41a24 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:35.500847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7821efac-4af7-48a4-a1e8-366bb0d41a24 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:35.508922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7821efac-4af7-48a4-a1e8-366bb0d41a24 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.509494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7821efac-4af7-48a4-a1e8-366bb0d41a24 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.510544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7821efac-4af7-48a4-a1e8-366bb0d41a24 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.511281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7821efac-4af7-48a4-a1e8-366bb0d41a24 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.834076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7821efac-4af7-48a4-a1e8-366bb0d41a24 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:35.843322 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7821efac-4af7-48a4-a1e8-366bb0d41a24 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1322 microversion: 2.1 time: 0.348660 Jul 20 04:12:35.849539 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 372/736] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:35 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:35.860521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3b3024bf-aa85-4d87-bb46-c17452f58db9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:35.869865 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3b3024bf-aa85-4d87-bb46-c17452f58db9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1318 microversion: 2.1 time: 0.591199 Jul 20 04:12:35.881204 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 365/737] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:35 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1318 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:35.943630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c00b95a5-e9d4-4b10-be69-f80cc9c36e42 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:35.948312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c00b95a5-e9d4-4b10-be69-f80cc9c36e42 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:35.968587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c00b95a5-e9d4-4b10-be69-f80cc9c36e42 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.970311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c00b95a5-e9d4-4b10-be69-f80cc9c36e42 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.975233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c00b95a5-e9d4-4b10-be69-f80cc9c36e42 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.977467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c00b95a5-e9d4-4b10-be69-f80cc9c36e42 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.006504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2cf6d016-398b-4084-bd2b-cfce7ff7ba58 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d98baf0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.113388 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2cf6d016-398b-4084-bd2b-cfce7ff7ba58 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.110978 Jul 20 04:12:36.114335 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 366/738] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:36 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:36.199642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ce1d3d7c-431c-478d-8fba-ba4d29c6fbcf tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.200531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ce1d3d7c-431c-478d-8fba-ba4d29c6fbcf tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:36.227787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce1d3d7c-431c-478d-8fba-ba4d29c6fbcf tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.228803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce1d3d7c-431c-478d-8fba-ba4d29c6fbcf tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.239340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce1d3d7c-431c-478d-8fba-ba4d29c6fbcf tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.240197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce1d3d7c-431c-478d-8fba-ba4d29c6fbcf tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.425350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ce1d3d7c-431c-478d-8fba-ba4d29c6fbcf tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:36.440417 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ce1d3d7c-431c-478d-8fba-ba4d29c6fbcf tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1321 microversion: 2.1 time: 0.246029 Jul 20 04:12:36.441084 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 367/739] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:36 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:36.446396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5c94373b-59fa-4146-8963-eb04439e3205 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.448612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5c94373b-59fa-4146-8963-eb04439e3205 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:36.462462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c94373b-59fa-4146-8963-eb04439e3205 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.463342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c94373b-59fa-4146-8963-eb04439e3205 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.464468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c94373b-59fa-4146-8963-eb04439e3205 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.465069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c94373b-59fa-4146-8963-eb04439e3205 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.532005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c00b95a5-e9d4-4b10-be69-f80cc9c36e42 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:36.544984 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c00b95a5-e9d4-4b10-be69-f80cc9c36e42 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1494 microversion: 2.1 time: 0.608888 Jul 20 04:12:36.546160 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 373/740] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:35 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1494 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:36.569517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b85f424c-ab8f-4306-ba8b-a9dfe5847368 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.573830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b85f424c-ab8f-4306-ba8b-a9dfe5847368 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:36.585488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b85f424c-ab8f-4306-ba8b-a9dfe5847368 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.592202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b85f424c-ab8f-4306-ba8b-a9dfe5847368 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.593947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b85f424c-ab8f-4306-ba8b-a9dfe5847368 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.594908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b85f424c-ab8f-4306-ba8b-a9dfe5847368 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.777102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5c94373b-59fa-4146-8963-eb04439e3205 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:36.787961 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5c94373b-59fa-4146-8963-eb04439e3205 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1313 microversion: 2.1 time: 0.345369 Jul 20 04:12:36.789777 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 368/741] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:36 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:36.831482 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b85f424c-ab8f-4306-ba8b-a9dfe5847368 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1647 microversion: 2.1 time: 0.271488 Jul 20 04:12:36.832366 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 374/742] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:36 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1647 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:36.848509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f96bb866-dab6-43cb-a5f9-7ced2d4bf791 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.849189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f96bb866-dab6-43cb-a5f9-7ced2d4bf791 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:36.859231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f96bb866-dab6-43cb-a5f9-7ced2d4bf791 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.860020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f96bb866-dab6-43cb-a5f9-7ced2d4bf791 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.861298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f96bb866-dab6-43cb-a5f9-7ced2d4bf791 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.869515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f96bb866-dab6-43cb-a5f9-7ced2d4bf791 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.872426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-38161f98-39eb-4c51-a713-c8b64e3c78d4 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.874469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-38161f98-39eb-4c51-a713-c8b64e3c78d4 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:36.901772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38161f98-39eb-4c51-a713-c8b64e3c78d4 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.902689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38161f98-39eb-4c51-a713-c8b64e3c78d4 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.904148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38161f98-39eb-4c51-a713-c8b64e3c78d4 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.904914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38161f98-39eb-4c51-a713-c8b64e3c78d4 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.563796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-38161f98-39eb-4c51-a713-c8b64e3c78d4 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:37.577650 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-38161f98-39eb-4c51-a713-c8b64e3c78d4 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1472 microversion: 2.1 time: 0.713756 Jul 20 04:12:37.581531 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 375/743] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:36 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1472 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:37.591046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-83962b93-d24d-40a0-8d3f-097b5d333974 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:37.593212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-83962b93-d24d-40a0-8d3f-097b5d333974 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:37.601149 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f96bb866-dab6-43cb-a5f9-7ced2d4bf791 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1647 microversion: 2.1 time: 0.755976 Jul 20 04:12:37.601856 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 369/744] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:36 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1647 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:37.603655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83962b93-d24d-40a0-8d3f-097b5d333974 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.605014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83962b93-d24d-40a0-8d3f-097b5d333974 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.606362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83962b93-d24d-40a0-8d3f-097b5d333974 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.607058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83962b93-d24d-40a0-8d3f-097b5d333974 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.625374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9205628-73cc-45ba-b389-d38e1f4a1c7f tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d9b3790>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:37.661088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:37.699749 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b9205628-73cc-45ba-b389-d38e1f4a1c7f tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.082762 Jul 20 04:12:37.711644 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 370/745] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:37 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:37.717336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dcede0f2-00ef-43d7-82bb-e34f71af64eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:37.718163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dcede0f2-00ef-43d7-82bb-e34f71af64eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:37.728766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcede0f2-00ef-43d7-82bb-e34f71af64eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.729221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcede0f2-00ef-43d7-82bb-e34f71af64eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.734053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcede0f2-00ef-43d7-82bb-e34f71af64eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.734462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcede0f2-00ef-43d7-82bb-e34f71af64eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.953743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-83962b93-d24d-40a0-8d3f-097b5d333974 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:37.970456 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-83962b93-d24d-40a0-8d3f-097b5d333974 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1318 microversion: 2.1 time: 0.387052 Jul 20 04:12:37.972569 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 376/746] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:37 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:37.985550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-f58fe68e-9a79-42b3-950e-0d211255de32 req-95d617e4-e52c-4951-be6d-b1ede70fa6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b18bea-6f4e-458b-8c7b-94f9c18c14af", "name": "network-vif-plugged", "status": "completed", "tag": "ad6410c3-97f5-499a-940a-0b6de8d80e72"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:38.030553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f58fe68e-9a79-42b3-950e-0d211255de32 req-95d617e4-e52c-4951-be6d-b1ede70fa6f3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.031358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f58fe68e-9a79-42b3-950e-0d211255de32 req-95d617e4-e52c-4951-be6d-b1ede70fa6f3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.046335 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f58fe68e-9a79-42b3-950e-0d211255de32 req-95d617e4-e52c-4951-be6d-b1ede70fa6f3 service nova] Creating event network-vif-plugged:ad6410c3-97f5-499a-940a-0b6de8d80e72 for instance 20b18bea-6f4e-458b-8c7b-94f9c18c14af on n-h1-764485-11 Jul 20 04:12:38.052761 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-f58fe68e-9a79-42b3-950e-0d211255de32 req-95d617e4-e52c-4951-be6d-b1ede70fa6f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078640 Jul 20 04:12:38.054073 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 377/747] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:38.060521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f1d227da-7a6a-444b-a429-9e67f1581cf1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:38.061375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f1d227da-7a6a-444b-a429-9e67f1581cf1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:38.069436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1d227da-7a6a-444b-a429-9e67f1581cf1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.070739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1d227da-7a6a-444b-a429-9e67f1581cf1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.071991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1d227da-7a6a-444b-a429-9e67f1581cf1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.072947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1d227da-7a6a-444b-a429-9e67f1581cf1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.106861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f1d227da-7a6a-444b-a429-9e67f1581cf1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f1d227da-7a6a-444b-a429-9e67f1581cf1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Request method failure captured: Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc/diagnostics HTTP/1.1 Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Ce3JJBOdFvHwSGDH-vOnePtJFnoPH5QtjogUVMoly_YKk18QkhlvyN8psMzFaRIOfPOTINcD5Byp8Ij9nqLKoDcLJ9eK7e5ZUotTPUPDgR5jnxZkJYchvSEUTMOj8APre3mQML-C7IzACmtSi9-z9CgWbBfjd_VYHSDMDuQjFJ9Xk Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 017f9c01d11b4ecf9fb69d461bc624a8 Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1150199108 Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:12:38.109289 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:12:38.113270 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/017f9c01d11b4ecf9fb69d461bc624a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/017f9c01d11b4ecf9fb69d461bc624a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_017f9c01d11b4ecf9fb69d461bc624a8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/017f9c01d11b4ecf9fb69d461bc624a8"}]}] Jul 20 04:12:38.113270 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1150199108 Jul 20 04:12:38.113270 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 017f9c01d11b4ecf9fb69d461bc624a8 Jul 20 04:12:38.113270 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1150199108 Jul 20 04:12:38.113270 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerDiagnosticsNegativeTest-1150199108-project Jul 20 04:12:38.113270 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:12:38.113270 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:12:38.113270 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 9144c9cf0e9e48d38f49d3587012d74e Jul 20 04:12:38.113270 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1150199108-project Jul 20 04:12:38.113270 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:12:38.113270 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'server_id': '1d355750-c712-4f8f-82bb-87880f3153bc'} Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:12:38.115156 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 04:12:38.119168 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:38.123635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dcede0f2-00ef-43d7-82bb-e34f71af64eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.124353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f1d227da-7a6a-444b-a429-9e67f1581cf1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:38.124838 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f1d227da-7a6a-444b-a429-9e67f1581cf1 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.066987 Jul 20 04:12:38.125206 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dcede0f2-00ef-43d7-82bb-e34f71af64eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1387 microversion: 2.1 time: 0.411804 Jul 20 04:12:38.134672 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 371/748] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:37 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1387 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:38.137262 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 378/749] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:12:38 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc/diagnostics => generated 117 bytes in 82 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:38.147747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-feb853c5-f508-4cbc-8eff-fcc95b7b3964 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:38.149158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-feb853c5-f508-4cbc-8eff-fcc95b7b3964 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:38.155616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f5e77b61-4c6b-48db-8c53-95143dde03fe tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:38.157433 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:38.157433 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:12:38.159125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5e77b61-4c6b-48db-8c53-95143dde03fe tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.159576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-feb853c5-f508-4cbc-8eff-fcc95b7b3964 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.159716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5e77b61-4c6b-48db-8c53-95143dde03fe tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.160434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-feb853c5-f508-4cbc-8eff-fcc95b7b3964 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.161285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5e77b61-4c6b-48db-8c53-95143dde03fe tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.161734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5e77b61-4c6b-48db-8c53-95143dde03fe tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.162322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-feb853c5-f508-4cbc-8eff-fcc95b7b3964 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.162978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-feb853c5-f508-4cbc-8eff-fcc95b7b3964 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.235291 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f5e77b61-4c6b-48db-8c53-95143dde03fe tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.105642 Jul 20 04:12:38.257134 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 372/750] 10.222.0.20 () {58 vars in 1175 bytes} [Wed Jul 20 04:12:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:38.257392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7d63930d-5228-4a83-ba7a-292abba9662f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:38.263488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7d63930d-5228-4a83-ba7a-292abba9662f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:38.283630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d63930d-5228-4a83-ba7a-292abba9662f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.284280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d63930d-5228-4a83-ba7a-292abba9662f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.285227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d63930d-5228-4a83-ba7a-292abba9662f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.293981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d63930d-5228-4a83-ba7a-292abba9662f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.347929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7d63930d-5228-4a83-ba7a-292abba9662f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:12:38.470180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:38.483668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-feb853c5-f508-4cbc-8eff-fcc95b7b3964 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.497825 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-feb853c5-f508-4cbc-8eff-fcc95b7b3964 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1313 microversion: 2.1 time: 0.358930 Jul 20 04:12:38.498643 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 379/751] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:38 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:38.510984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57bffbd0-20e8-4479-a58d-5943b3f1ecbd tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:38.513231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-57bffbd0-20e8-4479-a58d-5943b3f1ecbd tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:38.521782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57bffbd0-20e8-4479-a58d-5943b3f1ecbd tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.523619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57bffbd0-20e8-4479-a58d-5943b3f1ecbd tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.527391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57bffbd0-20e8-4479-a58d-5943b3f1ecbd tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.528125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57bffbd0-20e8-4479-a58d-5943b3f1ecbd tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.530129 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7d63930d-5228-4a83-ba7a-292abba9662f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 204 len: 0 microversion: 2.1 time: 0.276103 Jul 20 04:12:38.530800 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 373/752] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:12:38 2022] DELETE /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:12:38.548510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-553b6172-40ce-4242-95ae-507df490f1ef tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:38.549363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-553b6172-40ce-4242-95ae-507df490f1ef tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:38.559016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-553b6172-40ce-4242-95ae-507df490f1ef tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.559467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-553b6172-40ce-4242-95ae-507df490f1ef tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.560608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-553b6172-40ce-4242-95ae-507df490f1ef tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.561207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-553b6172-40ce-4242-95ae-507df490f1ef tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.654964 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57bffbd0-20e8-4479-a58d-5943b3f1ecbd tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170/action" status: 202 len: 0 microversion: 2.1 time: 0.153448 Jul 20 04:12:38.655938 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 380/753] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:38 2022] POST /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:38.697392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db377f82-0ecf-4d45-b2cd-bbe8839a5c56 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:38.698412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-db377f82-0ecf-4d45-b2cd-bbe8839a5c56 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:38.707799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db377f82-0ecf-4d45-b2cd-bbe8839a5c56 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.709046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db377f82-0ecf-4d45-b2cd-bbe8839a5c56 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.710152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db377f82-0ecf-4d45-b2cd-bbe8839a5c56 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.710886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db377f82-0ecf-4d45-b2cd-bbe8839a5c56 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.981290 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-db377f82-0ecf-4d45-b2cd-bbe8839a5c56 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1652 microversion: 2.1 time: 0.300981 Jul 20 04:12:38.982077 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 381/754] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:38 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1652 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:38.991202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-92e8b22d-82f4-4b54-bc17-5112c15f438f tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc4dee0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:38.996381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-553b6172-40ce-4242-95ae-507df490f1ef tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:39.005764 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-553b6172-40ce-4242-95ae-507df490f1ef tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1478 microversion: 2.1 time: 0.468312 Jul 20 04:12:39.027449 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 374/755] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:38 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1478 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:39.074002 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-92e8b22d-82f4-4b54-bc17-5112c15f438f tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.091011 Jul 20 04:12:39.087838 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 382/756] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:38 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:39.095167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cdd44aba-0b78-4167-bbfa-ecb505b31ae3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:39.096113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cdd44aba-0b78-4167-bbfa-ecb505b31ae3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:39.103891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cdd44aba-0b78-4167-bbfa-ecb505b31ae3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.104606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cdd44aba-0b78-4167-bbfa-ecb505b31ae3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.105849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cdd44aba-0b78-4167-bbfa-ecb505b31ae3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.106548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cdd44aba-0b78-4167-bbfa-ecb505b31ae3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.316150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-88868ba6-14bc-4ef9-9a43-a677a636869e tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Calling method '.version_select at 0x7fbf9da0b040>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:39.432509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cdd44aba-0b78-4167-bbfa-ecb505b31ae3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:39.440817 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cdd44aba-0b78-4167-bbfa-ecb505b31ae3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1318 microversion: 2.1 time: 0.351201 Jul 20 04:12:39.446896 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 383/757] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:39 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:39.459499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-804b44fe-b310-4a08-b680-ba4d04b1ae0a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:39.460773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-804b44fe-b310-4a08-b680-ba4d04b1ae0a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:39.472880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-804b44fe-b310-4a08-b680-ba4d04b1ae0a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.475351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-804b44fe-b310-4a08-b680-ba4d04b1ae0a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.480125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-804b44fe-b310-4a08-b680-ba4d04b1ae0a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.480782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-804b44fe-b310-4a08-b680-ba4d04b1ae0a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.496461 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-88868ba6-14bc-4ef9-9a43-a677a636869e tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/a407fee4cdfe4b58abbc3c19301a2ee8" status: 200 len: 371 microversion: 2.1 time: 0.467919 Jul 20 04:12:39.498284 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 375/758] 10.222.0.20 () {58 vars in 1241 bytes} [Wed Jul 20 04:12:39 2022] GET /compute/v2.1/os-quota-sets/a407fee4cdfe4b58abbc3c19301a2ee8 => generated 371 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:39.513986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc6fe980-94d6-4c8d-8c96-c6d908d08b67 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9d9b3820>, body: {"quota_set": {"ram": "5120"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:39.612218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc6fe980-94d6-4c8d-8c96-c6d908d08b67 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.612901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc6fe980-94d6-4c8d-8c96-c6d908d08b67 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.613930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc6fe980-94d6-4c8d-8c96-c6d908d08b67 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.614684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc6fe980-94d6-4c8d-8c96-c6d908d08b67 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.700149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-804b44fe-b310-4a08-b680-ba4d04b1ae0a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:39.706229 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc6fe980-94d6-4c8d-8c96-c6d908d08b67 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/a407fee4cdfe4b58abbc3c19301a2ee8" status: 200 len: 328 microversion: 2.1 time: 0.201108 Jul 20 04:12:39.710068 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-804b44fe-b310-4a08-b680-ba4d04b1ae0a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1387 microversion: 2.1 time: 0.261851 Jul 20 04:12:39.713925 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 376/759] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:12:39 2022] PUT /compute/v2.1/os-quota-sets/a407fee4cdfe4b58abbc3c19301a2ee8 => generated 328 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:39.716685 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 384/760] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:39 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1387 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:39.722903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2b746966-ee61-4ff5-8337-6b31cad53d35 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:39.724122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2b746966-ee61-4ff5-8337-6b31cad53d35 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:39.728323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bbf63ec8-3d3a-426b-bc32-4aca19d43679 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:39.732870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b746966-ee61-4ff5-8337-6b31cad53d35 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.733507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b746966-ee61-4ff5-8337-6b31cad53d35 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.734958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b746966-ee61-4ff5-8337-6b31cad53d35 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.735840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b746966-ee61-4ff5-8337-6b31cad53d35 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.749512 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bbf63ec8-3d3a-426b-bc32-4aca19d43679 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-quota-sets/a407fee4cdfe4b58abbc3c19301a2ee8" status: 202 len: 0 microversion: 2.1 time: 0.031195 Jul 20 04:12:39.753834 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 385/761] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:12:39 2022] DELETE /compute/v2.1/os-quota-sets/a407fee4cdfe4b58abbc3c19301a2ee8 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:39.764155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9d024f3-0370-4af3-aa3c-b408494fbe7d tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Calling method '.version_select at 0x7fbf9dc4dd30>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:40.265591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2b746966-ee61-4ff5-8337-6b31cad53d35 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:40.277303 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2b746966-ee61-4ff5-8337-6b31cad53d35 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1313 microversion: 2.1 time: 0.562038 Jul 20 04:12:40.279455 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 377/762] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:39 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:40.284140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a1a972a6-4b14-4e3e-998c-aae1bf155f57 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:40.291626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a1a972a6-4b14-4e3e-998c-aae1bf155f57 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:40.308927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1a972a6-4b14-4e3e-998c-aae1bf155f57 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.310704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1a972a6-4b14-4e3e-998c-aae1bf155f57 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.312563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1a972a6-4b14-4e3e-998c-aae1bf155f57 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.315935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1a972a6-4b14-4e3e-998c-aae1bf155f57 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.485642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=12,nova_api:DELETE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:40.496172 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9d024f3-0370-4af3-aa3c-b408494fbe7d tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/a407fee4cdfe4b58abbc3c19301a2ee8" status: 200 len: 371 microversion: 2.1 time: 0.737145 Jul 20 04:12:40.499667 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 386/763] 10.222.0.20 () {58 vars in 1241 bytes} [Wed Jul 20 04:12:39 2022] GET /compute/v2.1/os-quota-sets/a407fee4cdfe4b58abbc3c19301a2ee8 => generated 371 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:40.512028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10f3038f-8abc-4877-8638-96cdff458195 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:40.518686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-10f3038f-8abc-4877-8638-96cdff458195 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:40.538543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10f3038f-8abc-4877-8638-96cdff458195 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.539034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10f3038f-8abc-4877-8638-96cdff458195 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.547058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10f3038f-8abc-4877-8638-96cdff458195 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:40.552116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10f3038f-8abc-4877-8638-96cdff458195 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.019722 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a1a972a6-4b14-4e3e-998c-aae1bf155f57 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1632 microversion: 2.1 time: 0.736983 Jul 20 04:12:41.020333 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 378/764] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:40 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1632 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:41.027192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7fca6991-7034-4bf0-a9ba-a4add284d003 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d952430>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:41.132343 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7fca6991-7034-4bf0-a9ba-a4add284d003 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.110033 Jul 20 04:12:41.133522 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 379/765] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:41 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:41.149626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3801bf5a-c5b1-461c-acef-470d414cfae1 req-3e8f36a0-eaf5-4788-ad5d-9fcaaed98d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2fb172-fa1a-40e0-83b2-eefc51238dad", "name": "network-vif-plugged", "status": "completed", "tag": "03823a3f-4130-4cb7-bb66-1b00475c7a36"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:41.179527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3801bf5a-c5b1-461c-acef-470d414cfae1 req-3e8f36a0-eaf5-4788-ad5d-9fcaaed98d1c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.180643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3801bf5a-c5b1-461c-acef-470d414cfae1 req-3e8f36a0-eaf5-4788-ad5d-9fcaaed98d1c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.207756 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3801bf5a-c5b1-461c-acef-470d414cfae1 req-3e8f36a0-eaf5-4788-ad5d-9fcaaed98d1c service nova] Creating event network-vif-plugged:03823a3f-4130-4cb7-bb66-1b00475c7a36 for instance 6c2fb172-fa1a-40e0-83b2-eefc51238dad on n-h2-764485-11 Jul 20 04:12:41.214069 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3801bf5a-c5b1-461c-acef-470d414cfae1 req-3e8f36a0-eaf5-4788-ad5d-9fcaaed98d1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069493 Jul 20 04:12:41.214589 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 380/766] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:41.221902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8006cbd5-3cad-410a-bf08-cd67f3fa5e81 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:41.222605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8006cbd5-3cad-410a-bf08-cd67f3fa5e81 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:41.238999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10f3038f-8abc-4877-8638-96cdff458195 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9144c9cf0e9e48d38f49d3587012d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017f9c01d11b4ecf9fb69d461bc624a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:41.253493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8006cbd5-3cad-410a-bf08-cd67f3fa5e81 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.253946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8006cbd5-3cad-410a-bf08-cd67f3fa5e81 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.254723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8006cbd5-3cad-410a-bf08-cd67f3fa5e81 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.255156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8006cbd5-3cad-410a-bf08-cd67f3fa5e81 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.255534 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-10f3038f-8abc-4877-8638-96cdff458195 tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 200 len: 1478 microversion: 2.1 time: 0.751924 Jul 20 04:12:41.265915 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 387/767] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:40 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 1478 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:41.272086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b5c4ed7-1122-4a86-9008-83c0f040b118 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Calling method '.version_select at 0x7fbf9dcb2c10>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:41.608650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8006cbd5-3cad-410a-bf08-cd67f3fa5e81 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:41.630319 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b5c4ed7-1122-4a86-9008-83c0f040b118 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/aabfc60943364df085ba649a1f710229/defaults" status: 200 len: 371 microversion: 2.1 time: 0.361792 Jul 20 04:12:41.630951 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 388/768] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:12:41 2022] GET /compute/v2.1/os-quota-sets/aabfc60943364df085ba649a1f710229/defaults => generated 371 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:41.644737 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8006cbd5-3cad-410a-bf08-cd67f3fa5e81 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1318 microversion: 2.1 time: 0.428754 Jul 20 04:12:41.645344 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 381/769] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:41 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:41.650458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-25aed745-7590-4db4-a5ac-2c8a0b0706bc req-c6045b4f-01bc-4961-bef3-3bcf8ea87dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1780efb-bbd4-44eb-8fd2-7edbfa5bd516", "tag": "bfb0a5af-cb59-4409-8bdf-6c7efcdb9959"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:41.662643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4566e165-6a1a-4978-bec6-9098c008479a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:41.663358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4566e165-6a1a-4978-bec6-9098c008479a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:41.674055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4566e165-6a1a-4978-bec6-9098c008479a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.674517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4566e165-6a1a-4978-bec6-9098c008479a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.675333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4566e165-6a1a-4978-bec6-9098c008479a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.685701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4566e165-6a1a-4978-bec6-9098c008479a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.701337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-25aed745-7590-4db4-a5ac-2c8a0b0706bc req-c6045b4f-01bc-4961-bef3-3bcf8ea87dd5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.701804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-25aed745-7590-4db4-a5ac-2c8a0b0706bc req-c6045b4f-01bc-4961-bef3-3bcf8ea87dd5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.737841 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-25aed745-7590-4db4-a5ac-2c8a0b0706bc req-c6045b4f-01bc-4961-bef3-3bcf8ea87dd5 service nova] Creating event network-changed:bfb0a5af-cb59-4409-8bdf-6c7efcdb9959 for instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 on n-h1-764485-11 Jul 20 04:12:41.746056 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-25aed745-7590-4db4-a5ac-2c8a0b0706bc req-c6045b4f-01bc-4961-bef3-3bcf8ea87dd5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099508 Jul 20 04:12:41.747138 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 382/770] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:41.755165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f238b641-04f0-47e2-a6b5-9fb3b5ab934c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-764485-11", "block_migration": true, "disk_over_commit": false}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:41.759806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f238b641-04f0-47e2-a6b5-9fb3b5ab934c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:41.776534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f238b641-04f0-47e2-a6b5-9fb3b5ab934c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.777253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f238b641-04f0-47e2-a6b5-9fb3b5ab934c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.788262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f238b641-04f0-47e2-a6b5-9fb3b5ab934c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.788990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f238b641-04f0-47e2-a6b5-9fb3b5ab934c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.834515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-f238b641-04f0-47e2-a6b5-9fb3b5ab934c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lazy-loading 'flavor' on Instance uuid c7e603c0-187a-46e9-a4c5-da5f3d5e9170 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:41.857413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f238b641-04f0-47e2-a6b5-9fb3b5ab934c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Going to try to live migrate instance to n-h1-764485-11 {{(pid=119807) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:12:42.366047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4566e165-6a1a-4978-bec6-9098c008479a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:42.381926 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4566e165-6a1a-4978-bec6-9098c008479a tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1387 microversion: 2.1 time: 0.749870 Jul 20 04:12:42.386728 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 389/771] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:41 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1387 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:42.402270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d3b4a3ec-3b50-4c09-a8b6-ed066fa46b88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:42.403881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d3b4a3ec-3b50-4c09-a8b6-ed066fa46b88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:42.418499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d3b4a3ec-3b50-4c09-a8b6-ed066fa46b88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:42.419431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d3b4a3ec-3b50-4c09-a8b6-ed066fa46b88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:42.420449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d3b4a3ec-3b50-4c09-a8b6-ed066fa46b88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:42.420907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d3b4a3ec-3b50-4c09-a8b6-ed066fa46b88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.038333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d3b4a3ec-3b50-4c09-a8b6-ed066fa46b88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:43.049799 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d3b4a3ec-3b50-4c09-a8b6-ed066fa46b88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1313 microversion: 2.1 time: 0.660117 Jul 20 04:12:43.050882 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 390/772] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:42 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1313 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:43.060035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a8d2d6b9-e026-4a9f-8e2b-e67df304ca1a req-db168d55-c350-443f-9e7d-333906492bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d355750-c712-4f8f-82bb-87880f3153bc", "name": "network-vif-deleted", "tag": "3a853edd-2513-410e-a5a1-bd2350967d5f"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:43.072271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a8d2d6b9-e026-4a9f-8e2b-e67df304ca1a req-db168d55-c350-443f-9e7d-333906492bb3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.073074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a8d2d6b9-e026-4a9f-8e2b-e67df304ca1a req-db168d55-c350-443f-9e7d-333906492bb3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.090294 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a8d2d6b9-e026-4a9f-8e2b-e67df304ca1a req-db168d55-c350-443f-9e7d-333906492bb3 service nova] Creating event network-vif-deleted:3a853edd-2513-410e-a5a1-bd2350967d5f for instance 1d355750-c712-4f8f-82bb-87880f3153bc on n-h1-764485-11 Jul 20 04:12:43.096908 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a8d2d6b9-e026-4a9f-8e2b-e67df304ca1a req-db168d55-c350-443f-9e7d-333906492bb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044385 Jul 20 04:12:43.098808 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 391/773] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:43.107785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ebee312-5799-4e7c-99da-6862f9710764 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9dc8b820>, body: {"quota_set": {"ram": "5120"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:43.373637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ebee312-5799-4e7c-99da-6862f9710764 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.374465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ebee312-5799-4e7c-99da-6862f9710764 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.375639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ebee312-5799-4e7c-99da-6862f9710764 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.376349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ebee312-5799-4e7c-99da-6862f9710764 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.462277 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8ebee312-5799-4e7c-99da-6862f9710764 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/9c2d3e782c0c46cd80fe40711a9a6822" status: 200 len: 328 microversion: 2.1 time: 0.360692 Jul 20 04:12:43.469764 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 392/774] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:12:43 2022] PUT /compute/v2.1/os-quota-sets/9c2d3e782c0c46cd80fe40711a9a6822 => generated 328 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:43.477358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b2cb687-fd69-4b5f-b18b-739ee83780c0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9db031f0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:43.532763 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b2cb687-fd69-4b5f-b18b-739ee83780c0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.061507 Jul 20 04:12:43.533776 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 393/775] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:43 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:43.540006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-700611ce-bac6-44ca-b6af-7b155d29b95f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:43.542133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-700611ce-bac6-44ca-b6af-7b155d29b95f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] [instance: 1d355750-c712-4f8f-82bb-87880f3153bc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:43.550470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-700611ce-bac6-44ca-b6af-7b155d29b95f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.551196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-700611ce-bac6-44ca-b6af-7b155d29b95f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.552301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-700611ce-bac6-44ca-b6af-7b155d29b95f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.552896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-700611ce-bac6-44ca-b6af-7b155d29b95f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.568022 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-700611ce-bac6-44ca-b6af-7b155d29b95f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] HTTP exception thrown: Instance 1d355750-c712-4f8f-82bb-87880f3153bc could not be found. Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-700611ce-bac6-44ca-b6af-7b155d29b95f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Request method failure captured: Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc HTTP/1.1 Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Ce3JJBOdFvHwSGDH-vOnePtJFnoPH5QtjogUVMoly_YKk18QkhlvyN8psMzFaRIOfPOTINcD5Byp8Ij9nqLKoDcLJ9eK7e5ZUotTPUPDgR5jnxZkJYchvSEUTMOj8APre3mQML-C7IzACmtSi9-z9CgWbBfjd_VYHSDMDuQjFJ9Xk Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 017f9c01d11b4ecf9fb69d461bc624a8 Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1150199108 Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:12:43.570270 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:12:43.572552 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/017f9c01d11b4ecf9fb69d461bc624a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/017f9c01d11b4ecf9fb69d461bc624a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_017f9c01d11b4ecf9fb69d461bc624a8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/017f9c01d11b4ecf9fb69d461bc624a8"}]}] Jul 20 04:12:43.572552 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1150199108 Jul 20 04:12:43.572552 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 017f9c01d11b4ecf9fb69d461bc624a8 Jul 20 04:12:43.572552 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1150199108 Jul 20 04:12:43.572552 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerDiagnosticsNegativeTest-1150199108-project Jul 20 04:12:43.572552 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:12:43.572552 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:12:43.572552 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 9144c9cf0e9e48d38f49d3587012d74e Jul 20 04:12:43.572552 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1150199108-project Jul 20 04:12:43.572552 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:12:43.572552 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 1d355750-c712-4f8f-82bb-87880f3153bc could not be found. Jul 20 04:12:43.572552 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1d355750-c712-4f8f-82bb-87880f3153bc'} Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d355750-c712-4f8f-82bb-87880f3153bc could not be found. Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:43.573433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d355750-c712-4f8f-82bb-87880f3153bc could not be found. Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d355750-c712-4f8f-82bb-87880f3153bc could not be found. Jul 20 04:12:43.574919 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:12:43.577344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-700611ce-bac6-44ca-b6af-7b155d29b95f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] Returning 404 to user: Instance 1d355750-c712-4f8f-82bb-87880f3153bc could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:43.578373 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-700611ce-bac6-44ca-b6af-7b155d29b95f tempest-ServerDiagnosticsNegativeTest-1150199108 tempest-ServerDiagnosticsNegativeTest-1150199108-project] 10.222.0.20 "GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc" status: 404 len: 111 microversion: 2.1 time: 0.043152 Jul 20 04:12:43.579590 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 394/776] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:43 2022] GET /compute/v2.1/servers/1d355750-c712-4f8f-82bb-87880f3153bc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:43.601743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c66b10f-f67f-4dcd-92aa-e2fa25a012a0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:43.604367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9c66b10f-f67f-4dcd-92aa-e2fa25a012a0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:43.619484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c66b10f-f67f-4dcd-92aa-e2fa25a012a0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.620469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c66b10f-f67f-4dcd-92aa-e2fa25a012a0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.622480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c66b10f-f67f-4dcd-92aa-e2fa25a012a0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.623793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c66b10f-f67f-4dcd-92aa-e2fa25a012a0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.965321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9c66b10f-f67f-4dcd-92aa-e2fa25a012a0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:43.974522 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c66b10f-f67f-4dcd-92aa-e2fa25a012a0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1318 microversion: 2.1 time: 0.393518 Jul 20 04:12:43.985895 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 395/777] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:43 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:43.991213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52dc2e99-03e9-451d-96dc-37df404101eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:43.992652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52dc2e99-03e9-451d-96dc-37df404101eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:44.004773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52dc2e99-03e9-451d-96dc-37df404101eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:44.006631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52dc2e99-03e9-451d-96dc-37df404101eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.008060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52dc2e99-03e9-451d-96dc-37df404101eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:44.008972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52dc2e99-03e9-451d-96dc-37df404101eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.260142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52dc2e99-03e9-451d-96dc-37df404101eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:44.275800 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52dc2e99-03e9-451d-96dc-37df404101eb tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1387 microversion: 2.1 time: 0.288302 Jul 20 04:12:44.278358 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 396/778] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:43 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1387 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:44.291359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1b39ff1e-d4c4-4c8a-8f21-e6d515b50936 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Calling method '.version_select at 0x7fbf9ddd39d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:44.631002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b39ff1e-d4c4-4c8a-8f21-e6d515b50936 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:44.631782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b39ff1e-d4c4-4c8a-8f21-e6d515b50936 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.633514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b39ff1e-d4c4-4c8a-8f21-e6d515b50936 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:44.634234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b39ff1e-d4c4-4c8a-8f21-e6d515b50936 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.665067 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1b39ff1e-d4c4-4c8a-8f21-e6d515b50936 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/9c2d3e782c0c46cd80fe40711a9a6822/detail" status: 200 len: 916 microversion: 2.1 time: 0.383904 Jul 20 04:12:44.666536 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 397/779] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:12:44 2022] GET /compute/v2.1/os-quota-sets/9c2d3e782c0c46cd80fe40711a9a6822/detail => generated 916 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:44.672214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0596b2e8-72b1-4288-ac95-1b128949cc9b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:44.673381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0596b2e8-72b1-4288-ac95-1b128949cc9b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:44.682723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0596b2e8-72b1-4288-ac95-1b128949cc9b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:44.683761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0596b2e8-72b1-4288-ac95-1b128949cc9b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.684789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0596b2e8-72b1-4288-ac95-1b128949cc9b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:44.685454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0596b2e8-72b1-4288-ac95-1b128949cc9b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.064422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0596b2e8-72b1-4288-ac95-1b128949cc9b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:45.084418 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0596b2e8-72b1-4288-ac95-1b128949cc9b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1313 microversion: 2.1 time: 0.416120 Jul 20 04:12:45.094713 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 398/780] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:44 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:45.114199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-459fefa9-6909-4736-84d1-f0bb4546e6b5 req-56a00cf9-02e3-4d82-ba98-6d9c6f3b9fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906f54b8-7d83-4249-8ba0-338f5f9e84db", "name": "network-vif-plugged", "status": "completed", "tag": "00cbe8c3-ad37-4de6-b8a0-f0227bf8bde6"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:45.130843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-459fefa9-6909-4736-84d1-f0bb4546e6b5 req-56a00cf9-02e3-4d82-ba98-6d9c6f3b9fed service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.131303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-459fefa9-6909-4736-84d1-f0bb4546e6b5 req-56a00cf9-02e3-4d82-ba98-6d9c6f3b9fed service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.228427 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-459fefa9-6909-4736-84d1-f0bb4546e6b5 req-56a00cf9-02e3-4d82-ba98-6d9c6f3b9fed service nova] Creating event network-vif-plugged:00cbe8c3-ad37-4de6-b8a0-f0227bf8bde6 for instance 906f54b8-7d83-4249-8ba0-338f5f9e84db on n-h1-764485-11 Jul 20 04:12:45.233923 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-459fefa9-6909-4736-84d1-f0bb4546e6b5 req-56a00cf9-02e3-4d82-ba98-6d9c6f3b9fed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137578 Jul 20 04:12:45.253008 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 399/781] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:45.284672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e5499305-d130-4820-be61-40a4c15dadaf tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9df37940>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:45.410079 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e5499305-d130-4820-be61-40a4c15dadaf tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.155404 Jul 20 04:12:45.415564 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 400/782] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:45 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:45.422486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-95c14145-a76e-46f7-9839-b6ed79920569 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:45.423503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-95c14145-a76e-46f7-9839-b6ed79920569 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:45.430288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95c14145-a76e-46f7-9839-b6ed79920569 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.430822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95c14145-a76e-46f7-9839-b6ed79920569 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.431938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95c14145-a76e-46f7-9839-b6ed79920569 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.432449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95c14145-a76e-46f7-9839-b6ed79920569 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.647023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-95c14145-a76e-46f7-9839-b6ed79920569 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:45.659125 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-95c14145-a76e-46f7-9839-b6ed79920569 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1468 microversion: 2.1 time: 0.241962 Jul 20 04:12:45.670728 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 401/783] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:45 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1468 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:45.670728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-96a85156-c215-4e5e-9996-e9e5f9983773 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:45.671456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-96a85156-c215-4e5e-9996-e9e5f9983773 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:45.683701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96a85156-c215-4e5e-9996-e9e5f9983773 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.684288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96a85156-c215-4e5e-9996-e9e5f9983773 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.685328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96a85156-c215-4e5e-9996-e9e5f9983773 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.685895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96a85156-c215-4e5e-9996-e9e5f9983773 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.711668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:45.927949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-96a85156-c215-4e5e-9996-e9e5f9983773 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:45.937016 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-96a85156-c215-4e5e-9996-e9e5f9983773 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1387 microversion: 2.1 time: 0.274195 Jul 20 04:12:45.941624 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 402/784] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:45 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1387 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:45.953381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1239ead1-b208-48b9-8595-344b2c70c755 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9e1ba550>, body: {"quota_set": {"ram": "2048"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:46.443413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1239ead1-b208-48b9-8595-344b2c70c755 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.444097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1239ead1-b208-48b9-8595-344b2c70c755 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.451597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1239ead1-b208-48b9-8595-344b2c70c755 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.453251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1239ead1-b208-48b9-8595-344b2c70c755 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.581774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1239ead1-b208-48b9-8595-344b2c70c755 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.582242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1239ead1-b208-48b9-8595-344b2c70c755 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.583176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1239ead1-b208-48b9-8595-344b2c70c755 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.585046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1239ead1-b208-48b9-8595-344b2c70c755 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.801444 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1239ead1-b208-48b9-8595-344b2c70c755 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/9c2d3e782c0c46cd80fe40711a9a6822?user_id=103b6ff2913443cc8398037cd87b0b2c" status: 200 len: 328 microversion: 2.1 time: 0.858324 Jul 20 04:12:46.803116 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 403/785] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:12:45 2022] PUT /compute/v2.1/os-quota-sets/9c2d3e782c0c46cd80fe40711a9a6822?user_id=103b6ff2913443cc8398037cd87b0b2c => generated 328 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:46.816711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2dfc732c-ab00-45d2-b66c-58a63b520770 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:46.822142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2dfc732c-ab00-45d2-b66c-58a63b520770 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 20b18bea-6f4e-458b-8c7b-94f9c18c14af] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:46.841051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2dfc732c-ab00-45d2-b66c-58a63b520770 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.841788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2dfc732c-ab00-45d2-b66c-58a63b520770 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.844760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2dfc732c-ab00-45d2-b66c-58a63b520770 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.845379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2dfc732c-ab00-45d2-b66c-58a63b520770 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:47.635352 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f238b641-04f0-47e2-a6b5-9fb3b5ab934c tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170/action" status: 202 len: 0 microversion: 2.1 time: 5.886674 Jul 20 04:12:47.636442 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 383/786] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:41 2022] POST /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170/action => generated 0 bytes in 5888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:47.648756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-be9d1c60-ed46-4579-b342-8ff0fc2029e0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:47.659938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-be9d1c60-ed46-4579-b342-8ff0fc2029e0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:47.687532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be9d1c60-ed46-4579-b342-8ff0fc2029e0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:47.692381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be9d1c60-ed46-4579-b342-8ff0fc2029e0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:47.693627 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be9d1c60-ed46-4579-b342-8ff0fc2029e0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:47.697235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be9d1c60-ed46-4579-b342-8ff0fc2029e0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:47.877009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2dfc732c-ab00-45d2-b66c-58a63b520770 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:47.888279 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2dfc732c-ab00-45d2-b66c-58a63b520770 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af" status: 200 len: 1468 microversion: 2.1 time: 1.083830 Jul 20 04:12:47.892256 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 404/787] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:46 2022] GET /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af => generated 1468 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:47.905153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0936be97-d9c4-4aab-91c8-0813fb434006 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc4d9d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:48.010477 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0936be97-d9c4-4aab-91c8-0813fb434006 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.115050 Jul 20 04:12:48.012260 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 405/788] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:47 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:48.018193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2cb17f5d-e021-4f67-978e-a8b0e475904a tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Calling method '.version_select at 0x7fbf9dec5820>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:48.040865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-be9d1c60-ed46-4579-b342-8ff0fc2029e0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:48.052152 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-be9d1c60-ed46-4579-b342-8ff0fc2029e0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1313 microversion: 2.1 time: 0.413003 Jul 20 04:12:48.055366 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 384/789] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:47 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:48.067384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7192f633-8e8f-49d5-8d05-6689bc576230 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:48.069292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7192f633-8e8f-49d5-8d05-6689bc576230 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:48.089758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7192f633-8e8f-49d5-8d05-6689bc576230 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.090217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7192f633-8e8f-49d5-8d05-6689bc576230 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.093311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7192f633-8e8f-49d5-8d05-6689bc576230 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.095494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7192f633-8e8f-49d5-8d05-6689bc576230 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.420150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7192f633-8e8f-49d5-8d05-6689bc576230 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:48.434917 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7192f633-8e8f-49d5-8d05-6689bc576230 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1387 microversion: 2.1 time: 0.375185 Jul 20 04:12:48.436158 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 385/790] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:48 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1387 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:48.444160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7555190a-71bd-4ee3-84ca-372818e35681 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:48.445740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7555190a-71bd-4ee3-84ca-372818e35681 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:48.457044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7555190a-71bd-4ee3-84ca-372818e35681 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.457880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7555190a-71bd-4ee3-84ca-372818e35681 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.460111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7555190a-71bd-4ee3-84ca-372818e35681 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.461567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7555190a-71bd-4ee3-84ca-372818e35681 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.739023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7555190a-71bd-4ee3-84ca-372818e35681 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:48.750984 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7555190a-71bd-4ee3-84ca-372818e35681 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1504 microversion: 2.1 time: 0.313597 Jul 20 04:12:48.754235 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 386/791] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:48 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:48.767902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c8fc5380-1e31-47da-9fdf-106b8a5901eb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:48.777432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c8fc5380-1e31-47da-9fdf-106b8a5901eb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:48.779874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c8fc5380-1e31-47da-9fdf-106b8a5901eb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Searching by: {'reservation_id': 'r-fdf6wpn9', 'deleted': False, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:12:48.799838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:48.814426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8fc5380-1e31-47da-9fdf-106b8a5901eb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.818750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8fc5380-1e31-47da-9fdf-106b8a5901eb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.821238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8fc5380-1e31-47da-9fdf-106b8a5901eb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.823783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8fc5380-1e31-47da-9fdf-106b8a5901eb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.870856 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2cb17f5d-e021-4f67-978e-a8b0e475904a tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/9c2d3e782c0c46cd80fe40711a9a6822?user_id=103b6ff2913443cc8398037cd87b0b2c" status: 200 len: 370 microversion: 2.1 time: 0.857299 Jul 20 04:12:48.888033 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 406/792] 10.222.0.20 () {58 vars in 1322 bytes} [Wed Jul 20 04:12:48 2022] GET /compute/v2.1/os-quota-sets/9c2d3e782c0c46cd80fe40711a9a6822?user_id=103b6ff2913443cc8398037cd87b0b2c => generated 370 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:49.028952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-90a8a9a8-9b3d-41d8-beca-62936f3db238 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc53e50>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:49.130895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-c8fc5380-1e31-47da-9fdf-106b8a5901eb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:12:49.142268 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-90a8a9a8-9b3d-41d8-beca-62936f3db238 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.122010 Jul 20 04:12:49.147952 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 407/793] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:49 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:49.160221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b533d377-3861-4556-98db-09d5c05dabbb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:49.162114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b533d377-3861-4556-98db-09d5c05dabbb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:49.189901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b533d377-3861-4556-98db-09d5c05dabbb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.190387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b533d377-3861-4556-98db-09d5c05dabbb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.191263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b533d377-3861-4556-98db-09d5c05dabbb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.198283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b533d377-3861-4556-98db-09d5c05dabbb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.503835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=86,nova_cell0:UPDATE=7 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:49.516278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b533d377-3861-4556-98db-09d5c05dabbb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:49.528321 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b533d377-3861-4556-98db-09d5c05dabbb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1463 microversion: 2.1 time: 0.383900 Jul 20 04:12:49.528915 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 408/794] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:49 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1463 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:49.534122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c8fc5380-1e31-47da-9fdf-106b8a5901eb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:49.548372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52a82a08-9c01-46b2-b694-dffd1f239c6b tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:49.549385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52a82a08-9c01-46b2-b694-dffd1f239c6b tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:49.557278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8fc5380-1e31-47da-9fdf-106b8a5901eb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.559461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8fc5380-1e31-47da-9fdf-106b8a5901eb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.564612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52a82a08-9c01-46b2-b694-dffd1f239c6b tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.566383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52a82a08-9c01-46b2-b694-dffd1f239c6b tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.567905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52a82a08-9c01-46b2-b694-dffd1f239c6b tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.570743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52a82a08-9c01-46b2-b694-dffd1f239c6b tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.900462 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c8fc5380-1e31-47da-9fdf-106b8a5901eb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-fdf6wpn9" status: 200 len: 2929 microversion: 2.1 time: 1.144371 Jul 20 04:12:49.913597 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 387/795] 10.222.0.20 () {58 vars in 1196 bytes} [Wed Jul 20 04:12:48 2022] GET /compute/v2.1/servers/detail?reservation_id=r-fdf6wpn9 => generated 2929 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:49.913597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:49.920239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:49.946298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52a82a08-9c01-46b2-b694-dffd1f239c6b tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:49.958272 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52a82a08-9c01-46b2-b694-dffd1f239c6b tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1387 microversion: 2.1 time: 0.423184 Jul 20 04:12:49.959192 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 409/796] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:49 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1387 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:50.507173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:50.508619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:50.509826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:50.510438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:50.512435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1719288008", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:50.619144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:50.699439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:50.707279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Old instance type m1.heat2, new instance type m1.heat {{(pid=119807) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:12:50.725090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:50.725721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:50.726727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:50.736703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:50.739013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:51.038099 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a3216879-1c20-4fc0-a5a0-bbee7e038daf tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "POST /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db/action" status: 202 len: 0 microversion: 2.1 time: 1.134425 Jul 20 04:12:51.038099 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 388/797] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:49 2022] POST /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:51.042388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:51.043400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:51.044134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:51.044785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:51.045705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:51.048617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8765f90a-61ae-4c66-8fd9-6d08fe4cd5f8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.049229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8765f90a-61ae-4c66-8fd9-6d08fe4cd5f8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:51.061383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.061798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.062718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.063153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.089333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8765f90a-61ae-4c66-8fd9-6d08fe4cd5f8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.090067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8765f90a-61ae-4c66-8fd9-6d08fe4cd5f8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.090914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8765f90a-61ae-4c66-8fd9-6d08fe4cd5f8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.091356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8765f90a-61ae-4c66-8fd9-6d08fe4cd5f8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.119020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Getting quotas for project 5875a8f9aeef4ae09122649735d93375. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:51.138475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Getting quotas for user 61350a88f2664e6f9c6dee8a4186819b and project 5875a8f9aeef4ae09122649735d93375. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:51.196701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:51.201962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:51.312387 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2bf3c2d5-4819-4f11-ac35-f37276204566 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.351864 Jul 20 04:12:51.318030 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 410/798] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:51.343919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8973396d-99e4-4899-8b0d-9e968a1a4203 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.369342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:51.390307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8765f90a-61ae-4c66-8fd9-6d08fe4cd5f8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:51.421682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.compute.server_groups [None req-8973396d-99e4-4899-8b0d-9e968a1a4203 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Querying cell de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) for 2 instances {{(pid=119808) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:12:51.422964 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8765f90a-61ae-4c66-8fd9-6d08fe4cd5f8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1504 microversion: 2.1 time: 0.382034 Jul 20 04:12:51.422964 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 389/799] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:51.425597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8973396d-99e4-4899-8b0d-9e968a1a4203 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.428562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8973396d-99e4-4899-8b0d-9e968a1a4203 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.447453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8fccd1ea-a70a-464c-831a-bd46130c991d tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Calling method '.version_select at 0x7fbf9d9b39d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.472555 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8973396d-99e4-4899-8b0d-9e968a1a4203 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/70316b04-0172-4ec0-967d-d2a8b72e190a" status: 200 len: 271 microversion: 2.1 time: 0.153140 Jul 20 04:12:51.478889 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 411/800] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1/os-server-groups/70316b04-0172-4ec0-967d-d2a8b72e190a => generated 271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:51.488733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6db36f07-bc11-42f4-83af-dca5cff45660 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9ded2790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.583434 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6db36f07-bc11-42f4-83af-dca5cff45660 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.108485 Jul 20 04:12:51.590257 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 412/801] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:51.602669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4cf3ef4b-2a59-4891-827d-b73035f98853 req-ae61fc89-26a3-49ab-a4d1-2492536c98c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1780efb-bbd4-44eb-8fd2-7edbfa5bd516", "name": "network-vif-plugged", "status": "completed", "tag": "bfb0a5af-cb59-4409-8bdf-6c7efcdb9959"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:51.619742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4cf3ef4b-2a59-4891-827d-b73035f98853 req-ae61fc89-26a3-49ab-a4d1-2492536c98c9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.620318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4cf3ef4b-2a59-4891-827d-b73035f98853 req-ae61fc89-26a3-49ab-a4d1-2492536c98c9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.639282 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4cf3ef4b-2a59-4891-827d-b73035f98853 req-ae61fc89-26a3-49ab-a4d1-2492536c98c9 service nova] Creating event network-vif-plugged:bfb0a5af-cb59-4409-8bdf-6c7efcdb9959 for instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 on n-h1-764485-11 Jul 20 04:12:51.663393 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4cf3ef4b-2a59-4891-827d-b73035f98853 req-ae61fc89-26a3-49ab-a4d1-2492536c98c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071246 Jul 20 04:12:51.664992 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 413/802] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:51.673753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-94ae72bf-9a60-4fd3-8baf-eaf9762abdd3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.674735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-94ae72bf-9a60-4fd3-8baf-eaf9762abdd3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:51.684832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94ae72bf-9a60-4fd3-8baf-eaf9762abdd3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.685482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94ae72bf-9a60-4fd3-8baf-eaf9762abdd3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.687090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94ae72bf-9a60-4fd3-8baf-eaf9762abdd3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.687858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94ae72bf-9a60-4fd3-8baf-eaf9762abdd3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.703409 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8fccd1ea-a70a-464c-831a-bd46130c991d tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/aabfc60943364df085ba649a1f710229/defaults" status: 200 len: 371 microversion: 2.1 time: 0.266709 Jul 20 04:12:51.706798 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 390/803] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1/os-quota-sets/aabfc60943364df085ba649a1f710229/defaults => generated 371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:51.712648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-779e416f-9042-40b2-b4c7-3198b9069503 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.713275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-779e416f-9042-40b2-b4c7-3198b9069503 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:51.744131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-779e416f-9042-40b2-b4c7-3198b9069503 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.756526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-779e416f-9042-40b2-b4c7-3198b9069503 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.758607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-779e416f-9042-40b2-b4c7-3198b9069503 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.759919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-779e416f-9042-40b2-b4c7-3198b9069503 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.788980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:52.433681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-779e416f-9042-40b2-b4c7-3198b9069503 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:52.446624 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-779e416f-9042-40b2-b4c7-3198b9069503 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1472 microversion: 2.1 time: 0.738740 Jul 20 04:12:52.462864 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 391/804] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1472 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:52.468777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-950152888", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:52.476041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94ae72bf-9a60-4fd3-8baf-eaf9762abdd3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:52.490748 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-94ae72bf-9a60-4fd3-8baf-eaf9762abdd3 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1387 microversion: 2.1 time: 0.823732 Jul 20 04:12:52.492729 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 414/805] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1387 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:52.512635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e6e90b31-35e0-4f18-9167-34210dc9a273 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:52.513775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e6e90b31-35e0-4f18-9167-34210dc9a273 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:52.520204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6e90b31-35e0-4f18-9167-34210dc9a273 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.520935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6e90b31-35e0-4f18-9167-34210dc9a273 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.526387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6e90b31-35e0-4f18-9167-34210dc9a273 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.527503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6e90b31-35e0-4f18-9167-34210dc9a273 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.589406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:53.058754 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e6e90b31-35e0-4f18-9167-34210dc9a273 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1621 microversion: 2.1 time: 0.564712 Jul 20 04:12:53.066135 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 415/806] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:52 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1621 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:53.089603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aa52b9fc-461d-4382-8a54-5dc0c0494a68 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9dec5e50>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:53.269581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa52b9fc-461d-4382-8a54-5dc0c0494a68 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.274345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:53.275024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:53.275703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:53.276290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:53.276881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:53.280921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa52b9fc-461d-4382-8a54-5dc0c0494a68 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.285897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa52b9fc-461d-4382-8a54-5dc0c0494a68 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.286601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa52b9fc-461d-4382-8a54-5dc0c0494a68 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.326459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.327502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.328605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.329057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.383878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Getting quotas for project 5875a8f9aeef4ae09122649735d93375. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:53.403361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Getting quotas for user 61350a88f2664e6f9c6dee8a4186819b and project 5875a8f9aeef4ae09122649735d93375. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:53.454675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:53.465593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:53.605658 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f064456c-989a-4d92-bf56-4c545e4f54c4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.140938 Jul 20 04:12:53.613136 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 392/807] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:53.624133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-99bfdcea-ea00-45ff-9aff-74be8ec575e5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:53.646778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-99bfdcea-ea00-45ff-9aff-74be8ec575e5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:53.664502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99bfdcea-ea00-45ff-9aff-74be8ec575e5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.665092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99bfdcea-ea00-45ff-9aff-74be8ec575e5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.683261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99bfdcea-ea00-45ff-9aff-74be8ec575e5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.683931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99bfdcea-ea00-45ff-9aff-74be8ec575e5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.690403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:UPDATE=5,nova_cell0:SELECT=95 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:53.909759 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aa52b9fc-461d-4382-8a54-5dc0c0494a68 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/aabfc60943364df085ba649a1f710229" status: 200 len: 329 microversion: 2.1 time: 0.839292 Jul 20 04:12:53.911612 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 416/808] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Jul 20 04:12:53 2022] PUT /compute/v2.1/os-quota-sets/aabfc60943364df085ba649a1f710229 => generated 329 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:53.919435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6ec50bbc-e6e3-45bc-b4d9-a200f54adbe7 req-fb49d681-9286-4e3d-9e85-a7092dbec6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e603c0-187a-46e9-a4c5-da5f3d5e9170", "name": "network-vif-unplugged", "status": "completed", "tag": "bd71d3a7-7615-4097-8805-ca1d231d551c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:53.943775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6ec50bbc-e6e3-45bc-b4d9-a200f54adbe7 req-fb49d681-9286-4e3d-9e85-a7092dbec6d7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.946129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6ec50bbc-e6e3-45bc-b4d9-a200f54adbe7 req-fb49d681-9286-4e3d-9e85-a7092dbec6d7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.975176 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6ec50bbc-e6e3-45bc-b4d9-a200f54adbe7 req-fb49d681-9286-4e3d-9e85-a7092dbec6d7 service nova] Creating event network-vif-unplugged:bd71d3a7-7615-4097-8805-ca1d231d551c for instance c7e603c0-187a-46e9-a4c5-da5f3d5e9170 on n-h2-764485-11 Jul 20 04:12:53.990971 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6ec50bbc-e6e3-45bc-b4d9-a200f54adbe7 req-fb49d681-9286-4e3d-9e85-a7092dbec6d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078091 Jul 20 04:12:53.994885 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 417/809] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:54.004738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c58816bb-79ef-4677-8782-260472159617 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9df05940>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:54.093281 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c58816bb-79ef-4677-8782-260472159617 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.093953 Jul 20 04:12:54.094394 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 418/810] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:53 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:54.099339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fc83056b-e806-47fa-bac8-604029a2a8de tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:54.100292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fc83056b-e806-47fa-bac8-604029a2a8de tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] [instance: 20b18bea-6f4e-458b-8c7b-94f9c18c14af] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:54.108214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-99bfdcea-ea00-45ff-9aff-74be8ec575e5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:54.112471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc83056b-e806-47fa-bac8-604029a2a8de tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.113492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc83056b-e806-47fa-bac8-604029a2a8de tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.115102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc83056b-e806-47fa-bac8-604029a2a8de tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.115868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc83056b-e806-47fa-bac8-604029a2a8de tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.121684 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-99bfdcea-ea00-45ff-9aff-74be8ec575e5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1504 microversion: 2.1 time: 0.507212 Jul 20 04:12:54.127830 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 393/811] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:53 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1504 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:54.134315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-684e05bb-c7f9-4c2d-bd9e-f515586d397f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:54.136196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-684e05bb-c7f9-4c2d-bd9e-f515586d397f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:54.156453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-684e05bb-c7f9-4c2d-bd9e-f515586d397f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.157112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-684e05bb-c7f9-4c2d-bd9e-f515586d397f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.158342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-684e05bb-c7f9-4c2d-bd9e-f515586d397f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.159040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-684e05bb-c7f9-4c2d-bd9e-f515586d397f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.003125 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fc83056b-e806-47fa-bac8-604029a2a8de tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af" status: 200 len: 1621 microversion: 2.1 time: 0.907317 Jul 20 04:12:55.003910 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 419/812] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:54 2022] GET /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af => generated 1621 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:55.034439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cbca407d-1ec1-48d6-bf1f-45c8bfbfe7d6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:55.035369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cbca407d-1ec1-48d6-bf1f-45c8bfbfe7d6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:55.061395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cbca407d-1ec1-48d6-bf1f-45c8bfbfe7d6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.063675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cbca407d-1ec1-48d6-bf1f-45c8bfbfe7d6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.066557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cbca407d-1ec1-48d6-bf1f-45c8bfbfe7d6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.068572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-684e05bb-c7f9-4c2d-bd9e-f515586d397f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:55.069651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cbca407d-1ec1-48d6-bf1f-45c8bfbfe7d6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.079047 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-684e05bb-c7f9-4c2d-bd9e-f515586d397f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1472 microversion: 2.1 time: 0.948532 Jul 20 04:12:55.084546 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 394/813] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:54 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1472 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:55.094795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-34e46ad4-63ed-4d3b-84a5-39ae769e4795 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:55.095643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-34e46ad4-63ed-4d3b-84a5-39ae769e4795 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:55.103538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34e46ad4-63ed-4d3b-84a5-39ae769e4795 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.104235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34e46ad4-63ed-4d3b-84a5-39ae769e4795 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.105193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34e46ad4-63ed-4d3b-84a5-39ae769e4795 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.105796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34e46ad4-63ed-4d3b-84a5-39ae769e4795 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.208893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-34e46ad4-63ed-4d3b-84a5-39ae769e4795 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:55.220523 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-34e46ad4-63ed-4d3b-84a5-39ae769e4795 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1209 microversion: 2.1 time: 0.134715 Jul 20 04:12:55.222554 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 395/814] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:55 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1209 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:55.348999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4d054d70-8b5b-4d64-b296-93086c6403f9 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] Action: 'create', calling method: .version_select at 0x7fbf9dae5a60>, body: {"pool": null} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:55.801164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cbca407d-1ec1-48d6-bf1f-45c8bfbfe7d6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:55.814387 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cbca407d-1ec1-48d6-bf1f-45c8bfbfe7d6 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1586 microversion: 2.1 time: 0.809129 Jul 20 04:12:55.814993 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 420/815] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:55 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1586 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:55.840567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-92713f69-115d-43cf-bd42-1d01af145253 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9ddd3790>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:55.979311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92713f69-115d-43cf-bd42-1d01af145253 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.987339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92713f69-115d-43cf-bd42-1d01af145253 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.988327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92713f69-115d-43cf-bd42-1d01af145253 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.988813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92713f69-115d-43cf-bd42-1d01af145253 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.517276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=24,nova_api:UPDATE=10 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:56.699947 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-92713f69-115d-43cf-bd42-1d01af145253 tempest-QuotasAdminTestJSON-1233063022 tempest-QuotasAdminTestJSON-1233063022-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/aabfc60943364df085ba649a1f710229" status: 200 len: 329 microversion: 2.1 time: 0.867883 Jul 20 04:12:56.714473 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 421/816] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Jul 20 04:12:55 2022] PUT /compute/v2.1/os-quota-sets/aabfc60943364df085ba649a1f710229 => generated 329 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:56.737891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7c1a42bc-2696-476a-a950-42a334297034 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dab90d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:56.890640 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7c1a42bc-2696-476a-a950-42a334297034 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1451 microversion: 2.1 time: 0.174864 Jul 20 04:12:56.892601 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 422/817] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:56 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:56.902253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-908faabf-bb4f-4cf8-bd86-5415c064a396 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:56.904919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-908faabf-bb4f-4cf8-bd86-5415c064a396 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:56.927615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-908faabf-bb4f-4cf8-bd86-5415c064a396 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.930874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-908faabf-bb4f-4cf8-bd86-5415c064a396 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.932202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-908faabf-bb4f-4cf8-bd86-5415c064a396 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.933314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-908faabf-bb4f-4cf8-bd86-5415c064a396 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.433831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-908faabf-bb4f-4cf8-bd86-5415c064a396 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:57.450137 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-908faabf-bb4f-4cf8-bd86-5415c064a396 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1504 microversion: 2.1 time: 0.555129 Jul 20 04:12:57.459709 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 423/818] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:56 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1504 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:57.459709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1400853307", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "f32f3c69-0926-47e2-9498-38ca38aa5035"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:57.536922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:58.501896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:58.501896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:58.502241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:58.502594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:58.502832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:58.530148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.530603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.531412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.531888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.580329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:58.603279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:58.639721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:58.642097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:58.802057 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44b563e2-8ef0-49be-9999-8494c45b2040 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.339865 Jul 20 04:12:58.807479 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 424/819] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:58.822596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9a6495b4-4841-4613-8a30-bd7f54f2bedc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:58.831342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9a6495b4-4841-4613-8a30-bd7f54f2bedc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:58.849481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a6495b4-4841-4613-8a30-bd7f54f2bedc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.850189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a6495b4-4841-4613-8a30-bd7f54f2bedc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.852857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a6495b4-4841-4613-8a30-bd7f54f2bedc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.853711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a6495b4-4841-4613-8a30-bd7f54f2bedc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.140150 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9a6495b4-4841-4613-8a30-bd7f54f2bedc tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.330888 Jul 20 04:13:00.141487 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 425/820] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:12:58 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516/os-interface => generated 284 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:00.146537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-f35bb07d-8a2d-42b7-af2d-4090db8fbf22 req-22528aa3-1735-4182-a873-ab70c1794f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e603c0-187a-46e9-a4c5-da5f3d5e9170", "tag": "bd71d3a7-7615-4097-8805-ca1d231d551c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:00.168297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f35bb07d-8a2d-42b7-af2d-4090db8fbf22 req-22528aa3-1735-4182-a873-ab70c1794f34 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.168641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f35bb07d-8a2d-42b7-af2d-4090db8fbf22 req-22528aa3-1735-4182-a873-ab70c1794f34 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.192753 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f35bb07d-8a2d-42b7-af2d-4090db8fbf22 req-22528aa3-1735-4182-a873-ab70c1794f34 service nova] Creating event network-changed:bd71d3a7-7615-4097-8805-ca1d231d551c for instance c7e603c0-187a-46e9-a4c5-da5f3d5e9170 on n-h2-764485-11 Jul 20 04:13:00.205456 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-f35bb07d-8a2d-42b7-af2d-4090db8fbf22 req-22528aa3-1735-4182-a873-ab70c1794f34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062520 Jul 20 04:13:00.206086 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 426/821] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:00.219587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-adf8f8da-0b31-4b9c-837e-adfe51919139 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:00.220479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-adf8f8da-0b31-4b9c-837e-adfe51919139 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:00.231135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-adf8f8da-0b31-4b9c-837e-adfe51919139 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.236967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-adf8f8da-0b31-4b9c-837e-adfe51919139 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.238748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-adf8f8da-0b31-4b9c-837e-adfe51919139 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.239719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-adf8f8da-0b31-4b9c-837e-adfe51919139 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.993620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-adf8f8da-0b31-4b9c-837e-adfe51919139 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:01.002210 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-adf8f8da-0b31-4b9c-837e-adfe51919139 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.794945 Jul 20 04:13:01.003031 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 427/822] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:00 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:01.020825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-752a786b-8548-4844-8912-6d80118f37bf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.021704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-752a786b-8548-4844-8912-6d80118f37bf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:01.034585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-752a786b-8548-4844-8912-6d80118f37bf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.035351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-752a786b-8548-4844-8912-6d80118f37bf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.036700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-752a786b-8548-4844-8912-6d80118f37bf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.037447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-752a786b-8548-4844-8912-6d80118f37bf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.616207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-752a786b-8548-4844-8912-6d80118f37bf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:01.630320 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-752a786b-8548-4844-8912-6d80118f37bf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1313 microversion: 2.1 time: 0.615090 Jul 20 04:13:01.640963 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 428/823] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:01.649025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-68c4f98f-ace7-4133-b58a-b58533b78317 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9df1d3a0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.667055 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4d054d70-8b5b-4d64-b296-93086c6403f9 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.440373 Jul 20 04:13:01.668389 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 396/824] 10.222.0.20 () {60 vars in 1169 bytes} [Wed Jul 20 04:12:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:01.676628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-af4e653b-eae7-4a53-b05e-15a6c5721188 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.677271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-af4e653b-eae7-4a53-b05e-15a6c5721188 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:01.698338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af4e653b-eae7-4a53-b05e-15a6c5721188 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.698806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af4e653b-eae7-4a53-b05e-15a6c5721188 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.699644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af4e653b-eae7-4a53-b05e-15a6c5721188 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.700094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af4e653b-eae7-4a53-b05e-15a6c5721188 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.716851 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-68c4f98f-ace7-4133-b58a-b58533b78317 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1460 microversion: 2.1 time: 0.074062 Jul 20 04:13:01.717724 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 429/825] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1460 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:01.722875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ede0966f-14f9-469d-8982-2e19b54bef5b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.724258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ede0966f-14f9-469d-8982-2e19b54bef5b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:01.733590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ede0966f-14f9-469d-8982-2e19b54bef5b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.734307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ede0966f-14f9-469d-8982-2e19b54bef5b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.735292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ede0966f-14f9-469d-8982-2e19b54bef5b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.736035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ede0966f-14f9-469d-8982-2e19b54bef5b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.932376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ede0966f-14f9-469d-8982-2e19b54bef5b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:01.941821 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ede0966f-14f9-469d-8982-2e19b54bef5b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1275 microversion: 2.1 time: 0.222914 Jul 20 04:13:01.943572 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 430/826] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:01.951784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-33db746a-312a-451f-ab67-29985dae0a7c tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] Action: 'create', calling method: .version_select at 0x7fbf9dcb2ca0>, body: {"pool": null} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:02.548371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-af4e653b-eae7-4a53-b05e-15a6c5721188 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:02.563006 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-af4e653b-eae7-4a53-b05e-15a6c5721188 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1504 microversion: 2.1 time: 0.891430 Jul 20 04:13:02.564523 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 397/827] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1504 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:02.574067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-04df4d5e-a8dd-4c71-b5d6-a87e844d216d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da15040>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:02.672362 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-04df4d5e-a8dd-4c71-b5d6-a87e844d216d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 200 len: 1460 microversion: 2.1 time: 0.105493 Jul 20 04:13:02.676684 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 398/828] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:02 2022] GET /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 1460 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:02.683123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-51427af7-6e95-4491-a975-54fd2692c83f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:02.684127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-51427af7-6e95-4491-a975-54fd2692c83f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:02.704245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51427af7-6e95-4491-a975-54fd2692c83f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.705170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51427af7-6e95-4491-a975-54fd2692c83f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.709943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51427af7-6e95-4491-a975-54fd2692c83f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.711648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51427af7-6e95-4491-a975-54fd2692c83f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.359274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=15 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:03.430200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=7 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:03.655642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-51427af7-6e95-4491-a975-54fd2692c83f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:03.672769 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-51427af7-6e95-4491-a975-54fd2692c83f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.993931 Jul 20 04:13:03.674502 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 399/829] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:02 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:03.681272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-dede0803-6ef3-4d14-bd14-bad617825f49 req-c5822964-38df-45a1-b6b3-7c48c6bfe888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42b8c28-e93e-471e-b549-5718883dc7b6", "tag": "4266796f-8098-40de-be9c-26d7b872b741"}, {"server_uuid": "c7e603c0-187a-46e9-a4c5-da5f3d5e9170", "name": "network-vif-unplugged", "status": "completed", "tag": "bd71d3a7-7615-4097-8805-ca1d231d551c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:03.693807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dede0803-6ef3-4d14-bd14-bad617825f49 req-c5822964-38df-45a1-b6b3-7c48c6bfe888 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.694671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dede0803-6ef3-4d14-bd14-bad617825f49 req-c5822964-38df-45a1-b6b3-7c48c6bfe888 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.710875 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-dede0803-6ef3-4d14-bd14-bad617825f49 req-c5822964-38df-45a1-b6b3-7c48c6bfe888 service nova] Creating event network-changed:4266796f-8098-40de-be9c-26d7b872b741 for instance c42b8c28-e93e-471e-b549-5718883dc7b6 on n-h1-764485-11 Jul 20 04:13:03.714606 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-dede0803-6ef3-4d14-bd14-bad617825f49 req-c5822964-38df-45a1-b6b3-7c48c6bfe888 service nova] Creating event network-vif-unplugged:bd71d3a7-7615-4097-8805-ca1d231d551c for instance c7e603c0-187a-46e9-a4c5-da5f3d5e9170 on n-h2-764485-11 Jul 20 04:13:03.726739 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-dede0803-6ef3-4d14-bd14-bad617825f49 req-c5822964-38df-45a1-b6b3-7c48c6bfe888 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.049674 Jul 20 04:13:03.727784 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 400/830] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:03.733471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3b441c19-d7a4-4d32-a319-232951df4ffd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:03.734458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3b441c19-d7a4-4d32-a319-232951df4ffd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:03.742925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b441c19-d7a4-4d32-a319-232951df4ffd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.743599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b441c19-d7a4-4d32-a319-232951df4ffd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.744589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b441c19-d7a4-4d32-a319-232951df4ffd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.745371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b441c19-d7a4-4d32-a319-232951df4ffd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.582600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3b441c19-d7a4-4d32-a319-232951df4ffd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:04.601456 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3b441c19-d7a4-4d32-a319-232951df4ffd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1313 microversion: 2.1 time: 0.871231 Jul 20 04:13:04.603400 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 401/831] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:03 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1313 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:04.612425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dfbeaf6d-d0c9-45f9-b50f-c9692767cd1a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:04.614950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dfbeaf6d-d0c9-45f9-b50f-c9692767cd1a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:04.628607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dfbeaf6d-d0c9-45f9-b50f-c9692767cd1a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.629488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dfbeaf6d-d0c9-45f9-b50f-c9692767cd1a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.630461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dfbeaf6d-d0c9-45f9-b50f-c9692767cd1a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.631123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dfbeaf6d-d0c9-45f9-b50f-c9692767cd1a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:05.369960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dfbeaf6d-d0c9-45f9-b50f-c9692767cd1a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:05.384717 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dfbeaf6d-d0c9-45f9-b50f-c9692767cd1a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1466 microversion: 2.1 time: 0.779197 Jul 20 04:13:05.385834 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 402/832] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:04 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1466 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:05.401699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b584c8e4-49dc-4177-8fd2-58237e97c0a7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:05.402444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b584c8e4-49dc-4177-8fd2-58237e97c0a7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:05.409412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b584c8e4-49dc-4177-8fd2-58237e97c0a7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:05.410408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b584c8e4-49dc-4177-8fd2-58237e97c0a7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:05.412077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b584c8e4-49dc-4177-8fd2-58237e97c0a7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:05.412740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b584c8e4-49dc-4177-8fd2-58237e97c0a7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:05.740660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b584c8e4-49dc-4177-8fd2-58237e97c0a7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:05.749265 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b584c8e4-49dc-4177-8fd2-58237e97c0a7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1317 microversion: 2.1 time: 0.361479 Jul 20 04:13:05.750230 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 403/833] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:05 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:05.879497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1291912211", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:05.933849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:06.140618 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-33db746a-312a-451f-ab67-29985dae0a7c tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.194846 Jul 20 04:13:06.141630 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 431/834] 10.222.0.20 () {60 vars in 1169 bytes} [Wed Jul 20 04:13:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:06.146851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-042f7702-0f0f-4867-a469-78772cee32fc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:06.147554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-042f7702-0f0f-4867-a469-78772cee32fc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:06.156385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-042f7702-0f0f-4867-a469-78772cee32fc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.157272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-042f7702-0f0f-4867-a469-78772cee32fc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.158217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-042f7702-0f0f-4867-a469-78772cee32fc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.158957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-042f7702-0f0f-4867-a469-78772cee32fc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.274202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:06.274636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:06.275104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:06.275664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:06.275949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:06.287871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.289047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.289654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.290332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.329174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Getting quotas for project daa85be80057484a8e47c9ff76efc2c8. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:06.335571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Getting quotas for user f64c988993bd4107a8ba5103c143385d and project daa85be80057484a8e47c9ff76efc2c8. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:06.353626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:06.356391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:06.362661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-042f7702-0f0f-4867-a469-78772cee32fc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.364884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:06.372442 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-042f7702-0f0f-4867-a469-78772cee32fc tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1479 microversion: 2.1 time: 0.229287 Jul 20 04:13:06.373556 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 432/835] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:06 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1479 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:06.381068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6337d880-18ca-4768-aaea-dd5d80dcae2b req-260fd9e8-7eeb-4dcc-887e-8265ed0143e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3c36c5-27be-4732-b611-318b82de3094", "tag": "2bf3529a-e4e6-4908-b13f-8e1d8ee72c64"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:06.391063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6337d880-18ca-4768-aaea-dd5d80dcae2b req-260fd9e8-7eeb-4dcc-887e-8265ed0143e9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.391284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6337d880-18ca-4768-aaea-dd5d80dcae2b req-260fd9e8-7eeb-4dcc-887e-8265ed0143e9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.403912 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6337d880-18ca-4768-aaea-dd5d80dcae2b req-260fd9e8-7eeb-4dcc-887e-8265ed0143e9 service nova] Creating event network-changed:2bf3529a-e4e6-4908-b13f-8e1d8ee72c64 for instance 5f3c36c5-27be-4732-b611-318b82de3094 on n-h2-764485-11 Jul 20 04:13:06.410681 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6337d880-18ca-4768-aaea-dd5d80dcae2b req-260fd9e8-7eeb-4dcc-887e-8265ed0143e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035575 Jul 20 04:13:06.411615 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 433/836] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:06.416720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-30b240fc-0ff5-4652-bdd3-116fb9b3b3dd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:06.417427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-30b240fc-0ff5-4652-bdd3-116fb9b3b3dd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:06.420071 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2c985b1-eecd-453f-89e0-9b729cc6417d tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668679 Jul 20 04:13:06.421004 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 404/837] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:13:06.425892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f0ad9d0-6707-46cf-b0d0-f69ee18c9779 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:06.426586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0f0ad9d0-6707-46cf-b0d0-f69ee18c9779 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:06.430384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30b240fc-0ff5-4652-bdd3-116fb9b3b3dd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.430881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30b240fc-0ff5-4652-bdd3-116fb9b3b3dd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.431848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30b240fc-0ff5-4652-bdd3-116fb9b3b3dd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.432415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30b240fc-0ff5-4652-bdd3-116fb9b3b3dd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.434287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f0ad9d0-6707-46cf-b0d0-f69ee18c9779 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.434922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f0ad9d0-6707-46cf-b0d0-f69ee18c9779 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.435972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f0ad9d0-6707-46cf-b0d0-f69ee18c9779 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.436485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f0ad9d0-6707-46cf-b0d0-f69ee18c9779 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.667373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-30b240fc-0ff5-4652-bdd3-116fb9b3b3dd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.677717 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-30b240fc-0ff5-4652-bdd3-116fb9b3b3dd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.264362 Jul 20 04:13:06.680251 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 434/838] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:06 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:06.686637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0f1145b2-c578-43d7-ae2e-acc426740a78 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-795169631"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:06.687753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0f1145b2-c578-43d7-ae2e-acc426740a78 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:06.694999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f1145b2-c578-43d7-ae2e-acc426740a78 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.695747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f1145b2-c578-43d7-ae2e-acc426740a78 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.696754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f1145b2-c578-43d7-ae2e-acc426740a78 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.697227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f1145b2-c578-43d7-ae2e-acc426740a78 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.723722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0f0ad9d0-6707-46cf-b0d0-f69ee18c9779 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.739546 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f0ad9d0-6707-46cf-b0d0-f69ee18c9779 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1586 microversion: 2.1 time: 0.316827 Jul 20 04:13:06.742536 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 405/839] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:06 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1586 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:06.748782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ce0285a-7943-4e9f-aa06-c7fea7a091a0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:06.750032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ce0285a-7943-4e9f-aa06-c7fea7a091a0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:06.758114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ce0285a-7943-4e9f-aa06-c7fea7a091a0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.759787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ce0285a-7943-4e9f-aa06-c7fea7a091a0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.761159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ce0285a-7943-4e9f-aa06-c7fea7a091a0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.762139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ce0285a-7943-4e9f-aa06-c7fea7a091a0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.932086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ce0285a-7943-4e9f-aa06-c7fea7a091a0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.943008 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ce0285a-7943-4e9f-aa06-c7fea7a091a0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1313 microversion: 2.1 time: 0.199145 Jul 20 04:13:06.943818 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 406/840] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:06 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:06.951314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-404feae4-1a8c-45ea-b097-48d09df35815 req-1ca64e8e-819d-4328-8a47-869b54d8e4ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14dcab97-a96a-4c0d-9580-48f5ee096119", "tag": "f720b326-8d2c-474b-9bc7-7c7557c74c32"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:06.965846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-404feae4-1a8c-45ea-b097-48d09df35815 req-1ca64e8e-819d-4328-8a47-869b54d8e4ba service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.966584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-404feae4-1a8c-45ea-b097-48d09df35815 req-1ca64e8e-819d-4328-8a47-869b54d8e4ba service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.980260 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-404feae4-1a8c-45ea-b097-48d09df35815 req-1ca64e8e-819d-4328-8a47-869b54d8e4ba service nova] Creating event network-changed:f720b326-8d2c-474b-9bc7-7c7557c74c32 for instance 14dcab97-a96a-4c0d-9580-48f5ee096119 on n-h2-764485-11 Jul 20 04:13:06.985685 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-404feae4-1a8c-45ea-b097-48d09df35815 req-1ca64e8e-819d-4328-8a47-869b54d8e4ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038715 Jul 20 04:13:06.986529 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 407/841] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:06.992162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-21eb9519-29a3-4765-b066-37a56c5f8297 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] Action: 'create', calling method: .version_select at 0x7fbf9db22700>, body: {"pool": null} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:07.049602 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0f1145b2-c578-43d7-ae2e-acc426740a78 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "POST /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef/action" status: 202 len: 0 microversion: 2.1 time: 0.366168 Jul 20 04:13:07.050271 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 435/842] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:06 2022] POST /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:13:07.066290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2f647321-58eb-428a-b758-4ffdd97f39cd req-bedecbd0-5243-4e50-a8b3-df5a44bdc732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42b8c28-e93e-471e-b549-5718883dc7b6", "name": "network-vif-plugged", "status": "completed", "tag": "4266796f-8098-40de-be9c-26d7b872b741"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:07.078877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2f647321-58eb-428a-b758-4ffdd97f39cd req-bedecbd0-5243-4e50-a8b3-df5a44bdc732 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.079324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2f647321-58eb-428a-b758-4ffdd97f39cd req-bedecbd0-5243-4e50-a8b3-df5a44bdc732 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.093955 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2f647321-58eb-428a-b758-4ffdd97f39cd req-bedecbd0-5243-4e50-a8b3-df5a44bdc732 service nova] Creating event network-vif-plugged:4266796f-8098-40de-be9c-26d7b872b741 for instance c42b8c28-e93e-471e-b549-5718883dc7b6 on n-h1-764485-11 Jul 20 04:13:07.100520 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2f647321-58eb-428a-b758-4ffdd97f39cd req-bedecbd0-5243-4e50-a8b3-df5a44bdc732 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048905 Jul 20 04:13:07.101370 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 436/843] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:07.107211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-87b37514-e9b8-4794-b94f-8d8126dc414a tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '.version_select at 0x7fbf9ddd3dc0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.111178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87b37514-e9b8-4794-b94f-8d8126dc414a tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.111667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87b37514-e9b8-4794-b94f-8d8126dc414a tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.123710 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-87b37514-e9b8-4794-b94f-8d8126dc414a tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1584 microversion: 2.1 time: 0.020623 Jul 20 04:13:07.124704 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 437/844] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/os-migrations => generated 1584 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:07.131589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3243e263-5e71-4a18-a258-ef765ae4dbc6 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.134014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3243e263-5e71-4a18-a258-ef765ae4dbc6 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:07.143372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3243e263-5e71-4a18-a258-ef765ae4dbc6 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.144082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3243e263-5e71-4a18-a258-ef765ae4dbc6 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.144807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3243e263-5e71-4a18-a258-ef765ae4dbc6 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.145254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3243e263-5e71-4a18-a258-ef765ae4dbc6 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.251097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3243e263-5e71-4a18-a258-ef765ae4dbc6 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:07.260445 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3243e263-5e71-4a18-a258-ef765ae4dbc6 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1218 microversion: 2.1 time: 0.134543 Jul 20 04:13:07.267909 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 438/845] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:07.274769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8963143b-26f3-4330-8296-c6c47c3c6da6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.275935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8963143b-26f3-4330-8296-c6c47c3c6da6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:07.283056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8963143b-26f3-4330-8296-c6c47c3c6da6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.283532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8963143b-26f3-4330-8296-c6c47c3c6da6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.285107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8963143b-26f3-4330-8296-c6c47c3c6da6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.285724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8963143b-26f3-4330-8296-c6c47c3c6da6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.598371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8963143b-26f3-4330-8296-c6c47c3c6da6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:07.606913 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8963143b-26f3-4330-8296-c6c47c3c6da6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1317 microversion: 2.1 time: 0.344112 Jul 20 04:13:07.607494 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 439/846] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:07.612355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a5d075d2-034b-49d1-8232-efb6d51b77ec tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dffa820>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.667765 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a5d075d2-034b-49d1-8232-efb6d51b77ec tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.059144 Jul 20 04:13:07.674607 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 440/847] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:07.674607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ca7a8d84-594b-44a4-a597-f199b2802c73 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.674607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca7a8d84-594b-44a4-a597-f199b2802c73 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:07.683949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca7a8d84-594b-44a4-a597-f199b2802c73 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.684492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca7a8d84-594b-44a4-a597-f199b2802c73 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.685346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca7a8d84-594b-44a4-a597-f199b2802c73 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.685876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca7a8d84-594b-44a4-a597-f199b2802c73 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.926431 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ca7a8d84-594b-44a4-a597-f199b2802c73 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1632 microversion: 2.1 time: 0.256474 Jul 20 04:13:07.926939 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 441/848] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1632 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:07.933389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c278192-c410-435f-8bf6-a03f36836fbd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.934082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9c278192-c410-435f-8bf6-a03f36836fbd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:07.946681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c278192-c410-435f-8bf6-a03f36836fbd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.955211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c278192-c410-435f-8bf6-a03f36836fbd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.962130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c278192-c410-435f-8bf6-a03f36836fbd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.962837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c278192-c410-435f-8bf6-a03f36836fbd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.207846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9c278192-c410-435f-8bf6-a03f36836fbd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:08.221148 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c278192-c410-435f-8bf6-a03f36836fbd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.292070 Jul 20 04:13:08.232028 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 442/849] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:08.238287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-06ea64c6-2f80-4b53-9656-74ec8bddf2f5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Action: 'create', calling method: .version_select at 0x7fbf9df808b0>, body: {"keypair": {"name": "tempest-keypair-120088815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmovzs3rTpfqY/dr/+3L9e48UpvAQ9rBALZQe0NEGIqexXPolxUcnGS/mm2CV9BWllnyjWgAVzWJb5QBxpt/x1cTrhJMR+g6NOT5l0drVbYO6+nL8kJHZ1ILZtHCe0fEA=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:08.254324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-06ea64c6-2f80-4b53-9656-74ec8bddf2f5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Getting quotas for project 14ab6d1260864919b0f1b6d536fe65ae. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:08.261141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-06ea64c6-2f80-4b53-9656-74ec8bddf2f5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Getting quotas for user f94d458feafa4ec28c50a04fc2b2a1f4 and project 14ab6d1260864919b0f1b6d536fe65ae. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:08.286535 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-06ea64c6-2f80-4b53-9656-74ec8bddf2f5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052874 Jul 20 04:13:08.287758 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 443/850] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:13:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:08.293139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e0974a53-d62c-4ea7-bc8b-ef61006d4a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:08.294313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e0974a53-d62c-4ea7-bc8b-ef61006d4a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:08.301257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0974a53-d62c-4ea7-bc8b-ef61006d4a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.301981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0974a53-d62c-4ea7-bc8b-ef61006d4a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.303231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0974a53-d62c-4ea7-bc8b-ef61006d4a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.304609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0974a53-d62c-4ea7-bc8b-ef61006d4a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.548845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=20 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:08.680263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e0974a53-d62c-4ea7-bc8b-ef61006d4a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:08.691893 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e0974a53-d62c-4ea7-bc8b-ef61006d4a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1313 microversion: 2.1 time: 0.402721 Jul 20 04:13:08.702324 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 444/851] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:08 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:08.707715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-13f4552e-f4e5-4a97-a112-96b0831303f2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:08.708482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-13f4552e-f4e5-4a97-a112-96b0831303f2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:08.715630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13f4552e-f4e5-4a97-a112-96b0831303f2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.716083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13f4552e-f4e5-4a97-a112-96b0831303f2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.717304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13f4552e-f4e5-4a97-a112-96b0831303f2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.717817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13f4552e-f4e5-4a97-a112-96b0831303f2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.858976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-13f4552e-f4e5-4a97-a112-96b0831303f2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:08.867807 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-13f4552e-f4e5-4a97-a112-96b0831303f2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1280 microversion: 2.1 time: 0.163997 Jul 20 04:13:08.869166 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 445/852] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:08 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:08.873984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ebaaa802-b6de-4de0-a743-9a987749fcae req-dc72bc18-7267-4227-8305-933c68313402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1780efb-bbd4-44eb-8fd2-7edbfa5bd516", "tag": "bfb0a5af-cb59-4409-8bdf-6c7efcdb9959"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:08.886750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ebaaa802-b6de-4de0-a743-9a987749fcae req-dc72bc18-7267-4227-8305-933c68313402 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.887102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ebaaa802-b6de-4de0-a743-9a987749fcae req-dc72bc18-7267-4227-8305-933c68313402 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.900607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ebaaa802-b6de-4de0-a743-9a987749fcae req-dc72bc18-7267-4227-8305-933c68313402 service nova] Creating event network-changed:bfb0a5af-cb59-4409-8bdf-6c7efcdb9959 for instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 on n-h1-764485-11 Jul 20 04:13:08.906365 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ebaaa802-b6de-4de0-a743-9a987749fcae req-dc72bc18-7267-4227-8305-933c68313402 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035865 Jul 20 04:13:08.907161 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 446/853] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:08.912131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7def2ff6-73b3-421c-80d7-f0c2bc68072d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:08.912776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7def2ff6-73b3-421c-80d7-f0c2bc68072d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:08.919706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7def2ff6-73b3-421c-80d7-f0c2bc68072d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.920580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7def2ff6-73b3-421c-80d7-f0c2bc68072d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.921973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7def2ff6-73b3-421c-80d7-f0c2bc68072d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.922606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7def2ff6-73b3-421c-80d7-f0c2bc68072d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.012534 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-21eb9519-29a3-4765-b066-37a56c5f8297 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.024721 Jul 20 04:13:09.013745 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 408/854] 10.222.0.20 () {60 vars in 1169 bytes} [Wed Jul 20 04:13:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:09.023373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96aa23c8-727c-4ab3-bcc8-f07cb33d9e3d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da6c310>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.078748 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-96aa23c8-727c-4ab3-bcc8-f07cb33d9e3d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.063796 Jul 20 04:13:09.079547 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 409/855] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:09.089670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0540b9e7-1cb0-4735-ad52-d77d1612e1a3 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] Action: 'create', calling method: .version_select at 0x7fbf9dae5ca0>, body: {"pool": null} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:09.121636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7def2ff6-73b3-421c-80d7-f0c2bc68072d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:09.135108 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7def2ff6-73b3-421c-80d7-f0c2bc68072d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1317 microversion: 2.1 time: 0.226882 Jul 20 04:13:09.144791 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 447/856] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:08 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:09.150431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-79888bc7-2d07-4113-afc0-c23259b1965d req-414123b8-81e9-4b6c-a6de-98c78b614a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b5ae40-24a9-4b37-8920-8f32fd165dd8", "name": "network-vif-unplugged", "status": "completed", "tag": "f1ae2766-bf4e-4f6c-b66b-eb30f89c64f2"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:09.160796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-79888bc7-2d07-4113-afc0-c23259b1965d req-414123b8-81e9-4b6c-a6de-98c78b614a7d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.161735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-79888bc7-2d07-4113-afc0-c23259b1965d req-414123b8-81e9-4b6c-a6de-98c78b614a7d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.174155 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-79888bc7-2d07-4113-afc0-c23259b1965d req-414123b8-81e9-4b6c-a6de-98c78b614a7d service nova] Creating event network-vif-unplugged:f1ae2766-bf4e-4f6c-b66b-eb30f89c64f2 for instance 02b5ae40-24a9-4b37-8920-8f32fd165dd8 on n-h2-764485-11 Jul 20 04:13:09.180387 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-79888bc7-2d07-4113-afc0-c23259b1965d req-414123b8-81e9-4b6c-a6de-98c78b614a7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033605 Jul 20 04:13:09.181631 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 448/857] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:09.238886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52bed2d0-30bd-44cd-9905-1a8c5074e10f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.240322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52bed2d0-30bd-44cd-9905-1a8c5074e10f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:09.247427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52bed2d0-30bd-44cd-9905-1a8c5074e10f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.248015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52bed2d0-30bd-44cd-9905-1a8c5074e10f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.248803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52bed2d0-30bd-44cd-9905-1a8c5074e10f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.249245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52bed2d0-30bd-44cd-9905-1a8c5074e10f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.529841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52bed2d0-30bd-44cd-9905-1a8c5074e10f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:09.538229 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52bed2d0-30bd-44cd-9905-1a8c5074e10f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.303479 Jul 20 04:13:09.539235 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 449/858] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:09.710330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-69f78d47-922c-4c77-b475-36905aaaa855 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.711274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-69f78d47-922c-4c77-b475-36905aaaa855 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:09.718737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69f78d47-922c-4c77-b475-36905aaaa855 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.719201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69f78d47-922c-4c77-b475-36905aaaa855 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.720011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69f78d47-922c-4c77-b475-36905aaaa855 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.720458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69f78d47-922c-4c77-b475-36905aaaa855 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.860618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-69f78d47-922c-4c77-b475-36905aaaa855 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:09.869091 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-69f78d47-922c-4c77-b475-36905aaaa855 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1313 microversion: 2.1 time: 0.163276 Jul 20 04:13:09.869750 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 450/859] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:09.886781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f0dbd28-5e9b-4dae-bf67-ca2e16b724be tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.887495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1f0dbd28-5e9b-4dae-bf67-ca2e16b724be tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:09.894000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f0dbd28-5e9b-4dae-bf67-ca2e16b724be tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.894595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f0dbd28-5e9b-4dae-bf67-ca2e16b724be tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.895691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f0dbd28-5e9b-4dae-bf67-ca2e16b724be tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.896343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f0dbd28-5e9b-4dae-bf67-ca2e16b724be tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.046152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1f0dbd28-5e9b-4dae-bf67-ca2e16b724be tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.055848 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f0dbd28-5e9b-4dae-bf67-ca2e16b724be tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1280 microversion: 2.1 time: 0.173970 Jul 20 04:13:10.057071 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 451/860] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1280 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:10.093473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b4024b1d-29c6-40b9-8fe4-3010d5c09e26 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9def01f0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:10.155530 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b4024b1d-29c6-40b9-8fe4-3010d5c09e26 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.067499 Jul 20 04:13:10.156205 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 452/861] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:10 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:10.161810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c53f8b5-c3bd-4261-aba6-2ac0f088eb40 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:10.162846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4c53f8b5-c3bd-4261-aba6-2ac0f088eb40 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:10.171546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c53f8b5-c3bd-4261-aba6-2ac0f088eb40 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.172256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c53f8b5-c3bd-4261-aba6-2ac0f088eb40 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.173417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c53f8b5-c3bd-4261-aba6-2ac0f088eb40 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.174288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c53f8b5-c3bd-4261-aba6-2ac0f088eb40 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.701937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4c53f8b5-c3bd-4261-aba6-2ac0f088eb40 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.712193 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4c53f8b5-c3bd-4261-aba6-2ac0f088eb40 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1317 microversion: 2.1 time: 0.554718 Jul 20 04:13:10.713007 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 453/862] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:10 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:10.748260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d8f112b1-04cc-404b-90d9-e7b37b86e626 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:10.749022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d8f112b1-04cc-404b-90d9-e7b37b86e626 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:10.765460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d8f112b1-04cc-404b-90d9-e7b37b86e626 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.765922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d8f112b1-04cc-404b-90d9-e7b37b86e626 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.768444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d8f112b1-04cc-404b-90d9-e7b37b86e626 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.769197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d8f112b1-04cc-404b-90d9-e7b37b86e626 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.792488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:11.135215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d8f112b1-04cc-404b-90d9-e7b37b86e626 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:11.144111 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d8f112b1-04cc-404b-90d9-e7b37b86e626 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.429318 Jul 20 04:13:11.144703 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 454/863] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:10 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:11.152785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7b9ebd3-7af7-42f1-8b0b-6a31374c7f47 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.153623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a7b9ebd3-7af7-42f1-8b0b-6a31374c7f47 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:11.159129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:UPDATE=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:11.160983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7b9ebd3-7af7-42f1-8b0b-6a31374c7f47 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.161674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7b9ebd3-7af7-42f1-8b0b-6a31374c7f47 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.162669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7b9ebd3-7af7-42f1-8b0b-6a31374c7f47 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.164036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7b9ebd3-7af7-42f1-8b0b-6a31374c7f47 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.400643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a7b9ebd3-7af7-42f1-8b0b-6a31374c7f47 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:11.408337 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a7b9ebd3-7af7-42f1-8b0b-6a31374c7f47 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1313 microversion: 2.1 time: 0.259383 Jul 20 04:13:11.409697 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 455/864] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:11 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:11.415470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1377803347", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "bcbfb113-dc60-430e-be79-be98f4f2973e"}], "security_groups": [{"name": "tempest-securitygroup--1396150598"}], "key_name": "tempest-keypair-120088815", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:11.604620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] validate_networks() for [('bcbfb113-dc60-430e-be79-be98f4f2973e', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:11.924979 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0540b9e7-1cb0-4735-ad52-d77d1612e1a3 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.839173 Jul 20 04:13:11.933224 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 410/865] 10.222.0.20 () {60 vars in 1169 bytes} [Wed Jul 20 04:13:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:11.939035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d9fbf76e-4407-41e1-b942-7b646d6f7409 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.940186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d9fbf76e-4407-41e1-b942-7b646d6f7409 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:11.956848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9fbf76e-4407-41e1-b942-7b646d6f7409 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.958290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9fbf76e-4407-41e1-b942-7b646d6f7409 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.961478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9fbf76e-4407-41e1-b942-7b646d6f7409 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.962181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9fbf76e-4407-41e1-b942-7b646d6f7409 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.290198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d9fbf76e-4407-41e1-b942-7b646d6f7409 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:12.297780 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d9fbf76e-4407-41e1-b942-7b646d6f7409 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1322 microversion: 2.1 time: 0.363139 Jul 20 04:13:12.298482 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 411/866] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:11 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:12.303130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0bc43029-3e37-4229-8eb5-095ccbead50b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da873a0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:12.348252 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0bc43029-3e37-4229-8eb5-095ccbead50b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.048750 Jul 20 04:13:12.348834 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 412/867] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:12 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:12.353332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-2e8741c2-476a-40ac-92ac-f2cd9f8534b5 req-f2bbc9bf-695b-4826-a5a3-74ab736352f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14dcab97-a96a-4c0d-9580-48f5ee096119", "name": "network-vif-plugged", "status": "completed", "tag": "f720b326-8d2c-474b-9bc7-7c7557c74c32"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:12.361779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2e8741c2-476a-40ac-92ac-f2cd9f8534b5 req-f2bbc9bf-695b-4826-a5a3-74ab736352f1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.362230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2e8741c2-476a-40ac-92ac-f2cd9f8534b5 req-f2bbc9bf-695b-4826-a5a3-74ab736352f1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.373705 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-2e8741c2-476a-40ac-92ac-f2cd9f8534b5 req-f2bbc9bf-695b-4826-a5a3-74ab736352f1 service nova] Creating event network-vif-plugged:f720b326-8d2c-474b-9bc7-7c7557c74c32 for instance 14dcab97-a96a-4c0d-9580-48f5ee096119 on n-h2-764485-11 Jul 20 04:13:12.378939 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-2e8741c2-476a-40ac-92ac-f2cd9f8534b5 req-f2bbc9bf-695b-4826-a5a3-74ab736352f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029009 Jul 20 04:13:12.379563 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 413/868] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:12.388145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-79386551-0689-4130-85a1-7b54330d7e18 req-fa92ef4f-6edb-45ef-98b8-110f4f766ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec8bb6e1-5dc2-4370-9d9f-7156a11c451c", "tag": "607e04b7-5a1e-4f94-8b73-8315d16912cd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:12.396248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-79386551-0689-4130-85a1-7b54330d7e18 req-fa92ef4f-6edb-45ef-98b8-110f4f766ff3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.396687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-79386551-0689-4130-85a1-7b54330d7e18 req-fa92ef4f-6edb-45ef-98b8-110f4f766ff3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.407583 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-79386551-0689-4130-85a1-7b54330d7e18 req-fa92ef4f-6edb-45ef-98b8-110f4f766ff3 service nova] Creating event network-changed:607e04b7-5a1e-4f94-8b73-8315d16912cd for instance ec8bb6e1-5dc2-4370-9d9f-7156a11c451c on n-h1-764485-11 Jul 20 04:13:12.412492 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-79386551-0689-4130-85a1-7b54330d7e18 req-fa92ef4f-6edb-45ef-98b8-110f4f766ff3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030518 Jul 20 04:13:12.413960 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 414/869] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:12.419336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-405bf2c3-cdf7-48fa-8cd2-98af0dbe93ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:12.420075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-405bf2c3-cdf7-48fa-8cd2-98af0dbe93ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:12.426973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-405bf2c3-cdf7-48fa-8cd2-98af0dbe93ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.428081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-405bf2c3-cdf7-48fa-8cd2-98af0dbe93ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.429140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-405bf2c3-cdf7-48fa-8cd2-98af0dbe93ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.429464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-405bf2c3-cdf7-48fa-8cd2-98af0dbe93ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.528512 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:12.528994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:12.530056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:12.530484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:12.530898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:12.543920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.544607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.545787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.546399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.572383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Getting quotas for project 14ab6d1260864919b0f1b6d536fe65ae. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:12.577809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Getting quotas for user f94d458feafa4ec28c50a04fc2b2a1f4 and project 14ab6d1260864919b0f1b6d536fe65ae. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:12.591083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:12.593844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:12.607359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-405bf2c3-cdf7-48fa-8cd2-98af0dbe93ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:12.615392 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-405bf2c3-cdf7-48fa-8cd2-98af0dbe93ed tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1317 microversion: 2.1 time: 0.200506 Jul 20 04:13:12.616225 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 415/870] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:12 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:12.620748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-919cd77a-f386-4d9a-af18-b3f4609b079a tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] Calling method '.version_select at 0x7fbf9da6c820>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:12.644660 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-40da390c-4d76-43b5-bdfc-1f87692a65a0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.233653 Jul 20 04:13:12.645313 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 456/871] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:13:12.650620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f97d4f6a-802f-4cda-9319-8abeb4d379b0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:12.651451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f97d4f6a-802f-4cda-9319-8abeb4d379b0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:12.658200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f97d4f6a-802f-4cda-9319-8abeb4d379b0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.658652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f97d4f6a-802f-4cda-9319-8abeb4d379b0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.659428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f97d4f6a-802f-4cda-9319-8abeb4d379b0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.659899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f97d4f6a-802f-4cda-9319-8abeb4d379b0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.878742 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-919cd77a-f386-4d9a-af18-b3f4609b079a tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/89a3ebff-9e07-451d-aae9-bc1e3de5eadd" status: 200 len: 141 microversion: 2.1 time: 0.261482 Jul 20 04:13:12.880332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f97d4f6a-802f-4cda-9319-8abeb4d379b0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:12.886825 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 416/872] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jul 20 04:13:12 2022] GET /compute/v2.1/os-floating-ips/89a3ebff-9e07-451d-aae9-bc1e3de5eadd => generated 141 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:12.889037 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f97d4f6a-802f-4cda-9319-8abeb4d379b0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.242555 Jul 20 04:13:12.890116 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 457/873] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:12 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:12.895024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-040f47fb-4abb-477c-afac-d28ba5bfd96b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:12.895876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-040f47fb-4abb-477c-afac-d28ba5bfd96b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:12.903487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-16ef0625-681f-4e9a-b880-1fb22f6f0f35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:12.904414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-16ef0625-681f-4e9a-b880-1fb22f6f0f35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:12.914787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16ef0625-681f-4e9a-b880-1fb22f6f0f35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.916058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16ef0625-681f-4e9a-b880-1fb22f6f0f35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.916880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16ef0625-681f-4e9a-b880-1fb22f6f0f35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.917662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16ef0625-681f-4e9a-b880-1fb22f6f0f35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.983845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-040f47fb-4abb-477c-afac-d28ba5bfd96b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:12.994165 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-040f47fb-4abb-477c-afac-d28ba5bfd96b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1234 microversion: 2.1 time: 0.102403 Jul 20 04:13:13.003470 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 458/874] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:12 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1234 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:13.007623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-65f52e5d-f542-4e31-859d-36494c9bfd1c tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] Calling method '.version_select at 0x7fbf9dc4dca0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:13.267535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-16ef0625-681f-4e9a-b880-1fb22f6f0f35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:13.276046 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-16ef0625-681f-4e9a-b880-1fb22f6f0f35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1313 microversion: 2.1 time: 0.387058 Jul 20 04:13:13.276645 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 417/875] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:12 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:13.313929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-066ea8c2-bd72-4c0a-96b5-25acbbb029f1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:13.314632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-066ea8c2-bd72-4c0a-96b5-25acbbb029f1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:13.321509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-066ea8c2-bd72-4c0a-96b5-25acbbb029f1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.321964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-066ea8c2-bd72-4c0a-96b5-25acbbb029f1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.322740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-066ea8c2-bd72-4c0a-96b5-25acbbb029f1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.323178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-066ea8c2-bd72-4c0a-96b5-25acbbb029f1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.837105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-066ea8c2-bd72-4c0a-96b5-25acbbb029f1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:13.839413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:13.847389 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-066ea8c2-bd72-4c0a-96b5-25acbbb029f1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1322 microversion: 2.1 time: 0.537025 Jul 20 04:13:13.848054 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 418/876] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:13 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:13.853075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0625efb9-737b-4231-b082-2b463c3fd7a0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da45940>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:13.899182 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0625efb9-737b-4231-b082-2b463c3fd7a0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.050017 Jul 20 04:13:13.904693 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 419/877] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:13 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:13.909546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59e6bab9-d281-427f-820d-60a40ef1ad41 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:13.910160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-59e6bab9-d281-427f-820d-60a40ef1ad41 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:13.917100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59e6bab9-d281-427f-820d-60a40ef1ad41 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.917545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59e6bab9-d281-427f-820d-60a40ef1ad41 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.918334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59e6bab9-d281-427f-820d-60a40ef1ad41 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.918747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59e6bab9-d281-427f-820d-60a40ef1ad41 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.122043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-59e6bab9-d281-427f-820d-60a40ef1ad41 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.141807 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-59e6bab9-d281-427f-820d-60a40ef1ad41 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1317 microversion: 2.1 time: 0.235830 Jul 20 04:13:14.151536 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 420/878] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:13 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:14.151536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c95291e8-b09e-4717-bb5e-885e8fb2e9fe tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.151536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c95291e8-b09e-4717-bb5e-885e8fb2e9fe tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:14.156855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c95291e8-b09e-4717-bb5e-885e8fb2e9fe tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.157331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c95291e8-b09e-4717-bb5e-885e8fb2e9fe tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.158636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c95291e8-b09e-4717-bb5e-885e8fb2e9fe tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.159072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c95291e8-b09e-4717-bb5e-885e8fb2e9fe tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.258056 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-65f52e5d-f542-4e31-859d-36494c9bfd1c tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/89a3ebff-9e07-451d-aae9-bc1e3de5eadd" status: 202 len: 0 microversion: 2.1 time: 1.260984 Jul 20 04:13:14.259322 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 459/879] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:13:12 2022] DELETE /compute/v2.1/os-floating-ips/89a3ebff-9e07-451d-aae9-bc1e3de5eadd => generated 0 bytes in 1264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:14.268517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-207d5901-fb6f-4dc8-b385-d42fc184ed62 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.269357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-207d5901-fb6f-4dc8-b385-d42fc184ed62 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:14.276427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-207d5901-fb6f-4dc8-b385-d42fc184ed62 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.276994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-207d5901-fb6f-4dc8-b385-d42fc184ed62 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.277827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-207d5901-fb6f-4dc8-b385-d42fc184ed62 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.278444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-207d5901-fb6f-4dc8-b385-d42fc184ed62 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.352276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-207d5901-fb6f-4dc8-b385-d42fc184ed62 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.360547 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-207d5901-fb6f-4dc8-b385-d42fc184ed62 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1286 microversion: 2.1 time: 0.099960 Jul 20 04:13:14.361745 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 460/880] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:14.369747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c59463dc-7d4c-4193-bf8c-d2a725044884 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] Calling method '.version_select at 0x7fbf9dc53160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.375481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c95291e8-b09e-4717-bb5e-885e8fb2e9fe tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.384519 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c95291e8-b09e-4717-bb5e-885e8fb2e9fe tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.240667 Jul 20 04:13:14.385108 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 421/881] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:14.390381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2eed74cf-d92b-4f67-b801-3bc0b68c63bd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.391249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2eed74cf-d92b-4f67-b801-3bc0b68c63bd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:14.400330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eed74cf-d92b-4f67-b801-3bc0b68c63bd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.400783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eed74cf-d92b-4f67-b801-3bc0b68c63bd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.402161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eed74cf-d92b-4f67-b801-3bc0b68c63bd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.402654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eed74cf-d92b-4f67-b801-3bc0b68c63bd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.623816 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c59463dc-7d4c-4193-bf8c-d2a725044884 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.260799 Jul 20 04:13:14.624975 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 461/882] 10.222.0.20 () {58 vars in 1163 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:14.636210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8b20225b-d891-48ef-b1ec-03d308fa32e8 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] Calling method '.version_select at 0x7fbf9df1d1f0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.666839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2eed74cf-d92b-4f67-b801-3bc0b68c63bd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.689375 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2eed74cf-d92b-4f67-b801-3bc0b68c63bd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1313 microversion: 2.1 time: 0.300194 Jul 20 04:13:14.690011 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 422/883] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:14.864873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3825a145-eeb7-41fa-b45c-e7f99c5f36dd tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.865877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3825a145-eeb7-41fa-b45c-e7f99c5f36dd tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:14.878112 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8b20225b-d891-48ef-b1ec-03d308fa32e8 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.246813 Jul 20 04:13:14.880275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3825a145-eeb7-41fa-b45c-e7f99c5f36dd tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.881199 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 462/884] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:14.881694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3825a145-eeb7-41fa-b45c-e7f99c5f36dd tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.883100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3825a145-eeb7-41fa-b45c-e7f99c5f36dd tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.884174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3825a145-eeb7-41fa-b45c-e7f99c5f36dd tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.902172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5ab469aa-8f9a-4f6b-8dc3-b7fae6c88758 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] Calling method '.version_select at 0x7fbf9e125430>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:15.233135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3825a145-eeb7-41fa-b45c-e7f99c5f36dd tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:15.240837 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3825a145-eeb7-41fa-b45c-e7f99c5f36dd tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1322 microversion: 2.1 time: 0.380378 Jul 20 04:13:15.241460 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 423/885] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:15.246570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-62242c07-eb97-41bc-8fe3-e9ee1712a480 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da6c820>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:15.293563 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-62242c07-eb97-41bc-8fe3-e9ee1712a480 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.050351 Jul 20 04:13:15.294147 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 424/886] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:15 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:15.299032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-4672e93b-6445-401f-b259-4731504ea335 req-88b119d7-cfb6-4fd6-ac2e-dfd565ae16ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3c36c5-27be-4732-b611-318b82de3094", "name": "network-vif-plugged", "status": "completed", "tag": "2bf3529a-e4e6-4908-b13f-8e1d8ee72c64"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:15.307902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4672e93b-6445-401f-b259-4731504ea335 req-88b119d7-cfb6-4fd6-ac2e-dfd565ae16ca service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.308340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4672e93b-6445-401f-b259-4731504ea335 req-88b119d7-cfb6-4fd6-ac2e-dfd565ae16ca service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.321854 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-4672e93b-6445-401f-b259-4731504ea335 req-88b119d7-cfb6-4fd6-ac2e-dfd565ae16ca service nova] Creating event network-vif-plugged:2bf3529a-e4e6-4908-b13f-8e1d8ee72c64 for instance 5f3c36c5-27be-4732-b611-318b82de3094 on n-h2-764485-11 Jul 20 04:13:15.326821 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-4672e93b-6445-401f-b259-4731504ea335 req-88b119d7-cfb6-4fd6-ac2e-dfd565ae16ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031364 Jul 20 04:13:15.327639 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 425/887] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:15.334167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5541f28f-340b-4c5f-ab05-6ef0df481f9f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:15.335435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5541f28f-340b-4c5f-ab05-6ef0df481f9f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:15.341970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5541f28f-340b-4c5f-ab05-6ef0df481f9f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.342678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5541f28f-340b-4c5f-ab05-6ef0df481f9f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.343435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5541f28f-340b-4c5f-ab05-6ef0df481f9f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.343893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5541f28f-340b-4c5f-ab05-6ef0df481f9f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.652788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5541f28f-340b-4c5f-ab05-6ef0df481f9f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:15.660564 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5541f28f-340b-4c5f-ab05-6ef0df481f9f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1467 microversion: 2.1 time: 0.330677 Jul 20 04:13:15.661186 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 426/888] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:15 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1467 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:15.665886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aabab184-83f0-44ec-b8bf-763ec354d127 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:15.666498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aabab184-83f0-44ec-b8bf-763ec354d127 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:15.672343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aabab184-83f0-44ec-b8bf-763ec354d127 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.672890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aabab184-83f0-44ec-b8bf-763ec354d127 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.673679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aabab184-83f0-44ec-b8bf-763ec354d127 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.674156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aabab184-83f0-44ec-b8bf-763ec354d127 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.776548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aabab184-83f0-44ec-b8bf-763ec354d127 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:15.784866 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aabab184-83f0-44ec-b8bf-763ec354d127 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1292 microversion: 2.1 time: 0.122684 Jul 20 04:13:15.785449 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 427/889] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:15 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1292 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:15.790901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-06424d92-1d3b-4f25-afec-d97547a7edab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:15.791529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-06424d92-1d3b-4f25-afec-d97547a7edab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:15.797686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06424d92-1d3b-4f25-afec-d97547a7edab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.798141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06424d92-1d3b-4f25-afec-d97547a7edab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.798912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06424d92-1d3b-4f25-afec-d97547a7edab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.799344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06424d92-1d3b-4f25-afec-d97547a7edab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.082399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-06424d92-1d3b-4f25-afec-d97547a7edab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:16.092722 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-06424d92-1d3b-4f25-afec-d97547a7edab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.304941 Jul 20 04:13:16.093641 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 428/890] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:15 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:16.098078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-35bc55ea-d242-436f-8b33-61ea6697d973 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:16.098787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-35bc55ea-d242-436f-8b33-61ea6697d973 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:16.101414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:16.107177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35bc55ea-d242-436f-8b33-61ea6697d973 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.107741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35bc55ea-d242-436f-8b33-61ea6697d973 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.108603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35bc55ea-d242-436f-8b33-61ea6697d973 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.109120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35bc55ea-d242-436f-8b33-61ea6697d973 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.298507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:16.346108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:16.581959 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5ab469aa-8f9a-4f6b-8dc3-b7fae6c88758 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/37df7d76-030c-4430-9207-006b344e1b1c" status: 202 len: 0 microversion: 2.1 time: 1.689142 Jul 20 04:13:16.586688 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 463/891] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:13:14 2022] DELETE /compute/v2.1/os-floating-ips/37df7d76-030c-4430-9207-006b344e1b1c => generated 0 bytes in 1695 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:16.593796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-37a9741d-b8f5-4620-a163-2a953c212dca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:16.594427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-37a9741d-b8f5-4620-a163-2a953c212dca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:16.602723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37a9741d-b8f5-4620-a163-2a953c212dca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.603374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37a9741d-b8f5-4620-a163-2a953c212dca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.604600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37a9741d-b8f5-4620-a163-2a953c212dca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.605203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37a9741d-b8f5-4620-a163-2a953c212dca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.660746 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-35bc55ea-d242-436f-8b33-61ea6697d973 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1620 microversion: 2.1 time: 0.566177 Jul 20 04:13:16.670002 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 429/892] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:16 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1620 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:16.683959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-153b78d7-7e67-4967-914f-55afeb7c9449 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:16.686938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-153b78d7-7e67-4967-914f-55afeb7c9449 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:16.702303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-153b78d7-7e67-4967-914f-55afeb7c9449 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.703145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-153b78d7-7e67-4967-914f-55afeb7c9449 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.704884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-153b78d7-7e67-4967-914f-55afeb7c9449 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.705550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-153b78d7-7e67-4967-914f-55afeb7c9449 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.958479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-37a9741d-b8f5-4620-a163-2a953c212dca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:16.969812 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-37a9741d-b8f5-4620-a163-2a953c212dca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1313 microversion: 2.1 time: 0.381635 Jul 20 04:13:16.970406 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 464/893] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:16 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:16.982502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9863688-c1ee-4ec9-bf7c-02d20b771327 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9e1111f0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.009253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-153b78d7-7e67-4967-914f-55afeb7c9449 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:17.017743 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-153b78d7-7e67-4967-914f-55afeb7c9449 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1322 microversion: 2.1 time: 0.346613 Jul 20 04:13:17.019967 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 430/894] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:16 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:17.026219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-13d1e807-c570-4f67-ab9d-a67fc161bf84 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] Calling method '.version_select at 0x7fbf9da0bd30>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.031170 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a9863688-c1ee-4ec9-bf7c-02d20b771327 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.054871 Jul 20 04:13:17.035643 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 465/895] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:16 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:17.039318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-76eae859-30cf-4a1e-b90c-63af7d30eec2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.039977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-76eae859-30cf-4a1e-b90c-63af7d30eec2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:17.046656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76eae859-30cf-4a1e-b90c-63af7d30eec2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.047146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76eae859-30cf-4a1e-b90c-63af7d30eec2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.047964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76eae859-30cf-4a1e-b90c-63af7d30eec2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.048567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76eae859-30cf-4a1e-b90c-63af7d30eec2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.447742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-76eae859-30cf-4a1e-b90c-63af7d30eec2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:17.456947 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-76eae859-30cf-4a1e-b90c-63af7d30eec2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1360 microversion: 2.1 time: 0.423580 Jul 20 04:13:17.464938 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 466/896] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:17 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1360 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:17.464938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1625788749", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["f32f3c69-0926-47e2-9498-38ca38aa5035"]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:17.515927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:18.116419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:18.118122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:18.118610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:18.119063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:18.119480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:18.128263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.128716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.129522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.129961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.149589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:18.154799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:18.168869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:18.171198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:18.226266 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8d8c5a98-f5a2-421b-a9eb-84dc76263b39 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766676 Jul 20 04:13:18.227436 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 467/897] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:13:18.232700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dcc72407-3f8d-4db5-89a3-198b2b14bce4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:18.233543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dcc72407-3f8d-4db5-89a3-198b2b14bce4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:18.240014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dcc72407-3f8d-4db5-89a3-198b2b14bce4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.240467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dcc72407-3f8d-4db5-89a3-198b2b14bce4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.241812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dcc72407-3f8d-4db5-89a3-198b2b14bce4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.242262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dcc72407-3f8d-4db5-89a3-198b2b14bce4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.583605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dcc72407-3f8d-4db5-89a3-198b2b14bce4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:18.592730 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dcc72407-3f8d-4db5-89a3-198b2b14bce4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.363607 Jul 20 04:13:18.593645 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 468/898] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:18 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:18.599576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-c1eaa124-e883-429e-b614-63aebbab35ce req-5adfdc80-ee1a-4959-8964-3446ed397afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec531648-d3ee-43c8-8fda-89ae7282e4ef", "name": "network-vif-plugged", "status": "completed", "tag": "cbfa0b20-ec79-4d11-a450-6d6c8705b3b2"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:18.610942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c1eaa124-e883-429e-b614-63aebbab35ce req-5adfdc80-ee1a-4959-8964-3446ed397afc service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.611389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c1eaa124-e883-429e-b614-63aebbab35ce req-5adfdc80-ee1a-4959-8964-3446ed397afc service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.623573 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c1eaa124-e883-429e-b614-63aebbab35ce req-5adfdc80-ee1a-4959-8964-3446ed397afc service nova] Creating event network-vif-plugged:cbfa0b20-ec79-4d11-a450-6d6c8705b3b2 for instance ec531648-d3ee-43c8-8fda-89ae7282e4ef on n-h1-764485-11 Jul 20 04:13:18.628718 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-c1eaa124-e883-429e-b614-63aebbab35ce req-5adfdc80-ee1a-4959-8964-3446ed397afc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033707 Jul 20 04:13:18.629681 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 469/899] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:18.636500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a0807090-e7ea-4da6-8fff-f261ca2047cf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:18.637822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a0807090-e7ea-4da6-8fff-f261ca2047cf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:18.644483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0807090-e7ea-4da6-8fff-f261ca2047cf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.644933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0807090-e7ea-4da6-8fff-f261ca2047cf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.645881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0807090-e7ea-4da6-8fff-f261ca2047cf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.646635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0807090-e7ea-4da6-8fff-f261ca2047cf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.755664 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-13d1e807-c570-4f67-ab9d-a67fc161bf84 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/10be8668-bfa6-4b6d-81ac-519b00e138f1" status: 202 len: 0 microversion: 2.1 time: 1.734216 Jul 20 04:13:18.758037 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 431/900] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:13:17 2022] DELETE /compute/v2.1/os-floating-ips/10be8668-bfa6-4b6d-81ac-519b00e138f1 => generated 0 bytes in 1737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:18.764026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e08a6954-c4ee-40e0-812c-24c21fd538d2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:18.764654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e08a6954-c4ee-40e0-812c-24c21fd538d2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:18.774865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e08a6954-c4ee-40e0-812c-24c21fd538d2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.775561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e08a6954-c4ee-40e0-812c-24c21fd538d2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.776868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e08a6954-c4ee-40e0-812c-24c21fd538d2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.777753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e08a6954-c4ee-40e0-812c-24c21fd538d2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.967029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a0807090-e7ea-4da6-8fff-f261ca2047cf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:18.976259 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a0807090-e7ea-4da6-8fff-f261ca2047cf tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1462 microversion: 2.1 time: 0.344668 Jul 20 04:13:18.977590 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 470/901] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:18 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1462 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:18.993905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ba0b71ae-414b-4d06-9e05-2286f3d34715 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9db03550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:19.032549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e08a6954-c4ee-40e0-812c-24c21fd538d2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:19.045992 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e08a6954-c4ee-40e0-812c-24c21fd538d2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1322 microversion: 2.1 time: 0.286894 Jul 20 04:13:19.055493 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 432/902] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:18 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:19.056982 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ba0b71ae-414b-4d06-9e05-2286f3d34715 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.077731 Jul 20 04:13:19.057566 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 471/903] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:18 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:19.062118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ef0fd431-d9ee-4eb1-a738-4bb02ca761be req-3748e38c-e2ed-42b4-bc2c-7559b93dfdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0895e78-3e18-4ab2-b966-0561a857536c", "tag": "fb4a38b9-ae67-49b5-806c-bca8ef8b9f33"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:19.065997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-452f2025-9c72-4d08-9a76-dc84b059f4a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:19.066855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-452f2025-9c72-4d08-9a76-dc84b059f4a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:19.072700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ef0fd431-d9ee-4eb1-a738-4bb02ca761be req-3748e38c-e2ed-42b4-bc2c-7559b93dfdd8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.073145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ef0fd431-d9ee-4eb1-a738-4bb02ca761be req-3748e38c-e2ed-42b4-bc2c-7559b93dfdd8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.074350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-452f2025-9c72-4d08-9a76-dc84b059f4a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.074815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-452f2025-9c72-4d08-9a76-dc84b059f4a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.075631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-452f2025-9c72-4d08-9a76-dc84b059f4a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.076084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-452f2025-9c72-4d08-9a76-dc84b059f4a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.085657 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ef0fd431-d9ee-4eb1-a738-4bb02ca761be req-3748e38c-e2ed-42b4-bc2c-7559b93dfdd8 service nova] Creating event network-changed:fb4a38b9-ae67-49b5-806c-bca8ef8b9f33 for instance d0895e78-3e18-4ab2-b966-0561a857536c on n-h2-764485-11 Jul 20 04:13:19.092328 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ef0fd431-d9ee-4eb1-a738-4bb02ca761be req-3748e38c-e2ed-42b4-bc2c-7559b93dfdd8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033275 Jul 20 04:13:19.093166 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 472/904] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:19.100113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8bfec67c-4f1c-4b8e-b5cc-b4f003532a99 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:19.101039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8bfec67c-4f1c-4b8e-b5cc-b4f003532a99 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:19.107693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bfec67c-4f1c-4b8e-b5cc-b4f003532a99 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.108226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bfec67c-4f1c-4b8e-b5cc-b4f003532a99 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.109011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bfec67c-4f1c-4b8e-b5cc-b4f003532a99 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.109450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bfec67c-4f1c-4b8e-b5cc-b4f003532a99 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.146531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-452f2025-9c72-4d08-9a76-dc84b059f4a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:19.156784 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-452f2025-9c72-4d08-9a76-dc84b059f4a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1269 microversion: 2.1 time: 0.108995 Jul 20 04:13:19.157747 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 433/905] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:19 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1269 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:19.162863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-041ea661-8fcb-4d62-b83f-ba8ac2b65f77 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] Calling method '.version_select at 0x7fbf9d96c5e0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:19.421166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8bfec67c-4f1c-4b8e-b5cc-b4f003532a99 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:19.430276 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8bfec67c-4f1c-4b8e-b5cc-b4f003532a99 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1360 microversion: 2.1 time: 0.335416 Jul 20 04:13:19.440463 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 473/906] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:19 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1360 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:19.446951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-163cedb8-1fa1-4e84-8c04-e73cfa4de936 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:19.447605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-163cedb8-1fa1-4e84-8c04-e73cfa4de936 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:19.454455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-163cedb8-1fa1-4e84-8c04-e73cfa4de936 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.455109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-163cedb8-1fa1-4e84-8c04-e73cfa4de936 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.456120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-163cedb8-1fa1-4e84-8c04-e73cfa4de936 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.456721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-163cedb8-1fa1-4e84-8c04-e73cfa4de936 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.995062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-163cedb8-1fa1-4e84-8c04-e73cfa4de936 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:20.002787 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-163cedb8-1fa1-4e84-8c04-e73cfa4de936 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1463 microversion: 2.1 time: 0.561289 Jul 20 04:13:20.003372 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 474/907] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:19 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1463 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:20.007946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0f5da19d-27b8-4b00-bff3-c38da3e665ba tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.008604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0f5da19d-27b8-4b00-bff3-c38da3e665ba tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:20.014760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f5da19d-27b8-4b00-bff3-c38da3e665ba tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.016141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f5da19d-27b8-4b00-bff3-c38da3e665ba tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.017446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f5da19d-27b8-4b00-bff3-c38da3e665ba tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.019414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f5da19d-27b8-4b00-bff3-c38da3e665ba tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.242526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0f5da19d-27b8-4b00-bff3-c38da3e665ba tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:20.250185 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0f5da19d-27b8-4b00-bff3-c38da3e665ba tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.245801 Jul 20 04:13:20.250984 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 475/908] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:20.256136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-56f5c4a3-d4c0-4084-a5f2-7489ce757e06 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.256982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-56f5c4a3-d4c0-4084-a5f2-7489ce757e06 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:20.264681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56f5c4a3-d4c0-4084-a5f2-7489ce757e06 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.265128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56f5c4a3-d4c0-4084-a5f2-7489ce757e06 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.267167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56f5c4a3-d4c0-4084-a5f2-7489ce757e06 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.267641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56f5c4a3-d4c0-4084-a5f2-7489ce757e06 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.459491 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-041ea661-8fcb-4d62-b83f-ba8ac2b65f77 tempest-FloatingIPDetailsTestJSON-1687661050 tempest-FloatingIPDetailsTestJSON-1687661050-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/dd99a4a8-6a32-4259-b377-528affa169c5" status: 202 len: 0 microversion: 2.1 time: 1.300030 Jul 20 04:13:20.464274 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 434/909] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:13:19 2022] DELETE /compute/v2.1/os-floating-ips/dd99a4a8-6a32-4259-b377-528affa169c5 => generated 0 bytes in 1306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:20.469592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a219b0d-16fd-4831-a15a-9ed41c7e1438 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da049d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.482740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-56f5c4a3-d4c0-4084-a5f2-7489ce757e06 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:20.496391 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-56f5c4a3-d4c0-4084-a5f2-7489ce757e06 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1322 microversion: 2.1 time: 0.244334 Jul 20 04:13:20.507119 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 476/910] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:20.512845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-27019459", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c42b8c28-e93e-471e-b549-5718883dc7b6"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:20.523023 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a219b0d-16fd-4831-a15a-9ed41c7e1438 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.056810 Jul 20 04:13:20.529246 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 435/911] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:20.534482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6d9f4188-634c-4096-a64d-852f2f1abbbf tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.535118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6d9f4188-634c-4096-a64d-852f2f1abbbf tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:20.551430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d9f4188-634c-4096-a64d-852f2f1abbbf tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.552046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d9f4188-634c-4096-a64d-852f2f1abbbf tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.552881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d9f4188-634c-4096-a64d-852f2f1abbbf tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.553390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d9f4188-634c-4096-a64d-852f2f1abbbf tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.581410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:20.677721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6d9f4188-634c-4096-a64d-852f2f1abbbf tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:20.688262 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6d9f4188-634c-4096-a64d-852f2f1abbbf tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1275 microversion: 2.1 time: 0.157667 Jul 20 04:13:20.698969 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 436/912] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:20.704241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5929d911-6550-4452-be9e-f39c65816f10 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.705047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5929d911-6550-4452-be9e-f39c65816f10 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:20.714555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5929d911-6550-4452-be9e-f39c65816f10 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.715914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5929d911-6550-4452-be9e-f39c65816f10 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.716876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5929d911-6550-4452-be9e-f39c65816f10 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.717737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5929d911-6550-4452-be9e-f39c65816f10 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.889927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:20.890554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:20.891187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:20.891779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:20.892377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:20.915451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.915928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.916729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.917172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.921053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5929d911-6550-4452-be9e-f39c65816f10 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:20.931404 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5929d911-6550-4452-be9e-f39c65816f10 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1360 microversion: 2.1 time: 0.231018 Jul 20 04:13:20.935646 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 437/913] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1360 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:20.940649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d3874e2d-96f4-4596-9d05-d7c3f97d1e3c req-a4233d03-f965-406e-afeb-694e24501418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8bb6e1-5dc2-4370-9d9f-7156a11c451c", "name": "network-vif-plugged", "status": "completed", "tag": "607e04b7-5a1e-4f94-8b73-8315d16912cd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:20.955727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d3874e2d-96f4-4596-9d05-d7c3f97d1e3c req-a4233d03-f965-406e-afeb-694e24501418 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.957012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d3874e2d-96f4-4596-9d05-d7c3f97d1e3c req-a4233d03-f965-406e-afeb-694e24501418 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.964479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Getting quotas for project 5875a8f9aeef4ae09122649735d93375. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:20.976081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Getting quotas for user 61350a88f2664e6f9c6dee8a4186819b and project 5875a8f9aeef4ae09122649735d93375. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:20.981054 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d3874e2d-96f4-4596-9d05-d7c3f97d1e3c req-a4233d03-f965-406e-afeb-694e24501418 service nova] Creating event network-vif-plugged:607e04b7-5a1e-4f94-8b73-8315d16912cd for instance ec8bb6e1-5dc2-4370-9d9f-7156a11c451c on n-h1-764485-11 Jul 20 04:13:20.990256 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d3874e2d-96f4-4596-9d05-d7c3f97d1e3c req-a4233d03-f965-406e-afeb-694e24501418 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055825 Jul 20 04:13:20.991185 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 438/914] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:20.996765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:21.000251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:21.066491 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-042fd24b-7264-48c8-ae92-f556651eaaf2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557593 Jul 20 04:13:21.068041 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 477/915] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:13:21.081299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3b45fb36-349e-4cb3-bfa0-eca9a3f931cb tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:21.082276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3b45fb36-349e-4cb3-bfa0-eca9a3f931cb tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:21.155854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3b45fb36-349e-4cb3-bfa0-eca9a3f931cb tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:21.165504 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3b45fb36-349e-4cb3-bfa0-eca9a3f931cb tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1212 microversion: 2.1 time: 0.089280 Jul 20 04:13:21.171453 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 439/916] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:21 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1212 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:21.268685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bba15df3-0c7f-4d1e-8dcc-212ec0eefc8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:21.269714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bba15df3-0c7f-4d1e-8dcc-212ec0eefc8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:21.284967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bba15df3-0c7f-4d1e-8dcc-212ec0eefc8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:21.285853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bba15df3-0c7f-4d1e-8dcc-212ec0eefc8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.286552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bba15df3-0c7f-4d1e-8dcc-212ec0eefc8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:21.288099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bba15df3-0c7f-4d1e-8dcc-212ec0eefc8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.493593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bba15df3-0c7f-4d1e-8dcc-212ec0eefc8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:21.504695 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bba15df3-0c7f-4d1e-8dcc-212ec0eefc8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.240022 Jul 20 04:13:21.505745 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 478/917] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:21 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:21.515453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c8e7fe60-8088-4585-830b-d2891189bd41 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:21.516756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c8e7fe60-8088-4585-830b-d2891189bd41 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:21.524414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8e7fe60-8088-4585-830b-d2891189bd41 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:21.524927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8e7fe60-8088-4585-830b-d2891189bd41 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.525705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8e7fe60-8088-4585-830b-d2891189bd41 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:21.526132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8e7fe60-8088-4585-830b-d2891189bd41 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.536262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8687f6fb-fef4-4341-8c30-09e4ca89a7b8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dec5670>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:21.615330 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8687f6fb-fef4-4341-8c30-09e4ca89a7b8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.082806 Jul 20 04:13:21.624955 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 479/918] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:21 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:21.706798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9905b277-da2d-4d3d-809f-312290804c33 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:21.707888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9905b277-da2d-4d3d-809f-312290804c33 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:21.721393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9905b277-da2d-4d3d-809f-312290804c33 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:21.722135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9905b277-da2d-4d3d-809f-312290804c33 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.723634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9905b277-da2d-4d3d-809f-312290804c33 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:21.725333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9905b277-da2d-4d3d-809f-312290804c33 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.763167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c8e7fe60-8088-4585-830b-d2891189bd41 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:21.771614 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c8e7fe60-8088-4585-830b-d2891189bd41 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1322 microversion: 2.1 time: 0.260950 Jul 20 04:13:21.772845 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 440/919] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:21 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:21.831901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9905b277-da2d-4d3d-809f-312290804c33 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:21.841236 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9905b277-da2d-4d3d-809f-312290804c33 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1275 microversion: 2.1 time: 0.138881 Jul 20 04:13:21.842799 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 480/920] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:21 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1275 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:21.948107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-239ae834-61cb-4a8d-819a-d97d85fd5e7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:21.948805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-239ae834-61cb-4a8d-819a-d97d85fd5e7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:21.958524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-239ae834-61cb-4a8d-819a-d97d85fd5e7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:21.963972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-239ae834-61cb-4a8d-819a-d97d85fd5e7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.965222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-239ae834-61cb-4a8d-819a-d97d85fd5e7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:21.965945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-239ae834-61cb-4a8d-819a-d97d85fd5e7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.149798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-239ae834-61cb-4a8d-819a-d97d85fd5e7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:22.158792 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-239ae834-61cb-4a8d-819a-d97d85fd5e7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1360 microversion: 2.1 time: 0.214664 Jul 20 04:13:22.159383 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 441/921] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:21 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1360 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:22.189096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b89ab833-23e7-46cd-af3c-d9a172644776 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:22.190164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b89ab833-23e7-46cd-af3c-d9a172644776 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:22.201193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b89ab833-23e7-46cd-af3c-d9a172644776 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.202007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b89ab833-23e7-46cd-af3c-d9a172644776 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.203067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b89ab833-23e7-46cd-af3c-d9a172644776 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.203904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b89ab833-23e7-46cd-af3c-d9a172644776 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.300220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b89ab833-23e7-46cd-af3c-d9a172644776 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:22.320234 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b89ab833-23e7-46cd-af3c-d9a172644776 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1264 microversion: 2.1 time: 0.134936 Jul 20 04:13:22.321159 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 481/922] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:22 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:22.525910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ea03d8dd-4d8e-4204-aff9-8c2d3422db25 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:22.526854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ea03d8dd-4d8e-4204-aff9-8c2d3422db25 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:22.534073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea03d8dd-4d8e-4204-aff9-8c2d3422db25 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.535157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea03d8dd-4d8e-4204-aff9-8c2d3422db25 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.536444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea03d8dd-4d8e-4204-aff9-8c2d3422db25 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.538965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea03d8dd-4d8e-4204-aff9-8c2d3422db25 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.641822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2f9009eb-3e17-4120-86ad-2c6bf1a95746 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9e111dc0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:22.711916 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2f9009eb-3e17-4120-86ad-2c6bf1a95746 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.075087 Jul 20 04:13:22.714307 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 482/923] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:22 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:22.795970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-22c7f91e-1d3f-4d77-ae1e-82c18534cdaa tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:22.795970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-22c7f91e-1d3f-4d77-ae1e-82c18534cdaa tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:22.805719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ea03d8dd-4d8e-4204-aff9-8c2d3422db25 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:22.808555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:22.809452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22c7f91e-1d3f-4d77-ae1e-82c18534cdaa tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.810870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22c7f91e-1d3f-4d77-ae1e-82c18534cdaa tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.811975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22c7f91e-1d3f-4d77-ae1e-82c18534cdaa tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.812433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22c7f91e-1d3f-4d77-ae1e-82c18534cdaa tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.817035 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ea03d8dd-4d8e-4204-aff9-8c2d3422db25 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.297382 Jul 20 04:13:22.828315 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 442/924] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:22 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:22.840494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:22.861466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a076093-0d3d-49e5-a149-ad89d4cd5a44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:22.862260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a076093-0d3d-49e5-a149-ad89d4cd5a44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:22.870123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a076093-0d3d-49e5-a149-ad89d4cd5a44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.870650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a076093-0d3d-49e5-a149-ad89d4cd5a44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.871774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a076093-0d3d-49e5-a149-ad89d4cd5a44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.872295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a076093-0d3d-49e5-a149-ad89d4cd5a44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.965454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a076093-0d3d-49e5-a149-ad89d4cd5a44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:23.004005 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a076093-0d3d-49e5-a149-ad89d4cd5a44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1275 microversion: 2.1 time: 0.146954 Jul 20 04:13:23.010585 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 443/925] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:22 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:23.177006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-48649797-e4c1-418c-8bc2-adfc5a4dacf6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:23.177847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-48649797-e4c1-418c-8bc2-adfc5a4dacf6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:23.213469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48649797-e4c1-418c-8bc2-adfc5a4dacf6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:23.213922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48649797-e4c1-418c-8bc2-adfc5a4dacf6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:23.214712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48649797-e4c1-418c-8bc2-adfc5a4dacf6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:23.215151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48649797-e4c1-418c-8bc2-adfc5a4dacf6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:23.622888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-22c7f91e-1d3f-4d77-ae1e-82c18534cdaa tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:23.639886 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-22c7f91e-1d3f-4d77-ae1e-82c18534cdaa tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1322 microversion: 2.1 time: 0.852056 Jul 20 04:13:23.642347 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 483/926] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:22 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1322 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:23.663114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6f4ab98e-c76f-4eef-8f56-5629a2de8ff4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:23.664221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6f4ab98e-c76f-4eef-8f56-5629a2de8ff4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:23.700182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f4ab98e-c76f-4eef-8f56-5629a2de8ff4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:23.703821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f4ab98e-c76f-4eef-8f56-5629a2de8ff4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:23.708300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f4ab98e-c76f-4eef-8f56-5629a2de8ff4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:23.708785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f4ab98e-c76f-4eef-8f56-5629a2de8ff4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:24.196256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6f4ab98e-c76f-4eef-8f56-5629a2de8ff4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:24.210850 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6f4ab98e-c76f-4eef-8f56-5629a2de8ff4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1270 microversion: 2.1 time: 0.567533 Jul 20 04:13:24.211735 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 484/927] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:23 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1270 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:24.242629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f5a9115-4ff4-4cb8-af04-e018c47827e6 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9fed9280>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:24.318616 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f5a9115-4ff4-4cb8-af04-e018c47827e6 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.094606 Jul 20 04:13:24.321832 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 485/928] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:24 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:24.330342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-781a17c4-1aec-4b38-a2d9-d5885a6549bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:24.330970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-781a17c4-1aec-4b38-a2d9-d5885a6549bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:24.349636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-781a17c4-1aec-4b38-a2d9-d5885a6549bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:24.349636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-781a17c4-1aec-4b38-a2d9-d5885a6549bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:24.349960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-781a17c4-1aec-4b38-a2d9-d5885a6549bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:24.350732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-781a17c4-1aec-4b38-a2d9-d5885a6549bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:24.382282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-48649797-e4c1-418c-8bc2-adfc5a4dacf6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:24.394079 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-48649797-e4c1-418c-8bc2-adfc5a4dacf6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1360 microversion: 2.1 time: 1.219591 Jul 20 04:13:24.404690 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 444/929] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:23 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1360 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:24.415428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd8302e7-289c-4e6f-aa27-3549625ea708 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:24.426156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cd8302e7-289c-4e6f-aa27-3549625ea708 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:24.440534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd8302e7-289c-4e6f-aa27-3549625ea708 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:24.440994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd8302e7-289c-4e6f-aa27-3549625ea708 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:24.441868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd8302e7-289c-4e6f-aa27-3549625ea708 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:24.442307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd8302e7-289c-4e6f-aa27-3549625ea708 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:24.858144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cd8302e7-289c-4e6f-aa27-3549625ea708 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:24.870480 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd8302e7-289c-4e6f-aa27-3549625ea708 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1317 microversion: 2.1 time: 0.462289 Jul 20 04:13:24.884528 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 445/930] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:24 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:24.890678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-93573bf0-a7fd-40bf-81bf-abc3e48eac05 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:24.891623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-93573bf0-a7fd-40bf-81bf-abc3e48eac05 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:24.898810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93573bf0-a7fd-40bf-81bf-abc3e48eac05 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:24.899533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93573bf0-a7fd-40bf-81bf-abc3e48eac05 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:24.900559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93573bf0-a7fd-40bf-81bf-abc3e48eac05 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:24.901205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93573bf0-a7fd-40bf-81bf-abc3e48eac05 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:25.019794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-781a17c4-1aec-4b38-a2d9-d5885a6549bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:25.032607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-781a17c4-1aec-4b38-a2d9-d5885a6549bb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.709500 Jul 20 04:13:25.035050 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 486/931] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:24 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:25.228750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7df99e53-d89a-4e49-a5a4-696dc139632b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:25.229635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7df99e53-d89a-4e49-a5a4-696dc139632b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:25.236965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7df99e53-d89a-4e49-a5a4-696dc139632b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:25.237644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7df99e53-d89a-4e49-a5a4-696dc139632b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:25.238847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7df99e53-d89a-4e49-a5a4-696dc139632b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:25.239972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7df99e53-d89a-4e49-a5a4-696dc139632b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:25.460362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7df99e53-d89a-4e49-a5a4-696dc139632b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:25.472025 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7df99e53-d89a-4e49-a5a4-696dc139632b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1270 microversion: 2.1 time: 0.248079 Jul 20 04:13:25.473109 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 487/932] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:25 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1270 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:25.478531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7b2fdee3-1803-4cd1-bbf9-4b165f17b7c7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9e0039d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:25.573260 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7b2fdee3-1803-4cd1-bbf9-4b165f17b7c7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.098733 Jul 20 04:13:25.575914 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 488/933] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:25 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:25.588708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91739251-efc4-4b56-b082-77a3b033e46b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:25.589393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91739251-efc4-4b56-b082-77a3b033e46b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:25.604969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91739251-efc4-4b56-b082-77a3b033e46b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:25.610050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91739251-efc4-4b56-b082-77a3b033e46b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:25.611080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91739251-efc4-4b56-b082-77a3b033e46b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:25.611775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91739251-efc4-4b56-b082-77a3b033e46b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:25.648395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-93573bf0-a7fd-40bf-81bf-abc3e48eac05 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:25.657320 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-93573bf0-a7fd-40bf-81bf-abc3e48eac05 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1472 microversion: 2.1 time: 0.770706 Jul 20 04:13:25.666620 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 446/934] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:24 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1472 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:25.800128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c444715c-abca-4159-8faa-8bfb76e6abd3 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:25.800815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c444715c-abca-4159-8faa-8bfb76e6abd3 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] [instance: 9647d5f0-e693-4b7b-89e4-8d94bb367d99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:25.840545 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-c444715c-abca-4159-8faa-8bfb76e6abd3 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] HTTP exception thrown: Instance 9647d5f0-e693-4b7b-89e4-8d94bb367d99 could not be found. Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c444715c-abca-4159-8faa-8bfb76e6abd3 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Request method failure captured: Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/9647d5f0-e693-4b7b-89e4-8d94bb367d99/action HTTP/1.1 Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 15 Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14DPL0GCvBlUfcq3yvDie1QGfVf50foYfJ2UaEBwGb2Zm3lwX4Md9yiHXIb3FzDo_mnWMRvTRDJRbcqZGveaG3tH_cu3-AO3CULrh5mWXeGp7xW1a5SvxS9e382hQj3OkSRHHysD9KMkTiKIM3C0YJw050dw54djn0BGwHPWPZPswns Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 24477abdf5434f5bab1d3cfbc8b9cfcf Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:13:25.842763 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_24477abdf5434f5bab1d3cfbc8b9cfcf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}] Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 24477abdf5434f5bab1d3cfbc8b9cfcf Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersAdminNegativeTestJSON-971466896-project-admin Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 03468c09883a4d73b118dc8852761e66 Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersAdminNegativeTestJSON-971466896-project-admin Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: {"migrate": {}} Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:13:25.844483 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 9647d5f0-e693-4b7b-89e4-8d94bb367d99 could not be found. Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '9647d5f0-e693-4b7b-89e4-8d94bb367d99', 'body': {'migrate': {}}} Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9647d5f0-e693-4b7b-89e4-8d94bb367d99 could not be found. Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:25.853426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9647d5f0-e693-4b7b-89e4-8d94bb367d99 could not be found. Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9647d5f0-e693-4b7b-89e4-8d94bb367d99 could not be found. Jul 20 04:13:25.854883 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:13:25.856206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c444715c-abca-4159-8faa-8bfb76e6abd3 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Returning 404 to user: Instance 9647d5f0-e693-4b7b-89e4-8d94bb367d99 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:25.856206 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c444715c-abca-4159-8faa-8bfb76e6abd3 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/9647d5f0-e693-4b7b-89e4-8d94bb367d99/action" status: 404 len: 111 microversion: 2.1 time: 0.161092 Jul 20 04:13:25.856206 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 447/935] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:25 2022] POST /compute/v2.1/servers/9647d5f0-e693-4b7b-89e4-8d94bb367d99/action => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:25.892278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-58276bc9-11d7-4cba-b9fe-12fb41b155ef tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:25.892906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-58276bc9-11d7-4cba-b9fe-12fb41b155ef tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:25.906063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58276bc9-11d7-4cba-b9fe-12fb41b155ef tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:25.906395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58276bc9-11d7-4cba-b9fe-12fb41b155ef tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:25.907187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58276bc9-11d7-4cba-b9fe-12fb41b155ef tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:25.907671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58276bc9-11d7-4cba-b9fe-12fb41b155ef tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:26.162294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91739251-efc4-4b56-b082-77a3b033e46b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:26.171138 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91739251-efc4-4b56-b082-77a3b033e46b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1360 microversion: 2.1 time: 0.594090 Jul 20 04:13:26.176101 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 489/936] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:25 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1360 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:26.186773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-b31985a0-833f-4f64-8bdd-cc256ca31e1c req-42f07963-0348-4c61-956e-77e9811cdf4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee027f2-e9fe-4399-899d-142b4c3b538a", "tag": "757eb3b3-c7a1-48a2-9cf0-3c5eec6bf2f7"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:26.220021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b31985a0-833f-4f64-8bdd-cc256ca31e1c req-42f07963-0348-4c61-956e-77e9811cdf4f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:26.220471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b31985a0-833f-4f64-8bdd-cc256ca31e1c req-42f07963-0348-4c61-956e-77e9811cdf4f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:26.245670 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-b31985a0-833f-4f64-8bdd-cc256ca31e1c req-42f07963-0348-4c61-956e-77e9811cdf4f service nova] Creating event network-changed:757eb3b3-c7a1-48a2-9cf0-3c5eec6bf2f7 for instance 0ee027f2-e9fe-4399-899d-142b4c3b538a on n-h2-764485-11 Jul 20 04:13:26.264516 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-b31985a0-833f-4f64-8bdd-cc256ca31e1c req-42f07963-0348-4c61-956e-77e9811cdf4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086827 Jul 20 04:13:26.265352 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 490/937] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:26.270832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1055620251", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:26.394030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:26.544015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-58276bc9-11d7-4cba-b9fe-12fb41b155ef tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:26.556082 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-58276bc9-11d7-4cba-b9fe-12fb41b155ef tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1317 microversion: 2.1 time: 0.667579 Jul 20 04:13:26.556685 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 448/938] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:25 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:26.566110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-89d2dc5e-3e13-454c-ac93-94427292121e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:26.567472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-89d2dc5e-3e13-454c-ac93-94427292121e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:26.584101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89d2dc5e-3e13-454c-ac93-94427292121e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:26.585535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89d2dc5e-3e13-454c-ac93-94427292121e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:26.586645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89d2dc5e-3e13-454c-ac93-94427292121e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:26.591889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89d2dc5e-3e13-454c-ac93-94427292121e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.562007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89d2dc5e-3e13-454c-ac93-94427292121e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:27.578069 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-89d2dc5e-3e13-454c-ac93-94427292121e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 1.020307 Jul 20 04:13:27.578665 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 449/939] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:26 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:27.592691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-39cd16b7-4543-4e77-84f1-7802f63207ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:27.593399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-39cd16b7-4543-4e77-84f1-7802f63207ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:27.609827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39cd16b7-4543-4e77-84f1-7802f63207ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.610974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39cd16b7-4543-4e77-84f1-7802f63207ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.612018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39cd16b7-4543-4e77-84f1-7802f63207ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.612649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39cd16b7-4543-4e77-84f1-7802f63207ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.741821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:27.743196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:27.743914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:27.744524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:27.745133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:27.748983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:27.763208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=76 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:27.779226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.782499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.783549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.791373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.849896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Getting quotas for project daa85be80057484a8e47c9ff76efc2c8. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:27.866539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Getting quotas for user f64c988993bd4107a8ba5103c143385d and project daa85be80057484a8e47c9ff76efc2c8. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:27.930671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:27.935382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:28.041901 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b045810-b7fa-482e-98ee-5bebf1009039 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.775095 Jul 20 04:13:28.048273 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 491/940] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:13:28.061170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-492596f8-c179-4b24-8c65-6c485f48cdff tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9e145ca0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:28.063263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-39cd16b7-4543-4e77-84f1-7802f63207ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:28.088581 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-39cd16b7-4543-4e77-84f1-7802f63207ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1312 microversion: 2.1 time: 0.507104 Jul 20 04:13:28.101488 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 450/941] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:27 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1312 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:28.110709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f76975bd-ed59-4f9b-91e7-ebd831f4a1d8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:28.113215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f76975bd-ed59-4f9b-91e7-ebd831f4a1d8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:28.121451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f76975bd-ed59-4f9b-91e7-ebd831f4a1d8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:28.122298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f76975bd-ed59-4f9b-91e7-ebd831f4a1d8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.123326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f76975bd-ed59-4f9b-91e7-ebd831f4a1d8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:28.132670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f76975bd-ed59-4f9b-91e7-ebd831f4a1d8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.152275 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-492596f8-c179-4b24-8c65-6c485f48cdff tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.102607 Jul 20 04:13:28.152895 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 492/942] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:28 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:28.163204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d4daa1b7-39d0-444e-bd03-07f7e899a1b1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:28.168105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d4daa1b7-39d0-444e-bd03-07f7e899a1b1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:28.202012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4daa1b7-39d0-444e-bd03-07f7e899a1b1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:28.202866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4daa1b7-39d0-444e-bd03-07f7e899a1b1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.206558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4daa1b7-39d0-444e-bd03-07f7e899a1b1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:28.207103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4daa1b7-39d0-444e-bd03-07f7e899a1b1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.464537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f76975bd-ed59-4f9b-91e7-ebd831f4a1d8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:28.478102 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f76975bd-ed59-4f9b-91e7-ebd831f4a1d8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1360 microversion: 2.1 time: 0.383349 Jul 20 04:13:28.481650 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 451/943] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:28 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1360 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:28.492847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b78ed000-368a-445f-9a54-390fff68edd9 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:28.507496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b78ed000-368a-445f-9a54-390fff68edd9 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:28.604353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b78ed000-368a-445f-9a54-390fff68edd9 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:28.610072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d4daa1b7-39d0-444e-bd03-07f7e899a1b1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:28.612926 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b78ed000-368a-445f-9a54-390fff68edd9 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1222 microversion: 2.1 time: 0.129964 Jul 20 04:13:28.615389 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 452/944] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:28 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:28.637207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3fd803f9-2b7d-4f2f-ac30-0914e9ca5747 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:28.638194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3fd803f9-2b7d-4f2f-ac30-0914e9ca5747 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:28.640633 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d4daa1b7-39d0-444e-bd03-07f7e899a1b1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1317 microversion: 2.1 time: 0.481882 Jul 20 04:13:28.649251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fd803f9-2b7d-4f2f-ac30-0914e9ca5747 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:28.649802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fd803f9-2b7d-4f2f-ac30-0914e9ca5747 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.652444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fd803f9-2b7d-4f2f-ac30-0914e9ca5747 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:28.653686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fd803f9-2b7d-4f2f-ac30-0914e9ca5747 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.655595 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 493/945] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:28 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:28.904895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-8fb9430b-7758-4268-b409-90a90e3805fa req-36f4969e-7524-4e20-b9e0-8b0712d3295f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70dee161-ab18-4fdf-a60b-c6737b36f926", "tag": "aa64411a-0dd4-4483-a641-dc91cfde3a79"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:28.929609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-8fb9430b-7758-4268-b409-90a90e3805fa req-36f4969e-7524-4e20-b9e0-8b0712d3295f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:28.933799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-8fb9430b-7758-4268-b409-90a90e3805fa req-36f4969e-7524-4e20-b9e0-8b0712d3295f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.964548 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-8fb9430b-7758-4268-b409-90a90e3805fa req-36f4969e-7524-4e20-b9e0-8b0712d3295f service nova] Creating event network-changed:aa64411a-0dd4-4483-a641-dc91cfde3a79 for instance 70dee161-ab18-4fdf-a60b-c6737b36f926 on n-h1-764485-11 Jul 20 04:13:28.966398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3fd803f9-2b7d-4f2f-ac30-0914e9ca5747 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:28.977167 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-8fb9430b-7758-4268-b409-90a90e3805fa req-36f4969e-7524-4e20-b9e0-8b0712d3295f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075075 Jul 20 04:13:28.978641 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 494/946] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:28.981566 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3fd803f9-2b7d-4f2f-ac30-0914e9ca5747 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.362887 Jul 20 04:13:28.982441 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 453/947] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:28 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:29.111951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-502fa23f-9f9b-41e8-a920-099d52dc6506 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.112868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-502fa23f-9f9b-41e8-a920-099d52dc6506 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:29.160768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-502fa23f-9f9b-41e8-a920-099d52dc6506 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.163197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-502fa23f-9f9b-41e8-a920-099d52dc6506 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.165319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-502fa23f-9f9b-41e8-a920-099d52dc6506 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.165780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-502fa23f-9f9b-41e8-a920-099d52dc6506 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.167379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0e59a039-cbf9-4338-8bf6-53cb6713d1a9 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9db579d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.276650 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0e59a039-cbf9-4338-8bf6-53cb6713d1a9 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.113518 Jul 20 04:13:29.277667 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 454/948] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:29.299854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6c65d5c2-8130-4c87-aa02-939b292476a6 req-1f8cc947-e337-49ee-8262-5ac848c54f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0895e78-3e18-4ab2-b966-0561a857536c", "name": "network-vif-plugged", "status": "completed", "tag": "fb4a38b9-ae67-49b5-806c-bca8ef8b9f33"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:29.314898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6c65d5c2-8130-4c87-aa02-939b292476a6 req-1f8cc947-e337-49ee-8262-5ac848c54f67 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.315734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6c65d5c2-8130-4c87-aa02-939b292476a6 req-1f8cc947-e337-49ee-8262-5ac848c54f67 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.350499 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-6c65d5c2-8130-4c87-aa02-939b292476a6 req-1f8cc947-e337-49ee-8262-5ac848c54f67 service nova] Creating event network-vif-plugged:fb4a38b9-ae67-49b5-806c-bca8ef8b9f33 for instance d0895e78-3e18-4ab2-b966-0561a857536c on n-h2-764485-11 Jul 20 04:13:29.357166 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6c65d5c2-8130-4c87-aa02-939b292476a6 req-1f8cc947-e337-49ee-8262-5ac848c54f67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069995 Jul 20 04:13:29.358427 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 455/949] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:29.424038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-502fa23f-9f9b-41e8-a920-099d52dc6506 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:29.432936 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-502fa23f-9f9b-41e8-a920-099d52dc6506 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1312 microversion: 2.1 time: 0.327358 Jul 20 04:13:29.443266 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 495/950] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1312 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:29.504461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6f75f65d-a2bd-4765-9797-fef47b3b5567 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.506075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6f75f65d-a2bd-4765-9797-fef47b3b5567 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:29.515121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f75f65d-a2bd-4765-9797-fef47b3b5567 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.515862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f75f65d-a2bd-4765-9797-fef47b3b5567 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.517544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f75f65d-a2bd-4765-9797-fef47b3b5567 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.518184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f75f65d-a2bd-4765-9797-fef47b3b5567 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.632865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2714a74a-7a77-444f-a343-d520acb15025 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.633490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2714a74a-7a77-444f-a343-d520acb15025 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:29.644464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2714a74a-7a77-444f-a343-d520acb15025 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.651497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2714a74a-7a77-444f-a343-d520acb15025 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.652698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2714a74a-7a77-444f-a343-d520acb15025 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.653349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2714a74a-7a77-444f-a343-d520acb15025 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.747385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2714a74a-7a77-444f-a343-d520acb15025 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:29.753346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6f75f65d-a2bd-4765-9797-fef47b3b5567 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:29.758451 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2714a74a-7a77-444f-a343-d520acb15025 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1226 microversion: 2.1 time: 0.130512 Jul 20 04:13:29.760225 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 496/951] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1226 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:29.764903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-56e2b493-3797-4d6a-80fe-d46c350282ba tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.765678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-56e2b493-3797-4d6a-80fe-d46c350282ba tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:29.773766 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6f75f65d-a2bd-4765-9797-fef47b3b5567 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1360 microversion: 2.1 time: 0.280167 Jul 20 04:13:29.778442 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 456/952] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1360 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:29.781082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56e2b493-3797-4d6a-80fe-d46c350282ba tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.781793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56e2b493-3797-4d6a-80fe-d46c350282ba tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.782760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56e2b493-3797-4d6a-80fe-d46c350282ba tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.783210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56e2b493-3797-4d6a-80fe-d46c350282ba tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.993297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-56e2b493-3797-4d6a-80fe-d46c350282ba tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:30.000268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59e8d5ce-9849-4118-8b63-025a2329e402 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:30.000892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-59e8d5ce-9849-4118-8b63-025a2329e402 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:30.003688 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-56e2b493-3797-4d6a-80fe-d46c350282ba tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1317 microversion: 2.1 time: 0.242162 Jul 20 04:13:30.006117 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 497/953] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:30.028549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59e8d5ce-9849-4118-8b63-025a2329e402 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.029989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59e8d5ce-9849-4118-8b63-025a2329e402 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.031603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59e8d5ce-9849-4118-8b63-025a2329e402 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.032644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59e8d5ce-9849-4118-8b63-025a2329e402 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.220400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-59e8d5ce-9849-4118-8b63-025a2329e402 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:30.229940 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-59e8d5ce-9849-4118-8b63-025a2329e402 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.234339 Jul 20 04:13:30.231392 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 457/954] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:30.291003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39eaacc8-fdb9-4e1f-91a4-962b5ba4a8c8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9def0160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:30.346202 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39eaacc8-fdb9-4e1f-91a4-962b5ba4a8c8 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.060153 Jul 20 04:13:30.352488 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 498/955] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:30 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:30.451873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a4a3e30e-ce38-408d-bfe3-f7a9ffa5cd6d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:30.453543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a4a3e30e-ce38-408d-bfe3-f7a9ffa5cd6d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:30.463289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a4a3e30e-ce38-408d-bfe3-f7a9ffa5cd6d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.468176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a4a3e30e-ce38-408d-bfe3-f7a9ffa5cd6d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.469430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a4a3e30e-ce38-408d-bfe3-f7a9ffa5cd6d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.470373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a4a3e30e-ce38-408d-bfe3-f7a9ffa5cd6d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.689961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a4a3e30e-ce38-408d-bfe3-f7a9ffa5cd6d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:30.704040 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a4a3e30e-ce38-408d-bfe3-f7a9ffa5cd6d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1312 microversion: 2.1 time: 0.257737 Jul 20 04:13:30.711181 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 458/956] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:30 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1312 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:30.779664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c6832a5-c5e5-450d-8482-3effcc8405d4 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:30.779664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6c6832a5-c5e5-450d-8482-3effcc8405d4 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:30.789404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c6832a5-c5e5-450d-8482-3effcc8405d4 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.797147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c6832a5-c5e5-450d-8482-3effcc8405d4 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.797534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-063524f9-ed6b-4128-aec9-2f70b04fd2d9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:30.798165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-063524f9-ed6b-4128-aec9-2f70b04fd2d9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:30.799527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c6832a5-c5e5-450d-8482-3effcc8405d4 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.800145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c6832a5-c5e5-450d-8482-3effcc8405d4 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.818522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-063524f9-ed6b-4128-aec9-2f70b04fd2d9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.820054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-063524f9-ed6b-4128-aec9-2f70b04fd2d9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.820906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-063524f9-ed6b-4128-aec9-2f70b04fd2d9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.825129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-063524f9-ed6b-4128-aec9-2f70b04fd2d9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.928810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6c6832a5-c5e5-450d-8482-3effcc8405d4 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:30.937209 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6c6832a5-c5e5-450d-8482-3effcc8405d4 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1218 microversion: 2.1 time: 0.165491 Jul 20 04:13:30.947076 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 499/957] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:30 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:31.022920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-33a8b530-602c-44ca-82e0-e573a1f833c9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:31.023663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-33a8b530-602c-44ca-82e0-e573a1f833c9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:31.030499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-33a8b530-602c-44ca-82e0-e573a1f833c9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.035432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-33a8b530-602c-44ca-82e0-e573a1f833c9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.036336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-33a8b530-602c-44ca-82e0-e573a1f833c9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.036694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-33a8b530-602c-44ca-82e0-e573a1f833c9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.148348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-063524f9-ed6b-4128-aec9-2f70b04fd2d9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:31.159464 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-063524f9-ed6b-4128-aec9-2f70b04fd2d9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1360 microversion: 2.1 time: 0.366724 Jul 20 04:13:31.160593 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 459/958] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:30 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1360 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:31.248963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c55d1344-8318-48aa-beb4-655f76979d2c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:31.249553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c55d1344-8318-48aa-beb4-655f76979d2c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:31.262332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c55d1344-8318-48aa-beb4-655f76979d2c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.263047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c55d1344-8318-48aa-beb4-655f76979d2c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.263686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-33a8b530-602c-44ca-82e0-e573a1f833c9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:31.264701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c55d1344-8318-48aa-beb4-655f76979d2c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.266129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c55d1344-8318-48aa-beb4-655f76979d2c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.273799 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-33a8b530-602c-44ca-82e0-e573a1f833c9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1317 microversion: 2.1 time: 0.255002 Jul 20 04:13:31.286846 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 500/959] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:31 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:31.361446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e5ef9009-6140-4dee-86e5-8508fc89bb0f tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dfb4a60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:31.454386 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e5ef9009-6140-4dee-86e5-8508fc89bb0f tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.097973 Jul 20 04:13:31.462170 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 501/960] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:31 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:31.510814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c55d1344-8318-48aa-beb4-655f76979d2c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:31.522494 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c55d1344-8318-48aa-beb4-655f76979d2c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.277252 Jul 20 04:13:31.523451 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 460/961] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:31 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:31.729842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-af1a0096-def8-4987-b041-c16c79c85487 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:31.730508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-af1a0096-def8-4987-b041-c16c79c85487 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:31.738676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af1a0096-def8-4987-b041-c16c79c85487 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.739638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af1a0096-def8-4987-b041-c16c79c85487 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.740708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af1a0096-def8-4987-b041-c16c79c85487 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.741479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af1a0096-def8-4987-b041-c16c79c85487 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.937832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af1a0096-def8-4987-b041-c16c79c85487 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:31.950090 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-af1a0096-def8-4987-b041-c16c79c85487 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1312 microversion: 2.1 time: 0.224447 Jul 20 04:13:31.950994 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 502/962] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:31 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1312 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:31.965153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3d0856df-ee61-4a58-9763-6a17f20fe95b tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:31.965778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3d0856df-ee61-4a58-9763-6a17f20fe95b tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:31.972704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d0856df-ee61-4a58-9763-6a17f20fe95b tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.973295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d0856df-ee61-4a58-9763-6a17f20fe95b tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.974181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d0856df-ee61-4a58-9763-6a17f20fe95b tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.974696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d0856df-ee61-4a58-9763-6a17f20fe95b tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.070130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3d0856df-ee61-4a58-9763-6a17f20fe95b tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:32.082917 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3d0856df-ee61-4a58-9763-6a17f20fe95b tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1274 microversion: 2.1 time: 0.121995 Jul 20 04:13:32.094620 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 461/963] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:31 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:32.177909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c4a28696-eb92-4572-a0c4-b8e50631ce63 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:32.178816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c4a28696-eb92-4572-a0c4-b8e50631ce63 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:32.227497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4a28696-eb92-4572-a0c4-b8e50631ce63 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.228236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4a28696-eb92-4572-a0c4-b8e50631ce63 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.230086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4a28696-eb92-4572-a0c4-b8e50631ce63 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.230541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4a28696-eb92-4572-a0c4-b8e50631ce63 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.293102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-927e34d1-1018-40d9-b529-45af4867c63c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:32.293720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-927e34d1-1018-40d9-b529-45af4867c63c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:32.302315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-927e34d1-1018-40d9-b529-45af4867c63c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.302780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-927e34d1-1018-40d9-b529-45af4867c63c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.304424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-927e34d1-1018-40d9-b529-45af4867c63c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.305081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-927e34d1-1018-40d9-b529-45af4867c63c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.597919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c4a28696-eb92-4572-a0c4-b8e50631ce63 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:32.624571 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c4a28696-eb92-4572-a0c4-b8e50631ce63 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1360 microversion: 2.1 time: 0.451154 Jul 20 04:13:32.637209 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 503/964] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:32 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1360 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:32.642107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-84a68aa5-f8e9-4a67-b48f-71298c0b6298 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9e111940>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:32.646224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-927e34d1-1018-40d9-b529-45af4867c63c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:32.659081 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-927e34d1-1018-40d9-b529-45af4867c63c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1317 microversion: 2.1 time: 0.371509 Jul 20 04:13:32.659741 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 462/965] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:32 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:32.672344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9e57e50-9a6d-45eb-a386-104be9a4e98b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:32.674986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a9e57e50-9a6d-45eb-a386-104be9a4e98b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:32.695685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e57e50-9a6d-45eb-a386-104be9a4e98b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.698079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e57e50-9a6d-45eb-a386-104be9a4e98b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.700837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e57e50-9a6d-45eb-a386-104be9a4e98b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.701844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e57e50-9a6d-45eb-a386-104be9a4e98b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.739074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:32.776537 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-84a68aa5-f8e9-4a67-b48f-71298c0b6298 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.138148 Jul 20 04:13:32.777838 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 504/966] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:32 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:32.919827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a9e57e50-9a6d-45eb-a386-104be9a4e98b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:32.932451 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a9e57e50-9a6d-45eb-a386-104be9a4e98b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.268386 Jul 20 04:13:32.951893 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 463/967] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:32 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:32.970504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d9c964df-d274-4aeb-a5dc-f25c17e1c8ef tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:32.972245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d9c964df-d274-4aeb-a5dc-f25c17e1c8ef tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:32.984806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9c964df-d274-4aeb-a5dc-f25c17e1c8ef tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.985300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9c964df-d274-4aeb-a5dc-f25c17e1c8ef tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.986580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9c964df-d274-4aeb-a5dc-f25c17e1c8ef tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.987241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9c964df-d274-4aeb-a5dc-f25c17e1c8ef tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.108979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d618734a-6fd5-4b05-8dab-dac3b36ecca7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.110247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d618734a-6fd5-4b05-8dab-dac3b36ecca7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:33.120574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d618734a-6fd5-4b05-8dab-dac3b36ecca7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.122023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d618734a-6fd5-4b05-8dab-dac3b36ecca7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.123043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d618734a-6fd5-4b05-8dab-dac3b36ecca7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.123732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d618734a-6fd5-4b05-8dab-dac3b36ecca7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.240130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d9c964df-d274-4aeb-a5dc-f25c17e1c8ef tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:33.262606 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d9c964df-d274-4aeb-a5dc-f25c17e1c8ef tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1312 microversion: 2.1 time: 0.296567 Jul 20 04:13:33.274334 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 505/968] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:32 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1312 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:33.319877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d618734a-6fd5-4b05-8dab-dac3b36ecca7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:33.342050 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d618734a-6fd5-4b05-8dab-dac3b36ecca7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1274 microversion: 2.1 time: 0.245152 Jul 20 04:13:33.343087 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 464/969] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:33.655710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b8d52379-65e6-46d4-8b96-387f38dd149f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.656656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b8d52379-65e6-46d4-8b96-387f38dd149f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:33.666932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8d52379-65e6-46d4-8b96-387f38dd149f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.667661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8d52379-65e6-46d4-8b96-387f38dd149f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.668985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8d52379-65e6-46d4-8b96-387f38dd149f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.669688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8d52379-65e6-46d4-8b96-387f38dd149f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.676624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5ca08dbb-d72f-451b-ad5c-127c71022032 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.677567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5ca08dbb-d72f-451b-ad5c-127c71022032 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:33.695845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ca08dbb-d72f-451b-ad5c-127c71022032 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.696603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ca08dbb-d72f-451b-ad5c-127c71022032 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.697559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ca08dbb-d72f-451b-ad5c-127c71022032 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.698158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ca08dbb-d72f-451b-ad5c-127c71022032 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.924930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b8d52379-65e6-46d4-8b96-387f38dd149f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:33.936001 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b8d52379-65e6-46d4-8b96-387f38dd149f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1543 microversion: 2.1 time: 0.285399 Jul 20 04:13:33.948057 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 506/970] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1543 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:33.954816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bb317ba9-a1b0-478a-9a40-7e64c01d53d0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9df80310>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:34.059928 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bb317ba9-a1b0-478a-9a40-7e64c01d53d0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.120661 Jul 20 04:13:34.060870 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 507/971] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:34.067972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0004e6de-581f-42e8-8b8f-0e12286a340b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:34.069510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0004e6de-581f-42e8-8b8f-0e12286a340b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:34.077825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0004e6de-581f-42e8-8b8f-0e12286a340b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.078771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0004e6de-581f-42e8-8b8f-0e12286a340b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.080037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0004e6de-581f-42e8-8b8f-0e12286a340b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.080741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0004e6de-581f-42e8-8b8f-0e12286a340b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.123597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5ca08dbb-d72f-451b-ad5c-127c71022032 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:34.133121 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5ca08dbb-d72f-451b-ad5c-127c71022032 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1317 microversion: 2.1 time: 0.460384 Jul 20 04:13:34.142910 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 465/972] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:34.146453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-979bb132-3294-4c92-ac8e-8dd00b88bfcb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:34.147045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-979bb132-3294-4c92-ac8e-8dd00b88bfcb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:34.165249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-979bb132-3294-4c92-ac8e-8dd00b88bfcb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.166005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-979bb132-3294-4c92-ac8e-8dd00b88bfcb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.167014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-979bb132-3294-4c92-ac8e-8dd00b88bfcb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.167681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-979bb132-3294-4c92-ac8e-8dd00b88bfcb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.294201 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-979bb132-3294-4c92-ac8e-8dd00b88bfcb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151989 Jul 20 04:13:34.297888 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 466/973] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:13:34 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:34.300552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c31e3a92-9641-48ea-89d9-f748d6603a27 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:34.301352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c31e3a92-9641-48ea-89d9-f748d6603a27 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:34.314862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c31e3a92-9641-48ea-89d9-f748d6603a27 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.315321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c31e3a92-9641-48ea-89d9-f748d6603a27 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.322076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c31e3a92-9641-48ea-89d9-f748d6603a27 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.322541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c31e3a92-9641-48ea-89d9-f748d6603a27 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.877909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0004e6de-581f-42e8-8b8f-0e12286a340b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:34.891740 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0004e6de-581f-42e8-8b8f-0e12286a340b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1477 microversion: 2.1 time: 0.829245 Jul 20 04:13:34.892628 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 508/974] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:34 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1477 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:34.901308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c31e3a92-9641-48ea-89d9-f748d6603a27 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:34.912796 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c31e3a92-9641-48ea-89d9-f748d6603a27 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1312 microversion: 2.1 time: 0.616301 Jul 20 04:13:34.916811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2711ce3e-5926-4c36-bc47-90a161304cb2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:34.917428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2711ce3e-5926-4c36-bc47-90a161304cb2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:34.924036 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 467/975] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:34 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1312 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:34.947219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2711ce3e-5926-4c36-bc47-90a161304cb2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.949972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2711ce3e-5926-4c36-bc47-90a161304cb2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.951155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2711ce3e-5926-4c36-bc47-90a161304cb2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.952869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2711ce3e-5926-4c36-bc47-90a161304cb2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.962628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:35.073887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cedc4289-c62b-4f0a-851d-399c8b6de5b0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da6c700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:35.164848 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cedc4289-c62b-4f0a-851d-399c8b6de5b0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.094805 Jul 20 04:13:35.165447 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 468/976] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:35 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:35.170728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-151e438b-9c34-4436-98a3-d6c49371d622 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:35.171356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-151e438b-9c34-4436-98a3-d6c49371d622 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:35.199184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-151e438b-9c34-4436-98a3-d6c49371d622 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.199717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-151e438b-9c34-4436-98a3-d6c49371d622 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.200607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-151e438b-9c34-4436-98a3-d6c49371d622 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.201323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-151e438b-9c34-4436-98a3-d6c49371d622 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.572409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2711ce3e-5926-4c36-bc47-90a161304cb2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:35.581471 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2711ce3e-5926-4c36-bc47-90a161304cb2 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1280 microversion: 2.1 time: 0.675803 Jul 20 04:13:35.596043 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 509/977] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:34 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1280 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:35.604801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-26f36d4e-36aa-4645-8b78-adf539fd8e5e req-1959ef59-c8b4-4ebe-a482-8b613f645177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee027f2-e9fe-4399-899d-142b4c3b538a", "name": "network-vif-plugged", "status": "completed", "tag": "757eb3b3-c7a1-48a2-9cf0-3c5eec6bf2f7"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:35.620317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-26f36d4e-36aa-4645-8b78-adf539fd8e5e req-1959ef59-c8b4-4ebe-a482-8b613f645177 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.621055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-26f36d4e-36aa-4645-8b78-adf539fd8e5e req-1959ef59-c8b4-4ebe-a482-8b613f645177 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.634163 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-26f36d4e-36aa-4645-8b78-adf539fd8e5e req-1959ef59-c8b4-4ebe-a482-8b613f645177 service nova] Creating event network-vif-plugged:757eb3b3-c7a1-48a2-9cf0-3c5eec6bf2f7 for instance 0ee027f2-e9fe-4399-899d-142b4c3b538a on n-h2-764485-11 Jul 20 04:13:35.646387 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-26f36d4e-36aa-4645-8b78-adf539fd8e5e req-1959ef59-c8b4-4ebe-a482-8b613f645177 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048183 Jul 20 04:13:35.649073 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 510/978] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:35.917976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ee8cb8d7-28a6-4525-a054-331cb41faece tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:35.918698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ee8cb8d7-28a6-4525-a054-331cb41faece tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:35.945673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee8cb8d7-28a6-4525-a054-331cb41faece tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.949161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee8cb8d7-28a6-4525-a054-331cb41faece tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.956338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee8cb8d7-28a6-4525-a054-331cb41faece tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.957060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee8cb8d7-28a6-4525-a054-331cb41faece tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:36.110515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-151e438b-9c34-4436-98a3-d6c49371d622 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:36.126448 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-151e438b-9c34-4436-98a3-d6c49371d622 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1317 microversion: 2.1 time: 0.959137 Jul 20 04:13:36.127775 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 469/979] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:35 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1317 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:36.141384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6c58ebe2-df83-4d30-bad7-7ee30bfcd8dd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:36.142375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6c58ebe2-df83-4d30-bad7-7ee30bfcd8dd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:36.160146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c58ebe2-df83-4d30-bad7-7ee30bfcd8dd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:36.163497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c58ebe2-df83-4d30-bad7-7ee30bfcd8dd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:36.165826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c58ebe2-df83-4d30-bad7-7ee30bfcd8dd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:36.168092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c58ebe2-df83-4d30-bad7-7ee30bfcd8dd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:36.501620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee8cb8d7-28a6-4525-a054-331cb41faece tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:36.512716 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ee8cb8d7-28a6-4525-a054-331cb41faece tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1476 microversion: 2.1 time: 0.601067 Jul 20 04:13:36.531873 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 511/980] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:35 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1476 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:36.538102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0020bc06-4127-48c4-9f30-36ff88aa940e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dec5af0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:36.622204 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0020bc06-4127-48c4-9f30-36ff88aa940e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.088910 Jul 20 04:13:36.627934 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 512/981] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:36 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:36.632216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ed990819-db19-4995-a996-e4cf905b12af tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:36.640072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ed990819-db19-4995-a996-e4cf905b12af tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:36.657190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed990819-db19-4995-a996-e4cf905b12af tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:36.657679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed990819-db19-4995-a996-e4cf905b12af tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:36.662553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed990819-db19-4995-a996-e4cf905b12af tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:36.663135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed990819-db19-4995-a996-e4cf905b12af tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.769557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6c58ebe2-df83-4d30-bad7-7ee30bfcd8dd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:37.805624 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6c58ebe2-df83-4d30-bad7-7ee30bfcd8dd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1312 microversion: 2.1 time: 1.676561 Jul 20 04:13:37.818024 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 470/982] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:36 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1312 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:37.825977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:37.858911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f9b5d273-7d72-4806-bd52-9e27e171f5f7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:37.862792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f9b5d273-7d72-4806-bd52-9e27e171f5f7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:37.874900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ed990819-db19-4995-a996-e4cf905b12af tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:37.886699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9b5d273-7d72-4806-bd52-9e27e171f5f7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.887313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9b5d273-7d72-4806-bd52-9e27e171f5f7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.888391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9b5d273-7d72-4806-bd52-9e27e171f5f7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.894177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9b5d273-7d72-4806-bd52-9e27e171f5f7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.895864 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ed990819-db19-4995-a996-e4cf905b12af tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 1.268185 Jul 20 04:13:37.896545 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 513/983] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:36 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:37.909561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-78dafdcc-8a5a-4739-b773-ec35926acf4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:37.910186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-78dafdcc-8a5a-4739-b773-ec35926acf4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:37.928992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=5 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:37.941195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78dafdcc-8a5a-4739-b773-ec35926acf4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.941954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78dafdcc-8a5a-4739-b773-ec35926acf4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.946076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78dafdcc-8a5a-4739-b773-ec35926acf4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.946720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78dafdcc-8a5a-4739-b773-ec35926acf4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:38.592820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-78dafdcc-8a5a-4739-b773-ec35926acf4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:38.612747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:38.614059 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-78dafdcc-8a5a-4739-b773-ec35926acf4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1476 microversion: 2.1 time: 0.709938 Jul 20 04:13:38.630252 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 514/984] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:37 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1476 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:38.638218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-695720c6-053e-4cf5-969e-7044cd493b58 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d8beee0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:38.652129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f9b5d273-7d72-4806-bd52-9e27e171f5f7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:38.669190 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f9b5d273-7d72-4806-bd52-9e27e171f5f7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1317 microversion: 2.1 time: 0.846253 Jul 20 04:13:38.685372 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 471/985] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:37 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1317 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:38.704623 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-695720c6-053e-4cf5-969e-7044cd493b58 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.072160 Jul 20 04:13:38.705832 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 515/986] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:38 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:38.705994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-911c47f5-ba8d-4664-99ef-110adee4301f req-e7982b2b-981c-4276-a1c4-da8cc70b649f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906f54b8-7d83-4249-8ba0-338f5f9e84db", "name": "network-vif-unplugged", "status": "completed", "tag": "00cbe8c3-ad37-4de6-b8a0-f0227bf8bde6"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:38.712334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-3c906786-c4b8-453e-ad23-c2d26075c4fc req-43df87e5-119f-482e-ad04-ab09d34e2704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0895e78-3e18-4ab2-b966-0561a857536c", "tag": "fb4a38b9-ae67-49b5-806c-bca8ef8b9f33"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:38.728389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-911c47f5-ba8d-4664-99ef-110adee4301f req-e7982b2b-981c-4276-a1c4-da8cc70b649f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:38.728844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-911c47f5-ba8d-4664-99ef-110adee4301f req-e7982b2b-981c-4276-a1c4-da8cc70b649f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:38.732346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3c906786-c4b8-453e-ad23-c2d26075c4fc req-43df87e5-119f-482e-ad04-ab09d34e2704 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:38.734337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3c906786-c4b8-453e-ad23-c2d26075c4fc req-43df87e5-119f-482e-ad04-ab09d34e2704 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:38.753514 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-911c47f5-ba8d-4664-99ef-110adee4301f req-e7982b2b-981c-4276-a1c4-da8cc70b649f service nova] Creating event network-vif-unplugged:00cbe8c3-ad37-4de6-b8a0-f0227bf8bde6 for instance 906f54b8-7d83-4249-8ba0-338f5f9e84db on n-h1-764485-11 Jul 20 04:13:38.778407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-911c47f5-ba8d-4664-99ef-110adee4301f req-e7982b2b-981c-4276-a1c4-da8cc70b649f service nova] Instance 906f54b8-7d83-4249-8ba0-338f5f9e84db is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:13:38.781336 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-3c906786-c4b8-453e-ad23-c2d26075c4fc req-43df87e5-119f-482e-ad04-ab09d34e2704 service nova] Creating event network-changed:fb4a38b9-ae67-49b5-806c-bca8ef8b9f33 for instance d0895e78-3e18-4ab2-b966-0561a857536c on n-h2-764485-11 Jul 20 04:13:38.796450 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-911c47f5-ba8d-4664-99ef-110adee4301f req-e7982b2b-981c-4276-a1c4-da8cc70b649f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109720 Jul 20 04:13:38.797563 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 472/987] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:38.797685 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-3c906786-c4b8-453e-ad23-c2d26075c4fc req-43df87e5-119f-482e-ad04-ab09d34e2704 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090261 Jul 20 04:13:38.799184 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 516/988] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:38.806978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-06c0e386-98b7-409d-bbe3-84ba2cafac04 req-68df4e67-19f8-47dd-9892-673e26fcc7fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5f729b8-7001-423b-88d7-42ff10001e4a", "tag": "3ec24e9d-a1d9-4f7c-9bc3-e1b8748a4f54"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:38.817051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-06c0e386-98b7-409d-bbe3-84ba2cafac04 req-68df4e67-19f8-47dd-9892-673e26fcc7fd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:38.817669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-06c0e386-98b7-409d-bbe3-84ba2cafac04 req-68df4e67-19f8-47dd-9892-673e26fcc7fd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:38.830801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec1a327e-04ed-4c87-a2e9-1789ee7e35a6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:38.832505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ec1a327e-04ed-4c87-a2e9-1789ee7e35a6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:38.840812 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-06c0e386-98b7-409d-bbe3-84ba2cafac04 req-68df4e67-19f8-47dd-9892-673e26fcc7fd service nova] Creating event network-changed:3ec24e9d-a1d9-4f7c-9bc3-e1b8748a4f54 for instance f5f729b8-7001-423b-88d7-42ff10001e4a on n-h2-764485-11 Jul 20 04:13:38.842973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec1a327e-04ed-4c87-a2e9-1789ee7e35a6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:38.843740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec1a327e-04ed-4c87-a2e9-1789ee7e35a6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:38.845252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec1a327e-04ed-4c87-a2e9-1789ee7e35a6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:38.845937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec1a327e-04ed-4c87-a2e9-1789ee7e35a6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:38.846080 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-06c0e386-98b7-409d-bbe3-84ba2cafac04 req-68df4e67-19f8-47dd-9892-673e26fcc7fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046890 Jul 20 04:13:38.846907 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 473/989] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:38.915316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ad7e58e4-2344-4e4b-b513-5a65c9a3de6c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:38.916792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ad7e58e4-2344-4e4b-b513-5a65c9a3de6c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:38.938216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad7e58e4-2344-4e4b-b513-5a65c9a3de6c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:38.947170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad7e58e4-2344-4e4b-b513-5a65c9a3de6c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:38.948235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad7e58e4-2344-4e4b-b513-5a65c9a3de6c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:38.948784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad7e58e4-2344-4e4b-b513-5a65c9a3de6c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.374017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ad7e58e4-2344-4e4b-b513-5a65c9a3de6c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:39.390618 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ad7e58e4-2344-4e4b-b513-5a65c9a3de6c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.480479 Jul 20 04:13:39.400983 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 474/990] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:38 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:39.441808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ec1a327e-04ed-4c87-a2e9-1789ee7e35a6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:39.450208 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ec1a327e-04ed-4c87-a2e9-1789ee7e35a6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1312 microversion: 2.1 time: 0.625185 Jul 20 04:13:39.450811 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 517/991] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:38 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1312 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:39.635870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5757fda2-fb51-42aa-b844-67703c1b2062 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:39.636748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5757fda2-fb51-42aa-b844-67703c1b2062 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:39.649116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5757fda2-fb51-42aa-b844-67703c1b2062 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.654248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5757fda2-fb51-42aa-b844-67703c1b2062 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.657139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5757fda2-fb51-42aa-b844-67703c1b2062 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.660104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5757fda2-fb51-42aa-b844-67703c1b2062 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.702005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-55efa4f4-da7c-4fb1-9e31-e15ee27a6389 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:39.702640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-55efa4f4-da7c-4fb1-9e31-e15ee27a6389 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:39.719404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55efa4f4-da7c-4fb1-9e31-e15ee27a6389 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.722394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55efa4f4-da7c-4fb1-9e31-e15ee27a6389 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.725678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55efa4f4-da7c-4fb1-9e31-e15ee27a6389 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.726385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55efa4f4-da7c-4fb1-9e31-e15ee27a6389 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.997473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5757fda2-fb51-42aa-b844-67703c1b2062 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:40.012330 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5757fda2-fb51-42aa-b844-67703c1b2062 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1474 microversion: 2.1 time: 0.381651 Jul 20 04:13:40.014497 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 475/992] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:39 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1474 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:40.028252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-affceb4d-8bf8-4e64-8453-c55c3b3566f7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da984c0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:40.055216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-55efa4f4-da7c-4fb1-9e31-e15ee27a6389 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:40.072133 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-55efa4f4-da7c-4fb1-9e31-e15ee27a6389 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1467 microversion: 2.1 time: 0.374859 Jul 20 04:13:40.076040 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 518/993] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:39 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1467 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:40.097577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-678b04c1-4db9-409c-8b53-7647a16f26a9 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:40.098803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-678b04c1-4db9-409c-8b53-7647a16f26a9 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:40.124194 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-affceb4d-8bf8-4e64-8453-c55c3b3566f7 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1450 microversion: 2.1 time: 0.107990 Jul 20 04:13:40.125877 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 476/994] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:40 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1450 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:40.127589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-678b04c1-4db9-409c-8b53-7647a16f26a9 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.128435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-678b04c1-4db9-409c-8b53-7647a16f26a9 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.129801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-678b04c1-4db9-409c-8b53-7647a16f26a9 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.130731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-678b04c1-4db9-409c-8b53-7647a16f26a9 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.400323 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-678b04c1-4db9-409c-8b53-7647a16f26a9 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1620 microversion: 2.1 time: 0.309058 Jul 20 04:13:40.401168 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 519/995] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:40 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1620 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:40.415958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cdf9f242-1382-40eb-af31-9655abb38d11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:40.415958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cdf9f242-1382-40eb-af31-9655abb38d11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:40.419432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdf9f242-1382-40eb-af31-9655abb38d11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.421094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdf9f242-1382-40eb-af31-9655abb38d11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.422604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdf9f242-1382-40eb-af31-9655abb38d11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.424363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdf9f242-1382-40eb-af31-9655abb38d11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.473565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6f4f190e-8243-4ecc-b8e7-837018651b1d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:40.475722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6f4f190e-8243-4ecc-b8e7-837018651b1d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:40.487819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f4f190e-8243-4ecc-b8e7-837018651b1d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.488820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f4f190e-8243-4ecc-b8e7-837018651b1d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.491162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f4f190e-8243-4ecc-b8e7-837018651b1d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.491938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f4f190e-8243-4ecc-b8e7-837018651b1d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.686001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cdf9f242-1382-40eb-af31-9655abb38d11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:40.701461 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cdf9f242-1382-40eb-af31-9655abb38d11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.297773 Jul 20 04:13:40.702309 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 477/996] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:40 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:40.707144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-636673658", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f32f3c69-0926-47e2-9498-38ca38aa5035"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:40.796377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:40.800390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6f4f190e-8243-4ecc-b8e7-837018651b1d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:40.817786 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6f4f190e-8243-4ecc-b8e7-837018651b1d tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1312 microversion: 2.1 time: 0.348230 Jul 20 04:13:40.821044 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 520/997] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:40 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:41.000573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-955032b9-02fa-45ac-880b-40fcc61dcd27 req-e9b125c8-ff9d-4449-b3f0-a712989c51ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70dee161-ab18-4fdf-a60b-c6737b36f926", "name": "network-vif-plugged", "status": "completed", "tag": "aa64411a-0dd4-4483-a641-dc91cfde3a79"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:41.011249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-955032b9-02fa-45ac-880b-40fcc61dcd27 req-e9b125c8-ff9d-4449-b3f0-a712989c51ef service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.012060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-955032b9-02fa-45ac-880b-40fcc61dcd27 req-e9b125c8-ff9d-4449-b3f0-a712989c51ef service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.025302 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-955032b9-02fa-45ac-880b-40fcc61dcd27 req-e9b125c8-ff9d-4449-b3f0-a712989c51ef service nova] Creating event network-vif-plugged:aa64411a-0dd4-4483-a641-dc91cfde3a79 for instance 70dee161-ab18-4fdf-a60b-c6737b36f926 on n-h1-764485-11 Jul 20 04:13:41.031354 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-955032b9-02fa-45ac-880b-40fcc61dcd27 req-e9b125c8-ff9d-4449-b3f0-a712989c51ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034775 Jul 20 04:13:41.032215 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 521/998] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:41.040534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6b6f4602-e2c4-4c89-964f-b85b0358802b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:41.041257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6b6f4602-e2c4-4c89-964f-b85b0358802b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:41.048813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b6f4602-e2c4-4c89-964f-b85b0358802b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.049467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b6f4602-e2c4-4c89-964f-b85b0358802b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.050446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b6f4602-e2c4-4c89-964f-b85b0358802b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.051051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b6f4602-e2c4-4c89-964f-b85b0358802b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.077215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:41.078231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:41.078813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:41.079324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:41.079950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:41.091377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.092741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.095987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.096541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.123371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:41.133682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Getting quotas for user 5b0144f0f8694ba4b177c86a768a25e9 and project d46b20455b6a4fc39ff3676f6ce1b801. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:41.151852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:41.153933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:41.156911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:41.207959 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-440deb17-5489-4a92-8125-9ed53b35605f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504390 Jul 20 04:13:41.209540 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 478/999] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:13:41.214461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0dbd6311-18cb-43e7-8492-4af42a04bcd0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d96caf0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:41.243297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6b6f4602-e2c4-4c89-964f-b85b0358802b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:41.261789 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6b6f4602-e2c4-4c89-964f-b85b0358802b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1474 microversion: 2.1 time: 0.228207 Jul 20 04:13:41.272702 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 522/1000] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:41 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1474 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:41.281677 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0dbd6311-18cb-43e7-8492-4af42a04bcd0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1459 microversion: 2.1 time: 0.070744 Jul 20 04:13:41.282933 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 479/1001] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:41 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1459 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:41.284595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df30bb62-f004-4f5e-9212-19c74e69f46f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:41.285230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df30bb62-f004-4f5e-9212-19c74e69f46f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:41.297376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4681818a-4fcb-4fb6-ba3c-855044bab2c6 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dceaf70>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:41.379877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df30bb62-f004-4f5e-9212-19c74e69f46f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:41.390853 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4681818a-4fcb-4fb6-ba3c-855044bab2c6 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 200 len: 1459 microversion: 2.1 time: 0.099461 Jul 20 04:13:41.391435 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 480/1002] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:41 2022] GET /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 1459 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:41.403992 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df30bb62-f004-4f5e-9212-19c74e69f46f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1216 microversion: 2.1 time: 0.130404 Jul 20 04:13:41.405609 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 523/1003] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:41 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:41.407822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9f66d29d-ea95-49ee-aa45-8b90967e7c3b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:41.429120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9f66d29d-ea95-49ee-aa45-8b90967e7c3b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:41.453503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f66d29d-ea95-49ee-aa45-8b90967e7c3b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.453968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f66d29d-ea95-49ee-aa45-8b90967e7c3b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.455280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f66d29d-ea95-49ee-aa45-8b90967e7c3b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.455805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f66d29d-ea95-49ee-aa45-8b90967e7c3b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.620613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9f66d29d-ea95-49ee-aa45-8b90967e7c3b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:41.629959 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9f66d29d-ea95-49ee-aa45-8b90967e7c3b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1479 microversion: 2.1 time: 0.228077 Jul 20 04:13:41.631667 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 481/1004] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:41 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1479 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:41.720794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8d9a9327-d903-4d66-ab5d-e064045a8c84 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:41.721415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8d9a9327-d903-4d66-ab5d-e064045a8c84 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:41.731164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d9a9327-d903-4d66-ab5d-e064045a8c84 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.731635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d9a9327-d903-4d66-ab5d-e064045a8c84 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.732673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d9a9327-d903-4d66-ab5d-e064045a8c84 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.733277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d9a9327-d903-4d66-ab5d-e064045a8c84 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.838182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1e960197-a3b1-433c-b4a0-f80a7abd965f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:41.838875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1e960197-a3b1-433c-b4a0-f80a7abd965f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:41.854349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e960197-a3b1-433c-b4a0-f80a7abd965f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.855088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e960197-a3b1-433c-b4a0-f80a7abd965f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.856146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e960197-a3b1-433c-b4a0-f80a7abd965f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.856786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e960197-a3b1-433c-b4a0-f80a7abd965f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.061697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8d9a9327-d903-4d66-ab5d-e064045a8c84 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:42.073347 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8d9a9327-d903-4d66-ab5d-e064045a8c84 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.356800 Jul 20 04:13:42.078671 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 524/1005] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:41 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:42.149402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1e960197-a3b1-433c-b4a0-f80a7abd965f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:42.167582 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1e960197-a3b1-433c-b4a0-f80a7abd965f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1312 microversion: 2.1 time: 0.333897 Jul 20 04:13:42.168803 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 482/1006] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:41 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1312 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:42.281537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-18e0b990-0f75-4d27-8ff0-af734cf97bd4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:42.282248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-18e0b990-0f75-4d27-8ff0-af734cf97bd4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:42.310246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18e0b990-0f75-4d27-8ff0-af734cf97bd4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:42.314752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18e0b990-0f75-4d27-8ff0-af734cf97bd4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.316458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18e0b990-0f75-4d27-8ff0-af734cf97bd4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:42.319450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18e0b990-0f75-4d27-8ff0-af734cf97bd4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.426407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-89846aee-12c4-49a2-8e89-90d0fd24a098 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:42.427129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-89846aee-12c4-49a2-8e89-90d0fd24a098 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:42.435893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89846aee-12c4-49a2-8e89-90d0fd24a098 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:42.436663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89846aee-12c4-49a2-8e89-90d0fd24a098 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.438572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89846aee-12c4-49a2-8e89-90d0fd24a098 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:42.439232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89846aee-12c4-49a2-8e89-90d0fd24a098 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.558862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89846aee-12c4-49a2-8e89-90d0fd24a098 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:42.569751 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-89846aee-12c4-49a2-8e89-90d0fd24a098 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1212 microversion: 2.1 time: 0.150384 Jul 20 04:13:42.571067 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 483/1007] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:42 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1212 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:42.577213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-18e0b990-0f75-4d27-8ff0-af734cf97bd4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:42.585928 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-18e0b990-0f75-4d27-8ff0-af734cf97bd4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1474 microversion: 2.1 time: 0.308624 Jul 20 04:13:42.586597 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 525/1008] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:42 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1474 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:42.649994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c978f0a4-e8b7-4829-875b-c4c14a74be7a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:42.650615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c978f0a4-e8b7-4829-875b-c4c14a74be7a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:42.657519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c978f0a4-e8b7-4829-875b-c4c14a74be7a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:42.658534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c978f0a4-e8b7-4829-875b-c4c14a74be7a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.659471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c978f0a4-e8b7-4829-875b-c4c14a74be7a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:42.660003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c978f0a4-e8b7-4829-875b-c4c14a74be7a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.704311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-512255209", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "265c2afe-140f-48d5-89cc-51314f1c08d1"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:42.772567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] validate_networks() for [('265c2afe-140f-48d5-89cc-51314f1c08d1', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:42.922379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c978f0a4-e8b7-4829-875b-c4c14a74be7a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:42.936654 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c978f0a4-e8b7-4829-875b-c4c14a74be7a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1479 microversion: 2.1 time: 0.293125 Jul 20 04:13:42.937525 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 526/1009] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:42 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1479 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:43.094282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7cf93455-4c5f-4cfb-9fa6-114622d46ccc tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:43.094893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7cf93455-4c5f-4cfb-9fa6-114622d46ccc tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:43.101374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cf93455-4c5f-4cfb-9fa6-114622d46ccc tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.102048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cf93455-4c5f-4cfb-9fa6-114622d46ccc tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.103029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cf93455-4c5f-4cfb-9fa6-114622d46ccc tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.103462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cf93455-4c5f-4cfb-9fa6-114622d46ccc tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.369031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7cf93455-4c5f-4cfb-9fa6-114622d46ccc tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:43.380332 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7cf93455-4c5f-4cfb-9fa6-114622d46ccc tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.290083 Jul 20 04:13:43.382426 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 527/1010] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:43 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:43.395801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74f50d15-3e96-4a6b-9b17-a7d83427909e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:43.397228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74f50d15-3e96-4a6b-9b17-a7d83427909e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:43.404447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f50d15-3e96-4a6b-9b17-a7d83427909e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.405185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f50d15-3e96-4a6b-9b17-a7d83427909e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.406159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f50d15-3e96-4a6b-9b17-a7d83427909e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.407200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f50d15-3e96-4a6b-9b17-a7d83427909e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.542964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:43.543437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:43.543747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:43.544376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:43.544955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:43.555212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.555709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.556918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.557620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.579549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Getting quotas for project a15623aa4b154b46a0e7fa6bcdf6c1be. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:43.588304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Getting quotas for user a2e2ee08afb949bfabefeb750a0ba191 and project a15623aa4b154b46a0e7fa6bcdf6c1be. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:43.603725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:43.606292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:43.645367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-74f50d15-3e96-4a6b-9b17-a7d83427909e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:43.660997 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74f50d15-3e96-4a6b-9b17-a7d83427909e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1312 microversion: 2.1 time: 0.275445 Jul 20 04:13:43.675682 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 528/1011] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:43 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1312 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:43.687812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-35f87ba9-cf24-45a2-9116-bc37044bf60a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:43.688863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-35f87ba9-cf24-45a2-9116-bc37044bf60a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:43.697567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35f87ba9-cf24-45a2-9116-bc37044bf60a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.698329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35f87ba9-cf24-45a2-9116-bc37044bf60a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.699304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35f87ba9-cf24-45a2-9116-bc37044bf60a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.700013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35f87ba9-cf24-45a2-9116-bc37044bf60a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.718126 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5a24152d-640c-4d9f-ae2a-72d0d763c781 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.145610 Jul 20 04:13:43.723595 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 484/1012] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:13:43.742414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ed5db05d-d928-403a-abbc-efae68a896ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:43.743147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ed5db05d-d928-403a-abbc-efae68a896ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:43.770949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed5db05d-d928-403a-abbc-efae68a896ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.770949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed5db05d-d928-403a-abbc-efae68a896ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.770949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed5db05d-d928-403a-abbc-efae68a896ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.770949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed5db05d-d928-403a-abbc-efae68a896ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.794950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-35f87ba9-cf24-45a2-9116-bc37044bf60a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:43.805094 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-35f87ba9-cf24-45a2-9116-bc37044bf60a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1268 microversion: 2.1 time: 0.125508 Jul 20 04:13:43.815645 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 529/1013] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:43 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1268 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:43.829944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1a618844-4b89-4ba0-97a3-c03690a97db0 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:43.835682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1a618844-4b89-4ba0-97a3-c03690a97db0 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:44.066494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1a618844-4b89-4ba0-97a3-c03690a97db0 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:44.074656 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1a618844-4b89-4ba0-97a3-c03690a97db0 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1224 microversion: 2.1 time: 0.256360 Jul 20 04:13:44.079228 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 530/1014] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:43 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1224 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:44.085249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f9832750-7d08-40e8-bfee-237de45e20dc tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.086086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f9832750-7d08-40e8-bfee-237de45e20dc tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:44.094557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9832750-7d08-40e8-bfee-237de45e20dc tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.095256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9832750-7d08-40e8-bfee-237de45e20dc tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.096090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9832750-7d08-40e8-bfee-237de45e20dc tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.096527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9832750-7d08-40e8-bfee-237de45e20dc tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.135219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ed5db05d-d928-403a-abbc-efae68a896ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:44.145318 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ed5db05d-d928-403a-abbc-efae68a896ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1471 microversion: 2.1 time: 0.425328 Jul 20 04:13:44.146073 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 485/1015] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:43 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1471 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:44.173993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-307a299a-8b09-4550-9f28-5372a395b80b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:44.174903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-307a299a-8b09-4550-9f28-5372a395b80b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:44.201215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-307a299a-8b09-4550-9f28-5372a395b80b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.201761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-307a299a-8b09-4550-9f28-5372a395b80b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.202585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-307a299a-8b09-4550-9f28-5372a395b80b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.203028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-307a299a-8b09-4550-9f28-5372a395b80b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.256761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:44.279645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f9832750-7d08-40e8-bfee-237de45e20dc tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:44.282068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:44.291531 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f9832750-7d08-40e8-bfee-237de45e20dc tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1466 microversion: 2.1 time: 0.209966 Jul 20 04:13:44.292186 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 531/1016] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1466 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:44.308646 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-307a299a-8b09-4550-9f28-5372a395b80b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "POST /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db/action" status: 204 len: 0 microversion: 2.1 time: 0.148638 Jul 20 04:13:44.311436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c57cc46-e498-4192-b2b7-9168bed0d31a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9df05f70>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.313113 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 486/1017] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:44 2022] POST /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db/action => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:44.319905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d4107c85-0481-413f-b128-67c0ecb84c79 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.320666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d4107c85-0481-413f-b128-67c0ecb84c79 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:44.327139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d4107c85-0481-413f-b128-67c0ecb84c79 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.327832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d4107c85-0481-413f-b128-67c0ecb84c79 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.329009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d4107c85-0481-413f-b128-67c0ecb84c79 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.329600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d4107c85-0481-413f-b128-67c0ecb84c79 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.470965 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6c57cc46-e498-4192-b2b7-9168bed0d31a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images?changes-since=2022-07-20T04%3A11%3A21Z" status: 200 len: 1902 microversion: 2.1 time: 0.164376 Jul 20 04:13:44.479194 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 532/1018] 10.222.0.20 () {58 vars in 1198 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/images?changes-since=2022-07-20T04%3A11%3A21Z => generated 1902 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:44.487379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-508783f9-d245-4811-960e-989bfa48a8c0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.488340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-508783f9-d245-4811-960e-989bfa48a8c0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:44.497099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-508783f9-d245-4811-960e-989bfa48a8c0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.499085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-508783f9-d245-4811-960e-989bfa48a8c0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.500216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-508783f9-d245-4811-960e-989bfa48a8c0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.500834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-508783f9-d245-4811-960e-989bfa48a8c0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.502956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d4107c85-0481-413f-b128-67c0ecb84c79 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:44.513736 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d4107c85-0481-413f-b128-67c0ecb84c79 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1471 microversion: 2.1 time: 0.198842 Jul 20 04:13:44.514502 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 487/1019] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:44.529242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-49e4320e-4261-4137-ad65-719ffac454e4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da6c160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.697048 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-49e4320e-4261-4137-ad65-719ffac454e4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1034886835" status: 200 len: 485 microversion: 2.1 time: 0.172048 Jul 20 04:13:44.698678 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 488/1020] 10.222.0.20 () {58 vars in 1230 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1034886835 => generated 485 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:44.711138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fdebafc5-f89d-42cb-b1ad-5e32e3f4187a tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.711851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fdebafc5-f89d-42cb-b1ad-5e32e3f4187a tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:44.732185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fdebafc5-f89d-42cb-b1ad-5e32e3f4187a tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.732955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fdebafc5-f89d-42cb-b1ad-5e32e3f4187a tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.742458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fdebafc5-f89d-42cb-b1ad-5e32e3f4187a tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.742924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fdebafc5-f89d-42cb-b1ad-5e32e3f4187a tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.309551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-508783f9-d245-4811-960e-989bfa48a8c0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:45.320047 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-508783f9-d245-4811-960e-989bfa48a8c0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.838597 Jul 20 04:13:45.324226 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 533/1021] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:45.329504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c803dfbc-4ea0-4f9f-8db6-cbe001987631 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dd81430>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:45.643945 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c803dfbc-4ea0-4f9f-8db6-cbe001987631 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images?server=ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 956 microversion: 2.1 time: 0.318385 Jul 20 04:13:45.647844 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 534/1022] 10.222.0.20 () {58 vars in 1208 bytes} [Wed Jul 20 04:13:45 2022] GET /compute/v2.1/images?server=ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 956 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:45.663860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-face2e1f-4666-4dbd-96e3-b7d36dee59ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:45.665612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-face2e1f-4666-4dbd-96e3-b7d36dee59ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:45.672583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-face2e1f-4666-4dbd-96e3-b7d36dee59ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.673038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-face2e1f-4666-4dbd-96e3-b7d36dee59ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.675888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-face2e1f-4666-4dbd-96e3-b7d36dee59ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.676491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-face2e1f-4666-4dbd-96e3-b7d36dee59ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.875642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fdebafc5-f89d-42cb-b1ad-5e32e3f4187a tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:45.885168 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fdebafc5-f89d-42cb-b1ad-5e32e3f4187a tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1312 microversion: 2.1 time: 1.184716 Jul 20 04:13:45.888207 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 489/1023] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1312 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:45.901449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-91917063-3e4f-4ca9-8702-6f669bc47a94 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:45.902266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-91917063-3e4f-4ca9-8702-6f669bc47a94 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:45.919905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91917063-3e4f-4ca9-8702-6f669bc47a94 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.920751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91917063-3e4f-4ca9-8702-6f669bc47a94 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.921909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91917063-3e4f-4ca9-8702-6f669bc47a94 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.922623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91917063-3e4f-4ca9-8702-6f669bc47a94 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.954970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-face2e1f-4666-4dbd-96e3-b7d36dee59ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:45.974426 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-face2e1f-4666-4dbd-96e3-b7d36dee59ee tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1274 microversion: 2.1 time: 0.322572 Jul 20 04:13:45.976176 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 535/1024] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:45 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1274 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:45.991660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fc896df6-a15e-4f75-865b-25d18760f258 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:45.995177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fc896df6-a15e-4f75-865b-25d18760f258 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:46.009664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc896df6-a15e-4f75-865b-25d18760f258 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.010639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc896df6-a15e-4f75-865b-25d18760f258 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.011720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc896df6-a15e-4f75-865b-25d18760f258 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.012375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc896df6-a15e-4f75-865b-25d18760f258 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.087430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-91917063-3e4f-4ca9-8702-6f669bc47a94 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:46.104348 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-91917063-3e4f-4ca9-8702-6f669bc47a94 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1282 microversion: 2.1 time: 0.214482 Jul 20 04:13:46.104856 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 490/1025] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:45 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1282 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:46.118653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0ed4c80e-ef62-46d2-9e19-eb519e58cbc9 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dcea040>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.207854 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0ed4c80e-ef62-46d2-9e19-eb519e58cbc9 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 485 microversion: 2.1 time: 0.093146 Jul 20 04:13:46.210865 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 491/1026] 10.222.0.20 () {58 vars in 1316 bytes} [Wed Jul 20 04:13:46 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 485 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:46.225160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-49908140-1ef8-48d3-9c32-4c3727608450 req-28b9ff75-4bf4-4741-ace6-bbeff071b25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906f54b8-7d83-4249-8ba0-338f5f9e84db", "name": "network-vif-plugged", "status": "completed", "tag": "00cbe8c3-ad37-4de6-b8a0-f0227bf8bde6"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:46.246421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-49908140-1ef8-48d3-9c32-4c3727608450 req-28b9ff75-4bf4-4741-ace6-bbeff071b25c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.246974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-49908140-1ef8-48d3-9c32-4c3727608450 req-28b9ff75-4bf4-4741-ace6-bbeff071b25c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.267749 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-49908140-1ef8-48d3-9c32-4c3727608450 req-28b9ff75-4bf4-4741-ace6-bbeff071b25c service nova] Creating event network-vif-plugged:00cbe8c3-ad37-4de6-b8a0-f0227bf8bde6 for instance 906f54b8-7d83-4249-8ba0-338f5f9e84db on n-h1-764485-11 Jul 20 04:13:46.276939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-49908140-1ef8-48d3-9c32-4c3727608450 req-28b9ff75-4bf4-4741-ace6-bbeff071b25c service nova] Instance 906f54b8-7d83-4249-8ba0-338f5f9e84db is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:13:46.291334 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-49908140-1ef8-48d3-9c32-4c3727608450 req-28b9ff75-4bf4-4741-ace6-bbeff071b25c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078853 Jul 20 04:13:46.294325 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 492/1027] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:46.302070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b65737b6-5bf6-4085-b9c6-12ca5ec44f48 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da98b80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.393776 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b65737b6-5bf6-4085-b9c6-12ca5ec44f48 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 485 microversion: 2.1 time: 0.097390 Jul 20 04:13:46.397074 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 493/1028] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Jul 20 04:13:46 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 485 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:46.406103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-216e8c48-2ecf-4fb5-b016-487dd7e0db9c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.407118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-216e8c48-2ecf-4fb5-b016-487dd7e0db9c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:46.418097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-216e8c48-2ecf-4fb5-b016-487dd7e0db9c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.418711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-216e8c48-2ecf-4fb5-b016-487dd7e0db9c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.420185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-216e8c48-2ecf-4fb5-b016-487dd7e0db9c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.420758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-216e8c48-2ecf-4fb5-b016-487dd7e0db9c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.436174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fc896df6-a15e-4f75-865b-25d18760f258 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:46.445621 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fc896df6-a15e-4f75-865b-25d18760f258 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1471 microversion: 2.1 time: 0.466633 Jul 20 04:13:46.450958 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 536/1029] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:45 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1471 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:46.467444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a9dc7dc-03ec-4b20-8add-271019c66e03 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc4d9d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.597742 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7a9dc7dc-03ec-4b20-8add-271019c66e03 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.135415 Jul 20 04:13:46.598825 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 537/1030] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Jul 20 04:13:46 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:46.613557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f9aa0707-3438-4e15-90f4-1aa40f3d0e79 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d8bea60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.786721 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f9aa0707-3438-4e15-90f4-1aa40f3d0e79 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.179047 Jul 20 04:13:46.789784 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 538/1031] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Jul 20 04:13:46 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:46.804376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dea0e860-cd6b-4ca8-9857-abc4d10b4084 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d8be310>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.931792 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dea0e860-cd6b-4ca8-9857-abc4d10b4084 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.133861 Jul 20 04:13:46.935129 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 539/1032] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:13:46 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:46.942793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e2ab8034-3abd-4bf1-907e-a358a26e35b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.943747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e2ab8034-3abd-4bf1-907e-a358a26e35b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:46.950762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2ab8034-3abd-4bf1-907e-a358a26e35b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.951495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2ab8034-3abd-4bf1-907e-a358a26e35b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.952463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2ab8034-3abd-4bf1-907e-a358a26e35b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.953139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2ab8034-3abd-4bf1-907e-a358a26e35b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.157920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-216e8c48-2ecf-4fb5-b016-487dd7e0db9c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:47.166743 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-216e8c48-2ecf-4fb5-b016-487dd7e0db9c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.768227 Jul 20 04:13:47.175127 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 494/1033] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:46 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:47.183807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bc7a9c14-e7ba-4fc5-8837-e1fc44111eab tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9db22790>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:47.305504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e2ab8034-3abd-4bf1-907e-a358a26e35b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:47.327946 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e2ab8034-3abd-4bf1-907e-a358a26e35b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1462 microversion: 2.1 time: 0.381840 Jul 20 04:13:47.328803 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 540/1034] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:46 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1462 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:47.333575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3bfa26e5-2ce4-4d9e-b7a9-730f1fc71d1e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:47.335010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3bfa26e5-2ce4-4d9e-b7a9-730f1fc71d1e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:47.367011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3bfa26e5-2ce4-4d9e-b7a9-730f1fc71d1e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.367400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3bfa26e5-2ce4-4d9e-b7a9-730f1fc71d1e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.379646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3bfa26e5-2ce4-4d9e-b7a9-730f1fc71d1e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.380465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3bfa26e5-2ce4-4d9e-b7a9-730f1fc71d1e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.427218 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bc7a9c14-e7ba-4fc5-8837-e1fc44111eab tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/detail?changes-since=2022-07-20T04%3A11%3A17Z" status: 200 len: 6322 microversion: 2.1 time: 0.250605 Jul 20 04:13:47.443926 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 495/1035] 10.222.0.20 () {58 vars in 1219 bytes} [Wed Jul 20 04:13:47 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-20T04%3A11%3A17Z => generated 6322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:47.449873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-20bc2515-589d-4ca2-b7b9-4a1483a60d79 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:47.452221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-20bc2515-589d-4ca2-b7b9-4a1483a60d79 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:47.460973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20bc2515-589d-4ca2-b7b9-4a1483a60d79 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.461492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20bc2515-589d-4ca2-b7b9-4a1483a60d79 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.462899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20bc2515-589d-4ca2-b7b9-4a1483a60d79 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.463755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20bc2515-589d-4ca2-b7b9-4a1483a60d79 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.768977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3bfa26e5-2ce4-4d9e-b7a9-730f1fc71d1e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:47.777193 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3bfa26e5-2ce4-4d9e-b7a9-730f1fc71d1e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1316 microversion: 2.1 time: 0.447317 Jul 20 04:13:47.778025 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 541/1036] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:47 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:47.813242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-20bc2515-589d-4ca2-b7b9-4a1483a60d79 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:47.828912 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-20bc2515-589d-4ca2-b7b9-4a1483a60d79 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1324 microversion: 2.1 time: 0.383294 Jul 20 04:13:47.838220 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 496/1037] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:47 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1324 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:47.838220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-331917ae-8a2d-4335-992e-aeb5084d417a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da875e0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:47.933978 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-331917ae-8a2d-4335-992e-aeb5084d417a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1034886835" status: 200 len: 665 microversion: 2.1 time: 0.101192 Jul 20 04:13:47.935543 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 497/1038] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Jul 20 04:13:47 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1034886835 => generated 665 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:47.946336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-354d4621-cf46-4742-a849-cecd174026d1 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:47.948608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f1790660-7d9c-4ec2-8b87-5f6de05e6729 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:47.949316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f1790660-7d9c-4ec2-8b87-5f6de05e6729 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:47.950124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-354d4621-cf46-4742-a849-cecd174026d1 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Searching by: {'deleted': False, 'project_id': 'fae6cc604e5740068f1dd4b36c3ba748'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:13:47.957185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-354d4621-cf46-4742-a849-cecd174026d1 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.957862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-354d4621-cf46-4742-a849-cecd174026d1 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.959384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-354d4621-cf46-4742-a849-cecd174026d1 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.960437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-354d4621-cf46-4742-a849-cecd174026d1 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.962651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1790660-7d9c-4ec2-8b87-5f6de05e6729 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.963181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1790660-7d9c-4ec2-8b87-5f6de05e6729 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.964153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1790660-7d9c-4ec2-8b87-5f6de05e6729 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.964667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1790660-7d9c-4ec2-8b87-5f6de05e6729 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.114047 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-354d4621-cf46-4742-a849-cecd174026d1 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.331961 Jul 20 04:13:48.115224 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 542/1039] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:13:47 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:48.124965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d2e7e7f-3dbe-4994-af89-906c45c3b09c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc4d9d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.206305 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d2e7e7f-3dbe-4994-af89-906c45c3b09c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1463 microversion: 2.1 time: 0.088175 Jul 20 04:13:48.207460 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 543/1040] 10.222.0.20 () {58 vars in 1337 bytes} [Wed Jul 20 04:13:48 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1463 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:48.213513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d81a5f3c-b8de-4bae-8202-e8fad265d54f tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.233231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d81a5f3c-b8de-4bae-8202-e8fad265d54f tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Searching by: {'deleted': False} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:13:48.249481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81a5f3c-b8de-4bae-8202-e8fad265d54f tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.249982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81a5f3c-b8de-4bae-8202-e8fad265d54f tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.250723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81a5f3c-b8de-4bae-8202-e8fad265d54f tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.251174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81a5f3c-b8de-4bae-8202-e8fad265d54f tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.257948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f1790660-7d9c-4ec2-8b87-5f6de05e6729 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:48.267690 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f1790660-7d9c-4ec2-8b87-5f6de05e6729 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1463 microversion: 2.1 time: 0.330591 Jul 20 04:13:48.268318 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 498/1041] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:47 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1463 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:48.274971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-25f88ded-1309-48d5-8b11-34d270dcb2a7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.275612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-25f88ded-1309-48d5-8b11-34d270dcb2a7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:48.296073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25f88ded-1309-48d5-8b11-34d270dcb2a7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.297517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25f88ded-1309-48d5-8b11-34d270dcb2a7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.300045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25f88ded-1309-48d5-8b11-34d270dcb2a7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.308717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25f88ded-1309-48d5-8b11-34d270dcb2a7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.459858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-d81a5f3c-b8de-4bae-8202-e8fad265d54f tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Listed batch of 22 results from cell out of 1000 limit. Returned 22 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:13:48.564919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:48.574576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81a5f3c-b8de-4bae-8202-e8fad265d54f tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.575049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81a5f3c-b8de-4bae-8202-e8fad265d54f tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.848583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-25f88ded-1309-48d5-8b11-34d270dcb2a7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:48.857229 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-25f88ded-1309-48d5-8b11-34d270dcb2a7 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.587867 Jul 20 04:13:48.857824 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 499/1042] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:48 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:48.862216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bc1057e0-7efe-49de-b5ab-2af03df609a9 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dc09280>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.926112 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bc1057e0-7efe-49de-b5ab-2af03df609a9 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1463 microversion: 2.1 time: 0.067109 Jul 20 04:13:48.926695 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 500/1043] 10.222.0.20 () {58 vars in 1323 bytes} [Wed Jul 20 04:13:48 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1463 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:48.934994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0f77469-d16c-4071-b224-0cdcf12c9c88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.935964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b0f77469-d16c-4071-b224-0cdcf12c9c88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:48.945344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0f77469-d16c-4071-b224-0cdcf12c9c88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.946069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0f77469-d16c-4071-b224-0cdcf12c9c88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.947278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0f77469-d16c-4071-b224-0cdcf12c9c88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.948111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0f77469-d16c-4071-b224-0cdcf12c9c88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.263470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b0f77469-d16c-4071-b224-0cdcf12c9c88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:49.271774 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0f77469-d16c-4071-b224-0cdcf12c9c88 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1463 microversion: 2.1 time: 0.343209 Jul 20 04:13:49.272552 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 501/1044] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:48 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1463 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:49.277154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0afa7b81-07dd-4f07-a3e2-62a94dfb5884 req-988e9e57-6445-4945-9513-9420e2a908b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f729b8-7001-423b-88d7-42ff10001e4a", "name": "network-vif-plugged", "status": "completed", "tag": "3ec24e9d-a1d9-4f7c-9bc3-e1b8748a4f54"}, {"server_uuid": "ec531648-d3ee-43c8-8fda-89ae7282e4ef", "name": "network-vif-unplugged", "status": "completed", "tag": "cbfa0b20-ec79-4d11-a450-6d6c8705b3b2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:49.286358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0afa7b81-07dd-4f07-a3e2-62a94dfb5884 req-988e9e57-6445-4945-9513-9420e2a908b0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.287553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0afa7b81-07dd-4f07-a3e2-62a94dfb5884 req-988e9e57-6445-4945-9513-9420e2a908b0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.300291 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0afa7b81-07dd-4f07-a3e2-62a94dfb5884 req-988e9e57-6445-4945-9513-9420e2a908b0 service nova] Creating event network-vif-plugged:3ec24e9d-a1d9-4f7c-9bc3-e1b8748a4f54 for instance f5f729b8-7001-423b-88d7-42ff10001e4a on n-h2-764485-11 Jul 20 04:13:49.300799 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0afa7b81-07dd-4f07-a3e2-62a94dfb5884 req-988e9e57-6445-4945-9513-9420e2a908b0 service nova] Creating event network-vif-unplugged:cbfa0b20-ec79-4d11-a450-6d6c8705b3b2 for instance ec531648-d3ee-43c8-8fda-89ae7282e4ef on n-h1-764485-11 Jul 20 04:13:49.310389 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0afa7b81-07dd-4f07-a3e2-62a94dfb5884 req-988e9e57-6445-4945-9513-9420e2a908b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036713 Jul 20 04:13:49.311166 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 502/1045] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:49.315955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-7dd6ba2b-a3e2-4d17-bee0-0da47a0d69fc req-b8176008-1b2e-4666-a0b3-5323b668f68f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b03708f-1f01-49cb-9215-7c9dc75c3592", "tag": "dc30438d-5ef8-4ad2-b26e-fc49195b5e08"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:49.324192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7dd6ba2b-a3e2-4d17-bee0-0da47a0d69fc req-b8176008-1b2e-4666-a0b3-5323b668f68f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.324631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7dd6ba2b-a3e2-4d17-bee0-0da47a0d69fc req-b8176008-1b2e-4666-a0b3-5323b668f68f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.335876 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-7dd6ba2b-a3e2-4d17-bee0-0da47a0d69fc req-b8176008-1b2e-4666-a0b3-5323b668f68f service nova] Creating event network-changed:dc30438d-5ef8-4ad2-b26e-fc49195b5e08 for instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 on n-h2-764485-11 Jul 20 04:13:49.340773 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-7dd6ba2b-a3e2-4d17-bee0-0da47a0d69fc req-b8176008-1b2e-4666-a0b3-5323b668f68f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028505 Jul 20 04:13:49.341371 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 503/1046] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:49.346500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3e4f1c05-9311-46ee-bba4-40375f3c0117 req-a19066d2-ebb1-457f-81f5-0865b58e5030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a", "tag": "843dc3e4-010a-405c-9273-4b23321754bf"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:49.355145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3e4f1c05-9311-46ee-bba4-40375f3c0117 req-a19066d2-ebb1-457f-81f5-0865b58e5030 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.355609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3e4f1c05-9311-46ee-bba4-40375f3c0117 req-a19066d2-ebb1-457f-81f5-0865b58e5030 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.366148 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3e4f1c05-9311-46ee-bba4-40375f3c0117 req-a19066d2-ebb1-457f-81f5-0865b58e5030 service nova] Creating event network-changed:843dc3e4-010a-405c-9273-4b23321754bf for instance 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a on n-h1-764485-11 Jul 20 04:13:49.370826 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3e4f1c05-9311-46ee-bba4-40375f3c0117 req-a19066d2-ebb1-457f-81f5-0865b58e5030 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028229 Jul 20 04:13:49.371440 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 504/1047] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:49.376396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6d6f3011-fb6c-4cee-904d-8dc4e699c075 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.377048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6d6f3011-fb6c-4cee-904d-8dc4e699c075 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:49.383919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d6f3011-fb6c-4cee-904d-8dc4e699c075 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.384366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d6f3011-fb6c-4cee-904d-8dc4e699c075 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.385171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d6f3011-fb6c-4cee-904d-8dc4e699c075 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.385628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d6f3011-fb6c-4cee-904d-8dc4e699c075 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.415701 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d81a5f3c-b8de-4bae-8202-e8fad265d54f tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 35447 microversion: 2.1 time: 1.206967 Jul 20 04:13:49.416366 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 544/1048] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Jul 20 04:13:48 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 35447 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:13:49.431537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8856a15f-ef29-4feb-9522-c1a61f695214 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.431537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8856a15f-ef29-4feb-9522-c1a61f695214 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:49.431537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8856a15f-ef29-4feb-9522-c1a61f695214 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.431537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8856a15f-ef29-4feb-9522-c1a61f695214 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.432000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8856a15f-ef29-4feb-9522-c1a61f695214 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.432000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8856a15f-ef29-4feb-9522-c1a61f695214 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.577616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6d6f3011-fb6c-4cee-904d-8dc4e699c075 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:49.586284 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6d6f3011-fb6c-4cee-904d-8dc4e699c075 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1316 microversion: 2.1 time: 0.213686 Jul 20 04:13:49.586873 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 505/1049] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:49.591262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c9cb3598-0c29-44c8-8de1-77bdbf2a6bec tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da6c310>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.609405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8856a15f-ef29-4feb-9522-c1a61f695214 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:49.617132 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8856a15f-ef29-4feb-9522-c1a61f695214 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1324 microversion: 2.1 time: 0.199745 Jul 20 04:13:49.617710 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 545/1050] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1324 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:49.622086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-677a55c9-d3d5-406c-9d41-51655da53993 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Action: 'create', calling method: .version_select at 0x7fbf9d8be430>, body: {"keypair": {"name": "tempest-keypair-565360267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGEKtjS3cVOk2K18gPEBDst0pITJ7W25N/me3WQ5mfJvJA4fzQ8OnwwyRETj7Q09Su+fkH+0+7CFFguk3eRBiYm9S61RUsybRpcBpN96syGWJb3W46+1/L424ng6jRsgQ=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:49.635561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-677a55c9-d3d5-406c-9d41-51655da53993 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Getting quotas for project 41ba023317344d3490bdb01aa8b1e01b. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:49.640573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-677a55c9-d3d5-406c-9d41-51655da53993 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Getting quotas for user 9aa79203e62546cea351116b153afee5 and project 41ba023317344d3490bdb01aa8b1e01b. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:49.664448 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-677a55c9-d3d5-406c-9d41-51655da53993 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045675 Jul 20 04:13:49.664979 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 546/1051] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:13:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:49.669219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4ac02918-85a7-49fd-bb56-96892ec798d6 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.672944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4ac02918-85a7-49fd-bb56-96892ec798d6 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Searching by: {'deleted': False, 'project_id': 'fae6cc604e5740068f1dd4b36c3ba748'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:13:49.677870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ac02918-85a7-49fd-bb56-96892ec798d6 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.678321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ac02918-85a7-49fd-bb56-96892ec798d6 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.679104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ac02918-85a7-49fd-bb56-96892ec798d6 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.679581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ac02918-85a7-49fd-bb56-96892ec798d6 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.680992 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c9cb3598-0c29-44c8-8de1-77bdbf2a6bec tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7097 microversion: 2.1 time: 0.093084 Jul 20 04:13:49.681771 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 506/1052] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7097 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:49.701548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c4b6fc44-66b6-4627-95cb-b90a6a467714 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dd24ee0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.712119 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4ac02918-85a7-49fd-bb56-96892ec798d6 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?tenant_id=5875a8f9aeef4ae09122649735d93375" status: 200 len: 15 microversion: 2.1 time: 0.046080 Jul 20 04:13:49.712990 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 547/1053] 10.222.0.20 () {58 vars in 1230 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/servers/detail?tenant_id=5875a8f9aeef4ae09122649735d93375 => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:49.728622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cb3e7718-9adb-4569-b839-e87c6a907ab2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.733389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cb3e7718-9adb-4569-b839-e87c6a907ab2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Searching by: {'tenant_id': '5875a8f9aeef4ae09122649735d93375', 'deleted': False} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:13:49.739374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb3e7718-9adb-4569-b839-e87c6a907ab2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.739921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb3e7718-9adb-4569-b839-e87c6a907ab2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.740975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb3e7718-9adb-4569-b839-e87c6a907ab2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.741408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb3e7718-9adb-4569-b839-e87c6a907ab2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.774618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-cb3e7718-9adb-4569-b839-e87c6a907ab2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:13:49.777943 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c4b6fc44-66b6-4627-95cb-b90a6a467714 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4363 microversion: 2.1 time: 0.080621 Jul 20 04:13:49.779047 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 507/1054] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4363 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:49.793007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a0add76f-eb86-4815-a11a-8eccddafbab0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dcea310>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.838302 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a0add76f-eb86-4815-a11a-8eccddafbab0 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/bd7de922-6028-4caa-9dbc-4c1d87dfda55" status: 200 len: 784 microversion: 2.1 time: 0.048926 Jul 20 04:13:49.838903 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 508/1055] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/images/bd7de922-6028-4caa-9dbc-4c1d87dfda55 => generated 784 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:49.855074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-507763e5-8247-4b99-b84c-43ef05e626eb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9da0bee0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.867963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb3e7718-9adb-4569-b839-e87c6a907ab2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.868630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb3e7718-9adb-4569-b839-e87c6a907ab2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.907484 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-507763e5-8247-4b99-b84c-43ef05e626eb tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1606 microversion: 2.1 time: 0.058123 Jul 20 04:13:49.908313 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 509/1056] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1606 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:49.914697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-69f098bb-fbec-45bd-aabb-d48e5b302196 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.915542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-69f098bb-fbec-45bd-aabb-d48e5b302196 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:49.923773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69f098bb-fbec-45bd-aabb-d48e5b302196 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.924229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69f098bb-fbec-45bd-aabb-d48e5b302196 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.925007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69f098bb-fbec-45bd-aabb-d48e5b302196 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.925451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69f098bb-fbec-45bd-aabb-d48e5b302196 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.104877 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cb3e7718-9adb-4569-b839-e87c6a907ab2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5875a8f9aeef4ae09122649735d93375" status: 200 len: 4829 microversion: 2.1 time: 0.379942 Jul 20 04:13:50.105582 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 548/1057] 10.222.0.20 () {58 vars in 1256 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5875a8f9aeef4ae09122649735d93375 => generated 4829 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:50.110378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e501d76d-c6bd-477d-b7a7-d1e4e0ec5ab2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dcb2670>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:50.159151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-69f098bb-fbec-45bd-aabb-d48e5b302196 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:50.169186 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-69f098bb-fbec-45bd-aabb-d48e5b302196 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.259756 Jul 20 04:13:50.178321 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 510/1058] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:50.178321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e405e2af-5533-4731-a412-ae172be0285a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:50.179836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e405e2af-5533-4731-a412-ae172be0285a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Searching by: {'tenant_id': 'fae6cc604e5740068f1dd4b36c3ba748', 'deleted': False} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:13:50.187119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e405e2af-5533-4731-a412-ae172be0285a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.187119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e405e2af-5533-4731-a412-ae172be0285a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.187659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e405e2af-5533-4731-a412-ae172be0285a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.188099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e405e2af-5533-4731-a412-ae172be0285a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.291025 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e405e2af-5533-4731-a412-ae172be0285a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fae6cc604e5740068f1dd4b36c3ba748" status: 200 len: 15 microversion: 2.1 time: 0.119698 Jul 20 04:13:50.291935 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 511/1059] 10.222.0.20 () {58 vars in 1256 bytes} [Wed Jul 20 04:13:50 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fae6cc604e5740068f1dd4b36c3ba748 => generated 15 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:50.311005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b5a42bf6-872b-491d-9e92-30a09f938537 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:50.315121 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b5a42bf6-872b-491d-9e92-30a09f938537 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009112 Jul 20 04:13:50.316164 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 512/1060] 10.222.0.20 () {58 vars in 1188 bytes} [Wed Jul 20 04:13:50 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:50.333059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-19b6f976-7426-41a8-b551-e2278a86c0ea tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:50.334039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-19b6f976-7426-41a8-b551-e2278a86c0ea tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:50.340367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19b6f976-7426-41a8-b551-e2278a86c0ea tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.340824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19b6f976-7426-41a8-b551-e2278a86c0ea tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.341606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19b6f976-7426-41a8-b551-e2278a86c0ea tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.342049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19b6f976-7426-41a8-b551-e2278a86c0ea tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.427464 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-19b6f976-7426-41a8-b551-e2278a86c0ea tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action" status: 202 len: 0 microversion: 2.1 time: 0.098144 Jul 20 04:13:50.428668 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 513/1061] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:50 2022] POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:13:50.441142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9873ea2-8bbc-496e-bc7c-b06c0bfff586 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:50.444705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e9873ea2-8bbc-496e-bc7c-b06c0bfff586 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:50.445407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e9873ea2-8bbc-496e-bc7c-b06c0bfff586 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '5875a8f9aeef4ae09122649735d93375'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:13:50.451346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9873ea2-8bbc-496e-bc7c-b06c0bfff586 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.451816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9873ea2-8bbc-496e-bc7c-b06c0bfff586 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.452600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9873ea2-8bbc-496e-bc7c-b06c0bfff586 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.453027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9873ea2-8bbc-496e-bc7c-b06c0bfff586 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.538361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:50.543900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-e9873ea2-8bbc-496e-bc7c-b06c0bfff586 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:13:50.610141 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e9873ea2-8bbc-496e-bc7c-b06c0bfff586 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.172916 Jul 20 04:13:50.611036 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 514/1062] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Jul 20 04:13:50 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:50.615749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d8231df1-6fa7-445b-98bf-b26e081355bc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:50.616356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d8231df1-6fa7-445b-98bf-b26e081355bc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:50.622905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8231df1-6fa7-445b-98bf-b26e081355bc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.623355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8231df1-6fa7-445b-98bf-b26e081355bc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.624155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8231df1-6fa7-445b-98bf-b26e081355bc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.624587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8231df1-6fa7-445b-98bf-b26e081355bc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.735263 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e501d76d-c6bd-477d-b7a7-d1e4e0ec5ab2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "DELETE /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c" status: 204 len: 0 microversion: 2.1 time: 0.628548 Jul 20 04:13:50.735878 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 549/1063] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:50 2022] DELETE /compute/v2.1/images/4e4bc7e8-ca44-40ee-a34f-bb7d37c1044c => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:50.742673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-325524db-88bc-4cad-862c-32261274a367 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:50.743711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-325524db-88bc-4cad-862c-32261274a367 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:50.749977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-325524db-88bc-4cad-862c-32261274a367 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.750431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-325524db-88bc-4cad-862c-32261274a367 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.751195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-325524db-88bc-4cad-862c-32261274a367 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.751673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-325524db-88bc-4cad-862c-32261274a367 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.817196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d8231df1-6fa7-445b-98bf-b26e081355bc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:50.826386 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d8231df1-6fa7-445b-98bf-b26e081355bc tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1316 microversion: 2.1 time: 0.214277 Jul 20 04:13:50.827254 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 515/1064] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:50 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:50.832141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a93e1082-2649-4b59-b1ad-38fcf06be843 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:50.832834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a93e1082-2649-4b59-b1ad-38fcf06be843 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:50.839466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a93e1082-2649-4b59-b1ad-38fcf06be843 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.840095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a93e1082-2649-4b59-b1ad-38fcf06be843 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.840932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a93e1082-2649-4b59-b1ad-38fcf06be843 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.841328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a93e1082-2649-4b59-b1ad-38fcf06be843 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.842634 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-325524db-88bc-4cad-862c-32261274a367 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action" status: 202 len: 0 microversion: 2.1 time: 0.105174 Jul 20 04:13:50.843579 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 550/1065] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:50 2022] POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:50.848772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0ef8f533-6951-4af1-af12-a5912237257b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d8bed30>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.063243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a93e1082-2649-4b59-b1ad-38fcf06be843 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:51.072808 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a93e1082-2649-4b59-b1ad-38fcf06be843 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1324 microversion: 2.1 time: 0.244181 Jul 20 04:13:51.073520 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 516/1066] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:50 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1324 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:51.079895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fd9231dd-0c05-442c-9a4f-1f1d308cb878 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.080655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fd9231dd-0c05-442c-9a4f-1f1d308cb878 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.087098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd9231dd-0c05-442c-9a4f-1f1d308cb878 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.087572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd9231dd-0c05-442c-9a4f-1f1d308cb878 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.088357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd9231dd-0c05-442c-9a4f-1f1d308cb878 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.088799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd9231dd-0c05-442c-9a4f-1f1d308cb878 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.319362 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0ef8f533-6951-4af1-af12-a5912237257b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "DELETE /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0" status: 204 len: 0 microversion: 2.1 time: 0.474420 Jul 20 04:13:51.320392 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 551/1067] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:50 2022] DELETE /compute/v2.1/images/ece31405-4d86-4d67-a009-60b5763c5bf0 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:51.324217 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fd9231dd-0c05-442c-9a4f-1f1d308cb878 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1616 microversion: 2.1 time: 0.249209 Jul 20 04:13:51.325336 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 517/1068] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1616 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:51.325725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3ca46a92-6df1-4c6e-8ab4-f184780e50b1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.326404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3ca46a92-6df1-4c6e-8ab4-f184780e50b1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.331225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c1830a6a-0b41-4056-b082-efbfdb884420 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9dd24ee0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.333174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ca46a92-6df1-4c6e-8ab4-f184780e50b1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.334212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ca46a92-6df1-4c6e-8ab4-f184780e50b1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.334994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ca46a92-6df1-4c6e-8ab4-f184780e50b1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.335434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ca46a92-6df1-4c6e-8ab4-f184780e50b1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.485293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3ca46a92-6df1-4c6e-8ab4-f184780e50b1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:51.494003 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3ca46a92-6df1-4c6e-8ab4-f184780e50b1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.172302 Jul 20 04:13:51.494581 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 552/1069] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:51.498842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-800380ee-f67d-4061-9984-ecf4df24a7f7 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.499747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-800380ee-f67d-4061-9984-ecf4df24a7f7 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.505730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-800380ee-f67d-4061-9984-ecf4df24a7f7 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.506606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-800380ee-f67d-4061-9984-ecf4df24a7f7 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.507228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-800380ee-f67d-4061-9984-ecf4df24a7f7 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.507704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-800380ee-f67d-4061-9984-ecf4df24a7f7 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.651047 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-800380ee-f67d-4061-9984-ecf4df24a7f7 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1616 microversion: 2.1 time: 0.155420 Jul 20 04:13:51.656449 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 553/1070] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1616 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:51.656449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-48395ad3-cc77-49f7-8b84-d87befd268d8 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Calling method '.version_select at 0x7fbf9d6d5ca0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.658815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-48395ad3-cc77-49f7-8b84-d87befd268d8 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.659269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-48395ad3-cc77-49f7-8b84-d87befd268d8 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.671202 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-48395ad3-cc77-49f7-8b84-d87befd268d8 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1586 microversion: 2.1 time: 0.018098 Jul 20 04:13:51.674184 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 554/1071] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/os-migrations => generated 1586 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:51.677284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-856cf0f7-e05e-493b-b2b0-a47b6f2de6ff tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.682076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-856cf0f7-e05e-493b-b2b0-a47b6f2de6ff tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Searching by: {'host': 'n-h1-764485-11', 'deleted': False} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:13:51.690019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-856cf0f7-e05e-493b-b2b0-a47b6f2de6ff tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.690480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-856cf0f7-e05e-493b-b2b0-a47b6f2de6ff tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.691286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-856cf0f7-e05e-493b-b2b0-a47b6f2de6ff tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.691783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-856cf0f7-e05e-493b-b2b0-a47b6f2de6ff tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.779591 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c1830a6a-0b41-4056-b082-efbfdb884420 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "DELETE /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650" status: 204 len: 0 microversion: 2.1 time: 0.452817 Jul 20 04:13:51.780164 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 518/1072] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:51 2022] DELETE /compute/v2.1/images/ef4df1f2-f0fb-4d9f-b6b1-91eff3e48650 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:51.788422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5f81e478-9e3d-47d1-9553-010421545e63 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.795667 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5f81e478-9e3d-47d1-9553-010421545e63 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011483 Jul 20 04:13:51.796259 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 519/1073] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:51.799685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-856cf0f7-e05e-493b-b2b0-a47b6f2de6ff tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:13:51.800571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ec61179a-633e-47c4-89bc-b607965dd5c2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.801065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ec61179a-633e-47c4-89bc-b607965dd5c2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.808151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec61179a-633e-47c4-89bc-b607965dd5c2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.808606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec61179a-633e-47c4-89bc-b607965dd5c2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.809379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec61179a-633e-47c4-89bc-b607965dd5c2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.809817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec61179a-633e-47c4-89bc-b607965dd5c2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.835681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ec61179a-633e-47c4-89bc-b607965dd5c2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:51.861061 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-856cf0f7-e05e-493b-b2b0-a47b6f2de6ff tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=n-h1-764485-11&all_tenants=1" status: 200 len: 3622 microversion: 2.1 time: 0.187211 Jul 20 04:13:51.861663 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 555/1074] 10.222.0.20 () {58 vars in 1191 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers?host=n-h1-764485-11&all_tenants=1 => generated 3622 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:51.866139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-98414a09-3029-4786-9f9c-1f8c5a356704 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-386047851", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:51.867691 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:51.867691 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:13:51.882930 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-98414a09-3029-4786-9f9c-1f8c5a356704 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.020225 Jul 20 04:13:51.883741 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 556/1075] 10.222.0.20 () {60 vars in 1145 bytes} [Wed Jul 20 04:13:51 2022] POST /compute/v2.1/flavors => generated 498 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:51.888633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c54ea72-3b47-4aef-9de4-a30a1ea41a3f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.889434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9c54ea72-3b47-4aef-9de4-a30a1ea41a3f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.895536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c54ea72-3b47-4aef-9de4-a30a1ea41a3f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.896564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c54ea72-3b47-4aef-9de4-a30a1ea41a3f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.897861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c54ea72-3b47-4aef-9de4-a30a1ea41a3f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.897987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c54ea72-3b47-4aef-9de4-a30a1ea41a3f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.902018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:51.912952 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ec61179a-633e-47c4-89bc-b607965dd5c2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "DELETE /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 204 len: 0 microversion: 2.1 time: 0.114695 Jul 20 04:13:51.913589 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 520/1076] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:51 2022] DELETE /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:51.919493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6a716bb4-5ba8-4bba-be56-0b0b2425c2c9 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.924893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6a716bb4-5ba8-4bba-be56-0b0b2425c2c9 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:13:51.930678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a716bb4-5ba8-4bba-be56-0b0b2425c2c9 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.931131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a716bb4-5ba8-4bba-be56-0b0b2425c2c9 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.931972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a716bb4-5ba8-4bba-be56-0b0b2425c2c9 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.932411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a716bb4-5ba8-4bba-be56-0b0b2425c2c9 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.015695 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6a716bb4-5ba8-4bba-be56-0b0b2425c2c9 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.100850 Jul 20 04:13:52.016320 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 521/1077] 10.222.0.20 () {58 vars in 1195 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:52.020619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0bd768a1-fe7c-42be-87d1-bc114d8ef341 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.029722 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0bd768a1-fe7c-42be-87d1-bc114d8ef341 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012338 Jul 20 04:13:52.030417 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 522/1078] 10.222.0.20 () {58 vars in 1181 bytes} [Wed Jul 20 04:13:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:52.036086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9c54ea72-3b47-4aef-9de4-a30a1ea41a3f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.043849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-480c5f51-1807-4c66-bb7c-3e2cf8f6f61d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.044702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-480c5f51-1807-4c66-bb7c-3e2cf8f6f61d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:52.045073 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c54ea72-3b47-4aef-9de4-a30a1ea41a3f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1316 microversion: 2.1 time: 0.160460 Jul 20 04:13:52.054835 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 557/1079] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:52.054835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0f4dfaf-1695-4bef-b77b-c01f3896392e tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:52.054835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b0f4dfaf-1695-4bef-b77b-c01f3896392e tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:52.055203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-480c5f51-1807-4c66-bb7c-3e2cf8f6f61d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.055203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-480c5f51-1807-4c66-bb7c-3e2cf8f6f61d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.055203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-480c5f51-1807-4c66-bb7c-3e2cf8f6f61d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.055203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-480c5f51-1807-4c66-bb7c-3e2cf8f6f61d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.059063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0f4dfaf-1695-4bef-b77b-c01f3896392e tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.059538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0f4dfaf-1695-4bef-b77b-c01f3896392e tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.060478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0f4dfaf-1695-4bef-b77b-c01f3896392e tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.060919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0f4dfaf-1695-4bef-b77b-c01f3896392e tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.149262 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b0f4dfaf-1695-4bef-b77b-c01f3896392e tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action" status: 202 len: 0 microversion: 2.1 time: 0.102239 Jul 20 04:13:52.154999 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 558/1080] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:52 2022] POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:52.156757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-abd38361-121e-41f2-a503-be9011d376e6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.157368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-abd38361-121e-41f2-a503-be9011d376e6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:52.163437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abd38361-121e-41f2-a503-be9011d376e6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.163941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abd38361-121e-41f2-a503-be9011d376e6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.164711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abd38361-121e-41f2-a503-be9011d376e6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.165151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abd38361-121e-41f2-a503-be9011d376e6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.200644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-480c5f51-1807-4c66-bb7c-3e2cf8f6f61d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.208325 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-480c5f51-1807-4c66-bb7c-3e2cf8f6f61d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1472 microversion: 2.1 time: 0.168351 Jul 20 04:13:52.209629 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 523/1081] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:52 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1472 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:52.220534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-424452751", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "35b2f035-ad7b-48d5-b55f-6bd0d0ba499e"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:52.275572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:52.322062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-abd38361-121e-41f2-a503-be9011d376e6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.330004 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-abd38361-121e-41f2-a503-be9011d376e6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1324 microversion: 2.1 time: 0.176943 Jul 20 04:13:52.330604 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 559/1082] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:52 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1324 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:52.335427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:52.336955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:52.343333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.343799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.344565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.345001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.422614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:52.423039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:52.423537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:52.423946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:52.424406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:52.487530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:52.494929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.495548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.496351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.496876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.528070 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-25b36338-1f32-4944-8f62-844f49b25635 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action" status: 202 len: 1067 microversion: 2.1 time: 0.196299 Jul 20 04:13:52.529245 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 560/1083] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:52 2022] POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action => generated 1067 bytes in 198 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:13:52.541162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e8d10c6-f709-4575-8fcb-192674453ebb tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.541803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3e8d10c6-f709-4575-8fcb-192674453ebb tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:52.550935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e8d10c6-f709-4575-8fcb-192674453ebb tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.551789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e8d10c6-f709-4575-8fcb-192674453ebb tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.553567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e8d10c6-f709-4575-8fcb-192674453ebb tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.554197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e8d10c6-f709-4575-8fcb-192674453ebb tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.954597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:52.955093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:52.955544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:52.955957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:52.956366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:52.958661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3e8d10c6-f709-4575-8fcb-192674453ebb tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.966188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.966368 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3e8d10c6-f709-4575-8fcb-192674453ebb tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.435915 Jul 20 04:13:52.966650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.976978 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 561/1084] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:52 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:52.977169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.977169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.981139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d003d556-c5ac-4165-b51e-e6f3415373ca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.981999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d003d556-c5ac-4165-b51e-e6f3415373ca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:52.987767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Getting quotas for project 41ba023317344d3490bdb01aa8b1e01b. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:52.988398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d003d556-c5ac-4165-b51e-e6f3415373ca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.988844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d003d556-c5ac-4165-b51e-e6f3415373ca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.989848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d003d556-c5ac-4165-b51e-e6f3415373ca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.991184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d003d556-c5ac-4165-b51e-e6f3415373ca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.994718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Getting quotas for user 9aa79203e62546cea351116b153afee5 and project 41ba023317344d3490bdb01aa8b1e01b. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:53.006412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:53.011753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:53.014063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:53.062173 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5294e48b-fa93-49c9-b242-cbb594c467f5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845697 Jul 20 04:13:53.062910 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 524/1085] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:13:53.067293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-11fbde0c-8042-4242-863d-42344fe3656e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:53.068781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-11fbde0c-8042-4242-863d-42344fe3656e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:53.077592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11fbde0c-8042-4242-863d-42344fe3656e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.078086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11fbde0c-8042-4242-863d-42344fe3656e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.078866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11fbde0c-8042-4242-863d-42344fe3656e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.079337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11fbde0c-8042-4242-863d-42344fe3656e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.304223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d003d556-c5ac-4165-b51e-e6f3415373ca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:53.312449 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d003d556-c5ac-4165-b51e-e6f3415373ca tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1471 microversion: 2.1 time: 0.344064 Jul 20 04:13:53.313279 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 562/1086] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:52 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:53.318052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-92ec93a4-c149-4897-a281-3290ecc704be tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:53.319268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-92ec93a4-c149-4897-a281-3290ecc704be tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:53.395301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-92ec93a4-c149-4897-a281-3290ecc704be tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:53.401632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-11fbde0c-8042-4242-863d-42344fe3656e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:53.405085 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-92ec93a4-c149-4897-a281-3290ecc704be tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1278 microversion: 2.1 time: 0.090278 Jul 20 04:13:53.406120 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 563/1087] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:53 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:53.411118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-690ca738-439a-4719-9950-68893137527e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:53.412543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-690ca738-439a-4719-9950-68893137527e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:53.416677 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-11fbde0c-8042-4242-863d-42344fe3656e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1316 microversion: 2.1 time: 0.352786 Jul 20 04:13:53.419372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-690ca738-439a-4719-9950-68893137527e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.419888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-690ca738-439a-4719-9950-68893137527e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.420693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-690ca738-439a-4719-9950-68893137527e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.421080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-690ca738-439a-4719-9950-68893137527e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.424339 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 525/1088] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:53 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:53.429708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7ab9a50-2ba4-4e62-a284-cfc739331fb3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:53.430763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c7ab9a50-2ba4-4e62-a284-cfc739331fb3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:53.448635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7ab9a50-2ba4-4e62-a284-cfc739331fb3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.449553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7ab9a50-2ba4-4e62-a284-cfc739331fb3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.450693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7ab9a50-2ba4-4e62-a284-cfc739331fb3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.451328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7ab9a50-2ba4-4e62-a284-cfc739331fb3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.685354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c7ab9a50-2ba4-4e62-a284-cfc739331fb3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:53.692770 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c7ab9a50-2ba4-4e62-a284-cfc739331fb3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1324 microversion: 2.1 time: 0.267402 Jul 20 04:13:53.693901 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 526/1089] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:53 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1324 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:53.696172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-690ca738-439a-4719-9950-68893137527e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:53.703874 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-690ca738-439a-4719-9950-68893137527e tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1472 microversion: 2.1 time: 0.296483 Jul 20 04:13:53.704447 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 564/1090] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:53 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:53.985149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-83df5417-f428-4a6a-b0e2-4a3f5767ede5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:53.985692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-83df5417-f428-4a6a-b0e2-4a3f5767ede5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:53.994472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83df5417-f428-4a6a-b0e2-4a3f5767ede5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.994916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83df5417-f428-4a6a-b0e2-4a3f5767ede5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.995786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83df5417-f428-4a6a-b0e2-4a3f5767ede5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.996220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83df5417-f428-4a6a-b0e2-4a3f5767ede5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.138530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-83df5417-f428-4a6a-b0e2-4a3f5767ede5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:54.146045 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-83df5417-f428-4a6a-b0e2-4a3f5767ede5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.165580 Jul 20 04:13:54.146611 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 527/1091] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:53 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:54.331262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1e8243f5-f253-42a8-89d7-e01aeefc19d0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:54.332975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1e8243f5-f253-42a8-89d7-e01aeefc19d0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:54.343809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e8243f5-f253-42a8-89d7-e01aeefc19d0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.344260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e8243f5-f253-42a8-89d7-e01aeefc19d0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.345039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e8243f5-f253-42a8-89d7-e01aeefc19d0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.345470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e8243f5-f253-42a8-89d7-e01aeefc19d0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.422320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0568b757-60a4-4a36-a85e-2f652d3b88b3 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:54.423716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0568b757-60a4-4a36-a85e-2f652d3b88b3 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:54.430411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0568b757-60a4-4a36-a85e-2f652d3b88b3 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.430966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0568b757-60a4-4a36-a85e-2f652d3b88b3 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.432290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0568b757-60a4-4a36-a85e-2f652d3b88b3 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.432927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0568b757-60a4-4a36-a85e-2f652d3b88b3 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.518470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0568b757-60a4-4a36-a85e-2f652d3b88b3 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:54.523067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1e8243f5-f253-42a8-89d7-e01aeefc19d0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:54.526489 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0568b757-60a4-4a36-a85e-2f652d3b88b3 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1330 microversion: 2.1 time: 0.108085 Jul 20 04:13:54.528804 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 528/1092] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:54 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:54.531897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-79fa65e6-97f9-4526-aba4-02c64841ae76 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:54.532502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-79fa65e6-97f9-4526-aba4-02c64841ae76 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:54.534248 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1e8243f5-f253-42a8-89d7-e01aeefc19d0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1471 microversion: 2.1 time: 0.206885 Jul 20 04:13:54.535488 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 565/1093] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:54 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:54.539651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79fa65e6-97f9-4526-aba4-02c64841ae76 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.540132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79fa65e6-97f9-4526-aba4-02c64841ae76 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.540875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79fa65e6-97f9-4526-aba4-02c64841ae76 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.541315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79fa65e6-97f9-4526-aba4-02c64841ae76 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.678271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-79fa65e6-97f9-4526-aba4-02c64841ae76 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:54.686020 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-79fa65e6-97f9-4526-aba4-02c64841ae76 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1316 microversion: 2.1 time: 0.157586 Jul 20 04:13:54.686677 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 529/1094] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:54 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:54.710371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f1b1c52a-e2d7-46dc-9f8b-46e50e8e58f5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:54.710909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f1b1c52a-e2d7-46dc-9f8b-46e50e8e58f5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:54.716958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1b1c52a-e2d7-46dc-9f8b-46e50e8e58f5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.717890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1b1c52a-e2d7-46dc-9f8b-46e50e8e58f5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.718657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1b1c52a-e2d7-46dc-9f8b-46e50e8e58f5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.719123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1b1c52a-e2d7-46dc-9f8b-46e50e8e58f5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.722184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a028ae36-36db-460d-9519-17c4d1948cd4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:54.722795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a028ae36-36db-460d-9519-17c4d1948cd4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:54.730143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a028ae36-36db-460d-9519-17c4d1948cd4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.730711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a028ae36-36db-460d-9519-17c4d1948cd4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.731492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a028ae36-36db-460d-9519-17c4d1948cd4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.731945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a028ae36-36db-460d-9519-17c4d1948cd4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.925848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f1b1c52a-e2d7-46dc-9f8b-46e50e8e58f5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:54.929724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a028ae36-36db-460d-9519-17c4d1948cd4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:54.936097 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f1b1c52a-e2d7-46dc-9f8b-46e50e8e58f5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1324 microversion: 2.1 time: 0.229905 Jul 20 04:13:54.936717 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 566/1095] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:54 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1324 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:54.937484 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a028ae36-36db-460d-9519-17c4d1948cd4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1472 microversion: 2.1 time: 0.219068 Jul 20 04:13:54.938050 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 530/1096] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:54 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1472 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:55.163033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc7cfb2a-964e-4efe-858c-d55ce84bf537 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.163676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc7cfb2a-964e-4efe-858c-d55ce84bf537 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.169659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc7cfb2a-964e-4efe-858c-d55ce84bf537 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.170119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc7cfb2a-964e-4efe-858c-d55ce84bf537 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.170848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc7cfb2a-964e-4efe-858c-d55ce84bf537 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.171279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc7cfb2a-964e-4efe-858c-d55ce84bf537 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.304553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cc7cfb2a-964e-4efe-858c-d55ce84bf537 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.311958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cc7cfb2a-964e-4efe-858c-d55ce84bf537 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.153410 Jul 20 04:13:55.312519 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 567/1097] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:55.543839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4af187e8-3bc1-4d0e-b2aa-0dbac1a2ee12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.544455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4af187e8-3bc1-4d0e-b2aa-0dbac1a2ee12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.551108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4af187e8-3bc1-4d0e-b2aa-0dbac1a2ee12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.551601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4af187e8-3bc1-4d0e-b2aa-0dbac1a2ee12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.552384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4af187e8-3bc1-4d0e-b2aa-0dbac1a2ee12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.552825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4af187e8-3bc1-4d0e-b2aa-0dbac1a2ee12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.554203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3d65e0e8-016b-47d8-a7e6-36a2393a664c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.554816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3d65e0e8-016b-47d8-a7e6-36a2393a664c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.561281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d65e0e8-016b-47d8-a7e6-36a2393a664c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.561961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d65e0e8-016b-47d8-a7e6-36a2393a664c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.562727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d65e0e8-016b-47d8-a7e6-36a2393a664c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.563194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d65e0e8-016b-47d8-a7e6-36a2393a664c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.627154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4af187e8-3bc1-4d0e-b2aa-0dbac1a2ee12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.635967 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4af187e8-3bc1-4d0e-b2aa-0dbac1a2ee12 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1330 microversion: 2.1 time: 0.095987 Jul 20 04:13:55.636592 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 531/1098] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:55.703486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-73730c62-9467-4333-be74-a612c717b190 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.704155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-73730c62-9467-4333-be74-a612c717b190 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.710922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73730c62-9467-4333-be74-a612c717b190 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.711378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73730c62-9467-4333-be74-a612c717b190 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.712207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73730c62-9467-4333-be74-a612c717b190 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.712648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73730c62-9467-4333-be74-a612c717b190 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.718883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3d65e0e8-016b-47d8-a7e6-36a2393a664c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.726757 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3d65e0e8-016b-47d8-a7e6-36a2393a664c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1471 microversion: 2.1 time: 0.176630 Jul 20 04:13:55.727749 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 568/1099] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:55.838922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-73730c62-9467-4333-be74-a612c717b190 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.846604 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-73730c62-9467-4333-be74-a612c717b190 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1316 microversion: 2.1 time: 0.147069 Jul 20 04:13:55.847171 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 532/1100] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1316 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:55.953357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0d2aa86d-0d2f-4c64-ae8d-235fb46d340e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.953995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0d2aa86d-0d2f-4c64-ae8d-235fb46d340e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.962899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d2aa86d-0d2f-4c64-ae8d-235fb46d340e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.963146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1c2c6762-aa1e-4283-8d6d-445f2cee8044 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.963349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d2aa86d-0d2f-4c64-ae8d-235fb46d340e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.963791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1c2c6762-aa1e-4283-8d6d-445f2cee8044 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.964139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d2aa86d-0d2f-4c64-ae8d-235fb46d340e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.964568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d2aa86d-0d2f-4c64-ae8d-235fb46d340e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.970077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c2c6762-aa1e-4283-8d6d-445f2cee8044 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.970774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c2c6762-aa1e-4283-8d6d-445f2cee8044 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.971572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c2c6762-aa1e-4283-8d6d-445f2cee8044 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.972020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c2c6762-aa1e-4283-8d6d-445f2cee8044 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.988854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:56.183039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d2aa86d-0d2f-4c64-ae8d-235fb46d340e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:56.189969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1c2c6762-aa1e-4283-8d6d-445f2cee8044 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:56.191360 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0d2aa86d-0d2f-4c64-ae8d-235fb46d340e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1324 microversion: 2.1 time: 0.242051 Jul 20 04:13:56.192046 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 569/1101] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1324 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:56.197579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-40b0ba77-28a4-4445-8a5c-f917462c34cd req-a015a1be-0153-4288-8783-85b180ee12a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a", "name": "network-vif-plugged", "status": "completed", "tag": "843dc3e4-010a-405c-9273-4b23321754bf"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:56.198363 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1c2c6762-aa1e-4283-8d6d-445f2cee8044 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1472 microversion: 2.1 time: 0.240610 Jul 20 04:13:56.198938 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 533/1102] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1472 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:56.205766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-40b0ba77-28a4-4445-8a5c-f917462c34cd req-a015a1be-0153-4288-8783-85b180ee12a6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.206265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-40b0ba77-28a4-4445-8a5c-f917462c34cd req-a015a1be-0153-4288-8783-85b180ee12a6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.217570 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-40b0ba77-28a4-4445-8a5c-f917462c34cd req-a015a1be-0153-4288-8783-85b180ee12a6 service nova] Creating event network-vif-plugged:843dc3e4-010a-405c-9273-4b23321754bf for instance 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a on n-h1-764485-11 Jul 20 04:13:56.222516 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-40b0ba77-28a4-4445-8a5c-f917462c34cd req-a015a1be-0153-4288-8783-85b180ee12a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029216 Jul 20 04:13:56.223070 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 570/1103] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:56.329981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ff460dd-e985-4a72-8fd1-310ea30a605f tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:56.330598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ff460dd-e985-4a72-8fd1-310ea30a605f tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:56.337000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ff460dd-e985-4a72-8fd1-310ea30a605f tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.337458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ff460dd-e985-4a72-8fd1-310ea30a605f tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.338240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ff460dd-e985-4a72-8fd1-310ea30a605f tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.338701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ff460dd-e985-4a72-8fd1-310ea30a605f tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.511335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1ff460dd-e985-4a72-8fd1-310ea30a605f tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:56.518787 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ff460dd-e985-4a72-8fd1-310ea30a605f tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1322 microversion: 2.1 time: 0.192690 Jul 20 04:13:56.519354 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 534/1104] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:56 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:56.654569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-24ef3520-6ba0-4f1c-8faf-a7ba0ac4eb62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:56.655920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-24ef3520-6ba0-4f1c-8faf-a7ba0ac4eb62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:56.663972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24ef3520-6ba0-4f1c-8faf-a7ba0ac4eb62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.664419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24ef3520-6ba0-4f1c-8faf-a7ba0ac4eb62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.665224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24ef3520-6ba0-4f1c-8faf-a7ba0ac4eb62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.665836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24ef3520-6ba0-4f1c-8faf-a7ba0ac4eb62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.745143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-50181698-40f9-4b65-a2d2-5d25926c2524 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:56.745768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-50181698-40f9-4b65-a2d2-5d25926c2524 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:56.752349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50181698-40f9-4b65-a2d2-5d25926c2524 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.752807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50181698-40f9-4b65-a2d2-5d25926c2524 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.753589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50181698-40f9-4b65-a2d2-5d25926c2524 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.754034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50181698-40f9-4b65-a2d2-5d25926c2524 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.775960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-24ef3520-6ba0-4f1c-8faf-a7ba0ac4eb62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:56.785855 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-24ef3520-6ba0-4f1c-8faf-a7ba0ac4eb62 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1330 microversion: 2.1 time: 0.136626 Jul 20 04:13:56.787026 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 571/1105] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:56 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1330 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:56.865745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a7a34a1-51b9-4276-9926-115b2366f295 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:56.866672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a7a34a1-51b9-4276-9926-115b2366f295 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:56.874624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a7a34a1-51b9-4276-9926-115b2366f295 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.875220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a7a34a1-51b9-4276-9926-115b2366f295 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.876499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a7a34a1-51b9-4276-9926-115b2366f295 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.877167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a7a34a1-51b9-4276-9926-115b2366f295 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.883314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:57.071897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-50181698-40f9-4b65-a2d2-5d25926c2524 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.079841 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-50181698-40f9-4b65-a2d2-5d25926c2524 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1471 microversion: 2.1 time: 0.338496 Jul 20 04:13:57.080725 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 535/1106] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:56 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1471 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:57.209407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac77613d-561b-4f2c-8dc4-f7227cc20f2f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:57.210762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac77613d-561b-4f2c-8dc4-f7227cc20f2f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:57.217012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac77613d-561b-4f2c-8dc4-f7227cc20f2f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.217827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac77613d-561b-4f2c-8dc4-f7227cc20f2f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.218675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac77613d-561b-4f2c-8dc4-f7227cc20f2f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.219188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac77613d-561b-4f2c-8dc4-f7227cc20f2f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.235538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5a7a34a1-51b9-4276-9926-115b2366f295 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.247210 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a7a34a1-51b9-4276-9926-115b2366f295 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1316 microversion: 2.1 time: 0.386620 Jul 20 04:13:57.247833 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 572/1107] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:56 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:57.254770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d8e4aa4b-4a63-4f40-8a92-dfed639b67ee tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:57.256122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d8e4aa4b-4a63-4f40-8a92-dfed639b67ee tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:57.263352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d8e4aa4b-4a63-4f40-8a92-dfed639b67ee tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.264217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d8e4aa4b-4a63-4f40-8a92-dfed639b67ee tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.265026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d8e4aa4b-4a63-4f40-8a92-dfed639b67ee tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.265465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d8e4aa4b-4a63-4f40-8a92-dfed639b67ee tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.617297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ac77613d-561b-4f2c-8dc4-f7227cc20f2f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.625021 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ac77613d-561b-4f2c-8dc4-f7227cc20f2f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1324 microversion: 2.1 time: 0.420161 Jul 20 04:13:57.635775 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 536/1108] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:57 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1324 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:57.640905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6ba25590-8de8-4ec0-961e-1b970361580c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:57.641514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6ba25590-8de8-4ec0-961e-1b970361580c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:57.648269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ba25590-8de8-4ec0-961e-1b970361580c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.648727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ba25590-8de8-4ec0-961e-1b970361580c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.649500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ba25590-8de8-4ec0-961e-1b970361580c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.650114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ba25590-8de8-4ec0-961e-1b970361580c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.653557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d8e4aa4b-4a63-4f40-8a92-dfed639b67ee tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.663494 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d8e4aa4b-4a63-4f40-8a92-dfed639b67ee tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 200 len: 1472 microversion: 2.1 time: 0.414296 Jul 20 04:13:57.670305 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 573/1109] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:57 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 1472 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:57.725096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-3975e66f-e1d9-4f6d-9575-57d930c8ccce req-00f46ad0-acd9-4ee1-ae20-c2ff9adc24ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b5ae40-24a9-4b37-8920-8f32fd165dd8", "name": "network-vif-deleted", "tag": "f1ae2766-bf4e-4f6c-b66b-eb30f89c64f2"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:57.734503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3975e66f-e1d9-4f6d-9575-57d930c8ccce req-00f46ad0-acd9-4ee1-ae20-c2ff9adc24ae service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.734940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3975e66f-e1d9-4f6d-9575-57d930c8ccce req-00f46ad0-acd9-4ee1-ae20-c2ff9adc24ae service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.747237 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-3975e66f-e1d9-4f6d-9575-57d930c8ccce req-00f46ad0-acd9-4ee1-ae20-c2ff9adc24ae service nova] Creating event network-vif-deleted:f1ae2766-bf4e-4f6c-b66b-eb30f89c64f2 for instance 02b5ae40-24a9-4b37-8920-8f32fd165dd8 on n-h2-764485-11 Jul 20 04:13:57.753307 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-3975e66f-e1d9-4f6d-9575-57d930c8ccce req-00f46ad0-acd9-4ee1-ae20-c2ff9adc24ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032331 Jul 20 04:13:57.756379 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 574/1110] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:57.804896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a1570ae8-7a21-421c-948d-b4f9f920ffef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:57.805622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a1570ae8-7a21-421c-948d-b4f9f920ffef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:57.814544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1570ae8-7a21-421c-948d-b4f9f920ffef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.815242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1570ae8-7a21-421c-948d-b4f9f920ffef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.816222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1570ae8-7a21-421c-948d-b4f9f920ffef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.816663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1570ae8-7a21-421c-948d-b4f9f920ffef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.920701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a1570ae8-7a21-421c-948d-b4f9f920ffef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.928401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6ba25590-8de8-4ec0-961e-1b970361580c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.930729 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a1570ae8-7a21-421c-948d-b4f9f920ffef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1336 microversion: 2.1 time: 0.130997 Jul 20 04:13:57.940914 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6ba25590-8de8-4ec0-961e-1b970361580c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1471 microversion: 2.1 time: 0.303931 Jul 20 04:13:57.941228 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 575/1111] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:57 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1336 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:57.941971 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 537/1112] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:57 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1471 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:57.961570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-60764006-2f46-4d94-9d9b-cfb65f07792f tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:57.962337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-60764006-2f46-4d94-9d9b-cfb65f07792f tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:57.971737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-60764006-2f46-4d94-9d9b-cfb65f07792f tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.972879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-60764006-2f46-4d94-9d9b-cfb65f07792f tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.974784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-60764006-2f46-4d94-9d9b-cfb65f07792f tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.975446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-60764006-2f46-4d94-9d9b-cfb65f07792f tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.000632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-60764006-2f46-4d94-9d9b-cfb65f07792f tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lazy-loading 'flavor' on Instance uuid f5f729b8-7001-423b-88d7-42ff10001e4a {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:58.078153 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-60764006-2f46-4d94-9d9b-cfb65f07792f tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a/action" status: 202 len: 0 microversion: 2.1 time: 0.120534 Jul 20 04:13:58.087028 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 576/1113] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:57 2022] POST /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:58.090056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8acbaa6c-be36-4bea-b7d9-d52e05ea29db tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.090673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8acbaa6c-be36-4bea-b7d9-d52e05ea29db tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:58.099695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6d2f5845-30d6-4891-a472-01894cef209e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.100521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6d2f5845-30d6-4891-a472-01894cef209e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:58.107168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d2f5845-30d6-4891-a472-01894cef209e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.108158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d2f5845-30d6-4891-a472-01894cef209e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.108702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8acbaa6c-be36-4bea-b7d9-d52e05ea29db tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.109157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8acbaa6c-be36-4bea-b7d9-d52e05ea29db tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.109614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d2f5845-30d6-4891-a472-01894cef209e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.109941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8acbaa6c-be36-4bea-b7d9-d52e05ea29db tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.110386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8acbaa6c-be36-4bea-b7d9-d52e05ea29db tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.110532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d2f5845-30d6-4891-a472-01894cef209e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.418732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6d2f5845-30d6-4891-a472-01894cef209e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:58.429113 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6d2f5845-30d6-4891-a472-01894cef209e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1471 microversion: 2.1 time: 0.332299 Jul 20 04:13:58.431173 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 577/1114] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1471 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:58.443588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-3c9f8840-e186-43be-a1b1-62081985b6c0 req-ce9fbaab-627b-4d5d-a052-ab809a29c79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b03708f-1f01-49cb-9215-7c9dc75c3592", "name": "network-vif-plugged", "status": "completed", "tag": "dc30438d-5ef8-4ad2-b26e-fc49195b5e08"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:58.468319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3c9f8840-e186-43be-a1b1-62081985b6c0 req-ce9fbaab-627b-4d5d-a052-ab809a29c79d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.469036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3c9f8840-e186-43be-a1b1-62081985b6c0 req-ce9fbaab-627b-4d5d-a052-ab809a29c79d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.493794 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-3c9f8840-e186-43be-a1b1-62081985b6c0 req-ce9fbaab-627b-4d5d-a052-ab809a29c79d service nova] Creating event network-vif-plugged:dc30438d-5ef8-4ad2-b26e-fc49195b5e08 for instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 on n-h2-764485-11 Jul 20 04:13:58.508957 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-3c9f8840-e186-43be-a1b1-62081985b6c0 req-ce9fbaab-627b-4d5d-a052-ab809a29c79d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075660 Jul 20 04:13:58.511323 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 578/1115] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:58.522760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7555e0b1-a111-4f9b-81c2-9ec38e9fd5b7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.523476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7555e0b1-a111-4f9b-81c2-9ec38e9fd5b7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:58.535347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7555e0b1-a111-4f9b-81c2-9ec38e9fd5b7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.539910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7555e0b1-a111-4f9b-81c2-9ec38e9fd5b7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.543106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7555e0b1-a111-4f9b-81c2-9ec38e9fd5b7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.543601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7555e0b1-a111-4f9b-81c2-9ec38e9fd5b7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.796670 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8acbaa6c-be36-4bea-b7d9-d52e05ea29db tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1632 microversion: 2.1 time: 0.710545 Jul 20 04:13:58.797277 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 538/1116] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1632 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:58.802659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6156ca8-0a84-4984-8189-dd9284486b7a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.803947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a6156ca8-0a84-4984-8189-dd9284486b7a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:58.813016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6156ca8-0a84-4984-8189-dd9284486b7a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.813731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6156ca8-0a84-4984-8189-dd9284486b7a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.814523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6156ca8-0a84-4984-8189-dd9284486b7a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.816303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6156ca8-0a84-4984-8189-dd9284486b7a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.870932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7555e0b1-a111-4f9b-81c2-9ec38e9fd5b7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:58.879049 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7555e0b1-a111-4f9b-81c2-9ec38e9fd5b7 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1466 microversion: 2.1 time: 0.362580 Jul 20 04:13:58.879655 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 579/1117] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1466 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:58.885196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-070ad943-fc7b-4030-b2a0-b7ce080fbc89 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.886024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-070ad943-fc7b-4030-b2a0-b7ce080fbc89 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: 02b5ae40-24a9-4b37-8920-8f32fd165dd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:58.892406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-070ad943-fc7b-4030-b2a0-b7ce080fbc89 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.892861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-070ad943-fc7b-4030-b2a0-b7ce080fbc89 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.893723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-070ad943-fc7b-4030-b2a0-b7ce080fbc89 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.894144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-070ad943-fc7b-4030-b2a0-b7ce080fbc89 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.908691 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-070ad943-fc7b-4030-b2a0-b7ce080fbc89 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] HTTP exception thrown: Instance 02b5ae40-24a9-4b37-8920-8f32fd165dd8 could not be found. Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-070ad943-fc7b-4030-b2a0-b7ce080fbc89 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Request method failure captured: Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 HTTP/1.1 Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BkHsrromwNNQxZUp4hxHdTA8hqqNdyGaPImiGaI8og4t9zG5SYFAchGxMojLlY4W5AfPU9goQ7MhxXRccrlz3yJevDZgYKXyOTEqDQn9cfo0tXftSsoCsR9Tfin9zfdRJQW2MWCfNZlf6lxEGxuEoi4NSibHlOWaC5xmEclQ7cLvo Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 9dd02283590e49b8a869ff0f94f2884a Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ListImageFiltersTestJSON-94699728 Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:13:58.910373 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:13:58.912274 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9dd02283590e49b8a869ff0f94f2884a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dd02283590e49b8a869ff0f94f2884a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9dd02283590e49b8a869ff0f94f2884a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dd02283590e49b8a869ff0f94f2884a"}]}] Jul 20 04:13:58.912274 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ListImageFiltersTestJSON-94699728 Jul 20 04:13:58.912274 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 9dd02283590e49b8a869ff0f94f2884a Jul 20 04:13:58.912274 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-94699728 Jul 20 04:13:58.912274 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ListImageFiltersTestJSON-94699728-project Jul 20 04:13:58.912274 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:13:58.912274 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:13:58.912274 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 17824778e95f4fd1afb0a3c679b9be7f Jul 20 04:13:58.912274 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ListImageFiltersTestJSON-94699728-project Jul 20 04:13:58.912274 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:13:58.912274 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 02b5ae40-24a9-4b37-8920-8f32fd165dd8 could not be found. Jul 20 04:13:58.912274 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '02b5ae40-24a9-4b37-8920-8f32fd165dd8'} Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b5ae40-24a9-4b37-8920-8f32fd165dd8 could not be found. Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:58.916602 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b5ae40-24a9-4b37-8920-8f32fd165dd8 could not be found. Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b5ae40-24a9-4b37-8920-8f32fd165dd8 could not be found. Jul 20 04:13:58.918142 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:13:58.919607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-070ad943-fc7b-4030-b2a0-b7ce080fbc89 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Returning 404 to user: Instance 02b5ae40-24a9-4b37-8920-8f32fd165dd8 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:58.919607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-070ad943-fc7b-4030-b2a0-b7ce080fbc89 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8" status: 404 len: 111 microversion: 2.1 time: 0.030349 Jul 20 04:13:58.919607 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 580/1118] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/servers/02b5ae40-24a9-4b37-8920-8f32fd165dd8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:58.919607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-643fc519-cad9-48b1-aa73-b308c37b9d27 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.919607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-643fc519-cad9-48b1-aa73-b308c37b9d27 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:58.930651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-643fc519-cad9-48b1-aa73-b308c37b9d27 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.931312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-643fc519-cad9-48b1-aa73-b308c37b9d27 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.932252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-643fc519-cad9-48b1-aa73-b308c37b9d27 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.932760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-643fc519-cad9-48b1-aa73-b308c37b9d27 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.170845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a6156ca8-0a84-4984-8189-dd9284486b7a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:59.179001 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a6156ca8-0a84-4984-8189-dd9284486b7a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1324 microversion: 2.1 time: 0.380572 Jul 20 04:13:59.188092 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 539/1119] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:59.190658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8b146fc8-7e2f-4b3c-9953-c4b199e86e3a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:59.191158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8b146fc8-7e2f-4b3c-9953-c4b199e86e3a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:59.198159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b146fc8-7e2f-4b3c-9953-c4b199e86e3a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.198607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b146fc8-7e2f-4b3c-9953-c4b199e86e3a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.199370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b146fc8-7e2f-4b3c-9953-c4b199e86e3a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.199838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b146fc8-7e2f-4b3c-9953-c4b199e86e3a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.215982 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-643fc519-cad9-48b1-aa73-b308c37b9d27 tempest-ServersOnMultiNodesTest-592521972 tempest-ServersOnMultiNodesTest-592521972-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1619 microversion: 2.1 time: 0.302049 Jul 20 04:13:59.216713 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 581/1120] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1619 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:59.221852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-85f79547-f24b-4f66-9693-3cf3af2deacd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:59.222742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-85f79547-f24b-4f66-9693-3cf3af2deacd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:59.226635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8b146fc8-7e2f-4b3c-9953-c4b199e86e3a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:59.231819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85f79547-f24b-4f66-9693-3cf3af2deacd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.232395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85f79547-f24b-4f66-9693-3cf3af2deacd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.233285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85f79547-f24b-4f66-9693-3cf3af2deacd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.233830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85f79547-f24b-4f66-9693-3cf3af2deacd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.309753 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8b146fc8-7e2f-4b3c-9953-c4b199e86e3a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 204 len: 0 microversion: 2.1 time: 0.128497 Jul 20 04:13:59.310575 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 540/1121] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:59 2022] DELETE /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:59.317677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2baede65-72ed-42aa-a050-92604a212ef2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:59.318428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2baede65-72ed-42aa-a050-92604a212ef2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:59.325219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2baede65-72ed-42aa-a050-92604a212ef2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.325671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2baede65-72ed-42aa-a050-92604a212ef2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.326446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2baede65-72ed-42aa-a050-92604a212ef2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.326885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2baede65-72ed-42aa-a050-92604a212ef2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.355359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2baede65-72ed-42aa-a050-92604a212ef2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:59.445409 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2baede65-72ed-42aa-a050-92604a212ef2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 204 len: 0 microversion: 2.1 time: 0.132640 Jul 20 04:13:59.448873 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 541/1122] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:59 2022] DELETE /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:59.454595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f626f283-dcf7-4258-80d9-76e36973cc60 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:59.455304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f626f283-dcf7-4258-80d9-76e36973cc60 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:59.463103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f626f283-dcf7-4258-80d9-76e36973cc60 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.463857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f626f283-dcf7-4258-80d9-76e36973cc60 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.464803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f626f283-dcf7-4258-80d9-76e36973cc60 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.465395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f626f283-dcf7-4258-80d9-76e36973cc60 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.473475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-85f79547-f24b-4f66-9693-3cf3af2deacd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:59.481724 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-85f79547-f24b-4f66-9693-3cf3af2deacd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.263174 Jul 20 04:13:59.483288 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 582/1123] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:59 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:59.488885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6b0c57e-9b17-4447-921e-e8006cc143c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:59.490022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c6b0c57e-9b17-4447-921e-e8006cc143c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:59.497578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6b0c57e-9b17-4447-921e-e8006cc143c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.498261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6b0c57e-9b17-4447-921e-e8006cc143c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.499212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6b0c57e-9b17-4447-921e-e8006cc143c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.499862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6b0c57e-9b17-4447-921e-e8006cc143c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.076949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f626f283-dcf7-4258-80d9-76e36973cc60 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.083384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c6b0c57e-9b17-4447-921e-e8006cc143c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.092914 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c6b0c57e-9b17-4447-921e-e8006cc143c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1471 microversion: 2.1 time: 0.607891 Jul 20 04:14:00.093801 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f626f283-dcf7-4258-80d9-76e36973cc60 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1472 microversion: 2.1 time: 0.646585 Jul 20 04:14:00.093980 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 583/1124] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:59 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1471 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:00.095107 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 542/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:59 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1472 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:00.098806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-26dd16db-12c6-49f1-9b17-f47e7c5bcc4d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.099771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-26dd16db-12c6-49f1-9b17-f47e7c5bcc4d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.111703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26dd16db-12c6-49f1-9b17-f47e7c5bcc4d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.112299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26dd16db-12c6-49f1-9b17-f47e7c5bcc4d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.113204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26dd16db-12c6-49f1-9b17-f47e7c5bcc4d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.113752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26dd16db-12c6-49f1-9b17-f47e7c5bcc4d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.115303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6b1d653f-bbfe-4415-843c-4b8c46a026e8 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.115980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6b1d653f-bbfe-4415-843c-4b8c46a026e8 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.127064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b1d653f-bbfe-4415-843c-4b8c46a026e8 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.128182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b1d653f-bbfe-4415-843c-4b8c46a026e8 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.129182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b1d653f-bbfe-4415-843c-4b8c46a026e8 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.129881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b1d653f-bbfe-4415-843c-4b8c46a026e8 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.314255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-26dd16db-12c6-49f1-9b17-f47e7c5bcc4d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.322318 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-26dd16db-12c6-49f1-9b17-f47e7c5bcc4d tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1472 microversion: 2.1 time: 0.227343 Jul 20 04:14:00.322908 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 584/1126] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:00.325249 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6b1d653f-bbfe-4415-843c-4b8c46a026e8 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1615 microversion: 2.1 time: 0.228858 Jul 20 04:14:00.335569 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 543/1127] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1615 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:00.335750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-63aaf52f-392b-4ddc-b847-a22015532091 req-b765e0d2-366e-4ef4-953b-8453a8a0a9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "956609f6-9ca2-4919-988a-2b0d4a740b26", "tag": "cdee7da2-445b-4334-89cc-1a24affa04ae"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:00.335888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ace403f0-2ba3-45a0-ac5e-0c064d552de6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.335888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ace403f0-2ba3-45a0-ac5e-0c064d552de6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.336229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-63aaf52f-392b-4ddc-b847-a22015532091 req-b765e0d2-366e-4ef4-953b-8453a8a0a9a4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.336681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-63aaf52f-392b-4ddc-b847-a22015532091 req-b765e0d2-366e-4ef4-953b-8453a8a0a9a4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.337847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ace403f0-2ba3-45a0-ac5e-0c064d552de6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.338360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ace403f0-2ba3-45a0-ac5e-0c064d552de6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.339192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ace403f0-2ba3-45a0-ac5e-0c064d552de6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.339744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ace403f0-2ba3-45a0-ac5e-0c064d552de6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.350610 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-63aaf52f-392b-4ddc-b847-a22015532091 req-b765e0d2-366e-4ef4-953b-8453a8a0a9a4 service nova] Creating event network-changed:cdee7da2-445b-4334-89cc-1a24affa04ae for instance 956609f6-9ca2-4919-988a-2b0d4a740b26 on n-h2-764485-11 Jul 20 04:14:00.355646 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-63aaf52f-392b-4ddc-b847-a22015532091 req-b765e0d2-366e-4ef4-953b-8453a8a0a9a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031604 Jul 20 04:14:00.356261 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 585/1128] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:00.361339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f34bd6b-dd94-4d43-93d3-5b07eb99579b tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:00.361999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1f34bd6b-dd94-4d43-93d3-5b07eb99579b tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.366290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:00.371435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f34bd6b-dd94-4d43-93d3-5b07eb99579b tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.371962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f34bd6b-dd94-4d43-93d3-5b07eb99579b tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.372751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f34bd6b-dd94-4d43-93d3-5b07eb99579b tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.373197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f34bd6b-dd94-4d43-93d3-5b07eb99579b tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.401285 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-1f34bd6b-dd94-4d43-93d3-5b07eb99579b tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] HTTP exception thrown: Cannot 'migrate' instance f5f729b8-7001-423b-88d7-42ff10001e4a while it is in vm_state suspended Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f34bd6b-dd94-4d43-93d3-5b07eb99579b tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Request method failure captured: Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a/action HTTP/1.1 Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 15 Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14DPL0GCvBlUfcq3yvDie1QGfVf50foYfJ2UaEBwGb2Zm3lwX4Md9yiHXIb3FzDo_mnWMRvTRDJRbcqZGveaG3tH_cu3-AO3CULrh5mWXeGp7xW1a5SvxS9e382hQj3OkSRHHysD9KMkTiKIM3C0YJw050dw54djn0BGwHPWPZPswns Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 24477abdf5434f5bab1d3cfbc8b9cfcf Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:14:00.402993 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_24477abdf5434f5bab1d3cfbc8b9cfcf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}] Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 24477abdf5434f5bab1d3cfbc8b9cfcf Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersAdminNegativeTestJSON-971466896-project-admin Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 03468c09883a4d73b118dc8852761e66 Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersAdminNegativeTestJSON-971466896-project-admin Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: {"migrate": {}} Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:00.404634 n-d-764485-11 devstack@n-api.service[119808]: exception: Cannot 'migrate' instance f5f729b8-7001-423b-88d7-42ff10001e4a while it is in vm_state suspended Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'f5f729b8-7001-423b-88d7-42ff10001e4a', 'body': {'migrate': {}}} Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f5f729b8-7001-423b-88d7-42ff10001e4a in vm_state suspended. Cannot resize while the instance is in this state. Jul 20 04:14:00.405592 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance f5f729b8-7001-423b-88d7-42ff10001e4a while it is in vm_state suspended Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.406986 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.408711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:00.408711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:00.408711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:00.408711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:00.408711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance f5f729b8-7001-423b-88d7-42ff10001e4a while it is in vm_state suspended Jul 20 04:14:00.408711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.408711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f34bd6b-dd94-4d43-93d3-5b07eb99579b tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Returning 409 to user: Cannot 'migrate' instance f5f729b8-7001-423b-88d7-42ff10001e4a while it is in vm_state suspended {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:00.408711 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f34bd6b-dd94-4d43-93d3-5b07eb99579b tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a/action" status: 409 len: 148 microversion: 2.1 time: 0.046999 Jul 20 04:14:00.408711 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 586/1129] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:00 2022] POST /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a/action => generated 148 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:00.417078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8abe8c93-adf6-4b72-89b1-2bf6f9ea1770 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8abe8c93-adf6-4b72-89b1-2bf6f9ea1770 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Request method failure captured: Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c/action HTTP/1.1 Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 39 Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14DPL0GCvBlUfcq3yvDie1QGfVf50foYfJ2UaEBwGb2Zm3lwX4Md9yiHXIb3FzDo_mnWMRvTRDJRbcqZGveaG3tH_cu3-AO3CULrh5mWXeGp7xW1a5SvxS9e382hQj3OkSRHHysD9KMkTiKIM3C0YJw050dw54djn0BGwHPWPZPswns Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 24477abdf5434f5bab1d3cfbc8b9cfcf Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:14:00.419431 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:14:00.420929 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_24477abdf5434f5bab1d3cfbc8b9cfcf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}] Jul 20 04:14:00.420929 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:14:00.420929 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 24477abdf5434f5bab1d3cfbc8b9cfcf Jul 20 04:14:00.420929 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:14:00.420929 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersAdminNegativeTestJSON-971466896-project-admin Jul 20 04:14:00.420929 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:00.420929 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:00.420929 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 03468c09883a4d73b118dc8852761e66 Jul 20 04:14:00.420929 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersAdminNegativeTestJSON-971466896-project-admin Jul 20 04:14:00.420929 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:14:00.420929 n-d-764485-11 devstack@n-api.service[119808]: {"os-resetState": {"state": "invalid"}} Jul 20 04:14:00.420929 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ec8bb6e1-5dc2-4370-9d9f-7156a11c451c', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:00.421848 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:14:00.424236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 04:14:00.426226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.426226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8abe8c93-adf6-4b72-89b1-2bf6f9ea1770 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:00.426226 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8abe8c93-adf6-4b72-89b1-2bf6f9ea1770 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c/action" status: 400 len: 144 microversion: 2.1 time: 0.008326 Jul 20 04:14:00.426226 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 587/1130] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:00 2022] POST /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c/action => generated 144 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:14:00.430448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14194a2e-0336-476b-883f-660423a8a058 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14194a2e-0336-476b-883f-660423a8a058 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Request method failure captured: Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c/action HTTP/1.1 Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 31 Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14DPL0GCvBlUfcq3yvDie1QGfVf50foYfJ2UaEBwGb2Zm3lwX4Md9yiHXIb3FzDo_mnWMRvTRDJRbcqZGveaG3tH_cu3-AO3CULrh5mWXeGp7xW1a5SvxS9e382hQj3OkSRHHysD9KMkTiKIM3C0YJw050dw54djn0BGwHPWPZPswns Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 24477abdf5434f5bab1d3cfbc8b9cfcf Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:14:00.432590 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_24477abdf5434f5bab1d3cfbc8b9cfcf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}] Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 24477abdf5434f5bab1d3cfbc8b9cfcf Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersAdminNegativeTestJSON-971466896-project-admin Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 03468c09883a4d73b118dc8852761e66 Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersAdminNegativeTestJSON-971466896-project-admin Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: {"os-resetState": {"state": 1}} Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:00.434173 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ec8bb6e1-5dc2-4370-9d9f-7156a11c451c', 'body': {'os-resetState': {'state': 1}}} Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 1 Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:00.435111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 04:14:00.437541 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.439187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14194a2e-0336-476b-883f-660423a8a058 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:00.439187 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-14194a2e-0336-476b-883f-660423a8a058 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c/action" status: 400 len: 120 microversion: 2.1 time: 0.007693 Jul 20 04:14:00.439187 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 588/1131] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:00 2022] POST /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c/action => generated 120 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:14:00.444614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a782fdc-9289-4ce8-aaf6-09eefdba5f88 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:00.445507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3a782fdc-9289-4ce8-aaf6-09eefdba5f88 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Failed to fetch instance by id 999 {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:14:00.446095 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-3a782fdc-9289-4ce8-aaf6-09eefdba5f88 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a782fdc-9289-4ce8-aaf6-09eefdba5f88 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Request method failure captured: Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 37 Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14DPL0GCvBlUfcq3yvDie1QGfVf50foYfJ2UaEBwGb2Zm3lwX4Md9yiHXIb3FzDo_mnWMRvTRDJRbcqZGveaG3tH_cu3-AO3CULrh5mWXeGp7xW1a5SvxS9e382hQj3OkSRHHysD9KMkTiKIM3C0YJw050dw54djn0BGwHPWPZPswns Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 24477abdf5434f5bab1d3cfbc8b9cfcf Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:14:00.447776 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_24477abdf5434f5bab1d3cfbc8b9cfcf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24477abdf5434f5bab1d3cfbc8b9cfcf"}]}] Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 24477abdf5434f5bab1d3cfbc8b9cfcf Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-971466896 Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersAdminNegativeTestJSON-971466896-project-admin Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 03468c09883a4d73b118dc8852761e66 Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersAdminNegativeTestJSON-971466896-project-admin Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: {"os-resetState": {"state": "error"}} Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:00.449390 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 999 could not be found. Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:00.450270 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a782fdc-9289-4ce8-aaf6-09eefdba5f88 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:00.452352 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a782fdc-9289-4ce8-aaf6-09eefdba5f88 tempest-ServersAdminNegativeTestJSON-971466896 tempest-ServersAdminNegativeTestJSON-971466896-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.008236 Jul 20 04:14:00.454218 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 589/1132] 10.222.0.20 () {60 vars in 1178 bytes} [Wed Jul 20 04:14:00 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:00.459059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1d7ef798-1760-482d-b1c1-5aa22fca4869 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.459704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1d7ef798-1760-482d-b1c1-5aa22fca4869 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.466479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d7ef798-1760-482d-b1c1-5aa22fca4869 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.466677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d7ef798-1760-482d-b1c1-5aa22fca4869 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.467754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d7ef798-1760-482d-b1c1-5aa22fca4869 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.468196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d7ef798-1760-482d-b1c1-5aa22fca4869 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.485221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ace403f0-2ba3-45a0-ac5e-0c064d552de6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.494582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1d7ef798-1760-482d-b1c1-5aa22fca4869 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:00.503782 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ace403f0-2ba3-45a0-ac5e-0c064d552de6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1324 microversion: 2.1 time: 0.166525 Jul 20 04:14:00.513260 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 544/1133] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1324 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:00.513260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b48a2ca4-e058-4d02-977d-a5a4a4502756 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.513260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b48a2ca4-e058-4d02-977d-a5a4a4502756 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.516812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b48a2ca4-e058-4d02-977d-a5a4a4502756 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.517374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b48a2ca4-e058-4d02-977d-a5a4a4502756 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.518538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b48a2ca4-e058-4d02-977d-a5a4a4502756 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.519332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b48a2ca4-e058-4d02-977d-a5a4a4502756 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.590225 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1d7ef798-1760-482d-b1c1-5aa22fca4869 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 204 len: 0 microversion: 2.1 time: 0.134632 Jul 20 04:14:00.591924 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 590/1134] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:00 2022] DELETE /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:00.601478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4ca6d19d-3e01-4d0d-a5a8-60426ad41887 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.602191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4ca6d19d-3e01-4d0d-a5a8-60426ad41887 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.608719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ca6d19d-3e01-4d0d-a5a8-60426ad41887 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.609169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ca6d19d-3e01-4d0d-a5a8-60426ad41887 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.609941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ca6d19d-3e01-4d0d-a5a8-60426ad41887 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.610375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ca6d19d-3e01-4d0d-a5a8-60426ad41887 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.627280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:00.741757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b48a2ca4-e058-4d02-977d-a5a4a4502756 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.749262 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b48a2ca4-e058-4d02-977d-a5a4a4502756 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.243513 Jul 20 04:14:00.749840 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 545/1135] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:00.777258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4ca6d19d-3e01-4d0d-a5a8-60426ad41887 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.784708 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4ca6d19d-3e01-4d0d-a5a8-60426ad41887 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1468 microversion: 2.1 time: 0.188453 Jul 20 04:14:00.785296 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 591/1136] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1468 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:01.110733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-669df946-50e9-4587-85d4-afba19383e4c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.110956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-82f86dd7-5530-451c-b253-235bb0fc8c9b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.111427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-669df946-50e9-4587-85d4-afba19383e4c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.111566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-82f86dd7-5530-451c-b253-235bb0fc8c9b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.117911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-669df946-50e9-4587-85d4-afba19383e4c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.118354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-669df946-50e9-4587-85d4-afba19383e4c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.118747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82f86dd7-5530-451c-b253-235bb0fc8c9b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.119112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-669df946-50e9-4587-85d4-afba19383e4c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.119214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82f86dd7-5530-451c-b253-235bb0fc8c9b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.119568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-669df946-50e9-4587-85d4-afba19383e4c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.119975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82f86dd7-5530-451c-b253-235bb0fc8c9b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.121611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82f86dd7-5530-451c-b253-235bb0fc8c9b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.315847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-669df946-50e9-4587-85d4-afba19383e4c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.319759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-82f86dd7-5530-451c-b253-235bb0fc8c9b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.319975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:01.324613 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-669df946-50e9-4587-85d4-afba19383e4c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1471 microversion: 2.1 time: 0.217707 Jul 20 04:14:01.325197 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 546/1137] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1471 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:01.327732 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-82f86dd7-5530-451c-b253-235bb0fc8c9b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1472 microversion: 2.1 time: 0.220784 Jul 20 04:14:01.328303 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 592/1138] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:01.338802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7ff65ba8-d442-4571-958d-a450c447fd1b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.339386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7ff65ba8-d442-4571-958d-a450c447fd1b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.346156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ff65ba8-d442-4571-958d-a450c447fd1b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.346603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ff65ba8-d442-4571-958d-a450c447fd1b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.347349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ff65ba8-d442-4571-958d-a450c447fd1b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.347814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ff65ba8-d442-4571-958d-a450c447fd1b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.477703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7ff65ba8-d442-4571-958d-a450c447fd1b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.485637 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7ff65ba8-d442-4571-958d-a450c447fd1b tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1472 microversion: 2.1 time: 0.150765 Jul 20 04:14:01.486206 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 547/1139] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1472 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:01.520805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bfe34dab-4cb0-4bf8-8e8d-b689e8d27ec6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.521906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bfe34dab-4cb0-4bf8-8e8d-b689e8d27ec6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.528036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfe34dab-4cb0-4bf8-8e8d-b689e8d27ec6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.528483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfe34dab-4cb0-4bf8-8e8d-b689e8d27ec6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.529247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfe34dab-4cb0-4bf8-8e8d-b689e8d27ec6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.529739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfe34dab-4cb0-4bf8-8e8d-b689e8d27ec6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.662901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bfe34dab-4cb0-4bf8-8e8d-b689e8d27ec6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.670809 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bfe34dab-4cb0-4bf8-8e8d-b689e8d27ec6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1324 microversion: 2.1 time: 0.153827 Jul 20 04:14:01.671388 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 593/1140] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1324 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:01.765988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4204c331-6211-4914-a460-4f3eb6a6e305 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.766604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4204c331-6211-4914-a460-4f3eb6a6e305 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.773164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4204c331-6211-4914-a460-4f3eb6a6e305 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.773910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4204c331-6211-4914-a460-4f3eb6a6e305 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.774694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4204c331-6211-4914-a460-4f3eb6a6e305 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.775135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4204c331-6211-4914-a460-4f3eb6a6e305 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.802572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3852fa96-20bb-484d-b8cc-669984a46a0c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.803683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3852fa96-20bb-484d-b8cc-669984a46a0c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.805408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=10 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:01.810792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3852fa96-20bb-484d-b8cc-669984a46a0c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.811244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3852fa96-20bb-484d-b8cc-669984a46a0c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.812046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3852fa96-20bb-484d-b8cc-669984a46a0c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.812483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3852fa96-20bb-484d-b8cc-669984a46a0c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.954072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4204c331-6211-4914-a460-4f3eb6a6e305 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.961682 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4204c331-6211-4914-a460-4f3eb6a6e305 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.199485 Jul 20 04:14:01.962361 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 548/1141] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:01.981374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3852fa96-20bb-484d-b8cc-669984a46a0c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.988769 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3852fa96-20bb-484d-b8cc-669984a46a0c tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1468 microversion: 2.1 time: 0.190554 Jul 20 04:14:01.989334 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 594/1142] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1468 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:02.343044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d98b87c5-7739-4c98-8f68-bcabd06fd889 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.344601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d98b87c5-7739-4c98-8f68-bcabd06fd889 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.344741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ba8a2285-e8b5-4187-8763-ddccefa6aada tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.345259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ba8a2285-e8b5-4187-8763-ddccefa6aada tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.353284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ba8a2285-e8b5-4187-8763-ddccefa6aada tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.353517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d98b87c5-7739-4c98-8f68-bcabd06fd889 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.353904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d98b87c5-7739-4c98-8f68-bcabd06fd889 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.354293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ba8a2285-e8b5-4187-8763-ddccefa6aada tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.354849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d98b87c5-7739-4c98-8f68-bcabd06fd889 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.355300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d98b87c5-7739-4c98-8f68-bcabd06fd889 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.355607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ba8a2285-e8b5-4187-8763-ddccefa6aada tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.356391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ba8a2285-e8b5-4187-8763-ddccefa6aada tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.565108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ba8a2285-e8b5-4187-8763-ddccefa6aada tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.572502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d98b87c5-7739-4c98-8f68-bcabd06fd889 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.573097 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ba8a2285-e8b5-4187-8763-ddccefa6aada tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1472 microversion: 2.1 time: 0.232536 Jul 20 04:14:02.573682 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 595/1143] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1472 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:02.580316 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d98b87c5-7739-4c98-8f68-bcabd06fd889 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1471 microversion: 2.1 time: 0.241458 Jul 20 04:14:02.580881 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 549/1144] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1471 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:02.588407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-05f3d24f-fb8c-48b8-b378-8c1093f232ab tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.589098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-05f3d24f-fb8c-48b8-b378-8c1093f232ab tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.595334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05f3d24f-fb8c-48b8-b378-8c1093f232ab tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.595815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05f3d24f-fb8c-48b8-b378-8c1093f232ab tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.596567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05f3d24f-fb8c-48b8-b378-8c1093f232ab tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.596998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05f3d24f-fb8c-48b8-b378-8c1093f232ab tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.688513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8ba9c35b-c467-4900-bd48-ddeb81568870 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.689120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8ba9c35b-c467-4900-bd48-ddeb81568870 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.695894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8ba9c35b-c467-4900-bd48-ddeb81568870 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.696339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8ba9c35b-c467-4900-bd48-ddeb81568870 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.697150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8ba9c35b-c467-4900-bd48-ddeb81568870 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.697582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8ba9c35b-c467-4900-bd48-ddeb81568870 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.731550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-05f3d24f-fb8c-48b8-b378-8c1093f232ab tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.739288 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-05f3d24f-fb8c-48b8-b378-8c1093f232ab tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1472 microversion: 2.1 time: 0.164454 Jul 20 04:14:02.740026 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 596/1145] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:02.860087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8ba9c35b-c467-4900-bd48-ddeb81568870 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.868763 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8ba9c35b-c467-4900-bd48-ddeb81568870 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1520 microversion: 2.1 time: 0.184060 Jul 20 04:14:02.869347 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 550/1146] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:02.885983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1b1a9533-4a49-4d5f-aa90-dfee6f21fc1c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.886623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1b1a9533-4a49-4d5f-aa90-dfee6f21fc1c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.892978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b1a9533-4a49-4d5f-aa90-dfee6f21fc1c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.893434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b1a9533-4a49-4d5f-aa90-dfee6f21fc1c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.894190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b1a9533-4a49-4d5f-aa90-dfee6f21fc1c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.894629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b1a9533-4a49-4d5f-aa90-dfee6f21fc1c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.979249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-56db54b9-098c-4df3-b6f5-750693fcacf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.979906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-56db54b9-098c-4df3-b6f5-750693fcacf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.981828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=12 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:02.988427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56db54b9-098c-4df3-b6f5-750693fcacf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.988880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56db54b9-098c-4df3-b6f5-750693fcacf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.989811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56db54b9-098c-4df3-b6f5-750693fcacf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.990368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56db54b9-098c-4df3-b6f5-750693fcacf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.014492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=18 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:03.301992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1b1a9533-4a49-4d5f-aa90-dfee6f21fc1c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.309541 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1b1a9533-4a49-4d5f-aa90-dfee6f21fc1c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1520 microversion: 2.1 time: 0.427393 Jul 20 04:14:03.310461 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 597/1147] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1520 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:03.315231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d1b2e672-3733-4b97-aaef-50fb414203d0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.315867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d1b2e672-3733-4b97-aaef-50fb414203d0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:03.322395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1b2e672-3733-4b97-aaef-50fb414203d0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.322849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1b2e672-3733-4b97-aaef-50fb414203d0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.323641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1b2e672-3733-4b97-aaef-50fb414203d0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.324081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1b2e672-3733-4b97-aaef-50fb414203d0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.401793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=14 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:03.428737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-56db54b9-098c-4df3-b6f5-750693fcacf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.436248 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-56db54b9-098c-4df3-b6f5-750693fcacf8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.460876 Jul 20 04:14:03.436857 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 551/1148] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:03.441608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2e272026-08a7-4286-ae82-4f1e27d1a123 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-88651355", "metadata": {"": ""}}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2e272026-08a7-4286-ae82-4f1e27d1a123 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action HTTP/1.1 Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 105 Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:03.445094 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:03.446618 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:14:03.446618 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:03.446618 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:14:03.446618 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:03.446618 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:14:03.446618 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:03.446618 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:03.446618 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:14:03.446618 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:14:03.446618 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:14:03.446618 n-d-764485-11 devstack@n-api.service[119807]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-88651355", "metadata": {"": ""}}} Jul 20 04:14:03.446618 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '0b03708f-1f01-49cb-9215-7c9dc75c3592', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-88651355', 'metadata': {'': ''}}}} Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'': ''} Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:03.448266 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:03.449610 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:03.450957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:03.450957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:03.450957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:14:03.450957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:14:03.450957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:14:03.450957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:03.450957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2e272026-08a7-4286-ae82-4f1e27d1a123 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:03.450957 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2e272026-08a7-4286-ae82-4f1e27d1a123 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action" status: 400 len: 170 microversion: 2.1 time: 0.008506 Jul 20 04:14:03.450957 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 552/1149] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Jul 20 04:14:03 2022] POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action => generated 170 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:14:03.455816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0649c143-73e5-45d9-a975-7e45a710db0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.456429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0649c143-73e5-45d9-a975-7e45a710db0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:03.464347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0649c143-73e5-45d9-a975-7e45a710db0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.464796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0649c143-73e5-45d9-a975-7e45a710db0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.465565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0649c143-73e5-45d9-a975-7e45a710db0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.466113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0649c143-73e5-45d9-a975-7e45a710db0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.695609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d1b2e672-3733-4b97-aaef-50fb414203d0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.703656 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d1b2e672-3733-4b97-aaef-50fb414203d0 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1468 microversion: 2.1 time: 0.392185 Jul 20 04:14:03.704486 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 598/1150] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1468 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:03.708865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88b2d2c1-44b6-4bce-94ca-0ff17d8fd958 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.709468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88b2d2c1-44b6-4bce-94ca-0ff17d8fd958 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:03.715660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88b2d2c1-44b6-4bce-94ca-0ff17d8fd958 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.716104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88b2d2c1-44b6-4bce-94ca-0ff17d8fd958 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.716861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88b2d2c1-44b6-4bce-94ca-0ff17d8fd958 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.717581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88b2d2c1-44b6-4bce-94ca-0ff17d8fd958 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.846314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0649c143-73e5-45d9-a975-7e45a710db0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.856489 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0649c143-73e5-45d9-a975-7e45a710db0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1520 microversion: 2.1 time: 0.405034 Jul 20 04:14:03.857074 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 553/1151] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:03.867645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-26b761d5-fd30-4211-bbca-0d2d2af02d34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.867645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-26b761d5-fd30-4211-bbca-0d2d2af02d34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:03.869046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26b761d5-fd30-4211-bbca-0d2d2af02d34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.869195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26b761d5-fd30-4211-bbca-0d2d2af02d34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.870279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26b761d5-fd30-4211-bbca-0d2d2af02d34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.870805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26b761d5-fd30-4211-bbca-0d2d2af02d34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.041025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88b2d2c1-44b6-4bce-94ca-0ff17d8fd958 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:04.050119 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88b2d2c1-44b6-4bce-94ca-0ff17d8fd958 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1472 microversion: 2.1 time: 0.344767 Jul 20 04:14:04.050627 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 599/1152] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1472 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:04.056022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a60a5a22-58ef-48dc-afda-d68c4f00a794 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.056639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a60a5a22-58ef-48dc-afda-d68c4f00a794 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:04.062565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a60a5a22-58ef-48dc-afda-d68c4f00a794 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.063015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a60a5a22-58ef-48dc-afda-d68c4f00a794 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.063814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a60a5a22-58ef-48dc-afda-d68c4f00a794 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.064251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a60a5a22-58ef-48dc-afda-d68c4f00a794 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.151077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-26b761d5-fd30-4211-bbca-0d2d2af02d34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:04.158983 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-26b761d5-fd30-4211-bbca-0d2d2af02d34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1471 microversion: 2.1 time: 0.300911 Jul 20 04:14:04.169431 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 554/1153] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1471 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:04.169431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-41ae530b-035b-4e07-9e83-3afe5175dfbd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.169431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-41ae530b-035b-4e07-9e83-3afe5175dfbd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:04.195272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41ae530b-035b-4e07-9e83-3afe5175dfbd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.195752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41ae530b-035b-4e07-9e83-3afe5175dfbd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.196536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41ae530b-035b-4e07-9e83-3afe5175dfbd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.196977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41ae530b-035b-4e07-9e83-3afe5175dfbd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.415601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a60a5a22-58ef-48dc-afda-d68c4f00a794 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:04.424241 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a60a5a22-58ef-48dc-afda-d68c4f00a794 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1472 microversion: 2.1 time: 0.371999 Jul 20 04:14:04.425814 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 600/1154] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:04 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1472 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:04.452163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-f3fb2444-dfae-4551-82e6-4bd9e6d4c587 req-bf0aa44e-6d03-42e1-8374-da3f4083023d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f729b8-7001-423b-88d7-42ff10001e4a", "name": "network-vif-deleted", "tag": "3ec24e9d-a1d9-4f7c-9bc3-e1b8748a4f54"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:04.462999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f3fb2444-dfae-4551-82e6-4bd9e6d4c587 req-bf0aa44e-6d03-42e1-8374-da3f4083023d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.463656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f3fb2444-dfae-4551-82e6-4bd9e6d4c587 req-bf0aa44e-6d03-42e1-8374-da3f4083023d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.483605 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f3fb2444-dfae-4551-82e6-4bd9e6d4c587 req-bf0aa44e-6d03-42e1-8374-da3f4083023d service nova] Creating event network-vif-deleted:3ec24e9d-a1d9-4f7c-9bc3-e1b8748a4f54 for instance f5f729b8-7001-423b-88d7-42ff10001e4a on n-h2-764485-11 Jul 20 04:14:04.494563 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-f3fb2444-dfae-4551-82e6-4bd9e6d4c587 req-bf0aa44e-6d03-42e1-8374-da3f4083023d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044816 Jul 20 04:14:04.495846 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 601/1155] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:04.504690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ca37d40b-ece8-411f-94ab-6eb388407d08 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.505967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca37d40b-ece8-411f-94ab-6eb388407d08 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:04.514029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca37d40b-ece8-411f-94ab-6eb388407d08 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.514792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca37d40b-ece8-411f-94ab-6eb388407d08 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.515795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca37d40b-ece8-411f-94ab-6eb388407d08 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.516689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca37d40b-ece8-411f-94ab-6eb388407d08 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.538009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-41ae530b-035b-4e07-9e83-3afe5175dfbd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:04.550351 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-41ae530b-035b-4e07-9e83-3afe5175dfbd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1520 microversion: 2.1 time: 0.389511 Jul 20 04:14:04.550962 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 555/1156] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:04 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:04.568738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-66db9df2-670f-48ee-b62f-ac31105dd018 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-929806096", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-66db9df2-670f-48ee-b62f-ac31105dd018 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action HTTP/1.1 Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 618 Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:04.571580 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:04.572923 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:14:04.572923 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:04.572923 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:14:04.572923 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:04.572923 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:14:04.572923 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:04.572923 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:04.572923 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:14:04.572923 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:14:04.572923 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:14:04.577054 n-d-764485-11 devstack@n-api.service[119807]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-929806096", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 20 04:14:04.577054 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:14:04.577054 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:14:04.577327 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '0b03708f-1f01-49cb-9215-7c9dc75c3592', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-929806096', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 20 04:14:04.577327 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:04.577327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:04.577327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:14:04.577327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:14:04.577327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:14:04.577327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:14:04.577327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:14:04.577327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:04.577327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 20 04:14:04.577327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:04.578106 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:04.580043 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:04.580043 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:14:04.580043 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:14:04.580043 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:14:04.580043 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:14:04.580043 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:14:04.580043 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:14:04.580043 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:14:04.580043 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:04.580043 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:04.580043 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:04.580043 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:04.581618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:04.581618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:04.581618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:14:04.581618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:14:04.581618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:14:04.581618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:04.582355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-66db9df2-670f-48ee-b62f-ac31105dd018 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:04.582355 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-66db9df2-670f-48ee-b62f-ac31105dd018 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action" status: 400 len: 938 microversion: 2.1 time: 0.009057 Jul 20 04:14:04.582355 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 556/1157] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Jul 20 04:14:04 2022] POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action => generated 938 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:14:04.585245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc46c868-c7be-4220-941f-aad30ab688d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.585951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc46c868-c7be-4220-941f-aad30ab688d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:04.594423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc46c868-c7be-4220-941f-aad30ab688d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.594720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc46c868-c7be-4220-941f-aad30ab688d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.595746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc46c868-c7be-4220-941f-aad30ab688d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.596451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc46c868-c7be-4220-941f-aad30ab688d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.870380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ca37d40b-ece8-411f-94ab-6eb388407d08 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:04.877134 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ca37d40b-ece8-411f-94ab-6eb388407d08 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.379605 Jul 20 04:14:04.877938 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 602/1158] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:04 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:04.890972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db0a749c-0785-40f4-bfb3-4dc618c27215 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.892323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-db0a749c-0785-40f4-bfb3-4dc618c27215 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:04.900614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db0a749c-0785-40f4-bfb3-4dc618c27215 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.901364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db0a749c-0785-40f4-bfb3-4dc618c27215 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.902519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db0a749c-0785-40f4-bfb3-4dc618c27215 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.902963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db0a749c-0785-40f4-bfb3-4dc618c27215 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.903409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fc46c868-c7be-4220-941f-aad30ab688d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:04.912354 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc46c868-c7be-4220-941f-aad30ab688d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1520 microversion: 2.1 time: 0.333965 Jul 20 04:14:04.913708 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 557/1159] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:04 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:04.930532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-613083dc-eb15-4067-907d-eb5439af9666 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.931149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-613083dc-eb15-4067-907d-eb5439af9666 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:04.938406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-613083dc-eb15-4067-907d-eb5439af9666 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.938910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-613083dc-eb15-4067-907d-eb5439af9666 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.939788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-613083dc-eb15-4067-907d-eb5439af9666 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.940226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-613083dc-eb15-4067-907d-eb5439af9666 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.009623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-db0a749c-0785-40f4-bfb3-4dc618c27215 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.017529 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-db0a749c-0785-40f4-bfb3-4dc618c27215 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1426 microversion: 2.1 time: 0.138790 Jul 20 04:14:05.018394 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 603/1160] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:04 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1426 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:05.068783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aba6176f-47e6-4b18-9f1f-9d6a99349d7c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.069404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aba6176f-47e6-4b18-9f1f-9d6a99349d7c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.076811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aba6176f-47e6-4b18-9f1f-9d6a99349d7c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.077549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aba6176f-47e6-4b18-9f1f-9d6a99349d7c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.079138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aba6176f-47e6-4b18-9f1f-9d6a99349d7c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.079764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aba6176f-47e6-4b18-9f1f-9d6a99349d7c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.176589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aba6176f-47e6-4b18-9f1f-9d6a99349d7c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.192035 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aba6176f-47e6-4b18-9f1f-9d6a99349d7c tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1430 microversion: 2.1 time: 0.127837 Jul 20 04:14:05.194020 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 604/1161] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:05 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1430 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:05.204204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15c5ba4d-fe2b-4bd4-b7f9-8c40562caeba tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.205562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-15c5ba4d-fe2b-4bd4-b7f9-8c40562caeba tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.215583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15c5ba4d-fe2b-4bd4-b7f9-8c40562caeba tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.216213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15c5ba4d-fe2b-4bd4-b7f9-8c40562caeba tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.217144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15c5ba4d-fe2b-4bd4-b7f9-8c40562caeba tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.217992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15c5ba4d-fe2b-4bd4-b7f9-8c40562caeba tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.264955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-613083dc-eb15-4067-907d-eb5439af9666 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.273991 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-613083dc-eb15-4067-907d-eb5439af9666 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1520 microversion: 2.1 time: 0.347948 Jul 20 04:14:05.284047 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 558/1162] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:04 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:05.300836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6e77febe-1c49-47d2-ace4-a6ff95e8e0c3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6e77febe-1c49-47d2-ace4-a6ff95e8e0c3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action HTTP/1.1 Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 285 Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:05.303794 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:05.305397 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:14:05.305397 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:05.305397 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:14:05.305397 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:05.305397 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:14:05.305397 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:05.305397 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:05.305397 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:14:05.305397 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:14:05.305397 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:14:05.305397 n-d-764485-11 devstack@n-api.service[119807]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 04:14:05.306335 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:14:05.306335 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:14:05.306335 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '0b03708f-1f01-49cb-9215-7c9dc75c3592', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 04:14:05.306335 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:05.306335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:05.306335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:14:05.306335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:14:05.306335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:14:05.306335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:14:05.306335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:14:05.307186 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:14:05.308665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:14:05.309602 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:14:05.309602 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.310451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6e77febe-1c49-47d2-ace4-a6ff95e8e0c3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:05.311302 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6e77febe-1c49-47d2-ace4-a6ff95e8e0c3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action" status: 400 len: 619 microversion: 2.1 time: 0.014656 Jul 20 04:14:05.311907 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 559/1163] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Jul 20 04:14:05 2022] POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:14:05.316875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-917dd900-4ad7-4626-aab2-ec76d3635dc6 req-cb874da1-99d2-4660-be3c-ee4ef0f63eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a", "name": "network-vif-deleted", "tag": "843dc3e4-010a-405c-9273-4b23321754bf"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:05.326854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-917dd900-4ad7-4626-aab2-ec76d3635dc6 req-cb874da1-99d2-4660-be3c-ee4ef0f63eee service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.327460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-917dd900-4ad7-4626-aab2-ec76d3635dc6 req-cb874da1-99d2-4660-be3c-ee4ef0f63eee service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.338570 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-917dd900-4ad7-4626-aab2-ec76d3635dc6 req-cb874da1-99d2-4660-be3c-ee4ef0f63eee service nova] Creating event network-vif-deleted:843dc3e4-010a-405c-9273-4b23321754bf for instance 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a on n-h1-764485-11 Jul 20 04:14:05.344545 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-917dd900-4ad7-4626-aab2-ec76d3635dc6 req-cb874da1-99d2-4660-be3c-ee4ef0f63eee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 Jul 20 04:14:05.345714 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 560/1164] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:05.351942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f0bf4754-b8e5-4f0c-8e4e-e1503ad370d6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.352732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f0bf4754-b8e5-4f0c-8e4e-e1503ad370d6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.359159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0bf4754-b8e5-4f0c-8e4e-e1503ad370d6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.359733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0bf4754-b8e5-4f0c-8e4e-e1503ad370d6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.360625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0bf4754-b8e5-4f0c-8e4e-e1503ad370d6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.361119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0bf4754-b8e5-4f0c-8e4e-e1503ad370d6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.406273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-15c5ba4d-fe2b-4bd4-b7f9-8c40562caeba tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.417898 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-15c5ba4d-fe2b-4bd4-b7f9-8c40562caeba tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1477 microversion: 2.1 time: 0.222347 Jul 20 04:14:05.423240 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 605/1165] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:05 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1477 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:05.441912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b35ae3a1-036d-476d-b12f-784b50829950 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.443075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b35ae3a1-036d-476d-b12f-784b50829950 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.449981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b35ae3a1-036d-476d-b12f-784b50829950 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.450766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b35ae3a1-036d-476d-b12f-784b50829950 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.451715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b35ae3a1-036d-476d-b12f-784b50829950 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.452079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b35ae3a1-036d-476d-b12f-784b50829950 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.535891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b35ae3a1-036d-476d-b12f-784b50829950 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.543968 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b35ae3a1-036d-476d-b12f-784b50829950 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1430 microversion: 2.1 time: 0.105836 Jul 20 04:14:05.544560 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 606/1166] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:05 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1430 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:05.558372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f0bf4754-b8e5-4f0c-8e4e-e1503ad370d6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.566349 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f0bf4754-b8e5-4f0c-8e4e-e1503ad370d6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1520 microversion: 2.1 time: 0.219131 Jul 20 04:14:05.566809 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 561/1167] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:05 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:05.589064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e20e68e8-0c73-4a6e-a145-933ceda64789 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.589829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e20e68e8-0c73-4a6e-a145-933ceda64789 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.596635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e20e68e8-0c73-4a6e-a145-933ceda64789 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.597180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e20e68e8-0c73-4a6e-a145-933ceda64789 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.598048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e20e68e8-0c73-4a6e-a145-933ceda64789 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.598568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e20e68e8-0c73-4a6e-a145-933ceda64789 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.736058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e20e68e8-0c73-4a6e-a145-933ceda64789 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.744744 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e20e68e8-0c73-4a6e-a145-933ceda64789 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1520 microversion: 2.1 time: 0.160189 Jul 20 04:14:05.745640 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 607/1168] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:05 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:05.762178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d621a37b-5d91-4d26-8688-c9d469ad0be8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1080902828"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:05.765982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d621a37b-5d91-4d26-8688-c9d469ad0be8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.773219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d621a37b-5d91-4d26-8688-c9d469ad0be8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.773676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d621a37b-5d91-4d26-8688-c9d469ad0be8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.774467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d621a37b-5d91-4d26-8688-c9d469ad0be8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.774914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d621a37b-5d91-4d26-8688-c9d469ad0be8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.894059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0643e25b-4c11-4747-bcfc-b1fee57066d8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.894671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0643e25b-4c11-4747-bcfc-b1fee57066d8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.901590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0643e25b-4c11-4747-bcfc-b1fee57066d8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.902046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0643e25b-4c11-4747-bcfc-b1fee57066d8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.902817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0643e25b-4c11-4747-bcfc-b1fee57066d8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.903259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0643e25b-4c11-4747-bcfc-b1fee57066d8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.061390 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d621a37b-5d91-4d26-8688-c9d469ad0be8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action" status: 202 len: 0 microversion: 2.1 time: 0.302931 Jul 20 04:14:06.062061 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 562/1169] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:05 2022] POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:14:06.067165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d5237604-26a3-4315-af45-57fa1aa468a1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:06.068504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d5237604-26a3-4315-af45-57fa1aa468a1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:06.075177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5237604-26a3-4315-af45-57fa1aa468a1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.075665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5237604-26a3-4315-af45-57fa1aa468a1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.076470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5237604-26a3-4315-af45-57fa1aa468a1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.076899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5237604-26a3-4315-af45-57fa1aa468a1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.280670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d5237604-26a3-4315-af45-57fa1aa468a1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.289231 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d5237604-26a3-4315-af45-57fa1aa468a1 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1426 microversion: 2.1 time: 0.226006 Jul 20 04:14:06.289828 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 563/1170] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:06 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1426 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:06.294464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-115cd512-73b5-4d5c-8a08-02a236fdab0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-682951920"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:06.295567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-115cd512-73b5-4d5c-8a08-02a236fdab0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:06.301529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-115cd512-73b5-4d5c-8a08-02a236fdab0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.303024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-115cd512-73b5-4d5c-8a08-02a236fdab0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.303953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-115cd512-73b5-4d5c-8a08-02a236fdab0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.304400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-115cd512-73b5-4d5c-8a08-02a236fdab0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.326242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0643e25b-4c11-4747-bcfc-b1fee57066d8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.328564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:06.335243 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-115cd512-73b5-4d5c-8a08-02a236fdab0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] HTTP exception thrown: Cannot 'createImage' instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 while it is in task_state image_snapshot_pending Jul 20 04:14:06.335428 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0643e25b-4c11-4747-bcfc-b1fee57066d8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.445028 Jul 20 04:14:06.345204 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 608/1171] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:05 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-115cd512-73b5-4d5c-8a08-02a236fdab0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action HTTP/1.1 Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 84 Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:06.345391 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:06.346900 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:14:06.346900 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:06.346900 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:14:06.346900 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:06.346900 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:14:06.346900 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:06.346900 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:06.346900 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:14:06.346900 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:14:06.346900 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:14:06.346900 n-d-764485-11 devstack@n-api.service[119807]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-682951920"}} Jul 20 04:14:06.346900 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: exception: Cannot 'createImage' instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 while it is in task_state image_snapshot_pending Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '0b03708f-1f01-49cb-9215-7c9dc75c3592', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-682951920'}}} Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:06.347809 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 while it is in task_state image_snapshot_pending Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 while it is in task_state image_snapshot_pending Jul 20 04:14:06.349776 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:06.351164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-115cd512-73b5-4d5c-8a08-02a236fdab0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 409 to user: Cannot 'createImage' instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 while it is in task_state image_snapshot_pending {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:06.351164 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-115cd512-73b5-4d5c-8a08-02a236fdab0c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action" status: 409 len: 167 microversion: 2.1 time: 0.047583 Jul 20 04:14:06.351164 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 564/1172] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:06 2022] POST /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592/action => generated 167 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:06.351416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-47088c7f-b2a0-453a-97b7-4feb958debf4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:06.351416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-47088c7f-b2a0-453a-97b7-4feb958debf4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:06.351416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47088c7f-b2a0-453a-97b7-4feb958debf4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.351698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f8f61572-ed80-4e7a-857b-31e9b81a337d tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '.version_select at 0x7fbf9d65ab80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:06.351803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47088c7f-b2a0-453a-97b7-4feb958debf4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.351803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47088c7f-b2a0-453a-97b7-4feb958debf4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.351803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47088c7f-b2a0-453a-97b7-4feb958debf4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.412035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-47088c7f-b2a0-453a-97b7-4feb958debf4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.419690 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-47088c7f-b2a0-453a-97b7-4feb958debf4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1430 microversion: 2.1 time: 0.082745 Jul 20 04:14:06.420280 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 609/1173] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:06 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1430 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:06.437507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9e39b2f2-4f8e-4d7c-ab13-c97eb707e356 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:06.438122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9e39b2f2-4f8e-4d7c-ab13-c97eb707e356 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:06.444692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e39b2f2-4f8e-4d7c-ab13-c97eb707e356 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.445092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e39b2f2-4f8e-4d7c-ab13-c97eb707e356 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.445841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e39b2f2-4f8e-4d7c-ab13-c97eb707e356 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.446305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e39b2f2-4f8e-4d7c-ab13-c97eb707e356 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.465382 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f8f61572-ed80-4e7a-857b-31e9b81a337d tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "DELETE /compute/v2.1/images/cbb5a175-505c-4529-9bad-0782f1f8e14d" status: 204 len: 0 microversion: 2.1 time: 0.121790 Jul 20 04:14:06.465955 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 565/1174] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:06 2022] DELETE /compute/v2.1/images/cbb5a175-505c-4529-9bad-0782f1f8e14d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:14:06.474357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e40f78e6-ab7e-4379-95e2-7e3014983dad tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:06.474979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e40f78e6-ab7e-4379-95e2-7e3014983dad tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:06.481499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e40f78e6-ab7e-4379-95e2-7e3014983dad tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.481958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e40f78e6-ab7e-4379-95e2-7e3014983dad tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.483013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e40f78e6-ab7e-4379-95e2-7e3014983dad tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.483481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e40f78e6-ab7e-4379-95e2-7e3014983dad tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.638629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e39b2f2-4f8e-4d7c-ab13-c97eb707e356 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.648038 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9e39b2f2-4f8e-4d7c-ab13-c97eb707e356 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1477 microversion: 2.1 time: 0.214246 Jul 20 04:14:06.648703 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 610/1175] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:06 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:06.654042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-5c0c66f3-8500-454d-89ee-648ec19ad6b2 req-9025ddd8-0421-4230-81fa-8d551cf9f782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec531648-d3ee-43c8-8fda-89ae7282e4ef", "name": "network-vif-deleted", "tag": "cbfa0b20-ec79-4d11-a450-6d6c8705b3b2"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:06.662713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5c0c66f3-8500-454d-89ee-648ec19ad6b2 req-9025ddd8-0421-4230-81fa-8d551cf9f782 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.663167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5c0c66f3-8500-454d-89ee-648ec19ad6b2 req-9025ddd8-0421-4230-81fa-8d551cf9f782 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.668664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e40f78e6-ab7e-4379-95e2-7e3014983dad tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.671052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:06.675065 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-5c0c66f3-8500-454d-89ee-648ec19ad6b2 req-9025ddd8-0421-4230-81fa-8d551cf9f782 service nova] Creating event network-vif-deleted:cbfa0b20-ec79-4d11-a450-6d6c8705b3b2 for instance ec531648-d3ee-43c8-8fda-89ae7282e4ef on n-h1-764485-11 Jul 20 04:14:06.679245 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e40f78e6-ab7e-4379-95e2-7e3014983dad tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1540 microversion: 2.1 time: 0.208828 Jul 20 04:14:06.679929 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 566/1176] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:06 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1540 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:06.681370 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-5c0c66f3-8500-454d-89ee-648ec19ad6b2 req-9025ddd8-0421-4230-81fa-8d551cf9f782 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030916 Jul 20 04:14:06.682261 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 611/1177] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:06.686139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c15c2986-78a8-4b99-bf9e-3ec6b28f96f2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:06.686748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c15c2986-78a8-4b99-bf9e-3ec6b28f96f2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:06.694043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c15c2986-78a8-4b99-bf9e-3ec6b28f96f2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.694501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c15c2986-78a8-4b99-bf9e-3ec6b28f96f2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.695313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c15c2986-78a8-4b99-bf9e-3ec6b28f96f2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.695722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c15c2986-78a8-4b99-bf9e-3ec6b28f96f2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.759823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c15c2986-78a8-4b99-bf9e-3ec6b28f96f2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.767197 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c15c2986-78a8-4b99-bf9e-3ec6b28f96f2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1430 microversion: 2.1 time: 0.086130 Jul 20 04:14:06.767788 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 567/1178] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:06 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1430 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:07.308357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6facebbf-900f-41ba-9f90-c4c5581bbcb5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.311028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6facebbf-900f-41ba-9f90-c4c5581bbcb5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:07.319536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6facebbf-900f-41ba-9f90-c4c5581bbcb5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.320679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6facebbf-900f-41ba-9f90-c4c5581bbcb5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.321471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6facebbf-900f-41ba-9f90-c4c5581bbcb5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.321909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6facebbf-900f-41ba-9f90-c4c5581bbcb5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.355162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-735113fe-dbf4-44d4-8aa1-a8cbbc2a6e4c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.356196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-735113fe-dbf4-44d4-8aa1-a8cbbc2a6e4c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:07.362616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-735113fe-dbf4-44d4-8aa1-a8cbbc2a6e4c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.363415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-735113fe-dbf4-44d4-8aa1-a8cbbc2a6e4c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.364340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-735113fe-dbf4-44d4-8aa1-a8cbbc2a6e4c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.365283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-735113fe-dbf4-44d4-8aa1-a8cbbc2a6e4c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.406817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6facebbf-900f-41ba-9f90-c4c5581bbcb5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.417189 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6facebbf-900f-41ba-9f90-c4c5581bbcb5 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 200 len: 1298 microversion: 2.1 time: 0.113333 Jul 20 04:14:07.417799 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 612/1179] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:07.440568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9797b649-2b93-4198-9aec-e957fb0f083d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.442067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9797b649-2b93-4198-9aec-e957fb0f083d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:07.451239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9797b649-2b93-4198-9aec-e957fb0f083d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.452037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9797b649-2b93-4198-9aec-e957fb0f083d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.452996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9797b649-2b93-4198-9aec-e957fb0f083d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.453443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9797b649-2b93-4198-9aec-e957fb0f083d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.540457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9797b649-2b93-4198-9aec-e957fb0f083d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.548488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-735113fe-dbf4-44d4-8aa1-a8cbbc2a6e4c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.551453 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9797b649-2b93-4198-9aec-e957fb0f083d tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1430 microversion: 2.1 time: 0.118256 Jul 20 04:14:07.553196 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 613/1180] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1430 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:07.557895 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-735113fe-dbf4-44d4-8aa1-a8cbbc2a6e4c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.207855 Jul 20 04:14:07.559948 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 568/1181] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:07.665928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0c6d97a-d57b-496a-aabd-de8af7e5f9fd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.666544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b0c6d97a-d57b-496a-aabd-de8af7e5f9fd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:07.672727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0c6d97a-d57b-496a-aabd-de8af7e5f9fd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.673173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0c6d97a-d57b-496a-aabd-de8af7e5f9fd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.673950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0c6d97a-d57b-496a-aabd-de8af7e5f9fd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.674383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0c6d97a-d57b-496a-aabd-de8af7e5f9fd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.698789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ab92825-db26-47f3-8ca4-21393d2efaaf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.699396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ab92825-db26-47f3-8ca4-21393d2efaaf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:07.705478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ab92825-db26-47f3-8ca4-21393d2efaaf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.705995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ab92825-db26-47f3-8ca4-21393d2efaaf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.706845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ab92825-db26-47f3-8ca4-21393d2efaaf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.707342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ab92825-db26-47f3-8ca4-21393d2efaaf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.856355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b0c6d97a-d57b-496a-aabd-de8af7e5f9fd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.863982 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b0c6d97a-d57b-496a-aabd-de8af7e5f9fd tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1477 microversion: 2.1 time: 0.202646 Jul 20 04:14:07.864676 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 614/1182] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1477 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:07.869326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a47fa7ac-51f2-4bd7-a39c-729342f01c8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.869963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a47fa7ac-51f2-4bd7-a39c-729342f01c8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:07.875825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a47fa7ac-51f2-4bd7-a39c-729342f01c8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.876270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a47fa7ac-51f2-4bd7-a39c-729342f01c8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.877035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a47fa7ac-51f2-4bd7-a39c-729342f01c8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.877469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a47fa7ac-51f2-4bd7-a39c-729342f01c8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.883299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1ab92825-db26-47f3-8ca4-21393d2efaaf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.890769 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ab92825-db26-47f3-8ca4-21393d2efaaf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1532 microversion: 2.1 time: 0.195874 Jul 20 04:14:07.891431 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 569/1183] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1532 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:07.941992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a47fa7ac-51f2-4bd7-a39c-729342f01c8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.950454 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a47fa7ac-51f2-4bd7-a39c-729342f01c8f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1430 microversion: 2.1 time: 0.084691 Jul 20 04:14:07.951003 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 615/1184] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1430 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:08.434547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-231a4fb5-bea5-446d-8c36-af2c5da82478 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.435151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-231a4fb5-bea5-446d-8c36-af2c5da82478 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: f5f729b8-7001-423b-88d7-42ff10001e4a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.437524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:08.442635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-231a4fb5-bea5-446d-8c36-af2c5da82478 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.443248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-231a4fb5-bea5-446d-8c36-af2c5da82478 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.444042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-231a4fb5-bea5-446d-8c36-af2c5da82478 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.444481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-231a4fb5-bea5-446d-8c36-af2c5da82478 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.459393 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-231a4fb5-bea5-446d-8c36-af2c5da82478 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] HTTP exception thrown: Instance f5f729b8-7001-423b-88d7-42ff10001e4a could not be found. Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-231a4fb5-bea5-446d-8c36-af2c5da82478 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Request method failure captured: Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a HTTP/1.1 Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14DOJFzatfImLJ01gEudmxOaKVpmlhoSh-UIJwTR0TQF2kfjgE8fWAJb8XtgTMGuLgsdvmWAtabngO24HPksAluHiyl1yb0ZjNrTMYhSlVN8Z4kT_Dp5nlKrBuwvxxCeB2llVcrmpXu_2p3xvBYJHwm2vRCElAMNIc6Hg4-dvOMONsw Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: daa85be80057484a8e47c9ff76efc2c8 Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-654906269 Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:08.460922 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:08.462296 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/daa85be80057484a8e47c9ff76efc2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/daa85be80057484a8e47c9ff76efc2c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_daa85be80057484a8e47c9ff76efc2c8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/daa85be80057484a8e47c9ff76efc2c8"}]}] Jul 20 04:14:08.462296 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersAdminNegativeTestJSON-654906269 Jul 20 04:14:08.462296 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: daa85be80057484a8e47c9ff76efc2c8 Jul 20 04:14:08.462296 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-654906269 Jul 20 04:14:08.462296 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersAdminNegativeTestJSON-654906269-project Jul 20 04:14:08.462296 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:08.462296 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:08.462296 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: f64c988993bd4107a8ba5103c143385d Jul 20 04:14:08.462296 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersAdminNegativeTestJSON-654906269-project Jul 20 04:14:08.462296 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:14:08.462296 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance f5f729b8-7001-423b-88d7-42ff10001e4a could not be found. Jul 20 04:14:08.462296 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'f5f729b8-7001-423b-88d7-42ff10001e4a'} Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f729b8-7001-423b-88d7-42ff10001e4a could not be found. Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:08.463113 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f729b8-7001-423b-88d7-42ff10001e4a could not be found. Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f729b8-7001-423b-88d7-42ff10001e4a could not be found. Jul 20 04:14:08.464492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:08.465780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-231a4fb5-bea5-446d-8c36-af2c5da82478 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Returning 404 to user: Instance f5f729b8-7001-423b-88d7-42ff10001e4a could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:08.465780 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-231a4fb5-bea5-446d-8c36-af2c5da82478 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a" status: 404 len: 111 microversion: 2.1 time: 0.032307 Jul 20 04:14:08.465780 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 570/1185] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:08 2022] GET /compute/v2.1/servers/f5f729b8-7001-423b-88d7-42ff10001e4a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:08.471855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bfa7edd2-8365-4ac7-b687-c8a3f30d1672 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.472326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bfa7edd2-8365-4ac7-b687-c8a3f30d1672 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.479288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfa7edd2-8365-4ac7-b687-c8a3f30d1672 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.479814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfa7edd2-8365-4ac7-b687-c8a3f30d1672 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.480570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfa7edd2-8365-4ac7-b687-c8a3f30d1672 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.481004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfa7edd2-8365-4ac7-b687-c8a3f30d1672 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.505951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bfa7edd2-8365-4ac7-b687-c8a3f30d1672 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:08.575347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c158f782-9b6b-4757-bb31-1e0346c247ba tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.576517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c158f782-9b6b-4757-bb31-1e0346c247ba tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.585300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c158f782-9b6b-4757-bb31-1e0346c247ba tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.585653 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bfa7edd2-8365-4ac7-b687-c8a3f30d1672 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 204 len: 0 microversion: 2.1 time: 0.117347 Jul 20 04:14:08.586269 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 616/1186] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:08 2022] DELETE /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:08.586657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c158f782-9b6b-4757-bb31-1e0346c247ba tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.587813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c158f782-9b6b-4757-bb31-1e0346c247ba tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.588615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c158f782-9b6b-4757-bb31-1e0346c247ba tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.591690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7603dc07-3feb-4103-968b-e33cbdc498a4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.592675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7603dc07-3feb-4103-968b-e33cbdc498a4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.600414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7603dc07-3feb-4103-968b-e33cbdc498a4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.601087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7603dc07-3feb-4103-968b-e33cbdc498a4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.602391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7603dc07-3feb-4103-968b-e33cbdc498a4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.602836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7603dc07-3feb-4103-968b-e33cbdc498a4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.629566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c158f782-9b6b-4757-bb31-1e0346c247ba tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.630053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c158f782-9b6b-4757-bb31-1e0346c247ba tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.630900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-c158f782-9b6b-4757-bb31-1e0346c247ba tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lazy-loading 'fault' on Instance uuid ec531648-d3ee-43c8-8fda-89ae7282e4ef {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:08.685637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c158f782-9b6b-4757-bb31-1e0346c247ba tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:08.693450 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c158f782-9b6b-4757-bb31-1e0346c247ba tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1307 microversion: 2.1 time: 0.122635 Jul 20 04:14:08.703453 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 571/1187] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:08 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1307 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:08.703453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-617a0b85-3c5b-44ab-a1ed-732c35569cae tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.703453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-617a0b85-3c5b-44ab-a1ed-732c35569cae tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.704953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-617a0b85-3c5b-44ab-a1ed-732c35569cae tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.705407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-617a0b85-3c5b-44ab-a1ed-732c35569cae tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.706176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-617a0b85-3c5b-44ab-a1ed-732c35569cae tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.706613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-617a0b85-3c5b-44ab-a1ed-732c35569cae tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.818140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7603dc07-3feb-4103-968b-e33cbdc498a4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:08.825792 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7603dc07-3feb-4103-968b-e33cbdc498a4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.238341 Jul 20 04:14:08.836005 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 617/1188] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:08 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:08.877163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-617a0b85-3c5b-44ab-a1ed-732c35569cae tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:08.884238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e05e0ca0-2616-4e0a-bda3-61076bf7e4f3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.884855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e05e0ca0-2616-4e0a-bda3-61076bf7e4f3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.886116 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-617a0b85-3c5b-44ab-a1ed-732c35569cae tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1478 microversion: 2.1 time: 0.191054 Jul 20 04:14:08.886745 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 572/1189] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:08 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1478 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:08.897616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e05e0ca0-2616-4e0a-bda3-61076bf7e4f3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.898067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e05e0ca0-2616-4e0a-bda3-61076bf7e4f3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.898837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e05e0ca0-2616-4e0a-bda3-61076bf7e4f3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.899272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e05e0ca0-2616-4e0a-bda3-61076bf7e4f3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.910083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2688c5cb-aefa-4e04-bb4c-d8744a203a0b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.910774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2688c5cb-aefa-4e04-bb4c-d8744a203a0b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.919251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2688c5cb-aefa-4e04-bb4c-d8744a203a0b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.919855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2688c5cb-aefa-4e04-bb4c-d8744a203a0b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.920866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2688c5cb-aefa-4e04-bb4c-d8744a203a0b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.921502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2688c5cb-aefa-4e04-bb4c-d8744a203a0b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.106643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e05e0ca0-2616-4e0a-bda3-61076bf7e4f3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.114152 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e05e0ca0-2616-4e0a-bda3-61076bf7e4f3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1477 microversion: 2.1 time: 0.233822 Jul 20 04:14:09.121534 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 618/1190] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:08 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:09.121534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-78706feb-aada-4162-9aff-0ee04a14d5e5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.121965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2688c5cb-aefa-4e04-bb4c-d8744a203a0b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.122098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-78706feb-aada-4162-9aff-0ee04a14d5e5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:09.126109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78706feb-aada-4162-9aff-0ee04a14d5e5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.126597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78706feb-aada-4162-9aff-0ee04a14d5e5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.127371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78706feb-aada-4162-9aff-0ee04a14d5e5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.127866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78706feb-aada-4162-9aff-0ee04a14d5e5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.128677 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2688c5cb-aefa-4e04-bb4c-d8744a203a0b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1532 microversion: 2.1 time: 0.223651 Jul 20 04:14:09.129253 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 573/1191] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:08 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1532 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:09.165838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78706feb-aada-4162-9aff-0ee04a14d5e5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.166290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78706feb-aada-4162-9aff-0ee04a14d5e5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.167041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-78706feb-aada-4162-9aff-0ee04a14d5e5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lazy-loading 'fault' on Instance uuid 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:09.213065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-78706feb-aada-4162-9aff-0ee04a14d5e5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.221028 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-78706feb-aada-4162-9aff-0ee04a14d5e5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 200 len: 1306 microversion: 2.1 time: 0.105161 Jul 20 04:14:09.221603 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 619/1192] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:09.711066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a1078f8f-e345-4c11-87ac-c19b034a8a13 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.711788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a1078f8f-e345-4c11-87ac-c19b034a8a13 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:09.718773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1078f8f-e345-4c11-87ac-c19b034a8a13 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.719227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1078f8f-e345-4c11-87ac-c19b034a8a13 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.720027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1078f8f-e345-4c11-87ac-c19b034a8a13 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.720470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1078f8f-e345-4c11-87ac-c19b034a8a13 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.750938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1078f8f-e345-4c11-87ac-c19b034a8a13 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.751385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1078f8f-e345-4c11-87ac-c19b034a8a13 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.751862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-a1078f8f-e345-4c11-87ac-c19b034a8a13 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lazy-loading 'fault' on Instance uuid ec531648-d3ee-43c8-8fda-89ae7282e4ef {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:09.792590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a1078f8f-e345-4c11-87ac-c19b034a8a13 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17824778e95f4fd1afb0a3c679b9be7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd02283590e49b8a869ff0f94f2884a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.800023 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a1078f8f-e345-4c11-87ac-c19b034a8a13 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 200 len: 1307 microversion: 2.1 time: 0.093070 Jul 20 04:14:09.800594 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 574/1193] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:09.842950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1cd351ed-b3fe-43e3-a521-3d1dcb7841c6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.843607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1cd351ed-b3fe-43e3-a521-3d1dcb7841c6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:09.851673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cd351ed-b3fe-43e3-a521-3d1dcb7841c6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.852125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cd351ed-b3fe-43e3-a521-3d1dcb7841c6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.852889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cd351ed-b3fe-43e3-a521-3d1dcb7841c6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.853328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cd351ed-b3fe-43e3-a521-3d1dcb7841c6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.903522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-93a620c0-b288-45f6-bf1f-955ca187e929 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.904136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-93a620c0-b288-45f6-bf1f-955ca187e929 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:09.910057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93a620c0-b288-45f6-bf1f-955ca187e929 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.910512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93a620c0-b288-45f6-bf1f-955ca187e929 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.911918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93a620c0-b288-45f6-bf1f-955ca187e929 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.912270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93a620c0-b288-45f6-bf1f-955ca187e929 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.030250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1cd351ed-b3fe-43e3-a521-3d1dcb7841c6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:10.038976 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1cd351ed-b3fe-43e3-a521-3d1dcb7841c6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.199981 Jul 20 04:14:10.039582 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 620/1194] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:10.075748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-93a620c0-b288-45f6-bf1f-955ca187e929 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:10.083389 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-93a620c0-b288-45f6-bf1f-955ca187e929 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1478 microversion: 2.1 time: 0.183494 Jul 20 04:14:10.084183 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 575/1195] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1478 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:10.132193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8626b67d-250f-422f-8248-ef4997d0c0c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.132922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8626b67d-250f-422f-8248-ef4997d0c0c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.140054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8626b67d-250f-422f-8248-ef4997d0c0c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.140586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8626b67d-250f-422f-8248-ef4997d0c0c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.141442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8626b67d-250f-422f-8248-ef4997d0c0c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.141939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8626b67d-250f-422f-8248-ef4997d0c0c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.147281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ffe4f546-c2a3-412a-894c-2ecd3cf14574 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.148210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ffe4f546-c2a3-412a-894c-2ecd3cf14574 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.154630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffe4f546-c2a3-412a-894c-2ecd3cf14574 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.155081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffe4f546-c2a3-412a-894c-2ecd3cf14574 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.155893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffe4f546-c2a3-412a-894c-2ecd3cf14574 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.156331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffe4f546-c2a3-412a-894c-2ecd3cf14574 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.373905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8626b67d-250f-422f-8248-ef4997d0c0c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:10.382101 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8626b67d-250f-422f-8248-ef4997d0c0c9 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1477 microversion: 2.1 time: 0.254367 Jul 20 04:14:10.383028 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 621/1196] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:10 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1477 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:10.385218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ffe4f546-c2a3-412a-894c-2ecd3cf14574 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:10.392766 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ffe4f546-c2a3-412a-894c-2ecd3cf14574 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1538 microversion: 2.1 time: 0.250476 Jul 20 04:14:10.393325 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 576/1197] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:10 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1538 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:10.394269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9ccd2c67-244a-4fb1-b45a-e4f3ac79a1e0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.394928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9ccd2c67-244a-4fb1-b45a-e4f3ac79a1e0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.401659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ccd2c67-244a-4fb1-b45a-e4f3ac79a1e0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.402114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ccd2c67-244a-4fb1-b45a-e4f3ac79a1e0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.402886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ccd2c67-244a-4fb1-b45a-e4f3ac79a1e0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.403325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ccd2c67-244a-4fb1-b45a-e4f3ac79a1e0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.417294 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-9ccd2c67-244a-4fb1-b45a-e4f3ac79a1e0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] HTTP exception thrown: Instance 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a could not be found. Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9ccd2c67-244a-4fb1-b45a-e4f3ac79a1e0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Request method failure captured: Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a HTTP/1.1 Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BonZlQ2CRDfzy6JrdRaenVAP-bduTz2PxNs1mEGbtKMzvT-dul-9gf5wGDHb6-Ja3TZF-9wwGwHGzbe7xYytuKZ9ZEwl5liwrF5viKSArG_B5Iy_1d92vxWXWEjPLijtdray9LRHIdMdb-s1LiPXCMilU7o988KC_mdB6zGGRpmqU Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:10.418932 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:10.420460 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d46b20455b6a4fc39ff3676f6ce1b801", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}] Jul 20 04:14:10.420460 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:10.420460 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:10.420460 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:10.420460 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:10.420460 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:10.420460 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:10.420460 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 5b0144f0f8694ba4b177c86a768a25e9 Jul 20 04:14:10.420460 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:10.420460 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:10.420460 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a could not be found. Jul 20 04:14:10.420460 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a'} Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a could not be found. Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:10.421385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a could not be found. Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a could not be found. Jul 20 04:14:10.422896 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.424325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9ccd2c67-244a-4fb1-b45a-e4f3ac79a1e0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Returning 404 to user: Instance 6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:10.424325 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9ccd2c67-244a-4fb1-b45a-e4f3ac79a1e0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a" status: 404 len: 111 microversion: 2.1 time: 0.029907 Jul 20 04:14:10.424325 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 622/1198] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:10 2022] GET /compute/v2.1/servers/6f9970c7-1d20-4eab-9bd9-8c3e5810fb4a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:10.428887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-09535448-0058-4afc-98e4-38b36cef61ff tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.429392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-09535448-0058-4afc-98e4-38b36cef61ff tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.435353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-09535448-0058-4afc-98e4-38b36cef61ff tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.435841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-09535448-0058-4afc-98e4-38b36cef61ff tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.436611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-09535448-0058-4afc-98e4-38b36cef61ff tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.437055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-09535448-0058-4afc-98e4-38b36cef61ff tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.461878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-09535448-0058-4afc-98e4-38b36cef61ff tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:10.543307 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-09535448-0058-4afc-98e4-38b36cef61ff tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 204 len: 0 microversion: 2.1 time: 0.117876 Jul 20 04:14:10.543832 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 577/1199] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:10 2022] DELETE /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:10.551979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-18850af1-85e5-477a-85e1-efd751025a88 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.552658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-18850af1-85e5-477a-85e1-efd751025a88 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.559107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18850af1-85e5-477a-85e1-efd751025a88 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.559576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18850af1-85e5-477a-85e1-efd751025a88 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.560337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18850af1-85e5-477a-85e1-efd751025a88 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.560769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18850af1-85e5-477a-85e1-efd751025a88 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.700693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-18850af1-85e5-477a-85e1-efd751025a88 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:10.709492 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-18850af1-85e5-477a-85e1-efd751025a88 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1473 microversion: 2.1 time: 0.161224 Jul 20 04:14:10.710411 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 623/1200] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:10 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1473 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:10.819590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8d35bfe3-537e-4f1d-bdc0-ea61f44428a4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.820305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8d35bfe3-537e-4f1d-bdc0-ea61f44428a4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] [instance: ec531648-d3ee-43c8-8fda-89ae7282e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.827275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d35bfe3-537e-4f1d-bdc0-ea61f44428a4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.827758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d35bfe3-537e-4f1d-bdc0-ea61f44428a4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.828531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d35bfe3-537e-4f1d-bdc0-ea61f44428a4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.828966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d35bfe3-537e-4f1d-bdc0-ea61f44428a4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.843885 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-8d35bfe3-537e-4f1d-bdc0-ea61f44428a4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] HTTP exception thrown: Instance ec531648-d3ee-43c8-8fda-89ae7282e4ef could not be found. Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8d35bfe3-537e-4f1d-bdc0-ea61f44428a4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Request method failure captured: Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef HTTP/1.1 Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BkHsrromwNNQxZUp4hxHdTA8hqqNdyGaPImiGaI8og4t9zG5SYFAchGxMojLlY4W5AfPU9goQ7MhxXRccrlz3yJevDZgYKXyOTEqDQn9cfo0tXftSsoCsR9Tfin9zfdRJQW2MWCfNZlf6lxEGxuEoi4NSibHlOWaC5xmEclQ7cLvo Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 9dd02283590e49b8a869ff0f94f2884a Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ListImageFiltersTestJSON-94699728 Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:10.845508 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:10.847015 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9dd02283590e49b8a869ff0f94f2884a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dd02283590e49b8a869ff0f94f2884a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9dd02283590e49b8a869ff0f94f2884a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9dd02283590e49b8a869ff0f94f2884a"}]}] Jul 20 04:14:10.847015 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ListImageFiltersTestJSON-94699728 Jul 20 04:14:10.847015 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 9dd02283590e49b8a869ff0f94f2884a Jul 20 04:14:10.847015 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-94699728 Jul 20 04:14:10.847015 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ListImageFiltersTestJSON-94699728-project Jul 20 04:14:10.847015 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:10.847015 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:10.847015 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 17824778e95f4fd1afb0a3c679b9be7f Jul 20 04:14:10.847015 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ListImageFiltersTestJSON-94699728-project Jul 20 04:14:10.847015 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:14:10.847015 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance ec531648-d3ee-43c8-8fda-89ae7282e4ef could not be found. Jul 20 04:14:10.847015 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'ec531648-d3ee-43c8-8fda-89ae7282e4ef'} Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec531648-d3ee-43c8-8fda-89ae7282e4ef could not be found. Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:10.852127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec531648-d3ee-43c8-8fda-89ae7282e4ef could not be found. Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec531648-d3ee-43c8-8fda-89ae7282e4ef could not be found. Jul 20 04:14:10.854187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.855422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8d35bfe3-537e-4f1d-bdc0-ea61f44428a4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Returning 404 to user: Instance ec531648-d3ee-43c8-8fda-89ae7282e4ef could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:10.855422 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8d35bfe3-537e-4f1d-bdc0-ea61f44428a4 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef" status: 404 len: 111 microversion: 2.1 time: 0.032923 Jul 20 04:14:10.855422 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 578/1201] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:10 2022] GET /compute/v2.1/servers/ec531648-d3ee-43c8-8fda-89ae7282e4ef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:10.861706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-50ba75e7-bd0d-4a12-a377-1d861c27f21b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d57ef70>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.930175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0b093043-a494-460f-bd55-d9c4af5d5825 req-d056e268-1806-4d91-879a-3dbf0f39d72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42b8c28-e93e-471e-b549-5718883dc7b6", "name": "network-vif-plugged", "status": "completed", "tag": "4266796f-8098-40de-be9c-26d7b872b741"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:10.941225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0b093043-a494-460f-bd55-d9c4af5d5825 req-d056e268-1806-4d91-879a-3dbf0f39d72a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.941693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0b093043-a494-460f-bd55-d9c4af5d5825 req-d056e268-1806-4d91-879a-3dbf0f39d72a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.957469 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0b093043-a494-460f-bd55-d9c4af5d5825 req-d056e268-1806-4d91-879a-3dbf0f39d72a service nova] Creating event network-vif-plugged:4266796f-8098-40de-be9c-26d7b872b741 for instance c42b8c28-e93e-471e-b549-5718883dc7b6 on n-h1-764485-11 Jul 20 04:14:10.964185 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0b093043-a494-460f-bd55-d9c4af5d5825 req-d056e268-1806-4d91-879a-3dbf0f39d72a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041937 Jul 20 04:14:10.965083 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 579/1202] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:11.057096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9943e71-dba2-40af-a7bf-c2b49731637f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.057878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b9943e71-dba2-40af-a7bf-c2b49731637f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.064356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9943e71-dba2-40af-a7bf-c2b49731637f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.064735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9943e71-dba2-40af-a7bf-c2b49731637f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.065489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9943e71-dba2-40af-a7bf-c2b49731637f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.065998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9943e71-dba2-40af-a7bf-c2b49731637f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.100310 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-50ba75e7-bd0d-4a12-a377-1d861c27f21b tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "DELETE /compute/v2.1/images/47390548-7f3e-40b6-bedc-e9cd7c80100a" status: 204 len: 0 microversion: 2.1 time: 0.246037 Jul 20 04:14:11.101133 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 624/1203] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:10 2022] DELETE /compute/v2.1/images/47390548-7f3e-40b6-bedc-e9cd7c80100a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:11.105691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2bce96de-b514-4df2-af65-87cf8bd0b520 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.106307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2bce96de-b514-4df2-af65-87cf8bd0b520 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.115529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2bce96de-b514-4df2-af65-87cf8bd0b520 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.115994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2bce96de-b514-4df2-af65-87cf8bd0b520 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.116799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2bce96de-b514-4df2-af65-87cf8bd0b520 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.117234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2bce96de-b514-4df2-af65-87cf8bd0b520 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.255811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9943e71-dba2-40af-a7bf-c2b49731637f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.266210 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b9943e71-dba2-40af-a7bf-c2b49731637f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.214157 Jul 20 04:14:11.269317 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 580/1204] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:11 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:11.275453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f72fe26e-8755-45c2-9fd2-e9bfd957700a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9d61b310>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.284644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2bce96de-b514-4df2-af65-87cf8bd0b520 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.288288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:11.304643 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2bce96de-b514-4df2-af65-87cf8bd0b520 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1478 microversion: 2.1 time: 0.202446 Jul 20 04:14:11.305810 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 625/1205] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:11 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1478 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:11.401929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c84846a9-9a6b-47bd-9cba-3da4a0d2bd69 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.403151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c84846a9-9a6b-47bd-9cba-3da4a0d2bd69 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.413524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c84846a9-9a6b-47bd-9cba-3da4a0d2bd69 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.413983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c84846a9-9a6b-47bd-9cba-3da4a0d2bd69 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.414771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c84846a9-9a6b-47bd-9cba-3da4a0d2bd69 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.415623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c84846a9-9a6b-47bd-9cba-3da4a0d2bd69 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.534969 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f72fe26e-8755-45c2-9fd2-e9bfd957700a tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "DELETE /compute/v2.1/images/827708cb-c9ec-4d88-9734-f1e84f99c64a" status: 204 len: 0 microversion: 2.1 time: 0.264307 Jul 20 04:14:11.536493 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 581/1206] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:11 2022] DELETE /compute/v2.1/images/827708cb-c9ec-4d88-9734-f1e84f99c64a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:11.542288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0b99aa1-8718-4118-97fe-6e2971e60418 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.542912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b0b99aa1-8718-4118-97fe-6e2971e60418 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.550981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0b99aa1-8718-4118-97fe-6e2971e60418 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.551448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0b99aa1-8718-4118-97fe-6e2971e60418 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.553620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0b99aa1-8718-4118-97fe-6e2971e60418 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.554817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0b99aa1-8718-4118-97fe-6e2971e60418 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.611503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c84846a9-9a6b-47bd-9cba-3da4a0d2bd69 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.620049 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c84846a9-9a6b-47bd-9cba-3da4a0d2bd69 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1477 microversion: 2.1 time: 0.224349 Jul 20 04:14:11.620962 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 626/1207] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:11 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1477 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:11.626046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04433f5b-58c3-4216-84de-5cf5a5c23cc2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] Calling method '.version_select at 0x7fbf9ddde8b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.737380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b0b99aa1-8718-4118-97fe-6e2971e60418 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.746204 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0b99aa1-8718-4118-97fe-6e2971e60418 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1538 microversion: 2.1 time: 0.208054 Jul 20 04:14:11.746999 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 582/1208] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:11 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1538 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:11.752290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-449b9530-6e05-445b-9f8c-ed0f73088d04 req-daafe033-fb5e-4744-9c45-5c296164f544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8bb6e1-5dc2-4370-9d9f-7156a11c451c", "name": "network-vif-deleted", "tag": "607e04b7-5a1e-4f94-8b73-8315d16912cd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:11.760767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-449b9530-6e05-445b-9f8c-ed0f73088d04 req-daafe033-fb5e-4744-9c45-5c296164f544 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.761201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-449b9530-6e05-445b-9f8c-ed0f73088d04 req-daafe033-fb5e-4744-9c45-5c296164f544 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.772736 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-449b9530-6e05-445b-9f8c-ed0f73088d04 req-daafe033-fb5e-4744-9c45-5c296164f544 service nova] Creating event network-vif-deleted:607e04b7-5a1e-4f94-8b73-8315d16912cd for instance ec8bb6e1-5dc2-4370-9d9f-7156a11c451c on n-h1-764485-11 Jul 20 04:14:11.777705 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-449b9530-6e05-445b-9f8c-ed0f73088d04 req-daafe033-fb5e-4744-9c45-5c296164f544 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029041 Jul 20 04:14:11.778425 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 583/1209] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:11.786657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-03c5c17e-6065-4b01-9498-63479fe895d6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.787251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-03c5c17e-6065-4b01-9498-63479fe895d6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.794074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03c5c17e-6065-4b01-9498-63479fe895d6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.794602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03c5c17e-6065-4b01-9498-63479fe895d6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.795464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03c5c17e-6065-4b01-9498-63479fe895d6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.796056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03c5c17e-6065-4b01-9498-63479fe895d6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.902035 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-04433f5b-58c3-4216-84de-5cf5a5c23cc2 tempest-ListImageFiltersTestJSON-94699728 tempest-ListImageFiltersTestJSON-94699728-project] 10.222.0.20 "DELETE /compute/v2.1/images/c4be3b05-f993-4f22-9f45-7ad275f8093e" status: 204 len: 0 microversion: 2.1 time: 0.280006 Jul 20 04:14:11.906988 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 627/1210] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:11 2022] DELETE /compute/v2.1/images/c4be3b05-f993-4f22-9f45-7ad275f8093e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:11.954913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-03c5c17e-6065-4b01-9498-63479fe895d6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.959402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:11.971297 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-03c5c17e-6065-4b01-9498-63479fe895d6 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1473 microversion: 2.1 time: 0.189103 Jul 20 04:14:11.972352 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 584/1211] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:11 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1473 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:12.285768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52730643-10c7-4b14-9063-53e8a7b59474 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:12.287153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52730643-10c7-4b14-9063-53e8a7b59474 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:12.293264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52730643-10c7-4b14-9063-53e8a7b59474 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.293722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52730643-10c7-4b14-9063-53e8a7b59474 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.294491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52730643-10c7-4b14-9063-53e8a7b59474 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.294927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52730643-10c7-4b14-9063-53e8a7b59474 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.322381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e384cef0-761d-4c2e-8ad0-b8ce01f3654a tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:12.323274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e384cef0-761d-4c2e-8ad0-b8ce01f3654a tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:12.330303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e384cef0-761d-4c2e-8ad0-b8ce01f3654a tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.330749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e384cef0-761d-4c2e-8ad0-b8ce01f3654a tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.331534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e384cef0-761d-4c2e-8ad0-b8ce01f3654a tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.331976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e384cef0-761d-4c2e-8ad0-b8ce01f3654a tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.364050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e384cef0-761d-4c2e-8ad0-b8ce01f3654a tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.364652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e384cef0-761d-4c2e-8ad0-b8ce01f3654a tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.365222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-e384cef0-761d-4c2e-8ad0-b8ce01f3654a tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lazy-loading 'fault' on Instance uuid ec8bb6e1-5dc2-4370-9d9f-7156a11c451c {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:12.436380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e384cef0-761d-4c2e-8ad0-b8ce01f3654a tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64c988993bd4107a8ba5103c143385d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa85be80057484a8e47c9ff76efc2c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:12.444810 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e384cef0-761d-4c2e-8ad0-b8ce01f3654a tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 200 len: 1312 microversion: 2.1 time: 0.126222 Jul 20 04:14:12.445482 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 585/1212] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:12 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 1312 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:12.500602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52730643-10c7-4b14-9063-53e8a7b59474 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:12.508427 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52730643-10c7-4b14-9063-53e8a7b59474 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.226479 Jul 20 04:14:12.509189 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 628/1213] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:12 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:12.637496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-da171417-6e52-4e7f-aee5-be67efd7f1e5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:12.638116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-da171417-6e52-4e7f-aee5-be67efd7f1e5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:12.644271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da171417-6e52-4e7f-aee5-be67efd7f1e5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.645034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da171417-6e52-4e7f-aee5-be67efd7f1e5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.646495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da171417-6e52-4e7f-aee5-be67efd7f1e5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.647111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da171417-6e52-4e7f-aee5-be67efd7f1e5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.763795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-25888637-7262-4fcb-bdbc-70d2801dba62 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:12.764340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-25888637-7262-4fcb-bdbc-70d2801dba62 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:12.771846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25888637-7262-4fcb-bdbc-70d2801dba62 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.772301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25888637-7262-4fcb-bdbc-70d2801dba62 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.773801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25888637-7262-4fcb-bdbc-70d2801dba62 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.774572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25888637-7262-4fcb-bdbc-70d2801dba62 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.784681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-da171417-6e52-4e7f-aee5-be67efd7f1e5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:12.793992 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-da171417-6e52-4e7f-aee5-be67efd7f1e5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1477 microversion: 2.1 time: 0.160417 Jul 20 04:14:12.794587 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 586/1214] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:12 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1477 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:12.917232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-25888637-7262-4fcb-bdbc-70d2801dba62 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:12.927358 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-25888637-7262-4fcb-bdbc-70d2801dba62 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1538 microversion: 2.1 time: 0.167009 Jul 20 04:14:12.927773 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 629/1215] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:12 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1538 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:12.988822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b787b000-42a1-44e7-90ad-96a1e163d931 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:12.990117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b787b000-42a1-44e7-90ad-96a1e163d931 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:12.997007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b787b000-42a1-44e7-90ad-96a1e163d931 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.997473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b787b000-42a1-44e7-90ad-96a1e163d931 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.998458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b787b000-42a1-44e7-90ad-96a1e163d931 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.999018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b787b000-42a1-44e7-90ad-96a1e163d931 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.258894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b787b000-42a1-44e7-90ad-96a1e163d931 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:13.268510 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b787b000-42a1-44e7-90ad-96a1e163d931 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1473 microversion: 2.1 time: 0.283448 Jul 20 04:14:13.270353 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 587/1216] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:12 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1473 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:13.416746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7246b7de-2ec4-4c6b-a04b-fabe842f7296 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Action: 'create', calling method: .version_select at 0x7fbf9d547a60>, body: {"keypair": {"name": "tempest-keypair-1526273204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdKfhffyuqqZ6PppAfrTQ/TpmrNFVOkYrD4t3D7MMSKbfr4G8q8R0ncPFFAO3IiXTdlFsq2L7lhxfWOO7K4viXkDYdb3Z9VXPq4tpsJNcErzv6GYH59PUqBoV+5toC7Ag=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:13.431920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-7246b7de-2ec4-4c6b-a04b-fabe842f7296 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:13.437145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-7246b7de-2ec4-4c6b-a04b-fabe842f7296 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for user 81ee5f4bbc9f42b5bab588429940a69e and project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:13.447360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:13.462183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f5e52680-9347-40f5-8610-ee4cec3d8e11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:13.462794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f5e52680-9347-40f5-8610-ee4cec3d8e11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] [instance: ec8bb6e1-5dc2-4370-9d9f-7156a11c451c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:13.472704 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7246b7de-2ec4-4c6b-a04b-fabe842f7296 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.175795 Jul 20 04:14:13.472704 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 630/1217] 10.222.0.20 () {62 vars in 1198 bytes} [Wed Jul 20 04:14:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:14:13.475853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5e52680-9347-40f5-8610-ee4cec3d8e11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.476312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5e52680-9347-40f5-8610-ee4cec3d8e11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.477092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5e52680-9347-40f5-8610-ee4cec3d8e11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.477535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5e52680-9347-40f5-8610-ee4cec3d8e11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.482548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7c1372ae-0342-432c-afc6-b1be199bf1ef tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9d5b6040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:13.488596 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7c1372ae-0342-432c-afc6-b1be199bf1ef tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1526273204" status: 200 len: 512 microversion: 2.2 time: 0.011093 Jul 20 04:14:13.495010 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 631/1218] 10.222.0.20 () {60 vars in 1257 bytes} [Wed Jul 20 04:14:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1526273204 => generated 512 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:13.495160 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f5e52680-9347-40f5-8610-ee4cec3d8e11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] HTTP exception thrown: Instance ec8bb6e1-5dc2-4370-9d9f-7156a11c451c could not be found. Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f5e52680-9347-40f5-8610-ee4cec3d8e11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Request method failure captured: Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c HTTP/1.1 Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14DOJFzatfImLJ01gEudmxOaKVpmlhoSh-UIJwTR0TQF2kfjgE8fWAJb8XtgTMGuLgsdvmWAtabngO24HPksAluHiyl1yb0ZjNrTMYhSlVN8Z4kT_Dp5nlKrBuwvxxCeB2llVcrmpXu_2p3xvBYJHwm2vRCElAMNIc6Hg4-dvOMONsw Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: daa85be80057484a8e47c9ff76efc2c8 Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-654906269 Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:13.496088 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:13.497391 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/daa85be80057484a8e47c9ff76efc2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/daa85be80057484a8e47c9ff76efc2c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_daa85be80057484a8e47c9ff76efc2c8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/daa85be80057484a8e47c9ff76efc2c8"}]}] Jul 20 04:14:13.497391 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersAdminNegativeTestJSON-654906269 Jul 20 04:14:13.497391 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: daa85be80057484a8e47c9ff76efc2c8 Jul 20 04:14:13.497391 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-654906269 Jul 20 04:14:13.497391 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersAdminNegativeTestJSON-654906269-project Jul 20 04:14:13.497391 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:13.497391 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:13.497391 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: f64c988993bd4107a8ba5103c143385d Jul 20 04:14:13.497391 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersAdminNegativeTestJSON-654906269-project Jul 20 04:14:13.497391 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:14:13.497391 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance ec8bb6e1-5dc2-4370-9d9f-7156a11c451c could not be found. Jul 20 04:14:13.497391 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'ec8bb6e1-5dc2-4370-9d9f-7156a11c451c'} Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec8bb6e1-5dc2-4370-9d9f-7156a11c451c could not be found. Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:13.498194 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec8bb6e1-5dc2-4370-9d9f-7156a11c451c could not be found. Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec8bb6e1-5dc2-4370-9d9f-7156a11c451c could not be found. Jul 20 04:14:13.500459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:13.501586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f5e52680-9347-40f5-8610-ee4cec3d8e11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] Returning 404 to user: Instance ec8bb6e1-5dc2-4370-9d9f-7156a11c451c could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:13.501586 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f5e52680-9347-40f5-8610-ee4cec3d8e11 tempest-ServersAdminNegativeTestJSON-654906269 tempest-ServersAdminNegativeTestJSON-654906269-project] 10.222.0.20 "GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c" status: 404 len: 111 microversion: 2.1 time: 0.040222 Jul 20 04:14:13.501586 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 588/1219] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:13 2022] GET /compute/v2.1/servers/ec8bb6e1-5dc2-4370-9d9f-7156a11c451c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:13.501795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88c155eb-7434-439b-acc5-5b73d1ef7024 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9d50f0d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:13.525948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6c9fee5-205a-47fd-9600-d9ae3ea90026 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:13.525948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a6c9fee5-205a-47fd-9600-d9ae3ea90026 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:13.528306 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88c155eb-7434-439b-acc5-5b73d1ef7024 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526273204" status: 204 len: 0 microversion: 2.2 time: 0.031824 Jul 20 04:14:13.529517 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 632/1220] 10.222.0.20 () {60 vars in 1260 bytes} [Wed Jul 20 04:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526273204 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:14:13.532012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6c9fee5-205a-47fd-9600-d9ae3ea90026 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.532446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6c9fee5-205a-47fd-9600-d9ae3ea90026 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.533208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6c9fee5-205a-47fd-9600-d9ae3ea90026 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.533641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6c9fee5-205a-47fd-9600-d9ae3ea90026 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.542217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57ce1ab7-257a-4b71-9286-b4ed0c68c811 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Action: 'create', calling method: .version_select at 0x7fbf9d50f700>, body: {"keypair": {"name": "tempest-keypair-898658157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZHydhBvxlJo1IUAr4r82JmOgrJ/uPOD3g+w+bSEnK5Y7VK4jkcz6T8Is3lr5pEOclUsjOsCpMeKHeYzDXLtohtPOBfvC3Qjl9e/50KpB6mBZFp+3dosCAjrUjWTzndGA=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:13.558292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-57ce1ab7-257a-4b71-9286-b4ed0c68c811 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:13.566436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-57ce1ab7-257a-4b71-9286-b4ed0c68c811 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for user 81ee5f4bbc9f42b5bab588429940a69e and project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:13.592798 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57ce1ab7-257a-4b71-9286-b4ed0c68c811 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.055158 Jul 20 04:14:13.593417 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 633/1221] 10.222.0.20 () {62 vars in 1198 bytes} [Wed Jul 20 04:14:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:14:13.603949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d0a7521e-b7f5-4832-b817-ea71975ffc2b tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9d5650d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:13.623210 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d0a7521e-b7f5-4832-b817-ea71975ffc2b tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-898658157" status: 204 len: 0 microversion: 2.2 time: 0.023111 Jul 20 04:14:13.624143 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 634/1222] 10.222.0.20 () {60 vars in 1257 bytes} [Wed Jul 20 04:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-898658157 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:13.634016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7c941382-55ee-4955-ba24-de1edf3b17b9 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Action: 'create', calling method: .version_select at 0x7fbf9d57ef70>, body: {"keypair": {"name": "tempest-keypair-2036467044", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:13.650274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-7c941382-55ee-4955-ba24-de1edf3b17b9 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:13.655536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-7c941382-55ee-4955-ba24-de1edf3b17b9 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for user 81ee5f4bbc9f42b5bab588429940a69e and project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:13.687868 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7c941382-55ee-4955-ba24-de1edf3b17b9 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.058549 Jul 20 04:14:13.688628 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 635/1223] 10.222.0.20 () {62 vars in 1198 bytes} [Wed Jul 20 04:14:13 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 20 04:14:13.701416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-19a069b9-c907-4a48-9dcb-070ef44d23af tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9d69db80>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:13.747131 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-19a069b9-c907-4a48-9dcb-070ef44d23af tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2036467044" status: 204 len: 0 microversion: 2.2 time: 0.050436 Jul 20 04:14:13.747787 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 636/1224] 10.222.0.20 () {60 vars in 1260 bytes} [Wed Jul 20 04:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2036467044 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:13.763040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ede0be3f-ba46-43d5-a7a4-5b5ec1203632 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Action: 'create', calling method: .version_select at 0x7fbf9d686c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-577358076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsJxsfj4A1dYQHmwGfhVNSW4RWb1yvYKMpTatsrgrer+6qmU2BWby0SXF53fbNrDsewdEqXuU8sdFSgCgH7w2hTAaR6NM5hllEMLE2RuqeoIbkHYyE4hWByFEaJusLltg=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:13.789612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ede0be3f-ba46-43d5-a7a4-5b5ec1203632 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:13.796960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a6c9fee5-205a-47fd-9600-d9ae3ea90026 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:13.801541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ede0be3f-ba46-43d5-a7a4-5b5ec1203632 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for user 81ee5f4bbc9f42b5bab588429940a69e and project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:13.808853 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a6c9fee5-205a-47fd-9600-d9ae3ea90026 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.287576 Jul 20 04:14:13.809277 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 589/1225] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:13 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:13.814269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8b5748c8-d79c-492f-adf4-00fad1fae4b6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:13.820017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8b5748c8-d79c-492f-adf4-00fad1fae4b6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:13.833436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b5748c8-d79c-492f-adf4-00fad1fae4b6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.834302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b5748c8-d79c-492f-adf4-00fad1fae4b6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.835383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b5748c8-d79c-492f-adf4-00fad1fae4b6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.836016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b5748c8-d79c-492f-adf4-00fad1fae4b6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.870550 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ede0be3f-ba46-43d5-a7a4-5b5ec1203632 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.114296 Jul 20 04:14:13.871429 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 637/1226] 10.222.0.20 () {62 vars in 1198 bytes} [Wed Jul 20 04:14:13 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 20 04:14:13.884586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ea4c33c2-4d7a-4cc1-ac7b-01b5dc5134bf req-408e6800-df94-4538-a5ea-36b457d18cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee027f2-e9fe-4399-899d-142b4c3b538a", "name": "network-vif-deleted", "tag": "757eb3b3-c7a1-48a2-9cf0-3c5eec6bf2f7"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:13.912259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ea4c33c2-4d7a-4cc1-ac7b-01b5dc5134bf req-408e6800-df94-4538-a5ea-36b457d18cde service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.912547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ea4c33c2-4d7a-4cc1-ac7b-01b5dc5134bf req-408e6800-df94-4538-a5ea-36b457d18cde service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.928168 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ea4c33c2-4d7a-4cc1-ac7b-01b5dc5134bf req-408e6800-df94-4538-a5ea-36b457d18cde service nova] Creating event network-vif-deleted:757eb3b3-c7a1-48a2-9cf0-3c5eec6bf2f7 for instance 0ee027f2-e9fe-4399-899d-142b4c3b538a on n-h2-764485-11 Jul 20 04:14:13.937525 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ea4c33c2-4d7a-4cc1-ac7b-01b5dc5134bf req-408e6800-df94-4538-a5ea-36b457d18cde service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057447 Jul 20 04:14:13.940177 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 638/1227] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:13.950388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bbb772b9-bc04-403b-9a9b-b442c22dfd6e tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Action: 'create', calling method: .version_select at 0x7fbf9d50f820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1514788309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOWVI/CJ0cDzOhFasI64SOx4n53AmlexVnjFNUPCX+immYidb39IJTMXUlQlg7eKkNY1PYaT74PDu8Ag1t3DAvGQ/KqokFpw1QNoyCxWr0XJy9vapzJ0G22oeQ0AynacA=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:13.987268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-bbb772b9-bc04-403b-9a9b-b442c22dfd6e tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:13.995280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-bbb772b9-bc04-403b-9a9b-b442c22dfd6e tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for user 81ee5f4bbc9f42b5bab588429940a69e and project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:14.040650 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bbb772b9-bc04-403b-9a9b-b442c22dfd6e tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.095743 Jul 20 04:14:14.042232 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 639/1228] 10.222.0.20 () {62 vars in 1198 bytes} [Wed Jul 20 04:14:13 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:14:14.049950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c81fdafb-d91c-4156-84ad-2ea0a66c4a80 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.051343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c81fdafb-d91c-4156-84ad-2ea0a66c4a80 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:14.062023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c81fdafb-d91c-4156-84ad-2ea0a66c4a80 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.062491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c81fdafb-d91c-4156-84ad-2ea0a66c4a80 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.064992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c81fdafb-d91c-4156-84ad-2ea0a66c4a80 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.065645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c81fdafb-d91c-4156-84ad-2ea0a66c4a80 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.073499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8b5748c8-d79c-492f-adf4-00fad1fae4b6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:14.083322 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8b5748c8-d79c-492f-adf4-00fad1fae4b6 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1463 microversion: 2.1 time: 0.272113 Jul 20 04:14:14.084674 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 590/1229] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:13 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1463 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:14.100921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-00cb7cb6-988c-44fd-bef6-05d56ee1f723 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Action: 'create', calling method: .version_select at 0x7fbf9d9f8670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-355955679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXeZNkq0yEi+hovSxVc4Z11MGWD8ikd1EJLcB+HHtnLLR4xjZfRtZh/a7h5SfPXyTrktxBMwhHgszYAogKxk2mF8I1pCo+zn+cxV4WQZJPZ0a2MGEMI5OJwSR+P4O773Q=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:14.121731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-00cb7cb6-988c-44fd-bef6-05d56ee1f723 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:14.128933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-00cb7cb6-988c-44fd-bef6-05d56ee1f723 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for user 81ee5f4bbc9f42b5bab588429940a69e and project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:14.162055 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-00cb7cb6-988c-44fd-bef6-05d56ee1f723 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.065639 Jul 20 04:14:14.162997 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 591/1230] 10.222.0.20 () {62 vars in 1198 bytes} [Wed Jul 20 04:14:14 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:14:14.168265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0e240556-c530-49c8-92c5-1e4b0780e816 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.169648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0e240556-c530-49c8-92c5-1e4b0780e816 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:14.177306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e240556-c530-49c8-92c5-1e4b0780e816 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.177858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e240556-c530-49c8-92c5-1e4b0780e816 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.178770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e240556-c530-49c8-92c5-1e4b0780e816 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.179212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e240556-c530-49c8-92c5-1e4b0780e816 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.305482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c81fdafb-d91c-4156-84ad-2ea0a66c4a80 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:14.322153 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c81fdafb-d91c-4156-84ad-2ea0a66c4a80 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1538 microversion: 2.1 time: 0.276577 Jul 20 04:14:14.324210 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 640/1231] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:14 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1538 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:14.331043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5e6a871-5287-443f-9d3c-485889c9c0c8 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9d686790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.336235 n-d-764485-11 devstack@n-api.service[119808]: WARNING oslo_db.sqlalchemy.utils [None req-d5e6a871-5287-443f-9d3c-485889c9c0c8 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:14:14.344768 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d5e6a871-5287-443f-9d3c-485889c9c0c8 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.018888 Jul 20 04:14:14.351869 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 641/1232] 10.222.0.20 () {60 vars in 1176 bytes} [Wed Jul 20 04:14:14 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:14.363958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4a6a0609-9b31-450e-951f-46f98c584521 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.365248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4a6a0609-9b31-450e-951f-46f98c584521 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:14.372925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a6a0609-9b31-450e-951f-46f98c584521 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.373584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a6a0609-9b31-450e-951f-46f98c584521 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.374587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a6a0609-9b31-450e-951f-46f98c584521 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.375238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a6a0609-9b31-450e-951f-46f98c584521 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.394832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0e240556-c530-49c8-92c5-1e4b0780e816 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:14.430573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a6a0609-9b31-450e-951f-46f98c584521 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.431025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a6a0609-9b31-450e-951f-46f98c584521 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.431576 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0e240556-c530-49c8-92c5-1e4b0780e816 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1463 microversion: 2.1 time: 0.256306 Jul 20 04:14:14.432828 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 592/1233] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:14 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1463 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:14.434714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-4a6a0609-9b31-450e-951f-46f98c584521 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lazy-loading 'fault' on Instance uuid 0ee027f2-e9fe-4399-899d-142b4c3b538a {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:14.438290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3b6daf14-eb4d-4716-94f8-626362ef206b tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9dfdfc10>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.462800 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3b6daf14-eb4d-4716-94f8-626362ef206b tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-355955679" status: 204 len: 0 microversion: 2.2 time: 0.028332 Jul 20 04:14:14.467966 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 593/1234] 10.222.0.20 () {60 vars in 1317 bytes} [Wed Jul 20 04:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-355955679 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:14.475636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:14.477629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:14.485173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.485992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.487242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.487934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.512242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4a6a0609-9b31-450e-951f-46f98c584521 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:14.526399 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4a6a0609-9b31-450e-951f-46f98c584521 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 200 len: 1307 microversion: 2.1 time: 0.173429 Jul 20 04:14:14.537499 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 642/1235] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:14 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 1307 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:14.543135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1526abd7-021d-431b-bb83-9b2113dbc493 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9d565c10>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.576212 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1526abd7-021d-431b-bb83-9b2113dbc493 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1514788309" status: 204 len: 0 microversion: 2.2 time: 0.037240 Jul 20 04:14:14.577269 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 643/1236] 10.222.0.20 () {60 vars in 1320 bytes} [Wed Jul 20 04:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1514788309 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:14.584273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-e94f30a4-881d-46c7-aa99-eed663d9aef4 req-d372cd01-e158-4b86-9fd1-32cb54de9cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956609f6-9ca2-4919-988a-2b0d4a740b26", "name": "network-vif-plugged", "status": "completed", "tag": "cdee7da2-445b-4334-89cc-1a24affa04ae"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:14.606951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e94f30a4-881d-46c7-aa99-eed663d9aef4 req-d372cd01-e158-4b86-9fd1-32cb54de9cae service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.611407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e94f30a4-881d-46c7-aa99-eed663d9aef4 req-d372cd01-e158-4b86-9fd1-32cb54de9cae service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.620198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:14.620811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:14.621458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:14.622026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:14.622596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:14.637057 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e94f30a4-881d-46c7-aa99-eed663d9aef4 req-d372cd01-e158-4b86-9fd1-32cb54de9cae service nova] Creating event network-vif-plugged:cdee7da2-445b-4334-89cc-1a24affa04ae for instance 956609f6-9ca2-4919-988a-2b0d4a740b26 on n-h2-764485-11 Jul 20 04:14:14.658933 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-e94f30a4-881d-46c7-aa99-eed663d9aef4 req-d372cd01-e158-4b86-9fd1-32cb54de9cae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066228 Jul 20 04:14:14.660287 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 644/1237] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:14.673698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7d1daa70-67e4-4595-a5a3-a94e5e8aa57d tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9d686790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.701724 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7d1daa70-67e4-4595-a5a3-a94e5e8aa57d tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-577358076" status: 204 len: 0 microversion: 2.2 time: 0.036620 Jul 20 04:14:14.702279 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 645/1238] 10.222.0.20 () {60 vars in 1317 bytes} [Wed Jul 20 04:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-577358076 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:14.722470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2cfe068-e5d9-4507-a6ea-f697529763eb tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Action: 'create', calling method: .version_select at 0x7fbf9d565550>, body: {"keypair": {"name": "tempest-keypair-410384494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxyfNIStmD9pZhkvxssaxhf8Zb9R5Ui++pcGefbCSCKm6Cceti/sK6v+jIVSuFyRJdP6MBJEik9Age0N7397VP6EI+TSymCb5thSHYTko15ex/KFHxZcwMbtQlaTj90gw=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:14.727683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:14.740732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.741200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.742002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.742448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.758886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-c2cfe068-e5d9-4507-a6ea-f697529763eb tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:14.765887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-c2cfe068-e5d9-4507-a6ea-f697529763eb tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for user 81ee5f4bbc9f42b5bab588429940a69e and project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:14.804359 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a177db32-219f-4ede-bfc0-eb65e6cca624 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action" status: 202 len: 1067 microversion: 2.1 time: 0.334932 Jul 20 04:14:14.805031 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 594/1239] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:14 2022] POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action => generated 1067 bytes in 336 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:14:14.809861 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c2cfe068-e5d9-4507-a6ea-f697529763eb tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.092333 Jul 20 04:14:14.811290 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 646/1240] 10.222.0.20 () {62 vars in 1198 bytes} [Wed Jul 20 04:14:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:14:14.824106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f931a132-8721-421b-8963-daa660d502ed tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.824477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4b0f3a89-4d6b-4967-97cd-a30ea9f524a2 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9ddde8b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.826764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f931a132-8721-421b-8963-daa660d502ed tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:14.837163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f931a132-8721-421b-8963-daa660d502ed tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.837841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f931a132-8721-421b-8963-daa660d502ed tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.838896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f931a132-8721-421b-8963-daa660d502ed tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.839637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f931a132-8721-421b-8963-daa660d502ed tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.846034 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4b0f3a89-4d6b-4967-97cd-a30ea9f524a2 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-410384494" status: 200 len: 512 microversion: 2.2 time: 0.027056 Jul 20 04:14:14.846828 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 647/1241] 10.222.0.20 () {60 vars in 1254 bytes} [Wed Jul 20 04:14:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-410384494 => generated 512 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:14.853273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4f06f0eb-0b24-47de-8467-38f6149856eb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.854017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4f06f0eb-0b24-47de-8467-38f6149856eb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:14.858291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:14.862869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f06f0eb-0b24-47de-8467-38f6149856eb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.873136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f06f0eb-0b24-47de-8467-38f6149856eb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.874168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f06f0eb-0b24-47de-8467-38f6149856eb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.874583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f06f0eb-0b24-47de-8467-38f6149856eb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.155452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4f06f0eb-0b24-47de-8467-38f6149856eb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:15.167305 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4f06f0eb-0b24-47de-8467-38f6149856eb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.319354 Jul 20 04:14:15.167939 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 648/1242] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:14 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:15.179020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b9a37c2-36f4-4424-a850-537a857b01d0 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9d5b2dc0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.184088 n-d-764485-11 devstack@n-api.service[119808]: WARNING oslo_db.sqlalchemy.utils [None req-0b9a37c2-36f4-4424-a850-537a857b01d0 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:14:15.200731 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b9a37c2-36f4-4424-a850-537a857b01d0 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.031688 Jul 20 04:14:15.207269 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 649/1243] 10.222.0.20 () {60 vars in 1176 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:15.212985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6ac615d2-15ad-4ce8-8015-5d4e113211a7 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9d50f1f0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.221479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f931a132-8721-421b-8963-daa660d502ed tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:15.231444 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f931a132-8721-421b-8963-daa660d502ed tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.415615 Jul 20 04:14:15.232876 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 595/1244] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:14 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:15.246543 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6ac615d2-15ad-4ce8-8015-5d4e113211a7 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-410384494" status: 204 len: 0 microversion: 2.2 time: 0.038401 Jul 20 04:14:15.247323 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 650/1245] 10.222.0.20 () {60 vars in 1257 bytes} [Wed Jul 20 04:14:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-410384494 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:15.258064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-35f31c68-03de-4160-8aaf-87e1a5680168 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Action: 'create', calling method: .version_select at 0x7fbf9db57160>, body: {"keypair": {"name": "tempest-keypair-74053725", "type": "x509"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:15.281524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-35f31c68-03de-4160-8aaf-87e1a5680168 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:15.288305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-35f31c68-03de-4160-8aaf-87e1a5680168 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for user 81ee5f4bbc9f42b5bab588429940a69e and project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:15.304360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.processutils [None req-35f31c68-03de-4160-8aaf-87e1a5680168 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpxxryny00/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpxxryny00/temp.key -subj /CN=81ee5f4bbc9f42b5bab588429940a69e -extensions v3_req_client {{(pid=119807) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 20 04:14:15.344058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6fb26202-dbf5-4b80-a6ab-9fa1a8941ab5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.344823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6fb26202-dbf5-4b80-a6ab-9fa1a8941ab5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:15.354109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fb26202-dbf5-4b80-a6ab-9fa1a8941ab5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.355075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fb26202-dbf5-4b80-a6ab-9fa1a8941ab5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.356259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fb26202-dbf5-4b80-a6ab-9fa1a8941ab5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.356711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fb26202-dbf5-4b80-a6ab-9fa1a8941ab5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.526203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6fb26202-dbf5-4b80-a6ab-9fa1a8941ab5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:15.534300 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6fb26202-dbf5-4b80-a6ab-9fa1a8941ab5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1538 microversion: 2.1 time: 0.197766 Jul 20 04:14:15.535230 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 651/1246] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1538 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:15.544559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-01a343de-a4ae-4134-bd10-53df664a5176 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.545184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-01a343de-a4ae-4134-bd10-53df664a5176 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 0ee027f2-e9fe-4399-899d-142b4c3b538a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:15.551374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01a343de-a4ae-4134-bd10-53df664a5176 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.552418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01a343de-a4ae-4134-bd10-53df664a5176 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.553484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01a343de-a4ae-4134-bd10-53df664a5176 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.553827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01a343de-a4ae-4134-bd10-53df664a5176 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.570023 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-01a343de-a4ae-4134-bd10-53df664a5176 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] HTTP exception thrown: Instance 0ee027f2-e9fe-4399-899d-142b4c3b538a could not be found. Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-01a343de-a4ae-4134-bd10-53df664a5176 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Request method failure captured: Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a HTTP/1.1 Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BonZlQ2CRDfzy6JrdRaenVAP-bduTz2PxNs1mEGbtKMzvT-dul-9gf5wGDHb6-Ja3TZF-9wwGwHGzbe7xYytuKZ9ZEwl5liwrF5viKSArG_B5Iy_1d92vxWXWEjPLijtdray9LRHIdMdb-s1LiPXCMilU7o988KC_mdB6zGGRpmqU Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:15.571088 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:15.572500 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d46b20455b6a4fc39ff3676f6ce1b801", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}] Jul 20 04:14:15.572500 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:15.572500 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:15.572500 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:15.572500 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:15.572500 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:15.572500 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:15.572500 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 5b0144f0f8694ba4b177c86a768a25e9 Jul 20 04:14:15.572500 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:15.572500 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:15.572500 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 0ee027f2-e9fe-4399-899d-142b4c3b538a could not be found. Jul 20 04:14:15.572500 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '0ee027f2-e9fe-4399-899d-142b4c3b538a'} Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee027f2-e9fe-4399-899d-142b4c3b538a could not be found. Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:15.573269 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee027f2-e9fe-4399-899d-142b4c3b538a could not be found. Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee027f2-e9fe-4399-899d-142b4c3b538a could not be found. Jul 20 04:14:15.574459 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:15.577310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-01a343de-a4ae-4134-bd10-53df664a5176 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Returning 404 to user: Instance 0ee027f2-e9fe-4399-899d-142b4c3b538a could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:15.577310 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-01a343de-a4ae-4134-bd10-53df664a5176 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a" status: 404 len: 111 microversion: 2.1 time: 0.032017 Jul 20 04:14:15.577310 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 652/1247] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/servers/0ee027f2-e9fe-4399-899d-142b4c3b538a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:14:15.581308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-20e9b117-4a7d-4496-afca-a9b6a23654fb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.581819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-20e9b117-4a7d-4496-afca-a9b6a23654fb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:15.588394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20e9b117-4a7d-4496-afca-a9b6a23654fb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.588964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20e9b117-4a7d-4496-afca-a9b6a23654fb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.589935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20e9b117-4a7d-4496-afca-a9b6a23654fb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.590382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20e9b117-4a7d-4496-afca-a9b6a23654fb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.616947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-20e9b117-4a7d-4496-afca-a9b6a23654fb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:15.704935 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-20e9b117-4a7d-4496-afca-a9b6a23654fb tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 204 len: 0 microversion: 2.1 time: 0.127222 Jul 20 04:14:15.709310 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 653/1248] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:15 2022] DELETE /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:15.714683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57139572-e567-4280-ad4a-d462e83409b0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.715396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-57139572-e567-4280-ad4a-d462e83409b0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:15.721370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57139572-e567-4280-ad4a-d462e83409b0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.721817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57139572-e567-4280-ad4a-d462e83409b0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.722570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57139572-e567-4280-ad4a-d462e83409b0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.723029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57139572-e567-4280-ad4a-d462e83409b0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.767751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.processutils [None req-35f31c68-03de-4160-8aaf-87e1a5680168 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpxxryny00/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpxxryny00/temp.key -subj /CN=81ee5f4bbc9f42b5bab588429940a69e -extensions v3_req_client" returned: 0 in 0.463s {{(pid=119807) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 20 04:14:15.769266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.processutils [None req-35f31c68-03de-4160-8aaf-87e1a5680168 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpxxryny00/temp.key -password pass: {{(pid=119807) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 20 04:14:15.799882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.processutils [None req-35f31c68-03de-4160-8aaf-87e1a5680168 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpxxryny00/temp.key -password pass:" returned: 0 in 0.030s {{(pid=119807) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 20 04:14:15.845918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-35f31c68-03de-4160-8aaf-87e1a5680168 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:15.852133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-35f31c68-03de-4160-8aaf-87e1a5680168 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Getting quotas for user 81ee5f4bbc9f42b5bab588429940a69e and project a3b59d3ad0ad477f95093a94d65f10b8. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:15.867028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-57139572-e567-4280-ad4a-d462e83409b0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:15.870720 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-35f31c68-03de-4160-8aaf-87e1a5680168 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 4691 microversion: 2.2 time: 0.618053 Jul 20 04:14:15.875592 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 596/1249] 10.222.0.20 () {62 vars in 1197 bytes} [Wed Jul 20 04:14:15 2022] POST /compute/v2.1/os-keypairs => generated 4691 bytes in 620 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:15.875863 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57139572-e567-4280-ad4a-d462e83409b0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1473 microversion: 2.1 time: 0.165104 Jul 20 04:14:15.876577 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 654/1250] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:15.883328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-34d1dbb7-c4d5-405f-8374-6319edd3024f tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9d5bdf70>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.887365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:15.895623 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-34d1dbb7-c4d5-405f-8374-6319edd3024f tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-74053725" status: 200 len: 1532 microversion: 2.2 time: 0.017744 Jul 20 04:14:15.896371 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 597/1251] 10.222.0.20 () {60 vars in 1251 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-74053725 => generated 1532 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:15.906556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c4d857a6-1e10-462d-b03d-a87ad09c21ed tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9d5858b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.909215 n-d-764485-11 devstack@n-api.service[119808]: WARNING oslo_db.sqlalchemy.utils [None req-c4d857a6-1e10-462d-b03d-a87ad09c21ed tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:14:15.915689 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c4d857a6-1e10-462d-b03d-a87ad09c21ed tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1389 microversion: 2.2 time: 0.012907 Jul 20 04:14:15.916256 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 655/1252] 10.222.0.20 () {60 vars in 1176 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/os-keypairs => generated 1389 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:15.926151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d02d67f5-7bc8-4f7c-9081-fea02b3b9296 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] Calling method '.version_select at 0x7fbf9d96c790>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.946788 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d02d67f5-7bc8-4f7c-9081-fea02b3b9296 tempest-KeyPairsV22TestJSON-1727198594 tempest-KeyPairsV22TestJSON-1727198594-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-74053725" status: 204 len: 0 microversion: 2.2 time: 0.024632 Jul 20 04:14:15.947622 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 598/1253] 10.222.0.20 () {60 vars in 1254 bytes} [Wed Jul 20 04:14:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-74053725 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:16.191501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b30389a3-5a09-4402-8bd3-7d489f5403b2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:16.193156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b30389a3-5a09-4402-8bd3-7d489f5403b2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:16.199587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b30389a3-5a09-4402-8bd3-7d489f5403b2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.200042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b30389a3-5a09-4402-8bd3-7d489f5403b2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.200812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b30389a3-5a09-4402-8bd3-7d489f5403b2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.201249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b30389a3-5a09-4402-8bd3-7d489f5403b2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.250548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1195acb4-762f-4044-a6ef-1492caa81b34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:16.262602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1195acb4-762f-4044-a6ef-1492caa81b34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:16.273167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1195acb4-762f-4044-a6ef-1492caa81b34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.273706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1195acb4-762f-4044-a6ef-1492caa81b34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.274683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1195acb4-762f-4044-a6ef-1492caa81b34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.275124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1195acb4-762f-4044-a6ef-1492caa81b34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.475717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b30389a3-5a09-4402-8bd3-7d489f5403b2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:16.486024 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b30389a3-5a09-4402-8bd3-7d489f5403b2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.304549 Jul 20 04:14:16.494301 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 656/1254] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:16 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:16.536176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1195acb4-762f-4044-a6ef-1492caa81b34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:16.554049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fabb1313-490c-40ec-be2a-dd465ddfbb63 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:16.559763 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1195acb4-762f-4044-a6ef-1492caa81b34 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.313585 Jul 20 04:14:16.560114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fabb1313-490c-40ec-be2a-dd465ddfbb63 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:16.562783 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 599/1255] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:16 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:16.570992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fabb1313-490c-40ec-be2a-dd465ddfbb63 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.571965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fabb1313-490c-40ec-be2a-dd465ddfbb63 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.573052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fabb1313-490c-40ec-be2a-dd465ddfbb63 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.573518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fabb1313-490c-40ec-be2a-dd465ddfbb63 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.890160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fabb1313-490c-40ec-be2a-dd465ddfbb63 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:16.898452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7c843445-f338-4c08-94ae-29bee3e0ed52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:16.899060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7c843445-f338-4c08-94ae-29bee3e0ed52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:16.906090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c843445-f338-4c08-94ae-29bee3e0ed52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.906282 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fabb1313-490c-40ec-be2a-dd465ddfbb63 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1533 microversion: 2.1 time: 0.358989 Jul 20 04:14:16.906813 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 657/1256] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:16 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1533 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:16.907070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c843445-f338-4c08-94ae-29bee3e0ed52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.907901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c843445-f338-4c08-94ae-29bee3e0ed52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.908396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c843445-f338-4c08-94ae-29bee3e0ed52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.178731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7c843445-f338-4c08-94ae-29bee3e0ed52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:17.186928 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7c843445-f338-4c08-94ae-29bee3e0ed52 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1473 microversion: 2.1 time: 0.292442 Jul 20 04:14:17.199289 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 600/1257] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:16 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1473 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:17.510802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-50c5b61e-d24e-4e6e-bf2e-ca12d53751ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:17.512569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-50c5b61e-d24e-4e6e-bf2e-ca12d53751ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:17.521376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50c5b61e-d24e-4e6e-bf2e-ca12d53751ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.522105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50c5b61e-d24e-4e6e-bf2e-ca12d53751ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.523137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50c5b61e-d24e-4e6e-bf2e-ca12d53751ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.523799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50c5b61e-d24e-4e6e-bf2e-ca12d53751ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.578999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-41acc712-daa0-4add-a4d1-260b6d585080 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:17.581009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-41acc712-daa0-4add-a4d1-260b6d585080 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:17.592107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41acc712-daa0-4add-a4d1-260b6d585080 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.593631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41acc712-daa0-4add-a4d1-260b6d585080 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.594848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41acc712-daa0-4add-a4d1-260b6d585080 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.595548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41acc712-daa0-4add-a4d1-260b6d585080 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.877190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-50c5b61e-d24e-4e6e-bf2e-ca12d53751ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:17.888248 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-50c5b61e-d24e-4e6e-bf2e-ca12d53751ce tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1378 microversion: 2.1 time: 0.383234 Jul 20 04:14:17.889911 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 658/1258] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:17 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1378 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:17.895918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ecd6bea8-3ea6-4e42-ac68-2990ac38f487 req-52f86eac-3290-439d-af87-5e5458870489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b03708f-1f01-49cb-9215-7c9dc75c3592", "name": "network-vif-plugged", "status": "completed", "tag": "dc30438d-5ef8-4ad2-b26e-fc49195b5e08"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:17.906165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ecd6bea8-3ea6-4e42-ac68-2990ac38f487 req-52f86eac-3290-439d-af87-5e5458870489 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.906837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ecd6bea8-3ea6-4e42-ac68-2990ac38f487 req-52f86eac-3290-439d-af87-5e5458870489 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.932629 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ecd6bea8-3ea6-4e42-ac68-2990ac38f487 req-52f86eac-3290-439d-af87-5e5458870489 service nova] Creating event network-vif-plugged:dc30438d-5ef8-4ad2-b26e-fc49195b5e08 for instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 on n-h2-764485-11 Jul 20 04:14:17.951024 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ecd6bea8-3ea6-4e42-ac68-2990ac38f487 req-52f86eac-3290-439d-af87-5e5458870489 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057338 Jul 20 04:14:17.953113 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 659/1259] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:17.966662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8526d4da-3fd2-41c5-a1ab-345d6ebbca3b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:17.969805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8526d4da-3fd2-41c5-a1ab-345d6ebbca3b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:18.000224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8526d4da-3fd2-41c5-a1ab-345d6ebbca3b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.002234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8526d4da-3fd2-41c5-a1ab-345d6ebbca3b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.004344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8526d4da-3fd2-41c5-a1ab-345d6ebbca3b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.006715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8526d4da-3fd2-41c5-a1ab-345d6ebbca3b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.007099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-41acc712-daa0-4add-a4d1-260b6d585080 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:18.015876 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-41acc712-daa0-4add-a4d1-260b6d585080 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.441468 Jul 20 04:14:18.029731 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 601/1260] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:17 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:18.205084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7f88fb3c-4534-41c5-bcc3-dbff3f0f0ae0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:18.205703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7f88fb3c-4534-41c5-bcc3-dbff3f0f0ae0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:18.226579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f88fb3c-4534-41c5-bcc3-dbff3f0f0ae0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.227046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f88fb3c-4534-41c5-bcc3-dbff3f0f0ae0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.227879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f88fb3c-4534-41c5-bcc3-dbff3f0f0ae0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.228330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f88fb3c-4534-41c5-bcc3-dbff3f0f0ae0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.365854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8526d4da-3fd2-41c5-a1ab-345d6ebbca3b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:18.381997 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8526d4da-3fd2-41c5-a1ab-345d6ebbca3b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1533 microversion: 2.1 time: 0.425642 Jul 20 04:14:18.383338 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 660/1261] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:17 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1533 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:18.497334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7f88fb3c-4534-41c5-bcc3-dbff3f0f0ae0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:18.522095 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7f88fb3c-4534-41c5-bcc3-dbff3f0f0ae0 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1473 microversion: 2.1 time: 0.318883 Jul 20 04:14:18.523679 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 602/1262] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:18 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1473 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:18.906247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-00fbba4e-4775-49e9-afb4-8ee7d34fe243 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:18.906964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-00fbba4e-4775-49e9-afb4-8ee7d34fe243 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:18.914939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00fbba4e-4775-49e9-afb4-8ee7d34fe243 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.915692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00fbba4e-4775-49e9-afb4-8ee7d34fe243 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.917180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00fbba4e-4775-49e9-afb4-8ee7d34fe243 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.917848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00fbba4e-4775-49e9-afb4-8ee7d34fe243 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.922992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:19.036921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4840e00e-ec6c-49de-b4aa-000861b6cfd0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:19.038223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4840e00e-ec6c-49de-b4aa-000861b6cfd0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:19.045855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4840e00e-ec6c-49de-b4aa-000861b6cfd0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.046594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4840e00e-ec6c-49de-b4aa-000861b6cfd0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.047650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4840e00e-ec6c-49de-b4aa-000861b6cfd0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.050194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4840e00e-ec6c-49de-b4aa-000861b6cfd0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.595422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-00fbba4e-4775-49e9-afb4-8ee7d34fe243 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:19.616423 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-00fbba4e-4775-49e9-afb4-8ee7d34fe243 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1527 microversion: 2.1 time: 0.713945 Jul 20 04:14:19.632205 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 661/1263] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:18 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1527 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:19.638945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-203cab8a-8893-4c36-85b2-54729c03bd01 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:19.640309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-203cab8a-8893-4c36-85b2-54729c03bd01 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:19.649284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-203cab8a-8893-4c36-85b2-54729c03bd01 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.649937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-203cab8a-8893-4c36-85b2-54729c03bd01 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.650929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-203cab8a-8893-4c36-85b2-54729c03bd01 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.651570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-203cab8a-8893-4c36-85b2-54729c03bd01 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.822258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4840e00e-ec6c-49de-b4aa-000861b6cfd0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:19.840179 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4840e00e-ec6c-49de-b4aa-000861b6cfd0 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.807762 Jul 20 04:14:19.841042 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 603/1264] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:19 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:19.855825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f82e524-30f2-49fc-b215-08e59d6bb093 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:19.856951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2f82e524-30f2-49fc-b215-08e59d6bb093 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:19.865910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f82e524-30f2-49fc-b215-08e59d6bb093 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.866371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f82e524-30f2-49fc-b215-08e59d6bb093 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.867167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f82e524-30f2-49fc-b215-08e59d6bb093 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.867637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f82e524-30f2-49fc-b215-08e59d6bb093 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.200137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-203cab8a-8893-4c36-85b2-54729c03bd01 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:20.235320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2f82e524-30f2-49fc-b215-08e59d6bb093 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:20.240008 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-203cab8a-8893-4c36-85b2-54729c03bd01 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1520 microversion: 2.1 time: 0.605161 Jul 20 04:14:20.240227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:20.242534 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 662/1265] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:19 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1520 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:20.250537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-588ab09a-f39e-41f7-893f-761ed7746fd0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:20.252571 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2f82e524-30f2-49fc-b215-08e59d6bb093 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1473 microversion: 2.1 time: 0.400521 Jul 20 04:14:20.253428 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 604/1266] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:19 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1473 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:20.260243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8f94345d-02f9-4002-a55d-75bcbd7b8a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:20.260424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-588ab09a-f39e-41f7-893f-761ed7746fd0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:20.261194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8f94345d-02f9-4002-a55d-75bcbd7b8a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:20.269677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f94345d-02f9-4002-a55d-75bcbd7b8a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.271077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f94345d-02f9-4002-a55d-75bcbd7b8a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.272121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f94345d-02f9-4002-a55d-75bcbd7b8a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.273291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f94345d-02f9-4002-a55d-75bcbd7b8a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.288389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-588ab09a-f39e-41f7-893f-761ed7746fd0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.288879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-588ab09a-f39e-41f7-893f-761ed7746fd0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.289714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-588ab09a-f39e-41f7-893f-761ed7746fd0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.290158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-588ab09a-f39e-41f7-893f-761ed7746fd0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.320372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8f94345d-02f9-4002-a55d-75bcbd7b8a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:20.507166 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8f94345d-02f9-4002-a55d-75bcbd7b8a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 204 len: 0 microversion: 2.1 time: 0.252255 Jul 20 04:14:20.510893 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 605/1267] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:20 2022] DELETE /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:20.528256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4881db72-0aec-4860-abf8-183e2b8f2043 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:20.529327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4881db72-0aec-4860-abf8-183e2b8f2043 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:20.537381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4881db72-0aec-4860-abf8-183e2b8f2043 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.538160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4881db72-0aec-4860-abf8-183e2b8f2043 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.539017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4881db72-0aec-4860-abf8-183e2b8f2043 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.539691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4881db72-0aec-4860-abf8-183e2b8f2043 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.772773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-588ab09a-f39e-41f7-893f-761ed7746fd0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:20.782248 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-588ab09a-f39e-41f7-893f-761ed7746fd0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1527 microversion: 2.1 time: 0.538431 Jul 20 04:14:20.795501 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 663/1268] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:20 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1527 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:20.837526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cd15a711-d132-4c96-b598-c8ac15a93105 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:20.840597 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:20.840597 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:14:20.889192 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cd15a711-d132-4c96-b598-c8ac15a93105 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/35b2f035-ad7b-48d5-b55f-6bd0d0ba499e" status: 202 len: 0 microversion: 2.1 time: 0.091993 Jul 20 04:14:20.894585 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 664/1269] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:20 2022] DELETE /compute/v2.1/flavors/35b2f035-ad7b-48d5-b55f-6bd0d0ba499e => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:20.901583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1a604616-3d23-4f6e-997f-576b790b6ea1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:20.902610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1a604616-3d23-4f6e-997f-576b790b6ea1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:20.931197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a604616-3d23-4f6e-997f-576b790b6ea1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.933784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a604616-3d23-4f6e-997f-576b790b6ea1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.934963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a604616-3d23-4f6e-997f-576b790b6ea1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.935651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a604616-3d23-4f6e-997f-576b790b6ea1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.948983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4881db72-0aec-4860-abf8-183e2b8f2043 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:20.964072 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4881db72-0aec-4860-abf8-183e2b8f2043 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1526 microversion: 2.1 time: 0.447988 Jul 20 04:14:20.974819 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 606/1270] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:20 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1526 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:20.979617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f72db3b6-381e-4e0e-a6e2-9402b7ce9ea4 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:21.015348 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f72db3b6-381e-4e0e-a6e2-9402b7ce9ea4 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.039306 Jul 20 04:14:21.028029 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 607/1271] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:20 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:21.045874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:21.047094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:21.057473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.057916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.058723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.059168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.120017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:21.135708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Old instance type tempest-test_resize_flavor_-386047851, new instance type m1.heat {{(pid=119807) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:14:21.157716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:21.158596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:21.159278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:21.160509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:21.162156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:21.310585 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d90cdfec-d828-4b31-a846-cc581f6b3bb8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "POST /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26/action" status: 202 len: 0 microversion: 2.1 time: 0.267210 Jul 20 04:14:21.319222 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 608/1272] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:21 2022] POST /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:14:21.334517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-77145e58-8d60-4fb4-b3b4-d180ee8d3c2f req-57e1748d-aadc-414a-b22e-7d1e2f7a76cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14dcab97-a96a-4c0d-9580-48f5ee096119", "name": "network-vif-deleted", "tag": "f720b326-8d2c-474b-9bc7-7c7557c74c32"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:21.359541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-77145e58-8d60-4fb4-b3b4-d180ee8d3c2f req-57e1748d-aadc-414a-b22e-7d1e2f7a76cf service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.361224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-77145e58-8d60-4fb4-b3b4-d180ee8d3c2f req-57e1748d-aadc-414a-b22e-7d1e2f7a76cf service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.387021 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-77145e58-8d60-4fb4-b3b4-d180ee8d3c2f req-57e1748d-aadc-414a-b22e-7d1e2f7a76cf service nova] Creating event network-vif-deleted:f720b326-8d2c-474b-9bc7-7c7557c74c32 for instance 14dcab97-a96a-4c0d-9580-48f5ee096119 on n-h2-764485-11 Jul 20 04:14:21.398872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1a604616-3d23-4f6e-997f-576b790b6ea1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:21.414593 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1a604616-3d23-4f6e-997f-576b790b6ea1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.517735 Jul 20 04:14:21.415690 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-77145e58-8d60-4fb4-b3b4-d180ee8d3c2f req-57e1748d-aadc-414a-b22e-7d1e2f7a76cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094391 Jul 20 04:14:21.416150 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 665/1273] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:20 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:21.419573 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 609/1274] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:21.423432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d0b346f1-a964-428c-a2c4-ffc198289630 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:21.430518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d0b346f1-a964-428c-a2c4-ffc198289630 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:21.449745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e49fe6ff-3016-4fed-bc92-e29db4dd94f2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:21.454741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e49fe6ff-3016-4fed-bc92-e29db4dd94f2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:21.466456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0b346f1-a964-428c-a2c4-ffc198289630 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.466956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0b346f1-a964-428c-a2c4-ffc198289630 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.474924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0b346f1-a964-428c-a2c4-ffc198289630 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.475434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0b346f1-a964-428c-a2c4-ffc198289630 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.487930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e49fe6ff-3016-4fed-bc92-e29db4dd94f2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.488475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e49fe6ff-3016-4fed-bc92-e29db4dd94f2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.489744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e49fe6ff-3016-4fed-bc92-e29db4dd94f2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.490185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e49fe6ff-3016-4fed-bc92-e29db4dd94f2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.723987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d0b346f1-a964-428c-a2c4-ffc198289630 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:21.733183 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d0b346f1-a964-428c-a2c4-ffc198289630 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1431 microversion: 2.1 time: 0.315741 Jul 20 04:14:21.747735 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 666/1275] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:21 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1431 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:21.985511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2390ef7c-c315-4fd8-b779-7cf22cc2d52b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:21.986584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2390ef7c-c315-4fd8-b779-7cf22cc2d52b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:22.021388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2390ef7c-c315-4fd8-b779-7cf22cc2d52b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.022119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2390ef7c-c315-4fd8-b779-7cf22cc2d52b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.024128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2390ef7c-c315-4fd8-b779-7cf22cc2d52b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.026153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2390ef7c-c315-4fd8-b779-7cf22cc2d52b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.190282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e49fe6ff-3016-4fed-bc92-e29db4dd94f2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.202007 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e49fe6ff-3016-4fed-bc92-e29db4dd94f2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1536 microversion: 2.1 time: 0.781156 Jul 20 04:14:22.202612 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 610/1276] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:21 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1536 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:22.218629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-14da11cf-92fc-4253-b6c2-ef5716d992bb req-a270363f-2db9-450b-b65d-f94c1fbc26c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b03708f-1f01-49cb-9215-7c9dc75c3592", "name": "network-vif-unplugged", "status": "completed", "tag": "dc30438d-5ef8-4ad2-b26e-fc49195b5e08"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:22.237551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-14da11cf-92fc-4253-b6c2-ef5716d992bb req-a270363f-2db9-450b-b65d-f94c1fbc26c0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.238265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-14da11cf-92fc-4253-b6c2-ef5716d992bb req-a270363f-2db9-450b-b65d-f94c1fbc26c0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.268096 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-14da11cf-92fc-4253-b6c2-ef5716d992bb req-a270363f-2db9-450b-b65d-f94c1fbc26c0 service nova] Creating event network-vif-unplugged:dc30438d-5ef8-4ad2-b26e-fc49195b5e08 for instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 on n-h2-764485-11 Jul 20 04:14:22.277239 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-14da11cf-92fc-4253-b6c2-ef5716d992bb req-a270363f-2db9-450b-b65d-f94c1fbc26c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073405 Jul 20 04:14:22.278136 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 611/1277] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:22.433080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e507332f-755f-4eb4-834e-595de809b924 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:22.434733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e507332f-755f-4eb4-834e-595de809b924 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:22.443639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e507332f-755f-4eb4-834e-595de809b924 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.449143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e507332f-755f-4eb4-834e-595de809b924 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.450178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e507332f-755f-4eb4-834e-595de809b924 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.452544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e507332f-755f-4eb4-834e-595de809b924 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.991703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2390ef7c-c315-4fd8-b779-7cf22cc2d52b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:23.005733 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2390ef7c-c315-4fd8-b779-7cf22cc2d52b tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1526 microversion: 2.1 time: 1.026797 Jul 20 04:14:23.009123 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 667/1278] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:21 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1526 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:23.024269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2550cdc4-1ee0-4cca-8b75-6144816b9fd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:23.025709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2550cdc4-1ee0-4cca-8b75-6144816b9fd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:23.044822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2550cdc4-1ee0-4cca-8b75-6144816b9fd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.047753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2550cdc4-1ee0-4cca-8b75-6144816b9fd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.050958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2550cdc4-1ee0-4cca-8b75-6144816b9fd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.055777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2550cdc4-1ee0-4cca-8b75-6144816b9fd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.149445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2550cdc4-1ee0-4cca-8b75-6144816b9fd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.150170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2550cdc4-1ee0-4cca-8b75-6144816b9fd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.158453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-2550cdc4-1ee0-4cca-8b75-6144816b9fd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lazy-loading 'fault' on Instance uuid 14dcab97-a96a-4c0d-9580-48f5ee096119 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:23.328407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2550cdc4-1ee0-4cca-8b75-6144816b9fd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:23.344682 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2550cdc4-1ee0-4cca-8b75-6144816b9fd3 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 200 len: 1307 microversion: 2.1 time: 0.332582 Jul 20 04:14:23.345298 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 668/1279] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:23 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 1307 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:23.355878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ee987ba9-6c25-4221-82b0-4c0aaec555c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:23.356847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ee987ba9-6c25-4221-82b0-4c0aaec555c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:23.364593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee987ba9-6c25-4221-82b0-4c0aaec555c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.365310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee987ba9-6c25-4221-82b0-4c0aaec555c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.366327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee987ba9-6c25-4221-82b0-4c0aaec555c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.366923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee987ba9-6c25-4221-82b0-4c0aaec555c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.674277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e507332f-755f-4eb4-834e-595de809b924 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:23.685077 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e507332f-755f-4eb4-834e-595de809b924 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 1.256112 Jul 20 04:14:23.692663 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 612/1280] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:22 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:24.027600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-15719392-091a-4b10-8581-064b3a29ca44 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:24.028510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-15719392-091a-4b10-8581-064b3a29ca44 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:24.040329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15719392-091a-4b10-8581-064b3a29ca44 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.040848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15719392-091a-4b10-8581-064b3a29ca44 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.052024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15719392-091a-4b10-8581-064b3a29ca44 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.052768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15719392-091a-4b10-8581-064b3a29ca44 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.443624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee987ba9-6c25-4221-82b0-4c0aaec555c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:24.455191 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ee987ba9-6c25-4221-82b0-4c0aaec555c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1536 microversion: 2.1 time: 1.104992 Jul 20 04:14:24.456691 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 669/1281] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:23 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1536 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:24.467125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fcc1e993-f87f-4cdf-9643-704058d573a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:24.471946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fcc1e993-f87f-4cdf-9643-704058d573a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 14dcab97-a96a-4c0d-9580-48f5ee096119] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:24.481081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fcc1e993-f87f-4cdf-9643-704058d573a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.481540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fcc1e993-f87f-4cdf-9643-704058d573a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.482334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fcc1e993-f87f-4cdf-9643-704058d573a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.482769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fcc1e993-f87f-4cdf-9643-704058d573a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.506187 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-fcc1e993-f87f-4cdf-9643-704058d573a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] HTTP exception thrown: Instance 14dcab97-a96a-4c0d-9580-48f5ee096119 could not be found. Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fcc1e993-f87f-4cdf-9643-704058d573a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Request method failure captured: Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 HTTP/1.1 Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BonZlQ2CRDfzy6JrdRaenVAP-bduTz2PxNs1mEGbtKMzvT-dul-9gf5wGDHb6-Ja3TZF-9wwGwHGzbe7xYytuKZ9ZEwl5liwrF5viKSArG_B5Iy_1d92vxWXWEjPLijtdray9LRHIdMdb-s1LiPXCMilU7o988KC_mdB6zGGRpmqU Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:24.509239 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:24.510980 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d46b20455b6a4fc39ff3676f6ce1b801", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}] Jul 20 04:14:24.510980 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:24.510980 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:24.510980 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:24.510980 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:24.510980 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:24.510980 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:24.510980 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 5b0144f0f8694ba4b177c86a768a25e9 Jul 20 04:14:24.510980 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:24.510980 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:24.510980 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 14dcab97-a96a-4c0d-9580-48f5ee096119 could not be found. Jul 20 04:14:24.510980 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '14dcab97-a96a-4c0d-9580-48f5ee096119'} Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14dcab97-a96a-4c0d-9580-48f5ee096119 could not be found. Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:24.511806 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14dcab97-a96a-4c0d-9580-48f5ee096119 could not be found. Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14dcab97-a96a-4c0d-9580-48f5ee096119 could not be found. Jul 20 04:14:24.513118 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:24.516390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fcc1e993-f87f-4cdf-9643-704058d573a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Returning 404 to user: Instance 14dcab97-a96a-4c0d-9580-48f5ee096119 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:24.517499 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fcc1e993-f87f-4cdf-9643-704058d573a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119" status: 404 len: 111 microversion: 2.1 time: 0.059686 Jul 20 04:14:24.522293 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 670/1282] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:24 2022] GET /compute/v2.1/servers/14dcab97-a96a-4c0d-9580-48f5ee096119 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:24.528591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-582acb6a-e738-4140-b5e6-f2ec536d0c51 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:24.529388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-582acb6a-e738-4140-b5e6-f2ec536d0c51 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 20b18bea-6f4e-458b-8c7b-94f9c18c14af] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:24.544800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-582acb6a-e738-4140-b5e6-f2ec536d0c51 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.545260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-582acb6a-e738-4140-b5e6-f2ec536d0c51 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.550074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-582acb6a-e738-4140-b5e6-f2ec536d0c51 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.555729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-582acb6a-e738-4140-b5e6-f2ec536d0c51 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.593725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-582acb6a-e738-4140-b5e6-f2ec536d0c51 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 20b18bea-6f4e-458b-8c7b-94f9c18c14af] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:24.736876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-15719392-091a-4b10-8581-064b3a29ca44 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:24.745070 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-582acb6a-e738-4140-b5e6-f2ec536d0c51 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af" status: 204 len: 0 microversion: 2.1 time: 0.219513 Jul 20 04:14:24.746087 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 671/1283] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:24 2022] DELETE /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:24.753967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3ee5251f-06c2-45c2-9cc0-b7f7d0fe2dc1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:24.755796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3ee5251f-06c2-45c2-9cc0-b7f7d0fe2dc1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:24.766980 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-15719392-091a-4b10-8581-064b3a29ca44 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1526 microversion: 2.1 time: 0.743516 Jul 20 04:14:24.767907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ee5251f-06c2-45c2-9cc0-b7f7d0fe2dc1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.768591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ee5251f-06c2-45c2-9cc0-b7f7d0fe2dc1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.768956 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 613/1284] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:24 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1526 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:24.771692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ee5251f-06c2-45c2-9cc0-b7f7d0fe2dc1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.774008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ee5251f-06c2-45c2-9cc0-b7f7d0fe2dc1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.778672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=24 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:24.789817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5718dd49-9274-416f-920d-2e7d699f0226 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:24.791076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5718dd49-9274-416f-920d-2e7d699f0226 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:24.808636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5718dd49-9274-416f-920d-2e7d699f0226 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.810921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5718dd49-9274-416f-920d-2e7d699f0226 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.812071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5718dd49-9274-416f-920d-2e7d699f0226 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.812521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5718dd49-9274-416f-920d-2e7d699f0226 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.871718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5718dd49-9274-416f-920d-2e7d699f0226 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:24.978458 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5718dd49-9274-416f-920d-2e7d699f0226 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 204 len: 0 microversion: 2.1 time: 0.206457 Jul 20 04:14:24.979733 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 614/1285] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:24 2022] DELETE /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:24.988232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d673672d-a387-431f-a746-cd1a83a971c4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:24.989240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d673672d-a387-431f-a746-cd1a83a971c4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 20b18bea-6f4e-458b-8c7b-94f9c18c14af] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:24.996075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d673672d-a387-431f-a746-cd1a83a971c4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.996406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d673672d-a387-431f-a746-cd1a83a971c4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.997497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d673672d-a387-431f-a746-cd1a83a971c4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.997980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d673672d-a387-431f-a746-cd1a83a971c4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.419195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3ee5251f-06c2-45c2-9cc0-b7f7d0fe2dc1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:25.430425 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3ee5251f-06c2-45c2-9cc0-b7f7d0fe2dc1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.680839 Jul 20 04:14:25.432002 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 672/1286] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:24 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:25.475464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-262d2909-7046-4864-8001-455fd6dba380 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:25.476161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-262d2909-7046-4864-8001-455fd6dba380 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:25.483177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-262d2909-7046-4864-8001-455fd6dba380 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.483677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-262d2909-7046-4864-8001-455fd6dba380 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.484457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-262d2909-7046-4864-8001-455fd6dba380 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.485088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-262d2909-7046-4864-8001-455fd6dba380 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.499240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d673672d-a387-431f-a746-cd1a83a971c4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:25.516093 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d673672d-a387-431f-a746-cd1a83a971c4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af" status: 200 len: 1474 microversion: 2.1 time: 0.532362 Jul 20 04:14:25.517305 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 615/1287] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:24 2022] GET /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af => generated 1474 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:25.790408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-94cd7d98-f08c-416d-81da-ba5bc5fb7708 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:25.793030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-94cd7d98-f08c-416d-81da-ba5bc5fb7708 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:25.800175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94cd7d98-f08c-416d-81da-ba5bc5fb7708 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.800635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94cd7d98-f08c-416d-81da-ba5bc5fb7708 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.802604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94cd7d98-f08c-416d-81da-ba5bc5fb7708 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.803059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94cd7d98-f08c-416d-81da-ba5bc5fb7708 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.859660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=12 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:26.085324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-94cd7d98-f08c-416d-81da-ba5bc5fb7708 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:26.104099 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-94cd7d98-f08c-416d-81da-ba5bc5fb7708 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1484 microversion: 2.1 time: 0.322192 Jul 20 04:14:26.105960 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 616/1288] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:25 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1484 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:26.111318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c37eea09-04b0-43a2-b02b-0fb95f82b860 req-222139cc-ddaa-4e01-80f0-a6ded8d3ca20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b03708f-1f01-49cb-9215-7c9dc75c3592", "name": "network-vif-deleted", "tag": "dc30438d-5ef8-4ad2-b26e-fc49195b5e08"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:26.122681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c37eea09-04b0-43a2-b02b-0fb95f82b860 req-222139cc-ddaa-4e01-80f0-a6ded8d3ca20 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:26.123244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c37eea09-04b0-43a2-b02b-0fb95f82b860 req-222139cc-ddaa-4e01-80f0-a6ded8d3ca20 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:26.142711 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c37eea09-04b0-43a2-b02b-0fb95f82b860 req-222139cc-ddaa-4e01-80f0-a6ded8d3ca20 service nova] Creating event network-vif-deleted:dc30438d-5ef8-4ad2-b26e-fc49195b5e08 for instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 on n-h2-764485-11 Jul 20 04:14:26.149645 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c37eea09-04b0-43a2-b02b-0fb95f82b860 req-222139cc-ddaa-4e01-80f0-a6ded8d3ca20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042165 Jul 20 04:14:26.150693 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 617/1289] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:26.402259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-262d2909-7046-4864-8001-455fd6dba380 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:26.412260 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-262d2909-7046-4864-8001-455fd6dba380 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1541 microversion: 2.1 time: 0.940385 Jul 20 04:14:26.413260 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 673/1290] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:25 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1541 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:26.454850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-257d255e-b37a-43f6-aba3-881b660261b8 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:26.456652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-257d255e-b37a-43f6-aba3-881b660261b8 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:26.467684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-257d255e-b37a-43f6-aba3-881b660261b8 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:26.468835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-257d255e-b37a-43f6-aba3-881b660261b8 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:26.470445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-257d255e-b37a-43f6-aba3-881b660261b8 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:26.471908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-257d255e-b37a-43f6-aba3-881b660261b8 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:26.534295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2e019051-b4a9-4028-95b3-b725b6e759d4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:26.535596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2e019051-b4a9-4028-95b3-b725b6e759d4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 20b18bea-6f4e-458b-8c7b-94f9c18c14af] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:26.544851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e019051-b4a9-4028-95b3-b725b6e759d4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:26.545586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e019051-b4a9-4028-95b3-b725b6e759d4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:26.546583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e019051-b4a9-4028-95b3-b725b6e759d4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:26.554133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e019051-b4a9-4028-95b3-b725b6e759d4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:26.883962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-257d255e-b37a-43f6-aba3-881b660261b8 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:26.896235 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-257d255e-b37a-43f6-aba3-881b660261b8 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.448004 Jul 20 04:14:26.906262 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 618/1291] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:26 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:26.924909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2e019051-b4a9-4028-95b3-b725b6e759d4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:26.946609 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2e019051-b4a9-4028-95b3-b725b6e759d4 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af" status: 200 len: 1474 microversion: 2.1 time: 0.416498 Jul 20 04:14:26.962003 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 674/1292] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:26 2022] GET /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af => generated 1474 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:27.127785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-274f0518-44bd-43ce-a2bc-6a675bf940c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:27.129860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-274f0518-44bd-43ce-a2bc-6a675bf940c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:27.149513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-274f0518-44bd-43ce-a2bc-6a675bf940c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.150157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-274f0518-44bd-43ce-a2bc-6a675bf940c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.151044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-274f0518-44bd-43ce-a2bc-6a675bf940c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.152298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-274f0518-44bd-43ce-a2bc-6a675bf940c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.223896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-274f0518-44bd-43ce-a2bc-6a675bf940c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.225105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-274f0518-44bd-43ce-a2bc-6a675bf940c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.226007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-274f0518-44bd-43ce-a2bc-6a675bf940c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lazy-loading 'fault' on Instance uuid 0b03708f-1f01-49cb-9215-7c9dc75c3592 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:27.230456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:27.350338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-b7f8bdd2-1698-470d-b353-2872bf9461a9 req-5108d08c-d5e7-4b4b-82d4-f3624ce01981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b18bea-6f4e-458b-8c7b-94f9c18c14af", "name": "network-vif-deleted", "tag": "ad6410c3-97f5-499a-940a-0b6de8d80e72"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:27.365376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-274f0518-44bd-43ce-a2bc-6a675bf940c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:27.374404 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-274f0518-44bd-43ce-a2bc-6a675bf940c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 200 len: 1314 microversion: 2.1 time: 0.255348 Jul 20 04:14:27.375106 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 619/1293] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:27 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:27.376145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b7f8bdd2-1698-470d-b353-2872bf9461a9 req-5108d08c-d5e7-4b4b-82d4-f3624ce01981 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.376697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b7f8bdd2-1698-470d-b353-2872bf9461a9 req-5108d08c-d5e7-4b4b-82d4-f3624ce01981 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.432152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b51f4cc9-6014-431f-a62b-ec6d86df089b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:27.437903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b51f4cc9-6014-431f-a62b-ec6d86df089b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:27.449991 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-b7f8bdd2-1698-470d-b353-2872bf9461a9 req-5108d08c-d5e7-4b4b-82d4-f3624ce01981 service nova] Creating event network-vif-deleted:ad6410c3-97f5-499a-940a-0b6de8d80e72 for instance 20b18bea-6f4e-458b-8c7b-94f9c18c14af on n-h1-764485-11 Jul 20 04:14:27.455004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b51f4cc9-6014-431f-a62b-ec6d86df089b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.456510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b51f4cc9-6014-431f-a62b-ec6d86df089b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.458242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b51f4cc9-6014-431f-a62b-ec6d86df089b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.459667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b51f4cc9-6014-431f-a62b-ec6d86df089b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.461378 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-b7f8bdd2-1698-470d-b353-2872bf9461a9 req-5108d08c-d5e7-4b4b-82d4-f3624ce01981 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115758 Jul 20 04:14:27.476764 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 675/1294] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:27.919626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ca33e228-5a22-4912-88de-3d4cd4d08a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:27.920345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca33e228-5a22-4912-88de-3d4cd4d08a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:27.935268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca33e228-5a22-4912-88de-3d4cd4d08a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.935816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca33e228-5a22-4912-88de-3d4cd4d08a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.936542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca33e228-5a22-4912-88de-3d4cd4d08a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.936990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca33e228-5a22-4912-88de-3d4cd4d08a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.159733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b51f4cc9-6014-431f-a62b-ec6d86df089b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:28.171706 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b51f4cc9-6014-431f-a62b-ec6d86df089b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1541 microversion: 2.1 time: 0.745013 Jul 20 04:14:28.172306 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 620/1295] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:27 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1541 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:28.185934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fba636cd-daae-482a-9844-b5dd9e484069 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:28.188549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fba636cd-daae-482a-9844-b5dd9e484069 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 20b18bea-6f4e-458b-8c7b-94f9c18c14af] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:28.200688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fba636cd-daae-482a-9844-b5dd9e484069 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.202194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fba636cd-daae-482a-9844-b5dd9e484069 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.203693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fba636cd-daae-482a-9844-b5dd9e484069 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.204728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fba636cd-daae-482a-9844-b5dd9e484069 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.229127 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-fba636cd-daae-482a-9844-b5dd9e484069 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] HTTP exception thrown: Instance 20b18bea-6f4e-458b-8c7b-94f9c18c14af could not be found. Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fba636cd-daae-482a-9844-b5dd9e484069 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Request method failure captured: Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af HTTP/1.1 Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BonZlQ2CRDfzy6JrdRaenVAP-bduTz2PxNs1mEGbtKMzvT-dul-9gf5wGDHb6-Ja3TZF-9wwGwHGzbe7xYytuKZ9ZEwl5liwrF5viKSArG_B5Iy_1d92vxWXWEjPLijtdray9LRHIdMdb-s1LiPXCMilU7o988KC_mdB6zGGRpmqU Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:28.232493 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:28.233893 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d46b20455b6a4fc39ff3676f6ce1b801", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}] Jul 20 04:14:28.233893 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:28.233893 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:28.233893 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:28.233893 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:28.233893 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:28.233893 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:28.233893 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 5b0144f0f8694ba4b177c86a768a25e9 Jul 20 04:14:28.233893 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:28.233893 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:14:28.233893 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 20b18bea-6f4e-458b-8c7b-94f9c18c14af could not be found. Jul 20 04:14:28.233893 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '20b18bea-6f4e-458b-8c7b-94f9c18c14af'} Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b18bea-6f4e-458b-8c7b-94f9c18c14af could not be found. Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:28.234699 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b18bea-6f4e-458b-8c7b-94f9c18c14af could not be found. Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b18bea-6f4e-458b-8c7b-94f9c18c14af could not be found. Jul 20 04:14:28.237601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.245154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fba636cd-daae-482a-9844-b5dd9e484069 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Returning 404 to user: Instance 20b18bea-6f4e-458b-8c7b-94f9c18c14af could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:28.246488 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fba636cd-daae-482a-9844-b5dd9e484069 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af" status: 404 len: 111 microversion: 2.1 time: 0.068767 Jul 20 04:14:28.247685 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 621/1296] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:28 2022] GET /compute/v2.1/servers/20b18bea-6f4e-458b-8c7b-94f9c18c14af => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:28.256675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1b611bd0-56d8-4616-92a2-74c180dec244 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:28.257724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1b611bd0-56d8-4616-92a2-74c180dec244 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:28.267654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b611bd0-56d8-4616-92a2-74c180dec244 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.268541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b611bd0-56d8-4616-92a2-74c180dec244 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.270526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b611bd0-56d8-4616-92a2-74c180dec244 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.271378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b611bd0-56d8-4616-92a2-74c180dec244 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.499804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ca33e228-5a22-4912-88de-3d4cd4d08a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:28.507754 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ca33e228-5a22-4912-88de-3d4cd4d08a64 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.597785 Jul 20 04:14:28.508607 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 676/1297] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:27 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:28.514235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1e97dda2-351f-46d6-a862-d97f0daf03d9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:28.515061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1e97dda2-351f-46d6-a862-d97f0daf03d9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:28.522142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e97dda2-351f-46d6-a862-d97f0daf03d9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.522605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e97dda2-351f-46d6-a862-d97f0daf03d9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.523391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e97dda2-351f-46d6-a862-d97f0daf03d9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.524164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e97dda2-351f-46d6-a862-d97f0daf03d9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.541144 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-1e97dda2-351f-46d6-a862-d97f0daf03d9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] HTTP exception thrown: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1e97dda2-351f-46d6-a862-d97f0daf03d9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 HTTP/1.1 Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:28.543071 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:28.544728 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:14:28.544728 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:28.544728 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:14:28.544728 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:28.544728 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:14:28.544728 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:28.544728 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:28.544728 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:14:28.544728 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:14:28.544728 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:28.544728 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:14:28.544728 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '0b03708f-1f01-49cb-9215-7c9dc75c3592'} Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:28.545654 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:14:28.555065 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.556517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1e97dda2-351f-46d6-a862-d97f0daf03d9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 404 to user: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:28.556517 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1e97dda2-351f-46d6-a862-d97f0daf03d9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 404 len: 111 microversion: 2.1 time: 0.035146 Jul 20 04:14:28.556517 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 677/1298] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:28 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:28.736195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1b611bd0-56d8-4616-92a2-74c180dec244 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:28.746276 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1b611bd0-56d8-4616-92a2-74c180dec244 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 200 len: 1474 microversion: 2.1 time: 0.494343 Jul 20 04:14:28.759663 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 622/1299] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:28 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 1474 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:28.773805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-54ae8b58-91df-4c18-b520-cb40fbc6993a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Action: 'create', calling method: .version_select at 0x7fbf9db57940>, body: {"keypair": {"name": "tempest-keypair-1253854375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJttfy+g/IYs7DiC387oIYtTvsmROijm9EBUQzvArVOsa0ZVxP8qOaGPFTIfc7jlWxpRoYENl3utsy3SB+lB/1uw7t4gwHfpZp0xvMuiSFruJvXAwBdhu+AAyQbPD4oe6A=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:28.790354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-29518d27-e8db-41d6-9dfa-4a959010fdb9 tempest-FloatingIPDetailsNegativeTestJSON-1630252166 tempest-FloatingIPDetailsNegativeTestJSON-1630252166-project] Calling method '.version_select at 0x7fbf9d565e50>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:28.823058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-54ae8b58-91df-4c18-b520-cb40fbc6993a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Getting quotas for project a15623aa4b154b46a0e7fa6bcdf6c1be. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:28.840287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-54ae8b58-91df-4c18-b520-cb40fbc6993a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Getting quotas for user a2e2ee08afb949bfabefeb750a0ba191 and project a15623aa4b154b46a0e7fa6bcdf6c1be. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:28.900744 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-54ae8b58-91df-4c18-b520-cb40fbc6993a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132884 Jul 20 04:14:28.907890 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 623/1300] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:14:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:28.917416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG neutronclient.v2_0.client [None req-29518d27-e8db-41d6-9dfa-4a959010fdb9 tempest-FloatingIPDetailsNegativeTestJSON-1630252166 tempest-FloatingIPDetailsNegativeTestJSON-1630252166-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6a71f613-9e2a-487d-b952-5ee741c006e7 could not be found", "detail": ""}} {{(pid=119808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:14:28.918314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6cc21760-96e2-4014-bc6a-ffb7a995722b req-4805d675-f7bb-4559-83d1-d27eaa009b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2fb172-fa1a-40e0-83b2-eefc51238dad", "name": "network-vif-deleted", "tag": "03823a3f-4130-4cb7-bb66-1b00475c7a36"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:28.918827 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-29518d27-e8db-41d6-9dfa-4a959010fdb9 tempest-FloatingIPDetailsNegativeTestJSON-1630252166 tempest-FloatingIPDetailsNegativeTestJSON-1630252166-project] HTTP exception thrown: Floating IP not found for ID 6a71f613-9e2a-487d-b952-5ee741c006e7 Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-29518d27-e8db-41d6-9dfa-4a959010fdb9 tempest-FloatingIPDetailsNegativeTestJSON-1630252166 tempest-FloatingIPDetailsNegativeTestJSON-1630252166-project] Request method failure captured: Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-floating-ips/6a71f613-9e2a-487d-b952-5ee741c006e7 HTTP/1.1 Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14EkgaST7FLzpf8HeLO4eCdvUEFOYwNKepf8ulX4W1fjxss4Q9gq10_tuYpgVB2Q57rNh6uMVTtyCVME9RU_HKaaJ26clzzrPvr5x93MnlPA_-zvlxbPfiZ4ATR17AITPDs3fmSSuq9taPojgF7HQVOgIEcQA2LSV6Gzv_k9g4LOHio Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 67b843b4b03f402ab1c7f8cf7f0f2c5f Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1630252166 Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:28.934663 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:28.936994 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/67b843b4b03f402ab1c7f8cf7f0f2c5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67b843b4b03f402ab1c7f8cf7f0f2c5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_67b843b4b03f402ab1c7f8cf7f0f2c5f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/67b843b4b03f402ab1c7f8cf7f0f2c5f"}]}] Jul 20 04:14:28.936994 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1630252166 Jul 20 04:14:28.936994 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 67b843b4b03f402ab1c7f8cf7f0f2c5f Jul 20 04:14:28.936994 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1630252166 Jul 20 04:14:28.936994 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1630252166-project Jul 20 04:14:28.936994 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:28.936994 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:28.936994 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: e14f3a1ed2fa4dca90a6800f7e9cee86 Jul 20 04:14:28.936994 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1630252166-project Jul 20 04:14:28.936994 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:14:28.936994 n-d-764485-11 devstack@n-api.service[119808]: exception: Floating IP not found for ID 6a71f613-9e2a-487d-b952-5ee741c006e7 Jul 20 04:14:28.936994 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '6a71f613-9e2a-487d-b952-5ee741c006e7'} Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:28.943401 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6a71f613-9e2a-487d-b952-5ee741c006e7 could not be found Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d95b2c17-8e76-4c3f-a973-65be131260fb'] Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6a71f613-9e2a-487d-b952-5ee741c006e7. Jul 20 04:14:28.945461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6a71f613-9e2a-487d-b952-5ee741c006e7 Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:28.946899 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:28.948628 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:28.948628 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6a71f613-9e2a-487d-b952-5ee741c006e7 Jul 20 04:14:28.948628 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:28.948628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-29518d27-e8db-41d6-9dfa-4a959010fdb9 tempest-FloatingIPDetailsNegativeTestJSON-1630252166 tempest-FloatingIPDetailsNegativeTestJSON-1630252166-project] Returning 404 to user: Floating IP not found for ID 6a71f613-9e2a-487d-b952-5ee741c006e7 {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:28.948628 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-29518d27-e8db-41d6-9dfa-4a959010fdb9 tempest-FloatingIPDetailsNegativeTestJSON-1630252166 tempest-FloatingIPDetailsNegativeTestJSON-1630252166-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/6a71f613-9e2a-487d-b952-5ee741c006e7" status: 404 len: 111 microversion: 2.1 time: 0.382944 Jul 20 04:14:28.948628 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 678/1301] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jul 20 04:14:28 2022] GET /compute/v2.1/os-floating-ips/6a71f613-9e2a-487d-b952-5ee741c006e7 => generated 111 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:28.949119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6cc21760-96e2-4014-bc6a-ffb7a995722b req-4805d675-f7bb-4559-83d1-d27eaa009b13 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.949119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6cc21760-96e2-4014-bc6a-ffb7a995722b req-4805d675-f7bb-4559-83d1-d27eaa009b13 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.962063 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-6cc21760-96e2-4014-bc6a-ffb7a995722b req-4805d675-f7bb-4559-83d1-d27eaa009b13 service nova] Creating event network-vif-deleted:03823a3f-4130-4cb7-bb66-1b00475c7a36 for instance 6c2fb172-fa1a-40e0-83b2-eefc51238dad on n-h2-764485-11 Jul 20 04:14:28.968791 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6cc21760-96e2-4014-bc6a-ffb7a995722b req-4805d675-f7bb-4559-83d1-d27eaa009b13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056051 Jul 20 04:14:28.970491 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 624/1302] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:29.077357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-38704bcc-d5d2-4a45-9d67-fb698d49777f tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9d477430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-21377607", "description": "tempest-description-720805276"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:29.192283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-349ae6e1-a97a-444d-9bea-ce1d2e18100f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:29.193196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-349ae6e1-a97a-444d-9bea-ce1d2e18100f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:29.209969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-349ae6e1-a97a-444d-9bea-ce1d2e18100f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:29.210223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-349ae6e1-a97a-444d-9bea-ce1d2e18100f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:29.211048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-349ae6e1-a97a-444d-9bea-ce1d2e18100f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:29.211471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-349ae6e1-a97a-444d-9bea-ce1d2e18100f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.058059 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-38704bcc-d5d2-4a45-9d67-fb698d49777f tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.061547 Jul 20 04:14:30.058679 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 679/1303] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:14:28 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:30.064647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-695a2901-737f-4d8f-a1cb-c1694d7b2df4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:30.069008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-695a2901-737f-4d8f-a1cb-c1694d7b2df4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:30.090505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-695a2901-737f-4d8f-a1cb-c1694d7b2df4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.091676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-695a2901-737f-4d8f-a1cb-c1694d7b2df4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.094896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-695a2901-737f-4d8f-a1cb-c1694d7b2df4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.095830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-695a2901-737f-4d8f-a1cb-c1694d7b2df4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.121515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-349ae6e1-a97a-444d-9bea-ce1d2e18100f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:30.129576 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-349ae6e1-a97a-444d-9bea-ce1d2e18100f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1541 microversion: 2.1 time: 0.943054 Jul 20 04:14:30.133233 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 625/1304] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:29 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1541 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:30.147651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f6bbef39-93e9-465a-9cb4-0a9bd22f174e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:30.148672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f6bbef39-93e9-465a-9cb4-0a9bd22f174e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 6c2fb172-fa1a-40e0-83b2-eefc51238dad] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:30.164654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6bbef39-93e9-465a-9cb4-0a9bd22f174e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.167073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6bbef39-93e9-465a-9cb4-0a9bd22f174e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.170506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6bbef39-93e9-465a-9cb4-0a9bd22f174e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.171245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6bbef39-93e9-465a-9cb4-0a9bd22f174e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.199819 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f6bbef39-93e9-465a-9cb4-0a9bd22f174e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] HTTP exception thrown: Instance 6c2fb172-fa1a-40e0-83b2-eefc51238dad could not be found. Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f6bbef39-93e9-465a-9cb4-0a9bd22f174e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Request method failure captured: Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad HTTP/1.1 Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BonZlQ2CRDfzy6JrdRaenVAP-bduTz2PxNs1mEGbtKMzvT-dul-9gf5wGDHb6-Ja3TZF-9wwGwHGzbe7xYytuKZ9ZEwl5liwrF5viKSArG_B5Iy_1d92vxWXWEjPLijtdray9LRHIdMdb-s1LiPXCMilU7o988KC_mdB6zGGRpmqU Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:30.202739 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:30.204158 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d46b20455b6a4fc39ff3676f6ce1b801", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}] Jul 20 04:14:30.204158 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:30.204158 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:30.204158 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:30.204158 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:30.204158 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:30.204158 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:30.204158 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 5b0144f0f8694ba4b177c86a768a25e9 Jul 20 04:14:30.204158 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:30.204158 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:14:30.204158 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 6c2fb172-fa1a-40e0-83b2-eefc51238dad could not be found. Jul 20 04:14:30.204158 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '6c2fb172-fa1a-40e0-83b2-eefc51238dad'} Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2fb172-fa1a-40e0-83b2-eefc51238dad could not be found. Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:30.204932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2fb172-fa1a-40e0-83b2-eefc51238dad could not be found. Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2fb172-fa1a-40e0-83b2-eefc51238dad could not be found. Jul 20 04:14:30.206179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:30.213874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f6bbef39-93e9-465a-9cb4-0a9bd22f174e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Returning 404 to user: Instance 6c2fb172-fa1a-40e0-83b2-eefc51238dad could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:30.215885 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f6bbef39-93e9-465a-9cb4-0a9bd22f174e tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad" status: 404 len: 111 microversion: 2.1 time: 0.072525 Jul 20 04:14:30.222387 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 626/1305] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:30 2022] GET /compute/v2.1/servers/6c2fb172-fa1a-40e0-83b2-eefc51238dad => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:30.228902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b2cc954-3806-46d9-9a98-3efbddbb4e22 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9d591af0>, body: {"security_group_rule": {"parent_group_id": "3892b522-54de-4565-8bf5-42cf62ff8741", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:30.696349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-695a2901-737f-4d8f-a1cb-c1694d7b2df4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:30.705073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:30.714814 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-695a2901-737f-4d8f-a1cb-c1694d7b2df4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.654433 Jul 20 04:14:30.730095 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 680/1306] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:30 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:30.737061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2f0e27c8-b27b-43f0-9a8c-256eef96112f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:30.781133 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2f0e27c8-b27b-43f0-9a8c-256eef96112f tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/70316b04-0172-4ec0-967d-d2a8b72e190a" status: 204 len: 0 microversion: 2.1 time: 0.049037 Jul 20 04:14:30.782437 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 681/1307] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:14:30 2022] DELETE /compute/v2.1/os-server-groups/70316b04-0172-4ec0-967d-d2a8b72e190a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:30.791695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f55f6020-0bac-4067-ba02-efa4f1ff21a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:30.793054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f55f6020-0bac-4067-ba02-efa4f1ff21a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 92c61a93-0178-4e36-b9c0-75758c21dd7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:30.804501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f55f6020-0bac-4067-ba02-efa4f1ff21a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.805292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f55f6020-0bac-4067-ba02-efa4f1ff21a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.806834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f55f6020-0bac-4067-ba02-efa4f1ff21a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.807822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f55f6020-0bac-4067-ba02-efa4f1ff21a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.846440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f55f6020-0bac-4067-ba02-efa4f1ff21a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 92c61a93-0178-4e36-b9c0-75758c21dd7d] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:31.018726 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f55f6020-0bac-4067-ba02-efa4f1ff21a1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d" status: 204 len: 0 microversion: 2.1 time: 0.232032 Jul 20 04:14:31.024730 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 682/1308] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:30 2022] DELETE /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:14:31.030971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-173faf4c-1bf9-47ff-925d-871bf30805a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:31.031838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-173faf4c-1bf9-47ff-925d-871bf30805a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:31.039312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-173faf4c-1bf9-47ff-925d-871bf30805a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.040073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-173faf4c-1bf9-47ff-925d-871bf30805a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.041264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-173faf4c-1bf9-47ff-925d-871bf30805a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.041649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-173faf4c-1bf9-47ff-925d-871bf30805a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.088546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-173faf4c-1bf9-47ff-925d-871bf30805a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:31.162872 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0b2cc954-3806-46d9-9a98-3efbddbb4e22 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.937876 Jul 20 04:14:31.169791 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 627/1309] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:14:30 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:31.174056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-15dc6706-8d22-4307-8e8b-4bf27b7c7691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:31.174683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-15dc6706-8d22-4307-8e8b-4bf27b7c7691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:31.186050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15dc6706-8d22-4307-8e8b-4bf27b7c7691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.186498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15dc6706-8d22-4307-8e8b-4bf27b7c7691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.189960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15dc6706-8d22-4307-8e8b-4bf27b7c7691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.195971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15dc6706-8d22-4307-8e8b-4bf27b7c7691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.203869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:UPDATE=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:31.250832 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-173faf4c-1bf9-47ff-925d-871bf30805a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 204 len: 0 microversion: 2.1 time: 0.222840 Jul 20 04:14:31.253966 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 683/1310] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:31 2022] DELETE /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:31.261592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c59e234-6550-4f31-9627-fc35c88d7bff tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9d5650d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1381550034", "description": "tempest-description-1226719046"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:31.742406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-15dc6706-8d22-4307-8e8b-4bf27b7c7691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:31.757687 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-15dc6706-8d22-4307-8e8b-4bf27b7c7691 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1541 microversion: 2.1 time: 0.592703 Jul 20 04:14:31.763489 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 628/1311] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:31 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1541 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:31.782425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-752f3d0d-cabe-452f-9a09-cf68f79e9812 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:31.783331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-752f3d0d-cabe-452f-9a09-cf68f79e9812 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 92c61a93-0178-4e36-b9c0-75758c21dd7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:31.791450 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6c59e234-6550-4f31-9627-fc35c88d7bff tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.535064 Jul 20 04:14:31.792091 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 684/1312] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:14:31 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:31.802715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-752f3d0d-cabe-452f-9a09-cf68f79e9812 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.805719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-752f3d0d-cabe-452f-9a09-cf68f79e9812 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.806936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-752f3d0d-cabe-452f-9a09-cf68f79e9812 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.807611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-752f3d0d-cabe-452f-9a09-cf68f79e9812 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.808706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f5085c0b-437c-446c-9364-8edd40b2a68e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:31.810072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f5085c0b-437c-446c-9364-8edd40b2a68e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:31.824680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f5085c0b-437c-446c-9364-8edd40b2a68e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.825381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f5085c0b-437c-446c-9364-8edd40b2a68e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.826431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f5085c0b-437c-446c-9364-8edd40b2a68e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.827523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f5085c0b-437c-446c-9364-8edd40b2a68e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.296918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f5085c0b-437c-446c-9364-8edd40b2a68e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:32.313550 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f5085c0b-437c-446c-9364-8edd40b2a68e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.513481 Jul 20 04:14:32.318778 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 685/1313] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:31 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:32.323888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5f93fdc5-79fb-4fc6-a67d-68d9892d3e29 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9d585af0>, body: {"security_group_rule": {"parent_group_id": "bbb4c3c2-7f6f-47cb-8d82-7c9272abbdc9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:32.401991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-752f3d0d-cabe-452f-9a09-cf68f79e9812 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:32.417776 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-752f3d0d-cabe-452f-9a09-cf68f79e9812 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d" status: 200 len: 1474 microversion: 2.1 time: 0.643515 Jul 20 04:14:32.420538 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 629/1314] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:31 2022] GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d => generated 1474 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:32.486546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1155443606", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:32.557248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] validate_networks() for [('265c2afe-140f-48d5-89cc-51314f1c08d1', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:14:32.912822 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5f93fdc5-79fb-4fc6-a67d-68d9892d3e29 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.592581 Jul 20 04:14:32.914087 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 686/1315] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:14:32 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:32.919258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-750ca4e2-4ebe-4b12-ac7b-32fcd21842c5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:32.919258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-750ca4e2-4ebe-4b12-ac7b-32fcd21842c5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:32.927319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-750ca4e2-4ebe-4b12-ac7b-32fcd21842c5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.927934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-750ca4e2-4ebe-4b12-ac7b-32fcd21842c5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.930653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-750ca4e2-4ebe-4b12-ac7b-32fcd21842c5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.931205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-750ca4e2-4ebe-4b12-ac7b-32fcd21842c5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.266054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-750ca4e2-4ebe-4b12-ac7b-32fcd21842c5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:33.274290 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-750ca4e2-4ebe-4b12-ac7b-32fcd21842c5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1541 microversion: 2.1 time: 0.359787 Jul 20 04:14:33.274881 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 687/1316] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:32 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1541 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:33.279335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-77cffe6f-7f27-421a-afd3-79b146b08280 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9d50f820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-409334257", "description": "tempest-description-1614669499"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:33.673994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:33.675458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:33.675716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:33.676296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:33.676940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:33.687912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.687912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.688246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.688575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.709196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Getting quotas for project a15623aa4b154b46a0e7fa6bcdf6c1be. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:33.710394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:33.717068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Getting quotas for user a2e2ee08afb949bfabefeb750a0ba191 and project a15623aa4b154b46a0e7fa6bcdf6c1be. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:33.733806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:14:33.736061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:14:33.787407 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1c133cdd-ac2d-4172-a23e-92c4bd6a70fb tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.306703 Jul 20 04:14:33.788117 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 630/1317] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:14:33.792853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8d1dd2e6-9217-497f-9da5-66f77a4d1881 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:33.793535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8d1dd2e6-9217-497f-9da5-66f77a4d1881 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:33.805269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d1dd2e6-9217-497f-9da5-66f77a4d1881 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.805973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d1dd2e6-9217-497f-9da5-66f77a4d1881 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.807012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d1dd2e6-9217-497f-9da5-66f77a4d1881 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.807700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d1dd2e6-9217-497f-9da5-66f77a4d1881 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.834656 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-77cffe6f-7f27-421a-afd3-79b146b08280 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.558704 Jul 20 04:14:33.835742 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 688/1318] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:14:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:33.840912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0e05ed70-1bd9-4264-8442-25dbcffb97f4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:33.841136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8d1dd2e6-9217-497f-9da5-66f77a4d1881 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:33.841530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0e05ed70-1bd9-4264-8442-25dbcffb97f4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:33.856058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e05ed70-1bd9-4264-8442-25dbcffb97f4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.856693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e05ed70-1bd9-4264-8442-25dbcffb97f4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.857521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e05ed70-1bd9-4264-8442-25dbcffb97f4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.859000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e05ed70-1bd9-4264-8442-25dbcffb97f4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.955725 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8d1dd2e6-9217-497f-9da5-66f77a4d1881 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 204 len: 0 microversion: 2.1 time: 0.166146 Jul 20 04:14:33.956644 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 631/1319] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:33 2022] DELETE /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:33.966043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-505ed833-c87a-41df-926b-e4f059fffe44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:33.967037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-505ed833-c87a-41df-926b-e4f059fffe44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 92c61a93-0178-4e36-b9c0-75758c21dd7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:33.977387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-505ed833-c87a-41df-926b-e4f059fffe44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.980718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-505ed833-c87a-41df-926b-e4f059fffe44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.981810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-505ed833-c87a-41df-926b-e4f059fffe44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.982486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-505ed833-c87a-41df-926b-e4f059fffe44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.422905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0e05ed70-1bd9-4264-8442-25dbcffb97f4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:34.434848 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0e05ed70-1bd9-4264-8442-25dbcffb97f4 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.597684 Jul 20 04:14:34.446659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-505ed833-c87a-41df-926b-e4f059fffe44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:34.459683 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 689/1320] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:33 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:34.462702 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-505ed833-c87a-41df-926b-e4f059fffe44 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d" status: 200 len: 1474 microversion: 2.1 time: 0.503959 Jul 20 04:14:34.470894 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 632/1321] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:33 2022] GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d => generated 1474 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:34.479642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bd007d22-2f4d-463b-aafe-2b57fb3510fa tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:34.482067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bd007d22-2f4d-463b-aafe-2b57fb3510fa tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:34.487038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-20729dd7-211c-4497-bdbe-95c199d3ac03 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9d61b5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2141378696", "description": "tempest-description-1473996250"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:34.495059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd007d22-2f4d-463b-aafe-2b57fb3510fa tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.495549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd007d22-2f4d-463b-aafe-2b57fb3510fa tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.496333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd007d22-2f4d-463b-aafe-2b57fb3510fa tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.496774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd007d22-2f4d-463b-aafe-2b57fb3510fa tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.614479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bd007d22-2f4d-463b-aafe-2b57fb3510fa tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:34.624082 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bd007d22-2f4d-463b-aafe-2b57fb3510fa tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1221 microversion: 2.1 time: 0.163152 Jul 20 04:14:34.624691 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 690/1322] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:34 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1221 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:34.650209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ad320f38-432f-45bc-9901-3efe9165a63f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:34.650778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ad320f38-432f-45bc-9901-3efe9165a63f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:34.666990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad320f38-432f-45bc-9901-3efe9165a63f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.667610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad320f38-432f-45bc-9901-3efe9165a63f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.675476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad320f38-432f-45bc-9901-3efe9165a63f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.680153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad320f38-432f-45bc-9901-3efe9165a63f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.114732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ad320f38-432f-45bc-9901-3efe9165a63f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:35.123975 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ad320f38-432f-45bc-9901-3efe9165a63f tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1710 microversion: 2.1 time: 0.498220 Jul 20 04:14:35.129316 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 691/1323] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:34 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1710 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:35.134604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ab83f19e-3643-4e6e-adc1-5ec67451ad8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:35.142098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ab83f19e-3643-4e6e-adc1-5ec67451ad8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:35.155149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab83f19e-3643-4e6e-adc1-5ec67451ad8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.155755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab83f19e-3643-4e6e-adc1-5ec67451ad8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.156636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab83f19e-3643-4e6e-adc1-5ec67451ad8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.157299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab83f19e-3643-4e6e-adc1-5ec67451ad8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.163957 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-20729dd7-211c-4497-bdbe-95c199d3ac03 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.689430 Jul 20 04:14:35.175305 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 633/1324] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:14:34 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:35.191895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-cbbe8c17-e48d-4d77-9ff6-1f8755037432 req-fd1757ad-d58b-4cc9-9d93-1057dd42c3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c61a93-0178-4e36-b9c0-75758c21dd7d", "name": "network-vif-deleted", "tag": "23615810-0088-4804-b907-e616d9612905"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:35.217198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-cbbe8c17-e48d-4d77-9ff6-1f8755037432 req-fd1757ad-d58b-4cc9-9d93-1057dd42c3a7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.218213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-cbbe8c17-e48d-4d77-9ff6-1f8755037432 req-fd1757ad-d58b-4cc9-9d93-1057dd42c3a7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.249714 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-cbbe8c17-e48d-4d77-9ff6-1f8755037432 req-fd1757ad-d58b-4cc9-9d93-1057dd42c3a7 service nova] Creating event network-vif-deleted:23615810-0088-4804-b907-e616d9612905 for instance 92c61a93-0178-4e36-b9c0-75758c21dd7d on n-h2-764485-11 Jul 20 04:14:35.262915 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-cbbe8c17-e48d-4d77-9ff6-1f8755037432 req-fd1757ad-d58b-4cc9-9d93-1057dd42c3a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084800 Jul 20 04:14:35.266417 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 634/1325] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:35.282451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1fe30e06-de6b-4edf-81cc-b0cece6ba1a8 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9d5aca60>, body: {"security_group_rule": {"parent_group_id": "f1992bd8-bc61-41d9-b36a-36eafad8ba73", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "81f37aa8-4aaa-43cf-9555-a9c40f5f979c"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:35.741972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ab83f19e-3643-4e6e-adc1-5ec67451ad8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:35.750325 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ab83f19e-3643-4e6e-adc1-5ec67451ad8f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1541 microversion: 2.1 time: 0.619686 Jul 20 04:14:35.751406 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 692/1326] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:35 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1541 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:35.756502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-991d0f16-23bb-4e93-a1d9-c105dbea8de5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:35.757246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-991d0f16-23bb-4e93-a1d9-c105dbea8de5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 92c61a93-0178-4e36-b9c0-75758c21dd7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:35.764066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-991d0f16-23bb-4e93-a1d9-c105dbea8de5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.767696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-991d0f16-23bb-4e93-a1d9-c105dbea8de5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.768673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-991d0f16-23bb-4e93-a1d9-c105dbea8de5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.769185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-991d0f16-23bb-4e93-a1d9-c105dbea8de5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.860271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-991d0f16-23bb-4e93-a1d9-c105dbea8de5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.861275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-991d0f16-23bb-4e93-a1d9-c105dbea8de5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.861993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-991d0f16-23bb-4e93-a1d9-c105dbea8de5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lazy-loading 'fault' on Instance uuid 92c61a93-0178-4e36-b9c0-75758c21dd7d {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:36.061123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-991d0f16-23bb-4e93-a1d9-c105dbea8de5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:36.070304 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-991d0f16-23bb-4e93-a1d9-c105dbea8de5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d" status: 200 len: 1308 microversion: 2.1 time: 0.317976 Jul 20 04:14:36.071988 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 693/1327] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:35 2022] GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:36.084767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-58b6c0d1-cd58-49f0-a23e-617f5bc46bae tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:36.096349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-58b6c0d1-cd58-49f0-a23e-617f5bc46bae tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:36.129174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58b6c0d1-cd58-49f0-a23e-617f5bc46bae tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.129851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58b6c0d1-cd58-49f0-a23e-617f5bc46bae tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.133043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58b6c0d1-cd58-49f0-a23e-617f5bc46bae tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.134638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58b6c0d1-cd58-49f0-a23e-617f5bc46bae tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.482206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-58b6c0d1-cd58-49f0-a23e-617f5bc46bae tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:36.493133 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-58b6c0d1-cd58-49f0-a23e-617f5bc46bae tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.418278 Jul 20 04:14:36.494732 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 694/1328] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:36 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:36.500344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e672c5b2-7b26-46ff-912d-99b06fe8e5d4 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:36.501124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e672c5b2-7b26-46ff-912d-99b06fe8e5d4 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:36.509688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e672c5b2-7b26-46ff-912d-99b06fe8e5d4 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.510224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e672c5b2-7b26-46ff-912d-99b06fe8e5d4 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.511050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e672c5b2-7b26-46ff-912d-99b06fe8e5d4 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.511744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e672c5b2-7b26-46ff-912d-99b06fe8e5d4 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.642805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e672c5b2-7b26-46ff-912d-99b06fe8e5d4 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:36.660946 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e672c5b2-7b26-46ff-912d-99b06fe8e5d4 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1283 microversion: 2.1 time: 0.164740 Jul 20 04:14:36.663623 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 695/1329] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:36 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1283 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:36.670362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aa4ff8a4-5318-42b6-a96c-0427b5f50e55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:36.670796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aa4ff8a4-5318-42b6-a96c-0427b5f50e55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:36.681093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa4ff8a4-5318-42b6-a96c-0427b5f50e55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.681575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa4ff8a4-5318-42b6-a96c-0427b5f50e55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.682708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa4ff8a4-5318-42b6-a96c-0427b5f50e55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.683153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa4ff8a4-5318-42b6-a96c-0427b5f50e55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.695818 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1fe30e06-de6b-4edf-81cc-b0cece6ba1a8 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.427596 Jul 20 04:14:36.699207 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 635/1330] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:14:35 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:36.716396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c159f69d-2a38-4a31-b386-1f1e0222f26d tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9d61bee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2124134201", "description": "tempest-description-290502965"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:37.043762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aa4ff8a4-5318-42b6-a96c-0427b5f50e55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa6cffe813a43769950e2e05c45c82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300f36d34c9455aabd936f5d69e130f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:37.077352 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aa4ff8a4-5318-42b6-a96c-0427b5f50e55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 200 len: 1710 microversion: 2.1 time: 0.410031 Jul 20 04:14:37.078037 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 696/1331] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:36 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 1710 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:37.097677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0ccec0f-caa7-4abc-a6e1-8038e5738e3a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.098918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b0ccec0f-caa7-4abc-a6e1-8038e5738e3a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:37.105328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0ccec0f-caa7-4abc-a6e1-8038e5738e3a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.106003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0ccec0f-caa7-4abc-a6e1-8038e5738e3a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.107108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0ccec0f-caa7-4abc-a6e1-8038e5738e3a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.107748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0ccec0f-caa7-4abc-a6e1-8038e5738e3a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.190250 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c159f69d-2a38-4a31-b386-1f1e0222f26d tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.484261 Jul 20 04:14:37.194269 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 636/1332] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:14:36 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:37.200480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e4a7de65-d72d-4aee-af3f-e32978c0472c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.201475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e4a7de65-d72d-4aee-af3f-e32978c0472c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: 92c61a93-0178-4e36-b9c0-75758c21dd7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:37.213161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4a7de65-d72d-4aee-af3f-e32978c0472c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.218030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4a7de65-d72d-4aee-af3f-e32978c0472c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.221754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4a7de65-d72d-4aee-af3f-e32978c0472c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.225794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4a7de65-d72d-4aee-af3f-e32978c0472c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.249183 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e4a7de65-d72d-4aee-af3f-e32978c0472c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] HTTP exception thrown: Instance 92c61a93-0178-4e36-b9c0-75758c21dd7d could not be found. Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e4a7de65-d72d-4aee-af3f-e32978c0472c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Request method failure captured: Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d HTTP/1.1 Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BonZlQ2CRDfzy6JrdRaenVAP-bduTz2PxNs1mEGbtKMzvT-dul-9gf5wGDHb6-Ja3TZF-9wwGwHGzbe7xYytuKZ9ZEwl5liwrF5viKSArG_B5Iy_1d92vxWXWEjPLijtdray9LRHIdMdb-s1LiPXCMilU7o988KC_mdB6zGGRpmqU Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:37.252254 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:37.253604 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d46b20455b6a4fc39ff3676f6ce1b801", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}] Jul 20 04:14:37.253604 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:37.253604 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:37.253604 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:37.253604 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:37.253604 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:37.253604 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:37.253604 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 5b0144f0f8694ba4b177c86a768a25e9 Jul 20 04:14:37.253604 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:37.253604 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:14:37.253604 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 92c61a93-0178-4e36-b9c0-75758c21dd7d could not be found. Jul 20 04:14:37.253604 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '92c61a93-0178-4e36-b9c0-75758c21dd7d'} Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c61a93-0178-4e36-b9c0-75758c21dd7d could not be found. Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:37.254527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c61a93-0178-4e36-b9c0-75758c21dd7d could not be found. Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c61a93-0178-4e36-b9c0-75758c21dd7d could not be found. Jul 20 04:14:37.255805 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:37.260118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e4a7de65-d72d-4aee-af3f-e32978c0472c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Returning 404 to user: Instance 92c61a93-0178-4e36-b9c0-75758c21dd7d could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:37.261833 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e4a7de65-d72d-4aee-af3f-e32978c0472c tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d" status: 404 len: 111 microversion: 2.1 time: 0.066278 Jul 20 04:14:37.262946 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 637/1333] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:37 2022] GET /compute/v2.1/servers/92c61a93-0178-4e36-b9c0-75758c21dd7d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:37.272115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-68f870d3-d021-4457-bbb2-f3fe1ddd7fdf tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9d61b790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1025187650", "description": "tempest-description-711310004"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:37.486773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b0ccec0f-caa7-4abc-a6e1-8038e5738e3a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:37.500354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:37.505414 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b0ccec0f-caa7-4abc-a6e1-8038e5738e3a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1541 microversion: 2.1 time: 0.426295 Jul 20 04:14:37.514887 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 697/1334] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:37 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1541 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:37.523071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-365c44ed-c1c2-4184-b0c4-ff54409170a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.523736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-365c44ed-c1c2-4184-b0c4-ff54409170a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: dd494779-1291-4cff-bc89-8d50a706d908] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:37.530871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-365c44ed-c1c2-4184-b0c4-ff54409170a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.531472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-365c44ed-c1c2-4184-b0c4-ff54409170a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.532330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-365c44ed-c1c2-4184-b0c4-ff54409170a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.533855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-365c44ed-c1c2-4184-b0c4-ff54409170a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.558757 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-365c44ed-c1c2-4184-b0c4-ff54409170a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] HTTP exception thrown: Instance dd494779-1291-4cff-bc89-8d50a706d908 could not be found. Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-365c44ed-c1c2-4184-b0c4-ff54409170a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Request method failure captured: Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 HTTP/1.1 Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BonZlQ2CRDfzy6JrdRaenVAP-bduTz2PxNs1mEGbtKMzvT-dul-9gf5wGDHb6-Ja3TZF-9wwGwHGzbe7xYytuKZ9ZEwl5liwrF5viKSArG_B5Iy_1d92vxWXWEjPLijtdray9LRHIdMdb-s1LiPXCMilU7o988KC_mdB6zGGRpmqU Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:37.562104 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:37.563835 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d46b20455b6a4fc39ff3676f6ce1b801", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}] Jul 20 04:14:37.563835 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:37.563835 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:37.563835 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:37.563835 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:37.563835 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:37.563835 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:37.563835 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 5b0144f0f8694ba4b177c86a768a25e9 Jul 20 04:14:37.563835 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:37.563835 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:37.563835 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance dd494779-1291-4cff-bc89-8d50a706d908 could not be found. Jul 20 04:14:37.563835 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'dd494779-1291-4cff-bc89-8d50a706d908'} Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd494779-1291-4cff-bc89-8d50a706d908 could not be found. Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:37.564824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd494779-1291-4cff-bc89-8d50a706d908 could not be found. Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd494779-1291-4cff-bc89-8d50a706d908 could not be found. Jul 20 04:14:37.566292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:37.567949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-365c44ed-c1c2-4184-b0c4-ff54409170a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Returning 404 to user: Instance dd494779-1291-4cff-bc89-8d50a706d908 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:37.568731 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-365c44ed-c1c2-4184-b0c4-ff54409170a2 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908" status: 404 len: 111 microversion: 2.1 time: 0.054240 Jul 20 04:14:37.570303 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 698/1335] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:37 2022] GET /compute/v2.1/servers/dd494779-1291-4cff-bc89-8d50a706d908 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:37.575566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-35c14ba1-372a-4dea-9032-76b7d9db7d8a req-f8f1f70c-0c5b-4eaf-af10-4a5b8e18bd49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd494779-1291-4cff-bc89-8d50a706d908", "name": "network-vif-deleted", "tag": "865eb090-05a9-425e-9621-afb331576722"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:37.589825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-35c14ba1-372a-4dea-9032-76b7d9db7d8a req-f8f1f70c-0c5b-4eaf-af10-4a5b8e18bd49 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.602286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-35c14ba1-372a-4dea-9032-76b7d9db7d8a req-f8f1f70c-0c5b-4eaf-af10-4a5b8e18bd49 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.625110 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-35c14ba1-372a-4dea-9032-76b7d9db7d8a req-f8f1f70c-0c5b-4eaf-af10-4a5b8e18bd49 service nova] Creating event network-vif-deleted:865eb090-05a9-425e-9621-afb331576722 for instance dd494779-1291-4cff-bc89-8d50a706d908 on n-h2-764485-11 Jul 20 04:14:37.633808 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-35c14ba1-372a-4dea-9032-76b7d9db7d8a req-f8f1f70c-0c5b-4eaf-af10-4a5b8e18bd49 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062204 Jul 20 04:14:37.634719 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 699/1336] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:37.643611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d847c5f2-20ab-4cf6-92ac-69877eafbb50 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.645225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d847c5f2-20ab-4cf6-92ac-69877eafbb50 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:37.658698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d847c5f2-20ab-4cf6-92ac-69877eafbb50 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.662257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d847c5f2-20ab-4cf6-92ac-69877eafbb50 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.665899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d847c5f2-20ab-4cf6-92ac-69877eafbb50 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.668888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d847c5f2-20ab-4cf6-92ac-69877eafbb50 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.896463 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-68f870d3-d021-4457-bbb2-f3fe1ddd7fdf tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.632183 Jul 20 04:14:37.897767 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 638/1337] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:14:37 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:37.902776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8eed660c-3f19-480b-9d9c-b333254f1fa1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.967022 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8eed660c-3f19-480b-9d9c-b333254f1fa1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/e6ebd214-f600-47b0-91f9-9470eb79ceff" status: 204 len: 0 microversion: 2.1 time: 0.067818 Jul 20 04:14:37.968544 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 639/1338] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:14:37 2022] DELETE /compute/v2.1/os-server-groups/e6ebd214-f600-47b0-91f9-9470eb79ceff => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:37.974858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-843e63e0-2f41-4d4b-b17e-2074794ee483 req-ff0bc57e-ace1-4e96-950b-b6b52e855a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1780efb-bbd4-44eb-8fd2-7edbfa5bd516", "name": "network-vif-deleted", "tag": "bfb0a5af-cb59-4409-8bdf-6c7efcdb9959"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:37.986308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-843e63e0-2f41-4d4b-b17e-2074794ee483 req-ff0bc57e-ace1-4e96-950b-b6b52e855a1b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.987024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-843e63e0-2f41-4d4b-b17e-2074794ee483 req-ff0bc57e-ace1-4e96-950b-b6b52e855a1b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.999501 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-843e63e0-2f41-4d4b-b17e-2074794ee483 req-ff0bc57e-ace1-4e96-950b-b6b52e855a1b service nova] Creating event network-vif-deleted:bfb0a5af-cb59-4409-8bdf-6c7efcdb9959 for instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 on n-h1-764485-11 Jul 20 04:14:38.005975 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-843e63e0-2f41-4d4b-b17e-2074794ee483 req-ff0bc57e-ace1-4e96-950b-b6b52e855a1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036010 Jul 20 04:14:38.007088 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 640/1339] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:38.013532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d5270c65-8af5-4f97-8afa-4198b66b20b2 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.015400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d5270c65-8af5-4f97-8afa-4198b66b20b2 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:38.023961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5270c65-8af5-4f97-8afa-4198b66b20b2 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.024595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5270c65-8af5-4f97-8afa-4198b66b20b2 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.025804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5270c65-8af5-4f97-8afa-4198b66b20b2 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.026471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5270c65-8af5-4f97-8afa-4198b66b20b2 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.087187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d847c5f2-20ab-4cf6-92ac-69877eafbb50 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:38.105573 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d847c5f2-20ab-4cf6-92ac-69877eafbb50 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.466366 Jul 20 04:14:38.106312 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 700/1340] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:37 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:38.124823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7c473a1f-5144-4641-b1ba-4eb53db9e0fd tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9d5658b0>, body: {"security_group_rule": {"parent_group_id": "cccdcf95-e5d8-452c-915d-a158c54d6c97", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e9de1d23-f6c2-4bca-8105-cef5fe5c7a69"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:38.404333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d5270c65-8af5-4f97-8afa-4198b66b20b2 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:38.414643 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d5270c65-8af5-4f97-8afa-4198b66b20b2 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1325 microversion: 2.1 time: 0.406098 Jul 20 04:14:38.416646 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 641/1341] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:38 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1325 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:38.422248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a974aae8-62e4-48fe-bc3b-cf1e3edf7f6a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.422855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a974aae8-62e4-48fe-bc3b-cf1e3edf7f6a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:38.429785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a974aae8-62e4-48fe-bc3b-cf1e3edf7f6a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.430364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a974aae8-62e4-48fe-bc3b-cf1e3edf7f6a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.431232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a974aae8-62e4-48fe-bc3b-cf1e3edf7f6a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.431816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a974aae8-62e4-48fe-bc3b-cf1e3edf7f6a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.467718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a974aae8-62e4-48fe-bc3b-cf1e3edf7f6a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:38.563458 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a974aae8-62e4-48fe-bc3b-cf1e3edf7f6a tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 204 len: 0 microversion: 2.1 time: 0.145143 Jul 20 04:14:38.565278 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 642/1342] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:38 2022] DELETE /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:38.573605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-261890fe-dc10-4180-b9dc-25e350a78d55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.574732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-261890fe-dc10-4180-b9dc-25e350a78d55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:38.583549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-261890fe-dc10-4180-b9dc-25e350a78d55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.584282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-261890fe-dc10-4180-b9dc-25e350a78d55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.585498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-261890fe-dc10-4180-b9dc-25e350a78d55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.586440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-261890fe-dc10-4180-b9dc-25e350a78d55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.604826 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-261890fe-dc10-4180-b9dc-25e350a78d55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] HTTP exception thrown: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-261890fe-dc10-4180-b9dc-25e350a78d55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Request method failure captured: Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 HTTP/1.1 Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AqGSwljZ4607PE1v-i4JXIhIPfSNc4a-Ew-0m-hQLpDSdPNOx5NtAMwY_0hlKHA5B30yYtUSHzdsYYNSpM8bWduVZeauokMMnePmJrzcLIg39vLCxM8xg5Z51fWD6WXDqHPAn6PBfoYU15AuNf_nC-A6n9HyvjAcxP4rNkIxxxjoc Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:38.606557 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:38.608057 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8300f36d34c9455aabd936f5d69e130f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}] Jul 20 04:14:38.608057 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:38.608057 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:38.608057 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:38.608057 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:38.608057 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:38.608057 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:38.608057 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 8aa6cffe813a43769950e2e05c45c82b Jul 20 04:14:38.608057 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:38.608057 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:14:38.608057 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:38.608057 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'd1780efb-bbd4-44eb-8fd2-7edbfa5bd516'} Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:38.608881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:38.611482 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.617108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-261890fe-dc10-4180-b9dc-25e350a78d55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Returning 404 to user: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:38.617108 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-261890fe-dc10-4180-b9dc-25e350a78d55 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 404 len: 111 microversion: 2.1 time: 0.041237 Jul 20 04:14:38.617108 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 643/1343] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:38 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:38.794567 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7c473a1f-5144-4641-b1ba-4eb53db9e0fd tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.672612 Jul 20 04:14:38.796810 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 701/1344] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:14:38 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:38.797640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4808e1d1-649e-466c-b4f3-f38179df9128 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Calling method '.version_select at 0x7fbf9d5f38b0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.804746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f7200843-5cfc-4fa4-9ea0-cb0e143cb5ab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.805506 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f7200843-5cfc-4fa4-9ea0-cb0e143cb5ab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:38.818913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f7200843-5cfc-4fa4-9ea0-cb0e143cb5ab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.819424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f7200843-5cfc-4fa4-9ea0-cb0e143cb5ab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.822200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f7200843-5cfc-4fa4-9ea0-cb0e143cb5ab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.823037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f7200843-5cfc-4fa4-9ea0-cb0e143cb5ab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.843866 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-4808e1d1-649e-466c-b4f3-f38179df9128 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] HTTP exception thrown: Image not found. Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4808e1d1-649e-466c-b4f3-f38179df9128 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Request method failure captured: Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/images/c4cae165-e104-43e7-9abb-92dcef9517ab/metadata/os_distro HTTP/1.1 Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14EuFWRJmu3A-jL_Tsfx6yZj-_5bwKYkywvyPvfnnp6umusSHV1zf4Dx0xGFHiVe8W-x5vJ4rzZ_8PdXiiPvcxlRKgTaaysR2cIDUWO_JXrOfNUveXvgXtmP3lxjnQnfO483xXVcKQOc2HRTV7dB2n7Azdz8HUWPp_jAFb0kyNdxtkA Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 9b9dd3782c064c858dc8e4b88d689e0a Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:38.857832 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9b9dd3782c064c858dc8e4b88d689e0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b9dd3782c064c858dc8e4b88d689e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9b9dd3782c064c858dc8e4b88d689e0a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b9dd3782c064c858dc8e4b88d689e0a"}]}] Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 9b9dd3782c064c858dc8e4b88d689e0a Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesMetadataNegativeTestJSON-240701941-project Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 9848ccc5955c4781bb0824ca5a73ca87 Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-240701941-project Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'image_id': 'c4cae165-e104-43e7-9abb-92dcef9517ab', 'id': 'os_distro'} Jul 20 04:14:38.859618 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:38.860690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c4cae165-e104-43e7-9abb-92dcef9517ab Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:38.862187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c4cae165-e104-43e7-9abb-92dcef9517ab could not be found. Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:38.863933 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.865629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4808e1d1-649e-466c-b4f3-f38179df9128 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:38.867674 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4808e1d1-649e-466c-b4f3-f38179df9128 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] 10.222.0.20 "DELETE /compute/v2.1/images/c4cae165-e104-43e7-9abb-92dcef9517ab/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.249439 Jul 20 04:14:38.867674 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 644/1345] 10.222.0.20 () {58 vars in 1292 bytes} [Wed Jul 20 04:14:38 2022] DELETE /compute/v2.1/images/c4cae165-e104-43e7-9abb-92dcef9517ab/metadata/os_distro => generated 62 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:38.876178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-429dae82-b106-4243-afa9-b362cf8393b5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.877067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-429dae82-b106-4243-afa9-b362cf8393b5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:38.885007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-429dae82-b106-4243-afa9-b362cf8393b5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.885464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-429dae82-b106-4243-afa9-b362cf8393b5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.886276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-429dae82-b106-4243-afa9-b362cf8393b5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.886851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-429dae82-b106-4243-afa9-b362cf8393b5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.193125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f7200843-5cfc-4fa4-9ea0-cb0e143cb5ab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:39.201942 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f7200843-5cfc-4fa4-9ea0-cb0e143cb5ab tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1541 microversion: 2.1 time: 0.403781 Jul 20 04:14:39.212319 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 702/1346] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:38 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1541 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:39.212319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-06699854-fcf5-4717-82ea-8f5bd03eb6d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.212319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-06699854-fcf5-4717-82ea-8f5bd03eb6d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:39.217807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06699854-fcf5-4717-82ea-8f5bd03eb6d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.218384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06699854-fcf5-4717-82ea-8f5bd03eb6d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.219335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06699854-fcf5-4717-82ea-8f5bd03eb6d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.219890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06699854-fcf5-4717-82ea-8f5bd03eb6d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.234544 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-06699854-fcf5-4717-82ea-8f5bd03eb6d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] HTTP exception thrown: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:39.234834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-429dae82-b106-4243-afa9-b362cf8393b5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-06699854-fcf5-4717-82ea-8f5bd03eb6d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Request method failure captured: Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 HTTP/1.1 Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AqGSwljZ4607PE1v-i4JXIhIPfSNc4a-Ew-0m-hQLpDSdPNOx5NtAMwY_0hlKHA5B30yYtUSHzdsYYNSpM8bWduVZeauokMMnePmJrzcLIg39vLCxM8xg5Z51fWD6WXDqHPAn6PBfoYU15AuNf_nC-A6n9HyvjAcxP4rNkIxxxjoc Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:39.236221 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:39.237802 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8300f36d34c9455aabd936f5d69e130f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}] Jul 20 04:14:39.237802 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:39.237802 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:39.237802 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:39.237802 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:39.237802 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:39.237802 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:39.237802 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8aa6cffe813a43769950e2e05c45c82b Jul 20 04:14:39.237802 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:39.237802 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:39.237802 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:39.237802 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'c50659bf-f42b-4cb4-899f-20eeaf84e5c1'} Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.238671 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:39.239948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.241131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-06699854-fcf5-4717-82ea-8f5bd03eb6d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Returning 404 to user: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.241131 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-06699854-fcf5-4717-82ea-8f5bd03eb6d0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 404 len: 111 microversion: 2.1 time: 0.033299 Jul 20 04:14:39.241131 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 703/1347] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:39 2022] DELETE /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:39.243860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9631a86e-d244-436a-ba3d-a11c9510b242 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Calling method '.version_select at 0x7fbf9d4d3820>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.250600 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-429dae82-b106-4243-afa9-b362cf8393b5 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1472 microversion: 2.1 time: 0.382673 Jul 20 04:14:39.251298 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 645/1348] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:38 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1472 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:39.258181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f862c02e-ab1a-4850-a875-c60d1487940e tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Calling method '.version_select at 0x7fbf9d5ac310>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.279804 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f862c02e-ab1a-4850-a875-c60d1487940e tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] HTTP exception thrown: Image not found. Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f862c02e-ab1a-4850-a875-c60d1487940e tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Request method failure captured: Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/images/16770218-18ac-42ba-aa2b-e1bfc2aae4d5/metadata/os_version HTTP/1.1 Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14EuFWRJmu3A-jL_Tsfx6yZj-_5bwKYkywvyPvfnnp6umusSHV1zf4Dx0xGFHiVe8W-x5vJ4rzZ_8PdXiiPvcxlRKgTaaysR2cIDUWO_JXrOfNUveXvgXtmP3lxjnQnfO483xXVcKQOc2HRTV7dB2n7Azdz8HUWPp_jAFb0kyNdxtkA Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 9b9dd3782c064c858dc8e4b88d689e0a Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:39.281811 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9b9dd3782c064c858dc8e4b88d689e0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b9dd3782c064c858dc8e4b88d689e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9b9dd3782c064c858dc8e4b88d689e0a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b9dd3782c064c858dc8e4b88d689e0a"}]}] Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 9b9dd3782c064c858dc8e4b88d689e0a Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesMetadataNegativeTestJSON-240701941-project Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 9848ccc5955c4781bb0824ca5a73ca87 Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-240701941-project Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'image_id': '16770218-18ac-42ba-aa2b-e1bfc2aae4d5', 'id': 'os_version'} Jul 20 04:14:39.283365 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:39.284452 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 16770218-18ac-42ba-aa2b-e1bfc2aae4d5 Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:39.285880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 16770218-18ac-42ba-aa2b-e1bfc2aae4d5 could not be found. Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:39.287323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.288714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f862c02e-ab1a-4850-a875-c60d1487940e tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.290192 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f862c02e-ab1a-4850-a875-c60d1487940e tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] 10.222.0.20 "GET /compute/v2.1/images/16770218-18ac-42ba-aa2b-e1bfc2aae4d5/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.030867 Jul 20 04:14:39.290623 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 646/1349] 10.222.0.20 () {58 vars in 1292 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/images/16770218-18ac-42ba-aa2b-e1bfc2aae4d5/metadata/os_version => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:39.295377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eb4c46c2-bd98-47b9-bfea-49658fa0d032 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.296017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eb4c46c2-bd98-47b9-bfea-49658fa0d032 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:39.303422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb4c46c2-bd98-47b9-bfea-49658fa0d032 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.303923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb4c46c2-bd98-47b9-bfea-49658fa0d032 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.304700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb4c46c2-bd98-47b9-bfea-49658fa0d032 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.305145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb4c46c2-bd98-47b9-bfea-49658fa0d032 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.309342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:39.904810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eb4c46c2-bd98-47b9-bfea-49658fa0d032 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:39.912859 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eb4c46c2-bd98-47b9-bfea-49658fa0d032 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.621166 Jul 20 04:14:39.932992 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 647/1350] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:39.932992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dcbd55c6-1853-4efd-8387-03aad9934fe0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.932992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dcbd55c6-1853-4efd-8387-03aad9934fe0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:39.937618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcbd55c6-1853-4efd-8387-03aad9934fe0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.938204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcbd55c6-1853-4efd-8387-03aad9934fe0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.939600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcbd55c6-1853-4efd-8387-03aad9934fe0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.940045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcbd55c6-1853-4efd-8387-03aad9934fe0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.958069 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-dcbd55c6-1853-4efd-8387-03aad9934fe0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] HTTP exception thrown: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dcbd55c6-1853-4efd-8387-03aad9934fe0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Request method failure captured: Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 HTTP/1.1 Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14AqGSwljZ4607PE1v-i4JXIhIPfSNc4a-Ew-0m-hQLpDSdPNOx5NtAMwY_0hlKHA5B30yYtUSHzdsYYNSpM8bWduVZeauokMMnePmJrzcLIg39vLCxM8xg5Z51fWD6WXDqHPAn6PBfoYU15AuNf_nC-A6n9HyvjAcxP4rNkIxxxjoc Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:39.959655 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:39.960996 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8300f36d34c9455aabd936f5d69e130f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}] Jul 20 04:14:39.960996 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:39.960996 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:39.960996 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:39.960996 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:39.960996 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:39.960996 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:39.960996 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 8aa6cffe813a43769950e2e05c45c82b Jul 20 04:14:39.960996 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:39.960996 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:14:39.960996 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:39.960996 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'c50659bf-f42b-4cb4-899f-20eeaf84e5c1'} Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.961739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:39.962926 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.964154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dcbd55c6-1853-4efd-8387-03aad9934fe0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Returning 404 to user: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.964154 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dcbd55c6-1853-4efd-8387-03aad9934fe0 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 404 len: 111 microversion: 2.1 time: 0.036337 Jul 20 04:14:39.964154 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 648/1351] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:39.970379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-07fdaf34-e29b-4bc2-9f4a-9f9fef4aae25 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Calling method '.version_select at 0x7fbf9d67b8b0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:40.001961 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-07fdaf34-e29b-4bc2-9f4a-9f9fef4aae25 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] HTTP exception thrown: Image not found. Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-07fdaf34-e29b-4bc2-9f4a-9f9fef4aae25 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Request method failure captured: Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/images/5863e979-8cc2-4ec8-8ddf-856926883963/metadata HTTP/1.1 Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14EuFWRJmu3A-jL_Tsfx6yZj-_5bwKYkywvyPvfnnp6umusSHV1zf4Dx0xGFHiVe8W-x5vJ4rzZ_8PdXiiPvcxlRKgTaaysR2cIDUWO_JXrOfNUveXvgXtmP3lxjnQnfO483xXVcKQOc2HRTV7dB2n7Azdz8HUWPp_jAFb0kyNdxtkA Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 9b9dd3782c064c858dc8e4b88d689e0a Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:40.004590 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9b9dd3782c064c858dc8e4b88d689e0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b9dd3782c064c858dc8e4b88d689e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9b9dd3782c064c858dc8e4b88d689e0a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b9dd3782c064c858dc8e4b88d689e0a"}]}] Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 9b9dd3782c064c858dc8e4b88d689e0a Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesMetadataNegativeTestJSON-240701941-project Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 9848ccc5955c4781bb0824ca5a73ca87 Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-240701941-project Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'image_id': '5863e979-8cc2-4ec8-8ddf-856926883963'} Jul 20 04:14:40.006045 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:40.006863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5863e979-8cc2-4ec8-8ddf-856926883963 Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:40.008181 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5863e979-8cc2-4ec8-8ddf-856926883963 could not be found. Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:40.010053 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.012273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-07fdaf34-e29b-4bc2-9f4a-9f9fef4aae25 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:40.015273 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9631a86e-d244-436a-ba3d-a11c9510b242 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e9de1d23-f6c2-4bca-8105-cef5fe5c7a69" status: 202 len: 0 microversion: 2.1 time: 0.765465 Jul 20 04:14:40.015799 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-07fdaf34-e29b-4bc2-9f4a-9f9fef4aae25 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] 10.222.0.20 "GET /compute/v2.1/images/5863e979-8cc2-4ec8-8ddf-856926883963/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043666 Jul 20 04:14:40.015949 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 704/1352] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:39 2022] DELETE /compute/v2.1/os-security-groups/e9de1d23-f6c2-4bca-8105-cef5fe5c7a69 => generated 0 bytes in 767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:40.017889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c0080926-7b02-4af1-9190-29909dec1a11 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:40.018635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c0080926-7b02-4af1-9190-29909dec1a11 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:40.019668 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 649/1353] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/images/5863e979-8cc2-4ec8-8ddf-856926883963/metadata => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:40.026603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0080926-7b02-4af1-9190-29909dec1a11 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.027247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0080926-7b02-4af1-9190-29909dec1a11 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.028017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0080926-7b02-4af1-9190-29909dec1a11 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.028526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0080926-7b02-4af1-9190-29909dec1a11 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.040976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0fa55e68-d0c7-447c-9e4e-8be7ecf0f053 req-0cf1b091-055e-4427-85b8-17a18d253062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3299f0-afe7-4862-b16d-7bd4498f44c2", "tag": "95760499-0850-4542-b43e-cb93ce83f98a"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:40.057306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0fa55e68-d0c7-447c-9e4e-8be7ecf0f053 req-0cf1b091-055e-4427-85b8-17a18d253062 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.058253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0fa55e68-d0c7-447c-9e4e-8be7ecf0f053 req-0cf1b091-055e-4427-85b8-17a18d253062 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.069483 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0fa55e68-d0c7-447c-9e4e-8be7ecf0f053 req-0cf1b091-055e-4427-85b8-17a18d253062 service nova] Creating event network-changed:95760499-0850-4542-b43e-cb93ce83f98a for instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 on n-h2-764485-11 Jul 20 04:14:40.074623 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0fa55e68-d0c7-447c-9e4e-8be7ecf0f053 req-0cf1b091-055e-4427-85b8-17a18d253062 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053401 Jul 20 04:14:40.075229 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 650/1354] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:40.081421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6d56cba3-3753-48fe-88c2-7bf9bae8be62 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '.version_select at 0x7fbf9d5451f0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:40.101575 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6d56cba3-3753-48fe-88c2-7bf9bae8be62 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375586087" status: 202 len: 0 microversion: 2.1 time: 0.024935 Jul 20 04:14:40.102351 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 651/1355] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 04:14:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375586087 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:40.107106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b64303a9-a401-4052-b3e2-9014dd3fcb8a tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Calling method '.version_select at 0x7fbf9d5f3790>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:40.190935 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b64303a9-a401-4052-b3e2-9014dd3fcb8a tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/cccdcf95-e5d8-452c-915d-a158c54d6c97" status: 200 len: 247 microversion: 2.1 time: 0.087251 Jul 20 04:14:40.191993 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 652/1356] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:14:40 2022] GET /compute/v2.1/os-security-groups/cccdcf95-e5d8-452c-915d-a158c54d6c97 => generated 247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:40.204840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b83cac74-a381-43f0-b8cd-558c319f181c tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Action: 'update_all', calling method: .version_select at 0x7fbf9d51a280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:40.206746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c0080926-7b02-4af1-9190-29909dec1a11 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:40.215815 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c0080926-7b02-4af1-9190-29909dec1a11 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1325 microversion: 2.1 time: 0.204976 Jul 20 04:14:40.225785 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 705/1357] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:40 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:40.225785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4f70c6e9-11c6-439b-b0a0-72c154aeee25 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9d427040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-808374413", "description": "tempest-description-1625373684"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:40.231078 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b83cac74-a381-43f0-b8cd-558c319f181c tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] HTTP exception thrown: Image not found. Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b83cac74-a381-43f0-b8cd-558c319f181c tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Request method failure captured: Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: request: PUT /compute/v2.1/images/784c6f6e-e326-4429-8b4e-0e269aeb2ff9/metadata HTTP/1.1 Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 57 Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14EuFWRJmu3A-jL_Tsfx6yZj-_5bwKYkywvyPvfnnp6umusSHV1zf4Dx0xGFHiVe8W-x5vJ4rzZ_8PdXiiPvcxlRKgTaaysR2cIDUWO_JXrOfNUveXvgXtmP3lxjnQnfO483xXVcKQOc2HRTV7dB2n7Azdz8HUWPp_jAFb0kyNdxtkA Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 9b9dd3782c064c858dc8e4b88d689e0a Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:40.234431 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9b9dd3782c064c858dc8e4b88d689e0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b9dd3782c064c858dc8e4b88d689e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9b9dd3782c064c858dc8e4b88d689e0a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b9dd3782c064c858dc8e4b88d689e0a"}]}] Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 9b9dd3782c064c858dc8e4b88d689e0a Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesMetadataNegativeTestJSON-240701941-project Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 9848ccc5955c4781bb0824ca5a73ca87 Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-240701941-project Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:14:40.236417 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'image_id': '784c6f6e-e326-4429-8b4e-0e269aeb2ff9', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:40.237580 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 784c6f6e-e326-4429-8b4e-0e269aeb2ff9 Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:40.240028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 784c6f6e-e326-4429-8b4e-0e269aeb2ff9 could not be found. Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:40.241229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:40.243160 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.244909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b83cac74-a381-43f0-b8cd-558c319f181c tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:40.245048 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b83cac74-a381-43f0-b8cd-558c319f181c tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] 10.222.0.20 "PUT /compute/v2.1/images/784c6f6e-e326-4429-8b4e-0e269aeb2ff9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049467 Jul 20 04:14:40.245590 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 653/1358] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:14:40 2022] PUT /compute/v2.1/images/784c6f6e-e326-4429-8b4e-0e269aeb2ff9/metadata => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:40.256570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5b230952-8036-4718-876c-13ed495482e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:40.257502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5b230952-8036-4718-876c-13ed495482e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:40.264356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b230952-8036-4718-876c-13ed495482e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.264815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b230952-8036-4718-876c-13ed495482e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.265609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b230952-8036-4718-876c-13ed495482e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.266045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b230952-8036-4718-876c-13ed495482e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.473256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5b230952-8036-4718-876c-13ed495482e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:40.480075 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4f70c6e9-11c6-439b-b0a0-72c154aeee25 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.262395 Jul 20 04:14:40.481220 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 706/1359] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:14:40 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:40.486094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9fa57fe2-4c41-4af1-b2f5-d81035f38f06 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Action: 'update', calling method: .version_select at 0x7fbf9d4778b0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:40.494587 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5b230952-8036-4718-876c-13ed495482e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1541 microversion: 2.1 time: 0.247935 Jul 20 04:14:40.495182 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 654/1360] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:40 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1541 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:40.512449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f01ea5a3-ff72-446c-b283-d18cc80b2be9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:40.513549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f01ea5a3-ff72-446c-b283-d18cc80b2be9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:40.517947 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-9fa57fe2-4c41-4af1-b2f5-d81035f38f06 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] HTTP exception thrown: Image not found. Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9fa57fe2-4c41-4af1-b2f5-d81035f38f06 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Request method failure captured: Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: request: PUT /compute/v2.1/images/facf98bb-1c52-49ae-8415-032108fd7774/metadata/os_distro HTTP/1.1 Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 30 Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14EuFWRJmu3A-jL_Tsfx6yZj-_5bwKYkywvyPvfnnp6umusSHV1zf4Dx0xGFHiVe8W-x5vJ4rzZ_8PdXiiPvcxlRKgTaaysR2cIDUWO_JXrOfNUveXvgXtmP3lxjnQnfO483xXVcKQOc2HRTV7dB2n7Azdz8HUWPp_jAFb0kyNdxtkA Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 9b9dd3782c064c858dc8e4b88d689e0a Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:40.522697 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9b9dd3782c064c858dc8e4b88d689e0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b9dd3782c064c858dc8e4b88d689e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9b9dd3782c064c858dc8e4b88d689e0a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b9dd3782c064c858dc8e4b88d689e0a"}]}] Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 9b9dd3782c064c858dc8e4b88d689e0a Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesMetadataNegativeTestJSON-240701941-project Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 9848ccc5955c4781bb0824ca5a73ca87 Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-240701941-project Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: {"meta": {"os_distro": "alt"}} Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: exception: Image not found. Jul 20 04:14:40.524430 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'image_id': 'facf98bb-1c52-49ae-8415-032108fd7774', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:40.525411 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID facf98bb-1c52-49ae-8415-032108fd7774 Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:40.526549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image facf98bb-1c52-49ae-8415-032108fd7774 could not be found. Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:40.527851 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:40.529224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.530916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9fa57fe2-4c41-4af1-b2f5-d81035f38f06 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Returning 404 to user: Image not found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:40.530916 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9fa57fe2-4c41-4af1-b2f5-d81035f38f06 tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] 10.222.0.20 "PUT /compute/v2.1/images/facf98bb-1c52-49ae-8415-032108fd7774/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.043889 Jul 20 04:14:40.536909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f01ea5a3-ff72-446c-b283-d18cc80b2be9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.536909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f01ea5a3-ff72-446c-b283-d18cc80b2be9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.536909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f01ea5a3-ff72-446c-b283-d18cc80b2be9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.537385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f01ea5a3-ff72-446c-b283-d18cc80b2be9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.541471 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 707/1361] 10.222.0.20 () {60 vars in 1309 bytes} [Wed Jul 20 04:14:40 2022] PUT /compute/v2.1/images/facf98bb-1c52-49ae-8415-032108fd7774/metadata/os_distro => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:40.547324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d51dd346-25e0-4173-bc0a-9e8e1b4e6a33 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9e1bae50>, body: {"security_group_rule": {"parent_group_id": "3e2e30ef-2bd1-4569-9cba-adee11380c0d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:40.737983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f01ea5a3-ff72-446c-b283-d18cc80b2be9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0144f0f8694ba4b177c86a768a25e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46b20455b6a4fc39ff3676f6ce1b801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:40.753584 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f01ea5a3-ff72-446c-b283-d18cc80b2be9 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 200 len: 1472 microversion: 2.1 time: 0.244837 Jul 20 04:14:40.756401 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 655/1362] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:40 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 1472 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:40.773433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4e563098-1368-4014-9093-81fed027c80a tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Action: 'create', calling method: .version_select at 0x7fbf9d61b040>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:40.803270 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-4e563098-1368-4014-9093-81fed027c80a tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] HTTP exception thrown: Image not found. Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4e563098-1368-4014-9093-81fed027c80a tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Request method failure captured: Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/images/3abe07d7-855a-47f3-a25f-412f8bc3c569/metadata HTTP/1.1 Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 57 Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14EuFWRJmu3A-jL_Tsfx6yZj-_5bwKYkywvyPvfnnp6umusSHV1zf4Dx0xGFHiVe8W-x5vJ4rzZ_8PdXiiPvcxlRKgTaaysR2cIDUWO_JXrOfNUveXvgXtmP3lxjnQnfO483xXVcKQOc2HRTV7dB2n7Azdz8HUWPp_jAFb0kyNdxtkA Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 9b9dd3782c064c858dc8e4b88d689e0a Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:40.805543 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9b9dd3782c064c858dc8e4b88d689e0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b9dd3782c064c858dc8e4b88d689e0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9b9dd3782c064c858dc8e4b88d689e0a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b9dd3782c064c858dc8e4b88d689e0a"}]}] Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 9b9dd3782c064c858dc8e4b88d689e0a Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-240701941 Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesMetadataNegativeTestJSON-240701941-project Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 9848ccc5955c4781bb0824ca5a73ca87 Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-240701941-project Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:14:40.807169 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'image_id': '3abe07d7-855a-47f3-a25f-412f8bc3c569', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:40.808189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3abe07d7-855a-47f3-a25f-412f8bc3c569 Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:40.809932 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3abe07d7-855a-47f3-a25f-412f8bc3c569 could not be found. Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:40.812686 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:40.817519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:40.821909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4e563098-1368-4014-9093-81fed027c80a tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:40.821909 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4e563098-1368-4014-9093-81fed027c80a tempest-ImagesMetadataNegativeTestJSON-240701941 tempest-ImagesMetadataNegativeTestJSON-240701941-project] 10.222.0.20 "POST /compute/v2.1/images/3abe07d7-855a-47f3-a25f-412f8bc3c569/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043077 Jul 20 04:14:40.821909 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 656/1363] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Jul 20 04:14:40 2022] POST /compute/v2.1/images/3abe07d7-855a-47f3-a25f-412f8bc3c569/metadata => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:40.828438 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d51dd346-25e0-4173-bc0a-9e8e1b4e6a33 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.285108 Jul 20 04:14:40.835492 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 708/1364] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:14:40 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:40.845062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-931c39ad-7061-4365-a00c-5409ad8c9298 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Action: 'create', calling method: .version_select at 0x7fbf9d5d6820>, body: {"security_group_rule": {"parent_group_id": "3e2e30ef-2bd1-4569-9cba-adee11380c0d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:40.949496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dbb5b73d-7664-4999-9805-f36d50eb5cad tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:40.950130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dbb5b73d-7664-4999-9805-f36d50eb5cad tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:40.958704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbb5b73d-7664-4999-9805-f36d50eb5cad tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.959438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbb5b73d-7664-4999-9805-f36d50eb5cad tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.960420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbb5b73d-7664-4999-9805-f36d50eb5cad tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.961070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbb5b73d-7664-4999-9805-f36d50eb5cad tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.112273 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-931c39ad-7061-4365-a00c-5409ad8c9298 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.273557 Jul 20 04:14:41.112273 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 657/1365] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:14:40 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:41.130549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6cb07ff-0aec-4204-951f-c15a0198192c tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Calling method '.version_select at 0x7fbf9d591280>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.215294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dbb5b73d-7664-4999-9805-f36d50eb5cad tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:41.221221 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a6cb07ff-0aec-4204-951f-c15a0198192c tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/3e2e30ef-2bd1-4569-9cba-adee11380c0d" status: 200 len: 664 microversion: 2.1 time: 0.098452 Jul 20 04:14:41.222413 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 658/1366] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:14:41 2022] GET /compute/v2.1/os-security-groups/3e2e30ef-2bd1-4569-9cba-adee11380c0d => generated 664 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:41.228744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ce9e2acd-304d-4ff4-ba40-1877667d1496 tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.230565 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:41.230565 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:14:41.231825 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dbb5b73d-7664-4999-9805-f36d50eb5cad tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.293242 Jul 20 04:14:41.236419 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 709/1367] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:40 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:41.247309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-000cc5d8-fcfb-4e1e-b2c0-5cc008e6a4e6 req-3f5bd1b0-835b-45da-8d9f-dddba275efa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f32f3c69-0926-47e2-9498-38ca38aa5035", "name": "network-vif-deleted", "tag": "68b20988-ab90-4e07-8ec9-d18b65a6edbc"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:41.262769 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ce9e2acd-304d-4ff4-ba40-1877667d1496 tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/374739863" status: 202 len: 0 microversion: 2.1 time: 0.038610 Jul 20 04:14:41.266433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-000cc5d8-fcfb-4e1e-b2c0-5cc008e6a4e6 req-3f5bd1b0-835b-45da-8d9f-dddba275efa7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.267209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-000cc5d8-fcfb-4e1e-b2c0-5cc008e6a4e6 req-3f5bd1b0-835b-45da-8d9f-dddba275efa7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.267647 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 659/1368] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:14:41 2022] DELETE /compute/v2.1/flavors/374739863 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:41.274444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-80c300a9-d6b9-46a0-928b-e09e48d49ccf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.275317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-80c300a9-d6b9-46a0-928b-e09e48d49ccf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:41.279565 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-000cc5d8-fcfb-4e1e-b2c0-5cc008e6a4e6 req-3f5bd1b0-835b-45da-8d9f-dddba275efa7 service nova] Creating event network-vif-deleted:68b20988-ab90-4e07-8ec9-d18b65a6edbc for instance f32f3c69-0926-47e2-9498-38ca38aa5035 on n-h1-764485-11 Jul 20 04:14:41.283555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80c300a9-d6b9-46a0-928b-e09e48d49ccf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.284240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80c300a9-d6b9-46a0-928b-e09e48d49ccf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.284568 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-000cc5d8-fcfb-4e1e-b2c0-5cc008e6a4e6 req-3f5bd1b0-835b-45da-8d9f-dddba275efa7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043317 Jul 20 04:14:41.285774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80c300a9-d6b9-46a0-928b-e09e48d49ccf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.286518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80c300a9-d6b9-46a0-928b-e09e48d49ccf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.288944 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 710/1369] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:41.295058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ba0a71e-4dc9-40d1-af7f-7daaff5087ba tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Calling method '.version_select at 0x7fbf9d477040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.527253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-80c300a9-d6b9-46a0-928b-e09e48d49ccf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:41.538762 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-80c300a9-d6b9-46a0-928b-e09e48d49ccf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1325 microversion: 2.1 time: 0.269768 Jul 20 04:14:41.540125 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 660/1370] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:41 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1325 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:41.545010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-de58baa7-09da-4c63-818f-4c5c83e8c5bd tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.555766 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8ba0a71e-4dc9-40d1-af7f-7daaff5087ba tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/08431f33-3649-40a7-8808-a19fc6bf082b" status: 202 len: 0 microversion: 2.1 time: 0.265420 Jul 20 04:14:41.561911 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 711/1371] 10.222.0.20 () {58 vars in 1286 bytes} [Wed Jul 20 04:14:41 2022] DELETE /compute/v2.1/os-security-group-rules/08431f33-3649-40a7-8808-a19fc6bf082b => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:41.567357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09165c12-64f2-4aba-9294-831d28f11cc1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.568494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-09165c12-64f2-4aba-9294-831d28f11cc1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:41.573384 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-de58baa7-09da-4c63-818f-4c5c83e8c5bd tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.032136 Jul 20 04:14:41.574828 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 661/1372] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:41 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:41.580476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6d0ac21f-08d3-4c98-82a2-4d0905a4fd69 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Calling method '.version_select at 0x7fbf9d61b4c0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.595457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09165c12-64f2-4aba-9294-831d28f11cc1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.598852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09165c12-64f2-4aba-9294-831d28f11cc1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.599720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09165c12-64f2-4aba-9294-831d28f11cc1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.600164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09165c12-64f2-4aba-9294-831d28f11cc1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.856562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-09165c12-64f2-4aba-9294-831d28f11cc1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:41.864374 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-09165c12-64f2-4aba-9294-831d28f11cc1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1541 microversion: 2.1 time: 0.300764 Jul 20 04:14:41.864953 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 712/1373] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:41 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1541 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:41.869500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f036e962-dc55-4e2b-94b1-f5c51807d07b tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.870368 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:41.870368 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:14:41.888868 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f036e962-dc55-4e2b-94b1-f5c51807d07b tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/732991214" status: 202 len: 0 microversion: 2.1 time: 0.022629 Jul 20 04:14:41.893673 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 713/1374] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:14:41 2022] DELETE /compute/v2.1/flavors/732991214 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:41.900505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db94db9c-1fb0-4399-ba47-a4236e12bfc1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.901178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-db94db9c-1fb0-4399-ba47-a4236e12bfc1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] [instance: f32f3c69-0926-47e2-9498-38ca38aa5035] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:41.909375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db94db9c-1fb0-4399-ba47-a4236e12bfc1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.909897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db94db9c-1fb0-4399-ba47-a4236e12bfc1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.912268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db94db9c-1fb0-4399-ba47-a4236e12bfc1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.912716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db94db9c-1fb0-4399-ba47-a4236e12bfc1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.930765 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-db94db9c-1fb0-4399-ba47-a4236e12bfc1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] HTTP exception thrown: Instance f32f3c69-0926-47e2-9498-38ca38aa5035 could not be found. Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db94db9c-1fb0-4399-ba47-a4236e12bfc1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Request method failure captured: Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 HTTP/1.1 Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BonZlQ2CRDfzy6JrdRaenVAP-bduTz2PxNs1mEGbtKMzvT-dul-9gf5wGDHb6-Ja3TZF-9wwGwHGzbe7xYytuKZ9ZEwl5liwrF5viKSArG_B5Iy_1d92vxWXWEjPLijtdray9LRHIdMdb-s1LiPXCMilU7o988KC_mdB6zGGRpmqU Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:41.932468 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:41.934036 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d46b20455b6a4fc39ff3676f6ce1b801", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d46b20455b6a4fc39ff3676f6ce1b801"}]}] Jul 20 04:14:41.934036 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:41.934036 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: d46b20455b6a4fc39ff3676f6ce1b801 Jul 20 04:14:41.934036 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2076898807 Jul 20 04:14:41.934036 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:41.934036 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:41.934036 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:41.934036 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 5b0144f0f8694ba4b177c86a768a25e9 Jul 20 04:14:41.934036 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersOnMultiNodesTest-2076898807-project Jul 20 04:14:41.934036 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:41.934036 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance f32f3c69-0926-47e2-9498-38ca38aa5035 could not be found. Jul 20 04:14:41.934036 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'f32f3c69-0926-47e2-9498-38ca38aa5035'} Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f32f3c69-0926-47e2-9498-38ca38aa5035 could not be found. Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:41.934824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f32f3c69-0926-47e2-9498-38ca38aa5035 could not be found. Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f32f3c69-0926-47e2-9498-38ca38aa5035 could not be found. Jul 20 04:14:41.936819 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:41.939317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db94db9c-1fb0-4399-ba47-a4236e12bfc1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] Returning 404 to user: Instance f32f3c69-0926-47e2-9498-38ca38aa5035 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:41.939317 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-db94db9c-1fb0-4399-ba47-a4236e12bfc1 tempest-ServersOnMultiNodesTest-2076898807 tempest-ServersOnMultiNodesTest-2076898807-project] 10.222.0.20 "GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035" status: 404 len: 111 microversion: 2.1 time: 0.038264 Jul 20 04:14:41.939317 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 714/1375] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:41 2022] GET /compute/v2.1/servers/f32f3c69-0926-47e2-9498-38ca38aa5035 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:41.944035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9f8c0f12-8591-4d6e-a245-d5aa314e070f tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.954955 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6d0ac21f-08d3-4c98-82a2-4d0905a4fd69 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/3e2e30ef-2bd1-4569-9cba-adee11380c0d" status: 202 len: 0 microversion: 2.1 time: 0.378803 Jul 20 04:14:41.955869 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 662/1376] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:41 2022] DELETE /compute/v2.1/os-security-groups/3e2e30ef-2bd1-4569-9cba-adee11380c0d => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:41.964992 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9f8c0f12-8591-4d6e-a245-d5aa314e070f tempest-ServersWithSpecificFlavorTestJSON-341057051 tempest-ServersWithSpecificFlavorTestJSON-341057051-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029073 Jul 20 04:14:41.965548 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 715/1377] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:41.966012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ddab329b-ebcc-46d3-968a-447f89b66ec3 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Calling method '.version_select at 0x7fbf9d67bc10>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.986474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61887c2e-6fce-4ed1-a62f-89e10c3a810c tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.986986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-61887c2e-6fce-4ed1-a62f-89e10c3a810c tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:41.997388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61887c2e-6fce-4ed1-a62f-89e10c3a810c tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.997809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61887c2e-6fce-4ed1-a62f-89e10c3a810c tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.998457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61887c2e-6fce-4ed1-a62f-89e10c3a810c tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.998962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61887c2e-6fce-4ed1-a62f-89e10c3a810c tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.004028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-ddab329b-ebcc-46d3-968a-447f89b66ec3 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e9de1d23-f6c2-4bca-8105-cef5fe5c7a69 does not exist", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:14:42.004982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.security_group_api [None req-ddab329b-ebcc-46d3-968a-447f89b66ec3 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Neutron security group e9de1d23-f6c2-4bca-8105-cef5fe5c7a69 not found {{(pid=119807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:14:42.005534 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-ddab329b-ebcc-46d3-968a-447f89b66ec3 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] HTTP exception thrown: Security group e9de1d23-f6c2-4bca-8105-cef5fe5c7a69 does not exist Jul 20 04:14:42.005534 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-f0b668b9-1e36-434b-809d-f3bd2948d5a2'] Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ddab329b-ebcc-46d3-968a-447f89b66ec3 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Request method failure captured: Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-security-groups/e9de1d23-f6c2-4bca-8105-cef5fe5c7a69 HTTP/1.1 Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14EkKixWhwt_Zik7Hf9_3pImzy0KoB5KZxiOx3ykV85rXuSWilfwImGY5drHtCTpELWPqIAbosEtCMWVnfeZKon94-3J45wlNYvnNujGDC91_uwsasloAFil290Rq36ZeOZqaKq4uayaUiLdH6DJksGuM7tk6S5bt-OKMFUP7LkjCRg Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: c06a44b7b23c4aedb5e168601f9055e1 Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-320436594 Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:42.010917 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c06a44b7b23c4aedb5e168601f9055e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c06a44b7b23c4aedb5e168601f9055e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c06a44b7b23c4aedb5e168601f9055e1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c06a44b7b23c4aedb5e168601f9055e1"}]}] Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupRulesTestJSON-320436594 Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: c06a44b7b23c4aedb5e168601f9055e1 Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-320436594 Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupRulesTestJSON-320436594-project Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: d2060f9aafd6464a9d45f031d7849ae2 Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupRulesTestJSON-320436594-project Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: exception: Security group e9de1d23-f6c2-4bca-8105-cef5fe5c7a69 does not exist Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-f0b668b9-1e36-434b-809d-f3bd2948d5a2'] Jul 20 04:14:42.012492 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'e9de1d23-f6c2-4bca-8105-cef5fe5c7a69'} Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:42.013491 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e9de1d23-f6c2-4bca-8105-cef5fe5c7a69 does not exist Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0b668b9-1e36-434b-809d-f3bd2948d5a2'] Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:14:42.014785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e9de1d23-f6c2-4bca-8105-cef5fe5c7a69 does not exist Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0b668b9-1e36-434b-809d-f3bd2948d5a2'] Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e9de1d23-f6c2-4bca-8105-cef5fe5c7a69 does not exist Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0b668b9-1e36-434b-809d-f3bd2948d5a2'] Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.016383 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.018904 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:42.018904 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:42.018904 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:42.018904 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:42.018904 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e9de1d23-f6c2-4bca-8105-cef5fe5c7a69 does not exist Jul 20 04:14:42.018904 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0b668b9-1e36-434b-809d-f3bd2948d5a2'] Jul 20 04:14:42.018904 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.018904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ddab329b-ebcc-46d3-968a-447f89b66ec3 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Returning 404 to user: Security group e9de1d23-f6c2-4bca-8105-cef5fe5c7a69 does not exist Jul 20 04:14:42.018904 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-f0b668b9-1e36-434b-809d-f3bd2948d5a2'] {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:42.018904 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ddab329b-ebcc-46d3-968a-447f89b66ec3 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e9de1d23-f6c2-4bca-8105-cef5fe5c7a69" status: 404 len: 194 microversion: 2.1 time: 0.050537 Jul 20 04:14:42.018904 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 663/1378] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:41 2022] DELETE /compute/v2.1/os-security-groups/e9de1d23-f6c2-4bca-8105-cef5fe5c7a69 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:42.023624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5cbb1698-4553-4116-bb6b-3353c5cf44b6 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Calling method '.version_select at 0x7fbf9d451430>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.024646 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-61887c2e-6fce-4ed1-a62f-89e10c3a810c tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] HTTP exception thrown: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61887c2e-6fce-4ed1-a62f-89e10c3a810c tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Request method failure captured: Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 HTTP/1.1 Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AqGSwljZ4607PE1v-i4JXIhIPfSNc4a-Ew-0m-hQLpDSdPNOx5NtAMwY_0hlKHA5B30yYtUSHzdsYYNSpM8bWduVZeauokMMnePmJrzcLIg39vLCxM8xg5Z51fWD6WXDqHPAn6PBfoYU15AuNf_nC-A6n9HyvjAcxP4rNkIxxxjoc Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:42.026404 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:42.029142 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8300f36d34c9455aabd936f5d69e130f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}] Jul 20 04:14:42.029142 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:42.029142 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:42.029142 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:42.029142 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:42.029142 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:42.029142 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:42.029142 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8aa6cffe813a43769950e2e05c45c82b Jul 20 04:14:42.029142 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:42.029142 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:42.029142 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:42.029142 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'd1780efb-bbd4-44eb-8fd2-7edbfa5bd516'} Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:42.030789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:42.035630 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.038137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61887c2e-6fce-4ed1-a62f-89e10c3a810c tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Returning 404 to user: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:42.038137 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-61887c2e-6fce-4ed1-a62f-89e10c3a810c tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 404 len: 111 microversion: 2.1 time: 0.045017 Jul 20 04:14:42.038137 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 716/1379] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:41 2022] DELETE /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:14:42.042742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e2059be5-3d6c-446b-9a0c-0454e5d6bfcd tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.043471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e2059be5-3d6c-446b-9a0c-0454e5d6bfcd tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: d1780efb-bbd4-44eb-8fd2-7edbfa5bd516] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:42.049877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2059be5-3d6c-446b-9a0c-0454e5d6bfcd tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.050319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2059be5-3d6c-446b-9a0c-0454e5d6bfcd tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.051353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2059be5-3d6c-446b-9a0c-0454e5d6bfcd tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.052160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2059be5-3d6c-446b-9a0c-0454e5d6bfcd tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.068370 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-e2059be5-3d6c-446b-9a0c-0454e5d6bfcd tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] HTTP exception thrown: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e2059be5-3d6c-446b-9a0c-0454e5d6bfcd tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Request method failure captured: Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 HTTP/1.1 Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AqGSwljZ4607PE1v-i4JXIhIPfSNc4a-Ew-0m-hQLpDSdPNOx5NtAMwY_0hlKHA5B30yYtUSHzdsYYNSpM8bWduVZeauokMMnePmJrzcLIg39vLCxM8xg5Z51fWD6WXDqHPAn6PBfoYU15AuNf_nC-A6n9HyvjAcxP4rNkIxxxjoc Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:42.070433 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:42.071919 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8300f36d34c9455aabd936f5d69e130f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}] Jul 20 04:14:42.071919 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:42.071919 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:42.071919 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:42.071919 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:42.071919 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:42.071919 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:42.071919 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8aa6cffe813a43769950e2e05c45c82b Jul 20 04:14:42.071919 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:42.071919 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:42.071919 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:42.071919 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'd1780efb-bbd4-44eb-8fd2-7edbfa5bd516'} Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:42.072701 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. Jul 20 04:14:42.074008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.075131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e2059be5-3d6c-446b-9a0c-0454e5d6bfcd tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Returning 404 to user: Instance d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:42.075131 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e2059be5-3d6c-446b-9a0c-0454e5d6bfcd tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516" status: 404 len: 111 microversion: 2.1 time: 0.036361 Jul 20 04:14:42.075850 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 717/1380] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:42 2022] GET /compute/v2.1/servers/d1780efb-bbd4-44eb-8fd2-7edbfa5bd516 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:42.081137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6ccae7a1-0280-4a24-87ac-ee4d782b1e97 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.082880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6ccae7a1-0280-4a24-87ac-ee4d782b1e97 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:42.089214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ccae7a1-0280-4a24-87ac-ee4d782b1e97 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.089897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ccae7a1-0280-4a24-87ac-ee4d782b1e97 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.091031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ccae7a1-0280-4a24-87ac-ee4d782b1e97 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.091649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ccae7a1-0280-4a24-87ac-ee4d782b1e97 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.107332 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-6ccae7a1-0280-4a24-87ac-ee4d782b1e97 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] HTTP exception thrown: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6ccae7a1-0280-4a24-87ac-ee4d782b1e97 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Request method failure captured: Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 HTTP/1.1 Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AqGSwljZ4607PE1v-i4JXIhIPfSNc4a-Ew-0m-hQLpDSdPNOx5NtAMwY_0hlKHA5B30yYtUSHzdsYYNSpM8bWduVZeauokMMnePmJrzcLIg39vLCxM8xg5Z51fWD6WXDqHPAn6PBfoYU15AuNf_nC-A6n9HyvjAcxP4rNkIxxxjoc Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:42.108934 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:42.110284 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8300f36d34c9455aabd936f5d69e130f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}] Jul 20 04:14:42.110284 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:42.110284 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:42.110284 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:42.110284 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:42.110284 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:42.110284 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:42.110284 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8aa6cffe813a43769950e2e05c45c82b Jul 20 04:14:42.110284 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:42.110284 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:42.110284 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:42.110284 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'c50659bf-f42b-4cb4-899f-20eeaf84e5c1'} Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:42.111055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:42.112341 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.113760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6ccae7a1-0280-4a24-87ac-ee4d782b1e97 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Returning 404 to user: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:42.113760 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6ccae7a1-0280-4a24-87ac-ee4d782b1e97 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 404 len: 111 microversion: 2.1 time: 0.033129 Jul 20 04:14:42.114005 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 718/1381] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:42 2022] DELETE /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:42.118828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6a0e61c2-5e7a-4a6c-9bbd-fee6e74bd516 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.119860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6a0e61c2-5e7a-4a6c-9bbd-fee6e74bd516 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] [instance: c50659bf-f42b-4cb4-899f-20eeaf84e5c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:42.127701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a0e61c2-5e7a-4a6c-9bbd-fee6e74bd516 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.128365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a0e61c2-5e7a-4a6c-9bbd-fee6e74bd516 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.129711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a0e61c2-5e7a-4a6c-9bbd-fee6e74bd516 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.130306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a0e61c2-5e7a-4a6c-9bbd-fee6e74bd516 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.146473 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-6a0e61c2-5e7a-4a6c-9bbd-fee6e74bd516 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] HTTP exception thrown: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6a0e61c2-5e7a-4a6c-9bbd-fee6e74bd516 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Request method failure captured: Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 HTTP/1.1 Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14AqGSwljZ4607PE1v-i4JXIhIPfSNc4a-Ew-0m-hQLpDSdPNOx5NtAMwY_0hlKHA5B30yYtUSHzdsYYNSpM8bWduVZeauokMMnePmJrzcLIg39vLCxM8xg5Z51fWD6WXDqHPAn6PBfoYU15AuNf_nC-A6n9HyvjAcxP4rNkIxxxjoc Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:42.148604 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:42.150112 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8300f36d34c9455aabd936f5d69e130f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8300f36d34c9455aabd936f5d69e130f"}]}] Jul 20 04:14:42.150112 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:42.150112 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 8300f36d34c9455aabd936f5d69e130f Jul 20 04:14:42.150112 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783 Jul 20 04:14:42.150112 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:42.150112 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:42.150112 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:42.150112 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8aa6cffe813a43769950e2e05c45c82b Jul 20 04:14:42.150112 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1580959783-project Jul 20 04:14:42.150112 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:42.150112 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:42.150112 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'c50659bf-f42b-4cb4-899f-20eeaf84e5c1'} Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:42.150948 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. Jul 20 04:14:42.152291 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:42.155027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6a0e61c2-5e7a-4a6c-9bbd-fee6e74bd516 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] Returning 404 to user: Instance c50659bf-f42b-4cb4-899f-20eeaf84e5c1 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:42.156396 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6a0e61c2-5e7a-4a6c-9bbd-fee6e74bd516 tempest-ServersWithSpecificFlavorTestJSON-1580959783 tempest-ServersWithSpecificFlavorTestJSON-1580959783-project] 10.222.0.20 "GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1" status: 404 len: 111 microversion: 2.1 time: 0.041060 Jul 20 04:14:42.161355 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 719/1382] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:42 2022] GET /compute/v2.1/servers/c50659bf-f42b-4cb4-899f-20eeaf84e5c1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:42.250198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7dfe54a9-6723-4ff1-99b0-dc46f8b45c35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.250845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7dfe54a9-6723-4ff1-99b0-dc46f8b45c35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:42.258112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7dfe54a9-6723-4ff1-99b0-dc46f8b45c35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.262803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7dfe54a9-6723-4ff1-99b0-dc46f8b45c35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.263678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7dfe54a9-6723-4ff1-99b0-dc46f8b45c35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.266205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7dfe54a9-6723-4ff1-99b0-dc46f8b45c35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.297050 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5cbb1698-4553-4116-bb6b-3353c5cf44b6 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cccdcf95-e5d8-452c-915d-a158c54d6c97" status: 202 len: 0 microversion: 2.1 time: 0.279660 Jul 20 04:14:42.301653 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 664/1383] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:42 2022] DELETE /compute/v2.1/os-security-groups/cccdcf95-e5d8-452c-915d-a158c54d6c97 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:42.307971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d2a82df1-f577-474f-844a-5f7e0923e4eb tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Calling method '.version_select at 0x7fbf9dd9a700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.530166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7dfe54a9-6723-4ff1-99b0-dc46f8b45c35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:42.541997 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7dfe54a9-6723-4ff1-99b0-dc46f8b45c35 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.293763 Jul 20 04:14:42.544392 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 720/1384] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:42 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:42.562182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ef13631a-ccb4-4097-bc9e-26b139c9b504 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.562997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ef13631a-ccb4-4097-bc9e-26b139c9b504 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:42.575881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef13631a-ccb4-4097-bc9e-26b139c9b504 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.576683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef13631a-ccb4-4097-bc9e-26b139c9b504 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.578196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef13631a-ccb4-4097-bc9e-26b139c9b504 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.578908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef13631a-ccb4-4097-bc9e-26b139c9b504 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.836733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ef13631a-ccb4-4097-bc9e-26b139c9b504 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:42.845637 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ef13631a-ccb4-4097-bc9e-26b139c9b504 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1325 microversion: 2.1 time: 0.288746 Jul 20 04:14:42.846460 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 721/1385] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:42 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1325 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:42.853209 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d2a82df1-f577-474f-844a-5f7e0923e4eb tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/81f37aa8-4aaa-43cf-9555-a9c40f5f979c" status: 202 len: 0 microversion: 2.1 time: 0.549749 Jul 20 04:14:42.854072 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 665/1386] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:42 2022] DELETE /compute/v2.1/os-security-groups/81f37aa8-4aaa-43cf-9555-a9c40f5f979c => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:42.865242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8a3a1cdf-cc7b-4a11-8c14-57c24c5562dc tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Calling method '.version_select at 0x7fbf9d591ee0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.016132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fc2372ca-408c-4c18-b035-a55cade0e79d tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Action: 'create', calling method: .version_select at 0x7fbf9d427820>, body: {"keypair": {"name": "tempest-keypair-1680845937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9+n/tf3IcqV6BCBevwVlig2R2vaCrDKT25num/dcixgCuXO+/uIT92CNiA5Qu8XcXgoo80IbDaCIyKdUOEqg6ulQE+X+luGrMxrGD+qnqfxd82XZ7wjwzFjr4DWc9GJQ=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:43.034120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-fc2372ca-408c-4c18-b035-a55cade0e79d tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Getting quotas for project d936301751244098bdcc2d346766a0b3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:43.040755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-fc2372ca-408c-4c18-b035-a55cade0e79d tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Getting quotas for user 35a1d10ba0cf4cb6b57c32188a4ec016 and project d936301751244098bdcc2d346766a0b3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:43.072167 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fc2372ca-408c-4c18-b035-a55cade0e79d tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.223058 Jul 20 04:14:43.072784 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 722/1387] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:14:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:43.079757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b3c85903-2c0e-49b6-9736-50c47135421c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.080563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b3c85903-2c0e-49b6-9736-50c47135421c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:43.084878 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8a3a1cdf-cc7b-4a11-8c14-57c24c5562dc tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f1992bd8-bc61-41d9-b36a-36eafad8ba73" status: 202 len: 0 microversion: 2.1 time: 0.223491 Jul 20 04:14:43.085998 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 666/1388] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:42 2022] DELETE /compute/v2.1/os-security-groups/f1992bd8-bc61-41d9-b36a-36eafad8ba73 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:14:43.091022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3c85903-2c0e-49b6-9736-50c47135421c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.091477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3c85903-2c0e-49b6-9736-50c47135421c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.091863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-32eaf742-e3e5-4869-9643-11fb7750e39e tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Calling method '.version_select at 0x7fbf9d451310>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.092768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3c85903-2c0e-49b6-9736-50c47135421c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.093216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3c85903-2c0e-49b6-9736-50c47135421c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.101741 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-32eaf742-e3e5-4869-9643-11fb7750e39e tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1680845937" status: 200 len: 498 microversion: 2.1 time: 0.014480 Jul 20 04:14:43.109104 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 667/1389] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 20 04:14:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1680845937 => generated 498 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:43.128011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-44c371d3-53ab-4c06-be6f-2268abd6d863 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Calling method '.version_select at 0x7fbf9d450700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.335471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b3c85903-2c0e-49b6-9736-50c47135421c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:43.343711 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b3c85903-2c0e-49b6-9736-50c47135421c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1541 microversion: 2.1 time: 0.269783 Jul 20 04:14:43.347567 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 723/1390] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:43 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1541 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:43.353106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-25823141-e4af-4893-90da-7b4d2e997975 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Calling method '.version_select at 0x7fbf9d50f670>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.399429 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-25823141-e4af-4893-90da-7b4d2e997975 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680845937" status: 202 len: 0 microversion: 2.1 time: 0.049965 Jul 20 04:14:43.401517 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 724/1391] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 04:14:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680845937 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:43.417137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f1457946-0aae-4477-8ae5-74928375ab88 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Action: 'create', calling method: .version_select at 0x7fbf9d477670>, body: {"keypair": {"name": "tempest-keypair-661294217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3g3nCfv0SuVsLj4xL2lw2bRMZwL4nC9NoLV+NOmH25N1vSmGIxJYfbYwNhPn9fWw44jmgZXhN+VvmuIKkpiqOTy5n5GUx9L42sonmBns1ma3sisx4fYkkSEsNkk/tCsQ=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:43.447064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-f1457946-0aae-4477-8ae5-74928375ab88 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Getting quotas for project d936301751244098bdcc2d346766a0b3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:43.455427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-f1457946-0aae-4477-8ae5-74928375ab88 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Getting quotas for user 35a1d10ba0cf4cb6b57c32188a4ec016 and project d936301751244098bdcc2d346766a0b3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:43.462161 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-44c371d3-53ab-4c06-be6f-2268abd6d863 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/bbb4c3c2-7f6f-47cb-8d82-7c9272abbdc9" status: 202 len: 0 microversion: 2.1 time: 0.350894 Jul 20 04:14:43.462999 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 668/1392] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:43 2022] DELETE /compute/v2.1/os-security-groups/bbb4c3c2-7f6f-47cb-8d82-7c9272abbdc9 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:43.475284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1af9d50b-b946-43f3-ab66-8c729a71efe4 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] Calling method '.version_select at 0x7fbf9d450ca0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.484146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:43.494640 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f1457946-0aae-4477-8ae5-74928375ab88 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.084229 Jul 20 04:14:43.504679 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 725/1393] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:14:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:43.510178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0e4f8adf-3923-438e-ad9c-57e89be688b2 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Calling method '.version_select at 0x7fbf9d4773a0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.542981 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0e4f8adf-3923-438e-ad9c-57e89be688b2 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-661294217" status: 202 len: 0 microversion: 2.1 time: 0.036937 Jul 20 04:14:43.543985 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 726/1394] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 20 04:14:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-661294217 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:43.561922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-23530df9-d32c-4360-a713-3275e0254a73 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Action: 'create', calling method: .version_select at 0x7fbf9d427ee0>, body: {"keypair": {"name": "tempest-keypair-636186670", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:43.582062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-23530df9-d32c-4360-a713-3275e0254a73 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Getting quotas for project d936301751244098bdcc2d346766a0b3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:43.589248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-23530df9-d32c-4360-a713-3275e0254a73 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Getting quotas for user 35a1d10ba0cf4cb6b57c32188a4ec016 and project d936301751244098bdcc2d346766a0b3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:43.619761 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-23530df9-d32c-4360-a713-3275e0254a73 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.066387 Jul 20 04:14:43.620800 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 727/1395] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:14:43 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:43.630578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-90732fab-7558-4935-86c0-9cd3332dba2c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.631256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-90732fab-7558-4935-86c0-9cd3332dba2c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:43.642378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90732fab-7558-4935-86c0-9cd3332dba2c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.642954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90732fab-7558-4935-86c0-9cd3332dba2c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.644948 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90732fab-7558-4935-86c0-9cd3332dba2c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.645912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90732fab-7558-4935-86c0-9cd3332dba2c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.696467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:43.727306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:43.824425 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1af9d50b-b946-43f3-ab66-8c729a71efe4 tempest-SecurityGroupRulesTestJSON-320436594 tempest-SecurityGroupRulesTestJSON-320436594-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/3892b522-54de-4565-8bf5-42cf62ff8741" status: 202 len: 0 microversion: 2.1 time: 0.356977 Jul 20 04:14:43.828968 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 669/1396] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:43 2022] DELETE /compute/v2.1/os-security-groups/3892b522-54de-4565-8bf5-42cf62ff8741 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:43.834533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4b092f75-8712-4e04-bdd4-156dba816f0e tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Calling method '.version_select at 0x7fbf9d450700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.869503 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4b092f75-8712-4e04-bdd4-156dba816f0e tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-636186670" status: 202 len: 0 microversion: 2.1 time: 0.038616 Jul 20 04:14:43.870769 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 670/1397] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 20 04:14:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-636186670 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:43.876448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b41aa38c-7829-4af5-acea-9af1d0c29c05 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:43.877965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b41aa38c-7829-4af5-acea-9af1d0c29c05 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:43.885446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b41aa38c-7829-4af5-acea-9af1d0c29c05 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.886158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b41aa38c-7829-4af5-acea-9af1d0c29c05 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.887170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b41aa38c-7829-4af5-acea-9af1d0c29c05 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:43.887922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b41aa38c-7829-4af5-acea-9af1d0c29c05 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.899245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-90732fab-7558-4935-86c0-9cd3332dba2c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:43.909190 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-90732fab-7558-4935-86c0-9cd3332dba2c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.287208 Jul 20 04:14:43.913672 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 728/1398] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:43 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:43.926579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-22c0eb6e-a8f5-4ea6-b219-6ee93b515769 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Action: 'create', calling method: .version_select at 0x7fbf9d3f9430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1866571678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwRk7bn5HDzigi93RTIkdSa/FotsO6RZlLNgm0TFgyUq8XIh1kVgezfpl/CS3J6102GMs4m5gwBaXH4B3M9przDClYICQt+OO1rsHM6g9Krc4FXihOvd7x5YsQjw6PAVg=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:43.958450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-22c0eb6e-a8f5-4ea6-b219-6ee93b515769 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Getting quotas for project d936301751244098bdcc2d346766a0b3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:43.964455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-22c0eb6e-a8f5-4ea6-b219-6ee93b515769 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Getting quotas for user 35a1d10ba0cf4cb6b57c32188a4ec016 and project d936301751244098bdcc2d346766a0b3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:43.992690 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-22c0eb6e-a8f5-4ea6-b219-6ee93b515769 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.077888 Jul 20 04:14:43.993605 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 729/1399] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:14:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:44.006835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-594e8fdd-51f5-4465-8f4b-d6cf002db57a tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Action: 'create', calling method: .version_select at 0x7fbf9d47aca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-836818895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmk47OouHNufN2tuE5DLHJbDYfmaECNlm+xo+YnFQtsSiysspcLP8MJPgCmmodB1mvjeEI1VYWAArXwAPjw4AMw4j3+nXICyDuD9O/qKahFY5p1jceD3buLv1iCTegK2g=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:44.024061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-594e8fdd-51f5-4465-8f4b-d6cf002db57a tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Getting quotas for project d936301751244098bdcc2d346766a0b3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:44.034289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-594e8fdd-51f5-4465-8f4b-d6cf002db57a tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Getting quotas for user 35a1d10ba0cf4cb6b57c32188a4ec016 and project d936301751244098bdcc2d346766a0b3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:44.078206 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-594e8fdd-51f5-4465-8f4b-d6cf002db57a tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.076298 Jul 20 04:14:44.078990 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 730/1400] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:14:44 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:44.094021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0e993f7d-a46a-44e4-9ab4-ed74148aec57 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Action: 'create', calling method: .version_select at 0x7fbf9d47a1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1156735042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGb02R11thYBy4IBYYmBWS/3J3qZcI/6Donp8ZJptlYsNvg/KJZTjHNY25HlLi1XihdaOpMZYU//aXs+uyp6d2ysCJ9S6uvHobfh0ds5Za4pBIFybrVG8p40TUZTZfshw=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:44.109488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0e993f7d-a46a-44e4-9ab4-ed74148aec57 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Getting quotas for project d936301751244098bdcc2d346766a0b3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:44.115194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0e993f7d-a46a-44e4-9ab4-ed74148aec57 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Getting quotas for user 35a1d10ba0cf4cb6b57c32188a4ec016 and project d936301751244098bdcc2d346766a0b3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:44.142446 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0e993f7d-a46a-44e4-9ab4-ed74148aec57 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.052303 Jul 20 04:14:44.149503 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 731/1401] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:14:44 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:44.155919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-acec4608-7e09-4d2c-9a3a-26d4766ad2ab tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Calling method '.version_select at 0x7fbf9d3f9a60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:44.159110 n-d-764485-11 devstack@n-api.service[119808]: WARNING oslo_db.sqlalchemy.utils [None req-acec4608-7e09-4d2c-9a3a-26d4766ad2ab tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:14:44.166413 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-acec4608-7e09-4d2c-9a3a-26d4766ad2ab tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.015706 Jul 20 04:14:44.172010 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 732/1402] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:44 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:44.177531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-33be689c-ae32-4b60-9786-6b4e56672acf tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Calling method '.version_select at 0x7fbf9d477ee0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:44.212881 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-33be689c-ae32-4b60-9786-6b4e56672acf tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1156735042" status: 202 len: 0 microversion: 2.1 time: 0.039636 Jul 20 04:14:44.215758 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 733/1403] 10.222.0.20 () {58 vars in 1277 bytes} [Wed Jul 20 04:14:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1156735042 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:14:44.223621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-703a2ec2-3e82-413b-8555-5c9d1a681a06 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Calling method '.version_select at 0x7fbf9d3fa5e0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:44.227372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b41aa38c-7829-4af5-acea-9af1d0c29c05 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:44.246460 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b41aa38c-7829-4af5-acea-9af1d0c29c05 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1325 microversion: 2.1 time: 0.373996 Jul 20 04:14:44.247734 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 671/1404] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:43 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1325 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:44.279195 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-703a2ec2-3e82-413b-8555-5c9d1a681a06 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-836818895" status: 202 len: 0 microversion: 2.1 time: 0.059469 Jul 20 04:14:44.280756 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 734/1405] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:14:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-836818895 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:44.296030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ffb12e91-10bd-4738-acb7-587c11104d00 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] Calling method '.version_select at 0x7fbf9d61b670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:44.329882 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ffb12e91-10bd-4738-acb7-587c11104d00 tempest-KeyPairsV2TestJSON-509712748 tempest-KeyPairsV2TestJSON-509712748-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1866571678" status: 202 len: 0 microversion: 2.1 time: 0.043197 Jul 20 04:14:44.333650 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 672/1406] 10.222.0.20 () {58 vars in 1277 bytes} [Wed Jul 20 04:14:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1866571678 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:44.370538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5dd399fc-7a8c-48e1-9e6c-b17de0bb6608 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:44.371163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5dd399fc-7a8c-48e1-9e6c-b17de0bb6608 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:44.393876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5dd399fc-7a8c-48e1-9e6c-b17de0bb6608 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:44.396711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5dd399fc-7a8c-48e1-9e6c-b17de0bb6608 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:44.398472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5dd399fc-7a8c-48e1-9e6c-b17de0bb6608 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:44.401203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5dd399fc-7a8c-48e1-9e6c-b17de0bb6608 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:44.697759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5dd399fc-7a8c-48e1-9e6c-b17de0bb6608 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:44.705728 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5dd399fc-7a8c-48e1-9e6c-b17de0bb6608 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1540 microversion: 2.1 time: 0.342623 Jul 20 04:14:44.706241 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 735/1407] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:44 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1540 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:44.933219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-10c6e1d5-2e1e-4ba3-83b3-4271374329ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:44.934431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-10c6e1d5-2e1e-4ba3-83b3-4271374329ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:44.944927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10c6e1d5-2e1e-4ba3-83b3-4271374329ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:44.946013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10c6e1d5-2e1e-4ba3-83b3-4271374329ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:44.950562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10c6e1d5-2e1e-4ba3-83b3-4271374329ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:44.951326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10c6e1d5-2e1e-4ba3-83b3-4271374329ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.234698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-10c6e1d5-2e1e-4ba3-83b3-4271374329ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:45.246829 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-10c6e1d5-2e1e-4ba3-83b3-4271374329ab tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.321134 Jul 20 04:14:45.248328 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 673/1408] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:44 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:45.265663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aa715d3f-db19-4717-96af-e377bb777ebd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:45.267805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aa715d3f-db19-4717-96af-e377bb777ebd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:45.278818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa715d3f-db19-4717-96af-e377bb777ebd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.280955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa715d3f-db19-4717-96af-e377bb777ebd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.281955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa715d3f-db19-4717-96af-e377bb777ebd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.284559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa715d3f-db19-4717-96af-e377bb777ebd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.673716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aa715d3f-db19-4717-96af-e377bb777ebd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:45.683720 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aa715d3f-db19-4717-96af-e377bb777ebd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1325 microversion: 2.1 time: 0.421787 Jul 20 04:14:45.684743 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 736/1409] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:45 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:45.725170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e7636ad9-09ad-48d3-ab83-a4e01e7adf21 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:45.727316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e7636ad9-09ad-48d3-ab83-a4e01e7adf21 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:45.728739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-119e07e5-1582-4da0-b489-53d5f4a1e449 req-6e8adbe1-316a-4f5d-b683-33c68c3d64c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956609f6-9ca2-4919-988a-2b0d4a740b26", "name": "network-vif-unplugged", "status": "completed", "tag": "cdee7da2-445b-4334-89cc-1a24affa04ae"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:45.740923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7636ad9-09ad-48d3-ab83-a4e01e7adf21 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.743460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-119e07e5-1582-4da0-b489-53d5f4a1e449 req-6e8adbe1-316a-4f5d-b683-33c68c3d64c1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.744005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7636ad9-09ad-48d3-ab83-a4e01e7adf21 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.745416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7636ad9-09ad-48d3-ab83-a4e01e7adf21 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.745992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-119e07e5-1582-4da0-b489-53d5f4a1e449 req-6e8adbe1-316a-4f5d-b683-33c68c3d64c1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.748059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7636ad9-09ad-48d3-ab83-a4e01e7adf21 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.775047 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-119e07e5-1582-4da0-b489-53d5f4a1e449 req-6e8adbe1-316a-4f5d-b683-33c68c3d64c1 service nova] Creating event network-vif-unplugged:cdee7da2-445b-4334-89cc-1a24affa04ae for instance 956609f6-9ca2-4919-988a-2b0d4a740b26 on n-h1-764485-11 Jul 20 04:14:45.787175 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-119e07e5-1582-4da0-b489-53d5f4a1e449 req-6e8adbe1-316a-4f5d-b683-33c68c3d64c1 service nova] Instance 956609f6-9ca2-4919-988a-2b0d4a740b26 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:14:45.809823 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-119e07e5-1582-4da0-b489-53d5f4a1e449 req-6e8adbe1-316a-4f5d-b683-33c68c3d64c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084857 Jul 20 04:14:45.811814 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 737/1410] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:46.134156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e7636ad9-09ad-48d3-ab83-a4e01e7adf21 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:46.145329 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e7636ad9-09ad-48d3-ab83-a4e01e7adf21 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1540 microversion: 2.1 time: 0.424540 Jul 20 04:14:46.161888 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 674/1411] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:45 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1540 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:46.267327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0efcd5d8-4199-4868-9c82-3a2dbe554de5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:46.268085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0efcd5d8-4199-4868-9c82-3a2dbe554de5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:46.282324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0efcd5d8-4199-4868-9c82-3a2dbe554de5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:46.282780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0efcd5d8-4199-4868-9c82-3a2dbe554de5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:46.283604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0efcd5d8-4199-4868-9c82-3a2dbe554de5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:46.284052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0efcd5d8-4199-4868-9c82-3a2dbe554de5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:46.713590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-51524903-466e-4527-ac0d-8ebd14af3e28 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:46.714436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-51524903-466e-4527-ac0d-8ebd14af3e28 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:46.727116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51524903-466e-4527-ac0d-8ebd14af3e28 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:46.731116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51524903-466e-4527-ac0d-8ebd14af3e28 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:46.732458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51524903-466e-4527-ac0d-8ebd14af3e28 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:46.733002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51524903-466e-4527-ac0d-8ebd14af3e28 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.178099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0efcd5d8-4199-4868-9c82-3a2dbe554de5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:47.187413 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0efcd5d8-4199-4868-9c82-3a2dbe554de5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1472 microversion: 2.1 time: 0.925821 Jul 20 04:14:47.191716 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 738/1412] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:46 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1472 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:47.291870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-51524903-466e-4527-ac0d-8ebd14af3e28 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:47.306646 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-51524903-466e-4527-ac0d-8ebd14af3e28 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1325 microversion: 2.1 time: 0.609092 Jul 20 04:14:47.307262 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 675/1413] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:46 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1325 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:47.312955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a877563e-dae7-4b3e-9220-d17df2467a4d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.313724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a877563e-dae7-4b3e-9220-d17df2467a4d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:47.325010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a877563e-dae7-4b3e-9220-d17df2467a4d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.325715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a877563e-dae7-4b3e-9220-d17df2467a4d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.327458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a877563e-dae7-4b3e-9220-d17df2467a4d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.328185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a877563e-dae7-4b3e-9220-d17df2467a4d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.580617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14e84cec-b4bc-4811-997c-2c7c4ba91a96 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.582984 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:47.582984 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:14:47.584977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14e84cec-b4bc-4811-997c-2c7c4ba91a96 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.586646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14e84cec-b4bc-4811-997c-2c7c4ba91a96 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.589207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14e84cec-b4bc-4811-997c-2c7c4ba91a96 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.591074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14e84cec-b4bc-4811-997c-2c7c4ba91a96 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.642896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a877563e-dae7-4b3e-9220-d17df2467a4d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:47.652620 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a877563e-dae7-4b3e-9220-d17df2467a4d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1540 microversion: 2.1 time: 0.344169 Jul 20 04:14:47.653903 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 676/1414] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1540 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:47.671717 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-14e84cec-b4bc-4811-997c-2c7c4ba91a96 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.477875 Jul 20 04:14:47.672566 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 739/1415] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/os-services => generated 949 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:47.685470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-57aa7a6e-baf9-4a49-adfb-66298f215274 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.688263 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:47.688263 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:14:47.689851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57aa7a6e-baf9-4a49-adfb-66298f215274 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.690329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57aa7a6e-baf9-4a49-adfb-66298f215274 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.691671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57aa7a6e-baf9-4a49-adfb-66298f215274 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.692127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57aa7a6e-baf9-4a49-adfb-66298f215274 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.728405 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-57aa7a6e-baf9-4a49-adfb-66298f215274 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.047475 Jul 20 04:14:47.737362 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 677/1416] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:47.742319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e49ebd45-312c-4617-a9b3-a7547ca7621c tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.743902 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:47.743902 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:14:47.746159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e49ebd45-312c-4617-a9b3-a7547ca7621c tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.746837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e49ebd45-312c-4617-a9b3-a7547ca7621c tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.748011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e49ebd45-312c-4617-a9b3-a7547ca7621c tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.748622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e49ebd45-312c-4617-a9b3-a7547ca7621c tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.781363 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e49ebd45-312c-4617-a9b3-a7547ca7621c tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.044193 Jul 20 04:14:47.788988 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 740/1417] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/os-services => generated 949 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:47.794544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9cdf2bc8-5daa-4fe7-acb8-94f3778b371c tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.797264 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:47.797264 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:14:47.799629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9cdf2bc8-5daa-4fe7-acb8-94f3778b371c tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.800373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9cdf2bc8-5daa-4fe7-acb8-94f3778b371c tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.802349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9cdf2bc8-5daa-4fe7-acb8-94f3778b371c tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.802784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9cdf2bc8-5daa-4fe7-acb8-94f3778b371c tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.821501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=9 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:47.830266 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9cdf2bc8-5daa-4fe7-acb8-94f3778b371c tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-764485-11&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.039904 Jul 20 04:14:47.832168 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 678/1418] 10.222.0.20 () {58 vars in 1195 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/os-services?host=n-d-764485-11&binary=xxx => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:47.841304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a8bcbcee-a3ba-4a1c-8ebb-d81813ab569e req-99bb1684-e067-49bc-a15b-44687a2e31b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "956609f6-9ca2-4919-988a-2b0d4a740b26", "tag": "cdee7da2-445b-4334-89cc-1a24affa04ae"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:47.852415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c91b340c-b793-4138-be9b-29a66a815211 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.856925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a8bcbcee-a3ba-4a1c-8ebb-d81813ab569e req-99bb1684-e067-49bc-a15b-44687a2e31b7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.857497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a8bcbcee-a3ba-4a1c-8ebb-d81813ab569e req-99bb1684-e067-49bc-a15b-44687a2e31b7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.864089 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:47.864089 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:14:47.864536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c91b340c-b793-4138-be9b-29a66a815211 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.864993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c91b340c-b793-4138-be9b-29a66a815211 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.865891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c91b340c-b793-4138-be9b-29a66a815211 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.866225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c91b340c-b793-4138-be9b-29a66a815211 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.868163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:47.886136 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a8bcbcee-a3ba-4a1c-8ebb-d81813ab569e req-99bb1684-e067-49bc-a15b-44687a2e31b7 service nova] Creating event network-changed:cdee7da2-445b-4334-89cc-1a24affa04ae for instance 956609f6-9ca2-4919-988a-2b0d4a740b26 on n-h1-764485-11 Jul 20 04:14:47.898172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-a8bcbcee-a3ba-4a1c-8ebb-d81813ab569e req-99bb1684-e067-49bc-a15b-44687a2e31b7 service nova] Instance 956609f6-9ca2-4919-988a-2b0d4a740b26 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:14:47.925277 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a8bcbcee-a3ba-4a1c-8ebb-d81813ab569e req-99bb1684-e067-49bc-a15b-44687a2e31b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086072 Jul 20 04:14:47.929063 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c91b340c-b793-4138-be9b-29a66a815211 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.081363 Jul 20 04:14:47.930086 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 741/1419] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:47.934985 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 679/1420] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/os-services => generated 949 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:47.941138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ef8e3626-df30-4f67-9e43-a601883b08ed req-deff4fc4-4bfb-4dbc-8898-0cf33ca8d363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3299f0-afe7-4862-b16d-7bd4498f44c2", "name": "network-vif-plugged", "status": "completed", "tag": "95760499-0850-4542-b43e-cb93ce83f98a"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:47.946618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0408e609-3f12-4a22-8eb3-5c31a536d316 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.948182 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:47.948182 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:14:47.949448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0408e609-3f12-4a22-8eb3-5c31a536d316 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.949899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0408e609-3f12-4a22-8eb3-5c31a536d316 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.954851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0408e609-3f12-4a22-8eb3-5c31a536d316 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.957646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0408e609-3f12-4a22-8eb3-5c31a536d316 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.961143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ef8e3626-df30-4f67-9e43-a601883b08ed req-deff4fc4-4bfb-4dbc-8898-0cf33ca8d363 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.961549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ef8e3626-df30-4f67-9e43-a601883b08ed req-deff4fc4-4bfb-4dbc-8898-0cf33ca8d363 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.992765 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ef8e3626-df30-4f67-9e43-a601883b08ed req-deff4fc4-4bfb-4dbc-8898-0cf33ca8d363 service nova] Creating event network-vif-plugged:95760499-0850-4542-b43e-cb93ce83f98a for instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 on n-h2-764485-11 Jul 20 04:14:48.011923 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0408e609-3f12-4a22-8eb3-5c31a536d316 tempest-ServicesAdminNegativeTestJSON-31707302 tempest-ServicesAdminNegativeTestJSON-31707302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.074372 Jul 20 04:14:48.012608 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ef8e3626-df30-4f67-9e43-a601883b08ed req-deff4fc4-4bfb-4dbc-8898-0cf33ca8d363 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079815 Jul 20 04:14:48.014198 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 742/1421] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:48.018068 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 680/1422] 10.222.0.20 () {58 vars in 1197 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:48.205226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c4bdf1a9-b08c-472b-9c3e-0e5d48b1b97f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.206009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c4bdf1a9-b08c-472b-9c3e-0e5d48b1b97f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:48.221681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4bdf1a9-b08c-472b-9c3e-0e5d48b1b97f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:48.222377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4bdf1a9-b08c-472b-9c3e-0e5d48b1b97f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:48.227334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4bdf1a9-b08c-472b-9c3e-0e5d48b1b97f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:48.228052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4bdf1a9-b08c-472b-9c3e-0e5d48b1b97f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:48.462278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b1ee938-51cb-4911-8e4c-ee30f8d69549 tempest-ServicesAdminNegativeTestJSON-36019743 tempest-ServicesAdminNegativeTestJSON-36019743-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.464539 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:48.464539 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:14:48.466253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b1ee938-51cb-4911-8e4c-ee30f8d69549 tempest-ServicesAdminNegativeTestJSON-36019743 tempest-ServicesAdminNegativeTestJSON-36019743-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '0bc62973b8874b5b9bd558cba0e489ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40292491e823400eb462a9f02066296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b1ee938-51cb-4911-8e4c-ee30f8d69549 tempest-ServicesAdminNegativeTestJSON-36019743 tempest-ServicesAdminNegativeTestJSON-36019743-project] Request method failure captured: Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14E1Obw9jewRVNzfNvBMXuqeEAaFtfdSq0T75IfvGp_afmil-KHDl_WUKZLCQn4y5CK28np66CP6bvK9HjBjTA4Zd27KNWhKcbsX0LNcTDDIQMNZDg3YDsdtKGTx04kudmsvh7NjchlgxyTBrWABhmxCBkK5oNLJOXissSFynkJlj5I Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 40292491e823400eb462a9f02066296a Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-36019743 Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:14:48.469021 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:14:48.470446 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/40292491e823400eb462a9f02066296a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/40292491e823400eb462a9f02066296a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_40292491e823400eb462a9f02066296a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/40292491e823400eb462a9f02066296a"}]}] Jul 20 04:14:48.470446 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-36019743 Jul 20 04:14:48.470446 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 40292491e823400eb462a9f02066296a Jul 20 04:14:48.470446 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-36019743 Jul 20 04:14:48.470446 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServicesAdminNegativeTestJSON-36019743-project Jul 20 04:14:48.470446 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:14:48.470446 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:14:48.470446 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 0bc62973b8874b5b9bd558cba0e489ea Jul 20 04:14:48.470446 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-36019743-project Jul 20 04:14:48.470446 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:14:48.470446 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:14:48.470446 n-d-764485-11 devstack@n-api.service[119808]: action_args: {} Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:14:48.471380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:14:48.472702 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:14:48.475910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b1ee938-51cb-4911-8e4c-ee30f8d69549 tempest-ServicesAdminNegativeTestJSON-36019743 tempest-ServicesAdminNegativeTestJSON-36019743-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:48.477145 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5b1ee938-51cb-4911-8e4c-ee30f8d69549 tempest-ServicesAdminNegativeTestJSON-36019743 tempest-ServicesAdminNegativeTestJSON-36019743-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.454309 Jul 20 04:14:48.478233 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 743/1423] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/os-services => generated 112 bytes in 456 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:48.490873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-08a5f471-9168-47e1-9705-cb195dbf0a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.506264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-08a5f471-9168-47e1-9705-cb195dbf0a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:48.528338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08a5f471-9168-47e1-9705-cb195dbf0a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:48.530968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08a5f471-9168-47e1-9705-cb195dbf0a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:48.532460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08a5f471-9168-47e1-9705-cb195dbf0a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:48.533155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08a5f471-9168-47e1-9705-cb195dbf0a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:48.761286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c4bdf1a9-b08c-472b-9c3e-0e5d48b1b97f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:48.770148 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c4bdf1a9-b08c-472b-9c3e-0e5d48b1b97f tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1478 microversion: 2.1 time: 0.569110 Jul 20 04:14:48.782005 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 681/1424] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1478 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:48.873762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-08a5f471-9168-47e1-9705-cb195dbf0a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:48.884115 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-08a5f471-9168-47e1-9705-cb195dbf0a09 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1325 microversion: 2.1 time: 0.404447 Jul 20 04:14:48.894986 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 744/1425] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1325 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:48.900092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e60a4ac5-2a0f-4480-bebd-25641901cec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.911419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e60a4ac5-2a0f-4480-bebd-25641901cec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:48.925275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e60a4ac5-2a0f-4480-bebd-25641901cec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:48.946890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e60a4ac5-2a0f-4480-bebd-25641901cec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:48.947801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e60a4ac5-2a0f-4480-bebd-25641901cec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:48.948972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e60a4ac5-2a0f-4480-bebd-25641901cec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.056018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-22d4b92f-1bbe-4dca-9cd5-81336777a34d tempest-AbsoluteLimitsTestJSON-761706301 tempest-AbsoluteLimitsTestJSON-761706301-project] Calling method '.version_select at 0x7fbf9d453d30>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:49.075829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22d4b92f-1bbe-4dca-9cd5-81336777a34d tempest-AbsoluteLimitsTestJSON-761706301 tempest-AbsoluteLimitsTestJSON-761706301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.076649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22d4b92f-1bbe-4dca-9cd5-81336777a34d tempest-AbsoluteLimitsTestJSON-761706301 tempest-AbsoluteLimitsTestJSON-761706301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.077994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22d4b92f-1bbe-4dca-9cd5-81336777a34d tempest-AbsoluteLimitsTestJSON-761706301 tempest-AbsoluteLimitsTestJSON-761706301-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.078660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22d4b92f-1bbe-4dca-9cd5-81336777a34d tempest-AbsoluteLimitsTestJSON-761706301 tempest-AbsoluteLimitsTestJSON-761706301-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.109639 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-22d4b92f-1bbe-4dca-9cd5-81336777a34d tempest-AbsoluteLimitsTestJSON-761706301 tempest-AbsoluteLimitsTestJSON-761706301-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.325823 Jul 20 04:14:49.110548 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 682/1426] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/limits => generated 511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:49.399750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e60a4ac5-2a0f-4480-bebd-25641901cec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:49.407548 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e60a4ac5-2a0f-4480-bebd-25641901cec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1540 microversion: 2.1 time: 0.511135 Jul 20 04:14:49.411290 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 745/1427] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1540 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:49.789162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2b4f0627-5348-44af-b426-d8dee22cf4f2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:49.789804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2b4f0627-5348-44af-b426-d8dee22cf4f2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:49.796413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b4f0627-5348-44af-b426-d8dee22cf4f2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.796871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b4f0627-5348-44af-b426-d8dee22cf4f2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.797861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b4f0627-5348-44af-b426-d8dee22cf4f2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.798478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b4f0627-5348-44af-b426-d8dee22cf4f2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.903245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b7f2b76a-c78b-45bc-8472-a3f72810b597 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:49.915250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b7f2b76a-c78b-45bc-8472-a3f72810b597 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:49.948643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7f2b76a-c78b-45bc-8472-a3f72810b597 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.949232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7f2b76a-c78b-45bc-8472-a3f72810b597 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.950371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7f2b76a-c78b-45bc-8472-a3f72810b597 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.950817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7f2b76a-c78b-45bc-8472-a3f72810b597 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.969990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2b4f0627-5348-44af-b426-d8dee22cf4f2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:49.979199 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2b4f0627-5348-44af-b426-d8dee22cf4f2 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1478 microversion: 2.1 time: 0.193831 Jul 20 04:14:49.981260 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 683/1428] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:49 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1478 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:50.170089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b7f2b76a-c78b-45bc-8472-a3f72810b597 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:50.179790 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b7f2b76a-c78b-45bc-8472-a3f72810b597 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1325 microversion: 2.1 time: 0.282011 Jul 20 04:14:50.181104 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 746/1429] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:49 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:50.429106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d912cfbb-6c2f-4477-aa6e-6efe23d518d7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.430181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d912cfbb-6c2f-4477-aa6e-6efe23d518d7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:50.440011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d912cfbb-6c2f-4477-aa6e-6efe23d518d7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.441017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d912cfbb-6c2f-4477-aa6e-6efe23d518d7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.442495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d912cfbb-6c2f-4477-aa6e-6efe23d518d7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.443268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d912cfbb-6c2f-4477-aa6e-6efe23d518d7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.678018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d912cfbb-6c2f-4477-aa6e-6efe23d518d7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:50.690509 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d912cfbb-6c2f-4477-aa6e-6efe23d518d7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1540 microversion: 2.1 time: 0.267405 Jul 20 04:14:50.695674 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 684/1430] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:50 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1540 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:51.002998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8492fa71-687e-4c84-8316-a75e4a8f5cec tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.005206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8492fa71-687e-4c84-8316-a75e4a8f5cec tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:51.016724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8492fa71-687e-4c84-8316-a75e4a8f5cec tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.018099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8492fa71-687e-4c84-8316-a75e4a8f5cec tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.020566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8492fa71-687e-4c84-8316-a75e4a8f5cec tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.021195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8492fa71-687e-4c84-8316-a75e4a8f5cec tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.200728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5919c0a2-1081-4fa5-9de5-4c7b619f7bd9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.201972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5919c0a2-1081-4fa5-9de5-4c7b619f7bd9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:51.216318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5919c0a2-1081-4fa5-9de5-4c7b619f7bd9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.218989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5919c0a2-1081-4fa5-9de5-4c7b619f7bd9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.220901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5919c0a2-1081-4fa5-9de5-4c7b619f7bd9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.225388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5919c0a2-1081-4fa5-9de5-4c7b619f7bd9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.555968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8492fa71-687e-4c84-8316-a75e4a8f5cec tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:51.565533 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8492fa71-687e-4c84-8316-a75e4a8f5cec tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1478 microversion: 2.1 time: 0.569377 Jul 20 04:14:51.570440 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 747/1431] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:50 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1478 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:51.579248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ea0b821d-0c55-49f0-8529-8ca246f27963 req-b17ce256-0036-4d53-82e8-fc86c6dacd3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42b8c28-e93e-471e-b549-5718883dc7b6", "name": "network-vif-unplugged", "status": "completed", "tag": "4266796f-8098-40de-be9c-26d7b872b741"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:51.600573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ea0b821d-0c55-49f0-8529-8ca246f27963 req-b17ce256-0036-4d53-82e8-fc86c6dacd3c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.601032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ea0b821d-0c55-49f0-8529-8ca246f27963 req-b17ce256-0036-4d53-82e8-fc86c6dacd3c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.625125 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ea0b821d-0c55-49f0-8529-8ca246f27963 req-b17ce256-0036-4d53-82e8-fc86c6dacd3c service nova] Creating event network-vif-unplugged:4266796f-8098-40de-be9c-26d7b872b741 for instance c42b8c28-e93e-471e-b549-5718883dc7b6 on n-h1-764485-11 Jul 20 04:14:51.639129 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ea0b821d-0c55-49f0-8529-8ca246f27963 req-b17ce256-0036-4d53-82e8-fc86c6dacd3c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067051 Jul 20 04:14:51.640243 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 748/1432] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:51.687838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5919c0a2-1081-4fa5-9de5-4c7b619f7bd9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:51.704216 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5919c0a2-1081-4fa5-9de5-4c7b619f7bd9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1521 microversion: 2.1 time: 0.508811 Jul 20 04:14:51.706386 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 685/1433] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:51.720877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9ce12fc1-55fb-47cd-a62e-efdf64562adb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.724628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9ce12fc1-55fb-47cd-a62e-efdf64562adb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:51.728670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-10be4d94-ebe0-476b-a42c-db7b6b8668a3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.729294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-10be4d94-ebe0-476b-a42c-db7b6b8668a3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:51.733305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ce12fc1-55fb-47cd-a62e-efdf64562adb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.733766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ce12fc1-55fb-47cd-a62e-efdf64562adb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.736450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ce12fc1-55fb-47cd-a62e-efdf64562adb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.736583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10be4d94-ebe0-476b-a42c-db7b6b8668a3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.736905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ce12fc1-55fb-47cd-a62e-efdf64562adb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.737043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10be4d94-ebe0-476b-a42c-db7b6b8668a3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.738595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10be4d94-ebe0-476b-a42c-db7b6b8668a3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.746635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10be4d94-ebe0-476b-a42c-db7b6b8668a3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:52.260727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9ce12fc1-55fb-47cd-a62e-efdf64562adb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:52.312429 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9ce12fc1-55fb-47cd-a62e-efdf64562adb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1472 microversion: 2.1 time: 0.607933 Jul 20 04:14:52.316517 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 749/1434] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1472 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:52.534621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-10be4d94-ebe0-476b-a42c-db7b6b8668a3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:52.553646 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-10be4d94-ebe0-476b-a42c-db7b6b8668a3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1521 microversion: 2.1 time: 0.818376 Jul 20 04:14:52.554521 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 686/1435] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1521 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:52.572210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8f742905-8a83-467c-866c-e6f05fda5317 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1295888605"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:52.573296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8f742905-8a83-467c-866c-e6f05fda5317 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:52.587368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c53d00cf-0576-41e7-90c1-aa4ec3717dd5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:52.588028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c53d00cf-0576-41e7-90c1-aa4ec3717dd5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:52.592897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f742905-8a83-467c-866c-e6f05fda5317 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:52.593403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f742905-8a83-467c-866c-e6f05fda5317 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:52.594596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f742905-8a83-467c-866c-e6f05fda5317 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:52.594725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f742905-8a83-467c-866c-e6f05fda5317 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:52.600289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c53d00cf-0576-41e7-90c1-aa4ec3717dd5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:52.601308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c53d00cf-0576-41e7-90c1-aa4ec3717dd5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:52.602249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c53d00cf-0576-41e7-90c1-aa4ec3717dd5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:52.602683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c53d00cf-0576-41e7-90c1-aa4ec3717dd5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:52.623133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:52.952932 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8f742905-8a83-467c-866c-e6f05fda5317 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "POST /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2/action" status: 202 len: 0 microversion: 2.1 time: 0.384696 Jul 20 04:14:52.953884 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 750/1436] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:52 2022] POST /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:14:52.964888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8b1e2585-dcbb-4915-b188-1ed6b176a05e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '.version_select at 0x7fbf9d39dee0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:53.105940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c53d00cf-0576-41e7-90c1-aa4ec3717dd5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:53.114611 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c53d00cf-0576-41e7-90c1-aa4ec3717dd5 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1478 microversion: 2.1 time: 0.531305 Jul 20 04:14:53.120099 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 687/1437] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:52 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1478 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:53.175571 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8b1e2585-dcbb-4915-b188-1ed6b176a05e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "DELETE /compute/v2.1/images/088e449a-295c-4f13-aff2-a399c2007ff3" status: 204 len: 0 microversion: 2.1 time: 0.214654 Jul 20 04:14:53.183796 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 751/1438] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:52 2022] DELETE /compute/v2.1/images/088e449a-295c-4f13-aff2-a399c2007ff3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:53.195314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-059b0714-ce65-4a93-abed-4413ea6f6edc tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '.version_select at 0x7fbf9d453d30>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:53.231408 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-059b0714-ce65-4a93-abed-4413ea6f6edc tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] HTTP exception thrown: Image not found. Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-059b0714-ce65-4a93-abed-4413ea6f6edc tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/images/088e449a-295c-4f13-aff2-a399c2007ff3 HTTP/1.1 Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:14:53.234123 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '088e449a-295c-4f13-aff2-a399c2007ff3'} Jul 20 04:14:53.235649 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:53.236465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 088e449a-295c-4f13-aff2-a399c2007ff3 Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:53.237581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 088e449a-295c-4f13-aff2-a399c2007ff3 could not be found. Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:53.238909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:14:53.241540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-059b0714-ce65-4a93-abed-4413ea6f6edc tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:53.247139 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-059b0714-ce65-4a93-abed-4413ea6f6edc tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/images/088e449a-295c-4f13-aff2-a399c2007ff3" status: 404 len: 62 microversion: 2.1 time: 0.053448 Jul 20 04:14:53.247139 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 688/1439] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:14:53 2022] GET /compute/v2.1/images/088e449a-295c-4f13-aff2-a399c2007ff3 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:53.252429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-542ee474-4f2e-4fa2-98e5-1572150680f3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:53.253077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-542ee474-4f2e-4fa2-98e5-1572150680f3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:53.262179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:53.271250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-542ee474-4f2e-4fa2-98e5-1572150680f3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:53.272380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-542ee474-4f2e-4fa2-98e5-1572150680f3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:53.273329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-542ee474-4f2e-4fa2-98e5-1572150680f3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:53.275669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-542ee474-4f2e-4fa2-98e5-1572150680f3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:53.330617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-16c41e02-c499-4b3f-9bb8-11c6c86a22ac tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:53.332498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-16c41e02-c499-4b3f-9bb8-11c6c86a22ac tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:53.355381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16c41e02-c499-4b3f-9bb8-11c6c86a22ac tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:53.355626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16c41e02-c499-4b3f-9bb8-11c6c86a22ac tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:53.357345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16c41e02-c499-4b3f-9bb8-11c6c86a22ac tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:53.358158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16c41e02-c499-4b3f-9bb8-11c6c86a22ac tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:53.852285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-542ee474-4f2e-4fa2-98e5-1572150680f3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:53.868792 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-542ee474-4f2e-4fa2-98e5-1572150680f3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1533 microversion: 2.1 time: 0.620866 Jul 20 04:14:53.870414 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 752/1440] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:53 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1533 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:53.875464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-fd704bce-326b-45be-8889-64e67bbaccfd req-f5147ec1-dd74-4b69-b09d-a5e29846c8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42b8c28-e93e-471e-b549-5718883dc7b6", "name": "network-vif-plugged", "status": "completed", "tag": "4266796f-8098-40de-be9c-26d7b872b741"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:53.885832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-fd704bce-326b-45be-8889-64e67bbaccfd req-f5147ec1-dd74-4b69-b09d-a5e29846c8cf service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:53.886634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-fd704bce-326b-45be-8889-64e67bbaccfd req-f5147ec1-dd74-4b69-b09d-a5e29846c8cf service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:53.901012 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-fd704bce-326b-45be-8889-64e67bbaccfd req-f5147ec1-dd74-4b69-b09d-a5e29846c8cf service nova] Creating event network-vif-plugged:4266796f-8098-40de-be9c-26d7b872b741 for instance c42b8c28-e93e-471e-b549-5718883dc7b6 on n-h1-764485-11 Jul 20 04:14:53.908093 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-fd704bce-326b-45be-8889-64e67bbaccfd req-f5147ec1-dd74-4b69-b09d-a5e29846c8cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035603 Jul 20 04:14:53.908729 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 753/1441] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:53.936997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-16c41e02-c499-4b3f-9bb8-11c6c86a22ac tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:53.950694 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-16c41e02-c499-4b3f-9bb8-11c6c86a22ac tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1472 microversion: 2.1 time: 0.621018 Jul 20 04:14:53.952840 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 689/1442] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:53 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1472 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:54.136916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1ccc67bc-1723-49f2-9511-1fd6d294bad7 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:54.137854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1ccc67bc-1723-49f2-9511-1fd6d294bad7 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:54.141060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=24 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:54.158240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ccc67bc-1723-49f2-9511-1fd6d294bad7 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:54.159277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ccc67bc-1723-49f2-9511-1fd6d294bad7 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:54.160967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ccc67bc-1723-49f2-9511-1fd6d294bad7 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:54.164756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ccc67bc-1723-49f2-9511-1fd6d294bad7 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:54.693744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1ccc67bc-1723-49f2-9511-1fd6d294bad7 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:54.715602 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1ccc67bc-1723-49f2-9511-1fd6d294bad7 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1478 microversion: 2.1 time: 0.581681 Jul 20 04:14:54.717333 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 754/1443] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:54 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1478 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:54.891995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-357501ad-ec56-446f-9973-b23a317ad34f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:54.892605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-357501ad-ec56-446f-9973-b23a317ad34f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:54.902934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-357501ad-ec56-446f-9973-b23a317ad34f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:54.905507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-357501ad-ec56-446f-9973-b23a317ad34f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:54.909210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-357501ad-ec56-446f-9973-b23a317ad34f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:54.910319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-357501ad-ec56-446f-9973-b23a317ad34f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:54.968087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c57cf89a-6065-4510-91e3-469ed0b2adc4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:54.969108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c57cf89a-6065-4510-91e3-469ed0b2adc4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:54.989829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c57cf89a-6065-4510-91e3-469ed0b2adc4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:54.990708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c57cf89a-6065-4510-91e3-469ed0b2adc4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:54.991980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c57cf89a-6065-4510-91e3-469ed0b2adc4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:54.994039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c57cf89a-6065-4510-91e3-469ed0b2adc4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.595068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-357501ad-ec56-446f-9973-b23a317ad34f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:55.603322 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-357501ad-ec56-446f-9973-b23a317ad34f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1533 microversion: 2.1 time: 0.715466 Jul 20 04:14:55.607829 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 690/1444] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:54 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1533 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:55.684041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c57cf89a-6065-4510-91e3-469ed0b2adc4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:55.704985 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c57cf89a-6065-4510-91e3-469ed0b2adc4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1469 microversion: 2.1 time: 0.740927 Jul 20 04:14:55.719211 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 755/1445] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:54 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1469 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:55.723267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:55.724276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:55.732475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.733338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.734497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.734637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3120d8fd-d74d-4daf-8024-a17ce5076c8c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:55.735136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3120d8fd-d74d-4daf-8024-a17ce5076c8c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:55.735741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.752741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3120d8fd-d74d-4daf-8024-a17ce5076c8c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.754867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3120d8fd-d74d-4daf-8024-a17ce5076c8c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.756011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3120d8fd-d74d-4daf-8024-a17ce5076c8c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.760245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3120d8fd-d74d-4daf-8024-a17ce5076c8c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.785106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.785917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.787768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.788562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.851725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Getting quotas for project 41ba023317344d3490bdb01aa8b1e01b. Resources: {'cores', 'ram'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:55.874822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Getting quotas for user 9aa79203e62546cea351116b153afee5 and project 41ba023317344d3490bdb01aa8b1e01b. Resources: {'cores', 'ram'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:56.103730 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3a08a39a-a68f-40fe-bed3-4b9233a2f179 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "POST /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26/action" status: 202 len: 0 microversion: 2.1 time: 0.383991 Jul 20 04:14:56.105289 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 691/1446] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:55 2022] POST /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:56.121951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-378cd927-976b-428b-a487-a5a5b27138f7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:56.127846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-378cd927-976b-428b-a487-a5a5b27138f7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:56.145279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-378cd927-976b-428b-a487-a5a5b27138f7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.145675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-378cd927-976b-428b-a487-a5a5b27138f7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.150040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-378cd927-976b-428b-a487-a5a5b27138f7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.151073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-378cd927-976b-428b-a487-a5a5b27138f7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.669368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3120d8fd-d74d-4daf-8024-a17ce5076c8c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:56.693681 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3120d8fd-d74d-4daf-8024-a17ce5076c8c tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1478 microversion: 2.1 time: 0.960304 Jul 20 04:14:56.696248 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 756/1447] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:55 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1478 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:56.709987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7f7f99d1-c2f6-4770-b013-e6e13b999142 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:56.711937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7f7f99d1-c2f6-4770-b013-e6e13b999142 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:56.735893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f7f99d1-c2f6-4770-b013-e6e13b999142 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.739355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f7f99d1-c2f6-4770-b013-e6e13b999142 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.740530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f7f99d1-c2f6-4770-b013-e6e13b999142 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.747490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f7f99d1-c2f6-4770-b013-e6e13b999142 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.773940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-378cd927-976b-428b-a487-a5a5b27138f7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:56.796426 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-378cd927-976b-428b-a487-a5a5b27138f7 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1468 microversion: 2.1 time: 0.684461 Jul 20 04:14:56.798450 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 692/1448] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:56 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1468 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:57.114531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7f7f99d1-c2f6-4770-b013-e6e13b999142 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:57.126091 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7f7f99d1-c2f6-4770-b013-e6e13b999142 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1539 microversion: 2.1 time: 0.428365 Jul 20 04:14:57.130614 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 757/1449] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:56 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1539 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:57.713609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e1430018-cc4a-4207-94de-c25a9141f148 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:57.714592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e1430018-cc4a-4207-94de-c25a9141f148 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:57.724200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1430018-cc4a-4207-94de-c25a9141f148 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:57.725086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1430018-cc4a-4207-94de-c25a9141f148 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:57.726156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1430018-cc4a-4207-94de-c25a9141f148 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:57.726809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1430018-cc4a-4207-94de-c25a9141f148 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:57.816453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-56b2ebd4-97fa-4f08-93d2-2e29b2f43154 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:57.817272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-56b2ebd4-97fa-4f08-93d2-2e29b2f43154 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:57.819676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:57.827294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56b2ebd4-97fa-4f08-93d2-2e29b2f43154 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:57.827777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56b2ebd4-97fa-4f08-93d2-2e29b2f43154 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:57.828566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56b2ebd4-97fa-4f08-93d2-2e29b2f43154 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:57.829009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56b2ebd4-97fa-4f08-93d2-2e29b2f43154 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.657974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-56b2ebd4-97fa-4f08-93d2-2e29b2f43154 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:58.668807 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-56b2ebd4-97fa-4f08-93d2-2e29b2f43154 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1468 microversion: 2.1 time: 0.856848 Jul 20 04:14:58.672158 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 758/1450] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:57 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1468 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:58.681902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-27b5f382-8d4c-4b5a-b1c8-0cfc5fac19d1 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:58.682717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e1430018-cc4a-4207-94de-c25a9141f148 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:58.683810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-27b5f382-8d4c-4b5a-b1c8-0cfc5fac19d1 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:58.690513 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e1430018-cc4a-4207-94de-c25a9141f148 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1463 microversion: 2.1 time: 0.981069 Jul 20 04:14:58.691807 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 693/1451] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:57 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1463 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:58.698665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27b5f382-8d4c-4b5a-b1c8-0cfc5fac19d1 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.699215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27b5f382-8d4c-4b5a-b1c8-0cfc5fac19d1 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.700182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27b5f382-8d4c-4b5a-b1c8-0cfc5fac19d1 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.700628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27b5f382-8d4c-4b5a-b1c8-0cfc5fac19d1 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.717201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b4248c21-b869-4883-8c59-c677231c7a08 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:58.718772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b4248c21-b869-4883-8c59-c677231c7a08 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:58.732489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4248c21-b869-4883-8c59-c677231c7a08 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.733218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4248c21-b869-4883-8c59-c677231c7a08 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.739384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4248c21-b869-4883-8c59-c677231c7a08 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.740169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4248c21-b869-4883-8c59-c677231c7a08 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.911844 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b4248c21-b869-4883-8c59-c677231c7a08 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action" status: 202 len: 0 microversion: 2.1 time: 0.198446 Jul 20 04:14:58.912872 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 694/1452] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:58 2022] POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:14:58.921366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-da0adbbf-589f-4fd1-b6cc-6d8e1b24b65a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:58.922305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-da0adbbf-589f-4fd1-b6cc-6d8e1b24b65a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:58.945054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da0adbbf-589f-4fd1-b6cc-6d8e1b24b65a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.947287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da0adbbf-589f-4fd1-b6cc-6d8e1b24b65a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.948524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da0adbbf-589f-4fd1-b6cc-6d8e1b24b65a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.951159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da0adbbf-589f-4fd1-b6cc-6d8e1b24b65a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.993589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da0adbbf-589f-4fd1-b6cc-6d8e1b24b65a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.994307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da0adbbf-589f-4fd1-b6cc-6d8e1b24b65a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.994965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-da0adbbf-589f-4fd1-b6cc-6d8e1b24b65a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lazy-loading 'fault' on Instance uuid c42b8c28-e93e-471e-b549-5718883dc7b6 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:59.076106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:59.746232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-27b5f382-8d4c-4b5a-b1c8-0cfc5fac19d1 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:59.755052 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-27b5f382-8d4c-4b5a-b1c8-0cfc5fac19d1 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1539 microversion: 2.1 time: 1.081624 Jul 20 04:14:59.756210 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 759/1453] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:58 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1539 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:59.761966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-f2b1870a-794e-40a4-b0cb-631a945ef395 req-2f8b11a6-abcd-4fd3-a0a5-6f9149a1e36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956609f6-9ca2-4919-988a-2b0d4a740b26", "name": "network-vif-plugged", "status": "completed", "tag": "cdee7da2-445b-4334-89cc-1a24affa04ae"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:59.771451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f2b1870a-794e-40a4-b0cb-631a945ef395 req-2f8b11a6-abcd-4fd3-a0a5-6f9149a1e36e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.772176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f2b1870a-794e-40a4-b0cb-631a945ef395 req-2f8b11a6-abcd-4fd3-a0a5-6f9149a1e36e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.803973 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-da0adbbf-589f-4fd1-b6cc-6d8e1b24b65a tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1599 microversion: 2.1 time: 0.886633 Jul 20 04:14:59.816456 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 695/1454] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:58 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1599 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:59.830430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e4ed603d-8adf-4c85-958c-6bddd21ae346 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:59.831052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e4ed603d-8adf-4c85-958c-6bddd21ae346 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:59.845529 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f2b1870a-794e-40a4-b0cb-631a945ef395 req-2f8b11a6-abcd-4fd3-a0a5-6f9149a1e36e service nova] Creating event network-vif-plugged:cdee7da2-445b-4334-89cc-1a24affa04ae for instance 956609f6-9ca2-4919-988a-2b0d4a740b26 on n-h1-764485-11 Jul 20 04:14:59.866551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4ed603d-8adf-4c85-958c-6bddd21ae346 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.867595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4ed603d-8adf-4c85-958c-6bddd21ae346 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.872966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4ed603d-8adf-4c85-958c-6bddd21ae346 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.873598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4ed603d-8adf-4c85-958c-6bddd21ae346 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.886117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-f2b1870a-794e-40a4-b0cb-631a945ef395 req-2f8b11a6-abcd-4fd3-a0a5-6f9149a1e36e service nova] Instance 956609f6-9ca2-4919-988a-2b0d4a740b26 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:14:59.914466 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-f2b1870a-794e-40a4-b0cb-631a945ef395 req-2f8b11a6-abcd-4fd3-a0a5-6f9149a1e36e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156132 Jul 20 04:14:59.919482 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 760/1455] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:59.942016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4b90f0e7-f66a-4a34-bebf-4602e7f16c16 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:59.951495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4b90f0e7-f66a-4a34-bebf-4602e7f16c16 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:59.970030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b90f0e7-f66a-4a34-bebf-4602e7f16c16 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.973233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b90f0e7-f66a-4a34-bebf-4602e7f16c16 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.976062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b90f0e7-f66a-4a34-bebf-4602e7f16c16 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.977549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b90f0e7-f66a-4a34-bebf-4602e7f16c16 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.990281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:00.227084 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4b90f0e7-f66a-4a34-bebf-4602e7f16c16 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action" status: 202 len: 0 microversion: 2.1 time: 0.304340 Jul 20 04:15:00.227816 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 761/1456] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:14:59 2022] POST /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:00.243850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-71b6a7dc-384a-4b53-a9d5-07ad4484f5c2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.244565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-71b6a7dc-384a-4b53-a9d5-07ad4484f5c2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:00.271886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71b6a7dc-384a-4b53-a9d5-07ad4484f5c2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.272364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71b6a7dc-384a-4b53-a9d5-07ad4484f5c2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.274597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71b6a7dc-384a-4b53-a9d5-07ad4484f5c2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.276041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71b6a7dc-384a-4b53-a9d5-07ad4484f5c2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.397652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e4ed603d-8adf-4c85-958c-6bddd21ae346 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:00.412018 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e4ed603d-8adf-4c85-958c-6bddd21ae346 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1468 microversion: 2.1 time: 0.594291 Jul 20 04:15:00.423394 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 696/1457] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:59 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1468 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:00.688481 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-71b6a7dc-384a-4b53-a9d5-07ad4484f5c2 tempest-ServersAdminTestJSON-1578306976 tempest-ServersAdminTestJSON-1578306976-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1616 microversion: 2.1 time: 0.452127 Jul 20 04:15:00.700334 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 762/1458] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1616 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:00.709898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-75720ef3-5939-4f93-a564-06893453a12b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.710672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-75720ef3-5939-4f93-a564-06893453a12b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:00.724145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75720ef3-5939-4f93-a564-06893453a12b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.725033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75720ef3-5939-4f93-a564-06893453a12b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.726195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75720ef3-5939-4f93-a564-06893453a12b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.730158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75720ef3-5939-4f93-a564-06893453a12b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.777684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-314785f7-094e-486e-8c41-2cffd79435db tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.778302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-314785f7-094e-486e-8c41-2cffd79435db tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:00.782823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-75720ef3-5939-4f93-a564-06893453a12b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:00.788786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-314785f7-094e-486e-8c41-2cffd79435db tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.789244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-314785f7-094e-486e-8c41-2cffd79435db tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.790037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-314785f7-094e-486e-8c41-2cffd79435db tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.798034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-314785f7-094e-486e-8c41-2cffd79435db tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.950897 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-75720ef3-5939-4f93-a564-06893453a12b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 204 len: 0 microversion: 2.1 time: 0.245409 Jul 20 04:15:00.953702 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 697/1459] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:00 2022] DELETE /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:00.971158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-34e419ad-0294-4b73-a4ed-0da7af97a136 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.972453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-34e419ad-0294-4b73-a4ed-0da7af97a136 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:00.983047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34e419ad-0294-4b73-a4ed-0da7af97a136 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.988589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34e419ad-0294-4b73-a4ed-0da7af97a136 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.989699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34e419ad-0294-4b73-a4ed-0da7af97a136 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.996166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34e419ad-0294-4b73-a4ed-0da7af97a136 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.044791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:01.344006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-314785f7-094e-486e-8c41-2cffd79435db tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:01.370321 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-314785f7-094e-486e-8c41-2cffd79435db tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1534 microversion: 2.1 time: 0.598665 Jul 20 04:15:01.383570 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 763/1460] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1534 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:01.383944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-34e419ad-0294-4b73-a4ed-0da7af97a136 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:01.399204 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-34e419ad-0294-4b73-a4ed-0da7af97a136 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1468 microversion: 2.1 time: 0.440063 Jul 20 04:15:01.409362 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 698/1461] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1468 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:01.433213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-90e69d97-7e41-4bfe-bd56-50dd9adb1c0b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:01.433857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-90e69d97-7e41-4bfe-bd56-50dd9adb1c0b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:01.444394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90e69d97-7e41-4bfe-bd56-50dd9adb1c0b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.444859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90e69d97-7e41-4bfe-bd56-50dd9adb1c0b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.446601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90e69d97-7e41-4bfe-bd56-50dd9adb1c0b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.447420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90e69d97-7e41-4bfe-bd56-50dd9adb1c0b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.728084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-90e69d97-7e41-4bfe-bd56-50dd9adb1c0b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:01.745102 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-90e69d97-7e41-4bfe-bd56-50dd9adb1c0b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1468 microversion: 2.1 time: 0.319673 Jul 20 04:15:01.756110 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 764/1462] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:01 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1468 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:02.394768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ef507426-0ddd-4f69-b5e8-194408633522 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:02.396063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ef507426-0ddd-4f69-b5e8-194408633522 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:02.405208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef507426-0ddd-4f69-b5e8-194408633522 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.405964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef507426-0ddd-4f69-b5e8-194408633522 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.407791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef507426-0ddd-4f69-b5e8-194408633522 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.408576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef507426-0ddd-4f69-b5e8-194408633522 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.422886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-58193700-c582-4da4-90d3-c6a97a48f719 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:02.428152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-58193700-c582-4da4-90d3-c6a97a48f719 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:02.450519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58193700-c582-4da4-90d3-c6a97a48f719 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.450977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58193700-c582-4da4-90d3-c6a97a48f719 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.451876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58193700-c582-4da4-90d3-c6a97a48f719 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.463684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58193700-c582-4da4-90d3-c6a97a48f719 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.101114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ef507426-0ddd-4f69-b5e8-194408633522 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:03.117185 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ef507426-0ddd-4f69-b5e8-194408633522 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1521 microversion: 2.1 time: 0.729449 Jul 20 04:15:03.117423 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 699/1463] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:02 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1521 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:03.122169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6de3e7f9-d42d-49ed-a1ab-ce1d82e1bc90 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.122772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6de3e7f9-d42d-49ed-a1ab-ce1d82e1bc90 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:03.151815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6de3e7f9-d42d-49ed-a1ab-ce1d82e1bc90 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.152292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-58193700-c582-4da4-90d3-c6a97a48f719 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:03.152467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6de3e7f9-d42d-49ed-a1ab-ce1d82e1bc90 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.153232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6de3e7f9-d42d-49ed-a1ab-ce1d82e1bc90 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.153669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6de3e7f9-d42d-49ed-a1ab-ce1d82e1bc90 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.166495 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-58193700-c582-4da4-90d3-c6a97a48f719 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1468 microversion: 2.1 time: 0.753663 Jul 20 04:15:03.170713 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 765/1464] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:02 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1468 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:03.196991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f8fde160-d290-4878-b15f-945a544806c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.197826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f8fde160-d290-4878-b15f-945a544806c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:03.211255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8fde160-d290-4878-b15f-945a544806c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.211982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8fde160-d290-4878-b15f-945a544806c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.212967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8fde160-d290-4878-b15f-945a544806c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.213564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8fde160-d290-4878-b15f-945a544806c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.249127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f8fde160-d290-4878-b15f-945a544806c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:03.486015 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f8fde160-d290-4878-b15f-945a544806c8 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 204 len: 0 microversion: 2.1 time: 0.313622 Jul 20 04:15:03.489238 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 766/1465] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:03 2022] DELETE /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:03.500463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d34068d8-45d2-47fd-9581-6c16d422b309 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.502386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d34068d8-45d2-47fd-9581-6c16d422b309 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:03.510114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d34068d8-45d2-47fd-9581-6c16d422b309 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.510837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d34068d8-45d2-47fd-9581-6c16d422b309 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.512158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d34068d8-45d2-47fd-9581-6c16d422b309 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.512799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d34068d8-45d2-47fd-9581-6c16d422b309 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.260717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6de3e7f9-d42d-49ed-a1ab-ce1d82e1bc90 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:04.280670 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6de3e7f9-d42d-49ed-a1ab-ce1d82e1bc90 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1534 microversion: 2.1 time: 1.161530 Jul 20 04:15:04.294943 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 700/1466] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1534 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:04.303033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bc795adc-c9e2-48fb-9c2e-937fc46f6931 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:04.305231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bc795adc-c9e2-48fb-9c2e-937fc46f6931 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:04.307041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d34068d8-45d2-47fd-9581-6c16d422b309 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:04.312941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc795adc-c9e2-48fb-9c2e-937fc46f6931 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.313772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc795adc-c9e2-48fb-9c2e-937fc46f6931 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.315879 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d34068d8-45d2-47fd-9581-6c16d422b309 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1527 microversion: 2.1 time: 0.820166 Jul 20 04:15:04.327583 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 767/1467] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1527 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:04.328558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc795adc-c9e2-48fb-9c2e-937fc46f6931 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.328558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc795adc-c9e2-48fb-9c2e-937fc46f6931 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.313327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8126d490-c1bf-4e5f-aa8f-e1a424abfdd2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:05.315327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8126d490-c1bf-4e5f-aa8f-e1a424abfdd2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:05.330550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8126d490-c1bf-4e5f-aa8f-e1a424abfdd2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.332062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8126d490-c1bf-4e5f-aa8f-e1a424abfdd2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.333753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8126d490-c1bf-4e5f-aa8f-e1a424abfdd2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.334580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8126d490-c1bf-4e5f-aa8f-e1a424abfdd2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.824283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=13 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:05.961372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bc795adc-c9e2-48fb-9c2e-937fc46f6931 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:05.970123 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bc795adc-c9e2-48fb-9c2e-937fc46f6931 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 200 len: 1468 microversion: 2.1 time: 1.673301 Jul 20 04:15:05.973493 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 701/1468] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:04 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 1468 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:05.988643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-24f8e67a-468d-4dac-a24b-4015c1193bb6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:05.989826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-24f8e67a-468d-4dac-a24b-4015c1193bb6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:06.007329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24f8e67a-468d-4dac-a24b-4015c1193bb6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:06.008158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24f8e67a-468d-4dac-a24b-4015c1193bb6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:06.009304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24f8e67a-468d-4dac-a24b-4015c1193bb6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:06.010348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24f8e67a-468d-4dac-a24b-4015c1193bb6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:06.804987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-24f8e67a-468d-4dac-a24b-4015c1193bb6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:06.814021 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-24f8e67a-468d-4dac-a24b-4015c1193bb6 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1527 microversion: 2.1 time: 0.839190 Jul 20 04:15:06.820104 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 702/1469] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:05 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1527 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:06.974140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8126d490-c1bf-4e5f-aa8f-e1a424abfdd2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:06.987802 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8126d490-c1bf-4e5f-aa8f-e1a424abfdd2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1534 microversion: 2.1 time: 1.679138 Jul 20 04:15:06.990938 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 768/1470] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:05 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1534 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:07.000509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-c306082e-6a21-4065-9a74-38e63ac0316a req-b7bb7ff1-e268-4f07-bda8-bfbc0da3098d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956609f6-9ca2-4919-988a-2b0d4a740b26", "name": "network-vif-unplugged", "status": "completed", "tag": "cdee7da2-445b-4334-89cc-1a24affa04ae"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:07.044002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c306082e-6a21-4065-9a74-38e63ac0316a req-b7bb7ff1-e268-4f07-bda8-bfbc0da3098d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.044964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c306082e-6a21-4065-9a74-38e63ac0316a req-b7bb7ff1-e268-4f07-bda8-bfbc0da3098d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.084248 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c306082e-6a21-4065-9a74-38e63ac0316a req-b7bb7ff1-e268-4f07-bda8-bfbc0da3098d service nova] Creating event network-vif-unplugged:cdee7da2-445b-4334-89cc-1a24affa04ae for instance 956609f6-9ca2-4919-988a-2b0d4a740b26 on n-h2-764485-11 Jul 20 04:15:07.105579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-c306082e-6a21-4065-9a74-38e63ac0316a req-b7bb7ff1-e268-4f07-bda8-bfbc0da3098d service nova] Instance 956609f6-9ca2-4919-988a-2b0d4a740b26 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:15:07.158802 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-c306082e-6a21-4065-9a74-38e63ac0316a req-b7bb7ff1-e268-4f07-bda8-bfbc0da3098d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149431 Jul 20 04:15:07.163101 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 769/1471] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:07.177781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-669cb056-ba59-4400-9779-8fc007ae2909 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:07.179410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-669cb056-ba59-4400-9779-8fc007ae2909 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:07.217780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-669cb056-ba59-4400-9779-8fc007ae2909 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.241443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-669cb056-ba59-4400-9779-8fc007ae2909 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.242375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-669cb056-ba59-4400-9779-8fc007ae2909 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.242831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-669cb056-ba59-4400-9779-8fc007ae2909 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.444492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-84903c59-0240-45ed-9dee-b182827b1d5f tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] Calling method '.version_select at 0x7fbf9d422dc0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:07.876979 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-84903c59-0240-45ed-9dee-b182827b1d5f tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.055600 Jul 20 04:15:07.877825 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 703/1472] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Jul 20 04:15:06 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:15:07.888039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5f7cb99d-85cc-452b-89a3-b014ac716b28 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:07.890340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5f7cb99d-85cc-452b-89a3-b014ac716b28 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 70dee161-ab18-4fdf-a60b-c6737b36f926] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:07.906867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f7cb99d-85cc-452b-89a3-b014ac716b28 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.907819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f7cb99d-85cc-452b-89a3-b014ac716b28 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.912137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f7cb99d-85cc-452b-89a3-b014ac716b28 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.921123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f7cb99d-85cc-452b-89a3-b014ac716b28 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.963682 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-5f7cb99d-85cc-452b-89a3-b014ac716b28 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] HTTP exception thrown: Instance 70dee161-ab18-4fdf-a60b-c6737b36f926 could not be found. Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5f7cb99d-85cc-452b-89a3-b014ac716b28 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Request method failure captured: Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 HTTP/1.1 Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14C_nGwQCLew39hF3cwQVkTcE5v2emgtd00i10VkHHW2F0-w85jfBIfZ-W1mYSv1uZk2FXSwU6MusjgS0I-YGCX5izB5CvoR5qB4W2C66TUOMbpuo6CeMfPihsLjki-TkztoC3YW0ve1Eq1Nw6LxHlUSoyvHjnRcpjaQoXIXOKpahQw Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5875a8f9aeef4ae09122649735d93375 Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersAdminTestJSON-312124911 Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:15:07.968174 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:15:07.969699 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5875a8f9aeef4ae09122649735d93375"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5875a8f9aeef4ae09122649735d93375"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5875a8f9aeef4ae09122649735d93375", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5875a8f9aeef4ae09122649735d93375"}]}] Jul 20 04:15:07.969699 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersAdminTestJSON-312124911 Jul 20 04:15:07.969699 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5875a8f9aeef4ae09122649735d93375 Jul 20 04:15:07.969699 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersAdminTestJSON-312124911 Jul 20 04:15:07.969699 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersAdminTestJSON-312124911-project Jul 20 04:15:07.969699 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:15:07.969699 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:15:07.969699 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 61350a88f2664e6f9c6dee8a4186819b Jul 20 04:15:07.969699 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersAdminTestJSON-312124911-project Jul 20 04:15:07.969699 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:15:07.969699 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 70dee161-ab18-4fdf-a60b-c6737b36f926 could not be found. Jul 20 04:15:07.969699 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '70dee161-ab18-4fdf-a60b-c6737b36f926'} Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70dee161-ab18-4fdf-a60b-c6737b36f926 could not be found. Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:07.970543 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70dee161-ab18-4fdf-a60b-c6737b36f926 could not be found. Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70dee161-ab18-4fdf-a60b-c6737b36f926 could not be found. Jul 20 04:15:07.972881 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:07.977649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5f7cb99d-85cc-452b-89a3-b014ac716b28 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Returning 404 to user: Instance 70dee161-ab18-4fdf-a60b-c6737b36f926 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:07.980719 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5f7cb99d-85cc-452b-89a3-b014ac716b28 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926" status: 404 len: 111 microversion: 2.1 time: 0.100290 Jul 20 04:15:07.983102 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 704/1473] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:07 2022] GET /compute/v2.1/servers/70dee161-ab18-4fdf-a60b-c6737b36f926 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:08.050458 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-669cb056-ba59-4400-9779-8fc007ae2909 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1813 microversion: 2.1 time: 0.885036 Jul 20 04:15:08.053694 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 770/1474] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:07 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1813 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:08.218902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1401717940", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2f1733ae-f5aa-4d8e-b430-1f99c985f6d9"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:08.348540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] validate_networks() for [('2f1733ae-f5aa-4d8e-b430-1f99c985f6d9', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:08.429542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-650a7cc4-24d2-4e59-9fae-2a9d8e519013 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Calling method '.version_select at 0x7fbf9d3444c0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:08.431571 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:08.431571 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:08.433120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-650a7cc4-24d2-4e59-9fae-2a9d8e519013 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.434121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-650a7cc4-24d2-4e59-9fae-2a9d8e519013 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.436475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-650a7cc4-24d2-4e59-9fae-2a9d8e519013 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.441893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-650a7cc4-24d2-4e59-9fae-2a9d8e519013 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.507944 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-650a7cc4-24d2-4e59-9fae-2a9d8e519013 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.452875 Jul 20 04:15:08.519545 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 771/1475] 10.222.0.20 () {58 vars in 1127 bytes} [Wed Jul 20 04:15:08 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:08.526107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e1de162e-a2d7-4f87-bd19-62ec35002a1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:08.527245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e1de162e-a2d7-4f87-bd19-62ec35002a1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:08.535940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1de162e-a2d7-4f87-bd19-62ec35002a1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.536786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1de162e-a2d7-4f87-bd19-62ec35002a1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.537941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1de162e-a2d7-4f87-bd19-62ec35002a1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.538747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1de162e-a2d7-4f87-bd19-62ec35002a1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.810350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e1de162e-a2d7-4f87-bd19-62ec35002a1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:08.823655 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e1de162e-a2d7-4f87-bd19-62ec35002a1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1485 microversion: 2.1 time: 0.302376 Jul 20 04:15:08.824259 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 772/1476] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:08 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1485 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:08.849491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3435dec2-5739-4a6d-a6a2-60556530cfdf tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] Action: 'create', calling method: .version_select at 0x7fbf9d50f280>, body: {"pool": "non_exist_pool"} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:08.914360 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-3435dec2-5739-4a6d-a6a2-60556530cfdf tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] HTTP exception thrown: Floating IP pool not found. Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3435dec2-5739-4a6d-a6a2-60556530cfdf tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] Request method failure captured: Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 26 Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FKfcaQgccCSAfeaGpNKuFO3ejjF-RPx7M4Sk_71d9CgerBVkI1jmrMkF9Z2ukfsbfxF1-S5kK2KFXUkBEMkJAgBvuvaw0vcTCHmS2GQtelP3CtRyNR_ClzFbJBdp3sK9jkW9kPetD6Ri17DsqGAHjnwdjKarqMu-HDfg2D_ThXfKs Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 6b5bf6f2ab2b4fbf9685c16a40fdc0b1 Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-397276663 Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:08.918670 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6b5bf6f2ab2b4fbf9685c16a40fdc0b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6b5bf6f2ab2b4fbf9685c16a40fdc0b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6b5bf6f2ab2b4fbf9685c16a40fdc0b1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6b5bf6f2ab2b4fbf9685c16a40fdc0b1"}]}] Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-397276663 Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 6b5bf6f2ab2b4fbf9685c16a40fdc0b1 Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-397276663 Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FloatingIPsNegativeTestJSON-397276663-project Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: bf1b18d392314b8c9271e74eeca4fa57 Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-397276663-project Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: {"pool": "non_exist_pool"} Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: exception: Floating IP pool not found. Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 20 04:15:08.920642 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:08.921826 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 20 04:15:08.923638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:08.926279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3435dec2-5739-4a6d-a6a2-60556530cfdf tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] Returning 404 to user: Floating IP pool not found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:08.927661 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3435dec2-5739-4a6d-a6a2-60556530cfdf tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.090781 Jul 20 04:15:08.929327 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 773/1477] 10.222.0.20 () {60 vars in 1169 bytes} [Wed Jul 20 04:15:08 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:08.949666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b323865-0051-48af-8f35-690c7ab3facb tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:08.951936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b323865-0051-48af-8f35-690c7ab3facb tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:08.969090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b323865-0051-48af-8f35-690c7ab3facb tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.969900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b323865-0051-48af-8f35-690c7ab3facb tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.972530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b323865-0051-48af-8f35-690c7ab3facb tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.973034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b323865-0051-48af-8f35-690c7ab3facb tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.038857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b323865-0051-48af-8f35-690c7ab3facb tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:09.147340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:09.235939 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b323865-0051-48af-8f35-690c7ab3facb tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 204 len: 0 microversion: 2.1 time: 0.304959 Jul 20 04:15:09.238245 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 774/1478] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:08 2022] DELETE /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:09.246475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b23c53f9-6fc4-4bfa-87e1-cf865abba152 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.247724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b23c53f9-6fc4-4bfa-87e1-cf865abba152 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:09.255726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b23c53f9-6fc4-4bfa-87e1-cf865abba152 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.256758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b23c53f9-6fc4-4bfa-87e1-cf865abba152 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.257858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b23c53f9-6fc4-4bfa-87e1-cf865abba152 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.258519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b23c53f9-6fc4-4bfa-87e1-cf865abba152 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.480628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:09.481149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:09.481446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:09.482438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:09.483236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:09.499269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.500780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.502291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.504665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.547776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:09.554632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for user 793c626644204dc3a08ed9118c9aaf4c and project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:09.570398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:09.572730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:09.629028 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0359fa23-1db8-4b03-b6b1-9165f8cd1acc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.644344 Jul 20 04:15:09.637320 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 705/1479] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:09.681523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b23c53f9-6fc4-4bfa-87e1-cf865abba152 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:09.693741 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b23c53f9-6fc4-4bfa-87e1-cf865abba152 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1534 microversion: 2.1 time: 0.452139 Jul 20 04:15:09.702175 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 775/1480] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:09 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1534 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:09.710054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fa073149-7f6f-4ab1-9939-97b369733bed tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.713152 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:09.713152 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:09.715095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa073149-7f6f-4ab1-9939-97b369733bed tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.715960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa073149-7f6f-4ab1-9939-97b369733bed tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.716966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa073149-7f6f-4ab1-9939-97b369733bed tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.717947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa073149-7f6f-4ab1-9939-97b369733bed tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.751658 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fa073149-7f6f-4ab1-9939-97b369733bed tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.047580 Jul 20 04:15:09.755130 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 776/1481] 10.222.0.20 () {58 vars in 1175 bytes} [Wed Jul 20 04:15:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:09.774995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-97418a2c-372d-4f54-b7a1-055fe6c59cb0 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Calling method '.version_select at 0x7fbf9d422550>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.780535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3d3bfabf-f6ae-4867-8f25-4b1c3afa3b59 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Calling method '.version_select at 0x7fbf9d3af8b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.781886 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:09.781886 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:09.783101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d3bfabf-f6ae-4867-8f25-4b1c3afa3b59 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.783580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d3bfabf-f6ae-4867-8f25-4b1c3afa3b59 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.785102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d3bfabf-f6ae-4867-8f25-4b1c3afa3b59 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.785546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d3bfabf-f6ae-4867-8f25-4b1c3afa3b59 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.803216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-97418a2c-372d-4f54-b7a1-055fe6c59cb0 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cfcf3162-7054-48d6-abdf-779b0fa54c2a does not exist", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:15:09.804539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.security_group_api [None req-97418a2c-372d-4f54-b7a1-055fe6c59cb0 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Neutron security group cfcf3162-7054-48d6-abdf-779b0fa54c2a not found {{(pid=119807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:15:09.805678 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-97418a2c-372d-4f54-b7a1-055fe6c59cb0 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] HTTP exception thrown: Security group cfcf3162-7054-48d6-abdf-779b0fa54c2a does not exist Jul 20 04:15:09.805678 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-ff2928be-c4a7-4675-9063-b4cc707d764a'] Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-97418a2c-372d-4f54-b7a1-055fe6c59cb0 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Request method failure captured: Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-security-groups/cfcf3162-7054-48d6-abdf-779b0fa54c2a HTTP/1.1 Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FL1Y6tcMgRPD_XmJU84kreXRkMDi0FdAVsZsLc2WQ4nPQbm0ZyJ5FGG6lkIMRwZ7QYjGsPc4a5GD9PasUsHH3hoEh13dNduKepw3R3vArHNzFSzy9UeHE-dNTUSHqVvdueqRun4AG2yX6jkvj-vhothF_1H1AWO--mUo9FBonnK80 Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: f36ed842c59044e9b96ad1981e4ec146 Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1831617677 Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:15:09.808719 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f36ed842c59044e9b96ad1981e4ec146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f36ed842c59044e9b96ad1981e4ec146"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f36ed842c59044e9b96ad1981e4ec146", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f36ed842c59044e9b96ad1981e4ec146"}]}] Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1831617677 Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: f36ed842c59044e9b96ad1981e4ec146 Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1831617677 Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupsNegativeTestJSON-1831617677-project Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 3753a1dc40a64b26b7b8adb887295255 Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1831617677-project Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: exception: Security group cfcf3162-7054-48d6-abdf-779b0fa54c2a does not exist Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-ff2928be-c4a7-4675-9063-b4cc707d764a'] Jul 20 04:15:09.810225 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'cfcf3162-7054-48d6-abdf-779b0fa54c2a'} Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:09.813785 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cfcf3162-7054-48d6-abdf-779b0fa54c2a does not exist Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff2928be-c4a7-4675-9063-b4cc707d764a'] Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:15:09.816628 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cfcf3162-7054-48d6-abdf-779b0fa54c2a does not exist Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff2928be-c4a7-4675-9063-b4cc707d764a'] Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cfcf3162-7054-48d6-abdf-779b0fa54c2a does not exist Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff2928be-c4a7-4675-9063-b4cc707d764a'] Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.826278 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.829963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.829963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.829963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:09.829963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:09.829963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cfcf3162-7054-48d6-abdf-779b0fa54c2a does not exist Jul 20 04:15:09.829963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff2928be-c4a7-4675-9063-b4cc707d764a'] Jul 20 04:15:09.829963 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.829963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-97418a2c-372d-4f54-b7a1-055fe6c59cb0 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Returning 404 to user: Security group cfcf3162-7054-48d6-abdf-779b0fa54c2a does not exist Jul 20 04:15:09.829963 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-ff2928be-c4a7-4675-9063-b4cc707d764a'] {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:09.829963 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-97418a2c-372d-4f54-b7a1-055fe6c59cb0 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cfcf3162-7054-48d6-abdf-779b0fa54c2a" status: 404 len: 194 microversion: 2.1 time: 0.182773 Jul 20 04:15:09.829963 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 706/1482] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:15:09 2022] DELETE /compute/v2.1/os-security-groups/cfcf3162-7054-48d6-abdf-779b0fa54c2a => generated 194 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:09.841380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1caf87e7-97c5-4364-82d4-b0fc01ffc036 tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] Calling method '.version_select at 0x7fbf9d450160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.844874 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3d3bfabf-f6ae-4867-8f25-4b1c3afa3b59 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.088162 Jul 20 04:15:09.845503 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 777/1483] 10.222.0.20 () {58 vars in 1138 bytes} [Wed Jul 20 04:15:09 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:09.850765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-67d2deb4-000c-4064-8145-7f9ecc5942dd req-1ad4e648-3ef8-4014-a35f-fba093b71eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70dee161-ab18-4fdf-a60b-c6737b36f926", "name": "network-vif-deleted", "tag": "aa64411a-0dd4-4483-a641-dc91cfde3a79"}, {"name": "network-changed", "server_uuid": "956609f6-9ca2-4919-988a-2b0d4a740b26", "tag": "cdee7da2-445b-4334-89cc-1a24affa04ae"}, {"server_uuid": "2f3299f0-afe7-4862-b16d-7bd4498f44c2", "name": "network-vif-deleted", "tag": "95760499-0850-4542-b43e-cb93ce83f98a"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:09.885538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-67d2deb4-000c-4064-8145-7f9ecc5942dd req-1ad4e648-3ef8-4014-a35f-fba093b71eb6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.885985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-67d2deb4-000c-4064-8145-7f9ecc5942dd req-1ad4e648-3ef8-4014-a35f-fba093b71eb6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.919206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-1caf87e7-97c5-4364-82d4-b0fc01ffc036 tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9639d9ec-7b16-4523-8a83-e377d0e764e7 could not be found", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:15:09.920105 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-1caf87e7-97c5-4364-82d4-b0fc01ffc036 tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] HTTP exception thrown: Floating IP not found for ID 9639d9ec-7b16-4523-8a83-e377d0e764e7 Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1caf87e7-97c5-4364-82d4-b0fc01ffc036 tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] Request method failure captured: Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-floating-ips/9639d9ec-7b16-4523-8a83-e377d0e764e7 HTTP/1.1 Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FKfcaQgccCSAfeaGpNKuFO3ejjF-RPx7M4Sk_71d9CgerBVkI1jmrMkF9Z2ukfsbfxF1-S5kK2KFXUkBEMkJAgBvuvaw0vcTCHmS2GQtelP3CtRyNR_ClzFbJBdp3sK9jkW9kPetD6Ri17DsqGAHjnwdjKarqMu-HDfg2D_ThXfKs Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6b5bf6f2ab2b4fbf9685c16a40fdc0b1 Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-397276663 Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:15:09.922170 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6b5bf6f2ab2b4fbf9685c16a40fdc0b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6b5bf6f2ab2b4fbf9685c16a40fdc0b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6b5bf6f2ab2b4fbf9685c16a40fdc0b1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6b5bf6f2ab2b4fbf9685c16a40fdc0b1"}]}] Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-397276663 Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6b5bf6f2ab2b4fbf9685c16a40fdc0b1 Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-397276663 Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-FloatingIPsNegativeTestJSON-397276663-project Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: bf1b18d392314b8c9271e74eeca4fa57 Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-397276663-project Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: exception: Floating IP not found for ID 9639d9ec-7b16-4523-8a83-e377d0e764e7 Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '9639d9ec-7b16-4523-8a83-e377d0e764e7'} Jul 20 04:15:09.923587 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:15:09.924437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9639d9ec-7b16-4523-8a83-e377d0e764e7 could not be found Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b99b38a-086b-451e-8ac7-df20793bea0d'] Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9639d9ec-7b16-4523-8a83-e377d0e764e7. Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.926268 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9639d9ec-7b16-4523-8a83-e377d0e764e7 Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:09.928985 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:09.933757 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9639d9ec-7b16-4523-8a83-e377d0e764e7 Jul 20 04:15:09.933757 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.933757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1caf87e7-97c5-4364-82d4-b0fc01ffc036 tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] Returning 404 to user: Floating IP not found for ID 9639d9ec-7b16-4523-8a83-e377d0e764e7 {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:09.933757 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1caf87e7-97c5-4364-82d4-b0fc01ffc036 tempest-FloatingIPsNegativeTestJSON-397276663 tempest-FloatingIPsNegativeTestJSON-397276663-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/9639d9ec-7b16-4523-8a83-e377d0e764e7" status: 404 len: 111 microversion: 2.1 time: 0.090343 Jul 20 04:15:09.933757 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 707/1484] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:15:09 2022] DELETE /compute/v2.1/os-floating-ips/9639d9ec-7b16-4523-8a83-e377d0e764e7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:09.934474 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-67d2deb4-000c-4064-8145-7f9ecc5942dd req-1ad4e648-3ef8-4014-a35f-fba093b71eb6 service nova] Creating event network-vif-deleted:aa64411a-0dd4-4483-a641-dc91cfde3a79 for instance 70dee161-ab18-4fdf-a60b-c6737b36f926 on n-h1-764485-11 Jul 20 04:15:09.934474 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-67d2deb4-000c-4064-8145-7f9ecc5942dd req-1ad4e648-3ef8-4014-a35f-fba093b71eb6 service nova] Creating event network-changed:cdee7da2-445b-4334-89cc-1a24affa04ae for instance 956609f6-9ca2-4919-988a-2b0d4a740b26 on n-h2-764485-11 Jul 20 04:15:09.934474 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-67d2deb4-000c-4064-8145-7f9ecc5942dd req-1ad4e648-3ef8-4014-a35f-fba093b71eb6 service nova] Creating event network-vif-deleted:95760499-0850-4542-b43e-cb93ce83f98a for instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 on n-h2-764485-11 Jul 20 04:15:09.936532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dccc6763-f028-4362-a7ca-ea03f9778c8b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.948461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dccc6763-f028-4362-a7ca-ea03f9778c8b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:09.950388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-67d2deb4-000c-4064-8145-7f9ecc5942dd req-1ad4e648-3ef8-4014-a35f-fba093b71eb6 service nova] Instance 956609f6-9ca2-4919-988a-2b0d4a740b26 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:15:09.966876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dccc6763-f028-4362-a7ca-ea03f9778c8b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.967934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dccc6763-f028-4362-a7ca-ea03f9778c8b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.969106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dccc6763-f028-4362-a7ca-ea03f9778c8b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.972813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dccc6763-f028-4362-a7ca-ea03f9778c8b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.002567 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-67d2deb4-000c-4064-8145-7f9ecc5942dd req-1ad4e648-3ef8-4014-a35f-fba093b71eb6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.148962 Jul 20 04:15:10.004330 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 778/1485] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:10.011927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-625217d6-48a7-4a8a-9753-c5ff0ed2b057 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:10.020888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-625217d6-48a7-4a8a-9753-c5ff0ed2b057 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:10.370457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-625217d6-48a7-4a8a-9753-c5ff0ed2b057 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:10.390015 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-625217d6-48a7-4a8a-9753-c5ff0ed2b057 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 200 len: 1215 microversion: 2.1 time: 0.382269 Jul 20 04:15:10.392247 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 779/1486] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:10 2022] GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 1215 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:10.414288 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eb6502bf-1ea9-46f0-a97b-9228163909e2 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005498 Jul 20 04:15:10.418248 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 780/1487] 10.222.0.20 () {58 vars in 1163 bytes} [Wed Jul 20 04:15:10 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:15:10.460304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a6e4f131-5732-4ab7-a538-e675265469d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:10.464570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a6e4f131-5732-4ab7-a538-e675265469d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:10.498375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6e4f131-5732-4ab7-a538-e675265469d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.501455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6e4f131-5732-4ab7-a538-e675265469d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.504452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6e4f131-5732-4ab7-a538-e675265469d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.506047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6e4f131-5732-4ab7-a538-e675265469d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.631978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6e4f131-5732-4ab7-a538-e675265469d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.632561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6e4f131-5732-4ab7-a538-e675265469d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.633056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-a6e4f131-5732-4ab7-a538-e675265469d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lazy-loading 'fault' on Instance uuid 2f3299f0-afe7-4862-b16d-7bd4498f44c2 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:15:10.828124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dccc6763-f028-4362-a7ca-ea03f9778c8b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:10.860190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a6e4f131-5732-4ab7-a538-e675265469d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:10.865368 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dccc6763-f028-4362-a7ca-ea03f9778c8b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1468 microversion: 2.1 time: 0.912127 Jul 20 04:15:10.866065 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 708/1488] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:09 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1468 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:10.879263 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a6e4f131-5732-4ab7-a538-e675265469d3 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 200 len: 1315 microversion: 2.1 time: 0.458021 Jul 20 04:15:10.879691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d6797580-048a-411c-8a2a-3de097800762 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Calling method '.version_select at 0x7fbf9d5910d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:10.880158 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 781/1489] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:10 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:10.884107 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:10.884107 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:15:10.884803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5635714-9ab2-42b1-a176-55829a3b57b8 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Calling method '.version_select at 0x7fbf9d39b5e0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:10.885432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6797580-048a-411c-8a2a-3de097800762 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.885886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6797580-048a-411c-8a2a-3de097800762 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.886697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6797580-048a-411c-8a2a-3de097800762 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.887133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6797580-048a-411c-8a2a-3de097800762 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.947542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:10.962142 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d6797580-048a-411c-8a2a-3de097800762 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.094963 Jul 20 04:15:10.968260 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 709/1490] 10.222.0.20 () {58 vars in 1144 bytes} [Wed Jul 20 04:15:10 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:15:10.983529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eb571ab7-8ffa-4d71-bb80-545fdc4530ea tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:10.984153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eb571ab7-8ffa-4d71-bb80-545fdc4530ea tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:11.008459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb571ab7-8ffa-4d71-bb80-545fdc4530ea tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.008918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb571ab7-8ffa-4d71-bb80-545fdc4530ea tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:11.009796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb571ab7-8ffa-4d71-bb80-545fdc4530ea tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.010241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb571ab7-8ffa-4d71-bb80-545fdc4530ea tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.726982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eb571ab7-8ffa-4d71-bb80-545fdc4530ea tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:12.744243 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eb571ab7-8ffa-4d71-bb80-545fdc4530ea tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1534 microversion: 2.1 time: 1.772345 Jul 20 04:15:12.747900 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 710/1491] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:10 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1534 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:12.749672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95c6c9d5-a132-414a-b775-8ca3cf514336 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Calling method '.version_select at 0x7fbf9d422a60>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:12.751056 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:12.751056 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:15:12.752589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c6c9d5-a132-414a-b775-8ca3cf514336 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.764631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c6c9d5-a132-414a-b775-8ca3cf514336 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.765840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c6c9d5-a132-414a-b775-8ca3cf514336 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.766711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c6c9d5-a132-414a-b775-8ca3cf514336 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.819067 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95c6c9d5-a132-414a-b775-8ca3cf514336 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.072586 Jul 20 04:15:12.824208 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 711/1492] 10.222.0.20 () {58 vars in 1127 bytes} [Wed Jul 20 04:15:12 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:12.833782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fbc47c2f-deb8-4823-83f2-d6e98994db42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:12.836943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fbc47c2f-deb8-4823-83f2-d6e98994db42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:12.890344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbc47c2f-deb8-4823-83f2-d6e98994db42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.890791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbc47c2f-deb8-4823-83f2-d6e98994db42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.891861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbc47c2f-deb8-4823-83f2-d6e98994db42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.892310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbc47c2f-deb8-4823-83f2-d6e98994db42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.202371 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d5635714-9ab2-42b1-a176-55829a3b57b8 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 2.321123 Jul 20 04:15:13.203075 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 782/1493] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:15:10 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:13.208563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0e2eba71-9760-413f-91b2-ef87bdbd799e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.211265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0e2eba71-9760-413f-91b2-ef87bdbd799e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:13.244014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e2eba71-9760-413f-91b2-ef87bdbd799e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.247101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e2eba71-9760-413f-91b2-ef87bdbd799e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.253165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e2eba71-9760-413f-91b2-ef87bdbd799e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.253858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e2eba71-9760-413f-91b2-ef87bdbd799e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.674876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fbc47c2f-deb8-4823-83f2-d6e98994db42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:13.690060 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fbc47c2f-deb8-4823-83f2-d6e98994db42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 200 len: 1315 microversion: 2.1 time: 0.864517 Jul 20 04:15:13.702017 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 712/1494] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:12 2022] GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 1315 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:13.709339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a5a09171-1a7b-4279-af8c-8e8a60ab252d tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.710197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a5a09171-1a7b-4279-af8c-8e8a60ab252d tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:13.717444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5a09171-1a7b-4279-af8c-8e8a60ab252d tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.718337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5a09171-1a7b-4279-af8c-8e8a60ab252d tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.719291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5a09171-1a7b-4279-af8c-8e8a60ab252d tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.719915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5a09171-1a7b-4279-af8c-8e8a60ab252d tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.781122 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a5a09171-1a7b-4279-af8c-8e8a60ab252d tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] HTTP exception thrown: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a5a09171-1a7b-4279-af8c-8e8a60ab252d tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 HTTP/1.1 Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:15:13.793896 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:15:13.795548 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:15:13.795548 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:13.795548 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:15:13.795548 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:13.795548 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:15:13.795548 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:15:13.795548 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:15:13.795548 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:15:13.795548 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:15:13.795548 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:15:13.795548 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:13.795548 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '2f3299f0-afe7-4862-b16d-7bd4498f44c2'} Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:13.796652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:13.797957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:13.818978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a5a09171-1a7b-4279-af8c-8e8a60ab252d tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 404 to user: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:13.828635 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a5a09171-1a7b-4279-af8c-8e8a60ab252d tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 404 len: 111 microversion: 2.1 time: 0.125045 Jul 20 04:15:13.838440 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 713/1495] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:13 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:13.842915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2246e88f-3c5d-4610-b4e9-026cd7c783fb tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Calling method '.version_select at 0x7fbf9d4019d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.855405 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:13.855405 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:15:13.856843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2246e88f-3c5d-4610-b4e9-026cd7c783fb tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.857336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2246e88f-3c5d-4610-b4e9-026cd7c783fb tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.858142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2246e88f-3c5d-4610-b4e9-026cd7c783fb tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.858575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2246e88f-3c5d-4610-b4e9-026cd7c783fb tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.923596 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2246e88f-3c5d-4610-b4e9-026cd7c783fb tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.091702 Jul 20 04:15:13.925358 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 714/1496] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:13 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:13.930229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a6a556b-1425-49c9-81c3-447d428d10fd tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Calling method '.version_select at 0x7fbf9d591160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.998237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0e2eba71-9760-413f-91b2-ef87bdbd799e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:14.007139 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0e2eba71-9760-413f-91b2-ef87bdbd799e tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 200 len: 1468 microversion: 2.1 time: 0.802887 Jul 20 04:15:14.015910 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 783/1497] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:13 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 1468 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:14.021378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-41b3d530-e150-4129-b571-4d317d4aefe6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.021995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-41b3d530-e150-4129-b571-4d317d4aefe6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:14.052095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41b3d530-e150-4129-b571-4d317d4aefe6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.054248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41b3d530-e150-4129-b571-4d317d4aefe6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.057723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41b3d530-e150-4129-b571-4d317d4aefe6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.058443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41b3d530-e150-4129-b571-4d317d4aefe6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.669852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-41b3d530-e150-4129-b571-4d317d4aefe6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:14.689364 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-41b3d530-e150-4129-b571-4d317d4aefe6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1534 microversion: 2.1 time: 0.672241 Jul 20 04:15:14.710691 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 784/1498] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1534 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:14.726535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c314ecf-6bf0-4fea-9edb-57c8449fe063 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Calling method '.version_select at 0x7fbf9d3af8b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.728282 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:14.728282 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:14.729742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c314ecf-6bf0-4fea-9edb-57c8449fe063 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.730576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c314ecf-6bf0-4fea-9edb-57c8449fe063 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.735184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c314ecf-6bf0-4fea-9edb-57c8449fe063 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.735894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c314ecf-6bf0-4fea-9edb-57c8449fe063 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.786357 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4c314ecf-6bf0-4fea-9edb-57c8449fe063 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.074055 Jul 20 04:15:14.787192 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 785/1499] 10.222.0.20 () {58 vars in 1127 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:14.792621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-185969681", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:14.901935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] validate_networks() for [('265c2afe-140f-48d5-89cc-51314f1c08d1', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:15.181868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-4a6a556b-1425-49c9-81c3-447d428d10fd tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:15:15.183112 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-4a6a556b-1425-49c9-81c3-447d428d10fd tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 20 04:15:15.183112 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-97c0de76-6278-4848-a1ed-1487829171b1'] Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a6a556b-1425-49c9-81c3-447d428d10fd tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Request method failure captured: Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-security-groups/70cfef5e-8d11-41be-9afa-2c9f8cf7cbf0 HTTP/1.1 Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FL1Y6tcMgRPD_XmJU84kreXRkMDi0FdAVsZsLc2WQ4nPQbm0ZyJ5FGG6lkIMRwZ7QYjGsPc4a5GD9PasUsHH3hoEh13dNduKepw3R3vArHNzFSzy9UeHE-dNTUSHqVvdueqRun4AG2yX6jkvj-vhothF_1H1AWO--mUo9FBonnK80 Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: f36ed842c59044e9b96ad1981e4ec146 Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1831617677 Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:15:15.185235 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f36ed842c59044e9b96ad1981e4ec146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f36ed842c59044e9b96ad1981e4ec146"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f36ed842c59044e9b96ad1981e4ec146", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f36ed842c59044e9b96ad1981e4ec146"}]}] Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1831617677 Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: f36ed842c59044e9b96ad1981e4ec146 Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1831617677 Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupsNegativeTestJSON-1831617677-project Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 3753a1dc40a64b26b7b8adb887295255 Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1831617677-project Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: exception: Insufficient rights for removing default security group. Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-97c0de76-6278-4848-a1ed-1487829171b1'] Jul 20 04:15:15.186887 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '70cfef5e-8d11-41be-9afa-2c9f8cf7cbf0'} Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:15.187891 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97c0de76-6278-4848-a1ed-1487829171b1'] Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 20 04:15:15.189499 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97c0de76-6278-4848-a1ed-1487829171b1'] Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97c0de76-6278-4848-a1ed-1487829171b1'] Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:15.192429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:15.194972 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:15.194972 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:15.194972 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:15.194972 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 20 04:15:15.194972 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97c0de76-6278-4848-a1ed-1487829171b1'] Jul 20 04:15:15.194972 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:15.199719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a6a556b-1425-49c9-81c3-447d428d10fd tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 20 04:15:15.199719 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-97c0de76-6278-4848-a1ed-1487829171b1'] {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:15.199719 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a6a556b-1425-49c9-81c3-447d428d10fd tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/70cfef5e-8d11-41be-9afa-2c9f8cf7cbf0" status: 400 len: 182 microversion: 2.1 time: 1.271989 Jul 20 04:15:15.199719 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 715/1500] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:15:13 2022] DELETE /compute/v2.1/os-security-groups/70cfef5e-8d11-41be-9afa-2c9f8cf7cbf0 => generated 182 bytes in 1273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:15:15.207693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a81d41e0-3d9b-4fe0-92cb-877b8f65a187 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97c3b8cb-8f7c-4cce-b4f9-3a410fc57135", "device": "/dev/xvdb"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:15.210140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a81d41e0-3d9b-4fe0-92cb-877b8f65a187 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:15.236662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81d41e0-3d9b-4fe0-92cb-877b8f65a187 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.237877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81d41e0-3d9b-4fe0-92cb-877b8f65a187 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.239550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81d41e0-3d9b-4fe0-92cb-877b8f65a187 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.240365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81d41e0-3d9b-4fe0-92cb-877b8f65a187 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.713070 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a81d41e0-3d9b-4fe0-92cb-877b8f65a187 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "POST /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511661 Jul 20 04:15:15.718549 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 716/1501] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:15:15 2022] POST /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments => generated 194 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:15.731930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-086954e6-e786-48cf-a661-e1fd4215c032 req-9b40834e-3b00-440c-8cc9-d8a97d66ae6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a7d807-6862-4912-9ad7-a3e46de3ee3b", "tag": "d706330d-fc03-4355-a9d1-ff0a7787b8b2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:15.743860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-086954e6-e786-48cf-a661-e1fd4215c032 req-9b40834e-3b00-440c-8cc9-d8a97d66ae6c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.745493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-086954e6-e786-48cf-a661-e1fd4215c032 req-9b40834e-3b00-440c-8cc9-d8a97d66ae6c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.762883 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-086954e6-e786-48cf-a661-e1fd4215c032 req-9b40834e-3b00-440c-8cc9-d8a97d66ae6c service nova] Creating event network-changed:d706330d-fc03-4355-a9d1-ff0a7787b8b2 for instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b on n-h1-764485-11 Jul 20 04:15:15.769812 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-086954e6-e786-48cf-a661-e1fd4215c032 req-9b40834e-3b00-440c-8cc9-d8a97d66ae6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054159 Jul 20 04:15:15.783413 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 717/1502] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:15.793536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-05970bef-0581-41e6-a391-e096157fa47e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:15.794245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-05970bef-0581-41e6-a391-e096157fa47e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:15.803464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05970bef-0581-41e6-a391-e096157fa47e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.804264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05970bef-0581-41e6-a391-e096157fa47e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.805104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05970bef-0581-41e6-a391-e096157fa47e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.806168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05970bef-0581-41e6-a391-e096157fa47e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.484821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:16.485304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:16.485709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:16.486127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:16.486541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:16.499733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.500547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.501612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.502234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.504321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-05970bef-0581-41e6-a391-e096157fa47e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:16.525139 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-05970bef-0581-41e6-a391-e096157fa47e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 200 len: 1315 microversion: 2.1 time: 0.737336 Jul 20 04:15:16.526088 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 718/1503] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:15 2022] GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:16.530839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-041ddad7-1077-4154-8209-e1f8f1861674 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Calling method '.version_select at 0x7fbf9d494dc0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.531886 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:16.531886 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:15:16.539637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-041ddad7-1077-4154-8209-e1f8f1861674 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.540567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-041ddad7-1077-4154-8209-e1f8f1861674 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.547502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Getting quotas for project a15623aa4b154b46a0e7fa6bcdf6c1be. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:16.559121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Getting quotas for user a2e2ee08afb949bfabefeb750a0ba191 and project a15623aa4b154b46a0e7fa6bcdf6c1be. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:16.575784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-041ddad7-1077-4154-8209-e1f8f1861674 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.576297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-041ddad7-1077-4154-8209-e1f8f1861674 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.578159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:16.581378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:16.604779 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-041ddad7-1077-4154-8209-e1f8f1861674 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h1-764485-11" status: 200 len: 866 microversion: 2.1 time: 0.077369 Jul 20 04:15:16.605657 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 719/1504] 10.222.0.20 () {58 vars in 1172 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/os-hosts/n-h1-764485-11 => generated 866 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:16.611255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:16.617669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e159ded4-62f4-434b-a7fc-832ebb9e0550 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.618531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e159ded4-62f4-434b-a7fc-832ebb9e0550 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: 5f3c36c5-27be-4732-b611-318b82de3094] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:16.625548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e159ded4-62f4-434b-a7fc-832ebb9e0550 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.626315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e159ded4-62f4-434b-a7fc-832ebb9e0550 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.627722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e159ded4-62f4-434b-a7fc-832ebb9e0550 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.628398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e159ded4-62f4-434b-a7fc-832ebb9e0550 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.635486 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-54083e46-2b85-44f7-a7ba-18c95c9fc430 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.847039 Jul 20 04:15:16.636549 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 786/1505] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:16.641177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-26ad01a3-94e8-4a46-b679-b8040f3aee50 req-5f17cfe1-dfc4-4b41-aeba-76359523c5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3c36c5-27be-4732-b611-318b82de3094", "name": "network-vif-deleted", "tag": "2bf3529a-e4e6-4908-b13f-8e1d8ee72c64"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:16.651865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-26ad01a3-94e8-4a46-b679-b8040f3aee50 req-5f17cfe1-dfc4-4b41-aeba-76359523c5cc service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.652649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-26ad01a3-94e8-4a46-b679-b8040f3aee50 req-5f17cfe1-dfc4-4b41-aeba-76359523c5cc service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.667147 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-26ad01a3-94e8-4a46-b679-b8040f3aee50 req-5f17cfe1-dfc4-4b41-aeba-76359523c5cc service nova] Creating event network-vif-deleted:2bf3529a-e4e6-4908-b13f-8e1d8ee72c64 for instance 5f3c36c5-27be-4732-b611-318b82de3094 on n-h2-764485-11 Jul 20 04:15:16.669959 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e159ded4-62f4-434b-a7fc-832ebb9e0550 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] HTTP exception thrown: Instance 5f3c36c5-27be-4732-b611-318b82de3094 could not be found. Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e159ded4-62f4-434b-a7fc-832ebb9e0550 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Request method failure captured: Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 HTTP/1.1 Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14C_nGwQCLew39hF3cwQVkTcE5v2emgtd00i10VkHHW2F0-w85jfBIfZ-W1mYSv1uZk2FXSwU6MusjgS0I-YGCX5izB5CvoR5qB4W2C66TUOMbpuo6CeMfPihsLjki-TkztoC3YW0ve1Eq1Nw6LxHlUSoyvHjnRcpjaQoXIXOKpahQw Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5875a8f9aeef4ae09122649735d93375 Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersAdminTestJSON-312124911 Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:15:16.671824 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:15:16.673191 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5875a8f9aeef4ae09122649735d93375"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5875a8f9aeef4ae09122649735d93375"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5875a8f9aeef4ae09122649735d93375", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5875a8f9aeef4ae09122649735d93375"}]}] Jul 20 04:15:16.673191 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersAdminTestJSON-312124911 Jul 20 04:15:16.673191 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5875a8f9aeef4ae09122649735d93375 Jul 20 04:15:16.673191 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersAdminTestJSON-312124911 Jul 20 04:15:16.673191 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersAdminTestJSON-312124911-project Jul 20 04:15:16.673191 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:15:16.673191 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:15:16.673191 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 61350a88f2664e6f9c6dee8a4186819b Jul 20 04:15:16.673191 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersAdminTestJSON-312124911-project Jul 20 04:15:16.673191 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:15:16.673191 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 5f3c36c5-27be-4732-b611-318b82de3094 could not be found. Jul 20 04:15:16.673191 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '5f3c36c5-27be-4732-b611-318b82de3094'} Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3c36c5-27be-4732-b611-318b82de3094 could not be found. Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:16.673990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3c36c5-27be-4732-b611-318b82de3094 could not be found. Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3c36c5-27be-4732-b611-318b82de3094 could not be found. Jul 20 04:15:16.676155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:16.677272 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-26ad01a3-94e8-4a46-b679-b8040f3aee50 req-5f17cfe1-dfc4-4b41-aeba-76359523c5cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034311 Jul 20 04:15:16.677367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e159ded4-62f4-434b-a7fc-832ebb9e0550 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Returning 404 to user: Instance 5f3c36c5-27be-4732-b611-318b82de3094 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:16.677449 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 787/1506] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:16.677535 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e159ded4-62f4-434b-a7fc-832ebb9e0550 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094" status: 404 len: 111 microversion: 2.1 time: 0.061096 Jul 20 04:15:16.677535 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 720/1507] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/servers/5f3c36c5-27be-4732-b611-318b82de3094 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:16.678578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-95a184aa-92d2-43b4-b50b-7e32803e2003 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Calling method '.version_select at 0x7fbf9d344040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.684211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7ece7f14-dbd6-4c51-a814-a9a9da535dd1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.684884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7ece7f14-dbd6-4c51-a814-a9a9da535dd1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:16.692740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ece7f14-dbd6-4c51-a814-a9a9da535dd1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.693362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ece7f14-dbd6-4c51-a814-a9a9da535dd1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.694224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ece7f14-dbd6-4c51-a814-a9a9da535dd1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.694755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ece7f14-dbd6-4c51-a814-a9a9da535dd1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.746710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG neutronclient.v2_0.client [None req-95a184aa-92d2-43b4-b50b-7e32803e2003 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5b0bf782-6704-44de-ae2c-3586786d5868 does not exist", "detail": ""}} {{(pid=119808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:15:16.747458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.security_group_api [None req-95a184aa-92d2-43b4-b50b-7e32803e2003 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Neutron security group 5b0bf782-6704-44de-ae2c-3586786d5868 not found {{(pid=119808) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:15:16.747946 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-95a184aa-92d2-43b4-b50b-7e32803e2003 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] HTTP exception thrown: Security group 5b0bf782-6704-44de-ae2c-3586786d5868 does not exist Jul 20 04:15:16.747946 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-32331823-bbc3-42e6-b89c-a23487b04a62'] Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-95a184aa-92d2-43b4-b50b-7e32803e2003 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Request method failure captured: Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-security-groups/5b0bf782-6704-44de-ae2c-3586786d5868 HTTP/1.1 Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FL1Y6tcMgRPD_XmJU84kreXRkMDi0FdAVsZsLc2WQ4nPQbm0ZyJ5FGG6lkIMRwZ7QYjGsPc4a5GD9PasUsHH3hoEh13dNduKepw3R3vArHNzFSzy9UeHE-dNTUSHqVvdueqRun4AG2yX6jkvj-vhothF_1H1AWO--mUo9FBonnK80 Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: f36ed842c59044e9b96ad1981e4ec146 Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1831617677 Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:16.751676 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f36ed842c59044e9b96ad1981e4ec146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f36ed842c59044e9b96ad1981e4ec146"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f36ed842c59044e9b96ad1981e4ec146", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f36ed842c59044e9b96ad1981e4ec146"}]}] Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1831617677 Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: f36ed842c59044e9b96ad1981e4ec146 Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1831617677 Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupsNegativeTestJSON-1831617677-project Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3753a1dc40a64b26b7b8adb887295255 Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1831617677-project Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: exception: Security group 5b0bf782-6704-44de-ae2c-3586786d5868 does not exist Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-32331823-bbc3-42e6-b89c-a23487b04a62'] Jul 20 04:15:16.753603 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '5b0bf782-6704-44de-ae2c-3586786d5868'} Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:16.754422 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5b0bf782-6704-44de-ae2c-3586786d5868 does not exist Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32331823-bbc3-42e6-b89c-a23487b04a62'] Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:15:16.756597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5b0bf782-6704-44de-ae2c-3586786d5868 does not exist Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32331823-bbc3-42e6-b89c-a23487b04a62'] Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5b0bf782-6704-44de-ae2c-3586786d5868 does not exist Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32331823-bbc3-42e6-b89c-a23487b04a62'] Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:16.759070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:16.762188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:16.762188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:16.762188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:16.762188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:16.762188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5b0bf782-6704-44de-ae2c-3586786d5868 does not exist Jul 20 04:15:16.762188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32331823-bbc3-42e6-b89c-a23487b04a62'] Jul 20 04:15:16.762188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:16.762188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-95a184aa-92d2-43b4-b50b-7e32803e2003 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Returning 404 to user: Security group 5b0bf782-6704-44de-ae2c-3586786d5868 does not exist Jul 20 04:15:16.762188 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-32331823-bbc3-42e6-b89c-a23487b04a62'] {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:16.762188 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-95a184aa-92d2-43b4-b50b-7e32803e2003 tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/5b0bf782-6704-44de-ae2c-3586786d5868" status: 404 len: 194 microversion: 2.1 time: 0.080521 Jul 20 04:15:16.762188 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 788/1508] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/os-security-groups/5b0bf782-6704-44de-ae2c-3586786d5868 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:16.764616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-71209300-da48-4e57-a9c7-03cc6b33b855 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Calling method '.version_select at 0x7fbf9d4c0550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.764616 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:16.764616 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:16.773370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71209300-da48-4e57-a9c7-03cc6b33b855 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.774014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71209300-da48-4e57-a9c7-03cc6b33b855 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.793422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71209300-da48-4e57-a9c7-03cc6b33b855 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.794031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71209300-da48-4e57-a9c7-03cc6b33b855 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.852745 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-71209300-da48-4e57-a9c7-03cc6b33b855 tempest-HostsAdminTestJSON-1616271302 tempest-HostsAdminTestJSON-1616271302-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h2-764485-11" status: 200 len: 603 microversion: 2.1 time: 0.093978 Jul 20 04:15:16.860228 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 789/1509] 10.222.0.20 () {58 vars in 1172 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/os-hosts/n-h2-764485-11 => generated 603 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:16.884375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1b46ae1c-9c83-4eb0-9e52-c28f6f3e29dd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.885154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1b46ae1c-9c83-4eb0-9e52-c28f6f3e29dd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.016253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1b46ae1c-9c83-4eb0-9e52-c28f6f3e29dd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:17.024776 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1b46ae1c-9c83-4eb0-9e52-c28f6f3e29dd tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1224 microversion: 2.1 time: 0.168684 Jul 20 04:15:17.035063 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 790/1510] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1224 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:17.043224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ef03c99a-d46d-4ab5-b790-fec4da61c3b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.045756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ef03c99a-d46d-4ab5-b790-fec4da61c3b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.062680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef03c99a-d46d-4ab5-b790-fec4da61c3b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.063052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef03c99a-d46d-4ab5-b790-fec4da61c3b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.063867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef03c99a-d46d-4ab5-b790-fec4da61c3b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.064307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef03c99a-d46d-4ab5-b790-fec4da61c3b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.143418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ef03c99a-d46d-4ab5-b790-fec4da61c3b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:17.317257 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ef03c99a-d46d-4ab5-b790-fec4da61c3b3 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 204 len: 0 microversion: 2.1 time: 0.284168 Jul 20 04:15:17.322761 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 791/1511] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:17 2022] DELETE /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:17.332731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-abd93bf9-ce94-4f9a-9209-bd6dee7bccff tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Action: 'update', calling method: .version_select at 0x7fbf9d50fd30>, body: {"security_group": {"name": "tempest-sg-162958417", "description": "tempest-description-1586247117"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:17.559330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7ece7f14-dbd6-4c51-a814-a9a9da535dd1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:17.573047 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7ece7f14-dbd6-4c51-a814-a9a9da535dd1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1527 microversion: 2.1 time: 0.896770 Jul 20 04:15:17.588511 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 721/1512] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1527 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:17.588898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ed4b7c45-adb4-4786-b439-097781a854b1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.589497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ed4b7c45-adb4-4786-b439-097781a854b1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.604176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed4b7c45-adb4-4786-b439-097781a854b1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.604634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed4b7c45-adb4-4786-b439-097781a854b1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.605777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed4b7c45-adb4-4786-b439-097781a854b1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.606228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed4b7c45-adb4-4786-b439-097781a854b1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.757668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG neutronclient.v2_0.client [None req-abd93bf9-ce94-4f9a-9209-bd6dee7bccff tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cf8961d8-0b4d-4bc4-9a00-f74996cd1f48 does not exist", "detail": ""}} {{(pid=119808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:15:17.758286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.security_group_api [None req-abd93bf9-ce94-4f9a-9209-bd6dee7bccff tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Neutron security group cf8961d8-0b4d-4bc4-9a00-f74996cd1f48 not found {{(pid=119808) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:15:17.758824 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-abd93bf9-ce94-4f9a-9209-bd6dee7bccff tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] HTTP exception thrown: Security group cf8961d8-0b4d-4bc4-9a00-f74996cd1f48 does not exist Jul 20 04:15:17.758824 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-b32adc11-2808-4d59-9055-85abfc38ca6f'] Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-abd93bf9-ce94-4f9a-9209-bd6dee7bccff tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Request method failure captured: Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: request: PUT /compute/v2.1/os-security-groups/cf8961d8-0b4d-4bc4-9a00-f74996cd1f48 HTTP/1.1 Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 101 Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FL1Y6tcMgRPD_XmJU84kreXRkMDi0FdAVsZsLc2WQ4nPQbm0ZyJ5FGG6lkIMRwZ7QYjGsPc4a5GD9PasUsHH3hoEh13dNduKepw3R3vArHNzFSzy9UeHE-dNTUSHqVvdueqRun4AG2yX6jkvj-vhothF_1H1AWO--mUo9FBonnK80 Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: f36ed842c59044e9b96ad1981e4ec146 Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1831617677 Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:17.760841 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f36ed842c59044e9b96ad1981e4ec146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f36ed842c59044e9b96ad1981e4ec146"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f36ed842c59044e9b96ad1981e4ec146", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f36ed842c59044e9b96ad1981e4ec146"}]}] Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1831617677 Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: f36ed842c59044e9b96ad1981e4ec146 Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1831617677 Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupsNegativeTestJSON-1831617677-project Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3753a1dc40a64b26b7b8adb887295255 Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1831617677-project Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: {"security_group": {"name": "tempest-sg-162958417", "description": "tempest-description-1586247117"}} Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:17.762460 n-d-764485-11 devstack@n-api.service[119808]: exception: Security group cf8961d8-0b4d-4bc4-9a00-f74996cd1f48 does not exist Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-b32adc11-2808-4d59-9055-85abfc38ca6f'] Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'cf8961d8-0b4d-4bc4-9a00-f74996cd1f48', 'body': {'security_group': {'name': 'tempest-sg-162958417', 'description': 'tempest-description-1586247117'}}} Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:15:17.763433 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cf8961d8-0b4d-4bc4-9a00-f74996cd1f48 does not exist Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b32adc11-2808-4d59-9055-85abfc38ca6f'] Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:15:17.764801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cf8961d8-0b4d-4bc4-9a00-f74996cd1f48 does not exist Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b32adc11-2808-4d59-9055-85abfc38ca6f'] Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cf8961d8-0b4d-4bc4-9a00-f74996cd1f48 does not exist Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b32adc11-2808-4d59-9055-85abfc38ca6f'] Jul 20 04:15:17.767475 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cf8961d8-0b4d-4bc4-9a00-f74996cd1f48 does not exist Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b32adc11-2808-4d59-9055-85abfc38ca6f'] Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-abd93bf9-ce94-4f9a-9209-bd6dee7bccff tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] Returning 404 to user: Security group cf8961d8-0b4d-4bc4-9a00-f74996cd1f48 does not exist Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-b32adc11-2808-4d59-9055-85abfc38ca6f'] {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:17.770585 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-abd93bf9-ce94-4f9a-9209-bd6dee7bccff tempest-SecurityGroupsNegativeTestJSON-1831617677 tempest-SecurityGroupsNegativeTestJSON-1831617677-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/cf8961d8-0b4d-4bc4-9a00-f74996cd1f48" status: 404 len: 194 microversion: 2.1 time: 0.437685 Jul 20 04:15:17.772609 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 792/1513] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Jul 20 04:15:17 2022] PUT /compute/v2.1/os-security-groups/cf8961d8-0b4d-4bc4-9a00-f74996cd1f48 => generated 194 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:17.778535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-25cbc610-3522-4a23-ba67-4da10d3d8a62 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.781696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-25cbc610-3522-4a23-ba67-4da10d3d8a62 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.796755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25cbc610-3522-4a23-ba67-4da10d3d8a62 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.797222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25cbc610-3522-4a23-ba67-4da10d3d8a62 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.798020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25cbc610-3522-4a23-ba67-4da10d3d8a62 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.798473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-25cbc610-3522-4a23-ba67-4da10d3d8a62 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.103561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ed4b7c45-adb4-4786-b439-097781a854b1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:18.112781 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ed4b7c45-adb4-4786-b439-097781a854b1 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1469 microversion: 2.1 time: 0.532617 Jul 20 04:15:18.131828 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 722/1514] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1469 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:18.139728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5e7625c8-e980-4757-b274-68dfa4d736c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:18.140585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5e7625c8-e980-4757-b274-68dfa4d736c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:18.172583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e7625c8-e980-4757-b274-68dfa4d736c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.173310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e7625c8-e980-4757-b274-68dfa4d736c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.175141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e7625c8-e980-4757-b274-68dfa4d736c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.175977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e7625c8-e980-4757-b274-68dfa4d736c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.187890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:18.504991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-25cbc610-3522-4a23-ba67-4da10d3d8a62 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:18.521007 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-25cbc610-3522-4a23-ba67-4da10d3d8a62 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 200 len: 1315 microversion: 2.1 time: 0.752671 Jul 20 04:15:18.521690 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 793/1515] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:18.542642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec92bf68-0533-41e2-bf8c-416f1ab2ebba tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:18.543269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ec92bf68-0533-41e2-bf8c-416f1ab2ebba tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:18.560835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec92bf68-0533-41e2-bf8c-416f1ab2ebba tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.561224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec92bf68-0533-41e2-bf8c-416f1ab2ebba tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.562011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec92bf68-0533-41e2-bf8c-416f1ab2ebba tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.562461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec92bf68-0533-41e2-bf8c-416f1ab2ebba tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:19.293862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ec92bf68-0533-41e2-bf8c-416f1ab2ebba tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:19.308221 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ec92bf68-0533-41e2-bf8c-416f1ab2ebba tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1282 microversion: 2.1 time: 0.782383 Jul 20 04:15:19.308891 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 794/1516] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:18 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1282 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:19.331365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8b240044-d67c-49f6-9dee-732695911301 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:19.332465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8b240044-d67c-49f6-9dee-732695911301 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:19.345586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b240044-d67c-49f6-9dee-732695911301 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:19.349243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b240044-d67c-49f6-9dee-732695911301 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:19.352390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b240044-d67c-49f6-9dee-732695911301 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:19.354577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b240044-d67c-49f6-9dee-732695911301 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:19.563789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:20.082206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5e7625c8-e980-4757-b274-68dfa4d736c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:20.092304 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5e7625c8-e980-4757-b274-68dfa4d736c8 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1527 microversion: 2.1 time: 1.955890 Jul 20 04:15:20.094928 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 723/1517] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:18 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1527 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:20.114099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9043cea-2138-4b21-ad94-a8c9a2d3a972 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:20.116141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a9043cea-2138-4b21-ad94-a8c9a2d3a972 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:20.135463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9043cea-2138-4b21-ad94-a8c9a2d3a972 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.135951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9043cea-2138-4b21-ad94-a8c9a2d3a972 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.141950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9043cea-2138-4b21-ad94-a8c9a2d3a972 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.142419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9043cea-2138-4b21-ad94-a8c9a2d3a972 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.217472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8b240044-d67c-49f6-9dee-732695911301 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:21.226432 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8b240044-d67c-49f6-9dee-732695911301 tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1469 microversion: 2.1 time: 1.901080 Jul 20 04:15:21.227326 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 795/1518] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:19 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1469 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:21.232344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c50012c-1c0e-4c2a-845e-931bf80b5f36 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:21.236348 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:21.236348 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:21.249973 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-6c50012c-1c0e-4c2a-845e-931bf80b5f36 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] HTTP exception thrown: Flavor 35b2f035-ad7b-48d5-b55f-6bd0d0ba499e could not be found. Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c50012c-1c0e-4c2a-845e-931bf80b5f36 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Request method failure captured: Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/flavors/35b2f035-ad7b-48d5-b55f-6bd0d0ba499e HTTP/1.1 Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BUtGZKpX2clUJRCFkZYJrXOI-NcvXCa_oSvX1ZTG04HS1BhpfoXZunnAEdjh25YHG7TeASBI8D_5UH-exmlVCrejuaLL9U-ilsQUd91wnql9Mn51NUmNCKKQFq9pHzRUJ2GCz6lpcIMKNRFC08GaFXlyY42JcDiSykEKaZ1Aq9sTY Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 871d4eff31f34766adc724f52d5eea0b Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-MigrationsAdminTest-1941670778 Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:15:21.259600 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:15:21.261258 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/871d4eff31f34766adc724f52d5eea0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/871d4eff31f34766adc724f52d5eea0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_871d4eff31f34766adc724f52d5eea0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/871d4eff31f34766adc724f52d5eea0b"}]}] Jul 20 04:15:21.261258 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-MigrationsAdminTest-1941670778 Jul 20 04:15:21.261258 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 871d4eff31f34766adc724f52d5eea0b Jul 20 04:15:21.261258 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-MigrationsAdminTest-1941670778 Jul 20 04:15:21.261258 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-MigrationsAdminTest-1941670778-project-admin Jul 20 04:15:21.261258 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:21.261258 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:21.261258 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3c64cc1266264ac5b665950c0c6167d5 Jul 20 04:15:21.261258 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-MigrationsAdminTest-1941670778-project-admin Jul 20 04:15:21.261258 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:15:21.261258 n-d-764485-11 devstack@n-api.service[119808]: exception: Flavor 35b2f035-ad7b-48d5-b55f-6bd0d0ba499e could not be found. Jul 20 04:15:21.261258 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '35b2f035-ad7b-48d5-b55f-6bd0d0ba499e'} Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 35b2f035-ad7b-48d5-b55f-6bd0d0ba499e could not be found. Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:21.262227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 35b2f035-ad7b-48d5-b55f-6bd0d0ba499e could not be found. Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 35b2f035-ad7b-48d5-b55f-6bd0d0ba499e could not be found. Jul 20 04:15:21.263530 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:21.269727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c50012c-1c0e-4c2a-845e-931bf80b5f36 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Returning 404 to user: Flavor 35b2f035-ad7b-48d5-b55f-6bd0d0ba499e could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:21.270212 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6c50012c-1c0e-4c2a-845e-931bf80b5f36 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/35b2f035-ad7b-48d5-b55f-6bd0d0ba499e" status: 404 len: 109 microversion: 2.1 time: 0.039711 Jul 20 04:15:21.271317 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 796/1519] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:21 2022] DELETE /compute/v2.1/flavors/35b2f035-ad7b-48d5-b55f-6bd0d0ba499e => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:21.281775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-5fb68ee7-35d3-475c-bf98-3898763dc907 req-752cbb66-6015-4a60-a782-ec047d47dea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956609f6-9ca2-4919-988a-2b0d4a740b26", "name": "network-vif-plugged", "status": "completed", "tag": "cdee7da2-445b-4334-89cc-1a24affa04ae"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:21.308310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5fb68ee7-35d3-475c-bf98-3898763dc907 req-752cbb66-6015-4a60-a782-ec047d47dea4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.309079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5fb68ee7-35d3-475c-bf98-3898763dc907 req-752cbb66-6015-4a60-a782-ec047d47dea4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.333422 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-5fb68ee7-35d3-475c-bf98-3898763dc907 req-752cbb66-6015-4a60-a782-ec047d47dea4 service nova] Creating event network-vif-plugged:cdee7da2-445b-4334-89cc-1a24affa04ae for instance 956609f6-9ca2-4919-988a-2b0d4a740b26 on n-h2-764485-11 Jul 20 04:15:21.349346 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-5fb68ee7-35d3-475c-bf98-3898763dc907 req-752cbb66-6015-4a60-a782-ec047d47dea4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076380 Jul 20 04:15:21.350321 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 797/1520] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:21.363187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a9043cea-2138-4b21-ad94-a8c9a2d3a972 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:21.363742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b3835a0f-87b0-476b-a730-01e2d2f88d15 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:21.364694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b3835a0f-87b0-476b-a730-01e2d2f88d15 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:21.376095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3835a0f-87b0-476b-a730-01e2d2f88d15 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.385138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3835a0f-87b0-476b-a730-01e2d2f88d15 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.386214 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a9043cea-2138-4b21-ad94-a8c9a2d3a972 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 200 len: 1315 microversion: 2.1 time: 1.285912 Jul 20 04:15:21.386624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3835a0f-87b0-476b-a730-01e2d2f88d15 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.387281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3835a0f-87b0-476b-a730-01e2d2f88d15 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.390374 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 724/1521] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:20 2022] GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 1315 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:21.578125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1296233634", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:21.652157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:22.015716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b3835a0f-87b0-476b-a730-01e2d2f88d15 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:22.028317 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b3835a0f-87b0-476b-a730-01e2d2f88d15 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1282 microversion: 2.1 time: 0.675948 Jul 20 04:15:22.039211 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 798/1522] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:21 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1282 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:22.245769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da14e7d1-3ccc-4def-807f-438bba18676b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:22.246453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-da14e7d1-3ccc-4def-807f-438bba18676b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:22.262792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da14e7d1-3ccc-4def-807f-438bba18676b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.263075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da14e7d1-3ccc-4def-807f-438bba18676b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.270081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da14e7d1-3ccc-4def-807f-438bba18676b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.271487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da14e7d1-3ccc-4def-807f-438bba18676b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.663804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-da14e7d1-3ccc-4def-807f-438bba18676b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61350a88f2664e6f9c6dee8a4186819b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5875a8f9aeef4ae09122649735d93375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:22.675074 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da14e7d1-3ccc-4def-807f-438bba18676b tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 200 len: 1427 microversion: 2.1 time: 0.434268 Jul 20 04:15:22.680760 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 799/1523] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:22 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 1427 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:22.690825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7d9bf516-995f-4bf1-8800-27512a332c3f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:22.705108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7d9bf516-995f-4bf1-8800-27512a332c3f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:22.730263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d9bf516-995f-4bf1-8800-27512a332c3f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.730721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d9bf516-995f-4bf1-8800-27512a332c3f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.731545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d9bf516-995f-4bf1-8800-27512a332c3f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.731993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d9bf516-995f-4bf1-8800-27512a332c3f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.888732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:22.890510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:22.891442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:22.892211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:22.892875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:22.935802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.936821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.938008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.944172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.060847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Getting quotas for project 41ba023317344d3490bdb01aa8b1e01b. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:23.068849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Getting quotas for user 9aa79203e62546cea351116b153afee5 and project 41ba023317344d3490bdb01aa8b1e01b. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:23.092852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:23.096737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:23.218364 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5fc0627-7078-4a83-a3f7-2c267278784b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.642338 Jul 20 04:15:23.223226 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 725/1524] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:23.245486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b4e8e6c3-4130-43a9-8d32-1804a972ac98 req-102a28b1-402e-4c9c-8d05-6c1325e4ca79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42b8c28-e93e-471e-b549-5718883dc7b6", "name": "network-vif-deleted", "tag": "4266796f-8098-40de-be9c-26d7b872b741"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:23.290103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b4e8e6c3-4130-43a9-8d32-1804a972ac98 req-102a28b1-402e-4c9c-8d05-6c1325e4ca79 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.290828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b4e8e6c3-4130-43a9-8d32-1804a972ac98 req-102a28b1-402e-4c9c-8d05-6c1325e4ca79 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.334528 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b4e8e6c3-4130-43a9-8d32-1804a972ac98 req-102a28b1-402e-4c9c-8d05-6c1325e4ca79 service nova] Creating event network-vif-deleted:4266796f-8098-40de-be9c-26d7b872b741 for instance c42b8c28-e93e-471e-b549-5718883dc7b6 on n-h1-764485-11 Jul 20 04:15:23.353125 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b4e8e6c3-4130-43a9-8d32-1804a972ac98 req-102a28b1-402e-4c9c-8d05-6c1325e4ca79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121655 Jul 20 04:15:23.356395 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 726/1525] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:23.368474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0d28f4ac-a34d-4d15-8836-84f2e1ee3f4e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:23.369395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0d28f4ac-a34d-4d15-8836-84f2e1ee3f4e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:23.407475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d28f4ac-a34d-4d15-8836-84f2e1ee3f4e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.414652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d28f4ac-a34d-4d15-8836-84f2e1ee3f4e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.416561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d28f4ac-a34d-4d15-8836-84f2e1ee3f4e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.422977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d28f4ac-a34d-4d15-8836-84f2e1ee3f4e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.089292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7d9bf516-995f-4bf1-8800-27512a332c3f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:24.096022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:24.103608 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7d9bf516-995f-4bf1-8800-27512a332c3f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 200 len: 1315 microversion: 2.1 time: 1.421515 Jul 20 04:15:24.110426 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 800/1526] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:22 2022] GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 1315 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:24.132797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ecb5ebfd-bef5-4000-84fb-96dd12006406 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:24.133296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ecb5ebfd-bef5-4000-84fb-96dd12006406 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:24.274899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ecb5ebfd-bef5-4000-84fb-96dd12006406 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:24.292562 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ecb5ebfd-bef5-4000-84fb-96dd12006406 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1213 microversion: 2.1 time: 0.176386 Jul 20 04:15:24.295949 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 801/1527] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:24 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1213 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:24.312954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-af2fd672-755a-4437-bfc9-623a2150b369 req-3c5d4f13-16f5-4feb-920d-f99121ee2276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1a7d807-6862-4912-9ad7-a3e46de3ee3b", "name": "network-vif-plugged", "status": "completed", "tag": "d706330d-fc03-4355-a9d1-ff0a7787b8b2"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:24.357188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-af2fd672-755a-4437-bfc9-623a2150b369 req-3c5d4f13-16f5-4feb-920d-f99121ee2276 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.360339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-af2fd672-755a-4437-bfc9-623a2150b369 req-3c5d4f13-16f5-4feb-920d-f99121ee2276 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.365209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0d28f4ac-a34d-4d15-8836-84f2e1ee3f4e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:24.379566 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0d28f4ac-a34d-4d15-8836-84f2e1ee3f4e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1324 microversion: 2.1 time: 1.021621 Jul 20 04:15:24.380344 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 727/1528] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:23 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1324 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:24.387063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a378c859-f595-4024-98a7-5df739558aff tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:24.392735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a378c859-f595-4024-98a7-5df739558aff tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] [instance: c42b8c28-e93e-471e-b549-5718883dc7b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:24.397497 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-af2fd672-755a-4437-bfc9-623a2150b369 req-3c5d4f13-16f5-4feb-920d-f99121ee2276 service nova] Creating event network-vif-plugged:d706330d-fc03-4355-a9d1-ff0a7787b8b2 for instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b on n-h1-764485-11 Jul 20 04:15:24.405593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a378c859-f595-4024-98a7-5df739558aff tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.406270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a378c859-f595-4024-98a7-5df739558aff tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.407321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a378c859-f595-4024-98a7-5df739558aff tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.407999 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-af2fd672-755a-4437-bfc9-623a2150b369 req-3c5d4f13-16f5-4feb-920d-f99121ee2276 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109130 Jul 20 04:15:24.408421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a378c859-f595-4024-98a7-5df739558aff tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.419669 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 802/1529] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:24.454813 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a378c859-f595-4024-98a7-5df739558aff tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] HTTP exception thrown: Instance c42b8c28-e93e-471e-b549-5718883dc7b6 could not be found. Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a378c859-f595-4024-98a7-5df739558aff tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Request method failure captured: Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 HTTP/1.1 Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14C_nGwQCLew39hF3cwQVkTcE5v2emgtd00i10VkHHW2F0-w85jfBIfZ-W1mYSv1uZk2FXSwU6MusjgS0I-YGCX5izB5CvoR5qB4W2C66TUOMbpuo6CeMfPihsLjki-TkztoC3YW0ve1Eq1Nw6LxHlUSoyvHjnRcpjaQoXIXOKpahQw Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5875a8f9aeef4ae09122649735d93375 Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersAdminTestJSON-312124911 Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:15:24.473862 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:15:24.475600 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5875a8f9aeef4ae09122649735d93375"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5875a8f9aeef4ae09122649735d93375"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5875a8f9aeef4ae09122649735d93375", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5875a8f9aeef4ae09122649735d93375"}]}] Jul 20 04:15:24.475600 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersAdminTestJSON-312124911 Jul 20 04:15:24.475600 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5875a8f9aeef4ae09122649735d93375 Jul 20 04:15:24.475600 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersAdminTestJSON-312124911 Jul 20 04:15:24.475600 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersAdminTestJSON-312124911-project Jul 20 04:15:24.475600 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:15:24.475600 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:15:24.475600 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 61350a88f2664e6f9c6dee8a4186819b Jul 20 04:15:24.475600 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersAdminTestJSON-312124911-project Jul 20 04:15:24.475600 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:15:24.475600 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance c42b8c28-e93e-471e-b549-5718883dc7b6 could not be found. Jul 20 04:15:24.475600 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'c42b8c28-e93e-471e-b549-5718883dc7b6'} Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42b8c28-e93e-471e-b549-5718883dc7b6 could not be found. Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:24.476538 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42b8c28-e93e-471e-b549-5718883dc7b6 could not be found. Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42b8c28-e93e-471e-b549-5718883dc7b6 could not be found. Jul 20 04:15:24.478026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.480779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a378c859-f595-4024-98a7-5df739558aff tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] Returning 404 to user: Instance c42b8c28-e93e-471e-b549-5718883dc7b6 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:24.483236 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a378c859-f595-4024-98a7-5df739558aff tempest-ServersAdminTestJSON-312124911 tempest-ServersAdminTestJSON-312124911-project] 10.222.0.20 "GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6" status: 404 len: 111 microversion: 2.1 time: 0.101726 Jul 20 04:15:24.485132 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 728/1530] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:24 2022] GET /compute/v2.1/servers/c42b8c28-e93e-471e-b549-5718883dc7b6 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:25.135653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-195fb16b-157d-4c99-9b7b-22115af8e09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:25.136380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-195fb16b-157d-4c99-9b7b-22115af8e09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:25.154325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-195fb16b-157d-4c99-9b7b-22115af8e09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.154899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-195fb16b-157d-4c99-9b7b-22115af8e09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.155793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-195fb16b-157d-4c99-9b7b-22115af8e09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.156331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-195fb16b-157d-4c99-9b7b-22115af8e09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.313583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1cd8d133-d21b-4a62-90fe-3351498dc51b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:25.314211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1cd8d133-d21b-4a62-90fe-3351498dc51b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:25.330504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1cd8d133-d21b-4a62-90fe-3351498dc51b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.330504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1cd8d133-d21b-4a62-90fe-3351498dc51b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.330504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1cd8d133-d21b-4a62-90fe-3351498dc51b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.330928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1cd8d133-d21b-4a62-90fe-3351498dc51b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.474205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1cd8d133-d21b-4a62-90fe-3351498dc51b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:25.483103 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1cd8d133-d21b-4a62-90fe-3351498dc51b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1265 microversion: 2.1 time: 0.173882 Jul 20 04:15:25.487492 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 729/1531] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:25 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:25.500853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-61f49d99-6b6f-4c23-8eba-e2a9928e4a9a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:25.501378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-61f49d99-6b6f-4c23-8eba-e2a9928e4a9a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:25.523062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-61f49d99-6b6f-4c23-8eba-e2a9928e4a9a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.523554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-61f49d99-6b6f-4c23-8eba-e2a9928e4a9a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.524960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-61f49d99-6b6f-4c23-8eba-e2a9928e4a9a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.525715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-61f49d99-6b6f-4c23-8eba-e2a9928e4a9a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.528861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-195fb16b-157d-4c99-9b7b-22115af8e09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:25.543932 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-195fb16b-157d-4c99-9b7b-22115af8e09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 200 len: 1315 microversion: 2.1 time: 0.418297 Jul 20 04:15:25.560966 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 803/1532] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:25 2022] GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:26.081775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-61f49d99-6b6f-4c23-8eba-e2a9928e4a9a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:26.091329 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-61f49d99-6b6f-4c23-8eba-e2a9928e4a9a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1324 microversion: 2.1 time: 0.602741 Jul 20 04:15:26.094272 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 730/1533] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:25 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1324 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:26.434402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c14937c1-9e56-4093-8c56-d446e1d1c03b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] Calling method '.version_select at 0x7fbf9d5654c0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:26.435227 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:26.435227 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:26.436718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c14937c1-9e56-4093-8c56-d446e1d1c03b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.437484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c14937c1-9e56-4093-8c56-d446e1d1c03b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.471740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c14937c1-9e56-4093-8c56-d446e1d1c03b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.472340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c14937c1-9e56-4093-8c56-d446e1d1c03b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.485297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c14937c1-9e56-4093-8c56-d446e1d1c03b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.486173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c14937c1-9e56-4093-8c56-d446e1d1c03b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.494680 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c14937c1-9e56-4093-8c56-d446e1d1c03b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.492107 Jul 20 04:15:26.496808 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 804/1534] 10.222.0.20 () {60 vars in 1186 bytes} [Wed Jul 20 04:15:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:26.505795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fb789857-8ec7-4e13-985c-421e76524c40 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:26.506409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fb789857-8ec7-4e13-985c-421e76524c40 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:26.508133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-881b3991-f683-433a-a1c1-15e120a5672b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] Calling method '.version_select at 0x7fbf9d344790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:26.510271 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:26.510271 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:26.511462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-881b3991-f683-433a-a1c1-15e120a5672b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.512208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-881b3991-f683-433a-a1c1-15e120a5672b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.523925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb789857-8ec7-4e13-985c-421e76524c40 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.524378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb789857-8ec7-4e13-985c-421e76524c40 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.525168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb789857-8ec7-4e13-985c-421e76524c40 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.527022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=10 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:26.528788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb789857-8ec7-4e13-985c-421e76524c40 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.532561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-881b3991-f683-433a-a1c1-15e120a5672b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.533250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-881b3991-f683-433a-a1c1-15e120a5672b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.545504 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-881b3991-f683-433a-a1c1-15e120a5672b tempest-HypervisorAdminV228Test-1672715197 tempest-HypervisorAdminV228Test-1672715197-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.043183 Jul 20 04:15:26.547113 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 805/1535] 10.222.0.20 () {60 vars in 1192 bytes} [Wed Jul 20 04:15:26 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:26.569553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3036c64b-df21-46b8-9be5-ab6d4d89c09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:26.570412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3036c64b-df21-46b8-9be5-ab6d4d89c09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:26.587398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3036c64b-df21-46b8-9be5-ab6d4d89c09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.588102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3036c64b-df21-46b8-9be5-ab6d4d89c09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.589066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3036c64b-df21-46b8-9be5-ab6d4d89c09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.589667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3036c64b-df21-46b8-9be5-ab6d4d89c09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.853778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fb789857-8ec7-4e13-985c-421e76524c40 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:26.866678 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fb789857-8ec7-4e13-985c-421e76524c40 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1271 microversion: 2.1 time: 0.367099 Jul 20 04:15:26.871318 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 731/1536] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:26 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1271 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:26.884433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-4df5fc0b-57f0-44bf-9adb-024c0404512a req-b3b90e54-642a-491c-80ef-c5b610dfac5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3", "tag": "bf68dc13-58fc-471a-a043-6346ded43a80"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:26.904493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4df5fc0b-57f0-44bf-9adb-024c0404512a req-b3b90e54-642a-491c-80ef-c5b610dfac5e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.907418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4df5fc0b-57f0-44bf-9adb-024c0404512a req-b3b90e54-642a-491c-80ef-c5b610dfac5e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.946088 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-4df5fc0b-57f0-44bf-9adb-024c0404512a req-b3b90e54-642a-491c-80ef-c5b610dfac5e service nova] Creating event network-changed:bf68dc13-58fc-471a-a043-6346ded43a80 for instance 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 on n-h2-764485-11 Jul 20 04:15:26.957304 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-4df5fc0b-57f0-44bf-9adb-024c0404512a req-b3b90e54-642a-491c-80ef-c5b610dfac5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082180 Jul 20 04:15:26.957932 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 732/1537] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:27.121228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c73f56c5-ad99-4f37-9e09-907fb1ba357f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.125354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c73f56c5-ad99-4f37-9e09-907fb1ba357f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:27.135364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c73f56c5-ad99-4f37-9e09-907fb1ba357f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.140137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c73f56c5-ad99-4f37-9e09-907fb1ba357f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.141525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c73f56c5-ad99-4f37-9e09-907fb1ba357f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.145164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c73f56c5-ad99-4f37-9e09-907fb1ba357f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.345446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3036c64b-df21-46b8-9be5-ab6d4d89c09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:27.368048 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3036c64b-df21-46b8-9be5-ab6d4d89c09e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 200 len: 1501 microversion: 2.1 time: 0.804368 Jul 20 04:15:27.368963 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 806/1538] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:26 2022] GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 1501 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:27.384784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d4839f5-9f1d-4731-8646-856504eec41f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.385297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d4839f5-9f1d-4731-8646-856504eec41f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:27.401519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d4839f5-9f1d-4731-8646-856504eec41f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.401991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d4839f5-9f1d-4731-8646-856504eec41f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.402781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d4839f5-9f1d-4731-8646-856504eec41f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.403417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d4839f5-9f1d-4731-8646-856504eec41f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.459732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d4839f5-9f1d-4731-8646-856504eec41f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:27.640767 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d4839f5-9f1d-4731-8646-856504eec41f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 204 len: 0 microversion: 2.1 time: 0.256690 Jul 20 04:15:27.641576 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 807/1539] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:27 2022] DELETE /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:15:28.216951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-245e5a4a-23f1-4aa0-8bd6-9ca1fb6db411 tempest-ListImageFiltersNegativeTestJSON-1812707471 tempest-ListImageFiltersNegativeTestJSON-1812707471-project] Calling method '.version_select at 0x7fbf9d5b6af0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.270411 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-245e5a4a-23f1-4aa0-8bd6-9ca1fb6db411 tempest-ListImageFiltersNegativeTestJSON-1812707471 tempest-ListImageFiltersNegativeTestJSON-1812707471-project] HTTP exception thrown: Image not found. Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-245e5a4a-23f1-4aa0-8bd6-9ca1fb6db411 tempest-ListImageFiltersNegativeTestJSON-1812707471 tempest-ListImageFiltersNegativeTestJSON-1812707471-project] Request method failure captured: Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/images/e5718a86-00a8-4a63-a9c6-82e0c755c2c4 HTTP/1.1 Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FfBhHymThcQYMICb7YbBYrNZbeCOPYCHvIgZ94HxPx9zY8DtlPz1xozpCd21x6awarEe5vCU7F_plzLBNj5ydsbxbLzLA8H70hgGyLrZ4oVL9_3458VAFopG_-G1pwc9ukgiLkgPc_k4p1Uc0j9ODfEK3mVJQChm0OegbUHLfZ-vY Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ddb3b672307c47f6ab499990da8d827c Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1812707471 Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:28.273604 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ddb3b672307c47f6ab499990da8d827c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ddb3b672307c47f6ab499990da8d827c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ddb3b672307c47f6ab499990da8d827c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ddb3b672307c47f6ab499990da8d827c"}]}] Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1812707471 Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ddb3b672307c47f6ab499990da8d827c Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1812707471 Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ListImageFiltersNegativeTestJSON-1812707471-project Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: f3270ecaf7084ce8b530d8f383a5df12 Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1812707471-project Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: exception: Image not found. Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'e5718a86-00a8-4a63-a9c6-82e0c755c2c4'} Jul 20 04:15:28.275151 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:28.276120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e5718a86-00a8-4a63-a9c6-82e0c755c2c4 Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:28.277380 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e5718a86-00a8-4a63-a9c6-82e0c755c2c4 could not be found. Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:28.281360 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.287635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-245e5a4a-23f1-4aa0-8bd6-9ca1fb6db411 tempest-ListImageFiltersNegativeTestJSON-1812707471 tempest-ListImageFiltersNegativeTestJSON-1812707471-project] Returning 404 to user: Image not found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:28.291179 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-245e5a4a-23f1-4aa0-8bd6-9ca1fb6db411 tempest-ListImageFiltersNegativeTestJSON-1812707471 tempest-ListImageFiltersNegativeTestJSON-1812707471-project] 10.222.0.20 "GET /compute/v2.1/images/e5718a86-00a8-4a63-a9c6-82e0c755c2c4" status: 404 len: 62 microversion: 2.1 time: 0.630692 Jul 20 04:15:28.291179 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 808/1540] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:27 2022] GET /compute/v2.1/images/e5718a86-00a8-4a63-a9c6-82e0c755c2c4 => generated 62 bytes in 641 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:28.291502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-269f0171-9d28-4428-b97a-a22de586b6d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.300423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-269f0171-9d28-4428-b97a-a22de586b6d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:28.323758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-269f0171-9d28-4428-b97a-a22de586b6d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.324483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-269f0171-9d28-4428-b97a-a22de586b6d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.327572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-269f0171-9d28-4428-b97a-a22de586b6d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.330611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-269f0171-9d28-4428-b97a-a22de586b6d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.394154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c73f56c5-ad99-4f37-9e09-907fb1ba357f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:28.402747 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c73f56c5-ad99-4f37-9e09-907fb1ba357f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1324 microversion: 2.1 time: 1.295834 Jul 20 04:15:28.410713 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 733/1541] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:27 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1324 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:28.423209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-467dba48-2f92-4535-9070-98bc6e26fec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.428382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-467dba48-2f92-4535-9070-98bc6e26fec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:28.451189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-467dba48-2f92-4535-9070-98bc6e26fec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.451677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-467dba48-2f92-4535-9070-98bc6e26fec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.452460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-467dba48-2f92-4535-9070-98bc6e26fec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.452896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-467dba48-2f92-4535-9070-98bc6e26fec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.771938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-467dba48-2f92-4535-9070-98bc6e26fec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:28.784146 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-467dba48-2f92-4535-9070-98bc6e26fec1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1271 microversion: 2.1 time: 0.372029 Jul 20 04:15:28.793345 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 734/1542] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:28 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1271 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:28.983346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-269f0171-9d28-4428-b97a-a22de586b6d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:28.994241 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-269f0171-9d28-4428-b97a-a22de586b6d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 200 len: 1507 microversion: 2.1 time: 0.708897 Jul 20 04:15:28.996181 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 809/1543] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:28 2022] GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 1507 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:29.434657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bd9dd16a-6819-48f8-b80e-106b45e55e96 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:29.435308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bd9dd16a-6819-48f8-b80e-106b45e55e96 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:29.458289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd9dd16a-6819-48f8-b80e-106b45e55e96 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.460292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd9dd16a-6819-48f8-b80e-106b45e55e96 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.466619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd9dd16a-6819-48f8-b80e-106b45e55e96 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.469151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd9dd16a-6819-48f8-b80e-106b45e55e96 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.801970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4342b91c-11cd-4108-9ddc-70ef26db045c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:29.802615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4342b91c-11cd-4108-9ddc-70ef26db045c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:29.829016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4342b91c-11cd-4108-9ddc-70ef26db045c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.830608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4342b91c-11cd-4108-9ddc-70ef26db045c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.831670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4342b91c-11cd-4108-9ddc-70ef26db045c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.832127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4342b91c-11cd-4108-9ddc-70ef26db045c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.081004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bd9dd16a-6819-48f8-b80e-106b45e55e96 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:30.093735 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bd9dd16a-6819-48f8-b80e-106b45e55e96 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1324 microversion: 2.1 time: 0.671285 Jul 20 04:15:30.097392 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 735/1544] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:29 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1324 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:30.103972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-285fb328-4cb5-4d0f-a5a2-6858b2a4b697 req-37f1d061-0bea-4a1d-af21-00488fb83712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1a7d807-6862-4912-9ad7-a3e46de3ee3b", "name": "network-vif-deleted", "tag": "d706330d-fc03-4355-a9d1-ff0a7787b8b2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:30.133895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-285fb328-4cb5-4d0f-a5a2-6858b2a4b697 req-37f1d061-0bea-4a1d-af21-00488fb83712 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:30.135758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-285fb328-4cb5-4d0f-a5a2-6858b2a4b697 req-37f1d061-0bea-4a1d-af21-00488fb83712 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.164851 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-285fb328-4cb5-4d0f-a5a2-6858b2a4b697 req-37f1d061-0bea-4a1d-af21-00488fb83712 service nova] Creating event network-vif-deleted:d706330d-fc03-4355-a9d1-ff0a7787b8b2 for instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b on n-h1-764485-11 Jul 20 04:15:30.182066 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-285fb328-4cb5-4d0f-a5a2-6858b2a4b697 req-37f1d061-0bea-4a1d-af21-00488fb83712 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081024 Jul 20 04:15:30.183046 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 736/1545] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:30.202358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5deba081-5c42-4c5a-95de-480f56284346 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:30.203588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5deba081-5c42-4c5a-95de-480f56284346 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:30.223088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5deba081-5c42-4c5a-95de-480f56284346 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:30.224973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5deba081-5c42-4c5a-95de-480f56284346 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.227024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5deba081-5c42-4c5a-95de-480f56284346 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:30.229945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5deba081-5c42-4c5a-95de-480f56284346 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.287223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5deba081-5c42-4c5a-95de-480f56284346 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:30.288312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5deba081-5c42-4c5a-95de-480f56284346 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.288978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-5deba081-5c42-4c5a-95de-480f56284346 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lazy-loading 'fault' on Instance uuid a1a7d807-6862-4912-9ad7-a3e46de3ee3b {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:15:30.446551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5deba081-5c42-4c5a-95de-480f56284346 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:30.457591 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5deba081-5c42-4c5a-95de-480f56284346 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 200 len: 1305 microversion: 2.1 time: 0.271322 Jul 20 04:15:30.458456 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 737/1546] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:30 2022] GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 1305 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:30.576774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4342b91c-11cd-4108-9ddc-70ef26db045c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:30.591642 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4342b91c-11cd-4108-9ddc-70ef26db045c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1313 microversion: 2.1 time: 0.793679 Jul 20 04:15:30.595080 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 810/1547] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:29 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:31.114024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e270cf55-5b44-4895-8399-32d153b26704 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:31.114760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e270cf55-5b44-4895-8399-32d153b26704 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:31.126471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e270cf55-5b44-4895-8399-32d153b26704 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.128809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e270cf55-5b44-4895-8399-32d153b26704 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.130055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e270cf55-5b44-4895-8399-32d153b26704 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.130509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e270cf55-5b44-4895-8399-32d153b26704 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.478865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc058c02-028b-447b-9f1e-189887a5a4b3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:31.479526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc058c02-028b-447b-9f1e-189887a5a4b3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:31.491341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc058c02-028b-447b-9f1e-189887a5a4b3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.491834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc058c02-028b-447b-9f1e-189887a5a4b3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.498142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc058c02-028b-447b-9f1e-189887a5a4b3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.498502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc058c02-028b-447b-9f1e-189887a5a4b3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.534506 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-cc058c02-028b-447b-9f1e-189887a5a4b3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc058c02-028b-447b-9f1e-189887a5a4b3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b HTTP/1.1 Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:31.536760 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:31.538452 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:15:31.538452 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:15:31.538452 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:15:31.538452 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:15:31.538452 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:15:31.538452 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:31.538452 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:31.538452 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:15:31.538452 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:15:31.538452 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:15:31.538452 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:15:31.538452 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a1a7d807-6862-4912-9ad7-a3e46de3ee3b'} Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:31.551748 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:15:31.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:31.556019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc058c02-028b-447b-9f1e-189887a5a4b3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:31.556019 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cc058c02-028b-447b-9f1e-189887a5a4b3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 404 len: 111 microversion: 2.1 time: 0.065827 Jul 20 04:15:31.556019 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 811/1548] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:31 2022] GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:31.557958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e270cf55-5b44-4895-8399-32d153b26704 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:31.570333 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e270cf55-5b44-4895-8399-32d153b26704 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1324 microversion: 2.1 time: 0.461202 Jul 20 04:15:31.571604 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 738/1549] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:31 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1324 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:31.613430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9e768311-be4f-4f0c-ad74-e49e6e0f6d87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:31.614226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9e768311-be4f-4f0c-ad74-e49e6e0f6d87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:31.627869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e768311-be4f-4f0c-ad74-e49e6e0f6d87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.628355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e768311-be4f-4f0c-ad74-e49e6e0f6d87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.630503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e768311-be4f-4f0c-ad74-e49e6e0f6d87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.631029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e768311-be4f-4f0c-ad74-e49e6e0f6d87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.293592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e768311-be4f-4f0c-ad74-e49e6e0f6d87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:32.307121 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9e768311-be4f-4f0c-ad74-e49e6e0f6d87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1313 microversion: 2.1 time: 0.699868 Jul 20 04:15:32.312375 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 812/1550] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:31 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1313 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:32.328540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-556165894", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2f1733ae-f5aa-4d8e-b430-1f99c985f6d9"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:32.354248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-13e47d67-f840-439f-84c1-5442e50b0a41 req-ec658b8a-396f-4cdb-adb6-5fa0f4a0ff35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8", "tag": "0c831938-16c9-4f5e-8498-ff9d8d9f8c72"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:32.378181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-13e47d67-f840-439f-84c1-5442e50b0a41 req-ec658b8a-396f-4cdb-adb6-5fa0f4a0ff35 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:32.379985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-13e47d67-f840-439f-84c1-5442e50b0a41 req-ec658b8a-396f-4cdb-adb6-5fa0f4a0ff35 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.405368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] validate_networks() for [('2f1733ae-f5aa-4d8e-b430-1f99c985f6d9', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:32.418776 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-13e47d67-f840-439f-84c1-5442e50b0a41 req-ec658b8a-396f-4cdb-adb6-5fa0f4a0ff35 service nova] Creating event network-changed:0c831938-16c9-4f5e-8498-ff9d8d9f8c72 for instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 on n-h1-764485-11 Jul 20 04:15:32.429872 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-13e47d67-f840-439f-84c1-5442e50b0a41 req-ec658b8a-396f-4cdb-adb6-5fa0f4a0ff35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.581327 Jul 20 04:15:32.436264 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 739/1551] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:32.589332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4aca28ff-000a-4336-baab-a1175578b5e9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:32.590397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4aca28ff-000a-4336-baab-a1175578b5e9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:32.605907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4aca28ff-000a-4336-baab-a1175578b5e9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:32.606934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4aca28ff-000a-4336-baab-a1175578b5e9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.610180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4aca28ff-000a-4336-baab-a1175578b5e9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:32.610880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4aca28ff-000a-4336-baab-a1175578b5e9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.023349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:33.085280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:33.461360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4aca28ff-000a-4336-baab-a1175578b5e9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:33.475549 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4aca28ff-000a-4336-baab-a1175578b5e9 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1324 microversion: 2.1 time: 0.891526 Jul 20 04:15:33.476507 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 740/1552] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:32 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1324 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:33.663490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:33.664598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:33.665089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:33.666730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:33.666730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:33.685341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.687816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.688674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.690407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.734483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:33.745361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for user 793c626644204dc3a08ed9118c9aaf4c and project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:33.773004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:33.780502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:33.825970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-43e93598-eed9-4d73-bf7d-b6dc3f70934c tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Action: 'create', calling method: .version_select at 0x7fbf9d373af0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP50kK5YWfgvw9y0Sa4XP4rLE+zj8DWwtZf7ePhDaaah0ZGRwFi93hzf4D4dqWsv8Dn0zpEG14v21OxHoy7gtTo7yhfScxoQgtXJMbmr790DiRB45y7XNIdzpGkjeGipQ=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:33.836663 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-43e93598-eed9-4d73-bf7d-b6dc3f70934c tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-43e93598-eed9-4d73-bf7d-b6dc3f70934c tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Request method failure captured: Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 257 Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Fkp4J2SjzS7I3Yzhl2DoJkEMAchptzz5pwJ0NtdsDi0xWN4s-NGgOmPEsaS2bqZGLvPOOb1yrSC-M1GG9BZPP1J17Slhu896WDTSriGtfCd3D2gLWnd_MCy0X7FNXiFQPUpCS8nVtdd8JLRSCtegozNJXNLGUKAMndVM6czMWeero Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:15:33.839334 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:15:33.840942 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88a30d3013e547d5bc428d85317f5d25", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}] Jul 20 04:15:33.840942 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:33.840942 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:33.840942 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:33.840942 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:33.840942 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:15:33.840942 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:15:33.840942 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:33.840942 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:33.840942 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:15:33.840942 n-d-764485-11 devstack@n-api.service[119807]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP50kK5YWfgvw9y0Sa4XP4rLE+zj8DWwtZf7ePhDaaah0ZGRwFi93hzf4D4dqWsv8Dn0zpEG14v21OxHoy7gtTo7yhfScxoQgtXJMbmr790DiRB45y7XNIdzpGkjeGipQ=="}} Jul 20 04:15:33.840942 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP50kK5YWfgvw9y0Sa4XP4rLE+zj8DWwtZf7ePhDaaah0ZGRwFi93hzf4D4dqWsv8Dn0zpEG14v21OxHoy7gtTo7yhfScxoQgtXJMbmr790DiRB45y7XNIdzpGkjeGipQ=='}}} Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 20 04:15:33.841744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:15:33.843189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:15:33.844624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:15:33.844624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:15:33.844624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:33.844624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:33.844624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:33.844624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:33.844624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:33.844624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:33.844624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:33.844624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:33.844624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:15:33.844624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:33.846896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-43e93598-eed9-4d73-bf7d-b6dc3f70934c tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:33.848343 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-43e93598-eed9-4d73-bf7d-b6dc3f70934c tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.370821 Jul 20 04:15:33.849158 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 741/1553] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:15:33 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 372 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:15:33.857781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a5170d3-b0e2-42df-bf2b-6a1080ead17e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:33.858643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4a5170d3-b0e2-42df-bf2b-6a1080ead17e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:33.868065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a5170d3-b0e2-42df-bf2b-6a1080ead17e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.868770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a5170d3-b0e2-42df-bf2b-6a1080ead17e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.869809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a5170d3-b0e2-42df-bf2b-6a1080ead17e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.870479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a5170d3-b0e2-42df-bf2b-6a1080ead17e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.885459 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-42e5ab7b-c94a-4cc5-a4d7-abf1c5eef60d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.561601 Jul 20 04:15:33.887151 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 813/1554] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:34.100894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09ecf237-5210-4d45-b771-779ee5f46661 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Calling method '.version_select at 0x7fbf9d5b63a0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:34.102011 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:34.102011 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:34.104682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-09ecf237-5210-4d45-b771-779ee5f46661 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '12345e3543254b0ea8a1f0daa6a60fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297cf7b708ee4336ac8b99e7d70cfa68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09ecf237-5210-4d45-b771-779ee5f46661 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Request method failure captured: Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FkxVcL54ak20M64f7e998jr9TIU_xMSW1G_oILgS7aytAJ5XLvUbEmlREileRnAgep9_mT0LrRF2lTazFWuqb1p7t07k0C0gar_S4uoM17Ez3iHLznyGQOC0zAX6tIufqjxJG0bH2i_y8yC11-mIv-BR_MraBAYLPS-ZdV6uBS480 Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 297cf7b708ee4336ac8b99e7d70cfa68 Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:34.107972 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/297cf7b708ee4336ac8b99e7d70cfa68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297cf7b708ee4336ac8b99e7d70cfa68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_297cf7b708ee4336ac8b99e7d70cfa68", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297cf7b708ee4336ac8b99e7d70cfa68"}]}] Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 297cf7b708ee4336ac8b99e7d70cfa68 Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HypervisorAdminNegativeTestJSON-1272441223-project Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 12345e3543254b0ea8a1f0daa6a60fa9 Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223-project Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: action_args: {} Jul 20 04:15:34.109337 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:34.110210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 04:15:34.112137 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.115706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09ecf237-5210-4d45-b771-779ee5f46661 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:34.116855 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-09ecf237-5210-4d45-b771-779ee5f46661 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.228699 Jul 20 04:15:34.122624 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 814/1555] 10.222.0.20 () {58 vars in 1166 bytes} [Wed Jul 20 04:15:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 235 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:34.128544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a0cffcf-c1a5-4c37-a9b4-e0c70f56bbc2 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Action: 'create', calling method: .version_select at 0x7fbf9d5b20d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1001282318", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:34.149516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-5a0cffcf-c1a5-4c37-a9b4-e0c70f56bbc2 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Getting quotas for project 88a30d3013e547d5bc428d85317f5d25. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:34.156362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-5a0cffcf-c1a5-4c37-a9b4-e0c70f56bbc2 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Getting quotas for user cd23372312764aa5ab848350dab4fee0 and project 88a30d3013e547d5bc428d85317f5d25. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:34.166222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=21 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:34.183146 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-5a0cffcf-c1a5-4c37-a9b4-e0c70f56bbc2 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a0cffcf-c1a5-4c37-a9b4-e0c70f56bbc2 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Request method failure captured: Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 2167 Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Fkp4J2SjzS7I3Yzhl2DoJkEMAchptzz5pwJ0NtdsDi0xWN4s-NGgOmPEsaS2bqZGLvPOOb1yrSC-M1GG9BZPP1J17Slhu896WDTSriGtfCd3D2gLWnd_MCy0X7FNXiFQPUpCS8nVtdd8JLRSCtegozNJXNLGUKAMndVM6czMWeero Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88a30d3013e547d5bc428d85317f5d25", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}] Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1001282318", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:34.194713 n-d-764485-11 devstack@n-api.service[119808]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1001282318', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:34.197650 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:34.203203 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.209485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a0cffcf-c1a5-4c37-a9b4-e0c70f56bbc2 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:34.210667 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a0cffcf-c1a5-4c37-a9b4-e0c70f56bbc2 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.086439 Jul 20 04:15:34.211768 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 815/1556] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Jul 20 04:15:34 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:15:34.226532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df9c279c-bd97-4064-b695-de8766ec7d09 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:34.227647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df9c279c-bd97-4064-b695-de8766ec7d09 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:34.600670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df9c279c-bd97-4064-b695-de8766ec7d09 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:34.608512 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df9c279c-bd97-4064-b695-de8766ec7d09 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1214 microversion: 2.1 time: 0.391873 Jul 20 04:15:34.613847 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 816/1557] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:34 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1214 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:34.622494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f466176e-723b-4b2b-b1f9-a23473dae5a9 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:34.622823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f466176e-723b-4b2b-b1f9-a23473dae5a9 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:34.639357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f466176e-723b-4b2b-b1f9-a23473dae5a9 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.639853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f466176e-723b-4b2b-b1f9-a23473dae5a9 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.640647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f466176e-723b-4b2b-b1f9-a23473dae5a9 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.641094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f466176e-723b-4b2b-b1f9-a23473dae5a9 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.807115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a5170d3-b0e2-42df-bf2b-6a1080ead17e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:34.827807 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a5170d3-b0e2-42df-bf2b-6a1080ead17e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1313 microversion: 2.1 time: 0.975205 Jul 20 04:15:34.840213 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 742/1558] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:33 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1313 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:34.848678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c1503602-1d3f-4137-b042-3c9d082579c0 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Calling method '.version_select at 0x7fbf9d3f61f0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:34.852644 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:34.852644 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:15:34.853974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c1503602-1d3f-4137-b042-3c9d082579c0 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '12345e3543254b0ea8a1f0daa6a60fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297cf7b708ee4336ac8b99e7d70cfa68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c1503602-1d3f-4137-b042-3c9d082579c0 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Request method failure captured: Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FkxVcL54ak20M64f7e998jr9TIU_xMSW1G_oILgS7aytAJ5XLvUbEmlREileRnAgep9_mT0LrRF2lTazFWuqb1p7t07k0C0gar_S4uoM17Ez3iHLznyGQOC0zAX6tIufqjxJG0bH2i_y8yC11-mIv-BR_MraBAYLPS-ZdV6uBS480 Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 297cf7b708ee4336ac8b99e7d70cfa68 Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/297cf7b708ee4336ac8b99e7d70cfa68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297cf7b708ee4336ac8b99e7d70cfa68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_297cf7b708ee4336ac8b99e7d70cfa68", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297cf7b708ee4336ac8b99e7d70cfa68"}]}] Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 297cf7b708ee4336ac8b99e7d70cfa68 Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-HypervisorAdminNegativeTestJSON-1272441223-project Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 12345e3543254b0ea8a1f0daa6a60fa9 Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223-project Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: action_args: {} Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 04:15:34.855700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.859949 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:34.859949 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.859949 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:34.859949 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:34.859949 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:34.859949 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:34.859949 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:34.859949 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 04:15:34.859949 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.859949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c1503602-1d3f-4137-b042-3c9d082579c0 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:34.859949 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c1503602-1d3f-4137-b042-3c9d082579c0 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.014680 Jul 20 04:15:34.859949 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 743/1559] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:34 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:34.866573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aaacf616-d88b-44bf-8a77-ae96731c8630 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Action: 'create', calling method: .version_select at 0x7fbf9d31c3a0>, body: {"keypair": {"name": "tempest-keypair-1394889407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3dXUuU+xs71XkeG/JhcT8ilygtNLRUY0tCYBGw4n8gRthe5NWo7OQBXJZ4+msq2iHmzHW3CB8T9G7S3ipAFhFHyCBay0BEdK+nWOld4NezYHLB5nLAbj4UySTCzUBkXA=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:34.887801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-aaacf616-d88b-44bf-8a77-ae96731c8630 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Getting quotas for project 88a30d3013e547d5bc428d85317f5d25. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:34.895602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-aaacf616-d88b-44bf-8a77-ae96731c8630 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Getting quotas for user cd23372312764aa5ab848350dab4fee0 and project 88a30d3013e547d5bc428d85317f5d25. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:34.913625 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f466176e-723b-4b2b-b1f9-a23473dae5a9 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1859 microversion: 2.1 time: 0.298374 Jul 20 04:15:34.925161 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 817/1560] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:34 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1859 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:34.925161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a618b7e6-e273-45d5-936d-8c5e0fcd1e76 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:34.925161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a618b7e6-e273-45d5-936d-8c5e0fcd1e76 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:34.926985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:34.928807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a618b7e6-e273-45d5-936d-8c5e0fcd1e76 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.929253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a618b7e6-e273-45d5-936d-8c5e0fcd1e76 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.930028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a618b7e6-e273-45d5-936d-8c5e0fcd1e76 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.930508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a618b7e6-e273-45d5-936d-8c5e0fcd1e76 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.942414 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aaacf616-d88b-44bf-8a77-ae96731c8630 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083745 Jul 20 04:15:34.944202 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 744/1561] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:15:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:34.955920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9154bbd-fb0a-4f45-b4c5-d2353fb96d8c tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Calling method '.version_select at 0x7fbf9d31c160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:34.960208 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:34.960208 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:15:34.961742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9154bbd-fb0a-4f45-b4c5-d2353fb96d8c tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '12345e3543254b0ea8a1f0daa6a60fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297cf7b708ee4336ac8b99e7d70cfa68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9154bbd-fb0a-4f45-b4c5-d2353fb96d8c tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Request method failure captured: Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FkxVcL54ak20M64f7e998jr9TIU_xMSW1G_oILgS7aytAJ5XLvUbEmlREileRnAgep9_mT0LrRF2lTazFWuqb1p7t07k0C0gar_S4uoM17Ez3iHLznyGQOC0zAX6tIufqjxJG0bH2i_y8yC11-mIv-BR_MraBAYLPS-ZdV6uBS480 Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 297cf7b708ee4336ac8b99e7d70cfa68 Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/297cf7b708ee4336ac8b99e7d70cfa68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297cf7b708ee4336ac8b99e7d70cfa68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_297cf7b708ee4336ac8b99e7d70cfa68", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297cf7b708ee4336ac8b99e7d70cfa68"}]}] Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 297cf7b708ee4336ac8b99e7d70cfa68 Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-HypervisorAdminNegativeTestJSON-1272441223-project Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 12345e3543254b0ea8a1f0daa6a60fa9 Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223-project Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: action_args: {} Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.964014 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:34.968446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:34.968446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:34.968446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:34.968446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:34.968446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 04:15:34.968446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:34.970443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9154bbd-fb0a-4f45-b4c5-d2353fb96d8c tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:34.971814 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b9154bbd-fb0a-4f45-b4c5-d2353fb96d8c tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.025860 Jul 20 04:15:34.972838 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 745/1562] 10.222.0.20 () {58 vars in 1178 bytes} [Wed Jul 20 04:15:34 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:34.981355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a45f815e-e67d-40df-a701-970ae3f81655 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-764485-11", "block_migration": true, "disk_over_commit": false}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:34.982879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a45f815e-e67d-40df-a701-970ae3f81655 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:34.989905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a45f815e-e67d-40df-a701-970ae3f81655 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.990628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a45f815e-e67d-40df-a701-970ae3f81655 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.991729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a45f815e-e67d-40df-a701-970ae3f81655 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.992414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a45f815e-e67d-40df-a701-970ae3f81655 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.024850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-a45f815e-e67d-40df-a701-970ae3f81655 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lazy-loading 'flavor' on Instance uuid d0895e78-3e18-4ab2-b966-0561a857536c {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:15:35.044643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a45f815e-e67d-40df-a701-970ae3f81655 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Going to try to live migrate instance to n-h1-764485-11 {{(pid=119807) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:15:35.060232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:35.074960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:35.239599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a618b7e6-e273-45d5-936d-8c5e0fcd1e76 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:35.248895 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a618b7e6-e273-45d5-936d-8c5e0fcd1e76 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1324 microversion: 2.1 time: 0.332850 Jul 20 04:15:35.260629 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 818/1563] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:34 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:35.265642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e8b0319-d9d0-48f0-b28e-3f1ab2e32b31 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Action: 'create', calling method: .version_select at 0x7fbf9d5123a0>, body: {"keypair": {"name": "tempest-keypair-1394889407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgeMM4MUrE4SGB2H2guBRNuFnKvLr+V+TxW/r7jBJCmBZyvMkxmC+x5j7BQh9gUdi276fRa7r8i1Xc5jZYcoFFWs+DRIJuV3s22JA92OQiQrdaNtKa0OGeWlK2NbmXDIA=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:35.293915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3e8b0319-d9d0-48f0-b28e-3f1ab2e32b31 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Getting quotas for project 88a30d3013e547d5bc428d85317f5d25. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:35.303381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3e8b0319-d9d0-48f0-b28e-3f1ab2e32b31 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Getting quotas for user cd23372312764aa5ab848350dab4fee0 and project 88a30d3013e547d5bc428d85317f5d25. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:35.353641 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-3e8b0319-d9d0-48f0-b28e-3f1ab2e32b31 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] HTTP exception thrown: Key pair 'tempest-keypair-1394889407' already exists. Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e8b0319-d9d0-48f0-b28e-3f1ab2e32b31 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Request method failure captured: Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 273 Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Fkp4J2SjzS7I3Yzhl2DoJkEMAchptzz5pwJ0NtdsDi0xWN4s-NGgOmPEsaS2bqZGLvPOOb1yrSC-M1GG9BZPP1J17Slhu896WDTSriGtfCd3D2gLWnd_MCy0X7FNXiFQPUpCS8nVtdd8JLRSCtegozNJXNLGUKAMndVM6czMWeero Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88a30d3013e547d5bc428d85317f5d25", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}] Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: {"keypair": {"name": "tempest-keypair-1394889407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgeMM4MUrE4SGB2H2guBRNuFnKvLr+V+TxW/r7jBJCmBZyvMkxmC+x5j7BQh9gUdi276fRa7r8i1Xc5jZYcoFFWs+DRIJuV3s22JA92OQiQrdaNtKa0OGeWlK2NbmXDIA=="}} Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: exception: Key pair 'tempest-keypair-1394889407' already exists. Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1394889407', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgeMM4MUrE4SGB2H2guBRNuFnKvLr+V+TxW/r7jBJCmBZyvMkxmC+x5j7BQh9gUdi276fRa7r8i1Xc5jZYcoFFWs+DRIJuV3s22JA92OQiQrdaNtKa0OGeWlK2NbmXDIA=='}}} Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'cd23372312764aa5ab848350dab4fee0-tempest-keypair-1394889407' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 20 04:15:35.378756 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:15:35.385195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'cd23372312764aa5ab848350dab4fee0-tempest-keypair-1394889407' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 4, 15, 35, 344159), 'updated_at': None, 'name': 'tempest-keypair-1394889407', 'user_id': 'cd23372312764aa5ab848350dab4fee0', 'fingerprint': '83:72:d5:66:b3:47:4b:7b:66:fa:f8:40:46:e7:eb:0c', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgeMM4MUrE4SGB2H2guBRNuFnKvLr+V+TxW/r7jBJCmBZyvMkxmC+x5j7BQh9gUdi276fRa7r8i1Xc5jZYcoFFWs+DRIJuV3s22JA92OQiQrdaNtKa0OGeWlK2NbmXDIA==', 'type': 'ssh'}] Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi keypair.create() Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._create() Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1394889407' already exists. Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 20 04:15:35.391438 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1394889407' already exists. Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1394889407' already exists. Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e8b0319-d9d0-48f0-b28e-3f1ab2e32b31 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Returning 409 to user: Key pair 'tempest-keypair-1394889407' already exists. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3e8b0319-d9d0-48f0-b28e-3f1ab2e32b31 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.118515 Jul 20 04:15:35.398900 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 819/1564] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:15:35 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:35.489590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f1b1dff-cff8-4c89-ab6f-a01be6d270b6 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Calling method '.version_select at 0x7fbf9fe54790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:35.490789 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:35.490789 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:35.492928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f1b1dff-cff8-4c89-ab6f-a01be6d270b6 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.494023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f1b1dff-cff8-4c89-ab6f-a01be6d270b6 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.515150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f1b1dff-cff8-4c89-ab6f-a01be6d270b6 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.515940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f1b1dff-cff8-4c89-ab6f-a01be6d270b6 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.535840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f1b1dff-cff8-4c89-ab6f-a01be6d270b6 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.540353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f1b1dff-cff8-4c89-ab6f-a01be6d270b6 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.548021 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f1b1dff-cff8-4c89-ab6f-a01be6d270b6 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.165525 Jul 20 04:15:35.550380 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 820/1565] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:35 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:35.564963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-330cc8fa-04cd-4214-9083-ada3afa4a5d4 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Calling method '.version_select at 0x7fbf9d512dc0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:35.602336 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-330cc8fa-04cd-4214-9083-ada3afa4a5d4 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394889407" status: 202 len: 0 microversion: 2.1 time: 0.050124 Jul 20 04:15:35.603442 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 821/1566] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 04:15:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394889407 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:35.610196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15de3f37-1b88-4c6d-875f-233e9168d27a tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Calling method '.version_select at 0x7fbf9df05940>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:35.612030 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:35.612030 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:35.614707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-15de3f37-1b88-4c6d-875f-233e9168d27a tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '12345e3543254b0ea8a1f0daa6a60fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297cf7b708ee4336ac8b99e7d70cfa68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15de3f37-1b88-4c6d-875f-233e9168d27a tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Request method failure captured: Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FkxVcL54ak20M64f7e998jr9TIU_xMSW1G_oILgS7aytAJ5XLvUbEmlREileRnAgep9_mT0LrRF2lTazFWuqb1p7t07k0C0gar_S4uoM17Ez3iHLznyGQOC0zAX6tIufqjxJG0bH2i_y8yC11-mIv-BR_MraBAYLPS-ZdV6uBS480 Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 297cf7b708ee4336ac8b99e7d70cfa68 Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/297cf7b708ee4336ac8b99e7d70cfa68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297cf7b708ee4336ac8b99e7d70cfa68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_297cf7b708ee4336ac8b99e7d70cfa68", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297cf7b708ee4336ac8b99e7d70cfa68"}]}] Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 297cf7b708ee4336ac8b99e7d70cfa68 Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HypervisorAdminNegativeTestJSON-1272441223-project Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 12345e3543254b0ea8a1f0daa6a60fa9 Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223-project Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1'} Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.622626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.627579 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:35.627579 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:35.627579 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:35.627579 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:35.627579 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 04:15:35.627579 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.629207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15de3f37-1b88-4c6d-875f-233e9168d27a tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:35.630928 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-15de3f37-1b88-4c6d-875f-233e9168d27a tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.025738 Jul 20 04:15:35.632044 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 822/1567] 10.222.0.20 () {58 vars in 1172 bytes} [Wed Jul 20 04:15:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:35.642262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e51639a-73e4-47ff-92a3-547c2d69f2e2 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Action: 'create', calling method: .version_select at 0x7fbf9dec53a0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIcSbPLOuG5lqg7+3YXwuE1SG1JWGAvHM5FwR6y4hJZTPOi3sKN2TavFJt0IPUPf5ueDS7icqQ5klOCR416ak9pE4y6bS7zUZzUEeLT4TGlXj1AemN73pONNP5iV+0rgw=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e51639a-73e4-47ff-92a3-547c2d69f2e2 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Request method failure captured: Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 247 Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Fkp4J2SjzS7I3Yzhl2DoJkEMAchptzz5pwJ0NtdsDi0xWN4s-NGgOmPEsaS2bqZGLvPOOb1yrSC-M1GG9BZPP1J17Slhu896WDTSriGtfCd3D2gLWnd_MCy0X7FNXiFQPUpCS8nVtdd8JLRSCtegozNJXNLGUKAMndVM6czMWeero Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88a30d3013e547d5bc428d85317f5d25", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}] Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIcSbPLOuG5lqg7+3YXwuE1SG1JWGAvHM5FwR6y4hJZTPOi3sKN2TavFJt0IPUPf5ueDS7icqQ5klOCR416ak9pE4y6bS7zUZzUEeLT4TGlXj1AemN73pONNP5iV+0rgw=="}} Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIcSbPLOuG5lqg7+3YXwuE1SG1JWGAvHM5FwR6y4hJZTPOi3sKN2TavFJt0IPUPf5ueDS7icqQ5klOCR416ak9pE4y6bS7zUZzUEeLT4TGlXj1AemN73pONNP5iV+0rgw=='}}} Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi '' Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:15:35.646573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:15:35.652351 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.654525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e51639a-73e4-47ff-92a3-547c2d69f2e2 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:35.655596 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3e51639a-73e4-47ff-92a3-547c2d69f2e2 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.022186 Jul 20 04:15:35.656654 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 823/1568] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:15:35 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:15:35.664311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-01e77372-1212-47a7-98ca-a48cc3837c2b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:35.665369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-01e77372-1212-47a7-98ca-a48cc3837c2b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:35.672934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01e77372-1212-47a7-98ca-a48cc3837c2b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.673624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01e77372-1212-47a7-98ca-a48cc3837c2b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.676105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01e77372-1212-47a7-98ca-a48cc3837c2b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.676730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01e77372-1212-47a7-98ca-a48cc3837c2b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.960978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-01e77372-1212-47a7-98ca-a48cc3837c2b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:35.973779 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-01e77372-1212-47a7-98ca-a48cc3837c2b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1210 microversion: 2.1 time: 0.313949 Jul 20 04:15:35.975789 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 824/1569] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:35 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1210 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:35.996615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-786848e4-8b99-4685-bdef-c069b7d932e5 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Calling method '.version_select at 0x7fbf9d39bb80>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:35.997683 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:35.997683 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:36.004188 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-786848e4-8b99-4685-bdef-c069b7d932e5 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] HTTP exception thrown: Hypervisor with ID 'e97f68e1-7625-4617-a44f-84f565c04307' could not be found. Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-786848e4-8b99-4685-bdef-c069b7d932e5 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Request method failure captured: Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-hypervisors/e97f68e1-7625-4617-a44f-84f565c04307/uptime HTTP/1.1 Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FlY1NmRJZfGaLX_Wu0O3xiQF_OBJp6p0UDZlTOc0xD0uIarFw7X2ZxLeHmePdWhxwUUU_wHgwhuRm6YkXMtJZngGWjwGesPpXKJYPgOXPhi5jaKDydu9PpZTVHxy15prHJvyKwYbxeh1zQyhiCYJjJhxxCI4sRhy6asqVkKMx437U Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 6ff626c822b94e05962871c7145353b8 Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1425549391 Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ff626c822b94e05962871c7145353b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ff626c822b94e05962871c7145353b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ff626c822b94e05962871c7145353b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ff626c822b94e05962871c7145353b8"}]}] Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1425549391 Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 6ff626c822b94e05962871c7145353b8 Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1425549391 Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 5e7b5b4b7f434e1ea3f592ac0e2bec36 Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: exception: Hypervisor with ID 'e97f68e1-7625-4617-a44f-84f565c04307' could not be found. Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'e97f68e1-7625-4617-a44f-84f565c04307'} Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e97f68e1-7625-4617-a44f-84f565c04307' Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:36.024661 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e97f68e1-7625-4617-a44f-84f565c04307' could not be found. Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e97f68e1-7625-4617-a44f-84f565c04307' could not be found. Jul 20 04:15:36.035463 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.038295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-786848e4-8b99-4685-bdef-c069b7d932e5 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Returning 404 to user: Hypervisor with ID 'e97f68e1-7625-4617-a44f-84f565c04307' could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:36.040505 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-786848e4-8b99-4685-bdef-c069b7d932e5 tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/e97f68e1-7625-4617-a44f-84f565c04307/uptime" status: 404 len: 123 microversion: 2.1 time: 0.062428 Jul 20 04:15:36.044640 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 825/1570] 10.222.0.20 () {58 vars in 1277 bytes} [Wed Jul 20 04:15:35 2022] GET /compute/v2.1/os-hypervisors/e97f68e1-7625-4617-a44f-84f565c04307/uptime => generated 123 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:36.057520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10616e0b-ea1a-4ae6-ba60-1ff71d08074e tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Action: 'create', calling method: .version_select at 0x7fbf9d57e310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-424037509", "public_key": " "}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:36.101761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-10616e0b-ea1a-4ae6-ba60-1ff71d08074e tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Getting quotas for project 88a30d3013e547d5bc428d85317f5d25. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:36.112995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-10616e0b-ea1a-4ae6-ba60-1ff71d08074e tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Getting quotas for user cd23372312764aa5ab848350dab4fee0 and project 88a30d3013e547d5bc428d85317f5d25. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:36.167955 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-10616e0b-ea1a-4ae6-ba60-1ff71d08074e tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10616e0b-ea1a-4ae6-ba60-1ff71d08074e tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Request method failure captured: Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 94 Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Fkp4J2SjzS7I3Yzhl2DoJkEMAchptzz5pwJ0NtdsDi0xWN4s-NGgOmPEsaS2bqZGLvPOOb1yrSC-M1GG9BZPP1J17Slhu896WDTSriGtfCd3D2gLWnd_MCy0X7FNXiFQPUpCS8nVtdd8JLRSCtegozNJXNLGUKAMndVM6czMWeero Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88a30d3013e547d5bc428d85317f5d25", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}] Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-424037509", "public_key": " "}} Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-424037509', 'public_key': ' '}}} Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.170124 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:36.175254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.179836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10616e0b-ea1a-4ae6-ba60-1ff71d08074e tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:36.188367 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-10616e0b-ea1a-4ae6-ba60-1ff71d08074e tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.135284 Jul 20 04:15:36.189546 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 826/1571] 10.222.0.20 () {60 vars in 1157 bytes} [Wed Jul 20 04:15:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:15:36.197571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f9ee7454-168f-47a5-9e9c-dddbb9f582da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.198531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f9ee7454-168f-47a5-9e9c-dddbb9f582da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:36.215708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9ee7454-168f-47a5-9e9c-dddbb9f582da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.216388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9ee7454-168f-47a5-9e9c-dddbb9f582da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.217873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9ee7454-168f-47a5-9e9c-dddbb9f582da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.218321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9ee7454-168f-47a5-9e9c-dddbb9f582da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.629751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f9ee7454-168f-47a5-9e9c-dddbb9f582da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:36.641637 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f9ee7454-168f-47a5-9e9c-dddbb9f582da tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1313 microversion: 2.1 time: 0.450655 Jul 20 04:15:36.642241 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 827/1572] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:36 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:36.647149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2c383a2-f6c5-4c60-9373-4d705f05f90d tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Calling method '.version_select at 0x7fbf9dec50d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.647976 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:36.647976 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:36.649129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2c383a2-f6c5-4c60-9373-4d705f05f90d tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.649581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2c383a2-f6c5-4c60-9373-4d705f05f90d tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.689283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2c383a2-f6c5-4c60-9373-4d705f05f90d tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.690508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2c383a2-f6c5-4c60-9373-4d705f05f90d tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.726873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2c383a2-f6c5-4c60-9373-4d705f05f90d tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.727642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2c383a2-f6c5-4c60-9373-4d705f05f90d tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.734875 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f2c383a2-f6c5-4c60-9373-4d705f05f90d tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.091122 Jul 20 04:15:36.735817 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 828/1573] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:36 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:36.742425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ad094939-628a-49be-9300-e14b658fb98e tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Action: 'create', calling method: .version_select at 0x7fbf9df05e50>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGCVPLcLiTTMz6nlARpjGfBYF5lmeQjpjNtOwtfdSrxOS8bfNPYUvmw0zKVeQIsPMShi9npunWcu1uPMN41d7XwxLmYv/v50svcx67T2cyaT3XwEL6q87CM1NW3SRxmdg=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ad094939-628a-49be-9300-e14b658fb98e tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Request method failure captured: Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 507 Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Fkp4J2SjzS7I3Yzhl2DoJkEMAchptzz5pwJ0NtdsDi0xWN4s-NGgOmPEsaS2bqZGLvPOOb1yrSC-M1GG9BZPP1J17Slhu896WDTSriGtfCd3D2gLWnd_MCy0X7FNXiFQPUpCS8nVtdd8JLRSCtegozNJXNLGUKAMndVM6czMWeero Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88a30d3013e547d5bc428d85317f5d25", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}] Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGCVPLcLiTTMz6nlARpjGfBYF5lmeQjpjNtOwtfdSrxOS8bfNPYUvmw0zKVeQIsPMShi9npunWcu1uPMN41d7XwxLmYv/v50svcx67T2cyaT3XwEL6q87CM1NW3SRxmdg=="}} Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGCVPLcLiTTMz6nlARpjGfBYF5lmeQjpjNtOwtfdSrxOS8bfNPYUvmw0zKVeQIsPMShi9npunWcu1uPMN41d7XwxLmYv/v50svcx67T2cyaT3XwEL6q87CM1NW3SRxmdg=='}}} Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 20 04:15:36.754549 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:15:36.758276 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.762001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ad094939-628a-49be-9300-e14b658fb98e tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:36.763885 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ad094939-628a-49be-9300-e14b658fb98e tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.025211 Jul 20 04:15:36.770352 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 829/1574] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:15:36 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:15:36.776057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7acdcf1f-8188-4aac-9fd8-3a9a4e7dc467 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.776835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7acdcf1f-8188-4aac-9fd8-3a9a4e7dc467 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:36.784324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7acdcf1f-8188-4aac-9fd8-3a9a4e7dc467 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.784972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7acdcf1f-8188-4aac-9fd8-3a9a4e7dc467 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.785923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7acdcf1f-8188-4aac-9fd8-3a9a4e7dc467 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.786614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7acdcf1f-8188-4aac-9fd8-3a9a4e7dc467 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.791746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:37.149591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7acdcf1f-8188-4aac-9fd8-3a9a4e7dc467 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:37.157897 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7acdcf1f-8188-4aac-9fd8-3a9a4e7dc467 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1324 microversion: 2.1 time: 0.386202 Jul 20 04:15:37.159101 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 830/1575] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:36 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1324 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:37.165469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-411bc5c4-6579-4362-84cb-85d5bfb089e3 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Calling method '.version_select at 0x7fbf9df05a60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.167087 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:37.167087 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:37.168900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-411bc5c4-6579-4362-84cb-85d5bfb089e3 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '12345e3543254b0ea8a1f0daa6a60fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297cf7b708ee4336ac8b99e7d70cfa68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-411bc5c4-6579-4362-84cb-85d5bfb089e3 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Request method failure captured: Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FkxVcL54ak20M64f7e998jr9TIU_xMSW1G_oILgS7aytAJ5XLvUbEmlREileRnAgep9_mT0LrRF2lTazFWuqb1p7t07k0C0gar_S4uoM17Ez3iHLznyGQOC0zAX6tIufqjxJG0bH2i_y8yC11-mIv-BR_MraBAYLPS-ZdV6uBS480 Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 297cf7b708ee4336ac8b99e7d70cfa68 Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/297cf7b708ee4336ac8b99e7d70cfa68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297cf7b708ee4336ac8b99e7d70cfa68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_297cf7b708ee4336ac8b99e7d70cfa68", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/297cf7b708ee4336ac8b99e7d70cfa68"}]}] Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 297cf7b708ee4336ac8b99e7d70cfa68 Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223 Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HypervisorAdminNegativeTestJSON-1272441223-project Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 12345e3543254b0ea8a1f0daa6a60fa9 Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1272441223-project Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1'} Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 04:15:37.171753 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.179723 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:37.179723 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.179723 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.179723 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:37.179723 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:37.179723 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:37.179723 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:37.179723 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 04:15:37.179723 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.183050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-411bc5c4-6579-4362-84cb-85d5bfb089e3 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:37.184290 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-411bc5c4-6579-4362-84cb-85d5bfb089e3 tempest-HypervisorAdminNegativeTestJSON-1272441223 tempest-HypervisorAdminNegativeTestJSON-1272441223-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.023946 Jul 20 04:15:37.185435 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 831/1576] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:15:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:37.191260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b319d40-a328-4fe2-82fc-892aad350872 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Action: 'create', calling method: .version_select at 0x7fbf9d5b6ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1472600132", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:37.212659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3b319d40-a328-4fe2-82fc-892aad350872 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Getting quotas for project 88a30d3013e547d5bc428d85317f5d25. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:37.220886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3b319d40-a328-4fe2-82fc-892aad350872 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Getting quotas for user cd23372312764aa5ab848350dab4fee0 and project 88a30d3013e547d5bc428d85317f5d25. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:37.254139 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-3b319d40-a328-4fe2-82fc-892aad350872 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b319d40-a328-4fe2-82fc-892aad350872 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Request method failure captured: Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 118 Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Fkp4J2SjzS7I3Yzhl2DoJkEMAchptzz5pwJ0NtdsDi0xWN4s-NGgOmPEsaS2bqZGLvPOOb1yrSC-M1GG9BZPP1J17Slhu896WDTSriGtfCd3D2gLWnd_MCy0X7FNXiFQPUpCS8nVtdd8JLRSCtegozNJXNLGUKAMndVM6czMWeero Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88a30d3013e547d5bc428d85317f5d25", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}] Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1472600132", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1472600132', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 04:15:37.258324 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b319d40-a328-4fe2-82fc-892aad350872 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b319d40-a328-4fe2-82fc-892aad350872 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.077723 Jul 20 04:15:37.265193 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 832/1577] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:15:37 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:15:37.276890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7d557796-d9d0-496b-82e7-47773728c048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.278604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7d557796-d9d0-496b-82e7-47773728c048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:37.295247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d557796-d9d0-496b-82e7-47773728c048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.296658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d557796-d9d0-496b-82e7-47773728c048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.297720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d557796-d9d0-496b-82e7-47773728c048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.300178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d557796-d9d0-496b-82e7-47773728c048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.426446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7d557796-d9d0-496b-82e7-47773728c048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:37.443627 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7d557796-d9d0-496b-82e7-47773728c048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1272 microversion: 2.1 time: 0.177548 Jul 20 04:15:37.461250 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 833/1578] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:37 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:37.476216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-96ad52cd-aea2-4582-881f-d6195906785e tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Calling method '.version_select at 0x7fbf9d512790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.478289 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:37.478289 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:15:37.482103 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-96ad52cd-aea2-4582-881f-d6195906785e tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] HTTP exception thrown: Hypervisor with ID 'ace1e72b-8763-4f07-a20b-73ed05db0daa' could not be found. Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-96ad52cd-aea2-4582-881f-d6195906785e tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Request method failure captured: Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-hypervisors/ace1e72b-8763-4f07-a20b-73ed05db0daa HTTP/1.1 Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FlY1NmRJZfGaLX_Wu0O3xiQF_OBJp6p0UDZlTOc0xD0uIarFw7X2ZxLeHmePdWhxwUUU_wHgwhuRm6YkXMtJZngGWjwGesPpXKJYPgOXPhi5jaKDydu9PpZTVHxy15prHJvyKwYbxeh1zQyhiCYJjJhxxCI4sRhy6asqVkKMx437U Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 6ff626c822b94e05962871c7145353b8 Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1425549391 Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ff626c822b94e05962871c7145353b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ff626c822b94e05962871c7145353b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ff626c822b94e05962871c7145353b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ff626c822b94e05962871c7145353b8"}]}] Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1425549391 Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 6ff626c822b94e05962871c7145353b8 Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1425549391 Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 5e7b5b4b7f434e1ea3f592ac0e2bec36 Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: exception: Hypervisor with ID 'ace1e72b-8763-4f07-a20b-73ed05db0daa' could not be found. Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ace1e72b-8763-4f07-a20b-73ed05db0daa'} Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ace1e72b-8763-4f07-a20b-73ed05db0daa' Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:37.487103 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ace1e72b-8763-4f07-a20b-73ed05db0daa' could not be found. Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ace1e72b-8763-4f07-a20b-73ed05db0daa' could not be found. Jul 20 04:15:37.492233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.496253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-96ad52cd-aea2-4582-881f-d6195906785e tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] Returning 404 to user: Hypervisor with ID 'ace1e72b-8763-4f07-a20b-73ed05db0daa' could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:37.502729 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-96ad52cd-aea2-4582-881f-d6195906785e tempest-HypervisorAdminNegativeTestJSON-1425549391 tempest-HypervisorAdminNegativeTestJSON-1425549391-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/ace1e72b-8763-4f07-a20b-73ed05db0daa" status: 404 len: 123 microversion: 2.1 time: 0.037948 Jul 20 04:15:37.506040 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 834/1579] 10.222.0.20 () {58 vars in 1256 bytes} [Wed Jul 20 04:15:37 2022] GET /compute/v2.1/os-hypervisors/ace1e72b-8763-4f07-a20b-73ed05db0daa => generated 123 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:37.520033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-877c9c8f-bc0e-44d6-8a75-f7575a87b131 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Calling method '.version_select at 0x7fbf9d5b2a60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.555810 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-877c9c8f-bc0e-44d6-8a75-f7575a87b131 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1273392984 not found for user cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-877c9c8f-bc0e-44d6-8a75-f7575a87b131 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Request method failure captured: Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1273392984 HTTP/1.1 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Fkp4J2SjzS7I3Yzhl2DoJkEMAchptzz5pwJ0NtdsDi0xWN4s-NGgOmPEsaS2bqZGLvPOOb1yrSC-M1GG9BZPP1J17Slhu896WDTSriGtfCd3D2gLWnd_MCy0X7FNXiFQPUpCS8nVtdd8JLRSCtegozNJXNLGUKAMndVM6czMWeero Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88a30d3013e547d5bc428d85317f5d25", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88a30d3013e547d5bc428d85317f5d25"}]}] Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 88a30d3013e547d5bc428d85317f5d25 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-476935593 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-KeyPairsNegativeTestJSON-476935593-project Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: exception: Keypair tempest-keypair-non-existent-1273392984 not found for user cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'tempest-keypair-non-existent-1273392984'} Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1273392984 not found for user cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.560236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1273392984 not found for user cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1273392984 not found for user cd23372312764aa5ab848350dab4fee0 Jul 20 04:15:37.565181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:37.574030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-877c9c8f-bc0e-44d6-8a75-f7575a87b131 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1273392984 not found for user cd23372312764aa5ab848350dab4fee0 {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:37.575094 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-877c9c8f-bc0e-44d6-8a75-f7575a87b131 tempest-KeyPairsNegativeTestJSON-476935593 tempest-KeyPairsNegativeTestJSON-476935593-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1273392984" status: 404 len: 145 microversion: 2.1 time: 0.067656 Jul 20 04:15:37.575923 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 835/1580] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jul 20 04:15:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1273392984 => generated 145 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:37.591712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-84fa6454-bfb1-4ad7-907e-b052bd683221 req-432a99fb-9785-4bc8-96a1-b22b0805af46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3", "name": "network-vif-plugged", "status": "completed", "tag": "bf68dc13-58fc-471a-a043-6346ded43a80"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:37.608612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-84fa6454-bfb1-4ad7-907e-b052bd683221 req-432a99fb-9785-4bc8-96a1-b22b0805af46 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.612216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-84fa6454-bfb1-4ad7-907e-b052bd683221 req-432a99fb-9785-4bc8-96a1-b22b0805af46 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.630772 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-84fa6454-bfb1-4ad7-907e-b052bd683221 req-432a99fb-9785-4bc8-96a1-b22b0805af46 service nova] Creating event network-vif-plugged:bf68dc13-58fc-471a-a043-6346ded43a80 for instance 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 on n-h2-764485-11 Jul 20 04:15:37.645584 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-84fa6454-bfb1-4ad7-907e-b052bd683221 req-432a99fb-9785-4bc8-96a1-b22b0805af46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061575 Jul 20 04:15:37.648683 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 836/1581] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:37.660603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1b138f5c-4c56-46ab-bb62-4824e2aa7261 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.661922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1b138f5c-4c56-46ab-bb62-4824e2aa7261 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:37.677773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b138f5c-4c56-46ab-bb62-4824e2aa7261 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.678231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b138f5c-4c56-46ab-bb62-4824e2aa7261 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.679014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b138f5c-4c56-46ab-bb62-4824e2aa7261 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.679456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b138f5c-4c56-46ab-bb62-4824e2aa7261 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.045098 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a45f815e-e67d-40df-a701-970ae3f81655 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/action" status: 202 len: 0 microversion: 2.1 time: 3.070739 Jul 20 04:15:38.045967 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 746/1582] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:15:34 2022] POST /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/action => generated 0 bytes in 3072 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:38.055796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0e99ad5-9167-436c-a3a1-21bed8379b52 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:38.056864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e0e99ad5-9167-436c-a3a1-21bed8379b52 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:38.074195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0e99ad5-9167-436c-a3a1-21bed8379b52 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.075884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0e99ad5-9167-436c-a3a1-21bed8379b52 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.077160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0e99ad5-9167-436c-a3a1-21bed8379b52 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.078013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0e99ad5-9167-436c-a3a1-21bed8379b52 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.790410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1b138f5c-4c56-46ab-bb62-4824e2aa7261 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:38.800853 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1b138f5c-4c56-46ab-bb62-4824e2aa7261 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1313 microversion: 2.1 time: 1.146162 Jul 20 04:15:38.802028 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 837/1583] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:37 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1313 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:38.816039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6b55f14b-ba0f-466f-85a5-8b1a7aa8b55a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:38.817058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6b55f14b-ba0f-466f-85a5-8b1a7aa8b55a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:38.823810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b55f14b-ba0f-466f-85a5-8b1a7aa8b55a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.828171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b55f14b-ba0f-466f-85a5-8b1a7aa8b55a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.829018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b55f14b-ba0f-466f-85a5-8b1a7aa8b55a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.829460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b55f14b-ba0f-466f-85a5-8b1a7aa8b55a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.857569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e0e99ad5-9167-436c-a3a1-21bed8379b52 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:38.877694 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e0e99ad5-9167-436c-a3a1-21bed8379b52 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.825681 Jul 20 04:15:38.878885 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 747/1584] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:38 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:38.883646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6eb6da0-739a-4486-a397-04de461a64d9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:38.888649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a6eb6da0-739a-4486-a397-04de461a64d9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:38.909026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6eb6da0-739a-4486-a397-04de461a64d9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.909795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6eb6da0-739a-4486-a397-04de461a64d9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.910767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6eb6da0-739a-4486-a397-04de461a64d9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.911429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6eb6da0-739a-4486-a397-04de461a64d9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.902474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6b55f14b-ba0f-466f-85a5-8b1a7aa8b55a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:39.935577 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6b55f14b-ba0f-466f-85a5-8b1a7aa8b55a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1324 microversion: 2.1 time: 1.131816 Jul 20 04:15:39.936674 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 838/1585] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:38 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1324 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:39.962622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-12d5bba5-c744-46c4-8ed7-3a7714ee6a99 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:39.965052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-12d5bba5-c744-46c4-8ed7-3a7714ee6a99 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:39.977219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12d5bba5-c744-46c4-8ed7-3a7714ee6a99 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.978646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12d5bba5-c744-46c4-8ed7-3a7714ee6a99 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.980367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12d5bba5-c744-46c4-8ed7-3a7714ee6a99 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.981425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12d5bba5-c744-46c4-8ed7-3a7714ee6a99 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.012697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a6eb6da0-739a-4486-a397-04de461a64d9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.035245 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a6eb6da0-739a-4486-a397-04de461a64d9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1314 microversion: 2.1 time: 1.154985 Jul 20 04:15:40.046515 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 748/1586] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:38 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1314 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:40.052928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-91813aa7-c4da-45f7-aa82-6f1363852961 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.053796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-91813aa7-c4da-45f7-aa82-6f1363852961 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:40.061572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91813aa7-c4da-45f7-aa82-6f1363852961 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.062362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91813aa7-c4da-45f7-aa82-6f1363852961 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.063723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91813aa7-c4da-45f7-aa82-6f1363852961 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.065048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91813aa7-c4da-45f7-aa82-6f1363852961 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.074519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-12d5bba5-c744-46c4-8ed7-3a7714ee6a99 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:41.086187 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-12d5bba5-c744-46c4-8ed7-3a7714ee6a99 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1313 microversion: 2.1 time: 1.143804 Jul 20 04:15:41.087317 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 839/1587] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:39 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1313 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:41.100984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-94a1c55e-7dac-4019-a149-a50c6644fe1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.101858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-94a1c55e-7dac-4019-a149-a50c6644fe1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:41.109784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-91813aa7-c4da-45f7-aa82-6f1363852961 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:41.117592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94a1c55e-7dac-4019-a149-a50c6644fe1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.118377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94a1c55e-7dac-4019-a149-a50c6644fe1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.119385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94a1c55e-7dac-4019-a149-a50c6644fe1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.120067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94a1c55e-7dac-4019-a149-a50c6644fe1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.120235 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-91813aa7-c4da-45f7-aa82-6f1363852961 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 1.072099 Jul 20 04:15:41.123579 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 749/1588] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:41.143838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5811f390-6421-44f8-8272-a2487b0f0ec4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.167560 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5811f390-6421-44f8-8272-a2487b0f0ec4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:41.181712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5811f390-6421-44f8-8272-a2487b0f0ec4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.184903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5811f390-6421-44f8-8272-a2487b0f0ec4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.189933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5811f390-6421-44f8-8272-a2487b0f0ec4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.190636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5811f390-6421-44f8-8272-a2487b0f0ec4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.155998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94a1c55e-7dac-4019-a149-a50c6644fe1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.181221 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-94a1c55e-7dac-4019-a149-a50c6644fe1e tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1520 microversion: 2.1 time: 1.089539 Jul 20 04:15:42.183684 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 840/1589] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1520 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:42.219177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-5303e7dc-9ef5-4972-88d1-4b1077d7d6e8 req-9bb25a15-aac3-4960-8f6a-b24f492e26d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad081e26-4b6d-4baa-8173-83d0118cc42f", "tag": "127d2787-2622-4b1b-a505-666b064cac6d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:42.233193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5811f390-6421-44f8-8272-a2487b0f0ec4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.247764 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5811f390-6421-44f8-8272-a2487b0f0ec4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1314 microversion: 2.1 time: 1.111416 Jul 20 04:15:42.253874 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 750/1590] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1314 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:42.265789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5303e7dc-9ef5-4972-88d1-4b1077d7d6e8 req-9bb25a15-aac3-4960-8f6a-b24f492e26d5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.266246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5303e7dc-9ef5-4972-88d1-4b1077d7d6e8 req-9bb25a15-aac3-4960-8f6a-b24f492e26d5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.295904 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-5303e7dc-9ef5-4972-88d1-4b1077d7d6e8 req-9bb25a15-aac3-4960-8f6a-b24f492e26d5 service nova] Creating event network-changed:127d2787-2622-4b1b-a505-666b064cac6d for instance ad081e26-4b6d-4baa-8173-83d0118cc42f on n-h1-764485-11 Jul 20 04:15:42.312941 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-5303e7dc-9ef5-4972-88d1-4b1077d7d6e8 req-9bb25a15-aac3-4960-8f6a-b24f492e26d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111926 Jul 20 04:15:42.315473 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 841/1591] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:42.328331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ee921aaf-e988-4cb1-bfab-e6633a3f1fad tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:42.330996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ee921aaf-e988-4cb1-bfab-e6633a3f1fad tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:42.364783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee921aaf-e988-4cb1-bfab-e6633a3f1fad tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.368111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee921aaf-e988-4cb1-bfab-e6633a3f1fad tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.373055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee921aaf-e988-4cb1-bfab-e6633a3f1fad tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.375532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee921aaf-e988-4cb1-bfab-e6633a3f1fad tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.992060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-674691324", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "d9fe07a4-2a16-4e79-9ad2-c5078d0d5312"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:42.994884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee921aaf-e988-4cb1-bfab-e6633a3f1fad tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:43.006695 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ee921aaf-e988-4cb1-bfab-e6633a3f1fad tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1313 microversion: 2.1 time: 0.684560 Jul 20 04:15:43.008448 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 842/1592] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:42 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1313 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:43.023342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2cedc42c-6eb5-44ae-a5d4-af5e92f83585 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:43.025321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2cedc42c-6eb5-44ae-a5d4-af5e92f83585 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:43.041295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2cedc42c-6eb5-44ae-a5d4-af5e92f83585 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.041761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2cedc42c-6eb5-44ae-a5d4-af5e92f83585 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.044188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2cedc42c-6eb5-44ae-a5d4-af5e92f83585 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.044659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2cedc42c-6eb5-44ae-a5d4-af5e92f83585 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.135102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] validate_networks() for [('d9fe07a4-2a16-4e79-9ad2-c5078d0d5312', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:43.532405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2cedc42c-6eb5-44ae-a5d4-af5e92f83585 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:43.550746 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2cedc42c-6eb5-44ae-a5d4-af5e92f83585 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.539088 Jul 20 04:15:43.570032 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 843/1593] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:43 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:43.576248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-576002fa-f54f-4bdb-8a2a-d47b586603d5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:43.576773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-576002fa-f54f-4bdb-8a2a-d47b586603d5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:43.584504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-576002fa-f54f-4bdb-8a2a-d47b586603d5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.584971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-576002fa-f54f-4bdb-8a2a-d47b586603d5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.588145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-576002fa-f54f-4bdb-8a2a-d47b586603d5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.589976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-576002fa-f54f-4bdb-8a2a-d47b586603d5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.652288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-576002fa-f54f-4bdb-8a2a-d47b586603d5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:43.719478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:43.779724 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-576002fa-f54f-4bdb-8a2a-d47b586603d5 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 204 len: 0 microversion: 2.1 time: 0.208222 Jul 20 04:15:43.786085 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 844/1594] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:43 2022] DELETE /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:44.471214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62ab2f4a-e9da-4b34-bf85-1d251f53fcec tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] Calling method '.version_select at 0x7fbf9df1d0d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:44.498596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62ab2f4a-e9da-4b34-bf85-1d251f53fcec tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.503230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62ab2f4a-e9da-4b34-bf85-1d251f53fcec tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.506497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62ab2f4a-e9da-4b34-bf85-1d251f53fcec tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.506978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62ab2f4a-e9da-4b34-bf85-1d251f53fcec tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.563729 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-62ab2f4a-e9da-4b34-bf85-1d251f53fcec tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.776157 Jul 20 04:15:44.566357 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 845/1595] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 04:15:43 2022] GET /compute/v2.1/limits => generated 511 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:44.585914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-3026221d-44b7-4dfd-9366-62d4b555848c req-84edd5eb-439a-4328-a913-e169e66f4875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8", "name": "network-vif-plugged", "status": "completed", "tag": "0c831938-16c9-4f5e-8498-ff9d8d9f8c72"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:44.616836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3026221d-44b7-4dfd-9366-62d4b555848c req-84edd5eb-439a-4328-a913-e169e66f4875 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.627608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3026221d-44b7-4dfd-9366-62d4b555848c req-84edd5eb-439a-4328-a913-e169e66f4875 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.637820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:44.638353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:44.638628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:44.639044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:44.639645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:44.666388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.666759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.680185 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-3026221d-44b7-4dfd-9366-62d4b555848c req-84edd5eb-439a-4328-a913-e169e66f4875 service nova] Creating event network-vif-plugged:0c831938-16c9-4f5e-8498-ff9d8d9f8c72 for instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 on n-h1-764485-11 Jul 20 04:15:44.681700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.681975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.708378 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-3026221d-44b7-4dfd-9366-62d4b555848c req-84edd5eb-439a-4328-a913-e169e66f4875 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128922 Jul 20 04:15:44.710313 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 846/1596] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:44.726640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-981fbcc9-e84f-451e-895e-7d00a124df6e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:44.727456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-981fbcc9-e84f-451e-895e-7d00a124df6e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:44.766121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Getting quotas for project 6d23a8eadfd74e358d917b9aa3b85bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:44.768628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-981fbcc9-e84f-451e-895e-7d00a124df6e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.769087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-981fbcc9-e84f-451e-895e-7d00a124df6e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.775744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-981fbcc9-e84f-451e-895e-7d00a124df6e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.780309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-981fbcc9-e84f-451e-895e-7d00a124df6e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.803224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Getting quotas for user 0d1edf9dfed144d8875968ffd5f9ad91 and project 6d23a8eadfd74e358d917b9aa3b85bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:44.866837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:44.869272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:44.959418 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ecd2509c-fa5f-432d-89af-ea9379f0b75b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.702340 Jul 20 04:15:44.960764 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 751/1597] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:44.974113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-695e191b-b2b7-4fa3-96f1-9df6d4786966 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:44.974923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-695e191b-b2b7-4fa3-96f1-9df6d4786966 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:44.992656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-695e191b-b2b7-4fa3-96f1-9df6d4786966 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.993246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-695e191b-b2b7-4fa3-96f1-9df6d4786966 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.995415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-695e191b-b2b7-4fa3-96f1-9df6d4786966 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.996751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-695e191b-b2b7-4fa3-96f1-9df6d4786966 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.015038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-981fbcc9-e84f-451e-895e-7d00a124df6e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:46.030125 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-981fbcc9-e84f-451e-895e-7d00a124df6e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1314 microversion: 2.1 time: 1.318519 Jul 20 04:15:46.047763 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 847/1598] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:44 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1314 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:46.076293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c075f63-e1bd-4d86-b3d0-95b6f03daab4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:46.078856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8c075f63-e1bd-4d86-b3d0-95b6f03daab4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:46.103591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c075f63-e1bd-4d86-b3d0-95b6f03daab4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.108633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c075f63-e1bd-4d86-b3d0-95b6f03daab4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.109727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c075f63-e1bd-4d86-b3d0-95b6f03daab4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.110382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c075f63-e1bd-4d86-b3d0-95b6f03daab4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.136689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-695e191b-b2b7-4fa3-96f1-9df6d4786966 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:46.165147 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-695e191b-b2b7-4fa3-96f1-9df6d4786966 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1526 microversion: 2.1 time: 1.202320 Jul 20 04:15:46.191732 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 752/1599] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:44 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1526 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:46.212044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7dd075b3-f4e9-49fd-97f5-5dfc8b73f5c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:46.212737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7dd075b3-f4e9-49fd-97f5-5dfc8b73f5c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:46.259093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dd075b3-f4e9-49fd-97f5-5dfc8b73f5c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.260048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dd075b3-f4e9-49fd-97f5-5dfc8b73f5c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.260872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dd075b3-f4e9-49fd-97f5-5dfc8b73f5c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.261326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dd075b3-f4e9-49fd-97f5-5dfc8b73f5c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:47.688326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8c075f63-e1bd-4d86-b3d0-95b6f03daab4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:47.697742 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8c075f63-e1bd-4d86-b3d0-95b6f03daab4 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1313 microversion: 2.1 time: 1.647021 Jul 20 04:15:47.698684 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 848/1600] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:46 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1313 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:47.712943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-981e5c22-8abc-4780-8021-aac19b446836 tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1050954655", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:47.815269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-981e5c22-8abc-4780-8021-aac19b446836 tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:47.874514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7dd075b3-f4e9-49fd-97f5-5dfc8b73f5c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:47.897214 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7dd075b3-f4e9-49fd-97f5-5dfc8b73f5c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 1.703331 Jul 20 04:15:47.898636 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 753/1601] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:46 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:47.903866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-49bee216-49fd-4e7a-834b-c1ed48db41f3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:47.904486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-49bee216-49fd-4e7a-834b-c1ed48db41f3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:47.919776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49bee216-49fd-4e7a-834b-c1ed48db41f3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:47.920239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49bee216-49fd-4e7a-834b-c1ed48db41f3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:47.921047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49bee216-49fd-4e7a-834b-c1ed48db41f3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:47.921494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49bee216-49fd-4e7a-834b-c1ed48db41f3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.177275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-49bee216-49fd-4e7a-834b-c1ed48db41f3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:48.188270 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-49bee216-49fd-4e7a-834b-c1ed48db41f3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 200 len: 1265 microversion: 2.1 time: 0.288738 Jul 20 04:15:48.189104 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 754/1602] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:47 2022] GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:48.208688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-145ab822-a6b7-4b33-80e2-c9337e1ea67b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.210943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-145ab822-a6b7-4b33-80e2-c9337e1ea67b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:48.232258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-145ab822-a6b7-4b33-80e2-c9337e1ea67b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.232976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-145ab822-a6b7-4b33-80e2-c9337e1ea67b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.233960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-145ab822-a6b7-4b33-80e2-c9337e1ea67b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.234605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-145ab822-a6b7-4b33-80e2-c9337e1ea67b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.951664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-145ab822-a6b7-4b33-80e2-c9337e1ea67b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:48.965708 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-145ab822-a6b7-4b33-80e2-c9337e1ea67b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1314 microversion: 2.1 time: 0.767168 Jul 20 04:15:48.966642 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 755/1603] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:48 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:48.978592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9a0934cf-ff00-472f-92aa-89a7b217f24a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.980352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9a0934cf-ff00-472f-92aa-89a7b217f24a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:49.024873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a0934cf-ff00-472f-92aa-89a7b217f24a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.025539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a0934cf-ff00-472f-92aa-89a7b217f24a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.026607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a0934cf-ff00-472f-92aa-89a7b217f24a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.028423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a0934cf-ff00-472f-92aa-89a7b217f24a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.380056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9a0934cf-ff00-472f-92aa-89a7b217f24a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e2ee08afb949bfabefeb750a0ba191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15623aa4b154b46a0e7fa6bcdf6c1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:49.409859 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9a0934cf-ff00-472f-92aa-89a7b217f24a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 200 len: 1484 microversion: 2.1 time: 0.440257 Jul 20 04:15:49.413823 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 756/1604] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:48 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 1484 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:49.418509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d4edfa88-618f-4f50-bc3e-33cd4dcdea4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:49.419118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d4edfa88-618f-4f50-bc3e-33cd4dcdea4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:49.437655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-981e5c22-8abc-4780-8021-aac19b446836 tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] Getting quotas for project 15c48f50a29043e1a8eb9faed3a1de94. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:49.445713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d4edfa88-618f-4f50-bc3e-33cd4dcdea4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.447135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d4edfa88-618f-4f50-bc3e-33cd4dcdea4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.448764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d4edfa88-618f-4f50-bc3e-33cd4dcdea4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.451822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-981e5c22-8abc-4780-8021-aac19b446836 tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] Getting quotas for user 66f794bce3ab49fb8eab439e841e0761 and project 15c48f50a29043e1a8eb9faed3a1de94. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:49.452394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d4edfa88-618f-4f50-bc3e-33cd4dcdea4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.486380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:49.489112 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-981e5c22-8abc-4780-8021-aac19b446836 tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-981e5c22-8abc-4780-8021-aac19b446836 tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] Request method failure captured: Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 1752 Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FuLDfFPsRaN-_c97tC04BYQBu77A4aNVMQTMU2rjnWGZbsjtVaUVhDuTEPHXrj4CoUjsxAuSLsicBLUECGVggeJreZHV1ImKYdiXyL9EefkNjFVReObJut-eHlEDMXOd51r0aPAO8riS0w9FcJKmCHVaIrXzSMelRMpiHwRqUitr0 Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 15c48f50a29043e1a8eb9faed3a1de94 Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-583658943 Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/15c48f50a29043e1a8eb9faed3a1de94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/15c48f50a29043e1a8eb9faed3a1de94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_15c48f50a29043e1a8eb9faed3a1de94", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/15c48f50a29043e1a8eb9faed3a1de94"}]}] Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-583658943 Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 15c48f50a29043e1a8eb9faed3a1de94 Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-583658943 Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-583658943-project Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 66f794bce3ab49fb8eab439e841e0761 Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-583658943-project Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1050954655", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:15:49.491731 n-d-764485-11 devstack@n-api.service[119808]: exception: Maximum number of metadata items exceeds 128 Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1050954655', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:49.494571 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 20 04:15:49.500174 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:49.502350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-981e5c22-8abc-4780-8021-aac19b446836 tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:49.512663 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-981e5c22-8abc-4780-8021-aac19b446836 tempest-AbsoluteLimitsNegativeTestJSON-583658943 tempest-AbsoluteLimitsNegativeTestJSON-583658943-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.812592 Jul 20 04:15:49.513760 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 849/1605] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Jul 20 04:15:47 2022] POST /compute/v2.1/servers => generated 87 bytes in 1814 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:49.523821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1ea5f531-faa2-402f-8e56-88f9992d2839 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:49.524626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1ea5f531-faa2-402f-8e56-88f9992d2839 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:49.538472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ea5f531-faa2-402f-8e56-88f9992d2839 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.539221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ea5f531-faa2-402f-8e56-88f9992d2839 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.541495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ea5f531-faa2-402f-8e56-88f9992d2839 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.548797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ea5f531-faa2-402f-8e56-88f9992d2839 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.722433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d4edfa88-618f-4f50-bc3e-33cd4dcdea4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:50.731331 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d4edfa88-618f-4f50-bc3e-33cd4dcdea4b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1462 microversion: 2.1 time: 1.316385 Jul 20 04:15:50.737488 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 757/1606] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:49 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1462 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:50.743485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1ea5f531-faa2-402f-8e56-88f9992d2839 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:50.754327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-948416b8-4f70-45e3-a1a7-49da9e097712 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:50.755698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-948416b8-4f70-45e3-a1a7-49da9e097712 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:50.759231 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1ea5f531-faa2-402f-8e56-88f9992d2839 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 1.243954 Jul 20 04:15:50.764599 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 850/1607] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:49 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:50.772491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2ee3e215-d049-4c45-8e2c-0778ee723208 req-ab86a9b2-1e57-4a6d-966e-6c18df02ec89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3", "name": "network-vif-deleted", "tag": "bf68dc13-58fc-471a-a043-6346ded43a80"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:50.778245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-948416b8-4f70-45e3-a1a7-49da9e097712 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.783465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-948416b8-4f70-45e3-a1a7-49da9e097712 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.790899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-948416b8-4f70-45e3-a1a7-49da9e097712 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.792230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-948416b8-4f70-45e3-a1a7-49da9e097712 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.804658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2ee3e215-d049-4c45-8e2c-0778ee723208 req-ab86a9b2-1e57-4a6d-966e-6c18df02ec89 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.806068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2ee3e215-d049-4c45-8e2c-0778ee723208 req-ab86a9b2-1e57-4a6d-966e-6c18df02ec89 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.851107 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2ee3e215-d049-4c45-8e2c-0778ee723208 req-ab86a9b2-1e57-4a6d-966e-6c18df02ec89 service nova] Creating event network-vif-deleted:bf68dc13-58fc-471a-a043-6346ded43a80 for instance 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 on n-h2-764485-11 Jul 20 04:15:50.877772 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2ee3e215-d049-4c45-8e2c-0778ee723208 req-ab86a9b2-1e57-4a6d-966e-6c18df02ec89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109617 Jul 20 04:15:50.879122 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 851/1608] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:50.897194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c1655bc-c529-4ce2-baf0-f177c0bc5b1b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:50.898007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8c1655bc-c529-4ce2-baf0-f177c0bc5b1b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:50.920186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c1655bc-c529-4ce2-baf0-f177c0bc5b1b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.920674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c1655bc-c529-4ce2-baf0-f177c0bc5b1b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.922496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c1655bc-c529-4ce2-baf0-f177c0bc5b1b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.924022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c1655bc-c529-4ce2-baf0-f177c0bc5b1b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.018128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-948416b8-4f70-45e3-a1a7-49da9e097712 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:52.025845 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-948416b8-4f70-45e3-a1a7-49da9e097712 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 200 len: 1307 microversion: 2.1 time: 1.286641 Jul 20 04:15:52.026434 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 758/1609] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:50 2022] GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 1307 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:52.041095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-af6cdcb0-3a8b-4020-abfb-312d5c2db96a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:52.051229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-af6cdcb0-3a8b-4020-abfb-312d5c2db96a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:52.067713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af6cdcb0-3a8b-4020-abfb-312d5c2db96a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.068489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af6cdcb0-3a8b-4020-abfb-312d5c2db96a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.069474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af6cdcb0-3a8b-4020-abfb-312d5c2db96a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.074115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af6cdcb0-3a8b-4020-abfb-312d5c2db96a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.108268 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-af6cdcb0-3a8b-4020-abfb-312d5c2db96a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] HTTP exception thrown: Instance 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 could not be found. Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-af6cdcb0-3a8b-4020-abfb-312d5c2db96a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 HTTP/1.1 Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 could not be found. Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3'} Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 could not be found. Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 could not be found. Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:52.111648 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:52.116614 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:52.116614 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:52.116614 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:52.116614 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:52.116614 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:52.116614 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:52.116614 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 could not be found. Jul 20 04:15:52.116614 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:52.125447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-af6cdcb0-3a8b-4020-abfb-312d5c2db96a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 404 to user: Instance 7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:52.127005 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-af6cdcb0-3a8b-4020-abfb-312d5c2db96a tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3" status: 404 len: 111 microversion: 2.1 time: 0.089162 Jul 20 04:15:52.127932 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 759/1610] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:52 2022] GET /compute/v2.1/servers/7b5d5a9f-8c7a-42a6-aaa8-17f19cca60b3 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:52.347824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8c1655bc-c529-4ce2-baf0-f177c0bc5b1b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:52.387356 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8c1655bc-c529-4ce2-baf0-f177c0bc5b1b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1314 microversion: 2.1 time: 1.506461 Jul 20 04:15:52.388461 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 852/1611] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:50 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1314 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:52.395696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c233ac6b-6423-4a17-a699-e29acf9edcba tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:52.396602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c233ac6b-6423-4a17-a699-e29acf9edcba tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:52.405665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c233ac6b-6423-4a17-a699-e29acf9edcba tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.406449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c233ac6b-6423-4a17-a699-e29acf9edcba tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.408406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c233ac6b-6423-4a17-a699-e29acf9edcba tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.409265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c233ac6b-6423-4a17-a699-e29acf9edcba tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.496861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:52.913983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-37901cf4-f306-4ede-a26d-3e5522a25d63 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Action: 'create', calling method: .version_select at 0x7fbf9d387430>, body: {"keypair": {"name": "tempest-keypair-1914541826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGQLgXAiLGacjtLeNVqUh5gqBbscoe+DvHTDIrEPIAmftVoWOjj0YIBogcy1ns2aqypfq32R3IPdnC9yEixUMDaiul6hgVb3aR0kErwMOCv14rMToevykxRmz1DjIL9DA=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:52.951374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-37901cf4-f306-4ede-a26d-3e5522a25d63 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Getting quotas for project c85e2a4b7bff42809c8619bf2965d541. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:52.965852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-37901cf4-f306-4ede-a26d-3e5522a25d63 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Getting quotas for user fd588c20e041471b8ccb5e47552df9e6 and project c85e2a4b7bff42809c8619bf2965d541. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:53.028856 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-37901cf4-f306-4ede-a26d-3e5522a25d63 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.898676 Jul 20 04:15:53.036164 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c233ac6b-6423-4a17-a699-e29acf9edcba tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1615 microversion: 2.1 time: 0.644560 Jul 20 04:15:53.039711 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 760/1612] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:15:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:53.052314 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 853/1613] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:52 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1615 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:53.059224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-acda16ba-552c-4bc7-aad5-2968fd76150b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.062378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-acda16ba-552c-4bc7-aad5-2968fd76150b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:53.078675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-acda16ba-552c-4bc7-aad5-2968fd76150b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.080756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-acda16ba-552c-4bc7-aad5-2968fd76150b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.082918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-acda16ba-552c-4bc7-aad5-2968fd76150b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.086048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-acda16ba-552c-4bc7-aad5-2968fd76150b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.470873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-3040b707-c963-4389-91b9-c2d6dd282761 req-9532a190-d824-4606-b340-124c6d1e720e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad081e26-4b6d-4baa-8173-83d0118cc42f", "name": "network-vif-plugged", "status": "completed", "tag": "127d2787-2622-4b1b-a505-666b064cac6d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:53.487500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3040b707-c963-4389-91b9-c2d6dd282761 req-9532a190-d824-4606-b340-124c6d1e720e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.487983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3040b707-c963-4389-91b9-c2d6dd282761 req-9532a190-d824-4606-b340-124c6d1e720e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.546550 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-3040b707-c963-4389-91b9-c2d6dd282761 req-9532a190-d824-4606-b340-124c6d1e720e service nova] Creating event network-vif-plugged:127d2787-2622-4b1b-a505-666b064cac6d for instance ad081e26-4b6d-4baa-8173-83d0118cc42f on n-h1-764485-11 Jul 20 04:15:53.565526 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-3040b707-c963-4389-91b9-c2d6dd282761 req-9532a190-d824-4606-b340-124c6d1e720e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.510582 Jul 20 04:15:53.566586 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 854/1614] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:53.589562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ac0ff688-af10-4a11-8c72-6ff31bceb52c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '.version_select at 0x7fbf9d692160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.686479 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-ac0ff688-af10-4a11-8c72-6ff31bceb52c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] HTTP exception thrown: Image not found. Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ac0ff688-af10-4a11-8c72-6ff31bceb52c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/images/088e449a-295c-4f13-aff2-a399c2007ff3 HTTP/1.1 Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: exception: Image not found. Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '088e449a-295c-4f13-aff2-a399c2007ff3'} Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 088e449a-295c-4f13-aff2-a399c2007ff3 to delete Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 088e449a-295c-4f13-aff2-a399c2007ff3 could not be found. Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:53.688464 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ac0ff688-af10-4a11-8c72-6ff31bceb52c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 404 to user: Image not found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:53.694047 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ac0ff688-af10-4a11-8c72-6ff31bceb52c tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "DELETE /compute/v2.1/images/088e449a-295c-4f13-aff2-a399c2007ff3" status: 404 len: 62 microversion: 2.1 time: 0.123452 Jul 20 04:15:53.697381 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 855/1615] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:53 2022] DELETE /compute/v2.1/images/088e449a-295c-4f13-aff2-a399c2007ff3 => generated 62 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:53.701983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0ad1a608-d9d0-4798-8987-a7f14fc6fff2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.702735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0ad1a608-d9d0-4798-8987-a7f14fc6fff2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:53.727931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ad1a608-d9d0-4798-8987-a7f14fc6fff2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.729725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ad1a608-d9d0-4798-8987-a7f14fc6fff2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.731637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ad1a608-d9d0-4798-8987-a7f14fc6fff2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.732331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ad1a608-d9d0-4798-8987-a7f14fc6fff2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.041332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-acda16ba-552c-4bc7-aad5-2968fd76150b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:54.063803 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-acda16ba-552c-4bc7-aad5-2968fd76150b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 1.022328 Jul 20 04:15:54.066769 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 761/1616] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:53 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:54.079027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e3a74508-055f-4f5e-a8b3-e1fe0d265c04 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:54.083368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e3a74508-055f-4f5e-a8b3-e1fe0d265c04 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:54.104193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3a74508-055f-4f5e-a8b3-e1fe0d265c04 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.105679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3a74508-055f-4f5e-a8b3-e1fe0d265c04 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.108619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3a74508-055f-4f5e-a8b3-e1fe0d265c04 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.120628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3a74508-055f-4f5e-a8b3-e1fe0d265c04 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.279080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e3a74508-055f-4f5e-a8b3-e1fe0d265c04 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3c64cc1266264ac5b665950c0c6167d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871d4eff31f34766adc724f52d5eea0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:54.279766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e3a74508-055f-4f5e-a8b3-e1fe0d265c04 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] flavor_id is None. Assuming migration. {{(pid=119807) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:15:54.280671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e3a74508-055f-4f5e-a8b3-e1fe0d265c04 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119807) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:15:54.361590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0ad1a608-d9d0-4798-8987-a7f14fc6fff2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:54.379057 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0ad1a608-d9d0-4798-8987-a7f14fc6fff2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 200 len: 1307 microversion: 2.1 time: 0.682302 Jul 20 04:15:54.388873 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 856/1617] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:53 2022] GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 1307 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:54.416810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a71d845-704c-4718-8f26-6d708281d6ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:54.417442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7a71d845-704c-4718-8f26-6d708281d6ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:54.444163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a71d845-704c-4718-8f26-6d708281d6ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.444670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a71d845-704c-4718-8f26-6d708281d6ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.445515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a71d845-704c-4718-8f26-6d708281d6ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.445956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a71d845-704c-4718-8f26-6d708281d6ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.545397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:54.704184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:55.131968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7a71d845-704c-4718-8f26-6d708281d6ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:55.156435 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7a71d845-704c-4718-8f26-6d708281d6ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1314 microversion: 2.1 time: 0.765923 Jul 20 04:15:55.157415 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 857/1618] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:54 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:55.167192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-46d2595b-ffcb-44fc-b65f-59faee5fceb6 req-48374443-9b50-4a22-8eab-07f6c4363566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c0c327-39d3-44cf-8598-b6dcb35a2fbf", "tag": "97dd8aca-c919-4caf-a0ef-649a0381d912"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:55.185442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-46d2595b-ffcb-44fc-b65f-59faee5fceb6 req-48374443-9b50-4a22-8eab-07f6c4363566 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.187817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-46d2595b-ffcb-44fc-b65f-59faee5fceb6 req-48374443-9b50-4a22-8eab-07f6c4363566 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.222889 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-46d2595b-ffcb-44fc-b65f-59faee5fceb6 req-48374443-9b50-4a22-8eab-07f6c4363566 service nova] Creating event network-changed:97dd8aca-c919-4caf-a0ef-649a0381d912 for instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf on n-h2-764485-11 Jul 20 04:15:55.231715 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-46d2595b-ffcb-44fc-b65f-59faee5fceb6 req-48374443-9b50-4a22-8eab-07f6c4363566 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071944 Jul 20 04:15:55.233256 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 858/1619] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:55.243375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7e0c54a6-b84e-457c-840a-ab8672997437 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.244359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7e0c54a6-b84e-457c-840a-ab8672997437 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:55.255098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7e0c54a6-b84e-457c-840a-ab8672997437 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.256646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7e0c54a6-b84e-457c-840a-ab8672997437 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.257962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7e0c54a6-b84e-457c-840a-ab8672997437 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.258715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7e0c54a6-b84e-457c-840a-ab8672997437 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.284534 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-7e0c54a6-b84e-457c-840a-ab8672997437 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] HTTP exception thrown: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7e0c54a6-b84e-457c-840a-ab8672997437 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 HTTP/1.1 Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2f3299f0-afe7-4862-b16d-7bd4498f44c2'} Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:55.286653 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:55.293461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:55.293461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:55.293461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:55.293461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:55.293461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:55.293461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:55.293461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:55.293461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:55.293461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:55.293461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:55.293461 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:15:55.299705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7e0c54a6-b84e-457c-840a-ab8672997437 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 404 to user: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:55.301493 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7e0c54a6-b84e-457c-840a-ab8672997437 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 404 len: 111 microversion: 2.1 time: 0.065897 Jul 20 04:15:55.305620 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 859/1620] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:55 2022] DELETE /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:55.320929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ae39b599-784d-437e-9d31-01d64265f009 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.321975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ae39b599-784d-437e-9d31-01d64265f009 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:55.335251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae39b599-784d-437e-9d31-01d64265f009 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.336090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae39b599-784d-437e-9d31-01d64265f009 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.337103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae39b599-784d-437e-9d31-01d64265f009 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.339774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae39b599-784d-437e-9d31-01d64265f009 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.577347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:55.612011 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e3a74508-055f-4f5e-a8b3-e1fe0d265c04 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8/action" status: 202 len: 0 microversion: 2.1 time: 1.542072 Jul 20 04:15:55.612624 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 762/1621] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:15:54 2022] POST /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8/action => generated 0 bytes in 1545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:55.630581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c9500c69-2879-4a16-9189-c7a53f6eb791 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.631380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c9500c69-2879-4a16-9189-c7a53f6eb791 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 2f3299f0-afe7-4862-b16d-7bd4498f44c2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:55.646148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9500c69-2879-4a16-9189-c7a53f6eb791 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.646639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9500c69-2879-4a16-9189-c7a53f6eb791 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.647881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9500c69-2879-4a16-9189-c7a53f6eb791 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.655040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9500c69-2879-4a16-9189-c7a53f6eb791 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.683565 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-c9500c69-2879-4a16-9189-c7a53f6eb791 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] HTTP exception thrown: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c9500c69-2879-4a16-9189-c7a53f6eb791 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 HTTP/1.1 Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '2f3299f0-afe7-4862-b16d-7bd4498f44c2'} Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:55.689878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:55.698195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:55.698195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:55.698195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:55.698195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:55.698195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:55.698195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:55.698195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. Jul 20 04:15:55.698195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:15:55.700251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c9500c69-2879-4a16-9189-c7a53f6eb791 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 404 to user: Instance 2f3299f0-afe7-4862-b16d-7bd4498f44c2 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:55.701333 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c9500c69-2879-4a16-9189-c7a53f6eb791 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2" status: 404 len: 111 microversion: 2.1 time: 0.087618 Jul 20 04:15:55.702753 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 763/1622] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:55 2022] GET /compute/v2.1/servers/2f3299f0-afe7-4862-b16d-7bd4498f44c2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:55.719834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-be9b9ea4-9083-45f7-a4b9-c7b01ee3adc6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.721581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-be9b9ea4-9083-45f7-a4b9-c7b01ee3adc6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:55.738757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be9b9ea4-9083-45f7-a4b9-c7b01ee3adc6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.739564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be9b9ea4-9083-45f7-a4b9-c7b01ee3adc6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.740806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be9b9ea4-9083-45f7-a4b9-c7b01ee3adc6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.741710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be9b9ea4-9083-45f7-a4b9-c7b01ee3adc6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.472187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ae39b599-784d-437e-9d31-01d64265f009 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:56.486687 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ae39b599-784d-437e-9d31-01d64265f009 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 1.176104 Jul 20 04:15:56.487642 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 860/1623] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:55 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:56.499398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21be1921-ecac-48d3-91b4-60950f2618a9 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:56.500658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21be1921-ecac-48d3-91b4-60950f2618a9 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:56.519206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21be1921-ecac-48d3-91b4-60950f2618a9 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.523288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21be1921-ecac-48d3-91b4-60950f2618a9 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.524264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21be1921-ecac-48d3-91b4-60950f2618a9 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.525184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21be1921-ecac-48d3-91b4-60950f2618a9 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.872339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-be9b9ea4-9083-45f7-a4b9-c7b01ee3adc6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:56.885421 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-be9b9ea4-9083-45f7-a4b9-c7b01ee3adc6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 200 len: 1307 microversion: 2.1 time: 1.180809 Jul 20 04:15:56.910883 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 764/1624] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:55 2022] GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 1307 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:56.923374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-55d46041-442c-408e-9914-4c50b32ae19f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '.version_select at 0x7fbf9d450790>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:56.963062 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-55d46041-442c-408e-9914-4c50b32ae19f tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253854375" status: 202 len: 0 microversion: 2.1 time: 0.050994 Jul 20 04:15:56.968019 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 765/1625] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 04:15:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253854375 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:56.980611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a387f857-7ac0-41b9-b819-e5f0ae69a799 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:57.003133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a387f857-7ac0-41b9-b819-e5f0ae69a799 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:57.024824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a387f857-7ac0-41b9-b819-e5f0ae69a799 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.032196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a387f857-7ac0-41b9-b819-e5f0ae69a799 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.034727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a387f857-7ac0-41b9-b819-e5f0ae69a799 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.040084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a387f857-7ac0-41b9-b819-e5f0ae69a799 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.281338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-21be1921-ecac-48d3-91b4-60950f2618a9 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.299724 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21be1921-ecac-48d3-91b4-60950f2618a9 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1471 microversion: 2.1 time: 0.810717 Jul 20 04:15:57.314608 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 861/1626] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:56 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1471 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:57.322627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-847960857", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "195c1ac5-0c50-4d71-8cac-3b325ad0e6df"}], "security_groups": [{"name": "tempest-securitygroup--1792356433"}], "key_name": "tempest-keypair-1914541826", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:57.629886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a387f857-7ac0-41b9-b819-e5f0ae69a799 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.658660 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a387f857-7ac0-41b9-b819-e5f0ae69a799 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1501 microversion: 2.1 time: 0.685344 Jul 20 04:15:57.661862 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 766/1627] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:56 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1501 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:57.663924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] validate_networks() for [('195c1ac5-0c50-4d71-8cac-3b325ad0e6df', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:57.671085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1d27136c-708e-4ea8-a099-608a881abe04 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:57.672140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1d27136c-708e-4ea8-a099-608a881abe04 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:57.687221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d27136c-708e-4ea8-a099-608a881abe04 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.687973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d27136c-708e-4ea8-a099-608a881abe04 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.689245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d27136c-708e-4ea8-a099-608a881abe04 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.690086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d27136c-708e-4ea8-a099-608a881abe04 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.365571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1d27136c-708e-4ea8-a099-608a881abe04 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:58.378488 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1d27136c-708e-4ea8-a099-608a881abe04 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.715291 Jul 20 04:15:58.385529 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 767/1628] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:57 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:58.390462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-89bf7dbd-0063-4f8d-b2d5-40e4d07c195f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:58.391058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-89bf7dbd-0063-4f8d-b2d5-40e4d07c195f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:58.411389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89bf7dbd-0063-4f8d-b2d5-40e4d07c195f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.412264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89bf7dbd-0063-4f8d-b2d5-40e4d07c195f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.413449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89bf7dbd-0063-4f8d-b2d5-40e4d07c195f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.414140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89bf7dbd-0063-4f8d-b2d5-40e4d07c195f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.446152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89bf7dbd-0063-4f8d-b2d5-40e4d07c195f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:59.462962 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-89bf7dbd-0063-4f8d-b2d5-40e4d07c195f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 200 len: 1307 microversion: 2.1 time: 1.076261 Jul 20 04:15:59.463944 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 768/1629] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:58 2022] GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 1307 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:59.473827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=21 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:59.489025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aee2f9b4-7c8b-4d78-a6b1-d0da645aa8a1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:59.492360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aee2f9b4-7c8b-4d78-a6b1-d0da645aa8a1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:59.503597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aee2f9b4-7c8b-4d78-a6b1-d0da645aa8a1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.517741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aee2f9b4-7c8b-4d78-a6b1-d0da645aa8a1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.521131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aee2f9b4-7c8b-4d78-a6b1-d0da645aa8a1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.521801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aee2f9b4-7c8b-4d78-a6b1-d0da645aa8a1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.099792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Getting quotas for project c85e2a4b7bff42809c8619bf2965d541. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:00.112889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Getting quotas for user fd588c20e041471b8ccb5e47552df9e6 and project c85e2a4b7bff42809c8619bf2965d541. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:00.118902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aee2f9b4-7c8b-4d78-a6b1-d0da645aa8a1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:00.129640 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aee2f9b4-7c8b-4d78-a6b1-d0da645aa8a1 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1471 microversion: 2.1 time: 0.650861 Jul 20 04:16:00.130247 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 769/1630] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:59 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1471 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:00.145312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5543c8f5-309b-46c3-85bb-7aef71865abf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '.version_select at 0x7fbf9d5d65e0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.152623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:00.154451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:00.154942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:00.155591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:00.156398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:00.177940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.179216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.180813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.184018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.206542 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-5543c8f5-309b-46c3-85bb-7aef71865abf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] HTTP exception thrown: Image not found. Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5543c8f5-309b-46c3-85bb-7aef71865abf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/images/cbb5a175-505c-4529-9bad-0782f1f8e14d HTTP/1.1 Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'cbb5a175-505c-4529-9bad-0782f1f8e14d'} Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cbb5a175-505c-4529-9bad-0782f1f8e14d to delete Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cbb5a175-505c-4529-9bad-0782f1f8e14d could not be found. Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:00.213384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:00.219326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5543c8f5-309b-46c3-85bb-7aef71865abf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:00.222661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Getting quotas for project c85e2a4b7bff42809c8619bf2965d541. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:00.222780 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5543c8f5-309b-46c3-85bb-7aef71865abf tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "DELETE /compute/v2.1/images/cbb5a175-505c-4529-9bad-0782f1f8e14d" status: 404 len: 62 microversion: 2.1 time: 0.087512 Jul 20 04:16:00.226214 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 770/1631] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:00 2022] DELETE /compute/v2.1/images/cbb5a175-505c-4529-9bad-0782f1f8e14d => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:16:00.237606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-22bcddab-083f-409c-9e5a-f8451e1c9330 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.239476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Getting quotas for user fd588c20e041471b8ccb5e47552df9e6 and project c85e2a4b7bff42809c8619bf2965d541. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:00.240633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-22bcddab-083f-409c-9e5a-f8451e1c9330 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:00.263377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22bcddab-083f-409c-9e5a-f8451e1c9330 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.264268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22bcddab-083f-409c-9e5a-f8451e1c9330 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.264645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22bcddab-083f-409c-9e5a-f8451e1c9330 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.265248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22bcddab-083f-409c-9e5a-f8451e1c9330 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.278570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:00.281442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:00.403383 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9f330aa2-682e-49d5-bcfa-98e8e246c422 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.082803 Jul 20 04:16:00.405529 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 862/1632] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:57 2022] POST /compute/v2.1/servers => generated 407 bytes in 3090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:00.412142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1bad29e7-03c9-49ec-90bf-f09774648751 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.413006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1bad29e7-03c9-49ec-90bf-f09774648751 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:00.437856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1bad29e7-03c9-49ec-90bf-f09774648751 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.440075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1bad29e7-03c9-49ec-90bf-f09774648751 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.443795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1bad29e7-03c9-49ec-90bf-f09774648751 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.444960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1bad29e7-03c9-49ec-90bf-f09774648751 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.485749 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-1bad29e7-03c9-49ec-90bf-f09774648751 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] HTTP exception thrown: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1bad29e7-03c9-49ec-90bf-f09774648751 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 HTTP/1.1 Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '0b03708f-1f01-49cb-9215-7c9dc75c3592'} Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:00.488609 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:00.495111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:16:00.495111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:00.495111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:00.495111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:00.495111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:00.495111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:00.495111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:00.495111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:00.495111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:00.495111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:16:00.495111 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:00.498428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1bad29e7-03c9-49ec-90bf-f09774648751 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 404 to user: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:00.499818 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1bad29e7-03c9-49ec-90bf-f09774648751 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 404 len: 111 microversion: 2.1 time: 0.092808 Jul 20 04:16:00.500993 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 863/1633] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:00 2022] DELETE /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:00.508590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-46e1ee1e-aedc-47ef-aaeb-7f60d09c389a tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.509587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-46e1ee1e-aedc-47ef-aaeb-7f60d09c389a tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:00.721112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-46e1ee1e-aedc-47ef-aaeb-7f60d09c389a tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:00.732494 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-46e1ee1e-aedc-47ef-aaeb-7f60d09c389a tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1269 microversion: 2.1 time: 0.229387 Jul 20 04:16:00.749265 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 864/1634] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:00 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1269 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:00.769838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b2e25aee-1fe1-4165-8dd6-65eeaa64eb12 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.770610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b2e25aee-1fe1-4165-8dd6-65eeaa64eb12 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:00.795036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2e25aee-1fe1-4165-8dd6-65eeaa64eb12 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.795542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2e25aee-1fe1-4165-8dd6-65eeaa64eb12 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.796389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2e25aee-1fe1-4165-8dd6-65eeaa64eb12 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.800143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2e25aee-1fe1-4165-8dd6-65eeaa64eb12 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.147561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-22bcddab-083f-409c-9e5a-f8451e1c9330 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.157155 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-22bcddab-083f-409c-9e5a-f8451e1c9330 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.932483 Jul 20 04:16:01.158299 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 771/1635] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:00 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:01.172716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-12dc8e2b-15f2-4e43-8491-bb26623f1c30 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:01.180550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-12dc8e2b-15f2-4e43-8491-bb26623f1c30 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] [instance: 0b03708f-1f01-49cb-9215-7c9dc75c3592] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:01.196102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12dc8e2b-15f2-4e43-8491-bb26623f1c30 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.197534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12dc8e2b-15f2-4e43-8491-bb26623f1c30 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.202634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12dc8e2b-15f2-4e43-8491-bb26623f1c30 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.203451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12dc8e2b-15f2-4e43-8491-bb26623f1c30 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.248669 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-12dc8e2b-15f2-4e43-8491-bb26623f1c30 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] HTTP exception thrown: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-12dc8e2b-15f2-4e43-8491-bb26623f1c30 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Request method failure captured: Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 HTTP/1.1 Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14D2dC_xziawa7C5ToI58dxcnq7cW2w2vJ2ZpGeEkHscMHUtz99-bjRT3VgVtG6QVwxp94PE1gxxjEHEm06vQxiiTRoufjQGGTfogiCkE2P3dBNsv9IJYG4JlbIj5GWSytyEcvu5aI0S5LQlFl_Uxm7EPMyPm8QSFcwYIFq2QdKkCp4 Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a15623aa4b154b46a0e7fa6bcdf6c1be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a15623aa4b154b46a0e7fa6bcdf6c1be"}]}] Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a15623aa4b154b46a0e7fa6bcdf6c1be Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199 Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a2e2ee08afb949bfabefeb750a0ba191 Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1243631199-project Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '0b03708f-1f01-49cb-9215-7c9dc75c3592'} Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:01.250938 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:01.255329 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:01.255329 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:01.255329 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:01.255329 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:01.255329 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:01.255329 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:01.255329 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. Jul 20 04:16:01.255329 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:01.261711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-12dc8e2b-15f2-4e43-8491-bb26623f1c30 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] Returning 404 to user: Instance 0b03708f-1f01-49cb-9215-7c9dc75c3592 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:01.262936 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-12dc8e2b-15f2-4e43-8491-bb26623f1c30 tempest-ImagesOneServerNegativeTestJSON-1243631199 tempest-ImagesOneServerNegativeTestJSON-1243631199-project] 10.222.0.20 "GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592" status: 404 len: 111 microversion: 2.1 time: 0.094130 Jul 20 04:16:01.263939 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 772/1636] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:01 2022] GET /compute/v2.1/servers/0b03708f-1f01-49cb-9215-7c9dc75c3592 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:01.288726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b2e25aee-1fe1-4165-8dd6-65eeaa64eb12 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.302236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d22fdf35-9961-4ff6-896d-c5c8c84395e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6b4bbc3-3518-4b40-8b7a-d4e1045fdcf8"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:01.302608 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b2e25aee-1fe1-4165-8dd6-65eeaa64eb12 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 200 len: 1307 microversion: 2.1 time: 0.550910 Jul 20 04:16:01.308051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d22fdf35-9961-4ff6-896d-c5c8c84395e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:01.314488 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 865/1637] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:00 2022] GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 1307 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:01.316737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d22fdf35-9961-4ff6-896d-c5c8c84395e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.317471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d22fdf35-9961-4ff6-896d-c5c8c84395e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.326539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d2462c82-71e0-4e75-9cff-86b846c342dc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:01.330429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d2462c82-71e0-4e75-9cff-86b846c342dc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:01.331938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d22fdf35-9961-4ff6-896d-c5c8c84395e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.334427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d22fdf35-9961-4ff6-896d-c5c8c84395e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.350260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2462c82-71e0-4e75-9cff-86b846c342dc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.350745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2462c82-71e0-4e75-9cff-86b846c342dc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.360098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2462c82-71e0-4e75-9cff-86b846c342dc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.360644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2462c82-71e0-4e75-9cff-86b846c342dc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.776480 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d22fdf35-9961-4ff6-896d-c5c8c84395e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "POST /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511015 Jul 20 04:16:01.777106 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 773/1638] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:16:01 2022] POST /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:01.804789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9f6acb98-66f7-417b-907e-d22c49b7d879 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:01.805491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9f6acb98-66f7-417b-907e-d22c49b7d879 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:01.825029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f6acb98-66f7-417b-907e-d22c49b7d879 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.825484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f6acb98-66f7-417b-907e-d22c49b7d879 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.826271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f6acb98-66f7-417b-907e-d22c49b7d879 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.826711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f6acb98-66f7-417b-907e-d22c49b7d879 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.720392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9f6acb98-66f7-417b-907e-d22c49b7d879 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:02.732782 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9f6acb98-66f7-417b-907e-d22c49b7d879 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1321 microversion: 2.1 time: 0.950551 Jul 20 04:16:02.740665 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 774/1639] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:01 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1321 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:02.755942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-64557be9-243b-4394-bb6b-fd40d31f47b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:02.756737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-64557be9-243b-4394-bb6b-fd40d31f47b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:02.769260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64557be9-243b-4394-bb6b-fd40d31f47b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.770018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64557be9-243b-4394-bb6b-fd40d31f47b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.770965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64557be9-243b-4394-bb6b-fd40d31f47b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.771594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64557be9-243b-4394-bb6b-fd40d31f47b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.988175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=14 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:03.146085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d2462c82-71e0-4e75-9cff-86b846c342dc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.211951 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d2462c82-71e0-4e75-9cff-86b846c342dc tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1471 microversion: 2.1 time: 1.893547 Jul 20 04:16:03.213164 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 866/1640] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:01 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1471 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:03.233306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-68745779-f337-4a02-ac4f-bcadb56e0b0a req-e4978bce-85dd-4e74-b12a-6099e3e449e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c0c327-39d3-44cf-8598-b6dcb35a2fbf", "name": "network-vif-plugged", "status": "completed", "tag": "97dd8aca-c919-4caf-a0ef-649a0381d912"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:03.303932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-68745779-f337-4a02-ac4f-bcadb56e0b0a req-e4978bce-85dd-4e74-b12a-6099e3e449e2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.305913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-68745779-f337-4a02-ac4f-bcadb56e0b0a req-e4978bce-85dd-4e74-b12a-6099e3e449e2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.351959 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-68745779-f337-4a02-ac4f-bcadb56e0b0a req-e4978bce-85dd-4e74-b12a-6099e3e449e2 service nova] Creating event network-vif-plugged:97dd8aca-c919-4caf-a0ef-649a0381d912 for instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf on n-h2-764485-11 Jul 20 04:16:03.366325 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-68745779-f337-4a02-ac4f-bcadb56e0b0a req-e4978bce-85dd-4e74-b12a-6099e3e449e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150770 Jul 20 04:16:03.367273 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 867/1641] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:03.415985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f4382b2a-9b44-4218-9fb2-5a0e087aaf1c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.418334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f4382b2a-9b44-4218-9fb2-5a0e087aaf1c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:03.438284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4382b2a-9b44-4218-9fb2-5a0e087aaf1c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.441059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4382b2a-9b44-4218-9fb2-5a0e087aaf1c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.442120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4382b2a-9b44-4218-9fb2-5a0e087aaf1c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.445420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4382b2a-9b44-4218-9fb2-5a0e087aaf1c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.505307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-64557be9-243b-4394-bb6b-fd40d31f47b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.526884 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-64557be9-243b-4394-bb6b-fd40d31f47b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.782522 Jul 20 04:16:03.527532 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 775/1642] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:02 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:03.811695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-dd02bb97-4861-432e-bc65-ff4bfae60a3f req-622627fb-ad87-45e4-b536-bfc1169e68ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0895e78-3e18-4ab2-b966-0561a857536c", "name": "network-vif-unplugged", "status": "completed", "tag": "fb4a38b9-ae67-49b5-806c-bca8ef8b9f33"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:03.835340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dd02bb97-4861-432e-bc65-ff4bfae60a3f req-622627fb-ad87-45e4-b536-bfc1169e68ef service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.837102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dd02bb97-4861-432e-bc65-ff4bfae60a3f req-622627fb-ad87-45e4-b536-bfc1169e68ef service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.872671 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-dd02bb97-4861-432e-bc65-ff4bfae60a3f req-622627fb-ad87-45e4-b536-bfc1169e68ef service nova] Creating event network-vif-unplugged:fb4a38b9-ae67-49b5-806c-bca8ef8b9f33 for instance d0895e78-3e18-4ab2-b966-0561a857536c on n-h2-764485-11 Jul 20 04:16:03.889256 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-dd02bb97-4861-432e-bc65-ff4bfae60a3f req-622627fb-ad87-45e4-b536-bfc1169e68ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.359672 Jul 20 04:16:03.890588 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 776/1643] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:03.899917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1bfac1ea-b3b9-4ca1-aede-698f7e73abeb tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.901000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1bfac1ea-b3b9-4ca1-aede-698f7e73abeb tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:03.908454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bfac1ea-b3b9-4ca1-aede-698f7e73abeb tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.911139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bfac1ea-b3b9-4ca1-aede-698f7e73abeb tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.912215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bfac1ea-b3b9-4ca1-aede-698f7e73abeb tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.912874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bfac1ea-b3b9-4ca1-aede-698f7e73abeb tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.172387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1bfac1ea-b3b9-4ca1-aede-698f7e73abeb tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:04.182647 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1bfac1ea-b3b9-4ca1-aede-698f7e73abeb tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1327 microversion: 2.1 time: 0.289825 Jul 20 04:16:04.183451 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 777/1644] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:03 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1327 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:04.236676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2820f294-f935-461d-9523-55a819f62416 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:04.237913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2820f294-f935-461d-9523-55a819f62416 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:04.245795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2820f294-f935-461d-9523-55a819f62416 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.246782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2820f294-f935-461d-9523-55a819f62416 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.247900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2820f294-f935-461d-9523-55a819f62416 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.255753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2820f294-f935-461d-9523-55a819f62416 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.273908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f4382b2a-9b44-4218-9fb2-5a0e087aaf1c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:04.288449 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f4382b2a-9b44-4218-9fb2-5a0e087aaf1c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 200 len: 1307 microversion: 2.1 time: 0.916833 Jul 20 04:16:04.289409 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 868/1645] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:03 2022] GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 1307 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:04.544864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fa6aa9dd-e698-44a0-b312-64c87e1efb07 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:04.546161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fa6aa9dd-e698-44a0-b312-64c87e1efb07 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:04.560767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa6aa9dd-e698-44a0-b312-64c87e1efb07 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.561268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa6aa9dd-e698-44a0-b312-64c87e1efb07 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.563678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa6aa9dd-e698-44a0-b312-64c87e1efb07 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.564356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa6aa9dd-e698-44a0-b312-64c87e1efb07 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.457466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fa6aa9dd-e698-44a0-b312-64c87e1efb07 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.473515 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fa6aa9dd-e698-44a0-b312-64c87e1efb07 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.933155 Jul 20 04:16:05.474932 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 869/1646] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:04 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:05.482698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-53d44e36-82ca-4ea6-9e5f-e72a1f85c890 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:05.483547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-53d44e36-82ca-4ea6-9e5f-e72a1f85c890 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:05.489845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2820f294-f935-461d-9523-55a819f62416 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.502031 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2820f294-f935-461d-9523-55a819f62416 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1476 microversion: 2.1 time: 1.273676 Jul 20 04:16:05.506541 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 778/1647] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:04 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1476 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:05.519277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-92f42fa8-97ae-4ae8-9c17-117ae2d71673 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:05.520224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92f42fa8-97ae-4ae8-9c17-117ae2d71673 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:05.536268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:05.544344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53d44e36-82ca-4ea6-9e5f-e72a1f85c890 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.545596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f42fa8-97ae-4ae8-9c17-117ae2d71673 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.546356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f42fa8-97ae-4ae8-9c17-117ae2d71673 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.549354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53d44e36-82ca-4ea6-9e5f-e72a1f85c890 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.551157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f42fa8-97ae-4ae8-9c17-117ae2d71673 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.551802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53d44e36-82ca-4ea6-9e5f-e72a1f85c890 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.552426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f42fa8-97ae-4ae8-9c17-117ae2d71673 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.553630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53d44e36-82ca-4ea6-9e5f-e72a1f85c890 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.897503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-53d44e36-82ca-4ea6-9e5f-e72a1f85c890 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.932536 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-53d44e36-82ca-4ea6-9e5f-e72a1f85c890 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1327 microversion: 2.1 time: 0.454302 Jul 20 04:16:05.935436 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 870/1648] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:05 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1327 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:05.965582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-e8239446-efaa-4c98-815b-bc96feda6af8 req-f85e33df-070f-45b6-a28e-673d265a61aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0895e78-3e18-4ab2-b966-0561a857536c", "tag": "fb4a38b9-ae67-49b5-806c-bca8ef8b9f33"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:05.997548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e8239446-efaa-4c98-815b-bc96feda6af8 req-f85e33df-070f-45b6-a28e-673d265a61aa service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.002721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e8239446-efaa-4c98-815b-bc96feda6af8 req-f85e33df-070f-45b6-a28e-673d265a61aa service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.047615 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e8239446-efaa-4c98-815b-bc96feda6af8 req-f85e33df-070f-45b6-a28e-673d265a61aa service nova] Creating event network-changed:fb4a38b9-ae67-49b5-806c-bca8ef8b9f33 for instance d0895e78-3e18-4ab2-b966-0561a857536c on n-h2-764485-11 Jul 20 04:16:06.066611 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-e8239446-efaa-4c98-815b-bc96feda6af8 req-f85e33df-070f-45b6-a28e-673d265a61aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105999 Jul 20 04:16:06.070449 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 871/1649] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:06.495367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-28b5294c-4a0c-4fe9-b990-b278b7fd0002 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:06.496073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-28b5294c-4a0c-4fe9-b990-b278b7fd0002 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:06.514497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28b5294c-4a0c-4fe9-b990-b278b7fd0002 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.515061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28b5294c-4a0c-4fe9-b990-b278b7fd0002 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.521077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28b5294c-4a0c-4fe9-b990-b278b7fd0002 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.526754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28b5294c-4a0c-4fe9-b990-b278b7fd0002 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.646197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-92f42fa8-97ae-4ae8-9c17-117ae2d71673 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:06.661721 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-92f42fa8-97ae-4ae8-9c17-117ae2d71673 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 200 len: 1307 microversion: 2.1 time: 1.152995 Jul 20 04:16:06.664044 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 779/1650] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:05 2022] GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 1307 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:06.679227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f18523a2-a697-4ac7-bce4-8302dcd23865 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:06.682380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f18523a2-a697-4ac7-bce4-8302dcd23865 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:06.698739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f18523a2-a697-4ac7-bce4-8302dcd23865 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.700156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f18523a2-a697-4ac7-bce4-8302dcd23865 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.704429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f18523a2-a697-4ac7-bce4-8302dcd23865 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.705748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f18523a2-a697-4ac7-bce4-8302dcd23865 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.531034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f18523a2-a697-4ac7-bce4-8302dcd23865 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:08.540659 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f18523a2-a697-4ac7-bce4-8302dcd23865 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1476 microversion: 2.1 time: 1.872273 Jul 20 04:16:08.543996 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 780/1651] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:06 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1476 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:08.568094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c83b3937-5f9a-4ff3-9f23-ba554d57b75d tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:08.568950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c83b3937-5f9a-4ff3-9f23-ba554d57b75d tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:08.586707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c83b3937-5f9a-4ff3-9f23-ba554d57b75d tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.587359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c83b3937-5f9a-4ff3-9f23-ba554d57b75d tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.588297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c83b3937-5f9a-4ff3-9f23-ba554d57b75d tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.589895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c83b3937-5f9a-4ff3-9f23-ba554d57b75d tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.690180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-28b5294c-4a0c-4fe9-b990-b278b7fd0002 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:08.709733 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-28b5294c-4a0c-4fe9-b990-b278b7fd0002 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 2.217370 Jul 20 04:16:08.710415 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 872/1652] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:06 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:08.754920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e300cf7a-ab63-4109-be21-b8127674699a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:08.755750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e300cf7a-ab63-4109-be21-b8127674699a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:08.763335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e300cf7a-ab63-4109-be21-b8127674699a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.764148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e300cf7a-ab63-4109-be21-b8127674699a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.765194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e300cf7a-ab63-4109-be21-b8127674699a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.765847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e300cf7a-ab63-4109-be21-b8127674699a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.371609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e300cf7a-ab63-4109-be21-b8127674699a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:09.382133 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e300cf7a-ab63-4109-be21-b8127674699a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 200 len: 1487 microversion: 2.1 time: 0.662265 Jul 20 04:16:09.386048 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 873/1653] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:08 2022] GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 1487 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:09.409048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e65420f-c218-47f3-a3d2-307870e3dba5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:09.410176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3e65420f-c218-47f3-a3d2-307870e3dba5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:09.429682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e65420f-c218-47f3-a3d2-307870e3dba5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.430931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e65420f-c218-47f3-a3d2-307870e3dba5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.432883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e65420f-c218-47f3-a3d2-307870e3dba5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.434548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e65420f-c218-47f3-a3d2-307870e3dba5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.467301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c83b3937-5f9a-4ff3-9f23-ba554d57b75d tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:09.477711 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c83b3937-5f9a-4ff3-9f23-ba554d57b75d tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1395 microversion: 2.1 time: 0.926949 Jul 20 04:16:09.480003 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 781/1654] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:08 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1395 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:09.563331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0034b644-2154-4999-9aa6-913b5b3089ef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:09.564158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0034b644-2154-4999-9aa6-913b5b3089ef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:09.574975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0034b644-2154-4999-9aa6-913b5b3089ef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.575431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0034b644-2154-4999-9aa6-913b5b3089ef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.584584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0034b644-2154-4999-9aa6-913b5b3089ef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.586544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0034b644-2154-4999-9aa6-913b5b3089ef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.629196 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3e65420f-c218-47f3-a3d2-307870e3dba5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "POST /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf/action" status: 202 len: 0 microversion: 2.1 time: 0.227421 Jul 20 04:16:09.639055 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 874/1655] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:09 2022] POST /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:09.664180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b7fcf6a6-b311-4fcb-8ab6-c468597fe83b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:09.664962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b7fcf6a6-b311-4fcb-8ab6-c468597fe83b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:09.672962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:09.690399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7fcf6a6-b311-4fcb-8ab6-c468597fe83b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.690855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7fcf6a6-b311-4fcb-8ab6-c468597fe83b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.693514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7fcf6a6-b311-4fcb-8ab6-c468597fe83b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.694004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7fcf6a6-b311-4fcb-8ab6-c468597fe83b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.041344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0034b644-2154-4999-9aa6-913b5b3089ef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.051580 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0034b644-2154-4999-9aa6-913b5b3089ef tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1476 microversion: 2.1 time: 0.492503 Jul 20 04:16:10.061457 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 782/1656] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:09 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1476 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:10.068063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-65f3eddf-0466-476b-a3b9-aaacf72da084 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:10.069036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-65f3eddf-0466-476b-a3b9-aaacf72da084 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:10.075729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65f3eddf-0466-476b-a3b9-aaacf72da084 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.076425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65f3eddf-0466-476b-a3b9-aaacf72da084 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.077419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65f3eddf-0466-476b-a3b9-aaacf72da084 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.078056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65f3eddf-0466-476b-a3b9-aaacf72da084 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.118591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b7fcf6a6-b311-4fcb-8ab6-c468597fe83b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.122465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:10.130152 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b7fcf6a6-b311-4fcb-8ab6-c468597fe83b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 200 len: 1492 microversion: 2.1 time: 0.488478 Jul 20 04:16:10.133454 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 875/1657] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:09 2022] GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 1492 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:10.461295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-65f3eddf-0466-476b-a3b9-aaacf72da084 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.500036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dbc9e0ee-fab9-4cdd-8622-a0890cde3fa2 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:10.500401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dbc9e0ee-fab9-4cdd-8622-a0890cde3fa2 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:10.503201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:10.507118 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-65f3eddf-0466-476b-a3b9-aaacf72da084 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.440204 Jul 20 04:16:10.515041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbc9e0ee-fab9-4cdd-8622-a0890cde3fa2 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.522698 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 783/1658] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:10 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:10.523005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbc9e0ee-fab9-4cdd-8622-a0890cde3fa2 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.527022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbc9e0ee-fab9-4cdd-8622-a0890cde3fa2 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.527774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbc9e0ee-fab9-4cdd-8622-a0890cde3fa2 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.729678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=12 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:10.869524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dbc9e0ee-fab9-4cdd-8622-a0890cde3fa2 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.888406 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dbc9e0ee-fab9-4cdd-8622-a0890cde3fa2 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1395 microversion: 2.1 time: 0.395190 Jul 20 04:16:10.889020 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 876/1659] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:10 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1395 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:11.008120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-7195a004-2377-461c-ac84-fd838b97722f req-f05def14-c398-4fbb-968f-f0255065956e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7f16d9-5dea-46ea-92a8-ff136a0a3eda", "tag": "0138a7f2-ddae-40a3-9369-06d6c5361b07"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:11.065326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7195a004-2377-461c-ac84-fd838b97722f req-f05def14-c398-4fbb-968f-f0255065956e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.066063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7195a004-2377-461c-ac84-fd838b97722f req-f05def14-c398-4fbb-968f-f0255065956e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.069370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6fb67c19-90d0-4186-9ebe-51e587317f59 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.069863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6fb67c19-90d0-4186-9ebe-51e587317f59 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.080602 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-7195a004-2377-461c-ac84-fd838b97722f req-f05def14-c398-4fbb-968f-f0255065956e service nova] Creating event network-changed:0138a7f2-ddae-40a3-9369-06d6c5361b07 for instance af7f16d9-5dea-46ea-92a8-ff136a0a3eda on n-h2-764485-11 Jul 20 04:16:11.088022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fb67c19-90d0-4186-9ebe-51e587317f59 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.088489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fb67c19-90d0-4186-9ebe-51e587317f59 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.089354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fb67c19-90d0-4186-9ebe-51e587317f59 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.089806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fb67c19-90d0-4186-9ebe-51e587317f59 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.090735 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-7195a004-2377-461c-ac84-fd838b97722f req-f05def14-c398-4fbb-968f-f0255065956e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091882 Jul 20 04:16:11.092274 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 784/1660] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:11.152634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d02b5af2-465c-476d-a9c7-8e35a810fb94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.154152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d02b5af2-465c-476d-a9c7-8e35a810fb94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.195203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d02b5af2-465c-476d-a9c7-8e35a810fb94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.195847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d02b5af2-465c-476d-a9c7-8e35a810fb94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.199717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d02b5af2-465c-476d-a9c7-8e35a810fb94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.200182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d02b5af2-465c-476d-a9c7-8e35a810fb94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.588036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6fb67c19-90d0-4186-9ebe-51e587317f59 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:11.600947 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6fb67c19-90d0-4186-9ebe-51e587317f59 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1476 microversion: 2.1 time: 0.536024 Jul 20 04:16:11.602651 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 877/1661] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:11 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1476 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:11.670550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d02b5af2-465c-476d-a9c7-8e35a810fb94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:11.679339 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d02b5af2-465c-476d-a9c7-8e35a810fb94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 200 len: 1472 microversion: 2.1 time: 0.532086 Jul 20 04:16:11.682191 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 785/1662] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:11 2022] GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 1472 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:11.708114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-088f6471-44ed-4734-a757-caf562010f71 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1259788330"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:11.718556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-088f6471-44ed-4734-a757-caf562010f71 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.736418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-088f6471-44ed-4734-a757-caf562010f71 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.736894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-088f6471-44ed-4734-a757-caf562010f71 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.740545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-088f6471-44ed-4734-a757-caf562010f71 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.742160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-088f6471-44ed-4734-a757-caf562010f71 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.802455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c79b6bce-5938-4a4f-9fc3-fcc966a033b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.804217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c79b6bce-5938-4a4f-9fc3-fcc966a033b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.814006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c79b6bce-5938-4a4f-9fc3-fcc966a033b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.814755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c79b6bce-5938-4a4f-9fc3-fcc966a033b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.836290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c79b6bce-5938-4a4f-9fc3-fcc966a033b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.838784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c79b6bce-5938-4a4f-9fc3-fcc966a033b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.343879 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-088f6471-44ed-4734-a757-caf562010f71 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "POST /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf/action" status: 202 len: 0 microversion: 2.1 time: 0.647031 Jul 20 04:16:12.344929 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 786/1663] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:11 2022] POST /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:16:12.363809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c79b6bce-5938-4a4f-9fc3-fcc966a033b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:12.374321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-75ec1bdf-5570-4acc-bfa8-ca70d942bba3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:12.377539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-75ec1bdf-5570-4acc-bfa8-ca70d942bba3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:12.380322 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c79b6bce-5938-4a4f-9fc3-fcc966a033b0 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.774761 Jul 20 04:16:12.388930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75ec1bdf-5570-4acc-bfa8-ca70d942bba3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.389709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75ec1bdf-5570-4acc-bfa8-ca70d942bba3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.391206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75ec1bdf-5570-4acc-bfa8-ca70d942bba3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.392170 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 878/1664] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:11 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:12.392556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75ec1bdf-5570-4acc-bfa8-ca70d942bba3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.399966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49943c94-4628-44be-a658-abd0b11d0f79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d50f4c0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:12.460887 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-49943c94-4628-44be-a658-abd0b11d0f79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.066942 Jul 20 04:16:12.466858 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 879/1665] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:12 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:12.566638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-75ec1bdf-5570-4acc-bfa8-ca70d942bba3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:12.574521 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-75ec1bdf-5570-4acc-bfa8-ca70d942bba3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1395 microversion: 2.1 time: 0.228027 Jul 20 04:16:12.575825 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 787/1666] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:12 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1395 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:12.618639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8218acbb-d97f-415d-a1ad-4ca899488634 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:12.619458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8218acbb-d97f-415d-a1ad-4ca899488634 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:12.632328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8218acbb-d97f-415d-a1ad-4ca899488634 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.632799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8218acbb-d97f-415d-a1ad-4ca899488634 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.633594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8218acbb-d97f-415d-a1ad-4ca899488634 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.634224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8218acbb-d97f-415d-a1ad-4ca899488634 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.822597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8218acbb-d97f-415d-a1ad-4ca899488634 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:12.833295 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8218acbb-d97f-415d-a1ad-4ca899488634 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1476 microversion: 2.1 time: 0.217328 Jul 20 04:16:12.839795 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 880/1667] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:12 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1476 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:12.851296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6f6182cd-55bf-41cf-b068-498bdf451e91 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9d3f6280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1845800698", "description": "tempest-description-568372491"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:13.050658 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6f6182cd-55bf-41cf-b068-498bdf451e91 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.278380 Jul 20 04:16:13.052142 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 788/1668] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:16:12 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:16:13.063318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ddfc6bb8-4052-458c-918b-fb58672c3d5e tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9d57eca0>, body: {"security_group_rule": {"parent_group_id": "3a59efd9-7129-4e12-b8ba-69124c2d7b5e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:13.355481 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ddfc6bb8-4052-458c-918b-fb58672c3d5e tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.296220 Jul 20 04:16:13.356126 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 881/1669] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:16:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:13.367967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2d515927-cd89-48ff-a85e-ba30bc59ab69 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9d67b040>, body: {"security_group_rule": {"parent_group_id": "3a59efd9-7129-4e12-b8ba-69124c2d7b5e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:13.399553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df24b8d6-a81b-4c95-b0fc-fa9113907b7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:13.400179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df24b8d6-a81b-4c95-b0fc-fa9113907b7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:13.417627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df24b8d6-a81b-4c95-b0fc-fa9113907b7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.418086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df24b8d6-a81b-4c95-b0fc-fa9113907b7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.418874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df24b8d6-a81b-4c95-b0fc-fa9113907b7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.419314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df24b8d6-a81b-4c95-b0fc-fa9113907b7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.436266 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-2d515927-cd89-48ff-a85e-ba30bc59ab69 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] HTTP exception thrown: This rule already exists in group 3a59efd9-7129-4e12-b8ba-69124c2d7b5e Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2d515927-cd89-48ff-a85e-ba30bc59ab69 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Request method failure captured: Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 138 Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14GMtvm-ffpWhGNLqqvIpGV8jp8xeN4Iq7Ldwm6hnBHjVIvWvha7z1TJ2BbZlpicBNAHlqmWt6Y6iLKL-QyjMOpep3Umb8atAe_t3yfeBj_v595fIyRjgjvdsh-_hv_Ne5yWzUu9HHOhvrWi9govMWxbwcTZhwby0_NB-33atWQ1Vro Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25e2e2a97a9544fda9b5424675bf861d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}] Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 01aa83975cc04bb8bf27418c5dc83411 Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: {"security_group_rule": {"parent_group_id": "3a59efd9-7129-4e12-b8ba-69124c2d7b5e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: exception: This rule already exists in group 3a59efd9-7129-4e12-b8ba-69124c2d7b5e Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3a59efd9-7129-4e12-b8ba-69124c2d7b5e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 3a59efd9-7129-4e12-b8ba-69124c2d7b5e Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 3a59efd9-7129-4e12-b8ba-69124c2d7b5e Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:13.440314 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:13.445618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:13.445618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:13.445618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 3a59efd9-7129-4e12-b8ba-69124c2d7b5e Jul 20 04:16:13.445618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:13.445618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2d515927-cd89-48ff-a85e-ba30bc59ab69 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Returning 400 to user: This rule already exists in group 3a59efd9-7129-4e12-b8ba-69124c2d7b5e {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:13.445618 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2d515927-cd89-48ff-a85e-ba30bc59ab69 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.078272 Jul 20 04:16:13.446142 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 789/1670] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:16:13 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:16:13.452297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-11c369b2-77f7-4c70-9706-c6a128ec7655 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Calling method '.version_select at 0x7fbf9d5f3310>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:13.729390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df24b8d6-a81b-4c95-b0fc-fa9113907b7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:13.767800 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df24b8d6-a81b-4c95-b0fc-fa9113907b7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.351459 Jul 20 04:16:13.775803 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 882/1671] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:13 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:13.777627 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-11c369b2-77f7-4c70-9706-c6a128ec7655 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/6551b70f-dc28-4ef1-ab4a-23284dd55eb6" status: 202 len: 0 microversion: 2.1 time: 0.330391 Jul 20 04:16:13.778461 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 790/1672] 10.222.0.20 () {58 vars in 1286 bytes} [Wed Jul 20 04:16:13 2022] DELETE /compute/v2.1/os-security-group-rules/6551b70f-dc28-4ef1-ab4a-23284dd55eb6 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:13.791196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f9744513-79b5-4938-830e-094b1a894c91 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:13.791997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f9744513-79b5-4938-830e-094b1a894c91 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:13.796399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8bbc465a-7f48-4e5c-9c6c-60cf6928de0c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9db129d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:13.798907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9744513-79b5-4938-830e-094b1a894c91 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.799577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9744513-79b5-4938-830e-094b1a894c91 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.800389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9744513-79b5-4938-830e-094b1a894c91 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.801243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9744513-79b5-4938-830e-094b1a894c91 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.872675 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8bbc465a-7f48-4e5c-9c6c-60cf6928de0c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.092039 Jul 20 04:16:13.886848 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 883/1673] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:13 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:13.896486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-940f8a3a-8174-4bf7-95e5-a315ee52c376 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9d57eaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1212193210", "description": "tempest-description-657715740"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:14.096231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f9744513-79b5-4938-830e-094b1a894c91 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:14.111619 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f9744513-79b5-4938-830e-094b1a894c91 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1395 microversion: 2.1 time: 0.331106 Jul 20 04:16:14.113492 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 791/1674] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:13 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1395 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:14.126283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c49b080-d9a9-4b43-a5ae-98c7b1c47a3b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:14.127076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4c49b080-d9a9-4b43-a5ae-98c7b1c47a3b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:14.142641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c49b080-d9a9-4b43-a5ae-98c7b1c47a3b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.143292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c49b080-d9a9-4b43-a5ae-98c7b1c47a3b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.148506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c49b080-d9a9-4b43-a5ae-98c7b1c47a3b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.149359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c49b080-d9a9-4b43-a5ae-98c7b1c47a3b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.333545 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-940f8a3a-8174-4bf7-95e5-a315ee52c376 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.441175 Jul 20 04:16:14.334415 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 884/1675] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:16:13 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:14.348665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-79de4c3e-6668-49c3-9ae2-2cafedd3c572 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9d5850d0>, body: {"security_group_rule": {"parent_group_id": "da17fc9f-8881-4583-8f0a-0cc05da23396", "ip_protocol": "tcp", "from_port": 136460253, "to_port": 22}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:14.462923 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-79de4c3e-6668-49c3-9ae2-2cafedd3c572 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] HTTP exception thrown: Invalid port range 136460253:22. Former value cannot be greater than the later Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-79de4c3e-6668-49c3-9ae2-2cafedd3c572 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Request method failure captured: Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 145 Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14GMtvm-ffpWhGNLqqvIpGV8jp8xeN4Iq7Ldwm6hnBHjVIvWvha7z1TJ2BbZlpicBNAHlqmWt6Y6iLKL-QyjMOpep3Umb8atAe_t3yfeBj_v595fIyRjgjvdsh-_hv_Ne5yWzUu9HHOhvrWi9govMWxbwcTZhwby0_NB-33atWQ1Vro Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25e2e2a97a9544fda9b5424675bf861d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}] Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 01aa83975cc04bb8bf27418c5dc83411 Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: {"security_group_rule": {"parent_group_id": "da17fc9f-8881-4583-8f0a-0cc05da23396", "ip_protocol": "tcp", "from_port": 136460253, "to_port": 22}} Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid port range 136460253:22. Former value cannot be greater than the later Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'da17fc9f-8881-4583-8f0a-0cc05da23396', 'ip_protocol': 'tcp', 'from_port': 136460253, 'to_port': 22}}} Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 136460253:22. Former value cannot be greater than the later Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 136460253:22. Former value cannot be greater than the later Jul 20 04:16:14.464988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.469512 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:14.469512 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.469512 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:14.469512 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:14.469512 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:14.469512 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:14.469512 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:14.469512 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 136460253:22. Former value cannot be greater than the later Jul 20 04:16:14.469512 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.470642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4c49b080-d9a9-4b43-a5ae-98c7b1c47a3b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:14.473718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-79de4c3e-6668-49c3-9ae2-2cafedd3c572 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Returning 400 to user: Invalid port range 136460253:22. Former value cannot be greater than the later {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:14.474769 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-79de4c3e-6668-49c3-9ae2-2cafedd3c572 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.131362 Jul 20 04:16:14.475938 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 885/1676] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:16:14 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:16:14.477715 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4c49b080-d9a9-4b43-a5ae-98c7b1c47a3b tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1476 microversion: 2.1 time: 0.363138 Jul 20 04:16:14.487758 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 792/1677] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:14 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:14.490589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62009cd1-fc7b-437d-b978-97727f5d853e tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9d5b6280>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1858391970", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:14.492678 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-62009cd1-fc7b-437d-b978-97727f5d853e tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] HTTP exception thrown: Security group id should be uuid Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62009cd1-fc7b-437d-b978-97727f5d853e tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Request method failure captured: Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 131 Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14GMtvm-ffpWhGNLqqvIpGV8jp8xeN4Iq7Ldwm6hnBHjVIvWvha7z1TJ2BbZlpicBNAHlqmWt6Y6iLKL-QyjMOpep3Umb8atAe_t3yfeBj_v595fIyRjgjvdsh-_hv_Ne5yWzUu9HHOhvrWi9govMWxbwcTZhwby0_NB-33atWQ1Vro Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25e2e2a97a9544fda9b5424675bf861d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}] Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 01aa83975cc04bb8bf27418c5dc83411 Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1858391970", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: exception: Security group id should be uuid Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1858391970', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:14.496013 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:14.501784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 20 04:16:14.501784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:14.503644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62009cd1-fc7b-437d-b978-97727f5d853e tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Returning 400 to user: Security group id should be uuid {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:14.504719 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-62009cd1-fc7b-437d-b978-97727f5d853e tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.020583 Jul 20 04:16:14.505630 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 886/1678] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:16:14 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 20 04:16:14.515555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-db4c4d3b-d9a2-493e-ab73-26fd2060d4a8 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9d65a670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1935045536", "description": "tempest-description-252625815"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:14.786372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c31e20e-af41-440a-beca-35485e1570fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:14.787000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4c31e20e-af41-440a-beca-35485e1570fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:14.816065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c31e20e-af41-440a-beca-35485e1570fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.816713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c31e20e-af41-440a-beca-35485e1570fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.818112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c31e20e-af41-440a-beca-35485e1570fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.818721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c31e20e-af41-440a-beca-35485e1570fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.845432 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-db4c4d3b-d9a2-493e-ab73-26fd2060d4a8 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.334033 Jul 20 04:16:14.846689 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 793/1679] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:16:14 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:14.860622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fac1e283-f76d-4779-993b-a5f6584456ab tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9d67bb80>, body: {"security_group_rule": {"parent_group_id": "9b6b8627-8127-4227-9ede-7e81739315ef", "ip_protocol": "tempest-999-718985704", "from_port": 22, "to_port": 22}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:15.296989 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-fac1e283-f76d-4779-993b-a5f6584456ab tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] HTTP exception thrown: Invalid IP protocol tempest-999-718985704. Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fac1e283-f76d-4779-993b-a5f6584456ab tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Request method failure captured: Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 156 Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14GMtvm-ffpWhGNLqqvIpGV8jp8xeN4Iq7Ldwm6hnBHjVIvWvha7z1TJ2BbZlpicBNAHlqmWt6Y6iLKL-QyjMOpep3Umb8atAe_t3yfeBj_v595fIyRjgjvdsh-_hv_Ne5yWzUu9HHOhvrWi9govMWxbwcTZhwby0_NB-33atWQ1Vro Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25e2e2a97a9544fda9b5424675bf861d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}] Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 01aa83975cc04bb8bf27418c5dc83411 Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: {"security_group_rule": {"parent_group_id": "9b6b8627-8127-4227-9ede-7e81739315ef", "ip_protocol": "tempest-999-718985704", "from_port": 22, "to_port": 22}} Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid IP protocol tempest-999-718985704. Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9b6b8627-8127-4227-9ede-7e81739315ef', 'ip_protocol': 'tempest-999-718985704', 'from_port': 22, 'to_port': 22}}} Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-718985704. Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-718985704. Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:15.300935 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:15.306778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:15.306778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:15.306778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:15.306778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:15.306778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:15.306778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:15.306778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-718985704. Jul 20 04:16:15.306778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:15.309012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fac1e283-f76d-4779-993b-a5f6584456ab tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Returning 400 to user: Invalid IP protocol tempest-999-718985704. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:15.310741 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fac1e283-f76d-4779-993b-a5f6584456ab tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.456657 Jul 20 04:16:15.311876 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 794/1680] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:16:14 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 459 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:16:15.327119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3cd10287-a425-472e-87c4-78eee474d066 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d4650d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:15.375783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4c31e20e-af41-440a-beca-35485e1570fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:15.391156 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4c31e20e-af41-440a-beca-35485e1570fa tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.610541 Jul 20 04:16:15.392161 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 887/1681] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:14 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:15.403335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9290ac14-61ac-4513-a1cd-b43f95de8f71 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:15.404299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9290ac14-61ac-4513-a1cd-b43f95de8f71 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:15.421191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9290ac14-61ac-4513-a1cd-b43f95de8f71 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.421841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9290ac14-61ac-4513-a1cd-b43f95de8f71 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.423018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9290ac14-61ac-4513-a1cd-b43f95de8f71 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.424529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9290ac14-61ac-4513-a1cd-b43f95de8f71 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.426935 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3cd10287-a425-472e-87c4-78eee474d066 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.113709 Jul 20 04:16:15.432478 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 795/1682] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:15 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:15.694269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9290ac14-61ac-4513-a1cd-b43f95de8f71 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:15.709517 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9290ac14-61ac-4513-a1cd-b43f95de8f71 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1395 microversion: 2.1 time: 0.316074 Jul 20 04:16:15.710120 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 888/1683] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:15 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1395 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:15.723213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d1e27ce7-7126-452b-abe2-52102306913a tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9d5859d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1766687150", "description": "tempest-description-52767576"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:15.907650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-523035602", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "13fc6880-4fac-4a39-af23-98e984a520f4"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:15.993332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] validate_networks() for [('13fc6880-4fac-4a39-af23-98e984a520f4', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:16.351152 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d1e27ce7-7126-452b-abe2-52102306913a tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.639935 Jul 20 04:16:16.352156 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 889/1684] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:16:15 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:16.357081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16ef7ce2-f551-4893-b8b6-fea0d25ff98f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:16.358308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-16ef7ce2-f551-4893-b8b6-fea0d25ff98f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:16.375310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16ef7ce2-f551-4893-b8b6-fea0d25ff98f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.380932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16ef7ce2-f551-4893-b8b6-fea0d25ff98f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.383007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16ef7ce2-f551-4893-b8b6-fea0d25ff98f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.384439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16ef7ce2-f551-4893-b8b6-fea0d25ff98f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.781581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-16ef7ce2-f551-4893-b8b6-fea0d25ff98f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:16.801523 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-16ef7ce2-f551-4893-b8b6-fea0d25ff98f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1476 microversion: 2.1 time: 0.448059 Jul 20 04:16:16.811408 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 890/1685] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:16 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1476 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:16.817238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-963955de-2702-426b-86d4-2283ed44c2b0 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9d585280>, body: {"security_group_rule": {"parent_group_id": "83a9872a-dc0c-4ce3-8db8-000ac30f4933", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:16.909120 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-963955de-2702-426b-86d4-2283ed44c2b0 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-963955de-2702-426b-86d4-2283ed44c2b0 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Request method failure captured: Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 138 Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14GMtvm-ffpWhGNLqqvIpGV8jp8xeN4Iq7Ldwm6hnBHjVIvWvha7z1TJ2BbZlpicBNAHlqmWt6Y6iLKL-QyjMOpep3Umb8atAe_t3yfeBj_v595fIyRjgjvdsh-_hv_Ne5yWzUu9HHOhvrWi9govMWxbwcTZhwby0_NB-33atWQ1Vro Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25e2e2a97a9544fda9b5424675bf861d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}] Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 01aa83975cc04bb8bf27418c5dc83411 Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: {"security_group_rule": {"parent_group_id": "83a9872a-dc0c-4ce3-8db8-000ac30f4933", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'security_group_rule': {'parent_group_id': '83a9872a-dc0c-4ce3-8db8-000ac30f4933', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:16:16.910937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:16.915879 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:16.915879 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:16.915879 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:16.915879 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:16.915879 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:16.915879 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:16.915879 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:16.915879 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:16:16.915879 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:16.918002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-963955de-2702-426b-86d4-2283ed44c2b0 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:16.919049 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-963955de-2702-426b-86d4-2283ed44c2b0 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.109328 Jul 20 04:16:16.920168 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 891/1686] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:16:16 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:16:16.932444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6c87aed-7096-472f-8369-24354dc328f1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:16.933435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f6c87aed-7096-472f-8369-24354dc328f1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:16.957125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6c87aed-7096-472f-8369-24354dc328f1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.960569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6c87aed-7096-472f-8369-24354dc328f1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.961603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6c87aed-7096-472f-8369-24354dc328f1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.963818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6c87aed-7096-472f-8369-24354dc328f1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.220554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f6c87aed-7096-472f-8369-24354dc328f1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:17.230723 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f6c87aed-7096-472f-8369-24354dc328f1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.309216 Jul 20 04:16:17.232263 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 892/1687] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:16 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:17.247798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1c347d4b-e7ca-419e-bf43-cc716dd13a72 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9df1da60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:17.339037 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1c347d4b-e7ca-419e-bf43-cc716dd13a72 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.105414 Jul 20 04:16:17.348557 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 893/1688] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:17 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:17.360602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ebc78db3-6743-4793-8d02-6cac11b5b8c1 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:17.361622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ebc78db3-6743-4793-8d02-6cac11b5b8c1 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:17.369829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ebc78db3-6743-4793-8d02-6cac11b5b8c1 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.370714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ebc78db3-6743-4793-8d02-6cac11b5b8c1 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.371810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ebc78db3-6743-4793-8d02-6cac11b5b8c1 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.373609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ebc78db3-6743-4793-8d02-6cac11b5b8c1 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.412486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:17.413063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:17.413406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:17.413964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:17.414396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:17.444603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.446787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.448103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.449713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.508677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Getting quotas for project 5181d3786af0422c928fa68ae1fd3956. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:17.532425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Getting quotas for user b63f54e61ef144968f6c8d9cfb954c8f and project 5181d3786af0422c928fa68ae1fd3956. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:17.567820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:17.577038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:17.652368 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-76b60d65-b297-4771-ab24-638b5f6b0910 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.223721 Jul 20 04:16:17.659226 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 796/1689] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:16:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2231 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:16:17.668194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3065953a-d1c8-422a-9bbc-e5cecd1206ea tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9d5f3280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1319485215", "description": "tempest-description-317845506"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:17.676113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ebc78db3-6743-4793-8d02-6cac11b5b8c1 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:17.708182 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ebc78db3-6743-4793-8d02-6cac11b5b8c1 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1395 microversion: 2.1 time: 0.346616 Jul 20 04:16:17.709554 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 894/1690] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:17 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1395 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:17.894847 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3065953a-d1c8-422a-9bbc-e5cecd1206ea tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.234082 Jul 20 04:16:17.896137 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 797/1691] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:16:17 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:17.906747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-31cc36da-4c86-438f-b483-1822409eda63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:17.907911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-31cc36da-4c86-438f-b483-1822409eda63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:17.982590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-58c25054-2e7c-4967-8ca1-94ae367bd44a tempest-ListImagesTestJSON-450182036 tempest-ListImagesTestJSON-450182036-project] Calling method '.version_select at 0x7fbf9d5b20d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.003850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-31cc36da-4c86-438f-b483-1822409eda63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:18.013752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-31cc36da-4c86-438f-b483-1822409eda63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:18.016607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-31cc36da-4c86-438f-b483-1822409eda63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:18.018148 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-31cc36da-4c86-438f-b483-1822409eda63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1261 microversion: 2.25 time: 0.120716 Jul 20 04:16:18.019730 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 798/1692] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:17 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1261 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:18.024853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7585a6f4-79be-4ebc-a58f-21c9624bbf43 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.025580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7585a6f4-79be-4ebc-a58f-21c9624bbf43 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.032867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7585a6f4-79be-4ebc-a58f-21c9624bbf43 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.033593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7585a6f4-79be-4ebc-a58f-21c9624bbf43 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.034971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7585a6f4-79be-4ebc-a58f-21c9624bbf43 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.035597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7585a6f4-79be-4ebc-a58f-21c9624bbf43 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.068595 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-58c25054-2e7c-4967-8ca1-94ae367bd44a tempest-ListImagesTestJSON-450182036 tempest-ListImagesTestJSON-450182036-project] 10.222.0.20 "GET /compute/v2.1/images/bd7de922-6028-4caa-9dbc-4c1d87dfda55" status: 200 len: 784 microversion: 2.1 time: 0.353278 Jul 20 04:16:18.073271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7585a6f4-79be-4ebc-a58f-21c9624bbf43 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:18.082389 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 895/1693] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:17 2022] GET /compute/v2.1/images/bd7de922-6028-4caa-9dbc-4c1d87dfda55 => generated 784 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:18.100552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-cef962e3-b560-4ded-ad1a-e71305fcb522 req-979a874e-2f5a-4966-ba33-13283c4081a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0895e78-3e18-4ab2-b966-0561a857536c", "name": "network-vif-unplugged", "status": "completed", "tag": "fb4a38b9-ae67-49b5-806c-bca8ef8b9f33"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:18.110339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cef962e3-b560-4ded-ad1a-e71305fcb522 req-979a874e-2f5a-4966-ba33-13283c4081a5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.120409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cef962e3-b560-4ded-ad1a-e71305fcb522 req-979a874e-2f5a-4966-ba33-13283c4081a5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.140459 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-cef962e3-b560-4ded-ad1a-e71305fcb522 req-979a874e-2f5a-4966-ba33-13283c4081a5 service nova] Creating event network-vif-unplugged:fb4a38b9-ae67-49b5-806c-bca8ef8b9f33 for instance d0895e78-3e18-4ab2-b966-0561a857536c on n-h2-764485-11 Jul 20 04:16:18.147901 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-cef962e3-b560-4ded-ad1a-e71305fcb522 req-979a874e-2f5a-4966-ba33-13283c4081a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063372 Jul 20 04:16:18.149146 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 896/1694] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:18.155832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-64b83c9d-0307-46f8-b743-71d1fa318123 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.159057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-64b83c9d-0307-46f8-b743-71d1fa318123 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.167873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:18.170281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64b83c9d-0307-46f8-b743-71d1fa318123 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.171120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64b83c9d-0307-46f8-b743-71d1fa318123 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.173081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64b83c9d-0307-46f8-b743-71d1fa318123 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.173979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64b83c9d-0307-46f8-b743-71d1fa318123 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.268206 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7585a6f4-79be-4ebc-a58f-21c9624bbf43 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 204 len: 0 microversion: 2.1 time: 0.243998 Jul 20 04:16:18.271348 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 799/1695] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:18 2022] DELETE /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:18.304896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e11616fd-580f-4fcb-add0-62364dba7cb5 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9d450820>, body: {"security_group_rule": {"parent_group_id": "be9c936f-2de6-4596-90af-93e4de672b29", "ip_protocol": "tcp", "from_port": 22, "to_port": 1338899651}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:18.412707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-64b83c9d-0307-46f8-b743-71d1fa318123 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:18.422009 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-64b83c9d-0307-46f8-b743-71d1fa318123 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1476 microversion: 2.1 time: 0.271399 Jul 20 04:16:18.424245 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 897/1696] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:18.429832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b3daeddd-2ea4-47d7-9b42-a55b2a46c797 tempest-ListImagesTestJSON-450182036 tempest-ListImagesTestJSON-450182036-project] Calling method '.version_select at 0x7fbf9dab9ca0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.430683 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e11616fd-580f-4fcb-add0-62364dba7cb5 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] HTTP exception thrown: Invalid port range 22:1338899651. Valid TCP ports should be between 1-65535 Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e11616fd-580f-4fcb-add0-62364dba7cb5 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Request method failure captured: Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 146 Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14GMtvm-ffpWhGNLqqvIpGV8jp8xeN4Iq7Ldwm6hnBHjVIvWvha7z1TJ2BbZlpicBNAHlqmWt6Y6iLKL-QyjMOpep3Umb8atAe_t3yfeBj_v595fIyRjgjvdsh-_hv_Ne5yWzUu9HHOhvrWi9govMWxbwcTZhwby0_NB-33atWQ1Vro Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25e2e2a97a9544fda9b5424675bf861d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}] Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 01aa83975cc04bb8bf27418c5dc83411 Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: {"security_group_rule": {"parent_group_id": "be9c936f-2de6-4596-90af-93e4de672b29", "ip_protocol": "tcp", "from_port": 22, "to_port": 1338899651}} Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid port range 22:1338899651. Valid TCP ports should be between 1-65535 Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'be9c936f-2de6-4596-90af-93e4de672b29', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1338899651}}} Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1338899651. Valid TCP ports should be between 1-65535 Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1338899651. Valid TCP ports should be between 1-65535 Jul 20 04:16:18.432370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.437289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:18.437289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.437289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.437289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:18.437289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:18.437289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:18.437289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:18.437289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1338899651. Valid TCP ports should be between 1-65535 Jul 20 04:16:18.437289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.437289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e11616fd-580f-4fcb-add0-62364dba7cb5 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Returning 400 to user: Invalid port range 22:1338899651. Valid TCP ports should be between 1-65535 {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:18.437289 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e11616fd-580f-4fcb-add0-62364dba7cb5 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.159224 Jul 20 04:16:18.437289 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 800/1697] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:16:18 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:16:18.440504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b5e59e08-d4ac-4e80-b6c8-0b7d8ebaa48c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.441246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b5e59e08-d4ac-4e80-b6c8-0b7d8ebaa48c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.448529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5e59e08-d4ac-4e80-b6c8-0b7d8ebaa48c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.448926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5e59e08-d4ac-4e80-b6c8-0b7d8ebaa48c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.449711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5e59e08-d4ac-4e80-b6c8-0b7d8ebaa48c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.450148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5e59e08-d4ac-4e80-b6c8-0b7d8ebaa48c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.497435 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b3daeddd-2ea4-47d7-9b42-a55b2a46c797 tempest-ListImagesTestJSON-450182036 tempest-ListImagesTestJSON-450182036-project] 10.222.0.20 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.071844 Jul 20 04:16:18.498127 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 898/1698] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/images => generated 445 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:18.505426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-324896a5-72a6-479f-8e71-4f67b3957928 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.506427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-324896a5-72a6-479f-8e71-4f67b3957928 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.514541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-324896a5-72a6-479f-8e71-4f67b3957928 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.515069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-324896a5-72a6-479f-8e71-4f67b3957928 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.515964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-324896a5-72a6-479f-8e71-4f67b3957928 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.516630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-324896a5-72a6-479f-8e71-4f67b3957928 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.788622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b5e59e08-d4ac-4e80-b6c8-0b7d8ebaa48c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:18.798215 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b5e59e08-d4ac-4e80-b6c8-0b7d8ebaa48c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.362593 Jul 20 04:16:18.799311 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 801/1699] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:18.823484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d4a705c2-9002-4cf9-ab01-f86fff7d24b4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d451670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.840928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-324896a5-72a6-479f-8e71-4f67b3957928 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:18.853287 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-324896a5-72a6-479f-8e71-4f67b3957928 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1553 microversion: 2.1 time: 0.353894 Jul 20 04:16:18.853884 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 899/1700] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1553 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:18.861432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-54f40f43-8963-4a52-8751-0c0da3bbc11d tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Action: 'create', calling method: .version_select at 0x7fbf9dab9ca0>, body: {"security_group_rule": {"parent_group_id": "1102ea62-484a-4e9c-9185-fb70a28eb437", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:18.895833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG neutronclient.v2_0.client [None req-54f40f43-8963-4a52-8751-0c0da3bbc11d tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1102ea62-484a-4e9c-9185-fb70a28eb437 does not exist", "detail": ""}} {{(pid=119808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:16:18.896647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.security_group_api [None req-54f40f43-8963-4a52-8751-0c0da3bbc11d tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Neutron security group 1102ea62-484a-4e9c-9185-fb70a28eb437 not found {{(pid=119808) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:16:18.897351 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-54f40f43-8963-4a52-8751-0c0da3bbc11d tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] HTTP exception thrown: Security group 1102ea62-484a-4e9c-9185-fb70a28eb437 does not exist Jul 20 04:16:18.897351 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-c582cec2-be56-4626-88fe-81b7a4870c18'] Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-54f40f43-8963-4a52-8751-0c0da3bbc11d tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Request method failure captured: Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 138 Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14GMtvm-ffpWhGNLqqvIpGV8jp8xeN4Iq7Ldwm6hnBHjVIvWvha7z1TJ2BbZlpicBNAHlqmWt6Y6iLKL-QyjMOpep3Umb8atAe_t3yfeBj_v595fIyRjgjvdsh-_hv_Ne5yWzUu9HHOhvrWi9govMWxbwcTZhwby0_NB-33atWQ1Vro Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25e2e2a97a9544fda9b5424675bf861d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}] Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 01aa83975cc04bb8bf27418c5dc83411 Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: {"security_group_rule": {"parent_group_id": "1102ea62-484a-4e9c-9185-fb70a28eb437", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: exception: Security group 1102ea62-484a-4e9c-9185-fb70a28eb437 does not exist Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-c582cec2-be56-4626-88fe-81b7a4870c18'] Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1102ea62-484a-4e9c-9185-fb70a28eb437', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:16:18.899796 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1102ea62-484a-4e9c-9185-fb70a28eb437 does not exist Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c582cec2-be56-4626-88fe-81b7a4870c18'] Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1102ea62-484a-4e9c-9185-fb70a28eb437 does not exist Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c582cec2-be56-4626-88fe-81b7a4870c18'] Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1102ea62-484a-4e9c-9185-fb70a28eb437 does not exist Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c582cec2-be56-4626-88fe-81b7a4870c18'] Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1102ea62-484a-4e9c-9185-fb70a28eb437 does not exist Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c582cec2-be56-4626-88fe-81b7a4870c18'] Jul 20 04:16:18.904822 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.910417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-54f40f43-8963-4a52-8751-0c0da3bbc11d tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Returning 404 to user: Security group 1102ea62-484a-4e9c-9185-fb70a28eb437 does not exist Jul 20 04:16:18.910417 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-c582cec2-be56-4626-88fe-81b7a4870c18'] {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:18.911610 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-54f40f43-8963-4a52-8751-0c0da3bbc11d tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.056783 Jul 20 04:16:18.912385 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 900/1701] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Jul 20 04:16:18 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:18.920716 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d4a705c2-9002-4cf9-ab01-f86fff7d24b4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.119933 Jul 20 04:16:18.921225 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 802/1702] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:18.931310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4883cd89-8750-4439-a67c-c267f34eb6f3 tempest-ListImagesTestJSON-450182036 tempest-ListImagesTestJSON-450182036-project] Calling method '.version_select at 0x7fbf9d5123a0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.948341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dad947e5-0999-43a5-8c1c-ff36c467f5e8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.949232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dad947e5-0999-43a5-8c1c-ff36c467f5e8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.963076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dad947e5-0999-43a5-8c1c-ff36c467f5e8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.963790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dad947e5-0999-43a5-8c1c-ff36c467f5e8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.964493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dad947e5-0999-43a5-8c1c-ff36c467f5e8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.964934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dad947e5-0999-43a5-8c1c-ff36c467f5e8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:19.010981 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4883cd89-8750-4439-a67c-c267f34eb6f3 tempest-ListImagesTestJSON-450182036 tempest-ListImagesTestJSON-450182036-project] 10.222.0.20 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.097385 Jul 20 04:16:19.011647 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 901/1703] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:19.020577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4042cdfb-4919-4179-9f69-43decb8d3271 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Calling method '.version_select at 0x7fbf9dc4d820>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:19.104611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG neutronclient.v2_0.client [None req-4042cdfb-4919-4179-9f69-43decb8d3271 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a does not exist", "detail": ""}} {{(pid=119808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:16:19.105592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.security_group_api [None req-4042cdfb-4919-4179-9f69-43decb8d3271 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Neutron security group rule 0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a not found {{(pid=119808) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 20 04:16:19.106234 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-4042cdfb-4919-4179-9f69-43decb8d3271 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] HTTP exception thrown: Security group rule 0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a does not exist Jul 20 04:16:19.106234 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-f16d042d-179c-4655-8507-fec39f12dc6e'] Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4042cdfb-4919-4179-9f69-43decb8d3271 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Request method failure captured: Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-security-group-rules/0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a HTTP/1.1 Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14GMtvm-ffpWhGNLqqvIpGV8jp8xeN4Iq7Ldwm6hnBHjVIvWvha7z1TJ2BbZlpicBNAHlqmWt6Y6iLKL-QyjMOpep3Umb8atAe_t3yfeBj_v595fIyRjgjvdsh-_hv_Ne5yWzUu9HHOhvrWi9govMWxbwcTZhwby0_NB-33atWQ1Vro Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25e2e2a97a9544fda9b5424675bf861d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25e2e2a97a9544fda9b5424675bf861d"}]}] Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 25e2e2a97a9544fda9b5424675bf861d Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405 Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 01aa83975cc04bb8bf27418c5dc83411 Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-889867405-project Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: exception: Security group rule 0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a does not exist Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-f16d042d-179c-4655-8507-fec39f12dc6e'] Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a'} Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:16:19.108545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a does not exist Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f16d042d-179c-4655-8507-fec39f12dc6e'] Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a does not exist Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f16d042d-179c-4655-8507-fec39f12dc6e'] Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a does not exist Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f16d042d-179c-4655-8507-fec39f12dc6e'] Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a does not exist Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f16d042d-179c-4655-8507-fec39f12dc6e'] Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4042cdfb-4919-4179-9f69-43decb8d3271 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Returning 404 to user: Security group rule 0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a does not exist Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-f16d042d-179c-4655-8507-fec39f12dc6e'] {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:19.114434 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4042cdfb-4919-4179-9f69-43decb8d3271 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a" status: 404 len: 199 microversion: 2.1 time: 0.099271 Jul 20 04:16:19.117784 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 902/1704] 10.222.0.20 () {58 vars in 1286 bytes} [Wed Jul 20 04:16:19 2022] DELETE /compute/v2.1/os-security-group-rules/0f613fc9-7cdb-4dc7-9b42-8322acaa5b3a => generated 199 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:19.124046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ad6fa9d-13f1-4973-9b2f-35ad38a000e3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:19.129272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8ad6fa9d-13f1-4973-9b2f-35ad38a000e3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:19.143116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ad6fa9d-13f1-4973-9b2f-35ad38a000e3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:19.148282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ad6fa9d-13f1-4973-9b2f-35ad38a000e3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:19.149451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ad6fa9d-13f1-4973-9b2f-35ad38a000e3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:19.150635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ad6fa9d-13f1-4973-9b2f-35ad38a000e3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:19.287474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8ad6fa9d-13f1-4973-9b2f-35ad38a000e3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:19.300265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8ad6fa9d-13f1-4973-9b2f-35ad38a000e3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:19.303446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8ad6fa9d-13f1-4973-9b2f-35ad38a000e3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:19.307715 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8ad6fa9d-13f1-4973-9b2f-35ad38a000e3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1265 microversion: 2.25 time: 0.188925 Jul 20 04:16:19.308248 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 903/1705] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:19 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:19.316162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dad947e5-0999-43a5-8c1c-ff36c467f5e8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:19.319686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d1833b69-6de8-484d-9813-471c0f125239 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Calling method '.version_select at 0x7fbf9d512e50>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:19.331254 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dad947e5-0999-43a5-8c1c-ff36c467f5e8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1395 microversion: 2.1 time: 0.394593 Jul 20 04:16:19.332341 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 803/1706] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1395 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:19.444317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cfae7640-78c6-4f9f-b76e-90812a4df806 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:19.445003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cfae7640-78c6-4f9f-b76e-90812a4df806 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:19.477362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfae7640-78c6-4f9f-b76e-90812a4df806 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:19.478351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfae7640-78c6-4f9f-b76e-90812a4df806 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:19.480425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfae7640-78c6-4f9f-b76e-90812a4df806 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:19.483208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfae7640-78c6-4f9f-b76e-90812a4df806 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.358867 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d1833b69-6de8-484d-9813-471c0f125239 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/be9c936f-2de6-4596-90af-93e4de672b29" status: 202 len: 0 microversion: 2.1 time: 1.047248 Jul 20 04:16:20.360820 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 904/1707] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:16:19 2022] DELETE /compute/v2.1/os-security-groups/be9c936f-2de6-4596-90af-93e4de672b29 => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:20.366008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0d37df36-0014-49b9-bb6c-34763cc96e46 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:20.366715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0d37df36-0014-49b9-bb6c-34763cc96e46 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:20.382463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d37df36-0014-49b9-bb6c-34763cc96e46 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.382930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d37df36-0014-49b9-bb6c-34763cc96e46 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.383770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d37df36-0014-49b9-bb6c-34763cc96e46 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.384213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d37df36-0014-49b9-bb6c-34763cc96e46 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.428103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cfae7640-78c6-4f9f-b76e-90812a4df806 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:20.447297 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cfae7640-78c6-4f9f-b76e-90812a4df806 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1476 microversion: 2.1 time: 1.008477 Jul 20 04:16:20.447297 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 804/1708] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:19 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1476 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:20.456426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-baa54363-efd3-498c-a657-f84f9d6b85a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:20.457143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-baa54363-efd3-498c-a657-f84f9d6b85a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:20.465709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-baa54363-efd3-498c-a657-f84f9d6b85a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.466590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-baa54363-efd3-498c-a657-f84f9d6b85a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.467661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-baa54363-efd3-498c-a657-f84f9d6b85a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.469047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-baa54363-efd3-498c-a657-f84f9d6b85a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.726839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d37df36-0014-49b9-bb6c-34763cc96e46 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:20.740983 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0d37df36-0014-49b9-bb6c-34763cc96e46 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.378783 Jul 20 04:16:20.754924 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 905/1709] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:20 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:20.761396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da35d26a-3bc1-4b40-8ad7-3fe7c925d3e7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d5b2a60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:20.781491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-baa54363-efd3-498c-a657-f84f9d6b85a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:20.791886 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-baa54363-efd3-498c-a657-f84f9d6b85a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1553 microversion: 2.1 time: 0.341551 Jul 20 04:16:20.792817 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 805/1710] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:20 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1553 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:20.803163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-20d232d7-9858-4f9f-8224-98d5593cd91c req-63c4c990-ad3b-4fb0-a0f6-5e701b5ce046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7f16d9-5dea-46ea-92a8-ff136a0a3eda", "name": "network-vif-plugged", "status": "completed", "tag": "0138a7f2-ddae-40a3-9369-06d6c5361b07"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:20.806885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-20d232d7-9858-4f9f-8224-98d5593cd91c req-63c4c990-ad3b-4fb0-a0f6-5e701b5ce046 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.807370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-20d232d7-9858-4f9f-8224-98d5593cd91c req-63c4c990-ad3b-4fb0-a0f6-5e701b5ce046 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.821445 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-20d232d7-9858-4f9f-8224-98d5593cd91c req-63c4c990-ad3b-4fb0-a0f6-5e701b5ce046 service nova] Creating event network-vif-plugged:0138a7f2-ddae-40a3-9369-06d6c5361b07 for instance af7f16d9-5dea-46ea-92a8-ff136a0a3eda on n-h2-764485-11 Jul 20 04:16:20.826690 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-20d232d7-9858-4f9f-8224-98d5593cd91c req-63c4c990-ad3b-4fb0-a0f6-5e701b5ce046 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032495 Jul 20 04:16:20.827406 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 806/1711] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:20.830498 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da35d26a-3bc1-4b40-8ad7-3fe7c925d3e7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.073756 Jul 20 04:16:20.831585 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 906/1712] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:20 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:20.836390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ad5f34a8-a7bd-4ee9-a0bd-e259e9d888d3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:20.837009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ad5f34a8-a7bd-4ee9-a0bd-e259e9d888d3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:20.839630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-abd80dc6-5f46-4d08-9369-dcd3fcede92d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:20.840348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-abd80dc6-5f46-4d08-9369-dcd3fcede92d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:20.847170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad5f34a8-a7bd-4ee9-a0bd-e259e9d888d3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.847432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad5f34a8-a7bd-4ee9-a0bd-e259e9d888d3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.848831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad5f34a8-a7bd-4ee9-a0bd-e259e9d888d3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.849447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad5f34a8-a7bd-4ee9-a0bd-e259e9d888d3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.849765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abd80dc6-5f46-4d08-9369-dcd3fcede92d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.850231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abd80dc6-5f46-4d08-9369-dcd3fcede92d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.851015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abd80dc6-5f46-4d08-9369-dcd3fcede92d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.851459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abd80dc6-5f46-4d08-9369-dcd3fcede92d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:21.004246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-abd80dc6-5f46-4d08-9369-dcd3fcede92d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:21.010408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:21.013389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-abd80dc6-5f46-4d08-9369-dcd3fcede92d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:21.014900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-abd80dc6-5f46-4d08-9369-dcd3fcede92d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:21.016223 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-abd80dc6-5f46-4d08-9369-dcd3fcede92d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1313 microversion: 2.25 time: 0.187540 Jul 20 04:16:21.016982 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 807/1713] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:20 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:21.041344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-660721fc-fcbd-4ff7-b2c6-5681f4dd2c06 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Calling method '.version_select at 0x7fbf9d65a1f0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:21.263094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ad5f34a8-a7bd-4ee9-a0bd-e259e9d888d3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:21.271995 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ad5f34a8-a7bd-4ee9-a0bd-e259e9d888d3 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1395 microversion: 2.1 time: 0.439235 Jul 20 04:16:21.272593 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 907/1714] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:20 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1395 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:21.465159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44d4a1d5-a7a1-4eaa-b4ed-cb1fbc51c73d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:21.466444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44d4a1d5-a7a1-4eaa-b4ed-cb1fbc51c73d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:21.468020 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-660721fc-fcbd-4ff7-b2c6-5681f4dd2c06 tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/83a9872a-dc0c-4ce3-8db8-000ac30f4933" status: 202 len: 0 microversion: 2.1 time: 0.437038 Jul 20 04:16:21.468613 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 808/1715] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:16:21 2022] DELETE /compute/v2.1/os-security-groups/83a9872a-dc0c-4ce3-8db8-000ac30f4933 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:21.477640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44d4a1d5-a7a1-4eaa-b4ed-cb1fbc51c73d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:21.478684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44d4a1d5-a7a1-4eaa-b4ed-cb1fbc51c73d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:21.478854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-011b5004-57c2-4c0e-85a0-0b17fe46c3de tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Calling method '.version_select at 0x7fbf9ddea820>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:21.480050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44d4a1d5-a7a1-4eaa-b4ed-cb1fbc51c73d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:21.482196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44d4a1d5-a7a1-4eaa-b4ed-cb1fbc51c73d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:21.775424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44d4a1d5-a7a1-4eaa-b4ed-cb1fbc51c73d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:21.784113 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44d4a1d5-a7a1-4eaa-b4ed-cb1fbc51c73d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1476 microversion: 2.1 time: 0.325666 Jul 20 04:16:21.785100 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 908/1716] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:21 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1476 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:21.789825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-843069aa-1bb4-4f14-be55-c297bc986232 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:21.791025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-843069aa-1bb4-4f14-be55-c297bc986232 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:21.798112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-843069aa-1bb4-4f14-be55-c297bc986232 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:21.798559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-843069aa-1bb4-4f14-be55-c297bc986232 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:21.799328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-843069aa-1bb4-4f14-be55-c297bc986232 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:21.799788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-843069aa-1bb4-4f14-be55-c297bc986232 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:21.804874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:22.240293 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-011b5004-57c2-4c0e-85a0-0b17fe46c3de tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/9b6b8627-8127-4227-9ede-7e81739315ef" status: 202 len: 0 microversion: 2.1 time: 0.766929 Jul 20 04:16:22.244744 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 809/1717] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:16:21 2022] DELETE /compute/v2.1/os-security-groups/9b6b8627-8127-4227-9ede-7e81739315ef => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:16:22.249566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ab86868-1017-4b19-9d14-00be6263dfd4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:22.251042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ab86868-1017-4b19-9d14-00be6263dfd4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:22.259604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ab86868-1017-4b19-9d14-00be6263dfd4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.260360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ab86868-1017-4b19-9d14-00be6263dfd4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.261209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ab86868-1017-4b19-9d14-00be6263dfd4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.261948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ab86868-1017-4b19-9d14-00be6263dfd4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.427410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-843069aa-1bb4-4f14-be55-c297bc986232 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.461227 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-843069aa-1bb4-4f14-be55-c297bc986232 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 0.674782 Jul 20 04:16:22.464544 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 909/1718] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:21 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:22.476121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-735546dc-789e-4a4f-b87f-01931e4f8d29 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d6921f0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:22.574538 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-735546dc-789e-4a4f-b87f-01931e4f8d29 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.108495 Jul 20 04:16:22.576086 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 910/1719] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:22 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:22.589774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-732bec4b-ab89-4585-b6ff-717638818461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:22.590808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-732bec4b-ab89-4585-b6ff-717638818461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:22.600967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-732bec4b-ab89-4585-b6ff-717638818461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.601800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-732bec4b-ab89-4585-b6ff-717638818461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.603005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-732bec4b-ab89-4585-b6ff-717638818461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.604155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-732bec4b-ab89-4585-b6ff-717638818461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.758346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ab86868-1017-4b19-9d14-00be6263dfd4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.768088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-732bec4b-ab89-4585-b6ff-717638818461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.773378 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ab86868-1017-4b19-9d14-00be6263dfd4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1553 microversion: 2.1 time: 0.527441 Jul 20 04:16:22.774191 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 810/1720] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:22 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1553 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:22.779435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-547b205b-8b28-44d0-8d30-fa7fae6702ad tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Calling method '.version_select at 0x7fbf9dc09670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:22.787950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-732bec4b-ab89-4585-b6ff-717638818461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.792795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-732bec4b-ab89-4585-b6ff-717638818461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.797264 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-732bec4b-ab89-4585-b6ff-717638818461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1319 microversion: 2.25 time: 0.220159 Jul 20 04:16:22.802109 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 911/1721] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:22 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:22.812576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c4aa7dc-9ebc-432c-8f38-a89781142801 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:22.815203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0c4aa7dc-9ebc-432c-8f38-a89781142801 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:22.832295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c4aa7dc-9ebc-432c-8f38-a89781142801 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.835876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c4aa7dc-9ebc-432c-8f38-a89781142801 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.837911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c4aa7dc-9ebc-432c-8f38-a89781142801 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.838871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c4aa7dc-9ebc-432c-8f38-a89781142801 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.964010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0c4aa7dc-9ebc-432c-8f38-a89781142801 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:23.978258 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0c4aa7dc-9ebc-432c-8f38-a89781142801 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1395 microversion: 2.1 time: 1.173394 Jul 20 04:16:23.983230 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 912/1722] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:22 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1395 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:23.999183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9b4bdca4-204b-4ec6-9687-1685701c7229 req-a2d2c042-257b-4471-98d0-09075a4e519a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad081e26-4b6d-4baa-8173-83d0118cc42f", "name": "network-vif-deleted", "tag": "127d2787-2622-4b1b-a505-666b064cac6d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:24.027027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9b4bdca4-204b-4ec6-9687-1685701c7229 req-a2d2c042-257b-4471-98d0-09075a4e519a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.039958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9b4bdca4-204b-4ec6-9687-1685701c7229 req-a2d2c042-257b-4471-98d0-09075a4e519a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.059410 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9b4bdca4-204b-4ec6-9687-1685701c7229 req-a2d2c042-257b-4471-98d0-09075a4e519a service nova] Creating event network-vif-deleted:127d2787-2622-4b1b-a505-666b064cac6d for instance ad081e26-4b6d-4baa-8173-83d0118cc42f on n-h1-764485-11 Jul 20 04:16:24.066276 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9b4bdca4-204b-4ec6-9687-1685701c7229 req-a2d2c042-257b-4471-98d0-09075a4e519a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072689 Jul 20 04:16:24.067173 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 913/1723] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:24.073953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-06baf537-7b78-4562-b2d9-1cd5d17bbad5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:24.075304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-06baf537-7b78-4562-b2d9-1cd5d17bbad5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:24.086145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06baf537-7b78-4562-b2d9-1cd5d17bbad5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.086755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06baf537-7b78-4562-b2d9-1cd5d17bbad5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.088243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06baf537-7b78-4562-b2d9-1cd5d17bbad5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.089094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06baf537-7b78-4562-b2d9-1cd5d17bbad5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.580382 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-547b205b-8b28-44d0-8d30-fa7fae6702ad tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/da17fc9f-8881-4583-8f0a-0cc05da23396" status: 202 len: 0 microversion: 2.1 time: 1.804695 Jul 20 04:16:24.581968 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 811/1724] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:16:22 2022] DELETE /compute/v2.1/os-security-groups/da17fc9f-8881-4583-8f0a-0cc05da23396 => generated 0 bytes in 1807 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:24.587284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-aaed5b8d-f717-4503-b569-d31ff6941515 req-b00b2f17-6c70-450e-97ae-cacbafa22436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c0c327-39d3-44cf-8598-b6dcb35a2fbf", "name": "network-vif-plugged", "status": "completed", "tag": "97dd8aca-c919-4caf-a0ef-649a0381d912"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:24.609884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-aaed5b8d-f717-4503-b569-d31ff6941515 req-b00b2f17-6c70-450e-97ae-cacbafa22436 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.610772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-aaed5b8d-f717-4503-b569-d31ff6941515 req-b00b2f17-6c70-450e-97ae-cacbafa22436 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.617591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-06baf537-7b78-4562-b2d9-1cd5d17bbad5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:24.629069 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-06baf537-7b78-4562-b2d9-1cd5d17bbad5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1475 microversion: 2.1 time: 0.560410 Jul 20 04:16:24.629928 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 914/1725] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:24 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1475 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:24.640159 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-aaed5b8d-f717-4503-b569-d31ff6941515 req-b00b2f17-6c70-450e-97ae-cacbafa22436 service nova] Creating event network-vif-plugged:97dd8aca-c919-4caf-a0ef-649a0381d912 for instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf on n-h2-764485-11 Jul 20 04:16:24.643608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9145f4bb-357a-499f-9978-a7fb61a1ac72 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:24.644470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9145f4bb-357a-499f-9978-a7fb61a1ac72 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:24.653879 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-aaed5b8d-f717-4503-b569-d31ff6941515 req-b00b2f17-6c70-450e-97ae-cacbafa22436 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070314 Jul 20 04:16:24.658372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9145f4bb-357a-499f-9978-a7fb61a1ac72 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.659037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9145f4bb-357a-499f-9978-a7fb61a1ac72 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.660994 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 812/1726] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:24.661643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9145f4bb-357a-499f-9978-a7fb61a1ac72 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.664082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9145f4bb-357a-499f-9978-a7fb61a1ac72 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.676006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2ea9991-12e7-4df0-abd6-88c0bb81252c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d65af70>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:24.764771 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2ea9991-12e7-4df0-abd6-88c0bb81252c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.101665 Jul 20 04:16:24.765574 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 813/1727] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:24 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:24.791433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3a866c78-eab5-4cfb-a9fa-146b25c33016 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:24.804934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3a866c78-eab5-4cfb-a9fa-146b25c33016 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:24.819794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a866c78-eab5-4cfb-a9fa-146b25c33016 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.822242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a866c78-eab5-4cfb-a9fa-146b25c33016 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.824286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a866c78-eab5-4cfb-a9fa-146b25c33016 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.825926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a866c78-eab5-4cfb-a9fa-146b25c33016 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.773041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3a866c78-eab5-4cfb-a9fa-146b25c33016 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:25.787413 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3a866c78-eab5-4cfb-a9fa-146b25c33016 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1345 microversion: 2.1 time: 1.014259 Jul 20 04:16:25.792149 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 814/1728] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:24 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1345 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:25.803086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-92563819-708e-48a0-8fe3-198b16c49446 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:25.803767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92563819-708e-48a0-8fe3-198b16c49446 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:25.815290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92563819-708e-48a0-8fe3-198b16c49446 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.817314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92563819-708e-48a0-8fe3-198b16c49446 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.818161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92563819-708e-48a0-8fe3-198b16c49446 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.821171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92563819-708e-48a0-8fe3-198b16c49446 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.957684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9145f4bb-357a-499f-9978-a7fb61a1ac72 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:25.973107 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9145f4bb-357a-499f-9978-a7fb61a1ac72 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1716 microversion: 2.1 time: 1.341943 Jul 20 04:16:25.992713 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 915/1729] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:24 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1716 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:26.015153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-211f45d0-5469-43a4-9e15-4947260237ff tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] Calling method '.version_select at 0x7fbf9df05b80>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:27.424702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-92563819-708e-48a0-8fe3-198b16c49446 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:27.446861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-92563819-708e-48a0-8fe3-198b16c49446 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:27.455232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-92563819-708e-48a0-8fe3-198b16c49446 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:27.462298 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-92563819-708e-48a0-8fe3-198b16c49446 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1361 microversion: 2.25 time: 1.669081 Jul 20 04:16:27.463620 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 815/1730] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:25 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1361 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:27.470081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-433810e7-d5fb-41dc-83bc-b17ca0b502ca tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:27.471059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-433810e7-d5fb-41dc-83bc-b17ca0b502ca tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:27.479008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:27.481569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-433810e7-d5fb-41dc-83bc-b17ca0b502ca tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.482306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-433810e7-d5fb-41dc-83bc-b17ca0b502ca tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.483346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-433810e7-d5fb-41dc-83bc-b17ca0b502ca tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.484065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-433810e7-d5fb-41dc-83bc-b17ca0b502ca tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.008966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:28.539949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-433810e7-d5fb-41dc-83bc-b17ca0b502ca tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:28.561686 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-433810e7-d5fb-41dc-83bc-b17ca0b502ca tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1575 microversion: 2.1 time: 1.089853 Jul 20 04:16:28.562819 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 816/1731] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:27 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1575 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:28.570096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b7b24167-9b6e-4f67-8bc4-e29018f7fbb7 req-90b018cf-cceb-42d4-b037-aa385828b7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8", "name": "network-vif-unplugged", "status": "completed", "tag": "0c831938-16c9-4f5e-8498-ff9d8d9f8c72"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:28.596358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b7b24167-9b6e-4f67-8bc4-e29018f7fbb7 req-90b018cf-cceb-42d4-b037-aa385828b7d7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.607738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b7b24167-9b6e-4f67-8bc4-e29018f7fbb7 req-90b018cf-cceb-42d4-b037-aa385828b7d7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.653612 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b7b24167-9b6e-4f67-8bc4-e29018f7fbb7 req-90b018cf-cceb-42d4-b037-aa385828b7d7 service nova] Creating event network-vif-unplugged:0c831938-16c9-4f5e-8498-ff9d8d9f8c72 for instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 on n-h2-764485-11 Jul 20 04:16:28.671263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-b7b24167-9b6e-4f67-8bc4-e29018f7fbb7 req-90b018cf-cceb-42d4-b037-aa385828b7d7 service nova] Instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:16:28.699092 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b7b24167-9b6e-4f67-8bc4-e29018f7fbb7 req-90b018cf-cceb-42d4-b037-aa385828b7d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132531 Jul 20 04:16:28.708965 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 817/1732] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:28.722075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08522e17-0642-4c9c-a90f-401e38e87feb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:28.733862 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-211f45d0-5469-43a4-9e15-4947260237ff tempest-SecurityGroupRulesNegativeTestJSON-889867405 tempest-SecurityGroupRulesNegativeTestJSON-889867405-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/3a59efd9-7129-4e12-b8ba-69124c2d7b5e" status: 202 len: 0 microversion: 2.1 time: 2.722638 Jul 20 04:16:28.734493 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 916/1733] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:16:25 2022] DELETE /compute/v2.1/os-security-groups/3a59efd9-7129-4e12-b8ba-69124c2d7b5e => generated 0 bytes in 2741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:28.739589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db71934c-bfb4-464d-831f-02d919eabf90 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d5b6820>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:28.756580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-08522e17-0642-4c9c-a90f-401e38e87feb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:28.779537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08522e17-0642-4c9c-a90f-401e38e87feb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.789337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08522e17-0642-4c9c-a90f-401e38e87feb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.790200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08522e17-0642-4c9c-a90f-401e38e87feb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.790658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08522e17-0642-4c9c-a90f-401e38e87feb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.845735 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-db71934c-bfb4-464d-831f-02d919eabf90 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.109942 Jul 20 04:16:28.849089 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 917/1734] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:28 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:28.860799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-01d79d40-75e6-4aa4-b444-a83802533608 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:28.861612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-01d79d40-75e6-4aa4-b444-a83802533608 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:28.880235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01d79d40-75e6-4aa4-b444-a83802533608 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.882061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01d79d40-75e6-4aa4-b444-a83802533608 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.886219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01d79d40-75e6-4aa4-b444-a83802533608 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.888188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01d79d40-75e6-4aa4-b444-a83802533608 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.095542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-01d79d40-75e6-4aa4-b444-a83802533608 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:29.113279 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-01d79d40-75e6-4aa4-b444-a83802533608 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1345 microversion: 2.1 time: 0.262929 Jul 20 04:16:29.121228 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 918/1735] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:28 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1345 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:29.128981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a91a6445-3849-404a-8ff6-c100d77d734a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:29.133246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a91a6445-3849-404a-8ff6-c100d77d734a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:29.148760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a91a6445-3849-404a-8ff6-c100d77d734a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.149373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a91a6445-3849-404a-8ff6-c100d77d734a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.150314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a91a6445-3849-404a-8ff6-c100d77d734a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.160615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a91a6445-3849-404a-8ff6-c100d77d734a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.323079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a91a6445-3849-404a-8ff6-c100d77d734a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:30.333651 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a91a6445-3849-404a-8ff6-c100d77d734a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1706 microversion: 2.1 time: 1.210967 Jul 20 04:16:30.339903 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 919/1736] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:29 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1706 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:30.358162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e92974da-e13d-4885-8b29-bf6e13700bef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:30.358801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e92974da-e13d-4885-8b29-bf6e13700bef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:30.378041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e92974da-e13d-4885-8b29-bf6e13700bef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.378907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e92974da-e13d-4885-8b29-bf6e13700bef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.379317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e92974da-e13d-4885-8b29-bf6e13700bef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.379793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e92974da-e13d-4885-8b29-bf6e13700bef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.456970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-08522e17-0642-4c9c-a90f-401e38e87feb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:30.474465 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-08522e17-0642-4c9c-a90f-401e38e87feb tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1475 microversion: 2.1 time: 1.761975 Jul 20 04:16:30.475102 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 818/1737] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:28 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1475 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:30.502790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bfa84fe0-2d9f-4cf3-ad2d-de2716a2fbd8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:30.503370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bfa84fe0-2d9f-4cf3-ad2d-de2716a2fbd8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:30.528665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfa84fe0-2d9f-4cf3-ad2d-de2716a2fbd8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.529129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfa84fe0-2d9f-4cf3-ad2d-de2716a2fbd8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.529919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfa84fe0-2d9f-4cf3-ad2d-de2716a2fbd8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.533462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfa84fe0-2d9f-4cf3-ad2d-de2716a2fbd8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.221453 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bfa84fe0-2d9f-4cf3-ad2d-de2716a2fbd8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.729935 Jul 20 04:16:31.222397 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 819/1738] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:16:30 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda/os-interface => generated 284 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:31.227251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6a25fb6e-2d3f-407c-8242-9a8e2cb08620 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d65a160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.289698 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6a25fb6e-2d3f-407c-8242-9a8e2cb08620 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.066234 Jul 20 04:16:31.290884 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 820/1739] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:31.295778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-39330809-0240-49bc-94c0-4899ffc0d672 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.305534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-39330809-0240-49bc-94c0-4899ffc0d672 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.314945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39330809-0240-49bc-94c0-4899ffc0d672 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.315862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39330809-0240-49bc-94c0-4899ffc0d672 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.316820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39330809-0240-49bc-94c0-4899ffc0d672 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.317590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39330809-0240-49bc-94c0-4899ffc0d672 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.691021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-39330809-0240-49bc-94c0-4899ffc0d672 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.699688 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-39330809-0240-49bc-94c0-4899ffc0d672 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 200 len: 1345 microversion: 2.1 time: 0.407476 Jul 20 04:16:31.700287 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 821/1740] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 1345 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:31.724574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b3c37a0-0191-48a6-9b21-6e33780fac04 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '.version_select at 0x7fbf9d65a160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.727286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b3c37a0-0191-48a6-9b21-6e33780fac04 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.727792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b3c37a0-0191-48a6-9b21-6e33780fac04 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.762660 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0b3c37a0-0191-48a6-9b21-6e33780fac04 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2772 microversion: 2.1 time: 0.047090 Jul 20 04:16:31.775577 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 822/1741] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/os-migrations => generated 2772 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:32.076599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ae8590c7-950e-47da-a6d5-d7edb2f45de1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Action: 'create', calling method: .version_select at 0x7fbf9dbbaaf0>, body: {"keypair": {"name": "tempest-keypair-1391364140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGgQhWpVhg8egmaNMi7NfbfrxN75JG8k4UDmI8udxp1/mtc0CS4xLjOsltdCdv/HnvM6uOhBfcRVk+KTgYqOwST6gSHrJIrLeeWH8BNng5s8iPn3DmKZa+xVrbEQAqDnQ=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:32.113485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ae8590c7-950e-47da-a6d5-d7edb2f45de1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Getting quotas for project f335bb149385457d9ca74e9801e5e4fb. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:32.126830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ae8590c7-950e-47da-a6d5-d7edb2f45de1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Getting quotas for user 770247229b22438dba9d29709710ce60 and project f335bb149385457d9ca74e9801e5e4fb. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:32.178717 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ae8590c7-950e-47da-a6d5-d7edb2f45de1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.401898 Jul 20 04:16:32.179342 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 823/1742] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:16:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:32.193053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d5f05ac0-354e-47b6-9101-bbbea52abc7c req-6b56c569-124b-4074-9417-6e5bd507555b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8", "tag": "0c831938-16c9-4f5e-8498-ff9d8d9f8c72"}, {"name": "network-changed", "server_uuid": "7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe", "tag": "44316d0e-ff03-434b-84fc-d22fbc6f7ea6"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:32.213436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e92974da-e13d-4885-8b29-bf6e13700bef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:32.214406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d5f05ac0-354e-47b6-9101-bbbea52abc7c req-6b56c569-124b-4074-9417-6e5bd507555b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.214857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d5f05ac0-354e-47b6-9101-bbbea52abc7c req-6b56c569-124b-4074-9417-6e5bd507555b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.227120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e92974da-e13d-4885-8b29-bf6e13700bef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:32.236552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e92974da-e13d-4885-8b29-bf6e13700bef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:32.237752 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e92974da-e13d-4885-8b29-bf6e13700bef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1361 microversion: 2.25 time: 1.896672 Jul 20 04:16:32.244472 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d5f05ac0-354e-47b6-9101-bbbea52abc7c req-6b56c569-124b-4074-9417-6e5bd507555b service nova] Creating event network-changed:0c831938-16c9-4f5e-8498-ff9d8d9f8c72 for instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 on n-h2-764485-11 Jul 20 04:16:32.244980 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d5f05ac0-354e-47b6-9101-bbbea52abc7c req-6b56c569-124b-4074-9417-6e5bd507555b service nova] Creating event network-changed:44316d0e-ff03-434b-84fc-d22fbc6f7ea6 for instance 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe on n-h1-764485-11 Jul 20 04:16:32.251090 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 920/1743] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:30 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1361 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:32.261165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74d0db04-b15b-4547-b619-701893d3834a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:32.261798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74d0db04-b15b-4547-b619-701893d3834a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:32.268494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-d5f05ac0-354e-47b6-9101-bbbea52abc7c req-6b56c569-124b-4074-9417-6e5bd507555b service nova] Instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:16:32.285589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74d0db04-b15b-4547-b619-701893d3834a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.286359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74d0db04-b15b-4547-b619-701893d3834a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.287351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74d0db04-b15b-4547-b619-701893d3834a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.288004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74d0db04-b15b-4547-b619-701893d3834a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.305409 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d5f05ac0-354e-47b6-9101-bbbea52abc7c req-6b56c569-124b-4074-9417-6e5bd507555b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.124683 Jul 20 04:16:32.307276 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 824/1744] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:32.317775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4560e174-cf69-4186-b15d-f340aa6185ac tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:32.319118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4560e174-cf69-4186-b15d-f340aa6185ac tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:32.340289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4560e174-cf69-4186-b15d-f340aa6185ac tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.341325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4560e174-cf69-4186-b15d-f340aa6185ac tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.344921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4560e174-cf69-4186-b15d-f340aa6185ac tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.345735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4560e174-cf69-4186-b15d-f340aa6185ac tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.268828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-74d0db04-b15b-4547-b619-701893d3834a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.276889 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74d0db04-b15b-4547-b619-701893d3834a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1475 microversion: 2.1 time: 1.024530 Jul 20 04:16:33.289152 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 921/1745] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:32 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1475 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:33.294494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6ac0c6ee-809d-49ce-82f3-8a419b6ecca3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9dc4d820>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.458169 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6ac0c6ee-809d-49ce-82f3-8a419b6ecca3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.167508 Jul 20 04:16:33.458775 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 922/1746] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:33.463570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e202cec3-a5b5-487b-a107-2c3ba1b4e0c5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.473704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e202cec3-a5b5-487b-a107-2c3ba1b4e0c5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.495406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e202cec3-a5b5-487b-a107-2c3ba1b4e0c5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.495894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e202cec3-a5b5-487b-a107-2c3ba1b4e0c5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.496700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e202cec3-a5b5-487b-a107-2c3ba1b4e0c5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.497152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e202cec3-a5b5-487b-a107-2c3ba1b4e0c5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.546127 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-e202cec3-a5b5-487b-a107-2c3ba1b4e0c5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e202cec3-a5b5-487b-a107-2c3ba1b4e0c5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f HTTP/1.1 Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ad081e26-4b6d-4baa-8173-83d0118cc42f'} Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:33.548425 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:33.553375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:33.553375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:33.553375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:33.553375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:33.553375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:33.553375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:16:33.553375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:16:33.553375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e202cec3-a5b5-487b-a107-2c3ba1b4e0c5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:33.553375 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e202cec3-a5b5-487b-a107-2c3ba1b4e0c5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 404 len: 111 microversion: 2.1 time: 0.090134 Jul 20 04:16:33.553375 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 923/1747] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:33.566792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3d161c03-3ecb-4f07-8a71-f8b114406f82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.568517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3d161c03-3ecb-4f07-8a71-f8b114406f82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.575982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d161c03-3ecb-4f07-8a71-f8b114406f82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.576744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d161c03-3ecb-4f07-8a71-f8b114406f82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.578412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d161c03-3ecb-4f07-8a71-f8b114406f82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.580808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d161c03-3ecb-4f07-8a71-f8b114406f82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.612574 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4560e174-cf69-4186-b15d-f340aa6185ac tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1859 microversion: 2.1 time: 1.303361 Jul 20 04:16:33.627380 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 825/1748] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:32 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1859 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:33.659347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f26cf43-a467-4ec5-b0ee-9c146ee14a0e tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.661183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0f26cf43-a467-4ec5-b0ee-9c146ee14a0e tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.685341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f26cf43-a467-4ec5-b0ee-9c146ee14a0e tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.689510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f26cf43-a467-4ec5-b0ee-9c146ee14a0e tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.690993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f26cf43-a467-4ec5-b0ee-9c146ee14a0e tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.693758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f26cf43-a467-4ec5-b0ee-9c146ee14a0e tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.586709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3d161c03-3ecb-4f07-8a71-f8b114406f82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.601128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3d161c03-3ecb-4f07-8a71-f8b114406f82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.607394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3d161c03-3ecb-4f07-8a71-f8b114406f82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.609182 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3d161c03-3ecb-4f07-8a71-f8b114406f82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1361 microversion: 2.25 time: 1.057762 Jul 20 04:16:34.619082 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 924/1749] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1361 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:34.627332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-352fcc63-216b-4c78-82c7-de506b305f76 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:34.629385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-352fcc63-216b-4c78-82c7-de506b305f76 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:34.647142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-352fcc63-216b-4c78-82c7-de506b305f76 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.649599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-352fcc63-216b-4c78-82c7-de506b305f76 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.653510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-352fcc63-216b-4c78-82c7-de506b305f76 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.654439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-352fcc63-216b-4c78-82c7-de506b305f76 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.326626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0f26cf43-a467-4ec5-b0ee-9c146ee14a0e tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:35.343439 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f26cf43-a467-4ec5-b0ee-9c146ee14a0e tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1575 microversion: 2.1 time: 1.712518 Jul 20 04:16:35.347305 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 826/1750] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1575 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:35.357829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8c87f4e2-6d04-4100-912b-aa906dbb7184 req-7813f3c8-3e7f-461c-bb63-d724b2efd8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7f16d9-5dea-46ea-92a8-ff136a0a3eda", "tag": "0138a7f2-ddae-40a3-9369-06d6c5361b07"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:35.385768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8c87f4e2-6d04-4100-912b-aa906dbb7184 req-7813f3c8-3e7f-461c-bb63-d724b2efd8b5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.386729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8c87f4e2-6d04-4100-912b-aa906dbb7184 req-7813f3c8-3e7f-461c-bb63-d724b2efd8b5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.425326 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8c87f4e2-6d04-4100-912b-aa906dbb7184 req-7813f3c8-3e7f-461c-bb63-d724b2efd8b5 service nova] Creating event network-changed:0138a7f2-ddae-40a3-9369-06d6c5361b07 for instance af7f16d9-5dea-46ea-92a8-ff136a0a3eda on n-h2-764485-11 Jul 20 04:16:35.444630 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8c87f4e2-6d04-4100-912b-aa906dbb7184 req-7813f3c8-3e7f-461c-bb63-d724b2efd8b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094172 Jul 20 04:16:35.447856 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 827/1751] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:35.458972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bb7e01c5-8d83-4c7b-98bb-40d97af6e7fc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:35.460740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bb7e01c5-8d83-4c7b-98bb-40d97af6e7fc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:35.471903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:35.475101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb7e01c5-8d83-4c7b-98bb-40d97af6e7fc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.476367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb7e01c5-8d83-4c7b-98bb-40d97af6e7fc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.477409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb7e01c5-8d83-4c7b-98bb-40d97af6e7fc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.478020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb7e01c5-8d83-4c7b-98bb-40d97af6e7fc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.514369 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-bb7e01c5-8d83-4c7b-98bb-40d97af6e7fc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bb7e01c5-8d83-4c7b-98bb-40d97af6e7fc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f/os-volume_attachments HTTP/1.1 Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'server_id': 'ad081e26-4b6d-4baa-8173-83d0118cc42f'} Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:35.529458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:16:35.538318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:35.538318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:35.538318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:35.538318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:35.538318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:35.538318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:35.538318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:35.538318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:35.538318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:16:35.538318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:16:35.538318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bb7e01c5-8d83-4c7b-98bb-40d97af6e7fc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:35.538318 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bb7e01c5-8d83-4c7b-98bb-40d97af6e7fc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.086488 Jul 20 04:16:35.543534 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 828/1752] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:16:35 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f/os-volume_attachments => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:35.553151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-70358122-a75e-4f11-991a-ad6a72caa3db tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:35.554498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-70358122-a75e-4f11-991a-ad6a72caa3db tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:35.572224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-70358122-a75e-4f11-991a-ad6a72caa3db tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.574653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-70358122-a75e-4f11-991a-ad6a72caa3db tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.576305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-70358122-a75e-4f11-991a-ad6a72caa3db tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.580335 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-352fcc63-216b-4c78-82c7-de506b305f76 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1859 microversion: 2.1 time: 0.959640 Jul 20 04:16:35.592521 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 925/1753] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:34 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1859 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:35.595924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-70358122-a75e-4f11-991a-ad6a72caa3db tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.614463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f09865b9-c24c-45e1-ae1d-56cd2e447f44 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d692040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:35.733623 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f09865b9-c24c-45e1-ae1d-56cd2e447f44 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.139841 Jul 20 04:16:35.735792 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 926/1754] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:35 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:35.752439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ede6562e-bd81-437f-950d-3380d4630b7d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:35.777096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ede6562e-bd81-437f-950d-3380d4630b7d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:35.790838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ede6562e-bd81-437f-950d-3380d4630b7d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.791568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ede6562e-bd81-437f-950d-3380d4630b7d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.792550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ede6562e-bd81-437f-950d-3380d4630b7d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.793185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ede6562e-bd81-437f-950d-3380d4630b7d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.898507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ede6562e-bd81-437f-950d-3380d4630b7d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:36.937885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ede6562e-bd81-437f-950d-3380d4630b7d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:36.941795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ede6562e-bd81-437f-950d-3380d4630b7d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:36.949763 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ede6562e-bd81-437f-950d-3380d4630b7d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1361 microversion: 2.25 time: 1.212598 Jul 20 04:16:36.952802 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 927/1755] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:35 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1361 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:36.974181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2bf0c443-5785-46d7-af06-e9f9cf4c810a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:36.975296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2bf0c443-5785-46d7-af06-e9f9cf4c810a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:36.990493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2bf0c443-5785-46d7-af06-e9f9cf4c810a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.990951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2bf0c443-5785-46d7-af06-e9f9cf4c810a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.991764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2bf0c443-5785-46d7-af06-e9f9cf4c810a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.992390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2bf0c443-5785-46d7-af06-e9f9cf4c810a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.061343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-70358122-a75e-4f11-991a-ad6a72caa3db tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:37.083822 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-70358122-a75e-4f11-991a-ad6a72caa3db tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1473 microversion: 2.1 time: 1.538552 Jul 20 04:16:37.084701 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 829/1756] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:35 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1473 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:37.092524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-432556475", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2f1733ae-f5aa-4d8e-b430-1f99c985f6d9"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:37.213500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] validate_networks() for [('2f1733ae-f5aa-4d8e-b430-1f99c985f6d9', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:37.322655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-2bf0c443-5785-46d7-af06-e9f9cf4c810a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lazy-loading 'services' on Instance uuid d0895e78-3e18-4ab2-b966-0561a857536c {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:37.493550 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2bf0c443-5785-46d7-af06-e9f9cf4c810a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments/97c3b8cb-8f7c-4cce-b4f9-3a410fc57135" status: 202 len: 0 microversion: 2.1 time: 0.538352 Jul 20 04:16:37.494826 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 928/1757] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:16:36 2022] DELETE /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments/97c3b8cb-8f7c-4cce-b4f9-3a410fc57135 => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:37.502841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-662470245", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b275a14b-6f9a-4923-9df7-fe7c917887d6"}], "security_groups": [{"name": "tempest-securitygroup--506777496"}], "key_name": "tempest-keypair-1391364140", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:37.948694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] validate_networks() for [('b275a14b-6f9a-4923-9df7-fe7c917887d6', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:39.633635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:39.634191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:39.634945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:39.635555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:39.636155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:39.650543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.652262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.653345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.654242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.702529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:39.712838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for user 793c626644204dc3a08ed9118c9aaf4c and project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:39.729237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:39.732025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:39.807068 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-33785334-06da-4d4f-9e0b-f9e3bcb617f8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.721067 Jul 20 04:16:39.808405 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 830/1758] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:39.814338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e2244f01-a399-46fa-8649-89edd0fcadc7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d591b80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:39.884533 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e2244f01-a399-46fa-8649-89edd0fcadc7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.074787 Jul 20 04:16:39.885863 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 831/1759] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:39 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:39.893138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-41297cb9-d438-4937-b812-72f47ce74e82 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:39.894528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-41297cb9-d438-4937-b812-72f47ce74e82 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:39.901684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41297cb9-d438-4937-b812-72f47ce74e82 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.902461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41297cb9-d438-4937-b812-72f47ce74e82 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.903490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41297cb9-d438-4937-b812-72f47ce74e82 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.908164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41297cb9-d438-4937-b812-72f47ce74e82 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.990611 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-41297cb9-d438-4937-b812-72f47ce74e82 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103359 Jul 20 04:16:39.993533 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 832/1760] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:16:39 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:39.999031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8cd325f6-2cee-4b2b-83e0-a2e06e760c19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:40.000140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8cd325f6-2cee-4b2b-83e0-a2e06e760c19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:40.009310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cd325f6-2cee-4b2b-83e0-a2e06e760c19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.010166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cd325f6-2cee-4b2b-83e0-a2e06e760c19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.011199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cd325f6-2cee-4b2b-83e0-a2e06e760c19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.011917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cd325f6-2cee-4b2b-83e0-a2e06e760c19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.492591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8cd325f6-2cee-4b2b-83e0-a2e06e760c19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:40.510689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8cd325f6-2cee-4b2b-83e0-a2e06e760c19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:40.518045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8cd325f6-2cee-4b2b-83e0-a2e06e760c19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:40.524421 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8cd325f6-2cee-4b2b-83e0-a2e06e760c19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1361 microversion: 2.25 time: 0.525399 Jul 20 04:16:40.525674 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 833/1761] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:39 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1361 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:40.543920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-326675cc-65df-4bde-bdb2-621a22957a11 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:40.548176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-326675cc-65df-4bde-bdb2-621a22957a11 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:40.570089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-326675cc-65df-4bde-bdb2-621a22957a11 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.570558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-326675cc-65df-4bde-bdb2-621a22957a11 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.574538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-326675cc-65df-4bde-bdb2-621a22957a11 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.576562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-326675cc-65df-4bde-bdb2-621a22957a11 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.911495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-326675cc-65df-4bde-bdb2-621a22957a11 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:40.932598 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-326675cc-65df-4bde-bdb2-621a22957a11 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1470 microversion: 2.1 time: 0.402960 Jul 20 04:16:40.933639 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 834/1762] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:40 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1470 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:40.946146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e05c522c-9ab2-45cb-9db7-ffdb0dd4d4cb req-2dc98111-717c-4e4f-bec9-928de1935650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8", "name": "network-vif-plugged", "status": "completed", "tag": "0c831938-16c9-4f5e-8498-ff9d8d9f8c72"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:40.946342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Getting quotas for project f335bb149385457d9ca74e9801e5e4fb. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:40.969107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Getting quotas for user 770247229b22438dba9d29709710ce60 and project f335bb149385457d9ca74e9801e5e4fb. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:40.977632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e05c522c-9ab2-45cb-9db7-ffdb0dd4d4cb req-2dc98111-717c-4e4f-bec9-928de1935650 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.978744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e05c522c-9ab2-45cb-9db7-ffdb0dd4d4cb req-2dc98111-717c-4e4f-bec9-928de1935650 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.013859 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e05c522c-9ab2-45cb-9db7-ffdb0dd4d4cb req-2dc98111-717c-4e4f-bec9-928de1935650 service nova] Creating event network-vif-plugged:0c831938-16c9-4f5e-8498-ff9d8d9f8c72 for instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 on n-h2-764485-11 Jul 20 04:16:41.027911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-e05c522c-9ab2-45cb-9db7-ffdb0dd4d4cb req-2dc98111-717c-4e4f-bec9-928de1935650 service nova] Instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:16:41.053341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:41.053950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:41.054471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:41.059436 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e05c522c-9ab2-45cb-9db7-ffdb0dd4d4cb req-2dc98111-717c-4e4f-bec9-928de1935650 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124465 Jul 20 04:16:41.061003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:41.061699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:41.061847 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 835/1763] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:41.081468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eebc7ca7-a4b5-4b54-93fe-8a8d23ffe1e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:41.082308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eebc7ca7-a4b5-4b54-93fe-8a8d23ffe1e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.091394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.093520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.096984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eebc7ca7-a4b5-4b54-93fe-8a8d23ffe1e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.097575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.098089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.098231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eebc7ca7-a4b5-4b54-93fe-8a8d23ffe1e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.100784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eebc7ca7-a4b5-4b54-93fe-8a8d23ffe1e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.101308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eebc7ca7-a4b5-4b54-93fe-8a8d23ffe1e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.151940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Getting quotas for project f335bb149385457d9ca74e9801e5e4fb. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:41.162705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:41.173917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Getting quotas for user 770247229b22438dba9d29709710ce60 and project f335bb149385457d9ca74e9801e5e4fb. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:41.224096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:41.226945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:41.295081 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b8f34056-c68d-4645-8b7e-61217edd4c5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.798513 Jul 20 04:16:41.296122 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 929/1764] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:37 2022] POST /compute/v2.1/servers => generated 408 bytes in 3800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:41.303003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-23586942-04dd-41c6-a5f4-dfbc783812e1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d182ee0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:41.361193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eebc7ca7-a4b5-4b54-93fe-8a8d23ffe1e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:41.371278 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eebc7ca7-a4b5-4b54-93fe-8a8d23ffe1e1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1210 microversion: 2.1 time: 0.302059 Jul 20 04:16:41.377283 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 836/1765] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:41 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1210 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:41.384833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6ad8cb6d-4e77-4936-9576-0feca663bc87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:41.394591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6ad8cb6d-4e77-4936-9576-0feca663bc87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.405329 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-23586942-04dd-41c6-a5f4-dfbc783812e1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.107482 Jul 20 04:16:41.406378 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 930/1766] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:41 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:41.412203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c7f06e81-cb39-4e7f-a13d-228f0194e8e3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:41.413373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c7f06e81-cb39-4e7f-a13d-228f0194e8e3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.415386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ad8cb6d-4e77-4936-9576-0feca663bc87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.420045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ad8cb6d-4e77-4936-9576-0feca663bc87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.423313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ad8cb6d-4e77-4936-9576-0feca663bc87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.426762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7f06e81-cb39-4e7f-a13d-228f0194e8e3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.427318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7f06e81-cb39-4e7f-a13d-228f0194e8e3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.428183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7f06e81-cb39-4e7f-a13d-228f0194e8e3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.428629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7f06e81-cb39-4e7f-a13d-228f0194e8e3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.429363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ad8cb6d-4e77-4936-9576-0feca663bc87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.471184 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c7f06e81-cb39-4e7f-a13d-228f0194e8e3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063423 Jul 20 04:16:41.472174 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 931/1767] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:16:41 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:41.477794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0ce3254d-1f8d-4af7-a826-b4cfd4c7df5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:41.478412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0ce3254d-1f8d-4af7-a826-b4cfd4c7df5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.614424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0ce3254d-1f8d-4af7-a826-b4cfd4c7df5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:41.630355 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0ce3254d-1f8d-4af7-a826-b4cfd4c7df5c tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1277 microversion: 2.1 time: 0.152588 Jul 20 04:16:41.632402 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 932/1768] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:41 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:41.645439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cb0a3dd2-f15b-4f10-8d80-336589a9e131 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:41.650042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cb0a3dd2-f15b-4f10-8d80-336589a9e131 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.668479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb0a3dd2-f15b-4f10-8d80-336589a9e131 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.670637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb0a3dd2-f15b-4f10-8d80-336589a9e131 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.675193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb0a3dd2-f15b-4f10-8d80-336589a9e131 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.676098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb0a3dd2-f15b-4f10-8d80-336589a9e131 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.729222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cb0a3dd2-f15b-4f10-8d80-336589a9e131 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:41.816983 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6ad8cb6d-4e77-4936-9576-0feca663bc87 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "POST /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8/action" status: 202 len: 0 microversion: 2.1 time: 0.435455 Jul 20 04:16:41.822060 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 837/1769] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:41 2022] POST /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:41.850617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-364b8412-9a3c-4f57-96fb-2e4432e690c5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:41.851496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-364b8412-9a3c-4f57-96fb-2e4432e690c5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.878762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-364b8412-9a3c-4f57-96fb-2e4432e690c5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.879351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-364b8412-9a3c-4f57-96fb-2e4432e690c5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.882511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-364b8412-9a3c-4f57-96fb-2e4432e690c5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.885394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-364b8412-9a3c-4f57-96fb-2e4432e690c5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.921262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:42.097611 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cb0a3dd2-f15b-4f10-8d80-336589a9e131 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 204 len: 0 microversion: 2.1 time: 0.462639 Jul 20 04:16:42.099264 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 933/1770] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:41 2022] DELETE /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:42.105321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8d49790d-aedd-4b15-a743-30bca3c19d9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.111546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8d49790d-aedd-4b15-a743-30bca3c19d9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:42.134130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d49790d-aedd-4b15-a743-30bca3c19d9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.145744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d49790d-aedd-4b15-a743-30bca3c19d9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.149384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d49790d-aedd-4b15-a743-30bca3c19d9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.150419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d49790d-aedd-4b15-a743-30bca3c19d9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.709291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-364b8412-9a3c-4f57-96fb-2e4432e690c5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.730594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-364b8412-9a3c-4f57-96fb-2e4432e690c5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.732753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-364b8412-9a3c-4f57-96fb-2e4432e690c5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.734180 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-364b8412-9a3c-4f57-96fb-2e4432e690c5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1361 microversion: 2.25 time: 0.907819 Jul 20 04:16:42.745628 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 838/1771] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:41 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1361 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:42.753897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f58a4fd-d8c0-4a75-8106-34477c758319 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.764757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0f58a4fd-d8c0-4a75-8106-34477c758319 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:42.779719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f58a4fd-d8c0-4a75-8106-34477c758319 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.780201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f58a4fd-d8c0-4a75-8106-34477c758319 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.785537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f58a4fd-d8c0-4a75-8106-34477c758319 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.786306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f58a4fd-d8c0-4a75-8106-34477c758319 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.811938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8d49790d-aedd-4b15-a743-30bca3c19d9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.824268 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8d49790d-aedd-4b15-a743-30bca3c19d9d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1469 microversion: 2.1 time: 0.723289 Jul 20 04:16:42.837416 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 934/1772] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1469 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:42.858630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bebfe3f0-c0c6-48dc-bd6b-264397887e90 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d140dc0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.942206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0f58a4fd-d8c0-4a75-8106-34477c758319 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.978824 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f58a4fd-d8c0-4a75-8106-34477c758319 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1272 microversion: 2.1 time: 0.228092 Jul 20 04:16:42.982009 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 839/1773] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:43.019063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd313ddd-2405-460c-aea1-2dcd30e20b23 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.021501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cd313ddd-2405-460c-aea1-2dcd30e20b23 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.083500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd313ddd-2405-460c-aea1-2dcd30e20b23 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.084338 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bebfe3f0-c0c6-48dc-bd6b-264397887e90 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.245892 Jul 20 04:16:43.088548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd313ddd-2405-460c-aea1-2dcd30e20b23 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.089317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd313ddd-2405-460c-aea1-2dcd30e20b23 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.089787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd313ddd-2405-460c-aea1-2dcd30e20b23 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.090302 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 935/1774] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:43.104862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-79aedb85-6444-429f-844f-ca4791b89ff3 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.105498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-79aedb85-6444-429f-844f-ca4791b89ff3 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.117941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79aedb85-6444-429f-844f-ca4791b89ff3 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.126195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79aedb85-6444-429f-844f-ca4791b89ff3 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.127404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79aedb85-6444-429f-844f-ca4791b89ff3 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.128066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79aedb85-6444-429f-844f-ca4791b89ff3 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.189488 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd313ddd-2405-460c-aea1-2dcd30e20b23 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206263 Jul 20 04:16:43.190743 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 840/1775] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:43.197459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-2c9d44a5-f638-4158-8216-7ad5b691995a req-0552f71c-976a-4f2e-bf2c-1ab939e52282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe", "name": "network-vif-plugged", "status": "completed", "tag": "44316d0e-ff03-434b-84fc-d22fbc6f7ea6"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:43.208383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2c9d44a5-f638-4158-8216-7ad5b691995a req-0552f71c-976a-4f2e-bf2c-1ab939e52282 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.209313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2c9d44a5-f638-4158-8216-7ad5b691995a req-0552f71c-976a-4f2e-bf2c-1ab939e52282 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.252090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-79aedb85-6444-429f-844f-ca4791b89ff3 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:43.262307 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-2c9d44a5-f638-4158-8216-7ad5b691995a req-0552f71c-976a-4f2e-bf2c-1ab939e52282 service nova] Creating event network-vif-plugged:44316d0e-ff03-434b-84fc-d22fbc6f7ea6 for instance 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe on n-h1-764485-11 Jul 20 04:16:43.265344 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-79aedb85-6444-429f-844f-ca4791b89ff3 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1273 microversion: 2.1 time: 0.169136 Jul 20 04:16:43.266659 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 936/1776] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:43.271470 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-2c9d44a5-f638-4158-8216-7ad5b691995a req-0552f71c-976a-4f2e-bf2c-1ab939e52282 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078267 Jul 20 04:16:43.273300 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 841/1777] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:43.753357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3dbdb07a-cdbe-47e4-bc77-ccc7fb3fa72d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.753599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3dbdb07a-cdbe-47e4-bc77-ccc7fb3fa72d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.765778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3dbdb07a-cdbe-47e4-bc77-ccc7fb3fa72d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.766472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3dbdb07a-cdbe-47e4-bc77-ccc7fb3fa72d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.768078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3dbdb07a-cdbe-47e4-bc77-ccc7fb3fa72d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.769084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3dbdb07a-cdbe-47e4-bc77-ccc7fb3fa72d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.845836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-26906cf7-29a9-4131-8a10-0e2e8f7c114a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.846791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-26906cf7-29a9-4131-8a10-0e2e8f7c114a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.866969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26906cf7-29a9-4131-8a10-0e2e8f7c114a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.879992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26906cf7-29a9-4131-8a10-0e2e8f7c114a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.883541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26906cf7-29a9-4131-8a10-0e2e8f7c114a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.886016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26906cf7-29a9-4131-8a10-0e2e8f7c114a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.385861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-26906cf7-29a9-4131-8a10-0e2e8f7c114a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.395485 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-26906cf7-29a9-4131-8a10-0e2e8f7c114a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1469 microversion: 2.1 time: 0.554784 Jul 20 04:16:44.407799 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 842/1778] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1469 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:44.412943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ab83aee5-ed4b-49c4-a251-c020caa75847 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.416343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ab83aee5-ed4b-49c4-a251-c020caa75847 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.429131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab83aee5-ed4b-49c4-a251-c020caa75847 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.430025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab83aee5-ed4b-49c4-a251-c020caa75847 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.431081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab83aee5-ed4b-49c4-a251-c020caa75847 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.439928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3dbdb07a-cdbe-47e4-bc77-ccc7fb3fa72d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.441148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab83aee5-ed4b-49c4-a251-c020caa75847 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.449564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3dbdb07a-cdbe-47e4-bc77-ccc7fb3fa72d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.452197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3dbdb07a-cdbe-47e4-bc77-ccc7fb3fa72d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.473103 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3dbdb07a-cdbe-47e4-bc77-ccc7fb3fa72d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1361 microversion: 2.25 time: 0.724796 Jul 20 04:16:44.480329 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 937/1779] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1361 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:44.486215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c1e09ead-b478-424e-8b4d-1d11a55b64a4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d154ee0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.623423 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c1e09ead-b478-424e-8b4d-1d11a55b64a4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.141568 Jul 20 04:16:44.632839 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 938/1780] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:44.649077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b7e98ac3-79c3-450a-96e2-339957d31e97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.653036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b7e98ac3-79c3-450a-96e2-339957d31e97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.686815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7e98ac3-79c3-450a-96e2-339957d31e97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.689582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7e98ac3-79c3-450a-96e2-339957d31e97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.692427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7e98ac3-79c3-450a-96e2-339957d31e97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.694515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7e98ac3-79c3-450a-96e2-339957d31e97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.778720 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b7e98ac3-79c3-450a-96e2-339957d31e97 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144413 Jul 20 04:16:44.786566 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 939/1781] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:44.798111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-77bd4857-0201-4422-9bd6-27a3d995e80e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.798827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-77bd4857-0201-4422-9bd6-27a3d995e80e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.818185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-77bd4857-0201-4422-9bd6-27a3d995e80e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.818650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-77bd4857-0201-4422-9bd6-27a3d995e80e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.821110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-77bd4857-0201-4422-9bd6-27a3d995e80e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.821847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-77bd4857-0201-4422-9bd6-27a3d995e80e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.027403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ab83aee5-ed4b-49c4-a251-c020caa75847 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.043470 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ab83aee5-ed4b-49c4-a251-c020caa75847 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1314 microversion: 2.1 time: 0.634205 Jul 20 04:16:45.059627 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 843/1782] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:45.065495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-77bd4857-0201-4422-9bd6-27a3d995e80e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.082496 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-77bd4857-0201-4422-9bd6-27a3d995e80e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1335 microversion: 2.1 time: 0.293705 Jul 20 04:16:45.085264 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 940/1783] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1335 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:45.419031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-75ad4598-6f76-4546-a80c-3120bca5bfee tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.421007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-75ad4598-6f76-4546-a80c-3120bca5bfee tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:45.435095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75ad4598-6f76-4546-a80c-3120bca5bfee tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.435892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75ad4598-6f76-4546-a80c-3120bca5bfee tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.437028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75ad4598-6f76-4546-a80c-3120bca5bfee tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.437721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75ad4598-6f76-4546-a80c-3120bca5bfee tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.497913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d762da78-66d2-4609-ba85-c3e5b67ba683 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.498686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d762da78-66d2-4609-ba85-c3e5b67ba683 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:45.511093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d762da78-66d2-4609-ba85-c3e5b67ba683 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.511735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d762da78-66d2-4609-ba85-c3e5b67ba683 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.516981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d762da78-66d2-4609-ba85-c3e5b67ba683 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.524085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d762da78-66d2-4609-ba85-c3e5b67ba683 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.800418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-75ad4598-6f76-4546-a80c-3120bca5bfee tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.814936 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-75ad4598-6f76-4546-a80c-3120bca5bfee tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1469 microversion: 2.1 time: 0.401209 Jul 20 04:16:45.815902 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 844/1784] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1469 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:45.832209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0088dbad-5494-42b4-b685-ed8bbb69b390 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d401ca0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.852226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d762da78-66d2-4609-ba85-c3e5b67ba683 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.871174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d762da78-66d2-4609-ba85-c3e5b67ba683 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.873033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d762da78-66d2-4609-ba85-c3e5b67ba683 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.874430 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d762da78-66d2-4609-ba85-c3e5b67ba683 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1557 microversion: 2.25 time: 0.380967 Jul 20 04:16:45.879758 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 941/1785] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1557 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:16:45.883463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a3223f2-e982-4e2b-b3d0-cce0760f13bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.892730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a3223f2-e982-4e2b-b3d0-cce0760f13bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:45.898938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a3223f2-e982-4e2b-b3d0-cce0760f13bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.899398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a3223f2-e982-4e2b-b3d0-cce0760f13bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.900233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a3223f2-e982-4e2b-b3d0-cce0760f13bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.900675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a3223f2-e982-4e2b-b3d0-cce0760f13bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.902738 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0088dbad-5494-42b4-b685-ed8bbb69b390 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.083760 Jul 20 04:16:45.906469 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 845/1786] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:45.982725 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a3223f2-e982-4e2b-b3d0-cce0760f13bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105697 Jul 20 04:16:45.989708 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 942/1787] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:46.066699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9145314-18b9-4cd0-bb16-ba3b61ac5e61 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.067654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a9145314-18b9-4cd0-bb16-ba3b61ac5e61 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:46.080306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9145314-18b9-4cd0-bb16-ba3b61ac5e61 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.086205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9145314-18b9-4cd0-bb16-ba3b61ac5e61 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.087216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9145314-18b9-4cd0-bb16-ba3b61ac5e61 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.095368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9145314-18b9-4cd0-bb16-ba3b61ac5e61 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.282168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-125c8967-0e4e-471f-b226-33b94cbe1a1b tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.283409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-125c8967-0e4e-471f-b226-33b94cbe1a1b tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:46.307396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-125c8967-0e4e-471f-b226-33b94cbe1a1b tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.315678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-125c8967-0e4e-471f-b226-33b94cbe1a1b tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.317443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-125c8967-0e4e-471f-b226-33b94cbe1a1b tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.318075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-125c8967-0e4e-471f-b226-33b94cbe1a1b tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.405666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9145314-18b9-4cd0-bb16-ba3b61ac5e61 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:46.418226 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a9145314-18b9-4cd0-bb16-ba3b61ac5e61 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1314 microversion: 2.1 time: 0.356922 Jul 20 04:16:46.421888 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 943/1788] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:46.432428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eb4191ec-6050-403e-abab-1388e39fc828 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.436325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eb4191ec-6050-403e-abab-1388e39fc828 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:46.456345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb4191ec-6050-403e-abab-1388e39fc828 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.457338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb4191ec-6050-403e-abab-1388e39fc828 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.458385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb4191ec-6050-403e-abab-1388e39fc828 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.460790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb4191ec-6050-403e-abab-1388e39fc828 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.933603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-eb4191ec-6050-403e-abab-1388e39fc828 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:46.951391 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eb4191ec-6050-403e-abab-1388e39fc828 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1402 microversion: 2.1 time: 0.520954 Jul 20 04:16:46.972100 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 944/1789] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1402 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:46.997970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aa035451-2da8-4e36-ae7c-0fe394820868 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.004237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aa035451-2da8-4e36-ae7c-0fe394820868 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.022452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:47.028390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa035451-2da8-4e36-ae7c-0fe394820868 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.029109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa035451-2da8-4e36-ae7c-0fe394820868 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.042817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa035451-2da8-4e36-ae7c-0fe394820868 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.043272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa035451-2da8-4e36-ae7c-0fe394820868 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.067799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-125c8967-0e4e-471f-b226-33b94cbe1a1b tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:47.270647 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-125c8967-0e4e-471f-b226-33b94cbe1a1b tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 2051 microversion: 2.25 time: 1.362835 Jul 20 04:16:47.271590 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 846/1790] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 2051 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:47.277531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4d0ab332-37a7-422f-8536-1923333fe194 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d465ee0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.393298 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4d0ab332-37a7-422f-8536-1923333fe194 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1410 microversion: 2.1 time: 0.120400 Jul 20 04:16:47.395390 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 847/1791] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1410 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:47.407161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e96f65b3-c23b-447d-9043-2547a76b2e2a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.413745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e96f65b3-c23b-447d-9043-2547a76b2e2a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.441683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e96f65b3-c23b-447d-9043-2547a76b2e2a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.442412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e96f65b3-c23b-447d-9043-2547a76b2e2a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.443379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e96f65b3-c23b-447d-9043-2547a76b2e2a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.444185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e96f65b3-c23b-447d-9043-2547a76b2e2a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.555178 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e96f65b3-c23b-447d-9043-2547a76b2e2a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.158100 Jul 20 04:16:47.557294 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 848/1792] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:16:47.581464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f1fd7fce-2908-4b68-8d3f-914aee6fe8ea tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.582169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f1fd7fce-2908-4b68-8d3f-914aee6fe8ea tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.604781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1fd7fce-2908-4b68-8d3f-914aee6fe8ea tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.606733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1fd7fce-2908-4b68-8d3f-914aee6fe8ea tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.607597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1fd7fce-2908-4b68-8d3f-914aee6fe8ea tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.610666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1fd7fce-2908-4b68-8d3f-914aee6fe8ea tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.650866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aa035451-2da8-4e36-ae7c-0fe394820868 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:47.661764 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aa035451-2da8-4e36-ae7c-0fe394820868 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1469 microversion: 2.1 time: 0.686469 Jul 20 04:16:47.664234 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 945/1793] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1469 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:47.679759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cf51f9cb-82eb-460e-bd69-e41f4ec91579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.680437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cf51f9cb-82eb-460e-bd69-e41f4ec91579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.736735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf51f9cb-82eb-460e-bd69-e41f4ec91579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.740700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf51f9cb-82eb-460e-bd69-e41f4ec91579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.741736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf51f9cb-82eb-460e-bd69-e41f4ec91579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.743791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf51f9cb-82eb-460e-bd69-e41f4ec91579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.667872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cf51f9cb-82eb-460e-bd69-e41f4ec91579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:48.679444 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cf51f9cb-82eb-460e-bd69-e41f4ec91579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1314 microversion: 2.1 time: 1.007273 Jul 20 04:16:48.680381 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 946/1794] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1314 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:48.686524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-43bf9d65-b344-4345-85a4-4d353d0f2a78 req-148e80ce-64c1-46a5-9648-c21bf879f6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6460f29d-e3f7-4f4d-95e1-a374af5864c3", "tag": "05c8c052-daed-4646-9e5e-31c92143b2d3"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:48.698172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-43bf9d65-b344-4345-85a4-4d353d0f2a78 req-148e80ce-64c1-46a5-9648-c21bf879f6e4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.699478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-43bf9d65-b344-4345-85a4-4d353d0f2a78 req-148e80ce-64c1-46a5-9648-c21bf879f6e4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.708739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-f1fd7fce-2908-4b68-8d3f-914aee6fe8ea tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:48.719156 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-43bf9d65-b344-4345-85a4-4d353d0f2a78 req-148e80ce-64c1-46a5-9648-c21bf879f6e4 service nova] Creating event network-changed:05c8c052-daed-4646-9e5e-31c92143b2d3 for instance 6460f29d-e3f7-4f4d-95e1-a374af5864c3 on n-h2-764485-11 Jul 20 04:16:48.724867 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-43bf9d65-b344-4345-85a4-4d353d0f2a78 req-148e80ce-64c1-46a5-9648-c21bf879f6e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043027 Jul 20 04:16:48.726136 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 947/1795] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:48.728542 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f1fd7fce-2908-4b68-8d3f-914aee6fe8ea tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 2051 microversion: 2.25 time: 1.169690 Jul 20 04:16:48.739537 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 849/1796] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 2051 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:48.739537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7dd46dc8-b828-42a0-a5a1-71bbfa21f03f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9dd7f4c0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.754362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8516f2d5-ee53-4f8d-bd52-2eafeff691d1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.755088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8516f2d5-ee53-4f8d-bd52-2eafeff691d1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:48.763916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8516f2d5-ee53-4f8d-bd52-2eafeff691d1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.764363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8516f2d5-ee53-4f8d-bd52-2eafeff691d1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.765600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8516f2d5-ee53-4f8d-bd52-2eafeff691d1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.766414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8516f2d5-ee53-4f8d-bd52-2eafeff691d1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.795817 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7dd46dc8-b828-42a0-a5a1-71bbfa21f03f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1419 microversion: 2.1 time: 0.065031 Jul 20 04:16:48.797623 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 850/1797] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:48 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1419 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:48.803011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08d29bb0-402f-4b1e-89f9-7c1d25f506bd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.804976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-08d29bb0-402f-4b1e-89f9-7c1d25f506bd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:48.814378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08d29bb0-402f-4b1e-89f9-7c1d25f506bd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.815318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08d29bb0-402f-4b1e-89f9-7c1d25f506bd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.816631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08d29bb0-402f-4b1e-89f9-7c1d25f506bd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.817471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08d29bb0-402f-4b1e-89f9-7c1d25f506bd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.356056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8516f2d5-ee53-4f8d-bd52-2eafeff691d1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.376369 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8516f2d5-ee53-4f8d-bd52-2eafeff691d1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1402 microversion: 2.1 time: 0.647022 Jul 20 04:16:49.376968 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 948/1798] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:48 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1402 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:49.392102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1071b46f-f04f-4c3a-b5d3-c84d79b78d9a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:49.395791 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:16:49.395791 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:16:49.397863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1071b46f-f04f-4c3a-b5d3-c84d79b78d9a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.398410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1071b46f-f04f-4c3a-b5d3-c84d79b78d9a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.399254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1071b46f-f04f-4c3a-b5d3-c84d79b78d9a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.399729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1071b46f-f04f-4c3a-b5d3-c84d79b78d9a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.431944 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1071b46f-f04f-4c3a-b5d3-c84d79b78d9a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.047244 Jul 20 04:16:49.432750 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 949/1799] 10.222.0.20 () {60 vars in 1216 bytes} [Wed Jul 20 04:16:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:49.433031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-08d29bb0-402f-4b1e-89f9-7c1d25f506bd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.441744 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-08d29bb0-402f-4b1e-89f9-7c1d25f506bd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1469 microversion: 2.1 time: 0.642660 Jul 20 04:16:49.447823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8827f86d-093c-4675-8a5b-3d958f104bbf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d1543a0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:49.456661 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 851/1800] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:48 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1469 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:49.461549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3ad9ddd3-3549-4044-9d35-6d99fb310229 req-e145a5b3-4312-4bf7-a916-74bcacee0bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e1f3708-823c-49ca-8327-bfdd82211149", "tag": "54945e39-8427-4f57-9c15-e67b3e02d8f0"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:49.480245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3ad9ddd3-3549-4044-9d35-6d99fb310229 req-e145a5b3-4312-4bf7-a916-74bcacee0bc7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.480932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3ad9ddd3-3549-4044-9d35-6d99fb310229 req-e145a5b3-4312-4bf7-a916-74bcacee0bc7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.497025 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3ad9ddd3-3549-4044-9d35-6d99fb310229 req-e145a5b3-4312-4bf7-a916-74bcacee0bc7 service nova] Creating event network-changed:54945e39-8427-4f57-9c15-e67b3e02d8f0 for instance 1e1f3708-823c-49ca-8327-bfdd82211149 on n-h2-764485-11 Jul 20 04:16:49.503068 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3ad9ddd3-3549-4044-9d35-6d99fb310229 req-e145a5b3-4312-4bf7-a916-74bcacee0bc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045035 Jul 20 04:16:49.504364 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 852/1801] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:49.510078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a7ef719-0f3a-4773-82d3-6828d562d100 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-764485-11", "block_migration": "auto"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:49.511952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a7ef719-0f3a-4773-82d3-6828d562d100 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:49.519762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a7ef719-0f3a-4773-82d3-6828d562d100 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.520472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a7ef719-0f3a-4773-82d3-6828d562d100 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.521426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a7ef719-0f3a-4773-82d3-6828d562d100 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.522028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a7ef719-0f3a-4773-82d3-6828d562d100 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.534351 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8827f86d-093c-4675-8a5b-3d958f104bbf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 200 len: 1419 microversion: 2.1 time: 0.097617 Jul 20 04:16:49.541791 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 950/1802] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:49 2022] GET /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 1419 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:49.547223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e3c81f4a-4b74-47be-a67f-22453beecb16 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d140790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:49.552620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-0a7ef719-0f3a-4773-82d3-6828d562d100 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'flavor' on Instance uuid 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:49.567175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a7ef719-0f3a-4773-82d3-6828d562d100 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Going to try to live migrate instance to n-h2-764485-11 {{(pid=119807) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:16:49.619931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:49.671153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:49.723139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:50.620629 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e3c81f4a-4b74-47be-a67f-22453beecb16 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 204 len: 0 microversion: 2.1 time: 1.077302 Jul 20 04:16:50.621647 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 951/1803] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:49 2022] DELETE /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:50.630153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a984c01c-55b8-4ecd-8380-c987bac98359 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.631267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a984c01c-55b8-4ecd-8380-c987bac98359 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:50.647672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a984c01c-55b8-4ecd-8380-c987bac98359 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.649452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a984c01c-55b8-4ecd-8380-c987bac98359 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.654210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a984c01c-55b8-4ecd-8380-c987bac98359 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.654887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a984c01c-55b8-4ecd-8380-c987bac98359 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.223205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a984c01c-55b8-4ecd-8380-c987bac98359 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.236810 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a984c01c-55b8-4ecd-8380-c987bac98359 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1314 microversion: 2.1 time: 0.610732 Jul 20 04:16:51.247909 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 952/1804] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:50 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:51.255693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-789e34af-981d-4aa4-887e-001766a76bc1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.256607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-789e34af-981d-4aa4-887e-001766a76bc1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:51.278673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-789e34af-981d-4aa4-887e-001766a76bc1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.279335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-789e34af-981d-4aa4-887e-001766a76bc1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.280233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-789e34af-981d-4aa4-887e-001766a76bc1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.280743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-789e34af-981d-4aa4-887e-001766a76bc1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.620979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=12 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:51.803372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-789e34af-981d-4aa4-887e-001766a76bc1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.818205 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-789e34af-981d-4aa4-887e-001766a76bc1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1402 microversion: 2.1 time: 0.564670 Jul 20 04:16:51.819821 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 953/1805] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1402 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:51.833489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88c8bdb3-0a01-4b7f-8796-fd2547b9428c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.835525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88c8bdb3-0a01-4b7f-8796-fd2547b9428c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:51.854461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88c8bdb3-0a01-4b7f-8796-fd2547b9428c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.855538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88c8bdb3-0a01-4b7f-8796-fd2547b9428c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.859495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88c8bdb3-0a01-4b7f-8796-fd2547b9428c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.860398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88c8bdb3-0a01-4b7f-8796-fd2547b9428c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.909014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:52.290151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88c8bdb3-0a01-4b7f-8796-fd2547b9428c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.304369 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88c8bdb3-0a01-4b7f-8796-fd2547b9428c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1469 microversion: 2.1 time: 0.476788 Jul 20 04:16:52.305803 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 954/1806] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1469 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.310734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fc65d889-7b5e-44d8-8f1e-39a165e29b04 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.311229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fc65d889-7b5e-44d8-8f1e-39a165e29b04 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:52.334553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc65d889-7b5e-44d8-8f1e-39a165e29b04 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.335660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc65d889-7b5e-44d8-8f1e-39a165e29b04 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.336639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc65d889-7b5e-44d8-8f1e-39a165e29b04 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.337249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc65d889-7b5e-44d8-8f1e-39a165e29b04 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.392929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fc65d889-7b5e-44d8-8f1e-39a165e29b04 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:52.540677 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fc65d889-7b5e-44d8-8f1e-39a165e29b04 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 204 len: 0 microversion: 2.1 time: 0.231278 Jul 20 04:16:52.541320 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 955/1807] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:52 2022] DELETE /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:52.548393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6acb5645-70e9-4f1d-86e1-386a83466a68 req-d53bfd40-e459-4d58-84b0-62345e84150f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8", "name": "network-vif-unplugged", "status": "completed", "tag": "0c831938-16c9-4f5e-8498-ff9d8d9f8c72"}, {"name": "network-changed", "server_uuid": "14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8", "tag": "0c831938-16c9-4f5e-8498-ff9d8d9f8c72"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:52.558225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6acb5645-70e9-4f1d-86e1-386a83466a68 req-d53bfd40-e459-4d58-84b0-62345e84150f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.558937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6acb5645-70e9-4f1d-86e1-386a83466a68 req-d53bfd40-e459-4d58-84b0-62345e84150f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.583945 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6acb5645-70e9-4f1d-86e1-386a83466a68 req-d53bfd40-e459-4d58-84b0-62345e84150f service nova] Creating event network-vif-unplugged:0c831938-16c9-4f5e-8498-ff9d8d9f8c72 for instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 on n-h1-764485-11 Jul 20 04:16:52.585522 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6acb5645-70e9-4f1d-86e1-386a83466a68 req-d53bfd40-e459-4d58-84b0-62345e84150f service nova] Creating event network-changed:0c831938-16c9-4f5e-8498-ff9d8d9f8c72 for instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 on n-h1-764485-11 Jul 20 04:16:52.593982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-6acb5645-70e9-4f1d-86e1-386a83466a68 req-d53bfd40-e459-4d58-84b0-62345e84150f service nova] Instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:16:52.608001 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6acb5645-70e9-4f1d-86e1-386a83466a68 req-d53bfd40-e459-4d58-84b0-62345e84150f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.065214 Jul 20 04:16:52.609582 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 956/1808] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:52.616516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ed4c0050-e2c2-4bdb-923f-f9bd56a89ca7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.617488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ed4c0050-e2c2-4bdb-923f-f9bd56a89ca7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:52.625436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed4c0050-e2c2-4bdb-923f-f9bd56a89ca7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.626596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed4c0050-e2c2-4bdb-923f-f9bd56a89ca7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.628481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed4c0050-e2c2-4bdb-923f-f9bd56a89ca7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.629180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed4c0050-e2c2-4bdb-923f-f9bd56a89ca7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.807547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ed4c0050-e2c2-4bdb-923f-f9bd56a89ca7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.817919 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ed4c0050-e2c2-4bdb-923f-f9bd56a89ca7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1314 microversion: 2.1 time: 0.206654 Jul 20 04:16:52.827192 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 957/1809] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.827192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-13404964", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "d9fe07a4-2a16-4e79-9ad2-c5078d0d5312"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:52.913670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] validate_networks() for [('d9fe07a4-2a16-4e79-9ad2-c5078d0d5312', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:53.044807 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a7ef719-0f3a-4773-82d3-6828d562d100 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe/action" status: 202 len: 0 microversion: 2.25 time: 3.538975 Jul 20 04:16:53.047419 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 853/1810] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:16:49 2022] POST /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe/action => generated 0 bytes in 3542 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:53.055671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-257c9bf5-a139-4fcc-8e8b-d9e32d3e13d0 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.056678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-257c9bf5-a139-4fcc-8e8b-d9e32d3e13d0 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.067207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-257c9bf5-a139-4fcc-8e8b-d9e32d3e13d0 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.069420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-257c9bf5-a139-4fcc-8e8b-d9e32d3e13d0 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.070408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-257c9bf5-a139-4fcc-8e8b-d9e32d3e13d0 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.074167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-257c9bf5-a139-4fcc-8e8b-d9e32d3e13d0 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.496696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-257c9bf5-a139-4fcc-8e8b-d9e32d3e13d0 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.509694 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-257c9bf5-a139-4fcc-8e8b-d9e32d3e13d0 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1402 microversion: 2.1 time: 0.459965 Jul 20 04:16:53.511244 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 854/1811] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1402 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:53.525929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dedf0622-182f-41ef-8df4-f8c09a7616a4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.528475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dedf0622-182f-41ef-8df4-f8c09a7616a4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.545662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dedf0622-182f-41ef-8df4-f8c09a7616a4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.549571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dedf0622-182f-41ef-8df4-f8c09a7616a4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.558896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dedf0622-182f-41ef-8df4-f8c09a7616a4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.560405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dedf0622-182f-41ef-8df4-f8c09a7616a4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.595313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:53.596407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:53.597583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:53.598192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:53.598943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:53.612430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.613193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.614183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.614807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.661193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Getting quotas for project 6d23a8eadfd74e358d917b9aa3b85bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:53.677883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Getting quotas for user 0d1edf9dfed144d8875968ffd5f9ad91 and project 6d23a8eadfd74e358d917b9aa3b85bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:53.717329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:53.722783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:53.813791 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-099ec594-3bfa-49ce-91bd-323f89209569 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991671 Jul 20 04:16:53.820689 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 958/1812] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:53.837504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-94a9c492-b78a-46bc-91a0-7d9a575279fd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.839279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-94a9c492-b78a-46bc-91a0-7d9a575279fd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.854464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94a9c492-b78a-46bc-91a0-7d9a575279fd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.858692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94a9c492-b78a-46bc-91a0-7d9a575279fd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.859703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94a9c492-b78a-46bc-91a0-7d9a575279fd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.861025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94a9c492-b78a-46bc-91a0-7d9a575279fd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.893585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dedf0622-182f-41ef-8df4-f8c09a7616a4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.910906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dedf0622-182f-41ef-8df4-f8c09a7616a4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.918344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dedf0622-182f-41ef-8df4-f8c09a7616a4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.921524 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dedf0622-182f-41ef-8df4-f8c09a7616a4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 0.407989 Jul 20 04:16:53.927113 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 855/1813] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:53.954151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b32ccbb7-3fa8-4444-a6e8-9f41956705d7 req-317fa561-fee7-42bb-a0ad-7d1fdc245e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6460f29d-e3f7-4f4d-95e1-a374af5864c3", "name": "network-vif-plugged", "status": "completed", "tag": "05c8c052-daed-4646-9e5e-31c92143b2d3"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:53.972697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b32ccbb7-3fa8-4444-a6e8-9f41956705d7 req-317fa561-fee7-42bb-a0ad-7d1fdc245e22 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.974638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b32ccbb7-3fa8-4444-a6e8-9f41956705d7 req-317fa561-fee7-42bb-a0ad-7d1fdc245e22 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.020685 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b32ccbb7-3fa8-4444-a6e8-9f41956705d7 req-317fa561-fee7-42bb-a0ad-7d1fdc245e22 service nova] Creating event network-vif-plugged:05c8c052-daed-4646-9e5e-31c92143b2d3 for instance 6460f29d-e3f7-4f4d-95e1-a374af5864c3 on n-h2-764485-11 Jul 20 04:16:54.034118 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b32ccbb7-3fa8-4444-a6e8-9f41956705d7 req-317fa561-fee7-42bb-a0ad-7d1fdc245e22 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104782 Jul 20 04:16:54.034614 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 856/1814] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:54.048800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-41788910-6fae-494c-97cc-ca20e0414b55 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.061675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-41788910-6fae-494c-97cc-ca20e0414b55 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.293046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-41788910-6fae-494c-97cc-ca20e0414b55 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.304478 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-41788910-6fae-494c-97cc-ca20e0414b55 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1206 microversion: 2.1 time: 0.266193 Jul 20 04:16:54.305339 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 857/1815] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1206 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:54.317746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5633003-ed3c-423d-9997-1038a03a520a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.322148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c5633003-ed3c-423d-9997-1038a03a520a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.335895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5633003-ed3c-423d-9997-1038a03a520a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.338178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5633003-ed3c-423d-9997-1038a03a520a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.345220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5633003-ed3c-423d-9997-1038a03a520a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.345930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5633003-ed3c-423d-9997-1038a03a520a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.548595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94a9c492-b78a-46bc-91a0-7d9a575279fd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.560016 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-94a9c492-b78a-46bc-91a0-7d9a575279fd tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1469 microversion: 2.1 time: 0.743081 Jul 20 04:16:54.569458 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 959/1816] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1469 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:54.592031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1c00071c-eff7-4305-a26f-2c928efc1cb7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.592657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1c00071c-eff7-4305-a26f-2c928efc1cb7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.659802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c00071c-eff7-4305-a26f-2c928efc1cb7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.660320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c00071c-eff7-4305-a26f-2c928efc1cb7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.661153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c00071c-eff7-4305-a26f-2c928efc1cb7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.661597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c00071c-eff7-4305-a26f-2c928efc1cb7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.508056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1c00071c-eff7-4305-a26f-2c928efc1cb7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:55.516997 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1c00071c-eff7-4305-a26f-2c928efc1cb7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1402 microversion: 2.1 time: 0.936379 Jul 20 04:16:55.521729 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 960/1817] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1402 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:55.525517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c5633003-ed3c-423d-9997-1038a03a520a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:55.529200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b62ad951-1cdf-4ce0-b72e-9a626118d65c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:55.529817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b62ad951-1cdf-4ce0-b72e-9a626118d65c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:55.551401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b62ad951-1cdf-4ce0-b72e-9a626118d65c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.551894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b62ad951-1cdf-4ce0-b72e-9a626118d65c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.552777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b62ad951-1cdf-4ce0-b72e-9a626118d65c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.553287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b62ad951-1cdf-4ce0-b72e-9a626118d65c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.560970 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5633003-ed3c-423d-9997-1038a03a520a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1314 microversion: 2.1 time: 1.245274 Jul 20 04:16:55.564462 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 858/1818] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1314 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:55.578012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33b7067c-c03c-40d7-af17-ca61e7cf2956 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:55.580735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-33b7067c-c03c-40d7-af17-ca61e7cf2956 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:55.606472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33b7067c-c03c-40d7-af17-ca61e7cf2956 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.607155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33b7067c-c03c-40d7-af17-ca61e7cf2956 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.609587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33b7067c-c03c-40d7-af17-ca61e7cf2956 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.610584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33b7067c-c03c-40d7-af17-ca61e7cf2956 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.131647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-33b7067c-c03c-40d7-af17-ca61e7cf2956 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.143984 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-33b7067c-c03c-40d7-af17-ca61e7cf2956 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1258 microversion: 2.1 time: 0.577826 Jul 20 04:16:56.144601 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 859/1819] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:55 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1258 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:56.157822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dfcb6fd4-f3d2-4551-9e4c-8693e6170ba5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.158458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dfcb6fd4-f3d2-4551-9e4c-8693e6170ba5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:56.177588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dfcb6fd4-f3d2-4551-9e4c-8693e6170ba5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.182024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dfcb6fd4-f3d2-4551-9e4c-8693e6170ba5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.185689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dfcb6fd4-f3d2-4551-9e4c-8693e6170ba5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.188062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dfcb6fd4-f3d2-4551-9e4c-8693e6170ba5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.370350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b62ad951-1cdf-4ce0-b72e-9a626118d65c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.380807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b62ad951-1cdf-4ce0-b72e-9a626118d65c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.382807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b62ad951-1cdf-4ce0-b72e-9a626118d65c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.384422 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b62ad951-1cdf-4ce0-b72e-9a626118d65c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 0.861547 Jul 20 04:16:56.385495 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 961/1820] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:55 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:56.390393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-11b6eb1f-2ba4-49d3-a715-51d32c9ae3e1 req-efab13fa-3311-43ec-82e3-fcf85dd4db25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c0c327-39d3-44cf-8598-b6dcb35a2fbf", "name": "network-vif-unplugged", "status": "completed", "tag": "97dd8aca-c919-4caf-a0ef-649a0381d912"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:56.404703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-11b6eb1f-2ba4-49d3-a715-51d32c9ae3e1 req-efab13fa-3311-43ec-82e3-fcf85dd4db25 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.405144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-11b6eb1f-2ba4-49d3-a715-51d32c9ae3e1 req-efab13fa-3311-43ec-82e3-fcf85dd4db25 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.436849 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-11b6eb1f-2ba4-49d3-a715-51d32c9ae3e1 req-efab13fa-3311-43ec-82e3-fcf85dd4db25 service nova] Creating event network-vif-unplugged:97dd8aca-c919-4caf-a0ef-649a0381d912 for instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf on n-h2-764485-11 Jul 20 04:16:56.446266 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-11b6eb1f-2ba4-49d3-a715-51d32c9ae3e1 req-efab13fa-3311-43ec-82e3-fcf85dd4db25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057553 Jul 20 04:16:56.447147 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 962/1821] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:56.542492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8e1f15ad-07be-4ba2-a705-af3d40124dfd tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.543875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8e1f15ad-07be-4ba2-a705-af3d40124dfd tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:56.557959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e1f15ad-07be-4ba2-a705-af3d40124dfd tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.558412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e1f15ad-07be-4ba2-a705-af3d40124dfd tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.559216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e1f15ad-07be-4ba2-a705-af3d40124dfd tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.559687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e1f15ad-07be-4ba2-a705-af3d40124dfd tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.759633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dfcb6fd4-f3d2-4551-9e4c-8693e6170ba5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.770552 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dfcb6fd4-f3d2-4551-9e4c-8693e6170ba5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1462 microversion: 2.1 time: 0.624882 Jul 20 04:16:56.784719 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 860/1822] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1462 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:56.790167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-36b66f08-3d47-4e35-a7e7-d6da511006ee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.791080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-36b66f08-3d47-4e35-a7e7-d6da511006ee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:56.798723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-36b66f08-3d47-4e35-a7e7-d6da511006ee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.799461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-36b66f08-3d47-4e35-a7e7-d6da511006ee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.800458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-36b66f08-3d47-4e35-a7e7-d6da511006ee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.801078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-36b66f08-3d47-4e35-a7e7-d6da511006ee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.173267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8e1f15ad-07be-4ba2-a705-af3d40124dfd tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.185706 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8e1f15ad-07be-4ba2-a705-af3d40124dfd tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1402 microversion: 2.1 time: 0.647427 Jul 20 04:16:57.200251 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 963/1823] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1402 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:57.412997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-36b66f08-3d47-4e35-a7e7-d6da511006ee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.428352 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-36b66f08-3d47-4e35-a7e7-d6da511006ee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1314 microversion: 2.1 time: 0.641955 Jul 20 04:16:57.429757 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 861/1824] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:57.434771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f1cb77a0-4397-4d0d-bd6d-3e567b87c301 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.442003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f1cb77a0-4397-4d0d-bd6d-3e567b87c301 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.462203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1cb77a0-4397-4d0d-bd6d-3e567b87c301 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.462916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1cb77a0-4397-4d0d-bd6d-3e567b87c301 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.463982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1cb77a0-4397-4d0d-bd6d-3e567b87c301 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.464624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1cb77a0-4397-4d0d-bd6d-3e567b87c301 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.476347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-918561a2-bb9c-43c3-9912-491548b29007 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.477213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-918561a2-bb9c-43c3-9912-491548b29007 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.490974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-918561a2-bb9c-43c3-9912-491548b29007 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.492399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-918561a2-bb9c-43c3-9912-491548b29007 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.493971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-918561a2-bb9c-43c3-9912-491548b29007 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.495140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-918561a2-bb9c-43c3-9912-491548b29007 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.599450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f1cb77a0-4397-4d0d-bd6d-3e567b87c301 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.617585 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f1cb77a0-4397-4d0d-bd6d-3e567b87c301 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1264 microversion: 2.1 time: 0.185982 Jul 20 04:16:57.632191 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 862/1825] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:57.638559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-066c13d9-5252-4b7c-9ec3-a059c523e4fb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.639600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-066c13d9-5252-4b7c-9ec3-a059c523e4fb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.660920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-066c13d9-5252-4b7c-9ec3-a059c523e4fb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.662061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-066c13d9-5252-4b7c-9ec3-a059c523e4fb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.663109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-066c13d9-5252-4b7c-9ec3-a059c523e4fb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.668720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-066c13d9-5252-4b7c-9ec3-a059c523e4fb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.123708 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-918561a2-bb9c-43c3-9912-491548b29007 tempest-MigrationsAdminTest-1941670778 tempest-MigrationsAdminTest-1941670778-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1615 microversion: 2.1 time: 0.921842 Jul 20 04:16:58.133178 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 964/1826] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1615 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:58.149683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-0fdd8dbe-7569-4b6c-95df-038299b910f5 req-ad3c56fd-2812-41d8-b6be-a768bd4d4137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c0c327-39d3-44cf-8598-b6dcb35a2fbf", "name": "network-vif-deleted", "tag": "97dd8aca-c919-4caf-a0ef-649a0381d912"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:58.213471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0fdd8dbe-7569-4b6c-95df-038299b910f5 req-ad3c56fd-2812-41d8-b6be-a768bd4d4137 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.214538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0fdd8dbe-7569-4b6c-95df-038299b910f5 req-ad3c56fd-2812-41d8-b6be-a768bd4d4137 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.267127 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-0fdd8dbe-7569-4b6c-95df-038299b910f5 req-ad3c56fd-2812-41d8-b6be-a768bd4d4137 service nova] Creating event network-vif-deleted:97dd8aca-c919-4caf-a0ef-649a0381d912 for instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf on n-h2-764485-11 Jul 20 04:16:58.272967 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-0fdd8dbe-7569-4b6c-95df-038299b910f5 req-ad3c56fd-2812-41d8-b6be-a768bd4d4137 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135311 Jul 20 04:16:58.274601 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 965/1827] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:58.284192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-97f66a80-cd38-4bb1-985c-b813550ff2c2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.285164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-97f66a80-cd38-4bb1-985c-b813550ff2c2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.297758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97f66a80-cd38-4bb1-985c-b813550ff2c2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.298843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97f66a80-cd38-4bb1-985c-b813550ff2c2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.299954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97f66a80-cd38-4bb1-985c-b813550ff2c2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.300474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97f66a80-cd38-4bb1-985c-b813550ff2c2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.306692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-066c13d9-5252-4b7c-9ec3-a059c523e4fb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:58.344691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-066c13d9-5252-4b7c-9ec3-a059c523e4fb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:58.347804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-066c13d9-5252-4b7c-9ec3-a059c523e4fb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:58.349334 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-066c13d9-5252-4b7c-9ec3-a059c523e4fb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 0.715676 Jul 20 04:16:58.361463 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 863/1828] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:58.369936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-245cbb44-9043-498a-889a-94f865f46011 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.370390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-245cbb44-9043-498a-889a-94f865f46011 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.371325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-97f66a80-cd38-4bb1-985c-b813550ff2c2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:58.413642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-245cbb44-9043-498a-889a-94f865f46011 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.414115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-245cbb44-9043-498a-889a-94f865f46011 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.415139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-245cbb44-9043-498a-889a-94f865f46011 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.415631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-245cbb44-9043-498a-889a-94f865f46011 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.589816 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-97f66a80-cd38-4bb1-985c-b813550ff2c2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 204 len: 0 microversion: 2.1 time: 0.313173 Jul 20 04:16:58.591416 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 966/1829] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:58 2022] DELETE /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:58.610407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1c650553-2892-44d2-ab22-ed7924d4fafa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.612565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1c650553-2892-44d2-ab22-ed7924d4fafa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.632536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c650553-2892-44d2-ab22-ed7924d4fafa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.636128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c650553-2892-44d2-ab22-ed7924d4fafa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.637224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c650553-2892-44d2-ab22-ed7924d4fafa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.639565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c650553-2892-44d2-ab22-ed7924d4fafa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.344867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1c650553-2892-44d2-ab22-ed7924d4fafa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.357060 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1c650553-2892-44d2-ab22-ed7924d4fafa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1314 microversion: 2.1 time: 0.759009 Jul 20 04:16:59.372771 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 967/1830] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:58 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:59.380385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d07ecd1-5f6a-4b05-b6ce-40cddd307854 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.381969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5d07ecd1-5f6a-4b05-b6ce-40cddd307854 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.397980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d07ecd1-5f6a-4b05-b6ce-40cddd307854 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.400583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d07ecd1-5f6a-4b05-b6ce-40cddd307854 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.404308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d07ecd1-5f6a-4b05-b6ce-40cddd307854 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.409999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-245cbb44-9043-498a-889a-94f865f46011 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.418439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d07ecd1-5f6a-4b05-b6ce-40cddd307854 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.425604 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-245cbb44-9043-498a-889a-94f865f46011 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1402 microversion: 2.1 time: 1.064209 Jul 20 04:16:59.427909 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 864/1831] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:58 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1402 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:59.436217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4e05b41a-0b84-4317-8991-47c87948ce10 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.437893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4e05b41a-0b84-4317-8991-47c87948ce10 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.457041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e05b41a-0b84-4317-8991-47c87948ce10 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.458013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e05b41a-0b84-4317-8991-47c87948ce10 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.459100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e05b41a-0b84-4317-8991-47c87948ce10 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.461894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e05b41a-0b84-4317-8991-47c87948ce10 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.854164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5d07ecd1-5f6a-4b05-b6ce-40cddd307854 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.866274 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5d07ecd1-5f6a-4b05-b6ce-40cddd307854 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1468 microversion: 2.1 time: 0.491283 Jul 20 04:16:59.867454 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 968/1832] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1468 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:59.871210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4e05b41a-0b84-4317-8991-47c87948ce10 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.886761 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4e05b41a-0b84-4317-8991-47c87948ce10 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1306 microversion: 2.1 time: 0.455399 Jul 20 04:16:59.889937 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 865/1833] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1306 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:59.900721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fd7e4958-3dc3-4109-aac8-239b8e20fa7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.901351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fd7e4958-3dc3-4109-aac8-239b8e20fa7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.927907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd7e4958-3dc3-4109-aac8-239b8e20fa7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.929508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd7e4958-3dc3-4109-aac8-239b8e20fa7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.930590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd7e4958-3dc3-4109-aac8-239b8e20fa7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.931538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd7e4958-3dc3-4109-aac8-239b8e20fa7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.994433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-94699940-12cc-474d-8f24-456658d76c9c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'create', calling method: .version_select at 0x7fbf9d14ab80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1363041191", "description": "tempest-description-319272071"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:00.866312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fd7e4958-3dc3-4109-aac8-239b8e20fa7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:00.887963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fd7e4958-3dc3-4109-aac8-239b8e20fa7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:00.891960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fd7e4958-3dc3-4109-aac8-239b8e20fa7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:00.893202 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fd7e4958-3dc3-4109-aac8-239b8e20fa7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 0.998852 Jul 20 04:17:00.893782 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 866/1834] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:00.908081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1b659f0c-443f-4a8d-935c-f65a44a99017 req-2c2dcff0-caee-4762-8177-578e700d4c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8", "name": "network-vif-plugged", "status": "completed", "tag": "0c831938-16c9-4f5e-8498-ff9d8d9f8c72"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:00.921078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1b659f0c-443f-4a8d-935c-f65a44a99017 req-2c2dcff0-caee-4762-8177-578e700d4c6d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.923571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1b659f0c-443f-4a8d-935c-f65a44a99017 req-2c2dcff0-caee-4762-8177-578e700d4c6d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.951474 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1b659f0c-443f-4a8d-935c-f65a44a99017 req-2c2dcff0-caee-4762-8177-578e700d4c6d service nova] Creating event network-vif-plugged:0c831938-16c9-4f5e-8498-ff9d8d9f8c72 for instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 on n-h1-764485-11 Jul 20 04:17:00.957076 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1b659f0c-443f-4a8d-935c-f65a44a99017 req-2c2dcff0-caee-4762-8177-578e700d4c6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059728 Jul 20 04:17:00.958135 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 867/1835] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:00.970004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cf5a3947-f7f9-4c58-9040-ce4a62a4b3f2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:00.971091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cf5a3947-f7f9-4c58-9040-ce4a62a4b3f2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:00.978342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf5a3947-f7f9-4c58-9040-ce4a62a4b3f2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.979643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf5a3947-f7f9-4c58-9040-ce4a62a4b3f2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.980794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf5a3947-f7f9-4c58-9040-ce4a62a4b3f2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.981445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf5a3947-f7f9-4c58-9040-ce4a62a4b3f2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.216484 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-94699940-12cc-474d-8f24-456658d76c9c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.347661 Jul 20 04:17:01.224097 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 969/1836] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:16:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:01.230020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-50257d4e-c918-4e67-a63a-a47283d6e708 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:01.231321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-50257d4e-c918-4e67-a63a-a47283d6e708 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:01.246194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50257d4e-c918-4e67-a63a-a47283d6e708 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.247259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50257d4e-c918-4e67-a63a-a47283d6e708 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.248668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50257d4e-c918-4e67-a63a-a47283d6e708 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.250166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50257d4e-c918-4e67-a63a-a47283d6e708 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.819214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf5a3947-f7f9-4c58-9040-ce4a62a4b3f2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:01.831684 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cf5a3947-f7f9-4c58-9040-ce4a62a4b3f2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1314 microversion: 2.1 time: 0.872002 Jul 20 04:17:01.835227 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 868/1837] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:00 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1314 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:01.842017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9fd1881a-1451-4f48-b37f-a5895c37026c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:01.843764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9fd1881a-1451-4f48-b37f-a5895c37026c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:01.850847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9fd1881a-1451-4f48-b37f-a5895c37026c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.851202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9fd1881a-1451-4f48-b37f-a5895c37026c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.852103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9fd1881a-1451-4f48-b37f-a5895c37026c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.852489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9fd1881a-1451-4f48-b37f-a5895c37026c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.214048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-50257d4e-c918-4e67-a63a-a47283d6e708 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:02.225122 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-50257d4e-c918-4e67-a63a-a47283d6e708 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1589 microversion: 2.1 time: 0.999187 Jul 20 04:17:02.225757 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 970/1838] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:01 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1589 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:02.239822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3074dea1-05d0-4225-8e65-f992a10b6cde tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:02.240866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3074dea1-05d0-4225-8e65-f992a10b6cde tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:02.254620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3074dea1-05d0-4225-8e65-f992a10b6cde tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.258377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3074dea1-05d0-4225-8e65-f992a10b6cde tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.268251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3074dea1-05d0-4225-8e65-f992a10b6cde tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.268730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3074dea1-05d0-4225-8e65-f992a10b6cde tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.302931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:02.709047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9fd1881a-1451-4f48-b37f-a5895c37026c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:02.742656 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9fd1881a-1451-4f48-b37f-a5895c37026c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 200 len: 1468 microversion: 2.1 time: 0.899819 Jul 20 04:17:02.753611 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 869/1839] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:01 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 1468 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:02.769573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f77d4e33-5b42-4c12-899a-cf5a55e441b7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'create', calling method: .version_select at 0x7fbf9da451f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1519703201", "description": "tempest-description-1355064683"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:03.037040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3074dea1-05d0-4225-8e65-f992a10b6cde tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.054840 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3074dea1-05d0-4225-8e65-f992a10b6cde tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1306 microversion: 2.1 time: 0.827981 Jul 20 04:17:03.055484 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 971/1840] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:02 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1306 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:03.069492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9016b703-329d-406c-8560-33b28f5af8b3 req-c26bd3d2-b2b2-4001-bcdc-6cebf98f7c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe", "name": "network-vif-unplugged", "status": "completed", "tag": "44316d0e-ff03-434b-84fc-d22fbc6f7ea6"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:03.099658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9016b703-329d-406c-8560-33b28f5af8b3 req-c26bd3d2-b2b2-4001-bcdc-6cebf98f7c5b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.100121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9016b703-329d-406c-8560-33b28f5af8b3 req-c26bd3d2-b2b2-4001-bcdc-6cebf98f7c5b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.117230 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9016b703-329d-406c-8560-33b28f5af8b3 req-c26bd3d2-b2b2-4001-bcdc-6cebf98f7c5b service nova] Creating event network-vif-unplugged:44316d0e-ff03-434b-84fc-d22fbc6f7ea6 for instance 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe on n-h1-764485-11 Jul 20 04:17:03.128123 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9016b703-329d-406c-8560-33b28f5af8b3 req-c26bd3d2-b2b2-4001-bcdc-6cebf98f7c5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068686 Jul 20 04:17:03.129313 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 972/1841] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:03.153614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c0cfd0d3-b241-4a7f-b4dd-b5aee0b42f12 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.157626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c0cfd0d3-b241-4a7f-b4dd-b5aee0b42f12 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:03.179653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0cfd0d3-b241-4a7f-b4dd-b5aee0b42f12 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.180515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0cfd0d3-b241-4a7f-b4dd-b5aee0b42f12 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.181577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0cfd0d3-b241-4a7f-b4dd-b5aee0b42f12 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.182440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0cfd0d3-b241-4a7f-b4dd-b5aee0b42f12 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.625155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:03.708974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:03.777237 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f77d4e33-5b42-4c12-899a-cf5a55e441b7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.022103 Jul 20 04:17:03.778049 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 870/1842] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:02 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:03.795126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5dec02b9-044b-4e2b-a677-8b2e08e8032b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.796402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5dec02b9-044b-4e2b-a677-8b2e08e8032b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:03.807677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5dec02b9-044b-4e2b-a677-8b2e08e8032b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.808371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5dec02b9-044b-4e2b-a677-8b2e08e8032b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.810463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5dec02b9-044b-4e2b-a677-8b2e08e8032b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.815040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5dec02b9-044b-4e2b-a677-8b2e08e8032b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.862691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c0cfd0d3-b241-4a7f-b4dd-b5aee0b42f12 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.876993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c0cfd0d3-b241-4a7f-b4dd-b5aee0b42f12 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.880887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c0cfd0d3-b241-4a7f-b4dd-b5aee0b42f12 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.883814 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c0cfd0d3-b241-4a7f-b4dd-b5aee0b42f12 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 0.752429 Jul 20 04:17:03.885979 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 973/1843] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:03.896614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9e0fca4f-5df3-42fd-be43-715d38a6efce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.897290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9e0fca4f-5df3-42fd-be43-715d38a6efce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:03.904032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e0fca4f-5df3-42fd-be43-715d38a6efce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.904819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e0fca4f-5df3-42fd-be43-715d38a6efce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.906359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e0fca4f-5df3-42fd-be43-715d38a6efce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.906981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e0fca4f-5df3-42fd-be43-715d38a6efce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.028514 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5dec02b9-044b-4e2b-a677-8b2e08e8032b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.249292 Jul 20 04:17:04.029560 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 871/1844] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3/os-interface => generated 285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:04.036007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-7d15498e-3a41-4130-afb9-57665c2f513c req-d09db7bb-e8dc-4f10-9b95-f9ecf52c0898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1f3708-823c-49ca-8327-bfdd82211149", "name": "network-vif-plugged", "status": "completed", "tag": "54945e39-8427-4f57-9c15-e67b3e02d8f0"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:04.053414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:04.057659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7d15498e-3a41-4130-afb9-57665c2f513c req-d09db7bb-e8dc-4f10-9b95-f9ecf52c0898 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.061141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7d15498e-3a41-4130-afb9-57665c2f513c req-d09db7bb-e8dc-4f10-9b95-f9ecf52c0898 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.086507 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-7d15498e-3a41-4130-afb9-57665c2f513c req-d09db7bb-e8dc-4f10-9b95-f9ecf52c0898 service nova] Creating event network-vif-plugged:54945e39-8427-4f57-9c15-e67b3e02d8f0 for instance 1e1f3708-823c-49ca-8327-bfdd82211149 on n-h2-764485-11 Jul 20 04:17:04.102112 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-7d15498e-3a41-4130-afb9-57665c2f513c req-d09db7bb-e8dc-4f10-9b95-f9ecf52c0898 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061435 Jul 20 04:17:04.106981 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 872/1845] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:04.117247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7526f9c7-651d-448f-a7d6-3ad4b5f45ad2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:04.120104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7526f9c7-651d-448f-a7d6-3ad4b5f45ad2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:04.173259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7526f9c7-651d-448f-a7d6-3ad4b5f45ad2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.183101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7526f9c7-651d-448f-a7d6-3ad4b5f45ad2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.196641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7526f9c7-651d-448f-a7d6-3ad4b5f45ad2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.201178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7526f9c7-651d-448f-a7d6-3ad4b5f45ad2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.230347 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-7526f9c7-651d-448f-a7d6-3ad4b5f45ad2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] HTTP exception thrown: Instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 could not be found. Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7526f9c7-651d-448f-a7d6-3ad4b5f45ad2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Request method failure captured: Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 HTTP/1.1 Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BT-RCc3LxZsq5yJpBGrnw0swM1afBk2IT6qvTcGiyvXwtp9OsZ58SG4h86KwxYp_vyKbS5JwTT2Bv2Lcz7YgQ5VG_epOkNbddsUErfW0IXh5AUbO_uupm7upqkmjWLFNen0CAfNp7_peOl4geADRnLij-EYqHdKyEgodSB1ukTn88 Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 41ba023317344d3490bdb01aa8b1e01b Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-MigrationsAdminTest-920586646 Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/41ba023317344d3490bdb01aa8b1e01b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41ba023317344d3490bdb01aa8b1e01b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_41ba023317344d3490bdb01aa8b1e01b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41ba023317344d3490bdb01aa8b1e01b"}]}] Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-MigrationsAdminTest-920586646 Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 41ba023317344d3490bdb01aa8b1e01b Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-MigrationsAdminTest-920586646 Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-MigrationsAdminTest-920586646-project Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 9aa79203e62546cea351116b153afee5 Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-MigrationsAdminTest-920586646-project Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 could not be found. Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8'} Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 could not be found. Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 could not be found. Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:04.232637 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.238515 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.238515 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:04.238515 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:04.238515 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:04.238515 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:04.238515 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 could not be found. Jul 20 04:17:04.238515 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.242619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7526f9c7-651d-448f-a7d6-3ad4b5f45ad2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Returning 404 to user: Instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:04.243790 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7526f9c7-651d-448f-a7d6-3ad4b5f45ad2 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8" status: 404 len: 111 microversion: 2.1 time: 0.135287 Jul 20 04:17:04.244917 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 873/1846] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:04 2022] GET /compute/v2.1/servers/14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:04.251943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1632878915", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "425288b6-c0b7-4506-9750-208267afd7bc"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:04.300318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:04.346755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] validate_networks() for [('425288b6-c0b7-4506-9750-208267afd7bc', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:04.657478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e0fca4f-5df3-42fd-be43-715d38a6efce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.671605 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9e0fca4f-5df3-42fd-be43-715d38a6efce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1314 microversion: 2.1 time: 0.780188 Jul 20 04:17:04.675809 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 974/1847] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:04.685016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e25fe35d-1fbb-4b88-9183-e9680094a2b0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:04.685855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e25fe35d-1fbb-4b88-9183-e9680094a2b0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:04.694107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e25fe35d-1fbb-4b88-9183-e9680094a2b0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.694833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e25fe35d-1fbb-4b88-9183-e9680094a2b0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.695946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e25fe35d-1fbb-4b88-9183-e9680094a2b0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.697214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e25fe35d-1fbb-4b88-9183-e9680094a2b0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.051059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e25fe35d-1fbb-4b88-9183-e9680094a2b0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:05.066034 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e25fe35d-1fbb-4b88-9183-e9680094a2b0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1306 microversion: 2.1 time: 0.388258 Jul 20 04:17:05.076151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:05.078728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:05.079400 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 975/1848] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:04 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1306 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:05.079698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:05.080137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:05.080665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:05.084911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1df78d42-5cdb-4326-94c5-3ec7e01d0c31 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.085623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1df78d42-5cdb-4326-94c5-3ec7e01d0c31 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.090875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.091728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.092854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.094451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.103910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1df78d42-5cdb-4326-94c5-3ec7e01d0c31 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.104652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1df78d42-5cdb-4326-94c5-3ec7e01d0c31 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.106182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1df78d42-5cdb-4326-94c5-3ec7e01d0c31 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.106906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1df78d42-5cdb-4326-94c5-3ec7e01d0c31 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.117598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Getting quotas for project 5a6077ffc2e5466ab68104ce3963e514. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:05.123535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Getting quotas for user 197a968f1cd644d3afca88c6d60a87c2 and project 5a6077ffc2e5466ab68104ce3963e514. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:05.141136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1df78d42-5cdb-4326-94c5-3ec7e01d0c31 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:05.142667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:05.145889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:05.211451 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3fd2c47d-c0b8-49d0-9c7f-7a5a3ca09485 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964230 Jul 20 04:17:05.212229 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 874/1849] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:17:05.221694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a844fe7-5985-49e6-9ddf-85a708c83927 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.223949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4a844fe7-5985-49e6-9ddf-85a708c83927 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.231114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a844fe7-5985-49e6-9ddf-85a708c83927 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.231979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a844fe7-5985-49e6-9ddf-85a708c83927 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.233159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a844fe7-5985-49e6-9ddf-85a708c83927 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.235054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a844fe7-5985-49e6-9ddf-85a708c83927 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.241606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:05.280192 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1df78d42-5cdb-4326-94c5-3ec7e01d0c31 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "DELETE /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 204 len: 0 microversion: 2.1 time: 0.196782 Jul 20 04:17:05.281250 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 976/1850] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:05 2022] DELETE /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:05.297605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-7360ef1c-a35e-4aaa-8248-a87dc21f368c req-401ef810-9b9b-4e85-989e-c6f265adb5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8", "name": "network-vif-deleted", "tag": "0c831938-16c9-4f5e-8498-ff9d8d9f8c72"}, {"name": "network-changed", "server_uuid": "70d86df2-0b5f-4d16-b6a5-fe16c86494fe", "tag": "a3ee1c75-0199-4fca-95d5-7a8a2a2d9a58"}, {"name": "network-changed", "server_uuid": "7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe", "tag": "44316d0e-ff03-434b-84fc-d22fbc6f7ea6"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:05.345474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7360ef1c-a35e-4aaa-8248-a87dc21f368c req-401ef810-9b9b-4e85-989e-c6f265adb5f6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.345474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7360ef1c-a35e-4aaa-8248-a87dc21f368c req-401ef810-9b9b-4e85-989e-c6f265adb5f6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.372645 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7360ef1c-a35e-4aaa-8248-a87dc21f368c req-401ef810-9b9b-4e85-989e-c6f265adb5f6 service nova] Creating event network-vif-deleted:0c831938-16c9-4f5e-8498-ff9d8d9f8c72 for instance 14ae0e00-d87b-45cb-9c9a-1d5a5fb7aed8 on n-h1-764485-11 Jul 20 04:17:05.373359 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7360ef1c-a35e-4aaa-8248-a87dc21f368c req-401ef810-9b9b-4e85-989e-c6f265adb5f6 service nova] Creating event network-changed:a3ee1c75-0199-4fca-95d5-7a8a2a2d9a58 for instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe on n-h1-764485-11 Jul 20 04:17:05.374575 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7360ef1c-a35e-4aaa-8248-a87dc21f368c req-401ef810-9b9b-4e85-989e-c6f265adb5f6 service nova] Creating event network-changed:44316d0e-ff03-434b-84fc-d22fbc6f7ea6 for instance 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe on n-h1-764485-11 Jul 20 04:17:05.383608 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-7360ef1c-a35e-4aaa-8248-a87dc21f368c req-401ef810-9b9b-4e85-989e-c6f265adb5f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.100827 Jul 20 04:17:05.384547 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 977/1851] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:05.391759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-80b14ea1-baeb-4f95-9044-9d6d6165c454 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.392484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-80b14ea1-baeb-4f95-9044-9d6d6165c454 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.491360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-80b14ea1-baeb-4f95-9044-9d6d6165c454 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:05.499480 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-80b14ea1-baeb-4f95-9044-9d6d6165c454 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1216 microversion: 2.1 time: 0.113638 Jul 20 04:17:05.500572 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 978/1852] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1216 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:05.504572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a844fe7-5985-49e6-9ddf-85a708c83927 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:05.505299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2670d5ca-04aa-4d19-aacf-e7d11166ffff tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.505966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2670d5ca-04aa-4d19-aacf-e7d11166ffff tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.513482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2670d5ca-04aa-4d19-aacf-e7d11166ffff tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.513936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2670d5ca-04aa-4d19-aacf-e7d11166ffff tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.514991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2670d5ca-04aa-4d19-aacf-e7d11166ffff tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.516248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2670d5ca-04aa-4d19-aacf-e7d11166ffff tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.518623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a844fe7-5985-49e6-9ddf-85a708c83927 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:05.522227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a844fe7-5985-49e6-9ddf-85a708c83927 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:05.525933 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a844fe7-5985-49e6-9ddf-85a708c83927 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 0.311072 Jul 20 04:17:05.536779 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 875/1853] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:05.545341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2e93928e-bae7-4cfc-8d13-4035d68627a7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.547132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2e93928e-bae7-4cfc-8d13-4035d68627a7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.553748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e93928e-bae7-4cfc-8d13-4035d68627a7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.554341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e93928e-bae7-4cfc-8d13-4035d68627a7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.555264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e93928e-bae7-4cfc-8d13-4035d68627a7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.555825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e93928e-bae7-4cfc-8d13-4035d68627a7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.792969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2e93928e-bae7-4cfc-8d13-4035d68627a7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:05.801799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2670d5ca-04aa-4d19-aacf-e7d11166ffff tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:05.809777 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2e93928e-bae7-4cfc-8d13-4035d68627a7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1589 microversion: 2.1 time: 0.269879 Jul 20 04:17:05.810752 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2670d5ca-04aa-4d19-aacf-e7d11166ffff tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1533 microversion: 2.1 time: 0.309254 Jul 20 04:17:05.812104 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 876/1854] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1589 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:05.819843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-63335978-4e46-4c18-97cc-45e2bf59a294 req-9e360c1c-5458-4362-afc6-74ab79f54a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6460f29d-e3f7-4f4d-95e1-a374af5864c3", "tag": "05c8c052-daed-4646-9e5e-31c92143b2d3"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:05.824489 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 979/1855] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1533 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:05.830049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b52a234e-2ccc-427c-9466-2e22cf3de251 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.830888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b52a234e-2ccc-427c-9466-2e22cf3de251 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.834102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:05.842164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-63335978-4e46-4c18-97cc-45e2bf59a294 req-9e360c1c-5458-4362-afc6-74ab79f54a5d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.844789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b52a234e-2ccc-427c-9466-2e22cf3de251 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.845586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-63335978-4e46-4c18-97cc-45e2bf59a294 req-9e360c1c-5458-4362-afc6-74ab79f54a5d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.849140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b52a234e-2ccc-427c-9466-2e22cf3de251 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.850277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b52a234e-2ccc-427c-9466-2e22cf3de251 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.850885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b52a234e-2ccc-427c-9466-2e22cf3de251 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.872844 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-63335978-4e46-4c18-97cc-45e2bf59a294 req-9e360c1c-5458-4362-afc6-74ab79f54a5d service nova] Creating event network-changed:05c8c052-daed-4646-9e5e-31c92143b2d3 for instance 6460f29d-e3f7-4f4d-95e1-a374af5864c3 on n-h2-764485-11 Jul 20 04:17:05.883620 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-63335978-4e46-4c18-97cc-45e2bf59a294 req-9e360c1c-5458-4362-afc6-74ab79f54a5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066927 Jul 20 04:17:05.892134 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 877/1856] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:06.026131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b52a234e-2ccc-427c-9466-2e22cf3de251 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.034631 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b52a234e-2ccc-427c-9466-2e22cf3de251 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1314 microversion: 2.1 time: 0.208674 Jul 20 04:17:06.035545 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 980/1857] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:06.085319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ae467eaa-5d5c-4630-9fa5-aa42af3aa045 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:06.086061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ae467eaa-5d5c-4630-9fa5-aa42af3aa045 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:06.103450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae467eaa-5d5c-4630-9fa5-aa42af3aa045 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.104199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae467eaa-5d5c-4630-9fa5-aa42af3aa045 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.105039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae467eaa-5d5c-4630-9fa5-aa42af3aa045 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.105599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae467eaa-5d5c-4630-9fa5-aa42af3aa045 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.261533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ae467eaa-5d5c-4630-9fa5-aa42af3aa045 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.272623 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ae467eaa-5d5c-4630-9fa5-aa42af3aa045 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1306 microversion: 2.1 time: 0.192159 Jul 20 04:17:06.273213 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 878/1858] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:06 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1306 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:06.517511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-89eb2742-c3a5-4a43-9f72-62e88d4c45be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:06.518160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-89eb2742-c3a5-4a43-9f72-62e88d4c45be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:06.527895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89eb2742-c3a5-4a43-9f72-62e88d4c45be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.528600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89eb2742-c3a5-4a43-9f72-62e88d4c45be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.529534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89eb2742-c3a5-4a43-9f72-62e88d4c45be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.531679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89eb2742-c3a5-4a43-9f72-62e88d4c45be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.550616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-24868dc1-5bb2-43ef-8768-53ffff3e0d55 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:06.551668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-24868dc1-5bb2-43ef-8768-53ffff3e0d55 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:06.558879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24868dc1-5bb2-43ef-8768-53ffff3e0d55 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.559345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24868dc1-5bb2-43ef-8768-53ffff3e0d55 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.560175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24868dc1-5bb2-43ef-8768-53ffff3e0d55 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.562979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24868dc1-5bb2-43ef-8768-53ffff3e0d55 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.691472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-89eb2742-c3a5-4a43-9f72-62e88d4c45be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.700814 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-89eb2742-c3a5-4a43-9f72-62e88d4c45be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1220 microversion: 2.1 time: 0.188009 Jul 20 04:17:06.701671 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 981/1859] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:06 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1220 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:06.753341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-24868dc1-5bb2-43ef-8768-53ffff3e0d55 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.762063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-24868dc1-5bb2-43ef-8768-53ffff3e0d55 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.763656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-24868dc1-5bb2-43ef-8768-53ffff3e0d55 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.765494 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-24868dc1-5bb2-43ef-8768-53ffff3e0d55 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 0.219490 Jul 20 04:17:06.767027 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 879/1860] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:06 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:06.843644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4aebd500-775d-44ac-8ca1-7afa292a2a69 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:06.844813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4aebd500-775d-44ac-8ca1-7afa292a2a69 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:06.851899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aebd500-775d-44ac-8ca1-7afa292a2a69 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.852358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aebd500-775d-44ac-8ca1-7afa292a2a69 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.853142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aebd500-775d-44ac-8ca1-7afa292a2a69 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.853615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aebd500-775d-44ac-8ca1-7afa292a2a69 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.000138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4aebd500-775d-44ac-8ca1-7afa292a2a69 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:07.009111 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4aebd500-775d-44ac-8ca1-7afa292a2a69 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1533 microversion: 2.1 time: 0.170963 Jul 20 04:17:07.009987 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 982/1861] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:06 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1533 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:07.052813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bf176324-b9d8-4b7a-ad04-2bc601138bae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:07.053365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bf176324-b9d8-4b7a-ad04-2bc601138bae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:07.065769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf176324-b9d8-4b7a-ad04-2bc601138bae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.066304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf176324-b9d8-4b7a-ad04-2bc601138bae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.067052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf176324-b9d8-4b7a-ad04-2bc601138bae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.067502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf176324-b9d8-4b7a-ad04-2bc601138bae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.208466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bf176324-b9d8-4b7a-ad04-2bc601138bae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:07.216247 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bf176324-b9d8-4b7a-ad04-2bc601138bae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1501 microversion: 2.1 time: 0.167862 Jul 20 04:17:07.217021 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 880/1862] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:07 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:07.290032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9ac68bb3-d8c8-4531-9eae-b8347a365bbf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:07.290645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9ac68bb3-d8c8-4531-9eae-b8347a365bbf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:07.298023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ac68bb3-d8c8-4531-9eae-b8347a365bbf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.298475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ac68bb3-d8c8-4531-9eae-b8347a365bbf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.299248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ac68bb3-d8c8-4531-9eae-b8347a365bbf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.299721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ac68bb3-d8c8-4531-9eae-b8347a365bbf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.570246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9ac68bb3-d8c8-4531-9eae-b8347a365bbf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:07.582229 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9ac68bb3-d8c8-4531-9eae-b8347a365bbf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1306 microversion: 2.1 time: 0.295954 Jul 20 04:17:07.582811 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 983/1863] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:07 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1306 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:07.719360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1d004881-126a-4f1e-8dbf-3bd477585b3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:07.719980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1d004881-126a-4f1e-8dbf-3bd477585b3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:07.727631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d004881-126a-4f1e-8dbf-3bd477585b3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.728089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d004881-126a-4f1e-8dbf-3bd477585b3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.728878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d004881-126a-4f1e-8dbf-3bd477585b3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.729319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d004881-126a-4f1e-8dbf-3bd477585b3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.784810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-238264e8-9b6e-40c0-96ec-80c5398efb43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:07.786202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-238264e8-9b6e-40c0-96ec-80c5398efb43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:07.794566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-238264e8-9b6e-40c0-96ec-80c5398efb43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.795333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-238264e8-9b6e-40c0-96ec-80c5398efb43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.798745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-238264e8-9b6e-40c0-96ec-80c5398efb43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.799334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-238264e8-9b6e-40c0-96ec-80c5398efb43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.143793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1d004881-126a-4f1e-8dbf-3bd477585b3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.151845 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1d004881-126a-4f1e-8dbf-3bd477585b3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1212 microversion: 2.1 time: 0.437220 Jul 20 04:17:08.152756 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 881/1864] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:07 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1212 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:08.158440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0aba8ed-c233-4b93-bbd6-0023ad8c2c77 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:08.159466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b0aba8ed-c233-4b93-bbd6-0023ad8c2c77 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.166185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0aba8ed-c233-4b93-bbd6-0023ad8c2c77 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.166651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0aba8ed-c233-4b93-bbd6-0023ad8c2c77 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.167427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0aba8ed-c233-4b93-bbd6-0023ad8c2c77 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.167890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0aba8ed-c233-4b93-bbd6-0023ad8c2c77 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.447463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-238264e8-9b6e-40c0-96ec-80c5398efb43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.475634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-238264e8-9b6e-40c0-96ec-80c5398efb43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.489800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-238264e8-9b6e-40c0-96ec-80c5398efb43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.491202 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-238264e8-9b6e-40c0-96ec-80c5398efb43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 0.710935 Jul 20 04:17:08.491834 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 984/1865] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:07 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:08.501227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14ca3585-efd0-4b61-8697-8aa71265fb59 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:08.508568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-14ca3585-efd0-4b61-8697-8aa71265fb59 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.530850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14ca3585-efd0-4b61-8697-8aa71265fb59 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.539836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14ca3585-efd0-4b61-8697-8aa71265fb59 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.540971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14ca3585-efd0-4b61-8697-8aa71265fb59 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.541590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14ca3585-efd0-4b61-8697-8aa71265fb59 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.867857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b0aba8ed-c233-4b93-bbd6-0023ad8c2c77 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.883836 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0aba8ed-c233-4b93-bbd6-0023ad8c2c77 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1533 microversion: 2.1 time: 0.729299 Jul 20 04:17:08.885113 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 882/1866] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:08 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1533 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:08.891730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-99b40e58-8a7d-4010-9043-f4f2d0266b46 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:08.892931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-99b40e58-8a7d-4010-9043-f4f2d0266b46 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.901578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99b40e58-8a7d-4010-9043-f4f2d0266b46 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.902435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99b40e58-8a7d-4010-9043-f4f2d0266b46 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.904329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99b40e58-8a7d-4010-9043-f4f2d0266b46 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.906684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99b40e58-8a7d-4010-9043-f4f2d0266b46 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.681042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-14ca3585-efd0-4b61-8697-8aa71265fb59 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:09.690825 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-14ca3585-efd0-4b61-8697-8aa71265fb59 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1501 microversion: 2.1 time: 1.196090 Jul 20 04:17:09.692151 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 985/1867] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:08 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1501 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:09.697584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f646f761-1b56-44b2-8603-e5ac44576822 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:09.698491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f646f761-1b56-44b2-8603-e5ac44576822 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:09.706563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f646f761-1b56-44b2-8603-e5ac44576822 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.707374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f646f761-1b56-44b2-8603-e5ac44576822 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.708490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f646f761-1b56-44b2-8603-e5ac44576822 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.709162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f646f761-1b56-44b2-8603-e5ac44576822 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.008404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-99b40e58-8a7d-4010-9043-f4f2d0266b46 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:10.018031 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-99b40e58-8a7d-4010-9043-f4f2d0266b46 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1306 microversion: 2.1 time: 1.131538 Jul 20 04:17:10.018635 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 883/1868] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:08 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1306 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:10.032950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-47d1415b-0722-44bb-a09f-c180639d9c77 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:10.033399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-47d1415b-0722-44bb-a09f-c180639d9c77 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:10.046625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47d1415b-0722-44bb-a09f-c180639d9c77 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.047015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47d1415b-0722-44bb-a09f-c180639d9c77 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.047855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47d1415b-0722-44bb-a09f-c180639d9c77 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.048295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47d1415b-0722-44bb-a09f-c180639d9c77 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.064548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f646f761-1b56-44b2-8603-e5ac44576822 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.080500 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f646f761-1b56-44b2-8603-e5ac44576822 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1316 microversion: 2.1 time: 1.386988 Jul 20 04:17:11.083670 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 986/1869] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:09 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1316 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:11.096353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-594d23ae-9ff8-49c0-9a57-4ac49e83e087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.098751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-594d23ae-9ff8-49c0-9a57-4ac49e83e087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:11.110247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-594d23ae-9ff8-49c0-9a57-4ac49e83e087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.111130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-594d23ae-9ff8-49c0-9a57-4ac49e83e087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.112304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-594d23ae-9ff8-49c0-9a57-4ac49e83e087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.113763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-594d23ae-9ff8-49c0-9a57-4ac49e83e087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.445465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-594d23ae-9ff8-49c0-9a57-4ac49e83e087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.460728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-47d1415b-0722-44bb-a09f-c180639d9c77 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.474433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-47d1415b-0722-44bb-a09f-c180639d9c77 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.477352 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-594d23ae-9ff8-49c0-9a57-4ac49e83e087 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1491 microversion: 2.1 time: 0.379680 Jul 20 04:17:11.478627 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 987/1870] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:11 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1491 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:11.485283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-47d1415b-0722-44bb-a09f-c180639d9c77 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.486935 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-47d1415b-0722-44bb-a09f-c180639d9c77 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 1.464778 Jul 20 04:17:11.488072 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 884/1871] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:10 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:11.493637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4d4a5d39-c168-405c-b7e1-6e1cfadeaa36 req-424521f6-07aa-4228-907c-fba6adf955d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcccdd82-e3d1-4d66-aefc-657ce896eaf8", "tag": "6ccd2eda-880b-42ac-af0e-bb1e18b48e69"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:11.515970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4d4a5d39-c168-405c-b7e1-6e1cfadeaa36 req-424521f6-07aa-4228-907c-fba6adf955d1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.519778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4d4a5d39-c168-405c-b7e1-6e1cfadeaa36 req-424521f6-07aa-4228-907c-fba6adf955d1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.521282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d57a4cdd-a64b-4bab-9a42-217a297da687 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.525108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d57a4cdd-a64b-4bab-9a42-217a297da687 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:11.538041 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4d4a5d39-c168-405c-b7e1-6e1cfadeaa36 req-424521f6-07aa-4228-907c-fba6adf955d1 service nova] Creating event network-changed:6ccd2eda-880b-42ac-af0e-bb1e18b48e69 for instance bcccdd82-e3d1-4d66-aefc-657ce896eaf8 on n-h2-764485-11 Jul 20 04:17:11.547672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d57a4cdd-a64b-4bab-9a42-217a297da687 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.548233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d57a4cdd-a64b-4bab-9a42-217a297da687 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.549913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d57a4cdd-a64b-4bab-9a42-217a297da687 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.551783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d57a4cdd-a64b-4bab-9a42-217a297da687 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.553323 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4d4a5d39-c168-405c-b7e1-6e1cfadeaa36 req-424521f6-07aa-4228-907c-fba6adf955d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072782 Jul 20 04:17:11.553938 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 988/1872] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:11.559667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-788d9ca4-675a-45b7-99d1-16a5ac9cb8c4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.564641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-788d9ca4-675a-45b7-99d1-16a5ac9cb8c4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:11.578241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-788d9ca4-675a-45b7-99d1-16a5ac9cb8c4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.579020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-788d9ca4-675a-45b7-99d1-16a5ac9cb8c4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.579892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-788d9ca4-675a-45b7-99d1-16a5ac9cb8c4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.580440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-788d9ca4-675a-45b7-99d1-16a5ac9cb8c4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.612901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:12.007527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d57a4cdd-a64b-4bab-9a42-217a297da687 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.017653 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d57a4cdd-a64b-4bab-9a42-217a297da687 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1501 microversion: 2.1 time: 0.505887 Jul 20 04:17:12.018548 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 885/1873] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:11 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1501 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:12.023823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-847c308d-f8ce-4ae0-b7ae-d5d7c9cc7d73 req-59cc7c24-89fa-472a-887e-395c4cebfe99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956609f6-9ca2-4919-988a-2b0d4a740b26", "name": "network-vif-deleted", "tag": "cdee7da2-445b-4334-89cc-1a24affa04ae"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:12.033376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-847c308d-f8ce-4ae0-b7ae-d5d7c9cc7d73 req-59cc7c24-89fa-472a-887e-395c4cebfe99 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.034097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-847c308d-f8ce-4ae0-b7ae-d5d7c9cc7d73 req-59cc7c24-89fa-472a-887e-395c4cebfe99 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.048657 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-847c308d-f8ce-4ae0-b7ae-d5d7c9cc7d73 req-59cc7c24-89fa-472a-887e-395c4cebfe99 service nova] Creating event network-vif-deleted:cdee7da2-445b-4334-89cc-1a24affa04ae for instance 956609f6-9ca2-4919-988a-2b0d4a740b26 on n-h2-764485-11 Jul 20 04:17:12.055202 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-847c308d-f8ce-4ae0-b7ae-d5d7c9cc7d73 req-59cc7c24-89fa-472a-887e-395c4cebfe99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035108 Jul 20 04:17:12.056286 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 886/1874] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:12.099351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-788d9ca4-675a-45b7-99d1-16a5ac9cb8c4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.107898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-21d537d9-3b44-4e9a-8ad5-eb78c4162c0f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.110631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-21d537d9-3b44-4e9a-8ad5-eb78c4162c0f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:12.112399 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-788d9ca4-675a-45b7-99d1-16a5ac9cb8c4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1306 microversion: 2.1 time: 0.556703 Jul 20 04:17:12.113282 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 989/1875] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:11 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1306 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:12.120797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21d537d9-3b44-4e9a-8ad5-eb78c4162c0f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.121375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21d537d9-3b44-4e9a-8ad5-eb78c4162c0f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.122137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21d537d9-3b44-4e9a-8ad5-eb78c4162c0f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.122770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21d537d9-3b44-4e9a-8ad5-eb78c4162c0f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.402541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-21d537d9-3b44-4e9a-8ad5-eb78c4162c0f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.414462 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-21d537d9-3b44-4e9a-8ad5-eb78c4162c0f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1316 microversion: 2.1 time: 0.317685 Jul 20 04:17:12.415500 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 887/1876] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:12.483862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6ef49be2-fdaa-4ed6-b639-b5ee4c9209ee req-49e63847-9150-4ec7-87b6-c928da9b757e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d86df2-0b5f-4d16-b6a5-fe16c86494fe", "name": "network-vif-plugged", "status": "completed", "tag": "a3ee1c75-0199-4fca-95d5-7a8a2a2d9a58"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:12.496448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6ef49be2-fdaa-4ed6-b639-b5ee4c9209ee req-49e63847-9150-4ec7-87b6-c928da9b757e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.496889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6ef49be2-fdaa-4ed6-b639-b5ee4c9209ee req-49e63847-9150-4ec7-87b6-c928da9b757e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.498322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b526bfc3-ab53-476d-befa-1fe8b12cfab0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.500392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b526bfc3-ab53-476d-befa-1fe8b12cfab0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:12.510150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b526bfc3-ab53-476d-befa-1fe8b12cfab0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.510686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b526bfc3-ab53-476d-befa-1fe8b12cfab0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.512385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b526bfc3-ab53-476d-befa-1fe8b12cfab0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.513209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b526bfc3-ab53-476d-befa-1fe8b12cfab0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.513946 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6ef49be2-fdaa-4ed6-b639-b5ee4c9209ee req-49e63847-9150-4ec7-87b6-c928da9b757e service nova] Creating event network-vif-plugged:a3ee1c75-0199-4fca-95d5-7a8a2a2d9a58 for instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe on n-h1-764485-11 Jul 20 04:17:12.521775 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6ef49be2-fdaa-4ed6-b639-b5ee4c9209ee req-49e63847-9150-4ec7-87b6-c928da9b757e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042707 Jul 20 04:17:12.523014 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 990/1877] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:12.529673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ee7a604f-9464-4894-9879-489589c6ae4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.531035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ee7a604f-9464-4894-9879-489589c6ae4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:12.540924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee7a604f-9464-4894-9879-489589c6ae4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.541389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee7a604f-9464-4894-9879-489589c6ae4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.542472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee7a604f-9464-4894-9879-489589c6ae4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.543096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee7a604f-9464-4894-9879-489589c6ae4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.580007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b526bfc3-ab53-476d-befa-1fe8b12cfab0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.583601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b526bfc3-ab53-476d-befa-1fe8b12cfab0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.584747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-b526bfc3-ab53-476d-befa-1fe8b12cfab0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lazy-loading 'fault' on Instance uuid 956609f6-9ca2-4919-988a-2b0d4a740b26 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:12.708789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b526bfc3-ab53-476d-befa-1fe8b12cfab0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.721659 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b526bfc3-ab53-476d-befa-1fe8b12cfab0 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 200 len: 1368 microversion: 2.1 time: 0.229412 Jul 20 04:17:12.732384 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 888/1878] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:12.871599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee7a604f-9464-4894-9879-489589c6ae4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.884316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee7a604f-9464-4894-9879-489589c6ae4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.887279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee7a604f-9464-4894-9879-489589c6ae4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.888833 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ee7a604f-9464-4894-9879-489589c6ae4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 0.364399 Jul 20 04:17:12.890852 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 991/1879] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:13.042844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5a577b0b-7d20-422e-9b58-95727d159b77 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.044051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a577b0b-7d20-422e-9b58-95727d159b77 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.055086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a577b0b-7d20-422e-9b58-95727d159b77 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.056218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a577b0b-7d20-422e-9b58-95727d159b77 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.057794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a577b0b-7d20-422e-9b58-95727d159b77 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.058879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a577b0b-7d20-422e-9b58-95727d159b77 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.135249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2fad3a1-5db2-49f8-a09d-a91d078cefbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.136407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f2fad3a1-5db2-49f8-a09d-a91d078cefbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.145073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2fad3a1-5db2-49f8-a09d-a91d078cefbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.145535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2fad3a1-5db2-49f8-a09d-a91d078cefbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.146328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2fad3a1-5db2-49f8-a09d-a91d078cefbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.146770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2fad3a1-5db2-49f8-a09d-a91d078cefbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.286874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a577b0b-7d20-422e-9b58-95727d159b77 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.294998 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5a577b0b-7d20-422e-9b58-95727d159b77 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1501 microversion: 2.1 time: 0.264568 Jul 20 04:17:13.296141 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 889/1880] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:13 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1501 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:13.329822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f2fad3a1-5db2-49f8-a09d-a91d078cefbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.337607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f2fad3a1-5db2-49f8-a09d-a91d078cefbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1306 microversion: 2.1 time: 0.207124 Jul 20 04:17:13.338199 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 992/1881] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:13 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:13.432984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ccd929a0-3731-4e47-9582-67693d2199fa tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.433716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ccd929a0-3731-4e47-9582-67693d2199fa tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.440632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ccd929a0-3731-4e47-9582-67693d2199fa tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.441467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ccd929a0-3731-4e47-9582-67693d2199fa tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.442430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ccd929a0-3731-4e47-9582-67693d2199fa tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.442872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ccd929a0-3731-4e47-9582-67693d2199fa tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.573877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-c385bb0e-8953-4402-b738-174b61f31cc3 req-d6345d8e-af9c-4c65-baec-2aa507034193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe", "name": "network-vif-unplugged", "status": "completed", "tag": "44316d0e-ff03-434b-84fc-d22fbc6f7ea6"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:13.583118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c385bb0e-8953-4402-b738-174b61f31cc3 req-d6345d8e-af9c-4c65-baec-2aa507034193 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.583900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c385bb0e-8953-4402-b738-174b61f31cc3 req-d6345d8e-af9c-4c65-baec-2aa507034193 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.601476 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c385bb0e-8953-4402-b738-174b61f31cc3 req-d6345d8e-af9c-4c65-baec-2aa507034193 service nova] Creating event network-vif-unplugged:44316d0e-ff03-434b-84fc-d22fbc6f7ea6 for instance 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe on n-h1-764485-11 Jul 20 04:17:13.605455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ccd929a0-3731-4e47-9582-67693d2199fa tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.607715 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-c385bb0e-8953-4402-b738-174b61f31cc3 req-d6345d8e-af9c-4c65-baec-2aa507034193 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037434 Jul 20 04:17:13.609848 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 993/1882] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:13.615533 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ccd929a0-3731-4e47-9582-67693d2199fa tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1316 microversion: 2.1 time: 0.186798 Jul 20 04:17:13.616297 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 890/1883] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:13 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:13.740805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ab7e019-414e-4057-ab95-b3b98c07873e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.741536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8ab7e019-414e-4057-ab95-b3b98c07873e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 956609f6-9ca2-4919-988a-2b0d4a740b26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.747900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ab7e019-414e-4057-ab95-b3b98c07873e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.748347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ab7e019-414e-4057-ab95-b3b98c07873e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.749455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ab7e019-414e-4057-ab95-b3b98c07873e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.750007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ab7e019-414e-4057-ab95-b3b98c07873e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.763395 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-8ab7e019-414e-4057-ab95-b3b98c07873e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] HTTP exception thrown: Instance 956609f6-9ca2-4919-988a-2b0d4a740b26 could not be found. Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ab7e019-414e-4057-ab95-b3b98c07873e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Request method failure captured: Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 HTTP/1.1 Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BT-RCc3LxZsq5yJpBGrnw0swM1afBk2IT6qvTcGiyvXwtp9OsZ58SG4h86KwxYp_vyKbS5JwTT2Bv2Lcz7YgQ5VG_epOkNbddsUErfW0IXh5AUbO_uupm7upqkmjWLFNen0CAfNp7_peOl4geADRnLij-EYqHdKyEgodSB1ukTn88 Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 41ba023317344d3490bdb01aa8b1e01b Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-MigrationsAdminTest-920586646 Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/41ba023317344d3490bdb01aa8b1e01b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41ba023317344d3490bdb01aa8b1e01b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_41ba023317344d3490bdb01aa8b1e01b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41ba023317344d3490bdb01aa8b1e01b"}]}] Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-MigrationsAdminTest-920586646 Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 41ba023317344d3490bdb01aa8b1e01b Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-MigrationsAdminTest-920586646 Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-MigrationsAdminTest-920586646-project Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 9aa79203e62546cea351116b153afee5 Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-MigrationsAdminTest-920586646-project Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 956609f6-9ca2-4919-988a-2b0d4a740b26 could not be found. Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '956609f6-9ca2-4919-988a-2b0d4a740b26'} Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 956609f6-9ca2-4919-988a-2b0d4a740b26 could not be found. Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 956609f6-9ca2-4919-988a-2b0d4a740b26 could not be found. Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:13.765466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:13.770036 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:13.770036 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:13.770036 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:13.770036 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:13.770036 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:13.770036 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 956609f6-9ca2-4919-988a-2b0d4a740b26 could not be found. Jul 20 04:17:13.770036 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:13.770036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ab7e019-414e-4057-ab95-b3b98c07873e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Returning 404 to user: Instance 956609f6-9ca2-4919-988a-2b0d4a740b26 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:13.770036 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8ab7e019-414e-4057-ab95-b3b98c07873e tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26" status: 404 len: 111 microversion: 2.1 time: 0.030443 Jul 20 04:17:13.770036 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 994/1884] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:13 2022] GET /compute/v2.1/servers/956609f6-9ca2-4919-988a-2b0d4a740b26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:13.775972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2a58e96d-4c94-4ea5-bdcf-cd5eb43537ff tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '.version_select at 0x7fbf9d9f91f0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.796849 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2a58e96d-4c94-4ea5-bdcf-cd5eb43537ff tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-565360267" status: 202 len: 0 microversion: 2.1 time: 0.023971 Jul 20 04:17:13.797586 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 891/1885] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 20 04:17:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-565360267 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:17:13.910606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0d8e441c-fb94-4aba-b5aa-e3f4197b0c96 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.911223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0d8e441c-fb94-4aba-b5aa-e3f4197b0c96 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.917299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d8e441c-fb94-4aba-b5aa-e3f4197b0c96 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.917744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d8e441c-fb94-4aba-b5aa-e3f4197b0c96 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.918517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d8e441c-fb94-4aba-b5aa-e3f4197b0c96 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.918953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d8e441c-fb94-4aba-b5aa-e3f4197b0c96 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.000401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1723171124", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "bcbfb113-dc60-430e-be79-be98f4f2973e"}], "block_device_mapping_v2": [{"uuid": "608a3a91-ed4e-4954-8efd-0bf3d164b82d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:14.075968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] validate_networks() for [('bcbfb113-dc60-430e-be79-be98f4f2973e', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:14.100600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d8e441c-fb94-4aba-b5aa-e3f4197b0c96 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:14.111412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d8e441c-fb94-4aba-b5aa-e3f4197b0c96 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:14.112954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d8e441c-fb94-4aba-b5aa-e3f4197b0c96 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:14.114133 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0d8e441c-fb94-4aba-b5aa-e3f4197b0c96 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 0.207920 Jul 20 04:17:14.114751 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 995/1886] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:13 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:14.313126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2f25b176-9350-417c-a0b5-45f9472600c8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.314466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2f25b176-9350-417c-a0b5-45f9472600c8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.321783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f25b176-9350-417c-a0b5-45f9472600c8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.322583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f25b176-9350-417c-a0b5-45f9472600c8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.323656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f25b176-9350-417c-a0b5-45f9472600c8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.324343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f25b176-9350-417c-a0b5-45f9472600c8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.537546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f25b176-9350-417c-a0b5-45f9472600c8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:14.544977 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2f25b176-9350-417c-a0b5-45f9472600c8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1501 microversion: 2.1 time: 0.236432 Jul 20 04:17:14.545556 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 996/1887] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1501 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:14.551035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cd44bb38-a38b-4cfc-a941-69f583847321 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.551678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cd44bb38-a38b-4cfc-a941-69f583847321 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.557509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd44bb38-a38b-4cfc-a941-69f583847321 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.557940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd44bb38-a38b-4cfc-a941-69f583847321 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.558699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd44bb38-a38b-4cfc-a941-69f583847321 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.559130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd44bb38-a38b-4cfc-a941-69f583847321 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.565362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:14.565739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:14.566226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:14.566655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:14.567096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:14.576327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.576797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.577749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.578195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.596691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Getting quotas for project 14ab6d1260864919b0f1b6d536fe65ae. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:14.602685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Getting quotas for user f94d458feafa4ec28c50a04fc2b2a1f4 and project 14ab6d1260864919b0f1b6d536fe65ae. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:14.662876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:14.664978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='608a3a91-ed4e-4954-8efd-0bf3d164b82d',volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:14.700003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cd44bb38-a38b-4cfc-a941-69f583847321 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:14.707815 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cd44bb38-a38b-4cfc-a941-69f583847321 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1485 microversion: 2.1 time: 0.160363 Jul 20 04:17:14.708636 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 997/1888] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1485 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:14.713097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c958f84-8cf3-4c10-9dab-d49ee35454e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.713682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4c958f84-8cf3-4c10-9dab-d49ee35454e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.720725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c958f84-8cf3-4c10-9dab-d49ee35454e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.721174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c958f84-8cf3-4c10-9dab-d49ee35454e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.722068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c958f84-8cf3-4c10-9dab-d49ee35454e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.722517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c958f84-8cf3-4c10-9dab-d49ee35454e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.748031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4c958f84-8cf3-4c10-9dab-d49ee35454e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:14.802164 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-efeb3783-5f5f-4ff2-8e3e-00384a09e23d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806298 Jul 20 04:17:14.803104 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 892/1889] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:17:14.807684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8bc10574-f9dd-4d1b-bf9b-5f0fe0861411 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.808548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8bc10574-f9dd-4d1b-bf9b-5f0fe0861411 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.814872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8bc10574-f9dd-4d1b-bf9b-5f0fe0861411 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.815459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8bc10574-f9dd-4d1b-bf9b-5f0fe0861411 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.816250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8bc10574-f9dd-4d1b-bf9b-5f0fe0861411 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.816657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8bc10574-f9dd-4d1b-bf9b-5f0fe0861411 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.838037 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4c958f84-8cf3-4c10-9dab-d49ee35454e6 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "DELETE /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 204 len: 0 microversion: 2.1 time: 0.127968 Jul 20 04:17:14.843620 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 998/1890] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:14 2022] DELETE /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:14.849431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f01b0981-dfe2-40ec-915c-b06dfe567fa5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:14.859524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f01b0981-dfe2-40ec-915c-b06dfe567fa5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.860148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f01b0981-dfe2-40ec-915c-b06dfe567fa5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.926861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f01b0981-dfe2-40ec-915c-b06dfe567fa5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Going to try to stop instance {{(pid=119808) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:17:14.960255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8bc10574-f9dd-4d1b-bf9b-5f0fe0861411 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:14.970567 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8bc10574-f9dd-4d1b-bf9b-5f0fe0861411 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1316 microversion: 2.1 time: 0.166529 Jul 20 04:17:14.971148 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 893/1891] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:14.983970 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f01b0981-dfe2-40ec-915c-b06dfe567fa5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "POST /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe/action" status: 202 len: 0 microversion: 2.1 time: 0.135101 Jul 20 04:17:14.987774 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 999/1892] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:14 2022] POST /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:14.987946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0521bf0-0d44-4b49-b4f7-9b3e23ef411b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.987946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e0521bf0-0d44-4b49-b4f7-9b3e23ef411b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.990082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-534cf0a7-7301-49b2-ac00-129735f33cd5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.990911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-534cf0a7-7301-49b2-ac00-129735f33cd5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.999066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-534cf0a7-7301-49b2-ac00-129735f33cd5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.999717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-534cf0a7-7301-49b2-ac00-129735f33cd5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.000652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-534cf0a7-7301-49b2-ac00-129735f33cd5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.001164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-534cf0a7-7301-49b2-ac00-129735f33cd5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.056921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e0521bf0-0d44-4b49-b4f7-9b3e23ef411b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.065091 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e0521bf0-0d44-4b49-b4f7-9b3e23ef411b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1053 microversion: 2.1 time: 0.083813 Jul 20 04:17:15.067614 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 894/1893] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1053 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:15.070477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aa6237c5-de68-4aa7-bee6-d0ca7a40def2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:15.071097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aa6237c5-de68-4aa7-bee6-d0ca7a40def2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:15.079126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa6237c5-de68-4aa7-bee6-d0ca7a40def2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.079603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa6237c5-de68-4aa7-bee6-d0ca7a40def2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.080636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa6237c5-de68-4aa7-bee6-d0ca7a40def2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.081251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa6237c5-de68-4aa7-bee6-d0ca7a40def2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.105403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:15.215375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-534cf0a7-7301-49b2-ac00-129735f33cd5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.225542 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-534cf0a7-7301-49b2-ac00-129735f33cd5 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1469 microversion: 2.1 time: 0.239677 Jul 20 04:17:15.226322 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1000/1894] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1469 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:15.235754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-813cb3bb-066d-4f74-ad45-5a719f63649d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:15.235754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-813cb3bb-066d-4f74-ad45-5a719f63649d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:15.241587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-813cb3bb-066d-4f74-ad45-5a719f63649d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.242046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-813cb3bb-066d-4f74-ad45-5a719f63649d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.242829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-813cb3bb-066d-4f74-ad45-5a719f63649d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.243267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-813cb3bb-066d-4f74-ad45-5a719f63649d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.275156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aa6237c5-de68-4aa7-bee6-d0ca7a40def2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.283642 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aa6237c5-de68-4aa7-bee6-d0ca7a40def2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.216951 Jul 20 04:17:15.284244 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 895/1895] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:15 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:15.374467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-813cb3bb-066d-4f74-ad45-5a719f63649d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.382617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-813cb3bb-066d-4f74-ad45-5a719f63649d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.384179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-813cb3bb-066d-4f74-ad45-5a719f63649d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.385342 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-813cb3bb-066d-4f74-ad45-5a719f63649d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 0.158213 Jul 20 04:17:15.385907 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1001/1896] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:15 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:15.563617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2d7bf2b7-df15-475f-905c-1ee54e64580f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:15.564274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2d7bf2b7-df15-475f-905c-1ee54e64580f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:15.571360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d7bf2b7-df15-475f-905c-1ee54e64580f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.571787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d7bf2b7-df15-475f-905c-1ee54e64580f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.572562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d7bf2b7-df15-475f-905c-1ee54e64580f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.573008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d7bf2b7-df15-475f-905c-1ee54e64580f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.702084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2d7bf2b7-df15-475f-905c-1ee54e64580f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.710134 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2d7bf2b7-df15-475f-905c-1ee54e64580f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 200 len: 1501 microversion: 2.1 time: 0.150726 Jul 20 04:17:15.710710 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 896/1897] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:15 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:15.990105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-733974c1-d932-491e-9aa0-1a3fd3c49537 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:15.990741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-733974c1-d932-491e-9aa0-1a3fd3c49537 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:15.992788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:16.003595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-733974c1-d932-491e-9aa0-1a3fd3c49537 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.004341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-733974c1-d932-491e-9aa0-1a3fd3c49537 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.005311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-733974c1-d932-491e-9aa0-1a3fd3c49537 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.005924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-733974c1-d932-491e-9aa0-1a3fd3c49537 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.083157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9a287367-9d18-4724-afc2-b24716966b26 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:16.084708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9a287367-9d18-4724-afc2-b24716966b26 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:16.091086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a287367-9d18-4724-afc2-b24716966b26 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.092066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a287367-9d18-4724-afc2-b24716966b26 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.094034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a287367-9d18-4724-afc2-b24716966b26 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.094661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a287367-9d18-4724-afc2-b24716966b26 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.243639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9a287367-9d18-4724-afc2-b24716966b26 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:16.253243 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9a287367-9d18-4724-afc2-b24716966b26 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1151 microversion: 2.1 time: 0.174314 Jul 20 04:17:16.253856 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 897/1898] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:16 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1151 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:16.259971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6155bedc-ab83-4f15-8087-5a22cfd46c8a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:16.262007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6155bedc-ab83-4f15-8087-5a22cfd46c8a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:16.269443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6155bedc-ab83-4f15-8087-5a22cfd46c8a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.270135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6155bedc-ab83-4f15-8087-5a22cfd46c8a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.271106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6155bedc-ab83-4f15-8087-5a22cfd46c8a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.271574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6155bedc-ab83-4f15-8087-5a22cfd46c8a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.381715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-733974c1-d932-491e-9aa0-1a3fd3c49537 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:16.389928 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-733974c1-d932-491e-9aa0-1a3fd3c49537 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1316 microversion: 2.1 time: 0.405451 Jul 20 04:17:16.390607 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1002/1899] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:15 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:16.396182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-057c9e2f-cd82-4bd1-ae1f-6bd57bbc4737 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:16.396860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-057c9e2f-cd82-4bd1-ae1f-6bd57bbc4737 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:16.405603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-057c9e2f-cd82-4bd1-ae1f-6bd57bbc4737 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.406386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-057c9e2f-cd82-4bd1-ae1f-6bd57bbc4737 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.407316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-057c9e2f-cd82-4bd1-ae1f-6bd57bbc4737 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.407857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-057c9e2f-cd82-4bd1-ae1f-6bd57bbc4737 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.166198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6155bedc-ab83-4f15-8087-5a22cfd46c8a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.175706 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6155bedc-ab83-4f15-8087-5a22cfd46c8a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1469 microversion: 2.1 time: 0.920166 Jul 20 04:17:17.176409 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 898/1900] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:16 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1469 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:17.181748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-06728b7f-4b9c-4de2-b2f0-5161306715e1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:17.182660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-06728b7f-4b9c-4de2-b2f0-5161306715e1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:17.190846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06728b7f-4b9c-4de2-b2f0-5161306715e1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.191191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06728b7f-4b9c-4de2-b2f0-5161306715e1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.192015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06728b7f-4b9c-4de2-b2f0-5161306715e1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.192529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06728b7f-4b9c-4de2-b2f0-5161306715e1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.426283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-057c9e2f-cd82-4bd1-ae1f-6bd57bbc4737 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.433816 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-057c9e2f-cd82-4bd1-ae1f-6bd57bbc4737 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 1.041257 Jul 20 04:17:17.434390 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1003/1901] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:16 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:17.439129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4b0ca4be-59f1-4f9a-a278-75689598179a req-aa776401-6e46-4c33-933d-1a57310ad94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1f3708-823c-49ca-8327-bfdd82211149", "name": "network-vif-deleted", "tag": "54945e39-8427-4f57-9c15-e67b3e02d8f0"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:17.448382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4b0ca4be-59f1-4f9a-a278-75689598179a req-aa776401-6e46-4c33-933d-1a57310ad94a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.448754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4b0ca4be-59f1-4f9a-a278-75689598179a req-aa776401-6e46-4c33-933d-1a57310ad94a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.463549 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4b0ca4be-59f1-4f9a-a278-75689598179a req-aa776401-6e46-4c33-933d-1a57310ad94a service nova] Creating event network-vif-deleted:54945e39-8427-4f57-9c15-e67b3e02d8f0 for instance 1e1f3708-823c-49ca-8327-bfdd82211149 on n-h2-764485-11 Jul 20 04:17:17.470312 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4b0ca4be-59f1-4f9a-a278-75689598179a req-aa776401-6e46-4c33-933d-1a57310ad94a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034508 Jul 20 04:17:17.470977 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1004/1902] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:17.478945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a92bdfa-2887-4248-b78e-354f3ebc1cae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:17.479664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3a92bdfa-2887-4248-b78e-354f3ebc1cae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:17.487990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a92bdfa-2887-4248-b78e-354f3ebc1cae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.488690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a92bdfa-2887-4248-b78e-354f3ebc1cae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.489697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a92bdfa-2887-4248-b78e-354f3ebc1cae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.490330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a92bdfa-2887-4248-b78e-354f3ebc1cae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.505562 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-3a92bdfa-2887-4248-b78e-354f3ebc1cae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a92bdfa-2887-4248-b78e-354f3ebc1cae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 HTTP/1.1 Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1e1f3708-823c-49ca-8327-bfdd82211149'} Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:17.507492 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:17.511912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:17.511912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:17.511912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:17.511912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:17.511912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:17.511912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:17:17.511912 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:17.513976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a92bdfa-2887-4248-b78e-354f3ebc1cae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:17.515364 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a92bdfa-2887-4248-b78e-354f3ebc1cae tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 404 len: 111 microversion: 2.1 time: 0.040233 Jul 20 04:17:17.516464 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1005/1903] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:17 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:17.535530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2eb71e40-16dc-4112-80cb-4d42f006f471 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:17.536258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2eb71e40-16dc-4112-80cb-4d42f006f471 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:17.542896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2eb71e40-16dc-4112-80cb-4d42f006f471 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.543676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2eb71e40-16dc-4112-80cb-4d42f006f471 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.544661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2eb71e40-16dc-4112-80cb-4d42f006f471 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.545313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2eb71e40-16dc-4112-80cb-4d42f006f471 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.566944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:17.678111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2eb71e40-16dc-4112-80cb-4d42f006f471 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.688819 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2eb71e40-16dc-4112-80cb-4d42f006f471 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1169 microversion: 2.1 time: 0.171020 Jul 20 04:17:17.699022 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1006/1904] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:17 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1169 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:17.705703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ca46d4b6-4a22-444a-a7c9-c80b63214973 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:17.706636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca46d4b6-4a22-444a-a7c9-c80b63214973 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:17.713973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca46d4b6-4a22-444a-a7c9-c80b63214973 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.714781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca46d4b6-4a22-444a-a7c9-c80b63214973 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.715808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca46d4b6-4a22-444a-a7c9-c80b63214973 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.716467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca46d4b6-4a22-444a-a7c9-c80b63214973 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.837130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-06728b7f-4b9c-4de2-b2f0-5161306715e1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.852930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-06728b7f-4b9c-4de2-b2f0-5161306715e1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.856209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-06728b7f-4b9c-4de2-b2f0-5161306715e1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.858724 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-06728b7f-4b9c-4de2-b2f0-5161306715e1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1567 microversion: 2.25 time: 0.680542 Jul 20 04:17:17.860939 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 899/1905] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:17 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1567 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:17.866652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2137607222", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2f1733ae-f5aa-4d8e-b430-1f99c985f6d9"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:17.929452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] validate_networks() for [('2f1733ae-f5aa-4d8e-b430-1f99c985f6d9', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:18.352078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ca46d4b6-4a22-444a-a7c9-c80b63214973 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.364663 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ca46d4b6-4a22-444a-a7c9-c80b63214973 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1316 microversion: 2.1 time: 0.663556 Jul 20 04:17:18.365610 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1007/1906] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:17 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1316 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:18.371796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d34177ed-2045-4b73-9d31-a7863f590f15 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.371796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d34177ed-2045-4b73-9d31-a7863f590f15 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:18.397011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d34177ed-2045-4b73-9d31-a7863f590f15 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.397475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d34177ed-2045-4b73-9d31-a7863f590f15 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.398445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d34177ed-2045-4b73-9d31-a7863f590f15 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.398898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d34177ed-2045-4b73-9d31-a7863f590f15 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.864606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d34177ed-2045-4b73-9d31-a7863f590f15 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.873606 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d34177ed-2045-4b73-9d31-a7863f590f15 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 200 len: 1469 microversion: 2.1 time: 0.506504 Jul 20 04:17:18.874662 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1008/1907] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:18 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 1469 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:18.880474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e2d92781-c17f-49f7-ae6b-55aa5586b88c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.881348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e2d92781-c17f-49f7-ae6b-55aa5586b88c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:18.887979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2d92781-c17f-49f7-ae6b-55aa5586b88c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.888775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2d92781-c17f-49f7-ae6b-55aa5586b88c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.890444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2d92781-c17f-49f7-ae6b-55aa5586b88c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.890979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2d92781-c17f-49f7-ae6b-55aa5586b88c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.276467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e2d92781-c17f-49f7-ae6b-55aa5586b88c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:19.296320 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e2d92781-c17f-49f7-ae6b-55aa5586b88c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.419424 Jul 20 04:17:19.297809 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1009/1908] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:18 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:19.304956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8925cd81-41e8-4e37-8311-ca78ff89700e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.305841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8925cd81-41e8-4e37-8311-ca78ff89700e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:19.313409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8925cd81-41e8-4e37-8311-ca78ff89700e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.314261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8925cd81-41e8-4e37-8311-ca78ff89700e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.315249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8925cd81-41e8-4e37-8311-ca78ff89700e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.315920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8925cd81-41e8-4e37-8311-ca78ff89700e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.333761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:19.334599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:19.335106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:19.335719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:19.336153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:19.367266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.369292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.373176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.374375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.417464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:19.425350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for user 793c626644204dc3a08ed9118c9aaf4c and project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:19.446926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:19.448639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:19.451766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:19.521348 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a1117d4c-458c-4394-9c07-978bca3be864 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659017 Jul 20 04:17:19.525745 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 900/1909] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:17:19.535650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5a1a9c6d-2f31-4d4e-9c55-b7cf20443261 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.536599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a1a9c6d-2f31-4d4e-9c55-b7cf20443261 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:19.546539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a1a9c6d-2f31-4d4e-9c55-b7cf20443261 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.547227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a1a9c6d-2f31-4d4e-9c55-b7cf20443261 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.548286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a1a9c6d-2f31-4d4e-9c55-b7cf20443261 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.549519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a1a9c6d-2f31-4d4e-9c55-b7cf20443261 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.106143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a1a9c6d-2f31-4d4e-9c55-b7cf20443261 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.121972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a1a9c6d-2f31-4d4e-9c55-b7cf20443261 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.125207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a1a9c6d-2f31-4d4e-9c55-b7cf20443261 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.126694 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5a1a9c6d-2f31-4d4e-9c55-b7cf20443261 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1557 microversion: 2.25 time: 0.599684 Jul 20 04:17:20.131807 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 901/1910] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1557 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:20.138624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ecb30eb0-49c5-46db-8a8a-a10c56e6bd86 req-873c7ac4-75e6-42a3-8498-ec2a0fcd53b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906f54b8-7d83-4249-8ba0-338f5f9e84db", "name": "network-vif-deleted", "tag": "00cbe8c3-ad37-4de6-b8a0-f0227bf8bde6"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:20.150141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8925cd81-41e8-4e37-8311-ca78ff89700e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.157235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ecb30eb0-49c5-46db-8a8a-a10c56e6bd86 req-873c7ac4-75e6-42a3-8498-ec2a0fcd53b8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.157780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ecb30eb0-49c5-46db-8a8a-a10c56e6bd86 req-873c7ac4-75e6-42a3-8498-ec2a0fcd53b8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.180084 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ecb30eb0-49c5-46db-8a8a-a10c56e6bd86 req-873c7ac4-75e6-42a3-8498-ec2a0fcd53b8 service nova] Creating event network-vif-deleted:00cbe8c3-ad37-4de6-b8a0-f0227bf8bde6 for instance 906f54b8-7d83-4249-8ba0-338f5f9e84db on n-h1-764485-11 Jul 20 04:17:20.198263 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8925cd81-41e8-4e37-8311-ca78ff89700e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1211 microversion: 2.1 time: 0.899056 Jul 20 04:17:20.202355 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1010/1911] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1211 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:20.209784 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ecb30eb0-49c5-46db-8a8a-a10c56e6bd86 req-873c7ac4-75e6-42a3-8498-ec2a0fcd53b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076446 Jul 20 04:17:20.210404 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 902/1912] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:20.211611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b10cbae-b32e-4519-b6e6-98839a056824 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.212459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b10cbae-b32e-4519-b6e6-98839a056824 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:20.220333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a04205f1-8a62-47b7-b390-fa44af76b36f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.221052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a04205f1-8a62-47b7-b390-fa44af76b36f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:20.226531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b10cbae-b32e-4519-b6e6-98839a056824 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.227775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b10cbae-b32e-4519-b6e6-98839a056824 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.235627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b10cbae-b32e-4519-b6e6-98839a056824 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.236918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b10cbae-b32e-4519-b6e6-98839a056824 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.466558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a04205f1-8a62-47b7-b390-fa44af76b36f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.476037 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a04205f1-8a62-47b7-b390-fa44af76b36f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1215 microversion: 2.1 time: 0.264382 Jul 20 04:17:20.477013 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 903/1913] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1215 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:20.509164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-305b33ed-a82a-4194-a5f0-4f76939df748 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.509867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-305b33ed-a82a-4194-a5f0-4f76939df748 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 906f54b8-7d83-4249-8ba0-338f5f9e84db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:20.511236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b10cbae-b32e-4519-b6e6-98839a056824 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.517797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-305b33ed-a82a-4194-a5f0-4f76939df748 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.518259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-305b33ed-a82a-4194-a5f0-4f76939df748 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.521614 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b10cbae-b32e-4519-b6e6-98839a056824 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1316 microversion: 2.1 time: 0.317420 Jul 20 04:17:20.522420 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1011/1914] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:20.524468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-305b33ed-a82a-4194-a5f0-4f76939df748 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.524929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-305b33ed-a82a-4194-a5f0-4f76939df748 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.527983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-32af1238-75aa-4aa5-96d1-baa5d99287f4 req-b72b85ff-aaa4-40ac-946d-0561da2f6274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcccdd82-e3d1-4d66-aefc-657ce896eaf8", "name": "network-vif-plugged", "status": "completed", "tag": "6ccd2eda-880b-42ac-af0e-bb1e18b48e69"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:20.538436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-32af1238-75aa-4aa5-96d1-baa5d99287f4 req-b72b85ff-aaa4-40ac-946d-0561da2f6274 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.539176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-32af1238-75aa-4aa5-96d1-baa5d99287f4 req-b72b85ff-aaa4-40ac-946d-0561da2f6274 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.551148 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-305b33ed-a82a-4194-a5f0-4f76939df748 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] HTTP exception thrown: Instance 906f54b8-7d83-4249-8ba0-338f5f9e84db could not be found. Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-305b33ed-a82a-4194-a5f0-4f76939df748 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Request method failure captured: Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db HTTP/1.1 Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BT-RCc3LxZsq5yJpBGrnw0swM1afBk2IT6qvTcGiyvXwtp9OsZ58SG4h86KwxYp_vyKbS5JwTT2Bv2Lcz7YgQ5VG_epOkNbddsUErfW0IXh5AUbO_uupm7upqkmjWLFNen0CAfNp7_peOl4geADRnLij-EYqHdKyEgodSB1ukTn88 Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 41ba023317344d3490bdb01aa8b1e01b Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-MigrationsAdminTest-920586646 Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/41ba023317344d3490bdb01aa8b1e01b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41ba023317344d3490bdb01aa8b1e01b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_41ba023317344d3490bdb01aa8b1e01b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41ba023317344d3490bdb01aa8b1e01b"}]}] Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-MigrationsAdminTest-920586646 Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 41ba023317344d3490bdb01aa8b1e01b Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-MigrationsAdminTest-920586646 Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-MigrationsAdminTest-920586646-project Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 9aa79203e62546cea351116b153afee5 Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-MigrationsAdminTest-920586646-project Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 906f54b8-7d83-4249-8ba0-338f5f9e84db could not be found. Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '906f54b8-7d83-4249-8ba0-338f5f9e84db'} Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906f54b8-7d83-4249-8ba0-338f5f9e84db could not be found. Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906f54b8-7d83-4249-8ba0-338f5f9e84db could not be found. Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:20.553877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:20.559780 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:20.559780 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:20.559780 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:20.559780 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:20.559780 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:20.559780 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906f54b8-7d83-4249-8ba0-338f5f9e84db could not be found. Jul 20 04:17:20.559780 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:20.559780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-305b33ed-a82a-4194-a5f0-4f76939df748 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Returning 404 to user: Instance 906f54b8-7d83-4249-8ba0-338f5f9e84db could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:20.560452 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-305b33ed-a82a-4194-a5f0-4f76939df748 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db" status: 404 len: 111 microversion: 2.1 time: 0.071136 Jul 20 04:17:20.561477 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 904/1915] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/servers/906f54b8-7d83-4249-8ba0-338f5f9e84db => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:20.566192 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-32af1238-75aa-4aa5-96d1-baa5d99287f4 req-b72b85ff-aaa4-40ac-946d-0561da2f6274 service nova] Creating event network-vif-plugged:6ccd2eda-880b-42ac-af0e-bb1e18b48e69 for instance bcccdd82-e3d1-4d66-aefc-657ce896eaf8 on n-h2-764485-11 Jul 20 04:17:20.568457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e430abd-e43a-4069-96a4-2293b1bb482c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '.version_select at 0x7fbf9db22a60>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.573540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-32af1238-75aa-4aa5-96d1-baa5d99287f4 req-b72b85ff-aaa4-40ac-946d-0561da2f6274 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049635 Jul 20 04:17:20.574864 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1012/1916] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:20.581767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-20a35386-189d-4ee5-bd65-5be021bd8214 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.582664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-20a35386-189d-4ee5-bd65-5be021bd8214 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:20.583737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e430abd-e43a-4069-96a4-2293b1bb482c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.584209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e430abd-e43a-4069-96a4-2293b1bb482c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.591688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20a35386-189d-4ee5-bd65-5be021bd8214 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.592485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20a35386-189d-4ee5-bd65-5be021bd8214 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.594302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20a35386-189d-4ee5-bd65-5be021bd8214 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.595024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20a35386-189d-4ee5-bd65-5be021bd8214 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.596234 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7e430abd-e43a-4069-96a4-2293b1bb482c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2140 microversion: 2.25 time: 0.031534 Jul 20 04:17:20.597250 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 905/1917] 10.222.0.20 () {60 vars in 1183 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/os-migrations => generated 2140 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:20.602196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-79ed6d9e-da74-4363-a0ce-0d25309c623d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.602749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-79ed6d9e-da74-4363-a0ce-0d25309c623d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:20.612403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79ed6d9e-da74-4363-a0ce-0d25309c623d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.612857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79ed6d9e-da74-4363-a0ce-0d25309c623d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.613637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79ed6d9e-da74-4363-a0ce-0d25309c623d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.614072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79ed6d9e-da74-4363-a0ce-0d25309c623d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.649526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-79ed6d9e-da74-4363-a0ce-0d25309c623d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:20.741323 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-79ed6d9e-da74-4363-a0ce-0d25309c623d tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 204 len: 0 microversion: 2.1 time: 0.142632 Jul 20 04:17:20.745442 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 906/1918] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:20 2022] DELETE /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:20.750334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d9ae37a3-11e7-478e-9bf4-c64476336057 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.751429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d9ae37a3-11e7-478e-9bf4-c64476336057 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:20.758209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9ae37a3-11e7-478e-9bf4-c64476336057 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.758804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9ae37a3-11e7-478e-9bf4-c64476336057 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.759764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9ae37a3-11e7-478e-9bf4-c64476336057 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.760685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9ae37a3-11e7-478e-9bf4-c64476336057 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.899967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-20a35386-189d-4ee5-bd65-5be021bd8214 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.908184 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-20a35386-189d-4ee5-bd65-5be021bd8214 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.331831 Jul 20 04:17:20.909036 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1013/1919] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:20.914645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6dfb0e8a-cb39-4063-a4bb-3e226f5a2a7a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.915282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6dfb0e8a-cb39-4063-a4bb-3e226f5a2a7a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:20.922232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dfb0e8a-cb39-4063-a4bb-3e226f5a2a7a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.922883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dfb0e8a-cb39-4063-a4bb-3e226f5a2a7a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.923862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dfb0e8a-cb39-4063-a4bb-3e226f5a2a7a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.924460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dfb0e8a-cb39-4063-a4bb-3e226f5a2a7a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.013474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-d9ae37a3-11e7-478e-9bf4-c64476336057 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:21.028985 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d9ae37a3-11e7-478e-9bf4-c64476336057 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 2051 microversion: 2.25 time: 0.284142 Jul 20 04:17:21.031563 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 907/1920] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 2051 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:21.193433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-280678932", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "13fc6880-4fac-4a39-af23-98e984a520f4"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:21.268165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] validate_networks() for [('13fc6880-4fac-4a39-af23-98e984a520f4', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:21.352699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6dfb0e8a-cb39-4063-a4bb-3e226f5a2a7a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:21.364216 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6dfb0e8a-cb39-4063-a4bb-3e226f5a2a7a tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1469 microversion: 2.1 time: 0.453592 Jul 20 04:17:21.365528 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1014/1921] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1469 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:21.370980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-569515e9-052a-4de8-baa3-46783e006bba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:21.371663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-569515e9-052a-4de8-baa3-46783e006bba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:21.379655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-569515e9-052a-4de8-baa3-46783e006bba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.380116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-569515e9-052a-4de8-baa3-46783e006bba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.382145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-569515e9-052a-4de8-baa3-46783e006bba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.382938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-569515e9-052a-4de8-baa3-46783e006bba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.685397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-569515e9-052a-4de8-baa3-46783e006bba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:21.696802 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-569515e9-052a-4de8-baa3-46783e006bba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1211 microversion: 2.1 time: 0.330008 Jul 20 04:17:21.697592 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1015/1922] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:21 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1211 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:21.705577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21e69c1a-b865-442b-9c3b-6016c6e80048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:21.706623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21e69c1a-b865-442b-9c3b-6016c6e80048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:21.720446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21e69c1a-b865-442b-9c3b-6016c6e80048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.721384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21e69c1a-b865-442b-9c3b-6016c6e80048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.723213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21e69c1a-b865-442b-9c3b-6016c6e80048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.723860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21e69c1a-b865-442b-9c3b-6016c6e80048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.886673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-21e69c1a-b865-442b-9c3b-6016c6e80048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:21.895538 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21e69c1a-b865-442b-9c3b-6016c6e80048 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1267 microversion: 2.1 time: 0.196297 Jul 20 04:17:21.900461 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1016/1923] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:21 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:21.909355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cce34d43-c497-4b92-a94f-19c4a2c1896e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:21.909980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cce34d43-c497-4b92-a94f-19c4a2c1896e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:21.927805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cce34d43-c497-4b92-a94f-19c4a2c1896e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.930777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cce34d43-c497-4b92-a94f-19c4a2c1896e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.931790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cce34d43-c497-4b92-a94f-19c4a2c1896e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.932549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cce34d43-c497-4b92-a94f-19c4a2c1896e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.470749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:22.472193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:22.473021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:22.474055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:22.474816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:22.490412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.490879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.496814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cce34d43-c497-4b92-a94f-19c4a2c1896e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:22.506952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.511665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.516731 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cce34d43-c497-4b92-a94f-19c4a2c1896e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1316 microversion: 2.1 time: 0.611811 Jul 20 04:17:22.518847 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1017/1924] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:21 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:22.540534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0218932a-d675-4e88-a8be-0b23b604707c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:22.542506 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0218932a-d675-4e88-a8be-0b23b604707c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:22.560559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0218932a-d675-4e88-a8be-0b23b604707c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.561203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0218932a-d675-4e88-a8be-0b23b604707c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.566008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0218932a-d675-4e88-a8be-0b23b604707c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.566475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0218932a-d675-4e88-a8be-0b23b604707c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.572195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Getting quotas for project 5181d3786af0422c928fa68ae1fd3956. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:22.595057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Getting quotas for user b63f54e61ef144968f6c8d9cfb954c8f and project 5181d3786af0422c928fa68ae1fd3956. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:22.643542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:22.648698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:22.720158 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fbad19b1-dc63-4bc5-ae6d-95794a303a1d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.531852 Jul 20 04:17:22.721019 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 908/1925] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:17:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:17:22.726569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b540641e-bdd1-4244-9311-abc5f58c7632 req-47dab8f0-92fb-4916-aaa4-2347a6e3ddbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838c7de4-25f3-481a-b89f-6562178ccce0", "tag": "64e34bf8-7b7e-45eb-acd2-804013d49abe"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:22.736119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b540641e-bdd1-4244-9311-abc5f58c7632 req-47dab8f0-92fb-4916-aaa4-2347a6e3ddbc service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.736829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b540641e-bdd1-4244-9311-abc5f58c7632 req-47dab8f0-92fb-4916-aaa4-2347a6e3ddbc service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.749788 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b540641e-bdd1-4244-9311-abc5f58c7632 req-47dab8f0-92fb-4916-aaa4-2347a6e3ddbc service nova] Creating event network-changed:64e34bf8-7b7e-45eb-acd2-804013d49abe for instance 838c7de4-25f3-481a-b89f-6562178ccce0 on n-h1-764485-11 Jul 20 04:17:22.757119 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b540641e-bdd1-4244-9311-abc5f58c7632 req-47dab8f0-92fb-4916-aaa4-2347a6e3ddbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034621 Jul 20 04:17:22.758695 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 909/1926] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:22.765907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e107a3a5-c513-4b61-a9e6-1f445d1e1f00 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:22.766797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e107a3a5-c513-4b61-a9e6-1f445d1e1f00 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:22.778535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e107a3a5-c513-4b61-a9e6-1f445d1e1f00 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.779386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e107a3a5-c513-4b61-a9e6-1f445d1e1f00 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.780790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e107a3a5-c513-4b61-a9e6-1f445d1e1f00 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.781623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e107a3a5-c513-4b61-a9e6-1f445d1e1f00 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.049169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0218932a-d675-4e88-a8be-0b23b604707c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.057790 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0218932a-d675-4e88-a8be-0b23b604707c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.535412 Jul 20 04:17:23.058937 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1018/1927] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:22 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:23.064849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-06b6a713-ffd5-49de-8d95-7fe9b99e8283 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:23.065465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-06b6a713-ffd5-49de-8d95-7fe9b99e8283 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:23.080741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06b6a713-ffd5-49de-8d95-7fe9b99e8283 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.081199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06b6a713-ffd5-49de-8d95-7fe9b99e8283 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.081991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06b6a713-ffd5-49de-8d95-7fe9b99e8283 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.082447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06b6a713-ffd5-49de-8d95-7fe9b99e8283 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.163736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e107a3a5-c513-4b61-a9e6-1f445d1e1f00 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.179344 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e107a3a5-c513-4b61-a9e6-1f445d1e1f00 tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1469 microversion: 2.1 time: 0.418655 Jul 20 04:17:23.181300 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 910/1928] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:22 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1469 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:23.187921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-268e9382-66a7-44c5-9455-043769f81566 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:23.188728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-268e9382-66a7-44c5-9455-043769f81566 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:23.268596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-268e9382-66a7-44c5-9455-043769f81566 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.283648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-268e9382-66a7-44c5-9455-043769f81566 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.304367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-268e9382-66a7-44c5-9455-043769f81566 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.306582 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-268e9382-66a7-44c5-9455-043769f81566 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1261 microversion: 2.25 time: 0.123970 Jul 20 04:17:23.313200 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 911/1929] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:23 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1261 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:23.331156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b6ec3ff8-e2de-4b5d-87c3-fd4f3819f72b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:23.332320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b6ec3ff8-e2de-4b5d-87c3-fd4f3819f72b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:23.345730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6ec3ff8-e2de-4b5d-87c3-fd4f3819f72b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.346296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6ec3ff8-e2de-4b5d-87c3-fd4f3819f72b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.347091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6ec3ff8-e2de-4b5d-87c3-fd4f3819f72b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.352020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6ec3ff8-e2de-4b5d-87c3-fd4f3819f72b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.409803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-06b6a713-ffd5-49de-8d95-7fe9b99e8283 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.417334 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-06b6a713-ffd5-49de-8d95-7fe9b99e8283 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1199 microversion: 2.1 time: 0.357270 Jul 20 04:17:23.418109 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1019/1930] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:23 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1199 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:23.527160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b6ec3ff8-e2de-4b5d-87c3-fd4f3819f72b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.534073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a25a73b3-1edb-4e01-a80b-589d4ed6d7e7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:23.534686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a25a73b3-1edb-4e01-a80b-589d4ed6d7e7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:23.535425 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b6ec3ff8-e2de-4b5d-87c3-fd4f3819f72b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1315 microversion: 2.1 time: 0.219786 Jul 20 04:17:23.540986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a25a73b3-1edb-4e01-a80b-589d4ed6d7e7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.541434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a25a73b3-1edb-4e01-a80b-589d4ed6d7e7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.542200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a25a73b3-1edb-4e01-a80b-589d4ed6d7e7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.542637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a25a73b3-1edb-4e01-a80b-589d4ed6d7e7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.545017 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 912/1931] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:23 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:23.726726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a25a73b3-1edb-4e01-a80b-589d4ed6d7e7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.736205 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a25a73b3-1edb-4e01-a80b-589d4ed6d7e7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1316 microversion: 2.1 time: 0.206330 Jul 20 04:17:23.736790 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1020/1932] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:23 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:23.944705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-5f1b8ea4-a7ac-4c82-a654-f2b6fd0426aa req-b2e7aa41-9877-4252-9162-1e55b1609c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf4efd9-d89f-4775-adb9-fb25596bcd90", "tag": "5e4d8f7c-c8ab-4712-8ae2-7d6d6b1b7917"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:23.955769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5f1b8ea4-a7ac-4c82-a654-f2b6fd0426aa req-b2e7aa41-9877-4252-9162-1e55b1609c5c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.956223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5f1b8ea4-a7ac-4c82-a654-f2b6fd0426aa req-b2e7aa41-9877-4252-9162-1e55b1609c5c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.970022 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-5f1b8ea4-a7ac-4c82-a654-f2b6fd0426aa req-b2e7aa41-9877-4252-9162-1e55b1609c5c service nova] Creating event network-changed:5e4d8f7c-c8ab-4712-8ae2-7d6d6b1b7917 for instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 on n-h2-764485-11 Jul 20 04:17:23.974876 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-5f1b8ea4-a7ac-4c82-a654-f2b6fd0426aa req-b2e7aa41-9877-4252-9162-1e55b1609c5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036061 Jul 20 04:17:23.975576 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 913/1933] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:24.077407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a8369d50-51fd-42d8-9726-e0068adf2f06 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.078028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a8369d50-51fd-42d8-9726-e0068adf2f06 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:24.084929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8369d50-51fd-42d8-9726-e0068adf2f06 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.085382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8369d50-51fd-42d8-9726-e0068adf2f06 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.086151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8369d50-51fd-42d8-9726-e0068adf2f06 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.086777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8369d50-51fd-42d8-9726-e0068adf2f06 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.199171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9e41dff-b461-488c-bef1-17abf74ba79f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.200174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a9e41dff-b461-488c-bef1-17abf74ba79f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:24.216711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e41dff-b461-488c-bef1-17abf74ba79f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.217254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e41dff-b461-488c-bef1-17abf74ba79f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.218337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e41dff-b461-488c-bef1-17abf74ba79f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.218977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e41dff-b461-488c-bef1-17abf74ba79f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.252857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a8369d50-51fd-42d8-9726-e0068adf2f06 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.261545 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a8369d50-51fd-42d8-9726-e0068adf2f06 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.188621 Jul 20 04:17:24.262569 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1021/1934] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:24.275543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e41dff-b461-488c-bef1-17abf74ba79f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.276021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e41dff-b461-488c-bef1-17abf74ba79f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.276629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-a9e41dff-b461-488c-bef1-17abf74ba79f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lazy-loading 'fault' on Instance uuid 3434c2d3-9cb3-4688-8374-91f655cb9214 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:24.321965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a9e41dff-b461-488c-bef1-17abf74ba79f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa79203e62546cea351116b153afee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ba023317344d3490bdb01aa8b1e01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.326634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c9cb0554-f0ed-487e-b64b-57802d2b0848 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.329171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c9cb0554-f0ed-487e-b64b-57802d2b0848 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:24.330290 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a9e41dff-b461-488c-bef1-17abf74ba79f tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 200 len: 1303 microversion: 2.1 time: 0.135625 Jul 20 04:17:24.331097 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 914/1935] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:24.336778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9cb0554-f0ed-487e-b64b-57802d2b0848 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.337336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9cb0554-f0ed-487e-b64b-57802d2b0848 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.338119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9cb0554-f0ed-487e-b64b-57802d2b0848 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.338579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9cb0554-f0ed-487e-b64b-57802d2b0848 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.416241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c9cb0554-f0ed-487e-b64b-57802d2b0848 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.434849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c9cb0554-f0ed-487e-b64b-57802d2b0848 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.437469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c9cb0554-f0ed-487e-b64b-57802d2b0848 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.437716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-efc450d6-0e27-4f0a-b510-b6108bb5b76b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.438677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-efc450d6-0e27-4f0a-b510-b6108bb5b76b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:24.439005 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c9cb0554-f0ed-487e-b64b-57802d2b0848 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1265 microversion: 2.25 time: 0.117852 Jul 20 04:17:24.441086 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1022/1936] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:24.449466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-efc450d6-0e27-4f0a-b510-b6108bb5b76b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.450017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-efc450d6-0e27-4f0a-b510-b6108bb5b76b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.450958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-efc450d6-0e27-4f0a-b510-b6108bb5b76b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.451553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-efc450d6-0e27-4f0a-b510-b6108bb5b76b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.555584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c12b9083-3f1c-4b8d-a58f-44ffef046bc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.557243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c12b9083-3f1c-4b8d-a58f-44ffef046bc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:24.567274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c12b9083-3f1c-4b8d-a58f-44ffef046bc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.567984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c12b9083-3f1c-4b8d-a58f-44ffef046bc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.569739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c12b9083-3f1c-4b8d-a58f-44ffef046bc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.570524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c12b9083-3f1c-4b8d-a58f-44ffef046bc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.708604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-efc450d6-0e27-4f0a-b510-b6108bb5b76b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.718949 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-efc450d6-0e27-4f0a-b510-b6108bb5b76b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1199 microversion: 2.1 time: 0.286405 Jul 20 04:17:24.719932 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 915/1937] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1199 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:24.754725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7611121a-efa5-4be3-a0c3-0e7954bffc2b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.755248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7611121a-efa5-4be3-a0c3-0e7954bffc2b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:24.758218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c12b9083-3f1c-4b8d-a58f-44ffef046bc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.762215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7611121a-efa5-4be3-a0c3-0e7954bffc2b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.762914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:24.763088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7611121a-efa5-4be3-a0c3-0e7954bffc2b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.763737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7611121a-efa5-4be3-a0c3-0e7954bffc2b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.764556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7611121a-efa5-4be3-a0c3-0e7954bffc2b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.768815 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c12b9083-3f1c-4b8d-a58f-44ffef046bc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1315 microversion: 2.1 time: 0.219406 Jul 20 04:17:24.769661 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1023/1938] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:24.786571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:24.799237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-426dcf0d-51b8-4302-b160-bde7641fa259 req-e4881444-ded3-438e-9153-d20d8b3e6121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3434c2d3-9cb3-4688-8374-91f655cb9214", "name": "network-vif-deleted", "tag": "44b6c604-ac5e-4cec-9cac-9977a72935b5"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:24.808513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-426dcf0d-51b8-4302-b160-bde7641fa259 req-e4881444-ded3-438e-9153-d20d8b3e6121 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.808853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-426dcf0d-51b8-4302-b160-bde7641fa259 req-e4881444-ded3-438e-9153-d20d8b3e6121 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.822651 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-426dcf0d-51b8-4302-b160-bde7641fa259 req-e4881444-ded3-438e-9153-d20d8b3e6121 service nova] Creating event network-vif-deleted:44b6c604-ac5e-4cec-9cac-9977a72935b5 for instance 3434c2d3-9cb3-4688-8374-91f655cb9214 on n-h2-764485-11 Jul 20 04:17:24.828705 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-426dcf0d-51b8-4302-b160-bde7641fa259 req-e4881444-ded3-438e-9153-d20d8b3e6121 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033852 Jul 20 04:17:24.829952 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1024/1939] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:25.283468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e5378315-9be9-40eb-8b20-1c10ed2ffcc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:25.284370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e5378315-9be9-40eb-8b20-1c10ed2ffcc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:25.292229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5378315-9be9-40eb-8b20-1c10ed2ffcc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.293007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5378315-9be9-40eb-8b20-1c10ed2ffcc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.293992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5378315-9be9-40eb-8b20-1c10ed2ffcc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.294434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5378315-9be9-40eb-8b20-1c10ed2ffcc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.482354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7611121a-efa5-4be3-a0c3-0e7954bffc2b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.491256 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7611121a-efa5-4be3-a0c3-0e7954bffc2b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1503 microversion: 2.1 time: 0.740569 Jul 20 04:17:25.491880 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 916/1940] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1503 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:25.496464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b85dd515-02a6-47d2-8470-c71b027d490c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:25.497134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b85dd515-02a6-47d2-8470-c71b027d490c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] [instance: 3434c2d3-9cb3-4688-8374-91f655cb9214] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:25.503820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b85dd515-02a6-47d2-8470-c71b027d490c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.504588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b85dd515-02a6-47d2-8470-c71b027d490c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.505282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b85dd515-02a6-47d2-8470-c71b027d490c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.505735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b85dd515-02a6-47d2-8470-c71b027d490c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.520002 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b85dd515-02a6-47d2-8470-c71b027d490c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] HTTP exception thrown: Instance 3434c2d3-9cb3-4688-8374-91f655cb9214 could not be found. Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b85dd515-02a6-47d2-8470-c71b027d490c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Request method failure captured: Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 HTTP/1.1 Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BT-RCc3LxZsq5yJpBGrnw0swM1afBk2IT6qvTcGiyvXwtp9OsZ58SG4h86KwxYp_vyKbS5JwTT2Bv2Lcz7YgQ5VG_epOkNbddsUErfW0IXh5AUbO_uupm7upqkmjWLFNen0CAfNp7_peOl4geADRnLij-EYqHdKyEgodSB1ukTn88 Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 41ba023317344d3490bdb01aa8b1e01b Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-MigrationsAdminTest-920586646 Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/41ba023317344d3490bdb01aa8b1e01b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41ba023317344d3490bdb01aa8b1e01b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_41ba023317344d3490bdb01aa8b1e01b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41ba023317344d3490bdb01aa8b1e01b"}]}] Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-MigrationsAdminTest-920586646 Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 41ba023317344d3490bdb01aa8b1e01b Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-MigrationsAdminTest-920586646 Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-MigrationsAdminTest-920586646-project Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 9aa79203e62546cea351116b153afee5 Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-MigrationsAdminTest-920586646-project Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 3434c2d3-9cb3-4688-8374-91f655cb9214 could not be found. Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '3434c2d3-9cb3-4688-8374-91f655cb9214'} Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3434c2d3-9cb3-4688-8374-91f655cb9214 could not be found. Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3434c2d3-9cb3-4688-8374-91f655cb9214 could not be found. Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:25.521700 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:25.528458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:25.528458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:25.528458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:25.528458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:25.528458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:25.528458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3434c2d3-9cb3-4688-8374-91f655cb9214 could not be found. Jul 20 04:17:25.528458 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:25.528458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b85dd515-02a6-47d2-8470-c71b027d490c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] Returning 404 to user: Instance 3434c2d3-9cb3-4688-8374-91f655cb9214 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:25.528458 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b85dd515-02a6-47d2-8470-c71b027d490c tempest-MigrationsAdminTest-920586646 tempest-MigrationsAdminTest-920586646-project] 10.222.0.20 "GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214" status: 404 len: 111 microversion: 2.1 time: 0.030289 Jul 20 04:17:25.528458 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 917/1941] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:25 2022] GET /compute/v2.1/servers/3434c2d3-9cb3-4688-8374-91f655cb9214 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:25.535285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2eec8a73-6cc0-41e5-a733-4394dc1e46d5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:25.535940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2eec8a73-6cc0-41e5-a733-4394dc1e46d5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:25.543241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eec8a73-6cc0-41e5-a733-4394dc1e46d5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.543752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eec8a73-6cc0-41e5-a733-4394dc1e46d5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.544514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eec8a73-6cc0-41e5-a733-4394dc1e46d5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.544953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eec8a73-6cc0-41e5-a733-4394dc1e46d5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.707791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2eec8a73-6cc0-41e5-a733-4394dc1e46d5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.716445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2eec8a73-6cc0-41e5-a733-4394dc1e46d5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.720258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2eec8a73-6cc0-41e5-a733-4394dc1e46d5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.721603 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2eec8a73-6cc0-41e5-a733-4394dc1e46d5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1319 microversion: 2.25 time: 0.197042 Jul 20 04:17:25.722484 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 918/1942] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:25 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:25.736504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e5378315-9be9-40eb-8b20-1c10ed2ffcc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.738271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-66cf27e7-7995-42e6-a4df-d25dfb655602 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1363041191"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:25.738907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-66cf27e7-7995-42e6-a4df-d25dfb655602 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:25.747052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66cf27e7-7995-42e6-a4df-d25dfb655602 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.747842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66cf27e7-7995-42e6-a4df-d25dfb655602 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.748758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66cf27e7-7995-42e6-a4df-d25dfb655602 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.749594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66cf27e7-7995-42e6-a4df-d25dfb655602 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.750735 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e5378315-9be9-40eb-8b20-1c10ed2ffcc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.474174 Jul 20 04:17:25.760801 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1025/1943] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:25 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:25.767806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6b0bebca-27bf-412b-9bc1-4a8aba72b07c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:25.768659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6b0bebca-27bf-412b-9bc1-4a8aba72b07c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:25.775121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b0bebca-27bf-412b-9bc1-4a8aba72b07c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.776240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b0bebca-27bf-412b-9bc1-4a8aba72b07c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.777217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b0bebca-27bf-412b-9bc1-4a8aba72b07c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.783294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b0bebca-27bf-412b-9bc1-4a8aba72b07c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.085896 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.network.security_group_api [None req-66cf27e7-7995-42e6-a4df-d25dfb655602 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Adding security group 66046a8d-8d28-482d-a5cb-8b76376cb7e1 to port 6ccd2eda-880b-42ac-af0e-bb1e18b48e69 Jul 20 04:17:26.115328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6b0bebca-27bf-412b-9bc1-4a8aba72b07c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:26.125096 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6b0bebca-27bf-412b-9bc1-4a8aba72b07c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1199 microversion: 2.1 time: 0.362873 Jul 20 04:17:26.127665 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1026/1944] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:25 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1199 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:26.134118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ab5f1da8-1df6-4d44-a801-ea43f1985861 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:26.134864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ab5f1da8-1df6-4d44-a801-ea43f1985861 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:26.141445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:26.143433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab5f1da8-1df6-4d44-a801-ea43f1985861 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.144139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab5f1da8-1df6-4d44-a801-ea43f1985861 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.145145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab5f1da8-1df6-4d44-a801-ea43f1985861 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.145683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab5f1da8-1df6-4d44-a801-ea43f1985861 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.463257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ab5f1da8-1df6-4d44-a801-ea43f1985861 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:26.475913 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ab5f1da8-1df6-4d44-a801-ea43f1985861 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1315 microversion: 2.1 time: 0.346733 Jul 20 04:17:26.476498 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1027/1945] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:26 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:26.746724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-872430fa-e0ad-4e20-9580-db5eb8499afd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:26.749550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-872430fa-e0ad-4e20-9580-db5eb8499afd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:26.751835 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-66cf27e7-7995-42e6-a4df-d25dfb655602 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8/action" status: 202 len: 0 microversion: 2.1 time: 1.027909 Jul 20 04:17:26.755354 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 919/1946] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:25 2022] POST /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8/action => generated 0 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:26.760454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5a18aa2-5242-4549-b4cc-61a7334dd007 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1519703201"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:26.760919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c5a18aa2-5242-4549-b4cc-61a7334dd007 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:26.775308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-872430fa-e0ad-4e20-9580-db5eb8499afd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.776420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-872430fa-e0ad-4e20-9580-db5eb8499afd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.776758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5a18aa2-5242-4549-b4cc-61a7334dd007 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.777213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5a18aa2-5242-4549-b4cc-61a7334dd007 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.777998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5a18aa2-5242-4549-b4cc-61a7334dd007 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.778146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-872430fa-e0ad-4e20-9580-db5eb8499afd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.778438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5a18aa2-5242-4549-b4cc-61a7334dd007 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.778744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-872430fa-e0ad-4e20-9580-db5eb8499afd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.349827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-872430fa-e0ad-4e20-9580-db5eb8499afd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.365778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-872430fa-e0ad-4e20-9580-db5eb8499afd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.367422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-872430fa-e0ad-4e20-9580-db5eb8499afd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.368577 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-872430fa-e0ad-4e20-9580-db5eb8499afd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1361 microversion: 2.25 time: 0.632392 Jul 20 04:17:27.369476 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1028/1947] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:26 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1361 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:27.376056 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.network.security_group_api [None req-c5a18aa2-5242-4549-b4cc-61a7334dd007 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Adding security group 76398e9c-902d-4257-8f09-e45fea75b0e1 to port 6ccd2eda-880b-42ac-af0e-bb1e18b48e69 Jul 20 04:17:27.383031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d4948d00-0dcc-4ba1-b944-0f8fdcb944fd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:27.383710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d4948d00-0dcc-4ba1-b944-0f8fdcb944fd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:27.392443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4948d00-0dcc-4ba1-b944-0f8fdcb944fd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.392901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4948d00-0dcc-4ba1-b944-0f8fdcb944fd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.393700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4948d00-0dcc-4ba1-b944-0f8fdcb944fd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.394145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4948d00-0dcc-4ba1-b944-0f8fdcb944fd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.945147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d4948d00-0dcc-4ba1-b944-0f8fdcb944fd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.960244 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d4948d00-0dcc-4ba1-b944-0f8fdcb944fd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.589646 Jul 20 04:17:27.961567 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1029/1948] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:27 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:27.967050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-93aa57fc-ff00-46d8-bfea-2fe5dd762f36 req-16ab939b-d4c1-4a2d-a552-77b420f2c63e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcccdd82-e3d1-4d66-aefc-657ce896eaf8", "tag": "6ccd2eda-880b-42ac-af0e-bb1e18b48e69"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:27.979460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-93aa57fc-ff00-46d8-bfea-2fe5dd762f36 req-16ab939b-d4c1-4a2d-a552-77b420f2c63e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.980186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-93aa57fc-ff00-46d8-bfea-2fe5dd762f36 req-16ab939b-d4c1-4a2d-a552-77b420f2c63e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.019855 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-93aa57fc-ff00-46d8-bfea-2fe5dd762f36 req-16ab939b-d4c1-4a2d-a552-77b420f2c63e service nova] Creating event network-changed:6ccd2eda-880b-42ac-af0e-bb1e18b48e69 for instance bcccdd82-e3d1-4d66-aefc-657ce896eaf8 on n-h2-764485-11 Jul 20 04:17:28.042008 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-93aa57fc-ff00-46d8-bfea-2fe5dd762f36 req-16ab939b-d4c1-4a2d-a552-77b420f2c63e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078079 Jul 20 04:17:28.043196 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1030/1949] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:28.051492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b56ebad1-2918-4266-9dda-e1b63e2aca6a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.053290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b56ebad1-2918-4266-9dda-e1b63e2aca6a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.062095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b56ebad1-2918-4266-9dda-e1b63e2aca6a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.062955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b56ebad1-2918-4266-9dda-e1b63e2aca6a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.064423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b56ebad1-2918-4266-9dda-e1b63e2aca6a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.065468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b56ebad1-2918-4266-9dda-e1b63e2aca6a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.502766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b56ebad1-2918-4266-9dda-e1b63e2aca6a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.519424 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b56ebad1-2918-4266-9dda-e1b63e2aca6a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1199 microversion: 2.1 time: 0.470280 Jul 20 04:17:28.521466 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1031/1950] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1199 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:28.542652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3067347e-f2a5-43bf-9861-a20f468b64c9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.544406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3067347e-f2a5-43bf-9861-a20f468b64c9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.574802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3067347e-f2a5-43bf-9861-a20f468b64c9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.575364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3067347e-f2a5-43bf-9861-a20f468b64c9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.576943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3067347e-f2a5-43bf-9861-a20f468b64c9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.577786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3067347e-f2a5-43bf-9861-a20f468b64c9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.621274 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5a18aa2-5242-4549-b4cc-61a7334dd007 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8/action" status: 202 len: 0 microversion: 2.1 time: 1.864498 Jul 20 04:17:28.624543 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 920/1951] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:26 2022] POST /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8/action => generated 0 bytes in 1868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:17:28.631263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a5493157-7b00-415b-95cf-ffa40e2bda32 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.632360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a5493157-7b00-415b-95cf-ffa40e2bda32 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.647631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5493157-7b00-415b-95cf-ffa40e2bda32 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.649883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5493157-7b00-415b-95cf-ffa40e2bda32 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.655099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5493157-7b00-415b-95cf-ffa40e2bda32 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.656126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5493157-7b00-415b-95cf-ffa40e2bda32 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.048253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3067347e-f2a5-43bf-9861-a20f468b64c9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:29.056783 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3067347e-f2a5-43bf-9861-a20f468b64c9 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1315 microversion: 2.1 time: 0.533897 Jul 20 04:17:29.067761 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1032/1952] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:29.071711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b578e2b7-296d-4797-858f-4ff95b2cd61c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.072259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b578e2b7-296d-4797-858f-4ff95b2cd61c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.074472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a5493157-7b00-415b-95cf-ffa40e2bda32 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:29.080759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b578e2b7-296d-4797-858f-4ff95b2cd61c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.081230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b578e2b7-296d-4797-858f-4ff95b2cd61c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.082376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b578e2b7-296d-4797-858f-4ff95b2cd61c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.083118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b578e2b7-296d-4797-858f-4ff95b2cd61c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.087207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a5493157-7b00-415b-95cf-ffa40e2bda32 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:29.089016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a5493157-7b00-415b-95cf-ffa40e2bda32 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:29.090280 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a5493157-7b00-415b-95cf-ffa40e2bda32 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1361 microversion: 2.25 time: 0.464527 Jul 20 04:17:29.102417 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 921/1953] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1361 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:29.108484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7f38bc0e-8893-4285-ba22-12b68b301011 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.109313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7f38bc0e-8893-4285-ba22-12b68b301011 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.116100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f38bc0e-8893-4285-ba22-12b68b301011 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.116663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f38bc0e-8893-4285-ba22-12b68b301011 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.117577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f38bc0e-8893-4285-ba22-12b68b301011 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.118086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f38bc0e-8893-4285-ba22-12b68b301011 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.467077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7f38bc0e-8893-4285-ba22-12b68b301011 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:29.475783 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7f38bc0e-8893-4285-ba22-12b68b301011 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.372001 Jul 20 04:17:29.476312 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 922/1954] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:29.504136 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b578e2b7-296d-4797-858f-4ff95b2cd61c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.437955 Jul 20 04:17:29.504752 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1033/1955] 10.222.0.20 () {58 vars in 1292 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8/os-security-groups => generated 1158 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:29.519124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f9134875-e28d-423a-8f13-7f073db1516f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'create', calling method: .version_select at 0x7fbf9d07e940>, body: {"security_group": {"name": " tempest-securitygroup -1652193435 ", "description": "tempest-description-1626532903"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:29.613602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee8580b3-db5e-48d1-b707-df1f690c3f50 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9d385dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:29.676814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee8580b3-db5e-48d1-b707-df1f690c3f50 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.677347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee8580b3-db5e-48d1-b707-df1f690c3f50 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.678077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee8580b3-db5e-48d1-b707-df1f690c3f50 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.678515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee8580b3-db5e-48d1-b707-df1f690c3f50 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.721225 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f9134875-e28d-423a-8f13-7f073db1516f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.206068 Jul 20 04:17:29.722229 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1034/1956] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:29 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:29.728671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-05d0ba88-a0e5-4193-aa18-d5121fa69298 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.729675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-05d0ba88-a0e5-4193-aa18-d5121fa69298 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.738045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05d0ba88-a0e5-4193-aa18-d5121fa69298 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.738492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05d0ba88-a0e5-4193-aa18-d5121fa69298 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.739284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05d0ba88-a0e5-4193-aa18-d5121fa69298 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.739918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05d0ba88-a0e5-4193-aa18-d5121fa69298 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.746206 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ee8580b3-db5e-48d1-b707-df1f690c3f50 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/24e5def1dd404fb38308615cb6f3e1fc" status: 200 len: 240 microversion: 2.36 time: 0.268800 Jul 20 04:17:29.752919 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 923/1957] 10.222.0.20 () {62 vars in 1302 bytes} [Wed Jul 20 04:17:29 2022] PUT /compute/v2.1/os-quota-sets/24e5def1dd404fb38308615cb6f3e1fc => generated 240 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:17:29.756535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6bb93daf-212b-46b6-b26d-60993e47f834 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d2124c0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.851340 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6bb93daf-212b-46b6-b26d-60993e47f834 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/83d09467-1553-4f6b-ae58-68073d304c21" status: 200 len: 224 microversion: 2.1 time: 0.103175 Jul 20 04:17:29.852559 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 924/1958] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/os-security-groups/83d09467-1553-4f6b-ae58-68073d304c21 => generated 224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:29.859661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2290ab1f-9f2c-4bb0-bd2d-c6699c7a811b tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Calling method '.version_select at 0x7fbf9d212af0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.904901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-05d0ba88-a0e5-4193-aa18-d5121fa69298 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:29.913040 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-05d0ba88-a0e5-4193-aa18-d5121fa69298 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1199 microversion: 2.1 time: 0.189624 Jul 20 04:17:29.913956 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1035/1959] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1199 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:29.919109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44477071-7ee9-470c-9f47-12a1bbb8afe2 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d140160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.934650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2290ab1f-9f2c-4bb0-bd2d-c6699c7a811b tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.935197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2290ab1f-9f2c-4bb0-bd2d-c6699c7a811b tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.936786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2290ab1f-9f2c-4bb0-bd2d-c6699c7a811b tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.937408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2290ab1f-9f2c-4bb0-bd2d-c6699c7a811b tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.946444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=11 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:29.959319 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2290ab1f-9f2c-4bb0-bd2d-c6699c7a811b tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/24e5def1dd404fb38308615cb6f3e1fc/detail" status: 200 len: 672 microversion: 2.36 time: 0.105318 Jul 20 04:17:29.960072 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 925/1960] 10.222.0.20 () {60 vars in 1303 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/os-quota-sets/24e5def1dd404fb38308615cb6f3e1fc/detail => generated 672 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:17:30.066196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c1045321-781e-4cda-986e-368a80919f1d req-b5e67683-e089-4d7f-b05c-b0d3d0fb0d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcccdd82-e3d1-4d66-aefc-657ce896eaf8", "tag": "6ccd2eda-880b-42ac-af0e-bb1e18b48e69"}, {"name": "network-changed", "server_uuid": "cb7da181-3013-4dcb-aaeb-3fa090a01941", "tag": "c1b4726b-e1ba-4b8b-86cc-729b8499f72b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:30.088099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c1045321-781e-4cda-986e-368a80919f1d req-b5e67683-e089-4d7f-b05c-b0d3d0fb0d1a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.090367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c1045321-781e-4cda-986e-368a80919f1d req-b5e67683-e089-4d7f-b05c-b0d3d0fb0d1a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.112673 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c1045321-781e-4cda-986e-368a80919f1d req-b5e67683-e089-4d7f-b05c-b0d3d0fb0d1a service nova] Creating event network-changed:6ccd2eda-880b-42ac-af0e-bb1e18b48e69 for instance bcccdd82-e3d1-4d66-aefc-657ce896eaf8 on n-h2-764485-11 Jul 20 04:17:30.113380 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c1045321-781e-4cda-986e-368a80919f1d req-b5e67683-e089-4d7f-b05c-b0d3d0fb0d1a service nova] Creating event network-changed:c1b4726b-e1ba-4b8b-86cc-729b8499f72b for instance cb7da181-3013-4dcb-aaeb-3fa090a01941 on n-h1-764485-11 Jul 20 04:17:30.130005 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c1045321-781e-4cda-986e-368a80919f1d req-b5e67683-e089-4d7f-b05c-b0d3d0fb0d1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.067344 Jul 20 04:17:30.130964 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 926/1961] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:30.138254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-be3c8b8b-6394-4b54-afa1-5fb6fe189896 req-be654b46-53e6-45a9-8fd8-dcde557f6b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf4efd9-d89f-4775-adb9-fb25596bcd90", "name": "network-vif-plugged", "status": "completed", "tag": "5e4d8f7c-c8ab-4712-8ae2-7d6d6b1b7917"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:30.149826 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44477071-7ee9-470c-9f47-12a1bbb8afe2 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/83d09467-1553-4f6b-ae58-68073d304c21" status: 202 len: 0 microversion: 2.1 time: 0.234440 Jul 20 04:17:30.151040 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1036/1962] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:29 2022] DELETE /compute/v2.1/os-security-groups/83d09467-1553-4f6b-ae58-68073d304c21 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:30.157995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-be3c8b8b-6394-4b54-afa1-5fb6fe189896 req-be654b46-53e6-45a9-8fd8-dcde557f6b40 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.158587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-be3c8b8b-6394-4b54-afa1-5fb6fe189896 req-be654b46-53e6-45a9-8fd8-dcde557f6b40 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.159689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-55ec16d1-f2c8-4fc7-8b51-f4b1d7b12eec tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.160510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-55ec16d1-f2c8-4fc7-8b51-f4b1d7b12eec tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:30.168474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55ec16d1-f2c8-4fc7-8b51-f4b1d7b12eec tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.169390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55ec16d1-f2c8-4fc7-8b51-f4b1d7b12eec tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.171401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55ec16d1-f2c8-4fc7-8b51-f4b1d7b12eec tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.172316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55ec16d1-f2c8-4fc7-8b51-f4b1d7b12eec tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.184030 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-be3c8b8b-6394-4b54-afa1-5fb6fe189896 req-be654b46-53e6-45a9-8fd8-dcde557f6b40 service nova] Creating event network-vif-plugged:5e4d8f7c-c8ab-4712-8ae2-7d6d6b1b7917 for instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 on n-h2-764485-11 Jul 20 04:17:30.190410 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-be3c8b8b-6394-4b54-afa1-5fb6fe189896 req-be654b46-53e6-45a9-8fd8-dcde557f6b40 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057283 Jul 20 04:17:30.191250 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 927/1963] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:30.196994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-337ef455-668a-4db2-8da9-03570ec1d63e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.197846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-337ef455-668a-4db2-8da9-03570ec1d63e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:30.204424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-337ef455-668a-4db2-8da9-03570ec1d63e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.204881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-337ef455-668a-4db2-8da9-03570ec1d63e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.206185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-337ef455-668a-4db2-8da9-03570ec1d63e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.206633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-337ef455-668a-4db2-8da9-03570ec1d63e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.515444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-55ec16d1-f2c8-4fc7-8b51-f4b1d7b12eec tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.523771 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-55ec16d1-f2c8-4fc7-8b51-f4b1d7b12eec tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1315 microversion: 2.1 time: 0.371075 Jul 20 04:17:30.524427 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1037/1964] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:30 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:30.530173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c9acbb4b-570a-4ef3-b570-3eda57f28690 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9d0fb550>, body: {"quota_set": {"ram": "2048"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:30.549342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-337ef455-668a-4db2-8da9-03570ec1d63e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.559705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-337ef455-668a-4db2-8da9-03570ec1d63e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.561835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-337ef455-668a-4db2-8da9-03570ec1d63e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.563646 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-337ef455-668a-4db2-8da9-03570ec1d63e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1361 microversion: 2.25 time: 0.370677 Jul 20 04:17:30.577376 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 928/1965] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:30 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1361 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:30.583240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b2389960-4e6e-4ea3-bd77-e10b889304a4 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d5bd0d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.620185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9acbb4b-570a-4ef3-b570-3eda57f28690 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.620910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9acbb4b-570a-4ef3-b570-3eda57f28690 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.621719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9acbb4b-570a-4ef3-b570-3eda57f28690 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.622165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9acbb4b-570a-4ef3-b570-3eda57f28690 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.628607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-b2389960-4e6e-4ea3-bd77-e10b889304a4 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:17:30.629186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.security_group_api [None req-b2389960-4e6e-4ea3-bd77-e10b889304a4 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Neutron security group 83d09467-1553-4f6b-ae58-68073d304c21 not found {{(pid=119807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:17:30.629731 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b2389960-4e6e-4ea3-bd77-e10b889304a4 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:17:30.629731 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-8f046e9a-e715-418f-a974-6228fa67383e'] Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b2389960-4e6e-4ea3-bd77-e10b889304a4 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-security-groups/83d09467-1553-4f6b-ae58-68073d304c21 HTTP/1.1 Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: exception: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-8f046e9a-e715-418f-a974-6228fa67383e'] Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '83d09467-1553-4f6b-ae58-68073d304c21'} Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:17:30.631708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f046e9a-e715-418f-a974-6228fa67383e'] Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f046e9a-e715-418f-a974-6228fa67383e'] Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f046e9a-e715-418f-a974-6228fa67383e'] Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f046e9a-e715-418f-a974-6228fa67383e'] Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b2389960-4e6e-4ea3-bd77-e10b889304a4 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-8f046e9a-e715-418f-a974-6228fa67383e'] {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b2389960-4e6e-4ea3-bd77-e10b889304a4 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/83d09467-1553-4f6b-ae58-68073d304c21" status: 404 len: 194 microversion: 2.1 time: 0.054696 Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 929/1966] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:17:30 2022] GET /compute/v2.1/os-security-groups/83d09467-1553-4f6b-ae58-68073d304c21 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:30.639795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e8758f1a-ac5a-4970-8007-88ed31a31d5c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.647792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e8758f1a-ac5a-4970-8007-88ed31a31d5c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:30.647792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:30.649492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8758f1a-ac5a-4970-8007-88ed31a31d5c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.649979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8758f1a-ac5a-4970-8007-88ed31a31d5c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.650798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8758f1a-ac5a-4970-8007-88ed31a31d5c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.651200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8758f1a-ac5a-4970-8007-88ed31a31d5c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.668575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9acbb4b-570a-4ef3-b570-3eda57f28690 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.669031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9acbb4b-570a-4ef3-b570-3eda57f28690 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.669852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9acbb4b-570a-4ef3-b570-3eda57f28690 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.670334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9acbb4b-570a-4ef3-b570-3eda57f28690 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.730171 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c9acbb4b-570a-4ef3-b570-3eda57f28690 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/24e5def1dd404fb38308615cb6f3e1fc?user_id=b73e647c6d7e4263b1a68d8f9396aa64" status: 200 len: 240 microversion: 2.36 time: 0.204485 Jul 20 04:17:30.731032 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1038/1967] 10.222.0.20 () {62 vars in 1383 bytes} [Wed Jul 20 04:17:30 2022] PUT /compute/v2.1/os-quota-sets/24e5def1dd404fb38308615cb6f3e1fc?user_id=b73e647c6d7e4263b1a68d8f9396aa64 => generated 240 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:17:30.736610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15478bea-8ba6-4aa1-9e32-88817a0f2ffd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'create', calling method: .version_select at 0x7fbf9d1405e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1971758921", "description": "tempest-description-2110533768"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:31.151468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e8758f1a-ac5a-4970-8007-88ed31a31d5c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.159686 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e8758f1a-ac5a-4970-8007-88ed31a31d5c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.525011 Jul 20 04:17:31.169120 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 930/1968] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:30 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:31.169120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6eb3d34f-aef6-4dc1-8798-a231a77feca4 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] Calling method '.version_select at 0x7fbf9da154c0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.229121 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-15478bea-8ba6-4aa1-9e32-88817a0f2ffd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.496364 Jul 20 04:17:31.230345 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1039/1969] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:30 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:31.237814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e09f0661-8b66-42f5-903e-6c7affd422c3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.238447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e09f0661-8b66-42f5-903e-6c7affd422c3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:31.253981 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6eb3d34f-aef6-4dc1-8798-a231a77feca4 tempest-QuotasAdminTestV236-732195642 tempest-QuotasAdminTestV236-732195642-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/24e5def1dd404fb38308615cb6f3e1fc?user_id=b73e647c6d7e4263b1a68d8f9396aa64" status: 200 len: 282 microversion: 2.36 time: 0.092235 Jul 20 04:17:31.254573 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 931/1970] 10.222.0.20 () {60 vars in 1363 bytes} [Wed Jul 20 04:17:31 2022] GET /compute/v2.1/os-quota-sets/24e5def1dd404fb38308615cb6f3e1fc?user_id=b73e647c6d7e4263b1a68d8f9396aa64 => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:17:31.255315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e09f0661-8b66-42f5-903e-6c7affd422c3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.255857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e09f0661-8b66-42f5-903e-6c7affd422c3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.256712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e09f0661-8b66-42f5-903e-6c7affd422c3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.257205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e09f0661-8b66-42f5-903e-6c7affd422c3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.259113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-40b5c888-4185-4d98-a3f3-2ce5834871ed tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'create', calling method: .version_select at 0x7fbf9d2c59d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-51488961", "description": "tempest-description-1939111064"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:31.451755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e09f0661-8b66-42f5-903e-6c7affd422c3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.461879 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e09f0661-8b66-42f5-903e-6c7affd422c3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1199 microversion: 2.1 time: 0.229864 Jul 20 04:17:31.462879 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1040/1971] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:31 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1199 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:31.500211 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-40b5c888-4185-4d98-a3f3-2ce5834871ed tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.243807 Jul 20 04:17:31.501169 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 932/1972] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:31 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:31.512368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-23ea6a82-2ca1-4854-a7e3-6385942e465d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'create', calling method: .version_select at 0x7fbf9d154820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-918884299", "description": "tempest-description-16989912"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:31.540894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86ada54d-63e3-462c-934c-1e567468f96e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.541672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-86ada54d-63e3-462c-934c-1e567468f96e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:31.550232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86ada54d-63e3-462c-934c-1e567468f96e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.550885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86ada54d-63e3-462c-934c-1e567468f96e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.552192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86ada54d-63e3-462c-934c-1e567468f96e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.552638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86ada54d-63e3-462c-934c-1e567468f96e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.737518 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-23ea6a82-2ca1-4854-a7e3-6385942e465d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.228981 Jul 20 04:17:31.738977 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1041/1973] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:31 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:31.744030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-546e7148-d81f-4704-b9f8-6a4f9db012f4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.745122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-546e7148-d81f-4704-b9f8-6a4f9db012f4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:31.752628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-546e7148-d81f-4704-b9f8-6a4f9db012f4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.753335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-546e7148-d81f-4704-b9f8-6a4f9db012f4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.754354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-546e7148-d81f-4704-b9f8-6a4f9db012f4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.754897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-546e7148-d81f-4704-b9f8-6a4f9db012f4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.784709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-86ada54d-63e3-462c-934c-1e567468f96e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.793796 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-86ada54d-63e3-462c-934c-1e567468f96e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1315 microversion: 2.1 time: 0.256655 Jul 20 04:17:31.794854 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 933/1974] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:31 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:31.800656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d463eab8-621e-4017-93af-8e8db844fb27 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d32a940>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.971304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-546e7148-d81f-4704-b9f8-6a4f9db012f4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.981219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-546e7148-d81f-4704-b9f8-6a4f9db012f4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.984966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-546e7148-d81f-4704-b9f8-6a4f9db012f4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.986559 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-546e7148-d81f-4704-b9f8-6a4f9db012f4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1361 microversion: 2.25 time: 0.246327 Jul 20 04:17:31.987363 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1042/1975] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:31 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:32.091047 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d463eab8-621e-4017-93af-8e8db844fb27 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.294185 Jul 20 04:17:32.093818 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 934/1976] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:17:31 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:32.106280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b59e8cd2-c9ed-42b1-aac9-589f959f67b9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d168160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.177669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-16e746f2-992e-481c-b709-b075c3d3373e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.179294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-16e746f2-992e-481c-b709-b075c3d3373e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:32.190533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16e746f2-992e-481c-b709-b075c3d3373e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.191218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16e746f2-992e-481c-b709-b075c3d3373e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.192400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16e746f2-992e-481c-b709-b075c3d3373e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.193005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16e746f2-992e-481c-b709-b075c3d3373e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.470338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-16e746f2-992e-481c-b709-b075c3d3373e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:32.475392 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b59e8cd2-c9ed-42b1-aac9-589f959f67b9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5654b20f-3a46-4337-b4b1-0dcb07d1f569" status: 202 len: 0 microversion: 2.1 time: 0.372913 Jul 20 04:17:32.476831 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1043/1977] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:32 2022] DELETE /compute/v2.1/os-security-groups/5654b20f-3a46-4337-b4b1-0dcb07d1f569 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:32.480451 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-16e746f2-992e-481c-b709-b075c3d3373e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.306860 Jul 20 04:17:32.481059 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 935/1978] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:32.485893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-beaf78e9-ec0b-41ef-be58-8241d468a6f9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d373ca0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.487433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3c7df893-2d70-48dc-b13c-06e40726fc79 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.488335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3c7df893-2d70-48dc-b13c-06e40726fc79 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:32.499136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3c7df893-2d70-48dc-b13c-06e40726fc79 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.500083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3c7df893-2d70-48dc-b13c-06e40726fc79 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.501658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3c7df893-2d70-48dc-b13c-06e40726fc79 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.502874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3c7df893-2d70-48dc-b13c-06e40726fc79 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.522188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-beaf78e9-ec0b-41ef-be58-8241d468a6f9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:17:32.525355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.security_group_api [None req-beaf78e9-ec0b-41ef-be58-8241d468a6f9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Neutron security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 not found {{(pid=119807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:17:32.525962 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-beaf78e9-ec0b-41ef-be58-8241d468a6f9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:17:32.525962 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-ee016758-15d9-46ff-a0c8-9e2f7c953fed'] Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-beaf78e9-ec0b-41ef-be58-8241d468a6f9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-security-groups/5654b20f-3a46-4337-b4b1-0dcb07d1f569 HTTP/1.1 Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: exception: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-ee016758-15d9-46ff-a0c8-9e2f7c953fed'] Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '5654b20f-3a46-4337-b4b1-0dcb07d1f569'} Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:17:32.528876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee016758-15d9-46ff-a0c8-9e2f7c953fed'] Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee016758-15d9-46ff-a0c8-9e2f7c953fed'] Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee016758-15d9-46ff-a0c8-9e2f7c953fed'] Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee016758-15d9-46ff-a0c8-9e2f7c953fed'] Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-beaf78e9-ec0b-41ef-be58-8241d468a6f9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-ee016758-15d9-46ff-a0c8-9e2f7c953fed'] {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:32.533465 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-beaf78e9-ec0b-41ef-be58-8241d468a6f9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/5654b20f-3a46-4337-b4b1-0dcb07d1f569" status: 404 len: 194 microversion: 2.1 time: 0.047315 Jul 20 04:17:32.540456 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 936/1979] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/os-security-groups/5654b20f-3a46-4337-b4b1-0dcb07d1f569 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:32.543735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ba9e74b7-efc2-4544-ad9f-df5aa1884985 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d9b3af0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.737912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3c7df893-2d70-48dc-b13c-06e40726fc79 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:32.745766 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3c7df893-2d70-48dc-b13c-06e40726fc79 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1199 microversion: 2.1 time: 0.263359 Jul 20 04:17:32.746350 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1044/1980] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1199 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:32.813006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21ef46e9-a21b-4bbb-881b-8f8a87642f42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.813695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21ef46e9-a21b-4bbb-881b-8f8a87642f42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:32.821062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21ef46e9-a21b-4bbb-881b-8f8a87642f42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.821546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21ef46e9-a21b-4bbb-881b-8f8a87642f42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.822503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21ef46e9-a21b-4bbb-881b-8f8a87642f42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.822940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21ef46e9-a21b-4bbb-881b-8f8a87642f42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.838657 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ba9e74b7-efc2-4544-ad9f-df5aa1884985 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/bd21ca98-93ee-4209-bd02-f964df9512ed" status: 202 len: 0 microversion: 2.1 time: 0.299420 Jul 20 04:17:32.839643 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 937/1981] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:32 2022] DELETE /compute/v2.1/os-security-groups/bd21ca98-93ee-4209-bd02-f964df9512ed => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:32.847566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6c62f32e-ff7e-4965-8874-0065820caa3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d212700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.897963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-6c62f32e-ff7e-4965-8874-0065820caa3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:17:32.898570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.security_group_api [None req-6c62f32e-ff7e-4965-8874-0065820caa3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Neutron security group bd21ca98-93ee-4209-bd02-f964df9512ed not found {{(pid=119807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:17:32.899148 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-6c62f32e-ff7e-4965-8874-0065820caa3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:17:32.899148 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-5fbe5140-0c4a-4723-8750-f9902430aa54'] Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6c62f32e-ff7e-4965-8874-0065820caa3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-security-groups/bd21ca98-93ee-4209-bd02-f964df9512ed HTTP/1.1 Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: exception: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-5fbe5140-0c4a-4723-8750-f9902430aa54'] Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'bd21ca98-93ee-4209-bd02-f964df9512ed'} Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:17:32.901956 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5fbe5140-0c4a-4723-8750-f9902430aa54'] Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5fbe5140-0c4a-4723-8750-f9902430aa54'] Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5fbe5140-0c4a-4723-8750-f9902430aa54'] Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5fbe5140-0c4a-4723-8750-f9902430aa54'] Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6c62f32e-ff7e-4965-8874-0065820caa3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-5fbe5140-0c4a-4723-8750-f9902430aa54'] {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6c62f32e-ff7e-4965-8874-0065820caa3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/bd21ca98-93ee-4209-bd02-f964df9512ed" status: 404 len: 194 microversion: 2.1 time: 0.059960 Jul 20 04:17:32.908022 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 938/1982] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/os-security-groups/bd21ca98-93ee-4209-bd02-f964df9512ed => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:32.915612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d67da865-112a-4701-9354-0a811298c681 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9da6c1f0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.075353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-21ef46e9-a21b-4bbb-881b-8f8a87642f42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.084389 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21ef46e9-a21b-4bbb-881b-8f8a87642f42 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1502 microversion: 2.1 time: 0.276030 Jul 20 04:17:33.085435 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1045/1983] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:33.090626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a295cc0-6885-4e38-89d7-196bb9eff432 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.091488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7a295cc0-6885-4e38-89d7-196bb9eff432 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.101156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a295cc0-6885-4e38-89d7-196bb9eff432 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.101874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a295cc0-6885-4e38-89d7-196bb9eff432 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.102577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a295cc0-6885-4e38-89d7-196bb9eff432 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.102898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a295cc0-6885-4e38-89d7-196bb9eff432 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.333081 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d67da865-112a-4701-9354-0a811298c681 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/3ba96a68-db31-498a-adc5-1eace4ea6b23" status: 202 len: 0 microversion: 2.1 time: 0.422246 Jul 20 04:17:33.334268 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 939/1984] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:32 2022] DELETE /compute/v2.1/os-security-groups/3ba96a68-db31-498a-adc5-1eace4ea6b23 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:33.343423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9a34d491-ac49-4723-83c4-ec6ad0b3bd81 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:33.344007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9a34d491-ac49-4723-83c4-ec6ad0b3bd81 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.350773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a34d491-ac49-4723-83c4-ec6ad0b3bd81 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.351348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a34d491-ac49-4723-83c4-ec6ad0b3bd81 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.352164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a34d491-ac49-4723-83c4-ec6ad0b3bd81 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.352612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a34d491-ac49-4723-83c4-ec6ad0b3bd81 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.425223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7a295cc0-6885-4e38-89d7-196bb9eff432 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.436717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7a295cc0-6885-4e38-89d7-196bb9eff432 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.438560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7a295cc0-6885-4e38-89d7-196bb9eff432 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.440572 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7a295cc0-6885-4e38-89d7-196bb9eff432 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1361 microversion: 2.25 time: 0.353615 Jul 20 04:17:33.451651 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1046/1985] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:33.456932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6fa6b3c-8ade-43e1-aba4-d5621968d180 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d07edc0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.464433 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9a34d491-ac49-4723-83c4-ec6ad0b3bd81 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "POST /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90/action" status: 202 len: 0 microversion: 2.1 time: 0.125431 Jul 20 04:17:33.469617 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 940/1986] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:33 2022] POST /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:33.477327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2013af95-04f8-4362-9fe0-9f4f75e43b24 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.478276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2013af95-04f8-4362-9fe0-9f4f75e43b24 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.491127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2013af95-04f8-4362-9fe0-9f4f75e43b24 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.491887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2013af95-04f8-4362-9fe0-9f4f75e43b24 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.492812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2013af95-04f8-4362-9fe0-9f4f75e43b24 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.493258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2013af95-04f8-4362-9fe0-9f4f75e43b24 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.557021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG neutronclient.v2_0.client [None req-c6fa6b3c-8ade-43e1-aba4-d5621968d180 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist", "detail": ""}} {{(pid=119808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:17:33.557804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.security_group_api [None req-c6fa6b3c-8ade-43e1-aba4-d5621968d180 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Neutron security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 not found {{(pid=119808) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:17:33.558407 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-c6fa6b3c-8ade-43e1-aba4-d5621968d180 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:17:33.558407 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-f14f5b17-f0ea-48e2-a905-e7faf7c091ca'] Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6fa6b3c-8ade-43e1-aba4-d5621968d180 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-security-groups/3ba96a68-db31-498a-adc5-1eace4ea6b23 HTTP/1.1 Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: exception: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-f14f5b17-f0ea-48e2-a905-e7faf7c091ca'] Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '3ba96a68-db31-498a-adc5-1eace4ea6b23'} Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:17:33.560499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f14f5b17-f0ea-48e2-a905-e7faf7c091ca'] Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f14f5b17-f0ea-48e2-a905-e7faf7c091ca'] Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f14f5b17-f0ea-48e2-a905-e7faf7c091ca'] Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f14f5b17-f0ea-48e2-a905-e7faf7c091ca'] Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6fa6b3c-8ade-43e1-aba4-d5621968d180 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-f14f5b17-f0ea-48e2-a905-e7faf7c091ca'] {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c6fa6b3c-8ade-43e1-aba4-d5621968d180 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/3ba96a68-db31-498a-adc5-1eace4ea6b23" status: 404 len: 194 microversion: 2.1 time: 0.110194 Jul 20 04:17:33.567883 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1047/1987] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/os-security-groups/3ba96a68-db31-498a-adc5-1eace4ea6b23 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:33.574258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-41398233-745d-4d83-ae60-ba3b77d0fb83 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.575050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-41398233-745d-4d83-ae60-ba3b77d0fb83 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.585612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41398233-745d-4d83-ae60-ba3b77d0fb83 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.586168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41398233-745d-4d83-ae60-ba3b77d0fb83 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.587028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41398233-745d-4d83-ae60-ba3b77d0fb83 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.587635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41398233-745d-4d83-ae60-ba3b77d0fb83 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.604959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:33.838130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2013af95-04f8-4362-9fe0-9f4f75e43b24 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.847565 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2013af95-04f8-4362-9fe0-9f4f75e43b24 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1507 microversion: 2.1 time: 0.376177 Jul 20 04:17:33.848412 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 941/1988] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:33.853257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dde8fb6f-b77a-4a82-a821-f7da3bf2be5a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d212940>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.907693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-41398233-745d-4d83-ae60-ba3b77d0fb83 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.916369 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-41398233-745d-4d83-ae60-ba3b77d0fb83 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.350689 Jul 20 04:17:33.924010 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1048/1989] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:33.924010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-870d3b31-a1bf-431a-8394-c523166f486c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.924010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-870d3b31-a1bf-431a-8394-c523166f486c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.928567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-870d3b31-a1bf-431a-8394-c523166f486c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.929131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-870d3b31-a1bf-431a-8394-c523166f486c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.930055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-870d3b31-a1bf-431a-8394-c523166f486c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.930503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-870d3b31-a1bf-431a-8394-c523166f486c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.186439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-870d3b31-a1bf-431a-8394-c523166f486c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:34.194785 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-870d3b31-a1bf-431a-8394-c523166f486c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1199 microversion: 2.1 time: 0.276823 Jul 20 04:17:34.195359 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1049/1990] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1199 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:34.222650 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dde8fb6f-b77a-4a82-a821-f7da3bf2be5a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.372854 Jul 20 04:17:34.223481 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 942/1991] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:34.236726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3904c12f-92e5-4b63-9883-049fe46df5b5 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'create', calling method: .version_select at 0x7fbf9d91c9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1041672349", "description": "tempest-description-1924182073"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:34.401169 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3904c12f-92e5-4b63-9883-049fe46df5b5 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.166419 Jul 20 04:17:34.407702 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1050/1992] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:34 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:34.412574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-16af50a8-978a-4b80-a4de-a498326e8f43 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'create', calling method: .version_select at 0x7fbf9d21cee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2045208888", "description": "tempest-description-1994168370"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:34.460159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4d6565f1-d126-49dd-80f7-ab60f9b17e49 req-d24fe489-6c8d-40b5-aa19-7c734c282fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838c7de4-25f3-481a-b89f-6562178ccce0", "name": "network-vif-plugged", "status": "completed", "tag": "64e34bf8-7b7e-45eb-acd2-804013d49abe"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:34.481302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4d6565f1-d126-49dd-80f7-ab60f9b17e49 req-d24fe489-6c8d-40b5-aa19-7c734c282fd0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.483025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4d6565f1-d126-49dd-80f7-ab60f9b17e49 req-d24fe489-6c8d-40b5-aa19-7c734c282fd0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.497317 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4d6565f1-d126-49dd-80f7-ab60f9b17e49 req-d24fe489-6c8d-40b5-aa19-7c734c282fd0 service nova] Creating event network-vif-plugged:64e34bf8-7b7e-45eb-acd2-804013d49abe for instance 838c7de4-25f3-481a-b89f-6562178ccce0 on n-h1-764485-11 Jul 20 04:17:34.506706 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4d6565f1-d126-49dd-80f7-ab60f9b17e49 req-d24fe489-6c8d-40b5-aa19-7c734c282fd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055360 Jul 20 04:17:34.508159 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1051/1993] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:34.529875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52bdaf5a-950c-44c9-836d-1bd91177d671 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:34.531270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52bdaf5a-950c-44c9-836d-1bd91177d671 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:34.540936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52bdaf5a-950c-44c9-836d-1bd91177d671 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.542572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52bdaf5a-950c-44c9-836d-1bd91177d671 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.543426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52bdaf5a-950c-44c9-836d-1bd91177d671 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.543900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52bdaf5a-950c-44c9-836d-1bd91177d671 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.647361 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-16af50a8-978a-4b80-a4de-a498326e8f43 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.238649 Jul 20 04:17:34.648011 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 943/1994] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:34 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:34.763160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-801575545", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "425288b6-c0b7-4506-9750-208267afd7bc"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:34.780635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52bdaf5a-950c-44c9-836d-1bd91177d671 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:34.793848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52bdaf5a-950c-44c9-836d-1bd91177d671 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:34.796391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52bdaf5a-950c-44c9-836d-1bd91177d671 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:34.797732 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52bdaf5a-950c-44c9-836d-1bd91177d671 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1361 microversion: 2.25 time: 0.287946 Jul 20 04:17:34.799400 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1052/1995] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:34 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:34.818679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] validate_networks() for [('425288b6-c0b7-4506-9750-208267afd7bc', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:34.968622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1711292128", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": "none"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:35.022409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:35.023075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:35.023696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:35.024370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:35.024800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:35.036191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.036653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.037489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.037930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.056068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Getting quotas for project 746276d80b594ef58e02c38078972f86. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:35.061840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Getting quotas for user 5b887acad86a47fd8f0d739b1e65651a and project 746276d80b594ef58e02c38078972f86. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:35.075019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:35.078043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:35.122390 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f6cfaa41-ac56-4787-addc-bdb510f5cb4b tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.271319 Jul 20 04:17:35.123074 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1053/1996] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:17:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 273 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 20 04:17:35.128104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bc5a014e-33a5-4d2f-927f-f40c56ee39ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.128797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bc5a014e-33a5-4d2f-927f-f40c56ee39ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.135652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc5a014e-33a5-4d2f-927f-f40c56ee39ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.136117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc5a014e-33a5-4d2f-927f-f40c56ee39ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.136902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc5a014e-33a5-4d2f-927f-f40c56ee39ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.137355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc5a014e-33a5-4d2f-927f-f40c56ee39ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.235934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:35.236398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:35.237057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:35.237486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:35.237946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:35.245681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=45 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:35.249934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.250599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.251901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.252345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.279244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Getting quotas for project 5a6077ffc2e5466ab68104ce3963e514. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:35.286566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Getting quotas for user 197a968f1cd644d3afca88c6d60a87c2 and project 5a6077ffc2e5466ab68104ce3963e514. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:35.301499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:35.304004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:35.304895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bc5a014e-33a5-4d2f-927f-f40c56ee39ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.313886 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bc5a014e-33a5-4d2f-927f-f40c56ee39ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1487 microversion: 2.1 time: 0.189412 Jul 20 04:17:35.325186 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1054/1997] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1487 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:35.325186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-90b73040-00b2-4253-8439-9d3a0fbbc09b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.325186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-90b73040-00b2-4253-8439-9d3a0fbbc09b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.326893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90b73040-00b2-4253-8439-9d3a0fbbc09b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.327350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90b73040-00b2-4253-8439-9d3a0fbbc09b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.328393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90b73040-00b2-4253-8439-9d3a0fbbc09b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.328871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90b73040-00b2-4253-8439-9d3a0fbbc09b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.356058 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-886ee5ac-151a-4a6b-9512-d7b02bc01b00 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596533 Jul 20 04:17:35.357186 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 944/1998] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:17:35.362315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9d08d9f0-0c69-4f12-96dd-a1b8bcc5e9da tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:35.363658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9d08d9f0-0c69-4f12-96dd-a1b8bcc5e9da tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.477033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9d08d9f0-0c69-4f12-96dd-a1b8bcc5e9da tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.490393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9d08d9f0-0c69-4f12-96dd-a1b8bcc5e9da tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.492800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9d08d9f0-0c69-4f12-96dd-a1b8bcc5e9da tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.502181 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9d08d9f0-0c69-4f12-96dd-a1b8bcc5e9da tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "PUT /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1359 microversion: 2.75 time: 0.143547 Jul 20 04:17:35.503840 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 945/1999] 10.222.0.20 () {62 vars in 1296 bytes} [Wed Jul 20 04:17:35 2022] PUT /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:35.509094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-953b823e-e59c-401f-96ea-10cc72485cf1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.510004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-953b823e-e59c-401f-96ea-10cc72485cf1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.519240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-953b823e-e59c-401f-96ea-10cc72485cf1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.520021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-953b823e-e59c-401f-96ea-10cc72485cf1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.520937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-953b823e-e59c-401f-96ea-10cc72485cf1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.521520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-953b823e-e59c-401f-96ea-10cc72485cf1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.523118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-90b73040-00b2-4253-8439-9d3a0fbbc09b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.532976 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-90b73040-00b2-4253-8439-9d3a0fbbc09b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.217225 Jul 20 04:17:35.543104 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1055/2000] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:35.547778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8079b37f-fcb6-45c2-9dbf-eccc7dbd1810 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.548282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8079b37f-fcb6-45c2-9dbf-eccc7dbd1810 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.554681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8079b37f-fcb6-45c2-9dbf-eccc7dbd1810 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.555129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8079b37f-fcb6-45c2-9dbf-eccc7dbd1810 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.557027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8079b37f-fcb6-45c2-9dbf-eccc7dbd1810 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.557470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8079b37f-fcb6-45c2-9dbf-eccc7dbd1810 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.597477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8079b37f-fcb6-45c2-9dbf-eccc7dbd1810 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:35.713725 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8079b37f-fcb6-45c2-9dbf-eccc7dbd1810 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 204 len: 0 microversion: 2.1 time: 0.169512 Jul 20 04:17:35.714431 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1056/2001] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:35 2022] DELETE /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:35.716021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-953b823e-e59c-401f-96ea-10cc72485cf1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.721733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9397176e-eaca-42b4-a0be-a61dd42b8b9d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.722711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9397176e-eaca-42b4-a0be-a61dd42b8b9d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.729680 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-953b823e-e59c-401f-96ea-10cc72485cf1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1199 microversion: 2.1 time: 0.224028 Jul 20 04:17:35.730767 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 946/2002] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1199 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:35.738833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3d1dc118-7209-4441-933e-46b8e7a73c74 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.740039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3d1dc118-7209-4441-933e-46b8e7a73c74 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.749113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d1dc118-7209-4441-933e-46b8e7a73c74 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.750307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d1dc118-7209-4441-933e-46b8e7a73c74 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.751395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d1dc118-7209-4441-933e-46b8e7a73c74 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.752289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d1dc118-7209-4441-933e-46b8e7a73c74 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.793723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9397176e-eaca-42b4-a0be-a61dd42b8b9d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.802097 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9397176e-eaca-42b4-a0be-a61dd42b8b9d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1215 microversion: 2.1 time: 0.086221 Jul 20 04:17:35.802871 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1057/2003] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:35.807498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b8c74928-f85e-4a6d-a80e-0f7d87af661f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.808165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b8c74928-f85e-4a6d-a80e-0f7d87af661f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.819796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8c74928-f85e-4a6d-a80e-0f7d87af661f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.820487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8c74928-f85e-4a6d-a80e-0f7d87af661f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.821411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8c74928-f85e-4a6d-a80e-0f7d87af661f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.821874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8c74928-f85e-4a6d-a80e-0f7d87af661f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.893058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3d1dc118-7209-4441-933e-46b8e7a73c74 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.901544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3d1dc118-7209-4441-933e-46b8e7a73c74 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.903059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3d1dc118-7209-4441-933e-46b8e7a73c74 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.908551 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3d1dc118-7209-4441-933e-46b8e7a73c74 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1355 microversion: 2.75 time: 0.176387 Jul 20 04:17:35.909136 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 947/2004] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1355 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:35.913641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6ec31d4d-b3d0-4c95-ad95-441a1077afe4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.914248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6ec31d4d-b3d0-4c95-ad95-441a1077afe4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.920594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ec31d4d-b3d0-4c95-ad95-441a1077afe4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.921386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ec31d4d-b3d0-4c95-ad95-441a1077afe4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.922176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ec31d4d-b3d0-4c95-ad95-441a1077afe4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.922620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ec31d4d-b3d0-4c95-ad95-441a1077afe4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.010686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b8c74928-f85e-4a6d-a80e-0f7d87af661f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.018781 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b8c74928-f85e-4a6d-a80e-0f7d87af661f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1493 microversion: 2.1 time: 0.214718 Jul 20 04:17:36.019472 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1058/2005] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1493 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:36.071565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6ec31d4d-b3d0-4c95-ad95-441a1077afe4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.074626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:36.082899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6ec31d4d-b3d0-4c95-ad95-441a1077afe4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.084487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6ec31d4d-b3d0-4c95-ad95-441a1077afe4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.085599 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6ec31d4d-b3d0-4c95-ad95-441a1077afe4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1361 microversion: 2.25 time: 0.175544 Jul 20 04:17:36.086159 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 948/2006] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:36.550496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2ccae509-8318-40fc-a1f9-fd3cd799dc7e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.551107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2ccae509-8318-40fc-a1f9-fd3cd799dc7e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.557287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ccae509-8318-40fc-a1f9-fd3cd799dc7e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.557735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ccae509-8318-40fc-a1f9-fd3cd799dc7e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.558491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ccae509-8318-40fc-a1f9-fd3cd799dc7e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.558923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ccae509-8318-40fc-a1f9-fd3cd799dc7e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.691454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2ccae509-8318-40fc-a1f9-fd3cd799dc7e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.699023 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2ccae509-8318-40fc-a1f9-fd3cd799dc7e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.152415 Jul 20 04:17:36.699629 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1059/2007] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:36.747442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d2cc8de0-e269-44cc-9bec-9886fd9cee8c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.748723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d2cc8de0-e269-44cc-9bec-9886fd9cee8c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.756908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2cc8de0-e269-44cc-9bec-9886fd9cee8c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.757357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2cc8de0-e269-44cc-9bec-9886fd9cee8c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.758117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2cc8de0-e269-44cc-9bec-9886fd9cee8c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.758554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2cc8de0-e269-44cc-9bec-9886fd9cee8c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.821213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c0f7f058-7e48-4a1e-924b-86d723dff760 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.822101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c0f7f058-7e48-4a1e-924b-86d723dff760 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.828547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0f7f058-7e48-4a1e-924b-86d723dff760 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.829079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0f7f058-7e48-4a1e-924b-86d723dff760 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.829971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0f7f058-7e48-4a1e-924b-86d723dff760 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.830501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0f7f058-7e48-4a1e-924b-86d723dff760 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.898280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c0f7f058-7e48-4a1e-924b-86d723dff760 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.906965 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c0f7f058-7e48-4a1e-924b-86d723dff760 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1219 microversion: 2.1 time: 0.089485 Jul 20 04:17:36.916321 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1060/2008] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:36.921491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d2cc8de0-e269-44cc-9bec-9886fd9cee8c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.928219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-741a6368-e440-4791-a1d7-209aa24de30f tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.928961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-741a6368-e440-4791-a1d7-209aa24de30f tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.929600 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d2cc8de0-e269-44cc-9bec-9886fd9cee8c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1383 microversion: 2.1 time: 0.185882 Jul 20 04:17:36.930488 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 949/2009] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1383 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:36.935412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-741a6368-e440-4791-a1d7-209aa24de30f tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.935983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-741a6368-e440-4791-a1d7-209aa24de30f tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.936828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-741a6368-e440-4791-a1d7-209aa24de30f tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.937335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-741a6368-e440-4791-a1d7-209aa24de30f tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.946554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4f0c702d-535b-4d3c-9964-8f19702296ec tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.947724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4f0c702d-535b-4d3c-9964-8f19702296ec tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.955220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f0c702d-535b-4d3c-9964-8f19702296ec tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.955712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f0c702d-535b-4d3c-9964-8f19702296ec tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.956513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f0c702d-535b-4d3c-9964-8f19702296ec tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.956964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f0c702d-535b-4d3c-9964-8f19702296ec tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.057264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-741a6368-e440-4791-a1d7-209aa24de30f tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:37.065663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-741a6368-e440-4791-a1d7-209aa24de30f tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:37.067173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-741a6368-e440-4791-a1d7-209aa24de30f tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:37.074643 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-741a6368-e440-4791-a1d7-209aa24de30f tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1355 microversion: 2.75 time: 0.150235 Jul 20 04:17:37.075669 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1061/2010] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1355 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:37.081107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dab1781d-050b-4ba0-87c2-597a6869c9ff tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.081732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dab1781d-050b-4ba0-87c2-597a6869c9ff tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.083700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:37.089394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dab1781d-050b-4ba0-87c2-597a6869c9ff tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.089856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dab1781d-050b-4ba0-87c2-597a6869c9ff tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.090633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dab1781d-050b-4ba0-87c2-597a6869c9ff tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.091233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dab1781d-050b-4ba0-87c2-597a6869c9ff tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.122182 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4f0c702d-535b-4d3c-9964-8f19702296ec tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1536 microversion: 2.1 time: 0.180246 Jul 20 04:17:37.122778 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 950/2011] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1536 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:37.133406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-67e69629-2f37-4cd3-82ac-925793fd1017 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.133406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-67e69629-2f37-4cd3-82ac-925793fd1017 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.134248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-67e69629-2f37-4cd3-82ac-925793fd1017 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.135019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-67e69629-2f37-4cd3-82ac-925793fd1017 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.135539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-67e69629-2f37-4cd3-82ac-925793fd1017 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.136697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-67e69629-2f37-4cd3-82ac-925793fd1017 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.301665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dab1781d-050b-4ba0-87c2-597a6869c9ff tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:37.309342 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dab1781d-050b-4ba0-87c2-597a6869c9ff tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1493 microversion: 2.1 time: 0.232217 Jul 20 04:17:37.309847 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1062/2012] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:37 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1493 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:37.314553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-80b76354-2f29-4a6e-ae94-c40bf677ef93 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.315176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-80b76354-2f29-4a6e-ae94-c40bf677ef93 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.321071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80b76354-2f29-4a6e-ae94-c40bf677ef93 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.321533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80b76354-2f29-4a6e-ae94-c40bf677ef93 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.322312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80b76354-2f29-4a6e-ae94-c40bf677ef93 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.322946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80b76354-2f29-4a6e-ae94-c40bf677ef93 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.331309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-67e69629-2f37-4cd3-82ac-925793fd1017 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:37.341515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-67e69629-2f37-4cd3-82ac-925793fd1017 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:37.344009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-67e69629-2f37-4cd3-82ac-925793fd1017 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:37.345130 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-67e69629-2f37-4cd3-82ac-925793fd1017 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1361 microversion: 2.25 time: 0.221345 Jul 20 04:17:37.345862 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 951/2013] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:37 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:37.462026 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-80b76354-2f29-4a6e-ae94-c40bf677ef93 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1536 microversion: 2.1 time: 0.151089 Jul 20 04:17:37.466472 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1063/2014] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:37 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1536 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:37.479427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6819fa1-ae27-426e-8241-260641c24f06 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.480816 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:37.480816 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:17:37.482052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6819fa1-ae27-426e-8241-260641c24f06 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.482518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6819fa1-ae27-426e-8241-260641c24f06 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.483409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6819fa1-ae27-426e-8241-260641c24f06 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.483885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6819fa1-ae27-426e-8241-260641c24f06 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.506993 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e6819fa1-ae27-426e-8241-260641c24f06 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.031179 Jul 20 04:17:37.507612 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 952/2015] 10.222.0.20 () {58 vars in 1175 bytes} [Wed Jul 20 04:17:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:37.518862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da525d6f-ae85-41ac-ac55-6e7b916436ee tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-764485-11", "block_migration": false, "disk_over_commit": false}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:37.520109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-da525d6f-ae85-41ac-ac55-6e7b916436ee tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.526543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da525d6f-ae85-41ac-ac55-6e7b916436ee tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.526994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da525d6f-ae85-41ac-ac55-6e7b916436ee tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.527797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da525d6f-ae85-41ac-ac55-6e7b916436ee tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.528239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da525d6f-ae85-41ac-ac55-6e7b916436ee tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.552994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-da525d6f-ae85-41ac-ac55-6e7b916436ee tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lazy-loading 'flavor' on Instance uuid 838c7de4-25f3-481a-b89f-6562178ccce0 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:37.564855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-da525d6f-ae85-41ac-ac55-6e7b916436ee tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Going to try to live migrate instance to n-h2-764485-11 {{(pid=119808) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:17:37.626237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:37.715976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3a6bc69e-6487-484f-b4a3-2d80826f561e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.716889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3a6bc69e-6487-484f-b4a3-2d80826f561e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.723912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a6bc69e-6487-484f-b4a3-2d80826f561e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.724740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a6bc69e-6487-484f-b4a3-2d80826f561e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.725140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a6bc69e-6487-484f-b4a3-2d80826f561e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.725587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a6bc69e-6487-484f-b4a3-2d80826f561e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.865471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3a6bc69e-6487-484f-b4a3-2d80826f561e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:37.874028 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3a6bc69e-6487-484f-b4a3-2d80826f561e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.161387 Jul 20 04:17:37.874740 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 953/2016] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:37 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:37.923903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1a44a8ad-9106-4d9e-a8ef-29ce6ea8b76d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.924530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1a44a8ad-9106-4d9e-a8ef-29ce6ea8b76d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.930702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a44a8ad-9106-4d9e-a8ef-29ce6ea8b76d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.931156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a44a8ad-9106-4d9e-a8ef-29ce6ea8b76d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.932063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a44a8ad-9106-4d9e-a8ef-29ce6ea8b76d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.932502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a44a8ad-9106-4d9e-a8ef-29ce6ea8b76d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.001561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1a44a8ad-9106-4d9e-a8ef-29ce6ea8b76d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.011369 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1a44a8ad-9106-4d9e-a8ef-29ce6ea8b76d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1267 microversion: 2.1 time: 0.091430 Jul 20 04:17:38.011985 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 954/2017] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:37 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:38.096210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e79109da-c69b-46ab-9942-e9a3d5ed8469 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.096827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e79109da-c69b-46ab-9942-e9a3d5ed8469 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:38.104605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e79109da-c69b-46ab-9942-e9a3d5ed8469 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.105245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e79109da-c69b-46ab-9942-e9a3d5ed8469 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.106021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e79109da-c69b-46ab-9942-e9a3d5ed8469 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.106453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e79109da-c69b-46ab-9942-e9a3d5ed8469 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.178032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e79109da-c69b-46ab-9942-e9a3d5ed8469 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.186393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e79109da-c69b-46ab-9942-e9a3d5ed8469 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.188030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e79109da-c69b-46ab-9942-e9a3d5ed8469 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.193156 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e79109da-c69b-46ab-9942-e9a3d5ed8469 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1419 microversion: 2.75 time: 0.102539 Jul 20 04:17:38.193736 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 955/2018] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:38 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1419 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:38.327097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2208a84c-413a-4219-b0f8-d403ff4830b8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.327649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2208a84c-413a-4219-b0f8-d403ff4830b8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:38.334407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2208a84c-413a-4219-b0f8-d403ff4830b8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.335026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2208a84c-413a-4219-b0f8-d403ff4830b8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.336054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2208a84c-413a-4219-b0f8-d403ff4830b8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.336568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2208a84c-413a-4219-b0f8-d403ff4830b8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.542511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2208a84c-413a-4219-b0f8-d403ff4830b8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.553946 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2208a84c-413a-4219-b0f8-d403ff4830b8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1493 microversion: 2.1 time: 0.231284 Jul 20 04:17:38.555381 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 956/2019] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:38 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1493 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:38.560393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5234de0e-791c-484b-83d1-b3e9e23a19d7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.561766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5234de0e-791c-484b-83d1-b3e9e23a19d7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:38.568870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5234de0e-791c-484b-83d1-b3e9e23a19d7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.569404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5234de0e-791c-484b-83d1-b3e9e23a19d7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.570237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5234de0e-791c-484b-83d1-b3e9e23a19d7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.570774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5234de0e-791c-484b-83d1-b3e9e23a19d7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.722390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5234de0e-791c-484b-83d1-b3e9e23a19d7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.730503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5234de0e-791c-484b-83d1-b3e9e23a19d7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.732043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5234de0e-791c-484b-83d1-b3e9e23a19d7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.734176 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5234de0e-791c-484b-83d1-b3e9e23a19d7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1361 microversion: 2.25 time: 0.176895 Jul 20 04:17:38.734763 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 957/2020] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:38 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:38.741158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-21478c3a-cd7f-44fa-8498-a650d99b073a req-b979aff2-8a45-4413-ac5c-4d78f1e1852c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7da181-3013-4dcb-aaeb-3fa090a01941", "name": "network-vif-plugged", "status": "completed", "tag": "c1b4726b-e1ba-4b8b-86cc-729b8499f72b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:38.752093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-21478c3a-cd7f-44fa-8498-a650d99b073a req-b979aff2-8a45-4413-ac5c-4d78f1e1852c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.752547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-21478c3a-cd7f-44fa-8498-a650d99b073a req-b979aff2-8a45-4413-ac5c-4d78f1e1852c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.768655 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-21478c3a-cd7f-44fa-8498-a650d99b073a req-b979aff2-8a45-4413-ac5c-4d78f1e1852c service nova] Creating event network-vif-plugged:c1b4726b-e1ba-4b8b-86cc-729b8499f72b for instance cb7da181-3013-4dcb-aaeb-3fa090a01941 on n-h1-764485-11 Jul 20 04:17:38.775530 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-21478c3a-cd7f-44fa-8498-a650d99b073a req-b979aff2-8a45-4413-ac5c-4d78f1e1852c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038178 Jul 20 04:17:38.777291 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 958/2021] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:38.893602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9b178202-b421-47e5-a10c-f8963acae455 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.894300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9b178202-b421-47e5-a10c-f8963acae455 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:38.909860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b178202-b421-47e5-a10c-f8963acae455 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.910323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b178202-b421-47e5-a10c-f8963acae455 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.911115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b178202-b421-47e5-a10c-f8963acae455 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.911887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b178202-b421-47e5-a10c-f8963acae455 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.213080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9b178202-b421-47e5-a10c-f8963acae455 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.222646 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9b178202-b421-47e5-a10c-f8963acae455 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.335613 Jul 20 04:17:39.223659 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 959/2022] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:38 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:39.228401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d86b76f9-4a5d-4230-b618-04ab74b0ff86 req-86bee254-fdca-4886-8ed4-c4cf25b5de47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf4efd9-d89f-4775-adb9-fb25596bcd90", "name": "network-vif-deleted", "tag": "5e4d8f7c-c8ab-4712-8ae2-7d6d6b1b7917"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:39.237485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d86b76f9-4a5d-4230-b618-04ab74b0ff86 req-86bee254-fdca-4886-8ed4-c4cf25b5de47 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.238442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d86b76f9-4a5d-4230-b618-04ab74b0ff86 req-86bee254-fdca-4886-8ed4-c4cf25b5de47 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.251132 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d86b76f9-4a5d-4230-b618-04ab74b0ff86 req-86bee254-fdca-4886-8ed4-c4cf25b5de47 service nova] Creating event network-vif-deleted:5e4d8f7c-c8ab-4712-8ae2-7d6d6b1b7917 for instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 on n-h2-764485-11 Jul 20 04:17:39.256527 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d86b76f9-4a5d-4230-b618-04ab74b0ff86 req-86bee254-fdca-4886-8ed4-c4cf25b5de47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031475 Jul 20 04:17:39.257303 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 960/2023] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:39.262717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e73a58ad-cd7e-43aa-be82-a9dd9ca2591d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.263427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e73a58ad-cd7e-43aa-be82-a9dd9ca2591d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.270165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e73a58ad-cd7e-43aa-be82-a9dd9ca2591d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.270631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e73a58ad-cd7e-43aa-be82-a9dd9ca2591d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.271416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e73a58ad-cd7e-43aa-be82-a9dd9ca2591d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.271891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e73a58ad-cd7e-43aa-be82-a9dd9ca2591d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.348114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e73a58ad-cd7e-43aa-be82-a9dd9ca2591d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.356267 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e73a58ad-cd7e-43aa-be82-a9dd9ca2591d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1273 microversion: 2.1 time: 0.097575 Jul 20 04:17:39.358431 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 961/2024] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:39.363892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5c00ee7e-27b8-4089-b74f-7e7b06b1370c tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.364737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5c00ee7e-27b8-4089-b74f-7e7b06b1370c tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.371319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c00ee7e-27b8-4089-b74f-7e7b06b1370c tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.373135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c00ee7e-27b8-4089-b74f-7e7b06b1370c tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.374209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c00ee7e-27b8-4089-b74f-7e7b06b1370c tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.374565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c00ee7e-27b8-4089-b74f-7e7b06b1370c tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.425182 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da525d6f-ae85-41ac-ac55-6e7b916436ee tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0/action" status: 202 len: 0 microversion: 2.1 time: 1.909910 Jul 20 04:17:39.426068 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1064/2025] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:37 2022] POST /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0/action => generated 0 bytes in 1912 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:39.434470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-466fab4d-7b88-446b-9f37-1d1025ca8d3c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.435498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-466fab4d-7b88-446b-9f37-1d1025ca8d3c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.443750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-466fab4d-7b88-446b-9f37-1d1025ca8d3c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.444770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-466fab4d-7b88-446b-9f37-1d1025ca8d3c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.445736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-466fab4d-7b88-446b-9f37-1d1025ca8d3c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.446284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-466fab4d-7b88-446b-9f37-1d1025ca8d3c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.463556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5c00ee7e-27b8-4089-b74f-7e7b06b1370c tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.479783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5c00ee7e-27b8-4089-b74f-7e7b06b1370c tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.481518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5c00ee7e-27b8-4089-b74f-7e7b06b1370c tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.487792 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5c00ee7e-27b8-4089-b74f-7e7b06b1370c tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1417 microversion: 2.75 time: 0.127528 Jul 20 04:17:39.491555 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 962/2026] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1417 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:39.572022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6a949c38-d84e-431f-b170-b05e18af9d74 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.572642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6a949c38-d84e-431f-b170-b05e18af9d74 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.579372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a949c38-d84e-431f-b170-b05e18af9d74 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.579919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a949c38-d84e-431f-b170-b05e18af9d74 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.580697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a949c38-d84e-431f-b170-b05e18af9d74 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.581140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a949c38-d84e-431f-b170-b05e18af9d74 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.614702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a949c38-d84e-431f-b170-b05e18af9d74 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.615162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a949c38-d84e-431f-b170-b05e18af9d74 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.615645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-6a949c38-d84e-431f-b170-b05e18af9d74 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lazy-loading 'fault' on Instance uuid 5bf4efd9-d89f-4775-adb9-fb25596bcd90 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:39.672048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6a949c38-d84e-431f-b170-b05e18af9d74 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.679771 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6a949c38-d84e-431f-b170-b05e18af9d74 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1305 microversion: 2.1 time: 0.111547 Jul 20 04:17:39.680268 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 963/2027] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:39.725069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-466fab4d-7b88-446b-9f37-1d1025ca8d3c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.733568 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-466fab4d-7b88-446b-9f37-1d1025ca8d3c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.302541 Jul 20 04:17:39.734222 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1065/2028] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:39.752149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9e3e4d93-da26-437f-8ae8-105a18fa2e0a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.752761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9e3e4d93-da26-437f-8ae8-105a18fa2e0a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.760302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e3e4d93-da26-437f-8ae8-105a18fa2e0a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.760876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e3e4d93-da26-437f-8ae8-105a18fa2e0a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.761800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e3e4d93-da26-437f-8ae8-105a18fa2e0a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.762312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e3e4d93-da26-437f-8ae8-105a18fa2e0a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.971571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9e3e4d93-da26-437f-8ae8-105a18fa2e0a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.979838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9e3e4d93-da26-437f-8ae8-105a18fa2e0a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.981344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9e3e4d93-da26-437f-8ae8-105a18fa2e0a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.982562 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9e3e4d93-da26-437f-8ae8-105a18fa2e0a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1361 microversion: 2.25 time: 0.234354 Jul 20 04:17:39.983178 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 964/2029] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:40.240557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a34492d6-9c3d-4724-a8f6-1242d9bded79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:40.241179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a34492d6-9c3d-4724-a8f6-1242d9bded79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:40.249651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a34492d6-9c3d-4724-a8f6-1242d9bded79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.250089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a34492d6-9c3d-4724-a8f6-1242d9bded79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.250874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a34492d6-9c3d-4724-a8f6-1242d9bded79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.251319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a34492d6-9c3d-4724-a8f6-1242d9bded79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.374345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-457eabdf-744c-432d-9613-78bb749ca71f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:40.374970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-457eabdf-744c-432d-9613-78bb749ca71f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:40.381293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-457eabdf-744c-432d-9613-78bb749ca71f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.381752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-457eabdf-744c-432d-9613-78bb749ca71f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.382535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-457eabdf-744c-432d-9613-78bb749ca71f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.382983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-457eabdf-744c-432d-9613-78bb749ca71f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.383585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a34492d6-9c3d-4724-a8f6-1242d9bded79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.393950 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a34492d6-9c3d-4724-a8f6-1242d9bded79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.157244 Jul 20 04:17:40.394532 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1066/2030] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:40 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:40.508921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7b8d090e-362e-485d-85ec-4068d911b5af tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:40.509617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7b8d090e-362e-485d-85ec-4068d911b5af tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:40.514456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-457eabdf-744c-432d-9613-78bb749ca71f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.516915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b8d090e-362e-485d-85ec-4068d911b5af tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.517370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b8d090e-362e-485d-85ec-4068d911b5af tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.518152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b8d090e-362e-485d-85ec-4068d911b5af tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.518604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b8d090e-362e-485d-85ec-4068d911b5af tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.522205 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-457eabdf-744c-432d-9613-78bb749ca71f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1315 microversion: 2.1 time: 0.151856 Jul 20 04:17:40.523551 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 965/2031] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:40 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:40.584330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7b8d090e-362e-485d-85ec-4068d911b5af tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.592806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7b8d090e-362e-485d-85ec-4068d911b5af tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.594996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7b8d090e-362e-485d-85ec-4068d911b5af tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.600277 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7b8d090e-362e-485d-85ec-4068d911b5af tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1417 microversion: 2.75 time: 0.095355 Jul 20 04:17:40.612108 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1067/2032] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:40 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1417 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:40.696914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9085d524-b59a-4255-ae4c-82c6b0e232ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:40.697673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9085d524-b59a-4255-ae4c-82c6b0e232ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:40.704940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9085d524-b59a-4255-ae4c-82c6b0e232ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.705392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9085d524-b59a-4255-ae4c-82c6b0e232ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.706248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9085d524-b59a-4255-ae4c-82c6b0e232ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.706708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9085d524-b59a-4255-ae4c-82c6b0e232ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.737999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9085d524-b59a-4255-ae4c-82c6b0e232ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.738511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9085d524-b59a-4255-ae4c-82c6b0e232ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.738959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-9085d524-b59a-4255-ae4c-82c6b0e232ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lazy-loading 'fault' on Instance uuid 5bf4efd9-d89f-4775-adb9-fb25596bcd90 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:40.750863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ede8f949-6bca-4dd7-8a6f-f98fc71046f2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:40.751942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ede8f949-6bca-4dd7-8a6f-f98fc71046f2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:40.759055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ede8f949-6bca-4dd7-8a6f-f98fc71046f2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.759548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ede8f949-6bca-4dd7-8a6f-f98fc71046f2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.760497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ede8f949-6bca-4dd7-8a6f-f98fc71046f2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.760869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ede8f949-6bca-4dd7-8a6f-f98fc71046f2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.783913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9085d524-b59a-4255-ae4c-82c6b0e232ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.786212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:40.793207 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9085d524-b59a-4255-ae4c-82c6b0e232ba tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1305 microversion: 2.1 time: 0.100129 Jul 20 04:17:40.794846 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 966/2033] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:40 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:40.902707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ede8f949-6bca-4dd7-8a6f-f98fc71046f2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.910187 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ede8f949-6bca-4dd7-8a6f-f98fc71046f2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.164000 Jul 20 04:17:40.910758 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1068/2034] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:40 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:41.001543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c72856ce-5fd4-4009-8dbc-25c433680b45 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.002156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c72856ce-5fd4-4009-8dbc-25c433680b45 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.008480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c72856ce-5fd4-4009-8dbc-25c433680b45 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.008924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c72856ce-5fd4-4009-8dbc-25c433680b45 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.009732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c72856ce-5fd4-4009-8dbc-25c433680b45 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.010149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c72856ce-5fd4-4009-8dbc-25c433680b45 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.141691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c72856ce-5fd4-4009-8dbc-25c433680b45 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.149733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c72856ce-5fd4-4009-8dbc-25c433680b45 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.151240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c72856ce-5fd4-4009-8dbc-25c433680b45 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.152415 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c72856ce-5fd4-4009-8dbc-25c433680b45 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1557 microversion: 2.25 time: 0.155421 Jul 20 04:17:41.152969 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 967/2035] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:40 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:41.169318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-51bf786a-c28e-475f-9b04-29177875a9cf tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.170647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-51bf786a-c28e-475f-9b04-29177875a9cf tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.177139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51bf786a-c28e-475f-9b04-29177875a9cf tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.177583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51bf786a-c28e-475f-9b04-29177875a9cf tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.178336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51bf786a-c28e-475f-9b04-29177875a9cf tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.178767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51bf786a-c28e-475f-9b04-29177875a9cf tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.307049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-51bf786a-c28e-475f-9b04-29177875a9cf tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid cb7da181-3013-4dcb-aaeb-3fa090a01941 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:41.359260 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-51bf786a-c28e-475f-9b04-29177875a9cf tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 2051 microversion: 2.25 time: 0.193558 Jul 20 04:17:41.359869 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1069/2036] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 2051 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:41.376874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cdfd06cb-0c25-43ab-ad39-7a043dedbb2d tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.377495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cdfd06cb-0c25-43ab-ad39-7a043dedbb2d tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.383503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdfd06cb-0c25-43ab-ad39-7a043dedbb2d tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.383982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdfd06cb-0c25-43ab-ad39-7a043dedbb2d tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.384741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdfd06cb-0c25-43ab-ad39-7a043dedbb2d tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.385175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdfd06cb-0c25-43ab-ad39-7a043dedbb2d tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.410728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-93031742-7bf6-443e-8950-f673433462a1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.411367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-93031742-7bf6-443e-8950-f673433462a1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.417433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93031742-7bf6-443e-8950-f673433462a1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.417885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93031742-7bf6-443e-8950-f673433462a1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.418652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93031742-7bf6-443e-8950-f673433462a1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.419092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93031742-7bf6-443e-8950-f673433462a1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.572172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-cdfd06cb-0c25-43ab-ad39-7a043dedbb2d tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid cb7da181-3013-4dcb-aaeb-3fa090a01941 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:41.585286 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cdfd06cb-0c25-43ab-ad39-7a043dedbb2d tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 2051 microversion: 2.25 time: 0.212670 Jul 20 04:17:41.585855 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 968/2037] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 2051 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:41.589905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-93031742-7bf6-443e-8950-f673433462a1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.590385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a8f497cf-8dcf-4428-92c8-c16a4d53b05b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.590904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a8f497cf-8dcf-4428-92c8-c16a4d53b05b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.593827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:41.599239 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-93031742-7bf6-443e-8950-f673433462a1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.192396 Jul 20 04:17:41.600029 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1070/2038] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:41.600706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8f497cf-8dcf-4428-92c8-c16a4d53b05b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.601150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8f497cf-8dcf-4428-92c8-c16a4d53b05b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.601996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8f497cf-8dcf-4428-92c8-c16a4d53b05b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.602438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8f497cf-8dcf-4428-92c8-c16a4d53b05b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.604887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-41b02791-d6e0-4e0b-bc50-fa6dc6c384dc tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.606197 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:41.606197 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:17:41.608268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41b02791-d6e0-4e0b-bc50-fa6dc6c384dc tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.609622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41b02791-d6e0-4e0b-bc50-fa6dc6c384dc tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.610454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41b02791-d6e0-4e0b-bc50-fa6dc6c384dc tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.610891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41b02791-d6e0-4e0b-bc50-fa6dc6c384dc tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.636573 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-41b02791-d6e0-4e0b-bc50-fa6dc6c384dc tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.035153 Jul 20 04:17:41.637188 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1071/2039] 10.222.0.20 () {60 vars in 1216 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:17:41.642205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1bf30230-edb5-406e-9c0b-509b00064eb0 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.642812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1bf30230-edb5-406e-9c0b-509b00064eb0 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.649806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1bf30230-edb5-406e-9c0b-509b00064eb0 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.650254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1bf30230-edb5-406e-9c0b-509b00064eb0 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.651204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1bf30230-edb5-406e-9c0b-509b00064eb0 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.651674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1bf30230-edb5-406e-9c0b-509b00064eb0 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.730781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1bf30230-edb5-406e-9c0b-509b00064eb0 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.739777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1bf30230-edb5-406e-9c0b-509b00064eb0 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.741280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1bf30230-edb5-406e-9c0b-509b00064eb0 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.746563 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1bf30230-edb5-406e-9c0b-509b00064eb0 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1417 microversion: 2.75 time: 0.108397 Jul 20 04:17:41.747139 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1072/2040] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1417 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:41.752271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e020c865-32f2-4017-8f98-75e9b38f15e0 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:41.752871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e020c865-32f2-4017-8f98-75e9b38f15e0 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.759112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e020c865-32f2-4017-8f98-75e9b38f15e0 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.759603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e020c865-32f2-4017-8f98-75e9b38f15e0 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.760511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e020c865-32f2-4017-8f98-75e9b38f15e0 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.760945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e020c865-32f2-4017-8f98-75e9b38f15e0 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.762638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a8f497cf-8dcf-4428-92c8-c16a4d53b05b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.773961 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a8f497cf-8dcf-4428-92c8-c16a4d53b05b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1315 microversion: 2.1 time: 0.186131 Jul 20 04:17:41.781824 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 969/2041] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:41.811205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-edc205ba-f4a4-484c-be3b-5ed6f349b328 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.811855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-edc205ba-f4a4-484c-be3b-5ed6f349b328 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.818975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edc205ba-f4a4-484c-be3b-5ed6f349b328 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.819604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edc205ba-f4a4-484c-be3b-5ed6f349b328 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.820388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edc205ba-f4a4-484c-be3b-5ed6f349b328 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.820832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edc205ba-f4a4-484c-be3b-5ed6f349b328 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.832640 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e020c865-32f2-4017-8f98-75e9b38f15e0 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941/action" status: 202 len: 0 microversion: 2.25 time: 0.084239 Jul 20 04:17:41.833288 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1073/2042] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:17:41 2022] POST /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:41.842352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7944ea29-6b4b-492e-800e-40089458f01a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.843070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7944ea29-6b4b-492e-800e-40089458f01a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.849689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7944ea29-6b4b-492e-800e-40089458f01a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.850143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7944ea29-6b4b-492e-800e-40089458f01a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.851118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7944ea29-6b4b-492e-800e-40089458f01a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.851760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7944ea29-6b4b-492e-800e-40089458f01a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.863636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edc205ba-f4a4-484c-be3b-5ed6f349b328 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.864118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edc205ba-f4a4-484c-be3b-5ed6f349b328 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.864573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-edc205ba-f4a4-484c-be3b-5ed6f349b328 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lazy-loading 'fault' on Instance uuid 5bf4efd9-d89f-4775-adb9-fb25596bcd90 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:41.925850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-edc205ba-f4a4-484c-be3b-5ed6f349b328 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.934227 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-edc205ba-f4a4-484c-be3b-5ed6f349b328 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 200 len: 1305 microversion: 2.1 time: 0.126803 Jul 20 04:17:41.934898 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 970/2043] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 1305 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:41.940546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4b78e296-2185-4300-aa9c-9cc183f1871f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.941163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4b78e296-2185-4300-aa9c-9cc183f1871f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.947341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b78e296-2185-4300-aa9c-9cc183f1871f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.947993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b78e296-2185-4300-aa9c-9cc183f1871f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.948794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b78e296-2185-4300-aa9c-9cc183f1871f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.951868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b78e296-2185-4300-aa9c-9cc183f1871f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.076689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-7944ea29-6b4b-492e-800e-40089458f01a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid cb7da181-3013-4dcb-aaeb-3fa090a01941 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:42.101332 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7944ea29-6b4b-492e-800e-40089458f01a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 2056 microversion: 2.25 time: 0.263422 Jul 20 04:17:42.113804 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1074/2044] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 2056 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:42.468762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4b78e296-2185-4300-aa9c-9cc183f1871f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.476527 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4b78e296-2185-4300-aa9c-9cc183f1871f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.540421 Jul 20 04:17:42.477307 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 971/2045] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:42.618211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-75941968-4c9e-49a5-a4a6-056fe16b8a86 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.618827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-75941968-4c9e-49a5-a4a6-056fe16b8a86 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.626179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75941968-4c9e-49a5-a4a6-056fe16b8a86 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.626710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75941968-4c9e-49a5-a4a6-056fe16b8a86 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.627488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75941968-4c9e-49a5-a4a6-056fe16b8a86 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.627957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75941968-4c9e-49a5-a4a6-056fe16b8a86 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.766614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e7adf45a-824f-4e74-82c4-cdadd1e3c1ef tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.767253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e7adf45a-824f-4e74-82c4-cdadd1e3c1ef tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.775625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7adf45a-824f-4e74-82c4-cdadd1e3c1ef tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.775625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7adf45a-824f-4e74-82c4-cdadd1e3c1ef tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.776150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7adf45a-824f-4e74-82c4-cdadd1e3c1ef tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.776588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7adf45a-824f-4e74-82c4-cdadd1e3c1ef tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.882753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e7adf45a-824f-4e74-82c4-cdadd1e3c1ef tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.886856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-75941968-4c9e-49a5-a4a6-056fe16b8a86 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.893543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e7adf45a-824f-4e74-82c4-cdadd1e3c1ef tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.896931 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-75941968-4c9e-49a5-a4a6-056fe16b8a86 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.282502 Jul 20 04:17:42.897803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e7adf45a-824f-4e74-82c4-cdadd1e3c1ef tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.903795 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e7adf45a-824f-4e74-82c4-cdadd1e3c1ef tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1417 microversion: 2.75 time: 0.141250 Jul 20 04:17:42.908544 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1075/2046] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:42.914532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b116407-2258-4f12-bbd5-83f35159ff74 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.915373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b116407-2258-4f12-bbd5-83f35159ff74 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.916695 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 972/2047] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1417 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:42.924389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b116407-2258-4f12-bbd5-83f35159ff74 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.925095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b116407-2258-4f12-bbd5-83f35159ff74 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.925875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b116407-2258-4f12-bbd5-83f35159ff74 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.926323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b116407-2258-4f12-bbd5-83f35159ff74 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.955759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2459d987-40f6-4396-8398-6462618e7534 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.956408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2459d987-40f6-4396-8398-6462618e7534 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.963682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2459d987-40f6-4396-8398-6462618e7534 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.964136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2459d987-40f6-4396-8398-6462618e7534 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.964930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2459d987-40f6-4396-8398-6462618e7534 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.965371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2459d987-40f6-4396-8398-6462618e7534 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.985620 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-2459d987-40f6-4396-8398-6462618e7534 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2459d987-40f6-4396-8398-6462618e7534 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 HTTP/1.1 Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '5bf4efd9-d89f-4775-adb9-fb25596bcd90'} Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:42.987223 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:42.993282 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:42.993282 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:42.993282 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:42.993282 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:42.993282 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:42.993282 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:17:42.993282 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:42.993282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2459d987-40f6-4396-8398-6462618e7534 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:42.993282 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2459d987-40f6-4396-8398-6462618e7534 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 404 len: 111 microversion: 2.1 time: 0.041325 Jul 20 04:17:42.993282 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 973/2048] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:43.105655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-16736790", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2f1733ae-f5aa-4d8e-b430-1f99c985f6d9"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:43.170455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] validate_networks() for [('2f1733ae-f5aa-4d8e-b430-1f99c985f6d9', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:43.177521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0b116407-2258-4f12-bbd5-83f35159ff74 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:43.191970 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b116407-2258-4f12-bbd5-83f35159ff74 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1315 microversion: 2.1 time: 0.282123 Jul 20 04:17:43.192572 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1076/2049] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:43.206759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57c3e661-881b-4d08-99dc-9aeaa981b80c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:43.207742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-57c3e661-881b-4d08-99dc-9aeaa981b80c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:43.215829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57c3e661-881b-4d08-99dc-9aeaa981b80c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.216291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57c3e661-881b-4d08-99dc-9aeaa981b80c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.217709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57c3e661-881b-4d08-99dc-9aeaa981b80c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.218158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57c3e661-881b-4d08-99dc-9aeaa981b80c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.502751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-57c3e661-881b-4d08-99dc-9aeaa981b80c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid cb7da181-3013-4dcb-aaeb-3fa090a01941 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:43.518458 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57c3e661-881b-4d08-99dc-9aeaa981b80c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 2036 microversion: 2.25 time: 0.315575 Jul 20 04:17:43.518988 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1077/2050] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:43 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 2036 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:43.523491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-d3c1e86a-012f-4a38-a1e6-284b8d00a3e9 req-8be9b1c4-5576-4416-9423-e736758f3920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a749b53d-cbac-4db3-9cbf-6ef098f37cd8", "tag": "8db84d6a-e65e-407f-b791-d9e906efb840"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:43.532349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d3c1e86a-012f-4a38-a1e6-284b8d00a3e9 req-8be9b1c4-5576-4416-9423-e736758f3920 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.532801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d3c1e86a-012f-4a38-a1e6-284b8d00a3e9 req-8be9b1c4-5576-4416-9423-e736758f3920 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.543278 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-d3c1e86a-012f-4a38-a1e6-284b8d00a3e9 req-8be9b1c4-5576-4416-9423-e736758f3920 service nova] Creating event network-changed:8db84d6a-e65e-407f-b791-d9e906efb840 for instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 on n-h2-764485-11 Jul 20 04:17:43.548215 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-d3c1e86a-012f-4a38-a1e6-284b8d00a3e9 req-8be9b1c4-5576-4416-9423-e736758f3920 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028110 Jul 20 04:17:43.548820 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1078/2051] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:43.553857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49752deb-9f47-417f-b472-d5593cccf6c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:43.554569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-49752deb-9f47-417f-b472-d5593cccf6c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:43.561017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49752deb-9f47-417f-b472-d5593cccf6c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.561465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49752deb-9f47-417f-b472-d5593cccf6c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.562219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49752deb-9f47-417f-b472-d5593cccf6c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.562674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49752deb-9f47-417f-b472-d5593cccf6c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.870821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-49752deb-9f47-417f-b472-d5593cccf6c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:43.880900 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-49752deb-9f47-417f-b472-d5593cccf6c5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.330906 Jul 20 04:17:43.881495 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1079/2052] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:43 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:43.885956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a90881c1-fbdb-40d0-a0f7-649b2f7024f9 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-764485-11", "block_migration": "auto"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:43.887109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a90881c1-fbdb-40d0-a0f7-649b2f7024f9 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:43.894708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a90881c1-fbdb-40d0-a0f7-649b2f7024f9 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.895536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a90881c1-fbdb-40d0-a0f7-649b2f7024f9 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.896398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a90881c1-fbdb-40d0-a0f7-649b2f7024f9 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.897065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a90881c1-fbdb-40d0-a0f7-649b2f7024f9 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.926329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-a90881c1-fbdb-40d0-a0f7-649b2f7024f9 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'flavor' on Instance uuid cb7da181-3013-4dcb-aaeb-3fa090a01941 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:43.930010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:43.937415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:43.938834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:43.939295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:43.939746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:43.939896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a90881c1-fbdb-40d0-a0f7-649b2f7024f9 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Going to try to live migrate instance to n-h2-764485-11 {{(pid=119808) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:17:43.940249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:43.952411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.952823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.954157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.954628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.974103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:43.979885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for user 793c626644204dc3a08ed9118c9aaf4c and project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:43.999960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:44.006421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:44.075452 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-98fe4598-ac73-4e9f-802d-d86c1ceeb2a5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974091 Jul 20 04:17:44.077972 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 974/2053] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:17:44.083843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-23f7e12f-dab6-4595-9ef2-e18429df2ef6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.084490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-23f7e12f-dab6-4595-9ef2-e18429df2ef6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.093186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23f7e12f-dab6-4595-9ef2-e18429df2ef6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.094059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23f7e12f-dab6-4595-9ef2-e18429df2ef6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.094862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23f7e12f-dab6-4595-9ef2-e18429df2ef6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.095474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23f7e12f-dab6-4595-9ef2-e18429df2ef6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.322633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-23f7e12f-dab6-4595-9ef2-e18429df2ef6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.340421 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-23f7e12f-dab6-4595-9ef2-e18429df2ef6 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.261158 Jul 20 04:17:44.341921 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 975/2054] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:44.348211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f38efb38-fbd0-4044-8ea9-f64437818188 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.349277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f38efb38-fbd0-4044-8ea9-f64437818188 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.358033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f38efb38-fbd0-4044-8ea9-f64437818188 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.358922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f38efb38-fbd0-4044-8ea9-f64437818188 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.360131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f38efb38-fbd0-4044-8ea9-f64437818188 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.360789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f38efb38-fbd0-4044-8ea9-f64437818188 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.442959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f38efb38-fbd0-4044-8ea9-f64437818188 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.453253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f38efb38-fbd0-4044-8ea9-f64437818188 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.455308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f38efb38-fbd0-4044-8ea9-f64437818188 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.461895 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f38efb38-fbd0-4044-8ea9-f64437818188 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1438 microversion: 2.75 time: 0.118311 Jul 20 04:17:44.462615 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 976/2055] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1438 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:44.468849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b73fb719-2f02-47bb-886a-9a58e9bc15f3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.469637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b73fb719-2f02-47bb-886a-9a58e9bc15f3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.536296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b73fb719-2f02-47bb-886a-9a58e9bc15f3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.544339 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b73fb719-2f02-47bb-886a-9a58e9bc15f3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1213 microversion: 2.1 time: 0.079996 Jul 20 04:17:44.545556 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 977/2056] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:44.555497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-83f9d0e5-d88f-4b1a-93dc-af76181343d3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.555497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-83f9d0e5-d88f-4b1a-93dc-af76181343d3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.560366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83f9d0e5-d88f-4b1a-93dc-af76181343d3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.560936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83f9d0e5-d88f-4b1a-93dc-af76181343d3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.562167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83f9d0e5-d88f-4b1a-93dc-af76181343d3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.562664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83f9d0e5-d88f-4b1a-93dc-af76181343d3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.715203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-83f9d0e5-d88f-4b1a-93dc-af76181343d3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.729929 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-83f9d0e5-d88f-4b1a-93dc-af76181343d3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1315 microversion: 2.1 time: 0.183114 Jul 20 04:17:44.730786 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 978/2057] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:44.740010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:44.741440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.749168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.749620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.750454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.750896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.845076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:44.846430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:44.846430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:44.846749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:44.847142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:44.909131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.915854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.916330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.917125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.917570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.992754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.005351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.007141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.012543 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4debc716-90f8-4d29-939e-4bf9e2402666 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "POST /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975/action" status: 202 len: 1495 microversion: 2.75 time: 0.279042 Jul 20 04:17:45.013172 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 979/2058] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:17:44 2022] POST /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975/action => generated 1495 bytes in 282 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:17:45.018836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7923dde3-305b-4f6e-97cb-26378b21da91 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.019745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7923dde3-305b-4f6e-97cb-26378b21da91 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.027977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7923dde3-305b-4f6e-97cb-26378b21da91 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.028700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7923dde3-305b-4f6e-97cb-26378b21da91 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.030573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7923dde3-305b-4f6e-97cb-26378b21da91 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.031094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7923dde3-305b-4f6e-97cb-26378b21da91 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.173728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7923dde3-305b-4f6e-97cb-26378b21da91 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.182906 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7923dde3-305b-4f6e-97cb-26378b21da91 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.168017 Jul 20 04:17:45.191094 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 980/2059] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:45.191094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5b43f0d8-60b1-4751-a43d-3cd8a99e368a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.191094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5b43f0d8-60b1-4751-a43d-3cd8a99e368a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.198445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b43f0d8-60b1-4751-a43d-3cd8a99e368a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.199019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b43f0d8-60b1-4751-a43d-3cd8a99e368a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.200116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b43f0d8-60b1-4751-a43d-3cd8a99e368a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.200689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b43f0d8-60b1-4751-a43d-3cd8a99e368a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.287475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5b43f0d8-60b1-4751-a43d-3cd8a99e368a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.306361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5b43f0d8-60b1-4751-a43d-3cd8a99e368a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.308267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5b43f0d8-60b1-4751-a43d-3cd8a99e368a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.316294 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5b43f0d8-60b1-4751-a43d-3cd8a99e368a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.131102 Jul 20 04:17:45.316926 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 981/2060] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:45.359180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-06f320ed-2dd6-416c-a966-5561a102d076 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.360002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-06f320ed-2dd6-416c-a966-5561a102d076 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.367058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06f320ed-2dd6-416c-a966-5561a102d076 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.368339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06f320ed-2dd6-416c-a966-5561a102d076 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.369749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06f320ed-2dd6-416c-a966-5561a102d076 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.370358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06f320ed-2dd6-416c-a966-5561a102d076 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.646031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-06f320ed-2dd6-416c-a966-5561a102d076 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.648408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:45.656568 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-06f320ed-2dd6-416c-a966-5561a102d076 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1495 microversion: 2.1 time: 0.302113 Jul 20 04:17:45.659148 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 982/2061] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1495 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:45.663611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cdb13424-f4de-4b83-b984-92938a7e8787 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.664468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cdb13424-f4de-4b83-b984-92938a7e8787 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.673050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdb13424-f4de-4b83-b984-92938a7e8787 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.673514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdb13424-f4de-4b83-b984-92938a7e8787 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.674393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdb13424-f4de-4b83-b984-92938a7e8787 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.674841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdb13424-f4de-4b83-b984-92938a7e8787 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.760374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cdb13424-f4de-4b83-b984-92938a7e8787 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.770625 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cdb13424-f4de-4b83-b984-92938a7e8787 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1271 microversion: 2.1 time: 0.112359 Jul 20 04:17:45.771587 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 983/2062] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:45.776155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1a2b39f1-edff-42d0-b073-4ddfacbde8b7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.776757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1a2b39f1-edff-42d0-b073-4ddfacbde8b7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.784147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a2b39f1-edff-42d0-b073-4ddfacbde8b7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.784920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a2b39f1-edff-42d0-b073-4ddfacbde8b7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.785751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a2b39f1-edff-42d0-b073-4ddfacbde8b7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.786191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a2b39f1-edff-42d0-b073-4ddfacbde8b7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.798629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=20 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:45.992139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1a2b39f1-edff-42d0-b073-4ddfacbde8b7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.005133 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1a2b39f1-edff-42d0-b073-4ddfacbde8b7 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1315 microversion: 2.1 time: 0.232476 Jul 20 04:17:46.009823 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 984/2063] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:46.207597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2c28bdf5-4bbc-47a4-9c0a-5ea8867a11f7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:46.208558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2c28bdf5-4bbc-47a4-9c0a-5ea8867a11f7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:46.230516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c28bdf5-4bbc-47a4-9c0a-5ea8867a11f7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.231221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c28bdf5-4bbc-47a4-9c0a-5ea8867a11f7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.232037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c28bdf5-4bbc-47a4-9c0a-5ea8867a11f7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.233211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c28bdf5-4bbc-47a4-9c0a-5ea8867a11f7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.533992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2c28bdf5-4bbc-47a4-9c0a-5ea8867a11f7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.544985 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2c28bdf5-4bbc-47a4-9c0a-5ea8867a11f7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.348303 Jul 20 04:17:46.545920 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 985/2064] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:46 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:46.551946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3e0d9e51-1d00-4c75-929f-235eb59b50a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:46.553530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3e0d9e51-1d00-4c75-929f-235eb59b50a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:46.560447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e0d9e51-1d00-4c75-929f-235eb59b50a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.561004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e0d9e51-1d00-4c75-929f-235eb59b50a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.561619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e0d9e51-1d00-4c75-929f-235eb59b50a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.562065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e0d9e51-1d00-4c75-929f-235eb59b50a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.646451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3e0d9e51-1d00-4c75-929f-235eb59b50a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.657598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3e0d9e51-1d00-4c75-929f-235eb59b50a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.659115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3e0d9e51-1d00-4c75-929f-235eb59b50a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.664363 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3e0d9e51-1d00-4c75-929f-235eb59b50a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.117044 Jul 20 04:17:46.665450 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 986/2065] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:46 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:46.682066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-07d33ccb-0e0a-4042-ae30-f3c28bba0e94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:46.682696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-07d33ccb-0e0a-4042-ae30-f3c28bba0e94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:46.691059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-07d33ccb-0e0a-4042-ae30-f3c28bba0e94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.691261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-07d33ccb-0e0a-4042-ae30-f3c28bba0e94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.692059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-07d33ccb-0e0a-4042-ae30-f3c28bba0e94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.692515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-07d33ccb-0e0a-4042-ae30-f3c28bba0e94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.913093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-07d33ccb-0e0a-4042-ae30-f3c28bba0e94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.925698 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-07d33ccb-0e0a-4042-ae30-f3c28bba0e94 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 200 len: 1472 microversion: 2.1 time: 0.248433 Jul 20 04:17:46.926552 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 987/2066] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:46 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:46.938269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-87176212-1b5a-4426-9af2-083e4808b85d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:46.938937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-87176212-1b5a-4426-9af2-083e4808b85d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:46.946185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87176212-1b5a-4426-9af2-083e4808b85d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.947239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87176212-1b5a-4426-9af2-083e4808b85d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.948076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87176212-1b5a-4426-9af2-083e4808b85d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.948517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87176212-1b5a-4426-9af2-083e4808b85d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.239315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-87176212-1b5a-4426-9af2-083e4808b85d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.249493 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-87176212-1b5a-4426-9af2-083e4808b85d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1313 microversion: 2.1 time: 0.321817 Jul 20 04:17:47.252927 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 988/2067] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:46 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:47.264307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-691cd341-1747-449c-aee1-fcc6b061c8d5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2023130390"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:47.268034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-691cd341-1747-449c-aee1-fcc6b061c8d5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:47.277059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-691cd341-1747-449c-aee1-fcc6b061c8d5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.277540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-691cd341-1747-449c-aee1-fcc6b061c8d5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.278345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-691cd341-1747-449c-aee1-fcc6b061c8d5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.278784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-691cd341-1747-449c-aee1-fcc6b061c8d5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.739383 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-691cd341-1747-449c-aee1-fcc6b061c8d5 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "POST /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe/action" status: 202 len: 0 microversion: 2.1 time: 0.483969 Jul 20 04:17:47.740643 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 989/2068] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:47 2022] POST /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:17:47.772047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9dd5f17d-5d4b-4a01-949c-3fc6d55999b2 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:47.772937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9dd5f17d-5d4b-4a01-949c-3fc6d55999b2 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:47.807080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dd5f17d-5d4b-4a01-949c-3fc6d55999b2 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.808231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dd5f17d-5d4b-4a01-949c-3fc6d55999b2 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.810087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dd5f17d-5d4b-4a01-949c-3fc6d55999b2 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.812099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dd5f17d-5d4b-4a01-949c-3fc6d55999b2 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.220489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9dd5f17d-5d4b-4a01-949c-3fc6d55999b2 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.242345 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9dd5f17d-5d4b-4a01-949c-3fc6d55999b2 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1315 microversion: 2.1 time: 0.499451 Jul 20 04:17:48.246386 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 990/2069] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:47 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:48.258974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ef73a91a-3b99-4a64-b347-61a2205c4539 req-7f1f82b8-2137-4886-9c1b-5266de8122be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b275fa8-1d8e-435e-9256-5b2a33129d62", "tag": "cd19a68b-44cb-4c08-a687-f66d10df0d36"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:48.267855 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a90881c1-fbdb-40d0-a0f7-649b2f7024f9 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941/action" status: 202 len: 0 microversion: 2.25 time: 4.384090 Jul 20 04:17:48.273458 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1080/2070] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:17:43 2022] POST /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941/action => generated 0 bytes in 4391 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:48.285943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ef73a91a-3b99-4a64-b347-61a2205c4539 req-7f1f82b8-2137-4886-9c1b-5266de8122be service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.286487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ef73a91a-3b99-4a64-b347-61a2205c4539 req-7f1f82b8-2137-4886-9c1b-5266de8122be service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.311909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b15d687a-b1cc-4642-9928-a186b584f9b4 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.312146 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ef73a91a-3b99-4a64-b347-61a2205c4539 req-7f1f82b8-2137-4886-9c1b-5266de8122be service nova] Creating event network-changed:cd19a68b-44cb-4c08-a687-f66d10df0d36 for instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 on n-h1-764485-11 Jul 20 04:17:48.323714 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ef73a91a-3b99-4a64-b347-61a2205c4539 req-7f1f82b8-2137-4886-9c1b-5266de8122be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075314 Jul 20 04:17:48.324658 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 991/2071] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:48.330795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b15d687a-b1cc-4642-9928-a186b584f9b4 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.334248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b15d687a-b1cc-4642-9928-a186b584f9b4 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Searching by: {'deleted': False, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:48.336651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-742cde19-32b7-422d-96cb-194e7113e52a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.337353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-742cde19-32b7-422d-96cb-194e7113e52a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.350726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-742cde19-32b7-422d-96cb-194e7113e52a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.363237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-742cde19-32b7-422d-96cb-194e7113e52a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.364500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-742cde19-32b7-422d-96cb-194e7113e52a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.365148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-742cde19-32b7-422d-96cb-194e7113e52a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.373493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b15d687a-b1cc-4642-9928-a186b584f9b4 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.387331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b15d687a-b1cc-4642-9928-a186b584f9b4 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.392625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b15d687a-b1cc-4642-9928-a186b584f9b4 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.393808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b15d687a-b1cc-4642-9928-a186b584f9b4 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.440663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-b15d687a-b1cc-4642-9928-a186b584f9b4 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:48.474015 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b15d687a-b1cc-4642-9928-a186b584f9b4 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.198792 Jul 20 04:17:48.474576 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1081/2072] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers => generated 333 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:48.483435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10ce1f2a-0db3-4965-928a-e88de972dba7 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.484224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-10ce1f2a-0db3-4965-928a-e88de972dba7 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.490741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10ce1f2a-0db3-4965-928a-e88de972dba7 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.491188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10ce1f2a-0db3-4965-928a-e88de972dba7 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.492043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10ce1f2a-0db3-4965-928a-e88de972dba7 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.492494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10ce1f2a-0db3-4965-928a-e88de972dba7 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.606236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10ce1f2a-0db3-4965-928a-e88de972dba7 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.617706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10ce1f2a-0db3-4965-928a-e88de972dba7 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.619300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10ce1f2a-0db3-4965-928a-e88de972dba7 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.625526 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-10ce1f2a-0db3-4965-928a-e88de972dba7 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.149732 Jul 20 04:17:48.626204 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1082/2073] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:48.630829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a47a16b1-94dd-40f9-90ad-9cc38ff9e5a3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa28df3a0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.687160 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a47a16b1-94dd-40f9-90ad-9cc38ff9e5a3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.059693 Jul 20 04:17:48.687824 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1083/2074] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:48.694965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3f8baf4a-be05-4219-8875-2842b4e66611 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.695947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3f8baf4a-be05-4219-8875-2842b4e66611 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.703269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-742cde19-32b7-422d-96cb-194e7113e52a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.704181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f8baf4a-be05-4219-8875-2842b4e66611 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.704644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f8baf4a-be05-4219-8875-2842b4e66611 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.705424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f8baf4a-be05-4219-8875-2842b4e66611 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.705965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f8baf4a-be05-4219-8875-2842b4e66611 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.712930 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-742cde19-32b7-422d-96cb-194e7113e52a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.387073 Jul 20 04:17:48.724721 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 992/2075] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:48.731352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1f4d44ea-a404-4123-b74f-873cee84c5b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.732539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1f4d44ea-a404-4123-b74f-873cee84c5b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.739353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f4d44ea-a404-4123-b74f-873cee84c5b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.740234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f4d44ea-a404-4123-b74f-873cee84c5b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.741337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f4d44ea-a404-4123-b74f-873cee84c5b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.742027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f4d44ea-a404-4123-b74f-873cee84c5b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.285685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3f8baf4a-be05-4219-8875-2842b4e66611 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.290405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1f4d44ea-a404-4123-b74f-873cee84c5b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.293317 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3f8baf4a-be05-4219-8875-2842b4e66611 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1313 microversion: 2.1 time: 0.604327 Jul 20 04:17:49.293886 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1084/2076] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:49.299171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c3344e5-eeab-47bc-99c0-38b6c437ed89 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.302465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4c3344e5-eeab-47bc-99c0-38b6c437ed89 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.303224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4c3344e5-eeab-47bc-99c0-38b6c437ed89 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Searching by: {'deleted': False, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:49.308363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c3344e5-eeab-47bc-99c0-38b6c437ed89 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.308789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1f4d44ea-a404-4123-b74f-873cee84c5b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.308926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c3344e5-eeab-47bc-99c0-38b6c437ed89 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.309589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c3344e5-eeab-47bc-99c0-38b6c437ed89 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.310021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c3344e5-eeab-47bc-99c0-38b6c437ed89 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.310448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1f4d44ea-a404-4123-b74f-873cee84c5b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.311828 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1f4d44ea-a404-4123-b74f-873cee84c5b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.584713 Jul 20 04:17:49.312574 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 993/2077] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:49.319522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-46dbe3e2-8e4e-4728-8eb5-976675a619ec tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.320141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-46dbe3e2-8e4e-4728-8eb5-976675a619ec tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.327607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46dbe3e2-8e4e-4728-8eb5-976675a619ec tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.328312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46dbe3e2-8e4e-4728-8eb5-976675a619ec tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.329302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46dbe3e2-8e4e-4728-8eb5-976675a619ec tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.329910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46dbe3e2-8e4e-4728-8eb5-976675a619ec tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.346167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-4c3344e5-eeab-47bc-99c0-38b6c437ed89 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:49.381842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4c3344e5-eeab-47bc-99c0-38b6c437ed89 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.387693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c3344e5-eeab-47bc-99c0-38b6c437ed89 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.388145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c3344e5-eeab-47bc-99c0-38b6c437ed89 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.514902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-46dbe3e2-8e4e-4728-8eb5-976675a619ec tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.523024 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-46dbe3e2-8e4e-4728-8eb5-976675a619ec tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1315 microversion: 2.1 time: 0.207095 Jul 20 04:17:49.524003 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 994/2078] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:49.541289 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4c3344e5-eeab-47bc-99c0-38b6c437ed89 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.245499 Jul 20 04:17:49.541887 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1085/2079] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:49.558904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0e283953-b994-4d5c-b2c1-569d0deb5c9b tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.567120 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0e283953-b994-4d5c-b2c1-569d0deb5c9b tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012003 Jul 20 04:17:49.567696 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 995/2080] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:49.646372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df0c2e3e-50e6-4de6-b32d-1c72c6debbea tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.646985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df0c2e3e-50e6-4de6-b32d-1c72c6debbea tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.653319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df0c2e3e-50e6-4de6-b32d-1c72c6debbea tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.653748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df0c2e3e-50e6-4de6-b32d-1c72c6debbea tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.655247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df0c2e3e-50e6-4de6-b32d-1c72c6debbea tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.655736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df0c2e3e-50e6-4de6-b32d-1c72c6debbea tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.700313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5d3c34b3-4eb1-41e1-a3c4-7101aadffbb2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d119700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.740631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df0c2e3e-50e6-4de6-b32d-1c72c6debbea tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.750128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df0c2e3e-50e6-4de6-b32d-1c72c6debbea tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.751359 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5d3c34b3-4eb1-41e1-a3c4-7101aadffbb2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.055028 Jul 20 04:17:49.751987 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 996/2081] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:49.752446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df0c2e3e-50e6-4de6-b32d-1c72c6debbea tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.756636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-62df2d46-342a-4d08-bdb7-a3f367bd4038 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.757237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-62df2d46-342a-4d08-bdb7-a3f367bd4038 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.760227 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df0c2e3e-50e6-4de6-b32d-1c72c6debbea tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.118207 Jul 20 04:17:49.761000 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1086/2082] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:49.766078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62df2d46-342a-4d08-bdb7-a3f367bd4038 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.766536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62df2d46-342a-4d08-bdb7-a3f367bd4038 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.767317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62df2d46-342a-4d08-bdb7-a3f367bd4038 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.767786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62df2d46-342a-4d08-bdb7-a3f367bd4038 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.908353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fadf7da9-8823-4aff-9268-d9afd3439a1f tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.909252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fadf7da9-8823-4aff-9268-d9afd3439a1f tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.913398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-62df2d46-342a-4d08-bdb7-a3f367bd4038 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.916028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fadf7da9-8823-4aff-9268-d9afd3439a1f tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.916577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fadf7da9-8823-4aff-9268-d9afd3439a1f tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.917740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fadf7da9-8823-4aff-9268-d9afd3439a1f tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.918727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fadf7da9-8823-4aff-9268-d9afd3439a1f tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.921961 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-62df2d46-342a-4d08-bdb7-a3f367bd4038 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.168964 Jul 20 04:17:49.922556 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 997/2083] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:49.948477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fadf7da9-8823-4aff-9268-d9afd3439a1f tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:50.025511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-dd774748-fe2f-4d57-9fd9-963ab3f50260 req-6928f667-88f7-48e0-86de-1bddd9fb6bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a749b53d-cbac-4db3-9cbf-6ef098f37cd8", "name": "network-vif-plugged", "status": "completed", "tag": "8db84d6a-e65e-407f-b791-d9e906efb840"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:50.035298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dd774748-fe2f-4d57-9fd9-963ab3f50260 req-6928f667-88f7-48e0-86de-1bddd9fb6bdb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.036003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dd774748-fe2f-4d57-9fd9-963ab3f50260 req-6928f667-88f7-48e0-86de-1bddd9fb6bdb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.036235 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fadf7da9-8823-4aff-9268-d9afd3439a1f tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 204 len: 0 microversion: 2.1 time: 0.132268 Jul 20 04:17:50.037146 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1087/2084] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:49 2022] DELETE /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:50.046893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a49a9816-a101-44e4-9830-7c3d04b3fd1b tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.047622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a49a9816-a101-44e4-9830-7c3d04b3fd1b tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:50.051403 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-dd774748-fe2f-4d57-9fd9-963ab3f50260 req-6928f667-88f7-48e0-86de-1bddd9fb6bdb service nova] Creating event network-vif-plugged:8db84d6a-e65e-407f-b791-d9e906efb840 for instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 on n-h2-764485-11 Jul 20 04:17:50.053812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a49a9816-a101-44e4-9830-7c3d04b3fd1b tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.054257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a49a9816-a101-44e4-9830-7c3d04b3fd1b tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.055015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a49a9816-a101-44e4-9830-7c3d04b3fd1b tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.055465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a49a9816-a101-44e4-9830-7c3d04b3fd1b tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.056423 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-dd774748-fe2f-4d57-9fd9-963ab3f50260 req-6928f667-88f7-48e0-86de-1bddd9fb6bdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039905 Jul 20 04:17:50.057404 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 998/2085] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:50.189062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a49a9816-a101-44e4-9830-7c3d04b3fd1b tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.196874 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a49a9816-a101-44e4-9830-7c3d04b3fd1b tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1699 microversion: 2.1 time: 0.155020 Jul 20 04:17:50.197440 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1088/2086] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:50.310660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9c16261d-6b55-42ee-80e9-5028c959b761 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.311370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9c16261d-6b55-42ee-80e9-5028c959b761 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:50.317740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c16261d-6b55-42ee-80e9-5028c959b761 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.318198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c16261d-6b55-42ee-80e9-5028c959b761 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.318974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c16261d-6b55-42ee-80e9-5028c959b761 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.319417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c16261d-6b55-42ee-80e9-5028c959b761 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.330742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a126d5ee-466d-4e46-9fc9-76c8d649ee73 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.331358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a126d5ee-466d-4e46-9fc9-76c8d649ee73 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:50.338005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a126d5ee-466d-4e46-9fc9-76c8d649ee73 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.338454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a126d5ee-466d-4e46-9fc9-76c8d649ee73 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.339213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a126d5ee-466d-4e46-9fc9-76c8d649ee73 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.339674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a126d5ee-466d-4e46-9fc9-76c8d649ee73 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.511799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9c16261d-6b55-42ee-80e9-5028c959b761 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.520260 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9c16261d-6b55-42ee-80e9-5028c959b761 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1313 microversion: 2.1 time: 0.213808 Jul 20 04:17:50.520845 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 999/2087] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:50.526827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a126d5ee-466d-4e46-9fc9-76c8d649ee73 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.535152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a126d5ee-466d-4e46-9fc9-76c8d649ee73 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.536683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a126d5ee-466d-4e46-9fc9-76c8d649ee73 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.537831 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a126d5ee-466d-4e46-9fc9-76c8d649ee73 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.210966 Jul 20 04:17:50.538406 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1089/2088] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:50.540649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0114a306-1402-4adb-bb21-bac5d5e2b70b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.541273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0114a306-1402-4adb-bb21-bac5d5e2b70b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:50.547421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0114a306-1402-4adb-bb21-bac5d5e2b70b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.547924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0114a306-1402-4adb-bb21-bac5d5e2b70b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.548703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0114a306-1402-4adb-bb21-bac5d5e2b70b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.549144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0114a306-1402-4adb-bb21-bac5d5e2b70b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.683750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0114a306-1402-4adb-bb21-bac5d5e2b70b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.692187 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0114a306-1402-4adb-bb21-bac5d5e2b70b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1315 microversion: 2.1 time: 0.155399 Jul 20 04:17:50.692755 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1000/2089] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:50.764260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-77ce8801-7f04-4973-ae83-e59f19044df8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa27de040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.780396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a1955fe-493c-44dd-9ec9-a794fd7b0a5a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.780998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a1955fe-493c-44dd-9ec9-a794fd7b0a5a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:50.786893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a1955fe-493c-44dd-9ec9-a794fd7b0a5a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.787340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a1955fe-493c-44dd-9ec9-a794fd7b0a5a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.788143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a1955fe-493c-44dd-9ec9-a794fd7b0a5a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.788577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a1955fe-493c-44dd-9ec9-a794fd7b0a5a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.804828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:50.811963 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-77ce8801-7f04-4973-ae83-e59f19044df8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.052042 Jul 20 04:17:50.812650 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1090/2090] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:50.854997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a1955fe-493c-44dd-9ec9-a794fd7b0a5a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.864137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a1955fe-493c-44dd-9ec9-a794fd7b0a5a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.865706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a1955fe-493c-44dd-9ec9-a794fd7b0a5a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.870451 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a1955fe-493c-44dd-9ec9-a794fd7b0a5a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.093928 Jul 20 04:17:50.871019 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1001/2091] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:50.939603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-17045ca8-48dc-4fa7-9a89-fa0b3163cc28 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.940160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-17045ca8-48dc-4fa7-9a89-fa0b3163cc28 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:50.946273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17045ca8-48dc-4fa7-9a89-fa0b3163cc28 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.946722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17045ca8-48dc-4fa7-9a89-fa0b3163cc28 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.947477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17045ca8-48dc-4fa7-9a89-fa0b3163cc28 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.947935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17045ca8-48dc-4fa7-9a89-fa0b3163cc28 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.075693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-17045ca8-48dc-4fa7-9a89-fa0b3163cc28 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.083094 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-17045ca8-48dc-4fa7-9a89-fa0b3163cc28 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.148175 Jul 20 04:17:51.083691 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1091/2092] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:51.214168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-92316b89-7f9c-4c62-9d11-8e8a4b54f753 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.214788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92316b89-7f9c-4c62-9d11-8e8a4b54f753 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.221894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92316b89-7f9c-4c62-9d11-8e8a4b54f753 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.222350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92316b89-7f9c-4c62-9d11-8e8a4b54f753 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.223123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92316b89-7f9c-4c62-9d11-8e8a4b54f753 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.223583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92316b89-7f9c-4c62-9d11-8e8a4b54f753 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.410913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-92316b89-7f9c-4c62-9d11-8e8a4b54f753 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.418452 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-92316b89-7f9c-4c62-9d11-8e8a4b54f753 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1699 microversion: 2.1 time: 0.208218 Jul 20 04:17:51.419019 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1002/2093] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1699 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:51.536516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b167aa1a-a363-4113-a3ed-8d1b3d24fb97 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.537115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b167aa1a-a363-4113-a3ed-8d1b3d24fb97 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.543701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b167aa1a-a363-4113-a3ed-8d1b3d24fb97 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.544147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b167aa1a-a363-4113-a3ed-8d1b3d24fb97 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.545603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b167aa1a-a363-4113-a3ed-8d1b3d24fb97 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.546040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b167aa1a-a363-4113-a3ed-8d1b3d24fb97 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.556741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f324e966-693f-4b02-9ee8-b9b23fd5a89c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.557351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f324e966-693f-4b02-9ee8-b9b23fd5a89c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.562777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:51.564934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f324e966-693f-4b02-9ee8-b9b23fd5a89c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.565385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f324e966-693f-4b02-9ee8-b9b23fd5a89c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.566169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f324e966-693f-4b02-9ee8-b9b23fd5a89c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.566660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f324e966-693f-4b02-9ee8-b9b23fd5a89c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.849766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b167aa1a-a363-4113-a3ed-8d1b3d24fb97 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.857729 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b167aa1a-a363-4113-a3ed-8d1b3d24fb97 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1313 microversion: 2.1 time: 0.324810 Jul 20 04:17:51.860907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f324e966-693f-4b02-9ee8-b9b23fd5a89c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.864844 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1092/2094] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:51.869644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3da96d70-e8c6-48b8-8e62-de0a302c1338 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.870254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3da96d70-e8c6-48b8-8e62-de0a302c1338 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.876853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3da96d70-e8c6-48b8-8e62-de0a302c1338 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.877294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f324e966-693f-4b02-9ee8-b9b23fd5a89c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.877436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3da96d70-e8c6-48b8-8e62-de0a302c1338 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.878057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3da96d70-e8c6-48b8-8e62-de0a302c1338 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.878489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3da96d70-e8c6-48b8-8e62-de0a302c1338 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.879076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f324e966-693f-4b02-9ee8-b9b23fd5a89c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.880294 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f324e966-693f-4b02-9ee8-b9b23fd5a89c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.327412 Jul 20 04:17:51.889337 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1003/2095] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:51.889337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fb324403-1a83-487a-a979-fed10294132f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d153700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.933784 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fb324403-1a83-487a-a979-fed10294132f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.051473 Jul 20 04:17:51.934369 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1004/2096] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:51.939812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6d571dc6-5df7-4e8e-b965-24c5983cc90a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.940432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6d571dc6-5df7-4e8e-b965-24c5983cc90a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.946611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d571dc6-5df7-4e8e-b965-24c5983cc90a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.947085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d571dc6-5df7-4e8e-b965-24c5983cc90a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.947888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d571dc6-5df7-4e8e-b965-24c5983cc90a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.948330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d571dc6-5df7-4e8e-b965-24c5983cc90a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.043113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6d571dc6-5df7-4e8e-b965-24c5983cc90a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.054049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6d571dc6-5df7-4e8e-b965-24c5983cc90a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.055573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6d571dc6-5df7-4e8e-b965-24c5983cc90a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.061445 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6d571dc6-5df7-4e8e-b965-24c5983cc90a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.125108 Jul 20 04:17:52.062304 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1005/2097] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:52.101293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3c7b2388-e728-4887-9b0e-d29584483416 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:52.101832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3c7b2388-e728-4887-9b0e-d29584483416 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:52.108352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c7b2388-e728-4887-9b0e-d29584483416 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.108807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c7b2388-e728-4887-9b0e-d29584483416 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.109584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c7b2388-e728-4887-9b0e-d29584483416 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.110022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c7b2388-e728-4887-9b0e-d29584483416 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.136891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3da96d70-e8c6-48b8-8e62-de0a302c1338 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.145369 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3da96d70-e8c6-48b8-8e62-de0a302c1338 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1315 microversion: 2.1 time: 0.279346 Jul 20 04:17:52.146080 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1093/2098] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:52.323631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3c7b2388-e728-4887-9b0e-d29584483416 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.332037 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3c7b2388-e728-4887-9b0e-d29584483416 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.234643 Jul 20 04:17:52.332632 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1006/2099] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:52 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:52.437163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f65e6879-1aa9-4148-b5e3-2d32a916ecab tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:52.437868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f65e6879-1aa9-4148-b5e3-2d32a916ecab tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:52.444025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f65e6879-1aa9-4148-b5e3-2d32a916ecab tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.444490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f65e6879-1aa9-4148-b5e3-2d32a916ecab tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.445273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f65e6879-1aa9-4148-b5e3-2d32a916ecab tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.445716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f65e6879-1aa9-4148-b5e3-2d32a916ecab tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.579770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f65e6879-1aa9-4148-b5e3-2d32a916ecab tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.582188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:52.589353 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f65e6879-1aa9-4148-b5e3-2d32a916ecab tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1699 microversion: 2.1 time: 0.156747 Jul 20 04:17:52.589946 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1094/2100] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:52 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:52.880808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-89147c0e-2656-467a-8ed2-3b0098441316 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:52.881455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-89147c0e-2656-467a-8ed2-3b0098441316 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:52.889066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89147c0e-2656-467a-8ed2-3b0098441316 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.889613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89147c0e-2656-467a-8ed2-3b0098441316 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.890288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89147c0e-2656-467a-8ed2-3b0098441316 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.890735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89147c0e-2656-467a-8ed2-3b0098441316 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.898131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4110f6a6-6bba-4b02-a84d-8dec2cee13cc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:52.898749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4110f6a6-6bba-4b02-a84d-8dec2cee13cc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:52.907158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4110f6a6-6bba-4b02-a84d-8dec2cee13cc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.907678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4110f6a6-6bba-4b02-a84d-8dec2cee13cc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.908422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4110f6a6-6bba-4b02-a84d-8dec2cee13cc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.909848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4110f6a6-6bba-4b02-a84d-8dec2cee13cc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.182659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89147c0e-2656-467a-8ed2-3b0098441316 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.191988 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-89147c0e-2656-467a-8ed2-3b0098441316 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1313 microversion: 2.1 time: 0.314879 Jul 20 04:17:53.192692 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1007/2101] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:52 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:53.197810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f79b8ec3-6025-49f9-9eab-bf19c68a29f2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d119af0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:53.209275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4110f6a6-6bba-4b02-a84d-8dec2cee13cc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.220250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4110f6a6-6bba-4b02-a84d-8dec2cee13cc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.221780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4110f6a6-6bba-4b02-a84d-8dec2cee13cc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.222946 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4110f6a6-6bba-4b02-a84d-8dec2cee13cc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.328657 Jul 20 04:17:53.224006 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1095/2102] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:52 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:53.228879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ae2c844-a85b-4ec0-98d6-1891b30bde72 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:53.229604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8ae2c844-a85b-4ec0-98d6-1891b30bde72 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:53.236890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ae2c844-a85b-4ec0-98d6-1891b30bde72 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.237344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ae2c844-a85b-4ec0-98d6-1891b30bde72 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.238120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ae2c844-a85b-4ec0-98d6-1891b30bde72 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.238555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ae2c844-a85b-4ec0-98d6-1891b30bde72 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.249267 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f79b8ec3-6025-49f9-9eab-bf19c68a29f2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.055262 Jul 20 04:17:53.250259 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1008/2103] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:53 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:53.258947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3c7d9e89-8a8a-4c73-8e1b-00eb476a1f3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:53.259952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3c7d9e89-8a8a-4c73-8e1b-00eb476a1f3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:53.267205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c7d9e89-8a8a-4c73-8e1b-00eb476a1f3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.267698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c7d9e89-8a8a-4c73-8e1b-00eb476a1f3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.268481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c7d9e89-8a8a-4c73-8e1b-00eb476a1f3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.270070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c7d9e89-8a8a-4c73-8e1b-00eb476a1f3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.377072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8ae2c844-a85b-4ec0-98d6-1891b30bde72 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.386476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8ae2c844-a85b-4ec0-98d6-1891b30bde72 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.388070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8ae2c844-a85b-4ec0-98d6-1891b30bde72 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.394642 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8ae2c844-a85b-4ec0-98d6-1891b30bde72 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.169542 Jul 20 04:17:53.395558 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1096/2104] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:53 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:53.400891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-55b42de8-553a-4922-9a16-54e0173b745d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:53.401617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-55b42de8-553a-4922-9a16-54e0173b745d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:53.408632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55b42de8-553a-4922-9a16-54e0173b745d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.409082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55b42de8-553a-4922-9a16-54e0173b745d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.409852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55b42de8-553a-4922-9a16-54e0173b745d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.410290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55b42de8-553a-4922-9a16-54e0173b745d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.609858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3c7d9e89-8a8a-4c73-8e1b-00eb476a1f3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.617614 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3c7d9e89-8a8a-4c73-8e1b-00eb476a1f3c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1315 microversion: 2.1 time: 0.366436 Jul 20 04:17:53.618214 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1009/2105] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:53 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:53.623219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d90535c0-ffbd-4f45-b433-a42824d610c9 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:53.624118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d90535c0-ffbd-4f45-b433-a42824d610c9 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:53.630417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d90535c0-ffbd-4f45-b433-a42824d610c9 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.630811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d90535c0-ffbd-4f45-b433-a42824d610c9 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.631619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d90535c0-ffbd-4f45-b433-a42824d610c9 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.632062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d90535c0-ffbd-4f45-b433-a42824d610c9 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.654789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-55b42de8-553a-4922-9a16-54e0173b745d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.662704 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-55b42de8-553a-4922-9a16-54e0173b745d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.266122 Jul 20 04:17:53.663280 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1097/2106] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:53 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:53.869728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d90535c0-ffbd-4f45-b433-a42824d610c9 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd588c20e041471b8ccb5e47552df9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85e2a4b7bff42809c8619bf2965d541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.877495 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d90535c0-ffbd-4f45-b433-a42824d610c9 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 200 len: 1699 microversion: 2.1 time: 0.258294 Jul 20 04:17:53.878094 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1010/2107] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:53 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 1699 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:54.098469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9c7935eb-0f37-4d5d-8427-264950b60120 req-d12f9cfd-5d92-49f8-a460-3a63aff98907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7f16d9-5dea-46ea-92a8-ff136a0a3eda", "name": "network-vif-deleted", "tag": "0138a7f2-ddae-40a3-9369-06d6c5361b07"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:54.109865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9c7935eb-0f37-4d5d-8427-264950b60120 req-d12f9cfd-5d92-49f8-a460-3a63aff98907 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.110652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9c7935eb-0f37-4d5d-8427-264950b60120 req-d12f9cfd-5d92-49f8-a460-3a63aff98907 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.123195 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9c7935eb-0f37-4d5d-8427-264950b60120 req-d12f9cfd-5d92-49f8-a460-3a63aff98907 service nova] Creating event network-vif-deleted:0138a7f2-ddae-40a3-9369-06d6c5361b07 for instance af7f16d9-5dea-46ea-92a8-ff136a0a3eda on n-h2-764485-11 Jul 20 04:17:54.129100 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9c7935eb-0f37-4d5d-8427-264950b60120 req-d12f9cfd-5d92-49f8-a460-3a63aff98907 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034194 Jul 20 04:17:54.129718 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1098/2108] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:54.210282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3150c083-a1cf-43c5-b6d9-e2457cf54c0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.210901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3150c083-a1cf-43c5-b6d9-e2457cf54c0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.213852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=7 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:54.227427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3150c083-a1cf-43c5-b6d9-e2457cf54c0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.227937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3150c083-a1cf-43c5-b6d9-e2457cf54c0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.228733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3150c083-a1cf-43c5-b6d9-e2457cf54c0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.229284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3150c083-a1cf-43c5-b6d9-e2457cf54c0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.246046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a781fb31-1c6e-466e-88e7-3efda6e91bcc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.247043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a781fb31-1c6e-466e-88e7-3efda6e91bcc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.254394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a781fb31-1c6e-466e-88e7-3efda6e91bcc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.254848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a781fb31-1c6e-466e-88e7-3efda6e91bcc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.255664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a781fb31-1c6e-466e-88e7-3efda6e91bcc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.256125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a781fb31-1c6e-466e-88e7-3efda6e91bcc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.473471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3150c083-a1cf-43c5-b6d9-e2457cf54c0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.481743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a781fb31-1c6e-466e-88e7-3efda6e91bcc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.482926 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3150c083-a1cf-43c5-b6d9-e2457cf54c0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1313 microversion: 2.1 time: 0.276355 Jul 20 04:17:54.483967 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1011/2109] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:54.489239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a1674ea3-44b7-4857-b60c-4513afa20a5c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d119550>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.493553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a781fb31-1c6e-466e-88e7-3efda6e91bcc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.495655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a781fb31-1c6e-466e-88e7-3efda6e91bcc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.497228 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a781fb31-1c6e-466e-88e7-3efda6e91bcc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.257846 Jul 20 04:17:54.502601 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1099/2110] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:54.512170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-94bf0766-1903-450b-b2cd-7c3a64187ccb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.512784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-94bf0766-1903-450b-b2cd-7c3a64187ccb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.521269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94bf0766-1903-450b-b2cd-7c3a64187ccb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.521269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94bf0766-1903-450b-b2cd-7c3a64187ccb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.522897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94bf0766-1903-450b-b2cd-7c3a64187ccb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.522897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94bf0766-1903-450b-b2cd-7c3a64187ccb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.545221 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a1674ea3-44b7-4857-b60c-4513afa20a5c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.059307 Jul 20 04:17:54.545872 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1012/2111] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:54.600655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94bf0766-1903-450b-b2cd-7c3a64187ccb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.610662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94bf0766-1903-450b-b2cd-7c3a64187ccb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.612788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94bf0766-1903-450b-b2cd-7c3a64187ccb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.618549 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-94bf0766-1903-450b-b2cd-7c3a64187ccb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.114440 Jul 20 04:17:54.619213 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1100/2112] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:54.631927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=15 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:54.640737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8e89faf2-3fe4-442e-852b-2a760644f559 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.641732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8e89faf2-3fe4-442e-852b-2a760644f559 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.651469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e89faf2-3fe4-442e-852b-2a760644f559 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.652040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e89faf2-3fe4-442e-852b-2a760644f559 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.652900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e89faf2-3fe4-442e-852b-2a760644f559 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.653498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e89faf2-3fe4-442e-852b-2a760644f559 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.684266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-377791c6-2f8a-4cd7-b8a1-a3c75eb2038c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.686990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-377791c6-2f8a-4cd7-b8a1-a3c75eb2038c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.688713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:54.702876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-377791c6-2f8a-4cd7-b8a1-a3c75eb2038c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.704404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-377791c6-2f8a-4cd7-b8a1-a3c75eb2038c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.705360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-377791c6-2f8a-4cd7-b8a1-a3c75eb2038c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.705830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-377791c6-2f8a-4cd7-b8a1-a3c75eb2038c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.918149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8e89faf2-3fe4-442e-852b-2a760644f559 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.925086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-377791c6-2f8a-4cd7-b8a1-a3c75eb2038c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.928705 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8e89faf2-3fe4-442e-852b-2a760644f559 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1502 microversion: 2.1 time: 0.297500 Jul 20 04:17:54.929305 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1013/2113] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1502 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:54.937382 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-377791c6-2f8a-4cd7-b8a1-a3c75eb2038c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.257867 Jul 20 04:17:54.946706 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1101/2114] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:54.946706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9dde71af-0a1f-4217-8c64-89ff0c3a3941 req-360afd16-cc07-428b-ab12-0b6fbbc901a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d86df2-0b5f-4d16-b6a5-fe16c86494fe", "name": "network-vif-plugged", "status": "completed", "tag": "a3ee1c75-0199-4fca-95d5-7a8a2a2d9a58"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:54.947039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f9035f9-ca5e-43d5-a46a-4803a9f285e5 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.947039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2f9035f9-ca5e-43d5-a46a-4803a9f285e5 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] [instance: af7f16d9-5dea-46ea-92a8-ff136a0a3eda] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.951540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f9035f9-ca5e-43d5-a46a-4803a9f285e5 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.951999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f9035f9-ca5e-43d5-a46a-4803a9f285e5 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.952780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f9035f9-ca5e-43d5-a46a-4803a9f285e5 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.953183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9dde71af-0a1f-4217-8c64-89ff0c3a3941 req-360afd16-cc07-428b-ab12-0b6fbbc901a3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.953331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f9035f9-ca5e-43d5-a46a-4803a9f285e5 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.953808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9dde71af-0a1f-4217-8c64-89ff0c3a3941 req-360afd16-cc07-428b-ab12-0b6fbbc901a3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.967689 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-2f9035f9-ca5e-43d5-a46a-4803a9f285e5 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] HTTP exception thrown: Instance af7f16d9-5dea-46ea-92a8-ff136a0a3eda could not be found. Jul 20 04:17:54.967951 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9dde71af-0a1f-4217-8c64-89ff0c3a3941 req-360afd16-cc07-428b-ab12-0b6fbbc901a3 service nova] Creating event network-vif-plugged:a3ee1c75-0199-4fca-95d5-7a8a2a2d9a58 for instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe on n-h1-764485-11 Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f9035f9-ca5e-43d5-a46a-4803a9f285e5 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Request method failure captured: Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda HTTP/1.1 Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14F2pV9rLTs3Rj3xxaMRtdw4oStVv-HgcV_SfAx3-yMU95UogNDZdNPg_J_5tuITmpYdjx0ELGV33TbU7niFa-dL5aPDEizeh1pLjrlA-Lvso9dZf4B_HGihagaMDFeOD8FZIGmJ7feP3ETuWDV08UmkdqH_XI7QQTO7sHGYc6-5LEw Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: c85e2a4b7bff42809c8619bf2965d541 Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestJSON-2050599093 Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85e2a4b7bff42809c8619bf2965d541"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85e2a4b7bff42809c8619bf2965d541"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85e2a4b7bff42809c8619bf2965d541", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85e2a4b7bff42809c8619bf2965d541"}]}] Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestJSON-2050599093 Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: c85e2a4b7bff42809c8619bf2965d541 Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestJSON-2050599093 Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestJSON-2050599093-project Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: fd588c20e041471b8ccb5e47552df9e6 Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestJSON-2050599093-project Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance af7f16d9-5dea-46ea-92a8-ff136a0a3eda could not be found. Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'af7f16d9-5dea-46ea-92a8-ff136a0a3eda'} Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7f16d9-5dea-46ea-92a8-ff136a0a3eda could not be found. Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7f16d9-5dea-46ea-92a8-ff136a0a3eda could not be found. Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.969808 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.975796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:54.975796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:54.975796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:54.975796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:54.975796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7f16d9-5dea-46ea-92a8-ff136a0a3eda could not be found. Jul 20 04:17:54.975796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.975796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f9035f9-ca5e-43d5-a46a-4803a9f285e5 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Returning 404 to user: Instance af7f16d9-5dea-46ea-92a8-ff136a0a3eda could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:54.975796 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2f9035f9-ca5e-43d5-a46a-4803a9f285e5 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda" status: 404 len: 111 microversion: 2.1 time: 0.030451 Jul 20 04:17:54.975796 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1014/2115] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/af7f16d9-5dea-46ea-92a8-ff136a0a3eda => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:54.978691 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9dde71af-0a1f-4217-8c64-89ff0c3a3941 req-360afd16-cc07-428b-ab12-0b6fbbc901a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038881 Jul 20 04:17:54.979699 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1102/2116] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:54.980699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d7d05228-3a11-411d-a0eb-e45c85d30062 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1041672349"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:54.981501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d7d05228-3a11-411d-a0eb-e45c85d30062 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.987909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57dc1338-7b69-4b31-bc61-ea3530a08ea8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] Calling method '.version_select at 0x7fbf9d0fbee0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.988401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7d05228-3a11-411d-a0eb-e45c85d30062 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.988853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7d05228-3a11-411d-a0eb-e45c85d30062 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.989635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7d05228-3a11-411d-a0eb-e45c85d30062 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.990066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7d05228-3a11-411d-a0eb-e45c85d30062 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.007638 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57dc1338-7b69-4b31-bc61-ea3530a08ea8 tempest-ServersTestJSON-2050599093 tempest-ServersTestJSON-2050599093-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1914541826" status: 202 len: 0 microversion: 2.1 time: 0.023938 Jul 20 04:17:55.008389 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1103/2117] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 04:17:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1914541826 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:55.165030 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.network.security_group_api [None req-d7d05228-3a11-411d-a0eb-e45c85d30062 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Adding security group b205b394-2633-498a-a94a-104535598b66 to port 8db84d6a-e65e-407f-b791-d9e906efb840 Jul 20 04:17:55.500928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3adf93b9-43af-4e70-998e-4ef21c9233af tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:55.501679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3adf93b9-43af-4e70-998e-4ef21c9233af tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:55.508604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3adf93b9-43af-4e70-998e-4ef21c9233af tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.509348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3adf93b9-43af-4e70-998e-4ef21c9233af tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.510432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3adf93b9-43af-4e70-998e-4ef21c9233af tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.511040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3adf93b9-43af-4e70-998e-4ef21c9233af tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.840730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3adf93b9-43af-4e70-998e-4ef21c9233af tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.849774 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3adf93b9-43af-4e70-998e-4ef21c9233af tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1313 microversion: 2.1 time: 0.352679 Jul 20 04:17:55.867891 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1104/2118] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:55 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:55.873186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2f2476a8-3e9c-4296-ac02-29af87a5ba13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:55.873852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2f2476a8-3e9c-4296-ac02-29af87a5ba13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:55.889274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f2476a8-3e9c-4296-ac02-29af87a5ba13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.889747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f2476a8-3e9c-4296-ac02-29af87a5ba13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.890597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f2476a8-3e9c-4296-ac02-29af87a5ba13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.890988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f2476a8-3e9c-4296-ac02-29af87a5ba13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.016045 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d7d05228-3a11-411d-a0eb-e45c85d30062 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8/action" status: 202 len: 0 microversion: 2.1 time: 1.039118 Jul 20 04:17:56.021518 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1015/2119] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:54 2022] POST /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8/action => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:56.027302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2da3967b-2336-442d-bd46-ed21c9d40648 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d185f70>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:56.095549 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2da3967b-2336-442d-bd46-ed21c9d40648 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.072321 Jul 20 04:17:56.096730 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1016/2120] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:56 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:56.107932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-099ac321-c666-4262-9b89-b6134049ccb8 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:56.108859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-099ac321-c666-4262-9b89-b6134049ccb8 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:56.117157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-099ac321-c666-4262-9b89-b6134049ccb8 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.117896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-099ac321-c666-4262-9b89-b6134049ccb8 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.118875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-099ac321-c666-4262-9b89-b6134049ccb8 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.119495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-099ac321-c666-4262-9b89-b6134049ccb8 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.239967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f2476a8-3e9c-4296-ac02-29af87a5ba13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.244142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-099ac321-c666-4262-9b89-b6134049ccb8 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.253670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f2476a8-3e9c-4296-ac02-29af87a5ba13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.256714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-099ac321-c666-4262-9b89-b6134049ccb8 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.258462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-099ac321-c666-4262-9b89-b6134049ccb8 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.259686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f2476a8-3e9c-4296-ac02-29af87a5ba13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.261522 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2f2476a8-3e9c-4296-ac02-29af87a5ba13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.392717 Jul 20 04:17:56.263331 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1105/2121] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:55 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:56.270762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-492fe311-c637-4e1b-92d7-e2b7d2425f40 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:56.271471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-492fe311-c637-4e1b-92d7-e2b7d2425f40 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:56.279883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-492fe311-c637-4e1b-92d7-e2b7d2425f40 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.280797 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-099ac321-c666-4262-9b89-b6134049ccb8 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.182693 Jul 20 04:17:56.281408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-492fe311-c637-4e1b-92d7-e2b7d2425f40 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.282110 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1017/2122] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:56 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:56.282588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-492fe311-c637-4e1b-92d7-e2b7d2425f40 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.283119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-492fe311-c637-4e1b-92d7-e2b7d2425f40 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.288121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33f1bb66-2f3d-4fcc-9ff7-542991220297 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d11db80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:57.005015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-492fe311-c637-4e1b-92d7-e2b7d2425f40 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.021319 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-492fe311-c637-4e1b-92d7-e2b7d2425f40 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.754614 Jul 20 04:17:57.022612 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1106/2123] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:56 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:57.030651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-423d1f5b-9b6c-45e9-a9ad-b8cf7be0ab95 req-ac0778ac-9b6f-4f20-bd16-89cc91f9503d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a749b53d-cbac-4db3-9cbf-6ef098f37cd8", "tag": "8db84d6a-e65e-407f-b791-d9e906efb840"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:57.042119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-423d1f5b-9b6c-45e9-a9ad-b8cf7be0ab95 req-ac0778ac-9b6f-4f20-bd16-89cc91f9503d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.042693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-423d1f5b-9b6c-45e9-a9ad-b8cf7be0ab95 req-ac0778ac-9b6f-4f20-bd16-89cc91f9503d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.057206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-33f1bb66-2f3d-4fcc-9ff7-542991220297 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b205b394-2633-498a-a94a-104535598b66 in use.", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:17:57.059286 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-33f1bb66-2f3d-4fcc-9ff7-542991220297 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Security Group b205b394-2633-498a-a94a-104535598b66 in use. Jul 20 04:17:57.059286 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-7c5dfb9d-9d31-4db8-ba78-a17fe6d1e2c4'] Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33f1bb66-2f3d-4fcc-9ff7-542991220297 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-security-groups/b205b394-2633-498a-a94a-104535598b66 HTTP/1.1 Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: exception: Security Group b205b394-2633-498a-a94a-104535598b66 in use. Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-7c5dfb9d-9d31-4db8-ba78-a17fe6d1e2c4'] Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'b205b394-2633-498a-a94a-104535598b66'} Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:17:57.062546 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b205b394-2633-498a-a94a-104535598b66 in use. Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c5dfb9d-9d31-4db8-ba78-a17fe6d1e2c4'] Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b205b394-2633-498a-a94a-104535598b66 in use. Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c5dfb9d-9d31-4db8-ba78-a17fe6d1e2c4'] Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b205b394-2633-498a-a94a-104535598b66 in use. Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c5dfb9d-9d31-4db8-ba78-a17fe6d1e2c4'] Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b205b394-2633-498a-a94a-104535598b66 in use. Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c5dfb9d-9d31-4db8-ba78-a17fe6d1e2c4'] Jul 20 04:17:57.067002 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:17:57.074252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33f1bb66-2f3d-4fcc-9ff7-542991220297 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 400 to user: Security Group b205b394-2633-498a-a94a-104535598b66 in use. Jul 20 04:17:57.074252 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-7c5dfb9d-9d31-4db8-ba78-a17fe6d1e2c4'] {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:57.076326 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-33f1bb66-2f3d-4fcc-9ff7-542991220297 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b205b394-2633-498a-a94a-104535598b66" status: 400 len: 185 microversion: 2.1 time: 0.792190 Jul 20 04:17:57.080484 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1018/2124] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:56 2022] DELETE /compute/v2.1/os-security-groups/b205b394-2633-498a-a94a-104535598b66 => generated 185 bytes in 797 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:17:57.083383 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-423d1f5b-9b6c-45e9-a9ad-b8cf7be0ab95 req-ac0778ac-9b6f-4f20-bd16-89cc91f9503d service nova] Creating event network-changed:8db84d6a-e65e-407f-b791-d9e906efb840 for instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 on n-h2-764485-11 Jul 20 04:17:57.087122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-06ad35c9-fa18-4f44-b37a-cbd9fadbd477 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:57.087764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-06ad35c9-fa18-4f44-b37a-cbd9fadbd477 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:57.098549 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-423d1f5b-9b6c-45e9-a9ad-b8cf7be0ab95 req-ac0778ac-9b6f-4f20-bd16-89cc91f9503d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073632 Jul 20 04:17:57.099100 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1107/2125] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:57.102934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06ad35c9-fa18-4f44-b37a-cbd9fadbd477 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.103657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06ad35c9-fa18-4f44-b37a-cbd9fadbd477 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.104279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ec2ecc49-fd86-4af5-ad92-b9a7fd02d418 req-031f1e60-dd24-40ca-b109-afddb8cf773a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b275fa8-1d8e-435e-9256-5b2a33129d62", "name": "network-vif-plugged", "status": "completed", "tag": "cd19a68b-44cb-4c08-a687-f66d10df0d36"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:57.105500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06ad35c9-fa18-4f44-b37a-cbd9fadbd477 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.106126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06ad35c9-fa18-4f44-b37a-cbd9fadbd477 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.112992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ec2ecc49-fd86-4af5-ad92-b9a7fd02d418 req-031f1e60-dd24-40ca-b109-afddb8cf773a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.113444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ec2ecc49-fd86-4af5-ad92-b9a7fd02d418 req-031f1e60-dd24-40ca-b109-afddb8cf773a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.124930 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ec2ecc49-fd86-4af5-ad92-b9a7fd02d418 req-031f1e60-dd24-40ca-b109-afddb8cf773a service nova] Creating event network-vif-plugged:cd19a68b-44cb-4c08-a687-f66d10df0d36 for instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 on n-h1-764485-11 Jul 20 04:17:57.132392 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ec2ecc49-fd86-4af5-ad92-b9a7fd02d418 req-031f1e60-dd24-40ca-b109-afddb8cf773a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032286 Jul 20 04:17:57.133910 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1108/2126] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:57.141269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-17fe6a39-b043-47a3-82ef-77a2ada8219a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:57.142498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-17fe6a39-b043-47a3-82ef-77a2ada8219a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:57.158155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17fe6a39-b043-47a3-82ef-77a2ada8219a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.165473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17fe6a39-b043-47a3-82ef-77a2ada8219a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.166685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17fe6a39-b043-47a3-82ef-77a2ada8219a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.167297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17fe6a39-b043-47a3-82ef-77a2ada8219a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.288762 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-17fe6a39-b043-47a3-82ef-77a2ada8219a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8/action" status: 202 len: 0 microversion: 2.1 time: 0.152710 Jul 20 04:17:57.293537 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1109/2127] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:57 2022] POST /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:57.300754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-384e8bd4-7e89-4c26-ace3-b85754c23e02 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa28a9a60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:57.363273 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-384e8bd4-7e89-4c26-ace3-b85754c23e02 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.070011 Jul 20 04:17:57.364618 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1110/2128] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:57 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:57.371293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f15310a1-73ae-4826-9472-934ee0466858 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:57.372904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f15310a1-73ae-4826-9472-934ee0466858 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:57.382431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f15310a1-73ae-4826-9472-934ee0466858 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.383288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f15310a1-73ae-4826-9472-934ee0466858 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.384166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f15310a1-73ae-4826-9472-934ee0466858 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.384541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f15310a1-73ae-4826-9472-934ee0466858 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.740207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-06ad35c9-fa18-4f44-b37a-cbd9fadbd477 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.749643 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-06ad35c9-fa18-4f44-b37a-cbd9fadbd477 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1313 microversion: 2.1 time: 0.667845 Jul 20 04:17:57.761782 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1019/2129] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:57 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1313 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:57.769007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-105f452b-179f-408b-9def-02196575133d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:57.769944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-105f452b-179f-408b-9def-02196575133d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:57.783093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-105f452b-179f-408b-9def-02196575133d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.784453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-105f452b-179f-408b-9def-02196575133d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.786205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-105f452b-179f-408b-9def-02196575133d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.786910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-105f452b-179f-408b-9def-02196575133d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.843266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f15310a1-73ae-4826-9472-934ee0466858 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.877289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f15310a1-73ae-4826-9472-934ee0466858 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.880631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f15310a1-73ae-4826-9472-934ee0466858 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.881851 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f15310a1-73ae-4826-9472-934ee0466858 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.515047 Jul 20 04:17:57.882425 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1111/2130] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:57 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:57.899762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3f27e3ee-9066-4444-9d89-84d985176686 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:57.900384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3f27e3ee-9066-4444-9d89-84d985176686 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:57.911108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f27e3ee-9066-4444-9d89-84d985176686 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.911487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f27e3ee-9066-4444-9d89-84d985176686 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.912387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f27e3ee-9066-4444-9d89-84d985176686 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.913592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f27e3ee-9066-4444-9d89-84d985176686 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.092809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3f27e3ee-9066-4444-9d89-84d985176686 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:58.102365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3f27e3ee-9066-4444-9d89-84d985176686 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:58.111823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3f27e3ee-9066-4444-9d89-84d985176686 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:58.129489 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3f27e3ee-9066-4444-9d89-84d985176686 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.232410 Jul 20 04:17:58.130397 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1112/2131] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:57 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:58.136150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2ec64a0a-08fa-4ce8-b8e7-1c73c943201a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.137233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2ec64a0a-08fa-4ce8-b8e7-1c73c943201a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:58.148952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ec64a0a-08fa-4ce8-b8e7-1c73c943201a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.149401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ec64a0a-08fa-4ce8-b8e7-1c73c943201a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.150181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ec64a0a-08fa-4ce8-b8e7-1c73c943201a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.150613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ec64a0a-08fa-4ce8-b8e7-1c73c943201a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.532526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-105f452b-179f-408b-9def-02196575133d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:58.542021 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-105f452b-179f-408b-9def-02196575133d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1573 microversion: 2.1 time: 0.777852 Jul 20 04:17:58.546389 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1020/2132] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:57 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1573 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:58.558861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1e7999a5-e455-4b53-b9b1-da986fe28c66 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d11d160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.616358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2ec64a0a-08fa-4ce8-b8e7-1c73c943201a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:58.631197 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1e7999a5-e455-4b53-b9b1-da986fe28c66 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.084051 Jul 20 04:17:58.634071 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2ec64a0a-08fa-4ce8-b8e7-1c73c943201a tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.502043 Jul 20 04:17:58.634659 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1113/2133] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:58 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:58.634980 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1021/2134] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:58 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:58.769692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e3bae82-1a45-4276-b0e2-f76355a69266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.770315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3e3bae82-1a45-4276-b0e2-f76355a69266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:58.786529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e3bae82-1a45-4276-b0e2-f76355a69266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.786984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e3bae82-1a45-4276-b0e2-f76355a69266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.787986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e3bae82-1a45-4276-b0e2-f76355a69266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.788599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e3bae82-1a45-4276-b0e2-f76355a69266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.906999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9453df3-3479-45e0-8fe9-f0b51419c2f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.908492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b9453df3-3479-45e0-8fe9-f0b51419c2f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:58.918616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9453df3-3479-45e0-8fe9-f0b51419c2f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.919084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9453df3-3479-45e0-8fe9-f0b51419c2f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.922307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9453df3-3479-45e0-8fe9-f0b51419c2f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.922766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9453df3-3479-45e0-8fe9-f0b51419c2f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.281466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3e3bae82-1a45-4276-b0e2-f76355a69266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.292166 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3e3bae82-1a45-4276-b0e2-f76355a69266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1313 microversion: 2.1 time: 0.526052 Jul 20 04:17:59.302225 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1114/2135] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:58 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:59.304061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-288f4761-b641-41bc-a2f9-edd67a374ea4 req-d02fd1f7-cb10-423f-9164-cadae645cc35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838c7de4-25f3-481a-b89f-6562178ccce0", "name": "network-vif-unplugged", "status": "completed", "tag": "64e34bf8-7b7e-45eb-acd2-804013d49abe"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:59.333886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=13 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:59.335079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9453df3-3479-45e0-8fe9-f0b51419c2f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.340621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-288f4761-b641-41bc-a2f9-edd67a374ea4 req-d02fd1f7-cb10-423f-9164-cadae645cc35 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.341172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-288f4761-b641-41bc-a2f9-edd67a374ea4 req-d02fd1f7-cb10-423f-9164-cadae645cc35 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.345111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9453df3-3479-45e0-8fe9-f0b51419c2f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.346709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9453df3-3479-45e0-8fe9-f0b51419c2f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.350644 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b9453df3-3479-45e0-8fe9-f0b51419c2f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.451100 Jul 20 04:17:59.352811 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1022/2136] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:58 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:59.360449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:59.366443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d6fecb64-a5fa-4b91-be78-3025013d2575 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.367063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d6fecb64-a5fa-4b91-be78-3025013d2575 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:59.376413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6fecb64-a5fa-4b91-be78-3025013d2575 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.379302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:59.379752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6fecb64-a5fa-4b91-be78-3025013d2575 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.382481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6fecb64-a5fa-4b91-be78-3025013d2575 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.382961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6fecb64-a5fa-4b91-be78-3025013d2575 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.397458 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-288f4761-b641-41bc-a2f9-edd67a374ea4 req-d02fd1f7-cb10-423f-9164-cadae645cc35 service nova] Creating event network-vif-unplugged:64e34bf8-7b7e-45eb-acd2-804013d49abe for instance 838c7de4-25f3-481a-b89f-6562178ccce0 on n-h1-764485-11 Jul 20 04:17:59.409290 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-288f4761-b641-41bc-a2f9-edd67a374ea4 req-d02fd1f7-cb10-423f-9164-cadae645cc35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110010 Jul 20 04:17:59.412036 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1115/2137] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:59.502306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d6fecb64-a5fa-4b91-be78-3025013d2575 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.518132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d6fecb64-a5fa-4b91-be78-3025013d2575 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.521768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d6fecb64-a5fa-4b91-be78-3025013d2575 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.535479 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d6fecb64-a5fa-4b91-be78-3025013d2575 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.181546 Jul 20 04:17:59.537257 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1023/2138] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:59.566849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9e21ea21-e3e7-4926-aa5e-a1159e05e6e6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.568028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9e21ea21-e3e7-4926-aa5e-a1159e05e6e6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:59.578083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e21ea21-e3e7-4926-aa5e-a1159e05e6e6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.578845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e21ea21-e3e7-4926-aa5e-a1159e05e6e6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.579831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e21ea21-e3e7-4926-aa5e-a1159e05e6e6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.580438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e21ea21-e3e7-4926-aa5e-a1159e05e6e6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.651824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86b1a43f-fa41-4144-bf44-733e4b23a80c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d135e50>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.725647 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-86b1a43f-fa41-4144-bf44-733e4b23a80c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.078127 Jul 20 04:17:59.726821 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1024/2139] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:59.740271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-893b1397-955d-4a2b-89a1-989656483eb8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.741734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-893b1397-955d-4a2b-89a1-989656483eb8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:59.751033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-893b1397-955d-4a2b-89a1-989656483eb8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.751819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-893b1397-955d-4a2b-89a1-989656483eb8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.753527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-893b1397-955d-4a2b-89a1-989656483eb8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.754293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-893b1397-955d-4a2b-89a1-989656483eb8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.089198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e21ea21-e3e7-4926-aa5e-a1159e05e6e6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.110452 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9e21ea21-e3e7-4926-aa5e-a1159e05e6e6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1578 microversion: 2.1 time: 0.551504 Jul 20 04:18:00.111056 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1116/2140] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1578 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:00.310869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c725203-2823-465a-8889-6e0f771f45bf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:00.311738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6c725203-2823-465a-8889-6e0f771f45bf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:00.326474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c725203-2823-465a-8889-6e0f771f45bf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.327229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c725203-2823-465a-8889-6e0f771f45bf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.327724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c725203-2823-465a-8889-6e0f771f45bf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.328443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c725203-2823-465a-8889-6e0f771f45bf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.583440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-893b1397-955d-4a2b-89a1-989656483eb8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.593792 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-893b1397-955d-4a2b-89a1-989656483eb8 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.865476 Jul 20 04:18:00.595011 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1025/2141] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:00.607650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f72bde91-b553-4692-9eda-9cb50ad3a077 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:00.608779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f72bde91-b553-4692-9eda-9cb50ad3a077 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:00.615341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f72bde91-b553-4692-9eda-9cb50ad3a077 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.616292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f72bde91-b553-4692-9eda-9cb50ad3a077 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.617371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f72bde91-b553-4692-9eda-9cb50ad3a077 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.618092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f72bde91-b553-4692-9eda-9cb50ad3a077 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.645621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:00.884366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6c725203-2823-465a-8889-6e0f771f45bf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.894445 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6c725203-2823-465a-8889-6e0f771f45bf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1499 microversion: 2.1 time: 0.587866 Jul 20 04:18:00.905892 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1117/2142] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:00 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1499 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:00.905892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-de35bc94-5c69-4993-94db-cb148c9311d3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:00.905892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-de35bc94-5c69-4993-94db-cb148c9311d3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:00.913942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de35bc94-5c69-4993-94db-cb148c9311d3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.914769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de35bc94-5c69-4993-94db-cb148c9311d3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.916193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de35bc94-5c69-4993-94db-cb148c9311d3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.916913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de35bc94-5c69-4993-94db-cb148c9311d3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.960320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f72bde91-b553-4692-9eda-9cb50ad3a077 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.980000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f72bde91-b553-4692-9eda-9cb50ad3a077 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.983223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f72bde91-b553-4692-9eda-9cb50ad3a077 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.987540 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f72bde91-b553-4692-9eda-9cb50ad3a077 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.390547 Jul 20 04:18:00.989940 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1026/2143] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:00 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:01.001451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8cf6b007-fc1c-4145-af31-7e4198e13c10 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d212ee0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.046953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-de35bc94-5c69-4993-94db-cb148c9311d3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.066768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-de35bc94-5c69-4993-94db-cb148c9311d3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.071705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-de35bc94-5c69-4993-94db-cb148c9311d3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.087256 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8cf6b007-fc1c-4145-af31-7e4198e13c10 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.095584 Jul 20 04:18:01.087903 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1027/2144] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:00 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:01.103772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7138acfe-9782-4797-ac8b-f01411fc5274 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:01.106232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7138acfe-9782-4797-ac8b-f01411fc5274 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.120345 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-de35bc94-5c69-4993-94db-cb148c9311d3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.222759 Jul 20 04:18:01.121020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7138acfe-9782-4797-ac8b-f01411fc5274 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.122714 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1118/2145] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:00 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:01.133874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aac55548-2d64-454f-bae7-fc80cc3623b9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.134477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aac55548-2d64-454f-bae7-fc80cc3623b9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.135222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7138acfe-9782-4797-ac8b-f01411fc5274 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.136355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7138acfe-9782-4797-ac8b-f01411fc5274 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.137036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7138acfe-9782-4797-ac8b-f01411fc5274 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.150480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aac55548-2d64-454f-bae7-fc80cc3623b9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.150933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aac55548-2d64-454f-bae7-fc80cc3623b9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.152143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aac55548-2d64-454f-bae7-fc80cc3623b9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.154904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aac55548-2d64-454f-bae7-fc80cc3623b9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.199796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-7138acfe-9782-4797-ac8b-f01411fc5274 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lazy-loading 'flavor' on Instance uuid 3b275fa8-1d8e-435e-9256-5b2a33129d62 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:01.408515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aac55548-2d64-454f-bae7-fc80cc3623b9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.418309 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aac55548-2d64-454f-bae7-fc80cc3623b9 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1571 microversion: 2.1 time: 0.288997 Jul 20 04:18:01.430288 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1119/2146] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1571 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:01.436317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2805b6c1-a32f-4535-a9e2-45a99e85bcc3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2045208888"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:01.437245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2805b6c1-a32f-4535-a9e2-45a99e85bcc3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.444014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2805b6c1-a32f-4535-a9e2-45a99e85bcc3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.444808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2805b6c1-a32f-4535-a9e2-45a99e85bcc3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.445845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2805b6c1-a32f-4535-a9e2-45a99e85bcc3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.446503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2805b6c1-a32f-4535-a9e2-45a99e85bcc3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.750562 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7138acfe-9782-4797-ac8b-f01411fc5274 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "POST /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62/action" status: 202 len: 0 microversion: 2.1 time: 0.661283 Jul 20 04:18:01.751280 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.network.security_group_api [None req-2805b6c1-a32f-4535-a9e2-45a99e85bcc3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Adding security group b3903075-9565-4553-ac85-c8de0cd61d20 to port 8db84d6a-e65e-407f-b791-d9e906efb840 Jul 20 04:18:01.752504 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1028/2147] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:01 2022] POST /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:01.758499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8e05b4bd-579a-4c18-96c8-3376bb4d855d req-b6d48009-015a-4f20-a44a-005bb236e08f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838c7de4-25f3-481a-b89f-6562178ccce0", "tag": "64e34bf8-7b7e-45eb-acd2-804013d49abe"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:01.770073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8e05b4bd-579a-4c18-96c8-3376bb4d855d req-b6d48009-015a-4f20-a44a-005bb236e08f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.771690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8e05b4bd-579a-4c18-96c8-3376bb4d855d req-b6d48009-015a-4f20-a44a-005bb236e08f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.796151 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8e05b4bd-579a-4c18-96c8-3376bb4d855d req-b6d48009-015a-4f20-a44a-005bb236e08f service nova] Creating event network-changed:64e34bf8-7b7e-45eb-acd2-804013d49abe for instance 838c7de4-25f3-481a-b89f-6562178ccce0 on n-h1-764485-11 Jul 20 04:18:01.802339 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8e05b4bd-579a-4c18-96c8-3376bb4d855d req-b6d48009-015a-4f20-a44a-005bb236e08f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048212 Jul 20 04:18:01.803399 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1029/2148] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:01.811683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4fb92856-ccfa-4357-99fa-5e3e654ac5d7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.812993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4fb92856-ccfa-4357-99fa-5e3e654ac5d7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.820389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fb92856-ccfa-4357-99fa-5e3e654ac5d7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.821368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fb92856-ccfa-4357-99fa-5e3e654ac5d7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.826897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fb92856-ccfa-4357-99fa-5e3e654ac5d7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.827812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fb92856-ccfa-4357-99fa-5e3e654ac5d7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.295362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4fb92856-ccfa-4357-99fa-5e3e654ac5d7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.316769 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4fb92856-ccfa-4357-99fa-5e3e654ac5d7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.511773 Jul 20 04:18:02.317419 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1030/2149] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:02.331876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-499a461a-0475-4f05-8484-ab8e894b75d2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.332508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-499a461a-0475-4f05-8484-ab8e894b75d2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.355300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-499a461a-0475-4f05-8484-ab8e894b75d2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.356099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-499a461a-0475-4f05-8484-ab8e894b75d2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.358001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-499a461a-0475-4f05-8484-ab8e894b75d2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.358698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-499a461a-0475-4f05-8484-ab8e894b75d2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.721159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-499a461a-0475-4f05-8484-ab8e894b75d2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.735679 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-499a461a-0475-4f05-8484-ab8e894b75d2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.406299 Jul 20 04:18:02.737649 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1031/2150] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:02 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:02.748515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-51d74f14-454c-45e8-8052-7a28a1c314b3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.749484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-51d74f14-454c-45e8-8052-7a28a1c314b3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.756684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51d74f14-454c-45e8-8052-7a28a1c314b3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.758089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51d74f14-454c-45e8-8052-7a28a1c314b3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.759191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51d74f14-454c-45e8-8052-7a28a1c314b3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.759828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51d74f14-454c-45e8-8052-7a28a1c314b3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.242480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-51d74f14-454c-45e8-8052-7a28a1c314b3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.251337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-51d74f14-454c-45e8-8052-7a28a1c314b3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.252979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-51d74f14-454c-45e8-8052-7a28a1c314b3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.254836 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-51d74f14-454c-45e8-8052-7a28a1c314b3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.515927 Jul 20 04:18:03.261255 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1032/2151] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:02 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:03.266461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-21c676ca-95b2-4d66-bd05-32d2305deb5d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d0fc4c0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.301569 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2805b6c1-a32f-4535-a9e2-45a99e85bcc3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8/action" status: 202 len: 0 microversion: 2.1 time: 1.869677 Jul 20 04:18:03.308920 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1120/2152] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:01 2022] POST /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8/action => generated 0 bytes in 1878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:03.318421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67f8200c-bb6c-4eee-bba1-9dd4a3f4b8f3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.320877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67f8200c-bb6c-4eee-bba1-9dd4a3f4b8f3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:03.339813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67f8200c-bb6c-4eee-bba1-9dd4a3f4b8f3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.344683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67f8200c-bb6c-4eee-bba1-9dd4a3f4b8f3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.350199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67f8200c-bb6c-4eee-bba1-9dd4a3f4b8f3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.354556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67f8200c-bb6c-4eee-bba1-9dd4a3f4b8f3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.394948 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-21c676ca-95b2-4d66-bd05-32d2305deb5d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.132300 Jul 20 04:18:03.395979 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1033/2153] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:03 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:03.400663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-38d100da-ce86-4351-8beb-97a3212c3b04 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d0cf670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.519032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67f8200c-bb6c-4eee-bba1-9dd4a3f4b8f3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.533400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67f8200c-bb6c-4eee-bba1-9dd4a3f4b8f3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.537285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67f8200c-bb6c-4eee-bba1-9dd4a3f4b8f3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.561559 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67f8200c-bb6c-4eee-bba1-9dd4a3f4b8f3 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.251156 Jul 20 04:18:03.562608 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1121/2154] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:03 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:03.567491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-de136ed9-34c2-4bb8-8a77-4049a1ee8e7d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.568381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-de136ed9-34c2-4bb8-8a77-4049a1ee8e7d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:03.581652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de136ed9-34c2-4bb8-8a77-4049a1ee8e7d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.582185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de136ed9-34c2-4bb8-8a77-4049a1ee8e7d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.585830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de136ed9-34c2-4bb8-8a77-4049a1ee8e7d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.586300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de136ed9-34c2-4bb8-8a77-4049a1ee8e7d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.689124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-38d100da-ce86-4351-8beb-97a3212c3b04 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b3903075-9565-4553-ac85-c8de0cd61d20 in use.", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:18:03.690116 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-38d100da-ce86-4351-8beb-97a3212c3b04 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Security Group b3903075-9565-4553-ac85-c8de0cd61d20 in use. Jul 20 04:18:03.690116 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-c5914294-1b38-4758-9366-2ea26fdc8217'] Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-38d100da-ce86-4351-8beb-97a3212c3b04 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-security-groups/b3903075-9565-4553-ac85-c8de0cd61d20 HTTP/1.1 Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: exception: Security Group b3903075-9565-4553-ac85-c8de0cd61d20 in use. Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-c5914294-1b38-4758-9366-2ea26fdc8217'] Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'b3903075-9565-4553-ac85-c8de0cd61d20'} Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:18:03.692318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b3903075-9565-4553-ac85-c8de0cd61d20 in use. Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5914294-1b38-4758-9366-2ea26fdc8217'] Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b3903075-9565-4553-ac85-c8de0cd61d20 in use. Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5914294-1b38-4758-9366-2ea26fdc8217'] Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b3903075-9565-4553-ac85-c8de0cd61d20 in use. Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5914294-1b38-4758-9366-2ea26fdc8217'] Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b3903075-9565-4553-ac85-c8de0cd61d20 in use. Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5914294-1b38-4758-9366-2ea26fdc8217'] Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-38d100da-ce86-4351-8beb-97a3212c3b04 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 400 to user: Security Group b3903075-9565-4553-ac85-c8de0cd61d20 in use. Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-c5914294-1b38-4758-9366-2ea26fdc8217'] {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-38d100da-ce86-4351-8beb-97a3212c3b04 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b3903075-9565-4553-ac85-c8de0cd61d20" status: 400 len: 185 microversion: 2.1 time: 0.298230 Jul 20 04:18:03.697925 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1034/2155] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:18:03 2022] DELETE /compute/v2.1/os-security-groups/b3903075-9565-4553-ac85-c8de0cd61d20 => generated 185 bytes in 301 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:03.716004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fabff1b8-ed50-486b-bca4-546c7d4bccdf tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.718638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fabff1b8-ed50-486b-bca4-546c7d4bccdf tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:03.727053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fabff1b8-ed50-486b-bca4-546c7d4bccdf tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.728046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fabff1b8-ed50-486b-bca4-546c7d4bccdf tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.729074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fabff1b8-ed50-486b-bca4-546c7d4bccdf tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.729751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fabff1b8-ed50-486b-bca4-546c7d4bccdf tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.772213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fabff1b8-ed50-486b-bca4-546c7d4bccdf tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:03.938557 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fabff1b8-ed50-486b-bca4-546c7d4bccdf tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 204 len: 0 microversion: 2.1 time: 0.235444 Jul 20 04:18:03.943036 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1035/2156] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:03 2022] DELETE /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:03.963124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f763b413-9da8-42e3-a9b1-bd6e88ba3d96 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.966680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f763b413-9da8-42e3-a9b1-bd6e88ba3d96 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:03.981352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f763b413-9da8-42e3-a9b1-bd6e88ba3d96 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.982195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f763b413-9da8-42e3-a9b1-bd6e88ba3d96 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.984742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f763b413-9da8-42e3-a9b1-bd6e88ba3d96 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.986300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f763b413-9da8-42e3-a9b1-bd6e88ba3d96 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.994759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-de136ed9-34c2-4bb8-8a77-4049a1ee8e7d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.009104 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-de136ed9-34c2-4bb8-8a77-4049a1ee8e7d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.445033 Jul 20 04:18:04.018840 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1122/2157] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:03 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:04.034987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a0241c2b-f67b-47c0-bf92-d58271ddea9f req-2fa53a96-0e1a-4553-ad1b-d7bb1e7db640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a749b53d-cbac-4db3-9cbf-6ef098f37cd8", "tag": "8db84d6a-e65e-407f-b791-d9e906efb840"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:04.059354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a0241c2b-f67b-47c0-bf92-d58271ddea9f req-2fa53a96-0e1a-4553-ad1b-d7bb1e7db640 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.062588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a0241c2b-f67b-47c0-bf92-d58271ddea9f req-2fa53a96-0e1a-4553-ad1b-d7bb1e7db640 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.128143 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a0241c2b-f67b-47c0-bf92-d58271ddea9f req-2fa53a96-0e1a-4553-ad1b-d7bb1e7db640 service nova] Creating event network-changed:8db84d6a-e65e-407f-b791-d9e906efb840 for instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 on n-h2-764485-11 Jul 20 04:18:04.142135 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a0241c2b-f67b-47c0-bf92-d58271ddea9f req-2fa53a96-0e1a-4553-ad1b-d7bb1e7db640 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121650 Jul 20 04:18:04.145946 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1123/2158] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:04.160428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-606a6bbf-f7cb-4ee4-83fa-7de196bb80bd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.161453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-606a6bbf-f7cb-4ee4-83fa-7de196bb80bd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.192318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-606a6bbf-f7cb-4ee4-83fa-7de196bb80bd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.192930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-606a6bbf-f7cb-4ee4-83fa-7de196bb80bd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.195166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-606a6bbf-f7cb-4ee4-83fa-7de196bb80bd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.197842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-606a6bbf-f7cb-4ee4-83fa-7de196bb80bd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.230284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f763b413-9da8-42e3-a9b1-bd6e88ba3d96 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.242216 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f763b413-9da8-42e3-a9b1-bd6e88ba3d96 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.297104 Jul 20 04:18:04.245939 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1036/2159] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:03 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:04.279662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a532a1d9-3fef-40a2-ad21-228b2259cc51 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.281270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a532a1d9-3fef-40a2-ad21-228b2259cc51 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.306709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a532a1d9-3fef-40a2-ad21-228b2259cc51 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.308282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a532a1d9-3fef-40a2-ad21-228b2259cc51 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.311413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a532a1d9-3fef-40a2-ad21-228b2259cc51 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.312107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a532a1d9-3fef-40a2-ad21-228b2259cc51 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.654815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a532a1d9-3fef-40a2-ad21-228b2259cc51 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.670890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a532a1d9-3fef-40a2-ad21-228b2259cc51 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.672868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a532a1d9-3fef-40a2-ad21-228b2259cc51 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.679867 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a532a1d9-3fef-40a2-ad21-228b2259cc51 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.404521 Jul 20 04:18:04.685544 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1037/2160] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:04.690981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3f1fda50-7111-4c92-9702-442c1d1b219b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d135700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.734593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-606a6bbf-f7cb-4ee4-83fa-7de196bb80bd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.743888 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-606a6bbf-f7cb-4ee4-83fa-7de196bb80bd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1646 microversion: 2.1 time: 0.594856 Jul 20 04:18:04.752935 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1124/2161] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1646 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:04.776611 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3f1fda50-7111-4c92-9702-442c1d1b219b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.087296 Jul 20 04:18:04.777154 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1038/2162] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:04.785798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ff16c069-b9dd-4c99-a814-e4e594dd74cb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.786703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ff16c069-b9dd-4c99-a814-e4e594dd74cb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.801419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff16c069-b9dd-4c99-a814-e4e594dd74cb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.803971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff16c069-b9dd-4c99-a814-e4e594dd74cb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.805018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff16c069-b9dd-4c99-a814-e4e594dd74cb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.806776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff16c069-b9dd-4c99-a814-e4e594dd74cb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.915652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ff16c069-b9dd-4c99-a814-e4e594dd74cb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.930937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ff16c069-b9dd-4c99-a814-e4e594dd74cb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.935275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ff16c069-b9dd-4c99-a814-e4e594dd74cb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.946537 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ff16c069-b9dd-4c99-a814-e4e594dd74cb tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.175369 Jul 20 04:18:04.947952 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1125/2163] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:05.035852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-521c8416-fe93-4c2a-86bc-7b2155312545 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:05.036499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-521c8416-fe93-4c2a-86bc-7b2155312545 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:05.049522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-521c8416-fe93-4c2a-86bc-7b2155312545 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.049992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-521c8416-fe93-4c2a-86bc-7b2155312545 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.053796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-521c8416-fe93-4c2a-86bc-7b2155312545 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.054634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-521c8416-fe93-4c2a-86bc-7b2155312545 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.264007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15c96d31-0b97-4ba6-9c44-56a168e984d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:05.265136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-15c96d31-0b97-4ba6-9c44-56a168e984d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:05.286254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15c96d31-0b97-4ba6-9c44-56a168e984d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.290417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15c96d31-0b97-4ba6-9c44-56a168e984d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.292133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15c96d31-0b97-4ba6-9c44-56a168e984d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.292805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15c96d31-0b97-4ba6-9c44-56a168e984d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.319232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-521c8416-fe93-4c2a-86bc-7b2155312545 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.327478 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-521c8416-fe93-4c2a-86bc-7b2155312545 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.297017 Jul 20 04:18:05.331318 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1039/2164] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:05 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:05.473331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-15c96d31-0b97-4ba6-9c44-56a168e984d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.483259 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-15c96d31-0b97-4ba6-9c44-56a168e984d5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.224669 Jul 20 04:18:05.494187 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1126/2165] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:05 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:05.716698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4f7f0ac1-b293-48d8-937c-71703c64edbd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:05.717863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4f7f0ac1-b293-48d8-937c-71703c64edbd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:05.738012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f7f0ac1-b293-48d8-937c-71703c64edbd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.738381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f7f0ac1-b293-48d8-937c-71703c64edbd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.742229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f7f0ac1-b293-48d8-937c-71703c64edbd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.748634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f7f0ac1-b293-48d8-937c-71703c64edbd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.770741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cffe4bc4-c357-441b-bb66-81527405df76 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:05.771350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cffe4bc4-c357-441b-bb66-81527405df76 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:05.781669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cffe4bc4-c357-441b-bb66-81527405df76 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.783886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cffe4bc4-c357-441b-bb66-81527405df76 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.784850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cffe4bc4-c357-441b-bb66-81527405df76 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.786092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cffe4bc4-c357-441b-bb66-81527405df76 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.164066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4f7f0ac1-b293-48d8-937c-71703c64edbd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.173578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4f7f0ac1-b293-48d8-937c-71703c64edbd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.182345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4f7f0ac1-b293-48d8-937c-71703c64edbd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.183894 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4f7f0ac1-b293-48d8-937c-71703c64edbd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.477845 Jul 20 04:18:06.185576 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1040/2166] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:05 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:06.201251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e73d3d4c-3c5b-4974-a51f-4612eefe9043 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d385040>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:06.293981 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e73d3d4c-3c5b-4974-a51f-4612eefe9043 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.106855 Jul 20 04:18:06.294879 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1041/2167] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:06 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:06.299825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f17a9800-d4aa-475b-bbf3-4c0924e98712 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:06.300859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f17a9800-d4aa-475b-bbf3-4c0924e98712 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:06.308559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f17a9800-d4aa-475b-bbf3-4c0924e98712 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.309318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f17a9800-d4aa-475b-bbf3-4c0924e98712 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.314595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cffe4bc4-c357-441b-bb66-81527405df76 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.323280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f17a9800-d4aa-475b-bbf3-4c0924e98712 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.324367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f17a9800-d4aa-475b-bbf3-4c0924e98712 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.329737 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cffe4bc4-c357-441b-bb66-81527405df76 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1646 microversion: 2.1 time: 0.560540 Jul 20 04:18:06.340168 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1127/2168] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:05 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1646 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:06.352074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7ad607cf-8d71-4614-bf43-68f8670db2b2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:06.352698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7ad607cf-8d71-4614-bf43-68f8670db2b2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:06.359547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ad607cf-8d71-4614-bf43-68f8670db2b2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.360857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ad607cf-8d71-4614-bf43-68f8670db2b2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.362116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ad607cf-8d71-4614-bf43-68f8670db2b2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.363454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ad607cf-8d71-4614-bf43-68f8670db2b2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.568768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f17a9800-d4aa-475b-bbf3-4c0924e98712 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.583598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f17a9800-d4aa-475b-bbf3-4c0924e98712 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.588767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f17a9800-d4aa-475b-bbf3-4c0924e98712 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.603426 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f17a9800-d4aa-475b-bbf3-4c0924e98712 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.307110 Jul 20 04:18:06.604808 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1042/2169] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:06 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:06.614041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2d5d6e41-e636-42b6-bbbc-e416cd3a7d22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:06.618559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2d5d6e41-e636-42b6-bbbc-e416cd3a7d22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:06.633472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d5d6e41-e636-42b6-bbbc-e416cd3a7d22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.642580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d5d6e41-e636-42b6-bbbc-e416cd3a7d22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.643757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d5d6e41-e636-42b6-bbbc-e416cd3a7d22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.644382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d5d6e41-e636-42b6-bbbc-e416cd3a7d22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.846717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7ad607cf-8d71-4614-bf43-68f8670db2b2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.870346 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7ad607cf-8d71-4614-bf43-68f8670db2b2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.522794 Jul 20 04:18:06.875020 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1128/2170] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:06 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:06.897786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2f301c8a-a1f6-4b1b-b489-4b1367bff84c req-6c39bd84-fb2e-402e-950f-a8a7605f3e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838c7de4-25f3-481a-b89f-6562178ccce0", "name": "network-vif-unplugged", "status": "completed", "tag": "64e34bf8-7b7e-45eb-acd2-804013d49abe"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:06.933336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2f301c8a-a1f6-4b1b-b489-4b1367bff84c req-6c39bd84-fb2e-402e-950f-a8a7605f3e15 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.937139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2f301c8a-a1f6-4b1b-b489-4b1367bff84c req-6c39bd84-fb2e-402e-950f-a8a7605f3e15 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.965238 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2f301c8a-a1f6-4b1b-b489-4b1367bff84c req-6c39bd84-fb2e-402e-950f-a8a7605f3e15 service nova] Creating event network-vif-unplugged:64e34bf8-7b7e-45eb-acd2-804013d49abe for instance 838c7de4-25f3-481a-b89f-6562178ccce0 on n-h1-764485-11 Jul 20 04:18:06.972518 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2f301c8a-a1f6-4b1b-b489-4b1367bff84c req-6c39bd84-fb2e-402e-950f-a8a7605f3e15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094926 Jul 20 04:18:06.975070 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1129/2171] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:07.005338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2d5d6e41-e636-42b6-bbbc-e416cd3a7d22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.019407 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2d5d6e41-e636-42b6-bbbc-e416cd3a7d22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.413031 Jul 20 04:18:07.032409 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1043/2172] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:06 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:07.204872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-45faa614-a844-4cfc-86c0-53ddc446c4ca tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.206677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-45faa614-a844-4cfc-86c0-53ddc446c4ca tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:07.228525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45faa614-a844-4cfc-86c0-53ddc446c4ca tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.229473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45faa614-a844-4cfc-86c0-53ddc446c4ca tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.230548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45faa614-a844-4cfc-86c0-53ddc446c4ca tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.233097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45faa614-a844-4cfc-86c0-53ddc446c4ca tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.310009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-04743617-36c5-4f3a-8dc4-fffdb98b8388 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d0cf430>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.401241 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-04743617-36c5-4f3a-8dc4-fffdb98b8388 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.096738 Jul 20 04:18:07.410000 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1044/2173] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:07.416074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-352425cf-5583-4836-9d82-eb6445109c29 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.419196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-352425cf-5583-4836-9d82-eb6445109c29 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:07.455904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-352425cf-5583-4836-9d82-eb6445109c29 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.456466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-352425cf-5583-4836-9d82-eb6445109c29 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.458514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-352425cf-5583-4836-9d82-eb6445109c29 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.459215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-352425cf-5583-4836-9d82-eb6445109c29 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.645238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-352425cf-5583-4836-9d82-eb6445109c29 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.651934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:07.663097 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-352425cf-5583-4836-9d82-eb6445109c29 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1466 microversion: 2.1 time: 0.248152 Jul 20 04:18:07.665943 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1045/2174] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1466 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:07.681486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ccb1c59-d15c-4813-8023-7aeb43deb705 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.682508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ccb1c59-d15c-4813-8023-7aeb43deb705 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:07.690293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ccb1c59-d15c-4813-8023-7aeb43deb705 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.691150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ccb1c59-d15c-4813-8023-7aeb43deb705 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.692393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ccb1c59-d15c-4813-8023-7aeb43deb705 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.693124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ccb1c59-d15c-4813-8023-7aeb43deb705 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.735892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-45faa614-a844-4cfc-86c0-53ddc446c4ca tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.751118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-45faa614-a844-4cfc-86c0-53ddc446c4ca tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.754004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-45faa614-a844-4cfc-86c0-53ddc446c4ca tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.756735 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-45faa614-a844-4cfc-86c0-53ddc446c4ca tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.557443 Jul 20 04:18:07.773795 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1130/2175] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:07.846247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ccb1c59-d15c-4813-8023-7aeb43deb705 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.860019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ccb1c59-d15c-4813-8023-7aeb43deb705 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.862005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ccb1c59-d15c-4813-8023-7aeb43deb705 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.869216 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ccb1c59-d15c-4813-8023-7aeb43deb705 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.192430 Jul 20 04:18:07.885179 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1046/2176] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:07.894640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6803674-133c-43b4-a2ec-abe59741c39c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.898190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f6803674-133c-43b4-a2ec-abe59741c39c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:07.909578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6803674-133c-43b4-a2ec-abe59741c39c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.910734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6803674-133c-43b4-a2ec-abe59741c39c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.912517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6803674-133c-43b4-a2ec-abe59741c39c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.913345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6803674-133c-43b4-a2ec-abe59741c39c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.994297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c009c0d2-4719-43b6-aec2-bd303d4da136 req-f8700e19-fa0f-486b-945f-93095be6b7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a749b53d-cbac-4db3-9cbf-6ef098f37cd8", "name": "network-vif-deleted", "tag": "8db84d6a-e65e-407f-b791-d9e906efb840"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:08.032995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c009c0d2-4719-43b6-aec2-bd303d4da136 req-f8700e19-fa0f-486b-945f-93095be6b7b0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.033447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c009c0d2-4719-43b6-aec2-bd303d4da136 req-f8700e19-fa0f-486b-945f-93095be6b7b0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.104773 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c009c0d2-4719-43b6-aec2-bd303d4da136 req-f8700e19-fa0f-486b-945f-93095be6b7b0 service nova] Creating event network-vif-deleted:8db84d6a-e65e-407f-b791-d9e906efb840 for instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 on n-h2-764485-11 Jul 20 04:18:08.120857 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c009c0d2-4719-43b6-aec2-bd303d4da136 req-f8700e19-fa0f-486b-945f-93095be6b7b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137949 Jul 20 04:18:08.123683 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1047/2177] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:08.141608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9b009a66-a650-4d0b-8b41-fb14dec12bc1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:08.145379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9b009a66-a650-4d0b-8b41-fb14dec12bc1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.163094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b009a66-a650-4d0b-8b41-fb14dec12bc1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.163927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b009a66-a650-4d0b-8b41-fb14dec12bc1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.164969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b009a66-a650-4d0b-8b41-fb14dec12bc1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.167063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b009a66-a650-4d0b-8b41-fb14dec12bc1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.245837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f6803674-133c-43b4-a2ec-abe59741c39c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.258511 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f6803674-133c-43b4-a2ec-abe59741c39c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.369560 Jul 20 04:18:08.273056 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1131/2178] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:08.417764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ae39844f-dad1-46ed-964e-968025317c21 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d1491f0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:08.495311 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ae39844f-dad1-46ed-964e-968025317c21 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.082734 Jul 20 04:18:08.500864 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1132/2179] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:08 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:08.605384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9b009a66-a650-4d0b-8b41-fb14dec12bc1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.618456 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9b009a66-a650-4d0b-8b41-fb14dec12bc1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.491999 Jul 20 04:18:08.639269 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1048/2180] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:08 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:08.682782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-30f89d17-5ff7-42df-9e73-9d516cefc7f8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:08.683735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-30f89d17-5ff7-42df-9e73-9d516cefc7f8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.709730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30f89d17-5ff7-42df-9e73-9d516cefc7f8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.710289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30f89d17-5ff7-42df-9e73-9d516cefc7f8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.713329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30f89d17-5ff7-42df-9e73-9d516cefc7f8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.713799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30f89d17-5ff7-42df-9e73-9d516cefc7f8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.783190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-478ca84c-78a1-4595-9557-baa26f82d25b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:08.783849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-478ca84c-78a1-4595-9557-baa26f82d25b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.807876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-478ca84c-78a1-4595-9557-baa26f82d25b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.808363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-478ca84c-78a1-4595-9557-baa26f82d25b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.809202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-478ca84c-78a1-4595-9557-baa26f82d25b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.809859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-478ca84c-78a1-4595-9557-baa26f82d25b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.820453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30f89d17-5ff7-42df-9e73-9d516cefc7f8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.820918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30f89d17-5ff7-42df-9e73-9d516cefc7f8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.821387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-30f89d17-5ff7-42df-9e73-9d516cefc7f8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lazy-loading 'fault' on Instance uuid a749b53d-cbac-4db3-9cbf-6ef098f37cd8 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:08.919855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-30f89d17-5ff7-42df-9e73-9d516cefc7f8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.937750 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-30f89d17-5ff7-42df-9e73-9d516cefc7f8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 200 len: 1305 microversion: 2.1 time: 0.259215 Jul 20 04:18:08.941411 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1133/2181] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:08 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 1305 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:08.948786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3dd4a227-d3b1-4f6c-b864-778fe1963b0d tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:08.964258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3dd4a227-d3b1-4f6c-b864-778fe1963b0d tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.983154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3dd4a227-d3b1-4f6c-b864-778fe1963b0d tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.984068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3dd4a227-d3b1-4f6c-b864-778fe1963b0d tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.985120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3dd4a227-d3b1-4f6c-b864-778fe1963b0d tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.987256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3dd4a227-d3b1-4f6c-b864-778fe1963b0d tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.171918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3dd4a227-d3b1-4f6c-b864-778fe1963b0d tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.174241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:09.186771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-478ca84c-78a1-4595-9557-baa26f82d25b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.195769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-478ca84c-78a1-4595-9557-baa26f82d25b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.197574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-478ca84c-78a1-4595-9557-baa26f82d25b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.199783 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-478ca84c-78a1-4595-9557-baa26f82d25b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.422144 Jul 20 04:18:09.202063 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1049/2182] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:08 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:09.208824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3dd4a227-d3b1-4f6c-b864-778fe1963b0d tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.210831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3dd4a227-d3b1-4f6c-b864-778fe1963b0d tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.221596 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3dd4a227-d3b1-4f6c-b864-778fe1963b0d tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.277071 Jul 20 04:18:09.223638 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1134/2183] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:08 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:09.282831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7258773d-f9ec-42c0-9ae4-c5db8bf3d5a2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.283964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7258773d-f9ec-42c0-9ae4-c5db8bf3d5a2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:09.302810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7258773d-f9ec-42c0-9ae4-c5db8bf3d5a2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.303376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7258773d-f9ec-42c0-9ae4-c5db8bf3d5a2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.304277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7258773d-f9ec-42c0-9ae4-c5db8bf3d5a2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.304791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7258773d-f9ec-42c0-9ae4-c5db8bf3d5a2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.516069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-229cf28b-50fd-49d2-96f1-3a577efaea31 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa281ad30>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.518476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7258773d-f9ec-42c0-9ae4-c5db8bf3d5a2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.529636 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7258773d-f9ec-42c0-9ae4-c5db8bf3d5a2 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.251202 Jul 20 04:18:09.530906 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1050/2184] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:09.629498 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-229cf28b-50fd-49d2-96f1-3a577efaea31 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.118948 Jul 20 04:18:09.630634 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1135/2185] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:09.658708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c6c4945c-a133-4c3a-b641-e29295283f72 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.660459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c6c4945c-a133-4c3a-b641-e29295283f72 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:09.674962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c6c4945c-a133-4c3a-b641-e29295283f72 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.677368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c6c4945c-a133-4c3a-b641-e29295283f72 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.680578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c6c4945c-a133-4c3a-b641-e29295283f72 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.682275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c6c4945c-a133-4c3a-b641-e29295283f72 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.896165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c6c4945c-a133-4c3a-b641-e29295283f72 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.912378 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c6c4945c-a133-4c3a-b641-e29295283f72 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.257891 Jul 20 04:18:09.914563 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1051/2186] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:09.975746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ae7f474-11f5-46ae-9657-8dc3af520bb6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.977563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8ae7f474-11f5-46ae-9657-8dc3af520bb6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:09.992659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ae7f474-11f5-46ae-9657-8dc3af520bb6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.009042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ae7f474-11f5-46ae-9657-8dc3af520bb6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.012577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ae7f474-11f5-46ae-9657-8dc3af520bb6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.014063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ae7f474-11f5-46ae-9657-8dc3af520bb6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.055322 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-8ae7f474-11f5-46ae-9657-8dc3af520bb6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ae7f474-11f5-46ae-9657-8dc3af520bb6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 HTTP/1.1 Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a749b53d-cbac-4db3-9cbf-6ef098f37cd8'} Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:10.058231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:10.071197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:10.071197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:10.071197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:10.071197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:10.071197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:10.071197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:10.071197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:10.074898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ae7f474-11f5-46ae-9657-8dc3af520bb6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:10.077152 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8ae7f474-11f5-46ae-9657-8dc3af520bb6 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 404 len: 111 microversion: 2.1 time: 0.123304 Jul 20 04:18:10.078797 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1136/2187] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:10.087378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f273f9e7-28c3-457b-9cbe-00b7fee6360d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d08fc10>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.224122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e0f1cc88-6dde-4ed5-9595-0aab74e32c5a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.225854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e0f1cc88-6dde-4ed5-9595-0aab74e32c5a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.253527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0f1cc88-6dde-4ed5-9595-0aab74e32c5a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.255122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0f1cc88-6dde-4ed5-9595-0aab74e32c5a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.260472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0f1cc88-6dde-4ed5-9595-0aab74e32c5a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.261839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0f1cc88-6dde-4ed5-9595-0aab74e32c5a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.564513 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f273f9e7-28c3-457b-9cbe-00b7fee6360d tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b205b394-2633-498a-a94a-104535598b66" status: 202 len: 0 microversion: 2.1 time: 0.481117 Jul 20 04:18:10.566421 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1052/2188] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:18:10 2022] DELETE /compute/v2.1/os-security-groups/b205b394-2633-498a-a94a-104535598b66 => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:10.572143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bc223fdf-5f32-4131-9fa0-f5d75d26ab86 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.573830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bc223fdf-5f32-4131-9fa0-f5d75d26ab86 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.583322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc223fdf-5f32-4131-9fa0-f5d75d26ab86 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.584855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc223fdf-5f32-4131-9fa0-f5d75d26ab86 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.586631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc223fdf-5f32-4131-9fa0-f5d75d26ab86 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.587284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc223fdf-5f32-4131-9fa0-f5d75d26ab86 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.741375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e0f1cc88-6dde-4ed5-9595-0aab74e32c5a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.745187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bc223fdf-5f32-4131-9fa0-f5d75d26ab86 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.752669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e0f1cc88-6dde-4ed5-9595-0aab74e32c5a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.754447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e0f1cc88-6dde-4ed5-9595-0aab74e32c5a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.760495 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e0f1cc88-6dde-4ed5-9595-0aab74e32c5a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.542145 Jul 20 04:18:10.761628 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1137/2189] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:10.775436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d57f21ac-9722-43c1-b29b-41f129a4d792 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.777158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d57f21ac-9722-43c1-b29b-41f129a4d792 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.777608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bc223fdf-5f32-4131-9fa0-f5d75d26ab86 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.785530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d57f21ac-9722-43c1-b29b-41f129a4d792 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.786291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d57f21ac-9722-43c1-b29b-41f129a4d792 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.787598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d57f21ac-9722-43c1-b29b-41f129a4d792 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.788395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d57f21ac-9722-43c1-b29b-41f129a4d792 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.803906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bc223fdf-5f32-4131-9fa0-f5d75d26ab86 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.839091 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bc223fdf-5f32-4131-9fa0-f5d75d26ab86 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.271276 Jul 20 04:18:10.840091 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1053/2190] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:10.849028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-21e510be-5564-499a-8852-dbf9caf3c09b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d0a09d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.448914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d57f21ac-9722-43c1-b29b-41f129a4d792 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.457665 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d57f21ac-9722-43c1-b29b-41f129a4d792 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1393 microversion: 2.1 time: 0.694815 Jul 20 04:18:11.460663 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1138/2191] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1393 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:11.481808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-42f05c72-6429-47f6-b310-a5f72af172df tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d168160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.552196 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-42f05c72-6429-47f6-b310-a5f72af172df tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.084309 Jul 20 04:18:11.553003 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1139/2192] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:11 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:11.593704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-420f5704-4a1b-4d32-9c39-84137169e110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.595180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-420f5704-4a1b-4d32-9c39-84137169e110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:11.608270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-420f5704-4a1b-4d32-9c39-84137169e110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.609247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-420f5704-4a1b-4d32-9c39-84137169e110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.610370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-420f5704-4a1b-4d32-9c39-84137169e110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.611063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-420f5704-4a1b-4d32-9c39-84137169e110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.623767 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-21e510be-5564-499a-8852-dbf9caf3c09b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b3903075-9565-4553-ac85-c8de0cd61d20" status: 202 len: 0 microversion: 2.1 time: 0.782536 Jul 20 04:18:11.624366 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1054/2193] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:18:10 2022] DELETE /compute/v2.1/os-security-groups/b3903075-9565-4553-ac85-c8de0cd61d20 => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:11.635375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8a050d24-4d80-4864-9736-12b100448eba tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'create', calling method: .version_select at 0x7fbf9d0a0160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1021294941", "description": "tempest-description-1942742386"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:11.936983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-420f5704-4a1b-4d32-9c39-84137169e110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.958817 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-420f5704-4a1b-4d32-9c39-84137169e110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.392319 Jul 20 04:18:11.963546 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1140/2194] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:11 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:11.981180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2c3a41a8-c737-49c5-847e-f5cce21c2f71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.982252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2c3a41a8-c737-49c5-847e-f5cce21c2f71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:11.997029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c3a41a8-c737-49c5-847e-f5cce21c2f71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.997851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c3a41a8-c737-49c5-847e-f5cce21c2f71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.998814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c3a41a8-c737-49c5-847e-f5cce21c2f71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.999421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c3a41a8-c737-49c5-847e-f5cce21c2f71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.039569 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8a050d24-4d80-4864-9736-12b100448eba tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.407030 Jul 20 04:18:12.040887 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1055/2195] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:18:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:12.048143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dddc745a-0bd3-4941-9f2b-cd271b118d46 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:12.049401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dddc745a-0bd3-4941-9f2b-cd271b118d46 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:12.066657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dddc745a-0bd3-4941-9f2b-cd271b118d46 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.069971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dddc745a-0bd3-4941-9f2b-cd271b118d46 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.078069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dddc745a-0bd3-4941-9f2b-cd271b118d46 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.080350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dddc745a-0bd3-4941-9f2b-cd271b118d46 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.364252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dddc745a-0bd3-4941-9f2b-cd271b118d46 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.382640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dddc745a-0bd3-4941-9f2b-cd271b118d46 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.388854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dddc745a-0bd3-4941-9f2b-cd271b118d46 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.408678 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dddc745a-0bd3-4941-9f2b-cd271b118d46 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.366314 Jul 20 04:18:12.411546 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1056/2196] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:12 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:12.432743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a83912b1-e73a-4f0d-8765-4480b9337419 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Action: 'update', calling method: .version_select at 0x7fbf9d0a0670>, body: {"security_group": {"name": "tempest-sg-hth-1379377302", "description": "tempest-description-hth-1985941483"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:12.571409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c3a41a8-c737-49c5-847e-f5cce21c2f71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.589568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c3a41a8-c737-49c5-847e-f5cce21c2f71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.591137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c3a41a8-c737-49c5-847e-f5cce21c2f71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.597311 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2c3a41a8-c737-49c5-847e-f5cce21c2f71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.621171 Jul 20 04:18:12.600652 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1141/2197] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:11 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:12.620757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-261110f6-fb82-4229-aaec-b2b99bdeafe3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:12.621389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-261110f6-fb82-4229-aaec-b2b99bdeafe3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:12.643859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-261110f6-fb82-4229-aaec-b2b99bdeafe3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.644223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-261110f6-fb82-4229-aaec-b2b99bdeafe3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.645008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-261110f6-fb82-4229-aaec-b2b99bdeafe3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.645447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-261110f6-fb82-4229-aaec-b2b99bdeafe3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.089659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-261110f6-fb82-4229-aaec-b2b99bdeafe3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.105152 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-261110f6-fb82-4229-aaec-b2b99bdeafe3 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1383 microversion: 2.1 time: 0.499705 Jul 20 04:18:13.107071 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1142/2198] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:12 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1383 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:13.118764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7c7976c8-6fee-4440-a8dc-30749f7aad58 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d168c10>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.136266 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a83912b1-e73a-4f0d-8765-4480b9337419 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/6b52ea77-2cb1-4215-8f33-35f59e6426fd" status: 200 len: 218 microversion: 2.1 time: 0.709542 Jul 20 04:18:13.137253 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1057/2199] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Jul 20 04:18:12 2022] PUT /compute/v2.1/os-security-groups/6b52ea77-2cb1-4215-8f33-35f59e6426fd => generated 218 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:13.143532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d9f65d73-fe99-459d-a548-c35e66d0e266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.144169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d9f65d73-fe99-459d-a548-c35e66d0e266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:13.160391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9f65d73-fe99-459d-a548-c35e66d0e266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.160854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9f65d73-fe99-459d-a548-c35e66d0e266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.161665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9f65d73-fe99-459d-a548-c35e66d0e266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.162114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9f65d73-fe99-459d-a548-c35e66d0e266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.243162 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7c7976c8-6fee-4440-a8dc-30749f7aad58 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.134123 Jul 20 04:18:13.244153 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1143/2200] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:13.254311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3528828c-f42d-4d3c-845e-221871851571 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '.version_select at 0x7fbfa27a4af0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.258503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3528828c-f42d-4d3c-845e-221871851571 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.270362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3528828c-f42d-4d3c-845e-221871851571 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.335463 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3528828c-f42d-4d3c-845e-221871851571 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2345 microversion: 2.1 time: 0.090000 Jul 20 04:18:13.346052 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1144/2201] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/os-migrations => generated 2345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:13.367986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cdbd4b77-29bb-4eb6-94e8-9284b0f9e7e3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d168af0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.386037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d9f65d73-fe99-459d-a548-c35e66d0e266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.406418 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d9f65d73-fe99-459d-a548-c35e66d0e266 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.267606 Jul 20 04:18:13.407030 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1058/2202] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:13.419119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c733b833-11a0-41e2-bdf5-22cd0ccec8d6 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.421503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c733b833-11a0-41e2-bdf5-22cd0ccec8d6 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:13.437646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c733b833-11a0-41e2-bdf5-22cd0ccec8d6 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.438410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c733b833-11a0-41e2-bdf5-22cd0ccec8d6 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.440779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c733b833-11a0-41e2-bdf5-22cd0ccec8d6 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.441472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c733b833-11a0-41e2-bdf5-22cd0ccec8d6 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.566561 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cdbd4b77-29bb-4eb6-94e8-9284b0f9e7e3 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/6b52ea77-2cb1-4215-8f33-35f59e6426fd" status: 200 len: 218 microversion: 2.1 time: 0.209795 Jul 20 04:18:13.567161 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1145/2203] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/os-security-groups/6b52ea77-2cb1-4215-8f33-35f59e6426fd => generated 218 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:13.582297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a1400bdb-9b28-4abd-bb01-3beaff511078 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.582975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a1400bdb-9b28-4abd-bb01-3beaff511078 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:13.617093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1400bdb-9b28-4abd-bb01-3beaff511078 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.617576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1400bdb-9b28-4abd-bb01-3beaff511078 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.618390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1400bdb-9b28-4abd-bb01-3beaff511078 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.618834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1400bdb-9b28-4abd-bb01-3beaff511078 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.630174 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c733b833-11a0-41e2-bdf5-22cd0ccec8d6 tempest-LiveMigrationTest-1231296672 tempest-LiveMigrationTest-1231296672-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1536 microversion: 2.1 time: 0.221941 Jul 20 04:18:13.630979 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1059/2204] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1536 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:13.636163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-79ce484d-8481-4d3d-8a5d-e5058bf06d22 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d0f59d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.808444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a1400bdb-9b28-4abd-bb01-3beaff511078 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.821627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a1400bdb-9b28-4abd-bb01-3beaff511078 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.823727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a1400bdb-9b28-4abd-bb01-3beaff511078 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.838152 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a1400bdb-9b28-4abd-bb01-3beaff511078 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.261037 Jul 20 04:18:13.839713 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1146/2205] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:13.859456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7643a008-78a8-4ca3-8cbd-6fee13ce30ef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.860827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7643a008-78a8-4ca3-8cbd-6fee13ce30ef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:13.870507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7643a008-78a8-4ca3-8cbd-6fee13ce30ef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.871403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7643a008-78a8-4ca3-8cbd-6fee13ce30ef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.873638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7643a008-78a8-4ca3-8cbd-6fee13ce30ef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.874547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7643a008-78a8-4ca3-8cbd-6fee13ce30ef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.145335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7643a008-78a8-4ca3-8cbd-6fee13ce30ef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.178720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7643a008-78a8-4ca3-8cbd-6fee13ce30ef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.181555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7643a008-78a8-4ca3-8cbd-6fee13ce30ef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.192121 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7643a008-78a8-4ca3-8cbd-6fee13ce30ef tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.350314 Jul 20 04:18:14.192987 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1147/2206] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:14.198334 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-79ce484d-8481-4d3d-8a5d-e5058bf06d22 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/6b52ea77-2cb1-4215-8f33-35f59e6426fd" status: 202 len: 0 microversion: 2.1 time: 0.565850 Jul 20 04:18:14.199709 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1060/2207] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:18:13 2022] DELETE /compute/v2.1/os-security-groups/6b52ea77-2cb1-4215-8f33-35f59e6426fd => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:14.207460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-523472ae-1908-431b-be1f-45c8e8806269 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.208312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-523472ae-1908-431b-be1f-45c8e8806269 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.214244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9265b78-409f-45bd-aa4b-eb7d6715a924 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.215093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e9265b78-409f-45bd-aa4b-eb7d6715a924 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.235133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:14.243663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9265b78-409f-45bd-aa4b-eb7d6715a924 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.244050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-523472ae-1908-431b-be1f-45c8e8806269 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.247015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9265b78-409f-45bd-aa4b-eb7d6715a924 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.247834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-523472ae-1908-431b-be1f-45c8e8806269 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.248950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9265b78-409f-45bd-aa4b-eb7d6715a924 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.252128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-523472ae-1908-431b-be1f-45c8e8806269 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.252929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9265b78-409f-45bd-aa4b-eb7d6715a924 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.254498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-523472ae-1908-431b-be1f-45c8e8806269 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.299999 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e9265b78-409f-45bd-aa4b-eb7d6715a924 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9265b78-409f-45bd-aa4b-eb7d6715a924 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 HTTP/1.1 Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a749b53d-cbac-4db3-9cbf-6ef098f37cd8'} Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:14.303711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:14.308129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:14.308129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.308129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.308129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.308129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.308129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:14.308129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:14.308129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:14.308129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:14.308129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:14.308129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.316376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9265b78-409f-45bd-aa4b-eb7d6715a924 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:14.317598 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e9265b78-409f-45bd-aa4b-eb7d6715a924 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 404 len: 111 microversion: 2.1 time: 0.107781 Jul 20 04:18:14.321157 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1061/2208] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:14 2022] DELETE /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:14.330724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0875512c-8f50-4177-84b2-a4e62e31e8c3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d0f5b80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.331732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-523472ae-1908-431b-be1f-45c8e8806269 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:14.424609 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0875512c-8f50-4177-84b2-a4e62e31e8c3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.101543 Jul 20 04:18:14.425702 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1062/2209] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:14.443178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-be56d7bd-1754-4aab-b0e2-82be563368d8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.445413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-be56d7bd-1754-4aab-b0e2-82be563368d8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: a749b53d-cbac-4db3-9cbf-6ef098f37cd8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.457142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be56d7bd-1754-4aab-b0e2-82be563368d8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.457905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be56d7bd-1754-4aab-b0e2-82be563368d8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.459041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be56d7bd-1754-4aab-b0e2-82be563368d8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.459781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be56d7bd-1754-4aab-b0e2-82be563368d8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.490779 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-be56d7bd-1754-4aab-b0e2-82be563368d8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-be56d7bd-1754-4aab-b0e2-82be563368d8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 HTTP/1.1 Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a749b53d-cbac-4db3-9cbf-6ef098f37cd8'} Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.495924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.505169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.505169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:14.505169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:14.505169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:14.505169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:14.505169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. Jul 20 04:18:14.505169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.507105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-be56d7bd-1754-4aab-b0e2-82be563368d8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Instance a749b53d-cbac-4db3-9cbf-6ef098f37cd8 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:14.509337 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-be56d7bd-1754-4aab-b0e2-82be563368d8 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8" status: 404 len: 111 microversion: 2.1 time: 0.082345 Jul 20 04:18:14.514891 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1063/2210] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/servers/a749b53d-cbac-4db3-9cbf-6ef098f37cd8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:14.520586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8f342e88-6756-403f-9ef1-cd310547ffbc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.521551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8f342e88-6756-403f-9ef1-cd310547ffbc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.528978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f342e88-6756-403f-9ef1-cd310547ffbc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.529733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f342e88-6756-403f-9ef1-cd310547ffbc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.530771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f342e88-6756-403f-9ef1-cd310547ffbc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.531439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f342e88-6756-403f-9ef1-cd310547ffbc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.568365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:14.575751 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-523472ae-1908-431b-be1f-45c8e8806269 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "DELETE /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 204 len: 0 microversion: 2.1 time: 0.379712 Jul 20 04:18:14.582996 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1148/2211] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:14 2022] DELETE /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:14.596442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9f9fa3b-408b-4127-a7b3-c2776d0bea1b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbfa281ac10>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.638266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG neutronclient.v2_0.client [None req-a9f9fa3b-408b-4127-a7b3-c2776d0bea1b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b3903075-9565-4553-ac85-c8de0cd61d20 does not exist", "detail": ""}} {{(pid=119808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:18:14.639162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.security_group_api [None req-a9f9fa3b-408b-4127-a7b3-c2776d0bea1b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Neutron security group b3903075-9565-4553-ac85-c8de0cd61d20 not found {{(pid=119808) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:18:14.640258 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-a9f9fa3b-408b-4127-a7b3-c2776d0bea1b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Security group b3903075-9565-4553-ac85-c8de0cd61d20 does not exist Jul 20 04:18:14.640258 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-b1701334-3ba2-4487-a372-9a4d800b38d7'] Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9f9fa3b-408b-4127-a7b3-c2776d0bea1b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-security-groups/b3903075-9565-4553-ac85-c8de0cd61d20 HTTP/1.1 Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: exception: Security group b3903075-9565-4553-ac85-c8de0cd61d20 does not exist Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-b1701334-3ba2-4487-a372-9a4d800b38d7'] Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'b3903075-9565-4553-ac85-c8de0cd61d20'} Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:18:14.643250 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b3903075-9565-4553-ac85-c8de0cd61d20 does not exist Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1701334-3ba2-4487-a372-9a4d800b38d7'] Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b3903075-9565-4553-ac85-c8de0cd61d20 does not exist Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1701334-3ba2-4487-a372-9a4d800b38d7'] Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b3903075-9565-4553-ac85-c8de0cd61d20 does not exist Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1701334-3ba2-4487-a372-9a4d800b38d7'] Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b3903075-9565-4553-ac85-c8de0cd61d20 does not exist Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1701334-3ba2-4487-a372-9a4d800b38d7'] Jul 20 04:18:14.648725 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:14.653072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9f9fa3b-408b-4127-a7b3-c2776d0bea1b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Security group b3903075-9565-4553-ac85-c8de0cd61d20 does not exist Jul 20 04:18:14.653072 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-b1701334-3ba2-4487-a372-9a4d800b38d7'] {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:14.654273 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a9f9fa3b-408b-4127-a7b3-c2776d0bea1b tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b3903075-9565-4553-ac85-c8de0cd61d20" status: 404 len: 194 microversion: 2.1 time: 0.069259 Jul 20 04:18:14.655459 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1149/2212] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:18:14 2022] DELETE /compute/v2.1/os-security-groups/b3903075-9565-4553-ac85-c8de0cd61d20 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:14.676355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e580799a-e768-4c8e-95c0-f31fa4dee390 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.677379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e580799a-e768-4c8e-95c0-f31fa4dee390 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.696871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e580799a-e768-4c8e-95c0-f31fa4dee390 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.697918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e580799a-e768-4c8e-95c0-f31fa4dee390 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.699401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e580799a-e768-4c8e-95c0-f31fa4dee390 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.702320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e580799a-e768-4c8e-95c0-f31fa4dee390 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.937598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8f342e88-6756-403f-9ef1-cd310547ffbc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.951675 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8f342e88-6756-403f-9ef1-cd310547ffbc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.430216 Jul 20 04:18:14.952688 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1064/2213] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:14.963750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cb7f4de0-0f62-4331-97e5-2c5935dd884e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d1b0820>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.995821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e580799a-e768-4c8e-95c0-f31fa4dee390 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.016455 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e580799a-e768-4c8e-95c0-f31fa4dee390 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1389 microversion: 2.1 time: 0.352163 Jul 20 04:18:15.019139 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1150/2214] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1389 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:15.026985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-494e0347-f877-4d60-8e8e-6cd8eccfd537 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.031822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-494e0347-f877-4d60-8e8e-6cd8eccfd537 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:15.049782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-494e0347-f877-4d60-8e8e-6cd8eccfd537 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.052097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-cb7f4de0-0f62-4331-97e5-2c5935dd884e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b205b394-2633-498a-a94a-104535598b66 does not exist", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:18:15.053245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.security_group_api [None req-cb7f4de0-0f62-4331-97e5-2c5935dd884e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Neutron security group b205b394-2633-498a-a94a-104535598b66 not found {{(pid=119807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:18:15.054006 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-cb7f4de0-0f62-4331-97e5-2c5935dd884e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Security group b205b394-2633-498a-a94a-104535598b66 does not exist Jul 20 04:18:15.054006 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-855e6ed0-5055-4f22-8103-7410ec9a8df2'] Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cb7f4de0-0f62-4331-97e5-2c5935dd884e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-security-groups/b205b394-2633-498a-a94a-104535598b66 HTTP/1.1 Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: exception: Security group b205b394-2633-498a-a94a-104535598b66 does not exist Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-855e6ed0-5055-4f22-8103-7410ec9a8df2'] Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'b205b394-2633-498a-a94a-104535598b66'} Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:18:15.056328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b205b394-2633-498a-a94a-104535598b66 does not exist Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-855e6ed0-5055-4f22-8103-7410ec9a8df2'] Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b205b394-2633-498a-a94a-104535598b66 does not exist Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-855e6ed0-5055-4f22-8103-7410ec9a8df2'] Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b205b394-2633-498a-a94a-104535598b66 does not exist Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-855e6ed0-5055-4f22-8103-7410ec9a8df2'] Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b205b394-2633-498a-a94a-104535598b66 does not exist Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-855e6ed0-5055-4f22-8103-7410ec9a8df2'] Jul 20 04:18:15.065215 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.076542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cb7f4de0-0f62-4331-97e5-2c5935dd884e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Security group b205b394-2633-498a-a94a-104535598b66 does not exist Jul 20 04:18:15.076542 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-855e6ed0-5055-4f22-8103-7410ec9a8df2'] {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:15.076542 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cb7f4de0-0f62-4331-97e5-2c5935dd884e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b205b394-2633-498a-a94a-104535598b66" status: 404 len: 194 microversion: 2.1 time: 0.119792 Jul 20 04:18:15.078301 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1065/2215] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:18:14 2022] DELETE /compute/v2.1/os-security-groups/b205b394-2633-498a-a94a-104535598b66 => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:15.084991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-494e0347-f877-4d60-8e8e-6cd8eccfd537 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.087676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-494e0347-f877-4d60-8e8e-6cd8eccfd537 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.088903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d00526ef-9094-4880-a4f1-340eceb67b9c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d08fd30>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.090166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-494e0347-f877-4d60-8e8e-6cd8eccfd537 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.154756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-d00526ef-9094-4880-a4f1-340eceb67b9c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:18:15.154756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.security_group_api [None req-d00526ef-9094-4880-a4f1-340eceb67b9c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Neutron security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 not found {{(pid=119807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:18:15.154756 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-d00526ef-9094-4880-a4f1-340eceb67b9c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:18:15.154756 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-9e8e07cc-dcd7-4a25-b9c0-da393e64cf7b'] Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d00526ef-9094-4880-a4f1-340eceb67b9c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-security-groups/3ba96a68-db31-498a-adc5-1eace4ea6b23 HTTP/1.1 Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: exception: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-9e8e07cc-dcd7-4a25-b9c0-da393e64cf7b'] Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '3ba96a68-db31-498a-adc5-1eace4ea6b23'} Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:18:15.156370 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e8e07cc-dcd7-4a25-b9c0-da393e64cf7b'] Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e8e07cc-dcd7-4a25-b9c0-da393e64cf7b'] Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e8e07cc-dcd7-4a25-b9c0-da393e64cf7b'] Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e8e07cc-dcd7-4a25-b9c0-da393e64cf7b'] Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d00526ef-9094-4880-a4f1-340eceb67b9c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Security group 3ba96a68-db31-498a-adc5-1eace4ea6b23 does not exist Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-9e8e07cc-dcd7-4a25-b9c0-da393e64cf7b'] {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:15.160729 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d00526ef-9094-4880-a4f1-340eceb67b9c tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/3ba96a68-db31-498a-adc5-1eace4ea6b23" status: 404 len: 194 microversion: 2.1 time: 0.078304 Jul 20 04:18:15.168763 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1066/2216] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:18:15 2022] DELETE /compute/v2.1/os-security-groups/3ba96a68-db31-498a-adc5-1eace4ea6b23 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:15.186257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-01e11cf1-8d6c-4df4-9b89-5dbab9a5c4dd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbf9d1b0820>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.233789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-01e11cf1-8d6c-4df4-9b89-5dbab9a5c4dd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:18:15.234379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.security_group_api [None req-01e11cf1-8d6c-4df4-9b89-5dbab9a5c4dd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Neutron security group bd21ca98-93ee-4209-bd02-f964df9512ed not found {{(pid=119807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:18:15.234901 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-01e11cf1-8d6c-4df4-9b89-5dbab9a5c4dd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:18:15.234901 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-49d64502-2d17-43ae-90b7-c9cc432dc4ee'] Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-01e11cf1-8d6c-4df4-9b89-5dbab9a5c4dd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-security-groups/bd21ca98-93ee-4209-bd02-f964df9512ed HTTP/1.1 Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: exception: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-49d64502-2d17-43ae-90b7-c9cc432dc4ee'] Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'bd21ca98-93ee-4209-bd02-f964df9512ed'} Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:18:15.241965 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49d64502-2d17-43ae-90b7-c9cc432dc4ee'] Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49d64502-2d17-43ae-90b7-c9cc432dc4ee'] Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49d64502-2d17-43ae-90b7-c9cc432dc4ee'] Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49d64502-2d17-43ae-90b7-c9cc432dc4ee'] Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-01e11cf1-8d6c-4df4-9b89-5dbab9a5c4dd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Security group bd21ca98-93ee-4209-bd02-f964df9512ed does not exist Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: Neutron server returns request_ids: ['req-49d64502-2d17-43ae-90b7-c9cc432dc4ee'] {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-01e11cf1-8d6c-4df4-9b89-5dbab9a5c4dd tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/bd21ca98-93ee-4209-bd02-f964df9512ed" status: 404 len: 194 microversion: 2.1 time: 0.076833 Jul 20 04:18:15.247382 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1067/2217] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:18:15 2022] DELETE /compute/v2.1/os-security-groups/bd21ca98-93ee-4209-bd02-f964df9512ed => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:15.260514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aad7baa7-e7ff-4e73-814c-5a4a53a26286 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.261191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aad7baa7-e7ff-4e73-814c-5a4a53a26286 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:15.286440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aad7baa7-e7ff-4e73-814c-5a4a53a26286 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.287224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aad7baa7-e7ff-4e73-814c-5a4a53a26286 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.288248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aad7baa7-e7ff-4e73-814c-5a4a53a26286 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.292548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aad7baa7-e7ff-4e73-814c-5a4a53a26286 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.325536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-494e0347-f877-4d60-8e8e-6cd8eccfd537 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.339188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-494e0347-f877-4d60-8e8e-6cd8eccfd537 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.350279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-494e0347-f877-4d60-8e8e-6cd8eccfd537 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.370917 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-494e0347-f877-4d60-8e8e-6cd8eccfd537 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.349953 Jul 20 04:18:15.374545 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1151/2218] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:15 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:15.388177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df5dc23b-32f9-4d5c-9ef3-37864038e4be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbfa28979d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.512409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG neutronclient.v2_0.client [None req-df5dc23b-32f9-4d5c-9ef3-37864038e4be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist", "detail": ""}} {{(pid=119808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:18:15.513180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.security_group_api [None req-df5dc23b-32f9-4d5c-9ef3-37864038e4be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Neutron security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 not found {{(pid=119808) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:18:15.513735 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-df5dc23b-32f9-4d5c-9ef3-37864038e4be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:18:15.513735 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-c4f6f6fa-ccc4-44ce-814d-8968fc6970ca'] Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df5dc23b-32f9-4d5c-9ef3-37864038e4be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-security-groups/5654b20f-3a46-4337-b4b1-0dcb07d1f569 HTTP/1.1 Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: exception: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-c4f6f6fa-ccc4-44ce-814d-8968fc6970ca'] Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '5654b20f-3a46-4337-b4b1-0dcb07d1f569'} Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:18:15.516608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4f6f6fa-ccc4-44ce-814d-8968fc6970ca'] Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4f6f6fa-ccc4-44ce-814d-8968fc6970ca'] Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4f6f6fa-ccc4-44ce-814d-8968fc6970ca'] Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4f6f6fa-ccc4-44ce-814d-8968fc6970ca'] Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df5dc23b-32f9-4d5c-9ef3-37864038e4be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Security group 5654b20f-3a46-4337-b4b1-0dcb07d1f569 does not exist Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-c4f6f6fa-ccc4-44ce-814d-8968fc6970ca'] {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:15.521253 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df5dc23b-32f9-4d5c-9ef3-37864038e4be tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5654b20f-3a46-4337-b4b1-0dcb07d1f569" status: 404 len: 194 microversion: 2.1 time: 0.143011 Jul 20 04:18:15.527035 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1152/2219] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:18:15 2022] DELETE /compute/v2.1/os-security-groups/5654b20f-3a46-4337-b4b1-0dcb07d1f569 => generated 194 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:15.537316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b4259e03-909b-49b0-bcd1-f084f638639d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa27a4a60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.655023 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b4259e03-909b-49b0-bcd1-f084f638639d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.131222 Jul 20 04:18:15.657481 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1153/2220] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:15 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:15.668106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61c274e0-f6b7-4d9a-9c52-2819e47c6b2a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbfa284c940>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.720253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aad7baa7-e7ff-4e73-814c-5a4a53a26286 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.734999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aad7baa7-e7ff-4e73-814c-5a4a53a26286 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.740941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aad7baa7-e7ff-4e73-814c-5a4a53a26286 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.742453 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aad7baa7-e7ff-4e73-814c-5a4a53a26286 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.494136 Jul 20 04:18:15.744630 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1068/2221] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:15 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:15.757420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG neutronclient.v2_0.client [None req-61c274e0-f6b7-4d9a-9c52-2819e47c6b2a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist", "detail": ""}} {{(pid=119808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:18:15.758287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.security_group_api [None req-61c274e0-f6b7-4d9a-9c52-2819e47c6b2a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Neutron security group 83d09467-1553-4f6b-ae58-68073d304c21 not found {{(pid=119808) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:18:15.758995 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-61c274e0-f6b7-4d9a-9c52-2819e47c6b2a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:18:15.758995 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-ace4407a-010d-4003-94a5-29d190d3f288'] Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61c274e0-f6b7-4d9a-9c52-2819e47c6b2a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-security-groups/83d09467-1553-4f6b-ae58-68073d304c21 HTTP/1.1 Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: exception: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-ace4407a-010d-4003-94a5-29d190d3f288'] Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '83d09467-1553-4f6b-ae58-68073d304c21'} Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:18:15.761518 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ace4407a-010d-4003-94a5-29d190d3f288'] Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ace4407a-010d-4003-94a5-29d190d3f288'] Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ace4407a-010d-4003-94a5-29d190d3f288'] Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ace4407a-010d-4003-94a5-29d190d3f288'] Jul 20 04:18:15.767572 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:15.772205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61c274e0-f6b7-4d9a-9c52-2819e47c6b2a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Security group 83d09467-1553-4f6b-ae58-68073d304c21 does not exist Jul 20 04:18:15.772205 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-ace4407a-010d-4003-94a5-29d190d3f288'] {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:15.773402 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-61c274e0-f6b7-4d9a-9c52-2819e47c6b2a tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/83d09467-1553-4f6b-ae58-68073d304c21" status: 404 len: 194 microversion: 2.1 time: 0.114709 Jul 20 04:18:15.774144 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1154/2222] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:18:15 2022] DELETE /compute/v2.1/os-security-groups/83d09467-1553-4f6b-ae58-68073d304c21 => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:15.784208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8c8ecdcd-503d-4fa8-b904-b68b8619b788 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.784985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8c8ecdcd-503d-4fa8-b904-b68b8619b788 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:15.802602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8c8ecdcd-503d-4fa8-b904-b68b8619b788 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.803794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8c8ecdcd-503d-4fa8-b904-b68b8619b788 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.804684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8c8ecdcd-503d-4fa8-b904-b68b8619b788 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.806977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8c8ecdcd-503d-4fa8-b904-b68b8619b788 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.870661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8c8ecdcd-503d-4fa8-b904-b68b8619b788 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:15.971671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bfece4e3-3f1e-46d2-8bca-cade4d1854a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.972306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bfece4e3-3f1e-46d2-8bca-cade4d1854a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:15.991934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfece4e3-3f1e-46d2-8bca-cade4d1854a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.992810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfece4e3-3f1e-46d2-8bca-cade4d1854a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.995720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfece4e3-3f1e-46d2-8bca-cade4d1854a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.998935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfece4e3-3f1e-46d2-8bca-cade4d1854a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.144409 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8c8ecdcd-503d-4fa8-b904-b68b8619b788 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 204 len: 0 microversion: 2.1 time: 0.362976 Jul 20 04:18:16.145566 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1069/2223] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:15 2022] DELETE /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:18:16.152561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b8dfbbae-65e6-4431-9ec3-57e4f5f78169 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:16.159193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b8dfbbae-65e6-4431-9ec3-57e4f5f78169 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:16.180549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8dfbbae-65e6-4431-9ec3-57e4f5f78169 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.181303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8dfbbae-65e6-4431-9ec3-57e4f5f78169 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.182293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8dfbbae-65e6-4431-9ec3-57e4f5f78169 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.185852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8dfbbae-65e6-4431-9ec3-57e4f5f78169 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.890757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bfece4e3-3f1e-46d2-8bca-cade4d1854a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.914507 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bfece4e3-3f1e-46d2-8bca-cade4d1854a0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.945263 Jul 20 04:18:16.917815 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1155/2224] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:15 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:16.934639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f6119f5-e591-4b8b-b00c-01c29a17542f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:16.935486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1f6119f5-e591-4b8b-b00c-01c29a17542f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:16.962841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f6119f5-e591-4b8b-b00c-01c29a17542f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.969534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f6119f5-e591-4b8b-b00c-01c29a17542f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.970530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f6119f5-e591-4b8b-b00c-01c29a17542f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.970993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f6119f5-e591-4b8b-b00c-01c29a17542f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.995276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b8dfbbae-65e6-4431-9ec3-57e4f5f78169 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.011900 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b8dfbbae-65e6-4431-9ec3-57e4f5f78169 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1389 microversion: 2.1 time: 0.864826 Jul 20 04:18:17.017006 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1070/2225] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:16 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1389 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:17.028751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4807e313-7eed-4bdb-b04f-686cdebe0590 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:17.033198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4807e313-7eed-4bdb-b04f-686cdebe0590 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:17.056990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4807e313-7eed-4bdb-b04f-686cdebe0590 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.057800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4807e313-7eed-4bdb-b04f-686cdebe0590 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.061006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4807e313-7eed-4bdb-b04f-686cdebe0590 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.063757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4807e313-7eed-4bdb-b04f-686cdebe0590 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.353106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4807e313-7eed-4bdb-b04f-686cdebe0590 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.357021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:17.397278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4807e313-7eed-4bdb-b04f-686cdebe0590 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.436204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4807e313-7eed-4bdb-b04f-686cdebe0590 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.470720 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4807e313-7eed-4bdb-b04f-686cdebe0590 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.445442 Jul 20 04:18:17.471833 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1071/2226] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:17 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:17.491875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f2303f3-d50b-4db6-8535-cdeafaa45714 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa28ed040>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:17.520229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1f6119f5-e591-4b8b-b00c-01c29a17542f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.529599 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f6119f5-e591-4b8b-b00c-01c29a17542f tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1647 microversion: 2.1 time: 0.610659 Jul 20 04:18:17.542311 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1156/2227] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:16 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1647 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:17.555146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-c3dd815f-ff9b-4499-b043-367f5004c7c9 req-bbd5ac3d-ebfe-4a6a-bf3a-84460f1c15d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7da181-3013-4dcb-aaeb-3fa090a01941", "name": "network-vif-unplugged", "status": "completed", "tag": "c1b4726b-e1ba-4b8b-86cc-729b8499f72b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:17.569252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c3dd815f-ff9b-4499-b043-367f5004c7c9 req-bbd5ac3d-ebfe-4a6a-bf3a-84460f1c15d3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.570066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c3dd815f-ff9b-4499-b043-367f5004c7c9 req-bbd5ac3d-ebfe-4a6a-bf3a-84460f1c15d3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.588542 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c3dd815f-ff9b-4499-b043-367f5004c7c9 req-bbd5ac3d-ebfe-4a6a-bf3a-84460f1c15d3 service nova] Creating event network-vif-unplugged:c1b4726b-e1ba-4b8b-86cc-729b8499f72b for instance cb7da181-3013-4dcb-aaeb-3fa090a01941 on n-h1-764485-11 Jul 20 04:18:17.595296 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2f2303f3-d50b-4db6-8535-cdeafaa45714 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1410 microversion: 2.1 time: 0.117491 Jul 20 04:18:17.598267 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1072/2228] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:17 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1410 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:17.598664 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-c3dd815f-ff9b-4499-b043-367f5004c7c9 req-bbd5ac3d-ebfe-4a6a-bf3a-84460f1c15d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051448 Jul 20 04:18:17.600264 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1157/2229] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:17.607997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-eeb7db9b-7379-4438-8975-742dbea98305 req-fac3f921-e312-416a-8225-700511415035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838c7de4-25f3-481a-b89f-6562178ccce0", "name": "network-vif-deleted", "tag": "64e34bf8-7b7e-45eb-acd2-804013d49abe"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:17.609374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ffb30573-7955-4e20-8d08-094200a613bf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:17.610107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ffb30573-7955-4e20-8d08-094200a613bf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:17.632441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffb30573-7955-4e20-8d08-094200a613bf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.633592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffb30573-7955-4e20-8d08-094200a613bf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.634831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffb30573-7955-4e20-8d08-094200a613bf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.635849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffb30573-7955-4e20-8d08-094200a613bf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.652802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-eeb7db9b-7379-4438-8975-742dbea98305 req-fac3f921-e312-416a-8225-700511415035 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.654819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-eeb7db9b-7379-4438-8975-742dbea98305 req-fac3f921-e312-416a-8225-700511415035 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.702167 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-eeb7db9b-7379-4438-8975-742dbea98305 req-fac3f921-e312-416a-8225-700511415035 service nova] Creating event network-vif-deleted:64e34bf8-7b7e-45eb-acd2-804013d49abe for instance 838c7de4-25f3-481a-b89f-6562178ccce0 on n-h2-764485-11 Jul 20 04:18:17.715387 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-eeb7db9b-7379-4438-8975-742dbea98305 req-fac3f921-e312-416a-8225-700511415035 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112312 Jul 20 04:18:17.719582 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1158/2230] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:17.936525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dc45c5da-07a4-4f9f-8eb5-4ba1a72a3218 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:17.937343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dc45c5da-07a4-4f9f-8eb5-4ba1a72a3218 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:17.954180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc45c5da-07a4-4f9f-8eb5-4ba1a72a3218 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.955695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc45c5da-07a4-4f9f-8eb5-4ba1a72a3218 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.959787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc45c5da-07a4-4f9f-8eb5-4ba1a72a3218 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.963288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc45c5da-07a4-4f9f-8eb5-4ba1a72a3218 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.127928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ffb30573-7955-4e20-8d08-094200a613bf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.139094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ffb30573-7955-4e20-8d08-094200a613bf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.147750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ffb30573-7955-4e20-8d08-094200a613bf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.149671 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ffb30573-7955-4e20-8d08-094200a613bf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.550116 Jul 20 04:18:18.160455 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1073/2231] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:17 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:18.165528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ddf6dca-9f43-4944-9e21-53a750d7942d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.171416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ddf6dca-9f43-4944-9e21-53a750d7942d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:18.186624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ddf6dca-9f43-4944-9e21-53a750d7942d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.187344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ddf6dca-9f43-4944-9e21-53a750d7942d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.188576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ddf6dca-9f43-4944-9e21-53a750d7942d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.190699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ddf6dca-9f43-4944-9e21-53a750d7942d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.360464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dc45c5da-07a4-4f9f-8eb5-4ba1a72a3218 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.363393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ddf6dca-9f43-4944-9e21-53a750d7942d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.372573 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dc45c5da-07a4-4f9f-8eb5-4ba1a72a3218 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.441943 Jul 20 04:18:18.375307 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1159/2232] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:17 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:18.388093 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ddf6dca-9f43-4944-9e21-53a750d7942d tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1184 microversion: 2.1 time: 0.225568 Jul 20 04:18:18.388710 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1074/2233] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1184 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:18.490185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2456a39f-04f2-4960-9465-2e00bba67716 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.490971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2456a39f-04f2-4960-9465-2e00bba67716 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:18.498358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2456a39f-04f2-4960-9465-2e00bba67716 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.499596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2456a39f-04f2-4960-9465-2e00bba67716 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.500672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2456a39f-04f2-4960-9465-2e00bba67716 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.501717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2456a39f-04f2-4960-9465-2e00bba67716 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.523918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:18.547664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6303d654-5d97-4b08-8c11-3639cde1d94e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.548293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6303d654-5d97-4b08-8c11-3639cde1d94e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:18.581111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6303d654-5d97-4b08-8c11-3639cde1d94e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.582057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6303d654-5d97-4b08-8c11-3639cde1d94e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.584047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6303d654-5d97-4b08-8c11-3639cde1d94e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.584662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6303d654-5d97-4b08-8c11-3639cde1d94e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.617154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2456a39f-04f2-4960-9465-2e00bba67716 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.632785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2456a39f-04f2-4960-9465-2e00bba67716 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.634494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2456a39f-04f2-4960-9465-2e00bba67716 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.644890 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2456a39f-04f2-4960-9465-2e00bba67716 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1447 microversion: 2.75 time: 0.158465 Jul 20 04:18:18.659863 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1160/2234] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1447 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:18.675170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0dc55e63-4bb2-4189-b84f-00648c61472c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d168c10>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.751030 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0dc55e63-4bb2-4189-b84f-00648c61472c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1419 microversion: 2.1 time: 0.089890 Jul 20 04:18:18.756554 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1161/2235] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1419 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:18.763754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a5818f6f-a044-4b18-b8f9-8fe27673a7c8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa28b4f70>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.825532 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a5818f6f-a044-4b18-b8f9-8fe27673a7c8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 200 len: 1419 microversion: 2.1 time: 0.066418 Jul 20 04:18:18.826773 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1162/2236] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 1419 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:18.839763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e0f9808a-54ba-4bdf-b556-b0f248f53599 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa27a8e50>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.908721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6303d654-5d97-4b08-8c11-3639cde1d94e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.921427 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6303d654-5d97-4b08-8c11-3639cde1d94e tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1647 microversion: 2.1 time: 0.378551 Jul 20 04:18:18.924757 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1075/2237] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1647 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:19.172133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7e3f7a2-9d45-430b-bac2-9d687da5587c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.173545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c7e3f7a2-9d45-430b-bac2-9d687da5587c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.193643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7e3f7a2-9d45-430b-bac2-9d687da5587c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.201396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7e3f7a2-9d45-430b-bac2-9d687da5587c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.203213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7e3f7a2-9d45-430b-bac2-9d687da5587c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.208536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7e3f7a2-9d45-430b-bac2-9d687da5587c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.716628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c7e3f7a2-9d45-430b-bac2-9d687da5587c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.730079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c7e3f7a2-9d45-430b-bac2-9d687da5587c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.740714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c7e3f7a2-9d45-430b-bac2-9d687da5587c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.748714 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c7e3f7a2-9d45-430b-bac2-9d687da5587c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.582256 Jul 20 04:18:19.750520 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1076/2238] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:19.755675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d2446689-45be-4633-b62e-fe260a2b6f2e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.756553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d2446689-45be-4633-b62e-fe260a2b6f2e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.765986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2446689-45be-4633-b62e-fe260a2b6f2e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.766410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2446689-45be-4633-b62e-fe260a2b6f2e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.767460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2446689-45be-4633-b62e-fe260a2b6f2e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.768047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2446689-45be-4633-b62e-fe260a2b6f2e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.835472 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e0f9808a-54ba-4bdf-b556-b0f248f53599 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 204 len: 0 microversion: 2.1 time: 1.000715 Jul 20 04:18:19.836269 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1163/2239] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:18 2022] DELETE /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 0 bytes in 1002 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:19.842598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-039a0a54-5f49-4835-b4b4-5a5c582f7fba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.843225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-039a0a54-5f49-4835-b4b4-5a5c582f7fba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.854365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-039a0a54-5f49-4835-b4b4-5a5c582f7fba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.860296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-039a0a54-5f49-4835-b4b4-5a5c582f7fba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.865485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-039a0a54-5f49-4835-b4b4-5a5c582f7fba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.866139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-039a0a54-5f49-4835-b4b4-5a5c582f7fba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.042342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-039a0a54-5f49-4835-b4b4-5a5c582f7fba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.057057 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-039a0a54-5f49-4835-b4b4-5a5c582f7fba tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1184 microversion: 2.1 time: 0.215628 Jul 20 04:18:20.058321 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1164/2240] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1184 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:20.068670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-7a1d6b04-ee1f-4299-b8b0-b2114b008675 req-ce77e66c-d4c4-42e0-a27a-7a2ac007071b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb7da181-3013-4dcb-aaeb-3fa090a01941", "tag": "c1b4726b-e1ba-4b8b-86cc-729b8499f72b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:20.087363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7a1d6b04-ee1f-4299-b8b0-b2114b008675 req-ce77e66c-d4c4-42e0-a27a-7a2ac007071b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.087850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7a1d6b04-ee1f-4299-b8b0-b2114b008675 req-ce77e66c-d4c4-42e0-a27a-7a2ac007071b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.118643 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7a1d6b04-ee1f-4299-b8b0-b2114b008675 req-ce77e66c-d4c4-42e0-a27a-7a2ac007071b service nova] Creating event network-changed:c1b4726b-e1ba-4b8b-86cc-729b8499f72b for instance cb7da181-3013-4dcb-aaeb-3fa090a01941 on n-h1-764485-11 Jul 20 04:18:20.125448 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-7a1d6b04-ee1f-4299-b8b0-b2114b008675 req-ce77e66c-d4c4-42e0-a27a-7a2ac007071b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065608 Jul 20 04:18:20.126789 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1165/2241] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:20.134732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6b0c12c8-4a8a-44a4-b54c-84cf7baaa948 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.135796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6b0c12c8-4a8a-44a4-b54c-84cf7baaa948 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:20.144199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b0c12c8-4a8a-44a4-b54c-84cf7baaa948 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.145088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b0c12c8-4a8a-44a4-b54c-84cf7baaa948 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.146140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b0c12c8-4a8a-44a4-b54c-84cf7baaa948 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.146904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6b0c12c8-4a8a-44a4-b54c-84cf7baaa948 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.374507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6b0c12c8-4a8a-44a4-b54c-84cf7baaa948 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.388743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6b0c12c8-4a8a-44a4-b54c-84cf7baaa948 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.390768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6b0c12c8-4a8a-44a4-b54c-84cf7baaa948 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.409557 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6b0c12c8-4a8a-44a4-b54c-84cf7baaa948 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1453 microversion: 2.75 time: 0.280591 Jul 20 04:18:20.422849 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1166/2242] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:20 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1453 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:20.428138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-336d2b72-823a-43c8-b10c-1caed6a46478 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.433414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-336d2b72-823a-43c8-b10c-1caed6a46478 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:20.446560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-336d2b72-823a-43c8-b10c-1caed6a46478 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.452285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-336d2b72-823a-43c8-b10c-1caed6a46478 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.453693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-336d2b72-823a-43c8-b10c-1caed6a46478 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.454322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-336d2b72-823a-43c8-b10c-1caed6a46478 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.524951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-336d2b72-823a-43c8-b10c-1caed6a46478 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:20.538720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d2446689-45be-4633-b62e-fe260a2b6f2e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.556092 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d2446689-45be-4633-b62e-fe260a2b6f2e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.804342 Jul 20 04:18:20.563245 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1077/2243] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:20.568291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-78ac72bb-f909-42f1-9439-94aee17c2685 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.581706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-78ac72bb-f909-42f1-9439-94aee17c2685 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:20.607464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78ac72bb-f909-42f1-9439-94aee17c2685 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.613971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78ac72bb-f909-42f1-9439-94aee17c2685 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.615237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78ac72bb-f909-42f1-9439-94aee17c2685 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.615962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78ac72bb-f909-42f1-9439-94aee17c2685 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.726114 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-336d2b72-823a-43c8-b10c-1caed6a46478 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 204 len: 0 microversion: 2.1 time: 0.301139 Jul 20 04:18:20.726856 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1167/2244] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:20 2022] DELETE /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:20.734791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-115bed68-7b6d-4d76-9c0a-f01a9c60e2d9 req-b681ebbe-0e05-4a57-a25a-cc7a57cdd156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcccdd82-e3d1-4d66-aefc-657ce896eaf8", "name": "network-vif-deleted", "tag": "6ccd2eda-880b-42ac-af0e-bb1e18b48e69"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:20.745318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-115bed68-7b6d-4d76-9c0a-f01a9c60e2d9 req-b681ebbe-0e05-4a57-a25a-cc7a57cdd156 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.746433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-115bed68-7b6d-4d76-9c0a-f01a9c60e2d9 req-b681ebbe-0e05-4a57-a25a-cc7a57cdd156 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.767979 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-115bed68-7b6d-4d76-9c0a-f01a9c60e2d9 req-b681ebbe-0e05-4a57-a25a-cc7a57cdd156 service nova] Creating event network-vif-deleted:6ccd2eda-880b-42ac-af0e-bb1e18b48e69 for instance bcccdd82-e3d1-4d66-aefc-657ce896eaf8 on n-h2-764485-11 Jul 20 04:18:20.776607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-115bed68-7b6d-4d76-9c0a-f01a9c60e2d9 req-b681ebbe-0e05-4a57-a25a-cc7a57cdd156 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047536 Jul 20 04:18:20.777662 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1168/2245] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:20.784472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16788915-c6a3-4f90-9939-dc55d81cf75f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.785130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-16788915-c6a3-4f90-9939-dc55d81cf75f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:20.794508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16788915-c6a3-4f90-9939-dc55d81cf75f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.794650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16788915-c6a3-4f90-9939-dc55d81cf75f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.795454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16788915-c6a3-4f90-9939-dc55d81cf75f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.795922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16788915-c6a3-4f90-9939-dc55d81cf75f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.829385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-78ac72bb-f909-42f1-9439-94aee17c2685 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.842952 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-78ac72bb-f909-42f1-9439-94aee17c2685 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1467 microversion: 2.1 time: 0.278192 Jul 20 04:18:20.843769 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1078/2246] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:20 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1467 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:20.992423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1709867326", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "d9fe07a4-2a16-4e79-9ad2-c5078d0d5312"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:21.024647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-16788915-c6a3-4f90-9939-dc55d81cf75f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.035287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-16788915-c6a3-4f90-9939-dc55d81cf75f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.042785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-16788915-c6a3-4f90-9939-dc55d81cf75f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.046540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-16788915-c6a3-4f90-9939-dc55d81cf75f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.267621 Jul 20 04:18:21.047313 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1169/2247] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:20 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:21.084436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b54dfba5-12cb-4345-b937-d9d5dc09bd03 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:21.085521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b54dfba5-12cb-4345-b937-d9d5dc09bd03 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:21.098107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] validate_networks() for [('d9fe07a4-2a16-4e79-9ad2-c5078d0d5312', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:21.107307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b54dfba5-12cb-4345-b937-d9d5dc09bd03 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.112939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b54dfba5-12cb-4345-b937-d9d5dc09bd03 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.114192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b54dfba5-12cb-4345-b937-d9d5dc09bd03 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.114906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b54dfba5-12cb-4345-b937-d9d5dc09bd03 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.261799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b54dfba5-12cb-4345-b937-d9d5dc09bd03 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.276444 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b54dfba5-12cb-4345-b937-d9d5dc09bd03 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1184 microversion: 2.1 time: 0.204261 Jul 20 04:18:21.286963 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1170/2248] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:21 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1184 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:21.431552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aba24322-4dd9-41a1-88e3-f089f7c69d29 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:21.435186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aba24322-4dd9-41a1-88e3-f089f7c69d29 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:21.466558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aba24322-4dd9-41a1-88e3-f089f7c69d29 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.469124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aba24322-4dd9-41a1-88e3-f089f7c69d29 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.470129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aba24322-4dd9-41a1-88e3-f089f7c69d29 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.472360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aba24322-4dd9-41a1-88e3-f089f7c69d29 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.621028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aba24322-4dd9-41a1-88e3-f089f7c69d29 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.634620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aba24322-4dd9-41a1-88e3-f089f7c69d29 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.636491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aba24322-4dd9-41a1-88e3-f089f7c69d29 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.651700 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aba24322-4dd9-41a1-88e3-f089f7c69d29 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1453 microversion: 2.75 time: 0.225453 Jul 20 04:18:21.652485 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1171/2249] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:21 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1453 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:21.661402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1d3a4956-abe7-4292-8229-b61ab81190bb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:21.662251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1d3a4956-abe7-4292-8229-b61ab81190bb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:21.681213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d3a4956-abe7-4292-8229-b61ab81190bb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.681933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d3a4956-abe7-4292-8229-b61ab81190bb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.682895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d3a4956-abe7-4292-8229-b61ab81190bb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.683637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d3a4956-abe7-4292-8229-b61ab81190bb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.907345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:21.907971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:21.908510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:21.909197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:21.909714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:21.926178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.926630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.927432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.927897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.965738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1d3a4956-abe7-4292-8229-b61ab81190bb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.972350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Getting quotas for project 6d23a8eadfd74e358d917b9aa3b85bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:21.978178 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1d3a4956-abe7-4292-8229-b61ab81190bb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.324285 Jul 20 04:18:21.979074 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1172/2250] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:21 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:21.984186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1fde397d-7e18-4885-a702-382b109cbd40 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:21.988147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1fde397d-7e18-4885-a702-382b109cbd40 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.989092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1fde397d-7e18-4885-a702-382b109cbd40 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Searching by: {'deleted': False, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:18:21.993441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Getting quotas for user 0d1edf9dfed144d8875968ffd5f9ad91 and project 6d23a8eadfd74e358d917b9aa3b85bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:21.995079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fde397d-7e18-4885-a702-382b109cbd40 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.995676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fde397d-7e18-4885-a702-382b109cbd40 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.996572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fde397d-7e18-4885-a702-382b109cbd40 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.997905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fde397d-7e18-4885-a702-382b109cbd40 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.020716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:22.038095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-1fde397d-7e18-4885-a702-382b109cbd40 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:18:22.039748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:22.101133 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1fde397d-7e18-4885-a702-382b109cbd40 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.120551 Jul 20 04:18:22.102285 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1173/2251] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 04:18:21 2022] GET /compute/v2.1/servers => generated 339 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:22.108431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3cf34f8a-53e2-422b-8f4e-1ce434b0a5f5 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.109177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3cf34f8a-53e2-422b-8f4e-1ce434b0a5f5 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:22.116504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cf34f8a-53e2-422b-8f4e-1ce434b0a5f5 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.117041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cf34f8a-53e2-422b-8f4e-1ce434b0a5f5 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.117813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cf34f8a-53e2-422b-8f4e-1ce434b0a5f5 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.118255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cf34f8a-53e2-422b-8f4e-1ce434b0a5f5 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.144527 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4afe8fe4-e9ea-46ea-8726-92716e46e37c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.156586 Jul 20 04:18:22.145199 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1079/2252] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:18:22.152351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-876ede65-0b81-4d30-bcd4-39650910537c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.153012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-876ede65-0b81-4d30-bcd4-39650910537c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:22.177448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-876ede65-0b81-4d30-bcd4-39650910537c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.177911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-876ede65-0b81-4d30-bcd4-39650910537c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.178797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-876ede65-0b81-4d30-bcd4-39650910537c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.179634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-876ede65-0b81-4d30-bcd4-39650910537c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.233026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3cf34f8a-53e2-422b-8f4e-1ce434b0a5f5 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '197a968f1cd644d3afca88c6d60a87c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6077ffc2e5466ab68104ce3963e514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.242938 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3cf34f8a-53e2-422b-8f4e-1ce434b0a5f5 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 200 len: 1467 microversion: 2.1 time: 0.139630 Jul 20 04:18:22.254199 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1174/2253] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:22 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 1467 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:22.270294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2f048364-5b53-479f-8973-59589daed443 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.277411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f048364-5b53-479f-8973-59589daed443 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.278238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2f048364-5b53-479f-8973-59589daed443 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Searching by: {'deleted': False, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:18:22.300055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f048364-5b53-479f-8973-59589daed443 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.301140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f048364-5b53-479f-8973-59589daed443 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.306890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f048364-5b53-479f-8973-59589daed443 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.307502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f048364-5b53-479f-8973-59589daed443 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.363631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-2f048364-5b53-479f-8973-59589daed443 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:18:22.448021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f048364-5b53-479f-8973-59589daed443 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.457718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f048364-5b53-479f-8973-59589daed443 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.459570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f048364-5b53-479f-8973-59589daed443 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.914973 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2f048364-5b53-479f-8973-59589daed443 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 1.659416 Jul 20 04:18:23.916121 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1175/2254] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:18:22 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:23.921247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-60635360-e705-41d3-a129-1b0e7408c1a9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:23.922184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-60635360-e705-41d3-a129-1b0e7408c1a9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:23.938095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-60635360-e705-41d3-a129-1b0e7408c1a9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.938972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-60635360-e705-41d3-a129-1b0e7408c1a9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.940062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-60635360-e705-41d3-a129-1b0e7408c1a9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.940907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-60635360-e705-41d3-a129-1b0e7408c1a9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.973445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-876ede65-0b81-4d30-bcd4-39650910537c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.987350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-876ede65-0b81-4d30-bcd4-39650910537c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.989023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-876ede65-0b81-4d30-bcd4-39650910537c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.990221 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-876ede65-0b81-4d30-bcd4-39650910537c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 1.841747 Jul 20 04:18:23.996698 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1080/2255] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:22 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:24.009695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4480bc7a-5f2e-4d19-ad9f-f7230bac1f0c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.038021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4480bc7a-5f2e-4d19-ad9f-f7230bac1f0c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.070100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4480bc7a-5f2e-4d19-ad9f-f7230bac1f0c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.071437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4480bc7a-5f2e-4d19-ad9f-f7230bac1f0c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.079949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4480bc7a-5f2e-4d19-ad9f-f7230bac1f0c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.083745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4480bc7a-5f2e-4d19-ad9f-f7230bac1f0c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.674570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-60635360-e705-41d3-a129-1b0e7408c1a9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.683872 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-60635360-e705-41d3-a129-1b0e7408c1a9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1260 microversion: 2.1 time: 0.766391 Jul 20 04:18:24.689068 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1176/2256] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1260 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:24.691100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4480bc7a-5f2e-4d19-ad9f-f7230bac1f0c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.703021 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4480bc7a-5f2e-4d19-ad9f-f7230bac1f0c tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1184 microversion: 2.1 time: 0.704568 Jul 20 04:18:24.711975 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1081/2257] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1184 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:24.715158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04f4d2cf-904d-4793-a4d4-d1c354720324 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.716030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-04f4d2cf-904d-4793-a4d4-d1c354720324 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.729912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04f4d2cf-904d-4793-a4d4-d1c354720324 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.730358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04f4d2cf-904d-4793-a4d4-d1c354720324 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.731909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04f4d2cf-904d-4793-a4d4-d1c354720324 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.732412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04f4d2cf-904d-4793-a4d4-d1c354720324 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.732762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e2fc90ea-64a6-4a67-9e4b-8c12af7dd68c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.733413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e2fc90ea-64a6-4a67-9e4b-8c12af7dd68c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.767659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2fc90ea-64a6-4a67-9e4b-8c12af7dd68c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.768137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2fc90ea-64a6-4a67-9e4b-8c12af7dd68c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.768968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2fc90ea-64a6-4a67-9e4b-8c12af7dd68c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.769418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2fc90ea-64a6-4a67-9e4b-8c12af7dd68c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.975251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-04f4d2cf-904d-4793-a4d4-d1c354720324 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.987501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-04f4d2cf-904d-4793-a4d4-d1c354720324 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.004020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-04f4d2cf-904d-4793-a4d4-d1c354720324 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.055890 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-04f4d2cf-904d-4793-a4d4-d1c354720324 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1453 microversion: 2.75 time: 0.360509 Jul 20 04:18:25.065500 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1177/2258] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1453 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:25.073076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7bf3df8f-d1e8-48ce-8c90-cd1dcd24e289 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:25.073700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7bf3df8f-d1e8-48ce-8c90-cd1dcd24e289 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] [instance: bcccdd82-e3d1-4d66-aefc-657ce896eaf8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:25.104418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7bf3df8f-d1e8-48ce-8c90-cd1dcd24e289 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.104880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7bf3df8f-d1e8-48ce-8c90-cd1dcd24e289 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.105688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7bf3df8f-d1e8-48ce-8c90-cd1dcd24e289 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.119395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7bf3df8f-d1e8-48ce-8c90-cd1dcd24e289 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.177597 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-7bf3df8f-d1e8-48ce-8c90-cd1dcd24e289 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] HTTP exception thrown: Instance bcccdd82-e3d1-4d66-aefc-657ce896eaf8 could not be found. Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7bf3df8f-d1e8-48ce-8c90-cd1dcd24e289 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Request method failure captured: Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 HTTP/1.1 Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14G7Dg3IrMSAhJH4V1cma0B5YRsN5kC37XateEkLHkl_q8x9xxdfknG23ksxgEpI1kQ5COmIb9OHkYa-by6qkYHY-4kKlkuQpu1UV8BrNqypzRe_imKKfGCEKigU-00qO_6LHBIULJkidzL2jmJHM4lFycBC3RAQ6gv-gn-EWlg-fRs Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a6077ffc2e5466ab68104ce3963e514", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a6077ffc2e5466ab68104ce3963e514"}]}] Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5a6077ffc2e5466ab68104ce3963e514 Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634228839 Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 197a968f1cd644d3afca88c6d60a87c2 Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-SecurityGroupsTestJSON-634228839-project Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance bcccdd82-e3d1-4d66-aefc-657ce896eaf8 could not be found. Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'bcccdd82-e3d1-4d66-aefc-657ce896eaf8'} Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcccdd82-e3d1-4d66-aefc-657ce896eaf8 could not be found. Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcccdd82-e3d1-4d66-aefc-657ce896eaf8 could not be found. Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:25.187667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:25.192347 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:25.192347 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:25.192347 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:25.192347 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:25.192347 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:25.192347 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcccdd82-e3d1-4d66-aefc-657ce896eaf8 could not be found. Jul 20 04:18:25.192347 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:25.192347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7bf3df8f-d1e8-48ce-8c90-cd1dcd24e289 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Returning 404 to user: Instance bcccdd82-e3d1-4d66-aefc-657ce896eaf8 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:25.192347 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7bf3df8f-d1e8-48ce-8c90-cd1dcd24e289 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8" status: 404 len: 111 microversion: 2.1 time: 0.116786 Jul 20 04:18:25.202617 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1178/2259] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:25 2022] GET /compute/v2.1/servers/bcccdd82-e3d1-4d66-aefc-657ce896eaf8 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:25.222228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6dd3b8bf-a37a-4bc6-ad84-f568ed64364e req-f35b25ff-0143-4251-9a21-5c784204b029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d86df2-0b5f-4d16-b6a5-fe16c86494fe", "name": "network-vif-unplugged", "status": "completed", "tag": "a3ee1c75-0199-4fca-95d5-7a8a2a2d9a58"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:25.247449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6dd3b8bf-a37a-4bc6-ad84-f568ed64364e req-f35b25ff-0143-4251-9a21-5c784204b029 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.247951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6dd3b8bf-a37a-4bc6-ad84-f568ed64364e req-f35b25ff-0143-4251-9a21-5c784204b029 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.280134 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6dd3b8bf-a37a-4bc6-ad84-f568ed64364e req-f35b25ff-0143-4251-9a21-5c784204b029 service nova] Creating event network-vif-unplugged:a3ee1c75-0199-4fca-95d5-7a8a2a2d9a58 for instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe on n-h1-764485-11 Jul 20 04:18:25.295537 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6dd3b8bf-a37a-4bc6-ad84-f568ed64364e req-f35b25ff-0143-4251-9a21-5c784204b029 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089978 Jul 20 04:18:25.296170 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1179/2260] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:25.306765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57633ce7-f2c7-43d5-aefb-d8bd7ba5cfbb tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:25.329895 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57633ce7-f2c7-43d5-aefb-d8bd7ba5cfbb tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027889 Jul 20 04:18:25.336432 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1180/2261] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:18:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:25.345878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6af2914e-f41a-4d18-a686-2eac7db45837 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:25.346742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6af2914e-f41a-4d18-a686-2eac7db45837 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:25.384087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6af2914e-f41a-4d18-a686-2eac7db45837 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.384087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6af2914e-f41a-4d18-a686-2eac7db45837 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.385380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6af2914e-f41a-4d18-a686-2eac7db45837 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.385865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6af2914e-f41a-4d18-a686-2eac7db45837 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.398240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:25.456569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e2fc90ea-64a6-4a67-9e4b-8c12af7dd68c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.468048 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e2fc90ea-64a6-4a67-9e4b-8c12af7dd68c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.754004 Jul 20 04:18:25.468923 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1082/2262] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:25.506891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a26c3817-dcb1-47fd-85c1-58cf09b49871 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbfa28f9940>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:25.936799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6af2914e-f41a-4d18-a686-2eac7db45837 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.945813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6af2914e-f41a-4d18-a686-2eac7db45837 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.957231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6af2914e-f41a-4d18-a686-2eac7db45837 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.958720 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6af2914e-f41a-4d18-a686-2eac7db45837 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.624713 Jul 20 04:18:25.962260 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1181/2263] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:25 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:25.974378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-e87831f1-056b-4dce-9c80-db6a39c453b2 req-1c0df12c-893f-4099-bb1f-add5f24bbedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d86df2-0b5f-4d16-b6a5-fe16c86494fe", "name": "network-vif-deleted", "tag": "a3ee1c75-0199-4fca-95d5-7a8a2a2d9a58"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:26.003762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e87831f1-056b-4dce-9c80-db6a39c453b2 req-1c0df12c-893f-4099-bb1f-add5f24bbedd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.004946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e87831f1-056b-4dce-9c80-db6a39c453b2 req-1c0df12c-893f-4099-bb1f-add5f24bbedd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.033591 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e87831f1-056b-4dce-9c80-db6a39c453b2 req-1c0df12c-893f-4099-bb1f-add5f24bbedd service nova] Creating event network-vif-deleted:a3ee1c75-0199-4fca-95d5-7a8a2a2d9a58 for instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe on n-h1-764485-11 Jul 20 04:18:26.052578 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-e87831f1-056b-4dce-9c80-db6a39c453b2 req-1c0df12c-893f-4099-bb1f-add5f24bbedd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088786 Jul 20 04:18:26.053484 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1182/2264] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:26.064793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-40b41b2a-f99b-456d-ad94-8acc14e30766 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.065692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40b41b2a-f99b-456d-ad94-8acc14e30766 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.084717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40b41b2a-f99b-456d-ad94-8acc14e30766 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.085507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40b41b2a-f99b-456d-ad94-8acc14e30766 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.086765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40b41b2a-f99b-456d-ad94-8acc14e30766 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.087403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40b41b2a-f99b-456d-ad94-8acc14e30766 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.123062 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a26c3817-dcb1-47fd-85c1-58cf09b49871 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/76398e9c-902d-4257-8f09-e45fea75b0e1" status: 202 len: 0 microversion: 2.1 time: 0.634935 Jul 20 04:18:26.126533 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1083/2265] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:18:25 2022] DELETE /compute/v2.1/os-security-groups/76398e9c-902d-4257-8f09-e45fea75b0e1 => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:26.129577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3bd12eb7-3e34-49c9-a34e-ffe1bfac0ada tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.130429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3bd12eb7-3e34-49c9-a34e-ffe1bfac0ada tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.146921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3bd12eb7-3e34-49c9-a34e-ffe1bfac0ada tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.147375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3bd12eb7-3e34-49c9-a34e-ffe1bfac0ada tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.148206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3bd12eb7-3e34-49c9-a34e-ffe1bfac0ada tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.148651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3bd12eb7-3e34-49c9-a34e-ffe1bfac0ada tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.151454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40b41b2a-f99b-456d-ad94-8acc14e30766 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:26.288268 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-40b41b2a-f99b-456d-ad94-8acc14e30766 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 204 len: 0 microversion: 2.1 time: 0.233124 Jul 20 04:18:26.291987 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1183/2266] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:26 2022] DELETE /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:26.296793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c4edafbc-373d-4e02-b95a-acb7194e8de6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.297517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c4edafbc-373d-4e02-b95a-acb7194e8de6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.304898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4edafbc-373d-4e02-b95a-acb7194e8de6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.305351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4edafbc-373d-4e02-b95a-acb7194e8de6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.305924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3bd12eb7-3e34-49c9-a34e-ffe1bfac0ada tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.306127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4edafbc-373d-4e02-b95a-acb7194e8de6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.306568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4edafbc-373d-4e02-b95a-acb7194e8de6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.315148 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3bd12eb7-3e34-49c9-a34e-ffe1bfac0ada tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1266 microversion: 2.1 time: 0.189795 Jul 20 04:18:26.315774 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1084/2267] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:26.324468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-277a7fa7-f76b-43ac-8fe5-c065d3ecf1a2 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.326238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-277a7fa7-f76b-43ac-8fe5-c065d3ecf1a2 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.338778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-277a7fa7-f76b-43ac-8fe5-c065d3ecf1a2 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.339436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-277a7fa7-f76b-43ac-8fe5-c065d3ecf1a2 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.340942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-277a7fa7-f76b-43ac-8fe5-c065d3ecf1a2 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.341669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-277a7fa7-f76b-43ac-8fe5-c065d3ecf1a2 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.422358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c4edafbc-373d-4e02-b95a-acb7194e8de6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.452324 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c4edafbc-373d-4e02-b95a-acb7194e8de6 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1184 microversion: 2.1 time: 0.161616 Jul 20 04:18:26.457647 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1184/2268] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1184 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:26.471737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1002ee5f-200b-4e15-af08-f30af167aaf0 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] Calling method '.version_select at 0x7fbfa27b3310>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.530953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-277a7fa7-f76b-43ac-8fe5-c065d3ecf1a2 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.545568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-277a7fa7-f76b-43ac-8fe5-c065d3ecf1a2 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.547866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-277a7fa7-f76b-43ac-8fe5-c065d3ecf1a2 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.557375 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-277a7fa7-f76b-43ac-8fe5-c065d3ecf1a2 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1438 microversion: 2.75 time: 0.240070 Jul 20 04:18:26.575609 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1085/2269] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1438 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:26.581103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0dd58e9-4b16-46de-bac6-e9d0d0286c19 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.582086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b0dd58e9-4b16-46de-bac6-e9d0d0286c19 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.592280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0dd58e9-4b16-46de-bac6-e9d0d0286c19 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.594395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0dd58e9-4b16-46de-bac6-e9d0d0286c19 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.595324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0dd58e9-4b16-46de-bac6-e9d0d0286c19 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.595952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0dd58e9-4b16-46de-bac6-e9d0d0286c19 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.847481 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1002ee5f-200b-4e15-af08-f30af167aaf0 tempest-SecurityGroupsTestJSON-634228839 tempest-SecurityGroupsTestJSON-634228839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/66046a8d-8d28-482d-a5cb-8b76376cb7e1" status: 202 len: 0 microversion: 2.1 time: 0.388315 Jul 20 04:18:26.848622 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1185/2270] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:18:26 2022] DELETE /compute/v2.1/os-security-groups/66046a8d-8d28-482d-a5cb-8b76376cb7e1 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:26.855075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b3d5e4c5-201f-4792-aeee-69142bce3bf4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.855947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b3d5e4c5-201f-4792-aeee-69142bce3bf4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.872093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3d5e4c5-201f-4792-aeee-69142bce3bf4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.872093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3d5e4c5-201f-4792-aeee-69142bce3bf4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.872555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3d5e4c5-201f-4792-aeee-69142bce3bf4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.872934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3d5e4c5-201f-4792-aeee-69142bce3bf4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.903839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b0dd58e9-4b16-46de-bac6-e9d0d0286c19 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.915500 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0dd58e9-4b16-46de-bac6-e9d0d0286c19 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1713 microversion: 2.1 time: 0.338272 Jul 20 04:18:26.918706 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1086/2271] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1713 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:27.129404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b3d5e4c5-201f-4792-aeee-69142bce3bf4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.143955 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b3d5e4c5-201f-4792-aeee-69142bce3bf4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.293904 Jul 20 04:18:27.145198 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1186/2272] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:27.150557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8dc3c94c-c955-47e4-9b92-f2e731b2d7d8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.152008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8dc3c94c-c955-47e4-9b92-f2e731b2d7d8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.167948 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8dc3c94c-c955-47e4-9b92-f2e731b2d7d8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.168647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8dc3c94c-c955-47e4-9b92-f2e731b2d7d8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.169556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8dc3c94c-c955-47e4-9b92-f2e731b2d7d8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.170011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8dc3c94c-c955-47e4-9b92-f2e731b2d7d8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.251017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:27.252481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.259210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.259388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.260122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.260570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.391942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:27.392741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:27.393401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:27.394308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:27.395441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:27.454214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8dc3c94c-c955-47e4-9b92-f2e731b2d7d8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.474640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8dc3c94c-c955-47e4-9b92-f2e731b2d7d8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.476200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8dc3c94c-c955-47e4-9b92-f2e731b2d7d8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.479079 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8dc3c94c-c955-47e4-9b92-f2e731b2d7d8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.332167 Jul 20 04:18:27.480335 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1187/2273] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:27.485990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ee7e0c7a-26c9-4ff8-8f76-ea6ea490761f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.487698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ee7e0c7a-26c9-4ff8-8f76-ea6ea490761f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.495281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee7e0c7a-26c9-4ff8-8f76-ea6ea490761f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.496073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee7e0c7a-26c9-4ff8-8f76-ea6ea490761f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.497946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee7e0c7a-26c9-4ff8-8f76-ea6ea490761f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.499262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee7e0c7a-26c9-4ff8-8f76-ea6ea490761f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.532638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.548935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.549310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.556166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.556646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.681495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee7e0c7a-26c9-4ff8-8f76-ea6ea490761f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.691248 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ee7e0c7a-26c9-4ff8-8f76-ea6ea490761f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1266 microversion: 2.1 time: 0.209470 Jul 20 04:18:27.695824 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1188/2274] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:27.712678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b785908-0592-47aa-9cd7-46508ca0cb7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.713672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b785908-0592-47aa-9cd7-46508ca0cb7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.723721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b785908-0592-47aa-9cd7-46508ca0cb7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.724634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b785908-0592-47aa-9cd7-46508ca0cb7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.737890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b785908-0592-47aa-9cd7-46508ca0cb7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.744421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b785908-0592-47aa-9cd7-46508ca0cb7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.790722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b785908-0592-47aa-9cd7-46508ca0cb7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.791536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b785908-0592-47aa-9cd7-46508ca0cb7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.792217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-0b785908-0592-47aa-9cd7-46508ca0cb7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lazy-loading 'fault' on Instance uuid 838c7de4-25f3-481a-b89f-6562178ccce0 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:27.890485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:27.932150 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d9d30bee-fd6f-4476-ad86-8b39a2ed5a0e tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975/action" status: 202 len: 1944 microversion: 2.75 time: 1.011993 Jul 20 04:18:27.948755 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1087/2275] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:18:26 2022] POST /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975/action => generated 1944 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:18:27.954593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-7d3491f6-d0cf-4514-897f-25fcb6d07f8b req-e56e880f-9c6f-4db0-a204-1846bd3aa7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7da181-3013-4dcb-aaeb-3fa090a01941", "name": "network-vif-unplugged", "status": "completed", "tag": "c1b4726b-e1ba-4b8b-86cc-729b8499f72b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:27.964159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7d3491f6-d0cf-4514-897f-25fcb6d07f8b req-e56e880f-9c6f-4db0-a204-1846bd3aa7c5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.964852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7d3491f6-d0cf-4514-897f-25fcb6d07f8b req-e56e880f-9c6f-4db0-a204-1846bd3aa7c5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.980215 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-7d3491f6-d0cf-4514-897f-25fcb6d07f8b req-e56e880f-9c6f-4db0-a204-1846bd3aa7c5 service nova] Creating event network-vif-unplugged:c1b4726b-e1ba-4b8b-86cc-729b8499f72b for instance cb7da181-3013-4dcb-aaeb-3fa090a01941 on n-h1-764485-11 Jul 20 04:18:27.986826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0b785908-0592-47aa-9cd7-46508ca0cb7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.988523 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-7d3491f6-d0cf-4514-897f-25fcb6d07f8b req-e56e880f-9c6f-4db0-a204-1846bd3aa7c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037652 Jul 20 04:18:27.994828 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1088/2276] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:28.003802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aa7ac7b8-8ebb-4aa1-bbed-db2c770557e7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.004865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aa7ac7b8-8ebb-4aa1-bbed-db2c770557e7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.007542 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b785908-0592-47aa-9cd7-46508ca0cb7f tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 200 len: 1189 microversion: 2.1 time: 0.305858 Jul 20 04:18:28.008508 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1189/2277] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 1189 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:28.012812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa7ac7b8-8ebb-4aa1-bbed-db2c770557e7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.013537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa7ac7b8-8ebb-4aa1-bbed-db2c770557e7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.014594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa7ac7b8-8ebb-4aa1-bbed-db2c770557e7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.015268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa7ac7b8-8ebb-4aa1-bbed-db2c770557e7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.032781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-11b09a50-2a9c-440c-a614-418bc78ef219 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.034035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:28.042710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-11b09a50-2a9c-440c-a614-418bc78ef219 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.066306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11b09a50-2a9c-440c-a614-418bc78ef219 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.067033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11b09a50-2a9c-440c-a614-418bc78ef219 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.068087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11b09a50-2a9c-440c-a614-418bc78ef219 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.070056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11b09a50-2a9c-440c-a614-418bc78ef219 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.435672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-11b09a50-2a9c-440c-a614-418bc78ef219 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:28.470160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aa7ac7b8-8ebb-4aa1-bbed-db2c770557e7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.481785 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aa7ac7b8-8ebb-4aa1-bbed-db2c770557e7 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1713 microversion: 2.1 time: 0.482366 Jul 20 04:18:28.482861 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-11b09a50-2a9c-440c-a614-418bc78ef219 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.461246 Jul 20 04:18:28.483232 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1089/2278] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1713 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:28.497498 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1190/2279] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:28.507437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-78fdb511-ef3f-4720-b8f2-b6c8dd73f6a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.510959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-78fdb511-ef3f-4720-b8f2-b6c8dd73f6a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.520790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78fdb511-ef3f-4720-b8f2-b6c8dd73f6a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.521570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78fdb511-ef3f-4720-b8f2-b6c8dd73f6a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.522571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78fdb511-ef3f-4720-b8f2-b6c8dd73f6a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.523206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78fdb511-ef3f-4720-b8f2-b6c8dd73f6a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.523726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9c549be-cec8-42ac-b79c-4ee0488dc05f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.524941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a9c549be-cec8-42ac-b79c-4ee0488dc05f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.535868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:28.574454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9c549be-cec8-42ac-b79c-4ee0488dc05f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.577353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9c549be-cec8-42ac-b79c-4ee0488dc05f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.578227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9c549be-cec8-42ac-b79c-4ee0488dc05f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.578678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9c549be-cec8-42ac-b79c-4ee0488dc05f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.910019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-78fdb511-ef3f-4720-b8f2-b6c8dd73f6a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.918958 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-78fdb511-ef3f-4720-b8f2-b6c8dd73f6a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.434434 Jul 20 04:18:28.922619 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1090/2280] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:28.929387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-98220b72-eb7a-4c65-8315-d6441e5ea738 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.936677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-98220b72-eb7a-4c65-8315-d6441e5ea738 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.949117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98220b72-eb7a-4c65-8315-d6441e5ea738 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.953061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98220b72-eb7a-4c65-8315-d6441e5ea738 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.955732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98220b72-eb7a-4c65-8315-d6441e5ea738 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.956459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98220b72-eb7a-4c65-8315-d6441e5ea738 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.981716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9c549be-cec8-42ac-b79c-4ee0488dc05f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.990507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9c549be-cec8-42ac-b79c-4ee0488dc05f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.993311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9c549be-cec8-42ac-b79c-4ee0488dc05f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.995077 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a9c549be-cec8-42ac-b79c-4ee0488dc05f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.493864 Jul 20 04:18:28.996267 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1191/2281] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:29.024958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09ec8402-421c-4a6d-bb3a-d8fce28d56bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:29.026138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-09ec8402-421c-4a6d-bb3a-d8fce28d56bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 838c7de4-25f3-481a-b89f-6562178ccce0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:29.037552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09ec8402-421c-4a6d-bb3a-d8fce28d56bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.039885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09ec8402-421c-4a6d-bb3a-d8fce28d56bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.040955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09ec8402-421c-4a6d-bb3a-d8fce28d56bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.041457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09ec8402-421c-4a6d-bb3a-d8fce28d56bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.061613 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-09ec8402-421c-4a6d-bb3a-d8fce28d56bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] HTTP exception thrown: Instance 838c7de4-25f3-481a-b89f-6562178ccce0 could not be found. Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09ec8402-421c-4a6d-bb3a-d8fce28d56bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Request method failure captured: Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 HTTP/1.1 Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BRix5w6xVSgcgOsOksDcg0wMc1wfRQXEBFxlragbURj-fVZLEdITgDL85k9tP-gWDuDVZmK_o-XAUK80Dg_ZocG9xlvP8P3GahPvov_cu7B3mq5RFUvz37paH4WkSp50g_t6VCBAn8nuKEiecs3H5n6-qBu1yb3Ngs8RIirJsyvZQ Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 14ab6d1260864919b0f1b6d536fe65ae Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-LiveMigrationTest-1040157573 Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14ab6d1260864919b0f1b6d536fe65ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14ab6d1260864919b0f1b6d536fe65ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14ab6d1260864919b0f1b6d536fe65ae", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14ab6d1260864919b0f1b6d536fe65ae"}]}] Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-LiveMigrationTest-1040157573 Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 14ab6d1260864919b0f1b6d536fe65ae Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-LiveMigrationTest-1040157573 Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-LiveMigrationTest-1040157573-project Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: f94d458feafa4ec28c50a04fc2b2a1f4 Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-LiveMigrationTest-1040157573-project Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 838c7de4-25f3-481a-b89f-6562178ccce0 could not be found. Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '838c7de4-25f3-481a-b89f-6562178ccce0'} Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 838c7de4-25f3-481a-b89f-6562178ccce0 could not be found. Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 838c7de4-25f3-481a-b89f-6562178ccce0 could not be found. Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:29.063613 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:29.068557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:29.068557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:29.068557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:29.068557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:29.068557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:29.068557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 838c7de4-25f3-481a-b89f-6562178ccce0 could not be found. Jul 20 04:18:29.068557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:29.068557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09ec8402-421c-4a6d-bb3a-d8fce28d56bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Returning 404 to user: Instance 838c7de4-25f3-481a-b89f-6562178ccce0 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:29.068557 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-09ec8402-421c-4a6d-bb3a-d8fce28d56bd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0" status: 404 len: 111 microversion: 2.1 time: 0.043832 Jul 20 04:18:29.071722 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1192/2282] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:29 2022] GET /compute/v2.1/servers/838c7de4-25f3-481a-b89f-6562178ccce0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:18:29.085944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-98220b72-eb7a-4c65-8315-d6441e5ea738 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:29.103418 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-98220b72-eb7a-4c65-8315-d6441e5ea738 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1266 microversion: 2.1 time: 0.179554 Jul 20 04:18:29.116493 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1091/2283] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:29.501675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-737f9eb2-34ac-4520-aac1-fd9cd1a7a35b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:29.503400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-737f9eb2-34ac-4520-aac1-fd9cd1a7a35b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:29.514200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-737f9eb2-34ac-4520-aac1-fd9cd1a7a35b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.514987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-737f9eb2-34ac-4520-aac1-fd9cd1a7a35b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.516010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-737f9eb2-34ac-4520-aac1-fd9cd1a7a35b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.516595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33e8b788-f4d4-4896-9bfb-f770f5d410b1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:29.516987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-737f9eb2-34ac-4520-aac1-fd9cd1a7a35b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.517216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-33e8b788-f4d4-4896-9bfb-f770f5d410b1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:29.532272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33e8b788-f4d4-4896-9bfb-f770f5d410b1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.532726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33e8b788-f4d4-4896-9bfb-f770f5d410b1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.533516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33e8b788-f4d4-4896-9bfb-f770f5d410b1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.533956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33e8b788-f4d4-4896-9bfb-f770f5d410b1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.724232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-33e8b788-f4d4-4896-9bfb-f770f5d410b1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:29.779236 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-33e8b788-f4d4-4896-9bfb-f770f5d410b1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.267083 Jul 20 04:18:29.784836 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1092/2284] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:29 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:29.836582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-737f9eb2-34ac-4520-aac1-fd9cd1a7a35b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:29.846241 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-737f9eb2-34ac-4520-aac1-fd9cd1a7a35b tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1713 microversion: 2.1 time: 0.350346 Jul 20 04:18:29.848536 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1193/2285] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:29 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1713 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:29.946958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-45ace19b-0702-49ee-8e65-0f8909556ddc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:29.948358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-45ace19b-0702-49ee-8e65-0f8909556ddc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:29.961945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45ace19b-0702-49ee-8e65-0f8909556ddc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.963734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45ace19b-0702-49ee-8e65-0f8909556ddc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.964766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45ace19b-0702-49ee-8e65-0f8909556ddc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.969436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45ace19b-0702-49ee-8e65-0f8909556ddc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.014367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7cb64412-10d7-4504-8a4f-165608eac16e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.014994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7cb64412-10d7-4504-8a4f-165608eac16e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.031256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cb64412-10d7-4504-8a4f-165608eac16e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.032464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cb64412-10d7-4504-8a4f-165608eac16e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.034225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cb64412-10d7-4504-8a4f-165608eac16e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.036124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cb64412-10d7-4504-8a4f-165608eac16e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.477780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-45ace19b-0702-49ee-8e65-0f8909556ddc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.502574 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-45ace19b-0702-49ee-8e65-0f8909556ddc tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.565830 Jul 20 04:18:30.503629 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1093/2286] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:29 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:30.510577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7cb64412-10d7-4504-8a4f-165608eac16e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.526112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-11bc29ef-91b9-4ccf-a8b8-d8b73b5d72ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.527171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7cb64412-10d7-4504-8a4f-165608eac16e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.530280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7cb64412-10d7-4504-8a4f-165608eac16e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.530589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-11bc29ef-91b9-4ccf-a8b8-d8b73b5d72ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.540258 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7cb64412-10d7-4504-8a4f-165608eac16e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1567 microversion: 2.25 time: 0.529822 Jul 20 04:18:30.541424 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1194/2287] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1567 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:30.542992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11bc29ef-91b9-4ccf-a8b8-d8b73b5d72ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.548034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11bc29ef-91b9-4ccf-a8b8-d8b73b5d72ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.549002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11bc29ef-91b9-4ccf-a8b8-d8b73b5d72ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.549521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11bc29ef-91b9-4ccf-a8b8-d8b73b5d72ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.808806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-77ac3c1a-b436-493c-9fff-a0280f4172bb tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.809465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-77ac3c1a-b436-493c-9fff-a0280f4172bb tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.825229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-77ac3c1a-b436-493c-9fff-a0280f4172bb tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.826051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-77ac3c1a-b436-493c-9fff-a0280f4172bb tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.827027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-77ac3c1a-b436-493c-9fff-a0280f4172bb tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.827700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-77ac3c1a-b436-493c-9fff-a0280f4172bb tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.956346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-11bc29ef-91b9-4ccf-a8b8-d8b73b5d72ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.965414 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-11bc29ef-91b9-4ccf-a8b8-d8b73b5d72ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1308 microversion: 2.1 time: 0.460281 Jul 20 04:18:30.970384 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1094/2288] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:30.978467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e63df9d5-84da-4572-90a7-33168bddb186 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.982900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e63df9d5-84da-4572-90a7-33168bddb186 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.996002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e63df9d5-84da-4572-90a7-33168bddb186 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.996285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-77ac3c1a-b436-493c-9fff-a0280f4172bb tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:31.000253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e63df9d5-84da-4572-90a7-33168bddb186 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.001308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e63df9d5-84da-4572-90a7-33168bddb186 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.001856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e63df9d5-84da-4572-90a7-33168bddb186 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.043931 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-77ac3c1a-b436-493c-9fff-a0280f4172bb tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.239319 Jul 20 04:18:31.056278 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1195/2289] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:31.260166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e63df9d5-84da-4572-90a7-33168bddb186 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:31.269105 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e63df9d5-84da-4572-90a7-33168bddb186 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1713 microversion: 2.1 time: 0.297134 Jul 20 04:18:31.278604 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1095/2290] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1713 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:31.521507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c4f80df4-4740-485d-9f6e-ffab466a6433 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:31.522218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c4f80df4-4740-485d-9f6e-ffab466a6433 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:31.536441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4f80df4-4740-485d-9f6e-ffab466a6433 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.537316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4f80df4-4740-485d-9f6e-ffab466a6433 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.538199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4f80df4-4740-485d-9f6e-ffab466a6433 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.544637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4f80df4-4740-485d-9f6e-ffab466a6433 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.561216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6072f3a9-52db-44dd-8a01-e320f669471a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:31.562107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6072f3a9-52db-44dd-8a01-e320f669471a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:31.577217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6072f3a9-52db-44dd-8a01-e320f669471a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.577766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6072f3a9-52db-44dd-8a01-e320f669471a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.578632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6072f3a9-52db-44dd-8a01-e320f669471a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.579398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6072f3a9-52db-44dd-8a01-e320f669471a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.949512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:31.985292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c4f80df4-4740-485d-9f6e-ffab466a6433 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:31.994422 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c4f80df4-4740-485d-9f6e-ffab466a6433 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.477951 Jul 20 04:18:32.006757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:32.014178 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1196/2291] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:31 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:32.022190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-277be0a7-7dac-48bc-874f-848e146743e9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:32.023094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-277be0a7-7dac-48bc-874f-848e146743e9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:32.029988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-277be0a7-7dac-48bc-874f-848e146743e9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.030730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-277be0a7-7dac-48bc-874f-848e146743e9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.031794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-277be0a7-7dac-48bc-874f-848e146743e9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.032429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-277be0a7-7dac-48bc-874f-848e146743e9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.053377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:32.080836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6072f3a9-52db-44dd-8a01-e320f669471a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:32.092221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6072f3a9-52db-44dd-8a01-e320f669471a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:32.096303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6072f3a9-52db-44dd-8a01-e320f669471a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:32.098521 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6072f3a9-52db-44dd-8a01-e320f669471a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1542 microversion: 2.25 time: 0.542781 Jul 20 04:18:32.100164 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1096/2292] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:31 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1542 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:32.107679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-62acf5e0-39dd-4500-9ef4-8c8bb6652a69 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:32.108731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-62acf5e0-39dd-4500-9ef4-8c8bb6652a69 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:32.117631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62acf5e0-39dd-4500-9ef4-8c8bb6652a69 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.118528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62acf5e0-39dd-4500-9ef4-8c8bb6652a69 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.119552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62acf5e0-39dd-4500-9ef4-8c8bb6652a69 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.120209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62acf5e0-39dd-4500-9ef4-8c8bb6652a69 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.260806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-62acf5e0-39dd-4500-9ef4-8c8bb6652a69 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:32.280806 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-62acf5e0-39dd-4500-9ef4-8c8bb6652a69 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.179096 Jul 20 04:18:32.281459 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1097/2293] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:32 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:32.287452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-277be0a7-7dac-48bc-874f-848e146743e9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:32.299026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-438f7149-8fe9-4aee-a7f9-e7098155cb77 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '.version_select at 0x7fbfa2870a60>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:32.301644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-438f7149-8fe9-4aee-a7f9-e7098155cb77 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.302128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-438f7149-8fe9-4aee-a7f9-e7098155cb77 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.305937 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-277be0a7-7dac-48bc-874f-848e146743e9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1308 microversion: 2.1 time: 0.287619 Jul 20 04:18:32.307663 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1197/2294] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:32 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1308 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:32.318787 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-438f7149-8fe9-4aee-a7f9-e7098155cb77 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2383 microversion: 2.25 time: 0.024019 Jul 20 04:18:32.332039 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1098/2295] 10.222.0.20 () {60 vars in 1183 bytes} [Wed Jul 20 04:18:32 2022] GET /compute/v2.1/os-migrations => generated 2383 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:32.346718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8f133f8d-b578-4227-b281-130c3e5b413e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:32.347841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8f133f8d-b578-4227-b281-130c3e5b413e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:32.349121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-10d5591e-b3dc-453e-a1d4-0c2c86656084 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:32.355157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-10d5591e-b3dc-453e-a1d4-0c2c86656084 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:32.367213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:32.382300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10d5591e-b3dc-453e-a1d4-0c2c86656084 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.383161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10d5591e-b3dc-453e-a1d4-0c2c86656084 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.383920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f133f8d-b578-4227-b281-130c3e5b413e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.384813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10d5591e-b3dc-453e-a1d4-0c2c86656084 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.385309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f133f8d-b578-4227-b281-130c3e5b413e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.386255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f133f8d-b578-4227-b281-130c3e5b413e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.386881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10d5591e-b3dc-453e-a1d4-0c2c86656084 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.388249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f133f8d-b578-4227-b281-130c3e5b413e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.453170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:32.524330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8f133f8d-b578-4227-b281-130c3e5b413e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:32.545684 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8f133f8d-b578-4227-b281-130c3e5b413e tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1646 microversion: 2.1 time: 0.223182 Jul 20 04:18:32.546400 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1198/2296] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:32 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1646 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:32.660895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-10d5591e-b3dc-453e-a1d4-0c2c86656084 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid cb7da181-3013-4dcb-aaeb-3fa090a01941 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:32.678273 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-10d5591e-b3dc-453e-a1d4-0c2c86656084 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 2036 microversion: 2.25 time: 0.340389 Jul 20 04:18:32.699850 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1099/2297] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:32 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 2036 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:32.711837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d4a35258-2f22-473b-8f7c-e4f3db947c39 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Action: 'create', calling method: .version_select at 0x7fbf9d1828b0>, body: {"keypair": {"name": "tempest-keypair-720293465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBegnWVXdv907ndD8pA/e1YSxe733G/djQjrk7SAd8C0SzN5MRet9GdZ8ishGGlq5c9hre8wf7wZKjGQx36kYgehIMsyrGPCRpTii6hrEmPnnOgCJfJkD2C80RVnE5fM9Q=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:32.727877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-d4a35258-2f22-473b-8f7c-e4f3db947c39 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Getting quotas for project 5181d3786af0422c928fa68ae1fd3956. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:32.734101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-d4a35258-2f22-473b-8f7c-e4f3db947c39 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Getting quotas for user b63f54e61ef144968f6c8d9cfb954c8f and project 5181d3786af0422c928fa68ae1fd3956. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:32.769012 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d4a35258-2f22-473b-8f7c-e4f3db947c39 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.061177 Jul 20 04:18:32.769654 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1199/2298] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jul 20 04:18:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 20 04:18:33.019059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-af714279-3632-4380-b001-9e6e00ccd02b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.019730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-af714279-3632-4380-b001-9e6e00ccd02b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.035125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af714279-3632-4380-b001-9e6e00ccd02b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.035828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af714279-3632-4380-b001-9e6e00ccd02b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.038551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af714279-3632-4380-b001-9e6e00ccd02b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.039440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af714279-3632-4380-b001-9e6e00ccd02b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.300794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-98728fd6-12e3-4ab3-9b1a-d0b19cc304a1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.301431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-98728fd6-12e3-4ab3-9b1a-d0b19cc304a1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.312887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98728fd6-12e3-4ab3-9b1a-d0b19cc304a1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.313350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98728fd6-12e3-4ab3-9b1a-d0b19cc304a1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.314152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98728fd6-12e3-4ab3-9b1a-d0b19cc304a1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.314603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98728fd6-12e3-4ab3-9b1a-d0b19cc304a1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.558602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-98728fd6-12e3-4ab3-9b1a-d0b19cc304a1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:33.624237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-af714279-3632-4380-b001-9e6e00ccd02b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.628620 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-98728fd6-12e3-4ab3-9b1a-d0b19cc304a1 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.331867 Jul 20 04:18:33.632639 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1200/2299] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:33 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:33.645697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a52433f-1286-49bf-abb8-65b718d68370 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.646861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a52433f-1286-49bf-abb8-65b718d68370 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.648794 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-af714279-3632-4380-b001-9e6e00ccd02b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1505 microversion: 2.1 time: 0.633859 Jul 20 04:18:33.650815 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1100/2300] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:33 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1505 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:33.663044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a52433f-1286-49bf-abb8-65b718d68370 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.663520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e46549fa-5dac-42ab-a525-5dfc32a07a4f tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.664427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a52433f-1286-49bf-abb8-65b718d68370 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.665240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e46549fa-5dac-42ab-a525-5dfc32a07a4f tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.667240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a52433f-1286-49bf-abb8-65b718d68370 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.668646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a52433f-1286-49bf-abb8-65b718d68370 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.673493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:33.686364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e46549fa-5dac-42ab-a525-5dfc32a07a4f tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.686913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e46549fa-5dac-42ab-a525-5dfc32a07a4f tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.691125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e46549fa-5dac-42ab-a525-5dfc32a07a4f tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.691619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e46549fa-5dac-42ab-a525-5dfc32a07a4f tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.901218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e46549fa-5dac-42ab-a525-5dfc32a07a4f tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770247229b22438dba9d29709710ce60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f335bb149385457d9ca74e9801e5e4fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.914107 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e46549fa-5dac-42ab-a525-5dfc32a07a4f tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 200 len: 1646 microversion: 2.1 time: 0.259844 Jul 20 04:18:33.927918 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1101/2301] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:33 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 1646 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:33.938387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96183e3a-4d70-4bba-a41b-61ba52bb27f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.948447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96183e3a-4d70-4bba-a41b-61ba52bb27f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.970984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96183e3a-4d70-4bba-a41b-61ba52bb27f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.971448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96183e3a-4d70-4bba-a41b-61ba52bb27f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.980829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96183e3a-4d70-4bba-a41b-61ba52bb27f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.989075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96183e3a-4d70-4bba-a41b-61ba52bb27f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.113416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96183e3a-4d70-4bba-a41b-61ba52bb27f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:34.391841 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-96183e3a-4d70-4bba-a41b-61ba52bb27f9 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 204 len: 0 microversion: 2.1 time: 0.462390 Jul 20 04:18:34.395979 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1102/2302] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:33 2022] DELETE /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:34.411947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ade7cd0c-5703-4a07-bd28-6ef3be442751 req-e5065522-4d3c-4752-9c33-f0aabae2e4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6460f29d-e3f7-4f4d-95e1-a374af5864c3", "name": "network-vif-deleted", "tag": "05c8c052-daed-4646-9e5e-31c92143b2d3"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:34.435989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ade7cd0c-5703-4a07-bd28-6ef3be442751 req-e5065522-4d3c-4752-9c33-f0aabae2e4df service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.438006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ade7cd0c-5703-4a07-bd28-6ef3be442751 req-e5065522-4d3c-4752-9c33-f0aabae2e4df service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.518347 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ade7cd0c-5703-4a07-bd28-6ef3be442751 req-e5065522-4d3c-4752-9c33-f0aabae2e4df service nova] Creating event network-vif-deleted:05c8c052-daed-4646-9e5e-31c92143b2d3 for instance 6460f29d-e3f7-4f4d-95e1-a374af5864c3 on n-h2-764485-11 Jul 20 04:18:34.535246 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ade7cd0c-5703-4a07-bd28-6ef3be442751 req-e5065522-4d3c-4752-9c33-f0aabae2e4df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132673 Jul 20 04:18:34.545132 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1103/2303] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:34.554100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-830c74dd-1bfd-44ea-9c63-e73394bea406 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.557536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-830c74dd-1bfd-44ea-9c63-e73394bea406 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.575587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-830c74dd-1bfd-44ea-9c63-e73394bea406 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.580915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-830c74dd-1bfd-44ea-9c63-e73394bea406 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.586496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-830c74dd-1bfd-44ea-9c63-e73394bea406 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.586954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-830c74dd-1bfd-44ea-9c63-e73394bea406 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.651535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:35.555722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5a52433f-1286-49bf-abb8-65b718d68370 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.568997 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a52433f-1286-49bf-abb8-65b718d68370 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1308 microversion: 2.1 time: 1.932203 Jul 20 04:18:35.587977 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1201/2304] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:33 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1308 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:35.603359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-491eb8bf-58ed-41f9-9f8a-d7f1f3253860 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.604879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-491eb8bf-58ed-41f9-9f8a-d7f1f3253860 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.617354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-491eb8bf-58ed-41f9-9f8a-d7f1f3253860 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.619594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-491eb8bf-58ed-41f9-9f8a-d7f1f3253860 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.620574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-491eb8bf-58ed-41f9-9f8a-d7f1f3253860 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.625488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-491eb8bf-58ed-41f9-9f8a-d7f1f3253860 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.703913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-830c74dd-1bfd-44ea-9c63-e73394bea406 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.713320 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-830c74dd-1bfd-44ea-9c63-e73394bea406 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1666 microversion: 2.1 time: 1.166854 Jul 20 04:18:35.713919 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1104/2305] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:34 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1666 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:35.734929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5137a242-69bd-4492-96f1-c935ed5ab6dd tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.736025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5137a242-69bd-4492-96f1-c935ed5ab6dd tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.752549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5137a242-69bd-4492-96f1-c935ed5ab6dd tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.755227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5137a242-69bd-4492-96f1-c935ed5ab6dd tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.756296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5137a242-69bd-4492-96f1-c935ed5ab6dd tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.758873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5137a242-69bd-4492-96f1-c935ed5ab6dd tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.861862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-491eb8bf-58ed-41f9-9f8a-d7f1f3253860 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:35.919460 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-491eb8bf-58ed-41f9-9f8a-d7f1f3253860 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.328888 Jul 20 04:18:35.924072 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1202/2306] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:35.942818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6bf1cee-c2ce-465b-b81d-3bc9685fa4c1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.943487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f6bf1cee-c2ce-465b-b81d-3bc9685fa4c1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] [instance: 6460f29d-e3f7-4f4d-95e1-a374af5864c3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.959884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6bf1cee-c2ce-465b-b81d-3bc9685fa4c1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.961815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6bf1cee-c2ce-465b-b81d-3bc9685fa4c1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.962629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6bf1cee-c2ce-465b-b81d-3bc9685fa4c1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.963083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6bf1cee-c2ce-465b-b81d-3bc9685fa4c1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.004091 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f6bf1cee-c2ce-465b-b81d-3bc9685fa4c1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] HTTP exception thrown: Instance 6460f29d-e3f7-4f4d-95e1-a374af5864c3 could not be found. Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6bf1cee-c2ce-465b-b81d-3bc9685fa4c1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Request method failure captured: Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 HTTP/1.1 Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Gewvid1napbQ35q2dzw1OoRFxDbt0XG96S0t8klu-GKQITc_qP9JJ3XvKmKtHLr8nUj61ybSPTtPB2s2C9ONRERn3j5WJS6FrUb2H9FlA3ob1xRjSsUQqHWrY5I1c0_dwHUk5ihFrXD3EkPlKVmTNdNfMsqjH9KwP4ggF00NiIDiw Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: f335bb149385457d9ca74e9801e5e4fb Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestManualDisk-2115231816 Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f335bb149385457d9ca74e9801e5e4fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f335bb149385457d9ca74e9801e5e4fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f335bb149385457d9ca74e9801e5e4fb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f335bb149385457d9ca74e9801e5e4fb"}]}] Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestManualDisk-2115231816 Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: f335bb149385457d9ca74e9801e5e4fb Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestManualDisk-2115231816 Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestManualDisk-2115231816-project Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 770247229b22438dba9d29709710ce60 Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestManualDisk-2115231816-project Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 6460f29d-e3f7-4f4d-95e1-a374af5864c3 could not be found. Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '6460f29d-e3f7-4f4d-95e1-a374af5864c3'} Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6460f29d-e3f7-4f4d-95e1-a374af5864c3 could not be found. Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6460f29d-e3f7-4f4d-95e1-a374af5864c3 could not be found. Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:36.008136 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:36.014096 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:36.014096 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:36.014096 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:36.014096 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:36.014096 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:36.014096 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6460f29d-e3f7-4f4d-95e1-a374af5864c3 could not be found. Jul 20 04:18:36.014096 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:36.014096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6bf1cee-c2ce-465b-b81d-3bc9685fa4c1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Returning 404 to user: Instance 6460f29d-e3f7-4f4d-95e1-a374af5864c3 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:36.014096 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f6bf1cee-c2ce-465b-b81d-3bc9685fa4c1 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3" status: 404 len: 111 microversion: 2.1 time: 0.087245 Jul 20 04:18:36.019899 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1203/2307] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/6460f29d-e3f7-4f4d-95e1-a374af5864c3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:36.033260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c456316e-a510-445d-9077-ad02127e8077 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] Calling method '.version_select at 0x7fbfa28b4670>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.099152 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c456316e-a510-445d-9077-ad02127e8077 tempest-ServersTestManualDisk-2115231816 tempest-ServersTestManualDisk-2115231816-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391364140" status: 202 len: 0 microversion: 2.1 time: 0.076290 Jul 20 04:18:36.104518 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1204/2308] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 04:18:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391364140 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:36.175122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5137a242-69bd-4492-96f1-c935ed5ab6dd tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.197073 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5137a242-69bd-4492-96f1-c935ed5ab6dd tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1526 microversion: 2.1 time: 0.477948 Jul 20 04:18:36.203943 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1105/2309] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1526 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:36.593007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2534fbb0-6460-4d2b-915c-e49e0637c75e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.593900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2534fbb0-6460-4d2b-915c-e49e0637c75e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.596145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-0f780ceb-75b6-4f5f-86d4-3797615b8a71 req-1084a5f2-fe50-4ee7-b6c6-147ac09b9544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2394da98-223c-4a33-8a73-6a98c5822358", "tag": "a7ab8ce3-f14f-4e01-8c65-acc3536763ec"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:36.613904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2534fbb0-6460-4d2b-915c-e49e0637c75e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.614373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2534fbb0-6460-4d2b-915c-e49e0637c75e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.615177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2534fbb0-6460-4d2b-915c-e49e0637c75e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.624687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0f780ceb-75b6-4f5f-86d4-3797615b8a71 req-1084a5f2-fe50-4ee7-b6c6-147ac09b9544 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.625997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0f780ceb-75b6-4f5f-86d4-3797615b8a71 req-1084a5f2-fe50-4ee7-b6c6-147ac09b9544 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.626346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2534fbb0-6460-4d2b-915c-e49e0637c75e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.685151 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-0f780ceb-75b6-4f5f-86d4-3797615b8a71 req-1084a5f2-fe50-4ee7-b6c6-147ac09b9544 service nova] Creating event network-changed:a7ab8ce3-f14f-4e01-8c65-acc3536763ec for instance 2394da98-223c-4a33-8a73-6a98c5822358 on n-h1-764485-11 Jul 20 04:18:36.697762 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-0f780ceb-75b6-4f5f-86d4-3797615b8a71 req-1084a5f2-fe50-4ee7-b6c6-147ac09b9544 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109910 Jul 20 04:18:36.698882 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1205/2310] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:36.739080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d960252c-58da-4b53-9a3e-9ff781bb403e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.739436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d960252c-58da-4b53-9a3e-9ff781bb403e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.753213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d960252c-58da-4b53-9a3e-9ff781bb403e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.753833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d960252c-58da-4b53-9a3e-9ff781bb403e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.755059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d960252c-58da-4b53-9a3e-9ff781bb403e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.755697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d960252c-58da-4b53-9a3e-9ff781bb403e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.272188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2534fbb0-6460-4d2b-915c-e49e0637c75e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.282569 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2534fbb0-6460-4d2b-915c-e49e0637c75e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1308 microversion: 2.1 time: 0.694937 Jul 20 04:18:37.284023 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1106/2311] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1308 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:37.299043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e2609ff-5d52-4716-b70f-98afc89ca42b tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.301841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7e2609ff-5d52-4716-b70f-98afc89ca42b tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:37.317029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e2609ff-5d52-4716-b70f-98afc89ca42b tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.319248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e2609ff-5d52-4716-b70f-98afc89ca42b tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.321593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e2609ff-5d52-4716-b70f-98afc89ca42b tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.323901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e2609ff-5d52-4716-b70f-98afc89ca42b tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.366679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d960252c-58da-4b53-9a3e-9ff781bb403e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.378612 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d960252c-58da-4b53-9a3e-9ff781bb403e tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1666 microversion: 2.1 time: 0.649593 Jul 20 04:18:37.409179 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1206/2312] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1666 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:37.427074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-98996378-3f97-4a1a-b8fd-22a7115cc32f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.427737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-98996378-3f97-4a1a-b8fd-22a7115cc32f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:37.450894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98996378-3f97-4a1a-b8fd-22a7115cc32f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.466498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98996378-3f97-4a1a-b8fd-22a7115cc32f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.467582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98996378-3f97-4a1a-b8fd-22a7115cc32f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.471449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98996378-3f97-4a1a-b8fd-22a7115cc32f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.896741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-7e2609ff-5d52-4716-b70f-98afc89ca42b tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:37.936889 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7e2609ff-5d52-4716-b70f-98afc89ca42b tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.651259 Jul 20 04:18:37.952653 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1107/2313] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:37 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:37.952653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8aed9eee-c025-4b11-b9e1-f7b0c7136c3a req-d9a44f22-e631-4a9d-bbdc-fb5d0b43940f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b275fa8-1d8e-435e-9256-5b2a33129d62", "name": "network-vif-plugged", "status": "completed", "tag": "cd19a68b-44cb-4c08-a687-f66d10df0d36"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:37.975356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8aed9eee-c025-4b11-b9e1-f7b0c7136c3a req-d9a44f22-e631-4a9d-bbdc-fb5d0b43940f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.975984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8aed9eee-c025-4b11-b9e1-f7b0c7136c3a req-d9a44f22-e631-4a9d-bbdc-fb5d0b43940f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.001235 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8aed9eee-c025-4b11-b9e1-f7b0c7136c3a req-d9a44f22-e631-4a9d-bbdc-fb5d0b43940f service nova] Creating event network-vif-plugged:cd19a68b-44cb-4c08-a687-f66d10df0d36 for instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 on n-h1-764485-11 Jul 20 04:18:38.017635 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8aed9eee-c025-4b11-b9e1-f7b0c7136c3a req-d9a44f22-e631-4a9d-bbdc-fb5d0b43940f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074737 Jul 20 04:18:38.018727 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1108/2314] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:38.303871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-80af7d89-ebdb-4e0d-90ca-8db43c6728ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:38.305298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-80af7d89-ebdb-4e0d-90ca-8db43c6728ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:38.313742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80af7d89-ebdb-4e0d-90ca-8db43c6728ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.314860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80af7d89-ebdb-4e0d-90ca-8db43c6728ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.318210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80af7d89-ebdb-4e0d-90ca-8db43c6728ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.318210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80af7d89-ebdb-4e0d-90ca-8db43c6728ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.380209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-98996378-3f97-4a1a-b8fd-22a7115cc32f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:38.400002 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-98996378-3f97-4a1a-b8fd-22a7115cc32f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1526 microversion: 2.1 time: 0.988984 Jul 20 04:18:38.400789 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1207/2315] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:37 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1526 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:38.408233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-183a4994-d2a9-4681-a5c3-fe42752db602 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:38.409074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-183a4994-d2a9-4681-a5c3-fe42752db602 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:38.424993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-183a4994-d2a9-4681-a5c3-fe42752db602 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.434251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-183a4994-d2a9-4681-a5c3-fe42752db602 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.436216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-183a4994-d2a9-4681-a5c3-fe42752db602 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.440279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-183a4994-d2a9-4681-a5c3-fe42752db602 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.786932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-183a4994-d2a9-4681-a5c3-fe42752db602 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:38.804008 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-183a4994-d2a9-4681-a5c3-fe42752db602 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 200 len: 1598 microversion: 2.1 time: 0.398704 Jul 20 04:18:38.804881 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1208/2316] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:38 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 1598 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:38.821901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2079928376", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "13fc6880-4fac-4a39-af23-98e984a520f4"}], "security_groups": [{"name": "tempest-securitygroup--789410053"}], "key_name": "tempest-keypair-720293465", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:38.985301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-80af7d89-ebdb-4e0d-90ca-8db43c6728ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:38.994086 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-80af7d89-ebdb-4e0d-90ca-8db43c6728ae tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1308 microversion: 2.1 time: 0.695760 Jul 20 04:18:39.005224 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1109/2317] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:38 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1308 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:39.021292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9772c063-3d81-430b-a7cf-474054569e3d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.021904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9772c063-3d81-430b-a7cf-474054569e3d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.036542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9772c063-3d81-430b-a7cf-474054569e3d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.037267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9772c063-3d81-430b-a7cf-474054569e3d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.038340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9772c063-3d81-430b-a7cf-474054569e3d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.038947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9772c063-3d81-430b-a7cf-474054569e3d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.345754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] validate_networks() for [('13fc6880-4fac-4a39-af23-98e984a520f4', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:39.348834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-9772c063-3d81-430b-a7cf-474054569e3d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:39.410495 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9772c063-3d81-430b-a7cf-474054569e3d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.403862 Jul 20 04:18:39.411381 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1110/2318] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:39.428537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e12219eb-9d96-478b-ba5d-6e24ebb675f9 req-381062fb-cc83-419d-968c-78cc2c4adefa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0895e78-3e18-4ab2-b966-0561a857536c", "name": "network-vif-deleted", "tag": "fb4a38b9-ae67-49b5-806c-bca8ef8b9f33"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:39.447231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e12219eb-9d96-478b-ba5d-6e24ebb675f9 req-381062fb-cc83-419d-968c-78cc2c4adefa service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.449953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e12219eb-9d96-478b-ba5d-6e24ebb675f9 req-381062fb-cc83-419d-968c-78cc2c4adefa service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.483460 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e12219eb-9d96-478b-ba5d-6e24ebb675f9 req-381062fb-cc83-419d-968c-78cc2c4adefa service nova] Creating event network-vif-deleted:fb4a38b9-ae67-49b5-806c-bca8ef8b9f33 for instance d0895e78-3e18-4ab2-b966-0561a857536c on n-h1-764485-11 Jul 20 04:18:39.492303 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e12219eb-9d96-478b-ba5d-6e24ebb675f9 req-381062fb-cc83-419d-968c-78cc2c4adefa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073983 Jul 20 04:18:39.497662 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1111/2319] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:39.507145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2a3dcf92-9c4c-458b-ae48-c582bc909690 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.507881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2a3dcf92-9c4c-458b-ae48-c582bc909690 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.524966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a3dcf92-9c4c-458b-ae48-c582bc909690 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.525958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a3dcf92-9c4c-458b-ae48-c582bc909690 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.527235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a3dcf92-9c4c-458b-ae48-c582bc909690 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.529532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a3dcf92-9c4c-458b-ae48-c582bc909690 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.417469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2a3dcf92-9c4c-458b-ae48-c582bc909690 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.433261 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2a3dcf92-9c4c-458b-ae48-c582bc909690 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1526 microversion: 2.1 time: 0.933549 Jul 20 04:18:40.447706 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1112/2320] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1526 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:40.447706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-801213ac-f5dc-4bad-85ca-4506866036cd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.447706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-801213ac-f5dc-4bad-85ca-4506866036cd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: d0895e78-3e18-4ab2-b966-0561a857536c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.465386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-801213ac-f5dc-4bad-85ca-4506866036cd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.466524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-801213ac-f5dc-4bad-85ca-4506866036cd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.467399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-801213ac-f5dc-4bad-85ca-4506866036cd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.468903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-801213ac-f5dc-4bad-85ca-4506866036cd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.494355 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-801213ac-f5dc-4bad-85ca-4506866036cd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] HTTP exception thrown: Instance d0895e78-3e18-4ab2-b966-0561a857536c could not be found. Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-801213ac-f5dc-4bad-85ca-4506866036cd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Request method failure captured: Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c HTTP/1.1 Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14BRix5w6xVSgcgOsOksDcg0wMc1wfRQXEBFxlragbURj-fVZLEdITgDL85k9tP-gWDuDVZmK_o-XAUK80Dg_ZocG9xlvP8P3GahPvov_cu7B3mq5RFUvz37paH4WkSp50g_t6VCBAn8nuKEiecs3H5n6-qBu1yb3Ngs8RIirJsyvZQ Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 14ab6d1260864919b0f1b6d536fe65ae Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-LiveMigrationTest-1040157573 Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14ab6d1260864919b0f1b6d536fe65ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14ab6d1260864919b0f1b6d536fe65ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14ab6d1260864919b0f1b6d536fe65ae", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14ab6d1260864919b0f1b6d536fe65ae"}]}] Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-LiveMigrationTest-1040157573 Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 14ab6d1260864919b0f1b6d536fe65ae Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-LiveMigrationTest-1040157573 Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-LiveMigrationTest-1040157573-project Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: f94d458feafa4ec28c50a04fc2b2a1f4 Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-LiveMigrationTest-1040157573-project Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance d0895e78-3e18-4ab2-b966-0561a857536c could not be found. Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'd0895e78-3e18-4ab2-b966-0561a857536c'} Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0895e78-3e18-4ab2-b966-0561a857536c could not be found. Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0895e78-3e18-4ab2-b966-0561a857536c could not be found. Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:40.501674 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:40.508131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:40.508131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:40.508131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:40.508131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:40.508131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:40.508131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0895e78-3e18-4ab2-b966-0561a857536c could not be found. Jul 20 04:18:40.508131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:18:40.508131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-801213ac-f5dc-4bad-85ca-4506866036cd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Returning 404 to user: Instance d0895e78-3e18-4ab2-b966-0561a857536c could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:40.508131 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-801213ac-f5dc-4bad-85ca-4506866036cd tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c" status: 404 len: 111 microversion: 2.1 time: 0.062743 Jul 20 04:18:40.508131 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1113/2321] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/d0895e78-3e18-4ab2-b966-0561a857536c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:40.514510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8064c95f-c46e-4feb-bfee-49b583a45c14 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.516363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8064c95f-c46e-4feb-bfee-49b583a45c14 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.530837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8064c95f-c46e-4feb-bfee-49b583a45c14 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.531673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8064c95f-c46e-4feb-bfee-49b583a45c14 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.532668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8064c95f-c46e-4feb-bfee-49b583a45c14 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.534131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8064c95f-c46e-4feb-bfee-49b583a45c14 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.826825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:40.827739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:40.828302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:40.828734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:40.829208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:40.856164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.856636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.857448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.872198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.916514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Getting quotas for project 5181d3786af0422c928fa68ae1fd3956. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:40.928353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Getting quotas for user b63f54e61ef144968f6c8d9cfb954c8f and project 5181d3786af0422c928fa68ae1fd3956. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:40.966910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:40.971136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:41.107590 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0930a10d-ab4e-4b9e-9025-3d3ba09aa02e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.290637 Jul 20 04:18:41.118092 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1209/2322] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:18:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 2302 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:18:41.141088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7c80be3a-6888-4ab5-aa0a-f074847d6222 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.144606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7c80be3a-6888-4ab5-aa0a-f074847d6222 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.174384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7c80be3a-6888-4ab5-aa0a-f074847d6222 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.187625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7c80be3a-6888-4ab5-aa0a-f074847d6222 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.189600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7c80be3a-6888-4ab5-aa0a-f074847d6222 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.190091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7c80be3a-6888-4ab5-aa0a-f074847d6222 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.365631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-7c80be3a-6888-4ab5-aa0a-f074847d6222 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:41.372764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8064c95f-c46e-4feb-bfee-49b583a45c14 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.385747 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8064c95f-c46e-4feb-bfee-49b583a45c14 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1308 microversion: 2.1 time: 0.877382 Jul 20 04:18:41.393088 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1114/2323] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1308 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:41.400697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f8a28c75-799f-4c9c-8856-82fb19af8f42 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '.version_select at 0x7fbfa2909e50>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.425283 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7c80be3a-6888-4ab5-aa0a-f074847d6222 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.305414 Jul 20 04:18:41.441821 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1210/2324] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:41.453784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4faf8280-9a2b-4004-acee-be5800faeb3f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.457744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4faf8280-9a2b-4004-acee-be5800faeb3f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.459720 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f8a28c75-799f-4c9c-8856-82fb19af8f42 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-120088815" status: 202 len: 0 microversion: 2.1 time: 0.064345 Jul 20 04:18:41.464889 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1115/2325] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 20 04:18:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-120088815 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:41.489785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-92d8c8e0-c893-4058-a864-dcf814e4311f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.492598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92d8c8e0-c893-4058-a864-dcf814e4311f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.516517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92d8c8e0-c893-4058-a864-dcf814e4311f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.518829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92d8c8e0-c893-4058-a864-dcf814e4311f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.520520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92d8c8e0-c893-4058-a864-dcf814e4311f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.521742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92d8c8e0-c893-4058-a864-dcf814e4311f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.831600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4faf8280-9a2b-4004-acee-be5800faeb3f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.848992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4faf8280-9a2b-4004-acee-be5800faeb3f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.853880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4faf8280-9a2b-4004-acee-be5800faeb3f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.859188 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4faf8280-9a2b-4004-acee-be5800faeb3f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1285 microversion: 2.25 time: 0.414408 Jul 20 04:18:41.861231 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1211/2326] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1285 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:42.136133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-92d8c8e0-c893-4058-a864-dcf814e4311f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.156239 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-92d8c8e0-c893-4058-a864-dcf814e4311f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 0.679998 Jul 20 04:18:42.156967 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1116/2327] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:42.412647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-410bc1db-5f09-47f8-b903-36f84f344619 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:42.413788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-410bc1db-5f09-47f8-b903-36f84f344619 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:42.431415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-410bc1db-5f09-47f8-b903-36f84f344619 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.431907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-410bc1db-5f09-47f8-b903-36f84f344619 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.440398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-410bc1db-5f09-47f8-b903-36f84f344619 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.445463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-410bc1db-5f09-47f8-b903-36f84f344619 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.447672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c16d5796-9f6a-475e-aea3-29fa42f01c2f tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:42.448292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c16d5796-9f6a-475e-aea3-29fa42f01c2f tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:42.465974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c16d5796-9f6a-475e-aea3-29fa42f01c2f tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.466774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c16d5796-9f6a-475e-aea3-29fa42f01c2f tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.468069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c16d5796-9f6a-475e-aea3-29fa42f01c2f tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.469077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c16d5796-9f6a-475e-aea3-29fa42f01c2f tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.834589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-c16d5796-9f6a-475e-aea3-29fa42f01c2f tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:42.882148 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c16d5796-9f6a-475e-aea3-29fa42f01c2f tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.438106 Jul 20 04:18:42.883045 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1117/2328] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:42 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:42.898165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9580f817-63ce-4bf1-ac16-374ce414e7cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:42.899080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9580f817-63ce-4bf1-ac16-374ce414e7cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:42.910397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9580f817-63ce-4bf1-ac16-374ce414e7cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.916281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9580f817-63ce-4bf1-ac16-374ce414e7cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.917647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9580f817-63ce-4bf1-ac16-374ce414e7cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.918297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9580f817-63ce-4bf1-ac16-374ce414e7cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.145806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9580f817-63ce-4bf1-ac16-374ce414e7cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.161844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9580f817-63ce-4bf1-ac16-374ce414e7cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.165293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9580f817-63ce-4bf1-ac16-374ce414e7cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.169678 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9580f817-63ce-4bf1-ac16-374ce414e7cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1337 microversion: 2.25 time: 0.285185 Jul 20 04:18:43.183000 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1118/2329] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:42 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1337 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:43.198384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eed85d17-58cf-431d-9ca8-8803d7e3a1aa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.199033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eed85d17-58cf-431d-9ca8-8803d7e3a1aa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.222336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eed85d17-58cf-431d-9ca8-8803d7e3a1aa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.222791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eed85d17-58cf-431d-9ca8-8803d7e3a1aa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.223615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eed85d17-58cf-431d-9ca8-8803d7e3a1aa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.224115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eed85d17-58cf-431d-9ca8-8803d7e3a1aa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.447245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-410bc1db-5f09-47f8-b903-36f84f344619 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.458120 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-410bc1db-5f09-47f8-b903-36f84f344619 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1308 microversion: 2.1 time: 1.052192 Jul 20 04:18:43.469072 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1212/2330] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:42 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1308 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:43.659291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-5a2b2f76-4a11-4521-9f63-b78bd3cfa425 req-4ae8ce40-06ff-442a-b9f4-5f0a3bccbe9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2394da98-223c-4a33-8a73-6a98c5822358", "name": "network-vif-plugged", "status": "completed", "tag": "a7ab8ce3-f14f-4e01-8c65-acc3536763ec"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:43.707426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5a2b2f76-4a11-4521-9f63-b78bd3cfa425 req-4ae8ce40-06ff-442a-b9f4-5f0a3bccbe9d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.711116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5a2b2f76-4a11-4521-9f63-b78bd3cfa425 req-4ae8ce40-06ff-442a-b9f4-5f0a3bccbe9d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.769858 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-5a2b2f76-4a11-4521-9f63-b78bd3cfa425 req-4ae8ce40-06ff-442a-b9f4-5f0a3bccbe9d service nova] Creating event network-vif-plugged:a7ab8ce3-f14f-4e01-8c65-acc3536763ec for instance 2394da98-223c-4a33-8a73-6a98c5822358 on n-h1-764485-11 Jul 20 04:18:43.781827 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-5a2b2f76-4a11-4521-9f63-b78bd3cfa425 req-4ae8ce40-06ff-442a-b9f4-5f0a3bccbe9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127159 Jul 20 04:18:43.782464 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1213/2331] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:43.904728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-222d7b43-a06c-48ad-ae5f-7428b31c0ef0 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.905687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-222d7b43-a06c-48ad-ae5f-7428b31c0ef0 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.921419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-222d7b43-a06c-48ad-ae5f-7428b31c0ef0 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.922284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-222d7b43-a06c-48ad-ae5f-7428b31c0ef0 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.923304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-222d7b43-a06c-48ad-ae5f-7428b31c0ef0 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.926243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-222d7b43-a06c-48ad-ae5f-7428b31c0ef0 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.993720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eed85d17-58cf-431d-9ca8-8803d7e3a1aa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.004127 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eed85d17-58cf-431d-9ca8-8803d7e3a1aa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 0.819202 Jul 20 04:18:44.011547 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1119/2332] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:43 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:44.083249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-222d7b43-a06c-48ad-ae5f-7428b31c0ef0 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:44.130405 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-222d7b43-a06c-48ad-ae5f-7428b31c0ef0 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.231191 Jul 20 04:18:44.131342 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1214/2333] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:43 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:44.197162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b8339f01-169d-40e4-9253-867d6aa05893 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:44.198472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b8339f01-169d-40e4-9253-867d6aa05893 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:44.234619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8339f01-169d-40e4-9253-867d6aa05893 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.236113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8339f01-169d-40e4-9253-867d6aa05893 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.237782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8339f01-169d-40e4-9253-867d6aa05893 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.239433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8339f01-169d-40e4-9253-867d6aa05893 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.493971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-79128534-3084-466a-9861-4441d6f45d5a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:44.495059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-79128534-3084-466a-9861-4441d6f45d5a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:44.527842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79128534-3084-466a-9861-4441d6f45d5a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.533238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79128534-3084-466a-9861-4441d6f45d5a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.537059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79128534-3084-466a-9861-4441d6f45d5a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.539877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79128534-3084-466a-9861-4441d6f45d5a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.808949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b8339f01-169d-40e4-9253-867d6aa05893 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.832928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b8339f01-169d-40e4-9253-867d6aa05893 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.840954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b8339f01-169d-40e4-9253-867d6aa05893 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.842709 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b8339f01-169d-40e4-9253-867d6aa05893 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1343 microversion: 2.25 time: 0.652037 Jul 20 04:18:44.847708 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1120/2334] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:44 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1343 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:45.061068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-81483218-982a-4146-80b5-5293e98d4954 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.063003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-81483218-982a-4146-80b5-5293e98d4954 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.080135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81483218-982a-4146-80b5-5293e98d4954 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.080892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81483218-982a-4146-80b5-5293e98d4954 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.082337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81483218-982a-4146-80b5-5293e98d4954 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.083213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81483218-982a-4146-80b5-5293e98d4954 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.097439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-79128534-3084-466a-9861-4441d6f45d5a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.108218 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-79128534-3084-466a-9861-4441d6f45d5a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1308 microversion: 2.1 time: 0.635537 Jul 20 04:18:45.120681 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1215/2335] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:44 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1308 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:45.150345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bbef65b4-02e5-4a55-978a-ac160c9d2438 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.150966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bbef65b4-02e5-4a55-978a-ac160c9d2438 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.180906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bbef65b4-02e5-4a55-978a-ac160c9d2438 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.181346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bbef65b4-02e5-4a55-978a-ac160c9d2438 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.182369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bbef65b4-02e5-4a55-978a-ac160c9d2438 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.182981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bbef65b4-02e5-4a55-978a-ac160c9d2438 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.498038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-bbef65b4-02e5-4a55-978a-ac160c9d2438 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:45.545787 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bbef65b4-02e5-4a55-978a-ac160c9d2438 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.395964 Jul 20 04:18:45.553924 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1216/2336] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:45.560704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b1775b6d-0215-4e35-b2c5-61cf7336516b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.561451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b1775b6d-0215-4e35-b2c5-61cf7336516b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.581132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1775b6d-0215-4e35-b2c5-61cf7336516b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.582390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1775b6d-0215-4e35-b2c5-61cf7336516b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.583230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1775b6d-0215-4e35-b2c5-61cf7336516b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.583719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1775b6d-0215-4e35-b2c5-61cf7336516b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.648674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b1775b6d-0215-4e35-b2c5-61cf7336516b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:45.687588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:45.867717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-81483218-982a-4146-80b5-5293e98d4954 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.876524 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-81483218-982a-4146-80b5-5293e98d4954 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 0.836911 Jul 20 04:18:45.883541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:45.888433 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1121/2337] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:45.894217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aa36af23-9167-4c73-b5f5-26f75da98bb3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.894823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aa36af23-9167-4c73-b5f5-26f75da98bb3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.895929 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b1775b6d-0215-4e35-b2c5-61cf7336516b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 204 len: 0 microversion: 2.1 time: 0.339144 Jul 20 04:18:45.900229 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1217/2338] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:45 2022] DELETE /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:45.912806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9d4d16b-b525-4045-aac2-190def33f6eb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.921084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9d4d16b-b525-4045-aac2-190def33f6eb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.923834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa36af23-9167-4c73-b5f5-26f75da98bb3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.924303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa36af23-9167-4c73-b5f5-26f75da98bb3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.925107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa36af23-9167-4c73-b5f5-26f75da98bb3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.925558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa36af23-9167-4c73-b5f5-26f75da98bb3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.939152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9d4d16b-b525-4045-aac2-190def33f6eb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.943618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9d4d16b-b525-4045-aac2-190def33f6eb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.949663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9d4d16b-b525-4045-aac2-190def33f6eb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.955864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9d4d16b-b525-4045-aac2-190def33f6eb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.959113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aa36af23-9167-4c73-b5f5-26f75da98bb3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.977656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aa36af23-9167-4c73-b5f5-26f75da98bb3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.979295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9d4d16b-b525-4045-aac2-190def33f6eb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.982664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aa36af23-9167-4c73-b5f5-26f75da98bb3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.987337 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aa36af23-9167-4c73-b5f5-26f75da98bb3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1410 microversion: 2.25 time: 1.096420 Jul 20 04:18:46.988981 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1122/2339] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1410 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:46.992764 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9d4d16b-b525-4045-aac2-190def33f6eb tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1485 microversion: 2.1 time: 1.085032 Jul 20 04:18:46.998679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-124b1adb-ce5a-42b7-8dab-027f2300a7fa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.004749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-124b1adb-ce5a-42b7-8dab-027f2300a7fa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.007952 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1218/2340] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1485 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:47.016861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c9aaee04-c7d4-4d0e-91e7-928476413987 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.017787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c9aaee04-c7d4-4d0e-91e7-928476413987 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.019490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-124b1adb-ce5a-42b7-8dab-027f2300a7fa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.020175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-124b1adb-ce5a-42b7-8dab-027f2300a7fa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.024997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-124b1adb-ce5a-42b7-8dab-027f2300a7fa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.025843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-124b1adb-ce5a-42b7-8dab-027f2300a7fa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.033121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9aaee04-c7d4-4d0e-91e7-928476413987 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.033580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9aaee04-c7d4-4d0e-91e7-928476413987 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.037624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9aaee04-c7d4-4d0e-91e7-928476413987 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.038454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9aaee04-c7d4-4d0e-91e7-928476413987 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.091692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:47.402910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-c9aaee04-c7d4-4d0e-91e7-928476413987 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:47.486240 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c9aaee04-c7d4-4d0e-91e7-928476413987 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.479242 Jul 20 04:18:47.489062 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1219/2341] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:47.493973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-643e83bf-34d9-4a54-a506-8f792935121e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.520471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-643e83bf-34d9-4a54-a506-8f792935121e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.545378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-643e83bf-34d9-4a54-a506-8f792935121e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.546099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-643e83bf-34d9-4a54-a506-8f792935121e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.547091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-643e83bf-34d9-4a54-a506-8f792935121e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.549849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-643e83bf-34d9-4a54-a506-8f792935121e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.927871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-124b1adb-ce5a-42b7-8dab-027f2300a7fa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:47.944888 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-124b1adb-ce5a-42b7-8dab-027f2300a7fa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1487 microversion: 2.1 time: 0.954187 Jul 20 04:18:47.946405 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1123/2342] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1487 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:47.964704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d7dfeeda-5569-4cd2-b09c-ae6323b68257 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:47.966332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d7dfeeda-5569-4cd2-b09c-ae6323b68257 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.975986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7dfeeda-5569-4cd2-b09c-ae6323b68257 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.984157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7dfeeda-5569-4cd2-b09c-ae6323b68257 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.985696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7dfeeda-5569-4cd2-b09c-ae6323b68257 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.987613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7dfeeda-5569-4cd2-b09c-ae6323b68257 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.296161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-643e83bf-34d9-4a54-a506-8f792935121e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.321069 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-643e83bf-34d9-4a54-a506-8f792935121e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 0.827348 Jul 20 04:18:48.322379 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1220/2343] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:48.331637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02bd2224-739e-4542-8b45-bfc63912499f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.335884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-02bd2224-739e-4542-8b45-bfc63912499f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.353302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02bd2224-739e-4542-8b45-bfc63912499f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.354047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02bd2224-739e-4542-8b45-bfc63912499f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.355678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02bd2224-739e-4542-8b45-bfc63912499f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.358525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02bd2224-739e-4542-8b45-bfc63912499f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.459706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-d7dfeeda-5569-4cd2-b09c-ae6323b68257 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lazy-loading 'flavor' on Instance uuid 2394da98-223c-4a33-8a73-6a98c5822358 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:48.801598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-02bd2224-739e-4542-8b45-bfc63912499f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.822022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-02bd2224-739e-4542-8b45-bfc63912499f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.837600 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d7dfeeda-5569-4cd2-b09c-ae6323b68257 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "POST /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358/action" status: 202 len: 0 microversion: 2.1 time: 0.872243 Jul 20 04:18:48.842406 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1124/2344] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:47 2022] POST /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358/action => generated 0 bytes in 884 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:18:48.873703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-02bd2224-739e-4542-8b45-bfc63912499f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.888929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9009557-f43a-4c7c-a58a-584788f415b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.891123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a9009557-f43a-4c7c-a58a-584788f415b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.895079 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-02bd2224-739e-4542-8b45-bfc63912499f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1410 microversion: 2.25 time: 0.561788 Jul 20 04:18:48.896008 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1221/2345] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1410 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:48.917088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6ef375d1-07df-4dbf-a23f-434432d46f80 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.919625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9009557-f43a-4c7c-a58a-584788f415b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.920787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9009557-f43a-4c7c-a58a-584788f415b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.923385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9009557-f43a-4c7c-a58a-584788f415b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.924726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9009557-f43a-4c7c-a58a-584788f415b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.925321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6ef375d1-07df-4dbf-a23f-434432d46f80 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.961954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ef375d1-07df-4dbf-a23f-434432d46f80 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.963240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ef375d1-07df-4dbf-a23f-434432d46f80 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.967648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ef375d1-07df-4dbf-a23f-434432d46f80 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.971395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ef375d1-07df-4dbf-a23f-434432d46f80 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.186678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a9009557-f43a-4c7c-a58a-584788f415b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.195210 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a9009557-f43a-4c7c-a58a-584788f415b5 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 200 len: 1281 microversion: 2.1 time: 0.343883 Jul 20 04:18:49.198517 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1125/2346] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 1281 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:49.212031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-56903438-c06f-43b0-bcac-9beb3db5e80a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.212649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-56903438-c06f-43b0-bcac-9beb3db5e80a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.235416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-6ef375d1-07df-4dbf-a23f-434432d46f80 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:49.241990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56903438-c06f-43b0-bcac-9beb3db5e80a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.242462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56903438-c06f-43b0-bcac-9beb3db5e80a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.243252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56903438-c06f-43b0-bcac-9beb3db5e80a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.251456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56903438-c06f-43b0-bcac-9beb3db5e80a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.282666 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6ef375d1-07df-4dbf-a23f-434432d46f80 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.383623 Jul 20 04:18:49.283269 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1222/2347] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:49.360036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-46bf5559-0bbb-413f-a2f2-6fd57ae70f08 req-d69ccbc4-7b00-49ba-8366-393f312f887b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e603c0-187a-46e9-a4c5-da5f3d5e9170", "name": "network-vif-deleted", "tag": "bd71d3a7-7615-4097-8805-ca1d231d551c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:49.379132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-46bf5559-0bbb-413f-a2f2-6fd57ae70f08 req-d69ccbc4-7b00-49ba-8366-393f312f887b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.380378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-46bf5559-0bbb-413f-a2f2-6fd57ae70f08 req-d69ccbc4-7b00-49ba-8366-393f312f887b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.414278 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-46bf5559-0bbb-413f-a2f2-6fd57ae70f08 req-d69ccbc4-7b00-49ba-8366-393f312f887b service nova] Creating event network-vif-deleted:bd71d3a7-7615-4097-8805-ca1d231d551c for instance c7e603c0-187a-46e9-a4c5-da5f3d5e9170 on n-h1-764485-11 Jul 20 04:18:49.421174 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-46bf5559-0bbb-413f-a2f2-6fd57ae70f08 req-d69ccbc4-7b00-49ba-8366-393f312f887b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099836 Jul 20 04:18:49.422722 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1223/2348] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:49.430363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-848fcfc1-f60c-42f9-aefb-3e9f765178e4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.431633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-848fcfc1-f60c-42f9-aefb-3e9f765178e4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.441831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-848fcfc1-f60c-42f9-aefb-3e9f765178e4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.442852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-848fcfc1-f60c-42f9-aefb-3e9f765178e4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.446553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-848fcfc1-f60c-42f9-aefb-3e9f765178e4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.447916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-848fcfc1-f60c-42f9-aefb-3e9f765178e4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.053947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-56903438-c06f-43b0-bcac-9beb3db5e80a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:50.062608 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-56903438-c06f-43b0-bcac-9beb3db5e80a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1495 microversion: 2.1 time: 0.862938 Jul 20 04:18:50.067028 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1126/2349] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1495 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:50.081042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d16321a0-39d0-412f-9e60-8cc8f7525330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.082045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d16321a0-39d0-412f-9e60-8cc8f7525330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.095533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d16321a0-39d0-412f-9e60-8cc8f7525330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.096335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d16321a0-39d0-412f-9e60-8cc8f7525330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.097347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d16321a0-39d0-412f-9e60-8cc8f7525330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.097964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d16321a0-39d0-412f-9e60-8cc8f7525330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.272255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-848fcfc1-f60c-42f9-aefb-3e9f765178e4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:50.283483 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-848fcfc1-f60c-42f9-aefb-3e9f765178e4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 0.858817 Jul 20 04:18:50.288587 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1224/2350] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:50.297395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6541d10-ec26-47c4-9ecf-c87c8cc4b7de tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.298258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c6541d10-ec26-47c4-9ecf-c87c8cc4b7de tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: c7e603c0-187a-46e9-a4c5-da5f3d5e9170] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.313107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6541d10-ec26-47c4-9ecf-c87c8cc4b7de tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.313568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6541d10-ec26-47c4-9ecf-c87c8cc4b7de tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.314429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6541d10-ec26-47c4-9ecf-c87c8cc4b7de tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.314869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6541d10-ec26-47c4-9ecf-c87c8cc4b7de tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.354535 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-c6541d10-ec26-47c4-9ecf-c87c8cc4b7de tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] HTTP exception thrown: Instance c7e603c0-187a-46e9-a4c5-da5f3d5e9170 could not be found. Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6541d10-ec26-47c4-9ecf-c87c8cc4b7de tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Request method failure captured: Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 HTTP/1.1 Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BRix5w6xVSgcgOsOksDcg0wMc1wfRQXEBFxlragbURj-fVZLEdITgDL85k9tP-gWDuDVZmK_o-XAUK80Dg_ZocG9xlvP8P3GahPvov_cu7B3mq5RFUvz37paH4WkSp50g_t6VCBAn8nuKEiecs3H5n6-qBu1yb3Ngs8RIirJsyvZQ Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 14ab6d1260864919b0f1b6d536fe65ae Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-LiveMigrationTest-1040157573 Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14ab6d1260864919b0f1b6d536fe65ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14ab6d1260864919b0f1b6d536fe65ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14ab6d1260864919b0f1b6d536fe65ae", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14ab6d1260864919b0f1b6d536fe65ae"}]}] Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-LiveMigrationTest-1040157573 Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 14ab6d1260864919b0f1b6d536fe65ae Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-LiveMigrationTest-1040157573 Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-LiveMigrationTest-1040157573-project Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: f94d458feafa4ec28c50a04fc2b2a1f4 Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-LiveMigrationTest-1040157573-project Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance c7e603c0-187a-46e9-a4c5-da5f3d5e9170 could not be found. Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'c7e603c0-187a-46e9-a4c5-da5f3d5e9170'} Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e603c0-187a-46e9-a4c5-da5f3d5e9170 could not be found. Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e603c0-187a-46e9-a4c5-da5f3d5e9170 could not be found. Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:50.357224 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:50.366584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:50.366584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:50.366584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:50.366584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:50.366584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:50.366584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e603c0-187a-46e9-a4c5-da5f3d5e9170 could not be found. Jul 20 04:18:50.366584 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:50.366584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6541d10-ec26-47c4-9ecf-c87c8cc4b7de tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Returning 404 to user: Instance c7e603c0-187a-46e9-a4c5-da5f3d5e9170 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:50.366584 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c6541d10-ec26-47c4-9ecf-c87c8cc4b7de tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170" status: 404 len: 111 microversion: 2.1 time: 0.068754 Jul 20 04:18:50.371924 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1225/2351] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:50 2022] GET /compute/v2.1/servers/c7e603c0-187a-46e9-a4c5-da5f3d5e9170 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:50.376931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-12d7e4cc-1e7a-415e-a57c-73b05b18d7cd tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.377560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-12d7e4cc-1e7a-415e-a57c-73b05b18d7cd tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.400964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12d7e4cc-1e7a-415e-a57c-73b05b18d7cd tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.401420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12d7e4cc-1e7a-415e-a57c-73b05b18d7cd tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.402774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12d7e4cc-1e7a-415e-a57c-73b05b18d7cd tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.406202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12d7e4cc-1e7a-415e-a57c-73b05b18d7cd tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.566753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d16321a0-39d0-412f-9e60-8cc8f7525330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:50.584654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d16321a0-39d0-412f-9e60-8cc8f7525330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:50.587559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d16321a0-39d0-412f-9e60-8cc8f7525330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:50.594005 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d16321a0-39d0-412f-9e60-8cc8f7525330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1410 microversion: 2.25 time: 0.525405 Jul 20 04:18:50.594596 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1127/2352] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:50 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1410 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:50.617159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-49855c3c-2d1b-4cc9-b290-cc7524382c53 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.617672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-49855c3c-2d1b-4cc9-b290-cc7524382c53 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.641422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49855c3c-2d1b-4cc9-b290-cc7524382c53 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.649899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49855c3c-2d1b-4cc9-b290-cc7524382c53 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.652932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49855c3c-2d1b-4cc9-b290-cc7524382c53 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.654021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49855c3c-2d1b-4cc9-b290-cc7524382c53 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.679936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-12d7e4cc-1e7a-415e-a57c-73b05b18d7cd tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:50.732665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-49855c3c-2d1b-4cc9-b290-cc7524382c53 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:50.743728 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-12d7e4cc-1e7a-415e-a57c-73b05b18d7cd tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.367308 Jul 20 04:18:50.746356 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1226/2353] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:50 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:51.007747 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-49855c3c-2d1b-4cc9-b290-cc7524382c53 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 204 len: 0 microversion: 2.1 time: 0.397168 Jul 20 04:18:51.008874 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1128/2354] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:50 2022] DELETE /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:51.020336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9d293db-b7cf-40db-b87e-9c97384d39b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.021014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a9d293db-b7cf-40db-b87e-9c97384d39b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.032324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:51.037382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9d293db-b7cf-40db-b87e-9c97384d39b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.042560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9d293db-b7cf-40db-b87e-9c97384d39b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.045881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9d293db-b7cf-40db-b87e-9c97384d39b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.048660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9d293db-b7cf-40db-b87e-9c97384d39b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.085483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cb4fc462-0819-49c6-833e-344d6cc860ff tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.086691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cb4fc462-0819-49c6-833e-344d6cc860ff tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.099494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb4fc462-0819-49c6-833e-344d6cc860ff tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.100396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb4fc462-0819-49c6-833e-344d6cc860ff tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.102169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb4fc462-0819-49c6-833e-344d6cc860ff tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.108131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb4fc462-0819-49c6-833e-344d6cc860ff tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.831320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cb4fc462-0819-49c6-833e-344d6cc860ff tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:51.840721 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cb4fc462-0819-49c6-833e-344d6cc860ff tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 200 len: 1478 microversion: 2.1 time: 0.759267 Jul 20 04:18:51.841767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=12 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:51.857232 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1129/2355] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 1478 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:51.862433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9d293db-b7cf-40db-b87e-9c97384d39b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:51.863284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9190ac0b-c65c-4492-9ea0-9e6b31f9acc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.866892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9190ac0b-c65c-4492-9ea0-9e6b31f9acc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.875355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9190ac0b-c65c-4492-9ea0-9e6b31f9acc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.876320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9190ac0b-c65c-4492-9ea0-9e6b31f9acc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.877304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9190ac0b-c65c-4492-9ea0-9e6b31f9acc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.878174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9190ac0b-c65c-4492-9ea0-9e6b31f9acc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.889464 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a9d293db-b7cf-40db-b87e-9c97384d39b1 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1500 microversion: 2.1 time: 0.869546 Jul 20 04:18:51.891132 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1227/2356] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1500 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:51.926361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-862cd27b-4b98-444b-b83f-b3a1f4b0fc21 req-8cdbfadc-e817-4649-b95c-45d82c14429f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d80a59-9d6b-4b94-a643-8f6727f50511", "tag": "a43b1718-8133-4ab5-802a-5f461293d0fd"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:51.971223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-862cd27b-4b98-444b-b83f-b3a1f4b0fc21 req-8cdbfadc-e817-4649-b95c-45d82c14429f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.978365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-862cd27b-4b98-444b-b83f-b3a1f4b0fc21 req-8cdbfadc-e817-4649-b95c-45d82c14429f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.026209 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-862cd27b-4b98-444b-b83f-b3a1f4b0fc21 req-8cdbfadc-e817-4649-b95c-45d82c14429f service nova] Creating event network-changed:a43b1718-8133-4ab5-802a-5f461293d0fd for instance 57d80a59-9d6b-4b94-a643-8f6727f50511 on n-h2-764485-11 Jul 20 04:18:52.051549 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-862cd27b-4b98-444b-b83f-b3a1f4b0fc21 req-8cdbfadc-e817-4649-b95c-45d82c14429f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156559 Jul 20 04:18:52.052349 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1228/2357] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:52.059813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d850a2d3-928e-41fb-ada3-62bc5e4ea319 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:52.061166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d850a2d3-928e-41fb-ada3-62bc5e4ea319 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.068704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d850a2d3-928e-41fb-ada3-62bc5e4ea319 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.069405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d850a2d3-928e-41fb-ada3-62bc5e4ea319 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.070713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d850a2d3-928e-41fb-ada3-62bc5e4ea319 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.071322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d850a2d3-928e-41fb-ada3-62bc5e4ea319 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.371070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d850a2d3-928e-41fb-ada3-62bc5e4ea319 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.386028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d850a2d3-928e-41fb-ada3-62bc5e4ea319 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.389853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d850a2d3-928e-41fb-ada3-62bc5e4ea319 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.398718 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d850a2d3-928e-41fb-ada3-62bc5e4ea319 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1410 microversion: 2.25 time: 0.338845 Jul 20 04:18:52.399438 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1229/2358] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:52 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1410 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:52.410351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-72351b98-43b6-4380-8da9-25d648daca0d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:52.413641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-72351b98-43b6-4380-8da9-25d648daca0d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.431103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72351b98-43b6-4380-8da9-25d648daca0d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.431657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72351b98-43b6-4380-8da9-25d648daca0d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.432645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72351b98-43b6-4380-8da9-25d648daca0d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.436596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72351b98-43b6-4380-8da9-25d648daca0d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.651650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9190ac0b-c65c-4492-9ea0-9e6b31f9acc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.691845 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9190ac0b-c65c-4492-9ea0-9e6b31f9acc0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 0.832888 Jul 20 04:18:52.717306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-72351b98-43b6-4380-8da9-25d648daca0d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:52.719811 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1130/2359] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:52.725023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9ab4f30-827c-42f6-8631-fbb5086c376c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1790237673"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:52.726396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a9ab4f30-827c-42f6-8631-fbb5086c376c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.735660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9ab4f30-827c-42f6-8631-fbb5086c376c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.736412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9ab4f30-827c-42f6-8631-fbb5086c376c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.737393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9ab4f30-827c-42f6-8631-fbb5086c376c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.738007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9ab4f30-827c-42f6-8631-fbb5086c376c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.766081 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-72351b98-43b6-4380-8da9-25d648daca0d tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.361888 Jul 20 04:18:52.779269 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1230/2360] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:52 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:52.909542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ca937ca8-dc26-4f36-b31d-c957b84538e7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:52.912081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca937ca8-dc26-4f36-b31d-c957b84538e7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.923224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca937ca8-dc26-4f36-b31d-c957b84538e7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.930118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca937ca8-dc26-4f36-b31d-c957b84538e7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.935242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca937ca8-dc26-4f36-b31d-c957b84538e7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.935965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca937ca8-dc26-4f36-b31d-c957b84538e7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.507936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ca937ca8-dc26-4f36-b31d-c957b84538e7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.518479 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ca937ca8-dc26-4f36-b31d-c957b84538e7 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1500 microversion: 2.1 time: 0.614422 Jul 20 04:18:53.524327 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1231/2361] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:52 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1500 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:53.534769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9866fd7b-1f75-40e2-9d6a-f51a691358be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:53.537485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9866fd7b-1f75-40e2-9d6a-f51a691358be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:53.553075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9866fd7b-1f75-40e2-9d6a-f51a691358be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.555719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9866fd7b-1f75-40e2-9d6a-f51a691358be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.556763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9866fd7b-1f75-40e2-9d6a-f51a691358be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.558561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9866fd7b-1f75-40e2-9d6a-f51a691358be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.997599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9866fd7b-1f75-40e2-9d6a-f51a691358be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.008916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9866fd7b-1f75-40e2-9d6a-f51a691358be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.010740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9866fd7b-1f75-40e2-9d6a-f51a691358be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.013449 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9866fd7b-1f75-40e2-9d6a-f51a691358be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1410 microversion: 2.25 time: 0.487802 Jul 20 04:18:54.014573 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1232/2362] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:53 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1410 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:54.019936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39970171-e845-4da2-9c02-bbbc184b3ee8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:54.020733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-39970171-e845-4da2-9c02-bbbc184b3ee8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:54.027785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39970171-e845-4da2-9c02-bbbc184b3ee8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.028526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39970171-e845-4da2-9c02-bbbc184b3ee8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.029707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39970171-e845-4da2-9c02-bbbc184b3ee8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.030316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39970171-e845-4da2-9c02-bbbc184b3ee8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.413354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39970171-e845-4da2-9c02-bbbc184b3ee8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.437614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:54.442442 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39970171-e845-4da2-9c02-bbbc184b3ee8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 0.426564 Jul 20 04:18:54.451558 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1233/2363] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:54 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:54.463344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16fce7f9-5926-4d2d-ac9b-59614179f3a9 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:54.464842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-16fce7f9-5926-4d2d-ac9b-59614179f3a9 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:54.484772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16fce7f9-5926-4d2d-ac9b-59614179f3a9 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.486476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16fce7f9-5926-4d2d-ac9b-59614179f3a9 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.487541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16fce7f9-5926-4d2d-ac9b-59614179f3a9 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.489254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16fce7f9-5926-4d2d-ac9b-59614179f3a9 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.682141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-16fce7f9-5926-4d2d-ac9b-59614179f3a9 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:54.755133 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-16fce7f9-5926-4d2d-ac9b-59614179f3a9 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1931 microversion: 2.75 time: 0.301675 Jul 20 04:18:54.756496 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1234/2364] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:54 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1931 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:54.764995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b5471152-cf11-4c4b-bbcd-2131829f0f38 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:54.769224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b5471152-cf11-4c4b-bbcd-2131829f0f38 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:54.773756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5471152-cf11-4c4b-bbcd-2131829f0f38 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.774523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5471152-cf11-4c4b-bbcd-2131829f0f38 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.775581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5471152-cf11-4c4b-bbcd-2131829f0f38 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.776258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5471152-cf11-4c4b-bbcd-2131829f0f38 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.874655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b5471152-cf11-4c4b-bbcd-2131829f0f38 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94d458feafa4ec28c50a04fc2b2a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14ab6d1260864919b0f1b6d536fe65ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.890089 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b5471152-cf11-4c4b-bbcd-2131829f0f38 tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 200 len: 1296 microversion: 2.1 time: 0.131663 Jul 20 04:18:54.893758 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1235/2365] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:54 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 1296 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:54.898793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-144dc2b4-433d-4794-a1db-3037d6edee6c req-f0f3d365-e43e-4eb5-81b8-51ed7300e163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9df925-6109-4e21-a875-7d16c10d0b80", "name": "network-vif-deleted", "tag": "c7162384-17f5-4ea8-95c6-748ce045c8bb"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:54.919712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-144dc2b4-433d-4794-a1db-3037d6edee6c req-f0f3d365-e43e-4eb5-81b8-51ed7300e163 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.920082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-144dc2b4-433d-4794-a1db-3037d6edee6c req-f0f3d365-e43e-4eb5-81b8-51ed7300e163 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.963809 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-144dc2b4-433d-4794-a1db-3037d6edee6c req-f0f3d365-e43e-4eb5-81b8-51ed7300e163 service nova] Creating event network-vif-deleted:c7162384-17f5-4ea8-95c6-748ce045c8bb for instance 2d9df925-6109-4e21-a875-7d16c10d0b80 on n-h1-764485-11 Jul 20 04:18:54.986424 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-144dc2b4-433d-4794-a1db-3037d6edee6c req-f0f3d365-e43e-4eb5-81b8-51ed7300e163 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090535 Jul 20 04:18:54.987496 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1236/2366] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:55.047113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c6eb1f1-7440-4bff-bcf5-a065a224282f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.053033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4c6eb1f1-7440-4bff-bcf5-a065a224282f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.095311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c6eb1f1-7440-4bff-bcf5-a065a224282f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.098153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c6eb1f1-7440-4bff-bcf5-a065a224282f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.103324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c6eb1f1-7440-4bff-bcf5-a065a224282f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.106160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c6eb1f1-7440-4bff-bcf5-a065a224282f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.630217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4c6eb1f1-7440-4bff-bcf5-a065a224282f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.645076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4c6eb1f1-7440-4bff-bcf5-a065a224282f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.646606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4c6eb1f1-7440-4bff-bcf5-a065a224282f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.649739 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4c6eb1f1-7440-4bff-bcf5-a065a224282f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1410 microversion: 2.25 time: 0.621020 Jul 20 04:18:55.664909 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1237/2367] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1410 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:55.673462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a9341a5-87ec-4a4b-b0fe-f4a3cb6231d6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.688697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a9341a5-87ec-4a4b-b0fe-f4a3cb6231d6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.695820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a9341a5-87ec-4a4b-b0fe-f4a3cb6231d6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.696533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a9341a5-87ec-4a4b-b0fe-f4a3cb6231d6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.697517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a9341a5-87ec-4a4b-b0fe-f4a3cb6231d6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.701110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a9341a5-87ec-4a4b-b0fe-f4a3cb6231d6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.027689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5a9341a5-87ec-4a4b-b0fe-f4a3cb6231d6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:56.041083 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a9341a5-87ec-4a4b-b0fe-f4a3cb6231d6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 0.374715 Jul 20 04:18:56.042286 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1238/2368] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:56.048005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c5307384-37ee-402b-8d79-4aab565bf4c5 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:56.049522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c5307384-37ee-402b-8d79-4aab565bf4c5 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:56.059153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5307384-37ee-402b-8d79-4aab565bf4c5 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.059979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5307384-37ee-402b-8d79-4aab565bf4c5 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.060970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5307384-37ee-402b-8d79-4aab565bf4c5 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.061597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5307384-37ee-402b-8d79-4aab565bf4c5 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.203303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-c5307384-37ee-402b-8d79-4aab565bf4c5 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:56.248460 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c5307384-37ee-402b-8d79-4aab565bf4c5 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1937 microversion: 2.75 time: 0.203871 Jul 20 04:18:56.261159 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1239/2369] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:56 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1937 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:56.270021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6856e609-c04d-4976-a0bd-a896ae0e8a6b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:56.271822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6856e609-c04d-4976-a0bd-a896ae0e8a6b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] [instance: 2d9df925-6109-4e21-a875-7d16c10d0b80] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:56.285125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6856e609-c04d-4976-a0bd-a896ae0e8a6b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.288148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6856e609-c04d-4976-a0bd-a896ae0e8a6b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.293700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6856e609-c04d-4976-a0bd-a896ae0e8a6b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.295092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6856e609-c04d-4976-a0bd-a896ae0e8a6b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.311549 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-6856e609-c04d-4976-a0bd-a896ae0e8a6b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] HTTP exception thrown: Instance 2d9df925-6109-4e21-a875-7d16c10d0b80 could not be found. Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6856e609-c04d-4976-a0bd-a896ae0e8a6b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Request method failure captured: Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 HTTP/1.1 Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14BRix5w6xVSgcgOsOksDcg0wMc1wfRQXEBFxlragbURj-fVZLEdITgDL85k9tP-gWDuDVZmK_o-XAUK80Dg_ZocG9xlvP8P3GahPvov_cu7B3mq5RFUvz37paH4WkSp50g_t6VCBAn8nuKEiecs3H5n6-qBu1yb3Ngs8RIirJsyvZQ Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 14ab6d1260864919b0f1b6d536fe65ae Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-LiveMigrationTest-1040157573 Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14ab6d1260864919b0f1b6d536fe65ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14ab6d1260864919b0f1b6d536fe65ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14ab6d1260864919b0f1b6d536fe65ae", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14ab6d1260864919b0f1b6d536fe65ae"}]}] Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-LiveMigrationTest-1040157573 Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 14ab6d1260864919b0f1b6d536fe65ae Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-LiveMigrationTest-1040157573 Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-LiveMigrationTest-1040157573-project Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: f94d458feafa4ec28c50a04fc2b2a1f4 Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-LiveMigrationTest-1040157573-project Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 2d9df925-6109-4e21-a875-7d16c10d0b80 could not be found. Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2d9df925-6109-4e21-a875-7d16c10d0b80'} Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d9df925-6109-4e21-a875-7d16c10d0b80 could not be found. Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d9df925-6109-4e21-a875-7d16c10d0b80 could not be found. Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:56.315784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:56.318791 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:56.318791 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:56.318791 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:56.318791 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:56.318791 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:56.318791 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d9df925-6109-4e21-a875-7d16c10d0b80 could not be found. Jul 20 04:18:56.318791 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:18:56.326463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6856e609-c04d-4976-a0bd-a896ae0e8a6b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] Returning 404 to user: Instance 2d9df925-6109-4e21-a875-7d16c10d0b80 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:56.326463 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6856e609-c04d-4976-a0bd-a896ae0e8a6b tempest-LiveMigrationTest-1040157573 tempest-LiveMigrationTest-1040157573-project] 10.222.0.20 "GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80" status: 404 len: 111 microversion: 2.1 time: 0.054604 Jul 20 04:18:56.326463 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1240/2370] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:56 2022] GET /compute/v2.1/servers/2d9df925-6109-4e21-a875-7d16c10d0b80 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:56.668586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6f929d33-5c67-4bbe-ab0c-3fed9234bbc9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:56.669518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6f929d33-5c67-4bbe-ab0c-3fed9234bbc9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:56.678481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f929d33-5c67-4bbe-ab0c-3fed9234bbc9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.678935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f929d33-5c67-4bbe-ab0c-3fed9234bbc9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.686836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f929d33-5c67-4bbe-ab0c-3fed9234bbc9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.687307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f929d33-5c67-4bbe-ab0c-3fed9234bbc9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.485792 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a9ab4f30-827c-42f6-8631-fbb5086c376c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "POST /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358/action" status: 202 len: 0 microversion: 2.1 time: 4.764290 Jul 20 04:18:57.494899 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1131/2371] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:52 2022] POST /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358/action => generated 0 bytes in 4774 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:18:57.511101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2d7807b-0953-45d3-9545-658df7d100ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:57.513042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2d7807b-0953-45d3-9545-658df7d100ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:57.538251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2d7807b-0953-45d3-9545-658df7d100ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.544792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2d7807b-0953-45d3-9545-658df7d100ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.545989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2d7807b-0953-45d3-9545-658df7d100ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.546676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2d7807b-0953-45d3-9545-658df7d100ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.004985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6f929d33-5c67-4bbe-ab0c-3fed9234bbc9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.019139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6f929d33-5c67-4bbe-ab0c-3fed9234bbc9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.021905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6f929d33-5c67-4bbe-ab0c-3fed9234bbc9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.027388 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6f929d33-5c67-4bbe-ab0c-3fed9234bbc9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1410 microversion: 2.25 time: 1.363034 Jul 20 04:18:58.032161 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1241/2372] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:56 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1410 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:58.037471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6256d24a-a929-4d8d-bd75-7332c3351d17 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:58.044934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6256d24a-a929-4d8d-bd75-7332c3351d17 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:58.053311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6256d24a-a929-4d8d-bd75-7332c3351d17 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.056865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6256d24a-a929-4d8d-bd75-7332c3351d17 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.058079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6256d24a-a929-4d8d-bd75-7332c3351d17 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.063494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6256d24a-a929-4d8d-bd75-7332c3351d17 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.493551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c2d7807b-0953-45d3-9545-658df7d100ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.526575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-6256d24a-a929-4d8d-bd75-7332c3351d17 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:58.534793 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2d7807b-0953-45d3-9545-658df7d100ab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 1.035823 Jul 20 04:18:58.535740 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1132/2373] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:57 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:58.565213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1877713b-74c2-4bbd-9b47-cd51a9dc68ce req-a93a5f61-0cb8-4aba-8fb6-0818de99e2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d80a59-9d6b-4b94-a643-8f6727f50511", "name": "network-vif-plugged", "status": "completed", "tag": "a43b1718-8133-4ab5-802a-5f461293d0fd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:58.604001 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6256d24a-a929-4d8d-bd75-7332c3351d17 tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1937 microversion: 2.75 time: 0.570349 Jul 20 04:18:58.605805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1877713b-74c2-4bbd-9b47-cd51a9dc68ce req-a93a5f61-0cb8-4aba-8fb6-0818de99e2e2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.606257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1877713b-74c2-4bbd-9b47-cd51a9dc68ce req-a93a5f61-0cb8-4aba-8fb6-0818de99e2e2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.607121 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1242/2374] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:58 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1937 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:58.625161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c9fe1e55-1f24-4970-baf7-e6a8af41deea tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d0fd040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:58.635443 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1877713b-74c2-4bbd-9b47-cd51a9dc68ce req-a93a5f61-0cb8-4aba-8fb6-0818de99e2e2 service nova] Creating event network-vif-plugged:a43b1718-8133-4ab5-802a-5f461293d0fd for instance 57d80a59-9d6b-4b94-a643-8f6727f50511 on n-h2-764485-11 Jul 20 04:18:58.671972 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1877713b-74c2-4bbd-9b47-cd51a9dc68ce req-a93a5f61-0cb8-4aba-8fb6-0818de99e2e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126545 Jul 20 04:18:58.676571 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1133/2375] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:58.729958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c9fe1e55-1f24-4970-baf7-e6a8af41deea tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.117516 Jul 20 04:18:58.737437 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1243/2376] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:18:58 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:59.053885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fd4b5d62-fae5-412a-b6b4-181ca7ded7f6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.054760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fd4b5d62-fae5-412a-b6b4-181ca7ded7f6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.066860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd4b5d62-fae5-412a-b6b4-181ca7ded7f6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.069801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd4b5d62-fae5-412a-b6b4-181ca7ded7f6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.070751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd4b5d62-fae5-412a-b6b4-181ca7ded7f6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.072477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd4b5d62-fae5-412a-b6b4-181ca7ded7f6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.555769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-51347330-c388-4902-8ab8-c075a17b2674 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.556724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-51347330-c388-4902-8ab8-c075a17b2674 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.585397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51347330-c388-4902-8ab8-c075a17b2674 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.588276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51347330-c388-4902-8ab8-c075a17b2674 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.590793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51347330-c388-4902-8ab8-c075a17b2674 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.597745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51347330-c388-4902-8ab8-c075a17b2674 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.728295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fd4b5d62-fae5-412a-b6b4-181ca7ded7f6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:59.774777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fd4b5d62-fae5-412a-b6b4-181ca7ded7f6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:59.796229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fd4b5d62-fae5-412a-b6b4-181ca7ded7f6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:59.797462 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fd4b5d62-fae5-412a-b6b4-181ca7ded7f6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1410 microversion: 2.25 time: 0.749723 Jul 20 04:18:59.798375 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1134/2377] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1410 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:59.803407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-64beecbc-b9c0-47ae-9b3b-88ee2bc0bf5c tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.820349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-64beecbc-b9c0-47ae-9b3b-88ee2bc0bf5c tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.840615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64beecbc-b9c0-47ae-9b3b-88ee2bc0bf5c tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.841082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64beecbc-b9c0-47ae-9b3b-88ee2bc0bf5c tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.852748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64beecbc-b9c0-47ae-9b3b-88ee2bc0bf5c tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.856257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64beecbc-b9c0-47ae-9b3b-88ee2bc0bf5c tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.242616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:00.252934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-64beecbc-b9c0-47ae-9b3b-88ee2bc0bf5c tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:00.320634 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-64beecbc-b9c0-47ae-9b3b-88ee2bc0bf5c tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1937 microversion: 2.75 time: 0.519090 Jul 20 04:19:00.321543 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1135/2378] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1937 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:00.336414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-51347330-c388-4902-8ab8-c075a17b2674 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.354382 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-51347330-c388-4902-8ab8-c075a17b2674 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 0.799207 Jul 20 04:19:00.357661 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1244/2379] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:00.365049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ea644f46-68df-4ffc-a155-baffc0817b39 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d135ca0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:00.498524 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ea644f46-68df-4ffc-a155-baffc0817b39 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.171695 Jul 20 04:19:00.504769 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1136/2380] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:00 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:00.816682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ffb4f071-3870-468f-808f-a6677a76fbbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:00.817305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ffb4f071-3870-468f-808f-a6677a76fbbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:00.837705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ffb4f071-3870-468f-808f-a6677a76fbbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.844999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ffb4f071-3870-468f-808f-a6677a76fbbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.854114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ffb4f071-3870-468f-808f-a6677a76fbbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.855544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ffb4f071-3870-468f-808f-a6677a76fbbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.340727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-900642373", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "8607947f-722b-4d9f-aa06-f550b62f0123"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:01.469691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] validate_networks() for [('8607947f-722b-4d9f-aa06-f550b62f0123', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:01.644306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ffb4f071-3870-468f-808f-a6677a76fbbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.663249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ffb4f071-3870-468f-808f-a6677a76fbbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.673203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ffb4f071-3870-468f-808f-a6677a76fbbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.675050 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ffb4f071-3870-468f-808f-a6677a76fbbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1410 microversion: 2.25 time: 0.863349 Jul 20 04:19:01.684814 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1245/2381] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:00 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1410 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:01.692704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-03abd2dd-7c1d-42ed-a097-3c05d2081cad tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.696530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-03abd2dd-7c1d-42ed-a097-3c05d2081cad tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:01.710653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03abd2dd-7c1d-42ed-a097-3c05d2081cad tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.712945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03abd2dd-7c1d-42ed-a097-3c05d2081cad tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.715424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03abd2dd-7c1d-42ed-a097-3c05d2081cad tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.716328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03abd2dd-7c1d-42ed-a097-3c05d2081cad tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.077817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-03abd2dd-7c1d-42ed-a097-3c05d2081cad tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] Lazy-loading 'services' on Instance uuid 60dd7fc1-c282-4bc0-aedf-192a9ff26975 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:02.153465 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-03abd2dd-7c1d-42ed-a097-3c05d2081cad tempest-ServersAdmin275Test-1088297839 tempest-ServersAdmin275Test-1088297839-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1922 microversion: 2.75 time: 0.466913 Jul 20 04:19:02.162660 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1246/2382] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1922 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:02.167994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-46cd337b-dda8-46ad-991a-dd7840b4fd88 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:02.168635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-46cd337b-dda8-46ad-991a-dd7840b4fd88 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:02.193306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46cd337b-dda8-46ad-991a-dd7840b4fd88 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.194016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46cd337b-dda8-46ad-991a-dd7840b4fd88 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.195047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46cd337b-dda8-46ad-991a-dd7840b4fd88 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.195722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46cd337b-dda8-46ad-991a-dd7840b4fd88 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.570578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-46cd337b-dda8-46ad-991a-dd7840b4fd88 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:02.593363 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-46cd337b-dda8-46ad-991a-dd7840b4fd88 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 0.428885 Jul 20 04:19:02.597170 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1247/2383] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:02 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:02.635221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ae881bc1-a714-4833-ae6f-c466153eb5cf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d154040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:02.712256 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ae881bc1-a714-4833-ae6f-c466153eb5cf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.113333 Jul 20 04:19:02.716818 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1248/2384] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:02 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:02.735352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74768865-7ed5-4c19-9f68-0954bab946f6 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:02.736107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74768865-7ed5-4c19-9f68-0954bab946f6 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:02.747571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74768865-7ed5-4c19-9f68-0954bab946f6 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.750853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74768865-7ed5-4c19-9f68-0954bab946f6 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.751861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74768865-7ed5-4c19-9f68-0954bab946f6 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.752424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74768865-7ed5-4c19-9f68-0954bab946f6 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.828267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74768865-7ed5-4c19-9f68-0954bab946f6 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:03.025345 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74768865-7ed5-4c19-9f68-0954bab946f6 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "DELETE /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 204 len: 0 microversion: 2.75 time: 0.307478 Jul 20 04:19:03.026579 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1249/2385] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:19:02 2022] DELETE /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:19:03.041887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6d0b4f01-187d-4940-b537-f5529c8fbe8f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.045779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6d0b4f01-187d-4940-b537-f5529c8fbe8f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.066161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d0b4f01-187d-4940-b537-f5529c8fbe8f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.066681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d0b4f01-187d-4940-b537-f5529c8fbe8f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.068776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d0b4f01-187d-4940-b537-f5529c8fbe8f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.070421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d0b4f01-187d-4940-b537-f5529c8fbe8f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.288103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:03.288103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:03.288103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:03.288103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:03.288103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:03.304214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.304964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.310564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.311093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.387424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Getting quotas for project c1be6441272046629ac3840881e0148f. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:03.407723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Getting quotas for user 6294c9ac9cb34e9387ce8f109ac3d819 and project c1be6441272046629ac3840881e0148f. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:03.417213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:03.453399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:03.458185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:03.598091 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-92f9cf35-274c-4988-b83e-65aae71b6710 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.672622 Jul 20 04:19:03.599261 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1137/2386] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:19:03.615125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-75708d72-33c7-4922-b5cf-12251ae896a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.616086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-75708d72-33c7-4922-b5cf-12251ae896a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.624565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75708d72-33c7-4922-b5cf-12251ae896a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.625466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75708d72-33c7-4922-b5cf-12251ae896a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.627306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75708d72-33c7-4922-b5cf-12251ae896a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.627962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75708d72-33c7-4922-b5cf-12251ae896a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.933756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6d0b4f01-187d-4940-b537-f5529c8fbe8f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.936562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:03.945216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6d0b4f01-187d-4940-b537-f5529c8fbe8f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.962818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6d0b4f01-187d-4940-b537-f5529c8fbe8f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.966319 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6d0b4f01-187d-4940-b537-f5529c8fbe8f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1606 microversion: 2.25 time: 0.935774 Jul 20 04:19:03.970468 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1250/2387] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:03 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1606 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:03.972564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-75708d72-33c7-4922-b5cf-12251ae896a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.976573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-19d7156c-7f31-4191-9e68-e08332155ac6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.977587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-19d7156c-7f31-4191-9e68-e08332155ac6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.988978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19d7156c-7f31-4191-9e68-e08332155ac6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.990635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19d7156c-7f31-4191-9e68-e08332155ac6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.992526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19d7156c-7f31-4191-9e68-e08332155ac6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.993240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19d7156c-7f31-4191-9e68-e08332155ac6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.993369 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-75708d72-33c7-4922-b5cf-12251ae896a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:04.007433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-75708d72-33c7-4922-b5cf-12251ae896a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:04.037219 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-75708d72-33c7-4922-b5cf-12251ae896a1 tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1444 microversion: 2.75 time: 0.432692 Jul 20 04:19:04.040778 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1138/2388] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:03 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1444 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:04.059320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9f4a2357-0f84-4c90-a005-dce59502683c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d0f5160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:04.366760 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9f4a2357-0f84-4c90-a005-dce59502683c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.324296 Jul 20 04:19:04.368489 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1139/2389] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:04 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:04.385396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e27e79d6-761a-4fbe-b969-9636fb131555 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:04.389552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e27e79d6-761a-4fbe-b969-9636fb131555 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:04.415360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e27e79d6-761a-4fbe-b969-9636fb131555 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.415953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e27e79d6-761a-4fbe-b969-9636fb131555 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.421203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e27e79d6-761a-4fbe-b969-9636fb131555 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.421700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e27e79d6-761a-4fbe-b969-9636fb131555 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.906848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-19d7156c-7f31-4191-9e68-e08332155ac6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:04.923012 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-19d7156c-7f31-4191-9e68-e08332155ac6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 0.951180 Jul 20 04:19:04.928600 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1251/2390] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:03 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:04.950068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-484700438", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "8607947f-722b-4d9f-aa06-f550b62f0123"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:05.445080 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e27e79d6-761a-4fbe-b969-9636fb131555 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-interface" status: 200 len: 284 microversion: 2.25 time: 1.075072 Jul 20 04:19:05.446715 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1140/2391] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Jul 20 04:19:04 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-interface => generated 284 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:19:05.452974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f6d80fe4-a8d4-4e0b-bbf0-c6d7ab44608a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:05.453804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f6d80fe4-a8d4-4e0b-bbf0-c6d7ab44608a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:05.483773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6d80fe4-a8d4-4e0b-bbf0-c6d7ab44608a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:05.485886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6d80fe4-a8d4-4e0b-bbf0-c6d7ab44608a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:05.487079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6d80fe4-a8d4-4e0b-bbf0-c6d7ab44608a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:05.488995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6d80fe4-a8d4-4e0b-bbf0-c6d7ab44608a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:05.832491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f6d80fe4-a8d4-4e0b-bbf0-c6d7ab44608a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:05.842731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f6d80fe4-a8d4-4e0b-bbf0-c6d7ab44608a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:05.855587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f6d80fe4-a8d4-4e0b-bbf0-c6d7ab44608a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b887acad86a47fd8f0d739b1e65651a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746276d80b594ef58e02c38078972f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:05.872302 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f6d80fe4-a8d4-4e0b-bbf0-c6d7ab44608a tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 200 len: 1444 microversion: 2.75 time: 0.424067 Jul 20 04:19:05.872901 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1141/2392] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:05 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 1444 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:05.901021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6cdead3-b2e2-4402-b803-43fa332c71d2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d153f70>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:07.824319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] validate_networks() for [('8607947f-722b-4d9f-aa06-f550b62f0123', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:07.865338 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e6cdead3-b2e2-4402-b803-43fa332c71d2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 1.990998 Jul 20 04:19:07.866809 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1142/2393] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:05 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:07.875400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c59a7380-7afe-4189-8850-72dd79d9ea55 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:07.878083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c59a7380-7afe-4189-8850-72dd79d9ea55 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:07.903673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c59a7380-7afe-4189-8850-72dd79d9ea55 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.908266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c59a7380-7afe-4189-8850-72dd79d9ea55 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:07.909775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c59a7380-7afe-4189-8850-72dd79d9ea55 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.910424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c59a7380-7afe-4189-8850-72dd79d9ea55 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.244124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c59a7380-7afe-4189-8850-72dd79d9ea55 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:09.253147 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c59a7380-7afe-4189-8850-72dd79d9ea55 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1521 microversion: 2.1 time: 1.384818 Jul 20 04:19:09.263853 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1143/2394] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:07 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1521 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:09.279605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a401fcb-f081-4e9c-b69f-97c4b7887aff tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:09.280619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7a401fcb-f081-4e9c-b69f-97c4b7887aff tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] [instance: 60dd7fc1-c282-4bc0-aedf-192a9ff26975] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:09.293335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a401fcb-f081-4e9c-b69f-97c4b7887aff tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.296111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a401fcb-f081-4e9c-b69f-97c4b7887aff tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.297101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a401fcb-f081-4e9c-b69f-97c4b7887aff tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.304243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a401fcb-f081-4e9c-b69f-97c4b7887aff tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.350498 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-7a401fcb-f081-4e9c-b69f-97c4b7887aff tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] HTTP exception thrown: Instance 60dd7fc1-c282-4bc0-aedf-192a9ff26975 could not be found. Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a401fcb-f081-4e9c-b69f-97c4b7887aff tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Request method failure captured: Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 HTTP/1.1 Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Hdz4VPv4gkYDlITnqPdzxxmxmMld6WYL1JIbrcSf6i3IQQzPDWXvuIaGUTb-xFkMB5ul61PVY30d31IQqbm3XKaFz1CXnTICHGccgTFuP0eGrq7il4w-J2sg7wO2iG-sFDmXepfvJek9E44L9T9xbVTy_mSQyqWrnpB2EUcfgsfcA Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.75 Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 746276d80b594ef58e02c38078972f86 Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersAdmin275Test-470174016 Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/746276d80b594ef58e02c38078972f86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/746276d80b594ef58e02c38078972f86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_746276d80b594ef58e02c38078972f86", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/746276d80b594ef58e02c38078972f86"}]}] Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersAdmin275Test-470174016 Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 746276d80b594ef58e02c38078972f86 Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersAdmin275Test-470174016 Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersAdmin275Test-470174016-project Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 5b887acad86a47fd8f0d739b1e65651a Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersAdmin275Test-470174016-project Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 60dd7fc1-c282-4bc0-aedf-192a9ff26975 could not be found. Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '60dd7fc1-c282-4bc0-aedf-192a9ff26975'} Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60dd7fc1-c282-4bc0-aedf-192a9ff26975 could not be found. Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60dd7fc1-c282-4bc0-aedf-192a9ff26975 could not be found. Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:09.356803 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:19:09.360744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:09.360744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:09.360744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:09.360744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:09.360744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:09.360744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60dd7fc1-c282-4bc0-aedf-192a9ff26975 could not be found. Jul 20 04:19:09.360744 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:19:09.362271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a401fcb-f081-4e9c-b69f-97c4b7887aff tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] Returning 404 to user: Instance 60dd7fc1-c282-4bc0-aedf-192a9ff26975 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:09.365893 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7a401fcb-f081-4e9c-b69f-97c4b7887aff tempest-ServersAdmin275Test-470174016 tempest-ServersAdmin275Test-470174016-project] 10.222.0.20 "GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975" status: 404 len: 111 microversion: 2.75 time: 0.100799 Jul 20 04:19:09.366996 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1144/2395] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:09 2022] GET /compute/v2.1/servers/60dd7fc1-c282-4bc0-aedf-192a9ff26975 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:19:09.388755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-5079b557-dbb0-4529-83fc-f862da5ff27f req-18d823af-301c-4653-9d64-d3318e0a1d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2394da98-223c-4a33-8a73-6a98c5822358", "name": "network-vif-plugged", "status": "completed", "tag": "a7ab8ce3-f14f-4e01-8c65-acc3536763ec"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:09.400799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5079b557-dbb0-4529-83fc-f862da5ff27f req-18d823af-301c-4653-9d64-d3318e0a1d53 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.407642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5079b557-dbb0-4529-83fc-f862da5ff27f req-18d823af-301c-4653-9d64-d3318e0a1d53 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.442595 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-5079b557-dbb0-4529-83fc-f862da5ff27f req-18d823af-301c-4653-9d64-d3318e0a1d53 service nova] Creating event network-vif-plugged:a7ab8ce3-f14f-4e01-8c65-acc3536763ec for instance 2394da98-223c-4a33-8a73-6a98c5822358 on n-h1-764485-11 Jul 20 04:19:09.465397 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-5079b557-dbb0-4529-83fc-f862da5ff27f req-18d823af-301c-4653-9d64-d3318e0a1d53 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096834 Jul 20 04:19:09.469754 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1145/2396] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:09.489926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-73c6a5a8-defb-4afa-9721-03e1e24cef2d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d1531f0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:09.598511 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-73c6a5a8-defb-4afa-9721-03e1e24cef2d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.116452 Jul 20 04:19:09.602354 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1146/2397] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:09 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:10.284050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fbe835e4-8c91-4fbc-912e-f29bea4121c2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.284818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fbe835e4-8c91-4fbc-912e-f29bea4121c2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.304083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbe835e4-8c91-4fbc-912e-f29bea4121c2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.304773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbe835e4-8c91-4fbc-912e-f29bea4121c2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.305786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbe835e4-8c91-4fbc-912e-f29bea4121c2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.306398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbe835e4-8c91-4fbc-912e-f29bea4121c2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.955484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fbe835e4-8c91-4fbc-912e-f29bea4121c2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:10.968051 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fbe835e4-8c91-4fbc-912e-f29bea4121c2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1503 microversion: 2.1 time: 0.690593 Jul 20 04:19:10.971956 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1147/2398] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:10 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1503 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:10.989745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e78429bb-2574-4fc3-9e39-69fda2457610 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa28fe8b0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.085031 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e78429bb-2574-4fc3-9e39-69fda2457610 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.110646 Jul 20 04:19:11.088353 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1148/2399] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:10 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:11.990548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-83b2f7ac-3ab4-46b3-bfce-9d90c0e07f8a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.991940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-83b2f7ac-3ab4-46b3-bfce-9d90c0e07f8a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:12.038885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83b2f7ac-3ab4-46b3-bfce-9d90c0e07f8a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.048164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83b2f7ac-3ab4-46b3-bfce-9d90c0e07f8a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.050450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83b2f7ac-3ab4-46b3-bfce-9d90c0e07f8a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.053911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83b2f7ac-3ab4-46b3-bfce-9d90c0e07f8a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.180517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:12.193502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:12.194262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:12.194845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:12.195452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:12.254289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.254764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.311518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.312441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.056s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.460432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Getting quotas for project c1be6441272046629ac3840881e0148f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:12.500516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Getting quotas for user 6294c9ac9cb34e9387ce8f109ac3d819 and project c1be6441272046629ac3840881e0148f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:12.552093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:12.554369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 6131221c-3273-45e7-9458-8fedaa324b3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:12.668278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:12.725464 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e2746c80-4504-43ca-8dcb-12253e5b84ec tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.795597 Jul 20 04:19:12.734836 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1252/2400] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 7806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:12.768181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c988e48e-f723-4d8f-ab55-db81f607c1f1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9df374c0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:12.895808 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c988e48e-f723-4d8f-ab55-db81f607c1f1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.158356 Jul 20 04:19:12.905255 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1253/2401] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:12 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:12.924188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-0ff8941f-61f9-4e63-9fe8-1bdd0c2c95f1 req-a13eae22-1d4f-45a0-b4f7-7e04374d181f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d80a59-9d6b-4b94-a643-8f6727f50511", "tag": "a43b1718-8133-4ab5-802a-5f461293d0fd"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:12.964756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0ff8941f-61f9-4e63-9fe8-1bdd0c2c95f1 req-a13eae22-1d4f-45a0-b4f7-7e04374d181f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.966396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0ff8941f-61f9-4e63-9fe8-1bdd0c2c95f1 req-a13eae22-1d4f-45a0-b4f7-7e04374d181f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:13.003835 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-0ff8941f-61f9-4e63-9fe8-1bdd0c2c95f1 req-a13eae22-1d4f-45a0-b4f7-7e04374d181f service nova] Creating event network-changed:a43b1718-8133-4ab5-802a-5f461293d0fd for instance 57d80a59-9d6b-4b94-a643-8f6727f50511 on n-h2-764485-11 Jul 20 04:19:13.018290 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-0ff8941f-61f9-4e63-9fe8-1bdd0c2c95f1 req-a13eae22-1d4f-45a0-b4f7-7e04374d181f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111973 Jul 20 04:19:13.025634 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1254/2402] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:13.117874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-890862226", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "451", "networks": [{"uuid": "8607947f-722b-4d9f-aa06-f550b62f0123"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:13.284166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-83b2f7ac-3ab4-46b3-bfce-9d90c0e07f8a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:13.294677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] validate_networks() for [('8607947f-722b-4d9f-aa06-f550b62f0123', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:13.307058 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-83b2f7ac-3ab4-46b3-bfce-9d90c0e07f8a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1503 microversion: 2.1 time: 1.322581 Jul 20 04:19:13.330227 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1149/2403] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:11 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1503 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:13.913098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-99adeeee-1af2-4b6d-a536-0700b501a28a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa28fea60>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:13.931587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:13.933042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:14.066531 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-99adeeee-1af2-4b6d-a536-0700b501a28a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.159839 Jul 20 04:19:14.073064 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1150/2404] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:13 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:14.334288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6125bf8-4f37-4f7b-a8f3-4bbd4c1e3a7b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:14.335054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a6125bf8-4f37-4f7b-a8f3-4bbd4c1e3a7b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:14.366211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6125bf8-4f37-4f7b-a8f3-4bbd4c1e3a7b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.384180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6125bf8-4f37-4f7b-a8f3-4bbd4c1e3a7b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.396433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6125bf8-4f37-4f7b-a8f3-4bbd4c1e3a7b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.397927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6125bf8-4f37-4f7b-a8f3-4bbd4c1e3a7b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.290951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a6125bf8-4f37-4f7b-a8f3-4bbd4c1e3a7b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:15.363449 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a6125bf8-4f37-4f7b-a8f3-4bbd4c1e3a7b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1503 microversion: 2.1 time: 0.991868 Jul 20 04:19:15.363449 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1151/2405] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:14 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1503 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:15.363449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-32d0bf33-68f9-45f8-99f0-8507e5775729 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa284fdc0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.479340 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-32d0bf33-68f9-45f8-99f0-8507e5775729 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.155808 Jul 20 04:19:15.480245 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1152/2406] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:15 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:15.795581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:15.796702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:15.797421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:15.798047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:15.798656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:15.814158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.815151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.816566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.817342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.839032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Getting quotas for project c1be6441272046629ac3840881e0148f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:15.848673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Getting quotas for user 6294c9ac9cb34e9387ce8f109ac3d819 and project c1be6441272046629ac3840881e0148f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:15.870962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:15.876707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:15.970879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a8efc60d-34f9-448a-9134-c4643ff589b7 req-32d12d96-5b52-4fd2-a5d3-e9c9200c20c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b275fa8-1d8e-435e-9256-5b2a33129d62", "name": "network-vif-unplugged", "status": "completed", "tag": "cd19a68b-44cb-4c08-a687-f66d10df0d36"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:15.997363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a8efc60d-34f9-448a-9134-c4643ff589b7 req-32d12d96-5b52-4fd2-a5d3-e9c9200c20c8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.999904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a8efc60d-34f9-448a-9134-c4643ff589b7 req-32d12d96-5b52-4fd2-a5d3-e9c9200c20c8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.014830 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a4da1093-33dc-48a0-8560-23b09bda1872 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.901431 Jul 20 04:19:16.019639 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1255/2407] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:16.025988 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a8efc60d-34f9-448a-9134-c4643ff589b7 req-32d12d96-5b52-4fd2-a5d3-e9c9200c20c8 service nova] Creating event network-vif-unplugged:cd19a68b-44cb-4c08-a687-f66d10df0d36 for instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 on n-h1-764485-11 Jul 20 04:19:16.038022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6b4e6f26-fb46-4bdc-85a2-292946c1910c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:16.041440 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a8efc60d-34f9-448a-9134-c4643ff589b7 req-32d12d96-5b52-4fd2-a5d3-e9c9200c20c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074414 Jul 20 04:19:16.041569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6b4e6f26-fb46-4bdc-85a2-292946c1910c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:16.043425 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1153/2408] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:16.378436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ad0bbb71-c91b-4c35-8707-67c7b3d1a94f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:16.379286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ad0bbb71-c91b-4c35-8707-67c7b3d1a94f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:16.391021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad0bbb71-c91b-4c35-8707-67c7b3d1a94f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.395990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad0bbb71-c91b-4c35-8707-67c7b3d1a94f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.397540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad0bbb71-c91b-4c35-8707-67c7b3d1a94f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.400086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad0bbb71-c91b-4c35-8707-67c7b3d1a94f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.457727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6b4e6f26-fb46-4bdc-85a2-292946c1910c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:16.471354 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6b4e6f26-fb46-4bdc-85a2-292946c1910c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1220 microversion: 2.1 time: 0.446843 Jul 20 04:19:16.472001 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1256/2409] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:16 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1220 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:16.504382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02447466-948f-4260-9045-f80a64083cee tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9df37c10>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:16.683328 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-02447466-948f-4260-9045-f80a64083cee tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.170789 Jul 20 04:19:16.692358 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1257/2410] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:16 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:16.913240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-42cbd0be-d5c9-478c-835a-b79bd60c8bad req-8f855b04-f9f0-4ebb-90a0-57f5090cdf99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "103ad850-c12a-4118-9600-9ea876ec5cdb", "tag": "b2af76ca-80bb-4fc6-bb13-a0c498437b45"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:16.943304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-42cbd0be-d5c9-478c-835a-b79bd60c8bad req-8f855b04-f9f0-4ebb-90a0-57f5090cdf99 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.943936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-42cbd0be-d5c9-478c-835a-b79bd60c8bad req-8f855b04-f9f0-4ebb-90a0-57f5090cdf99 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.985040 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-42cbd0be-d5c9-478c-835a-b79bd60c8bad req-8f855b04-f9f0-4ebb-90a0-57f5090cdf99 service nova] Creating event network-changed:b2af76ca-80bb-4fc6-bb13-a0c498437b45 for instance 103ad850-c12a-4118-9600-9ea876ec5cdb on n-h1-764485-11 Jul 20 04:19:17.002192 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-42cbd0be-d5c9-478c-835a-b79bd60c8bad req-8f855b04-f9f0-4ebb-90a0-57f5090cdf99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092780 Jul 20 04:19:17.003439 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1258/2411] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:17.280652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ad0bbb71-c91b-4c35-8707-67c7b3d1a94f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:17.289026 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ad0bbb71-c91b-4c35-8707-67c7b3d1a94f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1503 microversion: 2.1 time: 0.914847 Jul 20 04:19:17.298573 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1154/2412] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:16 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1503 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:17.489227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6dbbaba5-108e-48cd-a89d-35dd1bf51010 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:17.490354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6dbbaba5-108e-48cd-a89d-35dd1bf51010 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:17.506609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dbbaba5-108e-48cd-a89d-35dd1bf51010 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.510152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dbbaba5-108e-48cd-a89d-35dd1bf51010 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.511835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dbbaba5-108e-48cd-a89d-35dd1bf51010 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.512595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dbbaba5-108e-48cd-a89d-35dd1bf51010 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.706957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-45ad6f78-8244-4120-bb76-861abd31b27d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d135670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:17.747435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6dbbaba5-108e-48cd-a89d-35dd1bf51010 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:17.768836 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6dbbaba5-108e-48cd-a89d-35dd1bf51010 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1224 microversion: 2.1 time: 0.270904 Jul 20 04:19:17.771033 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1259/2413] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:17 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1224 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:17.845089 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-45ad6f78-8244-4120-bb76-861abd31b27d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.143741 Jul 20 04:19:17.856428 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1155/2414] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:17 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:18.313411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b5964e58-379b-41de-83b5-faa436d4110c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:18.314238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b5964e58-379b-41de-83b5-faa436d4110c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:18.334877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5964e58-379b-41de-83b5-faa436d4110c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.335503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5964e58-379b-41de-83b5-faa436d4110c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.336735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5964e58-379b-41de-83b5-faa436d4110c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.337646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5964e58-379b-41de-83b5-faa436d4110c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.788432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c04e395b-e337-4c17-89a6-fd0d7cbe60cf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:18.789131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c04e395b-e337-4c17-89a6-fd0d7cbe60cf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:18.806680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c04e395b-e337-4c17-89a6-fd0d7cbe60cf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.807270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c04e395b-e337-4c17-89a6-fd0d7cbe60cf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.808663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c04e395b-e337-4c17-89a6-fd0d7cbe60cf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.809109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c04e395b-e337-4c17-89a6-fd0d7cbe60cf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.416246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c04e395b-e337-4c17-89a6-fd0d7cbe60cf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:19.427468 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c04e395b-e337-4c17-89a6-fd0d7cbe60cf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1278 microversion: 2.1 time: 0.642751 Jul 20 04:19:19.452704 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1156/2415] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:18 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1278 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:19.487940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3ebb6aaa-2825-4728-90bd-0f20534341b8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d135a60>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:19.513595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b5964e58-379b-41de-83b5-faa436d4110c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:19.527425 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b5964e58-379b-41de-83b5-faa436d4110c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1503 microversion: 2.1 time: 1.215897 Jul 20 04:19:19.541360 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1260/2416] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:18 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1503 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:19.603126 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3ebb6aaa-2825-4728-90bd-0f20534341b8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.149208 Jul 20 04:19:19.604847 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1157/2417] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:19 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:20.444218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8eefe432-4efa-48f0-8c76-e62e655f7625 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:20.449776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8eefe432-4efa-48f0-8c76-e62e655f7625 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.476862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8eefe432-4efa-48f0-8c76-e62e655f7625 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.477423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8eefe432-4efa-48f0-8c76-e62e655f7625 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.480313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8eefe432-4efa-48f0-8c76-e62e655f7625 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.484903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8eefe432-4efa-48f0-8c76-e62e655f7625 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.559371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-60ff459f-b945-4447-a30d-822681f68c5a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:20.560247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-60ff459f-b945-4447-a30d-822681f68c5a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.591091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60ff459f-b945-4447-a30d-822681f68c5a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.591705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60ff459f-b945-4447-a30d-822681f68c5a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.593387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60ff459f-b945-4447-a30d-822681f68c5a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.594781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60ff459f-b945-4447-a30d-822681f68c5a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.240043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8eefe432-4efa-48f0-8c76-e62e655f7625 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:21.257628 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8eefe432-4efa-48f0-8c76-e62e655f7625 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1278 microversion: 2.1 time: 0.816779 Jul 20 04:19:21.261596 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1261/2418] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:20 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1278 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:21.278616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-469151ce-78a1-42dd-9265-a862efdeafd7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d0e9550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:21.354077 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-469151ce-78a1-42dd-9265-a862efdeafd7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.090483 Jul 20 04:19:21.354992 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1262/2419] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:21 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:21.653094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-60ff459f-b945-4447-a30d-822681f68c5a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:21.669248 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-60ff459f-b945-4447-a30d-822681f68c5a tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 200 len: 1506 microversion: 2.1 time: 1.118701 Jul 20 04:19:21.671553 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1158/2420] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:20 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 1506 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:21.687559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:21.687979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:21.695096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.695771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.696712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.697304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.740341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:21.758045 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.compute.api [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Working on deleting snapshot bc9a61a6-1e96-4489-85a5-a88c214c8331 from shelved instance... Jul 20 04:19:22.277725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2b10fb2-e363-4b22-b00e-abcd045c3c0c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:22.278762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2b10fb2-e363-4b22-b00e-abcd045c3c0c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:22.292936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2b10fb2-e363-4b22-b00e-abcd045c3c0c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.293636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2b10fb2-e363-4b22-b00e-abcd045c3c0c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.295831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2b10fb2-e363-4b22-b00e-abcd045c3c0c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.297146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2b10fb2-e363-4b22-b00e-abcd045c3c0c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.308886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Doing local delete in cell de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) {{(pid=119808) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 20 04:19:23.311344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.312092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.312717 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.compute.api [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 20 04:19:23.330823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] deallocate_for_instance() {{(pid=119808) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 20 04:19:24.004887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c2b10fb2-e363-4b22-b00e-abcd045c3c0c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:24.016439 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2b10fb2-e363-4b22-b00e-abcd045c3c0c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1320 microversion: 2.1 time: 1.743277 Jul 20 04:19:24.017042 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1159/2421] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:22 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1320 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:24.023130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3bcfbe37-4ee4-4ee8-bd3a-e286c2f1ffb1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa28703a0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:24.113781 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3bcfbe37-4ee4-4ee8-bd3a-e286c2f1ffb1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.095618 Jul 20 04:19:24.116516 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1160/2422] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:24 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:24.297311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1349562670", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:24.376945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:25.826890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:26.462455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=14 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:26.546634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:26.548223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:26.548852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:26.549507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:26.550404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:26.628570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.630040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.631896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.638663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.723662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Getting quotas for project 4a46ad029dbb4797af468175c36fc530. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:26.747408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Getting quotas for user ebbba918962a4bcda2eae6f7f07946d8 and project 4a46ad029dbb4797af468175c36fc530. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:26.826579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:26.843080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:27.037329 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-973a3fd5-37cb-46aa-8d94-f7640c59faca tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.916116 Jul 20 04:19:27.048918 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1161/2423] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:27.059473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0d12840e-c669-4709-a4db-72ae488f104d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:27.086406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0d12840e-c669-4709-a4db-72ae488f104d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:27.117174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d12840e-c669-4709-a4db-72ae488f104d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:27.117954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d12840e-c669-4709-a4db-72ae488f104d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:27.125857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d12840e-c669-4709-a4db-72ae488f104d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:27.126695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d12840e-c669-4709-a4db-72ae488f104d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:27.502031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Updating instance_info_cache with network_info: [] {{(pid=119808) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:19:28.571062 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9fde0d67-f399-4cdd-8d64-da2eac0b4caa tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 204 len: 0 microversion: 2.1 time: 6.888094 Jul 20 04:19:28.588974 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1263/2424] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:21 2022] DELETE /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 0 bytes in 6904 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:28.616715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-edd873e4-4e94-4936-9b8f-dd65f1090ab7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d0e9790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:28.743603 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-edd873e4-4e94-4936-9b8f-dd65f1090ab7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1436 microversion: 2.1 time: 0.153121 Jul 20 04:19:28.744167 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1264/2425] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:28 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1436 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:28.765297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9a9cc8ba-5edc-40a8-bf23-0ac8ba817866 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:28.766405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9a9cc8ba-5edc-40a8-bf23-0ac8ba817866 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:28.787163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a9cc8ba-5edc-40a8-bf23-0ac8ba817866 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.796039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a9cc8ba-5edc-40a8-bf23-0ac8ba817866 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.799081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a9cc8ba-5edc-40a8-bf23-0ac8ba817866 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.799940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a9cc8ba-5edc-40a8-bf23-0ac8ba817866 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.958386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9a9cc8ba-5edc-40a8-bf23-0ac8ba817866 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbba918962a4bcda2eae6f7f07946d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a46ad029dbb4797af468175c36fc530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:29.975471 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9a9cc8ba-5edc-40a8-bf23-0ac8ba817866 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8" status: 200 len: 1266 microversion: 2.1 time: 1.222757 Jul 20 04:19:29.984208 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1265/2426] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:28 2022] GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 => generated 1266 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:30.000732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-24401f48-973e-4cbf-8ec9-89700cd0e644 req-b4c17ebb-c53c-4b79-a45c-71fb64e36011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6131221c-3273-45e7-9458-8fedaa324b3d", "tag": "3f966a3d-4e22-44cb-9eca-42c02abaefef"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:30.048539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-24401f48-973e-4cbf-8ec9-89700cd0e644 req-b4c17ebb-c53c-4b79-a45c-71fb64e36011 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.049864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-24401f48-973e-4cbf-8ec9-89700cd0e644 req-b4c17ebb-c53c-4b79-a45c-71fb64e36011 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.124633 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-24401f48-973e-4cbf-8ec9-89700cd0e644 req-b4c17ebb-c53c-4b79-a45c-71fb64e36011 service nova] Creating event network-changed:3f966a3d-4e22-44cb-9eca-42c02abaefef for instance 6131221c-3273-45e7-9458-8fedaa324b3d on n-h1-764485-11 Jul 20 04:19:30.136410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0d12840e-c669-4709-a4db-72ae488f104d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:30.146389 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0d12840e-c669-4709-a4db-72ae488f104d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1320 microversion: 2.1 time: 3.095924 Jul 20 04:19:30.147921 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-24401f48-973e-4cbf-8ec9-89700cd0e644 req-b4c17ebb-c53c-4b79-a45c-71fb64e36011 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162071 Jul 20 04:19:30.156342 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1162/2427] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:27 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1320 bytes in 3106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:30.162908 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1266/2428] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:30.176564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-abc589e5-1add-4214-897d-06799ac894c2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d5b2550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.183957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ad1ffca9-7b06-41a8-81c2-7c9ac2076190 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.186381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ad1ffca9-7b06-41a8-81c2-7c9ac2076190 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:30.217456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad1ffca9-7b06-41a8-81c2-7c9ac2076190 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.247547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad1ffca9-7b06-41a8-81c2-7c9ac2076190 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.248412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad1ffca9-7b06-41a8-81c2-7c9ac2076190 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.257990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad1ffca9-7b06-41a8-81c2-7c9ac2076190 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.323538 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-ad1ffca9-7b06-41a8-81c2-7c9ac2076190 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ad1ffca9-7b06-41a8-81c2-7c9ac2076190 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 HTTP/1.1 Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '3b275fa8-1d8e-435e-9256-5b2a33129d62'} Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:30.335288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:19:30.340046 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:30.340046 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:30.340046 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:30.340046 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:30.340046 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:30.340046 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:19:30.340046 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:19:30.348861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ad1ffca9-7b06-41a8-81c2-7c9ac2076190 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:30.350022 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ad1ffca9-7b06-41a8-81c2-7c9ac2076190 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 404 len: 111 microversion: 2.1 time: 0.189878 Jul 20 04:19:30.350616 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1163/2429] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:30.618089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-638366687", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2f1733ae-f5aa-4d8e-b430-1f99c985f6d9"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:35.899094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] validate_networks() for [('2f1733ae-f5aa-4d8e-b430-1f99c985f6d9', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:35.905473 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-abc589e5-1add-4214-897d-06799ac894c2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1445 microversion: 2.1 time: 5.741130 Jul 20 04:19:35.912621 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1267/2430] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1445 bytes in 5743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:35.912621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44aae7d9-c1c8-4b05-a5e1-1633431facdb tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:35.912621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44aae7d9-c1c8-4b05-a5e1-1633431facdb tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:35.923171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44aae7d9-c1c8-4b05-a5e1-1633431facdb tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.928460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44aae7d9-c1c8-4b05-a5e1-1633431facdb tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.929419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44aae7d9-c1c8-4b05-a5e1-1633431facdb tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.932917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44aae7d9-c1c8-4b05-a5e1-1633431facdb tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.963023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:36.209978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44aae7d9-c1c8-4b05-a5e1-1633431facdb tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbba918962a4bcda2eae6f7f07946d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a46ad029dbb4797af468175c36fc530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:36.224036 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44aae7d9-c1c8-4b05-a5e1-1633431facdb tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8" status: 200 len: 1314 microversion: 2.1 time: 0.316318 Jul 20 04:19:36.236188 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1268/2431] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:35 2022] GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:36.249308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-19d5d33f-5dda-4330-b13b-73580ab966d8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:36.252676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-19d5d33f-5dda-4330-b13b-73580ab966d8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:36.280458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19d5d33f-5dda-4330-b13b-73580ab966d8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.280903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19d5d33f-5dda-4330-b13b-73580ab966d8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.281696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19d5d33f-5dda-4330-b13b-73580ab966d8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.282179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19d5d33f-5dda-4330-b13b-73580ab966d8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.616339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-19d5d33f-5dda-4330-b13b-73580ab966d8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:36.627955 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-19d5d33f-5dda-4330-b13b-73580ab966d8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1320 microversion: 2.1 time: 0.384729 Jul 20 04:19:36.638260 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1269/2432] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:36 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1320 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:36.647377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d90176d6-6347-4069-9843-c492009faea2 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Action: 'create', calling method: .version_select at 0x7fbf9d400700>, body: {"keypair": {"name": "tempest-keypair-1521659503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMBqNNvEG/cNxEprNQp3rq2C79Hi3jBXs2FM910Rjt2v9NI0R1C7v9h1E2N3A9NywA/uSu7t/IUmIjwMTZLvu6uiT/mf5/6aj9ngDAFjRK1mBWa9GEbolbe2QeEbrMeuA=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:36.678356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:36.716792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-d90176d6-6347-4069-9843-c492009faea2 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Getting quotas for project 081d522e2dcb4382a220a60f6570caf0. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:36.728275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-d90176d6-6347-4069-9843-c492009faea2 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Getting quotas for user f7514410e1d348ea87a3ce1bc13a7d92 and project 081d522e2dcb4382a220a60f6570caf0. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:36.785662 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d90176d6-6347-4069-9843-c492009faea2 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.145850 Jul 20 04:19:36.787136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:36.792401 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1270/2433] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jul 20 04:19:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 153 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:19:36.803445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-71c26b54-7575-4386-b189-82166099ff09 req-b5663adc-502f-4d57-be49-5055414fbe6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b275fa8-1d8e-435e-9256-5b2a33129d62", "name": "network-vif-deleted", "tag": "cd19a68b-44cb-4c08-a687-f66d10df0d36"}, {"name": "network-changed", "server_uuid": "8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6", "tag": "f03054f4-ef50-46f3-86ab-6137f2b51442"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:36.833921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-71c26b54-7575-4386-b189-82166099ff09 req-b5663adc-502f-4d57-be49-5055414fbe6c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.846234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-71c26b54-7575-4386-b189-82166099ff09 req-b5663adc-502f-4d57-be49-5055414fbe6c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.881643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.compute.server_external_events [req-71c26b54-7575-4386-b189-82166099ff09 req-b5663adc-502f-4d57-be49-5055414fbe6c service nova] Unable to find a host for instance 3b275fa8-1d8e-435e-9256-5b2a33129d62. Dropping event network-vif-deleted {{(pid=119808) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:19:36.882159 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-71c26b54-7575-4386-b189-82166099ff09 req-b5663adc-502f-4d57-be49-5055414fbe6c service nova] Creating event network-changed:f03054f4-ef50-46f3-86ab-6137f2b51442 for instance 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 on n-h2-764485-11 Jul 20 04:19:36.893975 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-71c26b54-7575-4386-b189-82166099ff09 req-b5663adc-502f-4d57-be49-5055414fbe6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 347 microversion: 2.1 time: 0.096050 Jul 20 04:19:36.897456 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1271/2434] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 347 bytes in 104 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:19:36.910813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9a3f406a-e804-4fac-82ba-adeef25e1ce2 req-6edaaf39-5f55-4ee5-818c-22d02cc67be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103ad850-c12a-4118-9600-9ea876ec5cdb", "name": "network-vif-plugged", "status": "completed", "tag": "b2af76ca-80bb-4fc6-bb13-a0c498437b45"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:36.930288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9a3f406a-e804-4fac-82ba-adeef25e1ce2 req-6edaaf39-5f55-4ee5-818c-22d02cc67be7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.934321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9a3f406a-e804-4fac-82ba-adeef25e1ce2 req-6edaaf39-5f55-4ee5-818c-22d02cc67be7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.935545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:36.936308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:36.937034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:36.937673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:36.938308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:36.940773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:36.965234 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9a3f406a-e804-4fac-82ba-adeef25e1ce2 req-6edaaf39-5f55-4ee5-818c-22d02cc67be7 service nova] Creating event network-vif-plugged:b2af76ca-80bb-4fc6-bb13-a0c498437b45 for instance 103ad850-c12a-4118-9600-9ea876ec5cdb on n-h1-764485-11 Jul 20 04:19:36.977233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.977760 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9a3f406a-e804-4fac-82ba-adeef25e1ce2 req-6edaaf39-5f55-4ee5-818c-22d02cc67be7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078837 Jul 20 04:19:36.978563 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1272/2435] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:36.982952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.985750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.986398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.991815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-67454ca4-844a-4f16-a2f9-5e0d4ba32a92 req-72b27558-2f50-4292-bb26-c6ccf213d087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dae261d7-a988-4c63-ac78-62c8aef00af8", "tag": "b4ae28d2-9fdc-4aa9-a1dd-948d9416be04"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:37.006958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-67454ca4-844a-4f16-a2f9-5e0d4ba32a92 req-72b27558-2f50-4292-bb26-c6ccf213d087 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.010012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-67454ca4-844a-4f16-a2f9-5e0d4ba32a92 req-72b27558-2f50-4292-bb26-c6ccf213d087 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.011836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=86 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:37.026284 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-67454ca4-844a-4f16-a2f9-5e0d4ba32a92 req-72b27558-2f50-4292-bb26-c6ccf213d087 service nova] Creating event network-changed:b4ae28d2-9fdc-4aa9-a1dd-948d9416be04 for instance dae261d7-a988-4c63-ac78-62c8aef00af8 on n-h2-764485-11 Jul 20 04:19:37.043370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:37.043810 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-67454ca4-844a-4f16-a2f9-5e0d4ba32a92 req-72b27558-2f50-4292-bb26-c6ccf213d087 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063151 Jul 20 04:19:37.045549 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1273/2436] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:37.053190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-af6cdf16-f115-4db1-8dcf-c81673acc42f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d4c0820>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:37.059872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for user 793c626644204dc3a08ed9118c9aaf4c and project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:37.079892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:37.082278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:37.145355 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-af6cdf16-f115-4db1-8dcf-c81673acc42f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 200 len: 1445 microversion: 2.1 time: 0.098014 Jul 20 04:19:37.146236 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1274/2437] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:37 2022] GET /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:37.159237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5fb86bd2-bb52-4346-a72b-9f3a33137fa8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d585940>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:37.161571 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3f41034b-42ed-4621-9970-4502cd23d59b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.548676 Jul 20 04:19:37.162629 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1164/2438] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 6551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:19:37.175803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-139480e4-3b97-487e-817e-64e39568b3ed tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:37.176507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-139480e4-3b97-487e-817e-64e39568b3ed tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:37.290943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-139480e4-3b97-487e-817e-64e39568b3ed tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:37.302766 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-139480e4-3b97-487e-817e-64e39568b3ed tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1214 microversion: 2.1 time: 0.132946 Jul 20 04:19:37.303354 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1165/2439] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:37 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:37.331878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ffaea594-fc47-4cf3-b49a-98ff6ebdf67a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:37.332511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ffaea594-fc47-4cf3-b49a-98ff6ebdf67a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:37.358014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffaea594-fc47-4cf3-b49a-98ff6ebdf67a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.359930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffaea594-fc47-4cf3-b49a-98ff6ebdf67a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.360939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffaea594-fc47-4cf3-b49a-98ff6ebdf67a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.366026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffaea594-fc47-4cf3-b49a-98ff6ebdf67a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.857414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ffaea594-fc47-4cf3-b49a-98ff6ebdf67a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbba918962a4bcda2eae6f7f07946d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a46ad029dbb4797af468175c36fc530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:37.867322 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ffaea594-fc47-4cf3-b49a-98ff6ebdf67a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8" status: 200 len: 1314 microversion: 2.1 time: 0.562864 Jul 20 04:19:37.868964 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1166/2440] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:37 2022] GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:37.887833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-21497e54-1b0d-4def-8129-814650c2095c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:37.888724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-21497e54-1b0d-4def-8129-814650c2095c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:37.898859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21497e54-1b0d-4def-8129-814650c2095c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.900128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21497e54-1b0d-4def-8129-814650c2095c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.901191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21497e54-1b0d-4def-8129-814650c2095c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.903900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21497e54-1b0d-4def-8129-814650c2095c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.250699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-21497e54-1b0d-4def-8129-814650c2095c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:38.266419 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-21497e54-1b0d-4def-8129-814650c2095c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1320 microversion: 2.1 time: 0.395358 Jul 20 04:19:38.269348 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1167/2441] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:37 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:38.319708 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5fb86bd2-bb52-4346-a72b-9f3a33137fa8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 204 len: 0 microversion: 2.1 time: 1.163512 Jul 20 04:19:38.322202 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1275/2442] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:37 2022] DELETE /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 0 bytes in 1168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:38.332372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8433e262-eafd-4788-976f-ed6e3662d881 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:38.333990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8433e262-eafd-4788-976f-ed6e3662d881 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:38.337665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2404c8f-d118-4aaf-b4df-cd3ec20b536a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:38.338756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f2404c8f-d118-4aaf-b4df-cd3ec20b536a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:38.349422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2404c8f-d118-4aaf-b4df-cd3ec20b536a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.350297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2404c8f-d118-4aaf-b4df-cd3ec20b536a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.351727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2404c8f-d118-4aaf-b4df-cd3ec20b536a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.352390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2404c8f-d118-4aaf-b4df-cd3ec20b536a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.353277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8433e262-eafd-4788-976f-ed6e3662d881 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.356778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8433e262-eafd-4788-976f-ed6e3662d881 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.363352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8433e262-eafd-4788-976f-ed6e3662d881 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.364806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8433e262-eafd-4788-976f-ed6e3662d881 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.389955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f2404c8f-d118-4aaf-b4df-cd3ec20b536a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:38.523751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8433e262-eafd-4788-976f-ed6e3662d881 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:38.539128 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8433e262-eafd-4788-976f-ed6e3662d881 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1218 microversion: 2.1 time: 0.220947 Jul 20 04:19:38.540943 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1168/2443] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:38 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1218 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:38.557505 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f2404c8f-d118-4aaf-b4df-cd3ec20b536a tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 204 len: 0 microversion: 2.1 time: 0.229761 Jul 20 04:19:38.558626 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1276/2444] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:38 2022] DELETE /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:38.707479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2026276224", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "d9fe07a4-2a16-4e79-9ad2-c5078d0d5312"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:38.796335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] validate_networks() for [('d9fe07a4-2a16-4e79-9ad2-c5078d0d5312', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:38.892064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c5e0d952-5d66-4bc5-a849-dc7066663e58 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:38.892790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c5e0d952-5d66-4bc5-a849-dc7066663e58 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:38.903897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5e0d952-5d66-4bc5-a849-dc7066663e58 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.904583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5e0d952-5d66-4bc5-a849-dc7066663e58 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.905373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5e0d952-5d66-4bc5-a849-dc7066663e58 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.905814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5e0d952-5d66-4bc5-a849-dc7066663e58 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.653637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c5e0d952-5d66-4bc5-a849-dc7066663e58 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbba918962a4bcda2eae6f7f07946d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a46ad029dbb4797af468175c36fc530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:39.663200 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c5e0d952-5d66-4bc5-a849-dc7066663e58 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8" status: 200 len: 1314 microversion: 2.1 time: 0.780127 Jul 20 04:19:39.664690 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1277/2445] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:38 2022] GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:39.671057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-0f479b75-7dae-48a0-aa68-d60b66bd3deb req-5d8f8eda-ae2c-4fa0-a803-d239b4550d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6131221c-3273-45e7-9458-8fedaa324b3d", "name": "network-vif-plugged", "status": "completed", "tag": "3f966a3d-4e22-44cb-9eca-42c02abaefef"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:39.682359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0f479b75-7dae-48a0-aa68-d60b66bd3deb req-5d8f8eda-ae2c-4fa0-a803-d239b4550d97 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.682994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0f479b75-7dae-48a0-aa68-d60b66bd3deb req-5d8f8eda-ae2c-4fa0-a803-d239b4550d97 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.704267 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-0f479b75-7dae-48a0-aa68-d60b66bd3deb req-5d8f8eda-ae2c-4fa0-a803-d239b4550d97 service nova] Creating event network-vif-plugged:3f966a3d-4e22-44cb-9eca-42c02abaefef for instance 6131221c-3273-45e7-9458-8fedaa324b3d on n-h1-764485-11 Jul 20 04:19:39.709584 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-0f479b75-7dae-48a0-aa68-d60b66bd3deb req-5d8f8eda-ae2c-4fa0-a803-d239b4550d97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043473 Jul 20 04:19:39.710776 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1278/2446] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:39.719466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-725ffd29-4377-4e83-8779-f422787f6b9d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:39.720353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-725ffd29-4377-4e83-8779-f422787f6b9d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:39.728195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-725ffd29-4377-4e83-8779-f422787f6b9d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.729428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-725ffd29-4377-4e83-8779-f422787f6b9d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.733366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-725ffd29-4377-4e83-8779-f422787f6b9d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.735020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-725ffd29-4377-4e83-8779-f422787f6b9d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.137010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-725ffd29-4377-4e83-8779-f422787f6b9d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:40.160296 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-725ffd29-4377-4e83-8779-f422787f6b9d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1320 microversion: 2.1 time: 0.441097 Jul 20 04:19:40.161357 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1279/2447] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:39 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1320 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:40.179795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e01511cb-29f6-4967-8054-cf3fa1b8de9f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.182908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e01511cb-29f6-4967-8054-cf3fa1b8de9f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:40.209842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e01511cb-29f6-4967-8054-cf3fa1b8de9f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.210556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e01511cb-29f6-4967-8054-cf3fa1b8de9f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.211845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e01511cb-29f6-4967-8054-cf3fa1b8de9f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.212476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e01511cb-29f6-4967-8054-cf3fa1b8de9f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.364174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:40.365539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:40.366352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:40.366789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:40.367956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:40.382903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.383358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.387078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.387647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.415983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e01511cb-29f6-4967-8054-cf3fa1b8de9f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:40.429082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Getting quotas for project 6d23a8eadfd74e358d917b9aa3b85bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:40.431211 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e01511cb-29f6-4967-8054-cf3fa1b8de9f tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1266 microversion: 2.1 time: 0.267153 Jul 20 04:19:40.432086 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1280/2448] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:40 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:40.445495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Getting quotas for user 0d1edf9dfed144d8875968ffd5f9ad91 and project 6d23a8eadfd74e358d917b9aa3b85bb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:40.468291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:40.471087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:40.540179 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2f0710bb-ee59-42e4-9183-974b7f42dd82 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.837162 Jul 20 04:19:40.547111 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1169/2449] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:40.557923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-11278578-b890-4414-9b43-cc19d196f6c8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.559349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-11278578-b890-4414-9b43-cc19d196f6c8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:40.682424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7008a623-3726-45b8-86c6-1c7d5aabe9ff tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.683465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7008a623-3726-45b8-86c6-1c7d5aabe9ff tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:40.692174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7008a623-3726-45b8-86c6-1c7d5aabe9ff tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.701746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7008a623-3726-45b8-86c6-1c7d5aabe9ff tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.702725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7008a623-3726-45b8-86c6-1c7d5aabe9ff tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.703197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7008a623-3726-45b8-86c6-1c7d5aabe9ff tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.757830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-11278578-b890-4414-9b43-cc19d196f6c8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:40.771602 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-11278578-b890-4414-9b43-cc19d196f6c8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1208 microversion: 2.1 time: 0.219174 Jul 20 04:19:40.774540 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1281/2450] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:40 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1208 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:41.180522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7938cf43-6bbb-43b9-8d08-dc05e13aa1ed tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:41.181360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7938cf43-6bbb-43b9-8d08-dc05e13aa1ed tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:41.195004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7938cf43-6bbb-43b9-8d08-dc05e13aa1ed tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.198692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7938cf43-6bbb-43b9-8d08-dc05e13aa1ed tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.202982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7008a623-3726-45b8-86c6-1c7d5aabe9ff tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbba918962a4bcda2eae6f7f07946d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a46ad029dbb4797af468175c36fc530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:41.207250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7938cf43-6bbb-43b9-8d08-dc05e13aa1ed tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.207250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7938cf43-6bbb-43b9-8d08-dc05e13aa1ed tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.212130 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7008a623-3726-45b8-86c6-1c7d5aabe9ff tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8" status: 200 len: 1314 microversion: 2.1 time: 0.534490 Jul 20 04:19:41.215360 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1170/2451] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:40 2022] GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:41.455268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ef4b7005-ce8b-49d0-85a9-1700bc6134d4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:41.456963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ef4b7005-ce8b-49d0-85a9-1700bc6134d4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:41.466211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef4b7005-ce8b-49d0-85a9-1700bc6134d4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.466996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef4b7005-ce8b-49d0-85a9-1700bc6134d4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.468083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef4b7005-ce8b-49d0-85a9-1700bc6134d4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.468745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef4b7005-ce8b-49d0-85a9-1700bc6134d4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.512252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7938cf43-6bbb-43b9-8d08-dc05e13aa1ed tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:41.541764 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7938cf43-6bbb-43b9-8d08-dc05e13aa1ed tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1320 microversion: 2.1 time: 0.367158 Jul 20 04:19:41.543091 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1282/2452] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:41 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1320 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:41.553930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1316830419", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "df747a0a-54f0-4048-b8b5-f5647e06453b"}, {"port": "3298e9a7-b585-427c-b1d4-5645fbc2414d", "tag": "port-1"}, {"port": "838ed0ec-c5bd-4bce-ac1a-7200a5f4ab77", "tag": "port-2"}, {"uuid": "9b89a6bc-3585-4cd3-ae70-7573697ea437", "tag": "net-1"}, {"uuid": "9b89a6bc-3585-4cd3-ae70-7573697ea437"}, {"uuid": "c93631cd-552c-49dd-a0ce-ef64cd695003", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c93631cd-552c-49dd-a0ce-ef64cd695003", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "53c078fa-4c44-46fb-8133-68cf131126ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1c420aaa-5706-430a-a0d5-000f0d53abf2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a422425c-b54e-4e71-8280-94558346848e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1302483647"}], "key_name": "tempest-keypair-1521659503", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:41.563360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ef4b7005-ce8b-49d0-85a9-1700bc6134d4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:41.576997 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ef4b7005-ce8b-49d0-85a9-1700bc6134d4 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1272 microversion: 2.1 time: 0.128390 Jul 20 04:19:41.578125 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1171/2453] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:41 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:41.710070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] validate_networks() for [('df747a0a-54f0-4048-b8b5-f5647e06453b', None, None, None, None, None), (None, None, '3298e9a7-b585-427c-b1d4-5645fbc2414d', None, None, None), (None, None, '838ed0ec-c5bd-4bce-ac1a-7200a5f4ab77', None, None, None), ('9b89a6bc-3585-4cd3-ae70-7573697ea437', None, None, None, None, None), ('9b89a6bc-3585-4cd3-ae70-7573697ea437', None, None, None, None, None), ('c93631cd-552c-49dd-a0ce-ef64cd695003', '10.2.2.100', None, None, None, None), ('c93631cd-552c-49dd-a0ce-ef64cd695003', '10.2.2.200', None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:41.726802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-4553ab52-4f17-48d9-84f1-f303e31a910d req-67d078b3-0cf4-47b7-b806-78dd1ffae317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2394da98-223c-4a33-8a73-6a98c5822358", "name": "network-vif-unplugged", "status": "completed", "tag": "a7ab8ce3-f14f-4e01-8c65-acc3536763ec"}, {"server_uuid": "8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6", "name": "network-vif-plugged", "status": "completed", "tag": "f03054f4-ef50-46f3-86ab-6137f2b51442"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:41.745259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4553ab52-4f17-48d9-84f1-f303e31a910d req-67d078b3-0cf4-47b7-b806-78dd1ffae317 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.745908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4553ab52-4f17-48d9-84f1-f303e31a910d req-67d078b3-0cf4-47b7-b806-78dd1ffae317 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.771151 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-4553ab52-4f17-48d9-84f1-f303e31a910d req-67d078b3-0cf4-47b7-b806-78dd1ffae317 service nova] Creating event network-vif-unplugged:a7ab8ce3-f14f-4e01-8c65-acc3536763ec for instance 2394da98-223c-4a33-8a73-6a98c5822358 on n-h1-764485-11 Jul 20 04:19:41.772353 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-4553ab52-4f17-48d9-84f1-f303e31a910d req-67d078b3-0cf4-47b7-b806-78dd1ffae317 service nova] Creating event network-vif-plugged:f03054f4-ef50-46f3-86ab-6137f2b51442 for instance 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 on n-h2-764485-11 Jul 20 04:19:41.782548 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-4553ab52-4f17-48d9-84f1-f303e31a910d req-67d078b3-0cf4-47b7-b806-78dd1ffae317 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.060025 Jul 20 04:19:41.783404 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1172/2454] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:41.793849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8367ba7d-9250-4546-aee0-abb5c81d72c1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:41.794917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8367ba7d-9250-4546-aee0-abb5c81d72c1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:41.803980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8367ba7d-9250-4546-aee0-abb5c81d72c1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.804709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8367ba7d-9250-4546-aee0-abb5c81d72c1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.805670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8367ba7d-9250-4546-aee0-abb5c81d72c1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.806253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8367ba7d-9250-4546-aee0-abb5c81d72c1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.933687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8367ba7d-9250-4546-aee0-abb5c81d72c1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:41.942844 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8367ba7d-9250-4546-aee0-abb5c81d72c1 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1260 microversion: 2.1 time: 0.154262 Jul 20 04:19:41.945971 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1173/2455] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:41 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:42.238815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-486cfecf-87f8-4c03-bf8f-f36ee3622f9b tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.239915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-486cfecf-87f8-4c03-bf8f-f36ee3622f9b tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:42.254743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-486cfecf-87f8-4c03-bf8f-f36ee3622f9b tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.258309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-486cfecf-87f8-4c03-bf8f-f36ee3622f9b tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.262059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-486cfecf-87f8-4c03-bf8f-f36ee3622f9b tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.262771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-486cfecf-87f8-4c03-bf8f-f36ee3622f9b tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.002514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-486cfecf-87f8-4c03-bf8f-f36ee3622f9b tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbba918962a4bcda2eae6f7f07946d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a46ad029dbb4797af468175c36fc530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:43.013662 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-486cfecf-87f8-4c03-bf8f-f36ee3622f9b tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8" status: 200 len: 1314 microversion: 2.1 time: 0.787022 Jul 20 04:19:43.014263 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1174/2456] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 => generated 1314 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:43.027637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-91db4c3c-f7bf-41ff-a2c1-b61a42cfd5ca tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.028828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-91db4c3c-f7bf-41ff-a2c1-b61a42cfd5ca tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:43.046352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91db4c3c-f7bf-41ff-a2c1-b61a42cfd5ca tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.046819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91db4c3c-f7bf-41ff-a2c1-b61a42cfd5ca tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.050000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91db4c3c-f7bf-41ff-a2c1-b61a42cfd5ca tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.051455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91db4c3c-f7bf-41ff-a2c1-b61a42cfd5ca tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.559589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-91db4c3c-f7bf-41ff-a2c1-b61a42cfd5ca tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:43.567963 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-91db4c3c-f7bf-41ff-a2c1-b61a42cfd5ca tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1320 microversion: 2.1 time: 0.552620 Jul 20 04:19:43.575807 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1175/2457] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1320 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:43.582466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d2b782fb-67bb-4686-9b5f-635008791001 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.583099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d2b782fb-67bb-4686-9b5f-635008791001 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:43.593976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2b782fb-67bb-4686-9b5f-635008791001 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.594692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2b782fb-67bb-4686-9b5f-635008791001 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.595478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2b782fb-67bb-4686-9b5f-635008791001 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.595948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2b782fb-67bb-4686-9b5f-635008791001 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.786578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d2b782fb-67bb-4686-9b5f-635008791001 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:44.799359 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d2b782fb-67bb-4686-9b5f-635008791001 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1314 microversion: 2.1 time: 1.221995 Jul 20 04:19:44.800244 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1176/2458] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1314 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:44.805355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a2f9ad1c-a184-45a6-a8c3-42dad0035c5d req-0d299474-65b5-4e4e-9686-488166aff398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2394da98-223c-4a33-8a73-6a98c5822358", "name": "network-vif-deleted", "tag": "a7ab8ce3-f14f-4e01-8c65-acc3536763ec"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:44.814243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a2f9ad1c-a184-45a6-a8c3-42dad0035c5d req-0d299474-65b5-4e4e-9686-488166aff398 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.814946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a2f9ad1c-a184-45a6-a8c3-42dad0035c5d req-0d299474-65b5-4e4e-9686-488166aff398 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.832497 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a2f9ad1c-a184-45a6-a8c3-42dad0035c5d req-0d299474-65b5-4e4e-9686-488166aff398 service nova] Creating event network-vif-deleted:a7ab8ce3-f14f-4e01-8c65-acc3536763ec for instance 2394da98-223c-4a33-8a73-6a98c5822358 on n-h1-764485-11 Jul 20 04:19:44.840474 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a2f9ad1c-a184-45a6-a8c3-42dad0035c5d req-0d299474-65b5-4e4e-9686-488166aff398 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038820 Jul 20 04:19:44.848881 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1177/2459] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:44.855645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-80a89bd1-f97c-4f1e-9596-da7c6a85d27f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:44.856587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-80a89bd1-f97c-4f1e-9596-da7c6a85d27f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:44.874157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80a89bd1-f97c-4f1e-9596-da7c6a85d27f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.874886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80a89bd1-f97c-4f1e-9596-da7c6a85d27f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.879290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80a89bd1-f97c-4f1e-9596-da7c6a85d27f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.880005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80a89bd1-f97c-4f1e-9596-da7c6a85d27f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.304066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-80a89bd1-f97c-4f1e-9596-da7c6a85d27f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:45.313412 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-80a89bd1-f97c-4f1e-9596-da7c6a85d27f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1308 microversion: 2.1 time: 0.462320 Jul 20 04:19:45.324285 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1178/2460] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:44 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:45.332838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-83f1bfed-3b6d-4a3f-88fa-7d1713fce8b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:45.333679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-83f1bfed-3b6d-4a3f-88fa-7d1713fce8b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:45.342535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83f1bfed-3b6d-4a3f-88fa-7d1713fce8b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.343287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83f1bfed-3b6d-4a3f-88fa-7d1713fce8b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.345011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83f1bfed-3b6d-4a3f-88fa-7d1713fce8b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.345631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83f1bfed-3b6d-4a3f-88fa-7d1713fce8b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.667428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-83f1bfed-3b6d-4a3f-88fa-7d1713fce8b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbba918962a4bcda2eae6f7f07946d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a46ad029dbb4797af468175c36fc530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:45.679942 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-83f1bfed-3b6d-4a3f-88fa-7d1713fce8b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8" status: 200 len: 1314 microversion: 2.1 time: 0.352964 Jul 20 04:19:45.684342 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1179/2461] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:45 2022] GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:45.691858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1ceee24e-9ba4-40f8-825a-32dd5ff3e8b6 req-1f8026a2-a983-4ac8-9c0f-6b9d4aafd0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae261d7-a988-4c63-ac78-62c8aef00af8", "name": "network-vif-plugged", "status": "completed", "tag": "b4ae28d2-9fdc-4aa9-a1dd-948d9416be04"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:45.706133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1ceee24e-9ba4-40f8-825a-32dd5ff3e8b6 req-1f8026a2-a983-4ac8-9c0f-6b9d4aafd0c1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.707138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1ceee24e-9ba4-40f8-825a-32dd5ff3e8b6 req-1f8026a2-a983-4ac8-9c0f-6b9d4aafd0c1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.756011 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1ceee24e-9ba4-40f8-825a-32dd5ff3e8b6 req-1f8026a2-a983-4ac8-9c0f-6b9d4aafd0c1 service nova] Creating event network-vif-plugged:b4ae28d2-9fdc-4aa9-a1dd-948d9416be04 for instance dae261d7-a988-4c63-ac78-62c8aef00af8 on n-h2-764485-11 Jul 20 04:19:45.767860 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1ceee24e-9ba4-40f8-825a-32dd5ff3e8b6 req-1f8026a2-a983-4ac8-9c0f-6b9d4aafd0c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081946 Jul 20 04:19:45.772258 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1180/2462] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:45.793950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c3d49a66-a052-4747-9cbb-19adb1018877 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:45.796788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c3d49a66-a052-4747-9cbb-19adb1018877 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:45.833579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3d49a66-a052-4747-9cbb-19adb1018877 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.834039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3d49a66-a052-4747-9cbb-19adb1018877 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.834835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3d49a66-a052-4747-9cbb-19adb1018877 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.836961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3d49a66-a052-4747-9cbb-19adb1018877 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.276655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c3d49a66-a052-4747-9cbb-19adb1018877 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:46.293596 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c3d49a66-a052-4747-9cbb-19adb1018877 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1511 microversion: 2.1 time: 0.518223 Jul 20 04:19:46.295300 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1181/2463] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:45 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1511 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:46.303917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9639ae1a-3f4e-48c4-886c-09654308d709 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:46.305538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9639ae1a-3f4e-48c4-886c-09654308d709 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:46.328886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9639ae1a-3f4e-48c4-886c-09654308d709 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.330393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9639ae1a-3f4e-48c4-886c-09654308d709 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.331993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9639ae1a-3f4e-48c4-886c-09654308d709 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.332715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9639ae1a-3f4e-48c4-886c-09654308d709 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.848846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9639ae1a-3f4e-48c4-886c-09654308d709 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:46.860479 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9639ae1a-3f4e-48c4-886c-09654308d709 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1314 microversion: 2.1 time: 0.562052 Jul 20 04:19:46.862483 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1182/2464] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:46 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:46.881640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a390a0af-8ccd-4a2c-abe6-b7153b0dcb45 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:46.882721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a390a0af-8ccd-4a2c-abe6-b7153b0dcb45 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:46.899370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a390a0af-8ccd-4a2c-abe6-b7153b0dcb45 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.901791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a390a0af-8ccd-4a2c-abe6-b7153b0dcb45 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.906002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a390a0af-8ccd-4a2c-abe6-b7153b0dcb45 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.908991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a390a0af-8ccd-4a2c-abe6-b7153b0dcb45 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:47.301873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a390a0af-8ccd-4a2c-abe6-b7153b0dcb45 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:47.316655 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a390a0af-8ccd-4a2c-abe6-b7153b0dcb45 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1512 microversion: 2.1 time: 0.451509 Jul 20 04:19:47.317906 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1183/2465] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:46 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1512 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:47.329660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa1249b2-8283-4403-a8b6-ecac4a82c4f7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:47.330283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa1249b2-8283-4403-a8b6-ecac4a82c4f7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:47.339330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa1249b2-8283-4403-a8b6-ecac4a82c4f7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:47.343837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa1249b2-8283-4403-a8b6-ecac4a82c4f7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:47.345159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa1249b2-8283-4403-a8b6-ecac4a82c4f7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:47.348196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa1249b2-8283-4403-a8b6-ecac4a82c4f7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.047371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fa1249b2-8283-4403-a8b6-ecac4a82c4f7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:48.070394 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fa1249b2-8283-4403-a8b6-ecac4a82c4f7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1308 microversion: 2.1 time: 0.737172 Jul 20 04:19:48.071132 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1184/2466] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:47 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1308 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:48.077468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-333e6a12-85f7-4e00-9abb-575e5c3c3afd tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:48.089470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-333e6a12-85f7-4e00-9abb-575e5c3c3afd tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:48.107366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-333e6a12-85f7-4e00-9abb-575e5c3c3afd tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.108116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-333e6a12-85f7-4e00-9abb-575e5c3c3afd tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.109093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-333e6a12-85f7-4e00-9abb-575e5c3c3afd tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.109689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-333e6a12-85f7-4e00-9abb-575e5c3c3afd tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.119787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:48.490638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-333e6a12-85f7-4e00-9abb-575e5c3c3afd tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbba918962a4bcda2eae6f7f07946d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a46ad029dbb4797af468175c36fc530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:48.499281 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-333e6a12-85f7-4e00-9abb-575e5c3c3afd tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8" status: 200 len: 1463 microversion: 2.1 time: 0.425507 Jul 20 04:19:48.499923 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1185/2467] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:48 2022] GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 => generated 1463 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:48.504420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c81606db-04cc-4590-884d-6c16b6bb919b req-d7eeec31-7d50-4ec1-aa14-c0a4d0b48bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac84d10-8291-412d-8921-cdc10c2682fa", "tag": "752a09de-27dd-484d-921c-72aa7e0f3a31"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:48.551058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c81606db-04cc-4590-884d-6c16b6bb919b req-d7eeec31-7d50-4ec1-aa14-c0a4d0b48bd4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.551800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c81606db-04cc-4590-884d-6c16b6bb919b req-d7eeec31-7d50-4ec1-aa14-c0a4d0b48bd4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.576417 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c81606db-04cc-4590-884d-6c16b6bb919b req-d7eeec31-7d50-4ec1-aa14-c0a4d0b48bd4 service nova] Creating event network-changed:752a09de-27dd-484d-921c-72aa7e0f3a31 for instance 7ac84d10-8291-412d-8921-cdc10c2682fa on n-h1-764485-11 Jul 20 04:19:48.581647 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c81606db-04cc-4590-884d-6c16b6bb919b req-d7eeec31-7d50-4ec1-aa14-c0a4d0b48bd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080523 Jul 20 04:19:48.582278 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1186/2468] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:48.591562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-2180fbc5-8c24-4f8d-9148-4cf911199d09 req-4e2d8f82-16d8-429c-892c-4bfba50941a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e01d407e-11e5-485c-a8ad-e61430209b58", "tag": "ccb93931-e4ce-4c40-99a6-c9dcbbb6df7d"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:48.634323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2180fbc5-8c24-4f8d-9148-4cf911199d09 req-4e2d8f82-16d8-429c-892c-4bfba50941a4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.635208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2180fbc5-8c24-4f8d-9148-4cf911199d09 req-4e2d8f82-16d8-429c-892c-4bfba50941a4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.662849 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-2180fbc5-8c24-4f8d-9148-4cf911199d09 req-4e2d8f82-16d8-429c-892c-4bfba50941a4 service nova] Creating event network-changed:ccb93931-e4ce-4c40-99a6-c9dcbbb6df7d for instance e01d407e-11e5-485c-a8ad-e61430209b58 on n-h2-764485-11 Jul 20 04:19:48.675276 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-2180fbc5-8c24-4f8d-9148-4cf911199d09 req-4e2d8f82-16d8-429c-892c-4bfba50941a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091465 Jul 20 04:19:48.678295 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1187/2469] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:48.694096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96ad8d0e-c209-4c25-a5f8-3394bc0f4ce5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:48.697600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96ad8d0e-c209-4c25-a5f8-3394bc0f4ce5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 6131221c-3273-45e7-9458-8fedaa324b3d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:48.714540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96ad8d0e-c209-4c25-a5f8-3394bc0f4ce5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.715230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:48.716072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:48.716751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:48.717320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:48.717885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:48.718565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96ad8d0e-c209-4c25-a5f8-3394bc0f4ce5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.720770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=87,nova_api:UPDATE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:48.722153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96ad8d0e-c209-4c25-a5f8-3394bc0f4ce5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.724037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96ad8d0e-c209-4c25-a5f8-3394bc0f4ce5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.740497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.741369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.742652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.743278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.768000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Getting quotas for project 081d522e2dcb4382a220a60f6570caf0. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:48.775145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Getting quotas for user f7514410e1d348ea87a3ce1bc13a7d92 and project 081d522e2dcb4382a220a60f6570caf0. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:49.204640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:49.209987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='53c078fa-4c44-46fb-8133-68cf131126ac',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1c420aaa-5706-430a-a0d5-000f0d53abf2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a422425c-b54e-4e71-8280-94558346848e',volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:49.746664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-96ad8d0e-c209-4c25-a5f8-3394bc0f4ce5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:49.776048 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-96ad8d0e-c209-4c25-a5f8-3394bc0f4ce5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d" status: 200 len: 1511 microversion: 2.1 time: 1.093474 Jul 20 04:19:49.777527 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1188/2470] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:48 2022] GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d => generated 1511 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:49.807559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a5fd6d47-fa8f-4655-b332-e49377a762c3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:49.815468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a5fd6d47-fa8f-4655-b332-e49377a762c3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:49.833037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5fd6d47-fa8f-4655-b332-e49377a762c3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.833733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5fd6d47-fa8f-4655-b332-e49377a762c3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.834861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5fd6d47-fa8f-4655-b332-e49377a762c3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.835908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5fd6d47-fa8f-4655-b332-e49377a762c3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.916097 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e60dd79f-2a0f-4a36-ab01-76b90d2ecad1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.371452 Jul 20 04:19:49.918311 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1283/2471] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Jul 20 04:19:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 8374 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:19:50.195091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a5fd6d47-fa8f-4655-b332-e49377a762c3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.204263 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a5fd6d47-fa8f-4655-b332-e49377a762c3 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1314 microversion: 2.1 time: 0.416736 Jul 20 04:19:50.211177 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1189/2472] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:49 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:50.222475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5949d4d9-bccf-4d98-83a6-8f18ce032815 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.223364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5949d4d9-bccf-4d98-83a6-8f18ce032815 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:50.240398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5949d4d9-bccf-4d98-83a6-8f18ce032815 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.241685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5949d4d9-bccf-4d98-83a6-8f18ce032815 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.242631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5949d4d9-bccf-4d98-83a6-8f18ce032815 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.247113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5949d4d9-bccf-4d98-83a6-8f18ce032815 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.308087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6a74bd39-db10-49f3-8e7d-9192712a6d6d tempest-TenantUsagesTestJSON-1896789016 tempest-TenantUsagesTestJSON-1896789016-project-admin] Calling method '.version_select at 0x7fbf9d5b6a60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.333262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a74bd39-db10-49f3-8e7d-9192712a6d6d tempest-TenantUsagesTestJSON-1896789016 tempest-TenantUsagesTestJSON-1896789016-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.333725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a74bd39-db10-49f3-8e7d-9192712a6d6d tempest-TenantUsagesTestJSON-1896789016 tempest-TenantUsagesTestJSON-1896789016-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.360753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a74bd39-db10-49f3-8e7d-9192712a6d6d tempest-TenantUsagesTestJSON-1896789016 tempest-TenantUsagesTestJSON-1896789016-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.361479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a74bd39-db10-49f3-8e7d-9192712a6d6d tempest-TenantUsagesTestJSON-1896789016 tempest-TenantUsagesTestJSON-1896789016-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.388862 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6a74bd39-db10-49f3-8e7d-9192712a6d6d tempest-TenantUsagesTestJSON-1896789016 tempest-TenantUsagesTestJSON-1896789016-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/4a46ad029dbb4797af468175c36fc530?start=2022-07-19T04%3A19%3A48.508762&end=2022-07-21T04%3A19%3A48.508762" status: 200 len: 695 microversion: 2.1 time: 0.469215 Jul 20 04:19:50.390435 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1284/2473] 10.222.0.20 () {58 vars in 1411 bytes} [Wed Jul 20 04:19:49 2022] GET /compute/v2.1/os-simple-tenant-usage/4a46ad029dbb4797af468175c36fc530?start=2022-07-19T04%3A19%3A48.508762&end=2022-07-21T04%3A19%3A48.508762 => generated 695 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:50.396245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f6835e6-635f-47bc-8378-a2a85f488e2a tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.403865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:50.405292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1f6835e6-635f-47bc-8378-a2a85f488e2a tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.406801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1f6835e6-635f-47bc-8378-a2a85f488e2a tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:50.430020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f6835e6-635f-47bc-8378-a2a85f488e2a tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.430957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f6835e6-635f-47bc-8378-a2a85f488e2a tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.435442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f6835e6-635f-47bc-8378-a2a85f488e2a tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.436261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f6835e6-635f-47bc-8378-a2a85f488e2a tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.464517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=14 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:50.531124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5949d4d9-bccf-4d98-83a6-8f18ce032815 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.546311 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5949d4d9-bccf-4d98-83a6-8f18ce032815 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1308 microversion: 2.1 time: 0.333129 Jul 20 04:19:50.547381 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1190/2474] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:50.561305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fd2443d4-208e-455c-ac55-98ccb8a09d20 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.564193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fd2443d4-208e-455c-ac55-98ccb8a09d20 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:50.594746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-1f6835e6-635f-47bc-8378-a2a85f488e2a tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:19:50.638058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fd2443d4-208e-455c-ac55-98ccb8a09d20 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.657755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fd2443d4-208e-455c-ac55-98ccb8a09d20 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.659309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fd2443d4-208e-455c-ac55-98ccb8a09d20 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.660728 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fd2443d4-208e-455c-ac55-98ccb8a09d20 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1286 microversion: 2.42 time: 0.112233 Jul 20 04:19:50.661840 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1191/2475] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:50.677809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9a03103b-9afa-4480-9b34-e2b84507ee0a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '.version_select at 0x7fbf9d136a60>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.699610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a03103b-9afa-4480-9b34-e2b84507ee0a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.700358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a03103b-9afa-4480-9b34-e2b84507ee0a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.726677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a03103b-9afa-4480-9b34-e2b84507ee0a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.727705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a03103b-9afa-4480-9b34-e2b84507ee0a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.734883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1f6835e6-635f-47bc-8378-a2a85f488e2a tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.741775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f6835e6-635f-47bc-8378-a2a85f488e2a tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.742436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f6835e6-635f-47bc-8378-a2a85f488e2a tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.753854 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9a03103b-9afa-4480-9b34-e2b84507ee0a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/4a46ad029dbb4797af468175c36fc530?start=2022-07-19T04%3A19%3A48.508762&end=2022-07-21T04%3A19%3A48.508762" status: 200 len: 695 microversion: 2.1 time: 0.080865 Jul 20 04:19:50.763021 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1192/2476] 10.222.0.20 () {58 vars in 1411 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/os-simple-tenant-usage/4a46ad029dbb4797af468175c36fc530?start=2022-07-19T04%3A19%3A48.508762&end=2022-07-21T04%3A19%3A48.508762 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:50.768673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-739a87d6-dcc9-4f84-b97f-b5a0059cce48 tempest-TenantUsagesTestJSON-1896789016 tempest-TenantUsagesTestJSON-1896789016-project-admin] Calling method '.version_select at 0x7fbf9d1b0040>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.778397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-739a87d6-dcc9-4f84-b97f-b5a0059cce48 tempest-TenantUsagesTestJSON-1896789016 tempest-TenantUsagesTestJSON-1896789016-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.779025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-739a87d6-dcc9-4f84-b97f-b5a0059cce48 tempest-TenantUsagesTestJSON-1896789016 tempest-TenantUsagesTestJSON-1896789016-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.800025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-739a87d6-dcc9-4f84-b97f-b5a0059cce48 tempest-TenantUsagesTestJSON-1896789016 tempest-TenantUsagesTestJSON-1896789016-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.801008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-739a87d6-dcc9-4f84-b97f-b5a0059cce48 tempest-TenantUsagesTestJSON-1896789016 tempest-TenantUsagesTestJSON-1896789016-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.957496 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f6835e6-635f-47bc-8378-a2a85f488e2a tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.565508 Jul 20 04:19:50.958459 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1285/2477] 10.222.0.20 () {58 vars in 1166 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:50.966619 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-739a87d6-dcc9-4f84-b97f-b5a0059cce48 tempest-TenantUsagesTestJSON-1896789016 tempest-TenantUsagesTestJSON-1896789016-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A19%3A48.508762&end=2022-07-21T04%3A19%3A48.508762&detailed=1" status: 200 len: 27426 microversion: 2.1 time: 0.202126 Jul 20 04:19:50.967238 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1193/2478] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A19%3A48.508762&end=2022-07-21T04%3A19%3A48.508762&detailed=1 => generated 27426 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:19:50.982996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1b69b2ca-ff39-405d-833f-081e12e4ed82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.987614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1b69b2ca-ff39-405d-833f-081e12e4ed82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.988599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1b69b2ca-ff39-405d-833f-081e12e4ed82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-900642373', 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:50.994927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b69b2ca-ff39-405d-833f-081e12e4ed82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.995690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b69b2ca-ff39-405d-833f-081e12e4ed82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.996653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b69b2ca-ff39-405d-833f-081e12e4ed82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.997271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b69b2ca-ff39-405d-833f-081e12e4ed82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.004485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2efae7fc-eb2c-4a17-91cb-3d6bbefdc31a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:51.004997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2efae7fc-eb2c-4a17-91cb-3d6bbefdc31a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.021118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2efae7fc-eb2c-4a17-91cb-3d6bbefdc31a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.022144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2efae7fc-eb2c-4a17-91cb-3d6bbefdc31a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.023121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2efae7fc-eb2c-4a17-91cb-3d6bbefdc31a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.023757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2efae7fc-eb2c-4a17-91cb-3d6bbefdc31a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.095941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2efae7fc-eb2c-4a17-91cb-3d6bbefdc31a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:51.244867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-1b69b2ca-ff39-405d-833f-081e12e4ed82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:19:51.280835 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2efae7fc-eb2c-4a17-91cb-3d6bbefdc31a tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8" status: 204 len: 0 microversion: 2.1 time: 0.279908 Jul 20 04:19:51.282026 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1194/2479] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:50 2022] DELETE /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:19:51.291677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ece96fe-b339-43bf-8356-b28b3ff6d1a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:51.292740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ece96fe-b339-43bf-8356-b28b3ff6d1a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.300584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ece96fe-b339-43bf-8356-b28b3ff6d1a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.301104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ece96fe-b339-43bf-8356-b28b3ff6d1a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.301906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ece96fe-b339-43bf-8356-b28b3ff6d1a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.302411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ece96fe-b339-43bf-8356-b28b3ff6d1a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.431260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1b69b2ca-ff39-405d-833f-081e12e4ed82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:51.442745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b69b2ca-ff39-405d-833f-081e12e4ed82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.449569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b69b2ca-ff39-405d-833f-081e12e4ed82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.719820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ece96fe-b339-43bf-8356-b28b3ff6d1a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:51.737055 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ece96fe-b339-43bf-8356-b28b3ff6d1a6 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1314 microversion: 2.1 time: 0.452028 Jul 20 04:19:51.752845 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1195/2480] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:51 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:51.752845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e671b1f9-f159-4f40-8d0a-679c0471eee8 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:51.752845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e671b1f9-f159-4f40-8d0a-679c0471eee8 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.765106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:51.780676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e671b1f9-f159-4f40-8d0a-679c0471eee8 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.794109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e671b1f9-f159-4f40-8d0a-679c0471eee8 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.798243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e671b1f9-f159-4f40-8d0a-679c0471eee8 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.798878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e671b1f9-f159-4f40-8d0a-679c0471eee8 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.840671 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1b69b2ca-ff39-405d-833f-081e12e4ed82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-900642373" status: 200 len: 1515 microversion: 2.1 time: 0.866145 Jul 20 04:19:51.841772 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1286/2481] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-900642373 => generated 1515 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:51.847346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49dbc1b2-1cea-47f6-80ae-d366c88b1c8d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:51.858568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-49dbc1b2-1cea-47f6-80ae-d366c88b1c8d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.874105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49dbc1b2-1cea-47f6-80ae-d366c88b1c8d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.876263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49dbc1b2-1cea-47f6-80ae-d366c88b1c8d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.880565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49dbc1b2-1cea-47f6-80ae-d366c88b1c8d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.881137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49dbc1b2-1cea-47f6-80ae-d366c88b1c8d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.225843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-49dbc1b2-1cea-47f6-80ae-d366c88b1c8d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.248753 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-49dbc1b2-1cea-47f6-80ae-d366c88b1c8d tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1308 microversion: 2.1 time: 0.405640 Jul 20 04:19:52.249372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e671b1f9-f159-4f40-8d0a-679c0471eee8 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbba918962a4bcda2eae6f7f07946d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a46ad029dbb4797af468175c36fc530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.264759 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1287/2482] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:51 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1308 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:52.264759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-287fca78-ab5a-4ffd-9fae-d5b244a328e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:52.267713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-287fca78-ab5a-4ffd-9fae-d5b244a328e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:52.272870 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e671b1f9-f159-4f40-8d0a-679c0471eee8 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8" status: 200 len: 1469 microversion: 2.1 time: 0.525759 Jul 20 04:19:52.277364 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1196/2483] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:51 2022] GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 => generated 1469 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:52.280915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-287fca78-ab5a-4ffd-9fae-d5b244a328e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.281503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-287fca78-ab5a-4ffd-9fae-d5b244a328e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.282363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-287fca78-ab5a-4ffd-9fae-d5b244a328e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.282901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-287fca78-ab5a-4ffd-9fae-d5b244a328e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.292340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f080205b-8906-4286-a547-a0a30c688637 req-60249bd4-500b-4a37-be6f-efcca8d7f892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac84d10-8291-412d-8921-cdc10c2682fa", "name": "network-vif-plugged", "status": "completed", "tag": "752a09de-27dd-484d-921c-72aa7e0f3a31"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:52.315890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f080205b-8906-4286-a547-a0a30c688637 req-60249bd4-500b-4a37-be6f-efcca8d7f892 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.318384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f080205b-8906-4286-a547-a0a30c688637 req-60249bd4-500b-4a37-be6f-efcca8d7f892 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.346849 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f080205b-8906-4286-a547-a0a30c688637 req-60249bd4-500b-4a37-be6f-efcca8d7f892 service nova] Creating event network-vif-plugged:752a09de-27dd-484d-921c-72aa7e0f3a31 for instance 7ac84d10-8291-412d-8921-cdc10c2682fa on n-h1-764485-11 Jul 20 04:19:52.352584 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f080205b-8906-4286-a547-a0a30c688637 req-60249bd4-500b-4a37-be6f-efcca8d7f892 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072620 Jul 20 04:19:52.353757 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1197/2484] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:52.361322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8afa5fb0-b59f-4308-855b-f928684f4693 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:52.365276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8afa5fb0-b59f-4308-855b-f928684f4693 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.366507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8afa5fb0-b59f-4308-855b-f928684f4693 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:52.373938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8afa5fb0-b59f-4308-855b-f928684f4693 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.374696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8afa5fb0-b59f-4308-855b-f928684f4693 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.375711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8afa5fb0-b59f-4308-855b-f928684f4693 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.376387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8afa5fb0-b59f-4308-855b-f928684f4693 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.602119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-8afa5fb0-b59f-4308-855b-f928684f4693 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:19:52.731957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-287fca78-ab5a-4ffd-9fae-d5b244a328e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.755775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-287fca78-ab5a-4ffd-9fae-d5b244a328e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.757525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-287fca78-ab5a-4ffd-9fae-d5b244a328e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.760963 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-287fca78-ab5a-4ffd-9fae-d5b244a328e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1584 microversion: 2.42 time: 0.503973 Jul 20 04:19:52.761811 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1288/2485] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:52 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1584 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:52.773734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-238fcc6d-aaf5-4fbd-a585-bd48079a370c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:52.774714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-238fcc6d-aaf5-4fbd-a585-bd48079a370c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:52.787714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-238fcc6d-aaf5-4fbd-a585-bd48079a370c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.788919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-238fcc6d-aaf5-4fbd-a585-bd48079a370c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.789949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-238fcc6d-aaf5-4fbd-a585-bd48079a370c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.790346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-238fcc6d-aaf5-4fbd-a585-bd48079a370c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.831962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8afa5fb0-b59f-4308-855b-f928684f4693 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.847721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8afa5fb0-b59f-4308-855b-f928684f4693 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.848180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8afa5fb0-b59f-4308-855b-f928684f4693 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.378872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-238fcc6d-aaf5-4fbd-a585-bd48079a370c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:53.386556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:53.392607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-238fcc6d-aaf5-4fbd-a585-bd48079a370c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1314 microversion: 2.1 time: 0.628027 Jul 20 04:19:53.398507 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1289/2486] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:52 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:53.445506 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4a02f5b7-054b-47fc-8c6c-2b9f011214aa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:53.457806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4a02f5b7-054b-47fc-8c6c-2b9f011214aa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:53.471654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a02f5b7-054b-47fc-8c6c-2b9f011214aa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.472408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a02f5b7-054b-47fc-8c6c-2b9f011214aa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.473619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a02f5b7-054b-47fc-8c6c-2b9f011214aa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.474305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a02f5b7-054b-47fc-8c6c-2b9f011214aa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.123237 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8afa5fb0-b59f-4308-855b-f928684f4693 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 1.766802 Jul 20 04:19:54.124423 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1198/2487] 10.222.0.20 () {58 vars in 1172 bytes} [Wed Jul 20 04:19:52 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:54.130405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-384cf89a-078d-437b-9074-8549537740b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:54.133280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-384cf89a-078d-437b-9074-8549537740b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:54.149902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-384cf89a-078d-437b-9074-8549537740b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.151958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-384cf89a-078d-437b-9074-8549537740b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.162709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-384cf89a-078d-437b-9074-8549537740b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.165028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-384cf89a-078d-437b-9074-8549537740b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.776435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4a02f5b7-054b-47fc-8c6c-2b9f011214aa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.787984 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4a02f5b7-054b-47fc-8c6c-2b9f011214aa tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1308 microversion: 2.1 time: 1.346113 Jul 20 04:19:54.790066 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1290/2488] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:53 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1308 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:54.805394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-95f6f171-bd77-44b4-be0b-e14d657ef2c3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:54.807492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-95f6f171-bd77-44b4-be0b-e14d657ef2c3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:54.825538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95f6f171-bd77-44b4-be0b-e14d657ef2c3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.826974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95f6f171-bd77-44b4-be0b-e14d657ef2c3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.827828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95f6f171-bd77-44b4-be0b-e14d657ef2c3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.830313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95f6f171-bd77-44b4-be0b-e14d657ef2c3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.262424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-384cf89a-078d-437b-9074-8549537740b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbba918962a4bcda2eae6f7f07946d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a46ad029dbb4797af468175c36fc530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.282303 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-384cf89a-078d-437b-9074-8549537740b3 tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8" status: 200 len: 1469 microversion: 2.1 time: 1.156359 Jul 20 04:19:55.297543 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1199/2489] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:54 2022] GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 => generated 1469 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:55.307112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-596ac1b4-a10d-4a73-8a67-419c305c7317 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.321813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-596ac1b4-a10d-4a73-8a67-419c305c7317 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.329494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.compute.servers [None req-596ac1b4-a10d-4a73-8a67-419c305c7317 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Removing options 'limit' from query {{(pid=119807) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:19:55.331147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-596ac1b4-a10d-4a73-8a67-419c305c7317 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:55.345509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-596ac1b4-a10d-4a73-8a67-419c305c7317 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.346850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-596ac1b4-a10d-4a73-8a67-419c305c7317 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.351904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-596ac1b4-a10d-4a73-8a67-419c305c7317 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.352639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-596ac1b4-a10d-4a73-8a67-419c305c7317 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.433201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-596ac1b4-a10d-4a73-8a67-419c305c7317 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.454593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-596ac1b4-a10d-4a73-8a67-419c305c7317 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.455051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-596ac1b4-a10d-4a73-8a67-419c305c7317 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.733338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-95f6f171-bd77-44b4-be0b-e14d657ef2c3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.756070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-95f6f171-bd77-44b4-be0b-e14d657ef2c3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.759192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-95f6f171-bd77-44b4-be0b-e14d657ef2c3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.761323 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-95f6f171-bd77-44b4-be0b-e14d657ef2c3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1662 microversion: 2.42 time: 0.967964 Jul 20 04:19:55.779385 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1291/2490] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:54 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1662 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:55.813199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7646fc6f-9674-489a-9593-f8f948ee2738 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.813985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7646fc6f-9674-489a-9593-f8f948ee2738 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.852207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7646fc6f-9674-489a-9593-f8f948ee2738 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.852890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7646fc6f-9674-489a-9593-f8f948ee2738 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.855216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7646fc6f-9674-489a-9593-f8f948ee2738 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.855699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7646fc6f-9674-489a-9593-f8f948ee2738 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.057923 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-596ac1b4-a10d-4a73-8a67-419c305c7317 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.758014 Jul 20 04:19:56.058551 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1200/2491] 10.222.0.20 () {58 vars in 1160 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:56.063222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-63c7ef0d-93be-4df3-a653-f6c24e652dca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:56.063781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-63c7ef0d-93be-4df3-a653-f6c24e652dca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:56.076561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-63c7ef0d-93be-4df3-a653-f6c24e652dca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.077013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-63c7ef0d-93be-4df3-a653-f6c24e652dca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.077809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-63c7ef0d-93be-4df3-a653-f6c24e652dca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.078251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-63c7ef0d-93be-4df3-a653-f6c24e652dca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.196837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7646fc6f-9674-489a-9593-f8f948ee2738 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:56.209022 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7646fc6f-9674-489a-9593-f8f948ee2738 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1500 microversion: 2.1 time: 0.428359 Jul 20 04:19:56.210263 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1292/2492] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1500 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:56.219567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-e3d4f67d-8434-422b-9805-812cbf5587cc req-e3d0d37f-11c5-4e91-8063-d7e2273508c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae261d7-a988-4c63-ac78-62c8aef00af8", "name": "network-vif-deleted", "tag": "b4ae28d2-9fdc-4aa9-a1dd-948d9416be04"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:56.241454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e3d4f67d-8434-422b-9805-812cbf5587cc req-e3d0d37f-11c5-4e91-8063-d7e2273508c1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.243309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e3d4f67d-8434-422b-9805-812cbf5587cc req-e3d0d37f-11c5-4e91-8063-d7e2273508c1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.273498 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e3d4f67d-8434-422b-9805-812cbf5587cc req-e3d0d37f-11c5-4e91-8063-d7e2273508c1 service nova] Creating event network-vif-deleted:b4ae28d2-9fdc-4aa9-a1dd-948d9416be04 for instance dae261d7-a988-4c63-ac78-62c8aef00af8 on n-h2-764485-11 Jul 20 04:19:56.287086 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-e3d4f67d-8434-422b-9805-812cbf5587cc req-e3d0d37f-11c5-4e91-8063-d7e2273508c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075396 Jul 20 04:19:56.287993 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1293/2493] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:56.303621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d2161a20-e033-4d20-9143-91c1e013a6ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:56.312336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d2161a20-e033-4d20-9143-91c1e013a6ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:56.316258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d2161a20-e033-4d20-9143-91c1e013a6ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:56.326160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2161a20-e033-4d20-9143-91c1e013a6ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.331789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2161a20-e033-4d20-9143-91c1e013a6ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.333035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2161a20-e033-4d20-9143-91c1e013a6ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.333645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2161a20-e033-4d20-9143-91c1e013a6ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.469876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-63c7ef0d-93be-4df3-a653-f6c24e652dca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:56.480911 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-63c7ef0d-93be-4df3-a653-f6c24e652dca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1308 microversion: 2.1 time: 0.421272 Jul 20 04:19:56.488058 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1201/2494] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:56 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:56.495306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9a311780-56bd-49bc-9fa4-3c42dbd63c44 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:56.505079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a311780-56bd-49bc-9fa4-3c42dbd63c44 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.514234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a311780-56bd-49bc-9fa4-3c42dbd63c44 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.619307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-d2161a20-e033-4d20-9143-91c1e013a6ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:19:56.683079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9a311780-56bd-49bc-9fa4-3c42dbd63c44 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Going to try to stop instance {{(pid=119807) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:19:56.755700 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d2161a20-e033-4d20-9143-91c1e013a6ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.464909 Jul 20 04:19:56.757248 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1294/2495] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:19:56 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:56.769450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:56.784232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fdc066bf-d76c-4bc1-a75c-7d9ea0812e5d tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:56.785032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fdc066bf-d76c-4bc1-a75c-7d9ea0812e5d tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] [instance: dae261d7-a988-4c63-ac78-62c8aef00af8] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:56.787901 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9a311780-56bd-49bc-9fa4-3c42dbd63c44 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "POST /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa/action" status: 202 len: 0 microversion: 2.1 time: 0.298155 Jul 20 04:19:56.792832 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1202/2496] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:19:56 2022] POST /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:56.811759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fdc066bf-d76c-4bc1-a75c-7d9ea0812e5d tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.812218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fdc066bf-d76c-4bc1-a75c-7d9ea0812e5d tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.813201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fdc066bf-d76c-4bc1-a75c-7d9ea0812e5d tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.813795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fdc066bf-d76c-4bc1-a75c-7d9ea0812e5d tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.817133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-64a6894e-de3e-4c6b-9144-196673f85cf8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:56.826113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-64a6894e-de3e-4c6b-9144-196673f85cf8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:56.827306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.compute.servers [None req-64a6894e-de3e-4c6b-9144-196673f85cf8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Removing options 'limit' from query {{(pid=119807) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:19:56.829993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-64a6894e-de3e-4c6b-9144-196673f85cf8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:56.840958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64a6894e-de3e-4c6b-9144-196673f85cf8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.841706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64a6894e-de3e-4c6b-9144-196673f85cf8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.842746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64a6894e-de3e-4c6b-9144-196673f85cf8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.843398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64a6894e-de3e-4c6b-9144-196673f85cf8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.857831 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-fdc066bf-d76c-4bc1-a75c-7d9ea0812e5d tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] HTTP exception thrown: Instance dae261d7-a988-4c63-ac78-62c8aef00af8 could not be found. Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fdc066bf-d76c-4bc1-a75c-7d9ea0812e5d tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Request method failure captured: Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 HTTP/1.1 Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14JJCtDMCQtHbT5hQeUJsNVEg-WWyALJ6fgnMBGYQRN9diZTq4HrXbi39cGiw_vGwELuSK6ieZ60x6IAKYr-izvY3YQCFCTHGMuoRGrjy_BXrZ1YMnBnJv-tU56y7d-0lSTn8RnzXK-qOaOXAZ6Kx8_JSkhwsh8_UOuz49RuEPyoG9w Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 4a46ad029dbb4797af468175c36fc530 Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TenantUsagesTestJSON-1071421973 Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a46ad029dbb4797af468175c36fc530"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a46ad029dbb4797af468175c36fc530"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a46ad029dbb4797af468175c36fc530", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a46ad029dbb4797af468175c36fc530"}]}] Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TenantUsagesTestJSON-1071421973 Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 4a46ad029dbb4797af468175c36fc530 Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1071421973 Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TenantUsagesTestJSON-1071421973-project Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: ebbba918962a4bcda2eae6f7f07946d8 Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TenantUsagesTestJSON-1071421973-project Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance dae261d7-a988-4c63-ac78-62c8aef00af8 could not be found. Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'dae261d7-a988-4c63-ac78-62c8aef00af8'} Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dae261d7-a988-4c63-ac78-62c8aef00af8 could not be found. Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dae261d7-a988-4c63-ac78-62c8aef00af8 could not be found. Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:56.859562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:19:56.865211 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:56.865211 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:56.865211 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:56.865211 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:56.865211 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:56.865211 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dae261d7-a988-4c63-ac78-62c8aef00af8 could not be found. Jul 20 04:19:56.865211 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:19:56.870776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fdc066bf-d76c-4bc1-a75c-7d9ea0812e5d tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] Returning 404 to user: Instance dae261d7-a988-4c63-ac78-62c8aef00af8 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:56.873135 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fdc066bf-d76c-4bc1-a75c-7d9ea0812e5d tempest-TenantUsagesTestJSON-1071421973 tempest-TenantUsagesTestJSON-1071421973-project] 10.222.0.20 "GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8" status: 404 len: 111 microversion: 2.1 time: 0.114704 Jul 20 04:19:56.877968 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1295/2497] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:56 2022] GET /compute/v2.1/servers/dae261d7-a988-4c63-ac78-62c8aef00af8 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:56.899108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e26b4c1d-eb56-4047-9278-d5a20fe0e359 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:56.913692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e26b4c1d-eb56-4047-9278-d5a20fe0e359 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:56.944373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e26b4c1d-eb56-4047-9278-d5a20fe0e359 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.944837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e26b4c1d-eb56-4047-9278-d5a20fe0e359 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.945620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e26b4c1d-eb56-4047-9278-d5a20fe0e359 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.946062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e26b4c1d-eb56-4047-9278-d5a20fe0e359 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.138625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-64a6894e-de3e-4c6b-9144-196673f85cf8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:19:57.306749 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-64a6894e-de3e-4c6b-9144-196673f85cf8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.511550 Jul 20 04:19:57.308621 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1203/2498] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Jul 20 04:19:56 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:57.326323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ed6fb331-1f2b-4afa-93c4-f576603014d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.328033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ed6fb331-1f2b-4afa-93c4-f576603014d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.345126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed6fb331-1f2b-4afa-93c4-f576603014d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.345596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed6fb331-1f2b-4afa-93c4-f576603014d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.348683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed6fb331-1f2b-4afa-93c4-f576603014d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.349254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed6fb331-1f2b-4afa-93c4-f576603014d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.752361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e26b4c1d-eb56-4047-9278-d5a20fe0e359 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:57.772004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e26b4c1d-eb56-4047-9278-d5a20fe0e359 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:57.776329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e26b4c1d-eb56-4047-9278-d5a20fe0e359 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:57.777770 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e26b4c1d-eb56-4047-9278-d5a20fe0e359 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1756 microversion: 2.42 time: 0.898641 Jul 20 04:19:57.779402 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1296/2499] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:56 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1756 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:57.793485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67d1186f-c7aa-46d4-a699-820a0eef9a80 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.803202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67d1186f-c7aa-46d4-a699-820a0eef9a80 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:57.803902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67d1186f-c7aa-46d4-a699-820a0eef9a80 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:57.818815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67d1186f-c7aa-46d4-a699-820a0eef9a80 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.819266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67d1186f-c7aa-46d4-a699-820a0eef9a80 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.830764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67d1186f-c7aa-46d4-a699-820a0eef9a80 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.831401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67d1186f-c7aa-46d4-a699-820a0eef9a80 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.881126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-67d1186f-c7aa-46d4-a699-820a0eef9a80 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:19:57.974682 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67d1186f-c7aa-46d4-a699-820a0eef9a80 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.193990 Jul 20 04:19:57.975843 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1297/2500] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 04:19:57 2022] GET /compute/v2.1/servers => generated 1009 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:57.981686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-79b94381-9493-41f3-8998-28cd905f809c req-5186550b-6800-4b68-b34d-06e9b9ea1774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01d407e-11e5-485c-a8ad-e61430209b58", "name": "network-vif-plugged", "status": "completed", "tag": "ccb93931-e4ce-4c40-99a6-c9dcbbb6df7d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:58.000093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-79b94381-9493-41f3-8998-28cd905f809c req-5186550b-6800-4b68-b34d-06e9b9ea1774 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.014265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-79b94381-9493-41f3-8998-28cd905f809c req-5186550b-6800-4b68-b34d-06e9b9ea1774 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.061441 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-79b94381-9493-41f3-8998-28cd905f809c req-5186550b-6800-4b68-b34d-06e9b9ea1774 service nova] Creating event network-vif-plugged:ccb93931-e4ce-4c40-99a6-c9dcbbb6df7d for instance e01d407e-11e5-485c-a8ad-e61430209b58 on n-h2-764485-11 Jul 20 04:19:58.083125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ed6fb331-1f2b-4afa-93c4-f576603014d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.092460 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-79b94381-9493-41f3-8998-28cd905f809c req-5186550b-6800-4b68-b34d-06e9b9ea1774 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115182 Jul 20 04:19:58.096244 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1298/2501] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:58.100232 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ed6fb331-1f2b-4afa-93c4-f576603014d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 0.778205 Jul 20 04:19:58.100631 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1204/2502] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:57 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:58.109857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-551e39ba-7857-4bec-b68f-a5de5334287f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.112794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-551e39ba-7857-4bec-b68f-a5de5334287f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.120964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a78bb35-a1a6-4d85-9a60-b2870c054de8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.124752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5a78bb35-a1a6-4d85-9a60-b2870c054de8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.141478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-551e39ba-7857-4bec-b68f-a5de5334287f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.142436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-551e39ba-7857-4bec-b68f-a5de5334287f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.143503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-551e39ba-7857-4bec-b68f-a5de5334287f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.144206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-551e39ba-7857-4bec-b68f-a5de5334287f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.144643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a78bb35-a1a6-4d85-9a60-b2870c054de8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:58.176235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a78bb35-a1a6-4d85-9a60-b2870c054de8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.190105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a78bb35-a1a6-4d85-9a60-b2870c054de8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.190972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a78bb35-a1a6-4d85-9a60-b2870c054de8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.191426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a78bb35-a1a6-4d85-9a60-b2870c054de8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.436540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-5a78bb35-a1a6-4d85-9a60-b2870c054de8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:19:58.630213 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a78bb35-a1a6-4d85-9a60-b2870c054de8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.527419 Jul 20 04:19:58.630911 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1299/2503] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:58.643004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-902d993f-09f5-4208-a2f1-4ae460b1ac76 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.671550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-902d993f-09f5-4208-a2f1-4ae460b1ac76 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.672466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.compute.servers [None req-902d993f-09f5-4208-a2f1-4ae460b1ac76 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Removing options 'limit' from query {{(pid=119808) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:19:58.673404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-902d993f-09f5-4208-a2f1-4ae460b1ac76 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:58.699136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-902d993f-09f5-4208-a2f1-4ae460b1ac76 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.699845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-902d993f-09f5-4208-a2f1-4ae460b1ac76 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.703273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-902d993f-09f5-4208-a2f1-4ae460b1ac76 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.705877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-902d993f-09f5-4208-a2f1-4ae460b1ac76 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.779361 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-902d993f-09f5-4208-a2f1-4ae460b1ac76 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.139988 Jul 20 04:19:58.780585 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1300/2504] 10.222.0.20 () {58 vars in 1139 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:58.793423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-42e0394f-cb0f-4d6a-84ee-cdb888d25663 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.797690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-42e0394f-cb0f-4d6a-84ee-cdb888d25663 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.808236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-42e0394f-cb0f-4d6a-84ee-cdb888d25663 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-900642373', 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:58.814432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42e0394f-cb0f-4d6a-84ee-cdb888d25663 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.814887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42e0394f-cb0f-4d6a-84ee-cdb888d25663 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.823215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42e0394f-cb0f-4d6a-84ee-cdb888d25663 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.832107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42e0394f-cb0f-4d6a-84ee-cdb888d25663 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.001244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-551e39ba-7857-4bec-b68f-a5de5334287f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:59.014103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-42e0394f-cb0f-4d6a-84ee-cdb888d25663 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:19:59.020619 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-551e39ba-7857-4bec-b68f-a5de5334287f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1308 microversion: 2.1 time: 0.918006 Jul 20 04:19:59.021646 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1205/2505] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1308 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:59.048126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6dab9864-4a62-448c-aff9-935e298d1a89 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:59.051781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6dab9864-4a62-448c-aff9-935e298d1a89 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:59.088913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6dab9864-4a62-448c-aff9-935e298d1a89 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.090104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6dab9864-4a62-448c-aff9-935e298d1a89 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.091165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6dab9864-4a62-448c-aff9-935e298d1a89 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.096230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6dab9864-4a62-448c-aff9-935e298d1a89 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.221887 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-42e0394f-cb0f-4d6a-84ee-cdb888d25663 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-900642373" status: 200 len: 345 microversion: 2.1 time: 0.433481 Jul 20 04:19:59.222816 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1301/2506] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-900642373 => generated 345 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:59.227691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aa6c9f79-5a02-4811-ab7b-9ca6d295f78e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:59.245053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aa6c9f79-5a02-4811-ab7b-9ca6d295f78e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:59.258635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa6c9f79-5a02-4811-ab7b-9ca6d295f78e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.259845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa6c9f79-5a02-4811-ab7b-9ca6d295f78e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.261036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa6c9f79-5a02-4811-ab7b-9ca6d295f78e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.262412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa6c9f79-5a02-4811-ab7b-9ca6d295f78e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.162309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6dab9864-4a62-448c-aff9-935e298d1a89 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:00.187335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aa6c9f79-5a02-4811-ab7b-9ca6d295f78e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:00.193875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6dab9864-4a62-448c-aff9-935e298d1a89 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:00.197765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6dab9864-4a62-448c-aff9-935e298d1a89 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:00.208695 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6dab9864-4a62-448c-aff9-935e298d1a89 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1803 microversion: 2.42 time: 1.180536 Jul 20 04:20:00.211844 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1206/2507] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:59 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1803 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:00.217908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e033be76-a3c7-4e1e-9991-5cd6d1751d5e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:00.232233 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aa6c9f79-5a02-4811-ab7b-9ca6d295f78e tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 1.005211 Jul 20 04:20:00.233478 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1302/2508] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:59 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:00.248850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-daf3540d-7054-4283-ae30-a1d4ef9c4008 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:00.250078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-daf3540d-7054-4283-ae30-a1d4ef9c4008 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:00.269111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e033be76-a3c7-4e1e-9991-5cd6d1751d5e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.270148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-daf3540d-7054-4283-ae30-a1d4ef9c4008 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.270579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e033be76-a3c7-4e1e-9991-5cd6d1751d5e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.290918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-daf3540d-7054-4283-ae30-a1d4ef9c4008 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.291803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-daf3540d-7054-4283-ae30-a1d4ef9c4008 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.297867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-daf3540d-7054-4283-ae30-a1d4ef9c4008 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.330201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e033be76-a3c7-4e1e-9991-5cd6d1751d5e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Going to try to stop instance {{(pid=119807) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:20:00.531773 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e033be76-a3c7-4e1e-9991-5cd6d1751d5e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "POST /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.311009 Jul 20 04:20:00.535317 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1207/2509] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:20:00 2022] POST /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:00.553007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-35df9951-6e40-44fd-a041-2879ee2f2dfb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:00.553738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-35df9951-6e40-44fd-a041-2879ee2f2dfb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:00.572793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35df9951-6e40-44fd-a041-2879ee2f2dfb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.573264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35df9951-6e40-44fd-a041-2879ee2f2dfb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.575103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35df9951-6e40-44fd-a041-2879ee2f2dfb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.575579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35df9951-6e40-44fd-a041-2879ee2f2dfb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.325042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-daf3540d-7054-4283-ae30-a1d4ef9c4008 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:01.339093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-35df9951-6e40-44fd-a041-2879ee2f2dfb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:01.346466 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-daf3540d-7054-4283-ae30-a1d4ef9c4008 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1308 microversion: 2.1 time: 1.110477 Jul 20 04:20:01.347059 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1303/2510] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:00 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1308 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:01.353097 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-35df9951-6e40-44fd-a041-2879ee2f2dfb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1522 microversion: 2.1 time: 0.815911 Jul 20 04:20:01.367353 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1208/2511] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:00 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1522 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:01.374489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-267c9e1f-882b-4590-a194-e00a5696b17c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:01.375241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-267c9e1f-882b-4590-a194-e00a5696b17c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:01.376991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9852e78a-940a-428a-b607-256076b10eee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:01.378347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9852e78a-940a-428a-b607-256076b10eee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:01.383023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-267c9e1f-882b-4590-a194-e00a5696b17c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.383316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-267c9e1f-882b-4590-a194-e00a5696b17c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.384133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-267c9e1f-882b-4590-a194-e00a5696b17c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.385794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-267c9e1f-882b-4590-a194-e00a5696b17c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.396857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9852e78a-940a-428a-b607-256076b10eee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.400946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9852e78a-940a-428a-b607-256076b10eee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.402335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9852e78a-940a-428a-b607-256076b10eee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.402949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9852e78a-940a-428a-b607-256076b10eee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.433717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=16 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:02.222746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9852e78a-940a-428a-b607-256076b10eee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.262875 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9852e78a-940a-428a-b607-256076b10eee tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 0.891690 Jul 20 04:20:02.267252 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1209/2512] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:01 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:02.282243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-867a55a3-9307-4c92-966a-84bc9293a52e req-bd946267-5372-4243-80ea-72f7ae6e20ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "tag": "5477bec5-e7f2-4638-a405-8b50b8e83faa"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:02.324972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-867a55a3-9307-4c92-966a-84bc9293a52e req-bd946267-5372-4243-80ea-72f7ae6e20ee service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.327955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-867a55a3-9307-4c92-966a-84bc9293a52e req-bd946267-5372-4243-80ea-72f7ae6e20ee service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.376365 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-867a55a3-9307-4c92-966a-84bc9293a52e req-bd946267-5372-4243-80ea-72f7ae6e20ee service nova] Creating event network-changed:5477bec5-e7f2-4638-a405-8b50b8e83faa for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:20:02.382350 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-867a55a3-9307-4c92-966a-84bc9293a52e req-bd946267-5372-4243-80ea-72f7ae6e20ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112796 Jul 20 04:20:02.383608 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1210/2513] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:02.392477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0c6d2ab2-d9bb-41ef-aa81-ce647a2bf559 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:02.404633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0c6d2ab2-d9bb-41ef-aa81-ce647a2bf559 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:02.412042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c6d2ab2-d9bb-41ef-aa81-ce647a2bf559 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.412687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c6d2ab2-d9bb-41ef-aa81-ce647a2bf559 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.413784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c6d2ab2-d9bb-41ef-aa81-ce647a2bf559 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.414435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c6d2ab2-d9bb-41ef-aa81-ce647a2bf559 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.455205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-267c9e1f-882b-4590-a194-e00a5696b17c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.470064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-267c9e1f-882b-4590-a194-e00a5696b17c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.475984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-267c9e1f-882b-4590-a194-e00a5696b17c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.480785 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-267c9e1f-882b-4590-a194-e00a5696b17c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1850 microversion: 2.42 time: 1.131497 Jul 20 04:20:02.483999 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1304/2514] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:01 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1850 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:02.498561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f57d40d1-bc0e-4020-838f-f2fc533600f9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:02.499697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f57d40d1-bc0e-4020-838f-f2fc533600f9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:02.518038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f57d40d1-bc0e-4020-838f-f2fc533600f9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.518577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f57d40d1-bc0e-4020-838f-f2fc533600f9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.519466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f57d40d1-bc0e-4020-838f-f2fc533600f9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.519934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f57d40d1-bc0e-4020-838f-f2fc533600f9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.920784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0c6d2ab2-d9bb-41ef-aa81-ce647a2bf559 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.936913 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0c6d2ab2-d9bb-41ef-aa81-ce647a2bf559 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1488 microversion: 2.1 time: 0.546845 Jul 20 04:20:02.938293 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1211/2515] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:02 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1488 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:02.954595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6c7b2035-3bc8-4cd2-ba52-af56ad1c175b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1160950884"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:02.956181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6c7b2035-3bc8-4cd2-ba52-af56ad1c175b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:02.964022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c7b2035-3bc8-4cd2-ba52-af56ad1c175b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.965001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c7b2035-3bc8-4cd2-ba52-af56ad1c175b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.966021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c7b2035-3bc8-4cd2-ba52-af56ad1c175b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.967284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c7b2035-3bc8-4cd2-ba52-af56ad1c175b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.059030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f57d40d1-bc0e-4020-838f-f2fc533600f9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:03.075778 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f57d40d1-bc0e-4020-838f-f2fc533600f9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1522 microversion: 2.1 time: 0.587117 Jul 20 04:20:03.079376 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1305/2516] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:02 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1522 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:03.281592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e6ece5d8-938d-4d20-bb87-7eb67bbb17f7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:03.282468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e6ece5d8-938d-4d20-bb87-7eb67bbb17f7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:03.294565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6ece5d8-938d-4d20-bb87-7eb67bbb17f7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.295264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6ece5d8-938d-4d20-bb87-7eb67bbb17f7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.296361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6ece5d8-938d-4d20-bb87-7eb67bbb17f7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.303586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6ece5d8-938d-4d20-bb87-7eb67bbb17f7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.602074 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6c7b2035-3bc8-4cd2-ba52-af56ad1c175b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "POST /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58/action" status: 202 len: 0 microversion: 2.1 time: 0.648325 Jul 20 04:20:03.605037 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1212/2517] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:20:02 2022] POST /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:20:03.629398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bddafa4b-e475-4dcb-b141-36f857be6302 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:03.632613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bddafa4b-e475-4dcb-b141-36f857be6302 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:03.673759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bddafa4b-e475-4dcb-b141-36f857be6302 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.677048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bddafa4b-e475-4dcb-b141-36f857be6302 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.678041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bddafa4b-e475-4dcb-b141-36f857be6302 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.678732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bddafa4b-e475-4dcb-b141-36f857be6302 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.010481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e6ece5d8-938d-4d20-bb87-7eb67bbb17f7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:04.023435 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e6ece5d8-938d-4d20-bb87-7eb67bbb17f7 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 0.746041 Jul 20 04:20:04.025205 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1306/2518] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:03 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:04.034953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7fc2158e-b01a-4fb8-8880-3978e3d54ca9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa27d7430>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:04.126762 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7fc2158e-b01a-4fb8-8880-3978e3d54ca9 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/f6948217-b824-4099-b885-0f38517b26d8" status: 200 len: 1410 microversion: 2.1 time: 0.099645 Jul 20 04:20:04.127756 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1307/2519] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:04 2022] GET /compute/v2.1/images/f6948217-b824-4099-b885-0f38517b26d8 => generated 1410 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:04.135844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e58a01c3-6099-43ac-ba3a-9e116f4631ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:04.140306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e58a01c3-6099-43ac-ba3a-9e116f4631ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:04.163545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e58a01c3-6099-43ac-ba3a-9e116f4631ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.164415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e58a01c3-6099-43ac-ba3a-9e116f4631ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.165907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e58a01c3-6099-43ac-ba3a-9e116f4631ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.167116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e58a01c3-6099-43ac-ba3a-9e116f4631ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.276288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:04.418290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bddafa4b-e475-4dcb-b141-36f857be6302 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:04.435087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bddafa4b-e475-4dcb-b141-36f857be6302 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:04.441781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bddafa4b-e475-4dcb-b141-36f857be6302 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:04.443481 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bddafa4b-e475-4dcb-b141-36f857be6302 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1871 microversion: 2.42 time: 0.837154 Jul 20 04:20:04.445334 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1213/2520] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:03 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1871 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:04.473574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9da2c588-2245-4e51-8530-d7bb9a0b908b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d136c10>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:04.569582 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9da2c588-2245-4e51-8530-d7bb9a0b908b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/f6948217-b824-4099-b885-0f38517b26d8" status: 200 len: 1410 microversion: 2.1 time: 0.118716 Jul 20 04:20:04.570809 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1214/2521] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:04 2022] GET /compute/v2.1/images/f6948217-b824-4099-b885-0f38517b26d8 => generated 1410 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:04.582656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-9e159ded-871e-4e14-88cb-5b1357f019cf req-b580b077-9eb6-4809-b424-f6c212afd8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "tag": "3298e9a7-b585-427c-b1d4-5645fbc2414d"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:04.601682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9e159ded-871e-4e14-88cb-5b1357f019cf req-b580b077-9eb6-4809-b424-f6c212afd8c7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.610419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9e159ded-871e-4e14-88cb-5b1357f019cf req-b580b077-9eb6-4809-b424-f6c212afd8c7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.639776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e58a01c3-6099-43ac-ba3a-9e116f4631ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:04.668526 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e58a01c3-6099-43ac-ba3a-9e116f4631ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1522 microversion: 2.1 time: 0.539492 Jul 20 04:20:04.669563 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-9e159ded-871e-4e14-88cb-5b1357f019cf req-b580b077-9eb6-4809-b424-f6c212afd8c7 service nova] Creating event network-changed:3298e9a7-b585-427c-b1d4-5645fbc2414d for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:20:04.671546 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1308/2522] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:04 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:04.682962 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-9e159ded-871e-4e14-88cb-5b1357f019cf req-b580b077-9eb6-4809-b424-f6c212afd8c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110624 Jul 20 04:20:04.685903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bea4d773-4daf-4700-a75f-8f06457fb5b7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbfa27a4160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:04.689807 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1215/2523] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:04.869636 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bea4d773-4daf-4700-a75f-8f06457fb5b7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/images/f6948217-b824-4099-b885-0f38517b26d8" status: 204 len: 0 microversion: 2.1 time: 0.196933 Jul 20 04:20:04.871061 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1309/2524] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:04 2022] DELETE /compute/v2.1/images/f6948217-b824-4099-b885-0f38517b26d8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:04.883030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a5f6aaa-7a65-467b-8393-6dd92dec6a79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9db22ca0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:04.909807 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-7a5f6aaa-7a65-467b-8393-6dd92dec6a79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] HTTP exception thrown: Image not found. Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a5f6aaa-7a65-467b-8393-6dd92dec6a79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Request method failure captured: Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/images/f6948217-b824-4099-b885-0f38517b26d8 HTTP/1.1 Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FtbDaY-CCWSg76Wh3w-4TpDSkzEywl7I_1nYOMQtTMGfQnOBIbojhS5GH4tURAfFXEREzkB64Go-7bbBqVa_ay13eRF4swXQXfMMZJYhkoToy7jFTeSjdl4ZxflCEB3WO5vfllSD2IP-1TQSpZ49b5tMjks0kT09s-nU6QOpVpOjI Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d23a8eadfd74e358d917b9aa3b85bb7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}] Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesTestJSON-87966257 Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 0d1edf9dfed144d8875968ffd5f9ad91 Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'f6948217-b824-4099-b885-0f38517b26d8'} Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f6948217-b824-4099-b885-0f38517b26d8 Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:20:04.911971 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f6948217-b824-4099-b885-0f38517b26d8 could not be found. Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a5f6aaa-7a65-467b-8393-6dd92dec6a79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7a5f6aaa-7a65-467b-8393-6dd92dec6a79 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/images/f6948217-b824-4099-b885-0f38517b26d8" status: 404 len: 62 microversion: 2.1 time: 0.036647 Jul 20 04:20:04.916037 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1216/2525] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:20:04 2022] GET /compute/v2.1/images/f6948217-b824-4099-b885-0f38517b26d8 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:20:04.924250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-97a0fa80-4f0c-4193-b71f-b719a76efd6c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:04.924873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-97a0fa80-4f0c-4193-b71f-b719a76efd6c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:04.938931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97a0fa80-4f0c-4193-b71f-b719a76efd6c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.939409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97a0fa80-4f0c-4193-b71f-b719a76efd6c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.940238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97a0fa80-4f0c-4193-b71f-b719a76efd6c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.945867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97a0fa80-4f0c-4193-b71f-b719a76efd6c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.043604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe85142c-f537-4a84-b837-8ccb179c47ad tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.044362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe85142c-f537-4a84-b837-8ccb179c47ad tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.053292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe85142c-f537-4a84-b837-8ccb179c47ad tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.054016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe85142c-f537-4a84-b837-8ccb179c47ad tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.055021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe85142c-f537-4a84-b837-8ccb179c47ad tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.055651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe85142c-f537-4a84-b837-8ccb179c47ad tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.262969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-97a0fa80-4f0c-4193-b71f-b719a76efd6c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.274460 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-97a0fa80-4f0c-4193-b71f-b719a76efd6c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1500 microversion: 2.1 time: 0.351900 Jul 20 04:20:05.278805 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1310/2526] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:04 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1500 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:05.401594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe85142c-f537-4a84-b837-8ccb179c47ad tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.416482 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe85142c-f537-4a84-b837-8ccb179c47ad tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 0.371324 Jul 20 04:20:05.417183 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1217/2527] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:05 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:05.465367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-efcbf33f-e3be-487c-9094-92e990e50813 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.465997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-efcbf33f-e3be-487c-9094-92e990e50813 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.483451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-efcbf33f-e3be-487c-9094-92e990e50813 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.484266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-efcbf33f-e3be-487c-9094-92e990e50813 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.486165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-efcbf33f-e3be-487c-9094-92e990e50813 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.487629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-efcbf33f-e3be-487c-9094-92e990e50813 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.686372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-112935bc-5ae1-4a19-a62e-2ab56de71773 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.687023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-112935bc-5ae1-4a19-a62e-2ab56de71773 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.690462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:05.701750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-112935bc-5ae1-4a19-a62e-2ab56de71773 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.702475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-112935bc-5ae1-4a19-a62e-2ab56de71773 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.706072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-112935bc-5ae1-4a19-a62e-2ab56de71773 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.706882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-112935bc-5ae1-4a19-a62e-2ab56de71773 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.173925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-112935bc-5ae1-4a19-a62e-2ab56de71773 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.191052 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-112935bc-5ae1-4a19-a62e-2ab56de71773 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1522 microversion: 2.1 time: 0.505505 Jul 20 04:20:06.203800 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1218/2528] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:05 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:06.211065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-efcbf33f-e3be-487c-9094-92e990e50813 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.222476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-efcbf33f-e3be-487c-9094-92e990e50813 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.224033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-efcbf33f-e3be-487c-9094-92e990e50813 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.225194 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-efcbf33f-e3be-487c-9094-92e990e50813 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1871 microversion: 2.42 time: 0.765272 Jul 20 04:20:06.226271 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1311/2529] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:05 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1871 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:06.296978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-33f0998b-c656-4c3f-a2a8-319476bc5fdf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:06.297701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-33f0998b-c656-4c3f-a2a8-319476bc5fdf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:06.308373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-33f0998b-c656-4c3f-a2a8-319476bc5fdf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.311668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-33f0998b-c656-4c3f-a2a8-319476bc5fdf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.314697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-33f0998b-c656-4c3f-a2a8-319476bc5fdf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.315406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-33f0998b-c656-4c3f-a2a8-319476bc5fdf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.456291 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-671c1fd1-3990-41e3-b43c-f08057da8e96 tempest-TenantUsagesNegativeTestJSON-1132915927 tempest-TenantUsagesNegativeTestJSON-1132915927-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-19T04%3A20%3A05.884200&end=2022-07-21T04%3A20%3A05.884200" status: 404 len: 112 microversion: - time: 0.252315 Jul 20 04:20:06.457036 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1219/2530] 10.222.0.20 () {58 vars in 1315 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-19T04%3A20%3A05.884200&end=2022-07-21T04%3A20%3A05.884200 => generated 112 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:20:06.469511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-048098b4-8773-4150-a5eb-b74cd3aaff66 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:06.471338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-048098b4-8773-4150-a5eb-b74cd3aaff66 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:06.498402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-048098b4-8773-4150-a5eb-b74cd3aaff66 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.499467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-048098b4-8773-4150-a5eb-b74cd3aaff66 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.500526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-048098b4-8773-4150-a5eb-b74cd3aaff66 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.501180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-048098b4-8773-4150-a5eb-b74cd3aaff66 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.605720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-33f0998b-c656-4c3f-a2a8-319476bc5fdf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.618638 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-33f0998b-c656-4c3f-a2a8-319476bc5fdf tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1506 microversion: 2.1 time: 0.326778 Jul 20 04:20:06.619279 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1312/2531] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:06.640266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0440c470-9df1-432d-8c18-8057a2ff7bd5 tempest-TenantUsagesNegativeTestJSON-1132915927 tempest-TenantUsagesNegativeTestJSON-1132915927-project-admin] Calling method '.version_select at 0x7fbf9c86fe50>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:06.644906 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-0440c470-9df1-432d-8c18-8057a2ff7bd5 tempest-TenantUsagesNegativeTestJSON-1132915927 tempest-TenantUsagesNegativeTestJSON-1132915927-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0440c470-9df1-432d-8c18-8057a2ff7bd5 tempest-TenantUsagesNegativeTestJSON-1132915927 tempest-TenantUsagesNegativeTestJSON-1132915927-project-admin] Request method failure captured: Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-simple-tenant-usage/f290f671c33c4e9cb63b23961ddc3295?start=2022-07-21T04%3A20%3A05.884200&end=2022-07-19T04%3A20%3A05.884200 HTTP/1.1 Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14J1hoK-cYBkjcx_nQF01zLT7TF0pi0S2z1rvXFoSgbFZ_vP27lHItpE_Ovjp0WkjIFlHkd_FVQJ9_4oZ9joWnsISYjlGWakS43BBR0QyTwNvSldjieKHWjVSZkdIHrhLEBp4PY1uJsmD4Ay_bQjO2Lkm3-3iHTft9780d7oSqpw9qw Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 3db8b349064d4ab193cf29df1c72c454 Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1132915927 Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3db8b349064d4ab193cf29df1c72c454"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db8b349064d4ab193cf29df1c72c454"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3db8b349064d4ab193cf29df1c72c454", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db8b349064d4ab193cf29df1c72c454"}]}] Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1132915927 Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 3db8b349064d4ab193cf29df1c72c454 Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1132915927 Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TenantUsagesNegativeTestJSON-1132915927-project-admin Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 90f66322be9b43f4a6ed5bc8ebe8e17c Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1132915927-project-admin Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid start time. The start time cannot occur after the end time. Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'f290f671c33c4e9cb63b23961ddc3295'} Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 20 04:20:06.666426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:06.671690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0440c470-9df1-432d-8c18-8057a2ff7bd5 tempest-TenantUsagesNegativeTestJSON-1132915927 tempest-TenantUsagesNegativeTestJSON-1132915927-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:06.671690 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0440c470-9df1-432d-8c18-8057a2ff7bd5 tempest-TenantUsagesNegativeTestJSON-1132915927 tempest-TenantUsagesNegativeTestJSON-1132915927-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/f290f671c33c4e9cb63b23961ddc3295?start=2022-07-21T04%3A20%3A05.884200&end=2022-07-19T04%3A20%3A05.884200" status: 400 len: 111 microversion: 2.1 time: 0.048585 Jul 20 04:20:06.671690 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1313/2532] 10.222.0.20 () {58 vars in 1411 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/os-simple-tenant-usage/f290f671c33c4e9cb63b23961ddc3295?start=2022-07-21T04%3A20%3A05.884200&end=2022-07-19T04%3A20%3A05.884200 => generated 111 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:20:06.876653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02697336-8c47-47cf-8980-0281171ab40a tempest-TenantUsagesNegativeTestJSON-1482503656 tempest-TenantUsagesNegativeTestJSON-1482503656-project] Calling method '.version_select at 0x7fbfa27a4160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:06.879142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-02697336-8c47-47cf-8980-0281171ab40a tempest-TenantUsagesNegativeTestJSON-1482503656 tempest-TenantUsagesNegativeTestJSON-1482503656-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'c95aa504ffb144848619bebfadb8a7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f290f671c33c4e9cb63b23961ddc3295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02697336-8c47-47cf-8980-0281171ab40a tempest-TenantUsagesNegativeTestJSON-1482503656 tempest-TenantUsagesNegativeTestJSON-1482503656-project] Request method failure captured: Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A20%3A05.884200&end=2022-07-21T04%3A20%3A05.884200&detailed=1 HTTP/1.1 Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14J0je_URd6osdt6kIVb1-nLzAWyHOFEKVi3pjgrNV2oNyx3Npte_i3QghWEELxho9usQxBko9lgXGbxeLvNZ6vynPutfyWFeS44PHhkZM48ZW6NMdyoMloA8-ZDcIjauVdP25JPiO5_fDzeBeGHJcA0zwIvFN-JyKorZng9Di6ir_w Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: f290f671c33c4e9cb63b23961ddc3295 Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1482503656 Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f290f671c33c4e9cb63b23961ddc3295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f290f671c33c4e9cb63b23961ddc3295"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f290f671c33c4e9cb63b23961ddc3295", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f290f671c33c4e9cb63b23961ddc3295"}]}] Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1482503656 Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: f290f671c33c4e9cb63b23961ddc3295 Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1482503656 Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TenantUsagesNegativeTestJSON-1482503656-project Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c95aa504ffb144848619bebfadb8a7d5 Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1482503656-project Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: action_args: {} Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:20:06.881139 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:20:06.885872 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 04:20:06.885872 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:06.885872 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:06.885872 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:06.885872 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:06.885872 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:06.885872 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:06.885872 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:20:06.885872 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:20:06.885872 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 04:20:06.885872 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:06.892147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02697336-8c47-47cf-8980-0281171ab40a tempest-TenantUsagesNegativeTestJSON-1482503656 tempest-TenantUsagesNegativeTestJSON-1482503656-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:06.893376 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-02697336-8c47-47cf-8980-0281171ab40a tempest-TenantUsagesNegativeTestJSON-1482503656 tempest-TenantUsagesNegativeTestJSON-1482503656-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A20%3A05.884200&end=2022-07-21T04%3A20%3A05.884200&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.216446 Jul 20 04:20:06.894452 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1314/2533] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A20%3A05.884200&end=2022-07-21T04%3A20%3A05.884200&detailed=1 => generated 123 bytes in 218 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:06.907604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ee849786-3d4b-4f24-ae23-1829aa920d0d req-29b23d98-0912-4bb1-badd-04d89e4f1d23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "tag": "838ed0ec-c5bd-4bce-ac1a-7200a5f4ab77"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:06.910891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-048098b4-8773-4150-a5eb-b74cd3aaff66 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.932387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ee849786-3d4b-4f24-ae23-1829aa920d0d req-29b23d98-0912-4bb1-badd-04d89e4f1d23 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.933050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ee849786-3d4b-4f24-ae23-1829aa920d0d req-29b23d98-0912-4bb1-badd-04d89e4f1d23 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.933878 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-048098b4-8773-4150-a5eb-b74cd3aaff66 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 0.463725 Jul 20 04:20:06.934853 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1220/2534] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:06.949902 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ee849786-3d4b-4f24-ae23-1829aa920d0d req-29b23d98-0912-4bb1-badd-04d89e4f1d23 service nova] Creating event network-changed:838ed0ec-c5bd-4bce-ac1a-7200a5f4ab77 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:20:06.962087 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ee849786-3d4b-4f24-ae23-1829aa920d0d req-29b23d98-0912-4bb1-badd-04d89e4f1d23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063879 Jul 20 04:20:06.967183 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1315/2535] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:07.209180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8a7be783-5beb-475d-a6bc-a249d31e6332 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:07.210077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8a7be783-5beb-475d-a6bc-a249d31e6332 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:07.234817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:07.246331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a7be783-5beb-475d-a6bc-a249d31e6332 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.248238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a7be783-5beb-475d-a6bc-a249d31e6332 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.249508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e02a1194-a5e1-4d67-a2e4-6d36e19d501e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:07.250244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e02a1194-a5e1-4d67-a2e4-6d36e19d501e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:07.250990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a7be783-5beb-475d-a6bc-a249d31e6332 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.252781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a7be783-5beb-475d-a6bc-a249d31e6332 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.263918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:07.268984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e02a1194-a5e1-4d67-a2e4-6d36e19d501e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.269460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e02a1194-a5e1-4d67-a2e4-6d36e19d501e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.270422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e02a1194-a5e1-4d67-a2e4-6d36e19d501e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.270888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e02a1194-a5e1-4d67-a2e4-6d36e19d501e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.778896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8a7be783-5beb-475d-a6bc-a249d31e6332 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.788060 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8a7be783-5beb-475d-a6bc-a249d31e6332 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1522 microversion: 2.1 time: 0.582642 Jul 20 04:20:07.788659 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1221/2536] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:07 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1522 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:07.805353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0385ea95-7f36-42b3-8973-3c3942e5a77e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:07.807308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0385ea95-7f36-42b3-8973-3c3942e5a77e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:07.822789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0385ea95-7f36-42b3-8973-3c3942e5a77e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.827286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0385ea95-7f36-42b3-8973-3c3942e5a77e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.828411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0385ea95-7f36-42b3-8973-3c3942e5a77e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.830298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0385ea95-7f36-42b3-8973-3c3942e5a77e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.169061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e02a1194-a5e1-4d67-a2e4-6d36e19d501e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:08.198032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e02a1194-a5e1-4d67-a2e4-6d36e19d501e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:08.201238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e02a1194-a5e1-4d67-a2e4-6d36e19d501e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:08.203040 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e02a1194-a5e1-4d67-a2e4-6d36e19d501e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1892 microversion: 2.42 time: 0.960257 Jul 20 04:20:08.251710 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1316/2537] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:07 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1892 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:08.257513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7186f65d-e324-440e-9cb8-f3d42492cab8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:08.265616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7186f65d-e324-440e-9cb8-f3d42492cab8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:08.284448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7186f65d-e324-440e-9cb8-f3d42492cab8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.286615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7186f65d-e324-440e-9cb8-f3d42492cab8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.289134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7186f65d-e324-440e-9cb8-f3d42492cab8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.293625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7186f65d-e324-440e-9cb8-f3d42492cab8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.298666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0385ea95-7f36-42b3-8973-3c3942e5a77e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:08.307926 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0385ea95-7f36-42b3-8973-3c3942e5a77e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1506 microversion: 2.1 time: 0.518000 Jul 20 04:20:08.316101 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1222/2538] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:07 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:08.805410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cb8a4782-7e2b-474f-9bc9-7ec3fa66a929 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:08.806061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cb8a4782-7e2b-474f-9bc9-7ec3fa66a929 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:08.824663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb8a4782-7e2b-474f-9bc9-7ec3fa66a929 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.825399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb8a4782-7e2b-474f-9bc9-7ec3fa66a929 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.826332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb8a4782-7e2b-474f-9bc9-7ec3fa66a929 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.826919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb8a4782-7e2b-474f-9bc9-7ec3fa66a929 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.836696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7186f65d-e324-440e-9cb8-f3d42492cab8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:08.851145 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7186f65d-e324-440e-9cb8-f3d42492cab8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 0.597522 Jul 20 04:20:08.861770 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1317/2539] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:09.092784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cb8a4782-7e2b-474f-9bc9-7ec3fa66a929 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:09.111894 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cb8a4782-7e2b-474f-9bc9-7ec3fa66a929 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1522 microversion: 2.1 time: 0.310413 Jul 20 04:20:09.116779 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1223/2540] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:09.229511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a3f9d936-713b-46c0-8134-4f7191b29155 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.230975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a3f9d936-713b-46c0-8134-4f7191b29155 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.244635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=18 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:09.246606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3f9d936-713b-46c0-8134-4f7191b29155 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.250080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3f9d936-713b-46c0-8134-4f7191b29155 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.251733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3f9d936-713b-46c0-8134-4f7191b29155 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.252411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3f9d936-713b-46c0-8134-4f7191b29155 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.332875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-93042062-9fcf-482f-ae2c-898cae7b5beb tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.333498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-93042062-9fcf-482f-ae2c-898cae7b5beb tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.349495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93042062-9fcf-482f-ae2c-898cae7b5beb tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.349964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93042062-9fcf-482f-ae2c-898cae7b5beb tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.350923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93042062-9fcf-482f-ae2c-898cae7b5beb tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.351633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93042062-9fcf-482f-ae2c-898cae7b5beb tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.613212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-93042062-9fcf-482f-ae2c-898cae7b5beb tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:09.622649 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-93042062-9fcf-482f-ae2c-898cae7b5beb tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1506 microversion: 2.1 time: 0.293859 Jul 20 04:20:09.632831 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1224/2541] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:09.652889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a3f9d936-713b-46c0-8134-4f7191b29155 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:09.670081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a3f9d936-713b-46c0-8134-4f7191b29155 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:09.671616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a3f9d936-713b-46c0-8134-4f7191b29155 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:09.690110 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a3f9d936-713b-46c0-8134-4f7191b29155 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1892 microversion: 2.42 time: 0.470160 Jul 20 04:20:09.706949 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1318/2542] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1892 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:09.872180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-db8db40e-feb9-4551-b06f-0c1d439d8692 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.873181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-db8db40e-feb9-4551-b06f-0c1d439d8692 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.907398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db8db40e-feb9-4551-b06f-0c1d439d8692 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.910449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db8db40e-feb9-4551-b06f-0c1d439d8692 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.914884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db8db40e-feb9-4551-b06f-0c1d439d8692 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.915981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db8db40e-feb9-4551-b06f-0c1d439d8692 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.939390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9b278742-980a-4fe4-8a66-d7df4ebd635f req-50db6bac-e2ff-4e72-bb46-7b55dadfb1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "tag": "f686daf0-a9f5-40b9-993f-1a05e9682dd5"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:09.968459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9b278742-980a-4fe4-8a66-d7df4ebd635f req-50db6bac-e2ff-4e72-bb46-7b55dadfb1e1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.968910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9b278742-980a-4fe4-8a66-d7df4ebd635f req-50db6bac-e2ff-4e72-bb46-7b55dadfb1e1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.990421 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9b278742-980a-4fe4-8a66-d7df4ebd635f req-50db6bac-e2ff-4e72-bb46-7b55dadfb1e1 service nova] Creating event network-changed:f686daf0-a9f5-40b9-993f-1a05e9682dd5 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:20:10.005460 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9b278742-980a-4fe4-8a66-d7df4ebd635f req-50db6bac-e2ff-4e72-bb46-7b55dadfb1e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070044 Jul 20 04:20:10.006623 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1319/2543] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:10.131576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b149611d-09e0-49ba-9b2d-a004e060f5c7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.132298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b149611d-09e0-49ba-9b2d-a004e060f5c7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.144039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b149611d-09e0-49ba-9b2d-a004e060f5c7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.144502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b149611d-09e0-49ba-9b2d-a004e060f5c7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.147609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b149611d-09e0-49ba-9b2d-a004e060f5c7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.148015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b149611d-09e0-49ba-9b2d-a004e060f5c7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.235691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-db8db40e-feb9-4551-b06f-0c1d439d8692 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:10.249905 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-db8db40e-feb9-4551-b06f-0c1d439d8692 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 0.384444 Jul 20 04:20:10.262078 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1225/2544] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:10.410478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b149611d-09e0-49ba-9b2d-a004e060f5c7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:10.422035 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b149611d-09e0-49ba-9b2d-a004e060f5c7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1522 microversion: 2.1 time: 0.295812 Jul 20 04:20:10.432716 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1320/2545] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:10 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:10.518186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-bd780c7e-66ff-4e03-9c29-6fa502461b13 req-def4240e-0861-4857-a0ff-715a3f77bd23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01d407e-11e5-485c-a8ad-e61430209b58", "name": "network-vif-plugged", "status": "completed", "tag": "ccb93931-e4ce-4c40-99a6-c9dcbbb6df7d"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:10.542321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-bd780c7e-66ff-4e03-9c29-6fa502461b13 req-def4240e-0861-4857-a0ff-715a3f77bd23 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.543707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-bd780c7e-66ff-4e03-9c29-6fa502461b13 req-def4240e-0861-4857-a0ff-715a3f77bd23 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.567476 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-bd780c7e-66ff-4e03-9c29-6fa502461b13 req-def4240e-0861-4857-a0ff-715a3f77bd23 service nova] Creating event network-vif-plugged:ccb93931-e4ce-4c40-99a6-c9dcbbb6df7d for instance e01d407e-11e5-485c-a8ad-e61430209b58 on n-h2-764485-11 Jul 20 04:20:10.574152 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-bd780c7e-66ff-4e03-9c29-6fa502461b13 req-def4240e-0861-4857-a0ff-715a3f77bd23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059423 Jul 20 04:20:10.575321 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1226/2546] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:10.641898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e5e1c5ac-7c23-4e4b-bbc2-02addd9a8bc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.642963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e5e1c5ac-7c23-4e4b-bbc2-02addd9a8bc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.653196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5e1c5ac-7c23-4e4b-bbc2-02addd9a8bc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.653875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5e1c5ac-7c23-4e4b-bbc2-02addd9a8bc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.654879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5e1c5ac-7c23-4e4b-bbc2-02addd9a8bc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.655733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5e1c5ac-7c23-4e4b-bbc2-02addd9a8bc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.720049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e905aa04-0f66-418b-baff-d758895d6d0d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.724028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e905aa04-0f66-418b-baff-d758895d6d0d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.734406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e905aa04-0f66-418b-baff-d758895d6d0d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.735025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e905aa04-0f66-418b-baff-d758895d6d0d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.736202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e905aa04-0f66-418b-baff-d758895d6d0d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.736836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e905aa04-0f66-418b-baff-d758895d6d0d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.011898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e5e1c5ac-7c23-4e4b-bbc2-02addd9a8bc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.025866 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e5e1c5ac-7c23-4e4b-bbc2-02addd9a8bc8 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1506 microversion: 2.1 time: 0.382131 Jul 20 04:20:11.028378 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1321/2547] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:10 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:11.077039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e905aa04-0f66-418b-baff-d758895d6d0d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.086203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e905aa04-0f66-418b-baff-d758895d6d0d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.088701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e905aa04-0f66-418b-baff-d758895d6d0d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.089889 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e905aa04-0f66-418b-baff-d758895d6d0d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1892 microversion: 2.42 time: 0.376828 Jul 20 04:20:11.101391 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1227/2548] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:10 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1892 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:11.268747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c8dfadef-481e-431f-bb6f-f797c225ca22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.269375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c8dfadef-481e-431f-bb6f-f797c225ca22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:11.286877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8dfadef-481e-431f-bb6f-f797c225ca22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.287616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8dfadef-481e-431f-bb6f-f797c225ca22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.288578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8dfadef-481e-431f-bb6f-f797c225ca22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.289177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8dfadef-481e-431f-bb6f-f797c225ca22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.442277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-422addf7-6898-4802-8491-df697956c16e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.443163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-422addf7-6898-4802-8491-df697956c16e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:11.458807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-422addf7-6898-4802-8491-df697956c16e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.459432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-422addf7-6898-4802-8491-df697956c16e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.463642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-422addf7-6898-4802-8491-df697956c16e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.464455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-422addf7-6898-4802-8491-df697956c16e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.665433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c8dfadef-481e-431f-bb6f-f797c225ca22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.677923 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c8dfadef-481e-431f-bb6f-f797c225ca22 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 0.413553 Jul 20 04:20:11.679961 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1322/2549] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:11 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:11.712901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-422addf7-6898-4802-8491-df697956c16e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.734791 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-422addf7-6898-4802-8491-df697956c16e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1499 microversion: 2.1 time: 0.297189 Jul 20 04:20:11.746512 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1228/2550] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:11 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1499 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:11.764045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-69bc1da1-06e8-48fa-86a8-b5145936b3f8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.767744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-69bc1da1-06e8-48fa-86a8-b5145936b3f8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.768802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-69bc1da1-06e8-48fa-86a8-b5145936b3f8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:20:11.776022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69bc1da1-06e8-48fa-86a8-b5145936b3f8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.776733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69bc1da1-06e8-48fa-86a8-b5145936b3f8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.777913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69bc1da1-06e8-48fa-86a8-b5145936b3f8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.778513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69bc1da1-06e8-48fa-86a8-b5145936b3f8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.807323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-69bc1da1-06e8-48fa-86a8-b5145936b3f8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:20:11.844199 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-69bc1da1-06e8-48fa-86a8-b5145936b3f8 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.085119 Jul 20 04:20:11.852318 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1323/2551] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Jul 20 04:20:11 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:11.858570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ed53444b-c746-458b-85d0-90138d6ab80d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:11.866994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed53444b-c746-458b-85d0-90138d6ab80d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.869448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed53444b-c746-458b-85d0-90138d6ab80d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.901157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ed53444b-c746-458b-85d0-90138d6ab80d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Going to try to start instance {{(pid=119807) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:20:11.987904 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ed53444b-c746-458b-85d0-90138d6ab80d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "POST /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb/action" status: 202 len: 0 microversion: 2.1 time: 0.133796 Jul 20 04:20:11.988705 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1229/2552] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:20:11 2022] POST /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:20:11.998093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f8c0589f-f2ce-4482-98b6-db3db97adf9f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.998725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f8c0589f-f2ce-4482-98b6-db3db97adf9f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:12.008518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8c0589f-f2ce-4482-98b6-db3db97adf9f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.011200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8c0589f-f2ce-4482-98b6-db3db97adf9f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.012232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8c0589f-f2ce-4482-98b6-db3db97adf9f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.017075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8c0589f-f2ce-4482-98b6-db3db97adf9f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.047966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5a2fbd8e-ed59-4dde-95e5-94ce8ba6de21 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:12.049039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a2fbd8e-ed59-4dde-95e5-94ce8ba6de21 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:12.065361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a2fbd8e-ed59-4dde-95e5-94ce8ba6de21 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.066038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a2fbd8e-ed59-4dde-95e5-94ce8ba6de21 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.079955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a2fbd8e-ed59-4dde-95e5-94ce8ba6de21 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.085191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a2fbd8e-ed59-4dde-95e5-94ce8ba6de21 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.603788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f8c0589f-f2ce-4482-98b6-db3db97adf9f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:12.612593 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f8c0589f-f2ce-4482-98b6-db3db97adf9f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1508 microversion: 2.1 time: 0.618918 Jul 20 04:20:12.624008 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1324/2553] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:11 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1508 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:12.629257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9939e14e-8a4d-458d-bccb-1940e40d868c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:12.630167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9939e14e-8a4d-458d-bccb-1940e40d868c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:12.638435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9939e14e-8a4d-458d-bccb-1940e40d868c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.639257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9939e14e-8a4d-458d-bccb-1940e40d868c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.640288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9939e14e-8a4d-458d-bccb-1940e40d868c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.640961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9939e14e-8a4d-458d-bccb-1940e40d868c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.659627 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a2fbd8e-ed59-4dde-95e5-94ce8ba6de21 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:12.684074 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5a2fbd8e-ed59-4dde-95e5-94ce8ba6de21 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1501 microversion: 2.1 time: 0.631104 Jul 20 04:20:12.685092 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1230/2554] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:12 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1501 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:12.703036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-333ea721-c84b-497d-881a-1bed390629b0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:12.703962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-333ea721-c84b-497d-881a-1bed390629b0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:12.713033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-333ea721-c84b-497d-881a-1bed390629b0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.714444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-333ea721-c84b-497d-881a-1bed390629b0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.715716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-333ea721-c84b-497d-881a-1bed390629b0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.716395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-333ea721-c84b-497d-881a-1bed390629b0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.635208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-333ea721-c84b-497d-881a-1bed390629b0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.646521 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-333ea721-c84b-497d-881a-1bed390629b0 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 0.944641 Jul 20 04:20:13.663897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9939e14e-8a4d-458d-bccb-1940e40d868c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.667903 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1231/2555] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:12 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:13.682060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9939e14e-8a4d-458d-bccb-1940e40d868c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.682977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-85e0973f-b214-4004-984a-6f9bd0b1fb99 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.688684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9939e14e-8a4d-458d-bccb-1940e40d868c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.690668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-85e0973f-b214-4004-984a-6f9bd0b1fb99 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.695121 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9939e14e-8a4d-458d-bccb-1940e40d868c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1892 microversion: 2.42 time: 1.069701 Jul 20 04:20:13.698907 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1325/2556] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:12 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1892 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:13.711419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f95c8969-b919-4337-93da-3729584aebbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.714807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f95c8969-b919-4337-93da-3729584aebbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.728537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f95c8969-b919-4337-93da-3729584aebbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.729417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f95c8969-b919-4337-93da-3729584aebbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.730479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f95c8969-b919-4337-93da-3729584aebbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.731379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f95c8969-b919-4337-93da-3729584aebbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.734319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85e0973f-b214-4004-984a-6f9bd0b1fb99 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.734788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85e0973f-b214-4004-984a-6f9bd0b1fb99 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.735687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85e0973f-b214-4004-984a-6f9bd0b1fb99 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.739757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85e0973f-b214-4004-984a-6f9bd0b1fb99 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.186487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f95c8969-b919-4337-93da-3729584aebbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:14.204453 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f95c8969-b919-4337-93da-3729584aebbe tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1488 microversion: 2.1 time: 0.503030 Jul 20 04:20:14.208582 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1326/2557] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1488 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:14.223598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-bdc1cbbf-d9c4-4bf0-922c-9fc31d6770fd req-dd0ae836-c9ed-468b-9f86-5ccc5e19ee68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "tag": "ba9fd3bb-9cd1-4b98-911d-beb5f57fe7c1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:14.240906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:14.244258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-bdc1cbbf-d9c4-4bf0-922c-9fc31d6770fd req-dd0ae836-c9ed-468b-9f86-5ccc5e19ee68 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.248614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-bdc1cbbf-d9c4-4bf0-922c-9fc31d6770fd req-dd0ae836-c9ed-468b-9f86-5ccc5e19ee68 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.278300 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-bdc1cbbf-d9c4-4bf0-922c-9fc31d6770fd req-dd0ae836-c9ed-468b-9f86-5ccc5e19ee68 service nova] Creating event network-changed:ba9fd3bb-9cd1-4b98-911d-beb5f57fe7c1 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:20:14.326733 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-bdc1cbbf-d9c4-4bf0-922c-9fc31d6770fd req-dd0ae836-c9ed-468b-9f86-5ccc5e19ee68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108530 Jul 20 04:20:14.327440 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1327/2558] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:14.352469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ff8a2619-93ce-4829-bbbd-2109ccfe88f2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:14.357040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ff8a2619-93ce-4829-bbbd-2109ccfe88f2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.380316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff8a2619-93ce-4829-bbbd-2109ccfe88f2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.381022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff8a2619-93ce-4829-bbbd-2109ccfe88f2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.382705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff8a2619-93ce-4829-bbbd-2109ccfe88f2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.387931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff8a2619-93ce-4829-bbbd-2109ccfe88f2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.486878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ff8a2619-93ce-4829-bbbd-2109ccfe88f2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:14.597432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-85e0973f-b214-4004-984a-6f9bd0b1fb99 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:14.621109 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-85e0973f-b214-4004-984a-6f9bd0b1fb99 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1508 microversion: 2.1 time: 0.948653 Jul 20 04:20:14.622904 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1232/2559] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1508 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:14.645029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:14.671989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-71020977-879c-45fc-98e2-13e3b43a3dab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:14.673142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-71020977-879c-45fc-98e2-13e3b43a3dab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.697619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71020977-879c-45fc-98e2-13e3b43a3dab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.718466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71020977-879c-45fc-98e2-13e3b43a3dab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.727680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71020977-879c-45fc-98e2-13e3b43a3dab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.729825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71020977-879c-45fc-98e2-13e3b43a3dab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.733884 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ff8a2619-93ce-4829-bbbd-2109ccfe88f2 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 204 len: 0 microversion: 2.1 time: 0.401886 Jul 20 04:20:14.734525 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1328/2560] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:14 2022] DELETE /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:14.746385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-905ddba8-ee5d-46b7-945c-080d12cddb3e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:14.748795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-905ddba8-ee5d-46b7-945c-080d12cddb3e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.762110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-905ddba8-ee5d-46b7-945c-080d12cddb3e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.768124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-905ddba8-ee5d-46b7-945c-080d12cddb3e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.769175 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-905ddba8-ee5d-46b7-945c-080d12cddb3e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.769797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-905ddba8-ee5d-46b7-945c-080d12cddb3e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.105611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-71020977-879c-45fc-98e2-13e3b43a3dab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:15.126321 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-71020977-879c-45fc-98e2-13e3b43a3dab tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 0.463748 Jul 20 04:20:15.143165 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1233/2561] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:14 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:15.152268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-595e0dc3-d97c-448c-b09c-7e4f880e2557 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d96c700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:15.272594 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-595e0dc3-d97c-448c-b09c-7e4f880e2557 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] HTTP exception thrown: Image not found. Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-595e0dc3-d97c-448c-b09c-7e4f880e2557 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Request method failure captured: Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/images/f6948217-b824-4099-b885-0f38517b26d8 HTTP/1.1 Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FtbDaY-CCWSg76Wh3w-4TpDSkzEywl7I_1nYOMQtTMGfQnOBIbojhS5GH4tURAfFXEREzkB64Go-7bbBqVa_ay13eRF4swXQXfMMZJYhkoToy7jFTeSjdl4ZxflCEB3WO5vfllSD2IP-1TQSpZ49b5tMjks0kT09s-nU6QOpVpOjI Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d23a8eadfd74e358d917b9aa3b85bb7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}] Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesTestJSON-87966257 Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 0d1edf9dfed144d8875968ffd5f9ad91 Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'f6948217-b824-4099-b885-0f38517b26d8'} Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f6948217-b824-4099-b885-0f38517b26d8 to delete Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f6948217-b824-4099-b885-0f38517b26d8 could not be found. Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:15.276195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:20:15.280608 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:15.282906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-595e0dc3-d97c-448c-b09c-7e4f880e2557 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:15.283924 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-595e0dc3-d97c-448c-b09c-7e4f880e2557 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/images/f6948217-b824-4099-b885-0f38517b26d8" status: 404 len: 62 microversion: 2.1 time: 0.139510 Jul 20 04:20:15.284976 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1234/2562] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:15 2022] DELETE /compute/v2.1/images/f6948217-b824-4099-b885-0f38517b26d8 => generated 62 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:20:15.294515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2affc51d-7962-4eba-9b0b-ed6dccc1e9c3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:15.298599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2affc51d-7962-4eba-9b0b-ed6dccc1e9c3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:15.333707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2affc51d-7962-4eba-9b0b-ed6dccc1e9c3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.334329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2affc51d-7962-4eba-9b0b-ed6dccc1e9c3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.341337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2affc51d-7962-4eba-9b0b-ed6dccc1e9c3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.342771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2affc51d-7962-4eba-9b0b-ed6dccc1e9c3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.474857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2affc51d-7962-4eba-9b0b-ed6dccc1e9c3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:15.628122 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.compute.api [None req-2affc51d-7962-4eba-9b0b-ed6dccc1e9c3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Instance is already in deleting state, ignoring this request Jul 20 04:20:15.630111 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2affc51d-7962-4eba-9b0b-ed6dccc1e9c3 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 204 len: 0 microversion: 2.1 time: 0.341217 Jul 20 04:20:15.638613 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1235/2563] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:15 2022] DELETE /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:15.654308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f1b12e7-128f-48c9-8e94-313366e284f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:15.654964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0f1b12e7-128f-48c9-8e94-313366e284f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:15.672042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f1b12e7-128f-48c9-8e94-313366e284f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.673611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f1b12e7-128f-48c9-8e94-313366e284f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.673611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f1b12e7-128f-48c9-8e94-313366e284f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.673763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f1b12e7-128f-48c9-8e94-313366e284f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.239428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-905ddba8-ee5d-46b7-945c-080d12cddb3e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:16.259490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-905ddba8-ee5d-46b7-945c-080d12cddb3e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:16.278078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-905ddba8-ee5d-46b7-945c-080d12cddb3e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:16.286373 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-905ddba8-ee5d-46b7-945c-080d12cddb3e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1892 microversion: 2.42 time: 1.550362 Jul 20 04:20:16.311997 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1329/2564] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:14 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1892 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:16.340671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c5697f6-f3e4-4b61-94f4-052fc3e8fc7c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:16.389883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4c5697f6-f3e4-4b61-94f4-052fc3e8fc7c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:16.421997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c5697f6-f3e4-4b61-94f4-052fc3e8fc7c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.422687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c5697f6-f3e4-4b61-94f4-052fc3e8fc7c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.423666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c5697f6-f3e4-4b61-94f4-052fc3e8fc7c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.424241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c5697f6-f3e4-4b61-94f4-052fc3e8fc7c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.766775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0f1b12e7-128f-48c9-8e94-313366e284f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:16.779076 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f1b12e7-128f-48c9-8e94-313366e284f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1508 microversion: 2.1 time: 1.141745 Jul 20 04:20:16.781079 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1236/2565] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:15 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1508 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:16.791179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95d981ca-cd6b-4901-b54e-398211406636 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:16.794461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95d981ca-cd6b-4901-b54e-398211406636 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:16.812435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95d981ca-cd6b-4901-b54e-398211406636 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.813360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95d981ca-cd6b-4901-b54e-398211406636 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.814613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95d981ca-cd6b-4901-b54e-398211406636 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.816052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95d981ca-cd6b-4901-b54e-398211406636 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.829005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:17.381541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4c5697f6-f3e4-4b61-94f4-052fc3e8fc7c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:17.398999 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4c5697f6-f3e4-4b61-94f4-052fc3e8fc7c tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1494 microversion: 2.1 time: 1.081884 Jul 20 04:20:17.416554 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1330/2566] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:16 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1494 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:17.433368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7873698-cae7-4de8-ad76-3934e83e3729 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:17.464087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a7873698-cae7-4de8-ad76-3934e83e3729 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:17.489870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7873698-cae7-4de8-ad76-3934e83e3729 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.507084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7873698-cae7-4de8-ad76-3934e83e3729 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:17.544930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7873698-cae7-4de8-ad76-3934e83e3729 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.560215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7873698-cae7-4de8-ad76-3934e83e3729 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.630072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95d981ca-cd6b-4901-b54e-398211406636 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:18.644393 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95d981ca-cd6b-4901-b54e-398211406636 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 1.860157 Jul 20 04:20:18.651644 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1237/2567] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:16 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:18.663945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0484c87b-fecd-498a-a27c-d8d7dd0c5761 req-14020465-1cf3-4d1e-b09e-705b9549f92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "tag": "da06b2f2-360d-4c71-b7f9-0250c1dbb102"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:18.685679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0484c87b-fecd-498a-a27c-d8d7dd0c5761 req-14020465-1cf3-4d1e-b09e-705b9549f92c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.700263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0484c87b-fecd-498a-a27c-d8d7dd0c5761 req-14020465-1cf3-4d1e-b09e-705b9549f92c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.741777 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0484c87b-fecd-498a-a27c-d8d7dd0c5761 req-14020465-1cf3-4d1e-b09e-705b9549f92c service nova] Creating event network-changed:da06b2f2-360d-4c71-b7f9-0250c1dbb102 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:20:18.755341 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0484c87b-fecd-498a-a27c-d8d7dd0c5761 req-14020465-1cf3-4d1e-b09e-705b9549f92c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100239 Jul 20 04:20:18.764089 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1238/2568] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:18.769300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0cb86ebc-fb54-4dca-8b09-231a7f9ad0b7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:18.774115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0cb86ebc-fb54-4dca-8b09-231a7f9ad0b7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:18.805292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0cb86ebc-fb54-4dca-8b09-231a7f9ad0b7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.805965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0cb86ebc-fb54-4dca-8b09-231a7f9ad0b7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.806949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0cb86ebc-fb54-4dca-8b09-231a7f9ad0b7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.807399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0cb86ebc-fb54-4dca-8b09-231a7f9ad0b7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.171052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a7873698-cae7-4de8-ad76-3934e83e3729 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:20.206712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a7873698-cae7-4de8-ad76-3934e83e3729 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:20.209724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a7873698-cae7-4de8-ad76-3934e83e3729 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:20.213422 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a7873698-cae7-4de8-ad76-3934e83e3729 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1892 microversion: 2.42 time: 2.794028 Jul 20 04:20:20.220715 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1331/2569] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:17 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1892 bytes in 2802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:20.239002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-75f667e5-84fa-4a1a-9207-7bbd952b8264 req-cfe5d6a6-a9a0-4d79-a611-faeb431f1c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01d407e-11e5-485c-a8ad-e61430209b58", "name": "network-vif-unplugged", "status": "completed", "tag": "ccb93931-e4ce-4c40-99a6-c9dcbbb6df7d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:20.260454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-75f667e5-84fa-4a1a-9207-7bbd952b8264 req-cfe5d6a6-a9a0-4d79-a611-faeb431f1c2b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.261132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-75f667e5-84fa-4a1a-9207-7bbd952b8264 req-cfe5d6a6-a9a0-4d79-a611-faeb431f1c2b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.288363 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-75f667e5-84fa-4a1a-9207-7bbd952b8264 req-cfe5d6a6-a9a0-4d79-a611-faeb431f1c2b service nova] Creating event network-vif-unplugged:ccb93931-e4ce-4c40-99a6-c9dcbbb6df7d for instance e01d407e-11e5-485c-a8ad-e61430209b58 on n-h2-764485-11 Jul 20 04:20:20.302069 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-75f667e5-84fa-4a1a-9207-7bbd952b8264 req-cfe5d6a6-a9a0-4d79-a611-faeb431f1c2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079490 Jul 20 04:20:20.303227 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1332/2570] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:20.314904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-517d8277-e974-42f7-afe5-5c4c6360c4c0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:20.323973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-517d8277-e974-42f7-afe5-5c4c6360c4c0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:20.331379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-517d8277-e974-42f7-afe5-5c4c6360c4c0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.333652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-517d8277-e974-42f7-afe5-5c4c6360c4c0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.337179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-517d8277-e974-42f7-afe5-5c4c6360c4c0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.338065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-517d8277-e974-42f7-afe5-5c4c6360c4c0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.420256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0cb86ebc-fb54-4dca-8b09-231a7f9ad0b7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:20.436626 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0cb86ebc-fb54-4dca-8b09-231a7f9ad0b7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1512 microversion: 2.1 time: 1.671308 Jul 20 04:20:20.437489 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1239/2571] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:18 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1512 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:20.467947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b1cf828c-70a9-43d6-8595-7cf9718b635c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:20.470806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b1cf828c-70a9-43d6-8595-7cf9718b635c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:20.503043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b1cf828c-70a9-43d6-8595-7cf9718b635c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.503675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b1cf828c-70a9-43d6-8595-7cf9718b635c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.505080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b1cf828c-70a9-43d6-8595-7cf9718b635c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.505814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b1cf828c-70a9-43d6-8595-7cf9718b635c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.562718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-517d8277-e974-42f7-afe5-5c4c6360c4c0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1edf9dfed144d8875968ffd5f9ad91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23a8eadfd74e358d917b9aa3b85bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:20.574498 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-517d8277-e974-42f7-afe5-5c4c6360c4c0 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 200 len: 1293 microversion: 2.1 time: 0.267798 Jul 20 04:20:20.577225 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1333/2572] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:20 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 1293 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:20.596004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6c41c41f-600a-40a7-8f88-d7cf39696cd9 req-61e4e6b8-e995-4c5f-974f-41c425a08bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01d407e-11e5-485c-a8ad-e61430209b58", "name": "network-vif-deleted", "tag": "ccb93931-e4ce-4c40-99a6-c9dcbbb6df7d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:20.619917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6c41c41f-600a-40a7-8f88-d7cf39696cd9 req-61e4e6b8-e995-4c5f-974f-41c425a08bc7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.620704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6c41c41f-600a-40a7-8f88-d7cf39696cd9 req-61e4e6b8-e995-4c5f-974f-41c425a08bc7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.634763 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6c41c41f-600a-40a7-8f88-d7cf39696cd9 req-61e4e6b8-e995-4c5f-974f-41c425a08bc7 service nova] Creating event network-vif-deleted:ccb93931-e4ce-4c40-99a6-c9dcbbb6df7d for instance e01d407e-11e5-485c-a8ad-e61430209b58 on n-h2-764485-11 Jul 20 04:20:20.641049 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6c41c41f-600a-40a7-8f88-d7cf39696cd9 req-61e4e6b8-e995-4c5f-974f-41c425a08bc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062127 Jul 20 04:20:20.642386 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1334/2573] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:20.650024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-765e30e3-051b-4583-963a-f782500fb43f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:20.656203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-765e30e3-051b-4583-963a-f782500fb43f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:20.657017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.compute.servers [None req-765e30e3-051b-4583-963a-f782500fb43f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Removing options 'limit' from query {{(pid=119808) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:20:20.658774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-765e30e3-051b-4583-963a-f782500fb43f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:20:20.661185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-765e30e3-051b-4583-963a-f782500fb43f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.661917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-765e30e3-051b-4583-963a-f782500fb43f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.662987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-765e30e3-051b-4583-963a-f782500fb43f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.663976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-765e30e3-051b-4583-963a-f782500fb43f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.666677 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-765e30e3-051b-4583-963a-f782500fb43f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.022558 Jul 20 04:20:20.676726 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1335/2574] 10.222.0.20 () {58 vars in 1139 bytes} [Wed Jul 20 04:20:20 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:20:20.684005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ea4361f9-06bc-4809-b6a9-c6ce2006ca82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:20.685097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ea4361f9-06bc-4809-b6a9-c6ce2006ca82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:20.694217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea4361f9-06bc-4809-b6a9-c6ce2006ca82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.694920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea4361f9-06bc-4809-b6a9-c6ce2006ca82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.696917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea4361f9-06bc-4809-b6a9-c6ce2006ca82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.697406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea4361f9-06bc-4809-b6a9-c6ce2006ca82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.791654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:22.542579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ea4361f9-06bc-4809-b6a9-c6ce2006ca82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:22.558568 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ea4361f9-06bc-4809-b6a9-c6ce2006ca82 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1512 microversion: 2.1 time: 1.876853 Jul 20 04:20:22.559440 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1336/2575] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:20 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1512 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:22.571685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-85268138-3fb6-46f3-9cb7-3569341bff1d req-6dcf0bb8-d32d-4f11-a600-ae5adade61d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "tag": "800cf352-aa0e-40db-9b0e-767c0447d749"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:22.590208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-85268138-3fb6-46f3-9cb7-3569341bff1d req-6dcf0bb8-d32d-4f11-a600-ae5adade61d7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.593405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-85268138-3fb6-46f3-9cb7-3569341bff1d req-6dcf0bb8-d32d-4f11-a600-ae5adade61d7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.631392 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-85268138-3fb6-46f3-9cb7-3569341bff1d req-6dcf0bb8-d32d-4f11-a600-ae5adade61d7 service nova] Creating event network-changed:800cf352-aa0e-40db-9b0e-767c0447d749 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:20:22.647127 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-85268138-3fb6-46f3-9cb7-3569341bff1d req-6dcf0bb8-d32d-4f11-a600-ae5adade61d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084618 Jul 20 04:20:22.648576 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1337/2576] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:22.672492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a5704a75-d93b-4816-be72-ff746358a23c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:22.673668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a5704a75-d93b-4816-be72-ff746358a23c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:22.693550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a5704a75-d93b-4816-be72-ff746358a23c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.694462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a5704a75-d93b-4816-be72-ff746358a23c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.695538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a5704a75-d93b-4816-be72-ff746358a23c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.696292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a5704a75-d93b-4816-be72-ff746358a23c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.883330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b1cf828c-70a9-43d6-8595-7cf9718b635c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:22.895275 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b1cf828c-70a9-43d6-8595-7cf9718b635c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1510 microversion: 2.1 time: 2.456477 Jul 20 04:20:22.896667 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1240/2577] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:20 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1510 bytes in 2458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:22.918705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-03534edd-3f44-46c2-87a2-90a536609704 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:22.919776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-03534edd-3f44-46c2-87a2-90a536609704 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:22.936643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=86 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:22.944255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03534edd-3f44-46c2-87a2-90a536609704 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.945880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03534edd-3f44-46c2-87a2-90a536609704 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.949328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03534edd-3f44-46c2-87a2-90a536609704 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.949982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03534edd-3f44-46c2-87a2-90a536609704 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.461350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-a5704a75-d93b-4816-be72-ff746358a23c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid 57d80a59-9d6b-4b94-a643-8f6727f50511 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:20:24.507934 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a5704a75-d93b-4816-be72-ff746358a23c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 2346 microversion: 2.25 time: 1.857280 Jul 20 04:20:24.534163 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1338/2578] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:22 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 2346 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:24.543014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c5b9e2f-7646-4e6e-bc86-4527059ceaf7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:24.543875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0c5b9e2f-7646-4e6e-bc86-4527059ceaf7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: e01d407e-11e5-485c-a8ad-e61430209b58] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:24.552609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c5b9e2f-7646-4e6e-bc86-4527059ceaf7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:24.553309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c5b9e2f-7646-4e6e-bc86-4527059ceaf7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.554232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c5b9e2f-7646-4e6e-bc86-4527059ceaf7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:24.554800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c5b9e2f-7646-4e6e-bc86-4527059ceaf7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.580689 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-0c5b9e2f-7646-4e6e-bc86-4527059ceaf7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] HTTP exception thrown: Instance e01d407e-11e5-485c-a8ad-e61430209b58 could not be found. Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c5b9e2f-7646-4e6e-bc86-4527059ceaf7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Request method failure captured: Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 HTTP/1.1 Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FtbDaY-CCWSg76Wh3w-4TpDSkzEywl7I_1nYOMQtTMGfQnOBIbojhS5GH4tURAfFXEREzkB64Go-7bbBqVa_ay13eRF4swXQXfMMZJYhkoToy7jFTeSjdl4ZxflCEB3WO5vfllSD2IP-1TQSpZ49b5tMjks0kT09s-nU6QOpVpOjI Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d23a8eadfd74e358d917b9aa3b85bb7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}] Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesTestJSON-87966257 Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 0d1edf9dfed144d8875968ffd5f9ad91 Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance e01d407e-11e5-485c-a8ad-e61430209b58 could not be found. Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'e01d407e-11e5-485c-a8ad-e61430209b58'} Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e01d407e-11e5-485c-a8ad-e61430209b58 could not be found. Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e01d407e-11e5-485c-a8ad-e61430209b58 could not be found. Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:24.582371 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:24.586191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:24.586191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:24.586191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:24.586191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:24.586191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e01d407e-11e5-485c-a8ad-e61430209b58 could not be found. Jul 20 04:20:24.586191 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:24.586191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c5b9e2f-7646-4e6e-bc86-4527059ceaf7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Returning 404 to user: Instance e01d407e-11e5-485c-a8ad-e61430209b58 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:24.586191 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0c5b9e2f-7646-4e6e-bc86-4527059ceaf7 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58" status: 404 len: 111 microversion: 2.1 time: 0.048179 Jul 20 04:20:24.595923 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1339/2579] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:24 2022] GET /compute/v2.1/servers/e01d407e-11e5-485c-a8ad-e61430209b58 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:24.623528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9533dcd8-b96f-44e5-b076-3cf91f6fc217 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:24.624562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9533dcd8-b96f-44e5-b076-3cf91f6fc217 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 6131221c-3273-45e7-9458-8fedaa324b3d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:24.630927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9533dcd8-b96f-44e5-b076-3cf91f6fc217 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:24.631660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9533dcd8-b96f-44e5-b076-3cf91f6fc217 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.632609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9533dcd8-b96f-44e5-b076-3cf91f6fc217 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:24.633200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9533dcd8-b96f-44e5-b076-3cf91f6fc217 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.012613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-03534edd-3f44-46c2-87a2-90a536609704 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:25.060483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-03534edd-3f44-46c2-87a2-90a536609704 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:25.065628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-03534edd-3f44-46c2-87a2-90a536609704 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:25.070330 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-03534edd-3f44-46c2-87a2-90a536609704 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1892 microversion: 2.42 time: 2.170401 Jul 20 04:20:25.072750 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1241/2580] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:22 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1892 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:25.086524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-54196740-6dcc-4052-8041-eebf34449135 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.089087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-54196740-6dcc-4052-8041-eebf34449135 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:25.106604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54196740-6dcc-4052-8041-eebf34449135 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.107432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54196740-6dcc-4052-8041-eebf34449135 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.108818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54196740-6dcc-4052-8041-eebf34449135 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.109483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54196740-6dcc-4052-8041-eebf34449135 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.781401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-54196740-6dcc-4052-8041-eebf34449135 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:25.799151 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-54196740-6dcc-4052-8041-eebf34449135 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1487 microversion: 2.1 time: 0.722158 Jul 20 04:20:25.807674 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1242/2581] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:25 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1487 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:25.817656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5eb5d2c4-9e96-4772-9e09-11740be85c22 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.822306 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:20:25.822306 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:20:25.824250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5eb5d2c4-9e96-4772-9e09-11740be85c22 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.824904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5eb5d2c4-9e96-4772-9e09-11740be85c22 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.825724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5eb5d2c4-9e96-4772-9e09-11740be85c22 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.826167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5eb5d2c4-9e96-4772-9e09-11740be85c22 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.857734 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5eb5d2c4-9e96-4772-9e09-11740be85c22 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.047315 Jul 20 04:20:25.859065 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1243/2582] 10.222.0.20 () {60 vars in 1216 bytes} [Wed Jul 20 04:20:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:20:25.864233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b4c37eed-6703-4e2e-8e5d-6364d89e43dd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9dc5e5e0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.906024 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b4c37eed-6703-4e2e-8e5d-6364d89e43dd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] HTTP exception thrown: Image not found. Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b4c37eed-6703-4e2e-8e5d-6364d89e43dd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Request method failure captured: Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc HTTP/1.1 Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FtbDaY-CCWSg76Wh3w-4TpDSkzEywl7I_1nYOMQtTMGfQnOBIbojhS5GH4tURAfFXEREzkB64Go-7bbBqVa_ay13eRF4swXQXfMMZJYhkoToy7jFTeSjdl4ZxflCEB3WO5vfllSD2IP-1TQSpZ49b5tMjks0kT09s-nU6QOpVpOjI Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d23a8eadfd74e358d917b9aa3b85bb7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}] Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesTestJSON-87966257 Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 0d1edf9dfed144d8875968ffd5f9ad91 Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'b6ea36b8-611d-4f01-9fd6-c20784a0c4cc'} Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b6ea36b8-611d-4f01-9fd6-c20784a0c4cc to delete Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b6ea36b8-611d-4f01-9fd6-c20784a0c4cc could not be found. Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.908129 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b4c37eed-6703-4e2e-8e5d-6364d89e43dd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b4c37eed-6703-4e2e-8e5d-6364d89e43dd tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc" status: 404 len: 62 microversion: 2.1 time: 0.049356 Jul 20 04:20:25.912137 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1244/2583] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:25 2022] DELETE /compute/v2.1/images/b6ea36b8-611d-4f01-9fd6-c20784a0c4cc => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:20:25.914548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f7c2a3c6-7492-4a89-b687-a1fe61bf8c12 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.915655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f7c2a3c6-7492-4a89-b687-a1fe61bf8c12 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:25.939563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7c2a3c6-7492-4a89-b687-a1fe61bf8c12 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.940041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7c2a3c6-7492-4a89-b687-a1fe61bf8c12 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.944023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7c2a3c6-7492-4a89-b687-a1fe61bf8c12 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.944487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7c2a3c6-7492-4a89-b687-a1fe61bf8c12 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.952242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9533dcd8-b96f-44e5-b076-3cf91f6fc217 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:25.966975 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9533dcd8-b96f-44e5-b076-3cf91f6fc217 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d" status: 200 len: 1511 microversion: 2.1 time: 1.369816 Jul 20 04:20:25.979546 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1340/2584] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:24 2022] GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d => generated 1511 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:25.979546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c84dce3-fd34-4696-a199-0be8ce59a710 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.979546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8c84dce3-fd34-4696-a199-0be8ce59a710 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:25.988571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c84dce3-fd34-4696-a199-0be8ce59a710 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.990371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c84dce3-fd34-4696-a199-0be8ce59a710 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.991836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c84dce3-fd34-4696-a199-0be8ce59a710 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.993181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c84dce3-fd34-4696-a199-0be8ce59a710 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.001037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f7c2a3c6-7492-4a89-b687-a1fe61bf8c12 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:26.020452 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-8c84dce3-fd34-4696-a199-0be8ce59a710 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] HTTP exception thrown: Instance 2394da98-223c-4a33-8a73-6a98c5822358 could not be found. Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c84dce3-fd34-4696-a199-0be8ce59a710 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Request method failure captured: Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 HTTP/1.1 Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FtbDaY-CCWSg76Wh3w-4TpDSkzEywl7I_1nYOMQtTMGfQnOBIbojhS5GH4tURAfFXEREzkB64Go-7bbBqVa_ay13eRF4swXQXfMMZJYhkoToy7jFTeSjdl4ZxflCEB3WO5vfllSD2IP-1TQSpZ49b5tMjks0kT09s-nU6QOpVpOjI Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d23a8eadfd74e358d917b9aa3b85bb7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}] Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesTestJSON-87966257 Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 0d1edf9dfed144d8875968ffd5f9ad91 Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 2394da98-223c-4a33-8a73-6a98c5822358 could not be found. Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2394da98-223c-4a33-8a73-6a98c5822358'} Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2394da98-223c-4a33-8a73-6a98c5822358 could not be found. Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2394da98-223c-4a33-8a73-6a98c5822358 could not be found. Jul 20 04:20:26.024908 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.028445 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:26.028445 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.028445 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:26.028445 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:26.028445 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:26.028445 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:26.028445 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:26.028445 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2394da98-223c-4a33-8a73-6a98c5822358 could not be found. Jul 20 04:20:26.028445 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.028445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c84dce3-fd34-4696-a199-0be8ce59a710 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Returning 404 to user: Instance 2394da98-223c-4a33-8a73-6a98c5822358 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:26.028445 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8c84dce3-fd34-4696-a199-0be8ce59a710 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 404 len: 111 microversion: 2.1 time: 0.054745 Jul 20 04:20:26.028445 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1341/2585] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:25 2022] DELETE /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:26.041269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f8a34691-399d-4818-8f0b-0d4797339dbb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:26.042058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f8a34691-399d-4818-8f0b-0d4797339dbb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:26.079758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8a34691-399d-4818-8f0b-0d4797339dbb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.081023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8a34691-399d-4818-8f0b-0d4797339dbb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.082188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8a34691-399d-4818-8f0b-0d4797339dbb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.082677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8a34691-399d-4818-8f0b-0d4797339dbb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.163873 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f7c2a3c6-7492-4a89-b687-a1fe61bf8c12 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 204 len: 0 microversion: 2.1 time: 0.252065 Jul 20 04:20:26.166805 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1245/2586] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:25 2022] DELETE /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:26.175573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5e629bb5-1d61-4fec-af48-558e84862e5b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:26.177606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5e629bb5-1d61-4fec-af48-558e84862e5b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 2394da98-223c-4a33-8a73-6a98c5822358] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:26.192527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e629bb5-1d61-4fec-af48-558e84862e5b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.192998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e629bb5-1d61-4fec-af48-558e84862e5b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.193768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e629bb5-1d61-4fec-af48-558e84862e5b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.196960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e629bb5-1d61-4fec-af48-558e84862e5b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.237427 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-5e629bb5-1d61-4fec-af48-558e84862e5b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] HTTP exception thrown: Instance 2394da98-223c-4a33-8a73-6a98c5822358 could not be found. Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5e629bb5-1d61-4fec-af48-558e84862e5b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Request method failure captured: Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 HTTP/1.1 Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FtbDaY-CCWSg76Wh3w-4TpDSkzEywl7I_1nYOMQtTMGfQnOBIbojhS5GH4tURAfFXEREzkB64Go-7bbBqVa_ay13eRF4swXQXfMMZJYhkoToy7jFTeSjdl4ZxflCEB3WO5vfllSD2IP-1TQSpZ49b5tMjks0kT09s-nU6QOpVpOjI Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d23a8eadfd74e358d917b9aa3b85bb7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}] Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesTestJSON-87966257 Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 0d1edf9dfed144d8875968ffd5f9ad91 Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 2394da98-223c-4a33-8a73-6a98c5822358 could not be found. Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '2394da98-223c-4a33-8a73-6a98c5822358'} Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2394da98-223c-4a33-8a73-6a98c5822358 could not be found. Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2394da98-223c-4a33-8a73-6a98c5822358 could not be found. Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.239446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:26.244288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:26.244288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:26.244288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:26.244288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:26.244288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2394da98-223c-4a33-8a73-6a98c5822358 could not be found. Jul 20 04:20:26.244288 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:26.244288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5e629bb5-1d61-4fec-af48-558e84862e5b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Returning 404 to user: Instance 2394da98-223c-4a33-8a73-6a98c5822358 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:26.244288 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5e629bb5-1d61-4fec-af48-558e84862e5b tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358" status: 404 len: 111 microversion: 2.1 time: 0.072455 Jul 20 04:20:26.244288 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1246/2587] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:26 2022] GET /compute/v2.1/servers/2394da98-223c-4a33-8a73-6a98c5822358 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:26.269110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d9d10d5b-fc96-4c91-87af-789e4c968ff5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:26.276282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d9d10d5b-fc96-4c91-87af-789e4c968ff5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:26.296897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d10d5b-fc96-4c91-87af-789e4c968ff5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.300107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d10d5b-fc96-4c91-87af-789e4c968ff5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.301614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d10d5b-fc96-4c91-87af-789e4c968ff5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.302080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d10d5b-fc96-4c91-87af-789e4c968ff5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.756376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f8a34691-399d-4818-8f0b-0d4797339dbb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:26.781974 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f8a34691-399d-4818-8f0b-0d4797339dbb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1511 microversion: 2.1 time: 0.753677 Jul 20 04:20:26.783896 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1342/2588] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:26 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1511 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:26.810203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10d9357e-78a7-43f1-868b-c8a1d21a0110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:26.811436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-10d9357e-78a7-43f1-868b-c8a1d21a0110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:26.823159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10d9357e-78a7-43f1-868b-c8a1d21a0110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.824019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10d9357e-78a7-43f1-868b-c8a1d21a0110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.827629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10d9357e-78a7-43f1-868b-c8a1d21a0110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.847375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10d9357e-78a7-43f1-868b-c8a1d21a0110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.405702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10d9357e-78a7-43f1-868b-c8a1d21a0110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:27.415271 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-10d9357e-78a7-43f1-868b-c8a1d21a0110 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1493 microversion: 2.1 time: 0.626071 Jul 20 04:20:27.416085 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1343/2589] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:26 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1493 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:27.449427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5ecc25e0-30f2-469f-b853-409286032375 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9c8a6310>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.500679 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-5ecc25e0-30f2-469f-b853-409286032375 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] HTTP exception thrown: Image not found. Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5ecc25e0-30f2-469f-b853-409286032375 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Request method failure captured: Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 HTTP/1.1 Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FtbDaY-CCWSg76Wh3w-4TpDSkzEywl7I_1nYOMQtTMGfQnOBIbojhS5GH4tURAfFXEREzkB64Go-7bbBqVa_ay13eRF4swXQXfMMZJYhkoToy7jFTeSjdl4ZxflCEB3WO5vfllSD2IP-1TQSpZ49b5tMjks0kT09s-nU6QOpVpOjI Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d23a8eadfd74e358d917b9aa3b85bb7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}] Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesTestJSON-87966257 Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 0d1edf9dfed144d8875968ffd5f9ad91 Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: exception: Image not found. Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2111a6c9-ab23-46fe-b46b-3d5bd7a741e1'} Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 to delete Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 could not be found. Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.502674 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:20:27.507245 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.512737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5ecc25e0-30f2-469f-b853-409286032375 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Returning 404 to user: Image not found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:27.516427 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5ecc25e0-30f2-469f-b853-409286032375 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1" status: 404 len: 62 microversion: 2.1 time: 0.069214 Jul 20 04:20:27.517598 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1344/2590] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:27 2022] DELETE /compute/v2.1/images/2111a6c9-ab23-46fe-b46b-3d5bd7a741e1 => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:20:27.534797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6282125b-89ff-4664-b5cb-fa05d48e4fe9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.551853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6282125b-89ff-4664-b5cb-fa05d48e4fe9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:27.557609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6282125b-89ff-4664-b5cb-fa05d48e4fe9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:20:27.816969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d9d10d5b-fc96-4c91-87af-789e4c968ff5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:27.832824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d9d10d5b-fc96-4c91-87af-789e4c968ff5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:27.837629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d9d10d5b-fc96-4c91-87af-789e4c968ff5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:27.845242 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d9d10d5b-fc96-4c91-87af-789e4c968ff5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 1.602787 Jul 20 04:20:27.846466 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1247/2591] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:26 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:27.853629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-36be467d-5d49-4946-88fa-7080c054e529 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Action: 'create', calling method: .version_select at 0x7fbf9da0b1f0>, body: {"keypair": {"name": "tempest-keypair-507360018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDShwyJinpKvjrmzys7Vss4O7YFfj4iiqLozOvpBHPjXJuYGbLiECye2SFEYV3hxHGaAjFz8A3d8N0H09oTjF8vF8UtU5AcmzYXBz8m+AEatsNPMGSMZWMWp0Q1DABU7GA=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:27.898747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6282125b-89ff-4664-b5cb-fa05d48e4fe9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.899862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6282125b-89ff-4664-b5cb-fa05d48e4fe9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.900634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6282125b-89ff-4664-b5cb-fa05d48e4fe9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.901075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6282125b-89ff-4664-b5cb-fa05d48e4fe9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.922200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-36be467d-5d49-4946-88fa-7080c054e529 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Getting quotas for project 11a907925a4a4e2ea021a5a033582218. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:27.942071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-36be467d-5d49-4946-88fa-7080c054e529 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Getting quotas for user 22189fc24b5342789bde2c421fb2e75a and project 11a907925a4a4e2ea021a5a033582218. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:28.017468 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-36be467d-5d49-4946-88fa-7080c054e529 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.168804 Jul 20 04:20:28.019695 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1248/2592] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jul 20 04:20:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:20:28.037409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3068db9c-ceb2-4c97-92d9-8a6c92ea125f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:28.038657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3068db9c-ceb2-4c97-92d9-8a6c92ea125f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:28.059121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3068db9c-ceb2-4c97-92d9-8a6c92ea125f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.068215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3068db9c-ceb2-4c97-92d9-8a6c92ea125f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.069288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3068db9c-ceb2-4c97-92d9-8a6c92ea125f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.074659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3068db9c-ceb2-4c97-92d9-8a6c92ea125f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.098219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-6282125b-89ff-4664-b5cb-fa05d48e4fe9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:20:28.146809 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-3068db9c-ceb2-4c97-92d9-8a6c92ea125f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] HTTP exception thrown: Instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe could not be found. Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3068db9c-ceb2-4c97-92d9-8a6c92ea125f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Request method failure captured: Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe HTTP/1.1 Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FtbDaY-CCWSg76Wh3w-4TpDSkzEywl7I_1nYOMQtTMGfQnOBIbojhS5GH4tURAfFXEREzkB64Go-7bbBqVa_ay13eRF4swXQXfMMZJYhkoToy7jFTeSjdl4ZxflCEB3WO5vfllSD2IP-1TQSpZ49b5tMjks0kT09s-nU6QOpVpOjI Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d23a8eadfd74e358d917b9aa3b85bb7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}] Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 0d1edf9dfed144d8875968ffd5f9ad91 Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe could not be found. Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '70d86df2-0b5f-4d16-b6a5-fe16c86494fe'} Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe could not be found. Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe could not be found. Jul 20 04:20:28.156742 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.160453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:28.160453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.160453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.160453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:28.160453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:28.160453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:28.160453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:28.160453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe could not be found. Jul 20 04:20:28.160453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.160453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3068db9c-ceb2-4c97-92d9-8a6c92ea125f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Returning 404 to user: Instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:28.160453 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3068db9c-ceb2-4c97-92d9-8a6c92ea125f tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 404 len: 111 microversion: 2.1 time: 0.137450 Jul 20 04:20:28.168383 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1249/2593] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:28 2022] DELETE /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:28.193903 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6282125b-89ff-4664-b5cb-fa05d48e4fe9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.672142 Jul 20 04:20:28.195200 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1345/2594] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Jul 20 04:20:27 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:28.203612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8a318ad7-2e16-4c9e-9aca-20a2c5a39476 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:28.204241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8a318ad7-2e16-4c9e-9aca-20a2c5a39476 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 70d86df2-0b5f-4d16-b6a5-fe16c86494fe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:28.215230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a1f26dbd-ec57-4c62-96f2-ac98d55444b2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:28.216266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a1f26dbd-ec57-4c62-96f2-ac98d55444b2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:28.224100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a318ad7-2e16-4c9e-9aca-20a2c5a39476 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.224575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a318ad7-2e16-4c9e-9aca-20a2c5a39476 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.225350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a318ad7-2e16-4c9e-9aca-20a2c5a39476 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.230024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1f26dbd-ec57-4c62-96f2-ac98d55444b2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.230867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1f26dbd-ec57-4c62-96f2-ac98d55444b2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.232496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1f26dbd-ec57-4c62-96f2-ac98d55444b2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.233405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1f26dbd-ec57-4c62-96f2-ac98d55444b2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.248350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a318ad7-2e16-4c9e-9aca-20a2c5a39476 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.279045 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-8a318ad7-2e16-4c9e-9aca-20a2c5a39476 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] HTTP exception thrown: Instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe could not be found. Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8a318ad7-2e16-4c9e-9aca-20a2c5a39476 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Request method failure captured: Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe HTTP/1.1 Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FtbDaY-CCWSg76Wh3w-4TpDSkzEywl7I_1nYOMQtTMGfQnOBIbojhS5GH4tURAfFXEREzkB64Go-7bbBqVa_ay13eRF4swXQXfMMZJYhkoToy7jFTeSjdl4ZxflCEB3WO5vfllSD2IP-1TQSpZ49b5tMjks0kT09s-nU6QOpVpOjI Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d23a8eadfd74e358d917b9aa3b85bb7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}] Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 0d1edf9dfed144d8875968ffd5f9ad91 Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe could not be found. Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '70d86df2-0b5f-4d16-b6a5-fe16c86494fe'} Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe could not be found. Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe could not be found. Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.280632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.284155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:28.284155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:28.284155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:28.284155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:28.284155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe could not be found. Jul 20 04:20:28.284155 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.284155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8a318ad7-2e16-4c9e-9aca-20a2c5a39476 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Returning 404 to user: Instance 70d86df2-0b5f-4d16-b6a5-fe16c86494fe could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:28.284155 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8a318ad7-2e16-4c9e-9aca-20a2c5a39476 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe" status: 404 len: 111 microversion: 2.1 time: 0.112383 Jul 20 04:20:28.287481 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1250/2595] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:28 2022] GET /compute/v2.1/servers/70d86df2-0b5f-4d16-b6a5-fe16c86494fe => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:28.304335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dd423c78-3a38-43a4-a556-4f73cf8e92ca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '.version_select at 0x7fbf9d373af0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:28.340678 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-dd423c78-3a38-43a4-a556-4f73cf8e92ca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] HTTP exception thrown: Image not found. Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dd423c78-3a38-43a4-a556-4f73cf8e92ca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Request method failure captured: Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d HTTP/1.1 Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FtbDaY-CCWSg76Wh3w-4TpDSkzEywl7I_1nYOMQtTMGfQnOBIbojhS5GH4tURAfFXEREzkB64Go-7bbBqVa_ay13eRF4swXQXfMMZJYhkoToy7jFTeSjdl4ZxflCEB3WO5vfllSD2IP-1TQSpZ49b5tMjks0kT09s-nU6QOpVpOjI Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d23a8eadfd74e358d917b9aa3b85bb7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}] Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 0d1edf9dfed144d8875968ffd5f9ad91 Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '1d52b32f-341e-4d52-89d5-2e204ce7173d'} Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1d52b32f-341e-4d52-89d5-2e204ce7173d to delete Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1d52b32f-341e-4d52-89d5-2e204ce7173d could not be found. Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.342589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dd423c78-3a38-43a4-a556-4f73cf8e92ca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:28.346355 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dd423c78-3a38-43a4-a556-4f73cf8e92ca tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d" status: 404 len: 62 microversion: 2.1 time: 0.052998 Jul 20 04:20:28.348949 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1251/2596] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:28 2022] DELETE /compute/v2.1/images/1d52b32f-341e-4d52-89d5-2e204ce7173d => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:20:28.358205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6deb43e-82ff-404f-8335-a0a0a241a91e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:28.359723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e6deb43e-82ff-404f-8335-a0a0a241a91e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:28.377020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6deb43e-82ff-404f-8335-a0a0a241a91e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.378311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6deb43e-82ff-404f-8335-a0a0a241a91e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.379861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6deb43e-82ff-404f-8335-a0a0a241a91e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.380597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6deb43e-82ff-404f-8335-a0a0a241a91e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.412028 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e6deb43e-82ff-404f-8335-a0a0a241a91e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] HTTP exception thrown: Instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf could not be found. Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6deb43e-82ff-404f-8335-a0a0a241a91e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Request method failure captured: Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf HTTP/1.1 Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FtbDaY-CCWSg76Wh3w-4TpDSkzEywl7I_1nYOMQtTMGfQnOBIbojhS5GH4tURAfFXEREzkB64Go-7bbBqVa_ay13eRF4swXQXfMMZJYhkoToy7jFTeSjdl4ZxflCEB3WO5vfllSD2IP-1TQSpZ49b5tMjks0kT09s-nU6QOpVpOjI Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d23a8eadfd74e358d917b9aa3b85bb7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}] Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 0d1edf9dfed144d8875968ffd5f9ad91 Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf could not be found. Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '94c0c327-39d3-44cf-8598-b6dcb35a2fbf'} Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf could not be found. Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf could not be found. Jul 20 04:20:28.413652 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.419526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:28.419526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.419526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.419526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:28.419526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:28.419526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:28.419526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:28.419526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf could not be found. Jul 20 04:20:28.419526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.419526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6deb43e-82ff-404f-8335-a0a0a241a91e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Returning 404 to user: Instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:28.419526 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e6deb43e-82ff-404f-8335-a0a0a241a91e tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "DELETE /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 404 len: 111 microversion: 2.1 time: 0.065626 Jul 20 04:20:28.424476 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1252/2597] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:28 2022] DELETE /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:28.433864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-463b9561-3fc0-41e1-9d3f-1004625031e4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:28.434505 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-463b9561-3fc0-41e1-9d3f-1004625031e4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] [instance: 94c0c327-39d3-44cf-8598-b6dcb35a2fbf] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:28.447666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-463b9561-3fc0-41e1-9d3f-1004625031e4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.447666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-463b9561-3fc0-41e1-9d3f-1004625031e4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.448441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-463b9561-3fc0-41e1-9d3f-1004625031e4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.448894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-463b9561-3fc0-41e1-9d3f-1004625031e4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.467192 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-463b9561-3fc0-41e1-9d3f-1004625031e4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] HTTP exception thrown: Instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf could not be found. Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-463b9561-3fc0-41e1-9d3f-1004625031e4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Request method failure captured: Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf HTTP/1.1 Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FtbDaY-CCWSg76Wh3w-4TpDSkzEywl7I_1nYOMQtTMGfQnOBIbojhS5GH4tURAfFXEREzkB64Go-7bbBqVa_ay13eRF4swXQXfMMZJYhkoToy7jFTeSjdl4ZxflCEB3WO5vfllSD2IP-1TQSpZ49b5tMjks0kT09s-nU6QOpVpOjI Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d23a8eadfd74e358d917b9aa3b85bb7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d23a8eadfd74e358d917b9aa3b85bb7"}]}] Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6d23a8eadfd74e358d917b9aa3b85bb7 Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesTestJSON-87966257 Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 0d1edf9dfed144d8875968ffd5f9ad91 Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesTestJSON-87966257-project Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf could not be found. Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '94c0c327-39d3-44cf-8598-b6dcb35a2fbf'} Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf could not be found. Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf could not be found. Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.468782 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:28.472703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:28.472703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:28.472703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:28.472703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:28.472703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf could not be found. Jul 20 04:20:28.472703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:20:28.472703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-463b9561-3fc0-41e1-9d3f-1004625031e4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] Returning 404 to user: Instance 94c0c327-39d3-44cf-8598-b6dcb35a2fbf could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:28.472703 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-463b9561-3fc0-41e1-9d3f-1004625031e4 tempest-ImagesTestJSON-87966257 tempest-ImagesTestJSON-87966257-project] 10.222.0.20 "GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf" status: 404 len: 111 microversion: 2.1 time: 0.044972 Jul 20 04:20:28.474878 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1253/2598] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:28 2022] GET /compute/v2.1/servers/94c0c327-39d3-44cf-8598-b6dcb35a2fbf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:28.480482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-798ab720-b67b-43c4-8235-84076d57c0d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:28.481114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-798ab720-b67b-43c4-8235-84076d57c0d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:28.488153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-798ab720-b67b-43c4-8235-84076d57c0d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.488609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-798ab720-b67b-43c4-8235-84076d57c0d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.489412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-798ab720-b67b-43c4-8235-84076d57c0d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.489858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-798ab720-b67b-43c4-8235-84076d57c0d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.712522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-798ab720-b67b-43c4-8235-84076d57c0d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:28.730173 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-798ab720-b67b-43c4-8235-84076d57c0d8 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 200 len: 1451 microversion: 2.1 time: 0.254102 Jul 20 04:20:28.740012 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1254/2599] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:28 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 1451 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:28.753582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-79a788cf-9773-4656-97b7-97eea32c4cd3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "105d6142-95cb-4a79-a81c-c50d934f56e8", "device": "/dev/xvdb"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:28.756489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-79a788cf-9773-4656-97b7-97eea32c4cd3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:28.800172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79a788cf-9773-4656-97b7-97eea32c4cd3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.804269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79a788cf-9773-4656-97b7-97eea32c4cd3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.809344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79a788cf-9773-4656-97b7-97eea32c4cd3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.809905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79a788cf-9773-4656-97b7-97eea32c4cd3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.855584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a1f26dbd-ec57-4c62-96f2-ac98d55444b2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:28.868862 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a1f26dbd-ec57-4c62-96f2-ac98d55444b2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1512 microversion: 2.1 time: 0.663657 Jul 20 04:20:28.872458 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1346/2600] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:28 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1512 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:28.892851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-632e0ae6-bcfd-42b9-bf63-ed023ca59b17 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:28.901265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-632e0ae6-bcfd-42b9-bf63-ed023ca59b17 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:28.943453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-632e0ae6-bcfd-42b9-bf63-ed023ca59b17 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.946659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-632e0ae6-bcfd-42b9-bf63-ed023ca59b17 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.952913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-632e0ae6-bcfd-42b9-bf63-ed023ca59b17 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.953379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-632e0ae6-bcfd-42b9-bf63-ed023ca59b17 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.391257 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-79a788cf-9773-4656-97b7-97eea32c4cd3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "POST /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.654570 Jul 20 04:20:29.394617 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1255/2601] 10.222.0.20 () {62 vars in 1363 bytes} [Wed Jul 20 04:20:28 2022] POST /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:20:29.427950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f0d02358-c58a-4191-9aa0-e84f8a24f363 req-934015df-2768-4eaf-b57d-75984a803331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac84d10-8291-412d-8921-cdc10c2682fa", "name": "network-vif-deleted", "tag": "752a09de-27dd-484d-921c-72aa7e0f3a31"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:29.483949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f0d02358-c58a-4191-9aa0-e84f8a24f363 req-934015df-2768-4eaf-b57d-75984a803331 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.497644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f0d02358-c58a-4191-9aa0-e84f8a24f363 req-934015df-2768-4eaf-b57d-75984a803331 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.555146 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f0d02358-c58a-4191-9aa0-e84f8a24f363 req-934015df-2768-4eaf-b57d-75984a803331 service nova] Creating event network-vif-deleted:752a09de-27dd-484d-921c-72aa7e0f3a31 for instance 7ac84d10-8291-412d-8921-cdc10c2682fa on n-h1-764485-11 Jul 20 04:20:29.576053 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f0d02358-c58a-4191-9aa0-e84f8a24f363 req-934015df-2768-4eaf-b57d-75984a803331 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175687 Jul 20 04:20:29.577221 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1256/2602] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:29.591938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f1017bfc-05c1-4dd9-a88e-8ce36d635719 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:29.593967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f1017bfc-05c1-4dd9-a88e-8ce36d635719 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 6131221c-3273-45e7-9458-8fedaa324b3d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:29.602048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1017bfc-05c1-4dd9-a88e-8ce36d635719 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.602915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1017bfc-05c1-4dd9-a88e-8ce36d635719 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.605162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1017bfc-05c1-4dd9-a88e-8ce36d635719 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.605871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1017bfc-05c1-4dd9-a88e-8ce36d635719 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.319063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-632e0ae6-bcfd-42b9-bf63-ed023ca59b17 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:30.338748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-632e0ae6-bcfd-42b9-bf63-ed023ca59b17 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:30.349967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-632e0ae6-bcfd-42b9-bf63-ed023ca59b17 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:30.357617 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-632e0ae6-bcfd-42b9-bf63-ed023ca59b17 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 1.477249 Jul 20 04:20:30.387821 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1347/2603] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:28 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:30.395794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14f9175b-c17b-41a4-8a2c-aef562ddacf5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:30.396431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-14f9175b-c17b-41a4-8a2c-aef562ddacf5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:30.421328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14f9175b-c17b-41a4-8a2c-aef562ddacf5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.422648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14f9175b-c17b-41a4-8a2c-aef562ddacf5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.424828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14f9175b-c17b-41a4-8a2c-aef562ddacf5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.425483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14f9175b-c17b-41a4-8a2c-aef562ddacf5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.459108 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-14f9175b-c17b-41a4-8a2c-aef562ddacf5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14f9175b-c17b-41a4-8a2c-aef562ddacf5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa HTTP/1.1 Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '7ac84d10-8291-412d-8921-cdc10c2682fa'} Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:30.461241 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:30.465514 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:30.465514 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:30.465514 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:30.465514 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:30.465514 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:30.465514 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:20:30.465514 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:30.467894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14f9175b-c17b-41a4-8a2c-aef562ddacf5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:30.468973 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-14f9175b-c17b-41a4-8a2c-aef562ddacf5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 404 len: 111 microversion: 2.1 time: 0.080273 Jul 20 04:20:30.470785 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1348/2604] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:30 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:30.635845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f1017bfc-05c1-4dd9-a88e-8ce36d635719 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:30.658201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1708229243", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2f1733ae-f5aa-4d8e-b430-1f99c985f6d9"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:30.666983 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f1017bfc-05c1-4dd9-a88e-8ce36d635719 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d" status: 200 len: 1511 microversion: 2.1 time: 1.086793 Jul 20 04:20:30.682569 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1257/2605] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:29 2022] GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d => generated 1511 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:30.703952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e50706a4-70d2-4bbd-8b8f-5aba986c444f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:30.703952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e50706a4-70d2-4bbd-8b8f-5aba986c444f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:30.721977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e50706a4-70d2-4bbd-8b8f-5aba986c444f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.725214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e50706a4-70d2-4bbd-8b8f-5aba986c444f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.726392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e50706a4-70d2-4bbd-8b8f-5aba986c444f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.729798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e50706a4-70d2-4bbd-8b8f-5aba986c444f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.797444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] validate_networks() for [('2f1733ae-f5aa-4d8e-b430-1f99c985f6d9', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:20:31.389104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e50706a4-70d2-4bbd-8b8f-5aba986c444f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:31.397373 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e50706a4-70d2-4bbd-8b8f-5aba986c444f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1511 microversion: 2.1 time: 0.713436 Jul 20 04:20:31.397970 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1258/2606] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:30 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1511 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:31.425562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4daf6d92-b09a-49a1-bcb9-b54a50897747 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:31.431782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4daf6d92-b09a-49a1-bcb9-b54a50897747 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:31.448943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4daf6d92-b09a-49a1-bcb9-b54a50897747 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.449563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4daf6d92-b09a-49a1-bcb9-b54a50897747 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.450702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4daf6d92-b09a-49a1-bcb9-b54a50897747 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.451285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4daf6d92-b09a-49a1-bcb9-b54a50897747 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.513806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:32.755769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:20:32.763207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:20:32.764149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:20:32.764787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:20:32.765407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:20:32.803430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4daf6d92-b09a-49a1-bcb9-b54a50897747 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:32.815288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:32.816995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:32.818045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:32.818780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4daf6d92-b09a-49a1-bcb9-b54a50897747 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:32.819400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:32.821967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4daf6d92-b09a-49a1-bcb9-b54a50897747 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:32.837321 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4daf6d92-b09a-49a1-bcb9-b54a50897747 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 1.437597 Jul 20 04:20:32.850021 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1259/2607] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:31 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:32.887601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc406d01-eecf-4061-89b4-a22cfb669bcc tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:32.911101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fc406d01-eecf-4061-89b4-a22cfb669bcc tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:32.933547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc406d01-eecf-4061-89b4-a22cfb669bcc tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:20:32.957325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc406d01-eecf-4061-89b4-a22cfb669bcc tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:32.959013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:32.962374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc406d01-eecf-4061-89b4-a22cfb669bcc tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:32.968780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc406d01-eecf-4061-89b4-a22cfb669bcc tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:32.973548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc406d01-eecf-4061-89b4-a22cfb669bcc tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:32.980132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Getting quotas for user 793c626644204dc3a08ed9118c9aaf4c and project 43883ce179414508a380b92446797091. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:33.076414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:20:33.083936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:20:33.110726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-fc406d01-eecf-4061-89b4-a22cfb669bcc tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:20:33.184241 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b2eadea3-cd93-42a3-a0cb-acdd6fc18429 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.530123 Jul 20 04:20:33.202134 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1349/2608] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:20:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:20:33.217394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fc406d01-eecf-4061-89b4-a22cfb669bcc tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:33.221324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1b57fe32-9b8f-47d1-9c3a-eb165670b2cf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:33.222221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1b57fe32-9b8f-47d1-9c3a-eb165670b2cf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:33.249344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc406d01-eecf-4061-89b4-a22cfb669bcc tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:33.256907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc406d01-eecf-4061-89b4-a22cfb669bcc tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:34.157276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1b57fe32-9b8f-47d1-9c3a-eb165670b2cf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:34.175072 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1b57fe32-9b8f-47d1-9c3a-eb165670b2cf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1215 microversion: 2.1 time: 0.962700 Jul 20 04:20:34.185248 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1350/2609] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:33 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1215 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:34.191850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-522960149", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d331cdd5-9ea5-4140-8bc1-f2d215074015"}, {"port": "0f94531b-fcec-4091-9be6-24327def4b79", "tag": "port-1"}, {"port": "ed815642-7555-4590-a5fa-6a3dedab8275", "tag": "port-2"}, {"uuid": "568b4035-fde0-45f0-8fac-3f90f199a8f9", "tag": "net-1"}, {"uuid": "568b4035-fde0-45f0-8fac-3f90f199a8f9"}, {"uuid": "37a50995-42aa-4216-b0a1-58260d9ba501", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "37a50995-42aa-4216-b0a1-58260d9ba501", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d7d7c4a5-b09e-499b-82e3-95fbc2ac031f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "719415a9-e98d-4649-aa4a-377cb61ab324", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "089af5ff-0ffb-4cc7-9004-fa61fe4cf55b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1406978815"}], "key_name": "tempest-keypair-507360018", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:34.776903 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc406d01-eecf-4061-89b4-a22cfb669bcc tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 1.924487 Jul 20 04:20:34.778454 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1260/2610] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:20:32 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:34.785374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-074e1f0c-0da2-4c0e-92c7-376acc62a719 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:34.787064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-074e1f0c-0da2-4c0e-92c7-376acc62a719 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:34.813217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-074e1f0c-0da2-4c0e-92c7-376acc62a719 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:34.814095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-074e1f0c-0da2-4c0e-92c7-376acc62a719 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:34.816319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-074e1f0c-0da2-4c0e-92c7-376acc62a719 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:34.833031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-074e1f0c-0da2-4c0e-92c7-376acc62a719 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:34.930289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] validate_networks() for [('d331cdd5-9ea5-4140-8bc1-f2d215074015', None, None, None, None, None), (None, None, '0f94531b-fcec-4091-9be6-24327def4b79', None, None, None), (None, None, 'ed815642-7555-4590-a5fa-6a3dedab8275', None, None, None), ('568b4035-fde0-45f0-8fac-3f90f199a8f9', None, None, None, None, None), ('568b4035-fde0-45f0-8fac-3f90f199a8f9', None, None, None, None, None), ('37a50995-42aa-4216-b0a1-58260d9ba501', '10.2.2.100', None, None, None, None), ('37a50995-42aa-4216-b0a1-58260d9ba501', '10.2.2.200', None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:20:36.248953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-074e1f0c-0da2-4c0e-92c7-376acc62a719 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:36.275535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-074e1f0c-0da2-4c0e-92c7-376acc62a719 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:36.279812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-074e1f0c-0da2-4c0e-92c7-376acc62a719 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:36.284787 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-074e1f0c-0da2-4c0e-92c7-376acc62a719 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 1.503866 Jul 20 04:20:36.288204 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1261/2611] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:34 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:36.297671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-113f25a9-f7b1-4854-abeb-5caf8a7c117d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:36.310236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-113f25a9-f7b1-4854-abeb-5caf8a7c117d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:36.316377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-113f25a9-f7b1-4854-abeb-5caf8a7c117d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:20:36.881190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-113f25a9-f7b1-4854-abeb-5caf8a7c117d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:36.881744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-113f25a9-f7b1-4854-abeb-5caf8a7c117d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:36.884964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-113f25a9-f7b1-4854-abeb-5caf8a7c117d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:36.885919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-113f25a9-f7b1-4854-abeb-5caf8a7c117d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.280858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-113f25a9-f7b1-4854-abeb-5caf8a7c117d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:20:37.454319 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-113f25a9-f7b1-4854-abeb-5caf8a7c117d tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 1.161203 Jul 20 04:20:37.455183 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1262/2612] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Jul 20 04:20:36 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:37.463385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5b633770-2ea7-4dc3-914e-94d09ff58c2d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:37.472068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5b633770-2ea7-4dc3-914e-94d09ff58c2d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:37.493360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b633770-2ea7-4dc3-914e-94d09ff58c2d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.494172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b633770-2ea7-4dc3-914e-94d09ff58c2d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.496479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b633770-2ea7-4dc3-914e-94d09ff58c2d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.498551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b633770-2ea7-4dc3-914e-94d09ff58c2d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.867320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5b633770-2ea7-4dc3-914e-94d09ff58c2d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:37.883549 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5b633770-2ea7-4dc3-914e-94d09ff58c2d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1273 microversion: 2.1 time: 0.424304 Jul 20 04:20:37.889598 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1263/2613] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:37 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1273 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:37.903265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9996bf3-0334-4546-bd10-3f6f6ae90da5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:37.904164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b9996bf3-0334-4546-bd10-3f6f6ae90da5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:37.925382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9996bf3-0334-4546-bd10-3f6f6ae90da5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.926091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9996bf3-0334-4546-bd10-3f6f6ae90da5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.927076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9996bf3-0334-4546-bd10-3f6f6ae90da5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.931256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9996bf3-0334-4546-bd10-3f6f6ae90da5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:39.380919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9996bf3-0334-4546-bd10-3f6f6ae90da5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:39.397775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9996bf3-0334-4546-bd10-3f6f6ae90da5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:39.414717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9996bf3-0334-4546-bd10-3f6f6ae90da5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:39.416489 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b9996bf3-0334-4546-bd10-3f6f6ae90da5 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 1.525531 Jul 20 04:20:39.424418 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1264/2614] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:37 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:39.429504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd9d629c-3639-4ecd-b96c-76233ee3a1bb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:39.452245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cd9d629c-3639-4ecd-b96c-76233ee3a1bb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:39.453396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cd9d629c-3639-4ecd-b96c-76233ee3a1bb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:20:39.461292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd9d629c-3639-4ecd-b96c-76233ee3a1bb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:39.463291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd9d629c-3639-4ecd-b96c-76233ee3a1bb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:39.465780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd9d629c-3639-4ecd-b96c-76233ee3a1bb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:39.466498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd9d629c-3639-4ecd-b96c-76233ee3a1bb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:39.756188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-cd9d629c-3639-4ecd-b96c-76233ee3a1bb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:20:39.955433 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd9d629c-3639-4ecd-b96c-76233ee3a1bb tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.529501 Jul 20 04:20:39.966368 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1265/2615] 10.222.0.20 () {58 vars in 1211 bytes} [Wed Jul 20 04:20:39 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:39.973334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-90958446-3173-48f7-9f1a-61117b1fcb70 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:39.974079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-90958446-3173-48f7-9f1a-61117b1fcb70 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:39.999360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90958446-3173-48f7-9f1a-61117b1fcb70 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:39.999996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90958446-3173-48f7-9f1a-61117b1fcb70 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.000847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90958446-3173-48f7-9f1a-61117b1fcb70 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.001301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90958446-3173-48f7-9f1a-61117b1fcb70 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.102773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-90958446-3173-48f7-9f1a-61117b1fcb70 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:40.122637 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-90958446-3173-48f7-9f1a-61117b1fcb70 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1273 microversion: 2.1 time: 0.153886 Jul 20 04:20:40.128666 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1266/2616] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:39 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:40.140396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-414ba915-59de-4328-9bc4-98c9f544c30e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:40.154189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-414ba915-59de-4328-9bc4-98c9f544c30e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:40.155493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-414ba915-59de-4328-9bc4-98c9f544c30e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:20:40.170594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-414ba915-59de-4328-9bc4-98c9f544c30e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.173314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-414ba915-59de-4328-9bc4-98c9f544c30e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.176464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-414ba915-59de-4328-9bc4-98c9f544c30e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.177165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-414ba915-59de-4328-9bc4-98c9f544c30e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.421715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-414ba915-59de-4328-9bc4-98c9f544c30e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:20:40.579378 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-414ba915-59de-4328-9bc4-98c9f544c30e tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.448895 Jul 20 04:20:40.586840 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1267/2617] 10.222.0.20 () {58 vars in 1195 bytes} [Wed Jul 20 04:20:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:40.594012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-16e34a12-82b5-44c8-8a09-7ca19c214003 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:40.594949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-16e34a12-82b5-44c8-8a09-7ca19c214003 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:40.601645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16e34a12-82b5-44c8-8a09-7ca19c214003 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.602648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16e34a12-82b5-44c8-8a09-7ca19c214003 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.603468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16e34a12-82b5-44c8-8a09-7ca19c214003 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.603937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16e34a12-82b5-44c8-8a09-7ca19c214003 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:42.712717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-16e34a12-82b5-44c8-8a09-7ca19c214003 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:42.733947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-16e34a12-82b5-44c8-8a09-7ca19c214003 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:42.735449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-16e34a12-82b5-44c8-8a09-7ca19c214003 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:42.756334 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-16e34a12-82b5-44c8-8a09-7ca19c214003 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 2.160838 Jul 20 04:20:42.757296 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1268/2618] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:40 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:42.763146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-66c79930-95fd-4e9c-84c6-5f560f0b150f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:42.772405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-66c79930-95fd-4e9c-84c6-5f560f0b150f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:42.773416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-66c79930-95fd-4e9c-84c6-5f560f0b150f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'name': '-900642373', 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:20:42.792771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66c79930-95fd-4e9c-84c6-5f560f0b150f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:42.796148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66c79930-95fd-4e9c-84c6-5f560f0b150f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:42.797148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66c79930-95fd-4e9c-84c6-5f560f0b150f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:42.797761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66c79930-95fd-4e9c-84c6-5f560f0b150f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:42.892019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:42.893918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:43.030384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-66c79930-95fd-4e9c-84c6-5f560f0b150f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:20:43.192455 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-66c79930-95fd-4e9c-84c6-5f560f0b150f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-900642373" status: 200 len: 345 microversion: 2.1 time: 0.432881 Jul 20 04:20:43.201890 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1269/2619] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Jul 20 04:20:42 2022] GET /compute/v2.1/servers?name=-900642373 => generated 345 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:43.206880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5eeddc2b-f534-4ba3-a3e3-50f2a0d41b28 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:43.207725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5eeddc2b-f534-4ba3-a3e3-50f2a0d41b28 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:43.221952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:43.224213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5eeddc2b-f534-4ba3-a3e3-50f2a0d41b28 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.224532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5eeddc2b-f534-4ba3-a3e3-50f2a0d41b28 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.225322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5eeddc2b-f534-4ba3-a3e3-50f2a0d41b28 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.225759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5eeddc2b-f534-4ba3-a3e3-50f2a0d41b28 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.604880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5eeddc2b-f534-4ba3-a3e3-50f2a0d41b28 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:43.620416 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5eeddc2b-f534-4ba3-a3e3-50f2a0d41b28 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1315 microversion: 2.1 time: 0.417257 Jul 20 04:20:43.624082 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1270/2620] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:43 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:43.632641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2019bc27-dd7c-4c99-a89f-c3c6b79834ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:43.638586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2019bc27-dd7c-4c99-a89f-c3c6b79834ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:43.646030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2019bc27-dd7c-4c99-a89f-c3c6b79834ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:20:43.666293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2019bc27-dd7c-4c99-a89f-c3c6b79834ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.668001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2019bc27-dd7c-4c99-a89f-c3c6b79834ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.671281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2019bc27-dd7c-4c99-a89f-c3c6b79834ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.671977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2019bc27-dd7c-4c99-a89f-c3c6b79834ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.856299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-2019bc27-dd7c-4c99-a89f-c3c6b79834ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:20:43.949549 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2019bc27-dd7c-4c99-a89f-c3c6b79834ba tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.324279 Jul 20 04:20:43.951126 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1271/2621] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Jul 20 04:20:43 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:43.957748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-05b9887d-3563-4683-bf71-e9f023dac29a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:43.958387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-05b9887d-3563-4683-bf71-e9f023dac29a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:43.965448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05b9887d-3563-4683-bf71-e9f023dac29a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.965906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05b9887d-3563-4683-bf71-e9f023dac29a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.966897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05b9887d-3563-4683-bf71-e9f023dac29a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.967348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05b9887d-3563-4683-bf71-e9f023dac29a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:44.167071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:44.700422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-05b9887d-3563-4683-bf71-e9f023dac29a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:44.716071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-05b9887d-3563-4683-bf71-e9f023dac29a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:44.719219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-05b9887d-3563-4683-bf71-e9f023dac29a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:44.721819 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-05b9887d-3563-4683-bf71-e9f023dac29a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 0.769420 Jul 20 04:20:44.723978 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1272/2622] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:43 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:44.730725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-99db5b7a-930a-4777-8d6a-5bee7e6fc441 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:44.747316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-99db5b7a-930a-4777-8d6a-5bee7e6fc441 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:44.751573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-99db5b7a-930a-4777-8d6a-5bee7e6fc441 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-90064237', 'deleted': False, 'project_id': 'c1be6441272046629ac3840881e0148f'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:20:44.755940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99db5b7a-930a-4777-8d6a-5bee7e6fc441 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:44.756628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99db5b7a-930a-4777-8d6a-5bee7e6fc441 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:44.757733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99db5b7a-930a-4777-8d6a-5bee7e6fc441 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:44.758470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99db5b7a-930a-4777-8d6a-5bee7e6fc441 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:44.919437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-99db5b7a-930a-4777-8d6a-5bee7e6fc441 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:20:44.932831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:45.113218 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-99db5b7a-930a-4777-8d6a-5bee7e6fc441 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-90064237" status: 200 len: 345 microversion: 2.1 time: 0.387650 Jul 20 04:20:45.116333 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1273/2623] 10.222.0.20 () {58 vars in 1225 bytes} [Wed Jul 20 04:20:44 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-90064237 => generated 345 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:45.140197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e17e3e47-9253-4aba-a3e4-af30079f4aaf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:45.144790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e17e3e47-9253-4aba-a3e4-af30079f4aaf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:45.158942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e17e3e47-9253-4aba-a3e4-af30079f4aaf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:45.166043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e17e3e47-9253-4aba-a3e4-af30079f4aaf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:45.169135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e17e3e47-9253-4aba-a3e4-af30079f4aaf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:45.169373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e17e3e47-9253-4aba-a3e4-af30079f4aaf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:46.219253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e17e3e47-9253-4aba-a3e4-af30079f4aaf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:46.227195 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e17e3e47-9253-4aba-a3e4-af30079f4aaf tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1315 microversion: 2.1 time: 1.109578 Jul 20 04:20:46.238236 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1274/2624] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:45 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1315 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:46.482437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0cd86cab-6567-4909-ab7b-c2f5b17d8ef2 req-cb46a7a8-dac5-48c4-987a-3d5dc5e0f519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13179b6-ac74-46e9-8550-55de57c58e3e", "tag": "086a4d65-f359-47ab-8b1c-cbd929e01ff8"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:46.503905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0cd86cab-6567-4909-ab7b-c2f5b17d8ef2 req-cb46a7a8-dac5-48c4-987a-3d5dc5e0f519 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.504611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0cd86cab-6567-4909-ab7b-c2f5b17d8ef2 req-cb46a7a8-dac5-48c4-987a-3d5dc5e0f519 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:46.522705 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0cd86cab-6567-4909-ab7b-c2f5b17d8ef2 req-cb46a7a8-dac5-48c4-987a-3d5dc5e0f519 service nova] Creating event network-changed:086a4d65-f359-47ab-8b1c-cbd929e01ff8 for instance a13179b6-ac74-46e9-8550-55de57c58e3e on n-h2-764485-11 Jul 20 04:20:46.528739 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0cd86cab-6567-4909-ab7b-c2f5b17d8ef2 req-cb46a7a8-dac5-48c4-987a-3d5dc5e0f519 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283261 Jul 20 04:20:46.530040 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1275/2625] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:46.536439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-45467429-0241-4686-9176-83ad41c535e3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:46.537224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-45467429-0241-4686-9176-83ad41c535e3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:46.544693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45467429-0241-4686-9176-83ad41c535e3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.545156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45467429-0241-4686-9176-83ad41c535e3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:46.545943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45467429-0241-4686-9176-83ad41c535e3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.546392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45467429-0241-4686-9176-83ad41c535e3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:46.578525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-45467429-0241-4686-9176-83ad41c535e3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:46.717070 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-45467429-0241-4686-9176-83ad41c535e3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 204 len: 0 microversion: 2.1 time: 0.185054 Jul 20 04:20:46.718287 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1276/2626] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:46 2022] DELETE /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:46.893267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f2765c8b-5c53-4e2d-a62f-138978c33478 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Action: 'create', calling method: .version_select at 0x7fbf9d453b80>, body: {"keypair": {"name": "tempest-keypair-1142217574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVL1oMgikQIndZErp2xTDJSjI+zfr8p22bDbGbOwbqMoxy8rXpT3M8XKC5SLFQAKuorcEXRRcUFpxs0yaLVy6bmsEfq8pynrFnA/N0cutWgeN1SuXYIq7TVgZWU6LTjvQ=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:46.919616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-f2765c8b-5c53-4e2d-a62f-138978c33478 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Getting quotas for project cdc4b88912e5436caaa2ce17b7d972b0. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:46.927384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-f2765c8b-5c53-4e2d-a62f-138978c33478 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Getting quotas for user dc30eb948c9245ebab77d8306f408f1e and project cdc4b88912e5436caaa2ce17b7d972b0. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:46.945161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:46.969295 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f2765c8b-5c53-4e2d-a62f-138978c33478 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.249367 Jul 20 04:20:46.970759 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1277/2627] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:20:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:46.977361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a61cb1c2-df19-4257-87bf-cfecff0bdf1e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:46.978366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a61cb1c2-df19-4257-87bf-cfecff0bdf1e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:46.988589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a61cb1c2-df19-4257-87bf-cfecff0bdf1e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.989209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a61cb1c2-df19-4257-87bf-cfecff0bdf1e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:46.990143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a61cb1c2-df19-4257-87bf-cfecff0bdf1e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.990729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a61cb1c2-df19-4257-87bf-cfecff0bdf1e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:47.005881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:20:47.006425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:20:47.006940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:20:47.007417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:20:47.007980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:20:47.013678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:47.026255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:47.027181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:47.028536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:47.029204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:47.059745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Getting quotas for project 11a907925a4a4e2ea021a5a033582218. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:47.068024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Getting quotas for user 22189fc24b5342789bde2c421fb2e75a and project 11a907925a4a4e2ea021a5a033582218. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:47.475539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:20:47.478361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d7d7c4a5-b09e-499b-82e3-95fbc2ac031f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='719415a9-e98d-4649-aa4a-377cb61ab324',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='089af5ff-0ffb-4cc7-9004-fa61fe4cf55b',volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:20:47.839244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a61cb1c2-df19-4257-87bf-cfecff0bdf1e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:47.876574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a61cb1c2-df19-4257-87bf-cfecff0bdf1e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:47.884347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a61cb1c2-df19-4257-87bf-cfecff0bdf1e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:47.895269 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a61cb1c2-df19-4257-87bf-cfecff0bdf1e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 0.919678 Jul 20 04:20:47.912487 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1278/2628] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:46 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:47.927091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b68fddb8-c563-41a3-b374-4572e638114b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:47.928154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b68fddb8-c563-41a3-b374-4572e638114b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:47.949771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b68fddb8-c563-41a3-b374-4572e638114b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:47.950691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b68fddb8-c563-41a3-b374-4572e638114b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:47.952216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b68fddb8-c563-41a3-b374-4572e638114b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:47.955716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b68fddb8-c563-41a3-b374-4572e638114b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.361656 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-62676346-0368-45fb-946e-3f0a5459e576 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 14.174363 Jul 20 04:20:48.373695 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1351/2629] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Jul 20 04:20:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 14187 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:20:48.391936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5c87d6f7-c571-4d06-985f-d45f32146938 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:48.397670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5c87d6f7-c571-4d06-985f-d45f32146938 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:48.407425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c87d6f7-c571-4d06-985f-d45f32146938 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.408596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c87d6f7-c571-4d06-985f-d45f32146938 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.410164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c87d6f7-c571-4d06-985f-d45f32146938 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.411722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c87d6f7-c571-4d06-985f-d45f32146938 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.637584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b68fddb8-c563-41a3-b374-4572e638114b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:48.646977 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b68fddb8-c563-41a3-b374-4572e638114b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1517 microversion: 2.1 time: 0.732953 Jul 20 04:20:48.662921 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1279/2630] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:47 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1517 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:48.669246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a35b22d-34da-4875-b78a-3ded1d7a14a1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:48.669879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7a35b22d-34da-4875-b78a-3ded1d7a14a1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:48.796548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7a35b22d-34da-4875-b78a-3ded1d7a14a1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:48.806666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7a35b22d-34da-4875-b78a-3ded1d7a14a1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:48.810880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7a35b22d-34da-4875-b78a-3ded1d7a14a1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:48.817384 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7a35b22d-34da-4875-b78a-3ded1d7a14a1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1284 microversion: 2.32 time: 0.161888 Jul 20 04:20:48.818600 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1280/2631] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:48 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:48.883833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5c87d6f7-c571-4d06-985f-d45f32146938 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:48.900342 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5c87d6f7-c571-4d06-985f-d45f32146938 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1315 microversion: 2.1 time: 0.524003 Jul 20 04:20:48.907375 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1352/2632] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:48 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:48.919220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-31c47ba8-a481-4be5-be2a-51d657c6e3a9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:48.919885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-31c47ba8-a481-4be5-be2a-51d657c6e3a9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:48.960452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31c47ba8-a481-4be5-be2a-51d657c6e3a9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.966294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31c47ba8-a481-4be5-be2a-51d657c6e3a9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.967138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31c47ba8-a481-4be5-be2a-51d657c6e3a9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.974150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31c47ba8-a481-4be5-be2a-51d657c6e3a9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.554393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-31c47ba8-a481-4be5-be2a-51d657c6e3a9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:49.571832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-31c47ba8-a481-4be5-be2a-51d657c6e3a9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:49.584449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-31c47ba8-a481-4be5-be2a-51d657c6e3a9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:49.586594 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-31c47ba8-a481-4be5-be2a-51d657c6e3a9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 0.672954 Jul 20 04:20:49.589649 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1281/2633] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:48 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:49.670856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-34df2a4f-a1b0-4674-8519-34bd152f44d9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.672103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-34df2a4f-a1b0-4674-8519-34bd152f44d9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:49.704763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34df2a4f-a1b0-4674-8519-34bd152f44d9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.708548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34df2a4f-a1b0-4674-8519-34bd152f44d9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.716747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34df2a4f-a1b0-4674-8519-34bd152f44d9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.718790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34df2a4f-a1b0-4674-8519-34bd152f44d9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.837625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9dd4934-d6df-4595-83f3-a59c0fba0a48 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.838865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e9dd4934-d6df-4595-83f3-a59c0fba0a48 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:49.863739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9dd4934-d6df-4595-83f3-a59c0fba0a48 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.864600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9dd4934-d6df-4595-83f3-a59c0fba0a48 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.867139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9dd4934-d6df-4595-83f3-a59c0fba0a48 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.870624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9dd4934-d6df-4595-83f3-a59c0fba0a48 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:50.142717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e9dd4934-d6df-4595-83f3-a59c0fba0a48 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:50.165647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e9dd4934-d6df-4595-83f3-a59c0fba0a48 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:50.167800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e9dd4934-d6df-4595-83f3-a59c0fba0a48 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:50.169381 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e9dd4934-d6df-4595-83f3-a59c0fba0a48 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1518 microversion: 2.32 time: 0.336833 Jul 20 04:20:50.170522 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1282/2634] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:49 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1518 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:20:50.178963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ec30a4f5-e87e-4ad5-ba73-52ba6dc44465 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:50.180298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ec30a4f5-e87e-4ad5-ba73-52ba6dc44465 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:50.194920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec30a4f5-e87e-4ad5-ba73-52ba6dc44465 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:50.196118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec30a4f5-e87e-4ad5-ba73-52ba6dc44465 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:50.197069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec30a4f5-e87e-4ad5-ba73-52ba6dc44465 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:50.197732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec30a4f5-e87e-4ad5-ba73-52ba6dc44465 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:50.199359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-34df2a4f-a1b0-4674-8519-34bd152f44d9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:50.214101 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-34df2a4f-a1b0-4674-8519-34bd152f44d9 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1517 microversion: 2.1 time: 0.547135 Jul 20 04:20:50.221452 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1353/2635] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:49 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1517 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:50.591160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ec30a4f5-e87e-4ad5-ba73-52ba6dc44465 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:50.599321 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ec30a4f5-e87e-4ad5-ba73-52ba6dc44465 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1315 microversion: 2.1 time: 0.427275 Jul 20 04:20:50.599950 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1283/2636] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:50 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:50.614670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ddd92591-1376-4a23-ab68-b9f030519de4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:50.615564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ddd92591-1376-4a23-ab68-b9f030519de4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:50.634763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddd92591-1376-4a23-ab68-b9f030519de4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:50.636088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddd92591-1376-4a23-ab68-b9f030519de4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:50.636875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddd92591-1376-4a23-ab68-b9f030519de4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:50.637311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddd92591-1376-4a23-ab68-b9f030519de4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.192102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-170f09ac-6eff-49c9-b7a7-982202ee185c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:51.192717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-170f09ac-6eff-49c9-b7a7-982202ee185c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:51.205368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-170f09ac-6eff-49c9-b7a7-982202ee185c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.205825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-170f09ac-6eff-49c9-b7a7-982202ee185c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.206606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-170f09ac-6eff-49c9-b7a7-982202ee185c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.207043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-170f09ac-6eff-49c9-b7a7-982202ee185c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.776894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-170f09ac-6eff-49c9-b7a7-982202ee185c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:51.798883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-170f09ac-6eff-49c9-b7a7-982202ee185c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:51.803535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-170f09ac-6eff-49c9-b7a7-982202ee185c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:51.809013 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-170f09ac-6eff-49c9-b7a7-982202ee185c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1592 microversion: 2.32 time: 0.620788 Jul 20 04:20:51.824359 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1284/2637] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:51 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1592 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:51.831880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f55b85c1-2ae4-401e-b330-34aa0cd34697 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:51.832683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f55b85c1-2ae4-401e-b330-34aa0cd34697 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:51.840949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f55b85c1-2ae4-401e-b330-34aa0cd34697 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.841300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f55b85c1-2ae4-401e-b330-34aa0cd34697 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.842260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f55b85c1-2ae4-401e-b330-34aa0cd34697 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.842927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f55b85c1-2ae4-401e-b330-34aa0cd34697 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.393396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f55b85c1-2ae4-401e-b330-34aa0cd34697 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:52.402860 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f55b85c1-2ae4-401e-b330-34aa0cd34697 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1517 microversion: 2.1 time: 0.577343 Jul 20 04:20:52.416651 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1285/2638] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:51 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1517 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:52.421587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-46aa97ca-ea7f-4ffa-924c-112730088a31 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:52.422356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-46aa97ca-ea7f-4ffa-924c-112730088a31 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:52.440636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46aa97ca-ea7f-4ffa-924c-112730088a31 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.441239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46aa97ca-ea7f-4ffa-924c-112730088a31 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.442188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46aa97ca-ea7f-4ffa-924c-112730088a31 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.442789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46aa97ca-ea7f-4ffa-924c-112730088a31 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.455375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ddd92591-1376-4a23-ab68-b9f030519de4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:52.497756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ddd92591-1376-4a23-ab68-b9f030519de4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:52.511737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ddd92591-1376-4a23-ab68-b9f030519de4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:52.513459 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ddd92591-1376-4a23-ab68-b9f030519de4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 1.903148 Jul 20 04:20:52.514714 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1354/2639] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:50 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:20:52.537009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d1bf3f1-bc8c-471e-aa75-a3e4bb7944e2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:52.544548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d1bf3f1-bc8c-471e-aa75-a3e4bb7944e2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:52.561293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d1bf3f1-bc8c-471e-aa75-a3e4bb7944e2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.561980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d1bf3f1-bc8c-471e-aa75-a3e4bb7944e2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.562935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d1bf3f1-bc8c-471e-aa75-a3e4bb7944e2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.567570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d1bf3f1-bc8c-471e-aa75-a3e4bb7944e2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.929484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-46aa97ca-ea7f-4ffa-924c-112730088a31 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid 57d80a59-9d6b-4b94-a643-8f6727f50511 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:20:53.951919 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-46aa97ca-ea7f-4ffa-924c-112730088a31 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 2424 microversion: 2.25 time: 1.533860 Jul 20 04:20:53.953021 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1286/2640] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:52 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 2424 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:53.957837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b720d2e6-1db2-48e9-b8f6-2a58acd10751 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:53.958645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b720d2e6-1db2-48e9-b8f6-2a58acd10751 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:53.965706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b720d2e6-1db2-48e9-b8f6-2a58acd10751 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.966379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b720d2e6-1db2-48e9-b8f6-2a58acd10751 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.967375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b720d2e6-1db2-48e9-b8f6-2a58acd10751 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.968046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b720d2e6-1db2-48e9-b8f6-2a58acd10751 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.057672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2d1bf3f1-bc8c-471e-aa75-a3e4bb7944e2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:54.090036 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d1bf3f1-bc8c-471e-aa75-a3e4bb7944e2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1315 microversion: 2.1 time: 1.573748 Jul 20 04:20:54.093594 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1355/2641] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:52 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1315 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:54.104986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1582c1c7-471f-4660-8bc4-f127c62e116f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:54.105940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1582c1c7-471f-4660-8bc4-f127c62e116f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:54.110293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b720d2e6-1db2-48e9-b8f6-2a58acd10751 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:54.120787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1582c1c7-471f-4660-8bc4-f127c62e116f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.121056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b720d2e6-1db2-48e9-b8f6-2a58acd10751 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:54.122630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b720d2e6-1db2-48e9-b8f6-2a58acd10751 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:54.124309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1582c1c7-471f-4660-8bc4-f127c62e116f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.126912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1582c1c7-471f-4660-8bc4-f127c62e116f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.128085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1582c1c7-471f-4660-8bc4-f127c62e116f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.134339 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b720d2e6-1db2-48e9-b8f6-2a58acd10751 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1592 microversion: 2.32 time: 0.169528 Jul 20 04:20:54.145310 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1287/2642] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:53 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1592 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:54.155864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aecb12a8-a030-4214-a118-f9edc3c6f454 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:54.156527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aecb12a8-a030-4214-a118-f9edc3c6f454 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:54.163655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aecb12a8-a030-4214-a118-f9edc3c6f454 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.164637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aecb12a8-a030-4214-a118-f9edc3c6f454 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.165407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aecb12a8-a030-4214-a118-f9edc3c6f454 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.165844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aecb12a8-a030-4214-a118-f9edc3c6f454 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.758266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1582c1c7-471f-4660-8bc4-f127c62e116f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:54.774266 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1582c1c7-471f-4660-8bc4-f127c62e116f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 200 len: 1517 microversion: 2.1 time: 0.676531 Jul 20 04:20:54.775704 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1356/2643] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:54 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 1517 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:54.782215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-886674298", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "4ad2afdf-6c87-4018-afaa-15ee9b13db44"}], "security_groups": [{"name": "tempest-securitygroup--346024357"}], "key_name": "tempest-keypair-1142217574", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:54.797650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=16 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:54.879948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aecb12a8-a030-4214-a118-f9edc3c6f454 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:54.915223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aecb12a8-a030-4214-a118-f9edc3c6f454 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:54.921203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aecb12a8-a030-4214-a118-f9edc3c6f454 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:54.922435 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aecb12a8-a030-4214-a118-f9edc3c6f454 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 0.779710 Jul 20 04:20:54.927146 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1288/2644] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:54 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:55.068757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] validate_networks() for [('4ad2afdf-6c87-4018-afaa-15ee9b13db44', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:20:55.479649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a53960e5-8d03-438e-ba7b-9bc68d897e5c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Action: 'create', calling method: .version_select at 0x7fbf9d401af0>, body: {"keypair": {"name": "tempest-keypair-1039209220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4t5TY/hnxanPIcRw86GptHZvul27vR3+Z6eJ6gJ3yWZKcphPGhdMiVul6Gk4c5T1USvqpWjcCtFKdSmtlZ/MyTky0gOlHXPmddjXXwQxkEq2j7rBsYL/rRxNRrDmg/Tw=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:55.514457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-a53960e5-8d03-438e-ba7b-9bc68d897e5c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Getting quotas for project dc6203ba93464a3fa1d3d43e5162719b. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:55.524894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-a53960e5-8d03-438e-ba7b-9bc68d897e5c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Getting quotas for user 539fabc30c7c4ece81c9092dc26fde22 and project dc6203ba93464a3fa1d3d43e5162719b. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:55.588780 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a53960e5-8d03-438e-ba7b-9bc68d897e5c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.660393 Jul 20 04:20:55.591736 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1289/2645] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:20:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:55.608423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fb064e27-4f3b-44d7-99f0-5aae3e44f15a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-764485-11", "block_migration": "auto"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:55.610063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fb064e27-4f3b-44d7-99f0-5aae3e44f15a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:55.626289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb064e27-4f3b-44d7-99f0-5aae3e44f15a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:55.627482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb064e27-4f3b-44d7-99f0-5aae3e44f15a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.629350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb064e27-4f3b-44d7-99f0-5aae3e44f15a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:55.629998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb064e27-4f3b-44d7-99f0-5aae3e44f15a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.669858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-fb064e27-4f3b-44d7-99f0-5aae3e44f15a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'flavor' on Instance uuid 57d80a59-9d6b-4b94-a643-8f6727f50511 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:20:55.695730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fb064e27-4f3b-44d7-99f0-5aae3e44f15a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Going to try to live migrate instance to n-h1-764485-11 {{(pid=119807) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:20:55.781910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:56.438338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:20:56.439303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:20:56.440019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:20:56.440617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:20:56.441886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:20:56.470075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.471336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.473773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.475162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.509422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Getting quotas for project cdc4b88912e5436caaa2ce17b7d972b0. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:56.516808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Getting quotas for user dc30eb948c9245ebab77d8306f408f1e and project cdc4b88912e5436caaa2ce17b7d972b0. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:56.534672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:20:56.538481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:20:56.642743 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4919daff-a126-4911-95c0-1362fec9dc37 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.865665 Jul 20 04:20:56.644023 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1357/2646] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:20:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:20:56.649292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ea52b305-949f-4b6d-9ea0-485f2423040b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:56.655353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ea52b305-949f-4b6d-9ea0-485f2423040b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:56.670239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea52b305-949f-4b6d-9ea0-485f2423040b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.670976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea52b305-949f-4b6d-9ea0-485f2423040b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.672100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea52b305-949f-4b6d-9ea0-485f2423040b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.672781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea52b305-949f-4b6d-9ea0-485f2423040b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.885549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ea52b305-949f-4b6d-9ea0-485f2423040b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:56.903373 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ea52b305-949f-4b6d-9ea0-485f2423040b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1315 microversion: 2.1 time: 0.257197 Jul 20 04:20:56.912648 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1358/2647] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:56 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:56.925122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a3871e42-6c3a-4631-bb99-e0a0d9ffc2d8 req-c705a19d-f8d6-4b58-9432-7ccad378e84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6", "name": "network-vif-deleted", "tag": "f03054f4-ef50-46f3-86ab-6137f2b51442"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:56.944572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a3871e42-6c3a-4631-bb99-e0a0d9ffc2d8 req-c705a19d-f8d6-4b58-9432-7ccad378e84e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.945080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a3871e42-6c3a-4631-bb99-e0a0d9ffc2d8 req-c705a19d-f8d6-4b58-9432-7ccad378e84e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.970868 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a3871e42-6c3a-4631-bb99-e0a0d9ffc2d8 req-c705a19d-f8d6-4b58-9432-7ccad378e84e service nova] Creating event network-vif-deleted:f03054f4-ef50-46f3-86ab-6137f2b51442 for instance 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 on n-h2-764485-11 Jul 20 04:20:56.985840 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a3871e42-6c3a-4631-bb99-e0a0d9ffc2d8 req-c705a19d-f8d6-4b58-9432-7ccad378e84e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069137 Jul 20 04:20:56.988119 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1359/2648] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:57.000243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8d303996-bedf-49e8-9b28-6243e2321263 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:57.000996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8d303996-bedf-49e8-9b28-6243e2321263 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:57.020085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d303996-bedf-49e8-9b28-6243e2321263 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.020780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d303996-bedf-49e8-9b28-6243e2321263 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.024092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d303996-bedf-49e8-9b28-6243e2321263 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.024782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d303996-bedf-49e8-9b28-6243e2321263 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.375752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8d303996-bedf-49e8-9b28-6243e2321263 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:57.393405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8d303996-bedf-49e8-9b28-6243e2321263 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:57.400267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8d303996-bedf-49e8-9b28-6243e2321263 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:57.402472 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8d303996-bedf-49e8-9b28-6243e2321263 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1660 microversion: 2.32 time: 0.411637 Jul 20 04:20:57.403099 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1360/2649] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:56 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1660 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:57.415256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bff726f4-6610-404b-8211-9ae1068027af tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:57.415928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bff726f4-6610-404b-8211-9ae1068027af tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:57.431985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bff726f4-6610-404b-8211-9ae1068027af tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.432479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bff726f4-6610-404b-8211-9ae1068027af tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.433291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bff726f4-6610-404b-8211-9ae1068027af tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.433741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bff726f4-6610-404b-8211-9ae1068027af tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.471634 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-bff726f4-6610-404b-8211-9ae1068027af tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] HTTP exception thrown: Instance 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 could not be found. Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bff726f4-6610-404b-8211-9ae1068027af tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Request method failure captured: Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 HTTP/1.1 Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14I0oCE733hctV7j477z51pBM-dKAyFwwERSU8KUDq037AOZ16zUM-0bHFgZZvyZ7AAQonXs56Py8sY9rYGQXQppF74z890F5twIdoD1LOHy0tI5-luWGkfVJ9k5pKEEtnZ4Ni4TGQxfC0lm1LN9MKeDlqL3ZtxqQ5XSmVVO4n0LVco Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: c1be6441272046629ac3840881e0148f Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ListServerFiltersTestJSON-560985529 Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c1be6441272046629ac3840881e0148f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c1be6441272046629ac3840881e0148f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c1be6441272046629ac3840881e0148f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c1be6441272046629ac3840881e0148f"}]}] Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ListServerFiltersTestJSON-560985529 Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: c1be6441272046629ac3840881e0148f Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-560985529 Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ListServerFiltersTestJSON-560985529-project Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 6294c9ac9cb34e9387ce8f109ac3d819 Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ListServerFiltersTestJSON-560985529-project Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 could not be found. Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6'} Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 could not be found. Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 could not be found. Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:57.473510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:57.477714 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:57.477714 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:57.477714 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:57.477714 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:57.477714 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:57.477714 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 could not be found. Jul 20 04:20:57.477714 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:20:57.477714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bff726f4-6610-404b-8211-9ae1068027af tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Returning 404 to user: Instance 8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:57.477714 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bff726f4-6610-404b-8211-9ae1068027af tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6" status: 404 len: 111 microversion: 2.1 time: 0.067398 Jul 20 04:20:57.482403 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1361/2650] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:57 2022] GET /compute/v2.1/servers/8e8c0a7d-18d5-4f3c-a709-09a2b8b5b9a6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:57.491246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b6d0dc5-55e1-4dd9-95bf-ec6d7ae008fb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:57.495816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b6d0dc5-55e1-4dd9-95bf-ec6d7ae008fb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:57.507284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b6d0dc5-55e1-4dd9-95bf-ec6d7ae008fb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.510687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b6d0dc5-55e1-4dd9-95bf-ec6d7ae008fb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.511600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b6d0dc5-55e1-4dd9-95bf-ec6d7ae008fb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.512061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b6d0dc5-55e1-4dd9-95bf-ec6d7ae008fb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.260721 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fb064e27-4f3b-44d7-99f0-5aae3e44f15a tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/action" status: 202 len: 0 microversion: 2.25 time: 2.666582 Jul 20 04:20:58.265100 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1290/2651] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:20:55 2022] POST /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/action => generated 0 bytes in 2672 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:58.364493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-9be5ea0e-b295-41cd-9fd4-6f04e0a326e1 req-6e76ba8c-5f2b-48c0-9ef5-8ed9e29329c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13179b6-ac74-46e9-8550-55de57c58e3e", "name": "network-vif-plugged", "status": "completed", "tag": "086a4d65-f359-47ab-8b1c-cbd929e01ff8"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:58.392457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9be5ea0e-b295-41cd-9fd4-6f04e0a326e1 req-6e76ba8c-5f2b-48c0-9ef5-8ed9e29329c9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.394147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9be5ea0e-b295-41cd-9fd4-6f04e0a326e1 req-6e76ba8c-5f2b-48c0-9ef5-8ed9e29329c9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.423281 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-9be5ea0e-b295-41cd-9fd4-6f04e0a326e1 req-6e76ba8c-5f2b-48c0-9ef5-8ed9e29329c9 service nova] Creating event network-vif-plugged:086a4d65-f359-47ab-8b1c-cbd929e01ff8 for instance a13179b6-ac74-46e9-8550-55de57c58e3e on n-h2-764485-11 Jul 20 04:20:58.432102 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-9be5ea0e-b295-41cd-9fd4-6f04e0a326e1 req-6e76ba8c-5f2b-48c0-9ef5-8ed9e29329c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165316 Jul 20 04:20:58.434313 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1291/2652] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:58.441601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-176c8545-c429-4add-b7ae-7cc9073e90b4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:58.442767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-176c8545-c429-4add-b7ae-7cc9073e90b4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:58.452235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-176c8545-c429-4add-b7ae-7cc9073e90b4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.455721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-176c8545-c429-4add-b7ae-7cc9073e90b4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.456196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-176c8545-c429-4add-b7ae-7cc9073e90b4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.456874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-176c8545-c429-4add-b7ae-7cc9073e90b4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.506003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b6d0dc5-55e1-4dd9-95bf-ec6d7ae008fb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:58.520806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b6d0dc5-55e1-4dd9-95bf-ec6d7ae008fb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:58.535498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b6d0dc5-55e1-4dd9-95bf-ec6d7ae008fb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:58.537021 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b6d0dc5-55e1-4dd9-95bf-ec6d7ae008fb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 1.053540 Jul 20 04:20:58.542694 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1362/2653] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:57 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:58.564693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bb1f5396-69b6-407e-be95-05fd77f4d66f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:58.567576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bb1f5396-69b6-407e-be95-05fd77f4d66f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 6131221c-3273-45e7-9458-8fedaa324b3d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:58.582956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb1f5396-69b6-407e-be95-05fd77f4d66f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.583724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb1f5396-69b6-407e-be95-05fd77f4d66f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.584687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb1f5396-69b6-407e-be95-05fd77f4d66f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.586969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb1f5396-69b6-407e-be95-05fd77f4d66f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.647830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bb1f5396-69b6-407e-be95-05fd77f4d66f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 6131221c-3273-45e7-9458-8fedaa324b3d] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:58.808145 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bb1f5396-69b6-407e-be95-05fd77f4d66f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d" status: 204 len: 0 microversion: 2.1 time: 0.263705 Jul 20 04:20:58.809787 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1363/2654] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:58 2022] DELETE /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:58.821951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-176c8545-c429-4add-b7ae-7cc9073e90b4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:58.823387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bc47af70-106a-401c-98e8-0c90ac128f50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:58.826570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bc47af70-106a-401c-98e8-0c90ac128f50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:58.834733 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-176c8545-c429-4add-b7ae-7cc9073e90b4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1293 microversion: 2.1 time: 0.398186 Jul 20 04:20:58.837547 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1292/2655] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:58 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1293 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:58.843098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc47af70-106a-401c-98e8-0c90ac128f50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.843583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc47af70-106a-401c-98e8-0c90ac128f50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.845922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc47af70-106a-401c-98e8-0c90ac128f50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.846521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc47af70-106a-401c-98e8-0c90ac128f50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.848993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cf1bc108-e872-4ef1-9155-e410a7b65aaa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:58.853330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cf1bc108-e872-4ef1-9155-e410a7b65aaa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:58.871577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf1bc108-e872-4ef1-9155-e410a7b65aaa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.872404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf1bc108-e872-4ef1-9155-e410a7b65aaa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.873454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf1bc108-e872-4ef1-9155-e410a7b65aaa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.875379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf1bc108-e872-4ef1-9155-e410a7b65aaa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:59.462220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf1bc108-e872-4ef1-9155-e410a7b65aaa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:59.473229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf1bc108-e872-4ef1-9155-e410a7b65aaa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:59.481675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf1bc108-e872-4ef1-9155-e410a7b65aaa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:59.485042 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cf1bc108-e872-4ef1-9155-e410a7b65aaa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.646262 Jul 20 04:20:59.503192 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1293/2656] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:58 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:59.509148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-90c2a8e3-7554-4de3-8a6b-3efb9952d745 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:59.513758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-90c2a8e3-7554-4de3-8a6b-3efb9952d745 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:59.527611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90c2a8e3-7554-4de3-8a6b-3efb9952d745 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.532223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90c2a8e3-7554-4de3-8a6b-3efb9952d745 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:59.533264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90c2a8e3-7554-4de3-8a6b-3efb9952d745 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.533991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90c2a8e3-7554-4de3-8a6b-3efb9952d745 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:59.723991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bc47af70-106a-401c-98e8-0c90ac128f50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:59.744089 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bc47af70-106a-401c-98e8-0c90ac128f50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1315 microversion: 2.1 time: 0.927754 Jul 20 04:20:59.745429 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1364/2657] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:58 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1315 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:59.756856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1a2fd5f2-ea31-40f7-b4d6-ab0830483f3f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:59.758334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1a2fd5f2-ea31-40f7-b4d6-ab0830483f3f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 6131221c-3273-45e7-9458-8fedaa324b3d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:59.776853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a2fd5f2-ea31-40f7-b4d6-ab0830483f3f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.782209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a2fd5f2-ea31-40f7-b4d6-ab0830483f3f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:59.783370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a2fd5f2-ea31-40f7-b4d6-ab0830483f3f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.784071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a2fd5f2-ea31-40f7-b4d6-ab0830483f3f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.572013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-90c2a8e3-7554-4de3-8a6b-3efb9952d745 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:00.583926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-90c2a8e3-7554-4de3-8a6b-3efb9952d745 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:00.587401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-90c2a8e3-7554-4de3-8a6b-3efb9952d745 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:00.588512 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-90c2a8e3-7554-4de3-8a6b-3efb9952d745 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1707 microversion: 2.32 time: 1.083941 Jul 20 04:21:00.589208 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1294/2658] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:59 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1707 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:00.594101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cfe514f3-633f-40be-8db0-ea5197db85df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:00.595225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cfe514f3-633f-40be-8db0-ea5197db85df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:00.602818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfe514f3-633f-40be-8db0-ea5197db85df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.603711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfe514f3-633f-40be-8db0-ea5197db85df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.604716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfe514f3-633f-40be-8db0-ea5197db85df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.605366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfe514f3-633f-40be-8db0-ea5197db85df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.730572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1a2fd5f2-ea31-40f7-b4d6-ab0830483f3f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:00.740976 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1a2fd5f2-ea31-40f7-b4d6-ab0830483f3f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d" status: 200 len: 1517 microversion: 2.1 time: 0.994410 Jul 20 04:21:00.741579 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1365/2659] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:59 2022] GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d => generated 1517 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:00.760660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e0eff97a-d038-40fd-b1b7-a3e6dbed6b92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:00.761302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e0eff97a-d038-40fd-b1b7-a3e6dbed6b92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:00.788669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0eff97a-d038-40fd-b1b7-a3e6dbed6b92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.789173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0eff97a-d038-40fd-b1b7-a3e6dbed6b92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.790027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0eff97a-d038-40fd-b1b7-a3e6dbed6b92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.790479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0eff97a-d038-40fd-b1b7-a3e6dbed6b92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.998869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e0eff97a-d038-40fd-b1b7-a3e6dbed6b92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:01.012713 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e0eff97a-d038-40fd-b1b7-a3e6dbed6b92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1299 microversion: 2.1 time: 0.261123 Jul 20 04:21:01.013998 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1366/2660] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:00 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1299 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:01.132464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e29548d-7092-4727-828d-e52cff1b4a7a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Action: 'create', calling method: .version_select at 0x7fbf9c7d4700>, body: {"keypair": {"name": "tempest-keypair-78993561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKv0xM6tFL+M0du+f8cKPNwivNVf/1aZMWp86Ec3TGtm8vtpGRyoDf2oCFvOC5hBDfnhUiy4PmSNhWXP8Qwa+/qU+gGquiPhYwsA3067x2kYoXx349rG1FP+ADz/kB/jNQ=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:01.148109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3e29548d-7092-4727-828d-e52cff1b4a7a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Getting quotas for project 8298da14cfd743539e6421d8f00a3366. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:01.154278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3e29548d-7092-4727-828d-e52cff1b4a7a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Getting quotas for user 3fd5e2533a994d0fb65c1ede341b7f84 and project 8298da14cfd743539e6421d8f00a3366. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:01.188435 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3e29548d-7092-4727-828d-e52cff1b4a7a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.173200 Jul 20 04:21:01.189473 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1367/2661] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:21:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:01.196535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-531f7390-f7c5-4096-b69f-9e76de9871a1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:01.197309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-531f7390-f7c5-4096-b69f-9e76de9871a1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:01.205785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-531f7390-f7c5-4096-b69f-9e76de9871a1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:01.208141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-531f7390-f7c5-4096-b69f-9e76de9871a1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:01.208985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-531f7390-f7c5-4096-b69f-9e76de9871a1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:01.209482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-531f7390-f7c5-4096-b69f-9e76de9871a1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:01.456917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cfe514f3-633f-40be-8db0-ea5197db85df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:01.466856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cfe514f3-633f-40be-8db0-ea5197db85df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:01.468813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cfe514f3-633f-40be-8db0-ea5197db85df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:01.471190 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cfe514f3-633f-40be-8db0-ea5197db85df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 0.880835 Jul 20 04:21:01.480911 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1295/2662] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:00 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:01.487842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6564592a-1752-45e8-a4f5-143c62dbda50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:01.488818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6564592a-1752-45e8-a4f5-143c62dbda50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:01.497857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-531f7390-f7c5-4096-b69f-9e76de9871a1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:01.513575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-531f7390-f7c5-4096-b69f-9e76de9871a1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:01.517890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6564592a-1752-45e8-a4f5-143c62dbda50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:01.518486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6564592a-1752-45e8-a4f5-143c62dbda50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:01.519107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-531f7390-f7c5-4096-b69f-9e76de9871a1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:01.520425 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-531f7390-f7c5-4096-b69f-9e76de9871a1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.329962 Jul 20 04:21:01.521200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6564592a-1752-45e8-a4f5-143c62dbda50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:01.521648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6564592a-1752-45e8-a4f5-143c62dbda50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:01.527603 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1368/2663] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:01 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:01.533083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1972230705", "imageRef": "299bfa68-eda0-4a6c-8b11-c743e57cebe7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "11a8eca0-dbc1-4abb-a987-0603dc41a769"}], "security_groups": [{"name": "tempest-securitygroup--493355303"}], "key_name": "tempest-keypair-1039209220", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:01.797208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] validate_networks() for [('11a8eca0-dbc1-4abb-a987-0603dc41a769', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:02.013785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6564592a-1752-45e8-a4f5-143c62dbda50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:02.029723 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6564592a-1752-45e8-a4f5-143c62dbda50 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1501 microversion: 2.1 time: 0.547045 Jul 20 04:21:02.030319 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1296/2664] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:01 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1501 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:02.043694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e06e99ec-b509-4cba-a68f-9a79cc1bb8f5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:02.044553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e06e99ec-b509-4cba-a68f-9a79cc1bb8f5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:02.059072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e06e99ec-b509-4cba-a68f-9a79cc1bb8f5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.059551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e06e99ec-b509-4cba-a68f-9a79cc1bb8f5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.060351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e06e99ec-b509-4cba-a68f-9a79cc1bb8f5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.061896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e06e99ec-b509-4cba-a68f-9a79cc1bb8f5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.796292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e06e99ec-b509-4cba-a68f-9a79cc1bb8f5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:02.811304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e06e99ec-b509-4cba-a68f-9a79cc1bb8f5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:02.812844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e06e99ec-b509-4cba-a68f-9a79cc1bb8f5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:02.814007 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e06e99ec-b509-4cba-a68f-9a79cc1bb8f5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1754 microversion: 2.32 time: 0.781406 Jul 20 04:21:02.820129 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1297/2665] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:02 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1754 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:02.830309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ab0a480e-e341-4c1f-9ac7-878f18bf495b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:02.834200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ab0a480e-e341-4c1f-9ac7-878f18bf495b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 6131221c-3273-45e7-9458-8fedaa324b3d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:02.852979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab0a480e-e341-4c1f-9ac7-878f18bf495b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.853425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab0a480e-e341-4c1f-9ac7-878f18bf495b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.854381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab0a480e-e341-4c1f-9ac7-878f18bf495b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.854971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab0a480e-e341-4c1f-9ac7-878f18bf495b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.220182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ab0a480e-e341-4c1f-9ac7-878f18bf495b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:03.236375 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ab0a480e-e341-4c1f-9ac7-878f18bf495b tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d" status: 200 len: 1475 microversion: 2.1 time: 0.413161 Jul 20 04:21:03.237289 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1298/2666] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:02 2022] GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d => generated 1475 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:03.247457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5cc46d5d-5a80-41a5-85a0-2775d3ca5b3b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:03.249713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5cc46d5d-5a80-41a5-85a0-2775d3ca5b3b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:03.272637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cc46d5d-5a80-41a5-85a0-2775d3ca5b3b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.273711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cc46d5d-5a80-41a5-85a0-2775d3ca5b3b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.274554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cc46d5d-5a80-41a5-85a0-2775d3ca5b3b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.275057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cc46d5d-5a80-41a5-85a0-2775d3ca5b3b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.945448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5cc46d5d-5a80-41a5-85a0-2775d3ca5b3b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:03.972179 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5cc46d5d-5a80-41a5-85a0-2775d3ca5b3b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1366 microversion: 2.1 time: 0.733793 Jul 20 04:21:03.982556 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1299/2667] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:03 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1366 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:03.987940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f15d2f5c-4034-4239-a8f3-38d58d2f6579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:03.990888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f15d2f5c-4034-4239-a8f3-38d58d2f6579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:04.007300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f15d2f5c-4034-4239-a8f3-38d58d2f6579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.008799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f15d2f5c-4034-4239-a8f3-38d58d2f6579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.009852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f15d2f5c-4034-4239-a8f3-38d58d2f6579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.010518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f15d2f5c-4034-4239-a8f3-38d58d2f6579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.018933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:04.020110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:04.020771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:04.021366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:04.022044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:04.042445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.044103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.046144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.049328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.063693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-f15d2f5c-4034-4239-a8f3-38d58d2f6579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lazy-loading 'flavor' on Instance uuid a13179b6-ac74-46e9-8550-55de57c58e3e {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:21:04.114964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Getting quotas for project dc6203ba93464a3fa1d3d43e5162719b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:04.131278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Getting quotas for user 539fabc30c7c4ece81c9092dc26fde22 and project dc6203ba93464a3fa1d3d43e5162719b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:04.192298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:04.201222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='299bfa68-eda0-4a6c-8b11-c743e57cebe7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:04.203174 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f15d2f5c-4034-4239-a8f3-38d58d2f6579 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "POST /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e/action" status: 202 len: 0 microversion: 2.1 time: 0.218852 Jul 20 04:21:04.204584 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1300/2668] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:03 2022] POST /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:04.211703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b295ad9-0259-4dbc-9fc8-52952754c7c0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:04.216357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7b295ad9-0259-4dbc-9fc8-52952754c7c0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:04.230885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b295ad9-0259-4dbc-9fc8-52952754c7c0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.231495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b295ad9-0259-4dbc-9fc8-52952754c7c0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.233893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b295ad9-0259-4dbc-9fc8-52952754c7c0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.234921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b295ad9-0259-4dbc-9fc8-52952754c7c0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.372643 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d91c0e2b-bd81-403c-8714-cd1411e430f3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.845233 Jul 20 04:21:04.379910 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1369/2669] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 2853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:04.411953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e03a13a7-d322-4e97-845a-930909753618 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:04.413081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e03a13a7-d322-4e97-845a-930909753618 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:04.437007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e03a13a7-d322-4e97-845a-930909753618 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.437553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e03a13a7-d322-4e97-845a-930909753618 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.438248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e03a13a7-d322-4e97-845a-930909753618 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.438692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e03a13a7-d322-4e97-845a-930909753618 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.450770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:05.553803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:05.681737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7b295ad9-0259-4dbc-9fc8-52952754c7c0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:05.691217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e03a13a7-d322-4e97-845a-930909753618 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:05.705498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e03a13a7-d322-4e97-845a-930909753618 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:05.707923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7b295ad9-0259-4dbc-9fc8-52952754c7c0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:05.713736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e03a13a7-d322-4e97-845a-930909753618 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:05.715239 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e03a13a7-d322-4e97-845a-930909753618 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 1.334251 Jul 20 04:21:05.717651 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1370/2670] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:04 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:05.725426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7b295ad9-0259-4dbc-9fc8-52952754c7c0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:05.727875 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7b295ad9-0259-4dbc-9fc8-52952754c7c0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 1.521715 Jul 20 04:21:05.749999 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1301/2671] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:04 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:05.762408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-809e5b52-8cdf-4496-80ed-433a5b79b3e9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:05.764871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-809e5b52-8cdf-4496-80ed-433a5b79b3e9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:05.779267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-809e5b52-8cdf-4496-80ed-433a5b79b3e9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.782478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-809e5b52-8cdf-4496-80ed-433a5b79b3e9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.784301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-809e5b52-8cdf-4496-80ed-433a5b79b3e9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.784917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-809e5b52-8cdf-4496-80ed-433a5b79b3e9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.871634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-315de7ef-126e-4fc2-8468-2b7c441c6f13 req-2c80ea0f-ecd1-47d4-9fe1-95a924696f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6131221c-3273-45e7-9458-8fedaa324b3d", "name": "network-vif-deleted", "tag": "3f966a3d-4e22-44cb-9eca-42c02abaefef"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:05.875203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:05.906859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-315de7ef-126e-4fc2-8468-2b7c441c6f13 req-2c80ea0f-ecd1-47d4-9fe1-95a924696f69 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.909661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-315de7ef-126e-4fc2-8468-2b7c441c6f13 req-2c80ea0f-ecd1-47d4-9fe1-95a924696f69 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.951662 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-315de7ef-126e-4fc2-8468-2b7c441c6f13 req-2c80ea0f-ecd1-47d4-9fe1-95a924696f69 service nova] Creating event network-vif-deleted:3f966a3d-4e22-44cb-9eca-42c02abaefef for instance 6131221c-3273-45e7-9458-8fedaa324b3d on n-h1-764485-11 Jul 20 04:21:05.966340 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-315de7ef-126e-4fc2-8468-2b7c441c6f13 req-2c80ea0f-ecd1-47d4-9fe1-95a924696f69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244596 Jul 20 04:21:05.968170 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1371/2672] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:06.000327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1fb366dd-5af1-4179-8848-713282308f95 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:06.001489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1fb366dd-5af1-4179-8848-713282308f95 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:06.026248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fb366dd-5af1-4179-8848-713282308f95 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.026762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fb366dd-5af1-4179-8848-713282308f95 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.030424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fb366dd-5af1-4179-8848-713282308f95 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.030899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fb366dd-5af1-4179-8848-713282308f95 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.854116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-809e5b52-8cdf-4496-80ed-433a5b79b3e9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:06.873207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-809e5b52-8cdf-4496-80ed-433a5b79b3e9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:06.874452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-809e5b52-8cdf-4496-80ed-433a5b79b3e9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:06.886037 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-809e5b52-8cdf-4496-80ed-433a5b79b3e9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1754 microversion: 2.32 time: 1.133806 Jul 20 04:21:06.886841 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1302/2673] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:05 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1754 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:06.891272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1fb366dd-5af1-4179-8848-713282308f95 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:06.901164 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1fb366dd-5af1-4179-8848-713282308f95 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1492 microversion: 2.1 time: 0.931442 Jul 20 04:21:06.910246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a1c64fa-ce94-4352-a435-9031370300ac tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:06.911937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7a1c64fa-ce94-4352-a435-9031370300ac tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 6131221c-3273-45e7-9458-8fedaa324b3d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:06.920923 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1372/2674] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:05 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1492 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:06.931837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a1c64fa-ce94-4352-a435-9031370300ac tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.932296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a1c64fa-ce94-4352-a435-9031370300ac tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.933096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a1c64fa-ce94-4352-a435-9031370300ac tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.933535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a1c64fa-ce94-4352-a435-9031370300ac tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.933763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91b7d1f7-4e0a-4314-bd04-626a743aa28e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:06.934537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91b7d1f7-4e0a-4314-bd04-626a743aa28e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:06.956590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91b7d1f7-4e0a-4314-bd04-626a743aa28e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.963592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91b7d1f7-4e0a-4314-bd04-626a743aa28e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.964803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91b7d1f7-4e0a-4314-bd04-626a743aa28e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.965504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91b7d1f7-4e0a-4314-bd04-626a743aa28e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.998446 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-7a1c64fa-ce94-4352-a435-9031370300ac tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] HTTP exception thrown: Instance 6131221c-3273-45e7-9458-8fedaa324b3d could not be found. Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a1c64fa-ce94-4352-a435-9031370300ac tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Request method failure captured: Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d HTTP/1.1 Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14I0oCE733hctV7j477z51pBM-dKAyFwwERSU8KUDq037AOZ16zUM-0bHFgZZvyZ7AAQonXs56Py8sY9rYGQXQppF74z890F5twIdoD1LOHy0tI5-luWGkfVJ9k5pKEEtnZ4Ni4TGQxfC0lm1LN9MKeDlqL3ZtxqQ5XSmVVO4n0LVco Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: c1be6441272046629ac3840881e0148f Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ListServerFiltersTestJSON-560985529 Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c1be6441272046629ac3840881e0148f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c1be6441272046629ac3840881e0148f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c1be6441272046629ac3840881e0148f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c1be6441272046629ac3840881e0148f"}]}] Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ListServerFiltersTestJSON-560985529 Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: c1be6441272046629ac3840881e0148f Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-560985529 Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ListServerFiltersTestJSON-560985529-project Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 6294c9ac9cb34e9387ce8f109ac3d819 Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ListServerFiltersTestJSON-560985529-project Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 6131221c-3273-45e7-9458-8fedaa324b3d could not be found. Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '6131221c-3273-45e7-9458-8fedaa324b3d'} Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6131221c-3273-45e7-9458-8fedaa324b3d could not be found. Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6131221c-3273-45e7-9458-8fedaa324b3d could not be found. Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:07.004638 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:07.009348 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:07.009348 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:07.009348 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:07.009348 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:07.009348 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:07.009348 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6131221c-3273-45e7-9458-8fedaa324b3d could not be found. Jul 20 04:21:07.009348 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:07.009348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a1c64fa-ce94-4352-a435-9031370300ac tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Returning 404 to user: Instance 6131221c-3273-45e7-9458-8fedaa324b3d could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:07.013385 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7a1c64fa-ce94-4352-a435-9031370300ac tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d" status: 404 len: 111 microversion: 2.1 time: 0.116994 Jul 20 04:21:07.014048 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1303/2675] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:06 2022] GET /compute/v2.1/servers/6131221c-3273-45e7-9458-8fedaa324b3d => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:07.033444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f197e725-cd3d-4f95-afce-ea5549b82ea9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:07.035895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f197e725-cd3d-4f95-afce-ea5549b82ea9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:07.052637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f197e725-cd3d-4f95-afce-ea5549b82ea9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.057161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f197e725-cd3d-4f95-afce-ea5549b82ea9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.058063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f197e725-cd3d-4f95-afce-ea5549b82ea9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.058468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f197e725-cd3d-4f95-afce-ea5549b82ea9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.102407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91b7d1f7-4e0a-4314-bd04-626a743aa28e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:07.121191 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91b7d1f7-4e0a-4314-bd04-626a743aa28e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1304 microversion: 2.1 time: 0.195676 Jul 20 04:21:07.125618 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1373/2676] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:06 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1304 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:07.142177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a670cc2a-a770-4efb-bad7-dd70a5d7e3b0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:07.142951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a670cc2a-a770-4efb-bad7-dd70a5d7e3b0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:07.161534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a670cc2a-a770-4efb-bad7-dd70a5d7e3b0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.164787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a670cc2a-a770-4efb-bad7-dd70a5d7e3b0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.166103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a670cc2a-a770-4efb-bad7-dd70a5d7e3b0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.167768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a670cc2a-a770-4efb-bad7-dd70a5d7e3b0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.620065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f197e725-cd3d-4f95-afce-ea5549b82ea9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:07.642797 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f197e725-cd3d-4f95-afce-ea5549b82ea9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1366 microversion: 2.1 time: 0.627412 Jul 20 04:21:07.655661 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1304/2677] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:07 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1366 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:07.670403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-948804c9-7c6b-4d46-b6ee-a6e72e1db59a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:07.673884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-948804c9-7c6b-4d46-b6ee-a6e72e1db59a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:07.697758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-948804c9-7c6b-4d46-b6ee-a6e72e1db59a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.698592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-948804c9-7c6b-4d46-b6ee-a6e72e1db59a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.701657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-948804c9-7c6b-4d46-b6ee-a6e72e1db59a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.703252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-948804c9-7c6b-4d46-b6ee-a6e72e1db59a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.427676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a670cc2a-a770-4efb-bad7-dd70a5d7e3b0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:08.442142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a670cc2a-a770-4efb-bad7-dd70a5d7e3b0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:08.453426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a670cc2a-a770-4efb-bad7-dd70a5d7e3b0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:08.455244 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a670cc2a-a770-4efb-bad7-dd70a5d7e3b0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 1.325203 Jul 20 04:21:08.469227 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1374/2678] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:07 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:08.478879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6648f9cf-65ad-480e-9f9d-3285c314150d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:08.490022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6648f9cf-65ad-480e-9f9d-3285c314150d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:08.506641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6648f9cf-65ad-480e-9f9d-3285c314150d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.510863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6648f9cf-65ad-480e-9f9d-3285c314150d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.512246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6648f9cf-65ad-480e-9f9d-3285c314150d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.516237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6648f9cf-65ad-480e-9f9d-3285c314150d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.588413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6648f9cf-65ad-480e-9f9d-3285c314150d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:08.812093 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6648f9cf-65ad-480e-9f9d-3285c314150d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 204 len: 0 microversion: 2.1 time: 0.337201 Jul 20 04:21:08.817549 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1375/2679] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:08 2022] DELETE /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:08.829166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6aa36f8b-7811-45e2-bab9-d9c8fbc8fdaf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:08.832416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6aa36f8b-7811-45e2-bab9-d9c8fbc8fdaf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:08.849076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6aa36f8b-7811-45e2-bab9-d9c8fbc8fdaf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.852161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6aa36f8b-7811-45e2-bab9-d9c8fbc8fdaf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.853467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6aa36f8b-7811-45e2-bab9-d9c8fbc8fdaf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.854192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6aa36f8b-7811-45e2-bab9-d9c8fbc8fdaf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.920204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6aa36f8b-7811-45e2-bab9-d9c8fbc8fdaf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:09.153528 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6aa36f8b-7811-45e2-bab9-d9c8fbc8fdaf tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "DELETE /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 204 len: 0 microversion: 2.1 time: 0.332823 Jul 20 04:21:09.154397 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1376/2680] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:08 2022] DELETE /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:09.171592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a82fe6f7-a41e-424a-9c38-e8ac6a12b055 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:09.172580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a82fe6f7-a41e-424a-9c38-e8ac6a12b055 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:09.190908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a82fe6f7-a41e-424a-9c38-e8ac6a12b055 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.196785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a82fe6f7-a41e-424a-9c38-e8ac6a12b055 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.197827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a82fe6f7-a41e-424a-9c38-e8ac6a12b055 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.198428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a82fe6f7-a41e-424a-9c38-e8ac6a12b055 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.440742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-948804c9-7c6b-4d46-b6ee-a6e72e1db59a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:09.445842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:09.465994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-948804c9-7c6b-4d46-b6ee-a6e72e1db59a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:09.470486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-948804c9-7c6b-4d46-b6ee-a6e72e1db59a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:09.474205 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-948804c9-7c6b-4d46-b6ee-a6e72e1db59a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 1.813587 Jul 20 04:21:09.475357 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1305/2681] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:07 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:09.480964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c45d9322-d952-4f0c-aeed-f32b93719a81 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:09.481808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c45d9322-d952-4f0c-aeed-f32b93719a81 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:09.488989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c45d9322-d952-4f0c-aeed-f32b93719a81 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.489718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c45d9322-d952-4f0c-aeed-f32b93719a81 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.493740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c45d9322-d952-4f0c-aeed-f32b93719a81 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.503914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c45d9322-d952-4f0c-aeed-f32b93719a81 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.759187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a82fe6f7-a41e-424a-9c38-e8ac6a12b055 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:09.785855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a82fe6f7-a41e-424a-9c38-e8ac6a12b055 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:09.787823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a82fe6f7-a41e-424a-9c38-e8ac6a12b055 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:09.790112 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a82fe6f7-a41e-424a-9c38-e8ac6a12b055 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1848 microversion: 2.32 time: 0.631952 Jul 20 04:21:09.791797 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1377/2682] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:09 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1848 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:09.801521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c4b76890-761b-44ba-b72f-be3cd393455c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:09.806235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c4b76890-761b-44ba-b72f-be3cd393455c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:09.821605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b76890-761b-44ba-b72f-be3cd393455c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.828953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c45d9322-d952-4f0c-aeed-f32b93719a81 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:09.836093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b76890-761b-44ba-b72f-be3cd393455c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.840268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b76890-761b-44ba-b72f-be3cd393455c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.841085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b76890-761b-44ba-b72f-be3cd393455c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.842107 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c45d9322-d952-4f0c-aeed-f32b93719a81 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1371 microversion: 2.1 time: 0.365206 Jul 20 04:21:09.845037 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1306/2683] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:09 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:09.859885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a23aa8d1-86f1-40e2-beb0-161e61e556b6 req-7221c425-fbd8-4e26-83a7-ec6a5fb62e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5c32a2-e4d5-42ae-97c8-68123a555ec9", "tag": "b176f969-0f6e-4a2e-bc2b-d85011718eae"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:09.887542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a23aa8d1-86f1-40e2-beb0-161e61e556b6 req-7221c425-fbd8-4e26-83a7-ec6a5fb62e33 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.888376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a23aa8d1-86f1-40e2-beb0-161e61e556b6 req-7221c425-fbd8-4e26-83a7-ec6a5fb62e33 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.914056 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a23aa8d1-86f1-40e2-beb0-161e61e556b6 req-7221c425-fbd8-4e26-83a7-ec6a5fb62e33 service nova] Creating event network-changed:b176f969-0f6e-4a2e-bc2b-d85011718eae for instance dd5c32a2-e4d5-42ae-97c8-68123a555ec9 on n-h2-764485-11 Jul 20 04:21:09.926958 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a23aa8d1-86f1-40e2-beb0-161e61e556b6 req-7221c425-fbd8-4e26-83a7-ec6a5fb62e33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079107 Jul 20 04:21:09.928493 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1307/2684] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:09.936215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3758fee6-1833-4dd9-bc8b-18cf346a158d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:09.938797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3758fee6-1833-4dd9-bc8b-18cf346a158d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:09.948347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3758fee6-1833-4dd9-bc8b-18cf346a158d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.949117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3758fee6-1833-4dd9-bc8b-18cf346a158d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.950276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3758fee6-1833-4dd9-bc8b-18cf346a158d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.950972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3758fee6-1833-4dd9-bc8b-18cf346a158d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.333173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c4b76890-761b-44ba-b72f-be3cd393455c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:10.343024 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c4b76890-761b-44ba-b72f-be3cd393455c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1366 microversion: 2.1 time: 0.549761 Jul 20 04:21:10.354012 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1378/2685] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:09 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1366 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:10.359158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a1a6b431-71de-4617-a05d-19b187caedff tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:10.360123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a1a6b431-71de-4617-a05d-19b187caedff tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:10.363605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3758fee6-1833-4dd9-bc8b-18cf346a158d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:10.368570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1a6b431-71de-4617-a05d-19b187caedff tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.369101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1a6b431-71de-4617-a05d-19b187caedff tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.369967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1a6b431-71de-4617-a05d-19b187caedff tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.370504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1a6b431-71de-4617-a05d-19b187caedff tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.373228 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3758fee6-1833-4dd9-bc8b-18cf346a158d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1498 microversion: 2.1 time: 0.443228 Jul 20 04:21:10.374568 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1308/2686] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:09 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1498 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:10.379133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd3a7adc-9040-4e63-befb-fcef030b0e54 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:10.380355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cd3a7adc-9040-4e63-befb-fcef030b0e54 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:10.389823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd3a7adc-9040-4e63-befb-fcef030b0e54 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.390637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd3a7adc-9040-4e63-befb-fcef030b0e54 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.391634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd3a7adc-9040-4e63-befb-fcef030b0e54 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.392249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd3a7adc-9040-4e63-befb-fcef030b0e54 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.045606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a1a6b431-71de-4617-a05d-19b187caedff tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.062720 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a1a6b431-71de-4617-a05d-19b187caedff tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1518 microversion: 2.1 time: 0.707204 Jul 20 04:21:11.063428 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1379/2687] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:10 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1518 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:11.067971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-37b3a42a-dfca-401a-ad7c-c8ea914b9868 req-a2c0b71d-cb65-485f-a8bb-6856a87ca3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70e7012-a311-486b-9035-cb4ccdd2afde", "tag": "e163d8ed-10b5-4120-bc98-b65fc837fe7f"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:11.095545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-37b3a42a-dfca-401a-ad7c-c8ea914b9868 req-a2c0b71d-cb65-485f-a8bb-6856a87ca3ba service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.098216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-37b3a42a-dfca-401a-ad7c-c8ea914b9868 req-a2c0b71d-cb65-485f-a8bb-6856a87ca3ba service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.134778 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-37b3a42a-dfca-401a-ad7c-c8ea914b9868 req-a2c0b71d-cb65-485f-a8bb-6856a87ca3ba service nova] Creating event network-changed:e163d8ed-10b5-4120-bc98-b65fc837fe7f for instance a70e7012-a311-486b-9035-cb4ccdd2afde on n-h1-764485-11 Jul 20 04:21:11.153749 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-37b3a42a-dfca-401a-ad7c-c8ea914b9868 req-a2c0b71d-cb65-485f-a8bb-6856a87ca3ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088749 Jul 20 04:21:11.155231 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1380/2688] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:11.163204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b6849669-a197-432a-9b7c-ed22b8c00ae8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:11.164854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b6849669-a197-432a-9b7c-ed22b8c00ae8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:11.176566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6849669-a197-432a-9b7c-ed22b8c00ae8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.180460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6849669-a197-432a-9b7c-ed22b8c00ae8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.181853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6849669-a197-432a-9b7c-ed22b8c00ae8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.182584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6849669-a197-432a-9b7c-ed22b8c00ae8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.246301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cd3a7adc-9040-4e63-befb-fcef030b0e54 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.256420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cd3a7adc-9040-4e63-befb-fcef030b0e54 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.264487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cd3a7adc-9040-4e63-befb-fcef030b0e54 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.266842 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd3a7adc-9040-4e63-befb-fcef030b0e54 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.890626 Jul 20 04:21:11.268194 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1309/2689] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:10 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:11.274236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3b6dfe1e-6bb3-4ead-83d3-167642efb051 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:11.278621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3b6dfe1e-6bb3-4ead-83d3-167642efb051 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:11.290516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b6dfe1e-6bb3-4ead-83d3-167642efb051 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.291603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b6dfe1e-6bb3-4ead-83d3-167642efb051 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.292603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b6dfe1e-6bb3-4ead-83d3-167642efb051 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.293203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b6dfe1e-6bb3-4ead-83d3-167642efb051 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.751674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b6849669-a197-432a-9b7c-ed22b8c00ae8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.762230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b6849669-a197-432a-9b7c-ed22b8c00ae8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.767728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b6849669-a197-432a-9b7c-ed22b8c00ae8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.768940 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b6849669-a197-432a-9b7c-ed22b8c00ae8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 0.612344 Jul 20 04:21:11.769831 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1381/2690] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:11 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:11.784777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2c490239-40a1-4e98-a06e-ea475734b4b6 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:11.785805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2c490239-40a1-4e98-a06e-ea475734b4b6 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:11.813904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c490239-40a1-4e98-a06e-ea475734b4b6 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.814813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c490239-40a1-4e98-a06e-ea475734b4b6 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.816081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c490239-40a1-4e98-a06e-ea475734b4b6 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.816709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c490239-40a1-4e98-a06e-ea475734b4b6 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.115345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3b6dfe1e-6bb3-4ead-83d3-167642efb051 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:12.142295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3b6dfe1e-6bb3-4ead-83d3-167642efb051 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:12.144046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3b6dfe1e-6bb3-4ead-83d3-167642efb051 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:12.145276 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3b6dfe1e-6bb3-4ead-83d3-167642efb051 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1848 microversion: 2.32 time: 0.875710 Jul 20 04:21:12.158854 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1310/2691] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:11 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1848 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:12.195229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4effbc7d-28bd-487b-b947-8a2bbd4283df tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:12.199192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4effbc7d-28bd-487b-b947-8a2bbd4283df tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:12.215220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4effbc7d-28bd-487b-b947-8a2bbd4283df tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.216111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4effbc7d-28bd-487b-b947-8a2bbd4283df tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.225688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4effbc7d-28bd-487b-b947-8a2bbd4283df tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.226735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4effbc7d-28bd-487b-b947-8a2bbd4283df tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.388514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c490239-40a1-4e98-a06e-ea475734b4b6 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:12.415660 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2c490239-40a1-4e98-a06e-ea475734b4b6 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1371 microversion: 2.1 time: 0.638889 Jul 20 04:21:12.416655 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1382/2692] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:11 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1371 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:12.428151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b71f05ad-2cc2-4773-bafa-81cb3797b15c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:12.428774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b71f05ad-2cc2-4773-bafa-81cb3797b15c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:12.437004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b71f05ad-2cc2-4773-bafa-81cb3797b15c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.437780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b71f05ad-2cc2-4773-bafa-81cb3797b15c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.438784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b71f05ad-2cc2-4773-bafa-81cb3797b15c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.439443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b71f05ad-2cc2-4773-bafa-81cb3797b15c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.556216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b71f05ad-2cc2-4773-bafa-81cb3797b15c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793c626644204dc3a08ed9118c9aaf4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43883ce179414508a380b92446797091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:12.559468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4effbc7d-28bd-487b-b947-8a2bbd4283df tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:12.565960 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b71f05ad-2cc2-4773-bafa-81cb3797b15c tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 200 len: 1456 microversion: 2.1 time: 0.148216 Jul 20 04:21:12.568684 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4effbc7d-28bd-487b-b947-8a2bbd4283df tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1366 microversion: 2.1 time: 0.384926 Jul 20 04:21:12.571691 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1311/2693] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:12 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:12.572761 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1383/2694] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:12 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 1456 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:12.581135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f0024e3c-d5f4-4c1a-90bd-177a0ce342b6 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:12.582778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a5bd7d9b-e6c6-4305-8e75-a2a3f777bdf2 req-0c9a71de-5cce-4609-9910-1790f5b1af46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13179b6-ac74-46e9-8550-55de57c58e3e", "name": "network-vif-deleted", "tag": "086a4d65-f359-47ab-8b1c-cbd929e01ff8"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:12.583834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f0024e3c-d5f4-4c1a-90bd-177a0ce342b6 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:12.601726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0024e3c-d5f4-4c1a-90bd-177a0ce342b6 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.603040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a5bd7d9b-e6c6-4305-8e75-a2a3f777bdf2 req-0c9a71de-5cce-4609-9910-1790f5b1af46 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.603711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a5bd7d9b-e6c6-4305-8e75-a2a3f777bdf2 req-0c9a71de-5cce-4609-9910-1790f5b1af46 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.608114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0024e3c-d5f4-4c1a-90bd-177a0ce342b6 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.609012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0024e3c-d5f4-4c1a-90bd-177a0ce342b6 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.609467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0024e3c-d5f4-4c1a-90bd-177a0ce342b6 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.637185 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a5bd7d9b-e6c6-4305-8e75-a2a3f777bdf2 req-0c9a71de-5cce-4609-9910-1790f5b1af46 service nova] Creating event network-vif-deleted:086a4d65-f359-47ab-8b1c-cbd929e01ff8 for instance a13179b6-ac74-46e9-8550-55de57c58e3e on n-h2-764485-11 Jul 20 04:21:12.652992 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a5bd7d9b-e6c6-4305-8e75-a2a3f777bdf2 req-0c9a71de-5cce-4609-9910-1790f5b1af46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078743 Jul 20 04:21:12.654470 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1384/2695] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:12.676277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b1cec568-bc9c-43e3-9120-57da3daab010 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:12.677005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b1cec568-bc9c-43e3-9120-57da3daab010 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:12.688737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1cec568-bc9c-43e3-9120-57da3daab010 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.689196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1cec568-bc9c-43e3-9120-57da3daab010 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.689955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1cec568-bc9c-43e3-9120-57da3daab010 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.690383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1cec568-bc9c-43e3-9120-57da3daab010 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.729639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:12.894353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f0024e3c-d5f4-4c1a-90bd-177a0ce342b6 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:12.907279 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f0024e3c-d5f4-4c1a-90bd-177a0ce342b6 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1518 microversion: 2.1 time: 0.328810 Jul 20 04:21:12.916733 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1312/2696] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:12 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1518 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:12.916733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-696f7d5a-0bd8-43ac-a697-bc09fa09abbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:12.917129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-696f7d5a-0bd8-43ac-a697-bc09fa09abbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:12.938674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-696f7d5a-0bd8-43ac-a697-bc09fa09abbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.939136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-696f7d5a-0bd8-43ac-a697-bc09fa09abbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.939953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-696f7d5a-0bd8-43ac-a697-bc09fa09abbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.940399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-696f7d5a-0bd8-43ac-a697-bc09fa09abbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.400870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-696f7d5a-0bd8-43ac-a697-bc09fa09abbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:13.436623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-696f7d5a-0bd8-43ac-a697-bc09fa09abbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:13.446645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-696f7d5a-0bd8-43ac-a697-bc09fa09abbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:13.447295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b1cec568-bc9c-43e3-9120-57da3daab010 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:13.448342 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-696f7d5a-0bd8-43ac-a697-bc09fa09abbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 0.538975 Jul 20 04:21:13.449526 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1313/2697] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:12 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:13.455626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-899cd9ce-3778-4b60-b0a2-91711c112bd3 req-c968aaef-15db-478c-81cb-f899ef512cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-plugged", "status": "completed", "tag": "3298e9a7-b585-427c-b1d4-5645fbc2414d"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:13.477300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-899cd9ce-3778-4b60-b0a2-91711c112bd3 req-c968aaef-15db-478c-81cb-f899ef512cdc service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.477881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-899cd9ce-3778-4b60-b0a2-91711c112bd3 req-c968aaef-15db-478c-81cb-f899ef512cdc service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.492554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b1cec568-bc9c-43e3-9120-57da3daab010 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:13.494730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b1cec568-bc9c-43e3-9120-57da3daab010 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:13.495993 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b1cec568-bc9c-43e3-9120-57da3daab010 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.840009 Jul 20 04:21:13.496480 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-899cd9ce-3778-4b60-b0a2-91711c112bd3 req-c968aaef-15db-478c-81cb-f899ef512cdc service nova] Creating event network-vif-plugged:3298e9a7-b585-427c-b1d4-5645fbc2414d for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:21:13.503977 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1385/2698] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:12 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:13.509632 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-899cd9ce-3778-4b60-b0a2-91711c112bd3 req-c968aaef-15db-478c-81cb-f899ef512cdc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058745 Jul 20 04:21:13.510663 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1314/2699] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:13.511229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-319f7948-18a3-4f6c-8336-7df442f3acec tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:13.521407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-27fb09ec-241b-4656-a63d-16e4f02a0d62 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:13.523120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-27fb09ec-241b-4656-a63d-16e4f02a0d62 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:13.524858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-319f7948-18a3-4f6c-8336-7df442f3acec tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:13.530923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27fb09ec-241b-4656-a63d-16e4f02a0d62 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.531535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27fb09ec-241b-4656-a63d-16e4f02a0d62 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.536569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-319f7948-18a3-4f6c-8336-7df442f3acec tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.537026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-319f7948-18a3-4f6c-8336-7df442f3acec tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.537818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-319f7948-18a3-4f6c-8336-7df442f3acec tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.542726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27fb09ec-241b-4656-a63d-16e4f02a0d62 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.543209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27fb09ec-241b-4656-a63d-16e4f02a0d62 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.551157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-319f7948-18a3-4f6c-8336-7df442f3acec tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.077348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:14.134864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-319f7948-18a3-4f6c-8336-7df442f3acec tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.141722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-27fb09ec-241b-4656-a63d-16e4f02a0d62 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.154802 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-27fb09ec-241b-4656-a63d-16e4f02a0d62 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1371 microversion: 2.1 time: 0.642498 Jul 20 04:21:14.155798 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1315/2700] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:13 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1371 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:14.159692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-319f7948-18a3-4f6c-8336-7df442f3acec tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.163374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c98889b4-f90b-4194-9d66-59f9bdbc5c0a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.165232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c98889b4-f90b-4194-9d66-59f9bdbc5c0a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.165673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-319f7948-18a3-4f6c-8336-7df442f3acec tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.166896 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-319f7948-18a3-4f6c-8336-7df442f3acec tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1848 microversion: 2.32 time: 0.661844 Jul 20 04:21:14.167483 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1386/2701] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:13 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1848 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:14.177323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-34e09fbc-88f8-4845-a26b-46d31f472175 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.177950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-34e09fbc-88f8-4845-a26b-46d31f472175 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.184469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c98889b4-f90b-4194-9d66-59f9bdbc5c0a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.184670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=22 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:14.186828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34e09fbc-88f8-4845-a26b-46d31f472175 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.187474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34e09fbc-88f8-4845-a26b-46d31f472175 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.187964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c98889b4-f90b-4194-9d66-59f9bdbc5c0a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.189045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c98889b4-f90b-4194-9d66-59f9bdbc5c0a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.191264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c98889b4-f90b-4194-9d66-59f9bdbc5c0a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.191625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34e09fbc-88f8-4845-a26b-46d31f472175 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.192357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34e09fbc-88f8-4845-a26b-46d31f472175 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.214074 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-34e09fbc-88f8-4845-a26b-46d31f472175 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-34e09fbc-88f8-4845-a26b-46d31f472175 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e HTTP/1.1 Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a13179b6-ac74-46e9-8550-55de57c58e3e'} Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:14.216946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.221953 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:14.221953 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:14.221953 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:14.221953 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:14.221953 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:14.221953 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:14.221953 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.223892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-34e09fbc-88f8-4845-a26b-46d31f472175 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:14.225256 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-34e09fbc-88f8-4845-a26b-46d31f472175 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 404 len: 111 microversion: 2.1 time: 0.053230 Jul 20 04:21:14.233689 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1387/2702] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:14 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:14.241650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d037952f-efc9-495b-b48b-4109c50a3ed7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.242727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d037952f-efc9-495b-b48b-4109c50a3ed7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.250642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d037952f-efc9-495b-b48b-4109c50a3ed7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.251438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d037952f-efc9-495b-b48b-4109c50a3ed7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.252665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d037952f-efc9-495b-b48b-4109c50a3ed7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.253354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d037952f-efc9-495b-b48b-4109c50a3ed7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.652287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d037952f-efc9-495b-b48b-4109c50a3ed7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.663714 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d037952f-efc9-495b-b48b-4109c50a3ed7 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1518 microversion: 2.1 time: 0.427634 Jul 20 04:21:14.664918 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1388/2703] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:14 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1518 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:14.670219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-edec524f-ae77-41a5-8fdd-2d9fd5619955 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.679949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-edec524f-ae77-41a5-8fdd-2d9fd5619955 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.685655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c98889b4-f90b-4194-9d66-59f9bdbc5c0a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.687363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-edec524f-ae77-41a5-8fdd-2d9fd5619955 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.688180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-edec524f-ae77-41a5-8fdd-2d9fd5619955 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.689204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-edec524f-ae77-41a5-8fdd-2d9fd5619955 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.689718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-edec524f-ae77-41a5-8fdd-2d9fd5619955 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.699839 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c98889b4-f90b-4194-9d66-59f9bdbc5c0a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1366 microversion: 2.1 time: 0.539394 Jul 20 04:21:14.700710 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1316/2704] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:14 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1366 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:14.705583 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-edec524f-ae77-41a5-8fdd-2d9fd5619955 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:14.706178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a5d8feb4-984d-444f-a131-3ef33aab9ef9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.707031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a5d8feb4-984d-444f-a131-3ef33aab9ef9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-edec524f-ae77-41a5-8fdd-2d9fd5619955 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e HTTP/1.1 Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a13179b6-ac74-46e9-8550-55de57c58e3e'} Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:14.707170 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-edec524f-ae77-41a5-8fdd-2d9fd5619955 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:14.711389 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-edec524f-ae77-41a5-8fdd-2d9fd5619955 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 404 len: 111 microversion: 2.1 time: 0.042576 Jul 20 04:21:14.713424 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1389/2705] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:14 2022] DELETE /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:14.738591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5d8feb4-984d-444f-a131-3ef33aab9ef9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.739910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5d8feb4-984d-444f-a131-3ef33aab9ef9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.742059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5d8feb4-984d-444f-a131-3ef33aab9ef9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.743494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5d8feb4-984d-444f-a131-3ef33aab9ef9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.959200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a3cd9981-337d-4523-b139-98739fd5862b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.960373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a3cd9981-337d-4523-b139-98739fd5862b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.984098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3cd9981-337d-4523-b139-98739fd5862b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.989290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3cd9981-337d-4523-b139-98739fd5862b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.997781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3cd9981-337d-4523-b139-98739fd5862b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.999015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3cd9981-337d-4523-b139-98739fd5862b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.667395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a5d8feb4-984d-444f-a131-3ef33aab9ef9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:15.681808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a5d8feb4-984d-444f-a131-3ef33aab9ef9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:15.683921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a5d8feb4-984d-444f-a131-3ef33aab9ef9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:15.686483 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a5d8feb4-984d-444f-a131-3ef33aab9ef9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 0.984308 Jul 20 04:21:15.700313 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1317/2706] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:14 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:15.705643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-910d17b2-18a4-4e2c-b27d-3ab39aca6987 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:15.706469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-910d17b2-18a4-4e2c-b27d-3ab39aca6987 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a13179b6-ac74-46e9-8550-55de57c58e3e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:15.718940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-910d17b2-18a4-4e2c-b27d-3ab39aca6987 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.721446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-910d17b2-18a4-4e2c-b27d-3ab39aca6987 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.724278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-910d17b2-18a4-4e2c-b27d-3ab39aca6987 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.724899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-910d17b2-18a4-4e2c-b27d-3ab39aca6987 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.745868 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-910d17b2-18a4-4e2c-b27d-3ab39aca6987 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-910d17b2-18a4-4e2c-b27d-3ab39aca6987 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e HTTP/1.1 Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a13179b6-ac74-46e9-8550-55de57c58e3e'} Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:15.749662 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.754536 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:15.754536 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:15.754536 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:15.754536 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:15.754536 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:15.754536 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. Jul 20 04:21:15.754536 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.757526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-910d17b2-18a4-4e2c-b27d-3ab39aca6987 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance a13179b6-ac74-46e9-8550-55de57c58e3e could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:15.758599 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-910d17b2-18a4-4e2c-b27d-3ab39aca6987 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e" status: 404 len: 111 microversion: 2.1 time: 0.056977 Jul 20 04:21:15.760040 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1318/2707] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:15 2022] GET /compute/v2.1/servers/a13179b6-ac74-46e9-8550-55de57c58e3e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:15.768067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-399a8866-d209-432d-81e3-9065441ea1d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:15.768354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a3cd9981-337d-4523-b139-98739fd5862b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:15.769453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-399a8866-d209-432d-81e3-9065441ea1d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:15.777983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:15.780023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-399a8866-d209-432d-81e3-9065441ea1d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.781722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-399a8866-d209-432d-81e3-9065441ea1d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.783024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-399a8866-d209-432d-81e3-9065441ea1d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.784075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-399a8866-d209-432d-81e3-9065441ea1d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.791794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a3cd9981-337d-4523-b139-98739fd5862b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:15.795074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a3cd9981-337d-4523-b139-98739fd5862b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:15.805628 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a3cd9981-337d-4523-b139-98739fd5862b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 1.091687 Jul 20 04:21:15.806397 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1390/2708] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:14 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:15.819317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-29a84263-752f-4e07-88ee-fe84771c4210 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:15.834784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-29a84263-752f-4e07-88ee-fe84771c4210 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:15.856154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29a84263-752f-4e07-88ee-fe84771c4210 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.857895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29a84263-752f-4e07-88ee-fe84771c4210 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.859841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29a84263-752f-4e07-88ee-fe84771c4210 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.860724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29a84263-752f-4e07-88ee-fe84771c4210 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.165013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-399a8866-d209-432d-81e3-9065441ea1d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:16.207935 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-399a8866-d209-432d-81e3-9065441ea1d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1371 microversion: 2.1 time: 0.438347 Jul 20 04:21:16.215478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-29a84263-752f-4e07-88ee-fe84771c4210 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:16.217641 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1319/2709] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:15 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1371 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:16.224940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-5437f737-b327-4c6c-9136-4cfe1186faf9 req-4f974566-07d6-41d8-9b12-0a5971988fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-plugged", "status": "completed", "tag": "ba9fd3bb-9cd1-4b98-911d-beb5f57fe7c1"}, {"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-plugged", "status": "completed", "tag": "838ed0ec-c5bd-4bce-ac1a-7200a5f4ab77"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:16.245810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-29a84263-752f-4e07-88ee-fe84771c4210 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:16.246737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5437f737-b327-4c6c-9136-4cfe1186faf9 req-4f974566-07d6-41d8-9b12-0a5971988fdf service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.248209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-29a84263-752f-4e07-88ee-fe84771c4210 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:16.249660 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-29a84263-752f-4e07-88ee-fe84771c4210 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1848 microversion: 2.32 time: 0.441488 Jul 20 04:21:16.250869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5437f737-b327-4c6c-9136-4cfe1186faf9 req-4f974566-07d6-41d8-9b12-0a5971988fdf service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.261773 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1391/2710] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:15 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1848 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:16.267254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-018de233-a6bc-4ee8-8933-2c8c53170316 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:16.268478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-018de233-a6bc-4ee8-8933-2c8c53170316 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:16.277788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-018de233-a6bc-4ee8-8933-2c8c53170316 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.278352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-018de233-a6bc-4ee8-8933-2c8c53170316 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.279315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-018de233-a6bc-4ee8-8933-2c8c53170316 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.279916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-018de233-a6bc-4ee8-8933-2c8c53170316 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.295918 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-5437f737-b327-4c6c-9136-4cfe1186faf9 req-4f974566-07d6-41d8-9b12-0a5971988fdf service nova] Creating event network-vif-plugged:ba9fd3bb-9cd1-4b98-911d-beb5f57fe7c1 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:21:16.296433 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-5437f737-b327-4c6c-9136-4cfe1186faf9 req-4f974566-07d6-41d8-9b12-0a5971988fdf service nova] Creating event network-vif-plugged:838ed0ec-c5bd-4bce-ac1a-7200a5f4ab77 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:21:16.314492 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-5437f737-b327-4c6c-9136-4cfe1186faf9 req-4f974566-07d6-41d8-9b12-0a5971988fdf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095512 Jul 20 04:21:16.317958 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1320/2711] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:16.331748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-52ac815b-3528-4677-9a97-d0615e15ef8d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:16.332873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-52ac815b-3528-4677-9a97-d0615e15ef8d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:16.353790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52ac815b-3528-4677-9a97-d0615e15ef8d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.354224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52ac815b-3528-4677-9a97-d0615e15ef8d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.357201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52ac815b-3528-4677-9a97-d0615e15ef8d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.357664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52ac815b-3528-4677-9a97-d0615e15ef8d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.609860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-018de233-a6bc-4ee8-8933-2c8c53170316 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:16.622095 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-018de233-a6bc-4ee8-8933-2c8c53170316 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1518 microversion: 2.1 time: 0.358803 Jul 20 04:21:16.628579 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1392/2712] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:16 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1518 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:16.655371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd221fd8-cb4c-4a03-9169-a4fc512e1eeb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:16.657985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dd221fd8-cb4c-4a03-9169-a4fc512e1eeb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:16.698463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd221fd8-cb4c-4a03-9169-a4fc512e1eeb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.699441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd221fd8-cb4c-4a03-9169-a4fc512e1eeb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.704582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd221fd8-cb4c-4a03-9169-a4fc512e1eeb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.705270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd221fd8-cb4c-4a03-9169-a4fc512e1eeb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.741851 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-dd221fd8-cb4c-4a03-9169-a4fc512e1eeb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:21:16.754032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-52ac815b-3528-4677-9a97-d0615e15ef8d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd221fd8-cb4c-4a03-9169-a4fc512e1eeb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa HTTP/1.1 Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '7ac84d10-8291-412d-8921-cdc10c2682fa'} Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:16.758019 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd221fd8-cb4c-4a03-9169-a4fc512e1eeb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:16.761836 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dd221fd8-cb4c-4a03-9169-a4fc512e1eeb tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 404 len: 111 microversion: 2.1 time: 0.129631 Jul 20 04:21:16.767498 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1393/2713] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:16 2022] DELETE /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:16.775189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4169d254-c7e9-4bc4-877f-85ca391224e9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:16.777671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4169d254-c7e9-4bc4-877f-85ca391224e9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:16.778906 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-52ac815b-3528-4677-9a97-d0615e15ef8d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1366 microversion: 2.1 time: 0.459495 Jul 20 04:21:16.789820 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1321/2714] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:16 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:16.789820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-218e22ce-9d2e-4aac-aaad-3b50d7d4f8ce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:16.789820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-218e22ce-9d2e-4aac-aaad-3b50d7d4f8ce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 7ac84d10-8291-412d-8921-cdc10c2682fa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:16.806355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4169d254-c7e9-4bc4-877f-85ca391224e9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.819281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-218e22ce-9d2e-4aac-aaad-3b50d7d4f8ce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.820167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-218e22ce-9d2e-4aac-aaad-3b50d7d4f8ce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.820957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-218e22ce-9d2e-4aac-aaad-3b50d7d4f8ce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.821516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-218e22ce-9d2e-4aac-aaad-3b50d7d4f8ce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.825283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4169d254-c7e9-4bc4-877f-85ca391224e9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.831994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4169d254-c7e9-4bc4-877f-85ca391224e9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.833461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4169d254-c7e9-4bc4-877f-85ca391224e9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.874787 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-218e22ce-9d2e-4aac-aaad-3b50d7d4f8ce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-218e22ce-9d2e-4aac-aaad-3b50d7d4f8ce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa HTTP/1.1 Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '7ac84d10-8291-412d-8921-cdc10c2682fa'} Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:16.896783 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:16.903565 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:16.903565 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:16.903565 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:16.903565 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:16.903565 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:16.903565 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. Jul 20 04:21:16.903565 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:16.903565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-218e22ce-9d2e-4aac-aaad-3b50d7d4f8ce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance 7ac84d10-8291-412d-8921-cdc10c2682fa could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:16.903565 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-218e22ce-9d2e-4aac-aaad-3b50d7d4f8ce tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa" status: 404 len: 111 microversion: 2.1 time: 0.120378 Jul 20 04:21:16.904887 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1322/2715] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:16 2022] GET /compute/v2.1/servers/7ac84d10-8291-412d-8921-cdc10c2682fa => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:16.917015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b56f94a4-82e9-489e-b732-70b8cba55e97 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:16.922415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b56f94a4-82e9-489e-b732-70b8cba55e97 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:16.941638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b56f94a4-82e9-489e-b732-70b8cba55e97 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.942865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b56f94a4-82e9-489e-b732-70b8cba55e97 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.944186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b56f94a4-82e9-489e-b732-70b8cba55e97 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.944964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b56f94a4-82e9-489e-b732-70b8cba55e97 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.276129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4169d254-c7e9-4bc4-877f-85ca391224e9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.291483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4169d254-c7e9-4bc4-877f-85ca391224e9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.293543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4169d254-c7e9-4bc4-877f-85ca391224e9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.293688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b56f94a4-82e9-489e-b732-70b8cba55e97 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.295111 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4169d254-c7e9-4bc4-877f-85ca391224e9 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 0.526458 Jul 20 04:21:17.306351 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1394/2716] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:16 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:17.310029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b56f94a4-82e9-489e-b732-70b8cba55e97 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.311831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b56f94a4-82e9-489e-b732-70b8cba55e97 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.313044 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b56f94a4-82e9-489e-b732-70b8cba55e97 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.407127 Jul 20 04:21:17.316437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d2205ec-a397-473f-b6c4-d8736256aec1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:17.317078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d2205ec-a397-473f-b6c4-d8736256aec1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:17.318631 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1323/2717] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:16 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:17.329724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0d880008-7a57-4f2f-8a6b-fa6bd1f64497 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:17.333695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d2205ec-a397-473f-b6c4-d8736256aec1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.334376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d2205ec-a397-473f-b6c4-d8736256aec1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.335904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d2205ec-a397-473f-b6c4-d8736256aec1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.336555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d2205ec-a397-473f-b6c4-d8736256aec1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.336757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0d880008-7a57-4f2f-8a6b-fa6bd1f64497 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:17.355618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d880008-7a57-4f2f-8a6b-fa6bd1f64497 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.356081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d880008-7a57-4f2f-8a6b-fa6bd1f64497 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.356877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d880008-7a57-4f2f-8a6b-fa6bd1f64497 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.357500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d880008-7a57-4f2f-8a6b-fa6bd1f64497 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.358906 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-2d2205ec-a397-473f-b6c4-d8736256aec1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d2205ec-a397-473f-b6c4-d8736256aec1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 HTTP/1.1 Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '3b275fa8-1d8e-435e-9256-5b2a33129d62'} Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:17.364856 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:17.369484 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:21:17.369484 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:17.369484 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:17.369484 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:17.369484 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:17.369484 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:17.369484 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:17.369484 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:17.369484 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:17.369484 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:21:17.369484 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:17.372124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d2205ec-a397-473f-b6c4-d8736256aec1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:17.373642 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d2205ec-a397-473f-b6c4-d8736256aec1 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 404 len: 111 microversion: 2.1 time: 0.061315 Jul 20 04:21:17.374698 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1395/2718] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:17 2022] DELETE /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:17.390450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df983b6f-6284-47b1-abce-e5313b67ab17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:17.391361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df983b6f-6284-47b1-abce-e5313b67ab17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:17.400721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df983b6f-6284-47b1-abce-e5313b67ab17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.401421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df983b6f-6284-47b1-abce-e5313b67ab17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.402970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df983b6f-6284-47b1-abce-e5313b67ab17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.403669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df983b6f-6284-47b1-abce-e5313b67ab17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.785638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df983b6f-6284-47b1-abce-e5313b67ab17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.799744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0d880008-7a57-4f2f-8a6b-fa6bd1f64497 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.808159 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0d880008-7a57-4f2f-8a6b-fa6bd1f64497 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1371 microversion: 2.1 time: 0.488337 Jul 20 04:21:17.810729 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1324/2719] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:17 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1371 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:17.816334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2a7c80bf-7ee2-4b0a-9c64-3cf7691f4436 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:17.817218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2a7c80bf-7ee2-4b0a-9c64-3cf7691f4436 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 3b275fa8-1d8e-435e-9256-5b2a33129d62] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:17.821064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df983b6f-6284-47b1-abce-e5313b67ab17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.824825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a7c80bf-7ee2-4b0a-9c64-3cf7691f4436 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.825359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df983b6f-6284-47b1-abce-e5313b67ab17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.825754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a7c80bf-7ee2-4b0a-9c64-3cf7691f4436 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.826573 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df983b6f-6284-47b1-abce-e5313b67ab17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1848 microversion: 2.32 time: 0.449503 Jul 20 04:21:17.826964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a7c80bf-7ee2-4b0a-9c64-3cf7691f4436 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.827135 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1396/2720] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:17 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1848 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:17.828028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a7c80bf-7ee2-4b0a-9c64-3cf7691f4436 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.843754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eccab87e-b10b-4a55-9726-c8e7e94a4eb5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:17.844399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eccab87e-b10b-4a55-9726-c8e7e94a4eb5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:17.853975 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-2a7c80bf-7ee2-4b0a-9c64-3cf7691f4436 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2a7c80bf-7ee2-4b0a-9c64-3cf7691f4436 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 HTTP/1.1 Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '3b275fa8-1d8e-435e-9256-5b2a33129d62'} Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:17.856026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:17.859595 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:17.859595 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:17.859595 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:17.859595 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:17.859595 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:17.859595 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. Jul 20 04:21:17.859595 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:17.860089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eccab87e-b10b-4a55-9726-c8e7e94a4eb5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.860089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eccab87e-b10b-4a55-9726-c8e7e94a4eb5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.860089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eccab87e-b10b-4a55-9726-c8e7e94a4eb5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.860089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eccab87e-b10b-4a55-9726-c8e7e94a4eb5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.864172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2a7c80bf-7ee2-4b0a-9c64-3cf7691f4436 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance 3b275fa8-1d8e-435e-9256-5b2a33129d62 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:17.865167 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2a7c80bf-7ee2-4b0a-9c64-3cf7691f4436 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62" status: 404 len: 111 microversion: 2.1 time: 0.052667 Jul 20 04:21:17.866166 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1325/2721] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:17 2022] GET /compute/v2.1/servers/3b275fa8-1d8e-435e-9256-5b2a33129d62 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:17.871921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-52c1d8c3-6b94-4268-bc1f-40aeb4c3c0a0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:17.872783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-52c1d8c3-6b94-4268-bc1f-40aeb4c3c0a0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:17.881312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52c1d8c3-6b94-4268-bc1f-40aeb4c3c0a0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.882421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52c1d8c3-6b94-4268-bc1f-40aeb4c3c0a0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.883901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52c1d8c3-6b94-4268-bc1f-40aeb4c3c0a0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.884475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52c1d8c3-6b94-4268-bc1f-40aeb4c3c0a0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.907234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:18.167139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-eccab87e-b10b-4a55-9726-c8e7e94a4eb5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.177307 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eccab87e-b10b-4a55-9726-c8e7e94a4eb5 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1518 microversion: 2.1 time: 0.337738 Jul 20 04:21:18.193825 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1397/2722] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:17 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1518 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:18.201116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fddeb0a5-0e12-4cbe-9d66-6aabeed789f5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.201827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fddeb0a5-0e12-4cbe-9d66-6aabeed789f5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.212276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fddeb0a5-0e12-4cbe-9d66-6aabeed789f5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.212926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fddeb0a5-0e12-4cbe-9d66-6aabeed789f5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.214517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fddeb0a5-0e12-4cbe-9d66-6aabeed789f5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.215131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fddeb0a5-0e12-4cbe-9d66-6aabeed789f5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.223092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-52c1d8c3-6b94-4268-bc1f-40aeb4c3c0a0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.231887 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-52c1d8c3-6b94-4268-bc1f-40aeb4c3c0a0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1366 microversion: 2.1 time: 0.364297 Jul 20 04:21:18.233687 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1326/2723] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:17 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:18.245095 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-fddeb0a5-0e12-4cbe-9d66-6aabeed789f5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fddeb0a5-0e12-4cbe-9d66-6aabeed789f5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 HTTP/1.1 Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '5bf4efd9-d89f-4775-adb9-fb25596bcd90'} Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:18.247260 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fddeb0a5-0e12-4cbe-9d66-6aabeed789f5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:18.250802 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fddeb0a5-0e12-4cbe-9d66-6aabeed789f5 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 404 len: 111 microversion: 2.1 time: 0.053537 Jul 20 04:21:18.252412 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1398/2724] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:18 2022] DELETE /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:18.260886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2775fb16-7bb6-41ed-af68-a93c2bf4de0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.261528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2775fb16-7bb6-41ed-af68-a93c2bf4de0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 5bf4efd9-d89f-4775-adb9-fb25596bcd90] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.269464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2775fb16-7bb6-41ed-af68-a93c2bf4de0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.270111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2775fb16-7bb6-41ed-af68-a93c2bf4de0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.270938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2775fb16-7bb6-41ed-af68-a93c2bf4de0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.271427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2775fb16-7bb6-41ed-af68-a93c2bf4de0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.290353 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-2775fb16-7bb6-41ed-af68-a93c2bf4de0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2775fb16-7bb6-41ed-af68-a93c2bf4de0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 HTTP/1.1 Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '5bf4efd9-d89f-4775-adb9-fb25596bcd90'} Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:18.293298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.297679 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:18.297679 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:18.297679 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:18.297679 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:18.297679 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:18.297679 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. Jul 20 04:21:18.297679 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.297679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2775fb16-7bb6-41ed-af68-a93c2bf4de0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance 5bf4efd9-d89f-4775-adb9-fb25596bcd90 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:18.297679 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2775fb16-7bb6-41ed-af68-a93c2bf4de0b tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90" status: 404 len: 111 microversion: 2.1 time: 0.041806 Jul 20 04:21:18.300417 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1327/2725] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:18 2022] GET /compute/v2.1/servers/5bf4efd9-d89f-4775-adb9-fb25596bcd90 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:18.307151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bed36f1c-517b-401e-8ed2-76da5b66b929 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.308097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bed36f1c-517b-401e-8ed2-76da5b66b929 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.315333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bed36f1c-517b-401e-8ed2-76da5b66b929 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.316029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bed36f1c-517b-401e-8ed2-76da5b66b929 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.316972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bed36f1c-517b-401e-8ed2-76da5b66b929 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.317559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bed36f1c-517b-401e-8ed2-76da5b66b929 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.320729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-636fdc9e-68f2-46d3-af1f-5b1ac173a93e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.321476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-636fdc9e-68f2-46d3-af1f-5b1ac173a93e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.337710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-636fdc9e-68f2-46d3-af1f-5b1ac173a93e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.338191 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-bed36f1c-517b-401e-8ed2-76da5b66b929 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:21:18.339063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-636fdc9e-68f2-46d3-af1f-5b1ac173a93e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.340139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-636fdc9e-68f2-46d3-af1f-5b1ac173a93e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bed36f1c-517b-401e-8ed2-76da5b66b929 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 HTTP/1.1 Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1e1f3708-823c-49ca-8327-bfdd82211149'} Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:18.341280 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:18.346109 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:21:18.346109 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.346109 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:18.346109 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.346109 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:18.346109 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:18.346109 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:18.346109 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:18.346109 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:18.346109 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:21:18.346109 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.346851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-636fdc9e-68f2-46d3-af1f-5b1ac173a93e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.348955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bed36f1c-517b-401e-8ed2-76da5b66b929 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:18.351089 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bed36f1c-517b-401e-8ed2-76da5b66b929 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 404 len: 111 microversion: 2.1 time: 0.048701 Jul 20 04:21:18.352135 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1399/2726] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:18 2022] DELETE /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:18.357864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-35214653-f893-4369-a215-ffe4c0f47751 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.359150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-35214653-f893-4369-a215-ffe4c0f47751 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.368246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35214653-f893-4369-a215-ffe4c0f47751 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.369224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35214653-f893-4369-a215-ffe4c0f47751 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.370177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35214653-f893-4369-a215-ffe4c0f47751 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.370768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35214653-f893-4369-a215-ffe4c0f47751 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.591712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-35214653-f893-4369-a215-ffe4c0f47751 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.609670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-35214653-f893-4369-a215-ffe4c0f47751 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.611182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-35214653-f893-4369-a215-ffe4c0f47751 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.612406 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-35214653-f893-4369-a215-ffe4c0f47751 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.258945 Jul 20 04:21:18.613541 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1400/2727] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:18 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:18.619144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-43fe1ae0-a642-4af4-84bd-f79bd822d178 req-fc57bec4-7b1f-4bc7-b4c9-08eb285f5c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-plugged", "status": "completed", "tag": "5477bec5-e7f2-4638-a405-8b50b8e83faa"}, {"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-plugged", "status": "completed", "tag": "f686daf0-a9f5-40b9-993f-1a05e9682dd5"}, {"server_uuid": "dd5c32a2-e4d5-42ae-97c8-68123a555ec9", "name": "network-vif-plugged", "status": "completed", "tag": "b176f969-0f6e-4a2e-bc2b-d85011718eae"}, {"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-plugged", "status": "completed", "tag": "da06b2f2-360d-4c71-b7f9-0250c1dbb102"}, {"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-plugged", "status": "completed", "tag": "800cf352-aa0e-40db-9b0e-767c0447d749"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:18.654634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-43fe1ae0-a642-4af4-84bd-f79bd822d178 req-fc57bec4-7b1f-4bc7-b4c9-08eb285f5c18 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.655108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-43fe1ae0-a642-4af4-84bd-f79bd822d178 req-fc57bec4-7b1f-4bc7-b4c9-08eb285f5c18 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.698673 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-43fe1ae0-a642-4af4-84bd-f79bd822d178 req-fc57bec4-7b1f-4bc7-b4c9-08eb285f5c18 service nova] Creating event network-vif-plugged:5477bec5-e7f2-4638-a405-8b50b8e83faa for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:21:18.699205 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-43fe1ae0-a642-4af4-84bd-f79bd822d178 req-fc57bec4-7b1f-4bc7-b4c9-08eb285f5c18 service nova] Creating event network-vif-plugged:f686daf0-a9f5-40b9-993f-1a05e9682dd5 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:21:18.699975 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-43fe1ae0-a642-4af4-84bd-f79bd822d178 req-fc57bec4-7b1f-4bc7-b4c9-08eb285f5c18 service nova] Creating event network-vif-plugged:b176f969-0f6e-4a2e-bc2b-d85011718eae for instance dd5c32a2-e4d5-42ae-97c8-68123a555ec9 on n-h2-764485-11 Jul 20 04:21:18.700675 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-43fe1ae0-a642-4af4-84bd-f79bd822d178 req-fc57bec4-7b1f-4bc7-b4c9-08eb285f5c18 service nova] Creating event network-vif-plugged:da06b2f2-360d-4c71-b7f9-0250c1dbb102 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:21:18.702372 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-43fe1ae0-a642-4af4-84bd-f79bd822d178 req-fc57bec4-7b1f-4bc7-b4c9-08eb285f5c18 service nova] Creating event network-vif-plugged:800cf352-aa0e-40db-9b0e-767c0447d749 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:21:18.718737 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-43fe1ae0-a642-4af4-84bd-f79bd822d178 req-fc57bec4-7b1f-4bc7-b4c9-08eb285f5c18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.103702 Jul 20 04:21:18.719546 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1401/2728] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:18.725208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-99033b15-3d9c-47f0-be73-839b2e027292 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.726648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-99033b15-3d9c-47f0-be73-839b2e027292 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: 1e1f3708-823c-49ca-8327-bfdd82211149] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.734508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99033b15-3d9c-47f0-be73-839b2e027292 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.735207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99033b15-3d9c-47f0-be73-839b2e027292 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.736267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99033b15-3d9c-47f0-be73-839b2e027292 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.736956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99033b15-3d9c-47f0-be73-839b2e027292 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.750767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-636fdc9e-68f2-46d3-af1f-5b1ac173a93e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.761899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-636fdc9e-68f2-46d3-af1f-5b1ac173a93e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.764005 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-99033b15-3d9c-47f0-be73-839b2e027292 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:21:18.764501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-636fdc9e-68f2-46d3-af1f-5b1ac173a93e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.765751 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-636fdc9e-68f2-46d3-af1f-5b1ac173a93e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 0.454891 Jul 20 04:21:18.776804 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1328/2729] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:18 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-99033b15-3d9c-47f0-be73-839b2e027292 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 HTTP/1.1 Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1e1f3708-823c-49ca-8327-bfdd82211149'} Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:18.777015 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.781159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:18.781159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:18.781159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:18.781159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:18.781159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:18.781159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. Jul 20 04:21:18.781159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:18.781159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-99033b15-3d9c-47f0-be73-839b2e027292 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance 1e1f3708-823c-49ca-8327-bfdd82211149 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:18.781159 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-99033b15-3d9c-47f0-be73-839b2e027292 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149" status: 404 len: 111 microversion: 2.1 time: 0.053040 Jul 20 04:21:18.781159 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1402/2730] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:18 2022] GET /compute/v2.1/servers/1e1f3708-823c-49ca-8327-bfdd82211149 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:18.829845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe56a8fb-f333-4783-b8a9-cd3f6f29d389 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.830495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe56a8fb-f333-4783-b8a9-cd3f6f29d389 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.840601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe56a8fb-f333-4783-b8a9-cd3f6f29d389 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.841669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe56a8fb-f333-4783-b8a9-cd3f6f29d389 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.842346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe56a8fb-f333-4783-b8a9-cd3f6f29d389 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.842677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe56a8fb-f333-4783-b8a9-cd3f6f29d389 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.847295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2adebca-7c36-41d7-9251-111e1f18ffbd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.848089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f2adebca-7c36-41d7-9251-111e1f18ffbd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.858987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2adebca-7c36-41d7-9251-111e1f18ffbd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.860238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2adebca-7c36-41d7-9251-111e1f18ffbd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.861210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2adebca-7c36-41d7-9251-111e1f18ffbd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.864744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2adebca-7c36-41d7-9251-111e1f18ffbd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.176669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f2adebca-7c36-41d7-9251-111e1f18ffbd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.191076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe56a8fb-f333-4783-b8a9-cd3f6f29d389 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.196458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f2adebca-7c36-41d7-9251-111e1f18ffbd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.197977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f2adebca-7c36-41d7-9251-111e1f18ffbd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.199161 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f2adebca-7c36-41d7-9251-111e1f18ffbd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1848 microversion: 2.32 time: 0.355982 Jul 20 04:21:19.199419 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe56a8fb-f333-4783-b8a9-cd3f6f29d389 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1371 microversion: 2.1 time: 0.377040 Jul 20 04:21:19.199765 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1403/2731] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:18 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1848 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:21:19.200282 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1329/2732] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:18 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1371 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:19.214171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db2cde13-1b2f-4b4f-a3f7-896e7f5e64f3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:19.214812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-db2cde13-1b2f-4b4f-a3f7-896e7f5e64f3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:19.221009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db2cde13-1b2f-4b4f-a3f7-896e7f5e64f3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.221465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db2cde13-1b2f-4b4f-a3f7-896e7f5e64f3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.222242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db2cde13-1b2f-4b4f-a3f7-896e7f5e64f3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.222688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db2cde13-1b2f-4b4f-a3f7-896e7f5e64f3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.250952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9d59a91b-caa7-4717-b126-e07cfb6e33fa tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:19.251890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9d59a91b-caa7-4717-b126-e07cfb6e33fa tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:19.264374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d59a91b-caa7-4717-b126-e07cfb6e33fa tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.265137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d59a91b-caa7-4717-b126-e07cfb6e33fa tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.266220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d59a91b-caa7-4717-b126-e07cfb6e33fa tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.266809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d59a91b-caa7-4717-b126-e07cfb6e33fa tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.462183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-db2cde13-1b2f-4b4f-a3f7-896e7f5e64f3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.469005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9d59a91b-caa7-4717-b126-e07cfb6e33fa tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.477057 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-db2cde13-1b2f-4b4f-a3f7-896e7f5e64f3 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1518 microversion: 2.1 time: 0.265151 Jul 20 04:21:19.478175 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1404/2733] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:19 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1518 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:19.478562 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9d59a91b-caa7-4717-b126-e07cfb6e33fa tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1366 microversion: 2.1 time: 0.231791 Jul 20 04:21:19.488530 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1330/2734] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:19 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:19.631065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f880430f-fd07-4e67-ab32-17c0c1f5caab tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:19.631718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f880430f-fd07-4e67-ab32-17c0c1f5caab tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:19.638956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f880430f-fd07-4e67-ab32-17c0c1f5caab tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.639412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f880430f-fd07-4e67-ab32-17c0c1f5caab tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.640215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f880430f-fd07-4e67-ab32-17c0c1f5caab tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.640654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f880430f-fd07-4e67-ab32-17c0c1f5caab tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.785630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f0a06ce1-f85f-4254-895c-c1c499a2c82b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:19.786994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f0a06ce1-f85f-4254-895c-c1c499a2c82b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:19.801672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0a06ce1-f85f-4254-895c-c1c499a2c82b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.802140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0a06ce1-f85f-4254-895c-c1c499a2c82b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.802930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0a06ce1-f85f-4254-895c-c1c499a2c82b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.803399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0a06ce1-f85f-4254-895c-c1c499a2c82b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.804751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f880430f-fd07-4e67-ab32-17c0c1f5caab tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.814774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f880430f-fd07-4e67-ab32-17c0c1f5caab tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.816938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f880430f-fd07-4e67-ab32-17c0c1f5caab tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.818513 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f880430f-fd07-4e67-ab32-17c0c1f5caab tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.191165 Jul 20 04:21:19.822716 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1405/2735] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:19 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:20.028133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f0a06ce1-f85f-4254-895c-c1c499a2c82b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:20.040136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f0a06ce1-f85f-4254-895c-c1c499a2c82b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:20.042108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f0a06ce1-f85f-4254-895c-c1c499a2c82b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:20.043713 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f0a06ce1-f85f-4254-895c-c1c499a2c82b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 0.262526 Jul 20 04:21:20.044626 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1331/2736] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:19 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:21:20.219138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ae5628e8-d04d-40c5-9507-d5698423ed38 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:20.220244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ae5628e8-d04d-40c5-9507-d5698423ed38 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:20.228166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae5628e8-d04d-40c5-9507-d5698423ed38 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.228965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae5628e8-d04d-40c5-9507-d5698423ed38 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.229961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae5628e8-d04d-40c5-9507-d5698423ed38 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.230514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-43e66a91-1c8b-4176-8aa4-c76929793e76 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:20.231153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-43e66a91-1c8b-4176-8aa4-c76929793e76 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:20.231540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae5628e8-d04d-40c5-9507-d5698423ed38 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.270811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43e66a91-1c8b-4176-8aa4-c76929793e76 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.271288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43e66a91-1c8b-4176-8aa4-c76929793e76 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.279029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43e66a91-1c8b-4176-8aa4-c76929793e76 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.279497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43e66a91-1c8b-4176-8aa4-c76929793e76 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.008131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ae5628e8-d04d-40c5-9507-d5698423ed38 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:21.024828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ae5628e8-d04d-40c5-9507-d5698423ed38 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:21.027522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ae5628e8-d04d-40c5-9507-d5698423ed38 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:21.032269 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ae5628e8-d04d-40c5-9507-d5698423ed38 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1848 microversion: 2.32 time: 0.816694 Jul 20 04:21:21.035742 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1332/2737] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:20 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1848 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:21:21.045789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d3b540e2-6b7c-428d-9414-38ac4101db08 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:21.051185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-43e66a91-1c8b-4176-8aa4-c76929793e76 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:21.051837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d3b540e2-6b7c-428d-9414-38ac4101db08 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:21.066426 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-43e66a91-1c8b-4176-8aa4-c76929793e76 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1371 microversion: 2.1 time: 0.848571 Jul 20 04:21:21.067465 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1406/2738] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:20 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1371 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:21.068143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d3b540e2-6b7c-428d-9414-38ac4101db08 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.070919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d3b540e2-6b7c-428d-9414-38ac4101db08 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.073387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d3b540e2-6b7c-428d-9414-38ac4101db08 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.074489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d3b540e2-6b7c-428d-9414-38ac4101db08 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.080368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d77c18c6-1d7f-42a7-8176-54dd3c4a3040 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:21.081335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d77c18c6-1d7f-42a7-8176-54dd3c4a3040 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:21.100028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d77c18c6-1d7f-42a7-8176-54dd3c4a3040 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.101235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d77c18c6-1d7f-42a7-8176-54dd3c4a3040 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.104291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d77c18c6-1d7f-42a7-8176-54dd3c4a3040 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.104984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d77c18c6-1d7f-42a7-8176-54dd3c4a3040 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.165624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:21.325977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d3b540e2-6b7c-428d-9414-38ac4101db08 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:21.334283 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d3b540e2-6b7c-428d-9414-38ac4101db08 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1518 microversion: 2.1 time: 0.297204 Jul 20 04:21:21.348810 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1333/2739] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:21 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1518 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:21.366072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-2c2ae7a6-a6b2-4607-b088-44529aaea222 req-00d10727-eb8a-4ace-8240-e9c9bf736cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103ad850-c12a-4118-9600-9ea876ec5cdb", "name": "network-vif-unplugged", "status": "completed", "tag": "b2af76ca-80bb-4fc6-bb13-a0c498437b45"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:21.386961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2c2ae7a6-a6b2-4607-b088-44529aaea222 req-00d10727-eb8a-4ace-8240-e9c9bf736cc7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.396938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2c2ae7a6-a6b2-4607-b088-44529aaea222 req-00d10727-eb8a-4ace-8240-e9c9bf736cc7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.436227 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-2c2ae7a6-a6b2-4607-b088-44529aaea222 req-00d10727-eb8a-4ace-8240-e9c9bf736cc7 service nova] Creating event network-vif-unplugged:b2af76ca-80bb-4fc6-bb13-a0c498437b45 for instance 103ad850-c12a-4118-9600-9ea876ec5cdb on n-h1-764485-11 Jul 20 04:21:21.451401 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-2c2ae7a6-a6b2-4607-b088-44529aaea222 req-00d10727-eb8a-4ace-8240-e9c9bf736cc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099020 Jul 20 04:21:21.453363 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1334/2740] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:21.463606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1048921d-9a5c-4798-937b-3bf8f2be7c49 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:21.464584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1048921d-9a5c-4798-937b-3bf8f2be7c49 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:21.472672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1048921d-9a5c-4798-937b-3bf8f2be7c49 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.473802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1048921d-9a5c-4798-937b-3bf8f2be7c49 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.474766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1048921d-9a5c-4798-937b-3bf8f2be7c49 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.475371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1048921d-9a5c-4798-937b-3bf8f2be7c49 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.719470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d77c18c6-1d7f-42a7-8176-54dd3c4a3040 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:21.728215 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d77c18c6-1d7f-42a7-8176-54dd3c4a3040 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1555 microversion: 2.1 time: 0.659230 Jul 20 04:21:21.734622 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1407/2741] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:21 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1555 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:21.746276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c537cc6-ddbe-4a9d-abfb-358d5cbcab1d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:21.751823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9c537cc6-ddbe-4a9d-abfb-358d5cbcab1d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:21.772918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c537cc6-ddbe-4a9d-abfb-358d5cbcab1d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.774497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c537cc6-ddbe-4a9d-abfb-358d5cbcab1d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.776530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c537cc6-ddbe-4a9d-abfb-358d5cbcab1d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.782034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c537cc6-ddbe-4a9d-abfb-358d5cbcab1d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.789321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1048921d-9a5c-4798-937b-3bf8f2be7c49 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:21.810387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1048921d-9a5c-4798-937b-3bf8f2be7c49 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:21.813394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1048921d-9a5c-4798-937b-3bf8f2be7c49 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:21.814837 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1048921d-9a5c-4798-937b-3bf8f2be7c49 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.360127 Jul 20 04:21:21.815954 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1335/2742] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:21 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:21.823531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-01cbc3fe-72cc-4b5e-b85b-600dc1b7d131 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:21.824497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-01cbc3fe-72cc-4b5e-b85b-600dc1b7d131 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:21.839534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01cbc3fe-72cc-4b5e-b85b-600dc1b7d131 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.842331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01cbc3fe-72cc-4b5e-b85b-600dc1b7d131 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.843456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01cbc3fe-72cc-4b5e-b85b-600dc1b7d131 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.845424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01cbc3fe-72cc-4b5e-b85b-600dc1b7d131 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:22.184553 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-01cbc3fe-72cc-4b5e-b85b-600dc1b7d131 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.367254 Jul 20 04:21:22.186558 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1336/2743] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:21:21 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-interface => generated 284 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:22.195402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-11be8867-bbbf-4a04-8243-a01c41e24dcd req-2ae7c7f1-56d8-4514-99e1-e19db5052f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103ad850-c12a-4118-9600-9ea876ec5cdb", "name": "network-vif-deleted", "tag": "b2af76ca-80bb-4fc6-bb13-a0c498437b45"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:22.221820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-11be8867-bbbf-4a04-8243-a01c41e24dcd req-2ae7c7f1-56d8-4514-99e1-e19db5052f3b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:22.224056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-11be8867-bbbf-4a04-8243-a01c41e24dcd req-2ae7c7f1-56d8-4514-99e1-e19db5052f3b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:22.276987 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-11be8867-bbbf-4a04-8243-a01c41e24dcd req-2ae7c7f1-56d8-4514-99e1-e19db5052f3b service nova] Creating event network-vif-deleted:b2af76ca-80bb-4fc6-bb13-a0c498437b45 for instance 103ad850-c12a-4118-9600-9ea876ec5cdb on n-h1-764485-11 Jul 20 04:21:22.290478 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-11be8867-bbbf-4a04-8243-a01c41e24dcd req-2ae7c7f1-56d8-4514-99e1-e19db5052f3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099570 Jul 20 04:21:22.292497 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1337/2744] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:22.308474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1f5c31da-f566-4fcc-b8c1-8bb2a021483f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:22.309936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1f5c31da-f566-4fcc-b8c1-8bb2a021483f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:22.333517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f5c31da-f566-4fcc-b8c1-8bb2a021483f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:22.334234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f5c31da-f566-4fcc-b8c1-8bb2a021483f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:22.336109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f5c31da-f566-4fcc-b8c1-8bb2a021483f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:22.336715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f5c31da-f566-4fcc-b8c1-8bb2a021483f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:22.531307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9c537cc6-ddbe-4a9d-abfb-358d5cbcab1d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:22.549748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9c537cc6-ddbe-4a9d-abfb-358d5cbcab1d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:22.552727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9c537cc6-ddbe-4a9d-abfb-358d5cbcab1d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:22.554021 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c537cc6-ddbe-4a9d-abfb-358d5cbcab1d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 0.814525 Jul 20 04:21:22.561898 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1408/2745] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:21 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:22.574723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be610a4f-fd3f-4f20-8a87-f475c85f084e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:22.576806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-be610a4f-fd3f-4f20-8a87-f475c85f084e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:22.596852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be610a4f-fd3f-4f20-8a87-f475c85f084e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:22.598478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be610a4f-fd3f-4f20-8a87-f475c85f084e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:22.603655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be610a4f-fd3f-4f20-8a87-f475c85f084e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:22.604337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be610a4f-fd3f-4f20-8a87-f475c85f084e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:22.989697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-be610a4f-fd3f-4f20-8a87-f475c85f084e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:22.994407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1f5c31da-f566-4fcc-b8c1-8bb2a021483f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.001632 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-be610a4f-fd3f-4f20-8a87-f475c85f084e tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1371 microversion: 2.1 time: 0.437793 Jul 20 04:21:23.003891 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1409/2746] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:22 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:23.010262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1f5c31da-f566-4fcc-b8c1-8bb2a021483f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.010779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-982204ca-9aad-467c-9a28-a62fcabae44c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.011595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-982204ca-9aad-467c-9a28-a62fcabae44c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.014164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1f5c31da-f566-4fcc-b8c1-8bb2a021483f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.015580 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1f5c31da-f566-4fcc-b8c1-8bb2a021483f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1848 microversion: 2.32 time: 0.718320 Jul 20 04:21:23.026521 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1338/2747] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:22 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1848 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:23.026521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7aa33d6d-40e5-44e7-8c53-70a229f39f43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.026521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7aa33d6d-40e5-44e7-8c53-70a229f39f43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.033141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-982204ca-9aad-467c-9a28-a62fcabae44c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.034180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-982204ca-9aad-467c-9a28-a62fcabae44c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.035487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-982204ca-9aad-467c-9a28-a62fcabae44c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.036200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-982204ca-9aad-467c-9a28-a62fcabae44c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.041813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7aa33d6d-40e5-44e7-8c53-70a229f39f43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.042344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7aa33d6d-40e5-44e7-8c53-70a229f39f43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.043199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7aa33d6d-40e5-44e7-8c53-70a229f39f43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.043818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7aa33d6d-40e5-44e7-8c53-70a229f39f43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.247013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-982204ca-9aad-467c-9a28-a62fcabae44c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.255937 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-982204ca-9aad-467c-9a28-a62fcabae44c tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1476 microversion: 2.1 time: 0.250664 Jul 20 04:21:23.261438 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1410/2748] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:23 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1476 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:23.281972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-f4f1e42e-b1d9-409d-b757-610b3b37c60a req-eda63ed3-2641-47c3-94d5-e27546e4d983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "tag": "0e68e0df-9766-4b20-b15c-1fe9625a0d15"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:23.293482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f4f1e42e-b1d9-409d-b757-610b3b37c60a req-eda63ed3-2641-47c3-94d5-e27546e4d983 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.293937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f4f1e42e-b1d9-409d-b757-610b3b37c60a req-eda63ed3-2641-47c3-94d5-e27546e4d983 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.324882 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f4f1e42e-b1d9-409d-b757-610b3b37c60a req-eda63ed3-2641-47c3-94d5-e27546e4d983 service nova] Creating event network-changed:0e68e0df-9766-4b20-b15c-1fe9625a0d15 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:21:23.335790 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-f4f1e42e-b1d9-409d-b757-610b3b37c60a req-eda63ed3-2641-47c3-94d5-e27546e4d983 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072325 Jul 20 04:21:23.337220 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1411/2749] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:23.344087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2b5eb8fa-82c9-4d47-9d98-aa27be8239b2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.345134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2b5eb8fa-82c9-4d47-9d98-aa27be8239b2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.353001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b5eb8fa-82c9-4d47-9d98-aa27be8239b2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.353701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b5eb8fa-82c9-4d47-9d98-aa27be8239b2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.354655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b5eb8fa-82c9-4d47-9d98-aa27be8239b2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.355248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b5eb8fa-82c9-4d47-9d98-aa27be8239b2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.408900 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-2b5eb8fa-82c9-4d47-9d98-aa27be8239b2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2b5eb8fa-82c9-4d47-9d98-aa27be8239b2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f HTTP/1.1 Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ad081e26-4b6d-4baa-8173-83d0118cc42f'} Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:23.415711 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:23.420329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:21:23.420329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.420329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.420329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.420329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.420329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:23.420329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:23.420329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:23.420329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:23.420329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:21:23.420329 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.422826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2b5eb8fa-82c9-4d47-9d98-aa27be8239b2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:23.427974 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2b5eb8fa-82c9-4d47-9d98-aa27be8239b2 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 404 len: 111 microversion: 2.1 time: 0.089234 Jul 20 04:21:23.434853 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1412/2750] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:23 2022] DELETE /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:23.441426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f8a01034-e4ae-4439-9d34-8fa1c959531d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.442051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f8a01034-e4ae-4439-9d34-8fa1c959531d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: ad081e26-4b6d-4baa-8173-83d0118cc42f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.454896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8a01034-e4ae-4439-9d34-8fa1c959531d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.457788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8a01034-e4ae-4439-9d34-8fa1c959531d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.459489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8a01034-e4ae-4439-9d34-8fa1c959531d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.461717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8a01034-e4ae-4439-9d34-8fa1c959531d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.480012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7aa33d6d-40e5-44e7-8c53-70a229f39f43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.494095 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f8a01034-e4ae-4439-9d34-8fa1c959531d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f8a01034-e4ae-4439-9d34-8fa1c959531d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f HTTP/1.1 Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ad081e26-4b6d-4baa-8173-83d0118cc42f'} Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.495898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.499414 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.499414 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:23.499414 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:23.499414 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:23.499414 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:23.499414 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. Jul 20 04:21:23.499414 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.499414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f8a01034-e4ae-4439-9d34-8fa1c959531d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance ad081e26-4b6d-4baa-8173-83d0118cc42f could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:23.501380 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f8a01034-e4ae-4439-9d34-8fa1c959531d tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f" status: 404 len: 111 microversion: 2.1 time: 0.061298 Jul 20 04:21:23.501380 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1413/2751] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:23 2022] GET /compute/v2.1/servers/ad081e26-4b6d-4baa-8173-83d0118cc42f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:23.505626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7aa33d6d-40e5-44e7-8c53-70a229f39f43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.508350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7aa33d6d-40e5-44e7-8c53-70a229f39f43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.510314 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7aa33d6d-40e5-44e7-8c53-70a229f39f43 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.492298 Jul 20 04:21:23.511307 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1339/2752] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:23 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:23.516457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-66162d88-87b6-47ba-8380-3d3777f8c119 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.516967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-66162d88-87b6-47ba-8380-3d3777f8c119 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.524999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66162d88-87b6-47ba-8380-3d3777f8c119 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.525646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66162d88-87b6-47ba-8380-3d3777f8c119 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.526877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66162d88-87b6-47ba-8380-3d3777f8c119 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.527768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66162d88-87b6-47ba-8380-3d3777f8c119 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.550627 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-66162d88-87b6-47ba-8380-3d3777f8c119 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-66162d88-87b6-47ba-8380-3d3777f8c119 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b HTTP/1.1 Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a1a7d807-6862-4912-9ad7-a3e46de3ee3b'} Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:23.553309 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:23.557308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:21:23.557308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.557308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.557308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.557308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.557308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:23.557308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:23.557308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:23.557308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:23.557308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:21:23.557308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.559209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-66162d88-87b6-47ba-8380-3d3777f8c119 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:23.560291 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-66162d88-87b6-47ba-8380-3d3777f8c119 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 404 len: 111 microversion: 2.1 time: 0.054521 Jul 20 04:21:23.561510 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1414/2753] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:23 2022] DELETE /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:23.582253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6531e83-4fbb-4467-818d-89df86008118 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.583002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e6531e83-4fbb-4467-818d-89df86008118 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] [instance: a1a7d807-6862-4912-9ad7-a3e46de3ee3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.591865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1c47744c-8ae4-42e4-9144-d835d9906781 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.592527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1c47744c-8ae4-42e4-9144-d835d9906781 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.594576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:23.595964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6531e83-4fbb-4467-818d-89df86008118 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.597154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6531e83-4fbb-4467-818d-89df86008118 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.598261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6531e83-4fbb-4467-818d-89df86008118 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.598933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6531e83-4fbb-4467-818d-89df86008118 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.610264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c47744c-8ae4-42e4-9144-d835d9906781 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.610727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c47744c-8ae4-42e4-9144-d835d9906781 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.611535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c47744c-8ae4-42e4-9144-d835d9906781 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.612004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c47744c-8ae4-42e4-9144-d835d9906781 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.627161 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e6531e83-4fbb-4467-818d-89df86008118 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] HTTP exception thrown: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6531e83-4fbb-4467-818d-89df86008118 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Request method failure captured: Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b HTTP/1.1 Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14FLrHFxWLc7_7z6E2pYYhLRdUwF-ONzo-4ypIND8GsmX7hg4Rh_Kmr85pBdS_m1ub6VsE41-nXn6tIoU194IY5IJMGtwqA8CbFKicIzKMVmLEVmL7R1vW6MgKlQfc-Q8LwnRKL4sawkrf-9x1-ErCQ0sBp6uFB9Vk0cy0QDPIJgg-w Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43883ce179414508a380b92446797091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43883ce179414508a380b92446797091", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43883ce179414508a380b92446797091"}]}] Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 43883ce179414508a380b92446797091 Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-DeleteServersTestJSON-785985057 Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 793c626644204dc3a08ed9118c9aaf4c Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-DeleteServersTestJSON-785985057-project Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a1a7d807-6862-4912-9ad7-a3e46de3ee3b'} Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.629349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.633109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.633109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:23.633109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:23.633109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:23.633109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:23.633109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. Jul 20 04:21:23.633109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.638211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6531e83-4fbb-4467-818d-89df86008118 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] Returning 404 to user: Instance a1a7d807-6862-4912-9ad7-a3e46de3ee3b could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:23.639342 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e6531e83-4fbb-4467-818d-89df86008118 tempest-DeleteServersTestJSON-785985057 tempest-DeleteServersTestJSON-785985057-project] 10.222.0.20 "GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b" status: 404 len: 111 microversion: 2.1 time: 0.073895 Jul 20 04:21:23.641256 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1340/2754] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:23 2022] GET /compute/v2.1/servers/a1a7d807-6862-4912-9ad7-a3e46de3ee3b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:24.021426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3a078ef3-e28c-40a2-b391-268cc13001c7 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:24.022059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3a078ef3-e28c-40a2-b391-268cc13001c7 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:24.029301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a078ef3-e28c-40a2-b391-268cc13001c7 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.029758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a078ef3-e28c-40a2-b391-268cc13001c7 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.037654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a078ef3-e28c-40a2-b391-268cc13001c7 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.038680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a078ef3-e28c-40a2-b391-268cc13001c7 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.639828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1c47744c-8ae4-42e4-9144-d835d9906781 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:24.663241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1c47744c-8ae4-42e4-9144-d835d9906781 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:24.666796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1c47744c-8ae4-42e4-9144-d835d9906781 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:24.668137 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1c47744c-8ae4-42e4-9144-d835d9906781 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1880 microversion: 2.42 time: 1.087901 Jul 20 04:21:24.672959 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1415/2755] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:23 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1880 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:24.680368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-28084968-4844-4500-8a50-d1a2edd69dfb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:24.681262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-28084968-4844-4500-8a50-d1a2edd69dfb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:24.702981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28084968-4844-4500-8a50-d1a2edd69dfb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.705607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28084968-4844-4500-8a50-d1a2edd69dfb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.707489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28084968-4844-4500-8a50-d1a2edd69dfb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.708123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28084968-4844-4500-8a50-d1a2edd69dfb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.921610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3a078ef3-e28c-40a2-b391-268cc13001c7 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:24.936761 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3a078ef3-e28c-40a2-b391-268cc13001c7 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1371 microversion: 2.1 time: 0.919491 Jul 20 04:21:24.947199 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1341/2756] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:24 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1371 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:24.968466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a193cbe1-cb68-46db-86a8-60c79ab7303f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:24.973396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a193cbe1-cb68-46db-86a8-60c79ab7303f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:24.996666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a193cbe1-cb68-46db-86a8-60c79ab7303f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:25.009303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a193cbe1-cb68-46db-86a8-60c79ab7303f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:25.010822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a193cbe1-cb68-46db-86a8-60c79ab7303f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:25.011462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a193cbe1-cb68-46db-86a8-60c79ab7303f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:25.144463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a193cbe1-cb68-46db-86a8-60c79ab7303f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:25.147975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a193cbe1-cb68-46db-86a8-60c79ab7303f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:25.148739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-a193cbe1-cb68-46db-86a8-60c79ab7303f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lazy-loading 'fault' on Instance uuid 103ad850-c12a-4118-9600-9ea876ec5cdb {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:21:26.016823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a193cbe1-cb68-46db-86a8-60c79ab7303f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294c9ac9cb34e9387ce8f109ac3d819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1be6441272046629ac3840881e0148f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:26.025646 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a193cbe1-cb68-46db-86a8-60c79ab7303f tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 200 len: 1310 microversion: 2.1 time: 1.076958 Jul 20 04:21:26.026224 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1342/2757] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:24 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 1310 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:26.037167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-63282722-161a-47ff-8bfb-672cb9d4b165 req-5d79aeef-9163-468a-9aba-89eec5fa4062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5c32a2-e4d5-42ae-97c8-68123a555ec9", "tag": "b176f969-0f6e-4a2e-bc2b-d85011718eae"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:26.056870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-63282722-161a-47ff-8bfb-672cb9d4b165 req-5d79aeef-9163-468a-9aba-89eec5fa4062 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.057341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-63282722-161a-47ff-8bfb-672cb9d4b165 req-5d79aeef-9163-468a-9aba-89eec5fa4062 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.096639 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-63282722-161a-47ff-8bfb-672cb9d4b165 req-5d79aeef-9163-468a-9aba-89eec5fa4062 service nova] Creating event network-changed:b176f969-0f6e-4a2e-bc2b-d85011718eae for instance dd5c32a2-e4d5-42ae-97c8-68123a555ec9 on n-h2-764485-11 Jul 20 04:21:26.113358 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-63282722-161a-47ff-8bfb-672cb9d4b165 req-5d79aeef-9163-468a-9aba-89eec5fa4062 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080520 Jul 20 04:21:26.114035 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1343/2758] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:26.134636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3fd17503-7a00-4829-8446-899cd5912415 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:26.143943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3fd17503-7a00-4829-8446-899cd5912415 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:26.163599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fd17503-7a00-4829-8446-899cd5912415 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.164640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fd17503-7a00-4829-8446-899cd5912415 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.165697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fd17503-7a00-4829-8446-899cd5912415 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.171751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fd17503-7a00-4829-8446-899cd5912415 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.475065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-28084968-4844-4500-8a50-d1a2edd69dfb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:26.488012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-28084968-4844-4500-8a50-d1a2edd69dfb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:26.489538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-28084968-4844-4500-8a50-d1a2edd69dfb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:26.494480 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-28084968-4844-4500-8a50-d1a2edd69dfb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1848 microversion: 2.32 time: 1.820153 Jul 20 04:21:26.502400 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1416/2759] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:24 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1848 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:26.516200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-012c795b-9b85-48f4-88b5-ec30031ad26e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:26.517629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-012c795b-9b85-48f4-88b5-ec30031ad26e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:26.533408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-012c795b-9b85-48f4-88b5-ec30031ad26e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.533799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-012c795b-9b85-48f4-88b5-ec30031ad26e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.536542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-012c795b-9b85-48f4-88b5-ec30031ad26e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.537010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-012c795b-9b85-48f4-88b5-ec30031ad26e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.050582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3fd17503-7a00-4829-8446-899cd5912415 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:27.065207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3fd17503-7a00-4829-8446-899cd5912415 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:27.071758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3fd17503-7a00-4829-8446-899cd5912415 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:27.075179 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3fd17503-7a00-4829-8446-899cd5912415 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.954358 Jul 20 04:21:27.077916 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1344/2760] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:26 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:27.084434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d6e9b5c1-5cde-4e5f-af43-9e26c3f717f4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:27.086329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d6e9b5c1-5cde-4e5f-af43-9e26c3f717f4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:27.113637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6e9b5c1-5cde-4e5f-af43-9e26c3f717f4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.116246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6e9b5c1-5cde-4e5f-af43-9e26c3f717f4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.118120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6e9b5c1-5cde-4e5f-af43-9e26c3f717f4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.119469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6e9b5c1-5cde-4e5f-af43-9e26c3f717f4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.493285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-012c795b-9b85-48f4-88b5-ec30031ad26e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:27.519728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-012c795b-9b85-48f4-88b5-ec30031ad26e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:27.523470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-012c795b-9b85-48f4-88b5-ec30031ad26e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:27.526064 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-012c795b-9b85-48f4-88b5-ec30031ad26e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2837 microversion: 2.42 time: 1.022392 Jul 20 04:21:27.531586 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1417/2761] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:26 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2837 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:27.537397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91679f6a-69cd-4d16-ae28-064e3b55d9f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:27.539152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91679f6a-69cd-4d16-ae28-064e3b55d9f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] [instance: 103ad850-c12a-4118-9600-9ea876ec5cdb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:27.557699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91679f6a-69cd-4d16-ae28-064e3b55d9f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.563353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91679f6a-69cd-4d16-ae28-064e3b55d9f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.565807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91679f6a-69cd-4d16-ae28-064e3b55d9f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.567470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91679f6a-69cd-4d16-ae28-064e3b55d9f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.593551 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-91679f6a-69cd-4d16-ae28-064e3b55d9f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] HTTP exception thrown: Instance 103ad850-c12a-4118-9600-9ea876ec5cdb could not be found. Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91679f6a-69cd-4d16-ae28-064e3b55d9f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Request method failure captured: Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb HTTP/1.1 Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14I0oCE733hctV7j477z51pBM-dKAyFwwERSU8KUDq037AOZ16zUM-0bHFgZZvyZ7AAQonXs56Py8sY9rYGQXQppF74z890F5twIdoD1LOHy0tI5-luWGkfVJ9k5pKEEtnZ4Ni4TGQxfC0lm1LN9MKeDlqL3ZtxqQ5XSmVVO4n0LVco Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: c1be6441272046629ac3840881e0148f Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ListServerFiltersTestJSON-560985529 Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c1be6441272046629ac3840881e0148f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c1be6441272046629ac3840881e0148f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c1be6441272046629ac3840881e0148f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c1be6441272046629ac3840881e0148f"}]}] Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ListServerFiltersTestJSON-560985529 Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: c1be6441272046629ac3840881e0148f Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-560985529 Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ListServerFiltersTestJSON-560985529-project Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 6294c9ac9cb34e9387ce8f109ac3d819 Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ListServerFiltersTestJSON-560985529-project Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 103ad850-c12a-4118-9600-9ea876ec5cdb could not be found. Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '103ad850-c12a-4118-9600-9ea876ec5cdb'} Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 103ad850-c12a-4118-9600-9ea876ec5cdb could not be found. Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 103ad850-c12a-4118-9600-9ea876ec5cdb could not be found. Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:27.595871 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:27.600898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:27.600898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:27.600898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:27.600898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:27.600898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:27.600898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103ad850-c12a-4118-9600-9ea876ec5cdb could not be found. Jul 20 04:21:27.600898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:21:27.603896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91679f6a-69cd-4d16-ae28-064e3b55d9f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] Returning 404 to user: Instance 103ad850-c12a-4118-9600-9ea876ec5cdb could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:27.604994 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91679f6a-69cd-4d16-ae28-064e3b55d9f2 tempest-ListServerFiltersTestJSON-560985529 tempest-ListServerFiltersTestJSON-560985529-project] 10.222.0.20 "GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb" status: 404 len: 111 microversion: 2.1 time: 0.072030 Jul 20 04:21:27.606141 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1418/2762] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:27 2022] GET /compute/v2.1/servers/103ad850-c12a-4118-9600-9ea876ec5cdb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:27.611329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c380f9f0-66fa-4bff-a56e-995ce6636ac3 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:27.612866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c380f9f0-66fa-4bff-a56e-995ce6636ac3 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:27.619836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c380f9f0-66fa-4bff-a56e-995ce6636ac3 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.620596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c380f9f0-66fa-4bff-a56e-995ce6636ac3 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.621549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c380f9f0-66fa-4bff-a56e-995ce6636ac3 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.622193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c380f9f0-66fa-4bff-a56e-995ce6636ac3 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.449341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d6e9b5c1-5cde-4e5f-af43-9e26c3f717f4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:28.458307 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d6e9b5c1-5cde-4e5f-af43-9e26c3f717f4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1371 microversion: 2.1 time: 1.378949 Jul 20 04:21:28.468285 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1345/2763] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:27 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1371 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:28.474860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-49dbc618-fe01-4a19-8e52-5f5f030bd4b3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:28.474968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-49dbc618-fe01-4a19-8e52-5f5f030bd4b3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:28.513229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49dbc618-fe01-4a19-8e52-5f5f030bd4b3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:28.513705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49dbc618-fe01-4a19-8e52-5f5f030bd4b3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.516153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49dbc618-fe01-4a19-8e52-5f5f030bd4b3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:28.516613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49dbc618-fe01-4a19-8e52-5f5f030bd4b3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.596109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:29.420925 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-49dbc618-fe01-4a19-8e52-5f5f030bd4b3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.956070 Jul 20 04:21:29.422902 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1346/2764] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Jul 20 04:21:28 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f/os-interface => generated 1831 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:29.428153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a0f77a5c-ad95-48d1-a95c-cd73d82f8dc5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:29.429899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a0f77a5c-ad95-48d1-a95c-cd73d82f8dc5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:29.453632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0f77a5c-ad95-48d1-a95c-cd73d82f8dc5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.454845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0f77a5c-ad95-48d1-a95c-cd73d82f8dc5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.455938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0f77a5c-ad95-48d1-a95c-cd73d82f8dc5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.457753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0f77a5c-ad95-48d1-a95c-cd73d82f8dc5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.807661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c380f9f0-66fa-4bff-a56e-995ce6636ac3 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:29.818213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c380f9f0-66fa-4bff-a56e-995ce6636ac3 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:29.829966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c380f9f0-66fa-4bff-a56e-995ce6636ac3 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:29.834079 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c380f9f0-66fa-4bff-a56e-995ce6636ac3 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1869 microversion: 2.32 time: 2.226586 Jul 20 04:21:29.850371 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1419/2765] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:27 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1869 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:29.862050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-42f485aa-efe2-41c8-aa97-0556e429aa27 req-265dd133-812c-4930-b28f-047d14f22429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d80a59-9d6b-4b94-a643-8f6727f50511", "name": "network-vif-unplugged", "status": "completed", "tag": "a43b1718-8133-4ab5-802a-5f461293d0fd"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:29.897710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-42f485aa-efe2-41c8-aa97-0556e429aa27 req-265dd133-812c-4930-b28f-047d14f22429 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.898530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-42f485aa-efe2-41c8-aa97-0556e429aa27 req-265dd133-812c-4930-b28f-047d14f22429 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.942002 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-42f485aa-efe2-41c8-aa97-0556e429aa27 req-265dd133-812c-4930-b28f-047d14f22429 service nova] Creating event network-vif-unplugged:a43b1718-8133-4ab5-802a-5f461293d0fd for instance 57d80a59-9d6b-4b94-a643-8f6727f50511 on n-h2-764485-11 Jul 20 04:21:29.954832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a0f77a5c-ad95-48d1-a95c-cd73d82f8dc5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:29.968203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a0f77a5c-ad95-48d1-a95c-cd73d82f8dc5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:29.970990 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-42f485aa-efe2-41c8-aa97-0556e429aa27 req-265dd133-812c-4930-b28f-047d14f22429 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128407 Jul 20 04:21:29.973342 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1420/2766] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:29.977296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a0f77a5c-ad95-48d1-a95c-cd73d82f8dc5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:29.982027 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a0f77a5c-ad95-48d1-a95c-cd73d82f8dc5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.555070 Jul 20 04:21:29.985224 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1347/2767] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:29 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:29.988054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c4d353a4-9662-4675-9abc-df043f1109e4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:29.989415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c4d353a4-9662-4675-9abc-df043f1109e4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:29.997270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4d353a4-9662-4675-9abc-df043f1109e4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.998514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4d353a4-9662-4675-9abc-df043f1109e4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.999688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4d353a4-9662-4675-9abc-df043f1109e4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.000414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4d353a4-9662-4675-9abc-df043f1109e4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.360282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0dd1740c-3e72-4d41-83f9-7957036a9b3a req-f20d7800-9054-4a6c-ac1f-4bd00ad010a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70e7012-a311-486b-9035-cb4ccdd2afde", "name": "network-vif-plugged", "status": "completed", "tag": "e163d8ed-10b5-4120-bc98-b65fc837fe7f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:30.387853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0dd1740c-3e72-4d41-83f9-7957036a9b3a req-f20d7800-9054-4a6c-ac1f-4bd00ad010a6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.389312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0dd1740c-3e72-4d41-83f9-7957036a9b3a req-f20d7800-9054-4a6c-ac1f-4bd00ad010a6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.442519 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0dd1740c-3e72-4d41-83f9-7957036a9b3a req-f20d7800-9054-4a6c-ac1f-4bd00ad010a6 service nova] Creating event network-vif-plugged:e163d8ed-10b5-4120-bc98-b65fc837fe7f for instance a70e7012-a311-486b-9035-cb4ccdd2afde on n-h1-764485-11 Jul 20 04:21:30.466596 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0dd1740c-3e72-4d41-83f9-7957036a9b3a req-f20d7800-9054-4a6c-ac1f-4bd00ad010a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109696 Jul 20 04:21:30.483440 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1348/2768] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:21:30.620908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c4d353a4-9662-4675-9abc-df043f1109e4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:30.630892 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c4d353a4-9662-4675-9abc-df043f1109e4 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1371 microversion: 2.1 time: 0.654896 Jul 20 04:21:30.633524 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1421/2769] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:29 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1371 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:30.859382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0c5a6b3d-309b-49fd-af55-2e322a40a28f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:30.860696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0c5a6b3d-309b-49fd-af55-2e322a40a28f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:30.869844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c5a6b3d-309b-49fd-af55-2e322a40a28f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.870594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c5a6b3d-309b-49fd-af55-2e322a40a28f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.871937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c5a6b3d-309b-49fd-af55-2e322a40a28f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.872570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c5a6b3d-309b-49fd-af55-2e322a40a28f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.013429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-062fb8d0-1691-4d04-bd4f-288f3e52c45f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:31.014960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-062fb8d0-1691-4d04-bd4f-288f3e52c45f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:31.022831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-062fb8d0-1691-4d04-bd4f-288f3e52c45f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.023918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-062fb8d0-1691-4d04-bd4f-288f3e52c45f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.025569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-062fb8d0-1691-4d04-bd4f-288f3e52c45f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.026404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-062fb8d0-1691-4d04-bd4f-288f3e52c45f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.671963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-062fb8d0-1691-4d04-bd4f-288f3e52c45f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.672395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0c5a6b3d-309b-49fd-af55-2e322a40a28f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.692296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0c5a6b3d-309b-49fd-af55-2e322a40a28f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.692969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-062fb8d0-1691-4d04-bd4f-288f3e52c45f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.697650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0c5a6b3d-309b-49fd-af55-2e322a40a28f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.699024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-062fb8d0-1691-4d04-bd4f-288f3e52c45f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.700284 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0c5a6b3d-309b-49fd-af55-2e322a40a28f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1857 microversion: 2.32 time: 0.846144 Jul 20 04:21:31.701902 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-062fb8d0-1691-4d04-bd4f-288f3e52c45f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.692440 Jul 20 04:21:31.703089 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1349/2770] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:30 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1857 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:31.709291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-bb8459e8-2eab-49eb-b102-7614c6bfcaa2 req-90eef193-7507-4a6e-8030-99946dc3971d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "tag": "0f94531b-fcec-4091-9be6-24327def4b79"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:31.719637 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1422/2771] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:31 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:21:31.725327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-bb8459e8-2eab-49eb-b102-7614c6bfcaa2 req-90eef193-7507-4a6e-8030-99946dc3971d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.725793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-bb8459e8-2eab-49eb-b102-7614c6bfcaa2 req-90eef193-7507-4a6e-8030-99946dc3971d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.728162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9a249640-b149-4ba8-9caf-67c906b77f67 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:31.729033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9a249640-b149-4ba8-9caf-67c906b77f67 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:31.742403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a249640-b149-4ba8-9caf-67c906b77f67 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.747055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a249640-b149-4ba8-9caf-67c906b77f67 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.753854 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-bb8459e8-2eab-49eb-b102-7614c6bfcaa2 req-90eef193-7507-4a6e-8030-99946dc3971d service nova] Creating event network-changed:0f94531b-fcec-4091-9be6-24327def4b79 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:21:31.754727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a249640-b149-4ba8-9caf-67c906b77f67 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.758166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a249640-b149-4ba8-9caf-67c906b77f67 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.760894 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-bb8459e8-2eab-49eb-b102-7614c6bfcaa2 req-90eef193-7507-4a6e-8030-99946dc3971d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056405 Jul 20 04:21:31.762937 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1350/2772] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:32.008879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-17735479-5742-4ce3-b6a0-fdf78d9567bc req-a14f5d04-64ac-4732-a101-9f6e44ee0dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d80a59-9d6b-4b94-a643-8f6727f50511", "tag": "a43b1718-8133-4ab5-802a-5f461293d0fd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:32.033016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-17735479-5742-4ce3-b6a0-fdf78d9567bc req-a14f5d04-64ac-4732-a101-9f6e44ee0dc8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.035106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-17735479-5742-4ce3-b6a0-fdf78d9567bc req-a14f5d04-64ac-4732-a101-9f6e44ee0dc8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.068909 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-17735479-5742-4ce3-b6a0-fdf78d9567bc req-a14f5d04-64ac-4732-a101-9f6e44ee0dc8 service nova] Creating event network-changed:a43b1718-8133-4ab5-802a-5f461293d0fd for instance 57d80a59-9d6b-4b94-a643-8f6727f50511 on n-h2-764485-11 Jul 20 04:21:32.084976 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-17735479-5742-4ce3-b6a0-fdf78d9567bc req-a14f5d04-64ac-4732-a101-9f6e44ee0dc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081730 Jul 20 04:21:32.088323 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1351/2773] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:21:32.247948 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9a249640-b149-4ba8-9caf-67c906b77f67 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:32.286202 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9a249640-b149-4ba8-9caf-67c906b77f67 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1371 microversion: 2.1 time: 0.536533 Jul 20 04:21:32.290773 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1423/2774] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:31 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1371 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:32.725874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d0ddf740-4dbe-4200-8155-1d271e2a66d1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:32.740354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d0ddf740-4dbe-4200-8155-1d271e2a66d1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:32.744223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a3ffb6cc-c9b7-4152-9755-1d1672f8bde1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:32.748254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a3ffb6cc-c9b7-4152-9755-1d1672f8bde1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:32.769381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d0ddf740-4dbe-4200-8155-1d271e2a66d1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.769550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3ffb6cc-c9b7-4152-9755-1d1672f8bde1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.769874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3ffb6cc-c9b7-4152-9755-1d1672f8bde1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.770010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d0ddf740-4dbe-4200-8155-1d271e2a66d1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.770672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3ffb6cc-c9b7-4152-9755-1d1672f8bde1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.774297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d0ddf740-4dbe-4200-8155-1d271e2a66d1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.774792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3ffb6cc-c9b7-4152-9755-1d1672f8bde1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.776368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d0ddf740-4dbe-4200-8155-1d271e2a66d1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.512594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a3ffb6cc-c9b7-4152-9755-1d1672f8bde1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:33.535457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a3ffb6cc-c9b7-4152-9755-1d1672f8bde1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:33.541383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a3ffb6cc-c9b7-4152-9755-1d1672f8bde1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:33.548156 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a3ffb6cc-c9b7-4152-9755-1d1672f8bde1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.812275 Jul 20 04:21:33.561028 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1424/2775] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:32 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:33.566024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3cfccd22-c25a-4d99-b415-b812e24bbfbb tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:33.566638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3cfccd22-c25a-4d99-b415-b812e24bbfbb tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:33.598285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cfccd22-c25a-4d99-b415-b812e24bbfbb tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.598930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cfccd22-c25a-4d99-b415-b812e24bbfbb tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.599917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cfccd22-c25a-4d99-b415-b812e24bbfbb tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.600449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d0ddf740-4dbe-4200-8155-1d271e2a66d1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:33.600772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cfccd22-c25a-4d99-b415-b812e24bbfbb tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.621070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d0ddf740-4dbe-4200-8155-1d271e2a66d1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:33.625291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d0ddf740-4dbe-4200-8155-1d271e2a66d1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:33.626841 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d0ddf740-4dbe-4200-8155-1d271e2a66d1 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.909037 Jul 20 04:21:33.641469 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1352/2776] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:32 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:33.817497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-900085886", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": "none"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:33.885628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:33.886824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:33.887580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:33.888227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:33.889133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:33.902753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.903606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.904684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.905356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.934647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Getting quotas for project 01358b0931324052b21d7ec3a93c21c7. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:33.941388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Getting quotas for user 081ac197624348559fe831ca71586a46 and project 01358b0931324052b21d7ec3a93c21c7. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:33.960419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:33.963049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:34.017542 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-47c6877a-6417-4745-99d7-783b72f88905 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.374395 Jul 20 04:21:34.018778 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1353/2777] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:21:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:21:34.031376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2e8488f6-7732-4f49-9c2c-baf7e1e18bc9 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:34.032044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2e8488f6-7732-4f49-9c2c-baf7e1e18bc9 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:34.329591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2e8488f6-7732-4f49-9c2c-baf7e1e18bc9 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:34.344202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2e8488f6-7732-4f49-9c2c-baf7e1e18bc9 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:34.351271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2e8488f6-7732-4f49-9c2c-baf7e1e18bc9 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:34.353313 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2e8488f6-7732-4f49-9c2c-baf7e1e18bc9 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f" status: 200 len: 1280 microversion: 2.47 time: 0.327431 Jul 20 04:21:34.360354 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1354/2778] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:34 2022] GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f => generated 1280 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:21:34.366348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b5a59da6-3240-4694-84b8-0f29def91b46 req-a2ee17bb-809a-436f-8426-7d3a09d77ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "tag": "5477bec5-e7f2-4638-a405-8b50b8e83faa"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:34.389675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b5a59da6-3240-4694-84b8-0f29def91b46 req-a2ee17bb-809a-436f-8426-7d3a09d77ae0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.390166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b5a59da6-3240-4694-84b8-0f29def91b46 req-a2ee17bb-809a-436f-8426-7d3a09d77ae0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.411606 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b5a59da6-3240-4694-84b8-0f29def91b46 req-a2ee17bb-809a-436f-8426-7d3a09d77ae0 service nova] Creating event network-changed:5477bec5-e7f2-4638-a405-8b50b8e83faa for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:21:34.418492 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b5a59da6-3240-4694-84b8-0f29def91b46 req-a2ee17bb-809a-436f-8426-7d3a09d77ae0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056536 Jul 20 04:21:34.419389 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1355/2779] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:34.572066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86ea55b6-8cbb-4c37-8dcc-a63f745270d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:34.573207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-86ea55b6-8cbb-4c37-8dcc-a63f745270d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:34.590332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86ea55b6-8cbb-4c37-8dcc-a63f745270d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.593092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86ea55b6-8cbb-4c37-8dcc-a63f745270d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.594218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86ea55b6-8cbb-4c37-8dcc-a63f745270d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.596756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86ea55b6-8cbb-4c37-8dcc-a63f745270d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.679498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3cfccd22-c25a-4d99-b415-b812e24bbfbb tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:34.694375 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3cfccd22-c25a-4d99-b415-b812e24bbfbb tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1557 microversion: 2.1 time: 1.129974 Jul 20 04:21:34.698177 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1425/2780] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:33 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1557 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:34.703189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-396b4876-e6c0-4684-afcb-768a81a97489 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:34.704344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-396b4876-e6c0-4684-afcb-768a81a97489 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:34.714216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-396b4876-e6c0-4684-afcb-768a81a97489 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.715337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-396b4876-e6c0-4684-afcb-768a81a97489 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.717646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-396b4876-e6c0-4684-afcb-768a81a97489 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.718300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-396b4876-e6c0-4684-afcb-768a81a97489 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:35.249433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-86ea55b6-8cbb-4c37-8dcc-a63f745270d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:35.263017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-86ea55b6-8cbb-4c37-8dcc-a63f745270d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:35.265201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-86ea55b6-8cbb-4c37-8dcc-a63f745270d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:35.269293 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-86ea55b6-8cbb-4c37-8dcc-a63f745270d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.703565 Jul 20 04:21:35.280811 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1356/2781] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:34 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:35.285956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-91c9e213-28b4-4a84-a27f-c9ce3f5c07d0 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:35.286835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-91c9e213-28b4-4a84-a27f-c9ce3f5c07d0 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:35.297068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91c9e213-28b4-4a84-a27f-c9ce3f5c07d0 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:35.297552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91c9e213-28b4-4a84-a27f-c9ce3f5c07d0 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:35.298350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91c9e213-28b4-4a84-a27f-c9ce3f5c07d0 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:35.298854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91c9e213-28b4-4a84-a27f-c9ce3f5c07d0 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:35.308236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-396b4876-e6c0-4684-afcb-768a81a97489 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:35.318156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-396b4876-e6c0-4684-afcb-768a81a97489 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:35.320697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-396b4876-e6c0-4684-afcb-768a81a97489 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:35.321928 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-396b4876-e6c0-4684-afcb-768a81a97489 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.622672 Jul 20 04:21:35.322509 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1426/2782] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:34 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:35.337993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-dc155949-8e90-4412-8376-1bef8972c19b req-a770ef48-92d9-406a-b878-b28542ad1259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "tag": "ed815642-7555-4590-a5fa-6a3dedab8275"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:35.348309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dc155949-8e90-4412-8376-1bef8972c19b req-a770ef48-92d9-406a-b878-b28542ad1259 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:35.348846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dc155949-8e90-4412-8376-1bef8972c19b req-a770ef48-92d9-406a-b878-b28542ad1259 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:35.361639 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-dc155949-8e90-4412-8376-1bef8972c19b req-a770ef48-92d9-406a-b878-b28542ad1259 service nova] Creating event network-changed:ed815642-7555-4590-a5fa-6a3dedab8275 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:21:35.369520 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-dc155949-8e90-4412-8376-1bef8972c19b req-a770ef48-92d9-406a-b878-b28542ad1259 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035571 Jul 20 04:21:35.370638 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1427/2783] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:35.378284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-22fa19fe-1dea-43b0-bea9-dd1f19f95056 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:35.378997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-22fa19fe-1dea-43b0-bea9-dd1f19f95056 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:35.388726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22fa19fe-1dea-43b0-bea9-dd1f19f95056 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:35.389472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22fa19fe-1dea-43b0-bea9-dd1f19f95056 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:35.390521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22fa19fe-1dea-43b0-bea9-dd1f19f95056 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:35.390966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22fa19fe-1dea-43b0-bea9-dd1f19f95056 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:35.488451 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-91c9e213-28b4-4a84-a27f-c9ce3f5c07d0 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.206567 Jul 20 04:21:35.489379 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1357/2784] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:21:35 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:35.528602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-22fa19fe-1dea-43b0-bea9-dd1f19f95056 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:35.532818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:35.548772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-22fa19fe-1dea-43b0-bea9-dd1f19f95056 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:35.554121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-22fa19fe-1dea-43b0-bea9-dd1f19f95056 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:35.561144 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-22fa19fe-1dea-43b0-bea9-dd1f19f95056 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f" status: 200 len: 1332 microversion: 2.47 time: 0.188890 Jul 20 04:21:35.563997 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1428/2785] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:35 2022] GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f => generated 1332 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:36.293414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-71a9bdee-8055-48ca-84c3-d87cd0177bd9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:36.294617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-71a9bdee-8055-48ca-84c3-d87cd0177bd9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:36.302417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71a9bdee-8055-48ca-84c3-d87cd0177bd9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:36.303402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71a9bdee-8055-48ca-84c3-d87cd0177bd9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.304414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71a9bdee-8055-48ca-84c3-d87cd0177bd9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:36.305076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71a9bdee-8055-48ca-84c3-d87cd0177bd9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.345664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c0a4c63a-642c-4162-bdd5-58378911d73c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:36.346943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c0a4c63a-642c-4162-bdd5-58378911d73c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:36.364607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0a4c63a-642c-4162-bdd5-58378911d73c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:36.369973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0a4c63a-642c-4162-bdd5-58378911d73c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.375275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0a4c63a-642c-4162-bdd5-58378911d73c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:36.383162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0a4c63a-642c-4162-bdd5-58378911d73c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.877569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-71a9bdee-8055-48ca-84c3-d87cd0177bd9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:36.909916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-71a9bdee-8055-48ca-84c3-d87cd0177bd9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:36.915277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-71a9bdee-8055-48ca-84c3-d87cd0177bd9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:36.917534 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-71a9bdee-8055-48ca-84c3-d87cd0177bd9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.631788 Jul 20 04:21:36.932033 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1358/2786] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:36 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:36.941162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b49d398e-740a-4b18-acda-3435f0fc23bf tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:36.941162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b49d398e-740a-4b18-acda-3435f0fc23bf tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:36.948011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b49d398e-740a-4b18-acda-3435f0fc23bf tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:36.948880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b49d398e-740a-4b18-acda-3435f0fc23bf tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.950257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b49d398e-740a-4b18-acda-3435f0fc23bf tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:36.951147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b49d398e-740a-4b18-acda-3435f0fc23bf tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.962563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c0a4c63a-642c-4162-bdd5-58378911d73c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:36.978073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c0a4c63a-642c-4162-bdd5-58378911d73c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:36.981222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c0a4c63a-642c-4162-bdd5-58378911d73c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:36.985375 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c0a4c63a-642c-4162-bdd5-58378911d73c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.644076 Jul 20 04:21:36.989715 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1429/2787] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:36 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:37.217185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b49d398e-740a-4b18-acda-3435f0fc23bf tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:37.242097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b49d398e-740a-4b18-acda-3435f0fc23bf tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:37.244606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b49d398e-740a-4b18-acda-3435f0fc23bf tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:37.245823 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b49d398e-740a-4b18-acda-3435f0fc23bf tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f" status: 200 len: 1338 microversion: 2.47 time: 0.312172 Jul 20 04:21:37.246410 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1359/2788] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:36 2022] GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f => generated 1338 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:37.421252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6c7de61f-aa02-4667-a9b5-b9d23a051a8c req-9d1f8a11-b747-4cdb-8bdb-97eac1ec3c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "tag": "fc8882d0-d375-49a4-bfcc-f16a0141386d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:37.442003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6c7de61f-aa02-4667-a9b5-b9d23a051a8c req-9d1f8a11-b747-4cdb-8bdb-97eac1ec3c32 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.442469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6c7de61f-aa02-4667-a9b5-b9d23a051a8c req-9d1f8a11-b747-4cdb-8bdb-97eac1ec3c32 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.491636 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6c7de61f-aa02-4667-a9b5-b9d23a051a8c req-9d1f8a11-b747-4cdb-8bdb-97eac1ec3c32 service nova] Creating event network-changed:fc8882d0-d375-49a4-bfcc-f16a0141386d for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:21:37.508481 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6c7de61f-aa02-4667-a9b5-b9d23a051a8c req-9d1f8a11-b747-4cdb-8bdb-97eac1ec3c32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091298 Jul 20 04:21:37.516653 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1430/2789] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:37.939666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cbec0f50-7988-42c7-815f-fc7553fa2137 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:37.940427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cbec0f50-7988-42c7-815f-fc7553fa2137 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:37.944848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:37.956363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cbec0f50-7988-42c7-815f-fc7553fa2137 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.957707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cbec0f50-7988-42c7-815f-fc7553fa2137 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.958785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cbec0f50-7988-42c7-815f-fc7553fa2137 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.962035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cbec0f50-7988-42c7-815f-fc7553fa2137 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.009835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9d35669-3977-45a8-992c-16c4c8d97bce tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:38.011039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9d35669-3977-45a8-992c-16c4c8d97bce tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:38.018486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9d35669-3977-45a8-992c-16c4c8d97bce tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:38.019248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9d35669-3977-45a8-992c-16c4c8d97bce tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.020317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9d35669-3977-45a8-992c-16c4c8d97bce tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:38.021149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9d35669-3977-45a8-992c-16c4c8d97bce tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.393070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cbec0f50-7988-42c7-815f-fc7553fa2137 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.410400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cbec0f50-7988-42c7-815f-fc7553fa2137 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.413168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cbec0f50-7988-42c7-815f-fc7553fa2137 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.415644 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cbec0f50-7988-42c7-815f-fc7553fa2137 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.479695 Jul 20 04:21:38.423359 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1360/2790] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:37 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:38.428674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f63df0e1-5ed7-4f92-9a2a-5ffe00b7cd11 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:38.429519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f63df0e1-5ed7-4f92-9a2a-5ffe00b7cd11 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:38.446640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f63df0e1-5ed7-4f92-9a2a-5ffe00b7cd11 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:38.447105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f63df0e1-5ed7-4f92-9a2a-5ffe00b7cd11 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.447914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f63df0e1-5ed7-4f92-9a2a-5ffe00b7cd11 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:38.448354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f63df0e1-5ed7-4f92-9a2a-5ffe00b7cd11 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.480332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9d35669-3977-45a8-992c-16c4c8d97bce tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.497984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9d35669-3977-45a8-992c-16c4c8d97bce tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.501242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9d35669-3977-45a8-992c-16c4c8d97bce tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.504161 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9d35669-3977-45a8-992c-16c4c8d97bce tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.499812 Jul 20 04:21:38.518357 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1431/2791] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:38 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:21:38.557778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f63df0e1-5ed7-4f92-9a2a-5ffe00b7cd11 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.567418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f63df0e1-5ed7-4f92-9a2a-5ffe00b7cd11 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.570537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f63df0e1-5ed7-4f92-9a2a-5ffe00b7cd11 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.572193 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f63df0e1-5ed7-4f92-9a2a-5ffe00b7cd11 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f" status: 200 len: 1338 microversion: 2.47 time: 0.147540 Jul 20 04:21:38.573125 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1361/2792] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:38 2022] GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f => generated 1338 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:38.696053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-7467f294-b605-4214-adaa-167efc7ea564 req-f555e73f-76ae-4bf2-921a-f44656ea4722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70e7012-a311-486b-9035-cb4ccdd2afde", "tag": "e163d8ed-10b5-4120-bc98-b65fc837fe7f"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:38.710356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7467f294-b605-4214-adaa-167efc7ea564 req-f555e73f-76ae-4bf2-921a-f44656ea4722 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:38.714294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7467f294-b605-4214-adaa-167efc7ea564 req-f555e73f-76ae-4bf2-921a-f44656ea4722 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.751845 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7467f294-b605-4214-adaa-167efc7ea564 req-f555e73f-76ae-4bf2-921a-f44656ea4722 service nova] Creating event network-changed:e163d8ed-10b5-4120-bc98-b65fc837fe7f for instance a70e7012-a311-486b-9035-cb4ccdd2afde on n-h1-764485-11 Jul 20 04:21:38.768846 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-7467f294-b605-4214-adaa-167efc7ea564 req-f555e73f-76ae-4bf2-921a-f44656ea4722 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074904 Jul 20 04:21:38.771083 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1432/2793] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:39.265749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e73f527f-4ac7-47fc-855f-627e23d665be req-877b3bb6-549c-419b-b0da-8de4535d4309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d80a59-9d6b-4b94-a643-8f6727f50511", "name": "network-vif-unplugged", "status": "completed", "tag": "a43b1718-8133-4ab5-802a-5f461293d0fd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:39.290613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e73f527f-4ac7-47fc-855f-627e23d665be req-877b3bb6-549c-419b-b0da-8de4535d4309 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.294981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e73f527f-4ac7-47fc-855f-627e23d665be req-877b3bb6-549c-419b-b0da-8de4535d4309 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.340314 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e73f527f-4ac7-47fc-855f-627e23d665be req-877b3bb6-549c-419b-b0da-8de4535d4309 service nova] Creating event network-vif-unplugged:a43b1718-8133-4ab5-802a-5f461293d0fd for instance 57d80a59-9d6b-4b94-a643-8f6727f50511 on n-h2-764485-11 Jul 20 04:21:39.360197 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e73f527f-4ac7-47fc-855f-627e23d665be req-877b3bb6-549c-419b-b0da-8de4535d4309 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098969 Jul 20 04:21:39.360832 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1362/2794] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:39.440969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2308b90-fd1c-47fd-baea-8c6d4b9dd92f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.442795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f2308b90-fd1c-47fd-baea-8c6d4b9dd92f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:39.465534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2308b90-fd1c-47fd-baea-8c6d4b9dd92f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.466007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2308b90-fd1c-47fd-baea-8c6d4b9dd92f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.473195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2308b90-fd1c-47fd-baea-8c6d4b9dd92f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.474412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2308b90-fd1c-47fd-baea-8c6d4b9dd92f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.526967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0adcefad-f8d3-47d4-91db-3e7b9af105ee tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.527925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0adcefad-f8d3-47d4-91db-3e7b9af105ee tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:39.547345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0adcefad-f8d3-47d4-91db-3e7b9af105ee tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.547855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0adcefad-f8d3-47d4-91db-3e7b9af105ee tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.548655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0adcefad-f8d3-47d4-91db-3e7b9af105ee tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.552911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0adcefad-f8d3-47d4-91db-3e7b9af105ee tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:40.457252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f2308b90-fd1c-47fd-baea-8c6d4b9dd92f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.470250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f2308b90-fd1c-47fd-baea-8c6d4b9dd92f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.481125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f2308b90-fd1c-47fd-baea-8c6d4b9dd92f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.482623 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f2308b90-fd1c-47fd-baea-8c6d4b9dd92f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 1.051779 Jul 20 04:21:40.483386 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1433/2795] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:39 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:40.495071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-0389b941-b23c-4a23-ab88-98ac2f353042 req-e2e6fe57-85b6-4b97-86a5-f77e6cfcffcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "tag": "a5a8eb43-fc76-4f14-ba26-ef8b675f4786"}, {"name": "network-changed", "server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "tag": "97289e02-4c46-41f5-8198-449586f93c1d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:40.524463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0389b941-b23c-4a23-ab88-98ac2f353042 req-e2e6fe57-85b6-4b97-86a5-f77e6cfcffcb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:40.526136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0389b941-b23c-4a23-ab88-98ac2f353042 req-e2e6fe57-85b6-4b97-86a5-f77e6cfcffcb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:40.553348 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-0389b941-b23c-4a23-ab88-98ac2f353042 req-e2e6fe57-85b6-4b97-86a5-f77e6cfcffcb service nova] Creating event network-changed:a5a8eb43-fc76-4f14-ba26-ef8b675f4786 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:21:40.556245 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-0389b941-b23c-4a23-ab88-98ac2f353042 req-e2e6fe57-85b6-4b97-86a5-f77e6cfcffcb service nova] Creating event network-changed:97289e02-4c46-41f5-8198-449586f93c1d for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:21:40.566577 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-0389b941-b23c-4a23-ab88-98ac2f353042 req-e2e6fe57-85b6-4b97-86a5-f77e6cfcffcb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.078620 Jul 20 04:21:40.571669 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1434/2796] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:40.581949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ff219fc2-0d80-4cbf-8d42-502fc519f744 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:40.586757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ff219fc2-0d80-4cbf-8d42-502fc519f744 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:40.616896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff219fc2-0d80-4cbf-8d42-502fc519f744 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:40.617363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff219fc2-0d80-4cbf-8d42-502fc519f744 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:40.628844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff219fc2-0d80-4cbf-8d42-502fc519f744 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:40.640033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff219fc2-0d80-4cbf-8d42-502fc519f744 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:40.651167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0adcefad-f8d3-47d4-91db-3e7b9af105ee tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.670572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0adcefad-f8d3-47d4-91db-3e7b9af105ee tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.681778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0adcefad-f8d3-47d4-91db-3e7b9af105ee tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.687945 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0adcefad-f8d3-47d4-91db-3e7b9af105ee tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 1.167045 Jul 20 04:21:40.691120 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1363/2797] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:39 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:40.820321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ff219fc2-0d80-4cbf-8d42-502fc519f744 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.828727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ff219fc2-0d80-4cbf-8d42-502fc519f744 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.830238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ff219fc2-0d80-4cbf-8d42-502fc519f744 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.847851 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ff219fc2-0d80-4cbf-8d42-502fc519f744 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f" status: 200 len: 1359 microversion: 2.47 time: 0.270621 Jul 20 04:21:40.848629 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1435/2798] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:40 2022] GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:40.868386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a34f023c-e9e7-4eab-96c2-0f4311e8cf48 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-260050877"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:40.870119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a34f023c-e9e7-4eab-96c2-0f4311e8cf48 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:40.879730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a34f023c-e9e7-4eab-96c2-0f4311e8cf48 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:40.880946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a34f023c-e9e7-4eab-96c2-0f4311e8cf48 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:40.887253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a34f023c-e9e7-4eab-96c2-0f4311e8cf48 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:40.888315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a34f023c-e9e7-4eab-96c2-0f4311e8cf48 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.461859 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a34f023c-e9e7-4eab-96c2-0f4311e8cf48 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "POST /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f/action" status: 202 len: 52 microversion: 2.47 time: 0.598093 Jul 20 04:21:41.474601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bd6731c0-a44e-43e4-86c1-f8bc59508724 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:41.475255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bd6731c0-a44e-43e4-86c1-f8bc59508724 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:41.479755 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1364/2799] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:21:40 2022] POST /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f/action => generated 52 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:21:41.482997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd6731c0-a44e-43e4-86c1-f8bc59508724 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.483871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd6731c0-a44e-43e4-86c1-f8bc59508724 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.485081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd6731c0-a44e-43e4-86c1-f8bc59508724 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.485624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd6731c0-a44e-43e4-86c1-f8bc59508724 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.502487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-288bbcab-37e6-452c-9fc4-a1c514b4d451 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:41.503197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-288bbcab-37e6-452c-9fc4-a1c514b4d451 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:41.513313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-288bbcab-37e6-452c-9fc4-a1c514b4d451 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.513757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-288bbcab-37e6-452c-9fc4-a1c514b4d451 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.520687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-288bbcab-37e6-452c-9fc4-a1c514b4d451 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.521348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-288bbcab-37e6-452c-9fc4-a1c514b4d451 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.569816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bd6731c0-a44e-43e4-86c1-f8bc59508724 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:41.723575 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bd6731c0-a44e-43e4-86c1-f8bc59508724 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f" status: 204 len: 0 microversion: 2.47 time: 0.252442 Jul 20 04:21:41.726065 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1436/2800] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:21:41 2022] DELETE /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:21:41.753093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-033a223e-8422-4adc-9e4d-dfcbac0efe89 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:41.754195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-033a223e-8422-4adc-9e4d-dfcbac0efe89 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:41.783748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-033a223e-8422-4adc-9e4d-dfcbac0efe89 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.784198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-033a223e-8422-4adc-9e4d-dfcbac0efe89 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.784978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-033a223e-8422-4adc-9e4d-dfcbac0efe89 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.785416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-033a223e-8422-4adc-9e4d-dfcbac0efe89 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.792748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-288bbcab-37e6-452c-9fc4-a1c514b4d451 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:41.808263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-288bbcab-37e6-452c-9fc4-a1c514b4d451 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:41.810822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-288bbcab-37e6-452c-9fc4-a1c514b4d451 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:41.815226 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-288bbcab-37e6-452c-9fc4-a1c514b4d451 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.317387 Jul 20 04:21:41.818544 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1365/2801] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:41 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:21:41.831374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5f8ccc9-d4b2-4e51-a871-09803b04aabc tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:41.832317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c5f8ccc9-d4b2-4e51-a871-09803b04aabc tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:41.848408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5f8ccc9-d4b2-4e51-a871-09803b04aabc tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.851756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5f8ccc9-d4b2-4e51-a871-09803b04aabc tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.852788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5f8ccc9-d4b2-4e51-a871-09803b04aabc tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.855778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5f8ccc9-d4b2-4e51-a871-09803b04aabc tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.993985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c5f8ccc9-d4b2-4e51-a871-09803b04aabc tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:42.002704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c5f8ccc9-d4b2-4e51-a871-09803b04aabc tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:42.004246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c5f8ccc9-d4b2-4e51-a871-09803b04aabc tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:42.005468 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5f8ccc9-d4b2-4e51-a871-09803b04aabc tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f" status: 200 len: 1365 microversion: 2.47 time: 0.185669 Jul 20 04:21:42.006221 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1366/2802] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:41 2022] GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:42.630177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-2e9720fd-17e5-49a4-82e5-b11a006638dc req-f6c26365-6328-400c-ad2a-d20fac9579e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "tag": "48db0174-8198-40fd-8530-6c031438c060"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:42.640349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2e9720fd-17e5-49a4-82e5-b11a006638dc req-f6c26365-6328-400c-ad2a-d20fac9579e8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:42.641022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2e9720fd-17e5-49a4-82e5-b11a006638dc req-f6c26365-6328-400c-ad2a-d20fac9579e8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:42.653736 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-2e9720fd-17e5-49a4-82e5-b11a006638dc req-f6c26365-6328-400c-ad2a-d20fac9579e8 service nova] Creating event network-changed:48db0174-8198-40fd-8530-6c031438c060 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:21:42.663837 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-2e9720fd-17e5-49a4-82e5-b11a006638dc req-f6c26365-6328-400c-ad2a-d20fac9579e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036505 Jul 20 04:21:42.665253 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1367/2803] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:42.716957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-033a223e-8422-4adc-9e4d-dfcbac0efe89 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:42.733787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-033a223e-8422-4adc-9e4d-dfcbac0efe89 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:42.736043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-033a223e-8422-4adc-9e4d-dfcbac0efe89 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:42.737525 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-033a223e-8422-4adc-9e4d-dfcbac0efe89 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 1.009183 Jul 20 04:21:42.738802 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1437/2804] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:41 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:42.838848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1c5d5448-b580-4f4f-a1b4-42984331689e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:42.840839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1c5d5448-b580-4f4f-a1b4-42984331689e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:42.848440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c5d5448-b580-4f4f-a1b4-42984331689e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:42.849118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c5d5448-b580-4f4f-a1b4-42984331689e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:42.850705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c5d5448-b580-4f4f-a1b4-42984331689e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:42.851313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c5d5448-b580-4f4f-a1b4-42984331689e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:42.879124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:43.026634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04c07f04-4a20-4525-8d17-47e5c3942b92 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:43.027279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-04c07f04-4a20-4525-8d17-47e5c3942b92 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:43.035561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04c07f04-4a20-4525-8d17-47e5c3942b92 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.036046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04c07f04-4a20-4525-8d17-47e5c3942b92 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.037103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04c07f04-4a20-4525-8d17-47e5c3942b92 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.037955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04c07f04-4a20-4525-8d17-47e5c3942b92 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.192710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-04c07f04-4a20-4525-8d17-47e5c3942b92 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:43.204576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-04c07f04-4a20-4525-8d17-47e5c3942b92 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:43.208209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-04c07f04-4a20-4525-8d17-47e5c3942b92 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:43.211133 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-04c07f04-4a20-4525-8d17-47e5c3942b92 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f" status: 200 len: 1365 microversion: 2.47 time: 0.188222 Jul 20 04:21:43.212936 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1438/2805] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:43 2022] GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:21:43.311804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1c5d5448-b580-4f4f-a1b4-42984331689e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:43.327480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1c5d5448-b580-4f4f-a1b4-42984331689e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:43.329704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1c5d5448-b580-4f4f-a1b4-42984331689e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:43.331688 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1c5d5448-b580-4f4f-a1b4-42984331689e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.498652 Jul 20 04:21:43.332563 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1368/2806] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:42 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:43.757874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dc8e748a-752c-475b-9420-cf6c5bda97ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:43.759173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dc8e748a-752c-475b-9420-cf6c5bda97ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:43.788597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc8e748a-752c-475b-9420-cf6c5bda97ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.789335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc8e748a-752c-475b-9420-cf6c5bda97ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.790342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc8e748a-752c-475b-9420-cf6c5bda97ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.791103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc8e748a-752c-475b-9420-cf6c5bda97ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:44.225987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dc8e748a-752c-475b-9420-cf6c5bda97ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:44.233183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-594ba820-5f3f-41c6-a935-480e427a23f2 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:44.233937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-594ba820-5f3f-41c6-a935-480e427a23f2 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:44.243601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:44.250002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dc8e748a-752c-475b-9420-cf6c5bda97ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:44.252880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-594ba820-5f3f-41c6-a935-480e427a23f2 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:44.253234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dc8e748a-752c-475b-9420-cf6c5bda97ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:44.253874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-594ba820-5f3f-41c6-a935-480e427a23f2 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:44.256712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-594ba820-5f3f-41c6-a935-480e427a23f2 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:44.258066 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dc8e748a-752c-475b-9420-cf6c5bda97ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.504944 Jul 20 04:21:44.258813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-594ba820-5f3f-41c6-a935-480e427a23f2 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:44.276606 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1439/2807] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:43 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:44.340672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:44.353414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9f23f4b5-a782-4c41-8205-6f893ee94bcd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:44.354286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9f23f4b5-a782-4c41-8205-6f893ee94bcd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:44.364567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-594ba820-5f3f-41c6-a935-480e427a23f2 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:44.367815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f23f4b5-a782-4c41-8205-6f893ee94bcd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:44.368783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f23f4b5-a782-4c41-8205-6f893ee94bcd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:44.373863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-594ba820-5f3f-41c6-a935-480e427a23f2 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:44.374541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f23f4b5-a782-4c41-8205-6f893ee94bcd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:44.374858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f23f4b5-a782-4c41-8205-6f893ee94bcd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:44.376706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-594ba820-5f3f-41c6-a935-480e427a23f2 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:44.378300 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-594ba820-5f3f-41c6-a935-480e427a23f2 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f" status: 200 len: 1365 microversion: 2.47 time: 0.150507 Jul 20 04:21:44.379973 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1369/2808] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:44 2022] GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:44.619154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9f23f4b5-a782-4c41-8205-6f893ee94bcd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:44.639266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9f23f4b5-a782-4c41-8205-6f893ee94bcd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:44.641905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9f23f4b5-a782-4c41-8205-6f893ee94bcd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:44.643294 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9f23f4b5-a782-4c41-8205-6f893ee94bcd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.294843 Jul 20 04:21:44.646213 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1440/2809] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:44 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:21:45.138682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-749015791", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8a3ec81f-723e-4ea1-a259-1c9d3d2a556e"}], "security_groups": [{"name": "tempest-securitygroup--1853389654"}], "key_name": "tempest-keypair-78993561", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "5c98d13c-a88d-4133-8ebd-358115e26767", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:45.285341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-787644c0-7003-4897-a90f-aa35c9d6a031 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:45.288711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-787644c0-7003-4897-a90f-aa35c9d6a031 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:45.300521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-787644c0-7003-4897-a90f-aa35c9d6a031 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.301384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-787644c0-7003-4897-a90f-aa35c9d6a031 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.302898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-787644c0-7003-4897-a90f-aa35c9d6a031 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.304251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-787644c0-7003-4897-a90f-aa35c9d6a031 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.511556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] validate_networks() for [('8a3ec81f-723e-4ea1-a259-1c9d3d2a556e', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:45.962406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-787644c0-7003-4897-a90f-aa35c9d6a031 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:45.972507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-787644c0-7003-4897-a90f-aa35c9d6a031 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:45.974295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-787644c0-7003-4897-a90f-aa35c9d6a031 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:45.975998 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-787644c0-7003-4897-a90f-aa35c9d6a031 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.695219 Jul 20 04:21:45.976590 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1441/2810] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:45 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:45.981401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c4f39497-9596-412d-8a49-1683b5876a93 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:45.982020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c4f39497-9596-412d-8a49-1683b5876a93 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:45.988388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4f39497-9596-412d-8a49-1683b5876a93 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.989160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4f39497-9596-412d-8a49-1683b5876a93 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.990059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4f39497-9596-412d-8a49-1683b5876a93 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.990748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4f39497-9596-412d-8a49-1683b5876a93 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.118124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c4f39497-9596-412d-8a49-1683b5876a93 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:46.127303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c4f39497-9596-412d-8a49-1683b5876a93 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:46.128909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c4f39497-9596-412d-8a49-1683b5876a93 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:46.130104 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c4f39497-9596-412d-8a49-1683b5876a93 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f" status: 200 len: 1365 microversion: 2.47 time: 0.152403 Jul 20 04:21:46.130682 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1442/2811] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:45 2022] GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:46.136008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da99ff47-08fa-4cf9-8cba-2c788714fe63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:46.136621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-da99ff47-08fa-4cf9-8cba-2c788714fe63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:46.143247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da99ff47-08fa-4cf9-8cba-2c788714fe63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:46.143736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da99ff47-08fa-4cf9-8cba-2c788714fe63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.144516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da99ff47-08fa-4cf9-8cba-2c788714fe63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:46.144956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da99ff47-08fa-4cf9-8cba-2c788714fe63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.467200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-da99ff47-08fa-4cf9-8cba-2c788714fe63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:46.479462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-da99ff47-08fa-4cf9-8cba-2c788714fe63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:46.481368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-da99ff47-08fa-4cf9-8cba-2c788714fe63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:46.482847 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da99ff47-08fa-4cf9-8cba-2c788714fe63 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1813 microversion: 2.25 time: 0.350587 Jul 20 04:21:46.483635 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1443/2812] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:46 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1813 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:46.630785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Getting quotas for project 8298da14cfd743539e6421d8f00a3366. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:46.637617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Getting quotas for user 3fd5e2533a994d0fb65c1ede341b7f84 and project 8298da14cfd743539e6421d8f00a3366. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:46.652136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:46.652815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:46.653449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:46.654015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:46.654628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:46.668479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:46.669186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.670182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:46.670620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.691327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Getting quotas for project 8298da14cfd743539e6421d8f00a3366. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:46.697755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Getting quotas for user 3fd5e2533a994d0fb65c1ede341b7f84 and project 8298da14cfd743539e6421d8f00a3366. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:46.764988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:46.767813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c98d13c-a88d-4133-8ebd-358115e26767',volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:46.974331 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e66f64f1-ad33-4f02-9cfa-61431c8e657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.841980 Jul 20 04:21:46.976371 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1370/2813] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:45 2022] POST /compute/v2.1/servers => generated 407 bytes in 1846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:46.986515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-64d142fc-cc89-4692-a8a9-904f5de31256 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:46.987466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-64d142fc-cc89-4692-a8a9-904f5de31256 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:47.007342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f8ffdaa5-68ed-4077-8394-2da1e0a4c5af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:47.008291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f8ffdaa5-68ed-4077-8394-2da1e0a4c5af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:47.019496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8ffdaa5-68ed-4077-8394-2da1e0a4c5af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.020482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8ffdaa5-68ed-4077-8394-2da1e0a4c5af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.021637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8ffdaa5-68ed-4077-8394-2da1e0a4c5af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.023498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8ffdaa5-68ed-4077-8394-2da1e0a4c5af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.450394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-64d142fc-cc89-4692-a8a9-904f5de31256 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:47.465864 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-64d142fc-cc89-4692-a8a9-904f5de31256 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1119 microversion: 2.1 time: 0.483318 Jul 20 04:21:47.466460 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1444/2814] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:46 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1119 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:47.476170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21db9235-3c9e-45f8-9672-6d066c33b330 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:47.476170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21db9235-3c9e-45f8-9672-6d066c33b330 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:47.491020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21db9235-3c9e-45f8-9672-6d066c33b330 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.491607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21db9235-3c9e-45f8-9672-6d066c33b330 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.492716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21db9235-3c9e-45f8-9672-6d066c33b330 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.493361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21db9235-3c9e-45f8-9672-6d066c33b330 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.686825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-21db9235-3c9e-45f8-9672-6d066c33b330 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:47.696239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-21db9235-3c9e-45f8-9672-6d066c33b330 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:47.697787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-21db9235-3c9e-45f8-9672-6d066c33b330 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '081ac197624348559fe831ca71586a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01358b0931324052b21d7ec3a93c21c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:47.699321 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21db9235-3c9e-45f8-9672-6d066c33b330 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f" status: 200 len: 1365 microversion: 2.47 time: 0.231677 Jul 20 04:21:47.700312 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1445/2815] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:47 2022] GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:47.705616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2318b40d-c258-4bca-afa2-9fe50d2081f0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:47.706237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2318b40d-c258-4bca-afa2-9fe50d2081f0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:47.714309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2318b40d-c258-4bca-afa2-9fe50d2081f0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.714771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2318b40d-c258-4bca-afa2-9fe50d2081f0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.716001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2318b40d-c258-4bca-afa2-9fe50d2081f0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.716596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2318b40d-c258-4bca-afa2-9fe50d2081f0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.840365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f8ffdaa5-68ed-4077-8394-2da1e0a4c5af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:47.853733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f8ffdaa5-68ed-4077-8394-2da1e0a4c5af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:47.856809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f8ffdaa5-68ed-4077-8394-2da1e0a4c5af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:47.864954 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f8ffdaa5-68ed-4077-8394-2da1e0a4c5af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.870561 Jul 20 04:21:47.867226 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1371/2816] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:46 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:48.046766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2318b40d-c258-4bca-afa2-9fe50d2081f0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:48.051364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:48.059321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2318b40d-c258-4bca-afa2-9fe50d2081f0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:48.060844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2318b40d-c258-4bca-afa2-9fe50d2081f0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:48.062111 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2318b40d-c258-4bca-afa2-9fe50d2081f0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1803 microversion: 2.25 time: 0.360653 Jul 20 04:21:48.062682 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1446/2817] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:47 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1803 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:48.081215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f8efceac-4644-4f0e-8a93-e93c09634119 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '.version_select at 0x7fbf9d450e50>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.083691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8efceac-4644-4f0e-8a93-e93c09634119 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.084161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8efceac-4644-4f0e-8a93-e93c09634119 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.092790 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f8efceac-4644-4f0e-8a93-e93c09634119 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1536 microversion: 2.25 time: 0.015790 Jul 20 04:21:48.093474 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1372/2818] 10.222.0.20 () {60 vars in 1183 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/os-migrations => generated 1536 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:48.106281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1952f4b5-7265-4bfa-8898-cc18c4f70477 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.107242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1952f4b5-7265-4bfa-8898-cc18c4f70477 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:48.137977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1952f4b5-7265-4bfa-8898-cc18c4f70477 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.138765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1952f4b5-7265-4bfa-8898-cc18c4f70477 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.139464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1952f4b5-7265-4bfa-8898-cc18c4f70477 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.139928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1952f4b5-7265-4bfa-8898-cc18c4f70477 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.446251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-1952f4b5-7265-4bfa-8898-cc18c4f70477 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid 57d80a59-9d6b-4b94-a643-8f6727f50511 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:21:48.464923 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1952f4b5-7265-4bfa-8898-cc18c4f70477 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 2424 microversion: 2.25 time: 0.362386 Jul 20 04:21:48.466914 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1447/2819] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 2424 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:48.484293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1dba5901-4a09-4bca-92a2-167f9ae7fc5d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.485314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1dba5901-4a09-4bca-92a2-167f9ae7fc5d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:48.485633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7352abd6-3d56-4663-8d27-db162ec25470 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.486521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7352abd6-3d56-4663-8d27-db162ec25470 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:48.493591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7352abd6-3d56-4663-8d27-db162ec25470 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.494140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7352abd6-3d56-4663-8d27-db162ec25470 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.494988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7352abd6-3d56-4663-8d27-db162ec25470 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.495501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7352abd6-3d56-4663-8d27-db162ec25470 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.497263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dba5901-4a09-4bca-92a2-167f9ae7fc5d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.497899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dba5901-4a09-4bca-92a2-167f9ae7fc5d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.499019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dba5901-4a09-4bca-92a2-167f9ae7fc5d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.499658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dba5901-4a09-4bca-92a2-167f9ae7fc5d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.670354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1dba5901-4a09-4bca-92a2-167f9ae7fc5d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:48.678027 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1dba5901-4a09-4bca-92a2-167f9ae7fc5d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1217 microversion: 2.1 time: 0.198172 Jul 20 04:21:48.679212 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1373/2820] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1217 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:48.718544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-69c78540-64c3-4479-acc2-d770512b6e91 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.719172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-69c78540-64c3-4479-acc2-d770512b6e91 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] [instance: 2f7d7016-64dc-48ba-b821-3e54342d190f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:48.726300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69c78540-64c3-4479-acc2-d770512b6e91 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.726760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69c78540-64c3-4479-acc2-d770512b6e91 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.727623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69c78540-64c3-4479-acc2-d770512b6e91 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.728335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69c78540-64c3-4479-acc2-d770512b6e91 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.743612 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-69c78540-64c3-4479-acc2-d770512b6e91 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] HTTP exception thrown: Instance 2f7d7016-64dc-48ba-b821-3e54342d190f could not be found. Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-69c78540-64c3-4479-acc2-d770512b6e91 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Request method failure captured: Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f HTTP/1.1 Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14LNTmnbP5LTNlkGgwptzX8jSGnPQNIhUeyKbCNPdaRv9TEUMRuXcHepleU92I5W34RUr3Y5Eq0OMWi-qQIb48Yj7Y_gnnn8-iB5gokUF_m5c2sVVV7beDMUGXHGrPtMSE5yT5i1zP71Cq2p1GKLV_SyTqpDt83D6suwbIcyx2ZzO48 Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 01358b0931324052b21d7ec3a93c21c7 Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersAaction247Test-278125221 Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01358b0931324052b21d7ec3a93c21c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01358b0931324052b21d7ec3a93c21c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01358b0931324052b21d7ec3a93c21c7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01358b0931324052b21d7ec3a93c21c7"}]}] Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersAaction247Test-278125221 Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 01358b0931324052b21d7ec3a93c21c7 Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersAaction247Test-278125221 Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersAaction247Test-278125221-project Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 081ac197624348559fe831ca71586a46 Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersAaction247Test-278125221-project Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 2f7d7016-64dc-48ba-b821-3e54342d190f could not be found. Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '2f7d7016-64dc-48ba-b821-3e54342d190f'} Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7d7016-64dc-48ba-b821-3e54342d190f could not be found. Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7d7016-64dc-48ba-b821-3e54342d190f could not be found. Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:48.745327 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:48.749977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:48.749977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:48.749977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:48.749977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:48.749977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:48.749977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7d7016-64dc-48ba-b821-3e54342d190f could not be found. Jul 20 04:21:48.749977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:21:48.749977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-69c78540-64c3-4479-acc2-d770512b6e91 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] Returning 404 to user: Instance 2f7d7016-64dc-48ba-b821-3e54342d190f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:48.749977 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-69c78540-64c3-4479-acc2-d770512b6e91 tempest-ServersAaction247Test-278125221 tempest-ServersAaction247Test-278125221-project] 10.222.0.20 "GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f" status: 404 len: 111 microversion: 2.47 time: 0.032303 Jul 20 04:21:48.749977 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1374/2821] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/servers/2f7d7016-64dc-48ba-b821-3e54342d190f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:21:48.813465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-7352abd6-3d56-4663-8d27-db162ec25470 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid 57d80a59-9d6b-4b94-a643-8f6727f50511 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:21:48.844639 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7352abd6-3d56-4663-8d27-db162ec25470 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 2424 microversion: 2.25 time: 0.362954 Jul 20 04:21:48.846008 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1448/2822] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 2424 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:21:48.885117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c70432a6-a869-4b12-a1fe-aaf1f44bebfe tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.885755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c70432a6-a869-4b12-a1fe-aaf1f44bebfe tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:48.894041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c70432a6-a869-4b12-a1fe-aaf1f44bebfe tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.894780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c70432a6-a869-4b12-a1fe-aaf1f44bebfe tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.896222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c70432a6-a869-4b12-a1fe-aaf1f44bebfe tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.897428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c70432a6-a869-4b12-a1fe-aaf1f44bebfe tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.000576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c267db1f-3648-4f84-a58f-0a846060da7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.002397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c267db1f-3648-4f84-a58f-0a846060da7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:49.012016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c267db1f-3648-4f84-a58f-0a846060da7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.013096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c267db1f-3648-4f84-a58f-0a846060da7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.014206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c267db1f-3648-4f84-a58f-0a846060da7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.014858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c267db1f-3648-4f84-a58f-0a846060da7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.552242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-c267db1f-3648-4f84-a58f-0a846060da7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lazy-loading 'services' on Instance uuid 57d80a59-9d6b-4b94-a643-8f6727f50511 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:21:49.596474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c70432a6-a869-4b12-a1fe-aaf1f44bebfe tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:49.611564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c70432a6-a869-4b12-a1fe-aaf1f44bebfe tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:49.614601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c70432a6-a869-4b12-a1fe-aaf1f44bebfe tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:49.621287 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c70432a6-a869-4b12-a1fe-aaf1f44bebfe tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.740219 Jul 20 04:21:49.622488 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1375/2823] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:49.677064 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c267db1f-3648-4f84-a58f-0a846060da7c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "DELETE /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments/105d6142-95cb-4a79-a81c-c50d934f56e8" status: 202 len: 0 microversion: 2.25 time: 0.680392 Jul 20 04:21:49.682610 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1449/2824] 10.222.0.20 () {60 vars in 1456 bytes} [Wed Jul 20 04:21:48 2022] DELETE /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments/105d6142-95cb-4a79-a81c-c50d934f56e8 => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:49.691012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b10b32de-b2a9-4b09-8ab0-363ef5307a64 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.691917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b10b32de-b2a9-4b09-8ab0-363ef5307a64 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:49.698126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-025b908f-b45c-444b-a9e4-27870f97ef9c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.706831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-025b908f-b45c-444b-a9e4-27870f97ef9c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:49.711263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b10b32de-b2a9-4b09-8ab0-363ef5307a64 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.713045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b10b32de-b2a9-4b09-8ab0-363ef5307a64 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.713884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b10b32de-b2a9-4b09-8ab0-363ef5307a64 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.714325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b10b32de-b2a9-4b09-8ab0-363ef5307a64 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.721129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-025b908f-b45c-444b-a9e4-27870f97ef9c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.721783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-025b908f-b45c-444b-a9e4-27870f97ef9c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.722726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-025b908f-b45c-444b-a9e4-27870f97ef9c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.723397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-025b908f-b45c-444b-a9e4-27870f97ef9c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.788939 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b10b32de-b2a9-4b09-8ab0-363ef5307a64 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.105157 Jul 20 04:21:49.792913 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1376/2825] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:21:49 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:21:49.907552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-025b908f-b45c-444b-a9e4-27870f97ef9c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:49.922411 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-025b908f-b45c-444b-a9e4-27870f97ef9c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1235 microversion: 2.1 time: 0.228003 Jul 20 04:21:49.924929 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1450/2826] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:49 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1235 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:50.642360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a53142be-4821-402f-8caf-23b36041093e tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.644789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a53142be-4821-402f-8caf-23b36041093e tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:50.665745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a53142be-4821-402f-8caf-23b36041093e tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.666440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a53142be-4821-402f-8caf-23b36041093e tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.668171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a53142be-4821-402f-8caf-23b36041093e tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.670645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a53142be-4821-402f-8caf-23b36041093e tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.803919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c3aa33e7-05b1-4f93-9f3f-854c5250c6a5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.806953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c3aa33e7-05b1-4f93-9f3f-854c5250c6a5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:50.828661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3aa33e7-05b1-4f93-9f3f-854c5250c6a5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.828661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3aa33e7-05b1-4f93-9f3f-854c5250c6a5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.830213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3aa33e7-05b1-4f93-9f3f-854c5250c6a5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.830666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3aa33e7-05b1-4f93-9f3f-854c5250c6a5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.930223 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c3aa33e7-05b1-4f93-9f3f-854c5250c6a5 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131965 Jul 20 04:21:50.935609 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1451/2827] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:21:50 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:21:50.949614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0d76286-7e67-4092-9d2b-6fd219a55be8 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.957596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b0d76286-7e67-4092-9d2b-6fd219a55be8 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:50.981822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0d76286-7e67-4092-9d2b-6fd219a55be8 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.982611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0d76286-7e67-4092-9d2b-6fd219a55be8 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.985679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0d76286-7e67-4092-9d2b-6fd219a55be8 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.986472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0d76286-7e67-4092-9d2b-6fd219a55be8 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.093109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b0d76286-7e67-4092-9d2b-6fd219a55be8 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:51.105213 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b0d76286-7e67-4092-9d2b-6fd219a55be8 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1235 microversion: 2.1 time: 0.167431 Jul 20 04:21:51.108163 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1452/2828] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:50 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1235 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:51.944904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-22648ec8-d0f5-4835-867a-66ae0fb49e5f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:51.946193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-22648ec8-d0f5-4835-867a-66ae0fb49e5f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:51.965522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22648ec8-d0f5-4835-867a-66ae0fb49e5f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:51.967389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22648ec8-d0f5-4835-867a-66ae0fb49e5f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.971247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22648ec8-d0f5-4835-867a-66ae0fb49e5f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:51.972697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22648ec8-d0f5-4835-867a-66ae0fb49e5f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.996611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a53142be-4821-402f-8caf-23b36041093e tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:52.020766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a53142be-4821-402f-8caf-23b36041093e tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:52.024105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a53142be-4821-402f-8caf-23b36041093e tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:52.028369 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a53142be-4821-402f-8caf-23b36041093e tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 1.390467 Jul 20 04:21:52.045136 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1377/2829] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:50 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:52.047845 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-22648ec8-d0f5-4835-867a-66ae0fb49e5f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.108370 Jul 20 04:21:52.049608 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1453/2830] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:21:51 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:21:52.125618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-31e197ff-af3f-49ef-b263-777529fb81f3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:52.128066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-31e197ff-af3f-49ef-b263-777529fb81f3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:52.137220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31e197ff-af3f-49ef-b263-777529fb81f3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.138028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31e197ff-af3f-49ef-b263-777529fb81f3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.139040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31e197ff-af3f-49ef-b263-777529fb81f3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.139811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31e197ff-af3f-49ef-b263-777529fb81f3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.793822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-31e197ff-af3f-49ef-b263-777529fb81f3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:52.803229 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-31e197ff-af3f-49ef-b263-777529fb81f3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1303 microversion: 2.1 time: 0.684811 Jul 20 04:21:52.804690 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1378/2831] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:52 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1303 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:53.058057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0942e69-47ca-483d-9f6c-a6bc1b3f9986 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:53.059207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b0942e69-47ca-483d-9f6c-a6bc1b3f9986 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:53.060445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2b64398d-a674-467d-a1c5-1dca28e0bb13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:53.061362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2b64398d-a674-467d-a1c5-1dca28e0bb13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:53.070621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b64398d-a674-467d-a1c5-1dca28e0bb13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.071710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b64398d-a674-467d-a1c5-1dca28e0bb13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.073708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b64398d-a674-467d-a1c5-1dca28e0bb13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.075348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b64398d-a674-467d-a1c5-1dca28e0bb13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.082510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0942e69-47ca-483d-9f6c-a6bc1b3f9986 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.082979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0942e69-47ca-483d-9f6c-a6bc1b3f9986 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.083801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0942e69-47ca-483d-9f6c-a6bc1b3f9986 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.087955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0942e69-47ca-483d-9f6c-a6bc1b3f9986 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.153321 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2b64398d-a674-467d-a1c5-1dca28e0bb13 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.093575 Jul 20 04:21:53.155087 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1379/2832] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:21:53 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:21:53.716323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b0942e69-47ca-483d-9f6c-a6bc1b3f9986 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:53.729493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b0942e69-47ca-483d-9f6c-a6bc1b3f9986 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:53.731847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b0942e69-47ca-483d-9f6c-a6bc1b3f9986 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:53.733366 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b0942e69-47ca-483d-9f6c-a6bc1b3f9986 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.685001 Jul 20 04:21:53.734510 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1454/2833] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:53 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:53.822963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4493a880-f0d3-4a6e-95b8-fd5ed8e452f9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:53.823604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4493a880-f0d3-4a6e-95b8-fd5ed8e452f9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:53.830846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4493a880-f0d3-4a6e-95b8-fd5ed8e452f9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.831546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4493a880-f0d3-4a6e-95b8-fd5ed8e452f9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.832664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4493a880-f0d3-4a6e-95b8-fd5ed8e452f9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.833290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4493a880-f0d3-4a6e-95b8-fd5ed8e452f9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.167247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0f8cb449-a6e5-47a2-bb0e-34b089a78d16 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:54.169012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0f8cb449-a6e5-47a2-bb0e-34b089a78d16 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:54.189808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:54.197714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f8cb449-a6e5-47a2-bb0e-34b089a78d16 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.199373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f8cb449-a6e5-47a2-bb0e-34b089a78d16 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.201659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f8cb449-a6e5-47a2-bb0e-34b089a78d16 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.205611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f8cb449-a6e5-47a2-bb0e-34b089a78d16 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.285215 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0f8cb449-a6e5-47a2-bb0e-34b089a78d16 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123484 Jul 20 04:21:54.286428 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1455/2834] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:21:54 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:21:54.309383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4493a880-f0d3-4a6e-95b8-fd5ed8e452f9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:54.333693 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4493a880-f0d3-4a6e-95b8-fd5ed8e452f9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1303 microversion: 2.1 time: 0.501825 Jul 20 04:21:54.334996 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1380/2835] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:53 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1303 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:54.498863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-99ae2ce3-6b9d-4dc6-a224-f01678b7fa32 req-098762e7-26bc-45c6-a6a3-305a163e1e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48fbccd-a6bb-42bd-8472-a224bb30c0b0", "tag": "567b5770-118a-4239-8f7a-d878b7417a17"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:54.524542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-99ae2ce3-6b9d-4dc6-a224-f01678b7fa32 req-098762e7-26bc-45c6-a6a3-305a163e1e6d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.525387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-99ae2ce3-6b9d-4dc6-a224-f01678b7fa32 req-098762e7-26bc-45c6-a6a3-305a163e1e6d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.568050 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-99ae2ce3-6b9d-4dc6-a224-f01678b7fa32 req-098762e7-26bc-45c6-a6a3-305a163e1e6d service nova] Creating event network-changed:567b5770-118a-4239-8f7a-d878b7417a17 for instance c48fbccd-a6bb-42bd-8472-a224bb30c0b0 on n-h2-764485-11 Jul 20 04:21:54.588865 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-99ae2ce3-6b9d-4dc6-a224-f01678b7fa32 req-098762e7-26bc-45c6-a6a3-305a163e1e6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095577 Jul 20 04:21:54.597452 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1381/2836] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:21:54.701168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-525735203", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "640a8093-f650-4565-8492-8ab6b02bbd3f"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:54.753052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e7467331-d26f-477a-8041-a51f028bc6df tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:54.759330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e7467331-d26f-477a-8041-a51f028bc6df tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:54.769056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7467331-d26f-477a-8041-a51f028bc6df tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.772273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7467331-d26f-477a-8041-a51f028bc6df tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.774456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7467331-d26f-477a-8041-a51f028bc6df tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.776042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7467331-d26f-477a-8041-a51f028bc6df tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.806748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] validate_networks() for [('640a8093-f650-4565-8492-8ab6b02bbd3f', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:55.178984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e7467331-d26f-477a-8041-a51f028bc6df tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:55.198335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e7467331-d26f-477a-8041-a51f028bc6df tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:55.202962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e7467331-d26f-477a-8041-a51f028bc6df tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:55.205746 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e7467331-d26f-477a-8041-a51f028bc6df tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.456952 Jul 20 04:21:55.220488 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1382/2837] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:54 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:55.298715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9f3b499d-7b45-44ed-9ba0-d5c8cd64f030 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:55.300359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9f3b499d-7b45-44ed-9ba0-d5c8cd64f030 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:55.312307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f3b499d-7b45-44ed-9ba0-d5c8cd64f030 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.315168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f3b499d-7b45-44ed-9ba0-d5c8cd64f030 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.319950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f3b499d-7b45-44ed-9ba0-d5c8cd64f030 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.321148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f3b499d-7b45-44ed-9ba0-d5c8cd64f030 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.391386 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9f3b499d-7b45-44ed-9ba0-d5c8cd64f030 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.097333 Jul 20 04:21:55.393034 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1383/2838] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:21:55 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:21:55.399168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e92c8fbd-89d8-49b1-8f84-c2561898e19b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:55.399911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e92c8fbd-89d8-49b1-8f84-c2561898e19b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:55.407961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e92c8fbd-89d8-49b1-8f84-c2561898e19b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.408423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e92c8fbd-89d8-49b1-8f84-c2561898e19b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.409270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e92c8fbd-89d8-49b1-8f84-c2561898e19b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.409721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e92c8fbd-89d8-49b1-8f84-c2561898e19b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.777982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e92c8fbd-89d8-49b1-8f84-c2561898e19b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:55.780250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:55.780853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:55.781294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:55.781722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:55.782144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:55.787743 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e92c8fbd-89d8-49b1-8f84-c2561898e19b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1303 microversion: 2.1 time: 0.393214 Jul 20 04:21:55.799708 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1384/2839] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:55 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1303 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:55.802509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.803111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.813240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.813928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.840989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Getting quotas for project 04a675a96d3c48a8888e649879f21756. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:55.848306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Getting quotas for user 80e6c22902d74017aef7952ad1fdbeb4 and project 04a675a96d3c48a8888e649879f21756. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:55.867919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Going to run 3 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:55.871139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:55.919207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=1b1b703c-85b1-4e4f-b55e-663c74bbb5bd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:55.997270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:56.154220 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-40e925bd-762c-4f01-bb87-11e819c5e252 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.749913 Jul 20 04:21:56.155236 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1456/2840] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:56.166704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e28c19a8-d2ee-43fc-8ef3-561c7f5f936f tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:56.171423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e28c19a8-d2ee-43fc-8ef3-561c7f5f936f tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:56.172411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e28c19a8-d2ee-43fc-8ef3-561c7f5f936f tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Searching by: {'deleted': False, 'project_id': '04a675a96d3c48a8888e649879f21756'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:21:56.227264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e03a5e8d-0e1b-44c3-b009-47a93a70cf33 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:56.228125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e03a5e8d-0e1b-44c3-b009-47a93a70cf33 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:56.254563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e03a5e8d-0e1b-44c3-b009-47a93a70cf33 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.255112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e03a5e8d-0e1b-44c3-b009-47a93a70cf33 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.261113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e28c19a8-d2ee-43fc-8ef3-561c7f5f936f tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.261591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e28c19a8-d2ee-43fc-8ef3-561c7f5f936f tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.262594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e03a5e8d-0e1b-44c3-b009-47a93a70cf33 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.263056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e03a5e8d-0e1b-44c3-b009-47a93a70cf33 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.266528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e28c19a8-d2ee-43fc-8ef3-561c7f5f936f tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.266992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e28c19a8-d2ee-43fc-8ef3-561c7f5f936f tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.329765 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e28c19a8-d2ee-43fc-8ef3-561c7f5f936f tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.165991 Jul 20 04:21:56.335796 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1385/2841] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 04:21:56 2022] GET /compute/v2.1/servers => generated 1015 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:56.348978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-20a46f27-ba75-4d8f-ab2a-de27bd1f23a3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:56.355349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-20a46f27-ba75-4d8f-ab2a-de27bd1f23a3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:56.707474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:56.998145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-20a46f27-ba75-4d8f-ab2a-de27bd1f23a3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:57.011649 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-20a46f27-ba75-4d8f-ab2a-de27bd1f23a3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1222 microversion: 2.1 time: 0.667934 Jul 20 04:21:57.020791 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1386/2842] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:56 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1222 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:57.020791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-25824315-1249-4aa5-a587-a6ba894fdb11 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:57.020791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-25824315-1249-4aa5-a587-a6ba894fdb11 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:57.039493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25824315-1249-4aa5-a587-a6ba894fdb11 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:57.039981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25824315-1249-4aa5-a587-a6ba894fdb11 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:57.043167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25824315-1249-4aa5-a587-a6ba894fdb11 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:57.044654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25824315-1249-4aa5-a587-a6ba894fdb11 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:57.137745 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-25824315-1249-4aa5-a587-a6ba894fdb11 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.113029 Jul 20 04:21:57.144330 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1387/2843] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:21:57 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:21:57.161695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-89cf0f92-3076-4ff8-a8f8-8b1dc475843f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:57.164501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-89cf0f92-3076-4ff8-a8f8-8b1dc475843f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:57.180228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89cf0f92-3076-4ff8-a8f8-8b1dc475843f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:57.189549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89cf0f92-3076-4ff8-a8f8-8b1dc475843f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:57.190826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89cf0f92-3076-4ff8-a8f8-8b1dc475843f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:57.192147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89cf0f92-3076-4ff8-a8f8-8b1dc475843f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:57.534407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e03a5e8d-0e1b-44c3-b009-47a93a70cf33 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:57.555119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e03a5e8d-0e1b-44c3-b009-47a93a70cf33 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:57.561275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e03a5e8d-0e1b-44c3-b009-47a93a70cf33 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:57.570793 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e03a5e8d-0e1b-44c3-b009-47a93a70cf33 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 1.348038 Jul 20 04:21:57.571418 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1457/2844] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:56 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:21:57.715352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89cf0f92-3076-4ff8-a8f8-8b1dc475843f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:57.723851 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-89cf0f92-3076-4ff8-a8f8-8b1dc475843f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1303 microversion: 2.1 time: 0.575790 Jul 20 04:21:57.725005 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1388/2845] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:57 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1303 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:58.030298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-152bbdfb-f6e3-4d99-afbb-fe35424d143f tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:58.031456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-152bbdfb-f6e3-4d99-afbb-fe35424d143f tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:58.152259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3b7c0ca2-4b8f-426c-9a62-e989433e64e2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:58.153188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3b7c0ca2-4b8f-426c-9a62-e989433e64e2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:58.167403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b7c0ca2-4b8f-426c-9a62-e989433e64e2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.167900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b7c0ca2-4b8f-426c-9a62-e989433e64e2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.168700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b7c0ca2-4b8f-426c-9a62-e989433e64e2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.171686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b7c0ca2-4b8f-426c-9a62-e989433e64e2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.204562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:58.209504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-152bbdfb-f6e3-4d99-afbb-fe35424d143f tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:58.216791 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-152bbdfb-f6e3-4d99-afbb-fe35424d143f tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1222 microversion: 2.1 time: 0.191808 Jul 20 04:21:58.221003 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1458/2846] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:58 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:58.267401 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3b7c0ca2-4b8f-426c-9a62-e989433e64e2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.119263 Jul 20 04:21:58.287155 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1389/2847] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:21:58 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:58.593289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f8ab47bd-dc0d-498d-9474-3fdcb6c76ac9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:58.593932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f8ab47bd-dc0d-498d-9474-3fdcb6c76ac9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:58.625648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8ab47bd-dc0d-498d-9474-3fdcb6c76ac9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.626109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8ab47bd-dc0d-498d-9474-3fdcb6c76ac9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.626913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8ab47bd-dc0d-498d-9474-3fdcb6c76ac9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.627368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8ab47bd-dc0d-498d-9474-3fdcb6c76ac9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.759116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4670807f-a35a-44b1-9cd4-7084a456195c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:58.759762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4670807f-a35a-44b1-9cd4-7084a456195c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:58.812273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4670807f-a35a-44b1-9cd4-7084a456195c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.827618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4670807f-a35a-44b1-9cd4-7084a456195c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.828492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4670807f-a35a-44b1-9cd4-7084a456195c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.833613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4670807f-a35a-44b1-9cd4-7084a456195c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.786675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f8ab47bd-dc0d-498d-9474-3fdcb6c76ac9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:59.808896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f8ab47bd-dc0d-498d-9474-3fdcb6c76ac9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:59.816747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f8ab47bd-dc0d-498d-9474-3fdcb6c76ac9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:59.820865 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f8ab47bd-dc0d-498d-9474-3fdcb6c76ac9 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 1.234507 Jul 20 04:21:59.821442 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1459/2848] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:58 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:59.832078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0ff9bca0-7b9f-4d02-846d-eca173de98bd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:59.832078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0ff9bca0-7b9f-4d02-846d-eca173de98bd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:59.863201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ff9bca0-7b9f-4d02-846d-eca173de98bd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.863687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ff9bca0-7b9f-4d02-846d-eca173de98bd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.864499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ff9bca0-7b9f-4d02-846d-eca173de98bd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.865477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ff9bca0-7b9f-4d02-846d-eca173de98bd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.198043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0ff9bca0-7b9f-4d02-846d-eca173de98bd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:00.208563 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0ff9bca0-7b9f-4d02-846d-eca173de98bd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1274 microversion: 2.1 time: 0.385919 Jul 20 04:22:00.232007 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1460/2849] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:59 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1274 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:00.391298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4670807f-a35a-44b1-9cd4-7084a456195c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:00.428571 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4670807f-a35a-44b1-9cd4-7084a456195c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1303 microversion: 2.1 time: 1.687557 Jul 20 04:22:00.439181 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1390/2850] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:58 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1303 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:00.852405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a5e46c8-8bd1-48c5-b225-5b95ccec79ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:00.853758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a5e46c8-8bd1-48c5-b225-5b95ccec79ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:00.885167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5e46c8-8bd1-48c5-b225-5b95ccec79ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.886730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5e46c8-8bd1-48c5-b225-5b95ccec79ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.889994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5e46c8-8bd1-48c5-b225-5b95ccec79ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.892480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5e46c8-8bd1-48c5-b225-5b95ccec79ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.228130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-73edabe1-6d62-447e-b202-c3b9cdb4dcad tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.229768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-73edabe1-6d62-447e-b202-c3b9cdb4dcad tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:01.251796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73edabe1-6d62-447e-b202-c3b9cdb4dcad tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.269341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73edabe1-6d62-447e-b202-c3b9cdb4dcad tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.270678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73edabe1-6d62-447e-b202-c3b9cdb4dcad tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.271867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73edabe1-6d62-447e-b202-c3b9cdb4dcad tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.725611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-73edabe1-6d62-447e-b202-c3b9cdb4dcad tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:01.742806 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-73edabe1-6d62-447e-b202-c3b9cdb4dcad tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1280 microversion: 2.1 time: 0.514465 Jul 20 04:22:01.744075 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1391/2851] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1280 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:01.749112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ea149077-1a0c-4311-97ff-840e986f4c8f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.754528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ea149077-1a0c-4311-97ff-840e986f4c8f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:01.782427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea149077-1a0c-4311-97ff-840e986f4c8f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.783200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea149077-1a0c-4311-97ff-840e986f4c8f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.784214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea149077-1a0c-4311-97ff-840e986f4c8f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.784804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea149077-1a0c-4311-97ff-840e986f4c8f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.067380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5a5e46c8-8bd1-48c5-b225-5b95ccec79ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:02.082694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5a5e46c8-8bd1-48c5-b225-5b95ccec79ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:02.089899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5a5e46c8-8bd1-48c5-b225-5b95ccec79ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:02.098945 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a5e46c8-8bd1-48c5-b225-5b95ccec79ab tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 1.262346 Jul 20 04:22:02.103659 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1461/2852] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:00 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:02.273348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1339430034", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:02.420206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] validate_networks() for [('1b60abb6-5424-401f-b7ac-d06a262c24c3', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:22:02.577953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ea149077-1a0c-4311-97ff-840e986f4c8f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:02.589258 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ea149077-1a0c-4311-97ff-840e986f4c8f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1303 microversion: 2.1 time: 0.843851 Jul 20 04:22:02.589875 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1392/2853] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1303 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:02.763456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c9646d0e-78ef-4519-8231-280d768ea598 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:02.764382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c9646d0e-78ef-4519-8231-280d768ea598 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:02.780355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9646d0e-78ef-4519-8231-280d768ea598 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.781071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9646d0e-78ef-4519-8231-280d768ea598 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.784417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9646d0e-78ef-4519-8231-280d768ea598 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.785165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9646d0e-78ef-4519-8231-280d768ea598 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.920975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c9646d0e-78ef-4519-8231-280d768ea598 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:02.937254 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c9646d0e-78ef-4519-8231-280d768ea598 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1280 microversion: 2.1 time: 0.179982 Jul 20 04:22:02.937907 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1393/2854] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:02 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1280 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:03.126151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-11cc5afc-4aae-46aa-b08b-38bbcc314fe2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.129865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-11cc5afc-4aae-46aa-b08b-38bbcc314fe2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:03.144204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11cc5afc-4aae-46aa-b08b-38bbcc314fe2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.147005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11cc5afc-4aae-46aa-b08b-38bbcc314fe2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.148100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11cc5afc-4aae-46aa-b08b-38bbcc314fe2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.149947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11cc5afc-4aae-46aa-b08b-38bbcc314fe2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.629425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:03.629425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:03.629966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:03.630183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:03.632681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:03.670044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.670509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.676678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.683099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.734597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Getting quotas for project 2ba21f0dfdc04e41a9a30fa3dddf3e90. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:03.743916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Getting quotas for user a25a4e3b560846ec98b871b954481f09 and project 2ba21f0dfdc04e41a9a30fa3dddf3e90. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:03.775759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:22:03.781945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:03.860474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-11cc5afc-4aae-46aa-b08b-38bbcc314fe2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:03.877751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-11cc5afc-4aae-46aa-b08b-38bbcc314fe2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:03.889107 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b5f4a75-d3f9-4a7c-b9c4-84f1fb31fe79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.784202 Jul 20 04:22:03.892362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-11cc5afc-4aae-46aa-b08b-38bbcc314fe2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:03.892768 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1462/2855] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:22:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:22:03.895982 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-11cc5afc-4aae-46aa-b08b-38bbcc314fe2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.774983 Jul 20 04:22:03.908399 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1394/2856] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:03.915838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2b46d50a-d6e5-4388-8826-469e1932413e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.916450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-644e5b92-3b7b-4881-b71e-9a7ac1d9332c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.917778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2b46d50a-d6e5-4388-8826-469e1932413e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:03.918375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-644e5b92-3b7b-4881-b71e-9a7ac1d9332c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:03.927260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b46d50a-d6e5-4388-8826-469e1932413e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.928782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b46d50a-d6e5-4388-8826-469e1932413e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.929915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b46d50a-d6e5-4388-8826-469e1932413e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.930519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b46d50a-d6e5-4388-8826-469e1932413e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.223524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-644e5b92-3b7b-4881-b71e-9a7ac1d9332c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:04.268014 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-644e5b92-3b7b-4881-b71e-9a7ac1d9332c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1222 microversion: 2.1 time: 0.362929 Jul 20 04:22:04.275613 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1395/2857] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1222 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:04.295886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1cd6a1fc-dc52-4d75-8a8f-24e1ec5186ae tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:04.300413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1cd6a1fc-dc52-4d75-8a8f-24e1ec5186ae tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:04.324596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1cd6a1fc-dc52-4d75-8a8f-24e1ec5186ae tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.327555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1cd6a1fc-dc52-4d75-8a8f-24e1ec5186ae tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.328831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1cd6a1fc-dc52-4d75-8a8f-24e1ec5186ae tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.334316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1cd6a1fc-dc52-4d75-8a8f-24e1ec5186ae tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.677968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2b46d50a-d6e5-4388-8826-469e1932413e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:04.691735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1cd6a1fc-dc52-4d75-8a8f-24e1ec5186ae tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:04.700844 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2b46d50a-d6e5-4388-8826-469e1932413e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1303 microversion: 2.1 time: 0.806088 Jul 20 04:22:04.705893 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1463/2858] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1303 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:04.707786 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1cd6a1fc-dc52-4d75-8a8f-24e1ec5186ae tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1280 microversion: 2.1 time: 0.430190 Jul 20 04:22:04.722590 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1396/2859] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:04 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1280 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:04.726205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-162540502", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:04.803401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] validate_networks() for [('1b60abb6-5424-401f-b7ac-d06a262c24c3', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:22:04.918179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e4c96d1f-4833-423a-b845-9bfb12a66a4a tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:04.919794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e4c96d1f-4833-423a-b845-9bfb12a66a4a tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:04.926477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:04.929719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4c96d1f-4833-423a-b845-9bfb12a66a4a tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.931788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4c96d1f-4833-423a-b845-9bfb12a66a4a tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.937109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4c96d1f-4833-423a-b845-9bfb12a66a4a tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.938113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4c96d1f-4833-423a-b845-9bfb12a66a4a tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.108445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e4c96d1f-4833-423a-b845-9bfb12a66a4a tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:06.129625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e4c96d1f-4833-423a-b845-9bfb12a66a4a tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:06.137400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e4c96d1f-4833-423a-b845-9bfb12a66a4a tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:06.141682 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e4c96d1f-4833-423a-b845-9bfb12a66a4a tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 1.227624 Jul 20 04:22:06.144012 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1397/2860] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:04 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:06.157444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a95c3ca0-306b-4ee0-9976-078ad5852ea0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.158422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a95c3ca0-306b-4ee0-9976-078ad5852ea0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:06.175774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a95c3ca0-306b-4ee0-9976-078ad5852ea0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.178851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a95c3ca0-306b-4ee0-9976-078ad5852ea0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.181608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a95c3ca0-306b-4ee0-9976-078ad5852ea0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.184260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a95c3ca0-306b-4ee0-9976-078ad5852ea0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.311781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:07.383159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a95c3ca0-306b-4ee0-9976-078ad5852ea0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:07.393937 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a95c3ca0-306b-4ee0-9976-078ad5852ea0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1303 microversion: 2.1 time: 1.248655 Jul 20 04:22:07.394895 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1398/2861] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:06 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1303 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:07.419714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b58eb1ea-b972-430c-b65f-93a4d7eea4a8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:07.421869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b58eb1ea-b972-430c-b65f-93a4d7eea4a8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:07.442122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b58eb1ea-b972-430c-b65f-93a4d7eea4a8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:07.448010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b58eb1ea-b972-430c-b65f-93a4d7eea4a8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:07.449823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b58eb1ea-b972-430c-b65f-93a4d7eea4a8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:07.451291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b58eb1ea-b972-430c-b65f-93a4d7eea4a8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.216113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:08.217300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:08.217939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:08.218583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:08.219164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:08.251310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.251873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.252771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.253220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.319493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Getting quotas for project 2ba21f0dfdc04e41a9a30fa3dddf3e90. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:08.365333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Getting quotas for user a25a4e3b560846ec98b871b954481f09 and project 2ba21f0dfdc04e41a9a30fa3dddf3e90. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:08.441439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:22:08.449054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:08.509600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b58eb1ea-b972-430c-b65f-93a4d7eea4a8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:08.529577 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b58eb1ea-b972-430c-b65f-93a4d7eea4a8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 1.133204 Jul 20 04:22:08.532819 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1399/2862] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:07 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:08.548157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-baa99c48-f29d-45bd-8d31-76d8c0b4e1e4 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:08.549906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-baa99c48-f29d-45bd-8d31-76d8c0b4e1e4 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:08.565928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-baa99c48-f29d-45bd-8d31-76d8c0b4e1e4 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.572312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-baa99c48-f29d-45bd-8d31-76d8c0b4e1e4 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.581605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-baa99c48-f29d-45bd-8d31-76d8c0b4e1e4 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.582045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-baa99c48-f29d-45bd-8d31-76d8c0b4e1e4 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.585613 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ed6af437-4081-444d-8fef-44668996d355 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.875752 Jul 20 04:22:08.586424 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1464/2863] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:22:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 3880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:22:08.596965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-20a6d5b5-7b66-42ed-9192-b076393baad4 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:08.597730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-20a6d5b5-7b66-42ed-9192-b076393baad4 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:08.618619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20a6d5b5-7b66-42ed-9192-b076393baad4 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.619629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20a6d5b5-7b66-42ed-9192-b076393baad4 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.620677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20a6d5b5-7b66-42ed-9192-b076393baad4 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.621414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20a6d5b5-7b66-42ed-9192-b076393baad4 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.633945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:10.194041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-20a6d5b5-7b66-42ed-9192-b076393baad4 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:10.214227 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-20a6d5b5-7b66-42ed-9192-b076393baad4 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1291 microversion: 2.1 time: 1.626335 Jul 20 04:22:10.215147 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1465/2864] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:08 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1291 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:10.226987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-527f55c9-7a1c-410e-9a36-9b4ba7c64d10 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:10.230321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-527f55c9-7a1c-410e-9a36-9b4ba7c64d10 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:10.249414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-527f55c9-7a1c-410e-9a36-9b4ba7c64d10 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.250189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-527f55c9-7a1c-410e-9a36-9b4ba7c64d10 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.252075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-527f55c9-7a1c-410e-9a36-9b4ba7c64d10 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.254223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-527f55c9-7a1c-410e-9a36-9b4ba7c64d10 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.477559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-527f55c9-7a1c-410e-9a36-9b4ba7c64d10 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:10.485899 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-527f55c9-7a1c-410e-9a36-9b4ba7c64d10 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1273 microversion: 2.1 time: 0.267172 Jul 20 04:22:10.489331 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1466/2865] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:10 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:10.502549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-c6fa96ee-2b05-4d82-bff3-3e43ae224a89 req-c0f60a3e-8d80-4fc0-ab47-9deec42e8169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9c53e05-cfbb-479b-80a3-6a17db52e44f", "tag": "2b0d25d8-a589-4667-878e-c90799c2b8b1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:10.528284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c6fa96ee-2b05-4d82-bff3-3e43ae224a89 req-c0f60a3e-8d80-4fc0-ab47-9deec42e8169 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.528972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c6fa96ee-2b05-4d82-bff3-3e43ae224a89 req-c0f60a3e-8d80-4fc0-ab47-9deec42e8169 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.551459 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c6fa96ee-2b05-4d82-bff3-3e43ae224a89 req-c0f60a3e-8d80-4fc0-ab47-9deec42e8169 service nova] Creating event network-changed:2b0d25d8-a589-4667-878e-c90799c2b8b1 for instance c9c53e05-cfbb-479b-80a3-6a17db52e44f on n-h2-764485-11 Jul 20 04:22:10.566015 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-c6fa96ee-2b05-4d82-bff3-3e43ae224a89 req-c0f60a3e-8d80-4fc0-ab47-9deec42e8169 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073996 Jul 20 04:22:10.569923 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1467/2866] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:10.576339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c19f42c5-626c-43fc-9e28-2a7dcd57ce05 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:10.577735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c19f42c5-626c-43fc-9e28-2a7dcd57ce05 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:10.592122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c19f42c5-626c-43fc-9e28-2a7dcd57ce05 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.595877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c19f42c5-626c-43fc-9e28-2a7dcd57ce05 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.596951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c19f42c5-626c-43fc-9e28-2a7dcd57ce05 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.597605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c19f42c5-626c-43fc-9e28-2a7dcd57ce05 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.804547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-baa99c48-f29d-45bd-8d31-76d8c0b4e1e4 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:10.825047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-baa99c48-f29d-45bd-8d31-76d8c0b4e1e4 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:10.830176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-baa99c48-f29d-45bd-8d31-76d8c0b4e1e4 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:10.831768 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-baa99c48-f29d-45bd-8d31-76d8c0b4e1e4 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 2.297886 Jul 20 04:22:10.832999 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1400/2867] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:08 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:10.841433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e0504a01-edfc-4149-b4ca-7ee89e19d017 req-e797d9b8-6cbb-4486-9385-ab607cef6d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1b703c-85b1-4e4f-b55e-663c74bbb5bd", "tag": "b1ed6446-a73f-4f7c-a7b1-a59aef5b6f53"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:10.855586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e0504a01-edfc-4149-b4ca-7ee89e19d017 req-e797d9b8-6cbb-4486-9385-ab607cef6d13 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.856486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e0504a01-edfc-4149-b4ca-7ee89e19d017 req-e797d9b8-6cbb-4486-9385-ab607cef6d13 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.870777 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e0504a01-edfc-4149-b4ca-7ee89e19d017 req-e797d9b8-6cbb-4486-9385-ab607cef6d13 service nova] Creating event network-changed:b1ed6446-a73f-4f7c-a7b1-a59aef5b6f53 for instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd on n-h2-764485-11 Jul 20 04:22:10.876446 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e0504a01-edfc-4149-b4ca-7ee89e19d017 req-e797d9b8-6cbb-4486-9385-ab607cef6d13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041250 Jul 20 04:22:10.877767 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1401/2868] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:11.119966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c19f42c5-626c-43fc-9e28-2a7dcd57ce05 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:11.130026 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c19f42c5-626c-43fc-9e28-2a7dcd57ce05 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.558488 Jul 20 04:22:11.131460 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1468/2869] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:10 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:11.256466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-58e730b5-eab8-454b-aee6-469271f7e984 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:11.259750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-58e730b5-eab8-454b-aee6-469271f7e984 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:11.279955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58e730b5-eab8-454b-aee6-469271f7e984 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.281538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58e730b5-eab8-454b-aee6-469271f7e984 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.283133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58e730b5-eab8-454b-aee6-469271f7e984 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.284563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58e730b5-eab8-454b-aee6-469271f7e984 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.507562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-96d00682-429a-46bd-9056-86cbee4ff370 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:11.509310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-96d00682-429a-46bd-9056-86cbee4ff370 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:11.522603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96d00682-429a-46bd-9056-86cbee4ff370 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.525242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96d00682-429a-46bd-9056-86cbee4ff370 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.527037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96d00682-429a-46bd-9056-86cbee4ff370 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.527821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96d00682-429a-46bd-9056-86cbee4ff370 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.565569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-58e730b5-eab8-454b-aee6-469271f7e984 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:11.582211 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-58e730b5-eab8-454b-aee6-469271f7e984 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1291 microversion: 2.1 time: 0.353249 Jul 20 04:22:11.583230 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1402/2870] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:11 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1291 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:11.611256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-96d00682-429a-46bd-9056-86cbee4ff370 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:11.620778 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-96d00682-429a-46bd-9056-86cbee4ff370 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1279 microversion: 2.1 time: 0.118387 Jul 20 04:22:11.621520 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1469/2871] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:11 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:11.853752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5a9da059-9d6a-45b9-9bcd-25a822a9b63d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:11.855414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a9da059-9d6a-45b9-9bcd-25a822a9b63d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:11.869404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a9da059-9d6a-45b9-9bcd-25a822a9b63d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.875099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a9da059-9d6a-45b9-9bcd-25a822a9b63d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.877105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a9da059-9d6a-45b9-9bcd-25a822a9b63d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.881848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a9da059-9d6a-45b9-9bcd-25a822a9b63d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.148840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9224b5e4-462d-49f3-91d9-a0ff4b13e4de tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:12.149761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9224b5e4-462d-49f3-91d9-a0ff4b13e4de tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:12.163748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9224b5e4-462d-49f3-91d9-a0ff4b13e4de tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.164596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9224b5e4-462d-49f3-91d9-a0ff4b13e4de tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.165651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9224b5e4-462d-49f3-91d9-a0ff4b13e4de tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.166395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9224b5e4-462d-49f3-91d9-a0ff4b13e4de tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.510249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9224b5e4-462d-49f3-91d9-a0ff4b13e4de tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:12.512151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a9da059-9d6a-45b9-9bcd-25a822a9b63d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:12.527867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a9da059-9d6a-45b9-9bcd-25a822a9b63d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:12.530751 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9224b5e4-462d-49f3-91d9-a0ff4b13e4de tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.384008 Jul 20 04:22:12.530751 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1470/2872] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:12 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:12.534090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a9da059-9d6a-45b9-9bcd-25a822a9b63d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:12.535795 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5a9da059-9d6a-45b9-9bcd-25a822a9b63d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.688633 Jul 20 04:22:12.549595 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1403/2873] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:11 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:12.603848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-866070b9-9e4e-4410-a310-7e7c5ea30f7b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:12.604890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-866070b9-9e4e-4410-a310-7e7c5ea30f7b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:12.613249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-866070b9-9e4e-4410-a310-7e7c5ea30f7b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.613710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-866070b9-9e4e-4410-a310-7e7c5ea30f7b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.614989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-866070b9-9e4e-4410-a310-7e7c5ea30f7b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.615887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-866070b9-9e4e-4410-a310-7e7c5ea30f7b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.644941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-55a72a99-f22e-4f4b-b09b-4ee214918830 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:12.647656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-55a72a99-f22e-4f4b-b09b-4ee214918830 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:12.659493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55a72a99-f22e-4f4b-b09b-4ee214918830 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.659925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55a72a99-f22e-4f4b-b09b-4ee214918830 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.664384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55a72a99-f22e-4f4b-b09b-4ee214918830 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.664852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55a72a99-f22e-4f4b-b09b-4ee214918830 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.847793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-866070b9-9e4e-4410-a310-7e7c5ea30f7b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:12.866979 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-866070b9-9e4e-4410-a310-7e7c5ea30f7b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1291 microversion: 2.1 time: 0.269302 Jul 20 04:22:12.869097 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1471/2874] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:12 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1291 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:12.872488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-55a72a99-f22e-4f4b-b09b-4ee214918830 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:12.877704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-385ded28-891c-49b1-8391-8e92d6ef3ecb req-f9deaa64-166d-44ad-a7a7-172b8d622c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425d15e8-b80e-4921-89e1-c81e97829f29", "tag": "6df7a16c-fb5a-4718-9c5e-d12d30b2a431"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:12.881632 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-55a72a99-f22e-4f4b-b09b-4ee214918830 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.247835 Jul 20 04:22:12.882293 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1404/2875] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:12 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:12.891256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-385ded28-891c-49b1-8391-8e92d6ef3ecb req-f9deaa64-166d-44ad-a7a7-172b8d622c08 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.891807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-385ded28-891c-49b1-8391-8e92d6ef3ecb req-f9deaa64-166d-44ad-a7a7-172b8d622c08 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.905395 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-385ded28-891c-49b1-8391-8e92d6ef3ecb req-f9deaa64-166d-44ad-a7a7-172b8d622c08 service nova] Creating event network-changed:6df7a16c-fb5a-4718-9c5e-d12d30b2a431 for instance 425d15e8-b80e-4921-89e1-c81e97829f29 on n-h1-764485-11 Jul 20 04:22:12.911087 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-385ded28-891c-49b1-8391-8e92d6ef3ecb req-f9deaa64-166d-44ad-a7a7-172b8d622c08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040151 Jul 20 04:22:12.912632 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1472/2876] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:12.970598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1c5b8559-6579-4bc9-a241-b63ab9542bfc req-40a8ef5b-cbee-4d26-8bd3-10696d368d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839", "tag": "b1fe305d-7589-4093-92e7-6ca7f8c96f62"}, {"name": "network-changed", "server_uuid": "8542411a-8f79-4e60-8812-ed64ed34a90f", "tag": "6387a7ee-0405-45ab-b7a2-a8f09dbce266"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:12.980268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1c5b8559-6579-4bc9-a241-b63ab9542bfc req-40a8ef5b-cbee-4d26-8bd3-10696d368d92 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.980719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1c5b8559-6579-4bc9-a241-b63ab9542bfc req-40a8ef5b-cbee-4d26-8bd3-10696d368d92 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.997298 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1c5b8559-6579-4bc9-a241-b63ab9542bfc req-40a8ef5b-cbee-4d26-8bd3-10696d368d92 service nova] Creating event network-changed:b1fe305d-7589-4093-92e7-6ca7f8c96f62 for instance 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 on n-h2-764485-11 Jul 20 04:22:12.997884 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1c5b8559-6579-4bc9-a241-b63ab9542bfc req-40a8ef5b-cbee-4d26-8bd3-10696d368d92 service nova] Creating event network-changed:6387a7ee-0405-45ab-b7a2-a8f09dbce266 for instance 8542411a-8f79-4e60-8812-ed64ed34a90f on n-h1-764485-11 Jul 20 04:22:13.012505 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1c5b8559-6579-4bc9-a241-b63ab9542bfc req-40a8ef5b-cbee-4d26-8bd3-10696d368d92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045461 Jul 20 04:22:13.013394 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1405/2877] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:13.548172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bed281e7-8a59-482f-9779-2064cfee2e42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:13.549220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bed281e7-8a59-482f-9779-2064cfee2e42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:13.556699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bed281e7-8a59-482f-9779-2064cfee2e42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.557064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bed281e7-8a59-482f-9779-2064cfee2e42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.558005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bed281e7-8a59-482f-9779-2064cfee2e42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.558448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bed281e7-8a59-482f-9779-2064cfee2e42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.558594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e3bfafb2-c3ac-47d3-9288-6e1ecdb3b311 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:13.559578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e3bfafb2-c3ac-47d3-9288-6e1ecdb3b311 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:13.566246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3bfafb2-c3ac-47d3-9288-6e1ecdb3b311 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.566986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3bfafb2-c3ac-47d3-9288-6e1ecdb3b311 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.568871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3bfafb2-c3ac-47d3-9288-6e1ecdb3b311 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.569387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3bfafb2-c3ac-47d3-9288-6e1ecdb3b311 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.823148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bed281e7-8a59-482f-9779-2064cfee2e42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:13.833822 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bed281e7-8a59-482f-9779-2064cfee2e42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.291014 Jul 20 04:22:13.838609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e3bfafb2-c3ac-47d3-9288-6e1ecdb3b311 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:13.842955 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1473/2878] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:13 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:13.848714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e3bfafb2-c3ac-47d3-9288-6e1ecdb3b311 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:13.851178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e3bfafb2-c3ac-47d3-9288-6e1ecdb3b311 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:13.852507 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e3bfafb2-c3ac-47d3-9288-6e1ecdb3b311 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.299516 Jul 20 04:22:13.863180 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1406/2879] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:13 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:13.885577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67a21ee9-8fd2-4b3d-b991-75511c38ae24 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:13.886201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67a21ee9-8fd2-4b3d-b991-75511c38ae24 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:13.892580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67a21ee9-8fd2-4b3d-b991-75511c38ae24 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.893508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67a21ee9-8fd2-4b3d-b991-75511c38ae24 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.894548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67a21ee9-8fd2-4b3d-b991-75511c38ae24 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.894996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67a21ee9-8fd2-4b3d-b991-75511c38ae24 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.901889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-58ad3c61-c193-481d-81ee-90bdddff91ae tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:13.902794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-58ad3c61-c193-481d-81ee-90bdddff91ae tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:13.910009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58ad3c61-c193-481d-81ee-90bdddff91ae tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.910792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58ad3c61-c193-481d-81ee-90bdddff91ae tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.912357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58ad3c61-c193-481d-81ee-90bdddff91ae tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.913015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58ad3c61-c193-481d-81ee-90bdddff91ae tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.118003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67a21ee9-8fd2-4b3d-b991-75511c38ae24 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:14.130400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-58ad3c61-c193-481d-81ee-90bdddff91ae tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:14.132289 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67a21ee9-8fd2-4b3d-b991-75511c38ae24 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1291 microversion: 2.1 time: 0.250456 Jul 20 04:22:14.132910 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1474/2880] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:13 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1291 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:14.139687 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-58ad3c61-c193-481d-81ee-90bdddff91ae tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.245259 Jul 20 04:22:14.141157 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1407/2881] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:13 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:14.851969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7f6ed262-6c56-450d-b727-26f72da30bbf tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:14.853317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7f6ed262-6c56-450d-b727-26f72da30bbf tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:14.862228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f6ed262-6c56-450d-b727-26f72da30bbf tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.862889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f6ed262-6c56-450d-b727-26f72da30bbf tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.872646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6e614de6-e8f6-4812-be5c-9277f832fe7c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:14.872646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6e614de6-e8f6-4812-be5c-9277f832fe7c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:14.877925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f6ed262-6c56-450d-b727-26f72da30bbf tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.881300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:14.881830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f6ed262-6c56-450d-b727-26f72da30bbf tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.887239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6e614de6-e8f6-4812-be5c-9277f832fe7c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.889635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6e614de6-e8f6-4812-be5c-9277f832fe7c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.892480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6e614de6-e8f6-4812-be5c-9277f832fe7c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.893772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6e614de6-e8f6-4812-be5c-9277f832fe7c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.901575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:15.311567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7f6ed262-6c56-450d-b727-26f72da30bbf tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:15.318538 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7f6ed262-6c56-450d-b727-26f72da30bbf tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.471126 Jul 20 04:22:15.319108 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1475/2882] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:14 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:15.342807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-853d7ee9-ab71-4d5e-b90d-df2eb563ae80 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:15.343459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-853d7ee9-ab71-4d5e-b90d-df2eb563ae80 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:15.359193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-853d7ee9-ab71-4d5e-b90d-df2eb563ae80 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.359690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-853d7ee9-ab71-4d5e-b90d-df2eb563ae80 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.360477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-853d7ee9-ab71-4d5e-b90d-df2eb563ae80 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.365192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-853d7ee9-ab71-4d5e-b90d-df2eb563ae80 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.395177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6e614de6-e8f6-4812-be5c-9277f832fe7c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:15.408478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6e614de6-e8f6-4812-be5c-9277f832fe7c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:15.410494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6e614de6-e8f6-4812-be5c-9277f832fe7c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:15.413037 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6e614de6-e8f6-4812-be5c-9277f832fe7c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.545172 Jul 20 04:22:15.426549 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1408/2883] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:14 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:15.432921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b349a39b-c9cb-4e17-8b2d-cdb3df3a3f9b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:15.434232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b349a39b-c9cb-4e17-8b2d-cdb3df3a3f9b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:15.442084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b349a39b-c9cb-4e17-8b2d-cdb3df3a3f9b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.443349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b349a39b-c9cb-4e17-8b2d-cdb3df3a3f9b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.445675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b349a39b-c9cb-4e17-8b2d-cdb3df3a3f9b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.446303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b349a39b-c9cb-4e17-8b2d-cdb3df3a3f9b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.723533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-853d7ee9-ab71-4d5e-b90d-df2eb563ae80 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:15.737717 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-853d7ee9-ab71-4d5e-b90d-df2eb563ae80 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1291 microversion: 2.1 time: 0.397396 Jul 20 04:22:15.740895 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1476/2884] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:15 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1291 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:15.920525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b349a39b-c9cb-4e17-8b2d-cdb3df3a3f9b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:15.929459 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b349a39b-c9cb-4e17-8b2d-cdb3df3a3f9b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.500852 Jul 20 04:22:15.932879 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1409/2885] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:15 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:16.336636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f50425b7-208f-47c5-8608-58c90a1a18a5 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:16.337267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f50425b7-208f-47c5-8608-58c90a1a18a5 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:16.344784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f50425b7-208f-47c5-8608-58c90a1a18a5 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.345769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f50425b7-208f-47c5-8608-58c90a1a18a5 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.346550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f50425b7-208f-47c5-8608-58c90a1a18a5 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.347155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f50425b7-208f-47c5-8608-58c90a1a18a5 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.434740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-063f1bda-bca1-4a77-b37a-2838fe4951d5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:16.435390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-063f1bda-bca1-4a77-b37a-2838fe4951d5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:16.441909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-063f1bda-bca1-4a77-b37a-2838fe4951d5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.442290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-063f1bda-bca1-4a77-b37a-2838fe4951d5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.444153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-063f1bda-bca1-4a77-b37a-2838fe4951d5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.444670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-063f1bda-bca1-4a77-b37a-2838fe4951d5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.510294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f50425b7-208f-47c5-8608-58c90a1a18a5 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.521480 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f50425b7-208f-47c5-8608-58c90a1a18a5 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.189421 Jul 20 04:22:16.522442 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1477/2886] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:16 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:16.652567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-063f1bda-bca1-4a77-b37a-2838fe4951d5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.663280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-063f1bda-bca1-4a77-b37a-2838fe4951d5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.664944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-063f1bda-bca1-4a77-b37a-2838fe4951d5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.666163 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-063f1bda-bca1-4a77-b37a-2838fe4951d5 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.235359 Jul 20 04:22:16.667056 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1410/2887] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:16 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:16.757899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2cdb8da1-124c-4b36-b83f-518e7920c240 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:16.758676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2cdb8da1-124c-4b36-b83f-518e7920c240 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:16.765350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2cdb8da1-124c-4b36-b83f-518e7920c240 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.765798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2cdb8da1-124c-4b36-b83f-518e7920c240 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.766585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2cdb8da1-124c-4b36-b83f-518e7920c240 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.767411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2cdb8da1-124c-4b36-b83f-518e7920c240 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.914117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2cdb8da1-124c-4b36-b83f-518e7920c240 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.922343 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2cdb8da1-124c-4b36-b83f-518e7920c240 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1291 microversion: 2.1 time: 0.169900 Jul 20 04:22:16.923157 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1478/2888] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:16 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1291 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:16.949466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ed5d066d-b676-4ab6-a5cf-49c91473c0c1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:16.950443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ed5d066d-b676-4ab6-a5cf-49c91473c0c1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:16.957434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed5d066d-b676-4ab6-a5cf-49c91473c0c1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.957886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed5d066d-b676-4ab6-a5cf-49c91473c0c1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.958712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed5d066d-b676-4ab6-a5cf-49c91473c0c1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.960106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed5d066d-b676-4ab6-a5cf-49c91473c0c1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.112261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ed5d066d-b676-4ab6-a5cf-49c91473c0c1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:17.120207 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ed5d066d-b676-4ab6-a5cf-49c91473c0c1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.174810 Jul 20 04:22:17.120803 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1411/2889] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:16 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:17.538484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7491d27a-4028-47c9-b5a2-644b156935b9 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:17.539101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7491d27a-4028-47c9-b5a2-644b156935b9 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:17.542005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:17.547926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7491d27a-4028-47c9-b5a2-644b156935b9 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.548378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7491d27a-4028-47c9-b5a2-644b156935b9 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.549148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7491d27a-4028-47c9-b5a2-644b156935b9 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.549634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7491d27a-4028-47c9-b5a2-644b156935b9 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.684832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b59859be-9951-4861-afdb-087c16aaa580 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:17.685686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b59859be-9951-4861-afdb-087c16aaa580 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:17.686059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7491d27a-4028-47c9-b5a2-644b156935b9 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:17.693348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b59859be-9951-4861-afdb-087c16aaa580 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.693934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b59859be-9951-4861-afdb-087c16aaa580 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.694583 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7491d27a-4028-47c9-b5a2-644b156935b9 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.160277 Jul 20 04:22:17.694934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b59859be-9951-4861-afdb-087c16aaa580 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.695360 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1479/2890] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:17 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:17.695694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b59859be-9951-4861-afdb-087c16aaa580 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.890122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b59859be-9951-4861-afdb-087c16aaa580 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:17.899923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b59859be-9951-4861-afdb-087c16aaa580 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:17.902103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b59859be-9951-4861-afdb-087c16aaa580 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:17.903323 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b59859be-9951-4861-afdb-087c16aaa580 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.222772 Jul 20 04:22:17.904002 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1412/2891] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:17 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:17.940718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ff861282-f371-4bb6-a08f-c6939f8489b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:17.941343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ff861282-f371-4bb6-a08f-c6939f8489b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:17.948612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff861282-f371-4bb6-a08f-c6939f8489b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.949097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff861282-f371-4bb6-a08f-c6939f8489b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.949942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff861282-f371-4bb6-a08f-c6939f8489b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.950388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff861282-f371-4bb6-a08f-c6939f8489b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.086811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ff861282-f371-4bb6-a08f-c6939f8489b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:18.098171 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ff861282-f371-4bb6-a08f-c6939f8489b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1291 microversion: 2.1 time: 0.161531 Jul 20 04:22:18.098824 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1480/2892] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:17 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1291 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:18.137583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4b2e0847-cae9-43e0-843f-9d28c95082b3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:18.138270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4b2e0847-cae9-43e0-843f-9d28c95082b3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:18.144918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b2e0847-cae9-43e0-843f-9d28c95082b3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.145371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b2e0847-cae9-43e0-843f-9d28c95082b3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.146345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b2e0847-cae9-43e0-843f-9d28c95082b3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.146735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b2e0847-cae9-43e0-843f-9d28c95082b3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.285890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4b2e0847-cae9-43e0-843f-9d28c95082b3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:18.294373 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4b2e0847-cae9-43e0-843f-9d28c95082b3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.160761 Jul 20 04:22:18.294974 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1413/2893] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:18 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:18.712182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f7369b7-760f-4fd5-acda-04706c1fcfb4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:18.712895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1f7369b7-760f-4fd5-acda-04706c1fcfb4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:18.714982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:18.715799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=22 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:18.723721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f7369b7-760f-4fd5-acda-04706c1fcfb4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.724801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f7369b7-760f-4fd5-acda-04706c1fcfb4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.725594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f7369b7-760f-4fd5-acda-04706c1fcfb4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.726038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f7369b7-760f-4fd5-acda-04706c1fcfb4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.897780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1f7369b7-760f-4fd5-acda-04706c1fcfb4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:18.908927 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f7369b7-760f-4fd5-acda-04706c1fcfb4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.201394 Jul 20 04:22:18.910293 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1481/2894] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:18 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:18.925275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ebd1583-87de-4f6c-8d89-298c71c49d52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:18.925827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ebd1583-87de-4f6c-8d89-298c71c49d52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:18.932844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ebd1583-87de-4f6c-8d89-298c71c49d52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.933297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ebd1583-87de-4f6c-8d89-298c71c49d52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.934308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ebd1583-87de-4f6c-8d89-298c71c49d52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.934912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ebd1583-87de-4f6c-8d89-298c71c49d52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.073175 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2a2e9563-9f11-42f2-a057-62bd2b2a3272 req-57d97217-eb1d-471f-b299-a62c168870a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9c53e05-cfbb-479b-80a3-6a17db52e44f", "name": "network-vif-plugged", "status": "completed", "tag": "2b0d25d8-a589-4667-878e-c90799c2b8b1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:19.102594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2a2e9563-9f11-42f2-a057-62bd2b2a3272 req-57d97217-eb1d-471f-b299-a62c168870a7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.105257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2a2e9563-9f11-42f2-a057-62bd2b2a3272 req-57d97217-eb1d-471f-b299-a62c168870a7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.126417 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2a2e9563-9f11-42f2-a057-62bd2b2a3272 req-57d97217-eb1d-471f-b299-a62c168870a7 service nova] Creating event network-vif-plugged:2b0d25d8-a589-4667-878e-c90799c2b8b1 for instance c9c53e05-cfbb-479b-80a3-6a17db52e44f on n-h2-764485-11 Jul 20 04:22:19.143063 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2a2e9563-9f11-42f2-a057-62bd2b2a3272 req-57d97217-eb1d-471f-b299-a62c168870a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075727 Jul 20 04:22:19.144263 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1482/2895] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:19.161053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-95178308-7d33-4ff7-b5d6-a1535818fba5 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:19.161897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-95178308-7d33-4ff7-b5d6-a1535818fba5 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:19.170544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95178308-7d33-4ff7-b5d6-a1535818fba5 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.171006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95178308-7d33-4ff7-b5d6-a1535818fba5 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.171828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95178308-7d33-4ff7-b5d6-a1535818fba5 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.175289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95178308-7d33-4ff7-b5d6-a1535818fba5 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.299817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ebd1583-87de-4f6c-8d89-298c71c49d52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.329300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ebd1583-87de-4f6c-8d89-298c71c49d52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.337240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ebd1583-87de-4f6c-8d89-298c71c49d52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.346289 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ebd1583-87de-4f6c-8d89-298c71c49d52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.423496 Jul 20 04:22:19.360095 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1414/2896] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:18 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:19.370843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a2c15f0-1718-49d1-ac1b-23ff68f16b32 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:19.375458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4a2c15f0-1718-49d1-ac1b-23ff68f16b32 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:19.382904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a2c15f0-1718-49d1-ac1b-23ff68f16b32 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.384176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a2c15f0-1718-49d1-ac1b-23ff68f16b32 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.385278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a2c15f0-1718-49d1-ac1b-23ff68f16b32 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.386386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a2c15f0-1718-49d1-ac1b-23ff68f16b32 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.748619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-95178308-7d33-4ff7-b5d6-a1535818fba5 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.752706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:19.758300 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-95178308-7d33-4ff7-b5d6-a1535818fba5 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1291 microversion: 2.1 time: 0.612812 Jul 20 04:22:19.759127 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1483/2897] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:19 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1291 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:19.874763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a2c15f0-1718-49d1-ac1b-23ff68f16b32 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.884067 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a2c15f0-1718-49d1-ac1b-23ff68f16b32 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.521536 Jul 20 04:22:19.885395 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1415/2898] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:19 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:19.926412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-46701765-16e9-4432-8978-34beade38db4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:19.927575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-46701765-16e9-4432-8978-34beade38db4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:19.933975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46701765-16e9-4432-8978-34beade38db4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.934405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46701765-16e9-4432-8978-34beade38db4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.935174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46701765-16e9-4432-8978-34beade38db4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.935649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46701765-16e9-4432-8978-34beade38db4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.097911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-46701765-16e9-4432-8978-34beade38db4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:20.108581 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-46701765-16e9-4432-8978-34beade38db4 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.185976 Jul 20 04:22:20.109297 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1484/2899] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:19 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:20.374482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-952bf4f8-5910-4ce9-ba74-c609c1baa07d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:20.375271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-952bf4f8-5910-4ce9-ba74-c609c1baa07d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:20.384453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-952bf4f8-5910-4ce9-ba74-c609c1baa07d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.384453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-952bf4f8-5910-4ce9-ba74-c609c1baa07d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.384911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-952bf4f8-5910-4ce9-ba74-c609c1baa07d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.385386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-952bf4f8-5910-4ce9-ba74-c609c1baa07d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.600839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-952bf4f8-5910-4ce9-ba74-c609c1baa07d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:20.614523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-952bf4f8-5910-4ce9-ba74-c609c1baa07d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:20.616767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-952bf4f8-5910-4ce9-ba74-c609c1baa07d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:20.618540 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-952bf4f8-5910-4ce9-ba74-c609c1baa07d tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.247986 Jul 20 04:22:20.619241 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1416/2900] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:20 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:20.776103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e21f9b4-e0c1-46b4-b21e-d72596928919 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:20.776770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6e21f9b4-e0c1-46b4-b21e-d72596928919 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:20.783676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e21f9b4-e0c1-46b4-b21e-d72596928919 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.784130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e21f9b4-e0c1-46b4-b21e-d72596928919 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.784890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e21f9b4-e0c1-46b4-b21e-d72596928919 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.785358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e21f9b4-e0c1-46b4-b21e-d72596928919 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.908204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-986099ca-89a7-428b-9ac0-c44608490e74 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:20.909159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-986099ca-89a7-428b-9ac0-c44608490e74 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:20.915834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-986099ca-89a7-428b-9ac0-c44608490e74 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.916298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-986099ca-89a7-428b-9ac0-c44608490e74 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.917088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-986099ca-89a7-428b-9ac0-c44608490e74 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.917540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-986099ca-89a7-428b-9ac0-c44608490e74 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.997599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6e21f9b4-e0c1-46b4-b21e-d72596928919 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:21.007097 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6e21f9b4-e0c1-46b4-b21e-d72596928919 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1291 microversion: 2.1 time: 0.234786 Jul 20 04:22:21.007860 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1485/2901] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:20 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1291 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:21.125413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b97db65b-cdac-4a3a-8678-8c1ab3b3e9a7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:21.126056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b97db65b-cdac-4a3a-8678-8c1ab3b3e9a7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.136154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b97db65b-cdac-4a3a-8678-8c1ab3b3e9a7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.136991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b97db65b-cdac-4a3a-8678-8c1ab3b3e9a7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.137770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b97db65b-cdac-4a3a-8678-8c1ab3b3e9a7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.138742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b97db65b-cdac-4a3a-8678-8c1ab3b3e9a7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.224552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-986099ca-89a7-428b-9ac0-c44608490e74 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:21.241119 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-986099ca-89a7-428b-9ac0-c44608490e74 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.339017 Jul 20 04:22:21.242372 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1417/2902] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:20 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:21.248320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c95d8e9b-9879-4ee4-91d9-4ae535c60a0e req-33d8bdb7-2493-4054-9628-1336036924a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48fbccd-a6bb-42bd-8472-a224bb30c0b0", "name": "network-vif-plugged", "status": "completed", "tag": "567b5770-118a-4239-8f7a-d878b7417a17"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:21.260917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c95d8e9b-9879-4ee4-91d9-4ae535c60a0e req-33d8bdb7-2493-4054-9628-1336036924a3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.261529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c95d8e9b-9879-4ee4-91d9-4ae535c60a0e req-33d8bdb7-2493-4054-9628-1336036924a3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.277316 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c95d8e9b-9879-4ee4-91d9-4ae535c60a0e req-33d8bdb7-2493-4054-9628-1336036924a3 service nova] Creating event network-vif-plugged:567b5770-118a-4239-8f7a-d878b7417a17 for instance c48fbccd-a6bb-42bd-8472-a224bb30c0b0 on n-h2-764485-11 Jul 20 04:22:21.284796 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c95d8e9b-9879-4ee4-91d9-4ae535c60a0e req-33d8bdb7-2493-4054-9628-1336036924a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039387 Jul 20 04:22:21.286729 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1418/2903] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:21.358549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b97db65b-cdac-4a3a-8678-8c1ab3b3e9a7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:21.367282 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b97db65b-cdac-4a3a-8678-8c1ab3b3e9a7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.246053 Jul 20 04:22:21.367921 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1486/2904] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:21 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:21.638201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-09593dfa-bb1e-4b8d-9794-501b56d410ac tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:21.640266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-09593dfa-bb1e-4b8d-9794-501b56d410ac tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.665026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-09593dfa-bb1e-4b8d-9794-501b56d410ac tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.666671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-09593dfa-bb1e-4b8d-9794-501b56d410ac tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.667783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-09593dfa-bb1e-4b8d-9794-501b56d410ac tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.668602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-09593dfa-bb1e-4b8d-9794-501b56d410ac tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.026666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aec82953-70c5-48f8-a03a-51df0d94b1ea tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:22.027374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aec82953-70c5-48f8-a03a-51df0d94b1ea tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:22.046792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aec82953-70c5-48f8-a03a-51df0d94b1ea tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.047428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aec82953-70c5-48f8-a03a-51df0d94b1ea tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.049824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aec82953-70c5-48f8-a03a-51df0d94b1ea tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.050053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-09593dfa-bb1e-4b8d-9794-501b56d410ac tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.050465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aec82953-70c5-48f8-a03a-51df0d94b1ea tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.061030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-09593dfa-bb1e-4b8d-9794-501b56d410ac tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.062740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-09593dfa-bb1e-4b8d-9794-501b56d410ac tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.064107 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-09593dfa-bb1e-4b8d-9794-501b56d410ac tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.430285 Jul 20 04:22:22.065029 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1419/2905] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:21 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:22.221618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aec82953-70c5-48f8-a03a-51df0d94b1ea tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.240945 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aec82953-70c5-48f8-a03a-51df0d94b1ea tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1291 microversion: 2.1 time: 0.220621 Jul 20 04:22:22.241683 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1487/2906] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:22 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1291 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:22.259482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ef11e929-ee9f-4e19-9fc9-663ab6440161 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:22.260495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ef11e929-ee9f-4e19-9fc9-663ab6440161 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:22.267308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef11e929-ee9f-4e19-9fc9-663ab6440161 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.267855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef11e929-ee9f-4e19-9fc9-663ab6440161 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.268663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef11e929-ee9f-4e19-9fc9-663ab6440161 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.269145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef11e929-ee9f-4e19-9fc9-663ab6440161 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.387744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ca410cc7-46ff-4fd2-9574-2fbccbdd4879 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:22.388934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca410cc7-46ff-4fd2-9574-2fbccbdd4879 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:22.399869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca410cc7-46ff-4fd2-9574-2fbccbdd4879 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.400241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca410cc7-46ff-4fd2-9574-2fbccbdd4879 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.401043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca410cc7-46ff-4fd2-9574-2fbccbdd4879 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.401482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca410cc7-46ff-4fd2-9574-2fbccbdd4879 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.436192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ef11e929-ee9f-4e19-9fc9-663ab6440161 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.446271 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ef11e929-ee9f-4e19-9fc9-663ab6440161 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.191924 Jul 20 04:22:22.447568 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1420/2907] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:22 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:22.594656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ca410cc7-46ff-4fd2-9574-2fbccbdd4879 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.604429 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ca410cc7-46ff-4fd2-9574-2fbccbdd4879 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.223136 Jul 20 04:22:22.605005 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1488/2908] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:22 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:22.984299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc6bede0-2b96-4cc4-adc6-183c5299cdc3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:22.985029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc6bede0-2b96-4cc4-adc6-183c5299cdc3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:22.992795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc6bede0-2b96-4cc4-adc6-183c5299cdc3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.993255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc6bede0-2b96-4cc4-adc6-183c5299cdc3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.994267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc6bede0-2b96-4cc4-adc6-183c5299cdc3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.994801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc6bede0-2b96-4cc4-adc6-183c5299cdc3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.086376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e30080f2-fff7-48d7-b329-f6fb2a313cfd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:23.088020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e30080f2-fff7-48d7-b329-f6fb2a313cfd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:23.100957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e30080f2-fff7-48d7-b329-f6fb2a313cfd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.101718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e30080f2-fff7-48d7-b329-f6fb2a313cfd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.102678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e30080f2-fff7-48d7-b329-f6fb2a313cfd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.103283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e30080f2-fff7-48d7-b329-f6fb2a313cfd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.342212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fc6bede0-2b96-4cc4-adc6-183c5299cdc3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:23.360952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fc6bede0-2b96-4cc4-adc6-183c5299cdc3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:23.365538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fc6bede0-2b96-4cc4-adc6-183c5299cdc3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:23.368895 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc6bede0-2b96-4cc4-adc6-183c5299cdc3 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2955 microversion: 2.42 time: 0.388246 Jul 20 04:22:23.370644 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1421/2909] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:22 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2955 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:23.377321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7f600396-b495-4daf-8405-547acdc122f0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:23.378599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7f600396-b495-4daf-8405-547acdc122f0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:23.393456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e30080f2-fff7-48d7-b329-f6fb2a313cfd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:23.398587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f600396-b495-4daf-8405-547acdc122f0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.399632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f600396-b495-4daf-8405-547acdc122f0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.400739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f600396-b495-4daf-8405-547acdc122f0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.402188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f600396-b495-4daf-8405-547acdc122f0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.404781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e30080f2-fff7-48d7-b329-f6fb2a313cfd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:23.406681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e30080f2-fff7-48d7-b329-f6fb2a313cfd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:23.415216 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e30080f2-fff7-48d7-b329-f6fb2a313cfd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.325738 Jul 20 04:22:23.429145 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1489/2910] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:23 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:23.436989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-b230b6d5-05d0-4b58-ad2c-ac6d0d17b40e req-9e1cffc6-f606-470e-923f-b8718881333c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1b703c-85b1-4e4f-b55e-663c74bbb5bd", "name": "network-vif-plugged", "status": "completed", "tag": "b1ed6446-a73f-4f7c-a7b1-a59aef5b6f53"}, {"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-plugged", "status": "completed", "tag": "a5a8eb43-fc76-4f14-ba26-ef8b675f4786"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:23.449861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b230b6d5-05d0-4b58-ad2c-ac6d0d17b40e req-9e1cffc6-f606-470e-923f-b8718881333c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.450491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b230b6d5-05d0-4b58-ad2c-ac6d0d17b40e req-9e1cffc6-f606-470e-923f-b8718881333c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.480041 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-b230b6d5-05d0-4b58-ad2c-ac6d0d17b40e req-9e1cffc6-f606-470e-923f-b8718881333c service nova] Creating event network-vif-plugged:b1ed6446-a73f-4f7c-a7b1-a59aef5b6f53 for instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd on n-h2-764485-11 Jul 20 04:22:23.481073 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-b230b6d5-05d0-4b58-ad2c-ac6d0d17b40e req-9e1cffc6-f606-470e-923f-b8718881333c service nova] Creating event network-vif-plugged:a5a8eb43-fc76-4f14-ba26-ef8b675f4786 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:22:23.496134 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-b230b6d5-05d0-4b58-ad2c-ac6d0d17b40e req-9e1cffc6-f606-470e-923f-b8718881333c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065400 Jul 20 04:22:23.497753 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1490/2911] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:23.504290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2ed2d84-0b2d-4b98-8f13-981a74f0fde7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:23.505494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f2ed2d84-0b2d-4b98-8f13-981a74f0fde7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:23.513622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2ed2d84-0b2d-4b98-8f13-981a74f0fde7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.514510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2ed2d84-0b2d-4b98-8f13-981a74f0fde7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.515595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2ed2d84-0b2d-4b98-8f13-981a74f0fde7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.516211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2ed2d84-0b2d-4b98-8f13-981a74f0fde7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.669498 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f2ed2d84-0b2d-4b98-8f13-981a74f0fde7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.170272 Jul 20 04:22:23.670344 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1491/2912] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Jul 20 04:22:23 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f/os-interface => generated 1831 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:23.684028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7061b8fa-63c3-4698-9909-d3172e612c15 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:23.684969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7061b8fa-63c3-4698-9909-d3172e612c15 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:23.699990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7061b8fa-63c3-4698-9909-d3172e612c15 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.701826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7061b8fa-63c3-4698-9909-d3172e612c15 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.702853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7061b8fa-63c3-4698-9909-d3172e612c15 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.703559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7061b8fa-63c3-4698-9909-d3172e612c15 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.842494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7f600396-b495-4daf-8405-547acdc122f0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:23.856407 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7f600396-b495-4daf-8405-547acdc122f0 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1291 microversion: 2.1 time: 0.484396 Jul 20 04:22:23.857103 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1422/2913] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:23 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1291 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:23.861989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-124a8649-b850-4b08-bc18-fdb4c7c7e8fb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:23.862610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-124a8649-b850-4b08-bc18-fdb4c7c7e8fb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:23.870499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-124a8649-b850-4b08-bc18-fdb4c7c7e8fb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.870968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-124a8649-b850-4b08-bc18-fdb4c7c7e8fb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.871944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-124a8649-b850-4b08-bc18-fdb4c7c7e8fb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.872309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-124a8649-b850-4b08-bc18-fdb4c7c7e8fb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.966603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7061b8fa-63c3-4698-9909-d3172e612c15 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:23.978137 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7061b8fa-63c3-4698-9909-d3172e612c15 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.298221 Jul 20 04:22:23.979143 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1492/2914] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:23 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:23.994674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-6181444", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "13fc6880-4fac-4a39-af23-98e984a520f4"}], "block_device_mapping_v2": [{"uuid": "5aa7fe86-93da-46c5-bf6a-897aa7bca556", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:24.062575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-124a8649-b850-4b08-bc18-fdb4c7c7e8fb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:24.070769 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-124a8649-b850-4b08-bc18-fdb4c7c7e8fb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.212615 Jul 20 04:22:24.074480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] validate_networks() for [('13fc6880-4fac-4a39-af23-98e984a520f4', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:22:24.080446 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1423/2915] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:23 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:24.439456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3babe48b-7cd8-452a-9932-a9f344e021cd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:24.441987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3babe48b-7cd8-452a-9932-a9f344e021cd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:24.452924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3babe48b-7cd8-452a-9932-a9f344e021cd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.453525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3babe48b-7cd8-452a-9932-a9f344e021cd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:24.454984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3babe48b-7cd8-452a-9932-a9f344e021cd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.455542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3babe48b-7cd8-452a-9932-a9f344e021cd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:24.910217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:24.910682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:24.911771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:24.912457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:24.913031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:24.941536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.942523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:24.944332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.944857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:24.953114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3babe48b-7cd8-452a-9932-a9f344e021cd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:24.963089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3babe48b-7cd8-452a-9932-a9f344e021cd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:24.964620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3babe48b-7cd8-452a-9932-a9f344e021cd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:24.966016 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3babe48b-7cd8-452a-9932-a9f344e021cd tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.530956 Jul 20 04:22:24.977958 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1424/2916] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:24 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:24.978180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Getting quotas for project 5181d3786af0422c928fa68ae1fd3956. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:24.978292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33263e04-d80b-46a9-8b5c-e803608c2d2d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:24.978292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-33263e04-d80b-46a9-8b5c-e803608c2d2d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:24.978456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Getting quotas for user b63f54e61ef144968f6c8d9cfb954c8f and project 5181d3786af0422c928fa68ae1fd3956. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:24.978886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33263e04-d80b-46a9-8b5c-e803608c2d2d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.979342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33263e04-d80b-46a9-8b5c-e803608c2d2d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:24.980398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33263e04-d80b-46a9-8b5c-e803608c2d2d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.980843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33263e04-d80b-46a9-8b5c-e803608c2d2d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.001878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:25.042137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:22:25.044543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5aa7fe86-93da-46c5-bf6a-897aa7bca556',volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:25.157686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-33263e04-d80b-46a9-8b5c-e803608c2d2d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:25.169288 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-33263e04-d80b-46a9-8b5c-e803608c2d2d tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1482 microversion: 2.1 time: 0.201554 Jul 20 04:22:25.170295 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1425/2917] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:24 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1482 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:25.175296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-73680ccb-66e8-4cef-bfe1-648c98480e20 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:25.176348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-73680ccb-66e8-4cef-bfe1-648c98480e20 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:25.188071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73680ccb-66e8-4cef-bfe1-648c98480e20 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.188886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73680ccb-66e8-4cef-bfe1-648c98480e20 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.192017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73680ccb-66e8-4cef-bfe1-648c98480e20 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.192221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73680ccb-66e8-4cef-bfe1-648c98480e20 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.212764 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88432f4e-da11-44c5-9262-9bd077a5e592 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.223332 Jul 20 04:22:25.219214 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1493/2918] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:22:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:22:25.225470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8755fe4c-8b5c-4df7-a418-c9d1205c3fb6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:25.226520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8755fe4c-8b5c-4df7-a418-c9d1205c3fb6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:25.240694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8755fe4c-8b5c-4df7-a418-c9d1205c3fb6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.241494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8755fe4c-8b5c-4df7-a418-c9d1205c3fb6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.242361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8755fe4c-8b5c-4df7-a418-c9d1205c3fb6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.242804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8755fe4c-8b5c-4df7-a418-c9d1205c3fb6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.440810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-73680ccb-66e8-4cef-bfe1-648c98480e20 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:25.465748 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-73680ccb-66e8-4cef-bfe1-648c98480e20 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.289113 Jul 20 04:22:25.466858 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1426/2919] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:25 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:25.472407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95c1dac2-a490-4b52-bca8-88317006f9de tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:25.473273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95c1dac2-a490-4b52-bca8-88317006f9de tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:25.481924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c1dac2-a490-4b52-bca8-88317006f9de tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.482703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c1dac2-a490-4b52-bca8-88317006f9de tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.483823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c1dac2-a490-4b52-bca8-88317006f9de tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.484745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c1dac2-a490-4b52-bca8-88317006f9de tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.589381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8755fe4c-8b5c-4df7-a418-c9d1205c3fb6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:25.618654 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95c1dac2-a490-4b52-bca8-88317006f9de tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150420 Jul 20 04:22:25.619390 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1427/2920] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:22:25 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:25.620235 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8755fe4c-8b5c-4df7-a418-c9d1205c3fb6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.399174 Jul 20 04:22:25.622741 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1494/2921] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:25 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:25.633661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-16ab1e5c-6ff1-429f-8b7d-f513a777c8ed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:25.634363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-16ab1e5c-6ff1-429f-8b7d-f513a777c8ed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:25.635304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-7a038258-6231-4451-a5bc-02df2d4427dc req-d4a04769-1cba-42ad-aa63-1ef01cd58e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-plugged", "status": "completed", "tag": "0f94531b-fcec-4091-9be6-24327def4b79"}, {"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-plugged", "status": "completed", "tag": "97289e02-4c46-41f5-8198-449586f93c1d"}, {"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-plugged", "status": "completed", "tag": "ed815642-7555-4590-a5fa-6a3dedab8275"}, {"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-plugged", "status": "completed", "tag": "fc8882d0-d375-49a4-bfcc-f16a0141386d"}, {"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-plugged", "status": "completed", "tag": "48db0174-8198-40fd-8530-6c031438c060"}, {"server_uuid": "0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839", "name": "network-vif-plugged", "status": "completed", "tag": "b1fe305d-7589-4093-92e7-6ca7f8c96f62"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:25.677492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7a038258-6231-4451-a5bc-02df2d4427dc req-d4a04769-1cba-42ad-aa63-1ef01cd58e1b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.678797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7a038258-6231-4451-a5bc-02df2d4427dc req-d4a04769-1cba-42ad-aa63-1ef01cd58e1b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.716337 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7a038258-6231-4451-a5bc-02df2d4427dc req-d4a04769-1cba-42ad-aa63-1ef01cd58e1b service nova] Creating event network-vif-plugged:0f94531b-fcec-4091-9be6-24327def4b79 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:22:25.717209 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7a038258-6231-4451-a5bc-02df2d4427dc req-d4a04769-1cba-42ad-aa63-1ef01cd58e1b service nova] Creating event network-vif-plugged:97289e02-4c46-41f5-8198-449586f93c1d for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:22:25.718147 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7a038258-6231-4451-a5bc-02df2d4427dc req-d4a04769-1cba-42ad-aa63-1ef01cd58e1b service nova] Creating event network-vif-plugged:ed815642-7555-4590-a5fa-6a3dedab8275 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:22:25.718903 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7a038258-6231-4451-a5bc-02df2d4427dc req-d4a04769-1cba-42ad-aa63-1ef01cd58e1b service nova] Creating event network-vif-plugged:fc8882d0-d375-49a4-bfcc-f16a0141386d for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:22:25.719670 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7a038258-6231-4451-a5bc-02df2d4427dc req-d4a04769-1cba-42ad-aa63-1ef01cd58e1b service nova] Creating event network-vif-plugged:48db0174-8198-40fd-8530-6c031438c060 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:22:25.720673 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7a038258-6231-4451-a5bc-02df2d4427dc req-d4a04769-1cba-42ad-aa63-1ef01cd58e1b service nova] Creating event network-vif-plugged:b1fe305d-7589-4093-92e7-6ca7f8c96f62 for instance 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 on n-h2-764485-11 Jul 20 04:22:25.742221 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-7a038258-6231-4451-a5bc-02df2d4427dc req-d4a04769-1cba-42ad-aa63-1ef01cd58e1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.117917 Jul 20 04:22:25.745167 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1495/2922] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:25.769164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-16ab1e5c-6ff1-429f-8b7d-f513a777c8ed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:25.788723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-16ab1e5c-6ff1-429f-8b7d-f513a777c8ed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:25.796249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-16ab1e5c-6ff1-429f-8b7d-f513a777c8ed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:25.797619 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-16ab1e5c-6ff1-429f-8b7d-f513a777c8ed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1101 microversion: 2.25 time: 0.176906 Jul 20 04:22:25.798391 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1428/2923] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:25 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1101 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:25.986806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c886457b-ad51-4d32-911a-cdb32bdb350c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:25.988559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c886457b-ad51-4d32-911a-cdb32bdb350c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:25.995492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c886457b-ad51-4d32-911a-cdb32bdb350c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.996072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c886457b-ad51-4d32-911a-cdb32bdb350c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.996977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c886457b-ad51-4d32-911a-cdb32bdb350c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.997450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c886457b-ad51-4d32-911a-cdb32bdb350c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.242452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c886457b-ad51-4d32-911a-cdb32bdb350c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.258154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c886457b-ad51-4d32-911a-cdb32bdb350c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.262653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c886457b-ad51-4d32-911a-cdb32bdb350c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.263913 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c886457b-ad51-4d32-911a-cdb32bdb350c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.281778 Jul 20 04:22:26.266840 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1496/2924] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:25 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:26.484387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e19ceeca-eb02-4fde-9d30-4cc3c1fb384d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:26.485018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e19ceeca-eb02-4fde-9d30-4cc3c1fb384d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:26.493662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e19ceeca-eb02-4fde-9d30-4cc3c1fb384d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.494127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e19ceeca-eb02-4fde-9d30-4cc3c1fb384d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.494922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e19ceeca-eb02-4fde-9d30-4cc3c1fb384d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.495374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e19ceeca-eb02-4fde-9d30-4cc3c1fb384d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.639115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e05b59b8-95ea-429b-8184-ccdfc986e863 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:26.640129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e05b59b8-95ea-429b-8184-ccdfc986e863 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:26.652463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e19ceeca-eb02-4fde-9d30-4cc3c1fb384d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.667707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e05b59b8-95ea-429b-8184-ccdfc986e863 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.668247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e05b59b8-95ea-429b-8184-ccdfc986e863 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.669978 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e19ceeca-eb02-4fde-9d30-4cc3c1fb384d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.186771 Jul 20 04:22:26.670649 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1429/2925] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:26 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:26.679860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e05b59b8-95ea-429b-8184-ccdfc986e863 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.683197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e05b59b8-95ea-429b-8184-ccdfc986e863 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.816345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-142e6f42-05e1-423f-a22d-6c0e0e4697ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:26.817558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-142e6f42-05e1-423f-a22d-6c0e0e4697ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:26.828745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-142e6f42-05e1-423f-a22d-6c0e0e4697ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.831144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-142e6f42-05e1-423f-a22d-6c0e0e4697ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.833816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-142e6f42-05e1-423f-a22d-6c0e0e4697ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.836129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-142e6f42-05e1-423f-a22d-6c0e0e4697ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.874728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e05b59b8-95ea-429b-8184-ccdfc986e863 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.887628 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e05b59b8-95ea-429b-8184-ccdfc986e863 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.251992 Jul 20 04:22:26.888907 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1497/2926] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:26 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:26.936895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-142e6f42-05e1-423f-a22d-6c0e0e4697ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.946937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-142e6f42-05e1-423f-a22d-6c0e0e4697ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.948426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-142e6f42-05e1-423f-a22d-6c0e0e4697ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.949822 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-142e6f42-05e1-423f-a22d-6c0e0e4697ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1248 microversion: 2.25 time: 0.137210 Jul 20 04:22:26.950730 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1430/2927] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:26 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1248 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:27.169035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3dd7bbd4-0fe6-4393-80a6-272880b579b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:27.170815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3dd7bbd4-0fe6-4393-80a6-272880b579b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:27.179676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f9fc00cc-3c56-495a-9141-b0c3b23df378 req-29dd52cd-45e0-4785-9cc7-a902ee84a6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48fbccd-a6bb-42bd-8472-a224bb30c0b0", "tag": "567b5770-118a-4239-8f7a-d878b7417a17"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:27.202896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f9fc00cc-3c56-495a-9141-b0c3b23df378 req-29dd52cd-45e0-4785-9cc7-a902ee84a6f7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.204117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f9fc00cc-3c56-495a-9141-b0c3b23df378 req-29dd52cd-45e0-4785-9cc7-a902ee84a6f7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.204877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3dd7bbd4-0fe6-4393-80a6-272880b579b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.207411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3dd7bbd4-0fe6-4393-80a6-272880b579b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.209769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3dd7bbd4-0fe6-4393-80a6-272880b579b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.211942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3dd7bbd4-0fe6-4393-80a6-272880b579b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.239950 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f9fc00cc-3c56-495a-9141-b0c3b23df378 req-29dd52cd-45e0-4785-9cc7-a902ee84a6f7 service nova] Creating event network-changed:567b5770-118a-4239-8f7a-d878b7417a17 for instance c48fbccd-a6bb-42bd-8472-a224bb30c0b0 on n-h2-764485-11 Jul 20 04:22:27.249331 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f9fc00cc-3c56-495a-9141-b0c3b23df378 req-29dd52cd-45e0-4785-9cc7-a902ee84a6f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075464 Jul 20 04:22:27.252655 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1431/2928] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:27.286934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ccaf89c-5dc1-4177-bce6-735d0ddeda1c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:27.287744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ccaf89c-5dc1-4177-bce6-735d0ddeda1c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:27.320745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ccaf89c-5dc1-4177-bce6-735d0ddeda1c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.321467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ccaf89c-5dc1-4177-bce6-735d0ddeda1c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.322456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ccaf89c-5dc1-4177-bce6-735d0ddeda1c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.323065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ccaf89c-5dc1-4177-bce6-735d0ddeda1c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.626723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3dd7bbd4-0fe6-4393-80a6-272880b579b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:27.642941 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3dd7bbd4-0fe6-4393-80a6-272880b579b2 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1482 microversion: 2.1 time: 0.480320 Jul 20 04:22:27.643896 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1498/2929] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:27 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1482 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:27.688141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d1ffdd69-83b2-4a3d-89d8-87d6b8a574c9 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:27.688776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d1ffdd69-83b2-4a3d-89d8-87d6b8a574c9 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:27.704585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1ffdd69-83b2-4a3d-89d8-87d6b8a574c9 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.714335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1ffdd69-83b2-4a3d-89d8-87d6b8a574c9 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.715538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1ffdd69-83b2-4a3d-89d8-87d6b8a574c9 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.716151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1ffdd69-83b2-4a3d-89d8-87d6b8a574c9 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.747200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ccaf89c-5dc1-4177-bce6-735d0ddeda1c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:27.767193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ccaf89c-5dc1-4177-bce6-735d0ddeda1c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:27.768742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ccaf89c-5dc1-4177-bce6-735d0ddeda1c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:27.775309 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ccaf89c-5dc1-4177-bce6-735d0ddeda1c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.496029 Jul 20 04:22:27.778946 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1432/2930] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:27 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:27.795919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3d02ce2b-cd2a-4053-9aa8-a6edc4108b41 req-44b8972c-0fa2-4a32-b0c1-ea1df3ba1468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-plugged", "status": "completed", "tag": "0e68e0df-9766-4b20-b15c-1fe9625a0d15"}, {"server_uuid": "8542411a-8f79-4e60-8812-ed64ed34a90f", "name": "network-vif-plugged", "status": "completed", "tag": "6387a7ee-0405-45ab-b7a2-a8f09dbce266"}, {"server_uuid": "425d15e8-b80e-4921-89e1-c81e97829f29", "name": "network-vif-plugged", "status": "completed", "tag": "6df7a16c-fb5a-4718-9c5e-d12d30b2a431"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:27.841779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3d02ce2b-cd2a-4053-9aa8-a6edc4108b41 req-44b8972c-0fa2-4a32-b0c1-ea1df3ba1468 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.842473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3d02ce2b-cd2a-4053-9aa8-a6edc4108b41 req-44b8972c-0fa2-4a32-b0c1-ea1df3ba1468 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.878674 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3d02ce2b-cd2a-4053-9aa8-a6edc4108b41 req-44b8972c-0fa2-4a32-b0c1-ea1df3ba1468 service nova] Creating event network-vif-plugged:0e68e0df-9766-4b20-b15c-1fe9625a0d15 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:22:27.890357 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3d02ce2b-cd2a-4053-9aa8-a6edc4108b41 req-44b8972c-0fa2-4a32-b0c1-ea1df3ba1468 service nova] Creating event network-vif-plugged:6387a7ee-0405-45ab-b7a2-a8f09dbce266 for instance 8542411a-8f79-4e60-8812-ed64ed34a90f on n-h1-764485-11 Jul 20 04:22:27.893329 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3d02ce2b-cd2a-4053-9aa8-a6edc4108b41 req-44b8972c-0fa2-4a32-b0c1-ea1df3ba1468 service nova] Creating event network-vif-plugged:6df7a16c-fb5a-4718-9c5e-d12d30b2a431 for instance 425d15e8-b80e-4921-89e1-c81e97829f29 on n-h1-764485-11 Jul 20 04:22:27.925097 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3d02ce2b-cd2a-4053-9aa8-a6edc4108b41 req-44b8972c-0fa2-4a32-b0c1-ea1df3ba1468 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.144266 Jul 20 04:22:27.925740 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1433/2931] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:27.954372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-652454f3-97e7-4e4a-ac4c-76eb8918b56e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:27.955118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-652454f3-97e7-4e4a-ac4c-76eb8918b56e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:27.985435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-652454f3-97e7-4e4a-ac4c-76eb8918b56e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.992182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-652454f3-97e7-4e4a-ac4c-76eb8918b56e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.995497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-652454f3-97e7-4e4a-ac4c-76eb8918b56e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.996180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-652454f3-97e7-4e4a-ac4c-76eb8918b56e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.469758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d1ffdd69-83b2-4a3d-89d8-87d6b8a574c9 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:28.481815 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d1ffdd69-83b2-4a3d-89d8-87d6b8a574c9 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.797577 Jul 20 04:22:28.493595 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1499/2932] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:27 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:28.501708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2685d138-dfd4-4d8c-ac78-59be77927236 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:28.507945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2685d138-dfd4-4d8c-ac78-59be77927236 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:28.518138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2685d138-dfd4-4d8c-ac78-59be77927236 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.519600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2685d138-dfd4-4d8c-ac78-59be77927236 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.520734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2685d138-dfd4-4d8c-ac78-59be77927236 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.523677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2685d138-dfd4-4d8c-ac78-59be77927236 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.765881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-652454f3-97e7-4e4a-ac4c-76eb8918b56e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:28.777597 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-652454f3-97e7-4e4a-ac4c-76eb8918b56e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.841623 Jul 20 04:22:28.778040 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1434/2933] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:27 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:28.798874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f7b819ee-82aa-4928-a416-4a08d640ec17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:28.799536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f7b819ee-82aa-4928-a416-4a08d640ec17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:28.817379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7b819ee-82aa-4928-a416-4a08d640ec17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.843945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7b819ee-82aa-4928-a416-4a08d640ec17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.849140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7b819ee-82aa-4928-a416-4a08d640ec17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.850772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7b819ee-82aa-4928-a416-4a08d640ec17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.156538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2685d138-dfd4-4d8c-ac78-59be77927236 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:29.175825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2685d138-dfd4-4d8c-ac78-59be77927236 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:29.178329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2685d138-dfd4-4d8c-ac78-59be77927236 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:29.180992 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2685d138-dfd4-4d8c-ac78-59be77927236 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1290 microversion: 2.25 time: 0.684934 Jul 20 04:22:29.181895 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1500/2934] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:28 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1290 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:29.265150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f7b819ee-82aa-4928-a416-4a08d640ec17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:29.298795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f7b819ee-82aa-4928-a416-4a08d640ec17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:29.300836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f7b819ee-82aa-4928-a416-4a08d640ec17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:29.302978 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f7b819ee-82aa-4928-a416-4a08d640ec17 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.508990 Jul 20 04:22:29.304999 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1435/2935] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:28 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:29.501659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2a664e9-1309-499e-aa6c-af6f28b250d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:29.503628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f2a664e9-1309-499e-aa6c-af6f28b250d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:29.512183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2a664e9-1309-499e-aa6c-af6f28b250d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.513237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2a664e9-1309-499e-aa6c-af6f28b250d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.514306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2a664e9-1309-499e-aa6c-af6f28b250d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.514920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2a664e9-1309-499e-aa6c-af6f28b250d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.596234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-2073020b-32a2-408e-a4d0-9a08b33d077f req-9444d60f-aa75-4781-b4f9-815e79860e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "588d4bae-3e12-4c79-81c7-b6223cb6dacc", "tag": "5397e4d6-56be-4b85-aca3-b4aa19f1e755"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:29.618748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2073020b-32a2-408e-a4d0-9a08b33d077f req-9444d60f-aa75-4781-b4f9-815e79860e5a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.619433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2073020b-32a2-408e-a4d0-9a08b33d077f req-9444d60f-aa75-4781-b4f9-815e79860e5a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.660033 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-2073020b-32a2-408e-a4d0-9a08b33d077f req-9444d60f-aa75-4781-b4f9-815e79860e5a service nova] Creating event network-changed:5397e4d6-56be-4b85-aca3-b4aa19f1e755 for instance 588d4bae-3e12-4c79-81c7-b6223cb6dacc on n-h1-764485-11 Jul 20 04:22:29.672987 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-2073020b-32a2-408e-a4d0-9a08b33d077f req-9444d60f-aa75-4781-b4f9-815e79860e5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084691 Jul 20 04:22:29.674419 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1436/2936] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:29.702293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f2a664e9-1309-499e-aa6c-af6f28b250d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:29.711862 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f2a664e9-1309-499e-aa6c-af6f28b250d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1321 microversion: 2.1 time: 0.216154 Jul 20 04:22:29.713007 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1501/2937] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:29 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:29.796001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-43a28416-cca6-4c1b-852d-9ff7e0b22078 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:29.797359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-43a28416-cca6-4c1b-852d-9ff7e0b22078 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:29.805104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-43a28416-cca6-4c1b-852d-9ff7e0b22078 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.805610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-43a28416-cca6-4c1b-852d-9ff7e0b22078 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.806430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-43a28416-cca6-4c1b-852d-9ff7e0b22078 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.807100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-43a28416-cca6-4c1b-852d-9ff7e0b22078 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.960210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-43a28416-cca6-4c1b-852d-9ff7e0b22078 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:29.987098 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-43a28416-cca6-4c1b-852d-9ff7e0b22078 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.196349 Jul 20 04:22:30.007696 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1437/2938] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:29 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:30.200888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3033ba5d-4c26-4cec-8112-921727a438ba tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:30.201514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3033ba5d-4c26-4cec-8112-921727a438ba tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:30.208705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3033ba5d-4c26-4cec-8112-921727a438ba tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.209158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3033ba5d-4c26-4cec-8112-921727a438ba tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.209928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3033ba5d-4c26-4cec-8112-921727a438ba tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.210368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3033ba5d-4c26-4cec-8112-921727a438ba tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.323013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-82ffe700-ff69-4937-b5c1-64eda70a247b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:30.323774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-82ffe700-ff69-4937-b5c1-64eda70a247b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:30.330709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82ffe700-ff69-4937-b5c1-64eda70a247b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.331244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82ffe700-ff69-4937-b5c1-64eda70a247b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.332132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82ffe700-ff69-4937-b5c1-64eda70a247b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.332639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82ffe700-ff69-4937-b5c1-64eda70a247b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.354755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3033ba5d-4c26-4cec-8112-921727a438ba tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.358377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:30.366025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3033ba5d-4c26-4cec-8112-921727a438ba tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.367719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3033ba5d-4c26-4cec-8112-921727a438ba tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.368915 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3033ba5d-4c26-4cec-8112-921727a438ba tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1290 microversion: 2.25 time: 0.173107 Jul 20 04:22:30.371839 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1502/2939] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:30 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1290 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:30.545611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-82ffe700-ff69-4937-b5c1-64eda70a247b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.555639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-82ffe700-ff69-4937-b5c1-64eda70a247b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.557169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-82ffe700-ff69-4937-b5c1-64eda70a247b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.558368 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-82ffe700-ff69-4937-b5c1-64eda70a247b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1878 microversion: 2.32 time: 0.239544 Jul 20 04:22:30.558948 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1438/2940] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:30 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1878 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:30.801802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-593d293c-0843-4184-a184-2dd46d1bb3e0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:30.802431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-593d293c-0843-4184-a184-2dd46d1bb3e0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:30.809570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-593d293c-0843-4184-a184-2dd46d1bb3e0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.810027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-593d293c-0843-4184-a184-2dd46d1bb3e0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.810832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-593d293c-0843-4184-a184-2dd46d1bb3e0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.811273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-593d293c-0843-4184-a184-2dd46d1bb3e0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.949586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-593d293c-0843-4184-a184-2dd46d1bb3e0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.957425 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-593d293c-0843-4184-a184-2dd46d1bb3e0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1515 microversion: 2.1 time: 0.160026 Jul 20 04:22:30.958640 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1503/2941] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:30 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:30.974601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b2562384-0667-43b7-88ae-013d3ba243d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:30.975649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b2562384-0667-43b7-88ae-013d3ba243d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:30.982737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2562384-0667-43b7-88ae-013d3ba243d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.983198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2562384-0667-43b7-88ae-013d3ba243d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.984096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2562384-0667-43b7-88ae-013d3ba243d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.984492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2562384-0667-43b7-88ae-013d3ba243d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.009288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5227f773-0f74-4438-b04c-fb70bd4871f6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.010071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5227f773-0f74-4438-b04c-fb70bd4871f6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:31.012620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-b2562384-0667-43b7-88ae-013d3ba243d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lazy-loading 'flavor' on Instance uuid 425d15e8-b80e-4921-89e1-c81e97829f29 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:22:31.016646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5227f773-0f74-4438-b04c-fb70bd4871f6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.017210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5227f773-0f74-4438-b04c-fb70bd4871f6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.018181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5227f773-0f74-4438-b04c-fb70bd4871f6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.018718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5227f773-0f74-4438-b04c-fb70bd4871f6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.096769 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b2562384-0667-43b7-88ae-013d3ba243d4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29/action" status: 200 len: 32 microversion: 2.1 time: 0.126222 Jul 20 04:22:31.097807 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1439/2942] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:30 2022] POST /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29/action => generated 32 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:22:31.107470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-111c69d4-5876-468a-83ce-407160338185 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.108197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-111c69d4-5876-468a-83ce-407160338185 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:31.115197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-111c69d4-5876-468a-83ce-407160338185 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.116288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-111c69d4-5876-468a-83ce-407160338185 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.117100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-111c69d4-5876-468a-83ce-407160338185 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.117681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-111c69d4-5876-468a-83ce-407160338185 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.177438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5227f773-0f74-4438-b04c-fb70bd4871f6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.191938 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5227f773-0f74-4438-b04c-fb70bd4871f6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1322 microversion: 2.1 time: 0.187300 Jul 20 04:22:31.193660 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1504/2943] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:31.264108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-111c69d4-5876-468a-83ce-407160338185 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.272359 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-111c69d4-5876-468a-83ce-407160338185 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.169395 Jul 20 04:22:31.272929 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1440/2944] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:31.387154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-20a85320-8f72-4120-9bec-053f9e02755d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.387913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-20a85320-8f72-4120-9bec-053f9e02755d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:31.394703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20a85320-8f72-4120-9bec-053f9e02755d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.395331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20a85320-8f72-4120-9bec-053f9e02755d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.396254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20a85320-8f72-4120-9bec-053f9e02755d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.396745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20a85320-8f72-4120-9bec-053f9e02755d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.553192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-20a85320-8f72-4120-9bec-053f9e02755d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.561311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-20a85320-8f72-4120-9bec-053f9e02755d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.562861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-20a85320-8f72-4120-9bec-053f9e02755d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.564046 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-20a85320-8f72-4120-9bec-053f9e02755d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1290 microversion: 2.25 time: 0.181016 Jul 20 04:22:31.564626 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1505/2945] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1290 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:31.578703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1dc2fab0-87cd-4f0e-ae80-a176ba9d66cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.579753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1dc2fab0-87cd-4f0e-ae80-a176ba9d66cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:31.587372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dc2fab0-87cd-4f0e-ae80-a176ba9d66cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.590340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dc2fab0-87cd-4f0e-ae80-a176ba9d66cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.590340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dc2fab0-87cd-4f0e-ae80-a176ba9d66cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.590340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dc2fab0-87cd-4f0e-ae80-a176ba9d66cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.810926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1dc2fab0-87cd-4f0e-ae80-a176ba9d66cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.826316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1dc2fab0-87cd-4f0e-ae80-a176ba9d66cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.829370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1dc2fab0-87cd-4f0e-ae80-a176ba9d66cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.830735 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1dc2fab0-87cd-4f0e-ae80-a176ba9d66cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 2830 microversion: 2.32 time: 0.257647 Jul 20 04:22:31.840757 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1441/2946] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 2830 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:31.854871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d25bf9c-1a5f-4893-9a1c-96fc380d01cc tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.855446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5d25bf9c-1a5f-4893-9a1c-96fc380d01cc tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:31.863333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d25bf9c-1a5f-4893-9a1c-96fc380d01cc tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.863333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d25bf9c-1a5f-4893-9a1c-96fc380d01cc tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.864089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d25bf9c-1a5f-4893-9a1c-96fc380d01cc tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.865858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d25bf9c-1a5f-4893-9a1c-96fc380d01cc tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.052495 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5d25bf9c-1a5f-4893-9a1c-96fc380d01cc tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.204283 Jul 20 04:22:32.053330 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1506/2947] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc/os-interface => generated 1830 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:32.210426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-91cfd9b6-bc2e-4a86-ad19-0683c6f804cc tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.210992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-91cfd9b6-bc2e-4a86-ad19-0683c6f804cc tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:32.227980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91cfd9b6-bc2e-4a86-ad19-0683c6f804cc tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.228440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91cfd9b6-bc2e-4a86-ad19-0683c6f804cc tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.233973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91cfd9b6-bc2e-4a86-ad19-0683c6f804cc tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.233973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91cfd9b6-bc2e-4a86-ad19-0683c6f804cc tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.290383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88a22a70-9d13-4fda-8958-6e028b7b4a7b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.291482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88a22a70-9d13-4fda-8958-6e028b7b4a7b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:32.303112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88a22a70-9d13-4fda-8958-6e028b7b4a7b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.303941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88a22a70-9d13-4fda-8958-6e028b7b4a7b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.305626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88a22a70-9d13-4fda-8958-6e028b7b4a7b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.306352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88a22a70-9d13-4fda-8958-6e028b7b4a7b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.543926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-91cfd9b6-bc2e-4a86-ad19-0683c6f804cc tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.553967 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-91cfd9b6-bc2e-4a86-ad19-0683c6f804cc tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 200 len: 1515 microversion: 2.1 time: 0.347985 Jul 20 04:22:32.570056 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1442/2948] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 1515 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:32.577749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-07e976ee-e385-4b37-89b2-0b5b96126f04 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.579767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-07e976ee-e385-4b37-89b2-0b5b96126f04 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:32.596390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-07e976ee-e385-4b37-89b2-0b5b96126f04 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.596905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-07e976ee-e385-4b37-89b2-0b5b96126f04 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.597768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-07e976ee-e385-4b37-89b2-0b5b96126f04 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.598221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-07e976ee-e385-4b37-89b2-0b5b96126f04 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.617815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88a22a70-9d13-4fda-8958-6e028b7b4a7b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.624060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:32.636766 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88a22a70-9d13-4fda-8958-6e028b7b4a7b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.351041 Jul 20 04:22:32.637907 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1507/2949] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:32.643787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-71973601-a788-4811-a13c-caa74c8ab34d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.644706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-71973601-a788-4811-a13c-caa74c8ab34d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:32.659725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71973601-a788-4811-a13c-caa74c8ab34d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.660315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71973601-a788-4811-a13c-caa74c8ab34d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.661828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71973601-a788-4811-a13c-caa74c8ab34d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.662358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71973601-a788-4811-a13c-caa74c8ab34d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.829668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-07e976ee-e385-4b37-89b2-0b5b96126f04 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.840594 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-07e976ee-e385-4b37-89b2-0b5b96126f04 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839" status: 200 len: 1515 microversion: 2.1 time: 0.268079 Jul 20 04:22:32.841530 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1443/2950] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 => generated 1515 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:32.858744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2bdd3243-d2a3-49b3-8a98-7ff7f57adab3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.859488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2bdd3243-d2a3-49b3-8a98-7ff7f57adab3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:32.867120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bdd3243-d2a3-49b3-8a98-7ff7f57adab3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.867650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bdd3243-d2a3-49b3-8a98-7ff7f57adab3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.868989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bdd3243-d2a3-49b3-8a98-7ff7f57adab3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.869439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bdd3243-d2a3-49b3-8a98-7ff7f57adab3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.869827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-71973601-a788-4811-a13c-caa74c8ab34d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.882835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-71973601-a788-4811-a13c-caa74c8ab34d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.885154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-71973601-a788-4811-a13c-caa74c8ab34d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.886565 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-71973601-a788-4811-a13c-caa74c8ab34d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1290 microversion: 2.25 time: 0.247334 Jul 20 04:22:32.888822 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1508/2951] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1290 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:33.020707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2bdd3243-d2a3-49b3-8a98-7ff7f57adab3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.029169 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2bdd3243-d2a3-49b3-8a98-7ff7f57adab3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd" status: 200 len: 1516 microversion: 2.1 time: 0.175330 Jul 20 04:22:33.029899 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1444/2952] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:33.045924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c7f7eb0e-8d9d-4e81-a466-365384a1ab42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.046437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c7f7eb0e-8d9d-4e81-a466-365384a1ab42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.053418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7f7eb0e-8d9d-4e81-a466-365384a1ab42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.053882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7f7eb0e-8d9d-4e81-a466-365384a1ab42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.054681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7f7eb0e-8d9d-4e81-a466-365384a1ab42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.055133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7f7eb0e-8d9d-4e81-a466-365384a1ab42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.082658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c7f7eb0e-8d9d-4e81-a466-365384a1ab42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:33.179115 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c7f7eb0e-8d9d-4e81-a466-365384a1ab42 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd" status: 204 len: 0 microversion: 2.1 time: 0.136014 Jul 20 04:22:33.182955 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1509/2953] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:33 2022] DELETE /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:33.188854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1a000364-bb13-402e-a6c3-68ea296989c7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.189891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1a000364-bb13-402e-a6c3-68ea296989c7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.196970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a000364-bb13-402e-a6c3-68ea296989c7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.197554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a000364-bb13-402e-a6c3-68ea296989c7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.198432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a000364-bb13-402e-a6c3-68ea296989c7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.198948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a000364-bb13-402e-a6c3-68ea296989c7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.355095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a3fe55b1-789d-49be-aff6-2ba1e459a20e req-72a43027-1a7f-46c1-af96-5a203b4c9ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "tag": "0e68e0df-9766-4b20-b15c-1fe9625a0d15"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:33.365097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a3fe55b1-789d-49be-aff6-2ba1e459a20e req-72a43027-1a7f-46c1-af96-5a203b4c9ec7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.365786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a3fe55b1-789d-49be-aff6-2ba1e459a20e req-72a43027-1a7f-46c1-af96-5a203b4c9ec7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.379444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1a000364-bb13-402e-a6c3-68ea296989c7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.381416 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a3fe55b1-789d-49be-aff6-2ba1e459a20e req-72a43027-1a7f-46c1-af96-5a203b4c9ec7 service nova] Creating event network-changed:0e68e0df-9766-4b20-b15c-1fe9625a0d15 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:22:33.387128 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a3fe55b1-789d-49be-aff6-2ba1e459a20e req-72a43027-1a7f-46c1-af96-5a203b4c9ec7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036080 Jul 20 04:22:33.387928 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1510/2954] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:33.393246 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1a000364-bb13-402e-a6c3-68ea296989c7 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd" status: 200 len: 1522 microversion: 2.1 time: 0.208364 Jul 20 04:22:33.395823 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1445/2955] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:33 2022] GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:33.667785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e5c00354-284a-4a60-953c-188e2ead5b73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.668511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e5c00354-284a-4a60-953c-188e2ead5b73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.675069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5c00354-284a-4a60-953c-188e2ead5b73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.675752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5c00354-284a-4a60-953c-188e2ead5b73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.678053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5c00354-284a-4a60-953c-188e2ead5b73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.678503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5c00354-284a-4a60-953c-188e2ead5b73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.815940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e5c00354-284a-4a60-953c-188e2ead5b73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.824553 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e5c00354-284a-4a60-953c-188e2ead5b73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.168470 Jul 20 04:22:33.825137 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1511/2956] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:33 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:33.905426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-522518d1-119c-4c8a-9bb3-8ae8756c1330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.906088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-522518d1-119c-4c8a-9bb3-8ae8756c1330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.908066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:33.914349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-522518d1-119c-4c8a-9bb3-8ae8756c1330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.914889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-522518d1-119c-4c8a-9bb3-8ae8756c1330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.915769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-522518d1-119c-4c8a-9bb3-8ae8756c1330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.916304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-522518d1-119c-4c8a-9bb3-8ae8756c1330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.047222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-522518d1-119c-4c8a-9bb3-8ae8756c1330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:34.056070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-522518d1-119c-4c8a-9bb3-8ae8756c1330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:34.057581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-522518d1-119c-4c8a-9bb3-8ae8756c1330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:34.058701 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-522518d1-119c-4c8a-9bb3-8ae8756c1330 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1278 microversion: 2.25 time: 0.157550 Jul 20 04:22:34.059279 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1446/2957] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:33 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:34.412398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6be8a9c-9908-4893-b258-65081ea54bbb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:34.414077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f6be8a9c-9908-4893-b258-65081ea54bbb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:34.421491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6be8a9c-9908-4893-b258-65081ea54bbb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.421953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6be8a9c-9908-4893-b258-65081ea54bbb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.422732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6be8a9c-9908-4893-b258-65081ea54bbb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.423183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6be8a9c-9908-4893-b258-65081ea54bbb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.560721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f6be8a9c-9908-4893-b258-65081ea54bbb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:34.568464 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f6be8a9c-9908-4893-b258-65081ea54bbb tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd" status: 200 len: 1522 microversion: 2.1 time: 0.160817 Jul 20 04:22:34.569056 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1512/2958] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:34 2022] GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:34.841334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a8ca63d1-2c5e-4708-b584-0dc89178c124 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:34.842026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a8ca63d1-2c5e-4708-b584-0dc89178c124 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:34.849454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8ca63d1-2c5e-4708-b584-0dc89178c124 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.849905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8ca63d1-2c5e-4708-b584-0dc89178c124 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.850670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8ca63d1-2c5e-4708-b584-0dc89178c124 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.851109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8ca63d1-2c5e-4708-b584-0dc89178c124 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.996725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a8ca63d1-2c5e-4708-b584-0dc89178c124 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:35.006640 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a8ca63d1-2c5e-4708-b584-0dc89178c124 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.169093 Jul 20 04:22:35.009887 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1447/2959] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:34 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:35.079113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-94a3fd08-ca4d-4eb5-9f5a-84126ca592d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:35.079766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-94a3fd08-ca4d-4eb5-9f5a-84126ca592d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:35.081752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:35.082580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:35.088771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94a3fd08-ca4d-4eb5-9f5a-84126ca592d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:35.089221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94a3fd08-ca4d-4eb5-9f5a-84126ca592d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:35.089987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94a3fd08-ca4d-4eb5-9f5a-84126ca592d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:35.090424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94a3fd08-ca4d-4eb5-9f5a-84126ca592d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:35.273150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94a3fd08-ca4d-4eb5-9f5a-84126ca592d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:35.282899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94a3fd08-ca4d-4eb5-9f5a-84126ca592d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:35.284655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94a3fd08-ca4d-4eb5-9f5a-84126ca592d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:35.285861 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-94a3fd08-ca4d-4eb5-9f5a-84126ca592d9 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1278 microversion: 2.25 time: 0.211529 Jul 20 04:22:35.287724 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1513/2960] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:35 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:35.585706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-724ba39d-d88a-4407-95f2-b52f06066c44 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:35.586432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-724ba39d-d88a-4407-95f2-b52f06066c44 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:35.592909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-724ba39d-d88a-4407-95f2-b52f06066c44 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:35.593457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-724ba39d-d88a-4407-95f2-b52f06066c44 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:35.594355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-724ba39d-d88a-4407-95f2-b52f06066c44 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:35.594893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-724ba39d-d88a-4407-95f2-b52f06066c44 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:35.704372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-724ba39d-d88a-4407-95f2-b52f06066c44 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:35.713932 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-724ba39d-d88a-4407-95f2-b52f06066c44 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd" status: 200 len: 1480 microversion: 2.1 time: 0.132290 Jul 20 04:22:35.716699 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1448/2961] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:35 2022] GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd => generated 1480 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:35.773432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-276197f0-9ca6-4c62-ae7c-5e123382bb0a req-3ab67334-1ea8-40a8-9878-9ea668cd99b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1b703c-85b1-4e4f-b55e-663c74bbb5bd", "name": "network-vif-deleted", "tag": "b1ed6446-a73f-4f7c-a7b1-a59aef5b6f53"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:35.784783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-276197f0-9ca6-4c62-ae7c-5e123382bb0a req-3ab67334-1ea8-40a8-9878-9ea668cd99b6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:35.785202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-276197f0-9ca6-4c62-ae7c-5e123382bb0a req-3ab67334-1ea8-40a8-9878-9ea668cd99b6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:35.803282 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-276197f0-9ca6-4c62-ae7c-5e123382bb0a req-3ab67334-1ea8-40a8-9878-9ea668cd99b6 service nova] Creating event network-vif-deleted:b1ed6446-a73f-4f7c-a7b1-a59aef5b6f53 for instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd on n-h2-764485-11 Jul 20 04:22:35.808955 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-276197f0-9ca6-4c62-ae7c-5e123382bb0a req-3ab67334-1ea8-40a8-9878-9ea668cd99b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039911 Jul 20 04:22:35.809855 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1514/2962] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:36.026101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac28baf5-200c-45f8-b914-fecbd2f3bcb3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.027059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac28baf5-200c-45f8-b914-fecbd2f3bcb3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:36.029424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:36.037104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac28baf5-200c-45f8-b914-fecbd2f3bcb3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.037635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac28baf5-200c-45f8-b914-fecbd2f3bcb3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.038416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac28baf5-200c-45f8-b914-fecbd2f3bcb3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.038864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac28baf5-200c-45f8-b914-fecbd2f3bcb3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.174269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ac28baf5-200c-45f8-b914-fecbd2f3bcb3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.182702 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ac28baf5-200c-45f8-b914-fecbd2f3bcb3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.161996 Jul 20 04:22:36.183300 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1449/2963] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:36.307379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6722576b-586e-4625-9ab3-f3aec61d259f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.308269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6722576b-586e-4625-9ab3-f3aec61d259f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:36.314829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6722576b-586e-4625-9ab3-f3aec61d259f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.315284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6722576b-586e-4625-9ab3-f3aec61d259f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.316091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6722576b-586e-4625-9ab3-f3aec61d259f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.316532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6722576b-586e-4625-9ab3-f3aec61d259f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.465818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6722576b-586e-4625-9ab3-f3aec61d259f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.474849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6722576b-586e-4625-9ab3-f3aec61d259f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.476594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6722576b-586e-4625-9ab3-f3aec61d259f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.477862 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6722576b-586e-4625-9ab3-f3aec61d259f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1278 microversion: 2.25 time: 0.174761 Jul 20 04:22:36.478466 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1515/2964] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:36.734757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a268b5d7-eb40-4d4a-b664-f9373c32c611 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.735627 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a268b5d7-eb40-4d4a-b664-f9373c32c611 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:36.742568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a268b5d7-eb40-4d4a-b664-f9373c32c611 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.743157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a268b5d7-eb40-4d4a-b664-f9373c32c611 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.743954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a268b5d7-eb40-4d4a-b664-f9373c32c611 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.744392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a268b5d7-eb40-4d4a-b664-f9373c32c611 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.758700 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a268b5d7-eb40-4d4a-b664-f9373c32c611 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] HTTP exception thrown: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a268b5d7-eb40-4d4a-b664-f9373c32c611 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Request method failure captured: Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd HTTP/1.1 Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14LiljPX4PGA799jFW8yI70Qqfz32gMdEwPRfIuG9zK3gp4dtHBgAhxBdIk0RFEXKw8SVdVHDHEXXBMCNaOF2HgcXpx8BM1mUc4eRfgJuPzCi3qvsPehFJa2--8bxWC3gKl1nZfNTdo5uOr6v0PmA7Ht_IPno3hD-DzIxocaCDt4YQo Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04a675a96d3c48a8888e649879f21756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04a675a96d3c48a8888e649879f21756", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}] Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 80e6c22902d74017aef7952ad1fdbeb4 Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '1b1b703c-85b1-4e4f-b55e-663c74bbb5bd'} Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:36.760428 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:36.765391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:36.765391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:36.765391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:36.765391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:36.765391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:36.765391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:36.765391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:36.765391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a268b5d7-eb40-4d4a-b664-f9373c32c611 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Returning 404 to user: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:36.765391 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a268b5d7-eb40-4d4a-b664-f9373c32c611 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd" status: 404 len: 111 microversion: 2.1 time: 0.031499 Jul 20 04:22:36.765391 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1450/2965] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:36.771321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a5f4dd7-08e7-409e-8ebd-ea7de93253f3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.774963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5a5f4dd7-08e7-409e-8ebd-ea7de93253f3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.775880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a5f4dd7-08e7-409e-8ebd-ea7de93253f3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '04a675a96d3c48a8888e649879f21756'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:36.781485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5f4dd7-08e7-409e-8ebd-ea7de93253f3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.781992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5f4dd7-08e7-409e-8ebd-ea7de93253f3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.782797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5f4dd7-08e7-409e-8ebd-ea7de93253f3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.783240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5f4dd7-08e7-409e-8ebd-ea7de93253f3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.866530 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a5f4dd7-08e7-409e-8ebd-ea7de93253f3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.099040 Jul 20 04:22:36.867138 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1516/2966] 10.222.0.20 () {58 vars in 1229 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:36.878278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-853827d3-0371-4730-9e02-d8aa26a58ce9 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-853827d3-0371-4730-9e02-d8aa26a58ce9 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Request method failure captured: Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14LiljPX4PGA799jFW8yI70Qqfz32gMdEwPRfIuG9zK3gp4dtHBgAhxBdIk0RFEXKw8SVdVHDHEXXBMCNaOF2HgcXpx8BM1mUc4eRfgJuPzCi3qvsPehFJa2--8bxWC3gKl1nZfNTdo5uOr6v0PmA7Ht_IPno3hD-DzIxocaCDt4YQo Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04a675a96d3c48a8888e649879f21756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04a675a96d3c48a8888e649879f21756", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}] Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 80e6c22902d74017aef7952ad1fdbeb4 Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: action_args: {} Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 04:22:36.881739 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-853827d3-0371-4730-9e02-d8aa26a58ce9 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-853827d3-0371-4730-9e02-d8aa26a58ce9 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.008659 Jul 20 04:22:36.886177 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1451/2967] 10.222.0.20 () {58 vars in 1181 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:22:36.891852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d084446a-a8cb-49d9-8ca5-62bdb1148239 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.895133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d084446a-a8cb-49d9-8ca5-62bdb1148239 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.895985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d084446a-a8cb-49d9-8ca5-62bdb1148239 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Searching by: {'deleted': False, 'project_id': '04a675a96d3c48a8888e649879f21756'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:36.901197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d084446a-a8cb-49d9-8ca5-62bdb1148239 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.901661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d084446a-a8cb-49d9-8ca5-62bdb1148239 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.902458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d084446a-a8cb-49d9-8ca5-62bdb1148239 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.902892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d084446a-a8cb-49d9-8ca5-62bdb1148239 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.929141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-d084446a-a8cb-49d9-8ca5-62bdb1148239 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:22:36.955343 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d084446a-a8cb-49d9-8ca5-62bdb1148239 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.067152 Jul 20 04:22:36.955968 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1517/2968] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/servers => generated 681 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:36.966130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e98d7ace-10b9-46d7-9369-ab4f19d84887 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.969516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e98d7ace-10b9-46d7-9369-ab4f19d84887 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.969957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.compute.servers [None req-e98d7ace-10b9-46d7-9369-ab4f19d84887 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Removing options 'limit' from query {{(pid=119807) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:22:36.971905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e98d7ace-10b9-46d7-9369-ab4f19d84887 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Searching by: {'deleted': False, 'project_id': '04a675a96d3c48a8888e649879f21756'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:36.978420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e98d7ace-10b9-46d7-9369-ab4f19d84887 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.978964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e98d7ace-10b9-46d7-9369-ab4f19d84887 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.979790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e98d7ace-10b9-46d7-9369-ab4f19d84887 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.980231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e98d7ace-10b9-46d7-9369-ab4f19d84887 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.005217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-e98d7ace-10b9-46d7-9369-ab4f19d84887 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:22:37.034051 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e98d7ace-10b9-46d7-9369-ab4f19d84887 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.071659 Jul 20 04:22:37.034711 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1452/2969] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:37.046402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-034ed4d9-1767-4611-98f2-ba41c0362ef3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-034ed4d9-1767-4611-98f2-ba41c0362ef3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Request method failure captured: Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14LiljPX4PGA799jFW8yI70Qqfz32gMdEwPRfIuG9zK3gp4dtHBgAhxBdIk0RFEXKw8SVdVHDHEXXBMCNaOF2HgcXpx8BM1mUc4eRfgJuPzCi3qvsPehFJa2--8bxWC3gKl1nZfNTdo5uOr6v0PmA7Ht_IPno3hD-DzIxocaCDt4YQo Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04a675a96d3c48a8888e649879f21756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04a675a96d3c48a8888e649879f21756", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}] Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 80e6c22902d74017aef7952ad1fdbeb4 Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: action_args: {} Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi '-1' Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 04:22:37.049197 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-034ed4d9-1767-4611-98f2-ba41c0362ef3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-034ed4d9-1767-4611-98f2-ba41c0362ef3 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.008101 Jul 20 04:22:37.055499 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1518/2970] 10.222.0.20 () {58 vars in 1141 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:22:37.060441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-82396136-d07e-4b6e-95e2-69e14bc78d13 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-82396136-d07e-4b6e-95e2-69e14bc78d13 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Request method failure captured: Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14LiljPX4PGA799jFW8yI70Qqfz32gMdEwPRfIuG9zK3gp4dtHBgAhxBdIk0RFEXKw8SVdVHDHEXXBMCNaOF2HgcXpx8BM1mUc4eRfgJuPzCi3qvsPehFJa2--8bxWC3gKl1nZfNTdo5uOr6v0PmA7Ht_IPno3hD-DzIxocaCDt4YQo Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04a675a96d3c48a8888e649879f21756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04a675a96d3c48a8888e649879f21756", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}] Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 80e6c22902d74017aef7952ad1fdbeb4 Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: action_args: {} Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'testing' Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 04:22:37.062994 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-82396136-d07e-4b6e-95e2-69e14bc78d13 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-82396136-d07e-4b6e-95e2-69e14bc78d13 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.007834 Jul 20 04:22:37.069148 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1453/2971] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:22:37.073051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9fd1ca3f-23c8-4739-8cc6-df0abd57ce2e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.076693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9fd1ca3f-23c8-4739-8cc6-df0abd57ce2e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.077394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9fd1ca3f-23c8-4739-8cc6-df0abd57ce2e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '04a675a96d3c48a8888e649879f21756'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:37.088325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.compute.servers [None req-9fd1ca3f-23c8-4739-8cc6-df0abd57ce2e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Flavor 'non_existing_flavor' could not be found {{(pid=119808) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 20 04:22:37.089334 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9fd1ca3f-23c8-4739-8cc6-df0abd57ce2e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.019841 Jul 20 04:22:37.089901 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1519/2972] 10.222.0.20 () {58 vars in 1177 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:22:37.101402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-062ddd22-b4dc-42ee-8edf-9c811f0e99e0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.104828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-062ddd22-b4dc-42ee-8edf-9c811f0e99e0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.105492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-062ddd22-b4dc-42ee-8edf-9c811f0e99e0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '04a675a96d3c48a8888e649879f21756'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:37.112434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-062ddd22-b4dc-42ee-8edf-9c811f0e99e0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.112434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-062ddd22-b4dc-42ee-8edf-9c811f0e99e0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.113032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-062ddd22-b4dc-42ee-8edf-9c811f0e99e0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.113480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-062ddd22-b4dc-42ee-8edf-9c811f0e99e0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.198474 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-062ddd22-b4dc-42ee-8edf-9c811f0e99e0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.101243 Jul 20 04:22:37.199064 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1454/2973] 10.222.0.20 () {58 vars in 1173 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:37.201181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a1ce9b83-e60b-482e-9187-a7977373a905 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.201801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a1ce9b83-e60b-482e-9187-a7977373a905 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:37.203769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:37.209236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1ce9b83-e60b-482e-9187-a7977373a905 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.209687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1ce9b83-e60b-482e-9187-a7977373a905 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.210390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bc9e54f0-9f0a-4cff-81b3-d4267068cd98 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.210510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1ce9b83-e60b-482e-9187-a7977373a905 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.210912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1ce9b83-e60b-482e-9187-a7977373a905 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.214266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bc9e54f0-9f0a-4cff-81b3-d4267068cd98 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.214921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bc9e54f0-9f0a-4cff-81b3-d4267068cd98 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '04a675a96d3c48a8888e649879f21756'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:37.220719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc9e54f0-9f0a-4cff-81b3-d4267068cd98 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.221162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc9e54f0-9f0a-4cff-81b3-d4267068cd98 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.221961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc9e54f0-9f0a-4cff-81b3-d4267068cd98 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.222397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc9e54f0-9f0a-4cff-81b3-d4267068cd98 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.304101 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bc9e54f0-9f0a-4cff-81b3-d4267068cd98 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.097963 Jul 20 04:22:37.304711 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1455/2974] 10.222.0.20 () {58 vars in 1183 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:22:37.315054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-306e074c-b0ca-4f83-ae87-5fe221d7ed49 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.318534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-306e074c-b0ca-4f83-ae87-5fe221d7ed49 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.319267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-306e074c-b0ca-4f83-ae87-5fe221d7ed49 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Searching by: {'deleted': False, 'project_id': '04a675a96d3c48a8888e649879f21756'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:37.324387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-306e074c-b0ca-4f83-ae87-5fe221d7ed49 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.324837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-306e074c-b0ca-4f83-ae87-5fe221d7ed49 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.325633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-306e074c-b0ca-4f83-ae87-5fe221d7ed49 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.326061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-306e074c-b0ca-4f83-ae87-5fe221d7ed49 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.343949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a1ce9b83-e60b-482e-9187-a7977373a905 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.353104 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a1ce9b83-e60b-482e-9187-a7977373a905 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.156774 Jul 20 04:22:37.353786 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1520/2975] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:37.363002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-306e074c-b0ca-4f83-ae87-5fe221d7ed49 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:22:37.396780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-306e074c-b0ca-4f83-ae87-5fe221d7ed49 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.403364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-306e074c-b0ca-4f83-ae87-5fe221d7ed49 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.403843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-306e074c-b0ca-4f83-ae87-5fe221d7ed49 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.495914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8594bf1d-7b6c-40d6-a731-b738a5bf9a74 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.496622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8594bf1d-7b6c-40d6-a731-b738a5bf9a74 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:37.502727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8594bf1d-7b6c-40d6-a731-b738a5bf9a74 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.503181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8594bf1d-7b6c-40d6-a731-b738a5bf9a74 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.503972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8594bf1d-7b6c-40d6-a731-b738a5bf9a74 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.504474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8594bf1d-7b6c-40d6-a731-b738a5bf9a74 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.525601 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-306e074c-b0ca-4f83-ae87-5fe221d7ed49 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.214010 Jul 20 04:22:37.526205 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1456/2976] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:37.544210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d3622097-0410-44f7-9a04-d5d8cf690740 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.547495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d3622097-0410-44f7-9a04-d5d8cf690740 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.548497 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d3622097-0410-44f7-9a04-d5d8cf690740 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.008101 Jul 20 04:22:37.549025 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1457/2977] 10.222.0.20 () {58 vars in 1177 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:22:37.559592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-20a4c00b-0671-4beb-b7c0-0ec97f8e6a06 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.562893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-20a4c00b-0671-4beb-b7c0-0ec97f8e6a06 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.564430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-20a4c00b-0671-4beb-b7c0-0ec97f8e6a06 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Searching by: {'deleted': False, 'project_id': '04a675a96d3c48a8888e649879f21756'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:37.569205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20a4c00b-0671-4beb-b7c0-0ec97f8e6a06 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.569670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20a4c00b-0671-4beb-b7c0-0ec97f8e6a06 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.570475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20a4c00b-0671-4beb-b7c0-0ec97f8e6a06 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.570920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20a4c00b-0671-4beb-b7c0-0ec97f8e6a06 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.597140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-20a4c00b-0671-4beb-b7c0-0ec97f8e6a06 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:22:37.625596 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-20a4c00b-0671-4beb-b7c0-0ec97f8e6a06 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.069634 Jul 20 04:22:37.626197 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1458/2978] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers => generated 681 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:37.636538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8594bf1d-7b6c-40d6-a731-b738a5bf9a74 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.637733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-53b4699d-9665-47c7-afb5-baf9878c320b tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.638238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-53b4699d-9665-47c7-afb5-baf9878c320b tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:37.640187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:37.644620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53b4699d-9665-47c7-afb5-baf9878c320b tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.645651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53b4699d-9665-47c7-afb5-baf9878c320b tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.645846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8594bf1d-7b6c-40d6-a731-b738a5bf9a74 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.646512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53b4699d-9665-47c7-afb5-baf9878c320b tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.646956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53b4699d-9665-47c7-afb5-baf9878c320b tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.647873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8594bf1d-7b6c-40d6-a731-b738a5bf9a74 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.648995 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8594bf1d-7b6c-40d6-a731-b738a5bf9a74 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1278 microversion: 2.25 time: 0.156982 Jul 20 04:22:37.649580 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1521/2979] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:37.660623 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-53b4699d-9665-47c7-afb5-baf9878c320b tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] HTTP exception thrown: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-53b4699d-9665-47c7-afb5-baf9878c320b tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Request method failure captured: Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd HTTP/1.1 Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14LiljPX4PGA799jFW8yI70Qqfz32gMdEwPRfIuG9zK3gp4dtHBgAhxBdIk0RFEXKw8SVdVHDHEXXBMCNaOF2HgcXpx8BM1mUc4eRfgJuPzCi3qvsPehFJa2--8bxWC3gKl1nZfNTdo5uOr6v0PmA7Ht_IPno3hD-DzIxocaCDt4YQo Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04a675a96d3c48a8888e649879f21756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04a675a96d3c48a8888e649879f21756", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}] Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 80e6c22902d74017aef7952ad1fdbeb4 Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '1b1b703c-85b1-4e4f-b55e-663c74bbb5bd'} Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:37.663226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-53b4699d-9665-47c7-afb5-baf9878c320b tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Returning 404 to user: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-53b4699d-9665-47c7-afb5-baf9878c320b tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd" status: 404 len: 111 microversion: 2.1 time: 0.030688 Jul 20 04:22:37.667763 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1459/2980] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:37 2022] DELETE /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:22:37.673483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-103e4191-2e0e-4de4-a64d-4910a2b4715c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.674014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-103e4191-2e0e-4de4-a64d-4910a2b4715c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:37.681538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-103e4191-2e0e-4de4-a64d-4910a2b4715c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.681991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-103e4191-2e0e-4de4-a64d-4910a2b4715c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.682757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-103e4191-2e0e-4de4-a64d-4910a2b4715c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.683201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-103e4191-2e0e-4de4-a64d-4910a2b4715c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.712696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-103e4191-2e0e-4de4-a64d-4910a2b4715c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:37.789364 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-103e4191-2e0e-4de4-a64d-4910a2b4715c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839" status: 204 len: 0 microversion: 2.1 time: 0.119784 Jul 20 04:22:37.790163 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1522/2981] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:37 2022] DELETE /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:37.797973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-19dbe3ba-2958-40d4-a6e1-771f3a8b3be6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.798418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-19dbe3ba-2958-40d4-a6e1-771f3a8b3be6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:37.804852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19dbe3ba-2958-40d4-a6e1-771f3a8b3be6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.805290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19dbe3ba-2958-40d4-a6e1-771f3a8b3be6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.806056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19dbe3ba-2958-40d4-a6e1-771f3a8b3be6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.806498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19dbe3ba-2958-40d4-a6e1-771f3a8b3be6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.837057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-19dbe3ba-2958-40d4-a6e1-771f3a8b3be6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:37.912054 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-19dbe3ba-2958-40d4-a6e1-771f3a8b3be6 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 204 len: 0 microversion: 2.1 time: 0.117678 Jul 20 04:22:37.912854 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1460/2982] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:37 2022] DELETE /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:37.921970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f71c1437-8358-4d7f-9ec1-aea31092dea0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.922669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f71c1437-8358-4d7f-9ec1-aea31092dea0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:37.929140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f71c1437-8358-4d7f-9ec1-aea31092dea0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.929598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f71c1437-8358-4d7f-9ec1-aea31092dea0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.930403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f71c1437-8358-4d7f-9ec1-aea31092dea0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.930851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f71c1437-8358-4d7f-9ec1-aea31092dea0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.945215 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f71c1437-8358-4d7f-9ec1-aea31092dea0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] HTTP exception thrown: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f71c1437-8358-4d7f-9ec1-aea31092dea0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Request method failure captured: Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd HTTP/1.1 Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14LiljPX4PGA799jFW8yI70Qqfz32gMdEwPRfIuG9zK3gp4dtHBgAhxBdIk0RFEXKw8SVdVHDHEXXBMCNaOF2HgcXpx8BM1mUc4eRfgJuPzCi3qvsPehFJa2--8bxWC3gKl1nZfNTdo5uOr6v0PmA7Ht_IPno3hD-DzIxocaCDt4YQo Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04a675a96d3c48a8888e649879f21756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04a675a96d3c48a8888e649879f21756", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}] Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 80e6c22902d74017aef7952ad1fdbeb4 Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1b1b703c-85b1-4e4f-b55e-663c74bbb5bd'} Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:37.946863 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.951308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:37.951308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:37.951308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:37.951308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:37.951308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:37.951308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. Jul 20 04:22:37.951308 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:37.951308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f71c1437-8358-4d7f-9ec1-aea31092dea0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Returning 404 to user: Instance 1b1b703c-85b1-4e4f-b55e-663c74bbb5bd could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:37.951308 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f71c1437-8358-4d7f-9ec1-aea31092dea0 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd" status: 404 len: 111 microversion: 2.1 time: 0.031195 Jul 20 04:22:37.951308 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1523/2983] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers/1b1b703c-85b1-4e4f-b55e-663c74bbb5bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:37.957154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2d12a2e-1ad6-44b5-a845-38b55f8b1e8d tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.958742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a2d12a2e-1ad6-44b5-a845-38b55f8b1e8d tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:37.964948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2d12a2e-1ad6-44b5-a845-38b55f8b1e8d tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.965401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2d12a2e-1ad6-44b5-a845-38b55f8b1e8d tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.966168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2d12a2e-1ad6-44b5-a845-38b55f8b1e8d tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.966608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2d12a2e-1ad6-44b5-a845-38b55f8b1e8d tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.114792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a2d12a2e-1ad6-44b5-a845-38b55f8b1e8d tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:38.124029 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2d12a2e-1ad6-44b5-a845-38b55f8b1e8d tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839" status: 200 len: 1521 microversion: 2.1 time: 0.170928 Jul 20 04:22:38.124648 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1461/2984] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:38.370830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-299a2eb4-6c16-4a4c-a24d-0810d8959a7c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:38.371455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-299a2eb4-6c16-4a4c-a24d-0810d8959a7c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:38.377682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-299a2eb4-6c16-4a4c-a24d-0810d8959a7c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.378141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-299a2eb4-6c16-4a4c-a24d-0810d8959a7c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.378912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-299a2eb4-6c16-4a4c-a24d-0810d8959a7c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.379411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-299a2eb4-6c16-4a4c-a24d-0810d8959a7c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.516486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-299a2eb4-6c16-4a4c-a24d-0810d8959a7c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:38.524607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-299a2eb4-6c16-4a4c-a24d-0810d8959a7c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.157821 Jul 20 04:22:38.525387 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1524/2985] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:38 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:38.667280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-83a57b36-8251-4d21-a4e6-7bf7f806858d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:38.668035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-83a57b36-8251-4d21-a4e6-7bf7f806858d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:38.674676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83a57b36-8251-4d21-a4e6-7bf7f806858d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.675245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83a57b36-8251-4d21-a4e6-7bf7f806858d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.676373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83a57b36-8251-4d21-a4e6-7bf7f806858d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.677463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83a57b36-8251-4d21-a4e6-7bf7f806858d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.808442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-83a57b36-8251-4d21-a4e6-7bf7f806858d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:38.811990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:38.818047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-83a57b36-8251-4d21-a4e6-7bf7f806858d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:38.819595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-83a57b36-8251-4d21-a4e6-7bf7f806858d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:38.820724 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-83a57b36-8251-4d21-a4e6-7bf7f806858d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1278 microversion: 2.25 time: 0.157734 Jul 20 04:22:38.821305 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1462/2986] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:38 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:39.142881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-de832c68-2353-4a80-9a01-aef96fa68c9c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:39.143532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-de832c68-2353-4a80-9a01-aef96fa68c9c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:39.151186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de832c68-2353-4a80-9a01-aef96fa68c9c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.151677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de832c68-2353-4a80-9a01-aef96fa68c9c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.152442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de832c68-2353-4a80-9a01-aef96fa68c9c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.152889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de832c68-2353-4a80-9a01-aef96fa68c9c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.287069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-de832c68-2353-4a80-9a01-aef96fa68c9c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:39.294730 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-de832c68-2353-4a80-9a01-aef96fa68c9c tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839" status: 200 len: 1521 microversion: 2.1 time: 0.155760 Jul 20 04:22:39.295337 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1525/2987] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:39 2022] GET /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:39.319039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8f85a6fb-1fc1-482c-a447-d48d63eb9342 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c960b901-3c5b-499e-b649-60e8b7a3f1ab"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:39.320094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8f85a6fb-1fc1-482c-a447-d48d63eb9342 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:39.328035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f85a6fb-1fc1-482c-a447-d48d63eb9342 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.328485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f85a6fb-1fc1-482c-a447-d48d63eb9342 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.329249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f85a6fb-1fc1-482c-a447-d48d63eb9342 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.329687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f85a6fb-1fc1-482c-a447-d48d63eb9342 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.542302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-18e0ff9e-48dc-4c79-b1a3-8f5e4d2147b8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:39.543026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-18e0ff9e-48dc-4c79-b1a3-8f5e4d2147b8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:39.549105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18e0ff9e-48dc-4c79-b1a3-8f5e4d2147b8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.549554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18e0ff9e-48dc-4c79-b1a3-8f5e4d2147b8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.550313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18e0ff9e-48dc-4c79-b1a3-8f5e4d2147b8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.550753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18e0ff9e-48dc-4c79-b1a3-8f5e4d2147b8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.679627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-18e0ff9e-48dc-4c79-b1a3-8f5e4d2147b8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:39.687796 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-18e0ff9e-48dc-4c79-b1a3-8f5e4d2147b8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.149414 Jul 20 04:22:39.688379 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1526/2988] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:39 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:39.838811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91ea795b-4551-4917-b039-ee6a6025eeed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:39.839435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91ea795b-4551-4917-b039-ee6a6025eeed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:39.847878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91ea795b-4551-4917-b039-ee6a6025eeed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.850184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91ea795b-4551-4917-b039-ee6a6025eeed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.850994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91ea795b-4551-4917-b039-ee6a6025eeed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.851445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91ea795b-4551-4917-b039-ee6a6025eeed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.913101 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8f85a6fb-1fc1-482c-a447-d48d63eb9342 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "POST /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.598856 Jul 20 04:22:39.914147 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1463/2989] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:22:39 2022] POST /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments => generated 194 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:40.130431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91ea795b-4551-4917-b039-ee6a6025eeed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:40.141926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91ea795b-4551-4917-b039-ee6a6025eeed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:40.143444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91ea795b-4551-4917-b039-ee6a6025eeed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:40.144613 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91ea795b-4551-4917-b039-ee6a6025eeed tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1278 microversion: 2.25 time: 0.310029 Jul 20 04:22:40.150346 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1527/2990] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:39 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1278 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:40.312521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-20852b3b-9ff5-46b4-b288-e737df0e0fa8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:40.313120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b3ead094-29c7-4422-87ee-c5086779617d req-4bc4ffe7-890a-48da-9f57-6860dc2511c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8542411a-8f79-4e60-8812-ed64ed34a90f", "name": "network-vif-deleted", "tag": "6387a7ee-0405-45ab-b7a2-a8f09dbce266"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:40.313240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-20852b3b-9ff5-46b4-b288-e737df0e0fa8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:40.331765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20852b3b-9ff5-46b4-b288-e737df0e0fa8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.332282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20852b3b-9ff5-46b4-b288-e737df0e0fa8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.332966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b3ead094-29c7-4422-87ee-c5086779617d req-4bc4ffe7-890a-48da-9f57-6860dc2511c1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.333560 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b3ead094-29c7-4422-87ee-c5086779617d req-4bc4ffe7-890a-48da-9f57-6860dc2511c1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.334056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20852b3b-9ff5-46b4-b288-e737df0e0fa8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.334517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20852b3b-9ff5-46b4-b288-e737df0e0fa8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.348291 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b3ead094-29c7-4422-87ee-c5086779617d req-4bc4ffe7-890a-48da-9f57-6860dc2511c1 service nova] Creating event network-vif-deleted:6387a7ee-0405-45ab-b7a2-a8f09dbce266 for instance 8542411a-8f79-4e60-8812-ed64ed34a90f on n-h1-764485-11 Jul 20 04:22:40.354297 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b3ead094-29c7-4422-87ee-c5086779617d req-4bc4ffe7-890a-48da-9f57-6860dc2511c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049707 Jul 20 04:22:40.355497 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1464/2991] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:40.459520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-20852b3b-9ff5-46b4-b288-e737df0e0fa8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e6c22902d74017aef7952ad1fdbeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a675a96d3c48a8888e649879f21756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:40.477231 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-20852b3b-9ff5-46b4-b288-e737df0e0fa8 tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839" status: 200 len: 1479 microversion: 2.1 time: 0.167875 Jul 20 04:22:40.487027 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1528/2992] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:40 2022] GET /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 => generated 1479 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:40.526951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b8197169-930a-4521-afab-f5664ea8cda1 req-052d4cee-73a2-42b1-bdbe-877f7bb65fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839", "name": "network-vif-deleted", "tag": "b1fe305d-7589-4093-92e7-6ca7f8c96f62"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:40.542798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b8197169-930a-4521-afab-f5664ea8cda1 req-052d4cee-73a2-42b1-bdbe-877f7bb65fa0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.543617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b8197169-930a-4521-afab-f5664ea8cda1 req-052d4cee-73a2-42b1-bdbe-877f7bb65fa0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.560821 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b8197169-930a-4521-afab-f5664ea8cda1 req-052d4cee-73a2-42b1-bdbe-877f7bb65fa0 service nova] Creating event network-vif-deleted:b1fe305d-7589-4093-92e7-6ca7f8c96f62 for instance 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 on n-h2-764485-11 Jul 20 04:22:40.566346 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b8197169-930a-4521-afab-f5664ea8cda1 req-052d4cee-73a2-42b1-bdbe-877f7bb65fa0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043855 Jul 20 04:22:40.567094 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1465/2993] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:40.705914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-139c67af-e7fa-47eb-bc14-b34f763c01be tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:40.706702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-139c67af-e7fa-47eb-bc14-b34f763c01be tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:40.714569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-139c67af-e7fa-47eb-bc14-b34f763c01be tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.715185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-139c67af-e7fa-47eb-bc14-b34f763c01be tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.716276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-139c67af-e7fa-47eb-bc14-b34f763c01be tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.716735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-139c67af-e7fa-47eb-bc14-b34f763c01be tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.861343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-139c67af-e7fa-47eb-bc14-b34f763c01be tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:40.870312 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-139c67af-e7fa-47eb-bc14-b34f763c01be tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.168350 Jul 20 04:22:40.870912 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1529/2994] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:40 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:41.165582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bfdcf420-6966-41c1-a1c0-5d01a6bdf8c8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:41.166407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bfdcf420-6966-41c1-a1c0-5d01a6bdf8c8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:41.173232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfdcf420-6966-41c1-a1c0-5d01a6bdf8c8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.173713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfdcf420-6966-41c1-a1c0-5d01a6bdf8c8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.174665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfdcf420-6966-41c1-a1c0-5d01a6bdf8c8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.175110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfdcf420-6966-41c1-a1c0-5d01a6bdf8c8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.315525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bfdcf420-6966-41c1-a1c0-5d01a6bdf8c8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:41.324634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bfdcf420-6966-41c1-a1c0-5d01a6bdf8c8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:41.326250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bfdcf420-6966-41c1-a1c0-5d01a6bdf8c8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:41.327365 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bfdcf420-6966-41c1-a1c0-5d01a6bdf8c8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1278 microversion: 2.25 time: 0.168520 Jul 20 04:22:41.328261 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1466/2995] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:41 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:41.494340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02aac8b9-ee3e-4d1f-a787-2123646a983e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:41.494964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-02aac8b9-ee3e-4d1f-a787-2123646a983e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:41.501959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02aac8b9-ee3e-4d1f-a787-2123646a983e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.502414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02aac8b9-ee3e-4d1f-a787-2123646a983e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.503189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02aac8b9-ee3e-4d1f-a787-2123646a983e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.503661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02aac8b9-ee3e-4d1f-a787-2123646a983e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.518947 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-02aac8b9-ee3e-4d1f-a787-2123646a983e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] HTTP exception thrown: Instance 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 could not be found. Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02aac8b9-ee3e-4d1f-a787-2123646a983e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Request method failure captured: Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 HTTP/1.1 Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14LiljPX4PGA799jFW8yI70Qqfz32gMdEwPRfIuG9zK3gp4dtHBgAhxBdIk0RFEXKw8SVdVHDHEXXBMCNaOF2HgcXpx8BM1mUc4eRfgJuPzCi3qvsPehFJa2--8bxWC3gKl1nZfNTdo5uOr6v0PmA7Ht_IPno3hD-DzIxocaCDt4YQo Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04a675a96d3c48a8888e649879f21756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04a675a96d3c48a8888e649879f21756", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}] Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 80e6c22902d74017aef7952ad1fdbeb4 Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 could not be found. Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839'} Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 could not be found. Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 could not be found. Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:41.520773 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.525799 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:41.525799 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:41.525799 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:41.525799 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:41.525799 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:41.525799 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 could not be found. Jul 20 04:22:41.525799 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.525799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02aac8b9-ee3e-4d1f-a787-2123646a983e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Returning 404 to user: Instance 0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:41.525799 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-02aac8b9-ee3e-4d1f-a787-2123646a983e tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839" status: 404 len: 111 microversion: 2.1 time: 0.031993 Jul 20 04:22:41.526457 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1530/2996] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:41 2022] GET /compute/v2.1/servers/0dc9d2b6-49a3-4dc2-82cd-f4c2fa0bf839 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:41.532404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd68aef4-9722-4e2f-ba2a-47d092eb7bdd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:41.533231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cd68aef4-9722-4e2f-ba2a-47d092eb7bdd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] [instance: 8542411a-8f79-4e60-8812-ed64ed34a90f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:41.541760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd68aef4-9722-4e2f-ba2a-47d092eb7bdd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.542209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd68aef4-9722-4e2f-ba2a-47d092eb7bdd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.543015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd68aef4-9722-4e2f-ba2a-47d092eb7bdd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.543448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd68aef4-9722-4e2f-ba2a-47d092eb7bdd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.558398 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-cd68aef4-9722-4e2f-ba2a-47d092eb7bdd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] HTTP exception thrown: Instance 8542411a-8f79-4e60-8812-ed64ed34a90f could not be found. Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd68aef4-9722-4e2f-ba2a-47d092eb7bdd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Request method failure captured: Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f HTTP/1.1 Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14LiljPX4PGA799jFW8yI70Qqfz32gMdEwPRfIuG9zK3gp4dtHBgAhxBdIk0RFEXKw8SVdVHDHEXXBMCNaOF2HgcXpx8BM1mUc4eRfgJuPzCi3qvsPehFJa2--8bxWC3gKl1nZfNTdo5uOr6v0PmA7Ht_IPno3hD-DzIxocaCDt4YQo Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04a675a96d3c48a8888e649879f21756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04a675a96d3c48a8888e649879f21756", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04a675a96d3c48a8888e649879f21756"}]}] Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 04a675a96d3c48a8888e649879f21756 Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1305018256 Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 80e6c22902d74017aef7952ad1fdbeb4 Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ListServersNegativeTestJSON-1305018256-project Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 8542411a-8f79-4e60-8812-ed64ed34a90f could not be found. Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '8542411a-8f79-4e60-8812-ed64ed34a90f'} Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8542411a-8f79-4e60-8812-ed64ed34a90f could not be found. Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8542411a-8f79-4e60-8812-ed64ed34a90f could not be found. Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:41.560345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.564510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:41.564510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:41.564510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:41.564510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:41.564510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:41.564510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8542411a-8f79-4e60-8812-ed64ed34a90f could not be found. Jul 20 04:22:41.564510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.564510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd68aef4-9722-4e2f-ba2a-47d092eb7bdd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] Returning 404 to user: Instance 8542411a-8f79-4e60-8812-ed64ed34a90f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:41.564510 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd68aef4-9722-4e2f-ba2a-47d092eb7bdd tempest-ListServersNegativeTestJSON-1305018256 tempest-ListServersNegativeTestJSON-1305018256-project] 10.222.0.20 "GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f" status: 404 len: 111 microversion: 2.1 time: 0.033622 Jul 20 04:22:41.564510 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1467/2997] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:41 2022] GET /compute/v2.1/servers/8542411a-8f79-4e60-8812-ed64ed34a90f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:41.889228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6ecf9ba2-e356-40d7-92c7-f812d92ee36a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:41.889874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6ecf9ba2-e356-40d7-92c7-f812d92ee36a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:41.896869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ecf9ba2-e356-40d7-92c7-f812d92ee36a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.897410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ecf9ba2-e356-40d7-92c7-f812d92ee36a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.898182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ecf9ba2-e356-40d7-92c7-f812d92ee36a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.898619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ecf9ba2-e356-40d7-92c7-f812d92ee36a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.040800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6ecf9ba2-e356-40d7-92c7-f812d92ee36a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:42.052874 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6ecf9ba2-e356-40d7-92c7-f812d92ee36a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.166664 Jul 20 04:22:42.062994 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1531/2998] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:41 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:42.347374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2eecb0f7-d8e4-432b-832e-d0cc80f636b8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:42.348510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2eecb0f7-d8e4-432b-832e-d0cc80f636b8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:42.356970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eecb0f7-d8e4-432b-832e-d0cc80f636b8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.357424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eecb0f7-d8e4-432b-832e-d0cc80f636b8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.358454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eecb0f7-d8e4-432b-832e-d0cc80f636b8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.358943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eecb0f7-d8e4-432b-832e-d0cc80f636b8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.508861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2eecb0f7-d8e4-432b-832e-d0cc80f636b8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:42.519671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2eecb0f7-d8e4-432b-832e-d0cc80f636b8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:42.521725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2eecb0f7-d8e4-432b-832e-d0cc80f636b8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:42.522907 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2eecb0f7-d8e4-432b-832e-d0cc80f636b8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1278 microversion: 2.25 time: 0.180616 Jul 20 04:22:42.523487 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1468/2999] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:42 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:43.070995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9e6ef8fd-c603-4906-b8d4-43fade7aeddb tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:43.071559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9e6ef8fd-c603-4906-b8d4-43fade7aeddb tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:43.088647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e6ef8fd-c603-4906-b8d4-43fade7aeddb tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.089102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e6ef8fd-c603-4906-b8d4-43fade7aeddb tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.089893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e6ef8fd-c603-4906-b8d4-43fade7aeddb tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.090321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e6ef8fd-c603-4906-b8d4-43fade7aeddb tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.280942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e6ef8fd-c603-4906-b8d4-43fade7aeddb tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:43.290559 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9e6ef8fd-c603-4906-b8d4-43fade7aeddb tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.224553 Jul 20 04:22:43.300291 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1532/3000] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:43 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:43.542392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9581bf8f-84a2-4ba8-bad5-4e4dd4b8808d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:43.543090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9581bf8f-84a2-4ba8-bad5-4e4dd4b8808d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:43.556220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9581bf8f-84a2-4ba8-bad5-4e4dd4b8808d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.558817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9581bf8f-84a2-4ba8-bad5-4e4dd4b8808d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.562188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9581bf8f-84a2-4ba8-bad5-4e4dd4b8808d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.562920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9581bf8f-84a2-4ba8-bad5-4e4dd4b8808d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.757345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9581bf8f-84a2-4ba8-bad5-4e4dd4b8808d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:43.769567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9581bf8f-84a2-4ba8-bad5-4e4dd4b8808d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:43.772986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9581bf8f-84a2-4ba8-bad5-4e4dd4b8808d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:43.774626 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9581bf8f-84a2-4ba8-bad5-4e4dd4b8808d tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1278 microversion: 2.25 time: 0.236523 Jul 20 04:22:43.775356 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1469/3001] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:43 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:44.311702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd5b94a7-3f23-49c4-a793-718b2914f1a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:44.312603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dd5b94a7-3f23-49c4-a793-718b2914f1a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:44.321927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd5b94a7-3f23-49c4-a793-718b2914f1a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.322526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd5b94a7-3f23-49c4-a793-718b2914f1a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.323376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd5b94a7-3f23-49c4-a793-718b2914f1a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.323858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd5b94a7-3f23-49c4-a793-718b2914f1a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.539643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dd5b94a7-3f23-49c4-a793-718b2914f1a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:44.548394 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dd5b94a7-3f23-49c4-a793-718b2914f1a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.243433 Jul 20 04:22:44.549211 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1533/3002] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:44 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:44.805547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8373a7c3-b6bf-4d82-bafc-cd62eac58832 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:44.806306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8373a7c3-b6bf-4d82-bafc-cd62eac58832 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:44.829613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8373a7c3-b6bf-4d82-bafc-cd62eac58832 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.830594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8373a7c3-b6bf-4d82-bafc-cd62eac58832 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.831911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8373a7c3-b6bf-4d82-bafc-cd62eac58832 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.833355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8373a7c3-b6bf-4d82-bafc-cd62eac58832 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:45.121617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8373a7c3-b6bf-4d82-bafc-cd62eac58832 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:45.152119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8373a7c3-b6bf-4d82-bafc-cd62eac58832 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:45.157202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8373a7c3-b6bf-4d82-bafc-cd62eac58832 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:45.158772 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8373a7c3-b6bf-4d82-bafc-cd62eac58832 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1278 microversion: 2.25 time: 0.368233 Jul 20 04:22:45.159956 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1470/3003] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:44 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1278 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:45.567656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a981674-b174-4790-aa83-1683d963630e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:45.568443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3a981674-b174-4790-aa83-1683d963630e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:45.576085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a981674-b174-4790-aa83-1683d963630e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:45.576547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a981674-b174-4790-aa83-1683d963630e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:45.577335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a981674-b174-4790-aa83-1683d963630e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:45.577810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a981674-b174-4790-aa83-1683d963630e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:45.858608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3a981674-b174-4790-aa83-1683d963630e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:45.868501 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a981674-b174-4790-aa83-1683d963630e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.305177 Jul 20 04:22:45.869099 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1534/3004] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:45 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:46.125740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-09335051-6d24-425c-b9d2-e56a118e7869 req-2cf349f9-0e97-4c43-926a-b3c582604838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588d4bae-3e12-4c79-81c7-b6223cb6dacc", "name": "network-vif-plugged", "status": "completed", "tag": "5397e4d6-56be-4b85-aca3-b4aa19f1e755"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:46.135697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-09335051-6d24-425c-b9d2-e56a118e7869 req-2cf349f9-0e97-4c43-926a-b3c582604838 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.136118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-09335051-6d24-425c-b9d2-e56a118e7869 req-2cf349f9-0e97-4c43-926a-b3c582604838 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.149556 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-09335051-6d24-425c-b9d2-e56a118e7869 req-2cf349f9-0e97-4c43-926a-b3c582604838 service nova] Creating event network-vif-plugged:5397e4d6-56be-4b85-aca3-b4aa19f1e755 for instance 588d4bae-3e12-4c79-81c7-b6223cb6dacc on n-h1-764485-11 Jul 20 04:22:46.154326 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-09335051-6d24-425c-b9d2-e56a118e7869 req-2cf349f9-0e97-4c43-926a-b3c582604838 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032228 Jul 20 04:22:46.155243 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1471/3005] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:46.178337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e3cbaee6-97c4-4b4a-add1-d435dcdf1b19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:46.179330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e3cbaee6-97c4-4b4a-add1-d435dcdf1b19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:46.186275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e3cbaee6-97c4-4b4a-add1-d435dcdf1b19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.186887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e3cbaee6-97c4-4b4a-add1-d435dcdf1b19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.187854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e3cbaee6-97c4-4b4a-add1-d435dcdf1b19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.188292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e3cbaee6-97c4-4b4a-add1-d435dcdf1b19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.401401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e3cbaee6-97c4-4b4a-add1-d435dcdf1b19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:46.410132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e3cbaee6-97c4-4b4a-add1-d435dcdf1b19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:46.412810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e3cbaee6-97c4-4b4a-add1-d435dcdf1b19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:46.414289 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e3cbaee6-97c4-4b4a-add1-d435dcdf1b19 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1278 microversion: 2.25 time: 0.240142 Jul 20 04:22:46.415026 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1535/3006] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:46 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:46.887397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c87b58da-e8f1-4bd1-9d6e-69f513d3e8af tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:46.888168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c87b58da-e8f1-4bd1-9d6e-69f513d3e8af tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:46.894425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c87b58da-e8f1-4bd1-9d6e-69f513d3e8af tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.895498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c87b58da-e8f1-4bd1-9d6e-69f513d3e8af tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.896635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c87b58da-e8f1-4bd1-9d6e-69f513d3e8af tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.897069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c87b58da-e8f1-4bd1-9d6e-69f513d3e8af tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.038392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c87b58da-e8f1-4bd1-9d6e-69f513d3e8af tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:47.046276 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c87b58da-e8f1-4bd1-9d6e-69f513d3e8af tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.163245 Jul 20 04:22:47.047040 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1472/3007] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:46 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:47.432905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-189aadac-eda7-48ca-8356-f0d3262e0d82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:47.433668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-189aadac-eda7-48ca-8356-f0d3262e0d82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:47.436745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:47.446028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-189aadac-eda7-48ca-8356-f0d3262e0d82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:47.446703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-189aadac-eda7-48ca-8356-f0d3262e0d82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.447774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-189aadac-eda7-48ca-8356-f0d3262e0d82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:47.448592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-189aadac-eda7-48ca-8356-f0d3262e0d82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.682559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-189aadac-eda7-48ca-8356-f0d3262e0d82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:47.691503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-189aadac-eda7-48ca-8356-f0d3262e0d82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:47.694345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-189aadac-eda7-48ca-8356-f0d3262e0d82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:47.695634 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-189aadac-eda7-48ca-8356-f0d3262e0d82 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1278 microversion: 2.25 time: 0.267233 Jul 20 04:22:47.696216 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1536/3008] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:47 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:48.069694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-69bfae2f-83bc-4974-9f39-7c3c8e9b5627 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:48.071293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-69bfae2f-83bc-4974-9f39-7c3c8e9b5627 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:48.078902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:48.080520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:48.084426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69bfae2f-83bc-4974-9f39-7c3c8e9b5627 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.085329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69bfae2f-83bc-4974-9f39-7c3c8e9b5627 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.087025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69bfae2f-83bc-4974-9f39-7c3c8e9b5627 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.089154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69bfae2f-83bc-4974-9f39-7c3c8e9b5627 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.364099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-69bfae2f-83bc-4974-9f39-7c3c8e9b5627 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:48.380824 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-69bfae2f-83bc-4974-9f39-7c3c8e9b5627 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.319145 Jul 20 04:22:48.381656 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1473/3009] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:48 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:48.713781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cafc4969-f8e7-455a-9582-20ccfef3cf4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:48.715771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cafc4969-f8e7-455a-9582-20ccfef3cf4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:48.723636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cafc4969-f8e7-455a-9582-20ccfef3cf4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.724090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cafc4969-f8e7-455a-9582-20ccfef3cf4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.725455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cafc4969-f8e7-455a-9582-20ccfef3cf4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.725896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cafc4969-f8e7-455a-9582-20ccfef3cf4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.028608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cafc4969-f8e7-455a-9582-20ccfef3cf4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:49.037296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cafc4969-f8e7-455a-9582-20ccfef3cf4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:49.039335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cafc4969-f8e7-455a-9582-20ccfef3cf4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:49.040623 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cafc4969-f8e7-455a-9582-20ccfef3cf4c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1474 microversion: 2.25 time: 0.330893 Jul 20 04:22:49.041281 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1537/3010] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:48 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1474 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:49.059479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-78c5fcda-7149-4594-a333-1befb7162283 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:49.060128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-78c5fcda-7149-4594-a333-1befb7162283 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:49.067088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78c5fcda-7149-4594-a333-1befb7162283 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.067576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78c5fcda-7149-4594-a333-1befb7162283 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.068614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78c5fcda-7149-4594-a333-1befb7162283 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.069154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78c5fcda-7149-4594-a333-1befb7162283 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.329959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-78c5fcda-7149-4594-a333-1befb7162283 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid 588d4bae-3e12-4c79-81c7-b6223cb6dacc {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:22:49.348743 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-78c5fcda-7149-4594-a333-1befb7162283 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1966 microversion: 2.25 time: 0.292465 Jul 20 04:22:49.349690 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1474/3011] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:49 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1966 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:49.367306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-63b3a0ad-bdd0-4b35-a175-49f093303520 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:49.368134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-63b3a0ad-bdd0-4b35-a175-49f093303520 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:49.376085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63b3a0ad-bdd0-4b35-a175-49f093303520 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.376887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63b3a0ad-bdd0-4b35-a175-49f093303520 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.377813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63b3a0ad-bdd0-4b35-a175-49f093303520 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.378324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63b3a0ad-bdd0-4b35-a175-49f093303520 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.383016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:49.400092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8de1e41d-29de-47da-be04-3c2b6701b35d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:49.402388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8de1e41d-29de-47da-be04-3c2b6701b35d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:49.412571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8de1e41d-29de-47da-be04-3c2b6701b35d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.413440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8de1e41d-29de-47da-be04-3c2b6701b35d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.414503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8de1e41d-29de-47da-be04-3c2b6701b35d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.415158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8de1e41d-29de-47da-be04-3c2b6701b35d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.700158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8de1e41d-29de-47da-be04-3c2b6701b35d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:49.718791 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8de1e41d-29de-47da-be04-3c2b6701b35d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.324287 Jul 20 04:22:49.720978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-63b3a0ad-bdd0-4b35-a175-49f093303520 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid 588d4bae-3e12-4c79-81c7-b6223cb6dacc {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:22:49.721686 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1475/3012] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:49 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:49.736523 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-63b3a0ad-bdd0-4b35-a175-49f093303520 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1966 microversion: 2.25 time: 0.372845 Jul 20 04:22:49.737095 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1538/3013] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:49 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1966 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:49.755305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9854459-38fc-45fe-842e-102bb74612b3 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:49.757966 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:22:49.757966 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:22:49.760274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9854459-38fc-45fe-842e-102bb74612b3 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.761106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9854459-38fc-45fe-842e-102bb74612b3 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.762368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9854459-38fc-45fe-842e-102bb74612b3 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.762913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9854459-38fc-45fe-842e-102bb74612b3 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.792533 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b9854459-38fc-45fe-842e-102bb74612b3 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.041969 Jul 20 04:22:49.793511 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1476/3014] 10.222.0.20 () {60 vars in 1216 bytes} [Wed Jul 20 04:22:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:22:49.805091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4b9d940f-ff7c-42a9-afb5-5b6fb5d625f4 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-764485-11", "block_migration": "auto"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:49.806545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4b9d940f-ff7c-42a9-afb5-5b6fb5d625f4 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:49.815099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b9d940f-ff7c-42a9-afb5-5b6fb5d625f4 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.815581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b9d940f-ff7c-42a9-afb5-5b6fb5d625f4 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.817717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b9d940f-ff7c-42a9-afb5-5b6fb5d625f4 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.818334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b9d940f-ff7c-42a9-afb5-5b6fb5d625f4 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.868833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-4b9d940f-ff7c-42a9-afb5-5b6fb5d625f4 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'flavor' on Instance uuid 588d4bae-3e12-4c79-81c7-b6223cb6dacc {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:22:49.884283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4b9d940f-ff7c-42a9-afb5-5b6fb5d625f4 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Going to try to live migrate instance to n-h2-764485-11 {{(pid=119808) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:22:50.740939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ced699ba-4098-4c77-8241-b0901d7ea116 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:50.744745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ced699ba-4098-4c77-8241-b0901d7ea116 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:50.769046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ced699ba-4098-4c77-8241-b0901d7ea116 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.770880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ced699ba-4098-4c77-8241-b0901d7ea116 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.773228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ced699ba-4098-4c77-8241-b0901d7ea116 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.774299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ced699ba-4098-4c77-8241-b0901d7ea116 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.068235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ced699ba-4098-4c77-8241-b0901d7ea116 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:51.077871 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ced699ba-4098-4c77-8241-b0901d7ea116 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.344367 Jul 20 04:22:51.089728 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1477/3015] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:50 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:52.066439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-15737b3d-dbb7-4db7-9c12-1a3dfb9dddba tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "17648157-ed80-4b3d-8940-9bdb1245a73f"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:52.067772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-15737b3d-dbb7-4db7-9c12-1a3dfb9dddba tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.084963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15737b3d-dbb7-4db7-9c12-1a3dfb9dddba tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.085511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15737b3d-dbb7-4db7-9c12-1a3dfb9dddba tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.086399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15737b3d-dbb7-4db7-9c12-1a3dfb9dddba tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.087097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15737b3d-dbb7-4db7-9c12-1a3dfb9dddba tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.266348 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-15737b3d-dbb7-4db7-9c12-1a3dfb9dddba tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] HTTP exception thrown: Volume 17648157-ed80-4b3d-8940-9bdb1245a73f could not be found. Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-15737b3d-dbb7-4db7-9c12-1a3dfb9dddba tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Request method failure captured: Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: request: PUT /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments/c960b901-3c5b-499e-b649-60e8b7a3f1ab HTTP/1.1 Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 74 Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14KdV0R237ZQMbUf7p6vFErIgV0KYYRHguNZJv1j6ZYBGhxmD3ABMbjbXHNo7UVx3TYh8-DvcsONrA7-XtOU-udIwnQqPsJUMGkA8ykNhR0P1PXDmN2lGcXAhzfAvmjcEIWuowKqiq7hLOyc0GKtySsPNxOPY-SsKcWvfAq9q4Ggzj8 Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6aec483f5a7d4494953101d944c4d849 Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-VolumesAdminNegativeTest-1467021002 Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6aec483f5a7d4494953101d944c4d849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6aec483f5a7d4494953101d944c4d849"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6aec483f5a7d4494953101d944c4d849", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6aec483f5a7d4494953101d944c4d849"}]}] Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-VolumesAdminNegativeTest-1467021002 Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6aec483f5a7d4494953101d944c4d849 Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1467021002 Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-VolumesAdminNegativeTest-1467021002-project-admin Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 29aa17df12684b16896fe1c65b09e775 Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-VolumesAdminNegativeTest-1467021002-project-admin Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: {"volumeAttachment": {"volumeId": "17648157-ed80-4b3d-8940-9bdb1245a73f"}} Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: exception: Volume 17648157-ed80-4b3d-8940-9bdb1245a73f could not be found. Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'server_id': 'dd5c32a2-e4d5-42ae-97c8-68123a555ec9', 'id': 'c960b901-3c5b-499e-b649-60e8b7a3f1ab', 'body': {'volumeAttachment': {'volumeId': '17648157-ed80-4b3d-8940-9bdb1245a73f'}}} Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17648157-ed80-4b3d-8940-9bdb1245a73f could not be found. (HTTP 404) (Request-ID: req-e19fbc58-c256-41f4-81d5-19ff37045f21) Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:22:52.295947 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17648157-ed80-4b3d-8940-9bdb1245a73f could not be found. Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 17648157-ed80-4b3d-8940-9bdb1245a73f could not be found. Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17648157-ed80-4b3d-8940-9bdb1245a73f could not be found. Jul 20 04:22:52.300055 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:22:52.308524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-15737b3d-dbb7-4db7-9c12-1a3dfb9dddba tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Returning 400 to user: Volume 17648157-ed80-4b3d-8940-9bdb1245a73f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:52.310763 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-15737b3d-dbb7-4db7-9c12-1a3dfb9dddba tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments/c960b901-3c5b-499e-b649-60e8b7a3f1ab" status: 400 len: 107 microversion: 2.1 time: 0.426171 Jul 20 04:22:52.319312 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1478/3016] 10.222.0.20 () {60 vars in 1432 bytes} [Wed Jul 20 04:22:51 2022] PUT /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments/c960b901-3c5b-499e-b649-60e8b7a3f1ab => generated 107 bytes in 438 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:22:52.335306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-30b9f3be-4b90-4017-8cf0-12228ccc31ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.337795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-30b9f3be-4b90-4017-8cf0-12228ccc31ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.359393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-30b9f3be-4b90-4017-8cf0-12228ccc31ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.360254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-30b9f3be-4b90-4017-8cf0-12228ccc31ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.361416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-30b9f3be-4b90-4017-8cf0-12228ccc31ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.362125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-30b9f3be-4b90-4017-8cf0-12228ccc31ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.475125 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4b9d940f-ff7c-42a9-afb5-5b6fb5d625f4 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc/action" status: 202 len: 0 microversion: 2.25 time: 2.674080 Jul 20 04:22:52.476343 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1539/3017] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:22:49 2022] POST /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc/action => generated 0 bytes in 2676 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:52.491153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7be0b1ec-6aa6-4e1c-9987-1f756eb6b82a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.496218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7be0b1ec-6aa6-4e1c-9987-1f756eb6b82a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.505445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7be0b1ec-6aa6-4e1c-9987-1f756eb6b82a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.506173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7be0b1ec-6aa6-4e1c-9987-1f756eb6b82a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.507159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7be0b1ec-6aa6-4e1c-9987-1f756eb6b82a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.507809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7be0b1ec-6aa6-4e1c-9987-1f756eb6b82a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.631211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-7be0b1ec-6aa6-4e1c-9987-1f756eb6b82a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lazy-loading 'services' on Instance uuid dd5c32a2-e4d5-42ae-97c8-68123a555ec9 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:22:52.741998 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7be0b1ec-6aa6-4e1c-9987-1f756eb6b82a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments/c960b901-3c5b-499e-b649-60e8b7a3f1ab" status: 202 len: 0 microversion: 2.1 time: 0.264210 Jul 20 04:22:52.743306 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1540/3018] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:22:52 2022] DELETE /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments/c960b901-3c5b-499e-b649-60e8b7a3f1ab => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:52.750058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91216fc7-c9ba-42f7-92a9-8772f8b822e8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.752338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91216fc7-c9ba-42f7-92a9-8772f8b822e8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.765267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91216fc7-c9ba-42f7-92a9-8772f8b822e8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.767223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91216fc7-c9ba-42f7-92a9-8772f8b822e8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.768539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91216fc7-c9ba-42f7-92a9-8772f8b822e8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.773579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91216fc7-c9ba-42f7-92a9-8772f8b822e8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.940309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-30b9f3be-4b90-4017-8cf0-12228ccc31ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:52.950076 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-30b9f3be-4b90-4017-8cf0-12228ccc31ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.628507 Jul 20 04:22:52.950940 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1479/3019] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:52 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:52.965617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-caa7a09f-1c63-48c0-ac8a-c2549ab37673 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.966711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-caa7a09f-1c63-48c0-ac8a-c2549ab37673 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.975138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-caa7a09f-1c63-48c0-ac8a-c2549ab37673 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.975654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-caa7a09f-1c63-48c0-ac8a-c2549ab37673 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.976441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-caa7a09f-1c63-48c0-ac8a-c2549ab37673 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.976884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-caa7a09f-1c63-48c0-ac8a-c2549ab37673 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.012796 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-caa7a09f-1c63-48c0-ac8a-c2549ab37673 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060575 Jul 20 04:22:53.013764 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1480/3020] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:22:52 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:53.096688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91216fc7-c9ba-42f7-92a9-8772f8b822e8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:53.104846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91216fc7-c9ba-42f7-92a9-8772f8b822e8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:53.106362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91216fc7-c9ba-42f7-92a9-8772f8b822e8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:53.107547 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91216fc7-c9ba-42f7-92a9-8772f8b822e8 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.362844 Jul 20 04:22:53.108126 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1541/3021] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:52 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:53.261676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-589620423", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "19c8a53e-e349-4990-ac8d-cad6b2c0844d"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:53.315484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] validate_networks() for [('19c8a53e-e349-4990-ac8d-cad6b2c0844d', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:22:53.979551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5c943d99-32e8-4fec-8376-cc9716ad0708 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:53.981651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5c943d99-32e8-4fec-8376-cc9716ad0708 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:53.983645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:53.984190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:53.984851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:53.985277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:53.985701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:53.997970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:53.998428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.999443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.000091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.006292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c943d99-32e8-4fec-8376-cc9716ad0708 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.008353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c943d99-32e8-4fec-8376-cc9716ad0708 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.009761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c943d99-32e8-4fec-8376-cc9716ad0708 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.010632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c943d99-32e8-4fec-8376-cc9716ad0708 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.021822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Getting quotas for project acacca985d204f71a0cdc45a2c50f78c. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:54.029194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Getting quotas for user 61c292c64fb342b48356d4240c2952b2 and project acacca985d204f71a0cdc45a2c50f78c. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:54.060240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Going to run 2 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:22:54.064043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: d992ed51-bb47-460f-a825-bd45481d157e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:54.119473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=d992ed51-bb47-460f-a825-bd45481d157e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:54.242254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5c943d99-32e8-4fec-8376-cc9716ad0708 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:54.254109 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4668cddd-ade0-41d7-8301-ddda8a0db5dc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045193 Jul 20 04:22:54.256109 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1481/3022] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:22:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:22:54.269042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ed89968f-afd3-4a26-82e9-cc0539da841c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:54.278507 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5c943d99-32e8-4fec-8376-cc9716ad0708 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.311292 Jul 20 04:22:54.280303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ed89968f-afd3-4a26-82e9-cc0539da841c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:54.281059 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1542/3023] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:53 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:54.289218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed89968f-afd3-4a26-82e9-cc0539da841c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.289679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed89968f-afd3-4a26-82e9-cc0539da841c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.302126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44395ee7-a6c6-4f71-ab51-5c9d18a80aa4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:54.303534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed89968f-afd3-4a26-82e9-cc0539da841c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.304124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed89968f-afd3-4a26-82e9-cc0539da841c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.305445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44395ee7-a6c6-4f71-ab51-5c9d18a80aa4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:54.315831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:54.341397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44395ee7-a6c6-4f71-ab51-5c9d18a80aa4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.349032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44395ee7-a6c6-4f71-ab51-5c9d18a80aa4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.353301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44395ee7-a6c6-4f71-ab51-5c9d18a80aa4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.354267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44395ee7-a6c6-4f71-ab51-5c9d18a80aa4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.399540 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ed89968f-afd3-4a26-82e9-cc0539da841c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142070 Jul 20 04:22:54.416468 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1482/3024] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:22:54 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:54.432180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a386d87e-96d5-4fbd-8421-9363196d8a8b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:54.441555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a386d87e-96d5-4fbd-8421-9363196d8a8b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:54.442707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a386d87e-96d5-4fbd-8421-9363196d8a8b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Searching by: {'deleted': False, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:54.473869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a386d87e-96d5-4fbd-8421-9363196d8a8b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.474330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a386d87e-96d5-4fbd-8421-9363196d8a8b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.475136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a386d87e-96d5-4fbd-8421-9363196d8a8b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.475602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a386d87e-96d5-4fbd-8421-9363196d8a8b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.538836 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a386d87e-96d5-4fbd-8421-9363196d8a8b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.120821 Jul 20 04:22:54.539764 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1483/3025] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 04:22:54 2022] GET /compute/v2.1/servers => generated 675 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:54.553568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d2e6a824-a615-4204-ae9c-ca2c2bab6469 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:54.554384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d2e6a824-a615-4204-ae9c-ca2c2bab6469 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:54.565906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:54.640990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d2e6a824-a615-4204-ae9c-ca2c2bab6469 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:54.657455 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d2e6a824-a615-4204-ae9c-ca2c2bab6469 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1219 microversion: 2.1 time: 0.110365 Jul 20 04:22:54.671311 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1484/3026] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:54 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:54.709643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44395ee7-a6c6-4f71-ab51-5c9d18a80aa4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:54.722664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44395ee7-a6c6-4f71-ab51-5c9d18a80aa4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:54.726930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44395ee7-a6c6-4f71-ab51-5c9d18a80aa4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:54.750239 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44395ee7-a6c6-4f71-ab51-5c9d18a80aa4 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.446564 Jul 20 04:22:54.753108 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1543/3027] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:54 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:55.299393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a39b579-f8d4-4fb7-aa00-1795f38f58b5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:55.300120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a39b579-f8d4-4fb7-aa00-1795f38f58b5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:55.324209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a39b579-f8d4-4fb7-aa00-1795f38f58b5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.324666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a39b579-f8d4-4fb7-aa00-1795f38f58b5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.325463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a39b579-f8d4-4fb7-aa00-1795f38f58b5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.325905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a39b579-f8d4-4fb7-aa00-1795f38f58b5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.411900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-545131de-ed35-4004-8095-a8503d0dec1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:55.414020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-545131de-ed35-4004-8095-a8503d0dec1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:55.425406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-545131de-ed35-4004-8095-a8503d0dec1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.426383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-545131de-ed35-4004-8095-a8503d0dec1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.427230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-545131de-ed35-4004-8095-a8503d0dec1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.433033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-545131de-ed35-4004-8095-a8503d0dec1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.478595 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-545131de-ed35-4004-8095-a8503d0dec1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071358 Jul 20 04:22:55.481500 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1544/3028] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:22:55 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:55.672488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a39b579-f8d4-4fb7-aa00-1795f38f58b5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:55.678870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f3d38843-6c4a-461a-adf9-8ba615b36fc1 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:55.679496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f3d38843-6c4a-461a-adf9-8ba615b36fc1 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:55.681662 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a39b579-f8d4-4fb7-aa00-1795f38f58b5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.387204 Jul 20 04:22:55.683953 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1485/3029] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:55 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:55.696904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3d38843-6c4a-461a-adf9-8ba615b36fc1 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.698787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3d38843-6c4a-461a-adf9-8ba615b36fc1 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.700002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3d38843-6c4a-461a-adf9-8ba615b36fc1 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.700789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3d38843-6c4a-461a-adf9-8ba615b36fc1 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.774507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0d7c582f-f32f-48ad-ad47-29b996dd6b95 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:55.775244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0d7c582f-f32f-48ad-ad47-29b996dd6b95 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:55.789520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f3d38843-6c4a-461a-adf9-8ba615b36fc1 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:55.790384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d7c582f-f32f-48ad-ad47-29b996dd6b95 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.791275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d7c582f-f32f-48ad-ad47-29b996dd6b95 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.793289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d7c582f-f32f-48ad-ad47-29b996dd6b95 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.798450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d7c582f-f32f-48ad-ad47-29b996dd6b95 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.805882 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f3d38843-6c4a-461a-adf9-8ba615b36fc1 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1215 microversion: 2.1 time: 0.130787 Jul 20 04:22:55.818289 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1545/3030] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:55 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:56.066023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0d7c582f-f32f-48ad-ad47-29b996dd6b95 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:56.079251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0d7c582f-f32f-48ad-ad47-29b996dd6b95 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:56.080981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0d7c582f-f32f-48ad-ad47-29b996dd6b95 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:56.082228 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0d7c582f-f32f-48ad-ad47-29b996dd6b95 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.312666 Jul 20 04:22:56.082816 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1486/3031] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:55 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:56.492778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d728e20d-bcb3-4eba-86c6-b2ec59dae182 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:56.494069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d728e20d-bcb3-4eba-86c6-b2ec59dae182 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:56.502645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d728e20d-bcb3-4eba-86c6-b2ec59dae182 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.503106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d728e20d-bcb3-4eba-86c6-b2ec59dae182 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.504821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d728e20d-bcb3-4eba-86c6-b2ec59dae182 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.505338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d728e20d-bcb3-4eba-86c6-b2ec59dae182 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.560106 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d728e20d-bcb3-4eba-86c6-b2ec59dae182 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071618 Jul 20 04:22:56.561606 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1546/3032] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:22:56 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:56.703631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-da6471a4-df6e-4586-85eb-7e75fa86b995 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:56.706256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-da6471a4-df6e-4586-85eb-7e75fa86b995 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:56.715032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da6471a4-df6e-4586-85eb-7e75fa86b995 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.716086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da6471a4-df6e-4586-85eb-7e75fa86b995 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.717181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da6471a4-df6e-4586-85eb-7e75fa86b995 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.717958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da6471a4-df6e-4586-85eb-7e75fa86b995 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.825174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9608ff78-fc44-408b-b6a7-ebea1ae7f137 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:56.825846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9608ff78-fc44-408b-b6a7-ebea1ae7f137 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:56.858815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9608ff78-fc44-408b-b6a7-ebea1ae7f137 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.860261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9608ff78-fc44-408b-b6a7-ebea1ae7f137 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.862141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9608ff78-fc44-408b-b6a7-ebea1ae7f137 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.863367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9608ff78-fc44-408b-b6a7-ebea1ae7f137 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.042790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9608ff78-fc44-408b-b6a7-ebea1ae7f137 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:57.058198 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9608ff78-fc44-408b-b6a7-ebea1ae7f137 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1289 microversion: 2.1 time: 0.238020 Jul 20 04:22:57.058437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-da6471a4-df6e-4586-85eb-7e75fa86b995 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:57.059472 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1547/3033] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:56 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1289 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:57.067245 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-da6471a4-df6e-4586-85eb-7e75fa86b995 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.368089 Jul 20 04:22:57.069556 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1487/3034] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:56 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:57.103860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5e1f5ece-6a58-40ca-b224-675538844d92 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:57.105132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5e1f5ece-6a58-40ca-b224-675538844d92 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:57.118522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e1f5ece-6a58-40ca-b224-675538844d92 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.119741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e1f5ece-6a58-40ca-b224-675538844d92 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.121795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e1f5ece-6a58-40ca-b224-675538844d92 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.122633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e1f5ece-6a58-40ca-b224-675538844d92 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.486729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5e1f5ece-6a58-40ca-b224-675538844d92 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:57.506231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5e1f5ece-6a58-40ca-b224-675538844d92 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:57.510323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5e1f5ece-6a58-40ca-b224-675538844d92 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:57.514120 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5e1f5ece-6a58-40ca-b224-675538844d92 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.415080 Jul 20 04:22:57.517369 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1548/3035] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:57 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:57.573077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-574b1629-5ce7-4c66-a12b-0a3cb3a3f74d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:57.574047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-574b1629-5ce7-4c66-a12b-0a3cb3a3f74d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:57.589162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-574b1629-5ce7-4c66-a12b-0a3cb3a3f74d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.589857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-574b1629-5ce7-4c66-a12b-0a3cb3a3f74d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.591112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-574b1629-5ce7-4c66-a12b-0a3cb3a3f74d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.591687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-574b1629-5ce7-4c66-a12b-0a3cb3a3f74d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.648324 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-574b1629-5ce7-4c66-a12b-0a3cb3a3f74d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079176 Jul 20 04:22:57.652959 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1488/3036] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:22:57 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:58.078945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-45900cc4-40b2-419f-9d57-06d6e7cc7e8f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:58.080154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-45900cc4-40b2-419f-9d57-06d6e7cc7e8f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:58.085323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-638e732f-2de4-4b48-9464-501be219e63d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:58.086375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-638e732f-2de4-4b48-9464-501be219e63d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:58.090110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45900cc4-40b2-419f-9d57-06d6e7cc7e8f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.090954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45900cc4-40b2-419f-9d57-06d6e7cc7e8f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.091956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45900cc4-40b2-419f-9d57-06d6e7cc7e8f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.092556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45900cc4-40b2-419f-9d57-06d6e7cc7e8f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.101171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-638e732f-2de4-4b48-9464-501be219e63d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.101902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-638e732f-2de4-4b48-9464-501be219e63d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.102982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-638e732f-2de4-4b48-9464-501be219e63d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.103617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-638e732f-2de4-4b48-9464-501be219e63d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.267768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-45900cc4-40b2-419f-9d57-06d6e7cc7e8f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:58.277311 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-45900cc4-40b2-419f-9d57-06d6e7cc7e8f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1277 microversion: 2.1 time: 0.202905 Jul 20 04:22:58.278464 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1549/3037] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:58 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:58.503147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-638e732f-2de4-4b48-9464-501be219e63d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:58.512739 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-638e732f-2de4-4b48-9464-501be219e63d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.432560 Jul 20 04:22:58.513868 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1489/3038] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:58 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:58.534579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c94b7dd3-41f2-4771-a8cd-132cf93ef789 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:58.535990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c94b7dd3-41f2-4771-a8cd-132cf93ef789 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:58.543757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c94b7dd3-41f2-4771-a8cd-132cf93ef789 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.544654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c94b7dd3-41f2-4771-a8cd-132cf93ef789 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.545684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c94b7dd3-41f2-4771-a8cd-132cf93ef789 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.546339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c94b7dd3-41f2-4771-a8cd-132cf93ef789 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.661482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0762ae3a-8c51-4ce7-80af-d7fac881fb7b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:58.662775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0762ae3a-8c51-4ce7-80af-d7fac881fb7b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:58.671194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0762ae3a-8c51-4ce7-80af-d7fac881fb7b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.671818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0762ae3a-8c51-4ce7-80af-d7fac881fb7b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.672786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0762ae3a-8c51-4ce7-80af-d7fac881fb7b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.673241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0762ae3a-8c51-4ce7-80af-d7fac881fb7b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.714526 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0762ae3a-8c51-4ce7-80af-d7fac881fb7b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057712 Jul 20 04:22:58.719186 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1490/3039] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:22:58 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:58.856362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c94b7dd3-41f2-4771-a8cd-132cf93ef789 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:58.889346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c94b7dd3-41f2-4771-a8cd-132cf93ef789 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:58.891185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c94b7dd3-41f2-4771-a8cd-132cf93ef789 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:58.893518 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c94b7dd3-41f2-4771-a8cd-132cf93ef789 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.362372 Jul 20 04:22:58.894924 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1550/3040] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:58 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:59.296038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a5e8b6f-f9c6-4ba1-8135-ddac152b7ce6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:59.297620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a5e8b6f-f9c6-4ba1-8135-ddac152b7ce6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:59.307180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a5e8b6f-f9c6-4ba1-8135-ddac152b7ce6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.309330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a5e8b6f-f9c6-4ba1-8135-ddac152b7ce6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.311137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a5e8b6f-f9c6-4ba1-8135-ddac152b7ce6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.319042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a5e8b6f-f9c6-4ba1-8135-ddac152b7ce6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.531319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b709ffca-18ec-47df-8a62-71894bcc280e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:59.532385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b709ffca-18ec-47df-8a62-71894bcc280e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:59.549394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b709ffca-18ec-47df-8a62-71894bcc280e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.550020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b709ffca-18ec-47df-8a62-71894bcc280e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.557938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b709ffca-18ec-47df-8a62-71894bcc280e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.558409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b709ffca-18ec-47df-8a62-71894bcc280e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.764500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a5e8b6f-f9c6-4ba1-8135-ddac152b7ce6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:59.777520 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a5e8b6f-f9c6-4ba1-8135-ddac152b7ce6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1319 microversion: 2.1 time: 0.484309 Jul 20 04:22:59.790529 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1491/3041] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:59 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:59.797572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c174e11c-5132-4e95-a322-ae41468c2b87 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:59.800363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c174e11c-5132-4e95-a322-ae41468c2b87 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:59.809422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c174e11c-5132-4e95-a322-ae41468c2b87 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.810981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c174e11c-5132-4e95-a322-ae41468c2b87 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.812642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c174e11c-5132-4e95-a322-ae41468c2b87 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.813369 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c174e11c-5132-4e95-a322-ae41468c2b87 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.905284 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c174e11c-5132-4e95-a322-ae41468c2b87 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112833 Jul 20 04:22:59.918106 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1492/3042] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:22:59 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:59.935226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c88c72e3-756d-4498-a4c3-4bd0e3e72d68 req-25804a7c-93aa-4d1f-be0c-a28f59841052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d992ed51-bb47-460f-a825-bd45481d157e", "tag": "9cdfc191-27d5-4577-b743-484e29c410e4"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:59.961836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c88c72e3-756d-4498-a4c3-4bd0e3e72d68 req-25804a7c-93aa-4d1f-be0c-a28f59841052 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.963439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c88c72e3-756d-4498-a4c3-4bd0e3e72d68 req-25804a7c-93aa-4d1f-be0c-a28f59841052 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.968514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b709ffca-18ec-47df-8a62-71894bcc280e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:59.979630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:59.983109 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b709ffca-18ec-47df-8a62-71894bcc280e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.457091 Jul 20 04:22:59.994782 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1551/3043] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:59 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:00.001869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-99274e3f-ed73-4867-a2cb-68786aaf3086 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:00.002791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-99274e3f-ed73-4867-a2cb-68786aaf3086 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:00.005404 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c88c72e3-756d-4498-a4c3-4bd0e3e72d68 req-25804a7c-93aa-4d1f-be0c-a28f59841052 service nova] Creating event network-changed:9cdfc191-27d5-4577-b743-484e29c410e4 for instance d992ed51-bb47-460f-a825-bd45481d157e on n-h2-764485-11 Jul 20 04:23:00.015264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99274e3f-ed73-4867-a2cb-68786aaf3086 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.016409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99274e3f-ed73-4867-a2cb-68786aaf3086 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:00.017448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99274e3f-ed73-4867-a2cb-68786aaf3086 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.018188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99274e3f-ed73-4867-a2cb-68786aaf3086 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:00.022729 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c88c72e3-756d-4498-a4c3-4bd0e3e72d68 req-25804a7c-93aa-4d1f-be0c-a28f59841052 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102685 Jul 20 04:23:00.028232 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1493/3044] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:00.269126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-686922056", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "4ad2afdf-6c87-4018-afaa-15ee9b13db44"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:00.377550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] validate_networks() for [('4ad2afdf-6c87-4018-afaa-15ee9b13db44', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:00.871967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-99274e3f-ed73-4867-a2cb-68786aaf3086 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:00.883107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-99274e3f-ed73-4867-a2cb-68786aaf3086 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:00.886280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-99274e3f-ed73-4867-a2cb-68786aaf3086 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:00.888097 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-99274e3f-ed73-4867-a2cb-68786aaf3086 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.891199 Jul 20 04:23:00.889321 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1552/3045] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:59 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:00.898035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-295a9af7-ab73-47e5-96a9-1b7de143c1a7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:00.900269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-295a9af7-ab73-47e5-96a9-1b7de143c1a7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:00.907606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-295a9af7-ab73-47e5-96a9-1b7de143c1a7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.908553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-295a9af7-ab73-47e5-96a9-1b7de143c1a7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:00.909889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-295a9af7-ab73-47e5-96a9-1b7de143c1a7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.911652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-295a9af7-ab73-47e5-96a9-1b7de143c1a7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.391786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-295a9af7-ab73-47e5-96a9-1b7de143c1a7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:01.401355 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-295a9af7-ab73-47e5-96a9-1b7de143c1a7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1319 microversion: 2.1 time: 0.510030 Jul 20 04:23:01.402241 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1553/3046] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:00 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:01.406799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10f261c2-1dcd-4966-9051-ac26aeb42d4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:01.407492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-10f261c2-1dcd-4966-9051-ac26aeb42d4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:01.415487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10f261c2-1dcd-4966-9051-ac26aeb42d4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.416054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10f261c2-1dcd-4966-9051-ac26aeb42d4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.416905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10f261c2-1dcd-4966-9051-ac26aeb42d4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.417598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10f261c2-1dcd-4966-9051-ac26aeb42d4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.929824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10f261c2-1dcd-4966-9051-ac26aeb42d4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:01.939720 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-10f261c2-1dcd-4966-9051-ac26aeb42d4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.536666 Jul 20 04:23:01.940562 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1554/3047] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:01 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:01.957088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ba630713-bc57-4a0e-be66-b39786a6a090 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:01.958312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ba630713-bc57-4a0e-be66-b39786a6a090 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:01.965318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ba630713-bc57-4a0e-be66-b39786a6a090 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.966487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ba630713-bc57-4a0e-be66-b39786a6a090 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.968326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ba630713-bc57-4a0e-be66-b39786a6a090 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.969333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ba630713-bc57-4a0e-be66-b39786a6a090 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.219455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:02.220616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:02.221487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:02.222270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:02.224318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:02.251580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ba630713-bc57-4a0e-be66-b39786a6a090 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:02.252545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.253014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.253990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.254551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.261826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ba630713-bc57-4a0e-be66-b39786a6a090 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:02.263775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ba630713-bc57-4a0e-be66-b39786a6a090 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:02.265423 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ba630713-bc57-4a0e-be66-b39786a6a090 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.312301 Jul 20 04:23:02.266112 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1555/3048] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:01 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:02.272364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-0a985e15-0030-4f8d-b01e-0da02c6501fe req-c61ae92c-b15a-4704-b5e7-6113966852a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4ef6d1f-97e0-42a5-b324-a6a7dffd4682", "tag": "39050e91-cd0e-403c-8984-5646457d2de5"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:02.273521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Getting quotas for project cdc4b88912e5436caaa2ce17b7d972b0. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:02.279915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Getting quotas for user dc30eb948c9245ebab77d8306f408f1e and project cdc4b88912e5436caaa2ce17b7d972b0. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:02.282688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0a985e15-0030-4f8d-b01e-0da02c6501fe req-c61ae92c-b15a-4704-b5e7-6113966852a4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.283396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0a985e15-0030-4f8d-b01e-0da02c6501fe req-c61ae92c-b15a-4704-b5e7-6113966852a4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.294694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:02.297136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:02.298282 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-0a985e15-0030-4f8d-b01e-0da02c6501fe req-c61ae92c-b15a-4704-b5e7-6113966852a4 service nova] Creating event network-changed:39050e91-cd0e-403c-8984-5646457d2de5 for instance a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 on n-h2-764485-11 Jul 20 04:23:02.303571 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-0a985e15-0030-4f8d-b01e-0da02c6501fe req-c61ae92c-b15a-4704-b5e7-6113966852a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035890 Jul 20 04:23:02.304590 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1556/3049] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:02.312229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-756448d9-ce2d-4629-86ee-6358accd65dd tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30f21c73-252e-486e-94d8-335d5bb6a1e6"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:02.313650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-756448d9-ce2d-4629-86ee-6358accd65dd tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:02.322241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-756448d9-ce2d-4629-86ee-6358accd65dd tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.322861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-756448d9-ce2d-4629-86ee-6358accd65dd tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.323907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-756448d9-ce2d-4629-86ee-6358accd65dd tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.324565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-756448d9-ce2d-4629-86ee-6358accd65dd tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.345625 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5f29fa52-8be5-471e-81af-bf640a51cfc2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.081319 Jul 20 04:23:02.346884 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1494/3050] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:02.357288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a8de6305-5275-4138-8929-ba9b5fad36ae tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:02.360388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a8de6305-5275-4138-8929-ba9b5fad36ae tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:02.435210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a8de6305-5275-4138-8929-ba9b5fad36ae tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:02.457727 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a8de6305-5275-4138-8929-ba9b5fad36ae tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1217 microversion: 2.1 time: 0.102427 Jul 20 04:23:02.457830 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1495/3051] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:02 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:02.464232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0e86a42b-f946-4d86-8f8e-243eeb2fee82 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:02.465037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0e86a42b-f946-4d86-8f8e-243eeb2fee82 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:02.472225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e86a42b-f946-4d86-8f8e-243eeb2fee82 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.472875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e86a42b-f946-4d86-8f8e-243eeb2fee82 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.473916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e86a42b-f946-4d86-8f8e-243eeb2fee82 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.474518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e86a42b-f946-4d86-8f8e-243eeb2fee82 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.637990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0e86a42b-f946-4d86-8f8e-243eeb2fee82 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:02.648981 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0e86a42b-f946-4d86-8f8e-243eeb2fee82 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1319 microversion: 2.1 time: 0.189816 Jul 20 04:23:02.649854 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1496/3052] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:02 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:02.722898 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-756448d9-ce2d-4629-86ee-6358accd65dd tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "POST /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.416498 Jul 20 04:23:02.723630 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1557/3053] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:23:02 2022] POST /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:02.958497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e8c4db09-9fd6-4f64-a3e2-5819ff4c21f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:02.959120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e8c4db09-9fd6-4f64-a3e2-5819ff4c21f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:02.966284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8c4db09-9fd6-4f64-a3e2-5819ff4c21f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.966929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8c4db09-9fd6-4f64-a3e2-5819ff4c21f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.968057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8c4db09-9fd6-4f64-a3e2-5819ff4c21f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.968894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8c4db09-9fd6-4f64-a3e2-5819ff4c21f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.132494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e8c4db09-9fd6-4f64-a3e2-5819ff4c21f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:03.142644 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e8c4db09-9fd6-4f64-a3e2-5819ff4c21f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.188253 Jul 20 04:23:03.145180 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1497/3054] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:02 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:03.291752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c7b5486-4554-4f2e-a10c-283cd55f0ff7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:03.293004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9c7b5486-4554-4f2e-a10c-283cd55f0ff7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:03.302493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c7b5486-4554-4f2e-a10c-283cd55f0ff7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.303213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c7b5486-4554-4f2e-a10c-283cd55f0ff7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.304209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c7b5486-4554-4f2e-a10c-283cd55f0ff7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.304805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c7b5486-4554-4f2e-a10c-283cd55f0ff7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.469050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9c7b5486-4554-4f2e-a10c-283cd55f0ff7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:03.476787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9db50ae4-8fae-45ea-8947-cf47382b4936 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:03.478578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9db50ae4-8fae-45ea-8947-cf47382b4936 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:03.479933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9c7b5486-4554-4f2e-a10c-283cd55f0ff7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:03.482059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9c7b5486-4554-4f2e-a10c-283cd55f0ff7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:03.483473 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c7b5486-4554-4f2e-a10c-283cd55f0ff7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.199077 Jul 20 04:23:03.487566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9db50ae4-8fae-45ea-8947-cf47382b4936 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.489678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9db50ae4-8fae-45ea-8947-cf47382b4936 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.491530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9db50ae4-8fae-45ea-8947-cf47382b4936 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.492277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9db50ae4-8fae-45ea-8947-cf47382b4936 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.496597 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1558/3055] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:03 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:03.564767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9db50ae4-8fae-45ea-8947-cf47382b4936 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:03.573059 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9db50ae4-8fae-45ea-8947-cf47382b4936 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1221 microversion: 2.1 time: 0.101393 Jul 20 04:23:03.573663 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1498/3056] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:03 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1221 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:03.668884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e65e490-0885-4059-8e09-3f3b42a95e98 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:03.670044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3e65e490-0885-4059-8e09-3f3b42a95e98 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:03.679482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e65e490-0885-4059-8e09-3f3b42a95e98 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.680149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e65e490-0885-4059-8e09-3f3b42a95e98 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.681295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e65e490-0885-4059-8e09-3f3b42a95e98 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.681743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e65e490-0885-4059-8e09-3f3b42a95e98 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.841736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3e65e490-0885-4059-8e09-3f3b42a95e98 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:03.851338 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3e65e490-0885-4059-8e09-3f3b42a95e98 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1319 microversion: 2.1 time: 0.187633 Jul 20 04:23:03.851995 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1559/3057] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:03 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:04.162757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5de9ed5b-fd26-458a-ae10-a4c6af037f29 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:04.163301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5de9ed5b-fd26-458a-ae10-a4c6af037f29 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:04.169638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5de9ed5b-fd26-458a-ae10-a4c6af037f29 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.170222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5de9ed5b-fd26-458a-ae10-a4c6af037f29 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.171157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5de9ed5b-fd26-458a-ae10-a4c6af037f29 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.171596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5de9ed5b-fd26-458a-ae10-a4c6af037f29 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.313486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5de9ed5b-fd26-458a-ae10-a4c6af037f29 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:04.321711 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5de9ed5b-fd26-458a-ae10-a4c6af037f29 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.164488 Jul 20 04:23:04.322368 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1499/3058] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:04 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:04.508103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f3006020-4b10-40c3-b49d-714978425bac tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:04.509488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f3006020-4b10-40c3-b49d-714978425bac tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:04.517029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3006020-4b10-40c3-b49d-714978425bac tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.517498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3006020-4b10-40c3-b49d-714978425bac tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.518280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3006020-4b10-40c3-b49d-714978425bac tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.518840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3006020-4b10-40c3-b49d-714978425bac tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.591015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1efe25cb-e97e-4813-8529-5b283cbcc508 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:04.591689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1efe25cb-e97e-4813-8529-5b283cbcc508 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:04.600706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1efe25cb-e97e-4813-8529-5b283cbcc508 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.601223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1efe25cb-e97e-4813-8529-5b283cbcc508 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.602174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1efe25cb-e97e-4813-8529-5b283cbcc508 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.602617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1efe25cb-e97e-4813-8529-5b283cbcc508 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.672046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f3006020-4b10-40c3-b49d-714978425bac tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:04.682522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f3006020-4b10-40c3-b49d-714978425bac tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:04.684125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f3006020-4b10-40c3-b49d-714978425bac tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:04.685364 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f3006020-4b10-40c3-b49d-714978425bac tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.181953 Jul 20 04:23:04.696308 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1560/3059] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:04 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:04.726912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1efe25cb-e97e-4813-8529-5b283cbcc508 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:04.740221 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1efe25cb-e97e-4813-8529-5b283cbcc508 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1221 microversion: 2.1 time: 0.153183 Jul 20 04:23:04.742211 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1500/3060] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:04 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:04.869096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2c123486-6414-4f0b-ad5a-10838f6c89f7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:04.872771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2c123486-6414-4f0b-ad5a-10838f6c89f7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:04.889048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c123486-6414-4f0b-ad5a-10838f6c89f7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.895413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c123486-6414-4f0b-ad5a-10838f6c89f7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.906232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c123486-6414-4f0b-ad5a-10838f6c89f7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.906798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c123486-6414-4f0b-ad5a-10838f6c89f7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.236073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c123486-6414-4f0b-ad5a-10838f6c89f7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.245420 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2c123486-6414-4f0b-ad5a-10838f6c89f7 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1319 microversion: 2.1 time: 0.380490 Jul 20 04:23:05.246458 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1561/3061] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:04 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:05.342529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-58ca1a0e-c531-4572-adc8-bbd3b5ed0e2e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:05.343489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-58ca1a0e-c531-4572-adc8-bbd3b5ed0e2e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:05.353089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58ca1a0e-c531-4572-adc8-bbd3b5ed0e2e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.353741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58ca1a0e-c531-4572-adc8-bbd3b5ed0e2e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.354972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58ca1a0e-c531-4572-adc8-bbd3b5ed0e2e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.355906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58ca1a0e-c531-4572-adc8-bbd3b5ed0e2e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.424085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b685850b-09cc-40f3-8553-94955cc9a6bf tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:05.428847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b685850b-09cc-40f3-8553-94955cc9a6bf tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.429626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b685850b-09cc-40f3-8553-94955cc9a6bf tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Searching by: {'deleted': False, 'project_id': '8298da14cfd743539e6421d8f00a3366'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:23:05.435541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b685850b-09cc-40f3-8553-94955cc9a6bf tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.436002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b685850b-09cc-40f3-8553-94955cc9a6bf tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.436980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b685850b-09cc-40f3-8553-94955cc9a6bf tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.437417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b685850b-09cc-40f3-8553-94955cc9a6bf tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.471025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-b685850b-09cc-40f3-8553-94955cc9a6bf tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:23:05.504827 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b685850b-09cc-40f3-8553-94955cc9a6bf tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.085933 Jul 20 04:23:05.505617 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1562/3062] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 04:23:05 2022] GET /compute/v2.1/servers => generated 343 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:23:05.516828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c345c7c-95b6-44dd-9c2b-4ea578c50e02 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:05.520742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0c345c7c-95b6-44dd-9c2b-4ea578c50e02 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.521057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-58ca1a0e-c531-4572-adc8-bbd3b5ed0e2e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.521682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0c345c7c-95b6-44dd-9c2b-4ea578c50e02 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Searching by: {'deleted': False, 'project_id': '8298da14cfd743539e6421d8f00a3366'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:23:05.527827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c345c7c-95b6-44dd-9c2b-4ea578c50e02 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.528283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c345c7c-95b6-44dd-9c2b-4ea578c50e02 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.529084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c345c7c-95b6-44dd-9c2b-4ea578c50e02 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.529524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c345c7c-95b6-44dd-9c2b-4ea578c50e02 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.530488 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-58ca1a0e-c531-4572-adc8-bbd3b5ed0e2e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1521 microversion: 2.1 time: 0.195358 Jul 20 04:23:05.531244 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1501/3063] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:05 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:05.558207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-0c345c7c-95b6-44dd-9c2b-4ea578c50e02 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:23:05.593896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0c345c7c-95b6-44dd-9c2b-4ea578c50e02 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.601064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c345c7c-95b6-44dd-9c2b-4ea578c50e02 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.601557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c345c7c-95b6-44dd-9c2b-4ea578c50e02 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.706819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-820e8790-6e48-49b7-b214-376ee47926e0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:05.708834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-820e8790-6e48-49b7-b214-376ee47926e0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:05.716161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-820e8790-6e48-49b7-b214-376ee47926e0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.716724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-820e8790-6e48-49b7-b214-376ee47926e0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.717599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-820e8790-6e48-49b7-b214-376ee47926e0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.718047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-820e8790-6e48-49b7-b214-376ee47926e0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.727000 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0c345c7c-95b6-44dd-9c2b-4ea578c50e02 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.214020 Jul 20 04:23:05.728142 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1563/3064] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:23:05 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:05.746697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c1ea1a93-f4bc-48e5-a06d-ef9c8d50d22f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:05.755671 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c1ea1a93-f4bc-48e5-a06d-ef9c8d50d22f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012829 Jul 20 04:23:05.756281 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1564/3065] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:23:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:23:05.767230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-af38d81f-a4ee-4d20-b8a4-de8b716aa3f4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:05.767770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-af38d81f-a4ee-4d20-b8a4-de8b716aa3f4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:05.771496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:05.775370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af38d81f-a4ee-4d20-b8a4-de8b716aa3f4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.775852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af38d81f-a4ee-4d20-b8a4-de8b716aa3f4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.776641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af38d81f-a4ee-4d20-b8a4-de8b716aa3f4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:05.777084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af38d81f-a4ee-4d20-b8a4-de8b716aa3f4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.859669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af38d81f-a4ee-4d20-b8a4-de8b716aa3f4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.868224 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-af38d81f-a4ee-4d20-b8a4-de8b716aa3f4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1277 microversion: 2.1 time: 0.105222 Jul 20 04:23:05.868819 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1565/3066] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:05 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:05.897593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-820e8790-6e48-49b7-b214-376ee47926e0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.901509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:05.908960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-820e8790-6e48-49b7-b214-376ee47926e0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.911333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-820e8790-6e48-49b7-b214-376ee47926e0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.912814 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-820e8790-6e48-49b7-b214-376ee47926e0 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.210527 Jul 20 04:23:05.913504 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1502/3067] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:05 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:06.264823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-de260911-658a-470e-b58a-9e5f05137000 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.265588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-de260911-658a-470e-b58a-9e5f05137000 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:06.273151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de260911-658a-470e-b58a-9e5f05137000 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.273609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de260911-658a-470e-b58a-9e5f05137000 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.274420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de260911-658a-470e-b58a-9e5f05137000 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.274878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de260911-658a-470e-b58a-9e5f05137000 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.416973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-de260911-658a-470e-b58a-9e5f05137000 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:06.424790 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-de260911-658a-470e-b58a-9e5f05137000 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1319 microversion: 2.1 time: 0.164140 Jul 20 04:23:06.425510 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1566/3068] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:06 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:06.548009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e51aed05-3409-4fff-8fba-a9a91bb3d1cc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.548678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e51aed05-3409-4fff-8fba-a9a91bb3d1cc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:06.549324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c8f6d5c2-3b76-4f73-abf0-4ef2ae9d1b1c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.550031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c8f6d5c2-3b76-4f73-abf0-4ef2ae9d1b1c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:06.556119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e51aed05-3409-4fff-8fba-a9a91bb3d1cc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.556680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e51aed05-3409-4fff-8fba-a9a91bb3d1cc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.557459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8f6d5c2-3b76-4f73-abf0-4ef2ae9d1b1c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.557617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e51aed05-3409-4fff-8fba-a9a91bb3d1cc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.558101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8f6d5c2-3b76-4f73-abf0-4ef2ae9d1b1c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.558213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e51aed05-3409-4fff-8fba-a9a91bb3d1cc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.559005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8f6d5c2-3b76-4f73-abf0-4ef2ae9d1b1c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.559534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8f6d5c2-3b76-4f73-abf0-4ef2ae9d1b1c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.586772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e51aed05-3409-4fff-8fba-a9a91bb3d1cc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:06.693384 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e51aed05-3409-4fff-8fba-a9a91bb3d1cc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 204 len: 0 microversion: 2.1 time: 0.147854 Jul 20 04:23:06.694456 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1503/3069] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:06 2022] DELETE /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:06.702970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dbc46056-ccc8-4af2-9364-5cb86f12b32e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.704055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dbc46056-ccc8-4af2-9364-5cb86f12b32e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:06.710600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbc46056-ccc8-4af2-9364-5cb86f12b32e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.711244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbc46056-ccc8-4af2-9364-5cb86f12b32e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.711621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbc46056-ccc8-4af2-9364-5cb86f12b32e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.712068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbc46056-ccc8-4af2-9364-5cb86f12b32e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.731214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c8f6d5c2-3b76-4f73-abf0-4ef2ae9d1b1c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:06.734838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:06.740589 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c8f6d5c2-3b76-4f73-abf0-4ef2ae9d1b1c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1501 microversion: 2.1 time: 0.195388 Jul 20 04:23:06.741520 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1567/3070] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:06 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:06.757442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f55bf561-f149-4275-83c2-89d7aa1d6bef tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.758061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f55bf561-f149-4275-83c2-89d7aa1d6bef tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:06.766397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f55bf561-f149-4275-83c2-89d7aa1d6bef tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.766859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f55bf561-f149-4275-83c2-89d7aa1d6bef tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.767661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f55bf561-f149-4275-83c2-89d7aa1d6bef tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.768101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f55bf561-f149-4275-83c2-89d7aa1d6bef tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.920072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dbc46056-ccc8-4af2-9364-5cb86f12b32e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:06.932064 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dbc46056-ccc8-4af2-9364-5cb86f12b32e tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1606 microversion: 2.1 time: 0.233049 Jul 20 04:23:06.934784 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1504/3071] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:06 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1606 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:06.938158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a789939a-178a-49e2-b2b5-ecf77a7c4740 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.938900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a789939a-178a-49e2-b2b5-ecf77a7c4740 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:06.947992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a789939a-178a-49e2-b2b5-ecf77a7c4740 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.948589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a789939a-178a-49e2-b2b5-ecf77a7c4740 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.949665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a789939a-178a-49e2-b2b5-ecf77a7c4740 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.950256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a789939a-178a-49e2-b2b5-ecf77a7c4740 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.952013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f55bf561-f149-4275-83c2-89d7aa1d6bef tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:06.965488 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f55bf561-f149-4275-83c2-89d7aa1d6bef tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1515 microversion: 2.1 time: 0.211432 Jul 20 04:23:06.966125 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1568/3072] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:06 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1515 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:06.971662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bc7871f8-ab17-48ff-afe4-019a0ad892dc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.972972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bc7871f8-ab17-48ff-afe4-019a0ad892dc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:06.983825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc7871f8-ab17-48ff-afe4-019a0ad892dc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.985395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc7871f8-ab17-48ff-afe4-019a0ad892dc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.987073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc7871f8-ab17-48ff-afe4-019a0ad892dc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.988811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc7871f8-ab17-48ff-afe4-019a0ad892dc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.041966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a789939a-178a-49e2-b2b5-ecf77a7c4740 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:07.051895 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a789939a-178a-49e2-b2b5-ecf77a7c4740 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1277 microversion: 2.1 time: 0.117502 Jul 20 04:23:07.061408 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1505/3073] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:06 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:07.061408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6bc95a3c-a30d-43fd-acf1-d038389b6b2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:07.061408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6bc95a3c-a30d-43fd-acf1-d038389b6b2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 33929962-d675-4f42-bd4b-0e6a2ed00cd1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:07.065679 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-6bc95a3c-a30d-43fd-acf1-d038389b6b2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] HTTP exception thrown: Instance 33929962-d675-4f42-bd4b-0e6a2ed00cd1 could not be found. Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6bc95a3c-a30d-43fd-acf1-d038389b6b2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Request method failure captured: Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/33929962-d675-4f42-bd4b-0e6a2ed00cd1/action HTTP/1.1 Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 14 Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14LpvtEmNd4QrXIrUEvb-GSk-Q8Zjd0l-zF-kIlevLuoBgLZ_00_u1yvp6j7dRA_htG5kpVqZoVpEsFwn0RHk_cOjeEIbaoK3R2iKcoauuThhWzyvVf6At0QhXQxlwDjTmkqLnzcd5YkB5Z5aPRc9SOgHjbdPHPXD-aflxJrD9yhloY Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ba21f0dfdc04e41a9a30fa3dddf3e90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}] Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a25a4e3b560846ec98b871b954481f09 Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: {"rescue": {}} Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 33929962-d675-4f42-bd4b-0e6a2ed00cd1 could not be found. Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '33929962-d675-4f42-bd4b-0e6a2ed00cd1', 'body': {'rescue': {}}} Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33929962-d675-4f42-bd4b-0e6a2ed00cd1 could not be found. Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33929962-d675-4f42-bd4b-0e6a2ed00cd1 could not be found. Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:07.074087 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:07.078869 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:07.078869 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:07.078869 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:07.078869 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:07.078869 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33929962-d675-4f42-bd4b-0e6a2ed00cd1 could not be found. Jul 20 04:23:07.078869 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:07.078869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6bc95a3c-a30d-43fd-acf1-d038389b6b2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Returning 404 to user: Instance 33929962-d675-4f42-bd4b-0e6a2ed00cd1 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:07.078869 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6bc95a3c-a30d-43fd-acf1-d038389b6b2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/33929962-d675-4f42-bd4b-0e6a2ed00cd1/action" status: 404 len: 111 microversion: 2.1 time: 0.021881 Jul 20 04:23:07.078869 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1506/3074] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:07 2022] POST /compute/v2.1/servers/33929962-d675-4f42-bd4b-0e6a2ed00cd1/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:07.088566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-abec2762-6498-42a8-b81b-314d580811f8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:07.089147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-abec2762-6498-42a8-b81b-314d580811f8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:07.098571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abec2762-6498-42a8-b81b-314d580811f8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.099160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abec2762-6498-42a8-b81b-314d580811f8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.100229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abec2762-6498-42a8-b81b-314d580811f8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.100816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abec2762-6498-42a8-b81b-314d580811f8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.172446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bc7871f8-ab17-48ff-afe4-019a0ad892dc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:07.193456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bc7871f8-ab17-48ff-afe4-019a0ad892dc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:07.195500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bc7871f8-ab17-48ff-afe4-019a0ad892dc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:07.197275 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bc7871f8-ab17-48ff-afe4-019a0ad892dc tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.229609 Jul 20 04:23:07.198050 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1569/3075] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:06 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:07.200311 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-abec2762-6498-42a8-b81b-314d580811f8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/action" status: 202 len: 0 microversion: 2.1 time: 0.116735 Jul 20 04:23:07.204209 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1507/3076] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:07 2022] POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:23:07.214894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1d0d31aa-a14d-4437-8cde-f106f8a444e5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:07.215862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1d0d31aa-a14d-4437-8cde-f106f8a444e5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:07.226290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d0d31aa-a14d-4437-8cde-f106f8a444e5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.227064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d0d31aa-a14d-4437-8cde-f106f8a444e5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.228080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d0d31aa-a14d-4437-8cde-f106f8a444e5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.228691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d0d31aa-a14d-4437-8cde-f106f8a444e5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.318346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-54a9883b-a974-471d-86fc-fbba9ea6748b req-4b77e78a-e252-4473-a806-f8f39c7a920d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d992ed51-bb47-460f-a825-bd45481d157e", "name": "network-vif-plugged", "status": "completed", "tag": "9cdfc191-27d5-4577-b743-484e29c410e4"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:07.328822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-54a9883b-a974-471d-86fc-fbba9ea6748b req-4b77e78a-e252-4473-a806-f8f39c7a920d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.330186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-54a9883b-a974-471d-86fc-fbba9ea6748b req-4b77e78a-e252-4473-a806-f8f39c7a920d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.345829 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-54a9883b-a974-471d-86fc-fbba9ea6748b req-4b77e78a-e252-4473-a806-f8f39c7a920d service nova] Creating event network-vif-plugged:9cdfc191-27d5-4577-b743-484e29c410e4 for instance d992ed51-bb47-460f-a825-bd45481d157e on n-h2-764485-11 Jul 20 04:23:07.352299 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-54a9883b-a974-471d-86fc-fbba9ea6748b req-4b77e78a-e252-4473-a806-f8f39c7a920d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040208 Jul 20 04:23:07.353392 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1508/3077] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:07.418229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1d0d31aa-a14d-4437-8cde-f106f8a444e5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:07.428426 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1d0d31aa-a14d-4437-8cde-f106f8a444e5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1520 microversion: 2.1 time: 0.222193 Jul 20 04:23:07.428953 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1570/3078] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:07 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:07.446471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1a7313ee-ae7e-4bfa-b533-854f83e31152 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:07.447476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1a7313ee-ae7e-4bfa-b533-854f83e31152 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:07.455039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a7313ee-ae7e-4bfa-b533-854f83e31152 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.455498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a7313ee-ae7e-4bfa-b533-854f83e31152 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.456392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a7313ee-ae7e-4bfa-b533-854f83e31152 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.457628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a7313ee-ae7e-4bfa-b533-854f83e31152 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.611533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1a7313ee-ae7e-4bfa-b533-854f83e31152 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:07.620255 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1a7313ee-ae7e-4bfa-b533-854f83e31152 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1319 microversion: 2.1 time: 0.179124 Jul 20 04:23:07.621140 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1509/3079] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:07 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:07.950590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc0e00c8-4e1d-4f33-8e9b-3f4e48de078b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:07.951310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc0e00c8-4e1d-4f33-8e9b-3f4e48de078b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:07.960104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc0e00c8-4e1d-4f33-8e9b-3f4e48de078b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.960704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc0e00c8-4e1d-4f33-8e9b-3f4e48de078b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.961529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc0e00c8-4e1d-4f33-8e9b-3f4e48de078b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.961983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc0e00c8-4e1d-4f33-8e9b-3f4e48de078b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.071831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96d66762-9092-4df4-b9be-aad1eee58398 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:08.072516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96d66762-9092-4df4-b9be-aad1eee58398 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:08.079621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96d66762-9092-4df4-b9be-aad1eee58398 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.080088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96d66762-9092-4df4-b9be-aad1eee58398 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.080871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96d66762-9092-4df4-b9be-aad1eee58398 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.081317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96d66762-9092-4df4-b9be-aad1eee58398 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.110197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cc0e00c8-4e1d-4f33-8e9b-3f4e48de078b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:08.120511 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cc0e00c8-4e1d-4f33-8e9b-3f4e48de078b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1606 microversion: 2.1 time: 0.174245 Jul 20 04:23:08.121348 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1571/3080] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:07 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1606 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:08.151906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-96d66762-9092-4df4-b9be-aad1eee58398 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:08.159919 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-96d66762-9092-4df4-b9be-aad1eee58398 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1287 microversion: 2.1 time: 0.093603 Jul 20 04:23:08.160615 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1510/3081] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:08 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:08.217714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d1f7b2be-15a8-4c9c-9322-ad2f3f7c8636 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:08.218365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d1f7b2be-15a8-4c9c-9322-ad2f3f7c8636 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:08.224912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1f7b2be-15a8-4c9c-9322-ad2f3f7c8636 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.225364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1f7b2be-15a8-4c9c-9322-ad2f3f7c8636 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.226137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1f7b2be-15a8-4c9c-9322-ad2f3f7c8636 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.226580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1f7b2be-15a8-4c9c-9322-ad2f3f7c8636 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.386806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d1f7b2be-15a8-4c9c-9322-ad2f3f7c8636 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:08.394851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d1f7b2be-15a8-4c9c-9322-ad2f3f7c8636 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:08.396361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d1f7b2be-15a8-4c9c-9322-ad2f3f7c8636 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:08.397510 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d1f7b2be-15a8-4c9c-9322-ad2f3f7c8636 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.184135 Jul 20 04:23:08.398086 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1572/3082] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:08 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:08.447803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6111fb5-3151-487b-abd9-c0713d10da2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:08.448425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a6111fb5-3151-487b-abd9-c0713d10da2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:08.454459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6111fb5-3151-487b-abd9-c0713d10da2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.454906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6111fb5-3151-487b-abd9-c0713d10da2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.455695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6111fb5-3151-487b-abd9-c0713d10da2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.456135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6111fb5-3151-487b-abd9-c0713d10da2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.596211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a6111fb5-3151-487b-abd9-c0713d10da2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:08.607675 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a6111fb5-3151-487b-abd9-c0713d10da2b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1520 microversion: 2.1 time: 0.163683 Jul 20 04:23:08.608279 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1511/3083] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:08 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:08.638460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ffccce4-0dac-4501-a652-c1e4bd991a12 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:08.639199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8ffccce4-0dac-4501-a652-c1e4bd991a12 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:08.646439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ffccce4-0dac-4501-a652-c1e4bd991a12 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.646888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ffccce4-0dac-4501-a652-c1e4bd991a12 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.647707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ffccce4-0dac-4501-a652-c1e4bd991a12 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.648144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ffccce4-0dac-4501-a652-c1e4bd991a12 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.797993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8ffccce4-0dac-4501-a652-c1e4bd991a12 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:08.807012 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8ffccce4-0dac-4501-a652-c1e4bd991a12 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1319 microversion: 2.1 time: 0.172446 Jul 20 04:23:08.807646 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1573/3084] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:08 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:09.138464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3bd99d67-9965-45c1-8e5b-f1a1c51adbad tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:09.140028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3bd99d67-9965-45c1-8e5b-f1a1c51adbad tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:09.148418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3bd99d67-9965-45c1-8e5b-f1a1c51adbad tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.149180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3bd99d67-9965-45c1-8e5b-f1a1c51adbad tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.150425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3bd99d67-9965-45c1-8e5b-f1a1c51adbad tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.151059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3bd99d67-9965-45c1-8e5b-f1a1c51adbad tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.178070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ea1298b5-e189-4098-9f36-7c6e96efe7f5 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:09.179347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ea1298b5-e189-4098-9f36-7c6e96efe7f5 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:09.202774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea1298b5-e189-4098-9f36-7c6e96efe7f5 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.205686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea1298b5-e189-4098-9f36-7c6e96efe7f5 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.207297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea1298b5-e189-4098-9f36-7c6e96efe7f5 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.209721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea1298b5-e189-4098-9f36-7c6e96efe7f5 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.340649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ea1298b5-e189-4098-9f36-7c6e96efe7f5 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.356466 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ea1298b5-e189-4098-9f36-7c6e96efe7f5 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1275 microversion: 2.1 time: 0.183035 Jul 20 04:23:09.357956 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1574/3085] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:09 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:09.417725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-50b22d91-e64a-462b-b776-819b3e39b3b7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:09.418360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-50b22d91-e64a-462b-b776-819b3e39b3b7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:09.428938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50b22d91-e64a-462b-b776-819b3e39b3b7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.431479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50b22d91-e64a-462b-b776-819b3e39b3b7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.434323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50b22d91-e64a-462b-b776-819b3e39b3b7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.434775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50b22d91-e64a-462b-b776-819b3e39b3b7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.527555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3bd99d67-9965-45c1-8e5b-f1a1c51adbad tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.535538 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3bd99d67-9965-45c1-8e5b-f1a1c51adbad tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1606 microversion: 2.1 time: 0.400692 Jul 20 04:23:09.537483 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1512/3086] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:09 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1606 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:09.627835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-81e3dd9a-c1ee-43ea-8af4-5a45d421ad4e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:09.629467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-81e3dd9a-c1ee-43ea-8af4-5a45d421ad4e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:09.637901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81e3dd9a-c1ee-43ea-8af4-5a45d421ad4e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.638689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81e3dd9a-c1ee-43ea-8af4-5a45d421ad4e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.639844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81e3dd9a-c1ee-43ea-8af4-5a45d421ad4e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.641347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81e3dd9a-c1ee-43ea-8af4-5a45d421ad4e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.801798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-50b22d91-e64a-462b-b776-819b3e39b3b7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.811663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-50b22d91-e64a-462b-b776-819b3e39b3b7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.813331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-50b22d91-e64a-462b-b776-819b3e39b3b7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.814728 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-50b22d91-e64a-462b-b776-819b3e39b3b7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.402261 Jul 20 04:23:09.816551 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1575/3087] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:09 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:09.826035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f11c6d67-76b9-4798-866d-13e2df8eca3c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:09.827752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f11c6d67-76b9-4798-866d-13e2df8eca3c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:09.835632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f11c6d67-76b9-4798-866d-13e2df8eca3c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.836326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f11c6d67-76b9-4798-866d-13e2df8eca3c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.837218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f11c6d67-76b9-4798-866d-13e2df8eca3c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.838146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f11c6d67-76b9-4798-866d-13e2df8eca3c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.966399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-81e3dd9a-c1ee-43ea-8af4-5a45d421ad4e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.976888 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-81e3dd9a-c1ee-43ea-8af4-5a45d421ad4e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1500 microversion: 2.1 time: 0.354036 Jul 20 04:23:09.977488 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1513/3088] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:09 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1500 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:09.995332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c362e4a0-e98a-420e-b33b-2879b0c30553 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:09.996661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c362e4a0-e98a-420e-b33b-2879b0c30553 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:10.003108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c362e4a0-e98a-420e-b33b-2879b0c30553 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.004075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c362e4a0-e98a-420e-b33b-2879b0c30553 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.004870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c362e4a0-e98a-420e-b33b-2879b0c30553 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.005315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c362e4a0-e98a-420e-b33b-2879b0c30553 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.029289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-c362e4a0-e98a-420e-b33b-2879b0c30553 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lazy-loading 'flavor' on Instance uuid c9c53e05-cfbb-479b-80a3-6a17db52e44f {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:10.041727 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-c362e4a0-e98a-420e-b33b-2879b0c30553 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] HTTP exception thrown: Cannot 'rescue' instance c9c53e05-cfbb-479b-80a3-6a17db52e44f while it is in vm_state paused Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c362e4a0-e98a-420e-b33b-2879b0c30553 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Request method failure captured: Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/action HTTP/1.1 Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 14 Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14LpvtEmNd4QrXIrUEvb-GSk-Q8Zjd0l-zF-kIlevLuoBgLZ_00_u1yvp6j7dRA_htG5kpVqZoVpEsFwn0RHk_cOjeEIbaoK3R2iKcoauuThhWzyvVf6At0QhXQxlwDjTmkqLnzcd5YkB5Z5aPRc9SOgHjbdPHPXD-aflxJrD9yhloY Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ba21f0dfdc04e41a9a30fa3dddf3e90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}] Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a25a4e3b560846ec98b871b954481f09 Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: {"rescue": {}} Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: exception: Cannot 'rescue' instance c9c53e05-cfbb-479b-80a3-6a17db52e44f while it is in vm_state paused Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'c9c53e05-cfbb-479b-80a3-6a17db52e44f', 'body': {'rescue': {}}} Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9c53e05-cfbb-479b-80a3-6a17db52e44f in vm_state paused. Cannot rescue while the instance is in this state. Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance c9c53e05-cfbb-479b-80a3-6a17db52e44f while it is in vm_state paused Jul 20 04:23:10.043459 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:10.048041 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:10.048041 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:10.048041 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:10.048041 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:10.048041 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:10.048041 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:10.048041 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:10.048041 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance c9c53e05-cfbb-479b-80a3-6a17db52e44f while it is in vm_state paused Jul 20 04:23:10.048041 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:10.048041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c362e4a0-e98a-420e-b33b-2879b0c30553 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Returning 409 to user: Cannot 'rescue' instance c9c53e05-cfbb-479b-80a3-6a17db52e44f while it is in vm_state paused {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:10.048041 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c362e4a0-e98a-420e-b33b-2879b0c30553 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/action" status: 409 len: 144 microversion: 2.1 time: 0.053664 Jul 20 04:23:10.048041 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1514/3089] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:09 2022] POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/action => generated 144 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:23:10.053686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-778ba0d0-a680-409b-9ce5-a2135e67cf30 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:10.054213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-778ba0d0-a680-409b-9ce5-a2135e67cf30 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:10.060266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-778ba0d0-a680-409b-9ce5-a2135e67cf30 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.060716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-778ba0d0-a680-409b-9ce5-a2135e67cf30 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.061482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-778ba0d0-a680-409b-9ce5-a2135e67cf30 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.061915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-778ba0d0-a680-409b-9ce5-a2135e67cf30 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.092208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f11c6d67-76b9-4798-866d-13e2df8eca3c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:10.105951 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f11c6d67-76b9-4798-866d-13e2df8eca3c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1319 microversion: 2.1 time: 0.285232 Jul 20 04:23:10.107104 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1576/3090] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:09 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:10.147851 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-778ba0d0-a680-409b-9ce5-a2135e67cf30 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/action" status: 202 len: 0 microversion: 2.1 time: 0.097694 Jul 20 04:23:10.148860 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1515/3091] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:10 2022] POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:23:10.156873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3509a68d-e627-4672-88c4-3baf36e66fee tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:10.157501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3509a68d-e627-4672-88c4-3baf36e66fee tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:10.164296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3509a68d-e627-4672-88c4-3baf36e66fee tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.164756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3509a68d-e627-4672-88c4-3baf36e66fee tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.165546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3509a68d-e627-4672-88c4-3baf36e66fee tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.165989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3509a68d-e627-4672-88c4-3baf36e66fee tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.377700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-88e0b772-71da-4f19-94b8-5a2813bb906e tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:10.379258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-88e0b772-71da-4f19-94b8-5a2813bb906e tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:10.386264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88e0b772-71da-4f19-94b8-5a2813bb906e tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.386747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88e0b772-71da-4f19-94b8-5a2813bb906e tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.387546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88e0b772-71da-4f19-94b8-5a2813bb906e tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.387987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88e0b772-71da-4f19-94b8-5a2813bb906e tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.541694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-88e0b772-71da-4f19-94b8-5a2813bb906e tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:10.549664 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-88e0b772-71da-4f19-94b8-5a2813bb906e tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1275 microversion: 2.1 time: 0.177170 Jul 20 04:23:10.559946 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1516/3092] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:10 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:10.564814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6e9c685-eed3-4d62-bce9-ee016e48e7d9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:10.565434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e6e9c685-eed3-4d62-bce9-ee016e48e7d9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:10.573836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6e9c685-eed3-4d62-bce9-ee016e48e7d9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.574461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6e9c685-eed3-4d62-bce9-ee016e48e7d9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.575233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6e9c685-eed3-4d62-bce9-ee016e48e7d9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.575708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6e9c685-eed3-4d62-bce9-ee016e48e7d9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.594732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:10.683732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3509a68d-e627-4672-88c4-3baf36e66fee tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:10.691802 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3509a68d-e627-4672-88c4-3baf36e66fee tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1507 microversion: 2.1 time: 0.538820 Jul 20 04:23:10.692680 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1577/3093] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:10 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1507 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:10.834790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8d86989d-4bb1-438c-8156-f23e07c9a6c2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:10.835426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8d86989d-4bb1-438c-8156-f23e07c9a6c2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:10.841965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d86989d-4bb1-438c-8156-f23e07c9a6c2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.842422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d86989d-4bb1-438c-8156-f23e07c9a6c2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.843206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d86989d-4bb1-438c-8156-f23e07c9a6c2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.843709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d86989d-4bb1-438c-8156-f23e07c9a6c2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.857347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e6e9c685-eed3-4d62-bce9-ee016e48e7d9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:10.873351 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e6e9c685-eed3-4d62-bce9-ee016e48e7d9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1606 microversion: 2.1 time: 0.312048 Jul 20 04:23:10.887642 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1517/3094] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:10 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1606 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:11.075312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8d86989d-4bb1-438c-8156-f23e07c9a6c2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:11.090697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8d86989d-4bb1-438c-8156-f23e07c9a6c2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:11.092622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8d86989d-4bb1-438c-8156-f23e07c9a6c2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:11.093993 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8d86989d-4bb1-438c-8156-f23e07c9a6c2 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.263544 Jul 20 04:23:11.095077 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1578/3095] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:10 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:11.123730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-57f16fdd-780b-4f3d-a169-6ca205df8626 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:11.124350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-57f16fdd-780b-4f3d-a169-6ca205df8626 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:11.135400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57f16fdd-780b-4f3d-a169-6ca205df8626 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.135891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57f16fdd-780b-4f3d-a169-6ca205df8626 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.140196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57f16fdd-780b-4f3d-a169-6ca205df8626 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.140646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57f16fdd-780b-4f3d-a169-6ca205df8626 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.303759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-57f16fdd-780b-4f3d-a169-6ca205df8626 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:11.313743 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-57f16fdd-780b-4f3d-a169-6ca205df8626 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1319 microversion: 2.1 time: 0.193978 Jul 20 04:23:11.314620 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1518/3096] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:11 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:11.391492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-bcf1de8e-73db-4fa4-8078-13233f42b062 req-3cc98641-c3c1-479c-a253-3f391419a16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ef6d1f-97e0-42a5-b324-a6a7dffd4682", "name": "network-vif-plugged", "status": "completed", "tag": "39050e91-cd0e-403c-8984-5646457d2de5"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:11.403250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-bcf1de8e-73db-4fa4-8078-13233f42b062 req-3cc98641-c3c1-479c-a253-3f391419a16b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.403735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-bcf1de8e-73db-4fa4-8078-13233f42b062 req-3cc98641-c3c1-479c-a253-3f391419a16b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.417111 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-bcf1de8e-73db-4fa4-8078-13233f42b062 req-3cc98641-c3c1-479c-a253-3f391419a16b service nova] Creating event network-vif-plugged:39050e91-cd0e-403c-8984-5646457d2de5 for instance a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 on n-h2-764485-11 Jul 20 04:23:11.423162 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-bcf1de8e-73db-4fa4-8078-13233f42b062 req-3cc98641-c3c1-479c-a253-3f391419a16b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035567 Jul 20 04:23:11.428279 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1579/3097] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:11.569361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc9ceead-dab0-4912-a6cd-463d5b0c19d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:11.570211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc9ceead-dab0-4912-a6cd-463d5b0c19d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:11.577426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc9ceead-dab0-4912-a6cd-463d5b0c19d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.577877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc9ceead-dab0-4912-a6cd-463d5b0c19d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.578652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc9ceead-dab0-4912-a6cd-463d5b0c19d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.579123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc9ceead-dab0-4912-a6cd-463d5b0c19d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.723446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21fb679f-41bf-456b-83f7-111d0b6078b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:11.725938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21fb679f-41bf-456b-83f7-111d0b6078b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:11.750439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21fb679f-41bf-456b-83f7-111d0b6078b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.752762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21fb679f-41bf-456b-83f7-111d0b6078b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.754414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21fb679f-41bf-456b-83f7-111d0b6078b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.755412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21fb679f-41bf-456b-83f7-111d0b6078b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.993247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fc9ceead-dab0-4912-a6cd-463d5b0c19d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:12.003026 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc9ceead-dab0-4912-a6cd-463d5b0c19d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1317 microversion: 2.1 time: 0.438339 Jul 20 04:23:12.006645 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1519/3098] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:11 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:12.011388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f57e2a0a-40e6-4aff-b2d5-13d9c14d8862 req-480d303e-6fed-4cc1-ba68-c9ed16782805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48fbccd-a6bb-42bd-8472-a224bb30c0b0", "name": "network-vif-deleted", "tag": "567b5770-118a-4239-8f7a-d878b7417a17"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:12.025336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f57e2a0a-40e6-4aff-b2d5-13d9c14d8862 req-480d303e-6fed-4cc1-ba68-c9ed16782805 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.026225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f57e2a0a-40e6-4aff-b2d5-13d9c14d8862 req-480d303e-6fed-4cc1-ba68-c9ed16782805 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.039581 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f57e2a0a-40e6-4aff-b2d5-13d9c14d8862 req-480d303e-6fed-4cc1-ba68-c9ed16782805 service nova] Creating event network-vif-deleted:567b5770-118a-4239-8f7a-d878b7417a17 for instance c48fbccd-a6bb-42bd-8472-a224bb30c0b0 on n-h2-764485-11 Jul 20 04:23:12.045833 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f57e2a0a-40e6-4aff-b2d5-13d9c14d8862 req-480d303e-6fed-4cc1-ba68-c9ed16782805 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037869 Jul 20 04:23:12.046670 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1520/3099] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:12.054223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-53c9dd0c-bf82-4506-a438-8f12e64ec74f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:12.055381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-53c9dd0c-bf82-4506-a438-8f12e64ec74f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:12.064230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53c9dd0c-bf82-4506-a438-8f12e64ec74f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.068816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53c9dd0c-bf82-4506-a438-8f12e64ec74f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.069908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53c9dd0c-bf82-4506-a438-8f12e64ec74f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.070518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53c9dd0c-bf82-4506-a438-8f12e64ec74f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.248046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-21fb679f-41bf-456b-83f7-111d0b6078b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:12.260840 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21fb679f-41bf-456b-83f7-111d0b6078b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1507 microversion: 2.1 time: 0.553971 Jul 20 04:23:12.262679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:12.268509 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1580/3100] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:11 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1507 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:12.276403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-53c9dd0c-bf82-4506-a438-8f12e64ec74f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:12.287502 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-53c9dd0c-bf82-4506-a438-8f12e64ec74f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1538 microversion: 2.1 time: 0.237037 Jul 20 04:23:12.288974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-caf64030-29e3-488b-9d18-918839231461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:12.289403 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1521/3101] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:12 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1538 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:12.290124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-caf64030-29e3-488b-9d18-918839231461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:12.297139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caf64030-29e3-488b-9d18-918839231461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.297889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caf64030-29e3-488b-9d18-918839231461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.298925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caf64030-29e3-488b-9d18-918839231461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.299779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caf64030-29e3-488b-9d18-918839231461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.332579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-175bcd5d-8c95-485b-b444-fb92236fb89a tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:12.333516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-175bcd5d-8c95-485b-b444-fb92236fb89a tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:12.342090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-175bcd5d-8c95-485b-b444-fb92236fb89a tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.342594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-175bcd5d-8c95-485b-b444-fb92236fb89a tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.343614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-175bcd5d-8c95-485b-b444-fb92236fb89a tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.344980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-175bcd5d-8c95-485b-b444-fb92236fb89a tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.448039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=16 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:12.861450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-175bcd5d-8c95-485b-b444-fb92236fb89a tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:12.874399 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-175bcd5d-8c95-485b-b444-fb92236fb89a tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1319 microversion: 2.1 time: 0.546787 Jul 20 04:23:12.876541 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1522/3102] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:12 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:12.901248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-caf64030-29e3-488b-9d18-918839231461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:12.915699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-caf64030-29e3-488b-9d18-918839231461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:12.917796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-caf64030-29e3-488b-9d18-918839231461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:12.920087 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-caf64030-29e3-488b-9d18-918839231461 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.649141 Jul 20 04:23:12.921218 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1581/3103] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:12 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:13.032803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5e8b62ac-d668-47a4-b731-bf8f8082621a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:13.036086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5e8b62ac-d668-47a4-b731-bf8f8082621a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:13.040485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:13.046608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e8b62ac-d668-47a4-b731-bf8f8082621a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:13.047410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e8b62ac-d668-47a4-b731-bf8f8082621a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:13.048425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e8b62ac-d668-47a4-b731-bf8f8082621a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:13.050894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e8b62ac-d668-47a4-b731-bf8f8082621a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:13.290144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c4b85eda-0fbe-4aee-b7c6-bcc1e077e602 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:13.290993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c4b85eda-0fbe-4aee-b7c6-bcc1e077e602 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:13.307154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b85eda-0fbe-4aee-b7c6-bcc1e077e602 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:13.309733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b85eda-0fbe-4aee-b7c6-bcc1e077e602 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:13.310654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b85eda-0fbe-4aee-b7c6-bcc1e077e602 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:13.311106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b85eda-0fbe-4aee-b7c6-bcc1e077e602 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:13.699317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5e8b62ac-d668-47a4-b731-bf8f8082621a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:13.747219 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5e8b62ac-d668-47a4-b731-bf8f8082621a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1317 microversion: 2.1 time: 0.721198 Jul 20 04:23:13.761035 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1523/3104] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:13 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1317 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:13.790799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5979fa6c-f0a8-4c79-840c-c25bd2b1f6f7 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:13.791118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5979fa6c-f0a8-4c79-840c-c25bd2b1f6f7 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:13.821942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5979fa6c-f0a8-4c79-840c-c25bd2b1f6f7 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:13.828517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5979fa6c-f0a8-4c79-840c-c25bd2b1f6f7 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:13.829940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5979fa6c-f0a8-4c79-840c-c25bd2b1f6f7 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:13.830391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5979fa6c-f0a8-4c79-840c-c25bd2b1f6f7 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.009221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5979fa6c-f0a8-4c79-840c-c25bd2b1f6f7 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.017614 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5979fa6c-f0a8-4c79-840c-c25bd2b1f6f7 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1250 microversion: 2.1 time: 0.252439 Jul 20 04:23:14.018224 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1524/3105] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:13 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1250 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:14.018344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c4b85eda-0fbe-4aee-b7c6-bcc1e077e602 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.040056 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c4b85eda-0fbe-4aee-b7c6-bcc1e077e602 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1515 microversion: 2.1 time: 0.756397 Jul 20 04:23:14.041834 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1582/3106] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:13 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1515 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:14.048721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-19ca9ed8-769e-4b68-9baf-3c7d7d0d4df3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:14.049701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-19ca9ed8-769e-4b68-9baf-3c7d7d0d4df3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:14.056679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3557e799-51e8-4152-a286-12dd7bc10323 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:14.058438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3557e799-51e8-4152-a286-12dd7bc10323 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:14.064916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ca9ed8-769e-4b68-9baf-3c7d7d0d4df3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.066357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ca9ed8-769e-4b68-9baf-3c7d7d0d4df3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.067855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ca9ed8-769e-4b68-9baf-3c7d7d0d4df3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.068918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3557e799-51e8-4152-a286-12dd7bc10323 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.069157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ca9ed8-769e-4b68-9baf-3c7d7d0d4df3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.077969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3557e799-51e8-4152-a286-12dd7bc10323 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.082901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3557e799-51e8-4152-a286-12dd7bc10323 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.083326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3557e799-51e8-4152-a286-12dd7bc10323 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.604112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-19ca9ed8-769e-4b68-9baf-3c7d7d0d4df3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.635488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-19ca9ed8-769e-4b68-9baf-3c7d7d0d4df3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.658260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-19ca9ed8-769e-4b68-9baf-3c7d7d0d4df3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.661670 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-19ca9ed8-769e-4b68-9baf-3c7d7d0d4df3 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.618026 Jul 20 04:23:14.665582 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1583/3107] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:14 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:14.704597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-c3cd4c72-4bea-43f8-94bd-62532b3f94ba req-5ec07694-5eba-48fc-b013-b33fbf457f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588d4bae-3e12-4c79-81c7-b6223cb6dacc", "name": "network-vif-unplugged", "status": "completed", "tag": "5397e4d6-56be-4b85-aca3-b4aa19f1e755"}, {"name": "network-changed", "server_uuid": "588d4bae-3e12-4c79-81c7-b6223cb6dacc", "tag": "5397e4d6-56be-4b85-aca3-b4aa19f1e755"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:14.726031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c3cd4c72-4bea-43f8-94bd-62532b3f94ba req-5ec07694-5eba-48fc-b013-b33fbf457f96 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.726479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c3cd4c72-4bea-43f8-94bd-62532b3f94ba req-5ec07694-5eba-48fc-b013-b33fbf457f96 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.776920 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c3cd4c72-4bea-43f8-94bd-62532b3f94ba req-5ec07694-5eba-48fc-b013-b33fbf457f96 service nova] Creating event network-vif-unplugged:5397e4d6-56be-4b85-aca3-b4aa19f1e755 for instance 588d4bae-3e12-4c79-81c7-b6223cb6dacc on n-h1-764485-11 Jul 20 04:23:14.778177 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c3cd4c72-4bea-43f8-94bd-62532b3f94ba req-5ec07694-5eba-48fc-b013-b33fbf457f96 service nova] Creating event network-changed:5397e4d6-56be-4b85-aca3-b4aa19f1e755 for instance 588d4bae-3e12-4c79-81c7-b6223cb6dacc on n-h1-764485-11 Jul 20 04:23:14.799834 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-c3cd4c72-4bea-43f8-94bd-62532b3f94ba req-5ec07694-5eba-48fc-b013-b33fbf457f96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.117487 Jul 20 04:23:14.801070 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1584/3108] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:14.834886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d6404639-149e-4683-a80d-360a71eb397f tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:14.835652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d6404639-149e-4683-a80d-360a71eb397f tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:14.861453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6404639-149e-4683-a80d-360a71eb397f tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.861911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6404639-149e-4683-a80d-360a71eb397f tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.864291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6404639-149e-4683-a80d-360a71eb397f tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.864918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6404639-149e-4683-a80d-360a71eb397f tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.979629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3557e799-51e8-4152-a286-12dd7bc10323 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.993557 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3557e799-51e8-4152-a286-12dd7bc10323 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1319 microversion: 2.1 time: 0.974015 Jul 20 04:23:14.994554 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1525/3109] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:14 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1319 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:15.010070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-9e74b597-050c-4c51-a0bb-1e53e47f319b req-e60e1de5-a24a-4b61-97f6-4d3e2451e52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98588f3c-20c5-42a4-9f79-cf55750977d5", "tag": "2742784c-b94a-4677-bfd8-f7b559678bc9"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:15.024593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9e74b597-050c-4c51-a0bb-1e53e47f319b req-e60e1de5-a24a-4b61-97f6-4d3e2451e52e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:15.028534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9e74b597-050c-4c51-a0bb-1e53e47f319b req-e60e1de5-a24a-4b61-97f6-4d3e2451e52e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:15.080934 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-9e74b597-050c-4c51-a0bb-1e53e47f319b req-e60e1de5-a24a-4b61-97f6-4d3e2451e52e service nova] Creating event network-changed:2742784c-b94a-4677-bfd8-f7b559678bc9 for instance 98588f3c-20c5-42a4-9f79-cf55750977d5 on n-h2-764485-11 Jul 20 04:23:15.088278 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-9e74b597-050c-4c51-a0bb-1e53e47f319b req-e60e1de5-a24a-4b61-97f6-4d3e2451e52e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091730 Jul 20 04:23:15.089452 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1526/3110] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:15.096060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee6ea105-f563-4d0f-b216-5f7bae1e6867 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:15.096941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ee6ea105-f563-4d0f-b216-5f7bae1e6867 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:15.124438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee6ea105-f563-4d0f-b216-5f7bae1e6867 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:15.125194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee6ea105-f563-4d0f-b216-5f7bae1e6867 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:15.126467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee6ea105-f563-4d0f-b216-5f7bae1e6867 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:15.127165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee6ea105-f563-4d0f-b216-5f7bae1e6867 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:15.285850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ee6ea105-f563-4d0f-b216-5f7bae1e6867 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:15.296060 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ee6ea105-f563-4d0f-b216-5f7bae1e6867 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1250 microversion: 2.1 time: 0.205158 Jul 20 04:23:15.297535 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1527/3111] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:15 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1250 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:15.440413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d6404639-149e-4683-a80d-360a71eb397f tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:15.453867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:15.457715 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d6404639-149e-4683-a80d-360a71eb397f tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1317 microversion: 2.1 time: 0.639530 Jul 20 04:23:15.459143 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1585/3112] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:14 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:15.685268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7972c2c4-a87d-4dec-bf23-7944663f44f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:15.686012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7972c2c4-a87d-4dec-bf23-7944663f44f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:15.716155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7972c2c4-a87d-4dec-bf23-7944663f44f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:15.724049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7972c2c4-a87d-4dec-bf23-7944663f44f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:15.725413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7972c2c4-a87d-4dec-bf23-7944663f44f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:15.728051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7972c2c4-a87d-4dec-bf23-7944663f44f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.023033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-92400153-a0cf-4496-834d-b555c726187b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.024086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-92400153-a0cf-4496-834d-b555c726187b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.033666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:16.036502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:16.039501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92400153-a0cf-4496-834d-b555c726187b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.041016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92400153-a0cf-4496-834d-b555c726187b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.042457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92400153-a0cf-4496-834d-b555c726187b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.043412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92400153-a0cf-4496-834d-b555c726187b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.081936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7972c2c4-a87d-4dec-bf23-7944663f44f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:16.099409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7972c2c4-a87d-4dec-bf23-7944663f44f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:16.101605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7972c2c4-a87d-4dec-bf23-7944663f44f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:16.109267 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7972c2c4-a87d-4dec-bf23-7944663f44f1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.426478 Jul 20 04:23:16.111782 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1528/3113] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:15 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:16.313264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe1ef936-0861-45d3-be9f-b0a7c9b388c9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.314385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe1ef936-0861-45d3-be9f-b0a7c9b388c9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.323876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe1ef936-0861-45d3-be9f-b0a7c9b388c9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.326017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe1ef936-0861-45d3-be9f-b0a7c9b388c9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.331902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe1ef936-0861-45d3-be9f-b0a7c9b388c9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.332620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe1ef936-0861-45d3-be9f-b0a7c9b388c9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.430276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-92400153-a0cf-4496-834d-b555c726187b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:16.438919 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-92400153-a0cf-4496-834d-b555c726187b tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 200 len: 1506 microversion: 2.1 time: 0.430166 Jul 20 04:23:16.440085 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1586/3114] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:16.445629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c4b7c299-41e6-475a-b65c-60abc8d0edc9 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.448487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c4b7c299-41e6-475a-b65c-60abc8d0edc9 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.454578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe1ef936-0861-45d3-be9f-b0a7c9b388c9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:16.468486 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe1ef936-0861-45d3-be9f-b0a7c9b388c9 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1250 microversion: 2.1 time: 0.156830 Jul 20 04:23:16.471737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b7c299-41e6-475a-b65c-60abc8d0edc9 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.472829 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1529/3115] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1250 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:16.476549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b7c299-41e6-475a-b65c-60abc8d0edc9 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.477551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b7c299-41e6-475a-b65c-60abc8d0edc9 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.479572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b7c299-41e6-475a-b65c-60abc8d0edc9 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.481534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-18c3255f-092e-4622-b0c9-2fa11f96633e tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.486814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-18c3255f-092e-4622-b0c9-2fa11f96633e tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: d992ed51-bb47-460f-a825-bd45481d157e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.497890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18c3255f-092e-4622-b0c9-2fa11f96633e tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.501433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18c3255f-092e-4622-b0c9-2fa11f96633e tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.503804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18c3255f-092e-4622-b0c9-2fa11f96633e tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.504476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18c3255f-092e-4622-b0c9-2fa11f96633e tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.537186 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c4b7c299-41e6-475a-b65c-60abc8d0edc9 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095183 Jul 20 04:23:16.538102 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1587/3116] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:16.544207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-42bbcd4e-7beb-4653-9c1e-f39321fc9ac6 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.545339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-42bbcd4e-7beb-4653-9c1e-f39321fc9ac6 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.552824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42bbcd4e-7beb-4653-9c1e-f39321fc9ac6 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.553599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42bbcd4e-7beb-4653-9c1e-f39321fc9ac6 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.554604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42bbcd4e-7beb-4653-9c1e-f39321fc9ac6 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.555495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42bbcd4e-7beb-4653-9c1e-f39321fc9ac6 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.781838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-18c3255f-092e-4622-b0c9-2fa11f96633e tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:16.784926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-42bbcd4e-7beb-4653-9c1e-f39321fc9ac6 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:16.791914 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-18c3255f-092e-4622-b0c9-2fa11f96633e tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/d992ed51-bb47-460f-a825-bd45481d157e" status: 200 len: 1507 microversion: 2.1 time: 0.317200 Jul 20 04:23:16.793355 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1530/3117] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/servers/d992ed51-bb47-460f-a825-bd45481d157e => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:16.795037 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-42bbcd4e-7beb-4653-9c1e-f39321fc9ac6 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1317 microversion: 2.1 time: 0.254826 Jul 20 04:23:16.795768 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1588/3118] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:16.799773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-177de2e5-5589-43d4-8f27-31d8f5b19779 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.800707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-177de2e5-5589-43d4-8f27-31d8f5b19779 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.807696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-177de2e5-5589-43d4-8f27-31d8f5b19779 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.808512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-177de2e5-5589-43d4-8f27-31d8f5b19779 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.809356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-177de2e5-5589-43d4-8f27-31d8f5b19779 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.809863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-177de2e5-5589-43d4-8f27-31d8f5b19779 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.812880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-79383100-0f2c-4ebe-bc88-f964f1d98f9d tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.813393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-79383100-0f2c-4ebe-bc88-f964f1d98f9d tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: d992ed51-bb47-460f-a825-bd45481d157e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.820576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79383100-0f2c-4ebe-bc88-f964f1d98f9d tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.821036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79383100-0f2c-4ebe-bc88-f964f1d98f9d tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.821828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79383100-0f2c-4ebe-bc88-f964f1d98f9d tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.822318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79383100-0f2c-4ebe-bc88-f964f1d98f9d tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.854042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-79383100-0f2c-4ebe-bc88-f964f1d98f9d tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: d992ed51-bb47-460f-a825-bd45481d157e] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:16.947121 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-79383100-0f2c-4ebe-bc88-f964f1d98f9d tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d992ed51-bb47-460f-a825-bd45481d157e" status: 204 len: 0 microversion: 2.1 time: 0.137688 Jul 20 04:23:16.948185 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1589/3119] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:16 2022] DELETE /compute/v2.1/servers/d992ed51-bb47-460f-a825-bd45481d157e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:16.958276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fe3c6d3c-d443-42d2-95de-71905f7bd954 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.959017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fe3c6d3c-d443-42d2-95de-71905f7bd954 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.968585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe3c6d3c-d443-42d2-95de-71905f7bd954 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.969845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe3c6d3c-d443-42d2-95de-71905f7bd954 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.971120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe3c6d3c-d443-42d2-95de-71905f7bd954 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.971548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-177de2e5-5589-43d4-8f27-31d8f5b19779 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lazy-loading 'services' on Instance uuid a70e7012-a311-486b-9035-cb4ccdd2afde {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:16.972490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe3c6d3c-d443-42d2-95de-71905f7bd954 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.006324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fe3c6d3c-d443-42d2-95de-71905f7bd954 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: a4ef6d1f-97e0-42a5-b324-a6a7dffd4682] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:17.135005 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fe3c6d3c-d443-42d2-95de-71905f7bd954 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682" status: 204 len: 0 microversion: 2.1 time: 0.181733 Jul 20 04:23:17.135874 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-177de2e5-5589-43d4-8f27-31d8f5b19779 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde/os-volume_attachments/30f21c73-252e-486e-94d8-335d5bb6a1e6" status: 202 len: 0 microversion: 2.1 time: 0.340533 Jul 20 04:23:17.137223 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1531/3121] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:23:16 2022] DELETE /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde/os-volume_attachments/30f21c73-252e-486e-94d8-335d5bb6a1e6 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:23:17.139797 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1590/3121] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:16 2022] DELETE /compute/v2.1/servers/a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:23:17.160823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f7de5899-d340-4f4a-a088-115e71095696 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:17.165332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f7de5899-d340-4f4a-a088-115e71095696 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.175535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88067fc2-455e-4608-83d3-9675658d8f6f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.178488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88067fc2-455e-4608-83d3-9675658d8f6f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.188339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7de5899-d340-4f4a-a088-115e71095696 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.188940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7de5899-d340-4f4a-a088-115e71095696 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.191257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7de5899-d340-4f4a-a088-115e71095696 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.192758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7de5899-d340-4f4a-a088-115e71095696 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.213266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88067fc2-455e-4608-83d3-9675658d8f6f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.213751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88067fc2-455e-4608-83d3-9675658d8f6f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.216414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88067fc2-455e-4608-83d3-9675658d8f6f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.217244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88067fc2-455e-4608-83d3-9675658d8f6f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.257117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-f7de5899-d340-4f4a-a088-115e71095696 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lazy-loading 'flavor' on Instance uuid c9c53e05-cfbb-479b-80a3-6a17db52e44f {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:17.368184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:17.390605 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f7de5899-d340-4f4a-a088-115e71095696 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/action" status: 200 len: 32 microversion: 2.1 time: 0.245392 Jul 20 04:23:17.391859 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1532/3122] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:17 2022] POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:23:17.400404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-70376615", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "19c8a53e-e349-4990-ac8d-cad6b2c0844d"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:17.420003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88067fc2-455e-4608-83d3-9675658d8f6f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.442043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88067fc2-455e-4608-83d3-9675658d8f6f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.443585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88067fc2-455e-4608-83d3-9675658d8f6f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.444781 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88067fc2-455e-4608-83d3-9675658d8f6f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.303570 Jul 20 04:23:17.445355 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1591/3123] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:17 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:17.452591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5f162d03-1ff2-492b-94d3-41e90856a638 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.455371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5f162d03-1ff2-492b-94d3-41e90856a638 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.466289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5f162d03-1ff2-492b-94d3-41e90856a638 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.468417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5f162d03-1ff2-492b-94d3-41e90856a638 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.470273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5f162d03-1ff2-492b-94d3-41e90856a638 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.471761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5f162d03-1ff2-492b-94d3-41e90856a638 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.490856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] validate_networks() for [('19c8a53e-e349-4990-ac8d-cad6b2c0844d', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:17.715156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5f162d03-1ff2-492b-94d3-41e90856a638 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.724480 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5f162d03-1ff2-492b-94d3-41e90856a638 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.278014 Jul 20 04:23:17.725247 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1592/3124] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:17 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:17.730014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-277e0dca-063d-4372-b1f9-a10492ddfae6 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.730973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-277e0dca-063d-4372-b1f9-a10492ddfae6 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.738309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-277e0dca-063d-4372-b1f9-a10492ddfae6 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.738928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-277e0dca-063d-4372-b1f9-a10492ddfae6 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.739821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-277e0dca-063d-4372-b1f9-a10492ddfae6 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.740337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-277e0dca-063d-4372-b1f9-a10492ddfae6 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.839772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-277e0dca-063d-4372-b1f9-a10492ddfae6 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.850174 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-277e0dca-063d-4372-b1f9-a10492ddfae6 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1250 microversion: 2.1 time: 0.123628 Jul 20 04:23:17.860745 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1593/3125] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:17 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1250 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:17.867708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b4f52825-fc54-4512-95b2-d3972e13bc71 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.868232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b4f52825-fc54-4512-95b2-d3972e13bc71 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.875030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4f52825-fc54-4512-95b2-d3972e13bc71 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.875493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4f52825-fc54-4512-95b2-d3972e13bc71 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.876351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4f52825-fc54-4512-95b2-d3972e13bc71 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.876791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4f52825-fc54-4512-95b2-d3972e13bc71 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.151837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b4f52825-fc54-4512-95b2-d3972e13bc71 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:18.165023 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b4f52825-fc54-4512-95b2-d3972e13bc71 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1317 microversion: 2.1 time: 0.303313 Jul 20 04:23:18.167214 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1594/3126] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:17 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:18.187924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:18.189095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:18.190024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:18.192060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:18.192855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:18.203129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.203890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.204756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.205244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.225168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Getting quotas for project acacca985d204f71a0cdc45a2c50f78c. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:18.231360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Getting quotas for user 61c292c64fb342b48356d4240c2952b2 and project acacca985d204f71a0cdc45a2c50f78c. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:18.254496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Going to run 2 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:18.257670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: c59ed237-adcb-4557-823c-3c3d67657b15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:18.299484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=c59ed237-adcb-4557-823c-3c3d67657b15,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:18.366796 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d7bc0c3d-1016-4a66-9e04-dd8b625bcae6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.973123 Jul 20 04:23:18.368198 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1533/3127] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:17 2022] POST /compute/v2.1/servers => generated 32 bytes in 976 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:23:18.376738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e3048be2-7ed1-459f-99d5-c35a244e5d72 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:18.380734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e3048be2-7ed1-459f-99d5-c35a244e5d72 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:18.381815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e3048be2-7ed1-459f-99d5-c35a244e5d72 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Searching by: {'deleted': False, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:23:18.411264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e3048be2-7ed1-459f-99d5-c35a244e5d72 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.411875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e3048be2-7ed1-459f-99d5-c35a244e5d72 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.412674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e3048be2-7ed1-459f-99d5-c35a244e5d72 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.413122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e3048be2-7ed1-459f-99d5-c35a244e5d72 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.452901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-e3048be2-7ed1-459f-99d5-c35a244e5d72 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:23:18.467086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8fe723c1-4ded-44c6-b068-4977b758bb44 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:18.467961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8fe723c1-4ded-44c6-b068-4977b758bb44 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:18.482134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fe723c1-4ded-44c6-b068-4977b758bb44 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.485362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fe723c1-4ded-44c6-b068-4977b758bb44 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.488569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fe723c1-4ded-44c6-b068-4977b758bb44 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.489373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fe723c1-4ded-44c6-b068-4977b758bb44 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.512358 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e3048be2-7ed1-459f-99d5-c35a244e5d72 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1331 microversion: 2.1 time: 0.139545 Jul 20 04:23:18.513461 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1595/3128] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 04:23:18 2022] GET /compute/v2.1/servers => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:18.532356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-60a48459-68aa-4269-a9d4-8226cf7b244c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:18.533294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-60a48459-68aa-4269-a9d4-8226cf7b244c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:18.650023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-60a48459-68aa-4269-a9d4-8226cf7b244c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:18.657489 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-60a48459-68aa-4269-a9d4-8226cf7b244c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1216 microversion: 2.1 time: 0.136953 Jul 20 04:23:18.674900 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1596/3129] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:18 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:18.742377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0bf4ba18-cdf2-476a-83c5-050401c72b49 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:18.743177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0bf4ba18-cdf2-476a-83c5-050401c72b49 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:18.753134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bf4ba18-cdf2-476a-83c5-050401c72b49 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.753996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bf4ba18-cdf2-476a-83c5-050401c72b49 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.754962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bf4ba18-cdf2-476a-83c5-050401c72b49 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.755605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bf4ba18-cdf2-476a-83c5-050401c72b49 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.755976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8fe723c1-4ded-44c6-b068-4977b758bb44 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:18.770708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8fe723c1-4ded-44c6-b068-4977b758bb44 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:18.772459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8fe723c1-4ded-44c6-b068-4977b758bb44 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:18.773730 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8fe723c1-4ded-44c6-b068-4977b758bb44 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.311313 Jul 20 04:23:18.786872 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1534/3130] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:18 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:18.869415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-553e479a-faba-4cab-851b-41eca5b4c87b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:18.870171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-553e479a-faba-4cab-851b-41eca5b4c87b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:18.881561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-553e479a-faba-4cab-851b-41eca5b4c87b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.882081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-553e479a-faba-4cab-851b-41eca5b4c87b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.882850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-553e479a-faba-4cab-851b-41eca5b4c87b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.883346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-553e479a-faba-4cab-851b-41eca5b4c87b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.951656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0bf4ba18-cdf2-476a-83c5-050401c72b49 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:18.973712 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0bf4ba18-cdf2-476a-83c5-050401c72b49 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.235030 Jul 20 04:23:18.975046 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1597/3131] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:18 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:19.001157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-553e479a-faba-4cab-851b-41eca5b4c87b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:19.015630 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-553e479a-faba-4cab-851b-41eca5b4c87b tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1250 microversion: 2.1 time: 0.150798 Jul 20 04:23:19.027361 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1535/3132] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:18 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1250 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:19.188760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-653475a1-c5e9-47e5-9ea5-965c66df1e92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:19.189810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-653475a1-c5e9-47e5-9ea5-965c66df1e92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:19.198871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-653475a1-c5e9-47e5-9ea5-965c66df1e92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.199599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-653475a1-c5e9-47e5-9ea5-965c66df1e92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.200829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-653475a1-c5e9-47e5-9ea5-965c66df1e92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.201683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-653475a1-c5e9-47e5-9ea5-965c66df1e92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.411112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-653475a1-c5e9-47e5-9ea5-965c66df1e92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:19.429001 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-653475a1-c5e9-47e5-9ea5-965c66df1e92 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1317 microversion: 2.1 time: 0.245420 Jul 20 04:23:19.434488 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1598/3133] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:19 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:19.682832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1af4d7b4-ac44-40b7-8eb9-1a4cff3bf55c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:19.683654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1af4d7b4-ac44-40b7-8eb9-1a4cff3bf55c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:19.690930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1af4d7b4-ac44-40b7-8eb9-1a4cff3bf55c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.691707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1af4d7b4-ac44-40b7-8eb9-1a4cff3bf55c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.692547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1af4d7b4-ac44-40b7-8eb9-1a4cff3bf55c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.693016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1af4d7b4-ac44-40b7-8eb9-1a4cff3bf55c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.785965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1af4d7b4-ac44-40b7-8eb9-1a4cff3bf55c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:19.794240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c1653aaa-e215-49ae-bebb-628f1e70b036 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:19.795552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c1653aaa-e215-49ae-bebb-628f1e70b036 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:19.804464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1653aaa-e215-49ae-bebb-628f1e70b036 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.804936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1653aaa-e215-49ae-bebb-628f1e70b036 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.805732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1653aaa-e215-49ae-bebb-628f1e70b036 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.805855 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1af4d7b4-ac44-40b7-8eb9-1a4cff3bf55c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1220 microversion: 2.1 time: 0.127305 Jul 20 04:23:19.806154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1653aaa-e215-49ae-bebb-628f1e70b036 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.806448 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1536/3134] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:19 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:19.972735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c1653aaa-e215-49ae-bebb-628f1e70b036 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:19.982504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:19.994009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-97d268f4-302f-43b8-85ae-9247bd566e4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:19.994998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-97d268f4-302f-43b8-85ae-9247bd566e4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.008452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c1653aaa-e215-49ae-bebb-628f1e70b036 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:20.009695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97d268f4-302f-43b8-85ae-9247bd566e4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.010216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97d268f4-302f-43b8-85ae-9247bd566e4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.011734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97d268f4-302f-43b8-85ae-9247bd566e4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.011734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97d268f4-302f-43b8-85ae-9247bd566e4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.017055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c1653aaa-e215-49ae-bebb-628f1e70b036 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:20.018365 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c1653aaa-e215-49ae-bebb-628f1e70b036 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.228132 Jul 20 04:23:20.020237 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1599/3135] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:19 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:20.039008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-496f61dc-e65c-47d9-b7a4-224e7d6a2dbc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.039852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-496f61dc-e65c-47d9-b7a4-224e7d6a2dbc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.049197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-496f61dc-e65c-47d9-b7a4-224e7d6a2dbc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.049738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-496f61dc-e65c-47d9-b7a4-224e7d6a2dbc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.051236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-496f61dc-e65c-47d9-b7a4-224e7d6a2dbc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.052129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-496f61dc-e65c-47d9-b7a4-224e7d6a2dbc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.140131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-496f61dc-e65c-47d9-b7a4-224e7d6a2dbc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:20.150346 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-496f61dc-e65c-47d9-b7a4-224e7d6a2dbc tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1250 microversion: 2.1 time: 0.120567 Jul 20 04:23:20.151180 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1600/3136] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1250 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:20.189829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-97d268f4-302f-43b8-85ae-9247bd566e4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:20.198059 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-97d268f4-302f-43b8-85ae-9247bd566e4c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.208891 Jul 20 04:23:20.198647 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1537/3137] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:19 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:20.458889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-80d25a83-e2e9-4156-97d1-796c35eca703 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.459649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-80d25a83-e2e9-4156-97d1-796c35eca703 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.468365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80d25a83-e2e9-4156-97d1-796c35eca703 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.468818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80d25a83-e2e9-4156-97d1-796c35eca703 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.469590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80d25a83-e2e9-4156-97d1-796c35eca703 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.470026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80d25a83-e2e9-4156-97d1-796c35eca703 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.678336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-80d25a83-e2e9-4156-97d1-796c35eca703 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:20.686786 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-80d25a83-e2e9-4156-97d1-796c35eca703 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1317 microversion: 2.1 time: 0.233967 Jul 20 04:23:20.697584 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1601/3138] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:20.823428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-48379a69-c881-4817-bca4-9b7b3dc59278 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.823996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-48379a69-c881-4817-bca4-9b7b3dc59278 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.831739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48379a69-c881-4817-bca4-9b7b3dc59278 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.832333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48379a69-c881-4817-bca4-9b7b3dc59278 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.833181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48379a69-c881-4817-bca4-9b7b3dc59278 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.833620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48379a69-c881-4817-bca4-9b7b3dc59278 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.903562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-48379a69-c881-4817-bca4-9b7b3dc59278 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:20.912519 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-48379a69-c881-4817-bca4-9b7b3dc59278 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1220 microversion: 2.1 time: 0.092949 Jul 20 04:23:20.913444 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1538/3139] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:21.039709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cb019c38-9350-4c2d-a661-639098b49ef7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:21.040526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cb019c38-9350-4c2d-a661-639098b49ef7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:21.047387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb019c38-9350-4c2d-a661-639098b49ef7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.048132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb019c38-9350-4c2d-a661-639098b49ef7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.049328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb019c38-9350-4c2d-a661-639098b49ef7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.050708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb019c38-9350-4c2d-a661-639098b49ef7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.172623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-81d608d3-aa6a-4523-ae0d-0d2d1077657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:21.173621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-81d608d3-aa6a-4523-ae0d-0d2d1077657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:21.195232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81d608d3-aa6a-4523-ae0d-0d2d1077657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.195896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81d608d3-aa6a-4523-ae0d-0d2d1077657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.198360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81d608d3-aa6a-4523-ae0d-0d2d1077657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.199771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81d608d3-aa6a-4523-ae0d-0d2d1077657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.249408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cb019c38-9350-4c2d-a661-639098b49ef7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.262007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cb019c38-9350-4c2d-a661-639098b49ef7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.264215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cb019c38-9350-4c2d-a661-639098b49ef7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.265786 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cb019c38-9350-4c2d-a661-639098b49ef7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.231017 Jul 20 04:23:21.266965 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1602/3140] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:21 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:21.273478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bd4956f3-e65d-4dc3-80ce-dcab4a7ade45 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:21.274638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bd4956f3-e65d-4dc3-80ce-dcab4a7ade45 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:21.282154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd4956f3-e65d-4dc3-80ce-dcab4a7ade45 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.283000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd4956f3-e65d-4dc3-80ce-dcab4a7ade45 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.284405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd4956f3-e65d-4dc3-80ce-dcab4a7ade45 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.286486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd4956f3-e65d-4dc3-80ce-dcab4a7ade45 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.418580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-81d608d3-aa6a-4523-ae0d-0d2d1077657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.431270 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-81d608d3-aa6a-4523-ae0d-0d2d1077657a tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1250 microversion: 2.1 time: 0.266777 Jul 20 04:23:21.441249 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1539/3141] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:21 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1250 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:21.495693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bd4956f3-e65d-4dc3-80ce-dcab4a7ade45 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.506603 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bd4956f3-e65d-4dc3-80ce-dcab4a7ade45 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.238086 Jul 20 04:23:21.507135 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1603/3142] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:21 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:21.704845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8fde39c0-4bde-4c74-8ff3-76bec05ca1e2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:21.705833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8fde39c0-4bde-4c74-8ff3-76bec05ca1e2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:21.712294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fde39c0-4bde-4c74-8ff3-76bec05ca1e2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.712983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fde39c0-4bde-4c74-8ff3-76bec05ca1e2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.713767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fde39c0-4bde-4c74-8ff3-76bec05ca1e2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.714204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fde39c0-4bde-4c74-8ff3-76bec05ca1e2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.932469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e415b8e1-bd21-4df7-9f7a-8da704c2869c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:21.933314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e415b8e1-bd21-4df7-9f7a-8da704c2869c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:21.949117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e415b8e1-bd21-4df7-9f7a-8da704c2869c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.949647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e415b8e1-bd21-4df7-9f7a-8da704c2869c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.954725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e415b8e1-bd21-4df7-9f7a-8da704c2869c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.955197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e415b8e1-bd21-4df7-9f7a-8da704c2869c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.628881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e415b8e1-bd21-4df7-9f7a-8da704c2869c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:22.642329 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e415b8e1-bd21-4df7-9f7a-8da704c2869c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1220 microversion: 2.1 time: 0.714042 Jul 20 04:23:22.643329 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1604/3143] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:21 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1220 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:22.658252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-3a027f48-d27d-42a2-a4f2-5e8e23399951 req-73203ab1-80d5-4df0-a836-952ac2a86f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98588f3c-20c5-42a4-9f79-cf55750977d5", "name": "network-vif-plugged", "status": "completed", "tag": "2742784c-b94a-4677-bfd8-f7b559678bc9"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:22.675855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3a027f48-d27d-42a2-a4f2-5e8e23399951 req-73203ab1-80d5-4df0-a836-952ac2a86f30 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.676312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3a027f48-d27d-42a2-a4f2-5e8e23399951 req-73203ab1-80d5-4df0-a836-952ac2a86f30 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.702093 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-3a027f48-d27d-42a2-a4f2-5e8e23399951 req-73203ab1-80d5-4df0-a836-952ac2a86f30 service nova] Creating event network-vif-plugged:2742784c-b94a-4677-bfd8-f7b559678bc9 for instance 98588f3c-20c5-42a4-9f79-cf55750977d5 on n-h2-764485-11 Jul 20 04:23:22.710173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8fde39c0-4bde-4c74-8ff3-76bec05ca1e2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:22.710727 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-3a027f48-d27d-42a2-a4f2-5e8e23399951 req-73203ab1-80d5-4df0-a836-952ac2a86f30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056029 Jul 20 04:23:22.711622 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1605/3144] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:22.717138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14ea1e63-b2b1-4d6c-9789-df1e7253baa7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:22.717938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-14ea1e63-b2b1-4d6c-9789-df1e7253baa7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:22.727624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14ea1e63-b2b1-4d6c-9789-df1e7253baa7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.728092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14ea1e63-b2b1-4d6c-9789-df1e7253baa7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.728881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14ea1e63-b2b1-4d6c-9789-df1e7253baa7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.729326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14ea1e63-b2b1-4d6c-9789-df1e7253baa7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.732849 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8fde39c0-4bde-4c74-8ff3-76bec05ca1e2 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1317 microversion: 2.1 time: 1.031733 Jul 20 04:23:22.734419 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1540/3145] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:21 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1317 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:22.751301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9eecfe64-1e23-4dd3-a79f-8e3058681a88 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:22.760687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9eecfe64-1e23-4dd3-a79f-8e3058681a88 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:22.776235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9eecfe64-1e23-4dd3-a79f-8e3058681a88 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.776700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9eecfe64-1e23-4dd3-a79f-8e3058681a88 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.777488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9eecfe64-1e23-4dd3-a79f-8e3058681a88 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.777932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9eecfe64-1e23-4dd3-a79f-8e3058681a88 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.921840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9eecfe64-1e23-4dd3-a79f-8e3058681a88 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:22.942411 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9eecfe64-1e23-4dd3-a79f-8e3058681a88 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1250 microversion: 2.1 time: 0.194826 Jul 20 04:23:22.943190 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1541/3146] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:22 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1250 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:22.958554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1fc73464-c286-417b-8075-91976db046b4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:22.962917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1fc73464-c286-417b-8075-91976db046b4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:22.976985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1fc73464-c286-417b-8075-91976db046b4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.977453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1fc73464-c286-417b-8075-91976db046b4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.982443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1fc73464-c286-417b-8075-91976db046b4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.982950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1fc73464-c286-417b-8075-91976db046b4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:23.571303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-14ea1e63-b2b1-4d6c-9789-df1e7253baa7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:23.586109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-14ea1e63-b2b1-4d6c-9789-df1e7253baa7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:23.588293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-14ea1e63-b2b1-4d6c-9789-df1e7253baa7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:23.592601 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-14ea1e63-b2b1-4d6c-9789-df1e7253baa7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.879814 Jul 20 04:23:23.598190 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1606/3147] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:22 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:23.634457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1fc73464-c286-417b-8075-91976db046b4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:23.646202 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1fc73464-c286-417b-8075-91976db046b4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.701746 Jul 20 04:23:23.648225 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1542/3148] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:22 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:23.661795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b40b52eb-8c98-4d74-b26c-1a5f0752b360 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:23.662810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b40b52eb-8c98-4d74-b26c-1a5f0752b360 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:23.674751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b40b52eb-8c98-4d74-b26c-1a5f0752b360 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.674751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b40b52eb-8c98-4d74-b26c-1a5f0752b360 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:23.676742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b40b52eb-8c98-4d74-b26c-1a5f0752b360 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.677254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b40b52eb-8c98-4d74-b26c-1a5f0752b360 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:23.754899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e986781c-96e7-4534-83ea-09bef2c50edd tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:23.757098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e986781c-96e7-4534-83ea-09bef2c50edd tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:23.814492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e986781c-96e7-4534-83ea-09bef2c50edd tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.821752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e986781c-96e7-4534-83ea-09bef2c50edd tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:23.824971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e986781c-96e7-4534-83ea-09bef2c50edd tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.834073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e986781c-96e7-4534-83ea-09bef2c50edd tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.024135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b40b52eb-8c98-4d74-b26c-1a5f0752b360 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:24.055672 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b40b52eb-8c98-4d74-b26c-1a5f0752b360 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1274 microversion: 2.1 time: 0.398565 Jul 20 04:23:24.074275 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1607/3149] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:23 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1274 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:24.094932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44c6c297-b890-4248-b58a-be49c974299c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:24.096224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44c6c297-b890-4248-b58a-be49c974299c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:24.102658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:24.107931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44c6c297-b890-4248-b58a-be49c974299c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.109891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44c6c297-b890-4248-b58a-be49c974299c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.110788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44c6c297-b890-4248-b58a-be49c974299c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.113991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44c6c297-b890-4248-b58a-be49c974299c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.272883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44c6c297-b890-4248-b58a-be49c974299c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:24.282359 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44c6c297-b890-4248-b58a-be49c974299c tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1250 microversion: 2.1 time: 0.206613 Jul 20 04:23:24.283298 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1608/3150] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:24 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1250 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:24.444123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e986781c-96e7-4534-83ea-09bef2c50edd tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:24.502328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4b3cedfe-62b8-4ba5-9e55-d778ddaf3278 req-21e5c62f-c20a-4b7c-a496-181920161d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c59ed237-adcb-4557-823c-3c3d67657b15", "tag": "4a3848d0-c8d6-4e75-8a99-e7bdf4569a3c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:24.568439 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e986781c-96e7-4534-83ea-09bef2c50edd tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1317 microversion: 2.1 time: 0.810090 Jul 20 04:23:24.573382 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1543/3151] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:23 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1317 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:24.576548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4b3cedfe-62b8-4ba5-9e55-d778ddaf3278 req-21e5c62f-c20a-4b7c-a496-181920161d3c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.577467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4b3cedfe-62b8-4ba5-9e55-d778ddaf3278 req-21e5c62f-c20a-4b7c-a496-181920161d3c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.607785 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4b3cedfe-62b8-4ba5-9e55-d778ddaf3278 req-21e5c62f-c20a-4b7c-a496-181920161d3c service nova] Creating event network-changed:4a3848d0-c8d6-4e75-8a99-e7bdf4569a3c for instance c59ed237-adcb-4557-823c-3c3d67657b15 on n-h1-764485-11 Jul 20 04:23:24.617012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f598a439-09c6-4375-9355-002d218947c7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:24.617650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f598a439-09c6-4375-9355-002d218947c7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:24.630800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f598a439-09c6-4375-9355-002d218947c7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.632940 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4b3cedfe-62b8-4ba5-9e55-d778ddaf3278 req-21e5c62f-c20a-4b7c-a496-181920161d3c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137235 Jul 20 04:23:24.633698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f598a439-09c6-4375-9355-002d218947c7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.635571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f598a439-09c6-4375-9355-002d218947c7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.637297 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1609/3152] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:24.638163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f598a439-09c6-4375-9355-002d218947c7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.668481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3ec25b0a-ae43-4f09-b075-002934fad50f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:24.669811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3ec25b0a-ae43-4f09-b075-002934fad50f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:24.686549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ec25b0a-ae43-4f09-b075-002934fad50f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.688529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ec25b0a-ae43-4f09-b075-002934fad50f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.692996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ec25b0a-ae43-4f09-b075-002934fad50f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.697383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ec25b0a-ae43-4f09-b075-002934fad50f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.171758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3ec25b0a-ae43-4f09-b075-002934fad50f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.213705 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3ec25b0a-ae43-4f09-b075-002934fad50f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.550628 Jul 20 04:23:25.246341 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1610/3153] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:24 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:25.262413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2acf6432-dc1d-40f8-b5d8-77d6cbf77ee1 req-660316b1-6060-4122-b8ad-afe9fae48c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ef6d1f-97e0-42a5-b324-a6a7dffd4682", "name": "network-vif-deleted", "tag": "39050e91-cd0e-403c-8984-5646457d2de5"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:25.289807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2acf6432-dc1d-40f8-b5d8-77d6cbf77ee1 req-660316b1-6060-4122-b8ad-afe9fae48c17 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.295429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2acf6432-dc1d-40f8-b5d8-77d6cbf77ee1 req-660316b1-6060-4122-b8ad-afe9fae48c17 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.322944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f598a439-09c6-4375-9355-002d218947c7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.348159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f598a439-09c6-4375-9355-002d218947c7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.352346 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2acf6432-dc1d-40f8-b5d8-77d6cbf77ee1 req-660316b1-6060-4122-b8ad-afe9fae48c17 service nova] Creating event network-vif-deleted:39050e91-cd0e-403c-8984-5646457d2de5 for instance a4ef6d1f-97e0-42a5-b324-a6a7dffd4682 on n-h2-764485-11 Jul 20 04:23:25.354457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f598a439-09c6-4375-9355-002d218947c7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.356171 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f598a439-09c6-4375-9355-002d218947c7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.743663 Jul 20 04:23:25.364454 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1544/3154] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:24 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:25.373120 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2acf6432-dc1d-40f8-b5d8-77d6cbf77ee1 req-660316b1-6060-4122-b8ad-afe9fae48c17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127902 Jul 20 04:23:25.380126 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1611/3155] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:25.388737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6b0aa0a2-f33d-4bc1-842a-1d396e073422 req-ecf165c4-9d38-4d1f-9ca6-d733f2c6ad39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588d4bae-3e12-4c79-81c7-b6223cb6dacc", "name": "network-vif-unplugged", "status": "completed", "tag": "5397e4d6-56be-4b85-aca3-b4aa19f1e755"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:25.401312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-48501d77-da07-46d7-a448-481fea6b7407 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:25.402116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-48501d77-da07-46d7-a448-481fea6b7407 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:25.429848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6b0aa0a2-f33d-4bc1-842a-1d396e073422 req-ecf165c4-9d38-4d1f-9ca6-d733f2c6ad39 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.433374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6b0aa0a2-f33d-4bc1-842a-1d396e073422 req-ecf165c4-9d38-4d1f-9ca6-d733f2c6ad39 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.444428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-48501d77-da07-46d7-a448-481fea6b7407 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.446383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-48501d77-da07-46d7-a448-481fea6b7407 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.447243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-48501d77-da07-46d7-a448-481fea6b7407 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.447731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-48501d77-da07-46d7-a448-481fea6b7407 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.477760 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-6b0aa0a2-f33d-4bc1-842a-1d396e073422 req-ecf165c4-9d38-4d1f-9ca6-d733f2c6ad39 service nova] Creating event network-vif-unplugged:5397e4d6-56be-4b85-aca3-b4aa19f1e755 for instance 588d4bae-3e12-4c79-81c7-b6223cb6dacc on n-h1-764485-11 Jul 20 04:23:25.490473 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6b0aa0a2-f33d-4bc1-842a-1d396e073422 req-ecf165c4-9d38-4d1f-9ca6-d733f2c6ad39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121626 Jul 20 04:23:25.493953 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1545/3156] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:25.506714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-18603e25-13db-4c1f-b9b8-e930ad064320 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:25.507877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-18603e25-13db-4c1f-b9b8-e930ad064320 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:25.522685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18603e25-13db-4c1f-b9b8-e930ad064320 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.528193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18603e25-13db-4c1f-b9b8-e930ad064320 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.530279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18603e25-13db-4c1f-b9b8-e930ad064320 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.531825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18603e25-13db-4c1f-b9b8-e930ad064320 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.740812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-18603e25-13db-4c1f-b9b8-e930ad064320 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.762741 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-18603e25-13db-4c1f-b9b8-e930ad064320 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1250 microversion: 2.1 time: 0.264266 Jul 20 04:23:25.764236 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1546/3157] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:25 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1250 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:25.778185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c28dcca5-45a7-4cf5-9eb7-107c45165cec tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:25.779231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c28dcca5-45a7-4cf5-9eb7-107c45165cec tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:25.801837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c28dcca5-45a7-4cf5-9eb7-107c45165cec tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.803209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c28dcca5-45a7-4cf5-9eb7-107c45165cec tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.804855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c28dcca5-45a7-4cf5-9eb7-107c45165cec tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.805521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c28dcca5-45a7-4cf5-9eb7-107c45165cec tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.867338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-48501d77-da07-46d7-a448-481fea6b7407 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.884615 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-48501d77-da07-46d7-a448-481fea6b7407 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1316 microversion: 2.1 time: 0.503146 Jul 20 04:23:25.886314 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1612/3158] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:25 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:25.898224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0f79bfe1-f0df-4cd2-99fb-59654d55cf11 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:25.899834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0f79bfe1-f0df-4cd2-99fb-59654d55cf11 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:25.912512 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f79bfe1-f0df-4cd2-99fb-59654d55cf11 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.917742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f79bfe1-f0df-4cd2-99fb-59654d55cf11 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.934288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f79bfe1-f0df-4cd2-99fb-59654d55cf11 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.935352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f79bfe1-f0df-4cd2-99fb-59654d55cf11 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.017425 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0f79bfe1-f0df-4cd2-99fb-59654d55cf11 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129789 Jul 20 04:23:26.018149 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1613/3159] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:23:25 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:23:26.186290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-799a52f4-53e3-4274-84f4-4dcdcb1a31d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:26.187697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-799a52f4-53e3-4274-84f4-4dcdcb1a31d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:26.201012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-799a52f4-53e3-4274-84f4-4dcdcb1a31d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.204724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-799a52f4-53e3-4274-84f4-4dcdcb1a31d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.208219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-799a52f4-53e3-4274-84f4-4dcdcb1a31d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.210362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-799a52f4-53e3-4274-84f4-4dcdcb1a31d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.223567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c28dcca5-45a7-4cf5-9eb7-107c45165cec tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:26.240978 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c28dcca5-45a7-4cf5-9eb7-107c45165cec tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1507 microversion: 2.1 time: 0.475304 Jul 20 04:23:26.242246 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1547/3160] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:25 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:26.264590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-105cd375-6c62-43cc-8e07-7645b7ab8873 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:26.265481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-105cd375-6c62-43cc-8e07-7645b7ab8873 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:26.273803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-105cd375-6c62-43cc-8e07-7645b7ab8873 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.274482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-105cd375-6c62-43cc-8e07-7645b7ab8873 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.275650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-105cd375-6c62-43cc-8e07-7645b7ab8873 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.276249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-105cd375-6c62-43cc-8e07-7645b7ab8873 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.287555 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-799a52f4-53e3-4274-84f4-4dcdcb1a31d3 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106991 Jul 20 04:23:26.298179 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1614/3161] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:23:26 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:23:26.382881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-31ddd1ec-ce3f-4049-b15f-e1f33f402b3b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:26.383631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-31ddd1ec-ce3f-4049-b15f-e1f33f402b3b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:26.401561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31ddd1ec-ce3f-4049-b15f-e1f33f402b3b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.402319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31ddd1ec-ce3f-4049-b15f-e1f33f402b3b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.403279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31ddd1ec-ce3f-4049-b15f-e1f33f402b3b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.404104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31ddd1ec-ce3f-4049-b15f-e1f33f402b3b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.552040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-105cd375-6c62-43cc-8e07-7645b7ab8873 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:26.565818 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-105cd375-6c62-43cc-8e07-7645b7ab8873 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.308649 Jul 20 04:23:26.566766 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1548/3162] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:26 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:26.708645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-31ddd1ec-ce3f-4049-b15f-e1f33f402b3b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:26.728893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-31ddd1ec-ce3f-4049-b15f-e1f33f402b3b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:26.741463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-31ddd1ec-ce3f-4049-b15f-e1f33f402b3b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:26.744766 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-31ddd1ec-ce3f-4049-b15f-e1f33f402b3b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.366428 Jul 20 04:23:26.745528 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1615/3163] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:26 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:26.784891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-758be5e2-8e9a-4839-9e34-8a201fb01ba3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:26.785966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-758be5e2-8e9a-4839-9e34-8a201fb01ba3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:26.819000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-758be5e2-8e9a-4839-9e34-8a201fb01ba3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.825616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-758be5e2-8e9a-4839-9e34-8a201fb01ba3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.827730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f72c41cd-a5bb-4e1a-ab44-211d7d09b07c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:26.832598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-758be5e2-8e9a-4839-9e34-8a201fb01ba3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.833489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f72c41cd-a5bb-4e1a-ab44-211d7d09b07c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:26.834749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-758be5e2-8e9a-4839-9e34-8a201fb01ba3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.853206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f72c41cd-a5bb-4e1a-ab44-211d7d09b07c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.870093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f72c41cd-a5bb-4e1a-ab44-211d7d09b07c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.877566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f72c41cd-a5bb-4e1a-ab44-211d7d09b07c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.881231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f72c41cd-a5bb-4e1a-ab44-211d7d09b07c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.963475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f72c41cd-a5bb-4e1a-ab44-211d7d09b07c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:26.975916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-758be5e2-8e9a-4839-9e34-8a201fb01ba3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.976430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-758be5e2-8e9a-4839-9e34-8a201fb01ba3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.976909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-758be5e2-8e9a-4839-9e34-8a201fb01ba3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lazy-loading 'fault' on Instance uuid c48fbccd-a6bb-42bd-8472-a224bb30c0b0 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:27.100503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:27.140820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-758be5e2-8e9a-4839-9e34-8a201fb01ba3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd5e2533a994d0fb65c1ede341b7f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298da14cfd743539e6421d8f00a3366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:27.154762 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-758be5e2-8e9a-4839-9e34-8a201fb01ba3 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 200 len: 1209 microversion: 2.1 time: 0.375309 Jul 20 04:23:27.171350 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1549/3164] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:26 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 1209 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:27.189331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3f095c8f-ee81-41a1-a293-2a5704813adc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:27.201427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3f095c8f-ee81-41a1-a293-2a5704813adc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:27.217348 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f72c41cd-a5bb-4e1a-ab44-211d7d09b07c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 204 len: 0 microversion: 2.1 time: 0.408397 Jul 20 04:23:27.221794 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1616/3165] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:26 2022] DELETE /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:27.232296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9bd1a45d-5ac4-41e2-8e5b-829464de3e92 req-0a619844-a568-4723-a7da-0ae07ae36a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f67abf3-3423-4658-9583-5b5a2957cb1e", "tag": "c3dcb55c-4cbe-4726-92df-83de60bed473"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:27.241770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f095c8f-ee81-41a1-a293-2a5704813adc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.251042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9bd1a45d-5ac4-41e2-8e5b-829464de3e92 req-0a619844-a568-4723-a7da-0ae07ae36a7d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.251503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9bd1a45d-5ac4-41e2-8e5b-829464de3e92 req-0a619844-a568-4723-a7da-0ae07ae36a7d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.252381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f095c8f-ee81-41a1-a293-2a5704813adc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.255081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f095c8f-ee81-41a1-a293-2a5704813adc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.257246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f095c8f-ee81-41a1-a293-2a5704813adc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.292717 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9bd1a45d-5ac4-41e2-8e5b-829464de3e92 req-0a619844-a568-4723-a7da-0ae07ae36a7d service nova] Creating event network-changed:c3dcb55c-4cbe-4726-92df-83de60bed473 for instance 0f67abf3-3423-4658-9583-5b5a2957cb1e on n-h2-764485-11 Jul 20 04:23:27.301998 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9bd1a45d-5ac4-41e2-8e5b-829464de3e92 req-0a619844-a568-4723-a7da-0ae07ae36a7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081815 Jul 20 04:23:27.303140 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1617/3166] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:27.310326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3bd4adc5-a0e6-44c1-bf62-a83e6c19dc36 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:27.311243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3bd4adc5-a0e6-44c1-bf62-a83e6c19dc36 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:27.320784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:27.322638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3bd4adc5-a0e6-44c1-bf62-a83e6c19dc36 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.323360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3bd4adc5-a0e6-44c1-bf62-a83e6c19dc36 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.324095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3bd4adc5-a0e6-44c1-bf62-a83e6c19dc36 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.324692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3bd4adc5-a0e6-44c1-bf62-a83e6c19dc36 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.718812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3bd4adc5-a0e6-44c1-bf62-a83e6c19dc36 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:27.723778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3f095c8f-ee81-41a1-a293-2a5704813adc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:27.730967 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3bd4adc5-a0e6-44c1-bf62-a83e6c19dc36 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1682 microversion: 2.1 time: 0.426216 Jul 20 04:23:27.733515 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3f095c8f-ee81-41a1-a293-2a5704813adc tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1316 microversion: 2.1 time: 0.560544 Jul 20 04:23:27.734322 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1618/3167] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:27 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1682 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:27.738076 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1550/3168] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:27 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1316 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:27.744785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6fd3dcef-0799-480c-a466-408f5543ac5d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:27.746181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6fd3dcef-0799-480c-a466-408f5543ac5d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:27.757307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6fd3dcef-0799-480c-a466-408f5543ac5d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.757985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6fd3dcef-0799-480c-a466-408f5543ac5d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.759128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6fd3dcef-0799-480c-a466-408f5543ac5d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.760688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9761e153-07e8-4ad2-8bee-4f78fdbd47eb req-fcf4eb11-9dee-4c6c-b989-78220ffa8b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d992ed51-bb47-460f-a825-bd45481d157e", "name": "network-vif-deleted", "tag": "9cdfc191-27d5-4577-b743-484e29c410e4"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:27.761935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6fd3dcef-0799-480c-a466-408f5543ac5d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.778794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9761e153-07e8-4ad2-8bee-4f78fdbd47eb req-fcf4eb11-9dee-4c6c-b989-78220ffa8b2c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.779263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9761e153-07e8-4ad2-8bee-4f78fdbd47eb req-fcf4eb11-9dee-4c6c-b989-78220ffa8b2c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.812493 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9761e153-07e8-4ad2-8bee-4f78fdbd47eb req-fcf4eb11-9dee-4c6c-b989-78220ffa8b2c service nova] Creating event network-vif-deleted:9cdfc191-27d5-4577-b743-484e29c410e4 for instance d992ed51-bb47-460f-a825-bd45481d157e on n-h2-764485-11 Jul 20 04:23:27.823098 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9761e153-07e8-4ad2-8bee-4f78fdbd47eb req-fcf4eb11-9dee-4c6c-b989-78220ffa8b2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087474 Jul 20 04:23:27.823799 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1619/3169] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:27.838415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d80938e6-45f7-4d86-8682-b730a4d2f203 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:27.839208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d80938e6-45f7-4d86-8682-b730a4d2f203 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:27.864164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d80938e6-45f7-4d86-8682-b730a4d2f203 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.872246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d80938e6-45f7-4d86-8682-b730a4d2f203 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.873598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d80938e6-45f7-4d86-8682-b730a4d2f203 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.874521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d80938e6-45f7-4d86-8682-b730a4d2f203 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.156028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6fd3dcef-0799-480c-a466-408f5543ac5d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:28.169826 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6fd3dcef-0799-480c-a466-408f5543ac5d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.429294 Jul 20 04:23:28.171770 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1551/3170] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:27 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:28.189905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9feb7d18-8401-4a19-83bc-73279d58186f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:28.190596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9feb7d18-8401-4a19-83bc-73279d58186f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [instance: c48fbccd-a6bb-42bd-8472-a224bb30c0b0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:28.198521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9feb7d18-8401-4a19-83bc-73279d58186f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.199183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9feb7d18-8401-4a19-83bc-73279d58186f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.200299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9feb7d18-8401-4a19-83bc-73279d58186f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.201125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9feb7d18-8401-4a19-83bc-73279d58186f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.225616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:28.230031 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-9feb7d18-8401-4a19-83bc-73279d58186f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] HTTP exception thrown: Instance c48fbccd-a6bb-42bd-8472-a224bb30c0b0 could not be found. Jul 20 04:23:28.235691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d80938e6-45f7-4d86-8682-b730a4d2f203 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9feb7d18-8401-4a19-83bc-73279d58186f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Request method failure captured: Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 HTTP/1.1 Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14KsBJQ8x-Zeg8FnA5v6RiaxVho5RtsflPhdBTK9GBLoiGTSONULi6T1hMFqwSwb6n2MczhYuNDI6Mb1G4VCVi3MmWogcUanLm2GXH-fQIIEQbj84C7Xp2oETuIF3iu-d_Z1pWI71741nTFPQ8aDaWhdW4aOEt7_u0kU-yhSZfZSGCI Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 8298da14cfd743539e6421d8f00a3366 Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestBootFromVolume-151918248 Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8298da14cfd743539e6421d8f00a3366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8298da14cfd743539e6421d8f00a3366"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8298da14cfd743539e6421d8f00a3366", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8298da14cfd743539e6421d8f00a3366"}]}] Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestBootFromVolume-151918248 Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 8298da14cfd743539e6421d8f00a3366 Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestBootFromVolume-151918248 Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestBootFromVolume-151918248-project Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 3fd5e2533a994d0fb65c1ede341b7f84 Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestBootFromVolume-151918248-project Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance c48fbccd-a6bb-42bd-8472-a224bb30c0b0 could not be found. Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'c48fbccd-a6bb-42bd-8472-a224bb30c0b0'} Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48fbccd-a6bb-42bd-8472-a224bb30c0b0 could not be found. Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48fbccd-a6bb-42bd-8472-a224bb30c0b0 could not be found. Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:28.239749 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:28.245035 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:28.245035 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:28.245035 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:28.245035 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:28.245035 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:28.245035 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48fbccd-a6bb-42bd-8472-a224bb30c0b0 could not be found. Jul 20 04:23:28.245035 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:28.251340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9feb7d18-8401-4a19-83bc-73279d58186f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Returning 404 to user: Instance c48fbccd-a6bb-42bd-8472-a224bb30c0b0 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:28.252269 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9feb7d18-8401-4a19-83bc-73279d58186f tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0" status: 404 len: 111 microversion: 2.1 time: 0.066415 Jul 20 04:23:28.255907 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1552/3171] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:28 2022] GET /compute/v2.1/servers/c48fbccd-a6bb-42bd-8472-a224bb30c0b0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:28.260415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d80938e6-45f7-4d86-8682-b730a4d2f203 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:28.262217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d80938e6-45f7-4d86-8682-b730a4d2f203 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:28.263132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0e37adfb-d99d-4526-82b0-14cf49cede72 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] Calling method '.version_select at 0x7fbf9c52a160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:28.263713 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d80938e6-45f7-4d86-8682-b730a4d2f203 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.438638 Jul 20 04:23:28.264749 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1620/3172] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:27 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:28.274408 n-d-764485-11 devstack@n-api.service[119807]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0e37adfb-d99d-4526-82b0-14cf49cede72 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [bca7174f-0467-4fc3-b62f-e45d1aa4ab6a] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 04:23:28.274835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:28.685486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c46fc7d7-83b3-4866-a996-c777014a9810 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:28.686801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c46fc7d7-83b3-4866-a996-c777014a9810 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:28.689102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:28.692835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:28.699477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c46fc7d7-83b3-4866-a996-c777014a9810 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.700476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c46fc7d7-83b3-4866-a996-c777014a9810 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.701499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c46fc7d7-83b3-4866-a996-c777014a9810 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.702644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c46fc7d7-83b3-4866-a996-c777014a9810 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.926627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c46fc7d7-83b3-4866-a996-c777014a9810 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:28.936180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c46fc7d7-83b3-4866-a996-c777014a9810 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:28.937671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c46fc7d7-83b3-4866-a996-c777014a9810 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:28.938988 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c46fc7d7-83b3-4866-a996-c777014a9810 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 2949 microversion: 2.32 time: 0.257759 Jul 20 04:23:28.939573 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1621/3173] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:28 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 2949 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:28.944791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8e45eb5e-cd46-48e9-a643-39c23ec0da54 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:28.945440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8e45eb5e-cd46-48e9-a643-39c23ec0da54 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:28.951544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e45eb5e-cd46-48e9-a643-39c23ec0da54 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.952046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e45eb5e-cd46-48e9-a643-39c23ec0da54 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.952933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e45eb5e-cd46-48e9-a643-39c23ec0da54 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.953420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e45eb5e-cd46-48e9-a643-39c23ec0da54 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.101509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8e45eb5e-cd46-48e9-a643-39c23ec0da54 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.109316 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8e45eb5e-cd46-48e9-a643-39c23ec0da54 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1682 microversion: 2.1 time: 0.168786 Jul 20 04:23:29.109893 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1622/3174] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:28 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:29.124191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c5139b66-dea8-4012-83ac-445cb8bfb3e2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:29.124799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c5139b66-dea8-4012-83ac-445cb8bfb3e2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:29.132292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5139b66-dea8-4012-83ac-445cb8bfb3e2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.132785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5139b66-dea8-4012-83ac-445cb8bfb3e2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.133590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5139b66-dea8-4012-83ac-445cb8bfb3e2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.134082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5139b66-dea8-4012-83ac-445cb8bfb3e2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.282362 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [None req-0e37adfb-d99d-4526-82b0-14cf49cede72 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] [bca7174f-0467-4fc3-b62f-e45d1aa4ab6a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58528. Jul 20 04:23:29.284376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c5139b66-dea8-4012-83ac-445cb8bfb3e2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.292753 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c5139b66-dea8-4012-83ac-445cb8bfb3e2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1316 microversion: 2.1 time: 0.172076 Jul 20 04:23:29.304636 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1623/3175] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:29 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:29.310100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-37171683-00fe-43aa-9270-1bf9995e6493 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:29.310552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-37171683-00fe-43aa-9270-1bf9995e6493 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:29.312867 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0e37adfb-d99d-4526-82b0-14cf49cede72 tempest-ServersTestBootFromVolume-151918248 tempest-ServersTestBootFromVolume-151918248-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-78993561" status: 202 len: 0 microversion: 2.1 time: 1.054464 Jul 20 04:23:29.313639 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1553/3176] 10.222.0.20 () {58 vars in 1214 bytes} [Wed Jul 20 04:23:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-78993561 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:23:29.320815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ac208a6-d403-4432-9a9f-759ecbe22bd4 tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0e9ebb22-c831-48f7-8682-044e8603e23a"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:29.322650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ac208a6-d403-4432-9a9f-759ecbe22bd4 tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:29.328300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37171683-00fe-43aa-9270-1bf9995e6493 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.328777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37171683-00fe-43aa-9270-1bf9995e6493 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.329569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37171683-00fe-43aa-9270-1bf9995e6493 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.330031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37171683-00fe-43aa-9270-1bf9995e6493 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.335929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ac208a6-d403-4432-9a9f-759ecbe22bd4 tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.336847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ac208a6-d403-4432-9a9f-759ecbe22bd4 tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.337924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ac208a6-d403-4432-9a9f-759ecbe22bd4 tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.339732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ac208a6-d403-4432-9a9f-759ecbe22bd4 tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.410731 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-1ac208a6-d403-4432-9a9f-759ecbe22bd4 tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] HTTP exception thrown: Volume 5a2e02fe-b722-42dd-899c-175de484a66f could not be found. Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ac208a6-d403-4432-9a9f-759ecbe22bd4 tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Request method failure captured: Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: request: PUT /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5/os-volume_attachments/5a2e02fe-b722-42dd-899c-175de484a66f HTTP/1.1 Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 74 Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14KdV0R237ZQMbUf7p6vFErIgV0KYYRHguNZJv1j6ZYBGhxmD3ABMbjbXHNo7UVx3TYh8-DvcsONrA7-XtOU-udIwnQqPsJUMGkA8ykNhR0P1PXDmN2lGcXAhzfAvmjcEIWuowKqiq7hLOyc0GKtySsPNxOPY-SsKcWvfAq9q4Ggzj8 Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6aec483f5a7d4494953101d944c4d849 Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-VolumesAdminNegativeTest-1467021002 Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6aec483f5a7d4494953101d944c4d849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6aec483f5a7d4494953101d944c4d849"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6aec483f5a7d4494953101d944c4d849", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6aec483f5a7d4494953101d944c4d849"}]}] Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-VolumesAdminNegativeTest-1467021002 Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6aec483f5a7d4494953101d944c4d849 Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1467021002 Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-VolumesAdminNegativeTest-1467021002-project-admin Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 29aa17df12684b16896fe1c65b09e775 Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-VolumesAdminNegativeTest-1467021002-project-admin Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: {"volumeAttachment": {"volumeId": "0e9ebb22-c831-48f7-8682-044e8603e23a"}} Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: exception: Volume 5a2e02fe-b722-42dd-899c-175de484a66f could not be found. Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'server_id': '98588f3c-20c5-42a4-9f79-cf55750977d5', 'id': '5a2e02fe-b722-42dd-899c-175de484a66f', 'body': {'volumeAttachment': {'volumeId': '0e9ebb22-c831-48f7-8682-044e8603e23a'}}} Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5a2e02fe-b722-42dd-899c-175de484a66f could not be found. (HTTP 404) (Request-ID: req-f668f547-22a3-43f3-929b-3d6116746ae8) Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:23:29.414717 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5a2e02fe-b722-42dd-899c-175de484a66f could not be found. Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5a2e02fe-b722-42dd-899c-175de484a66f could not be found. Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5a2e02fe-b722-42dd-899c-175de484a66f could not be found. Jul 20 04:23:29.422453 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.433055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ac208a6-d403-4432-9a9f-759ecbe22bd4 tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] Returning 404 to user: Volume 5a2e02fe-b722-42dd-899c-175de484a66f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:29.434338 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ac208a6-d403-4432-9a9f-759ecbe22bd4 tempest-VolumesAdminNegativeTest-1467021002 tempest-VolumesAdminNegativeTest-1467021002-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5/os-volume_attachments/5a2e02fe-b722-42dd-899c-175de484a66f" status: 404 len: 109 microversion: 2.1 time: 0.119350 Jul 20 04:23:29.435161 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1554/3177] 10.222.0.20 () {60 vars in 1432 bytes} [Wed Jul 20 04:23:29 2022] PUT /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5/os-volume_attachments/5a2e02fe-b722-42dd-899c-175de484a66f => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:29.442906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-370525e9-22b6-491c-b9cd-1144238c318f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:29.444121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-370525e9-22b6-491c-b9cd-1144238c318f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:29.453901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-370525e9-22b6-491c-b9cd-1144238c318f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.454702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-370525e9-22b6-491c-b9cd-1144238c318f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.455910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-370525e9-22b6-491c-b9cd-1144238c318f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.457375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-370525e9-22b6-491c-b9cd-1144238c318f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.492219 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-37171683-00fe-43aa-9270-1bf9995e6493 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.186263 Jul 20 04:23:29.501094 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1624/3178] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Jul 20 04:23:29 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc/os-interface => generated 1830 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:29.506695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e72a534a-19b1-4a0b-8bad-e55176a09c83 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:29.509488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e72a534a-19b1-4a0b-8bad-e55176a09c83 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:29.529655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e72a534a-19b1-4a0b-8bad-e55176a09c83 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.530509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e72a534a-19b1-4a0b-8bad-e55176a09c83 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.532202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e72a534a-19b1-4a0b-8bad-e55176a09c83 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.532877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e72a534a-19b1-4a0b-8bad-e55176a09c83 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.744392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-370525e9-22b6-491c-b9cd-1144238c318f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.754645 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-370525e9-22b6-491c-b9cd-1144238c318f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.317777 Jul 20 04:23:29.756353 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1555/3179] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:29 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:29.785362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e72a534a-19b1-4a0b-8bad-e55176a09c83 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.794692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e72a534a-19b1-4a0b-8bad-e55176a09c83 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.798102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e72a534a-19b1-4a0b-8bad-e55176a09c83 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.800545 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e72a534a-19b1-4a0b-8bad-e55176a09c83 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.297153 Jul 20 04:23:29.811476 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1625/3180] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:29 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:30.127807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-63c4ab71-3d0e-4319-bcdc-778a0fab2e69 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:30.129131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-63c4ab71-3d0e-4319-bcdc-778a0fab2e69 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:30.148479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-63c4ab71-3d0e-4319-bcdc-778a0fab2e69 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:30.148932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-63c4ab71-3d0e-4319-bcdc-778a0fab2e69 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:30.150034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-63c4ab71-3d0e-4319-bcdc-778a0fab2e69 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:30.150653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-63c4ab71-3d0e-4319-bcdc-778a0fab2e69 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:30.334797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1c7dc9e1-b1c9-4e71-8619-b952790c1ab2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:30.338008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1c7dc9e1-b1c9-4e71-8619-b952790c1ab2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:30.357124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c7dc9e1-b1c9-4e71-8619-b952790c1ab2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:30.358170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c7dc9e1-b1c9-4e71-8619-b952790c1ab2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:30.359390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c7dc9e1-b1c9-4e71-8619-b952790c1ab2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:30.360063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c7dc9e1-b1c9-4e71-8619-b952790c1ab2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:30.613222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-63c4ab71-3d0e-4319-bcdc-778a0fab2e69 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:30.633309 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-63c4ab71-3d0e-4319-bcdc-778a0fab2e69 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1682 microversion: 2.1 time: 0.507098 Jul 20 04:23:30.634419 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1556/3181] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:30 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1682 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:30.772771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ef94f480-699c-4fa0-adae-ceb436312e82 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:30.780059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ef94f480-699c-4fa0-adae-ceb436312e82 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:30.796979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef94f480-699c-4fa0-adae-ceb436312e82 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:30.798716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef94f480-699c-4fa0-adae-ceb436312e82 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:30.803357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef94f480-699c-4fa0-adae-ceb436312e82 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:30.805487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef94f480-699c-4fa0-adae-ceb436312e82 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:31.966551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1c7dc9e1-b1c9-4e71-8619-b952790c1ab2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:31.984924 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1c7dc9e1-b1c9-4e71-8619-b952790c1ab2 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1316 microversion: 2.1 time: 1.675482 Jul 20 04:23:31.995338 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1626/3182] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:30 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1316 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:32.011301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02fb6734-31ad-495a-a3f2-737b76655781 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:32.016082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-02fb6734-31ad-495a-a3f2-737b76655781 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:32.036520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02fb6734-31ad-495a-a3f2-737b76655781 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:32.037232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02fb6734-31ad-495a-a3f2-737b76655781 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:32.039060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02fb6734-31ad-495a-a3f2-737b76655781 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:32.048478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02fb6734-31ad-495a-a3f2-737b76655781 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:32.615702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ef94f480-699c-4fa0-adae-ceb436312e82 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:32.647005 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ef94f480-699c-4fa0-adae-ceb436312e82 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 1.878839 Jul 20 04:23:32.652204 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1557/3183] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:30 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:32.662875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-54d5dc3f-f6e3-44dd-8048-684cfd097761 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:32.664840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-54d5dc3f-f6e3-44dd-8048-684cfd097761 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:32.681435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54d5dc3f-f6e3-44dd-8048-684cfd097761 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:32.685454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54d5dc3f-f6e3-44dd-8048-684cfd097761 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:32.692151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54d5dc3f-f6e3-44dd-8048-684cfd097761 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:32.692922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54d5dc3f-f6e3-44dd-8048-684cfd097761 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:32.773158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-02fb6734-31ad-495a-a3f2-737b76655781 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:32.784627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-02fb6734-31ad-495a-a3f2-737b76655781 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:32.787288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-02fb6734-31ad-495a-a3f2-737b76655781 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:32.788887 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-02fb6734-31ad-495a-a3f2-737b76655781 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.792172 Jul 20 04:23:32.789475 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1627/3184] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:31 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:33.010462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a287c56d-eeb8-4c7d-ab5c-e1d1218a824c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:33.011994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a287c56d-eeb8-4c7d-ab5c-e1d1218a824c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:33.026604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a287c56d-eeb8-4c7d-ab5c-e1d1218a824c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.031182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a287c56d-eeb8-4c7d-ab5c-e1d1218a824c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.035704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a287c56d-eeb8-4c7d-ab5c-e1d1218a824c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.036439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a287c56d-eeb8-4c7d-ab5c-e1d1218a824c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.408763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-54d5dc3f-f6e3-44dd-8048-684cfd097761 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:33.428934 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-54d5dc3f-f6e3-44dd-8048-684cfd097761 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1682 microversion: 2.1 time: 0.773721 Jul 20 04:23:33.432020 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1558/3185] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:32 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1682 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:33.495076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a287c56d-eeb8-4c7d-ab5c-e1d1218a824c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:33.506236 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a287c56d-eeb8-4c7d-ab5c-e1d1218a824c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1316 microversion: 2.1 time: 0.506528 Jul 20 04:23:33.515551 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1628/3186] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:32 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:33.546217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c44282ba-ed15-4e77-9b03-c7d7a7a71dab req-26075a3d-fed6-4b6a-b35d-6c8bc963a717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c59ed237-adcb-4557-823c-3c3d67657b15", "name": "network-vif-plugged", "status": "completed", "tag": "4a3848d0-c8d6-4e75-8a99-e7bdf4569a3c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:33.571237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c44282ba-ed15-4e77-9b03-c7d7a7a71dab req-26075a3d-fed6-4b6a-b35d-6c8bc963a717 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.572031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c44282ba-ed15-4e77-9b03-c7d7a7a71dab req-26075a3d-fed6-4b6a-b35d-6c8bc963a717 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.613344 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c44282ba-ed15-4e77-9b03-c7d7a7a71dab req-26075a3d-fed6-4b6a-b35d-6c8bc963a717 service nova] Creating event network-vif-plugged:4a3848d0-c8d6-4e75-8a99-e7bdf4569a3c for instance c59ed237-adcb-4557-823c-3c3d67657b15 on n-h1-764485-11 Jul 20 04:23:33.622017 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c44282ba-ed15-4e77-9b03-c7d7a7a71dab req-26075a3d-fed6-4b6a-b35d-6c8bc963a717 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079781 Jul 20 04:23:33.624259 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1559/3187] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:33.669026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-22baa6c4-bedf-45e2-b17c-eb9851adc8f7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:33.669685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-22baa6c4-bedf-45e2-b17c-eb9851adc8f7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:33.679296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22baa6c4-bedf-45e2-b17c-eb9851adc8f7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.680571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22baa6c4-bedf-45e2-b17c-eb9851adc8f7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.681382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22baa6c4-bedf-45e2-b17c-eb9851adc8f7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.681875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22baa6c4-bedf-45e2-b17c-eb9851adc8f7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.811742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9fc795e3-8c98-4904-a402-91da333a280a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:33.812844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9fc795e3-8c98-4904-a402-91da333a280a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:33.835167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9fc795e3-8c98-4904-a402-91da333a280a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.835652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9fc795e3-8c98-4904-a402-91da333a280a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.836466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9fc795e3-8c98-4904-a402-91da333a280a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.836911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9fc795e3-8c98-4904-a402-91da333a280a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.267775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-22baa6c4-bedf-45e2-b17c-eb9851adc8f7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:34.280059 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-22baa6c4-bedf-45e2-b17c-eb9851adc8f7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.614933 Jul 20 04:23:34.280669 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1629/3188] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:33 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:34.288635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ab5fd773-9aac-47fb-9028-3b28fb93824b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:34.289154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ab5fd773-9aac-47fb-9028-3b28fb93824b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:34.321657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab5fd773-9aac-47fb-9028-3b28fb93824b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.330391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab5fd773-9aac-47fb-9028-3b28fb93824b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.332052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab5fd773-9aac-47fb-9028-3b28fb93824b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.332519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab5fd773-9aac-47fb-9028-3b28fb93824b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.390837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ab5fd773-9aac-47fb-9028-3b28fb93824b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:34.481561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9fc795e3-8c98-4904-a402-91da333a280a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:34.498464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9fc795e3-8c98-4904-a402-91da333a280a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:34.501773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9fc795e3-8c98-4904-a402-91da333a280a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:34.504383 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9fc795e3-8c98-4904-a402-91da333a280a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.698262 Jul 20 04:23:34.507542 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1560/3189] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:33 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:34.522974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1a6eabcd-5b39-405b-9e31-07b3cf77c0ab tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:34.526022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1a6eabcd-5b39-405b-9e31-07b3cf77c0ab tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:34.544663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a6eabcd-5b39-405b-9e31-07b3cf77c0ab tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.546692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a6eabcd-5b39-405b-9e31-07b3cf77c0ab tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.547754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a6eabcd-5b39-405b-9e31-07b3cf77c0ab tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.550923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a6eabcd-5b39-405b-9e31-07b3cf77c0ab tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.588066 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ab5fd773-9aac-47fb-9028-3b28fb93824b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "DELETE /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 204 len: 0 microversion: 2.1 time: 0.306039 Jul 20 04:23:34.592002 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1630/3190] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:34 2022] DELETE /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:34.598154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4a81480c-3d69-4685-9af1-374260800fae tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:34.599088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4a81480c-3d69-4685-9af1-374260800fae tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:34.611060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a81480c-3d69-4685-9af1-374260800fae tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.614748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a81480c-3d69-4685-9af1-374260800fae tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.621069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a81480c-3d69-4685-9af1-374260800fae tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.621754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a81480c-3d69-4685-9af1-374260800fae tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.821598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1a6eabcd-5b39-405b-9e31-07b3cf77c0ab tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:34.835400 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1a6eabcd-5b39-405b-9e31-07b3cf77c0ab tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1615 microversion: 2.1 time: 0.323803 Jul 20 04:23:34.836455 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1561/3191] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:34 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1615 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:34.844889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-321ad896-3caf-433e-9a0d-7991a2459817 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:34.851000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-321ad896-3caf-433e-9a0d-7991a2459817 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:34.853872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:34.867177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-321ad896-3caf-433e-9a0d-7991a2459817 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.867672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-321ad896-3caf-433e-9a0d-7991a2459817 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.868673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-321ad896-3caf-433e-9a0d-7991a2459817 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.869118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-321ad896-3caf-433e-9a0d-7991a2459817 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.144953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4a81480c-3d69-4685-9af1-374260800fae tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:35.153539 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4a81480c-3d69-4685-9af1-374260800fae tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1316 microversion: 2.1 time: 0.559967 Jul 20 04:23:35.154148 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1631/3192] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:34 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:35.298440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-199ca4f4-6433-4d5a-80ae-a7fc35de85ca tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:35.299285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-199ca4f4-6433-4d5a-80ae-a7fc35de85ca tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:35.305800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-199ca4f4-6433-4d5a-80ae-a7fc35de85ca tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.306252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-199ca4f4-6433-4d5a-80ae-a7fc35de85ca tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.307069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-199ca4f4-6433-4d5a-80ae-a7fc35de85ca tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.308115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-199ca4f4-6433-4d5a-80ae-a7fc35de85ca tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.337612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-321ad896-3caf-433e-9a0d-7991a2459817 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:35.345906 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-321ad896-3caf-433e-9a0d-7991a2459817 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1513 microversion: 2.1 time: 0.506754 Jul 20 04:23:35.347895 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1562/3193] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:34 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1513 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:35.534363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c79db4d5-a97b-47ee-81f3-7ee410b2607e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:35.534999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c79db4d5-a97b-47ee-81f3-7ee410b2607e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:35.547637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c79db4d5-a97b-47ee-81f3-7ee410b2607e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.548110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c79db4d5-a97b-47ee-81f3-7ee410b2607e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.548981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c79db4d5-a97b-47ee-81f3-7ee410b2607e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.552373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c79db4d5-a97b-47ee-81f3-7ee410b2607e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.553415 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:23:35.553714 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 04:23:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f (ip 10.222.0.20) !!! Jul 20 04:23:35.970046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-199ca4f4-6433-4d5a-80ae-a7fc35de85ca tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:35.981678 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-199ca4f4-6433-4d5a-80ae-a7fc35de85ca tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.686422 Jul 20 04:23:35.992977 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1632/3194] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:35 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:36.001160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-7486ee44-0289-4a9d-b45c-5ccae5e2ada8 req-e902802d-d978-49f1-ba5a-773b0eb419eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70e7012-a311-486b-9035-cb4ccdd2afde", "name": "network-vif-deleted", "tag": "e163d8ed-10b5-4120-bc98-b65fc837fe7f"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:36.014840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7486ee44-0289-4a9d-b45c-5ccae5e2ada8 req-e902802d-d978-49f1-ba5a-773b0eb419eb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.015294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7486ee44-0289-4a9d-b45c-5ccae5e2ada8 req-e902802d-d978-49f1-ba5a-773b0eb419eb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.034031 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7486ee44-0289-4a9d-b45c-5ccae5e2ada8 req-e902802d-d978-49f1-ba5a-773b0eb419eb service nova] Creating event network-vif-deleted:e163d8ed-10b5-4120-bc98-b65fc837fe7f for instance a70e7012-a311-486b-9035-cb4ccdd2afde on n-h1-764485-11 Jul 20 04:23:36.041546 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-7486ee44-0289-4a9d-b45c-5ccae5e2ada8 req-e902802d-d978-49f1-ba5a-773b0eb419eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046383 Jul 20 04:23:36.042418 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1633/3195] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:36.047801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-617bd761-ae7c-4d91-8158-0c6a8ce6d657 req-3635ee34-cfff-4de9-9001-840367d492de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f67abf3-3423-4658-9583-5b5a2957cb1e", "name": "network-vif-plugged", "status": "completed", "tag": "c3dcb55c-4cbe-4726-92df-83de60bed473"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:36.059764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-617bd761-ae7c-4d91-8158-0c6a8ce6d657 req-3635ee34-cfff-4de9-9001-840367d492de service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.060398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-617bd761-ae7c-4d91-8158-0c6a8ce6d657 req-3635ee34-cfff-4de9-9001-840367d492de service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.064844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:36.076027 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-617bd761-ae7c-4d91-8158-0c6a8ce6d657 req-3635ee34-cfff-4de9-9001-840367d492de service nova] Creating event network-vif-plugged:c3dcb55c-4cbe-4726-92df-83de60bed473 for instance 0f67abf3-3423-4658-9583-5b5a2957cb1e on n-h2-764485-11 Jul 20 04:23:36.081444 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-617bd761-ae7c-4d91-8158-0c6a8ce6d657 req-3635ee34-cfff-4de9-9001-840367d492de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037628 Jul 20 04:23:36.083881 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1634/3196] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:36.092786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3f09e0ed-cb00-4c15-8769-11ca57b6b8f2 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:36.093731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3f09e0ed-cb00-4c15-8769-11ca57b6b8f2 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:36.103754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f09e0ed-cb00-4c15-8769-11ca57b6b8f2 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.105244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f09e0ed-cb00-4c15-8769-11ca57b6b8f2 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.106264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f09e0ed-cb00-4c15-8769-11ca57b6b8f2 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.106895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f09e0ed-cb00-4c15-8769-11ca57b6b8f2 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.125419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c79db4d5-a97b-47ee-81f3-7ee410b2607e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.136416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c79db4d5-a97b-47ee-81f3-7ee410b2607e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.140185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c79db4d5-a97b-47ee-81f3-7ee410b2607e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.147798 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c79db4d5-a97b-47ee-81f3-7ee410b2607e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1484 microversion: 2.25 time: 0.624897 Jul 20 04:23:36.150965 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1563/3197] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:35 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1484 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:36.160624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f09e0ed-cb00-4c15-8769-11ca57b6b8f2 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.161366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f09e0ed-cb00-4c15-8769-11ca57b6b8f2 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.161978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-3f09e0ed-cb00-4c15-8769-11ca57b6b8f2 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lazy-loading 'fault' on Instance uuid a70e7012-a311-486b-9035-cb4ccdd2afde {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:36.173612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2c19474-51ae-4e11-a9be-bdc7e7a384e6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:36.177253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a2c19474-51ae-4e11-a9be-bdc7e7a384e6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:36.206740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2c19474-51ae-4e11-a9be-bdc7e7a384e6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.208531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2c19474-51ae-4e11-a9be-bdc7e7a384e6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.210405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2c19474-51ae-4e11-a9be-bdc7e7a384e6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.211182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2c19474-51ae-4e11-a9be-bdc7e7a384e6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.240439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3f09e0ed-cb00-4c15-8769-11ca57b6b8f2 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539fabc30c7c4ece81c9092dc26fde22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6203ba93464a3fa1d3d43e5162719b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.258869 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3f09e0ed-cb00-4c15-8769-11ca57b6b8f2 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 200 len: 1332 microversion: 2.1 time: 0.163183 Jul 20 04:23:36.259893 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1635/3198] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:36 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 1332 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:36.366664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7f65c599-69b9-41f9-8ef0-ed34a8897fc4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:36.367312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7f65c599-69b9-41f9-8ef0-ed34a8897fc4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:36.373907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f65c599-69b9-41f9-8ef0-ed34a8897fc4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.374693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f65c599-69b9-41f9-8ef0-ed34a8897fc4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.375815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f65c599-69b9-41f9-8ef0-ed34a8897fc4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.377174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f65c599-69b9-41f9-8ef0-ed34a8897fc4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.725932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a2c19474-51ae-4e11-a9be-bdc7e7a384e6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.737292 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2c19474-51ae-4e11-a9be-bdc7e7a384e6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1316 microversion: 2.1 time: 0.569483 Jul 20 04:23:36.737906 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1564/3199] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:36 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:36.863332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7f65c599-69b9-41f9-8ef0-ed34a8897fc4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.871269 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7f65c599-69b9-41f9-8ef0-ed34a8897fc4 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1513 microversion: 2.1 time: 0.510202 Jul 20 04:23:36.871899 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1636/3200] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:36 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1513 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:37.001866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59f9b632-4b32-4785-a68d-dbfd73b2b8d7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.003248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-59f9b632-4b32-4785-a68d-dbfd73b2b8d7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.011379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59f9b632-4b32-4785-a68d-dbfd73b2b8d7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.012129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59f9b632-4b32-4785-a68d-dbfd73b2b8d7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.013047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59f9b632-4b32-4785-a68d-dbfd73b2b8d7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.013674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59f9b632-4b32-4785-a68d-dbfd73b2b8d7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.140830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-232ca963-a983-49a1-a8f4-308e032fc48a req-fc4fa158-b782-43b4-adbe-0ec8f67d1a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98588f3c-20c5-42a4-9f79-cf55750977d5", "name": "network-vif-deleted", "tag": "2742784c-b94a-4677-bfd8-f7b559678bc9"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:37.156173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-232ca963-a983-49a1-a8f4-308e032fc48a req-fc4fa158-b782-43b4-adbe-0ec8f67d1a25 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.156890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-232ca963-a983-49a1-a8f4-308e032fc48a req-fc4fa158-b782-43b4-adbe-0ec8f67d1a25 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.170463 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-232ca963-a983-49a1-a8f4-308e032fc48a req-fc4fa158-b782-43b4-adbe-0ec8f67d1a25 service nova] Creating event network-vif-deleted:2742784c-b94a-4677-bfd8-f7b559678bc9 for instance 98588f3c-20c5-42a4-9f79-cf55750977d5 on n-h2-764485-11 Jul 20 04:23:37.177763 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-232ca963-a983-49a1-a8f4-308e032fc48a req-fc4fa158-b782-43b4-adbe-0ec8f67d1a25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040425 Jul 20 04:23:37.178406 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1637/3201] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:23:37.183706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39d6b59e-79df-4e66-b35f-48df2e9219be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.184422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-39d6b59e-79df-4e66-b35f-48df2e9219be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.196585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39d6b59e-79df-4e66-b35f-48df2e9219be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.197036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39d6b59e-79df-4e66-b35f-48df2e9219be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.198016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39d6b59e-79df-4e66-b35f-48df2e9219be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.198421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39d6b59e-79df-4e66-b35f-48df2e9219be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.225996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-59f9b632-4b32-4785-a68d-dbfd73b2b8d7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:37.242309 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-59f9b632-4b32-4785-a68d-dbfd73b2b8d7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.245356 Jul 20 04:23:37.243187 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1565/3202] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:36 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:37.278230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3e4f2509-7a46-42d5-baeb-225de5197e02 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.279170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3e4f2509-7a46-42d5-baeb-225de5197e02 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.286060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e4f2509-7a46-42d5-baeb-225de5197e02 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.287202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e4f2509-7a46-42d5-baeb-225de5197e02 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.288254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e4f2509-7a46-42d5-baeb-225de5197e02 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.288664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e4f2509-7a46-42d5-baeb-225de5197e02 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.306571 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-3e4f2509-7a46-42d5-baeb-225de5197e02 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] HTTP exception thrown: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3e4f2509-7a46-42d5-baeb-225de5197e02 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Request method failure captured: Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde HTTP/1.1 Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14JndUCVxyxnfvC_hbZZyFnBg3Lup8EJGxFDpYvqzTkKEWHaLK9UuN4-MpzmdmZA6TP8hpG6-r8RkU6imv0QmWh8EPFeX6xjtfwGxACDoP9me0DTJ2G3aTSa2azKfvIDbq6WEk_HYguBAy6WuV4DQZ0Gb2NpglUeb6TbTN9lX9ozG4Q Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: dc6203ba93464a3fa1d3d43e5162719b Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-415125591 Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc6203ba93464a3fa1d3d43e5162719b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc6203ba93464a3fa1d3d43e5162719b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc6203ba93464a3fa1d3d43e5162719b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc6203ba93464a3fa1d3d43e5162719b"}]}] Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-415125591 Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: dc6203ba93464a3fa1d3d43e5162719b Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-415125591 Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachSCSIVolumeTestJSON-415125591-project Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 539fabc30c7c4ece81c9092dc26fde22 Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-415125591-project Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a70e7012-a311-486b-9035-cb4ccdd2afde'} Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:37.308504 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:37.313928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:37.313928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:37.313928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:37.313928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:37.313928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:37.313928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:37.313928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:37.316284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3e4f2509-7a46-42d5-baeb-225de5197e02 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Returning 404 to user: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:37.317507 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3e4f2509-7a46-42d5-baeb-225de5197e02 tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 404 len: 111 microversion: 2.1 time: 0.044049 Jul 20 04:23:37.318721 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1566/3203] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:37.329181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eda36073-b874-41ca-a9bd-77aa5128054c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '.version_select at 0x7fbf9c4ccd30>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.375712 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eda36073-b874-41ca-a9bd-77aa5128054c tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1039209220" status: 202 len: 0 microversion: 2.1 time: 0.051985 Jul 20 04:23:37.377212 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1567/3204] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 04:23:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1039209220 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:23:37.384588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39d6b59e-79df-4e66-b35f-48df2e9219be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:37.397885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39d6b59e-79df-4e66-b35f-48df2e9219be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:37.405479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39d6b59e-79df-4e66-b35f-48df2e9219be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:37.406730 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39d6b59e-79df-4e66-b35f-48df2e9219be tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1474 microversion: 2.25 time: 0.227229 Jul 20 04:23:37.412081 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1638/3205] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1474 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:37.428010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0ecde812-64a4-48b2-8907-fa84127d5d89 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '.version_select at 0x7fbf9c5d2a60>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.431563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ecde812-64a4-48b2-8907-fa84127d5d89 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.432817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ecde812-64a4-48b2-8907-fa84127d5d89 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.449215 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0ecde812-64a4-48b2-8907-fa84127d5d89 tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1961 microversion: 2.25 time: 0.027021 Jul 20 04:23:37.450591 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1568/3206] 10.222.0.20 () {60 vars in 1183 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/os-migrations => generated 1961 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:37.462460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-51407fd0-3f28-4beb-aea0-4bd73c381c7c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.463344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-51407fd0-3f28-4beb-aea0-4bd73c381c7c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.470129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51407fd0-3f28-4beb-aea0-4bd73c381c7c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.471116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51407fd0-3f28-4beb-aea0-4bd73c381c7c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.472144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51407fd0-3f28-4beb-aea0-4bd73c381c7c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.472861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51407fd0-3f28-4beb-aea0-4bd73c381c7c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.673254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-51407fd0-3f28-4beb-aea0-4bd73c381c7c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] Lazy-loading 'services' on Instance uuid 588d4bae-3e12-4c79-81c7-b6223cb6dacc {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:37.706405 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-51407fd0-3f28-4beb-aea0-4bd73c381c7c tempest-LiveAutoBlockMigrationV225Test-1550681687 tempest-LiveAutoBlockMigrationV225Test-1550681687-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1966 microversion: 2.25 time: 0.246888 Jul 20 04:23:37.707358 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1639/3207] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1966 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:37.742130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d7ae8bae-83ff-49c7-9306-0bf467b51182 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.743079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d7ae8bae-83ff-49c7-9306-0bf467b51182 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.755224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b85e1ba2-66b1-4f11-a651-e1d461460fc6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.755870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b85e1ba2-66b1-4f11-a651-e1d461460fc6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.765138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b85e1ba2-66b1-4f11-a651-e1d461460fc6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.765696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b85e1ba2-66b1-4f11-a651-e1d461460fc6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.766565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b85e1ba2-66b1-4f11-a651-e1d461460fc6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.767151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b85e1ba2-66b1-4f11-a651-e1d461460fc6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.767358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7ae8bae-83ff-49c7-9306-0bf467b51182 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.768176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7ae8bae-83ff-49c7-9306-0bf467b51182 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.769348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7ae8bae-83ff-49c7-9306-0bf467b51182 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.770145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7ae8bae-83ff-49c7-9306-0bf467b51182 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.836714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d7ae8bae-83ff-49c7-9306-0bf467b51182 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:37.944470 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d7ae8bae-83ff-49c7-9306-0bf467b51182 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "DELETE /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 204 len: 0 microversion: 2.25 time: 0.207586 Jul 20 04:23:37.954095 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1569/3208] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:23:37 2022] DELETE /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:23:37.960587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-20a8e383-c705-4b01-84dd-cfe3166a7840 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.961913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-20a8e383-c705-4b01-84dd-cfe3166a7840 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.978415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20a8e383-c705-4b01-84dd-cfe3166a7840 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.988057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20a8e383-c705-4b01-84dd-cfe3166a7840 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.990453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20a8e383-c705-4b01-84dd-cfe3166a7840 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.991175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20a8e383-c705-4b01-84dd-cfe3166a7840 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.016291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:38.099287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-20a8e383-c705-4b01-84dd-cfe3166a7840 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.108766 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-20a8e383-c705-4b01-84dd-cfe3166a7840 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1471 microversion: 2.1 time: 0.152314 Jul 20 04:23:38.119495 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1570/3209] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:38.119495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4318e6c4-7194-4842-ba30-829c5dd51a71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:38.119495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4318e6c4-7194-4842-ba30-829c5dd51a71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:38.128077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4318e6c4-7194-4842-ba30-829c5dd51a71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.128833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4318e6c4-7194-4842-ba30-829c5dd51a71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.129842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4318e6c4-7194-4842-ba30-829c5dd51a71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.130316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4318e6c4-7194-4842-ba30-829c5dd51a71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.187111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b85e1ba2-66b1-4f11-a651-e1d461460fc6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.199631 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b85e1ba2-66b1-4f11-a651-e1d461460fc6 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1316 microversion: 2.1 time: 0.448224 Jul 20 04:23:38.200336 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1640/3210] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:38.260801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-196601a4-65e8-4e27-9d93-f971df7e43c0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:38.261544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-196601a4-65e8-4e27-9d93-f971df7e43c0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:38.269914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-196601a4-65e8-4e27-9d93-f971df7e43c0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.270662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-196601a4-65e8-4e27-9d93-f971df7e43c0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.271681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-196601a4-65e8-4e27-9d93-f971df7e43c0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.272314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-196601a4-65e8-4e27-9d93-f971df7e43c0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.406533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4318e6c4-7194-4842-ba30-829c5dd51a71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.420673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4318e6c4-7194-4842-ba30-829c5dd51a71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.422195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4318e6c4-7194-4842-ba30-829c5dd51a71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.423378 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4318e6c4-7194-4842-ba30-829c5dd51a71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1480 microversion: 2.25 time: 0.312077 Jul 20 04:23:38.426470 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1571/3211] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:38 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1480 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:38.626016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-196601a4-65e8-4e27-9d93-f971df7e43c0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.642036 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-196601a4-65e8-4e27-9d93-f971df7e43c0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.385715 Jul 20 04:23:38.644122 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1641/3212] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:38 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:39.126630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1d3d942e-56df-4fc8-9605-e90f907bd8ed tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.127190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1d3d942e-56df-4fc8-9605-e90f907bd8ed tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:39.134487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d3d942e-56df-4fc8-9605-e90f907bd8ed tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.134919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d3d942e-56df-4fc8-9605-e90f907bd8ed tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.136080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d3d942e-56df-4fc8-9605-e90f907bd8ed tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.136510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d3d942e-56df-4fc8-9605-e90f907bd8ed tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.210310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1d3d942e-56df-4fc8-9605-e90f907bd8ed tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:39.220141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7cb34a79-905f-40b6-8486-33e0167713b4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.223385 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1d3d942e-56df-4fc8-9605-e90f907bd8ed tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1302 microversion: 2.1 time: 0.100852 Jul 20 04:23:39.224014 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1572/3213] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:39 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:39.228688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7cb34a79-905f-40b6-8486-33e0167713b4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:39.237828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cb34a79-905f-40b6-8486-33e0167713b4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.241685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cb34a79-905f-40b6-8486-33e0167713b4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.242530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cb34a79-905f-40b6-8486-33e0167713b4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.243020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cb34a79-905f-40b6-8486-33e0167713b4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.408393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7cb34a79-905f-40b6-8486-33e0167713b4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:39.416994 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7cb34a79-905f-40b6-8486-33e0167713b4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1316 microversion: 2.1 time: 0.202416 Jul 20 04:23:39.417780 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1642/3214] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:39 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:39.446574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a018916e-9727-4be6-80aa-ec0550b880bb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.448932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a018916e-9727-4be6-80aa-ec0550b880bb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:39.456653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a018916e-9727-4be6-80aa-ec0550b880bb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.457283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a018916e-9727-4be6-80aa-ec0550b880bb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.458294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a018916e-9727-4be6-80aa-ec0550b880bb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.458915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a018916e-9727-4be6-80aa-ec0550b880bb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.657808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a018916e-9727-4be6-80aa-ec0550b880bb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:39.662430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-78b0c59f-3214-4103-bebf-de2d490f2445 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.664625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-78b0c59f-3214-4103-bebf-de2d490f2445 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:39.672340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a018916e-9727-4be6-80aa-ec0550b880bb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:39.674497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a018916e-9727-4be6-80aa-ec0550b880bb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:39.676757 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a018916e-9727-4be6-80aa-ec0550b880bb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1480 microversion: 2.25 time: 0.235898 Jul 20 04:23:39.677879 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1573/3215] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:39 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1480 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:39.683493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78b0c59f-3214-4103-bebf-de2d490f2445 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.684127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78b0c59f-3214-4103-bebf-de2d490f2445 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.685073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78b0c59f-3214-4103-bebf-de2d490f2445 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.685526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78b0c59f-3214-4103-bebf-de2d490f2445 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.864866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-78b0c59f-3214-4103-bebf-de2d490f2445 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:39.876158 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-78b0c59f-3214-4103-bebf-de2d490f2445 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.219357 Jul 20 04:23:39.877611 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1643/3216] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:39 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:40.241821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9443dd6e-8bd5-421d-9236-aaf9891cb1c8 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:40.242541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9443dd6e-8bd5-421d-9236-aaf9891cb1c8 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:40.255533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9443dd6e-8bd5-421d-9236-aaf9891cb1c8 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.256335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9443dd6e-8bd5-421d-9236-aaf9891cb1c8 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.257276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9443dd6e-8bd5-421d-9236-aaf9891cb1c8 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.258030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9443dd6e-8bd5-421d-9236-aaf9891cb1c8 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.309532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9443dd6e-8bd5-421d-9236-aaf9891cb1c8 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.309990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9443dd6e-8bd5-421d-9236-aaf9891cb1c8 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.310727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-9443dd6e-8bd5-421d-9236-aaf9891cb1c8 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lazy-loading 'fault' on Instance uuid 98588f3c-20c5-42a4-9f79-cf55750977d5 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:40.391390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9443dd6e-8bd5-421d-9236-aaf9891cb1c8 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:40.405470 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9443dd6e-8bd5-421d-9236-aaf9891cb1c8 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1307 microversion: 2.1 time: 0.168705 Jul 20 04:23:40.406471 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1574/3217] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:40 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1307 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:40.434181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39853dbb-2d42-4625-90c2-cea9b272e0f9 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:40.434822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-39853dbb-2d42-4625-90c2-cea9b272e0f9 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:40.449935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39853dbb-2d42-4625-90c2-cea9b272e0f9 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.450403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39853dbb-2d42-4625-90c2-cea9b272e0f9 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.463649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39853dbb-2d42-4625-90c2-cea9b272e0f9 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.464479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39853dbb-2d42-4625-90c2-cea9b272e0f9 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.695865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-da29e73a-266a-4a74-aae5-686ced6de7bd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:40.696554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-da29e73a-266a-4a74-aae5-686ced6de7bd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:40.703304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da29e73a-266a-4a74-aae5-686ced6de7bd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.703985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da29e73a-266a-4a74-aae5-686ced6de7bd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.705094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da29e73a-266a-4a74-aae5-686ced6de7bd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.706619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da29e73a-266a-4a74-aae5-686ced6de7bd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.711415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39853dbb-2d42-4625-90c2-cea9b272e0f9 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:40.725701 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39853dbb-2d42-4625-90c2-cea9b272e0f9 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1503 microversion: 2.1 time: 0.295098 Jul 20 04:23:40.736842 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1644/3218] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:40 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1503 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:40.746979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-76a20965-c0ba-439a-85ae-eae0f09b7a9f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:40.748328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-76a20965-c0ba-439a-85ae-eae0f09b7a9f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: c59ed237-adcb-4557-823c-3c3d67657b15] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:40.756520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76a20965-c0ba-439a-85ae-eae0f09b7a9f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.757554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76a20965-c0ba-439a-85ae-eae0f09b7a9f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.758378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76a20965-c0ba-439a-85ae-eae0f09b7a9f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.758827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76a20965-c0ba-439a-85ae-eae0f09b7a9f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.068298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-da29e73a-266a-4a74-aae5-686ced6de7bd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.079118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-da29e73a-266a-4a74-aae5-686ced6de7bd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.081739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-da29e73a-266a-4a74-aae5-686ced6de7bd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.082963 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-da29e73a-266a-4a74-aae5-686ced6de7bd tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1480 microversion: 2.25 time: 0.392087 Jul 20 04:23:41.083615 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1575/3219] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:40 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1480 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:41.089662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-28901aea-0539-45a2-b884-1f5158775808 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:41.090656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-28901aea-0539-45a2-b884-1f5158775808 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:41.099677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28901aea-0539-45a2-b884-1f5158775808 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.100351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28901aea-0539-45a2-b884-1f5158775808 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.101144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28901aea-0539-45a2-b884-1f5158775808 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.101757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28901aea-0539-45a2-b884-1f5158775808 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.124595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-76a20965-c0ba-439a-85ae-eae0f09b7a9f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.141254 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-76a20965-c0ba-439a-85ae-eae0f09b7a9f tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15" status: 200 len: 1504 microversion: 2.1 time: 0.399735 Jul 20 04:23:41.143148 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1645/3220] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:40 2022] GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15 => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:41.161714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b34041c7-da93-4941-845d-70eac2b7e783 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:41.162217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b34041c7-da93-4941-845d-70eac2b7e783 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: c59ed237-adcb-4557-823c-3c3d67657b15] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:41.168726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b34041c7-da93-4941-845d-70eac2b7e783 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.169257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b34041c7-da93-4941-845d-70eac2b7e783 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.170106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b34041c7-da93-4941-845d-70eac2b7e783 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.170644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b34041c7-da93-4941-845d-70eac2b7e783 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.202471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b34041c7-da93-4941-845d-70eac2b7e783 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: c59ed237-adcb-4557-823c-3c3d67657b15] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:41.336789 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b34041c7-da93-4941-845d-70eac2b7e783 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15" status: 204 len: 0 microversion: 2.1 time: 0.176877 Jul 20 04:23:41.339053 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1646/3221] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:41 2022] DELETE /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:23:41.347829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-28901aea-0539-45a2-b884-1f5158775808 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.358070 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-28901aea-0539-45a2-b884-1f5158775808 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.273217 Jul 20 04:23:41.358255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aa65c962-c9c9-44cd-b858-bf51e33eb6e8 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:41.358663 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1576/3222] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:41 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:41.359271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aa65c962-c9c9-44cd-b858-bf51e33eb6e8 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:41.375955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa65c962-c9c9-44cd-b858-bf51e33eb6e8 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.376685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa65c962-c9c9-44cd-b858-bf51e33eb6e8 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.378452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa65c962-c9c9-44cd-b858-bf51e33eb6e8 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.381377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa65c962-c9c9-44cd-b858-bf51e33eb6e8 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.424983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e8f999cb-4791-4ba3-9b5b-9753d45bd03b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:41.425943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e8f999cb-4791-4ba3-9b5b-9753d45bd03b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:41.429812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aa65c962-c9c9-44cd-b858-bf51e33eb6e8 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:41.434553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8f999cb-4791-4ba3-9b5b-9753d45bd03b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.437306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8f999cb-4791-4ba3-9b5b-9753d45bd03b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.438287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8f999cb-4791-4ba3-9b5b-9753d45bd03b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.440144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8f999cb-4791-4ba3-9b5b-9753d45bd03b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.514423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8f999cb-4791-4ba3-9b5b-9753d45bd03b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.515143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8f999cb-4791-4ba3-9b5b-9753d45bd03b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.515882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-e8f999cb-4791-4ba3-9b5b-9753d45bd03b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lazy-loading 'fault' on Instance uuid 98588f3c-20c5-42a4-9f79-cf55750977d5 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:41.553288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:41.603397 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aa65c962-c9c9-44cd-b858-bf51e33eb6e8 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 204 len: 0 microversion: 2.1 time: 0.255142 Jul 20 04:23:41.610316 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1647/3223] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:41 2022] DELETE /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:41.620743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e8f999cb-4791-4ba3-9b5b-9753d45bd03b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.622541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9a903e5c-1d70-456d-88ab-59e2dbaacb1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:41.624028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9a903e5c-1d70-456d-88ab-59e2dbaacb1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: c59ed237-adcb-4557-823c-3c3d67657b15] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:41.633874 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e8f999cb-4791-4ba3-9b5b-9753d45bd03b tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1307 microversion: 2.1 time: 0.214413 Jul 20 04:23:41.635947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a903e5c-1d70-456d-88ab-59e2dbaacb1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.636421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a903e5c-1d70-456d-88ab-59e2dbaacb1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.637227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a903e5c-1d70-456d-88ab-59e2dbaacb1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.637732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a903e5c-1d70-456d-88ab-59e2dbaacb1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.650526 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1577/3224] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:41 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:41.682163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:41.871626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e5482e15-eec6-4f74-a29e-9c8830b3e444 req-37b297d6-dc1a-42b4-bc17-c23bb7caf4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588d4bae-3e12-4c79-81c7-b6223cb6dacc", "name": "network-vif-deleted", "tag": "5397e4d6-56be-4b85-aca3-b4aa19f1e755"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:41.882397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e5482e15-eec6-4f74-a29e-9c8830b3e444 req-37b297d6-dc1a-42b4-bc17-c23bb7caf4a7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.889356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e5482e15-eec6-4f74-a29e-9c8830b3e444 req-37b297d6-dc1a-42b4-bc17-c23bb7caf4a7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.910999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9a903e5c-1d70-456d-88ab-59e2dbaacb1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.915546 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e5482e15-eec6-4f74-a29e-9c8830b3e444 req-37b297d6-dc1a-42b4-bc17-c23bb7caf4a7 service nova] Creating event network-vif-deleted:5397e4d6-56be-4b85-aca3-b4aa19f1e755 for instance 588d4bae-3e12-4c79-81c7-b6223cb6dacc on n-h2-764485-11 Jul 20 04:23:41.920037 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9a903e5c-1d70-456d-88ab-59e2dbaacb1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15" status: 200 len: 1510 microversion: 2.1 time: 0.308072 Jul 20 04:23:41.921316 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1648/3225] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:41 2022] GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15 => generated 1510 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:41.932933 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e5482e15-eec6-4f74-a29e-9c8830b3e444 req-37b297d6-dc1a-42b4-bc17-c23bb7caf4a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064781 Jul 20 04:23:41.933923 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1578/3226] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:42.103349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6ccafc2a-6320-498d-8019-760a8f497cbf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.104078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6ccafc2a-6320-498d-8019-760a8f497cbf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.112133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ccafc2a-6320-498d-8019-760a8f497cbf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.113674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ccafc2a-6320-498d-8019-760a8f497cbf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.114590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ccafc2a-6320-498d-8019-760a8f497cbf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.115409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ccafc2a-6320-498d-8019-760a8f497cbf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.216831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6ccafc2a-6320-498d-8019-760a8f497cbf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:42.226680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6ccafc2a-6320-498d-8019-760a8f497cbf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:42.228611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6ccafc2a-6320-498d-8019-760a8f497cbf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:42.230261 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6ccafc2a-6320-498d-8019-760a8f497cbf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1438 microversion: 2.25 time: 0.131324 Jul 20 04:23:42.239199 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1649/3227] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1438 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:42.380365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a83846d9-b4c1-4dea-8718-4860d6b31674 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.381400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a83846d9-b4c1-4dea-8718-4860d6b31674 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.398482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a83846d9-b4c1-4dea-8718-4860d6b31674 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.399178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a83846d9-b4c1-4dea-8718-4860d6b31674 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.400294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a83846d9-b4c1-4dea-8718-4860d6b31674 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.400958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a83846d9-b4c1-4dea-8718-4860d6b31674 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.560979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a83846d9-b4c1-4dea-8718-4860d6b31674 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:42.569589 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a83846d9-b4c1-4dea-8718-4860d6b31674 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1501 microversion: 2.1 time: 0.195005 Jul 20 04:23:42.587132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c2553d7-721c-4ce9-b117-5729c28a6c89 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5362424e-2d0c-44c0-9ff9-8cd2b1a51a0c"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:42.588494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8c2553d7-721c-4ce9-b117-5729c28a6c89 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.592294 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1579/3228] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1501 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:42.604408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c2553d7-721c-4ce9-b117-5729c28a6c89 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.604889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c2553d7-721c-4ce9-b117-5729c28a6c89 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.605763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c2553d7-721c-4ce9-b117-5729c28a6c89 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.606210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c2553d7-721c-4ce9-b117-5729c28a6c89 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.646637 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-8c2553d7-721c-4ce9-b117-5729c28a6c89 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] HTTP exception thrown: Cannot 'attach_volume' instance c9c53e05-cfbb-479b-80a3-6a17db52e44f while it is in vm_state rescued Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c2553d7-721c-4ce9-b117-5729c28a6c89 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Request method failure captured: Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/os-volume_attachments HTTP/1.1 Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 74 Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14LpvtEmNd4QrXIrUEvb-GSk-Q8Zjd0l-zF-kIlevLuoBgLZ_00_u1yvp6j7dRA_htG5kpVqZoVpEsFwn0RHk_cOjeEIbaoK3R2iKcoauuThhWzyvVf6At0QhXQxlwDjTmkqLnzcd5YkB5Z5aPRc9SOgHjbdPHPXD-aflxJrD9yhloY Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ba21f0dfdc04e41a9a30fa3dddf3e90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}] Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: a25a4e3b560846ec98b871b954481f09 Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: {"volumeAttachment": {"volumeId": "5362424e-2d0c-44c0-9ff9-8cd2b1a51a0c"}} Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: exception: Cannot 'attach_volume' instance c9c53e05-cfbb-479b-80a3-6a17db52e44f while it is in vm_state rescued Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'server_id': 'c9c53e05-cfbb-479b-80a3-6a17db52e44f', 'body': {'volumeAttachment': {'volumeId': '5362424e-2d0c-44c0-9ff9-8cd2b1a51a0c'}}} Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9c53e05-cfbb-479b-80a3-6a17db52e44f in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 04:23:42.648843 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c9c53e05-cfbb-479b-80a3-6a17db52e44f while it is in vm_state rescued Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c9c53e05-cfbb-479b-80a3-6a17db52e44f while it is in vm_state rescued Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c2553d7-721c-4ce9-b117-5729c28a6c89 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Returning 409 to user: Cannot 'attach_volume' instance c9c53e05-cfbb-479b-80a3-6a17db52e44f while it is in vm_state rescued {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:42.653876 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8c2553d7-721c-4ce9-b117-5729c28a6c89 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067240 Jul 20 04:23:42.654891 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1650/3229] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:23:42 2022] POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:23:42.661159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a1967ea0-e1c2-4da8-9736-c098805520eb tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.661778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a1967ea0-e1c2-4da8-9736-c098805520eb tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.670771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da9accf4-c0de-4ed9-a05c-9e69ff2f51ec tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:42.671633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-da9accf4-c0de-4ed9-a05c-9e69ff2f51ec tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.679089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da9accf4-c0de-4ed9-a05c-9e69ff2f51ec tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.679294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1967ea0-e1c2-4da8-9736-c098805520eb tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.679796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da9accf4-c0de-4ed9-a05c-9e69ff2f51ec tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.680084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1967ea0-e1c2-4da8-9736-c098805520eb tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.680767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da9accf4-c0de-4ed9-a05c-9e69ff2f51ec tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.680893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1967ea0-e1c2-4da8-9736-c098805520eb tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.681301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1967ea0-e1c2-4da8-9736-c098805520eb tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.681484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da9accf4-c0de-4ed9-a05c-9e69ff2f51ec tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.753818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1967ea0-e1c2-4da8-9736-c098805520eb tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.753818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1967ea0-e1c2-4da8-9736-c098805520eb tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.754058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-a1967ea0-e1c2-4da8-9736-c098805520eb tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lazy-loading 'fault' on Instance uuid 98588f3c-20c5-42a4-9f79-cf55750977d5 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:42.783861 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da9accf4-c0de-4ed9-a05c-9e69ff2f51ec tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/action" status: 202 len: 0 microversion: 2.1 time: 0.124752 Jul 20 04:23:42.791188 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1651/3230] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:42 2022] POST /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:23:42.798545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cb439d5b-539e-47a5-9588-2c37fa12e00e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.800287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cb439d5b-539e-47a5-9588-2c37fa12e00e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.819986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb439d5b-539e-47a5-9588-2c37fa12e00e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.820963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb439d5b-539e-47a5-9588-2c37fa12e00e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.823026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb439d5b-539e-47a5-9588-2c37fa12e00e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.824221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb439d5b-539e-47a5-9588-2c37fa12e00e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.922546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a1967ea0-e1c2-4da8-9736-c098805520eb tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:42.938252 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a1967ea0-e1c2-4da8-9736-c098805520eb tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 200 len: 1307 microversion: 2.1 time: 0.281428 Jul 20 04:23:42.947187 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1580/3231] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 1307 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:42.952809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-670a80b1-5f50-47cf-95e7-7bf9a78897c4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.960286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-670a80b1-5f50-47cf-95e7-7bf9a78897c4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: c59ed237-adcb-4557-823c-3c3d67657b15] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.967887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-670a80b1-5f50-47cf-95e7-7bf9a78897c4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.972801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-670a80b1-5f50-47cf-95e7-7bf9a78897c4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.974869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-670a80b1-5f50-47cf-95e7-7bf9a78897c4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.976199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-670a80b1-5f50-47cf-95e7-7bf9a78897c4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.380344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cb439d5b-539e-47a5-9588-2c37fa12e00e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:43.391053 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cb439d5b-539e-47a5-9588-2c37fa12e00e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1509 microversion: 2.1 time: 0.597007 Jul 20 04:23:43.391673 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1652/3232] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1509 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:43.399493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2cca3cf3-de1d-491c-a8f9-872682de1e7b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:43.400133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2cca3cf3-de1d-491c-a8f9-872682de1e7b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:43.419484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2cca3cf3-de1d-491c-a8f9-872682de1e7b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.420005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2cca3cf3-de1d-491c-a8f9-872682de1e7b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.420785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2cca3cf3-de1d-491c-a8f9-872682de1e7b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.421226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2cca3cf3-de1d-491c-a8f9-872682de1e7b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.551895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-670a80b1-5f50-47cf-95e7-7bf9a78897c4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:43.565056 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-670a80b1-5f50-47cf-95e7-7bf9a78897c4 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15" status: 200 len: 1510 microversion: 2.1 time: 0.615868 Jul 20 04:23:43.566080 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1581/3233] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15 => generated 1510 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:43.666212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2cca3cf3-de1d-491c-a8f9-872682de1e7b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:43.681129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2cca3cf3-de1d-491c-a8f9-872682de1e7b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:43.693719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2cca3cf3-de1d-491c-a8f9-872682de1e7b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:43.695233 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2cca3cf3-de1d-491c-a8f9-872682de1e7b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1263 microversion: 2.25 time: 0.302635 Jul 20 04:23:43.696051 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1653/3234] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:43 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1263 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:43.803097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6122c0b-f405-49a8-8fcb-a5e8d6b6db9d tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:43.804612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a6122c0b-f405-49a8-8fcb-a5e8d6b6db9d tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:43.811565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6122c0b-f405-49a8-8fcb-a5e8d6b6db9d tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.812082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6122c0b-f405-49a8-8fcb-a5e8d6b6db9d tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.813566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6122c0b-f405-49a8-8fcb-a5e8d6b6db9d tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.817060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6122c0b-f405-49a8-8fcb-a5e8d6b6db9d tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.847893 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a6122c0b-f405-49a8-8fcb-a5e8d6b6db9d tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] HTTP exception thrown: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6122c0b-f405-49a8-8fcb-a5e8d6b6db9d tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Request method failure captured: Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde HTTP/1.1 Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14JndUCVxyxnfvC_hbZZyFnBg3Lup8EJGxFDpYvqzTkKEWHaLK9UuN4-MpzmdmZA6TP8hpG6-r8RkU6imv0QmWh8EPFeX6xjtfwGxACDoP9me0DTJ2G3aTSa2azKfvIDbq6WEk_HYguBAy6WuV4DQZ0Gb2NpglUeb6TbTN9lX9ozG4Q Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: dc6203ba93464a3fa1d3d43e5162719b Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-415125591 Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc6203ba93464a3fa1d3d43e5162719b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc6203ba93464a3fa1d3d43e5162719b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc6203ba93464a3fa1d3d43e5162719b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc6203ba93464a3fa1d3d43e5162719b"}]}] Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-415125591 Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: dc6203ba93464a3fa1d3d43e5162719b Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-415125591 Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachSCSIVolumeTestJSON-415125591-project Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 539fabc30c7c4ece81c9092dc26fde22 Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-415125591-project Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a70e7012-a311-486b-9035-cb4ccdd2afde'} Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:43.852787 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:43.857439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:43.857439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:43.857439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:43.857439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:43.857439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:43.857439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:43.857439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:43.857439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:43.857439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:43.857439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:43.857439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:43.858785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6122c0b-f405-49a8-8fcb-a5e8d6b6db9d tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Returning 404 to user: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:43.864867 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a6122c0b-f405-49a8-8fcb-a5e8d6b6db9d tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 404 len: 111 microversion: 2.1 time: 0.065724 Jul 20 04:23:43.868451 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1582/3235] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:43 2022] DELETE /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:43.874105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a0bb824-005d-4849-9792-2a93166bfbef tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:43.874932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a0bb824-005d-4849-9792-2a93166bfbef tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] [instance: a70e7012-a311-486b-9035-cb4ccdd2afde] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:43.885964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a0bb824-005d-4849-9792-2a93166bfbef tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.886566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a0bb824-005d-4849-9792-2a93166bfbef tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.892002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a0bb824-005d-4849-9792-2a93166bfbef tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.893539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a0bb824-005d-4849-9792-2a93166bfbef tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.934123 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-5a0bb824-005d-4849-9792-2a93166bfbef tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] HTTP exception thrown: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a0bb824-005d-4849-9792-2a93166bfbef tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Request method failure captured: Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde HTTP/1.1 Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14JndUCVxyxnfvC_hbZZyFnBg3Lup8EJGxFDpYvqzTkKEWHaLK9UuN4-MpzmdmZA6TP8hpG6-r8RkU6imv0QmWh8EPFeX6xjtfwGxACDoP9me0DTJ2G3aTSa2azKfvIDbq6WEk_HYguBAy6WuV4DQZ0Gb2NpglUeb6TbTN9lX9ozG4Q Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: dc6203ba93464a3fa1d3d43e5162719b Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-415125591 Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc6203ba93464a3fa1d3d43e5162719b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc6203ba93464a3fa1d3d43e5162719b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc6203ba93464a3fa1d3d43e5162719b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc6203ba93464a3fa1d3d43e5162719b"}]}] Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-415125591 Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: dc6203ba93464a3fa1d3d43e5162719b Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-415125591 Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AttachSCSIVolumeTestJSON-415125591-project Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 539fabc30c7c4ece81c9092dc26fde22 Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-415125591-project Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a70e7012-a311-486b-9035-cb4ccdd2afde'} Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:43.937145 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:43.943159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:43.943159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:43.943159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:43.943159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:43.943159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:43.943159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. Jul 20 04:23:43.943159 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:43.948254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a0bb824-005d-4849-9792-2a93166bfbef tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] Returning 404 to user: Instance a70e7012-a311-486b-9035-cb4ccdd2afde could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:43.950701 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a0bb824-005d-4849-9792-2a93166bfbef tempest-AttachSCSIVolumeTestJSON-415125591 tempest-AttachSCSIVolumeTestJSON-415125591-project] 10.222.0.20 "GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde" status: 404 len: 111 microversion: 2.1 time: 0.080819 Jul 20 04:23:43.959873 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1654/3236] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:43 2022] GET /compute/v2.1/servers/a70e7012-a311-486b-9035-cb4ccdd2afde => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:43.962976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b0b6bda-379a-4509-b281-d4bef80a0e1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:43.964371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7b0b6bda-379a-4509-b281-d4bef80a0e1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: 98588f3c-20c5-42a4-9f79-cf55750977d5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:43.977421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b0b6bda-379a-4509-b281-d4bef80a0e1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.978272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b0b6bda-379a-4509-b281-d4bef80a0e1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.979273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b0b6bda-379a-4509-b281-d4bef80a0e1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.979948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b0b6bda-379a-4509-b281-d4bef80a0e1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:44.001488 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-7b0b6bda-379a-4509-b281-d4bef80a0e1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] HTTP exception thrown: Instance 98588f3c-20c5-42a4-9f79-cf55750977d5 could not be found. Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b0b6bda-379a-4509-b281-d4bef80a0e1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Request method failure captured: Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 HTTP/1.1 Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14KQzyDs3kQ4EMMtv2PY-2c8fjvm5daqtldMtDktyAMexX1ZjFkvVTTPHTvOYq7W_8rVyH9SwPAA6b3rzjB2THHNKg_7vnLMnKfJwukVdb73z3zXHv8cv9qeoAfpvq7VJL3DofWdCzEvVw34pa3rhljspo13AqB0cwHNljy30qOkfVw Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: cdc4b88912e5436caaa2ce17b7d972b0 Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-VolumesAdminNegativeTest-644877418 Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cdc4b88912e5436caaa2ce17b7d972b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cdc4b88912e5436caaa2ce17b7d972b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cdc4b88912e5436caaa2ce17b7d972b0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cdc4b88912e5436caaa2ce17b7d972b0"}]}] Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-VolumesAdminNegativeTest-644877418 Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: cdc4b88912e5436caaa2ce17b7d972b0 Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-644877418 Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-VolumesAdminNegativeTest-644877418-project Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: dc30eb948c9245ebab77d8306f408f1e Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-VolumesAdminNegativeTest-644877418-project Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 98588f3c-20c5-42a4-9f79-cf55750977d5 could not be found. Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '98588f3c-20c5-42a4-9f79-cf55750977d5'} Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98588f3c-20c5-42a4-9f79-cf55750977d5 could not be found. Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98588f3c-20c5-42a4-9f79-cf55750977d5 could not be found. Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:44.016907 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:44.021423 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:44.021423 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:44.021423 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:44.021423 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:44.021423 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:44.021423 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98588f3c-20c5-42a4-9f79-cf55750977d5 could not be found. Jul 20 04:23:44.021423 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:23:44.023437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b0b6bda-379a-4509-b281-d4bef80a0e1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Returning 404 to user: Instance 98588f3c-20c5-42a4-9f79-cf55750977d5 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:44.024585 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7b0b6bda-379a-4509-b281-d4bef80a0e1d tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5" status: 404 len: 111 microversion: 2.1 time: 0.065932 Jul 20 04:23:44.025715 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1583/3237] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:43 2022] GET /compute/v2.1/servers/98588f3c-20c5-42a4-9f79-cf55750977d5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:23:44.412735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5c1581c3-1511-483c-96c7-f05701e7793d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:44.413423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5c1581c3-1511-483c-96c7-f05701e7793d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:44.439946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c1581c3-1511-483c-96c7-f05701e7793d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:44.442831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c1581c3-1511-483c-96c7-f05701e7793d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:44.449226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c1581c3-1511-483c-96c7-f05701e7793d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:44.451571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c1581c3-1511-483c-96c7-f05701e7793d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:44.582262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-660ff6e3-3a69-40ca-8eb5-77bd8ca121ba tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:44.583130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-660ff6e3-3a69-40ca-8eb5-77bd8ca121ba tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: c59ed237-adcb-4557-823c-3c3d67657b15] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:44.600849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-660ff6e3-3a69-40ca-8eb5-77bd8ca121ba tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:44.601294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-660ff6e3-3a69-40ca-8eb5-77bd8ca121ba tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:44.602071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-660ff6e3-3a69-40ca-8eb5-77bd8ca121ba tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:44.613172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-660ff6e3-3a69-40ca-8eb5-77bd8ca121ba tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.488332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-660ff6e3-3a69-40ca-8eb5-77bd8ca121ba tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:45.505287 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-660ff6e3-3a69-40ca-8eb5-77bd8ca121ba tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15" status: 200 len: 1468 microversion: 2.1 time: 0.926790 Jul 20 04:23:45.515968 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1584/3238] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:44 2022] GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15 => generated 1468 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:45.521861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-87400d76-7d5e-479f-940a-ba978a94cb6a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:45.522475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-87400d76-7d5e-479f-940a-ba978a94cb6a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:45.551320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87400d76-7d5e-479f-940a-ba978a94cb6a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.551794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87400d76-7d5e-479f-940a-ba978a94cb6a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.552775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87400d76-7d5e-479f-940a-ba978a94cb6a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.553507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87400d76-7d5e-479f-940a-ba978a94cb6a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.929814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-87400d76-7d5e-479f-940a-ba978a94cb6a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:45.939575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-87400d76-7d5e-479f-940a-ba978a94cb6a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:45.941861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-87400d76-7d5e-479f-940a-ba978a94cb6a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:45.953156 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-87400d76-7d5e-479f-940a-ba978a94cb6a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1263 microversion: 2.25 time: 0.435754 Jul 20 04:23:45.954462 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1585/3239] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:45 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1263 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:46.103316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6cdeb52a-c8f9-42bd-87ad-76eed115e89a req-06bae591-39a4-413a-880c-21767ec1bec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c59ed237-adcb-4557-823c-3c3d67657b15", "name": "network-vif-deleted", "tag": "4a3848d0-c8d6-4e75-8a99-e7bdf4569a3c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:46.119390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6cdeb52a-c8f9-42bd-87ad-76eed115e89a req-06bae591-39a4-413a-880c-21767ec1bec0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:46.120971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6cdeb52a-c8f9-42bd-87ad-76eed115e89a req-06bae591-39a4-413a-880c-21767ec1bec0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:46.142643 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-6cdeb52a-c8f9-42bd-87ad-76eed115e89a req-06bae591-39a4-413a-880c-21767ec1bec0 service nova] Creating event network-vif-deleted:4a3848d0-c8d6-4e75-8a99-e7bdf4569a3c for instance c59ed237-adcb-4557-823c-3c3d67657b15 on n-h1-764485-11 Jul 20 04:23:46.153337 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6cdeb52a-c8f9-42bd-87ad-76eed115e89a req-06bae591-39a4-413a-880c-21767ec1bec0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053784 Jul 20 04:23:46.155458 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1586/3240] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:23:46.321829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5c1581c3-1511-483c-96c7-f05701e7793d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:46.344581 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5c1581c3-1511-483c-96c7-f05701e7793d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1509 microversion: 2.1 time: 1.939320 Jul 20 04:23:46.358023 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1655/3241] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:44 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1509 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:46.528080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a81dde61-e71e-4464-86f0-0052c2ce1005 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:46.529422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a81dde61-e71e-4464-86f0-0052c2ce1005 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: c59ed237-adcb-4557-823c-3c3d67657b15] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:46.544004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81dde61-e71e-4464-86f0-0052c2ce1005 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:46.544470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81dde61-e71e-4464-86f0-0052c2ce1005 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:46.551902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81dde61-e71e-4464-86f0-0052c2ce1005 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:46.552299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81dde61-e71e-4464-86f0-0052c2ce1005 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:46.672602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81dde61-e71e-4464-86f0-0052c2ce1005 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:46.673449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81dde61-e71e-4464-86f0-0052c2ce1005 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:46.674083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-a81dde61-e71e-4464-86f0-0052c2ce1005 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lazy-loading 'fault' on Instance uuid c59ed237-adcb-4557-823c-3c3d67657b15 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:46.836856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a81dde61-e71e-4464-86f0-0052c2ce1005 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:46.849059 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a81dde61-e71e-4464-86f0-0052c2ce1005 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15" status: 200 len: 1306 microversion: 2.1 time: 0.329414 Jul 20 04:23:46.860589 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1587/3242] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:46 2022] GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15 => generated 1306 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:46.976534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d253447-0d22-40b7-b664-2c0fdfec5bcf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:46.977619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d253447-0d22-40b7-b664-2c0fdfec5bcf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:47.004858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d253447-0d22-40b7-b664-2c0fdfec5bcf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.005459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d253447-0d22-40b7-b664-2c0fdfec5bcf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.011866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d253447-0d22-40b7-b664-2c0fdfec5bcf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.012619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d253447-0d22-40b7-b664-2c0fdfec5bcf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.117775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2d253447-0d22-40b7-b664-2c0fdfec5bcf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:47.131181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2d253447-0d22-40b7-b664-2c0fdfec5bcf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:47.133996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2d253447-0d22-40b7-b664-2c0fdfec5bcf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:47.135136 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d253447-0d22-40b7-b664-2c0fdfec5bcf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1263 microversion: 2.25 time: 0.166164 Jul 20 04:23:47.147062 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1656/3243] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:46 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:47.364381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1fd39a49-1eae-4099-b9de-eeed1463c822 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:47.364949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1fd39a49-1eae-4099-b9de-eeed1463c822 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:47.375313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1fd39a49-1eae-4099-b9de-eeed1463c822 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.375853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1fd39a49-1eae-4099-b9de-eeed1463c822 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.376651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1fd39a49-1eae-4099-b9de-eeed1463c822 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.377089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1fd39a49-1eae-4099-b9de-eeed1463c822 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.402734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:47.570679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1fd39a49-1eae-4099-b9de-eeed1463c822 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:47.583707 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1fd39a49-1eae-4099-b9de-eeed1463c822 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1509 microversion: 2.1 time: 0.224277 Jul 20 04:23:47.584304 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1588/3244] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:47 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:47.867157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-147ec928-1cea-4a1e-9805-d695e51fae1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:47.867812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-147ec928-1cea-4a1e-9805-d695e51fae1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: c59ed237-adcb-4557-823c-3c3d67657b15] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:47.874366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-147ec928-1cea-4a1e-9805-d695e51fae1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.874840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-147ec928-1cea-4a1e-9805-d695e51fae1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.875654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-147ec928-1cea-4a1e-9805-d695e51fae1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.876100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-147ec928-1cea-4a1e-9805-d695e51fae1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.891600 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-147ec928-1cea-4a1e-9805-d695e51fae1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] HTTP exception thrown: Instance c59ed237-adcb-4557-823c-3c3d67657b15 could not be found. Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-147ec928-1cea-4a1e-9805-d695e51fae1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Request method failure captured: Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15 HTTP/1.1 Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14MdWrk2q2egReHKT5xA5ueLoLYkupXnhosJCzTBmQAVxt4b5dDqt5l4CC-ulCddhINHheGm2jjYoLGZj3sw6qZx1gF_hhBc4xaRgFGPhT_It8estx1-LNe1tAFOp3aoQE3C2fpc5-dRF1NjPJTyUP3e6xwMJ3tvWYjy6tPJ1OguCmc Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: acacca985d204f71a0cdc45a2c50f78c Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-MultipleCreateTestJSON-1097985965 Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/acacca985d204f71a0cdc45a2c50f78c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/acacca985d204f71a0cdc45a2c50f78c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_acacca985d204f71a0cdc45a2c50f78c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/acacca985d204f71a0cdc45a2c50f78c"}]}] Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-MultipleCreateTestJSON-1097985965 Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: acacca985d204f71a0cdc45a2c50f78c Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1097985965 Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-MultipleCreateTestJSON-1097985965-project Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 61c292c64fb342b48356d4240c2952b2 Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-MultipleCreateTestJSON-1097985965-project Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance c59ed237-adcb-4557-823c-3c3d67657b15 could not be found. Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'c59ed237-adcb-4557-823c-3c3d67657b15'} Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c59ed237-adcb-4557-823c-3c3d67657b15 could not be found. Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c59ed237-adcb-4557-823c-3c3d67657b15 could not be found. Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:47.894466 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:47.898638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:47.898638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:47.898638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:47.898638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:47.898638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:47.898638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c59ed237-adcb-4557-823c-3c3d67657b15 could not be found. Jul 20 04:23:47.898638 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:47.898638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-147ec928-1cea-4a1e-9805-d695e51fae1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Returning 404 to user: Instance c59ed237-adcb-4557-823c-3c3d67657b15 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:47.898638 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-147ec928-1cea-4a1e-9805-d695e51fae1c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15" status: 404 len: 111 microversion: 2.1 time: 0.033669 Jul 20 04:23:47.900306 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1657/3245] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:47 2022] GET /compute/v2.1/servers/c59ed237-adcb-4557-823c-3c3d67657b15 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:47.906182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4da38d40-5fe2-4a4c-b695-45d3a3ed633c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:47.906996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4da38d40-5fe2-4a4c-b695-45d3a3ed633c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:47.931051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4da38d40-5fe2-4a4c-b695-45d3a3ed633c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.932490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4da38d40-5fe2-4a4c-b695-45d3a3ed633c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.933477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4da38d40-5fe2-4a4c-b695-45d3a3ed633c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.934078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4da38d40-5fe2-4a4c-b695-45d3a3ed633c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.980014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4da38d40-5fe2-4a4c-b695-45d3a3ed633c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.980760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4da38d40-5fe2-4a4c-b695-45d3a3ed633c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.981381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-4da38d40-5fe2-4a4c-b695-45d3a3ed633c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lazy-loading 'fault' on Instance uuid 0f67abf3-3423-4658-9583-5b5a2957cb1e {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:48.039020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4da38d40-5fe2-4a4c-b695-45d3a3ed633c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c292c64fb342b48356d4240c2952b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acacca985d204f71a0cdc45a2c50f78c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:48.052056 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4da38d40-5fe2-4a4c-b695-45d3a3ed633c tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 200 len: 1306 microversion: 2.1 time: 0.150243 Jul 20 04:23:48.052747 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1589/3246] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:47 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 1306 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:48.157420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-90f5cb8c-7dd2-4152-b722-5b3a63359e71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:48.160339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-90f5cb8c-7dd2-4152-b722-5b3a63359e71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:48.169581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90f5cb8c-7dd2-4152-b722-5b3a63359e71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.170702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90f5cb8c-7dd2-4152-b722-5b3a63359e71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.191268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90f5cb8c-7dd2-4152-b722-5b3a63359e71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.192401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90f5cb8c-7dd2-4152-b722-5b3a63359e71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.268970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-737d537a-8ab6-460a-8ba1-2c10062700d9 req-7befd2ea-96f9-418b-809c-4b8e62458c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f67abf3-3423-4658-9583-5b5a2957cb1e", "name": "network-vif-deleted", "tag": "c3dcb55c-4cbe-4726-92df-83de60bed473"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:48.287960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-737d537a-8ab6-460a-8ba1-2c10062700d9 req-7befd2ea-96f9-418b-809c-4b8e62458c7e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.290615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-737d537a-8ab6-460a-8ba1-2c10062700d9 req-7befd2ea-96f9-418b-809c-4b8e62458c7e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.324694 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-737d537a-8ab6-460a-8ba1-2c10062700d9 req-7befd2ea-96f9-418b-809c-4b8e62458c7e service nova] Creating event network-vif-deleted:c3dcb55c-4cbe-4726-92df-83de60bed473 for instance 0f67abf3-3423-4658-9583-5b5a2957cb1e on n-h2-764485-11 Jul 20 04:23:48.333844 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-737d537a-8ab6-460a-8ba1-2c10062700d9 req-7befd2ea-96f9-418b-809c-4b8e62458c7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068921 Jul 20 04:23:48.334793 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1590/3247] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:23:48.390951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-90f5cb8c-7dd2-4152-b722-5b3a63359e71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:48.405376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-90f5cb8c-7dd2-4152-b722-5b3a63359e71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:48.407177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-90f5cb8c-7dd2-4152-b722-5b3a63359e71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:48.409368 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-90f5cb8c-7dd2-4152-b722-5b3a63359e71 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1263 microversion: 2.25 time: 0.258286 Jul 20 04:23:48.410480 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1658/3248] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:48 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1263 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:48.602718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-58bd1c33-b272-4f27-932b-5162f5a459ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:48.603436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-58bd1c33-b272-4f27-932b-5162f5a459ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:48.624152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58bd1c33-b272-4f27-932b-5162f5a459ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.626142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58bd1c33-b272-4f27-932b-5162f5a459ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.627887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58bd1c33-b272-4f27-932b-5162f5a459ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.631357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58bd1c33-b272-4f27-932b-5162f5a459ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.986200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-58bd1c33-b272-4f27-932b-5162f5a459ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.007221 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-58bd1c33-b272-4f27-932b-5162f5a459ce tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1509 microversion: 2.1 time: 0.408342 Jul 20 04:23:49.009519 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1591/3249] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:48 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:49.069211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b84b29be-0db5-4826-96b2-a6cbe9074663 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:49.069979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b84b29be-0db5-4826-96b2-a6cbe9074663 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] [instance: 0f67abf3-3423-4658-9583-5b5a2957cb1e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:49.079196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b84b29be-0db5-4826-96b2-a6cbe9074663 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.091110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b84b29be-0db5-4826-96b2-a6cbe9074663 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.094723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b84b29be-0db5-4826-96b2-a6cbe9074663 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.097584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b84b29be-0db5-4826-96b2-a6cbe9074663 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.151736 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-b84b29be-0db5-4826-96b2-a6cbe9074663 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] HTTP exception thrown: Instance 0f67abf3-3423-4658-9583-5b5a2957cb1e could not be found. Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b84b29be-0db5-4826-96b2-a6cbe9074663 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Request method failure captured: Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e HTTP/1.1 Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14MdWrk2q2egReHKT5xA5ueLoLYkupXnhosJCzTBmQAVxt4b5dDqt5l4CC-ulCddhINHheGm2jjYoLGZj3sw6qZx1gF_hhBc4xaRgFGPhT_It8estx1-LNe1tAFOp3aoQE3C2fpc5-dRF1NjPJTyUP3e6xwMJ3tvWYjy6tPJ1OguCmc Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: acacca985d204f71a0cdc45a2c50f78c Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-MultipleCreateTestJSON-1097985965 Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/acacca985d204f71a0cdc45a2c50f78c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/acacca985d204f71a0cdc45a2c50f78c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_acacca985d204f71a0cdc45a2c50f78c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/acacca985d204f71a0cdc45a2c50f78c"}]}] Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-MultipleCreateTestJSON-1097985965 Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: acacca985d204f71a0cdc45a2c50f78c Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1097985965 Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-MultipleCreateTestJSON-1097985965-project Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 61c292c64fb342b48356d4240c2952b2 Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-MultipleCreateTestJSON-1097985965-project Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 0f67abf3-3423-4658-9583-5b5a2957cb1e could not be found. Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '0f67abf3-3423-4658-9583-5b5a2957cb1e'} Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f67abf3-3423-4658-9583-5b5a2957cb1e could not be found. Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f67abf3-3423-4658-9583-5b5a2957cb1e could not be found. Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:49.160577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.164868 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:49.164868 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:49.164868 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:49.164868 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:49.164868 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:49.164868 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f67abf3-3423-4658-9583-5b5a2957cb1e could not be found. Jul 20 04:23:49.164868 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.169396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b84b29be-0db5-4826-96b2-a6cbe9074663 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] Returning 404 to user: Instance 0f67abf3-3423-4658-9583-5b5a2957cb1e could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:49.170673 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b84b29be-0db5-4826-96b2-a6cbe9074663 tempest-MultipleCreateTestJSON-1097985965 tempest-MultipleCreateTestJSON-1097985965-project] 10.222.0.20 "GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e" status: 404 len: 111 microversion: 2.1 time: 0.105480 Jul 20 04:23:49.178622 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1659/3250] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:49 2022] GET /compute/v2.1/servers/0f67abf3-3423-4658-9583-5b5a2957cb1e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:49.431615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96b056b8-7995-48a7-978a-edafb9cb4cbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:49.432720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96b056b8-7995-48a7-978a-edafb9cb4cbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:49.447562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96b056b8-7995-48a7-978a-edafb9cb4cbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.452306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96b056b8-7995-48a7-978a-edafb9cb4cbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.453448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96b056b8-7995-48a7-978a-edafb9cb4cbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.454060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96b056b8-7995-48a7-978a-edafb9cb4cbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.743609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-96b056b8-7995-48a7-978a-edafb9cb4cbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.758965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-96b056b8-7995-48a7-978a-edafb9cb4cbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.765202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-96b056b8-7995-48a7-978a-edafb9cb4cbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.767160 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-96b056b8-7995-48a7-978a-edafb9cb4cbb tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1263 microversion: 2.25 time: 0.340541 Jul 20 04:23:49.767984 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1592/3251] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:49 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1263 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:50.026873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fb72c083-7094-4857-b7ea-22221ce31c8f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:50.029085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fb72c083-7094-4857-b7ea-22221ce31c8f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:50.039857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb72c083-7094-4857-b7ea-22221ce31c8f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.042021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb72c083-7094-4857-b7ea-22221ce31c8f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.043444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb72c083-7094-4857-b7ea-22221ce31c8f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.044113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb72c083-7094-4857-b7ea-22221ce31c8f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.354215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fb72c083-7094-4857-b7ea-22221ce31c8f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:50.381262 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fb72c083-7094-4857-b7ea-22221ce31c8f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1515 microversion: 2.1 time: 0.359687 Jul 20 04:23:50.401587 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1660/3252] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:50 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1515 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:50.793547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8fce716a-81ef-4c4d-ac34-8daa20f1c93e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:50.794178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8fce716a-81ef-4c4d-ac34-8daa20f1c93e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:50.813030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fce716a-81ef-4c4d-ac34-8daa20f1c93e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.813493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fce716a-81ef-4c4d-ac34-8daa20f1c93e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.814278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fce716a-81ef-4c4d-ac34-8daa20f1c93e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.814849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fce716a-81ef-4c4d-ac34-8daa20f1c93e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.464349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8fce716a-81ef-4c4d-ac34-8daa20f1c93e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:51.476882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8fce716a-81ef-4c4d-ac34-8daa20f1c93e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:51.496734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8fce716a-81ef-4c4d-ac34-8daa20f1c93e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:51.498096 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8fce716a-81ef-4c4d-ac34-8daa20f1c93e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 200 len: 1263 microversion: 2.25 time: 0.714771 Jul 20 04:23:51.498694 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1593/3253] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:50 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 1263 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:52.516037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-933e0473-7e1b-4a94-b838-df5c3a0cc454 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:52.516662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-933e0473-7e1b-4a94-b838-df5c3a0cc454 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 588d4bae-3e12-4c79-81c7-b6223cb6dacc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:52.529759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-933e0473-7e1b-4a94-b838-df5c3a0cc454 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.531445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-933e0473-7e1b-4a94-b838-df5c3a0cc454 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.536019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-933e0473-7e1b-4a94-b838-df5c3a0cc454 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.536709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-933e0473-7e1b-4a94-b838-df5c3a0cc454 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.561470 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-933e0473-7e1b-4a94-b838-df5c3a0cc454 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] HTTP exception thrown: Instance 588d4bae-3e12-4c79-81c7-b6223cb6dacc could not be found. Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-933e0473-7e1b-4a94-b838-df5c3a0cc454 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Request method failure captured: Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc HTTP/1.1 Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14F6EHv6_3-eUvkZutuRKeqYZbd9Lts8Mw1PXhoaXrHUVMSbGgd9FlzNYB6pxR43mrbax3Wud-PliKxYMBv0yid5LV5HajYdCRurOd6ct5v6iy0xgU1XPpRLkgpRgB4c_iRQ6M2I32d1o39gdKyLTAZxtke49Wb9JUR_5bMVxpce3dM Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5181d3786af0422c928fa68ae1fd3956 Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1432039837 Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5181d3786af0422c928fa68ae1fd3956"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5181d3786af0422c928fa68ae1fd3956"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5181d3786af0422c928fa68ae1fd3956", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5181d3786af0422c928fa68ae1fd3956"}]}] Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1432039837 Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5181d3786af0422c928fa68ae1fd3956 Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1432039837 Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-LiveAutoBlockMigrationV225Test-1432039837-project Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b63f54e61ef144968f6c8d9cfb954c8f Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1432039837-project Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 588d4bae-3e12-4c79-81c7-b6223cb6dacc could not be found. Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '588d4bae-3e12-4c79-81c7-b6223cb6dacc'} Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 588d4bae-3e12-4c79-81c7-b6223cb6dacc could not be found. Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 588d4bae-3e12-4c79-81c7-b6223cb6dacc could not be found. Jul 20 04:23:52.564192 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:52.568566 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:52.568566 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:52.568566 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:52.568566 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:52.568566 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:52.568566 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:52.568566 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:52.568566 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 588d4bae-3e12-4c79-81c7-b6223cb6dacc could not be found. Jul 20 04:23:52.568566 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:23:52.569930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-933e0473-7e1b-4a94-b838-df5c3a0cc454 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Returning 404 to user: Instance 588d4bae-3e12-4c79-81c7-b6223cb6dacc could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:52.570970 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-933e0473-7e1b-4a94-b838-df5c3a0cc454 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc" status: 404 len: 111 microversion: 2.25 time: 0.059049 Jul 20 04:23:52.575321 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1661/3254] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:52 2022] GET /compute/v2.1/servers/588d4bae-3e12-4c79-81c7-b6223cb6dacc => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:23:53.252601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4cee6647-fbc1-4662-b904-c8b2efcd5932 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'create', calling method: .version_select at 0x7fbf9c52ae50>, body: {"keypair": {"name": "tempest-keypair-1129299152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLblDvLU+Yqdhw5I8Q7Fif4zKKO2q+d1xwwH9cBOPaSs0elhhF6j/iV6QpRl06jNJn9gkspU8GYQTexvmtLta55sjswmO6DP5Pql4akFg0/DIIIcRx5KViq29noWiTUh7Q=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:53.297120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-4cee6647-fbc1-4662-b904-c8b2efcd5932 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Getting quotas for project 2ba21f0dfdc04e41a9a30fa3dddf3e90. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:53.315392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-4cee6647-fbc1-4662-b904-c8b2efcd5932 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Getting quotas for user a25a4e3b560846ec98b871b954481f09 and project 2ba21f0dfdc04e41a9a30fa3dddf3e90. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:53.369182 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4cee6647-fbc1-4662-b904-c8b2efcd5932 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120839 Jul 20 04:23:53.375048 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1594/3255] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:23:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:55.474703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2024055180", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "4ecafda7-bef2-4970-b500-38ffdaaafe04"}, {"uuid": "1395b238-ef2b-425b-8aa1-5e7161c41573"}, {"uuid": "4ecafda7-bef2-4970-b500-38ffdaaafe04"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:55.573697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] validate_networks() for [('4ecafda7-bef2-4970-b500-38ffdaaafe04', None, None, None, None, None), ('1395b238-ef2b-425b-8aa1-5e7161c41573', None, None, None, None, None), ('4ecafda7-bef2-4970-b500-38ffdaaafe04', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:57.628822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d54c5588-d1a4-46d3-ae9c-132442e9d83a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:57.629909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d54c5588-d1a4-46d3-ae9c-132442e9d83a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:57.652349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d54c5588-d1a4-46d3-ae9c-132442e9d83a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.653183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d54c5588-d1a4-46d3-ae9c-132442e9d83a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.654222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d54c5588-d1a4-46d3-ae9c-132442e9d83a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.654886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d54c5588-d1a4-46d3-ae9c-132442e9d83a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.719155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d54c5588-d1a4-46d3-ae9c-132442e9d83a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:57.890722 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d54c5588-d1a4-46d3-ae9c-132442e9d83a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 204 len: 0 microversion: 2.1 time: 0.267681 Jul 20 04:23:57.893351 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1595/3256] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:57 2022] DELETE /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:57.902728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-71e35ded-2fa4-4a34-b3f8-0d8e49dc4e4a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:57.903446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-71e35ded-2fa4-4a34-b3f8-0d8e49dc4e4a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:57.915245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:57.923900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71e35ded-2fa4-4a34-b3f8-0d8e49dc4e4a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.927655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71e35ded-2fa4-4a34-b3f8-0d8e49dc4e4a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.930070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71e35ded-2fa4-4a34-b3f8-0d8e49dc4e4a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.932576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71e35ded-2fa4-4a34-b3f8-0d8e49dc4e4a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:59.231783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-71e35ded-2fa4-4a34-b3f8-0d8e49dc4e4a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:59.282650 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-71e35ded-2fa4-4a34-b3f8-0d8e49dc4e4a tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1680 microversion: 2.1 time: 1.384768 Jul 20 04:23:59.284006 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1596/3257] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:57 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1680 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:59.307258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1646713131", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b60abb6-5424-401f-b7ac-d06a262c24c3"}], "security_groups": [{"name": "tempest-securitygroup--1561822547"}], "key_name": "tempest-keypair-1129299152", "user_data": "}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:59.876221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] validate_networks() for [('1b60abb6-5424-401f-b7ac-d06a262c24c3', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:00.363059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:00.363718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:00.364421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:00.365025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:00.366815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:00.402847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.403310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:00.412766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.413225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:00.459164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Getting quotas for project 8d31e7a862bb417db2ddaf24d4c0f99b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:00.477343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Getting quotas for user c3fccf60e600450c8d10e10e3311fbae and project 8d31e7a862bb417db2ddaf24d4c0f99b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:00.509965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:00.512909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:00.643663 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3830a632-c807-45a0-9526-6f2325e166b9 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.171723 Jul 20 04:24:00.652410 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1662/3258] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 5183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:00.664243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a15f27dd-41fc-4202-93b1-c5500f1fb3d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:00.672965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a15f27dd-41fc-4202-93b1-c5500f1fb3d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:00.693957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a15f27dd-41fc-4202-93b1-c5500f1fb3d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.694700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a15f27dd-41fc-4202-93b1-c5500f1fb3d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:00.695760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a15f27dd-41fc-4202-93b1-c5500f1fb3d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.696363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a15f27dd-41fc-4202-93b1-c5500f1fb3d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.937204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:01.937703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:01.938111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:01.938522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:01.939446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:01.965652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:01.966352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.967365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:01.967997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.995705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Getting quotas for project 2ba21f0dfdc04e41a9a30fa3dddf3e90. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:02.002957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Getting quotas for user a25a4e3b560846ec98b871b954481f09 and project 2ba21f0dfdc04e41a9a30fa3dddf3e90. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:02.024797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:02.027837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:02.101926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a15f27dd-41fc-4202-93b1-c5500f1fb3d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:02.110016 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e4b20f5c-6221-482f-9ca5-e99ed45589cd tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.824103 Jul 20 04:24:02.110227 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a15f27dd-41fc-4202-93b1-c5500f1fb3d9 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1680 microversion: 2.1 time: 1.456130 Jul 20 04:24:02.110681 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1663/3259] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:00 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1680 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:02.112314 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1597/3260] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 2827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:02.121419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1630ec18-0205-4495-b820-257b7f1897b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:02.122521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-37ce618c-e43d-4efa-b520-dffbbd4ab03a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:02.123208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-37ce618c-e43d-4efa-b520-dffbbd4ab03a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:02.123937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1630ec18-0205-4495-b820-257b7f1897b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:02.156333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37ce618c-e43d-4efa-b520-dffbbd4ab03a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:02.156795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37ce618c-e43d-4efa-b520-dffbbd4ab03a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:02.157900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37ce618c-e43d-4efa-b520-dffbbd4ab03a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:02.158905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37ce618c-e43d-4efa-b520-dffbbd4ab03a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:02.159643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1630ec18-0205-4495-b820-257b7f1897b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:02.160175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1630ec18-0205-4495-b820-257b7f1897b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:02.161039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1630ec18-0205-4495-b820-257b7f1897b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:02.161488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1630ec18-0205-4495-b820-257b7f1897b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:02.199409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1630ec18-0205-4495-b820-257b7f1897b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:02.333989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-37ce618c-e43d-4efa-b520-dffbbd4ab03a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:02.344045 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-37ce618c-e43d-4efa-b520-dffbbd4ab03a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1265 microversion: 2.1 time: 0.225371 Jul 20 04:24:02.345368 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1630ec18-0205-4495-b820-257b7f1897b1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "DELETE /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 204 len: 0 microversion: 2.25 time: 0.229146 Jul 20 04:24:02.347850 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1664/3261] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:02 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:02.356576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21add186-a5e9-49c6-8a69-5c415386f694 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:02.361639 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1598/3262] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:24:02 2022] DELETE /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:02.368046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21add186-a5e9-49c6-8a69-5c415386f694 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:02.375605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e029c093-d47f-479e-9e4e-0d949420419f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:02.379120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e029c093-d47f-479e-9e4e-0d949420419f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:02.399885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e029c093-d47f-479e-9e4e-0d949420419f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:02.400361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e029c093-d47f-479e-9e4e-0d949420419f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:02.401173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e029c093-d47f-479e-9e4e-0d949420419f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:02.406290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e029c093-d47f-479e-9e4e-0d949420419f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:02.493938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-21add186-a5e9-49c6-8a69-5c415386f694 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:02.504672 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21add186-a5e9-49c6-8a69-5c415386f694 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1246 microversion: 2.1 time: 0.155532 Jul 20 04:24:02.505467 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1665/3263] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:02 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1246 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:03.090226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e029c093-d47f-479e-9e4e-0d949420419f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:03.108292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e029c093-d47f-479e-9e4e-0d949420419f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:03.111751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e029c093-d47f-479e-9e4e-0d949420419f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:03.121159 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e029c093-d47f-479e-9e4e-0d949420419f tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1731 microversion: 2.25 time: 0.753778 Jul 20 04:24:03.122421 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1599/3264] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:02 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1731 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:03.132822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2957e75a-abea-4274-a0c0-a4721d0dbd7c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:03.133610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2957e75a-abea-4274-a0c0-a4721d0dbd7c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:03.145271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2957e75a-abea-4274-a0c0-a4721d0dbd7c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.146544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2957e75a-abea-4274-a0c0-a4721d0dbd7c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.150133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2957e75a-abea-4274-a0c0-a4721d0dbd7c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.151325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2957e75a-abea-4274-a0c0-a4721d0dbd7c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.323141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2957e75a-abea-4274-a0c0-a4721d0dbd7c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc30eb948c9245ebab77d8306f408f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc4b88912e5436caaa2ce17b7d972b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:03.347878 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2957e75a-abea-4274-a0c0-a4721d0dbd7c tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 200 len: 1613 microversion: 2.1 time: 0.223128 Jul 20 04:24:03.349050 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1666/3265] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:03 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 1613 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:03.365578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ad1c73cf-b30e-487c-ae8b-b24d7e2f5684 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:03.366072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ad1c73cf-b30e-487c-ae8b-b24d7e2f5684 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:03.379477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-34629537-f5d8-4737-ad49-bae23f277134 req-8667895e-6183-4dc6-b071-6594ed2e484a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd5c32a2-e4d5-42ae-97c8-68123a555ec9", "name": "network-vif-deleted", "tag": "b176f969-0f6e-4a2e-bc2b-d85011718eae"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:03.392145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad1c73cf-b30e-487c-ae8b-b24d7e2f5684 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.393450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad1c73cf-b30e-487c-ae8b-b24d7e2f5684 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.394496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad1c73cf-b30e-487c-ae8b-b24d7e2f5684 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.396181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-34629537-f5d8-4737-ad49-bae23f277134 req-8667895e-6183-4dc6-b071-6594ed2e484a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.397022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad1c73cf-b30e-487c-ae8b-b24d7e2f5684 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.400159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-34629537-f5d8-4737-ad49-bae23f277134 req-8667895e-6183-4dc6-b071-6594ed2e484a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.423186 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-34629537-f5d8-4737-ad49-bae23f277134 req-8667895e-6183-4dc6-b071-6594ed2e484a service nova] Creating event network-vif-deleted:b176f969-0f6e-4a2e-bc2b-d85011718eae for instance dd5c32a2-e4d5-42ae-97c8-68123a555ec9 on n-h2-764485-11 Jul 20 04:24:03.442095 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-34629537-f5d8-4737-ad49-bae23f277134 req-8667895e-6183-4dc6-b071-6594ed2e484a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066647 Jul 20 04:24:03.444501 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1667/3266] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:03.522701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c7842d12-c4c8-40fe-b802-2047f1b422aa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:03.523711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c7842d12-c4c8-40fe-b802-2047f1b422aa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:03.544888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7842d12-c4c8-40fe-b802-2047f1b422aa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.548043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7842d12-c4c8-40fe-b802-2047f1b422aa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.549634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7842d12-c4c8-40fe-b802-2047f1b422aa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.553838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7842d12-c4c8-40fe-b802-2047f1b422aa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.670673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ad1c73cf-b30e-487c-ae8b-b24d7e2f5684 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:03.681042 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ad1c73cf-b30e-487c-ae8b-b24d7e2f5684 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1271 microversion: 2.1 time: 0.319614 Jul 20 04:24:03.682178 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1600/3267] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:03 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1271 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:03.762949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c7842d12-c4c8-40fe-b802-2047f1b422aa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:03.772204 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c7842d12-c4c8-40fe-b802-2047f1b422aa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1298 microversion: 2.1 time: 0.253712 Jul 20 04:24:03.785367 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1668/3268] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:03 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1298 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:04.140349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cf530d37-9d39-4bd0-a869-179f2fb8a6e7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:04.141067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cf530d37-9d39-4bd0-a869-179f2fb8a6e7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:04.153728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf530d37-9d39-4bd0-a869-179f2fb8a6e7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.154184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf530d37-9d39-4bd0-a869-179f2fb8a6e7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.155030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf530d37-9d39-4bd0-a869-179f2fb8a6e7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.157383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf530d37-9d39-4bd0-a869-179f2fb8a6e7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.366437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd6cc88d-71bc-46a1-b973-8678a0c015c0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:04.367217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dd6cc88d-71bc-46a1-b973-8678a0c015c0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] [instance: dd5c32a2-e4d5-42ae-97c8-68123a555ec9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:04.376031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd6cc88d-71bc-46a1-b973-8678a0c015c0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.376482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd6cc88d-71bc-46a1-b973-8678a0c015c0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.384779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd6cc88d-71bc-46a1-b973-8678a0c015c0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.385197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd6cc88d-71bc-46a1-b973-8678a0c015c0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.390075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:04.418971 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-dd6cc88d-71bc-46a1-b973-8678a0c015c0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] HTTP exception thrown: Instance dd5c32a2-e4d5-42ae-97c8-68123a555ec9 could not be found. Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd6cc88d-71bc-46a1-b973-8678a0c015c0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Request method failure captured: Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 HTTP/1.1 Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14KQzyDs3kQ4EMMtv2PY-2c8fjvm5daqtldMtDktyAMexX1ZjFkvVTTPHTvOYq7W_8rVyH9SwPAA6b3rzjB2THHNKg_7vnLMnKfJwukVdb73z3zXHv8cv9qeoAfpvq7VJL3DofWdCzEvVw34pa3rhljspo13AqB0cwHNljy30qOkfVw Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: cdc4b88912e5436caaa2ce17b7d972b0 Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-VolumesAdminNegativeTest-644877418 Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cdc4b88912e5436caaa2ce17b7d972b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cdc4b88912e5436caaa2ce17b7d972b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cdc4b88912e5436caaa2ce17b7d972b0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cdc4b88912e5436caaa2ce17b7d972b0"}]}] Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-VolumesAdminNegativeTest-644877418 Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: cdc4b88912e5436caaa2ce17b7d972b0 Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-644877418 Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-VolumesAdminNegativeTest-644877418-project Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: dc30eb948c9245ebab77d8306f408f1e Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-VolumesAdminNegativeTest-644877418-project Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance dd5c32a2-e4d5-42ae-97c8-68123a555ec9 could not be found. Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'dd5c32a2-e4d5-42ae-97c8-68123a555ec9'} Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd5c32a2-e4d5-42ae-97c8-68123a555ec9 could not be found. Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd5c32a2-e4d5-42ae-97c8-68123a555ec9 could not be found. Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:04.421437 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:04.425576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:04.425576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:04.425576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:04.425576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:04.425576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:04.425576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd5c32a2-e4d5-42ae-97c8-68123a555ec9 could not be found. Jul 20 04:24:04.425576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:04.428234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd6cc88d-71bc-46a1-b973-8678a0c015c0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Returning 404 to user: Instance dd5c32a2-e4d5-42ae-97c8-68123a555ec9 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:04.429483 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dd6cc88d-71bc-46a1-b973-8678a0c015c0 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9" status: 404 len: 111 microversion: 2.1 time: 0.068390 Jul 20 04:24:04.434253 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1669/3269] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:04 2022] GET /compute/v2.1/servers/dd5c32a2-e4d5-42ae-97c8-68123a555ec9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:04.441000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-12507bb7-3281-4fdb-86fe-5e7d114ec505 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] Calling method '.version_select at 0x7fbf9d07eee0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:04.474980 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-12507bb7-3281-4fdb-86fe-5e7d114ec505 tempest-VolumesAdminNegativeTest-644877418 tempest-VolumesAdminNegativeTest-644877418-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142217574" status: 202 len: 0 microversion: 2.1 time: 0.038162 Jul 20 04:24:04.476960 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1670/3270] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 04:24:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142217574 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:24:04.703610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e6d3512b-79e4-4407-99d7-90d70ed11907 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:04.704639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e6d3512b-79e4-4407-99d7-90d70ed11907 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:04.728039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6d3512b-79e4-4407-99d7-90d70ed11907 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.728789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6d3512b-79e4-4407-99d7-90d70ed11907 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.729656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6d3512b-79e4-4407-99d7-90d70ed11907 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.730111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6d3512b-79e4-4407-99d7-90d70ed11907 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.875622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf530d37-9d39-4bd0-a869-179f2fb8a6e7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:04.899400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e6d3512b-79e4-4407-99d7-90d70ed11907 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:04.903524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf530d37-9d39-4bd0-a869-179f2fb8a6e7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:04.911120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf530d37-9d39-4bd0-a869-179f2fb8a6e7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:04.912392 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cf530d37-9d39-4bd0-a869-179f2fb8a6e7 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1731 microversion: 2.25 time: 0.776340 Jul 20 04:24:04.916807 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1601/3271] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:04 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1731 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:04.935923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-19d32b42-aab2-46c1-8e1a-1abc10e2e9e8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:04.936547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-19d32b42-aab2-46c1-8e1a-1abc10e2e9e8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:04.943162 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e6d3512b-79e4-4407-99d7-90d70ed11907 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1271 microversion: 2.1 time: 0.248555 Jul 20 04:24:04.953731 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1671/3272] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:04 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1271 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:04.961507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19d32b42-aab2-46c1-8e1a-1abc10e2e9e8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.961967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19d32b42-aab2-46c1-8e1a-1abc10e2e9e8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.962765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19d32b42-aab2-46c1-8e1a-1abc10e2e9e8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.963201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19d32b42-aab2-46c1-8e1a-1abc10e2e9e8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:05.176011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-19d32b42-aab2-46c1-8e1a-1abc10e2e9e8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:05.184927 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-19d32b42-aab2-46c1-8e1a-1abc10e2e9e8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1304 microversion: 2.1 time: 0.252785 Jul 20 04:24:05.188579 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1602/3273] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:04 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1304 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:05.937698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4193f43c-41c5-4622-ab66-9ad91f96e7ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:05.938522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4193f43c-41c5-4622-ab66-9ad91f96e7ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:05.952379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4193f43c-41c5-4622-ab66-9ad91f96e7ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:05.957454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4193f43c-41c5-4622-ab66-9ad91f96e7ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:05.958439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4193f43c-41c5-4622-ab66-9ad91f96e7ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:05.959054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4193f43c-41c5-4622-ab66-9ad91f96e7ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:05.961620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-79ab056a-435a-475e-a94c-916458c7a512 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:05.962249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-79ab056a-435a-475e-a94c-916458c7a512 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:05.974362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79ab056a-435a-475e-a94c-916458c7a512 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:05.974823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79ab056a-435a-475e-a94c-916458c7a512 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:05.986556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79ab056a-435a-475e-a94c-916458c7a512 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:05.987191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79ab056a-435a-475e-a94c-916458c7a512 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:06.440917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4193f43c-41c5-4622-ab66-9ad91f96e7ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:06.457025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4193f43c-41c5-4622-ab66-9ad91f96e7ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:06.458843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4193f43c-41c5-4622-ab66-9ad91f96e7ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:06.460286 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4193f43c-41c5-4622-ab66-9ad91f96e7ec tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1664 microversion: 2.25 time: 0.526854 Jul 20 04:24:06.461488 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1672/3274] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:05 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1664 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:06.476969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-93a11da8-2ed4-4679-9007-795dff3f0b79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:06.484231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-93a11da8-2ed4-4679-9007-795dff3f0b79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:06.495257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93a11da8-2ed4-4679-9007-795dff3f0b79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:06.495850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93a11da8-2ed4-4679-9007-795dff3f0b79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:06.496722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93a11da8-2ed4-4679-9007-795dff3f0b79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:06.497999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93a11da8-2ed4-4679-9007-795dff3f0b79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:06.871595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-79ab056a-435a-475e-a94c-916458c7a512 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:06.875852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:06.891359 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-79ab056a-435a-475e-a94c-916458c7a512 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1313 microversion: 2.1 time: 0.932301 Jul 20 04:24:06.903399 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1603/3275] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:05 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1313 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:07.024222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-418beb8c-d3ba-42b9-9c01-9976bc307c30 req-77cdace3-345a-4269-ad73-2a8d844b9784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e1887b-7d01-481c-a707-dd7d60a9a97b", "tag": "4e249346-af6b-4c8d-98eb-93eec710477c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:07.044666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-418beb8c-d3ba-42b9-9c01-9976bc307c30 req-77cdace3-345a-4269-ad73-2a8d844b9784 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.045253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-418beb8c-d3ba-42b9-9c01-9976bc307c30 req-77cdace3-345a-4269-ad73-2a8d844b9784 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.101078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-93a11da8-2ed4-4679-9007-795dff3f0b79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:07.102305 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-418beb8c-d3ba-42b9-9c01-9976bc307c30 req-77cdace3-345a-4269-ad73-2a8d844b9784 service nova] Creating event network-changed:4e249346-af6b-4c8d-98eb-93eec710477c for instance 45e1887b-7d01-481c-a707-dd7d60a9a97b on n-h1-764485-11 Jul 20 04:24:07.109083 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-418beb8c-d3ba-42b9-9c01-9976bc307c30 req-77cdace3-345a-4269-ad73-2a8d844b9784 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088308 Jul 20 04:24:07.110184 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1604/3276] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:24:07.115977 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-93a11da8-2ed4-4679-9007-795dff3f0b79 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1372 microversion: 2.1 time: 0.651324 Jul 20 04:24:07.116583 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1673/3277] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:06 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1372 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:07.448401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-4f622201-a99a-443a-91b3-91dc0550158e req-28639dc2-8230-4054-8a54-07eebcb90dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d80a59-9d6b-4b94-a643-8f6727f50511", "name": "network-vif-deleted", "tag": "a43b1718-8133-4ab5-802a-5f461293d0fd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:07.474987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4f622201-a99a-443a-91b3-91dc0550158e req-28639dc2-8230-4054-8a54-07eebcb90dc2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.476083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4f622201-a99a-443a-91b3-91dc0550158e req-28639dc2-8230-4054-8a54-07eebcb90dc2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.496426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-26c42107-ec59-4a65-8e5b-6bf42f96e2cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:07.496989 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-4f622201-a99a-443a-91b3-91dc0550158e req-28639dc2-8230-4054-8a54-07eebcb90dc2 service nova] Creating event network-vif-deleted:a43b1718-8133-4ab5-802a-5f461293d0fd for instance 57d80a59-9d6b-4b94-a643-8f6727f50511 on n-h1-764485-11 Jul 20 04:24:07.497113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-26c42107-ec59-4a65-8e5b-6bf42f96e2cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:07.505557 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-4f622201-a99a-443a-91b3-91dc0550158e req-28639dc2-8230-4054-8a54-07eebcb90dc2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071404 Jul 20 04:24:07.507286 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1605/3278] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:07.518024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26c42107-ec59-4a65-8e5b-6bf42f96e2cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.518486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26c42107-ec59-4a65-8e5b-6bf42f96e2cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.519263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26c42107-ec59-4a65-8e5b-6bf42f96e2cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.529830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26c42107-ec59-4a65-8e5b-6bf42f96e2cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.757148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-26c42107-ec59-4a65-8e5b-6bf42f96e2cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:07.776559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-26c42107-ec59-4a65-8e5b-6bf42f96e2cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:07.784708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-26c42107-ec59-4a65-8e5b-6bf42f96e2cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:07.787647 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-26c42107-ec59-4a65-8e5b-6bf42f96e2cf tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 200 len: 1370 microversion: 2.25 time: 0.306727 Jul 20 04:24:07.789862 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1674/3279] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:07 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 1370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:07.891738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-870f27fa-afe7-4626-b77c-9ed9f7db0d63 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:07.902872 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-870f27fa-afe7-4626-b77c-9ed9f7db0d63 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.213286 Jul 20 04:24:07.911291 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1606/3280] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:07.919170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d115d604-7ec1-4a93-bd56-f40b46b47d20 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:07.920000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d115d604-7ec1-4a93-bd56-f40b46b47d20 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:07.937744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d115d604-7ec1-4a93-bd56-f40b46b47d20 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.939857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ea80e221-3f38-4f8f-b17a-052d3257703c tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:07.940211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d115d604-7ec1-4a93-bd56-f40b46b47d20 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.941432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d115d604-7ec1-4a93-bd56-f40b46b47d20 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.942086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d115d604-7ec1-4a93-bd56-f40b46b47d20 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.988405 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ea80e221-3f38-4f8f-b17a-052d3257703c tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.073659 Jul 20 04:24:07.993979 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1607/3281] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 04:24:07 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:08.007014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ea2f2b4b-5d29-4e64-942d-7c02e41d09ba tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.015659 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ea2f2b4b-5d29-4e64-942d-7c02e41d09ba tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013059 Jul 20 04:24:08.016242 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1608/3282] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:24:08.033960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0560f3cd-40e1-444a-9b5c-f85fd5b5bace tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.051246 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0560f3cd-40e1-444a-9b5c-f85fd5b5bace tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026120 Jul 20 04:24:08.052529 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1609/3283] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:08.066108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7f7c8718-3c58-407d-901a-94f5532a767f tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.122554 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7f7c8718-3c58-407d-901a-94f5532a767f tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.061711 Jul 20 04:24:08.133290 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1610/3284] 10.222.0.20 () {58 vars in 1164 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:08.139713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f6c6574-7845-4039-ac44-29d64f1d06a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.141015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0f6c6574-7845-4039-ac44-29d64f1d06a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:08.154820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f6c6574-7845-4039-ac44-29d64f1d06a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.155976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f6c6574-7845-4039-ac44-29d64f1d06a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.157422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f6c6574-7845-4039-ac44-29d64f1d06a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.158995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f6c6574-7845-4039-ac44-29d64f1d06a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.454082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d115d604-7ec1-4a93-bd56-f40b46b47d20 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:08.466626 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d115d604-7ec1-4a93-bd56-f40b46b47d20 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1313 microversion: 2.1 time: 0.559212 Jul 20 04:24:08.470485 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1675/3285] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:07 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:08.481802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62f9a0c3-b54e-4fb3-b061-84956e581947 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.494088 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-62f9a0c3-b54e-4fb3-b061-84956e581947 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020809 Jul 20 04:24:08.495271 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1676/3286] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:08.507454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-11b60221-b38a-48e3-ab6c-7e981474fd4b tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.528034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0f6c6574-7845-4039-ac44-29d64f1d06a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:08.541421 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f6c6574-7845-4039-ac44-29d64f1d06a7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1372 microversion: 2.1 time: 0.406608 Jul 20 04:24:08.544094 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1611/3287] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1372 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:08.566501 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-11b60221-b38a-48e3-ab6c-7e981474fd4b tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.064383 Jul 20 04:24:08.567836 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1677/3288] 10.222.0.20 () {58 vars in 1168 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:08.581691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5ca84248-5383-4d40-88be-84243b439e67 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.592903 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5ca84248-5383-4d40-88be-84243b439e67 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.015282 Jul 20 04:24:08.606360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2596dc60-23a9-4d30-b6e2-61b0a127e1dd tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.612342 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1612/3289] 10.222.0.20 () {58 vars in 1160 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:08.616485 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2596dc60-23a9-4d30-b6e2-61b0a127e1dd tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014023 Jul 20 04:24:08.627651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-027d87d7-b02d-41e0-8f3c-4ec3e86f3aa8 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.633073 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1678/3290] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:08.679078 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-027d87d7-b02d-41e0-8f3c-4ec3e86f3aa8 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.055231 Jul 20 04:24:08.684221 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1613/3291] 10.222.0.20 () {58 vars in 1166 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:08.699341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-29b2dc82-df9c-4778-9008-98f989b8ecac tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.713235 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-29b2dc82-df9c-4778-9008-98f989b8ecac tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018584 Jul 20 04:24:08.717765 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1679/3292] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:08.730584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a8e84f41-55fc-4ae0-b8df-7a45aba65943 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.747938 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a8e84f41-55fc-4ae0-b8df-7a45aba65943 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.021219 Jul 20 04:24:08.761690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44bea7bd-ae67-463d-bf4b-987f6012674b tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.768414 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1614/3293] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:08.772998 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44bea7bd-ae67-463d-bf4b-987f6012674b tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015359 Jul 20 04:24:08.780479 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1680/3294] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:08.785053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dbf179d5-479f-4369-9552-2cc4c29f4f6f tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.806511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6677f39e-98d7-48eb-94d7-04e77d16a35b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.807273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6677f39e-98d7-48eb-94d7-04e77d16a35b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 57d80a59-9d6b-4b94-a643-8f6727f50511] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:08.819930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6677f39e-98d7-48eb-94d7-04e77d16a35b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.820546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6677f39e-98d7-48eb-94d7-04e77d16a35b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.825040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6677f39e-98d7-48eb-94d7-04e77d16a35b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.825696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6677f39e-98d7-48eb-94d7-04e77d16a35b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.831977 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dbf179d5-479f-4369-9552-2cc4c29f4f6f tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.051372 Jul 20 04:24:08.839725 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1615/3295] 10.222.0.20 () {58 vars in 1147 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:08.846239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fb0fbd54-c526-49a7-908b-0a39cd977cc1 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.860721 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-6677f39e-98d7-48eb-94d7-04e77d16a35b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] HTTP exception thrown: Instance 57d80a59-9d6b-4b94-a643-8f6727f50511 could not be found. Jul 20 04:24:08.862277 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fb0fbd54-c526-49a7-908b-0a39cd977cc1 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.017921 Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6677f39e-98d7-48eb-94d7-04e77d16a35b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Request method failure captured: Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 HTTP/1.1 Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14F6EHv6_3-eUvkZutuRKeqYZbd9Lts8Mw1PXhoaXrHUVMSbGgd9FlzNYB6pxR43mrbax3Wud-PliKxYMBv0yid5LV5HajYdCRurOd6ct5v6iy0xgU1XPpRLkgpRgB4c_iRQ6M2I32d1o39gdKyLTAZxtke49Wb9JUR_5bMVxpce3dM Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5181d3786af0422c928fa68ae1fd3956 Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1432039837 Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5181d3786af0422c928fa68ae1fd3956"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5181d3786af0422c928fa68ae1fd3956"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5181d3786af0422c928fa68ae1fd3956", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5181d3786af0422c928fa68ae1fd3956"}]}] Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1432039837 Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5181d3786af0422c928fa68ae1fd3956 Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1432039837 Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-LiveAutoBlockMigrationV225Test-1432039837-project Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b63f54e61ef144968f6c8d9cfb954c8f Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1432039837-project Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 57d80a59-9d6b-4b94-a643-8f6727f50511 could not be found. Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '57d80a59-9d6b-4b94-a643-8f6727f50511'} Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d80a59-9d6b-4b94-a643-8f6727f50511 could not be found. Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d80a59-9d6b-4b94-a643-8f6727f50511 could not be found. Jul 20 04:24:08.864106 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:08.868271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:08.868271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:08.868271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:08.868271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:08.868271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:08.868271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:08.868271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:08.868271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d80a59-9d6b-4b94-a643-8f6727f50511 could not be found. Jul 20 04:24:08.868271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:08.868814 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1616/3296] 10.222.0.20 () {58 vars in 1139 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:08.872845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6677f39e-98d7-48eb-94d7-04e77d16a35b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Returning 404 to user: Instance 57d80a59-9d6b-4b94-a643-8f6727f50511 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:08.875063 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6677f39e-98d7-48eb-94d7-04e77d16a35b tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511" status: 404 len: 111 microversion: 2.25 time: 0.072562 Jul 20 04:24:08.878377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d1b0da73-7d51-455f-aa57-f823ba3d3882 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.878867 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1681/3297] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/servers/57d80a59-9d6b-4b94-a643-8f6727f50511 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:24:08.887391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ea428e5e-20f2-4f45-a681-26cbfacc2aac tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '.version_select at 0x7fbf9c8141f0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.910576 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d1b0da73-7d51-455f-aa57-f823ba3d3882 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040129 Jul 20 04:24:08.913502 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1617/3298] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:08.921806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7f8dd3ec-7b61-4666-aaee-184a83085c3a tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.933013 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ea428e5e-20f2-4f45-a681-26cbfacc2aac tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-720293465" status: 204 len: 0 microversion: 2.25 time: 0.049558 Jul 20 04:24:08.937264 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1682/3299] 10.222.0.20 () {60 vars in 1258 bytes} [Wed Jul 20 04:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-720293465 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:08.979627 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7f8dd3ec-7b61-4666-aaee-184a83085c3a tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.061639 Jul 20 04:24:08.980533 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1618/3300] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:09.003155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c4796fb-ca0b-40d5-804d-95754136b8a9 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:09.040748 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c4796fb-ca0b-40d5-804d-95754136b8a9 tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051358 Jul 20 04:24:09.042040 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1683/3301] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:09.059688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a123b457-9261-44a8-a296-81de85bcedba tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:09.085881 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a123b457-9261-44a8-a296-81de85bcedba tempest-FlavorsV2TestJSON-353174954 tempest-FlavorsV2TestJSON-353174954-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021043 Jul 20 04:24:09.086714 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1619/3302] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:09.487849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-363c2617-30cd-4be9-b224-d7cc47f804ae tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:09.488527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-363c2617-30cd-4be9-b224-d7cc47f804ae tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:09.496756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-363c2617-30cd-4be9-b224-d7cc47f804ae tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.497219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-363c2617-30cd-4be9-b224-d7cc47f804ae tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.513609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-363c2617-30cd-4be9-b224-d7cc47f804ae tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.514278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-363c2617-30cd-4be9-b224-d7cc47f804ae tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.561297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5500cc2c-b6c7-47be-99c3-318059281f24 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:09.562152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5500cc2c-b6c7-47be-99c3-318059281f24 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:09.574610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5500cc2c-b6c7-47be-99c3-318059281f24 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.577888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5500cc2c-b6c7-47be-99c3-318059281f24 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.578918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5500cc2c-b6c7-47be-99c3-318059281f24 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.579538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5500cc2c-b6c7-47be-99c3-318059281f24 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:10.140450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5500cc2c-b6c7-47be-99c3-318059281f24 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:10.159395 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5500cc2c-b6c7-47be-99c3-318059281f24 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1372 microversion: 2.1 time: 0.602656 Jul 20 04:24:10.160477 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1620/3303] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:09 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1372 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:10.432184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:10.550008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-363c2617-30cd-4be9-b224-d7cc47f804ae tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:10.558633 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-363c2617-30cd-4be9-b224-d7cc47f804ae tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1334 microversion: 2.1 time: 1.075698 Jul 20 04:24:10.559216 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1684/3304] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:09 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1334 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:11.178589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6b3dab58-16a2-48a2-b4b4-3c6fba650ce8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:11.179559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6b3dab58-16a2-48a2-b4b4-3c6fba650ce8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:11.195269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b3dab58-16a2-48a2-b4b4-3c6fba650ce8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.195983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b3dab58-16a2-48a2-b4b4-3c6fba650ce8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.197050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b3dab58-16a2-48a2-b4b4-3c6fba650ce8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.203393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b3dab58-16a2-48a2-b4b4-3c6fba650ce8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.578247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be5abb5a-afed-491c-9e34-9dc8567a19a3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:11.579072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-be5abb5a-afed-491c-9e34-9dc8567a19a3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:11.591690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:11.597251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be5abb5a-afed-491c-9e34-9dc8567a19a3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.598707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be5abb5a-afed-491c-9e34-9dc8567a19a3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.602304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be5abb5a-afed-491c-9e34-9dc8567a19a3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.604008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be5abb5a-afed-491c-9e34-9dc8567a19a3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.989893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6b3dab58-16a2-48a2-b4b4-3c6fba650ce8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:12.003110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:12.015681 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6b3dab58-16a2-48a2-b4b4-3c6fba650ce8 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1372 microversion: 2.1 time: 0.842544 Jul 20 04:24:12.016287 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1621/3305] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:11 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1372 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:12.039085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-033a23de-aa70-4598-a530-b728ecef08ee tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:12.039613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-033a23de-aa70-4598-a530-b728ecef08ee tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:12.053844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:12.070692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-033a23de-aa70-4598-a530-b728ecef08ee tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.071148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-033a23de-aa70-4598-a530-b728ecef08ee tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.073180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-033a23de-aa70-4598-a530-b728ecef08ee tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.073686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-033a23de-aa70-4598-a530-b728ecef08ee tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.104493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-033a23de-aa70-4598-a530-b728ecef08ee tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:12.244640 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-033a23de-aa70-4598-a530-b728ecef08ee tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 204 len: 0 microversion: 2.25 time: 0.210748 Jul 20 04:24:12.246594 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1622/3306] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:24:12 2022] DELETE /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:12.263222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2bf91512-933a-4a9b-80af-74ea4415ff5c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:12.265399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2bf91512-933a-4a9b-80af-74ea4415ff5c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:12.281939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bf91512-933a-4a9b-80af-74ea4415ff5c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.283724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bf91512-933a-4a9b-80af-74ea4415ff5c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.285133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bf91512-933a-4a9b-80af-74ea4415ff5c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.287087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bf91512-933a-4a9b-80af-74ea4415ff5c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.481643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-be5abb5a-afed-491c-9e34-9dc8567a19a3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:12.496211 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-be5abb5a-afed-491c-9e34-9dc8567a19a3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1334 microversion: 2.1 time: 0.923405 Jul 20 04:24:12.509564 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1685/3307] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:11 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1334 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:13.014774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2bf91512-933a-4a9b-80af-74ea4415ff5c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:13.034935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52b3492c-0191-4df1-a747-31845bd9e58e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:13.035883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52b3492c-0191-4df1-a747-31845bd9e58e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:13.037470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2bf91512-933a-4a9b-80af-74ea4415ff5c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:13.038593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:13.039161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2bf91512-933a-4a9b-80af-74ea4415ff5c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:13.040757 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2bf91512-933a-4a9b-80af-74ea4415ff5c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1548 microversion: 2.25 time: 0.789854 Jul 20 04:24:13.044577 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1623/3308] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:12 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1548 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:13.078432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52b3492c-0191-4df1-a747-31845bd9e58e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.080520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52b3492c-0191-4df1-a747-31845bd9e58e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.081366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52b3492c-0191-4df1-a747-31845bd9e58e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.081826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52b3492c-0191-4df1-a747-31845bd9e58e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.515139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-48969d66-5659-4105-974a-d5a58202d16b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:13.517495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-48969d66-5659-4105-974a-d5a58202d16b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:13.549409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48969d66-5659-4105-974a-d5a58202d16b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.550459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48969d66-5659-4105-974a-d5a58202d16b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.556838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48969d66-5659-4105-974a-d5a58202d16b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.557816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48969d66-5659-4105-974a-d5a58202d16b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.990386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52b3492c-0191-4df1-a747-31845bd9e58e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:13.998212 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52b3492c-0191-4df1-a747-31845bd9e58e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1372 microversion: 2.1 time: 0.969281 Jul 20 04:24:13.999020 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1686/3309] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:13 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1372 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:14.062262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c7354a4b-f30c-4c16-9804-b174f24eae3e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:14.063777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c7354a4b-f30c-4c16-9804-b174f24eae3e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:14.071778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7354a4b-f30c-4c16-9804-b174f24eae3e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:14.072598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7354a4b-f30c-4c16-9804-b174f24eae3e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:14.073605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7354a4b-f30c-4c16-9804-b174f24eae3e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:14.074277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7354a4b-f30c-4c16-9804-b174f24eae3e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:14.768869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-48969d66-5659-4105-974a-d5a58202d16b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:14.786960 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-48969d66-5659-4105-974a-d5a58202d16b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 1.275773 Jul 20 04:24:14.787860 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1624/3310] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:13 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:15.016528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-503d0208-ccff-48b5-aab9-c23a69aeefe7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:15.018080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-503d0208-ccff-48b5-aab9-c23a69aeefe7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:15.026708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-503d0208-ccff-48b5-aab9-c23a69aeefe7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:15.029585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-503d0208-ccff-48b5-aab9-c23a69aeefe7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.031700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-503d0208-ccff-48b5-aab9-c23a69aeefe7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:15.033492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-503d0208-ccff-48b5-aab9-c23a69aeefe7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.052582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c7354a4b-f30c-4c16-9804-b174f24eae3e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:15.091332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c7354a4b-f30c-4c16-9804-b174f24eae3e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:15.099139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c7354a4b-f30c-4c16-9804-b174f24eae3e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:15.102687 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c7354a4b-f30c-4c16-9804-b174f24eae3e tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1548 microversion: 2.25 time: 1.042431 Jul 20 04:24:15.105849 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1687/3311] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:14 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1548 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:15.622368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-400503ab-2440-4597-9ac4-020e7df087e5 req-76051a1a-97a3-455c-9dc4-f97073195a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7da181-3013-4dcb-aaeb-3fa090a01941", "name": "network-vif-deleted", "tag": "c1b4726b-e1ba-4b8b-86cc-729b8499f72b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:15.655392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-400503ab-2440-4597-9ac4-020e7df087e5 req-76051a1a-97a3-455c-9dc4-f97073195a1c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:15.671572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-400503ab-2440-4597-9ac4-020e7df087e5 req-76051a1a-97a3-455c-9dc4-f97073195a1c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.742429 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-400503ab-2440-4597-9ac4-020e7df087e5 req-76051a1a-97a3-455c-9dc4-f97073195a1c service nova] Creating event network-vif-deleted:c1b4726b-e1ba-4b8b-86cc-729b8499f72b for instance cb7da181-3013-4dcb-aaeb-3fa090a01941 on n-h2-764485-11 Jul 20 04:24:15.768009 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-400503ab-2440-4597-9ac4-020e7df087e5 req-76051a1a-97a3-455c-9dc4-f97073195a1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154521 Jul 20 04:24:15.771961 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1688/3312] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:24:15.809278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d248011-750f-4a9b-9250-bf6c4afcc192 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:15.810294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d248011-750f-4a9b-9250-bf6c4afcc192 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:15.830330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-503d0208-ccff-48b5-aab9-c23a69aeefe7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:15.853922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d248011-750f-4a9b-9250-bf6c4afcc192 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:15.856059 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-503d0208-ccff-48b5-aab9-c23a69aeefe7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1372 microversion: 2.1 time: 0.844371 Jul 20 04:24:15.857725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d248011-750f-4a9b-9250-bf6c4afcc192 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.860343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d248011-750f-4a9b-9250-bf6c4afcc192 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:15.865269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d248011-750f-4a9b-9250-bf6c4afcc192 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.868052 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1625/3313] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:15 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1372 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:16.123240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:16.124250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:16.139874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:16.141826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:16.144961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:16.146781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:16.285543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:16.286248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:16.286882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lazy-loading 'fault' on Instance uuid cb7da181-3013-4dcb-aaeb-3fa090a01941 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:16.578360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:16.593123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:16.604032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:16.606822 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a81d5942-e6e2-47e2-98ba-e172b57bc0c1 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 200 len: 1351 microversion: 2.25 time: 0.488555 Jul 20 04:24:16.607441 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1626/3314] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:16 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 1351 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:24:16.812153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2d248011-750f-4a9b-9250-bf6c4afcc192 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:16.833550 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d248011-750f-4a9b-9250-bf6c4afcc192 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 1.031986 Jul 20 04:24:16.835952 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1689/3315] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:15 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:16.841012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2acd9a27-1c7f-4af8-ba4b-71bca2123e18 req-d748e512-80e5-4e90-a526-ddb584a6dc74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e1887b-7d01-481c-a707-dd7d60a9a97b", "name": "network-vif-plugged", "status": "completed", "tag": "4e249346-af6b-4c8d-98eb-93eec710477c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:16.878054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2acd9a27-1c7f-4af8-ba4b-71bca2123e18 req-d748e512-80e5-4e90-a526-ddb584a6dc74 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:16.878877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2acd9a27-1c7f-4af8-ba4b-71bca2123e18 req-d748e512-80e5-4e90-a526-ddb584a6dc74 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:16.922494 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2acd9a27-1c7f-4af8-ba4b-71bca2123e18 req-d748e512-80e5-4e90-a526-ddb584a6dc74 service nova] Creating event network-vif-plugged:4e249346-af6b-4c8d-98eb-93eec710477c for instance 45e1887b-7d01-481c-a707-dd7d60a9a97b on n-h1-764485-11 Jul 20 04:24:16.937312 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2acd9a27-1c7f-4af8-ba4b-71bca2123e18 req-d748e512-80e5-4e90-a526-ddb584a6dc74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099754 Jul 20 04:24:16.937963 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1690/3316] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:16.975975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74f7d5bf-d312-4cd4-b91e-70ccf5b89489 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:16.977179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74f7d5bf-d312-4cd4-b91e-70ccf5b89489 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:16.982145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7228efe4-5c2b-4124-9c81-0bc82627b110 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'create', calling method: .version_select at 0x7fbf9c44f310>, body: {"keypair": {"name": "tempest-keypair-130480390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO6ECSnDzmzSkwOtnbTS7/OOGAYAtcKZeSxAPY367CI9rTM0h6GvQhCQwxoisFvYZkaNQnNhdlGB0b5fgen8KCsKnlxtbKO+H0nXGkH93oBnvKmL2okytnJ9+YIXUd5Tw=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:17.007958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f7d5bf-d312-4cd4-b91e-70ccf5b89489 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:17.008418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f7d5bf-d312-4cd4-b91e-70ccf5b89489 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:17.009208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f7d5bf-d312-4cd4-b91e-70ccf5b89489 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:17.009646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f7d5bf-d312-4cd4-b91e-70ccf5b89489 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:17.038415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7228efe4-5c2b-4124-9c81-0bc82627b110 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Getting quotas for project 1be9144d8b214ecb8e416318d92b92ea. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:17.049958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7228efe4-5c2b-4124-9c81-0bc82627b110 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Getting quotas for user b559a8f5a1724682831d18c3f7ddfdf2 and project 1be9144d8b214ecb8e416318d92b92ea. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:17.054438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:17.115795 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7228efe4-5c2b-4124-9c81-0bc82627b110 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.506490 Jul 20 04:24:17.117211 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1627/3317] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:24:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:17.556105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-74f7d5bf-d312-4cd4-b91e-70ccf5b89489 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:17.578903 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74f7d5bf-d312-4cd4-b91e-70ccf5b89489 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1372 microversion: 2.1 time: 0.631219 Jul 20 04:24:17.580674 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1691/3318] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:16 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1372 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:17.628972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-275c1d30-e867-46d2-b9ab-b488d92c7cf6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:17.629892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-275c1d30-e867-46d2-b9ab-b488d92c7cf6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: cb7da181-3013-4dcb-aaeb-3fa090a01941] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:17.650205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-275c1d30-e867-46d2-b9ab-b488d92c7cf6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:17.650933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-275c1d30-e867-46d2-b9ab-b488d92c7cf6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:17.654251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-275c1d30-e867-46d2-b9ab-b488d92c7cf6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:17.656801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-275c1d30-e867-46d2-b9ab-b488d92c7cf6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:17.738241 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-275c1d30-e867-46d2-b9ab-b488d92c7cf6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] HTTP exception thrown: Instance cb7da181-3013-4dcb-aaeb-3fa090a01941 could not be found. Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-275c1d30-e867-46d2-b9ab-b488d92c7cf6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Request method failure captured: Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 HTTP/1.1 Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14F6EHv6_3-eUvkZutuRKeqYZbd9Lts8Mw1PXhoaXrHUVMSbGgd9FlzNYB6pxR43mrbax3Wud-PliKxYMBv0yid5LV5HajYdCRurOd6ct5v6iy0xgU1XPpRLkgpRgB4c_iRQ6M2I32d1o39gdKyLTAZxtke49Wb9JUR_5bMVxpce3dM Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5181d3786af0422c928fa68ae1fd3956 Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1432039837 Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5181d3786af0422c928fa68ae1fd3956"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5181d3786af0422c928fa68ae1fd3956"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5181d3786af0422c928fa68ae1fd3956", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5181d3786af0422c928fa68ae1fd3956"}]}] Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1432039837 Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5181d3786af0422c928fa68ae1fd3956 Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1432039837 Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-LiveAutoBlockMigrationV225Test-1432039837-project Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: b63f54e61ef144968f6c8d9cfb954c8f Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1432039837-project Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance cb7da181-3013-4dcb-aaeb-3fa090a01941 could not be found. Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'cb7da181-3013-4dcb-aaeb-3fa090a01941'} Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb7da181-3013-4dcb-aaeb-3fa090a01941 could not be found. Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb7da181-3013-4dcb-aaeb-3fa090a01941 could not be found. Jul 20 04:24:17.742432 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:24:17.747274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:17.747274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:24:17.747274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:17.747274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:17.747274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:17.747274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:17.747274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:17.747274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb7da181-3013-4dcb-aaeb-3fa090a01941 could not be found. Jul 20 04:24:17.747274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:24:17.749357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-275c1d30-e867-46d2-b9ab-b488d92c7cf6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Returning 404 to user: Instance cb7da181-3013-4dcb-aaeb-3fa090a01941 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:17.755796 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-275c1d30-e867-46d2-b9ab-b488d92c7cf6 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941" status: 404 len: 111 microversion: 2.25 time: 0.127034 Jul 20 04:24:17.757166 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1628/3319] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:17 2022] GET /compute/v2.1/servers/cb7da181-3013-4dcb-aaeb-3fa090a01941 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:24:17.767944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4db299f5-49b3-4d15-b8fc-f0880d6ec7fa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:17.768309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4db299f5-49b3-4d15-b8fc-f0880d6ec7fa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:17.786712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4db299f5-49b3-4d15-b8fc-f0880d6ec7fa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:17.787203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4db299f5-49b3-4d15-b8fc-f0880d6ec7fa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:17.790489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4db299f5-49b3-4d15-b8fc-f0880d6ec7fa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:17.790991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4db299f5-49b3-4d15-b8fc-f0880d6ec7fa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:17.855331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-725e308b-c9be-442c-a731-707fef8ba20e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:17.856858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4db299f5-49b3-4d15-b8fc-f0880d6ec7fa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:17.859418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-725e308b-c9be-442c-a731-707fef8ba20e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:17.900568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-725e308b-c9be-442c-a731-707fef8ba20e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:17.901119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-725e308b-c9be-442c-a731-707fef8ba20e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:17.901963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-725e308b-c9be-442c-a731-707fef8ba20e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:17.902662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-725e308b-c9be-442c-a731-707fef8ba20e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.047281 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4db299f5-49b3-4d15-b8fc-f0880d6ec7fa tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 204 len: 0 microversion: 2.25 time: 0.285325 Jul 20 04:24:18.055654 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1692/3320] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:24:17 2022] DELETE /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:18.063308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-48bcf852-fb6c-47e0-88d4-3d5e545a339d req-a8d0dd31-08ec-464f-a865-a8ecd6607415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7547c2-1e5a-4c01-9dba-a4340f629ceb", "tag": "b4a1bdb4-6f66-4a99-b99c-11e705bfb8a7"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:18.076034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-48bcf852-fb6c-47e0-88d4-3d5e545a339d req-a8d0dd31-08ec-464f-a865-a8ecd6607415 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.076693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-48bcf852-fb6c-47e0-88d4-3d5e545a339d req-a8d0dd31-08ec-464f-a865-a8ecd6607415 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.104591 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-48bcf852-fb6c-47e0-88d4-3d5e545a339d req-a8d0dd31-08ec-464f-a865-a8ecd6607415 service nova] Creating event network-changed:b4a1bdb4-6f66-4a99-b99c-11e705bfb8a7 for instance be7547c2-1e5a-4c01-9dba-a4340f629ceb on n-h1-764485-11 Jul 20 04:24:18.116537 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-48bcf852-fb6c-47e0-88d4-3d5e545a339d req-a8d0dd31-08ec-464f-a865-a8ecd6607415 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058291 Jul 20 04:24:18.119151 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1693/3321] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:18.136583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-627927bc-8f83-4c44-a0a9-ec08c804256c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:18.138388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-627927bc-8f83-4c44-a0a9-ec08c804256c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:18.154957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-627927bc-8f83-4c44-a0a9-ec08c804256c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.155551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-627927bc-8f83-4c44-a0a9-ec08c804256c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.156426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-627927bc-8f83-4c44-a0a9-ec08c804256c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.159397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-627927bc-8f83-4c44-a0a9-ec08c804256c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.480867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-725e308b-c9be-442c-a731-707fef8ba20e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:18.493993 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-725e308b-c9be-442c-a731-707fef8ba20e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 0.644104 Jul 20 04:24:18.503881 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1629/3322] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:17 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:18.598793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cc03b58c-872a-40eb-b1e0-51944214d892 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:18.608673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cc03b58c-872a-40eb-b1e0-51944214d892 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:18.616166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc03b58c-872a-40eb-b1e0-51944214d892 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.616969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc03b58c-872a-40eb-b1e0-51944214d892 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.635482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc03b58c-872a-40eb-b1e0-51944214d892 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.636139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc03b58c-872a-40eb-b1e0-51944214d892 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.707976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-627927bc-8f83-4c44-a0a9-ec08c804256c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:18.726228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-627927bc-8f83-4c44-a0a9-ec08c804256c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:18.741539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-627927bc-8f83-4c44-a0a9-ec08c804256c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:18.743085 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-627927bc-8f83-4c44-a0a9-ec08c804256c tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1563 microversion: 2.25 time: 0.620468 Jul 20 04:24:18.744098 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1694/3323] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:18 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1563 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:19.412808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cc03b58c-872a-40eb-b1e0-51944214d892 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:19.422180 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cc03b58c-872a-40eb-b1e0-51944214d892 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1372 microversion: 2.1 time: 0.828824 Jul 20 04:24:19.435890 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1630/3324] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:18 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1372 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:19.510495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57fa763d-df08-414b-b9cc-2f0c03ae6125 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:19.511939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-57fa763d-df08-414b-b9cc-2f0c03ae6125 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:19.521065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57fa763d-df08-414b-b9cc-2f0c03ae6125 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.521742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57fa763d-df08-414b-b9cc-2f0c03ae6125 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.522755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57fa763d-df08-414b-b9cc-2f0c03ae6125 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.523396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57fa763d-df08-414b-b9cc-2f0c03ae6125 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.563415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:19.762166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7494e72a-46c6-4b00-b4df-d690e877ad05 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:19.762779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7494e72a-46c6-4b00-b4df-d690e877ad05 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:19.777189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7494e72a-46c6-4b00-b4df-d690e877ad05 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.778100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7494e72a-46c6-4b00-b4df-d690e877ad05 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.779084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7494e72a-46c6-4b00-b4df-d690e877ad05 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.779767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7494e72a-46c6-4b00-b4df-d690e877ad05 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:21.125897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-57fa763d-df08-414b-b9cc-2f0c03ae6125 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:21.146478 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57fa763d-df08-414b-b9cc-2f0c03ae6125 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 1.638819 Jul 20 04:24:21.147428 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1695/3325] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:19 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:21.163330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fe366517-5d56-487d-93fd-3eced02de93d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:21.165564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fe366517-5d56-487d-93fd-3eced02de93d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:21.191460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe366517-5d56-487d-93fd-3eced02de93d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:21.192013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe366517-5d56-487d-93fd-3eced02de93d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:21.192752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe366517-5d56-487d-93fd-3eced02de93d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:21.193201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe366517-5d56-487d-93fd-3eced02de93d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:21.425862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7494e72a-46c6-4b00-b4df-d690e877ad05 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:21.440332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7494e72a-46c6-4b00-b4df-d690e877ad05 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:21.441868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7494e72a-46c6-4b00-b4df-d690e877ad05 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b63f54e61ef144968f6c8d9cfb954c8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181d3786af0422c928fa68ae1fd3956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:21.443116 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7494e72a-46c6-4b00-b4df-d690e877ad05 tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 200 len: 1563 microversion: 2.25 time: 1.684801 Jul 20 04:24:21.443639 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1631/3326] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:19 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 1563 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:21.467530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a958be2d-5a77-475f-9dee-95d9d65cc4f5 req-07b614ed-fb2a-440b-88d8-b5c681656519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7547c2-1e5a-4c01-9dba-a4340f629ceb", "tag": "1fdb3a12-1979-42c4-ad4d-c0ab385f139e"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:21.477857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a958be2d-5a77-475f-9dee-95d9d65cc4f5 req-07b614ed-fb2a-440b-88d8-b5c681656519 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:21.482516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a958be2d-5a77-475f-9dee-95d9d65cc4f5 req-07b614ed-fb2a-440b-88d8-b5c681656519 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:21.506901 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a958be2d-5a77-475f-9dee-95d9d65cc4f5 req-07b614ed-fb2a-440b-88d8-b5c681656519 service nova] Creating event network-changed:1fdb3a12-1979-42c4-ad4d-c0ab385f139e for instance be7547c2-1e5a-4c01-9dba-a4340f629ceb on n-h1-764485-11 Jul 20 04:24:21.517902 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a958be2d-5a77-475f-9dee-95d9d65cc4f5 req-07b614ed-fb2a-440b-88d8-b5c681656519 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066393 Jul 20 04:24:21.541529 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1632/3327] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:21.843812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-12f38f40-24a5-4de5-8372-cf7e1414c8d9 tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Action: 'create', calling method: .version_select at 0x7fbf9c3ca8b0>, body: {"pool": null} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:22.488012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fe366517-5d56-487d-93fd-3eced02de93d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:22.496058 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fe366517-5d56-487d-93fd-3eced02de93d tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1565 microversion: 2.1 time: 1.345758 Jul 20 04:24:22.507889 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1696/3328] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:21 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1565 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:22.516561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6aa39bf3-d9cb-4f73-a0f5-d110d5b6e353 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.517148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6aa39bf3-d9cb-4f73-a0f5-d110d5b6e353 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:22.545960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6aa39bf3-d9cb-4f73-a0f5-d110d5b6e353 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.546425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6aa39bf3-d9cb-4f73-a0f5-d110d5b6e353 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.547213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6aa39bf3-d9cb-4f73-a0f5-d110d5b6e353 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.547690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6aa39bf3-d9cb-4f73-a0f5-d110d5b6e353 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.220131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6aa39bf3-d9cb-4f73-a0f5-d110d5b6e353 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:23.230244 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6aa39bf3-d9cb-4f73-a0f5-d110d5b6e353 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 0.721007 Jul 20 04:24:23.231176 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1697/3329] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:22 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:23.237541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6592ffa-f256-4ae4-94e6-ea612c14b33a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:23.238819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c6592ffa-f256-4ae4-94e6-ea612c14b33a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] [instance: 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:23.250395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6592ffa-f256-4ae4-94e6-ea612c14b33a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.252442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6592ffa-f256-4ae4-94e6-ea612c14b33a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.254189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6592ffa-f256-4ae4-94e6-ea612c14b33a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.255159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6592ffa-f256-4ae4-94e6-ea612c14b33a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.296249 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-c6592ffa-f256-4ae4-94e6-ea612c14b33a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] HTTP exception thrown: Instance 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe could not be found. Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6592ffa-f256-4ae4-94e6-ea612c14b33a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Request method failure captured: Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe HTTP/1.1 Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14F6EHv6_3-eUvkZutuRKeqYZbd9Lts8Mw1PXhoaXrHUVMSbGgd9FlzNYB6pxR43mrbax3Wud-PliKxYMBv0yid5LV5HajYdCRurOd6ct5v6iy0xgU1XPpRLkgpRgB4c_iRQ6M2I32d1o39gdKyLTAZxtke49Wb9JUR_5bMVxpce3dM Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5181d3786af0422c928fa68ae1fd3956 Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1432039837 Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5181d3786af0422c928fa68ae1fd3956"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5181d3786af0422c928fa68ae1fd3956"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5181d3786af0422c928fa68ae1fd3956", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5181d3786af0422c928fa68ae1fd3956"}]}] Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1432039837 Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5181d3786af0422c928fa68ae1fd3956 Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1432039837 Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-LiveAutoBlockMigrationV225Test-1432039837-project Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b63f54e61ef144968f6c8d9cfb954c8f Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1432039837-project Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe could not be found. Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe'} Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe could not be found. Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe could not be found. Jul 20 04:24:23.300862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.306256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:23.306256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.306256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:23.306256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:23.306256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:23.306256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:23.306256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:23.306256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe could not be found. Jul 20 04:24:23.306256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.315581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6592ffa-f256-4ae4-94e6-ea612c14b33a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] Returning 404 to user: Instance 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:23.316713 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c6592ffa-f256-4ae4-94e6-ea612c14b33a tempest-LiveAutoBlockMigrationV225Test-1432039837 tempest-LiveAutoBlockMigrationV225Test-1432039837-project] 10.222.0.20 "GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe" status: 404 len: 111 microversion: 2.25 time: 0.084105 Jul 20 04:24:23.317461 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1698/3330] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:23 2022] GET /compute/v2.1/servers/7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:24:23.325583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6f208e36-64d3-4b3d-a232-5430c78537c4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:23.331442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6f208e36-64d3-4b3d-a232-5430c78537c4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:23.368867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f208e36-64d3-4b3d-a232-5430c78537c4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.369960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f208e36-64d3-4b3d-a232-5430c78537c4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.371565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f208e36-64d3-4b3d-a232-5430c78537c4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.372926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f208e36-64d3-4b3d-a232-5430c78537c4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.763205 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6f208e36-64d3-4b3d-a232-5430c78537c4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.444148 Jul 20 04:24:23.771109 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1699/3331] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:24:23 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-interface => generated 284 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:23.777800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a4456f38-58e8-4123-9cd1-676419acf632 req-fcfbbec7-153c-41ee-b8e0-576adb0ee21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe", "name": "network-vif-deleted", "tag": "44316d0e-ff03-434b-84fc-d22fbc6f7ea6"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:23.814329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a4456f38-58e8-4123-9cd1-676419acf632 req-fcfbbec7-153c-41ee-b8e0-576adb0ee21e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.814800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a4456f38-58e8-4123-9cd1-676419acf632 req-fcfbbec7-153c-41ee-b8e0-576adb0ee21e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.841890 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a4456f38-58e8-4123-9cd1-676419acf632 req-fcfbbec7-153c-41ee-b8e0-576adb0ee21e service nova] Creating event network-vif-deleted:44316d0e-ff03-434b-84fc-d22fbc6f7ea6 for instance 7f053e2c-4029-4ae4-a3bd-ffa9a7d83bfe on n-h2-764485-11 Jul 20 04:24:23.849290 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a4456f38-58e8-4123-9cd1-676419acf632 req-fcfbbec7-153c-41ee-b8e0-576adb0ee21e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076227 Jul 20 04:24:23.850133 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1700/3332] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:24.254308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7f91718d-cf2d-4275-8104-f70b7d2bf43b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:24.255036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7f91718d-cf2d-4275-8104-f70b7d2bf43b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:24.261834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f91718d-cf2d-4275-8104-f70b7d2bf43b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:24.263483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f91718d-cf2d-4275-8104-f70b7d2bf43b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:24.264522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f91718d-cf2d-4275-8104-f70b7d2bf43b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:24.265136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f91718d-cf2d-4275-8104-f70b7d2bf43b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.249940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7f91718d-cf2d-4275-8104-f70b7d2bf43b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:25.260764 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7f91718d-cf2d-4275-8104-f70b7d2bf43b tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 1.014309 Jul 20 04:24:25.262199 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1701/3333] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:24 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:25.269512 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1030929801", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a7e8d9c-f123-4816-a77b-51f1b199a341"}], "security_groups": [{"name": "tempest-securitygroup--1672425932"}], "key_name": "tempest-keypair-130480390", "user_data": "}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:25.721018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] validate_networks() for [('1a7e8d9c-f123-4816-a77b-51f1b199a341', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:27.078212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:27.671819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:27.673090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:27.673734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:27.674723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:27.675167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:27.706146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.709045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.714513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.715598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.783169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Getting quotas for project 1be9144d8b214ecb8e416318d92b92ea. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:27.793889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Getting quotas for user b559a8f5a1724682831d18c3f7ddfdf2 and project 1be9144d8b214ecb8e416318d92b92ea. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:27.814121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:27.821945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:27.893399 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b54a9724-07cd-4916-8364-a3ed2724e98e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.625083 Jul 20 04:24:27.895224 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1702/3334] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:25 2022] POST /compute/v2.1/servers => generated 409 bytes in 2632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:27.903364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-674c2e5b-d9ea-4240-9fe5-4a841673dae9 req-83185b3a-4571-4218-af47-b5a79f96bb7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7547c2-1e5a-4c01-9dba-a4340f629ceb", "tag": "34883a48-b463-4133-9579-48abc49b901a"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:27.920986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-674c2e5b-d9ea-4240-9fe5-4a841673dae9 req-83185b3a-4571-4218-af47-b5a79f96bb7d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.921541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-674c2e5b-d9ea-4240-9fe5-4a841673dae9 req-83185b3a-4571-4218-af47-b5a79f96bb7d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.937934 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-674c2e5b-d9ea-4240-9fe5-4a841673dae9 req-83185b3a-4571-4218-af47-b5a79f96bb7d service nova] Creating event network-changed:34883a48-b463-4133-9579-48abc49b901a for instance be7547c2-1e5a-4c01-9dba-a4340f629ceb on n-h1-764485-11 Jul 20 04:24:27.963184 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-674c2e5b-d9ea-4240-9fe5-4a841673dae9 req-83185b3a-4571-4218-af47-b5a79f96bb7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064884 Jul 20 04:24:27.963184 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1703/3335] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:27.968313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-28b3b172-4cd4-41a0-bb2d-b53e07435d8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.969027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-28b3b172-4cd4-41a0-bb2d-b53e07435d8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:27.976763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28b3b172-4cd4-41a0-bb2d-b53e07435d8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.977218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28b3b172-4cd4-41a0-bb2d-b53e07435d8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.978167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28b3b172-4cd4-41a0-bb2d-b53e07435d8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.978438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28b3b172-4cd4-41a0-bb2d-b53e07435d8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.495417 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-12f38f40-24a5-4de5-8372-cf7e1414c8d9 tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 6.750967 Jul 20 04:24:28.499458 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1633/3336] 10.222.0.20 () {60 vars in 1169 bytes} [Wed Jul 20 04:24:21 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 6756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:24:28.507214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-57b0b6e9-a4f6-4772-a5e5-ec5794d84e3f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:28.507997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-57b0b6e9-a4f6-4772-a5e5-ec5794d84e3f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:28.759677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-57b0b6e9-a4f6-4772-a5e5-ec5794d84e3f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:28.783523 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-57b0b6e9-a4f6-4772-a5e5-ec5794d84e3f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1238 microversion: 2.1 time: 0.279391 Jul 20 04:24:28.784261 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1634/3337] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:28 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1238 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:29.110440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-26c7ae02-5e03-482f-b151-b9fd0585ad2c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.111147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-26c7ae02-5e03-482f-b151-b9fd0585ad2c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:29.112839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-28b3b172-4cd4-41a0-bb2d-b53e07435d8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:29.121079 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-28b3b172-4cd4-41a0-bb2d-b53e07435d8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 1.156801 Jul 20 04:24:29.130943 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1704/3338] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:27 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:29.132485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-33abe5b3-cc7f-44b5-ad67-943394529226 tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Calling method '.version_select at 0x7fbf9c67cf70>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.135731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26c7ae02-5e03-482f-b151-b9fd0585ad2c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.139866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26c7ae02-5e03-482f-b151-b9fd0585ad2c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.142296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26c7ae02-5e03-482f-b151-b9fd0585ad2c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.143348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26c7ae02-5e03-482f-b151-b9fd0585ad2c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.306423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-26c7ae02-5e03-482f-b151-b9fd0585ad2c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:29.520134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:29.603331 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-26c7ae02-5e03-482f-b151-b9fd0585ad2c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 204 len: 0 microversion: 2.42 time: 0.817777 Jul 20 04:24:29.607312 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1635/3339] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:24:28 2022] DELETE /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 0 bytes in 819 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:29.626872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-885860d7-4920-416b-98c6-142fa9e5f03d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.631281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-885860d7-4920-416b-98c6-142fa9e5f03d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:29.643175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-885860d7-4920-416b-98c6-142fa9e5f03d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.648752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-885860d7-4920-416b-98c6-142fa9e5f03d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.649748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-885860d7-4920-416b-98c6-142fa9e5f03d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.650207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-885860d7-4920-416b-98c6-142fa9e5f03d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.479528 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-33abe5b3-cc7f-44b5-ad67-943394529226 tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/5e25e5d2-68cd-498e-b1ca-6b77a0478299" status: 200 len: 140 microversion: 2.1 time: 1.350463 Jul 20 04:24:30.480828 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1705/3340] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/os-floating-ips/5e25e5d2-68cd-498e-b1ca-6b77a0478299 => generated 140 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:30.493678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fbac0254-490b-4c79-9a4c-3421165a5b7d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:30.502452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fbac0254-490b-4c79-9a4c-3421165a5b7d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:30.532367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbac0254-490b-4c79-9a4c-3421165a5b7d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.533943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbac0254-490b-4c79-9a4c-3421165a5b7d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.536005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbac0254-490b-4c79-9a4c-3421165a5b7d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.537955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbac0254-490b-4c79-9a4c-3421165a5b7d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.645547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-885860d7-4920-416b-98c6-142fa9e5f03d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:30.659254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-885860d7-4920-416b-98c6-142fa9e5f03d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:30.660963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-885860d7-4920-416b-98c6-142fa9e5f03d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:30.663079 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-885860d7-4920-416b-98c6-142fa9e5f03d tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2961 microversion: 2.42 time: 1.051831 Jul 20 04:24:30.678588 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1636/3341] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2961 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:30.683384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4fff1d7d-e7f9-43f2-b30a-a354ab72842d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:30.683938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4fff1d7d-e7f9-43f2-b30a-a354ab72842d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:30.691341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fff1d7d-e7f9-43f2-b30a-a354ab72842d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.691846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fff1d7d-e7f9-43f2-b30a-a354ab72842d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.693111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fff1d7d-e7f9-43f2-b30a-a354ab72842d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.693557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fff1d7d-e7f9-43f2-b30a-a354ab72842d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.751483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fbac0254-490b-4c79-9a4c-3421165a5b7d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:30.764422 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fbac0254-490b-4c79-9a4c-3421165a5b7d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1296 microversion: 2.1 time: 0.282281 Jul 20 04:24:30.765036 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1706/3342] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:30 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1296 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:30.793085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4408d847-74d3-4ff9-a0cf-88d3d3001164 tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Calling method '.version_select at 0x7fbfa276fe50>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.236450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4fff1d7d-e7f9-43f2-b30a-a354ab72842d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:31.249975 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4fff1d7d-e7f9-43f2-b30a-a354ab72842d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 0.570504 Jul 20 04:24:31.259473 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1637/3343] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:30 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:31.259473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-fd1eb859-ae6c-45cc-b742-3de496ba9f27 req-e5562841-1e6a-40f0-b0a8-7919fc230f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e1887b-7d01-481c-a707-dd7d60a9a97b", "tag": "4e249346-af6b-4c8d-98eb-93eec710477c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:31.266832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fd1eb859-ae6c-45cc-b742-3de496ba9f27 req-e5562841-1e6a-40f0-b0a8-7919fc230f2c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.267395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fd1eb859-ae6c-45cc-b742-3de496ba9f27 req-e5562841-1e6a-40f0-b0a8-7919fc230f2c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.288513 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-fd1eb859-ae6c-45cc-b742-3de496ba9f27 req-e5562841-1e6a-40f0-b0a8-7919fc230f2c service nova] Creating event network-changed:4e249346-af6b-4c8d-98eb-93eec710477c for instance 45e1887b-7d01-481c-a707-dd7d60a9a97b on n-h1-764485-11 Jul 20 04:24:31.295981 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-fd1eb859-ae6c-45cc-b742-3de496ba9f27 req-e5562841-1e6a-40f0-b0a8-7919fc230f2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043461 Jul 20 04:24:31.296976 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1638/3344] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:31.380286 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4408d847-74d3-4ff9-a0cf-88d3d3001164 tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 143 microversion: 2.1 time: 0.601803 Jul 20 04:24:31.387900 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1707/3345] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Jul 20 04:24:30 2022] GET /compute/v2.1/os-floating-ips => generated 143 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:31.393547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-761e49c8-12c1-494a-9a71-cc261563e7a4 tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Calling method '.version_select at 0x7fbf9c3ea670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.686014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c66f355a-93da-4ea4-bea8-76c670e126e4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.687836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c66f355a-93da-4ea4-bea8-76c670e126e4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:31.719396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c66f355a-93da-4ea4-bea8-76c670e126e4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.719396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c66f355a-93da-4ea4-bea8-76c670e126e4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.723308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c66f355a-93da-4ea4-bea8-76c670e126e4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.723581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c66f355a-93da-4ea4-bea8-76c670e126e4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.750973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c66f355a-93da-4ea4-bea8-76c670e126e4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:32.770689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c66f355a-93da-4ea4-bea8-76c670e126e4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:32.772635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c66f355a-93da-4ea4-bea8-76c670e126e4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:32.774151 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c66f355a-93da-4ea4-bea8-76c670e126e4 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2961 microversion: 2.42 time: 1.093976 Jul 20 04:24:32.775118 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1708/3346] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:31 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2961 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:32.780409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bb8c0d44-1f74-4d30-9d2c-e873193c65ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:32.794753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bb8c0d44-1f74-4d30-9d2c-e873193c65ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:32.806958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb8c0d44-1f74-4d30-9d2c-e873193c65ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.807797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb8c0d44-1f74-4d30-9d2c-e873193c65ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.808704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb8c0d44-1f74-4d30-9d2c-e873193c65ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.810309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb8c0d44-1f74-4d30-9d2c-e873193c65ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.947180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bb8c0d44-1f74-4d30-9d2c-e873193c65ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:32.957574 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bb8c0d44-1f74-4d30-9d2c-e873193c65ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1296 microversion: 2.1 time: 0.181114 Jul 20 04:24:32.958448 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1709/3347] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:32 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1296 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:32.972910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eac84878-c65e-4419-ae5e-0684281b098f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:32.973717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eac84878-c65e-4419-ae5e-0684281b098f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:32.980689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eac84878-c65e-4419-ae5e-0684281b098f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.981379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eac84878-c65e-4419-ae5e-0684281b098f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.982344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eac84878-c65e-4419-ae5e-0684281b098f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.982941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eac84878-c65e-4419-ae5e-0684281b098f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:33.354415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-eac84878-c65e-4419-ae5e-0684281b098f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:33.367475 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eac84878-c65e-4419-ae5e-0684281b098f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 0.406536 Jul 20 04:24:33.368851 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1710/3348] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:32 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:33.728092 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-761e49c8-12c1-494a-9a71-cc261563e7a4 tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/5e25e5d2-68cd-498e-b1ca-6b77a0478299" status: 202 len: 0 microversion: 2.1 time: 2.339000 Jul 20 04:24:33.729892 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1639/3349] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:24:31 2022] DELETE /compute/v2.1/os-floating-ips/5e25e5d2-68cd-498e-b1ca-6b77a0478299 => generated 0 bytes in 2342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:24:33.740407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-06f417c8-e168-4215-a301-7e1154795e1b tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Action: 'create', calling method: .version_select at 0x7fbfa27a4d30>, body: {"pool": null} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:33.795025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ff2bea4-b201-404e-9deb-a962f2a5fe90 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:33.796102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ff2bea4-b201-404e-9deb-a962f2a5fe90 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:33.804745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ff2bea4-b201-404e-9deb-a962f2a5fe90 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:33.805219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ff2bea4-b201-404e-9deb-a962f2a5fe90 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:33.806245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ff2bea4-b201-404e-9deb-a962f2a5fe90 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:33.806726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ff2bea4-b201-404e-9deb-a962f2a5fe90 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.222601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ff2bea4-b201-404e-9deb-a962f2a5fe90 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:34.245508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ff2bea4-b201-404e-9deb-a962f2a5fe90 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:34.247534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ff2bea4-b201-404e-9deb-a962f2a5fe90 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:34.249200 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ff2bea4-b201-404e-9deb-a962f2a5fe90 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2961 microversion: 2.42 time: 0.458648 Jul 20 04:24:34.250066 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1640/3350] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:33 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2961 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:24:34.256779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-650d91cb-ca68-4d8b-9118-632971695e1e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:34.257662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-650d91cb-ca68-4d8b-9118-632971695e1e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:34.265676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-650d91cb-ca68-4d8b-9118-632971695e1e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.266658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-650d91cb-ca68-4d8b-9118-632971695e1e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.267867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-650d91cb-ca68-4d8b-9118-632971695e1e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.268825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-650d91cb-ca68-4d8b-9118-632971695e1e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.650228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-650d91cb-ca68-4d8b-9118-632971695e1e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:34.667357 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-650d91cb-ca68-4d8b-9118-632971695e1e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1364 microversion: 2.1 time: 0.415652 Jul 20 04:24:34.668588 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1641/3351] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:34 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1364 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:34.674809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-49f26260-4929-41ed-b612-5e577a374bb2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:34.675730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-49f26260-4929-41ed-b612-5e577a374bb2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:34.701679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49f26260-4929-41ed-b612-5e577a374bb2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.702140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49f26260-4929-41ed-b612-5e577a374bb2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.702939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49f26260-4929-41ed-b612-5e577a374bb2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.703371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49f26260-4929-41ed-b612-5e577a374bb2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:35.150352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-49f26260-4929-41ed-b612-5e577a374bb2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:35.160808 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-49f26260-4929-41ed-b612-5e577a374bb2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 0.490603 Jul 20 04:24:35.173823 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1642/3352] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:34 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:35.275024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b3e6d26a-aa02-48bb-8571-14ba913e51e7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:35.275665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b3e6d26a-aa02-48bb-8571-14ba913e51e7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:35.283351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3e6d26a-aa02-48bb-8571-14ba913e51e7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:35.283829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3e6d26a-aa02-48bb-8571-14ba913e51e7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:35.284677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3e6d26a-aa02-48bb-8571-14ba913e51e7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:35.285105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3e6d26a-aa02-48bb-8571-14ba913e51e7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.259783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b3e6d26a-aa02-48bb-8571-14ba913e51e7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:36.298947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b3e6d26a-aa02-48bb-8571-14ba913e51e7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:36.300763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b3e6d26a-aa02-48bb-8571-14ba913e51e7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:36.302022 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b3e6d26a-aa02-48bb-8571-14ba913e51e7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2961 microversion: 2.42 time: 1.031547 Jul 20 04:24:36.302775 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1643/3353] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:35 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2961 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:36.308458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3d4f381d-0189-468f-88aa-8e9d7de7cd0c req-c36ae529-5a44-40a7-8d09-b98ae2cdd7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c037b53b-2303-44d0-bb77-c8fa405473bb", "tag": "86571be8-3cd1-44e0-856c-952546489890"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:36.319875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3d4f381d-0189-468f-88aa-8e9d7de7cd0c req-c36ae529-5a44-40a7-8d09-b98ae2cdd7dd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:36.320411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3d4f381d-0189-468f-88aa-8e9d7de7cd0c req-c36ae529-5a44-40a7-8d09-b98ae2cdd7dd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.332971 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3d4f381d-0189-468f-88aa-8e9d7de7cd0c req-c36ae529-5a44-40a7-8d09-b98ae2cdd7dd service nova] Creating event network-changed:86571be8-3cd1-44e0-856c-952546489890 for instance c037b53b-2303-44d0-bb77-c8fa405473bb on n-h2-764485-11 Jul 20 04:24:36.339268 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3d4f381d-0189-468f-88aa-8e9d7de7cd0c req-c36ae529-5a44-40a7-8d09-b98ae2cdd7dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034751 Jul 20 04:24:36.340231 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1644/3354] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:36.346061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7d8a00f0-a8e2-4a98-972c-606effc283d0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:36.346943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7d8a00f0-a8e2-4a98-972c-606effc283d0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:36.353701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d8a00f0-a8e2-4a98-972c-606effc283d0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:36.354235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d8a00f0-a8e2-4a98-972c-606effc283d0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.355116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d8a00f0-a8e2-4a98-972c-606effc283d0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:36.355801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d8a00f0-a8e2-4a98-972c-606effc283d0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.394770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7d8a00f0-a8e2-4a98-972c-606effc283d0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:37.404937 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7d8a00f0-a8e2-4a98-972c-606effc283d0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1364 microversion: 2.1 time: 1.063280 Jul 20 04:24:37.406217 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1645/3355] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:36 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1364 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:37.415423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-507e35fc-7707-4422-82c8-8a1395f2f5e3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:37.416563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-507e35fc-7707-4422-82c8-8a1395f2f5e3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:37.428684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-507e35fc-7707-4422-82c8-8a1395f2f5e3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.430456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-507e35fc-7707-4422-82c8-8a1395f2f5e3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.432130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-507e35fc-7707-4422-82c8-8a1395f2f5e3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.432736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-507e35fc-7707-4422-82c8-8a1395f2f5e3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.749927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:37.805288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:38.191031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-507e35fc-7707-4422-82c8-8a1395f2f5e3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:38.220487 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-507e35fc-7707-4422-82c8-8a1395f2f5e3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 0.795592 Jul 20 04:24:38.220487 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1646/3356] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:37 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:38.220487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8c095867-00cc-4351-8375-c4ff52d15aa1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:38.220487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8c095867-00cc-4351-8375-c4ff52d15aa1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:38.240937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8c095867-00cc-4351-8375-c4ff52d15aa1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.241679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8c095867-00cc-4351-8375-c4ff52d15aa1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.242649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8c095867-00cc-4351-8375-c4ff52d15aa1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.243252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8c095867-00cc-4351-8375-c4ff52d15aa1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.774617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:38.853615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8c095867-00cc-4351-8375-c4ff52d15aa1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:38.869939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8c095867-00cc-4351-8375-c4ff52d15aa1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:38.873098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8c095867-00cc-4351-8375-c4ff52d15aa1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:38.876569 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8c095867-00cc-4351-8375-c4ff52d15aa1 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2961 microversion: 2.42 time: 0.666869 Jul 20 04:24:38.877812 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1647/3357] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:38 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2961 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:38.884738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-03563879-959d-4202-9d39-df900fb606c8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:38.885640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-03563879-959d-4202-9d39-df900fb606c8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:38.893977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03563879-959d-4202-9d39-df900fb606c8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.894455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03563879-959d-4202-9d39-df900fb606c8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.896074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03563879-959d-4202-9d39-df900fb606c8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.896521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03563879-959d-4202-9d39-df900fb606c8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.288657 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-06f417c8-e168-4215-a301-7e1154795e1b tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.553472 Jul 20 04:24:39.302776 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1711/3358] 10.222.0.20 () {60 vars in 1169 bytes} [Wed Jul 20 04:24:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:39.313381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9cd566db-59eb-415e-926c-40e6b013c600 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:39.315293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9cd566db-59eb-415e-926c-40e6b013c600 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:39.323774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9cd566db-59eb-415e-926c-40e6b013c600 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.324489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9cd566db-59eb-415e-926c-40e6b013c600 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.328144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9cd566db-59eb-415e-926c-40e6b013c600 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.328959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9cd566db-59eb-415e-926c-40e6b013c600 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.558218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-03563879-959d-4202-9d39-df900fb606c8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:39.569214 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-03563879-959d-4202-9d39-df900fb606c8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1364 microversion: 2.1 time: 0.689282 Jul 20 04:24:39.572191 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1648/3359] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:38 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1364 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:39.585106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ae78513e-1442-47de-9c42-b0e2bfd89416 tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Calling method '.version_select at 0x7fbf9d0a4a60>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:39.694044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9cd566db-59eb-415e-926c-40e6b013c600 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:39.708037 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9cd566db-59eb-415e-926c-40e6b013c600 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 0.401327 Jul 20 04:24:39.708956 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1712/3360] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:39 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:39.723041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-aab84aa1-a42f-484e-a7d1-059cc1ae2d60 req-dcd812a8-e6eb-4714-8e40-7f5e857a9dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-unplugged", "status": "completed", "tag": "da06b2f2-360d-4c71-b7f9-0250c1dbb102"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:39.752805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-aab84aa1-a42f-484e-a7d1-059cc1ae2d60 req-dcd812a8-e6eb-4714-8e40-7f5e857a9dd0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.758256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-aab84aa1-a42f-484e-a7d1-059cc1ae2d60 req-dcd812a8-e6eb-4714-8e40-7f5e857a9dd0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.794334 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-aab84aa1-a42f-484e-a7d1-059cc1ae2d60 req-dcd812a8-e6eb-4714-8e40-7f5e857a9dd0 service nova] Creating event network-vif-unplugged:da06b2f2-360d-4c71-b7f9-0250c1dbb102 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:24:39.807843 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-aab84aa1-a42f-484e-a7d1-059cc1ae2d60 req-dcd812a8-e6eb-4714-8e40-7f5e857a9dd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096458 Jul 20 04:24:39.811380 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1713/3361] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:39.898793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e72e91e9-d5be-4bbf-80f3-0f5312038ccc tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:39.900071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e72e91e9-d5be-4bbf-80f3-0f5312038ccc tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:39.915396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e72e91e9-d5be-4bbf-80f3-0f5312038ccc tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.916358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e72e91e9-d5be-4bbf-80f3-0f5312038ccc tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.917569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e72e91e9-d5be-4bbf-80f3-0f5312038ccc tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.920476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e72e91e9-d5be-4bbf-80f3-0f5312038ccc tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.058691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e72e91e9-d5be-4bbf-80f3-0f5312038ccc tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:41.090821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e72e91e9-d5be-4bbf-80f3-0f5312038ccc tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:41.095719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e72e91e9-d5be-4bbf-80f3-0f5312038ccc tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:41.100587 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e72e91e9-d5be-4bbf-80f3-0f5312038ccc tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2940 microversion: 2.42 time: 1.205531 Jul 20 04:24:41.103147 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1714/3362] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:39 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2940 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:41.109872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-70ce3654-1362-4b3e-a744-3245e3098d4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:41.111981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-70ce3654-1362-4b3e-a744-3245e3098d4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:41.121827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70ce3654-1362-4b3e-a744-3245e3098d4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.123400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70ce3654-1362-4b3e-a744-3245e3098d4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.125704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70ce3654-1362-4b3e-a744-3245e3098d4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.126521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70ce3654-1362-4b3e-a744-3245e3098d4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.718996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-70ce3654-1362-4b3e-a744-3245e3098d4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:41.732470 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-70ce3654-1362-4b3e-a744-3245e3098d4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1364 microversion: 2.1 time: 0.627800 Jul 20 04:24:41.742319 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1715/3363] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:41 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1364 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:41.769546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dc73cf88-afc4-44da-8efd-214186fd5e5e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:41.770448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dc73cf88-afc4-44da-8efd-214186fd5e5e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:41.787122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:41.789399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc73cf88-afc4-44da-8efd-214186fd5e5e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.790128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc73cf88-afc4-44da-8efd-214186fd5e5e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.792423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc73cf88-afc4-44da-8efd-214186fd5e5e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.792994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc73cf88-afc4-44da-8efd-214186fd5e5e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.320590 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ae78513e-1442-47de-9c42-b0e2bfd89416 tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/33efa4e5-af95-464e-b560-14376373118f" status: 202 len: 0 microversion: 2.1 time: 2.746285 Jul 20 04:24:42.321729 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1649/3364] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:24:39 2022] DELETE /compute/v2.1/os-floating-ips/33efa4e5-af95-464e-b560-14376373118f => generated 0 bytes in 2748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:24:42.328494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6c968543-095a-4406-9d31-e026d41c8c09 req-2229d9a8-3cd4-4c89-a9f7-bac7dbedad1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-unplugged", "status": "completed", "tag": "800cf352-aa0e-40db-9b0e-767c0447d749"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:42.359874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dc73cf88-afc4-44da-8efd-214186fd5e5e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:42.380838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6c968543-095a-4406-9d31-e026d41c8c09 req-2229d9a8-3cd4-4c89-a9f7-bac7dbedad1a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.383380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6c968543-095a-4406-9d31-e026d41c8c09 req-2229d9a8-3cd4-4c89-a9f7-bac7dbedad1a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.385483 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dc73cf88-afc4-44da-8efd-214186fd5e5e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 0.638904 Jul 20 04:24:42.385943 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1716/3365] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:41 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:42.395432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-de998d79-7f3d-4566-ac7c-b41f1a324edd tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:42.396687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-de998d79-7f3d-4566-ac7c-b41f1a324edd tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:42.411398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de998d79-7f3d-4566-ac7c-b41f1a324edd tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.413604 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-6c968543-095a-4406-9d31-e026d41c8c09 req-2229d9a8-3cd4-4c89-a9f7-bac7dbedad1a service nova] Creating event network-vif-unplugged:800cf352-aa0e-40db-9b0e-767c0447d749 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:24:42.416554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de998d79-7f3d-4566-ac7c-b41f1a324edd tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.417413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de998d79-7f3d-4566-ac7c-b41f1a324edd tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.417862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de998d79-7f3d-4566-ac7c-b41f1a324edd tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.423901 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6c968543-095a-4406-9d31-e026d41c8c09 req-2229d9a8-3cd4-4c89-a9f7-bac7dbedad1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100403 Jul 20 04:24:42.425562 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1650/3366] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:42.435990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d63418d8-7bd5-4f60-a78a-c9a6d84b49ce tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Calling method '.version_select at 0x7fbf9c4e1940>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:42.549442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG neutronclient.v2_0.client [None req-d63418d8-7bd5-4f60-a78a-c9a6d84b49ce tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 33efa4e5-af95-464e-b560-14376373118f could not be found", "detail": ""}} {{(pid=119807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:24:42.550150 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-d63418d8-7bd5-4f60-a78a-c9a6d84b49ce tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] HTTP exception thrown: Floating IP not found for ID 33efa4e5-af95-464e-b560-14376373118f Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d63418d8-7bd5-4f60-a78a-c9a6d84b49ce tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Request method failure captured: Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-floating-ips/33efa4e5-af95-464e-b560-14376373118f HTTP/1.1 Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14N1ISff9HOf1pG6nLcq5hWg_QQf8CBd0aaUyFKmrAE92SGj3kLhDUMEwWMdP-PTFbtaN-LrrOFwkmwQ-6p16sVlFObfciaU7VeKeLtGat3qhFWdLqpmDEt_oBL0cvM82tbzgPinNkyL0x97ZO-VEMk_D41_ESBsCkkKwbKTYc0xSLk Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 823eb986f4294afba87765f08d9fd7d8 Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-FloatingIPsTestJSON-961583906 Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/823eb986f4294afba87765f08d9fd7d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/823eb986f4294afba87765f08d9fd7d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_823eb986f4294afba87765f08d9fd7d8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/823eb986f4294afba87765f08d9fd7d8"}]}] Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-FloatingIPsTestJSON-961583906 Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 823eb986f4294afba87765f08d9fd7d8 Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-FloatingIPsTestJSON-961583906 Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-FloatingIPsTestJSON-961583906-project Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 641c7378c559401babc8a3c4915609b8 Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-FloatingIPsTestJSON-961583906-project Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: exception: Floating IP not found for ID 33efa4e5-af95-464e-b560-14376373118f Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '33efa4e5-af95-464e-b560-14376373118f'} Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 33efa4e5-af95-464e-b560-14376373118f could not be found Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2f68647-4cf9-45e9-b614-218a201ca2a5'] Jul 20 04:24:42.552604 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 33efa4e5-af95-464e-b560-14376373118f. Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 33efa4e5-af95-464e-b560-14376373118f Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 33efa4e5-af95-464e-b560-14376373118f Jul 20 04:24:42.557198 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.561552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d63418d8-7bd5-4f60-a78a-c9a6d84b49ce tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Returning 404 to user: Floating IP not found for ID 33efa4e5-af95-464e-b560-14376373118f {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:42.563809 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d63418d8-7bd5-4f60-a78a-c9a6d84b49ce tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/33efa4e5-af95-464e-b560-14376373118f" status: 404 len: 111 microversion: 2.1 time: 0.134469 Jul 20 04:24:42.565072 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1651/3367] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jul 20 04:24:42 2022] GET /compute/v2.1/os-floating-ips/33efa4e5-af95-464e-b560-14376373118f => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:42.717026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-593202762", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "ee650482-819d-4b05-bb31-636c7b988bd6"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:42.739150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-de998d79-7f3d-4566-ac7c-b41f1a324edd tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:42.758792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-de998d79-7f3d-4566-ac7c-b41f1a324edd tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:42.761937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-de998d79-7f3d-4566-ac7c-b41f1a324edd tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:42.766369 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-de998d79-7f3d-4566-ac7c-b41f1a324edd tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2919 microversion: 2.42 time: 0.378042 Jul 20 04:24:42.767255 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1717/3368] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:42 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2919 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:42.773209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0ba2a82f-3ad9-4cd9-8d50-078bd4433dfd tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Calling method '.version_select at 0x7fbf9c601940>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:42.822737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] validate_networks() for [('ee650482-819d-4b05-bb31-636c7b988bd6', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:42.828470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG neutronclient.v2_0.client [None req-0ba2a82f-3ad9-4cd9-8d50-078bd4433dfd tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 33efa4e5-af95-464e-b560-14376373118f could not be found", "detail": ""}} {{(pid=119808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:24:42.829566 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-0ba2a82f-3ad9-4cd9-8d50-078bd4433dfd tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] HTTP exception thrown: Floating IP not found for ID 33efa4e5-af95-464e-b560-14376373118f Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0ba2a82f-3ad9-4cd9-8d50-078bd4433dfd tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Request method failure captured: Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-floating-ips/33efa4e5-af95-464e-b560-14376373118f HTTP/1.1 Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14N1ISff9HOf1pG6nLcq5hWg_QQf8CBd0aaUyFKmrAE92SGj3kLhDUMEwWMdP-PTFbtaN-LrrOFwkmwQ-6p16sVlFObfciaU7VeKeLtGat3qhFWdLqpmDEt_oBL0cvM82tbzgPinNkyL0x97ZO-VEMk_D41_ESBsCkkKwbKTYc0xSLk Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 823eb986f4294afba87765f08d9fd7d8 Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FloatingIPsTestJSON-961583906 Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/823eb986f4294afba87765f08d9fd7d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/823eb986f4294afba87765f08d9fd7d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_823eb986f4294afba87765f08d9fd7d8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/823eb986f4294afba87765f08d9fd7d8"}]}] Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FloatingIPsTestJSON-961583906 Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 823eb986f4294afba87765f08d9fd7d8 Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FloatingIPsTestJSON-961583906 Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FloatingIPsTestJSON-961583906-project Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 641c7378c559401babc8a3c4915609b8 Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FloatingIPsTestJSON-961583906-project Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: exception: Floating IP not found for ID 33efa4e5-af95-464e-b560-14376373118f Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '33efa4e5-af95-464e-b560-14376373118f'} Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 33efa4e5-af95-464e-b560-14376373118f could not be found Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54c8cb46-48a8-4e6e-92be-58b79f4f5e78'] Jul 20 04:24:42.831736 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 33efa4e5-af95-464e-b560-14376373118f. Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 33efa4e5-af95-464e-b560-14376373118f Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 33efa4e5-af95-464e-b560-14376373118f Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0ba2a82f-3ad9-4cd9-8d50-078bd4433dfd tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] Returning 404 to user: Floating IP not found for ID 33efa4e5-af95-464e-b560-14376373118f {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:42.836120 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0ba2a82f-3ad9-4cd9-8d50-078bd4433dfd tempest-FloatingIPsTestJSON-961583906 tempest-FloatingIPsTestJSON-961583906-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/33efa4e5-af95-464e-b560-14376373118f" status: 404 len: 111 microversion: 2.1 time: 0.065377 Jul 20 04:24:42.859676 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1718/3369] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:24:42 2022] DELETE /compute/v2.1/os-floating-ips/33efa4e5-af95-464e-b560-14376373118f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:42.873087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b439df52-93d0-4784-b06c-e8dac4ff0ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:42.873934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b439df52-93d0-4784-b06c-e8dac4ff0ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:42.898504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b439df52-93d0-4784-b06c-e8dac4ff0ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.901746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b439df52-93d0-4784-b06c-e8dac4ff0ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.918340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b439df52-93d0-4784-b06c-e8dac4ff0ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.919269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b439df52-93d0-4784-b06c-e8dac4ff0ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:43.385854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b439df52-93d0-4784-b06c-e8dac4ff0ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:43.393126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:43.402778 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b439df52-93d0-4784-b06c-e8dac4ff0ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1364 microversion: 2.1 time: 0.539989 Jul 20 04:24:43.412917 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1719/3370] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:42 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1364 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:43.414186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ee023f01-ebd7-474a-89dd-27f0e478f287 req-efe10543-2547-48ad-8050-ab7c5e15ba79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-deleted", "tag": "ba9fd3bb-9cd1-4b98-911d-beb5f57fe7c1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:43.445054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ee023f01-ebd7-474a-89dd-27f0e478f287 req-efe10543-2547-48ad-8050-ab7c5e15ba79 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:43.447422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ee023f01-ebd7-474a-89dd-27f0e478f287 req-efe10543-2547-48ad-8050-ab7c5e15ba79 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:43.492992 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ee023f01-ebd7-474a-89dd-27f0e478f287 req-efe10543-2547-48ad-8050-ab7c5e15ba79 service nova] Creating event network-vif-deleted:ba9fd3bb-9cd1-4b98-911d-beb5f57fe7c1 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:24:43.508110 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ee023f01-ebd7-474a-89dd-27f0e478f287 req-efe10543-2547-48ad-8050-ab7c5e15ba79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102859 Jul 20 04:24:43.509950 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1720/3371] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:43.525938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52f94ac4-b927-44d3-8ae7-0b27f218bb8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:43.526788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52f94ac4-b927-44d3-8ae7-0b27f218bb8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:43.545528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52f94ac4-b927-44d3-8ae7-0b27f218bb8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:43.547100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52f94ac4-b927-44d3-8ae7-0b27f218bb8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:43.548365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52f94ac4-b927-44d3-8ae7-0b27f218bb8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:43.551018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52f94ac4-b927-44d3-8ae7-0b27f218bb8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.058313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52f94ac4-b927-44d3-8ae7-0b27f218bb8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:44.067696 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52f94ac4-b927-44d3-8ae7-0b27f218bb8e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 0.555066 Jul 20 04:24:44.073434 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1721/3372] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:43 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:44.093267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:44.093846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:44.098786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:44.099330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:44.099798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:44.116583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.117153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.119384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.119918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.178948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Getting quotas for project d54f1cbd9d674e7c899d15803e7186b2. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:44.193805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Getting quotas for user 1eb3f567f63548ffb95a5d6d24dca135 and project d54f1cbd9d674e7c899d15803e7186b2. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:44.225580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:44.228564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:44.327975 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9094c141-d88d-4559-a792-b21b21bfba1a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.757320 Jul 20 04:24:44.328819 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1652/3373] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:44.339301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-643f2a06-cab2-42f0-a13b-d50e07f70f01 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.347198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-643f2a06-cab2-42f0-a13b-d50e07f70f01 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.378993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-643f2a06-cab2-42f0-a13b-d50e07f70f01 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.379687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-643f2a06-cab2-42f0-a13b-d50e07f70f01 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.380684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-643f2a06-cab2-42f0-a13b-d50e07f70f01 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.381294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-643f2a06-cab2-42f0-a13b-d50e07f70f01 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.412972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7bd7ade5-1b37-4d73-a276-b5da32e0ea2c tempest-NetworksTest-481812994 tempest-NetworksTest-481812994-project-admin] Calling method '.version_select at 0x7fbf9c6f8550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:45.629769 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7bd7ade5-1b37-4d73-a276-b5da32e0ea2c tempest-NetworksTest-481812994 tempest-NetworksTest-481812994-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 12132 microversion: 2.1 time: 1.554145 Jul 20 04:24:45.631364 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1722/3374] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/os-networks => generated 12132 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:24:45.638325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-239dc0d1-7993-4483-8f75-8388a8824384 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:45.639071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-239dc0d1-7993-4483-8f75-8388a8824384 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:45.654738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-239dc0d1-7993-4483-8f75-8388a8824384 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.655413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-239dc0d1-7993-4483-8f75-8388a8824384 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.656463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-239dc0d1-7993-4483-8f75-8388a8824384 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.658912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-239dc0d1-7993-4483-8f75-8388a8824384 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.682756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-643f2a06-cab2-42f0-a13b-d50e07f70f01 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:45.701466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-643f2a06-cab2-42f0-a13b-d50e07f70f01 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:45.710098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-643f2a06-cab2-42f0-a13b-d50e07f70f01 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:45.713089 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-643f2a06-cab2-42f0-a13b-d50e07f70f01 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2711 microversion: 2.42 time: 1.377745 Jul 20 04:24:45.715977 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1653/3375] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2711 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:45.727714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe00c4d3-7fbd-4945-8b08-fd524d07b933 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:45.727714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe00c4d3-7fbd-4945-8b08-fd524d07b933 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:45.742007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe00c4d3-7fbd-4945-8b08-fd524d07b933 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.743220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe00c4d3-7fbd-4945-8b08-fd524d07b933 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.744430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe00c4d3-7fbd-4945-8b08-fd524d07b933 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.745203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe00c4d3-7fbd-4945-8b08-fd524d07b933 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.747023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-239dc0d1-7993-4483-8f75-8388a8824384 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:45.758766 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-239dc0d1-7993-4483-8f75-8388a8824384 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1267 microversion: 2.1 time: 0.123415 Jul 20 04:24:45.759567 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1723/3376] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:45 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1267 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:45.772992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-e4b9dbca-aecb-4699-88cd-0c618d6e3e47 req-e02dc34d-94a2-4fe3-ad4f-474dfd320c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-unplugged", "status": "completed", "tag": "5477bec5-e7f2-4638-a405-8b50b8e83faa"}, {"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-unplugged", "status": "completed", "tag": "f686daf0-a9f5-40b9-993f-1a05e9682dd5"}, {"server_uuid": "be7547c2-1e5a-4c01-9dba-a4340f629ceb", "name": "network-vif-plugged", "status": "completed", "tag": "b4a1bdb4-6f66-4a99-b99c-11e705bfb8a7"}, {"server_uuid": "be7547c2-1e5a-4c01-9dba-a4340f629ceb", "name": "network-vif-plugged", "status": "completed", "tag": "34883a48-b463-4133-9579-48abc49b901a"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:45.797657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e4b9dbca-aecb-4699-88cd-0c618d6e3e47 req-e02dc34d-94a2-4fe3-ad4f-474dfd320c84 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.801969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e4b9dbca-aecb-4699-88cd-0c618d6e3e47 req-e02dc34d-94a2-4fe3-ad4f-474dfd320c84 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.844681 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e4b9dbca-aecb-4699-88cd-0c618d6e3e47 req-e02dc34d-94a2-4fe3-ad4f-474dfd320c84 service nova] Creating event network-vif-unplugged:5477bec5-e7f2-4638-a405-8b50b8e83faa for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:24:45.845747 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e4b9dbca-aecb-4699-88cd-0c618d6e3e47 req-e02dc34d-94a2-4fe3-ad4f-474dfd320c84 service nova] Creating event network-vif-unplugged:f686daf0-a9f5-40b9-993f-1a05e9682dd5 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:24:45.846790 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e4b9dbca-aecb-4699-88cd-0c618d6e3e47 req-e02dc34d-94a2-4fe3-ad4f-474dfd320c84 service nova] Creating event network-vif-plugged:b4a1bdb4-6f66-4a99-b99c-11e705bfb8a7 for instance be7547c2-1e5a-4c01-9dba-a4340f629ceb on n-h1-764485-11 Jul 20 04:24:45.847323 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e4b9dbca-aecb-4699-88cd-0c618d6e3e47 req-e02dc34d-94a2-4fe3-ad4f-474dfd320c84 service nova] Creating event network-vif-plugged:34883a48-b463-4133-9579-48abc49b901a for instance be7547c2-1e5a-4c01-9dba-a4340f629ceb on n-h1-764485-11 Jul 20 04:24:45.860159 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-e4b9dbca-aecb-4699-88cd-0c618d6e3e47 req-e02dc34d-94a2-4fe3-ad4f-474dfd320c84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.095341 Jul 20 04:24:45.862092 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1724/3377] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:45.870908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9ee39196-8415-446c-881b-e6f9f24fd1d7 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:45.872408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9ee39196-8415-446c-881b-e6f9f24fd1d7 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:45.880154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ee39196-8415-446c-881b-e6f9f24fd1d7 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.881092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ee39196-8415-446c-881b-e6f9f24fd1d7 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.882600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ee39196-8415-446c-881b-e6f9f24fd1d7 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.883215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ee39196-8415-446c-881b-e6f9f24fd1d7 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.201296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe00c4d3-7fbd-4945-8b08-fd524d07b933 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:46.212911 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe00c4d3-7fbd-4945-8b08-fd524d07b933 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1364 microversion: 2.1 time: 0.494422 Jul 20 04:24:46.216437 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1654/3378] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:45 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1364 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:46.230365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-30a6d799-4033-4955-84c9-078f4d6efe6f req-50e83382-ad2a-4379-8ba0-ca07deb824a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-deleted", "tag": "da06b2f2-360d-4c71-b7f9-0250c1dbb102"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:46.256819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-30a6d799-4033-4955-84c9-078f4d6efe6f req-50e83382-ad2a-4379-8ba0-ca07deb824a2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.260322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-30a6d799-4033-4955-84c9-078f4d6efe6f req-50e83382-ad2a-4379-8ba0-ca07deb824a2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.290315 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-30a6d799-4033-4955-84c9-078f4d6efe6f req-50e83382-ad2a-4379-8ba0-ca07deb824a2 service nova] Creating event network-vif-deleted:da06b2f2-360d-4c71-b7f9-0250c1dbb102 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:24:46.302636 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-30a6d799-4033-4955-84c9-078f4d6efe6f req-50e83382-ad2a-4379-8ba0-ca07deb824a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084609 Jul 20 04:24:46.309056 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1655/3379] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:46.315435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-de7e1dbd-93b3-44db-830b-bee7da98b960 tempest-NetworksTest-481812994 tempest-NetworksTest-481812994-project-admin] Calling method '.version_select at 0x7fbf9c3c7b80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.584675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9ee39196-8415-446c-881b-e6f9f24fd1d7 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:46.593451 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9ee39196-8415-446c-881b-e6f9f24fd1d7 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 0.729774 Jul 20 04:24:46.604733 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1725/3380] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:45 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:46.668866 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-de7e1dbd-93b3-44db-830b-bee7da98b960 tempest-NetworksTest-481812994 tempest-NetworksTest-481812994-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks/7c850665-4c6d-46f2-aa23-038d4cc04131" status: 200 len: 652 microversion: 2.1 time: 0.358031 Jul 20 04:24:46.669467 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1656/3381] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/os-networks/7c850665-4c6d-46f2-aa23-038d4cc04131 => generated 652 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:46.681022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2b43c45a-4aea-4d82-a110-ca88575cfcb0 tempest-NetworksTest-481812994 tempest-NetworksTest-481812994-project-admin] Calling method '.version_select at 0x7fbfa2759040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.741474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2bbee236-7cc8-4424-b4ea-ee7eca633d93 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.742223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2bbee236-7cc8-4424-b4ea-ee7eca633d93 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:46.752091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bbee236-7cc8-4424-b4ea-ee7eca633d93 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.756284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bbee236-7cc8-4424-b4ea-ee7eca633d93 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.757270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bbee236-7cc8-4424-b4ea-ee7eca633d93 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.758328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bbee236-7cc8-4424-b4ea-ee7eca633d93 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.055870 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2b43c45a-4aea-4d82-a110-ca88575cfcb0 tempest-NetworksTest-481812994 tempest-NetworksTest-481812994-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 12132 microversion: 2.1 time: 0.379873 Jul 20 04:24:47.056870 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1726/3382] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/os-networks => generated 12132 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:24:47.067878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91f3bb35-a03b-4656-a21f-c064a72db2c9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:47.068215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91f3bb35-a03b-4656-a21f-c064a72db2c9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:47.094757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91f3bb35-a03b-4656-a21f-c064a72db2c9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.095207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91f3bb35-a03b-4656-a21f-c064a72db2c9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.098318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91f3bb35-a03b-4656-a21f-c064a72db2c9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.099828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91f3bb35-a03b-4656-a21f-c064a72db2c9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.440641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91f3bb35-a03b-4656-a21f-c064a72db2c9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:47.449719 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91f3bb35-a03b-4656-a21f-c064a72db2c9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1273 microversion: 2.1 time: 0.391559 Jul 20 04:24:47.452153 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1727/3383] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:47 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1273 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:47.463283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c28e707-aa53-4f43-a9e1-65a6e21482fd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:47.464104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6c28e707-aa53-4f43-a9e1-65a6e21482fd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:47.478279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c28e707-aa53-4f43-a9e1-65a6e21482fd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.478881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c28e707-aa53-4f43-a9e1-65a6e21482fd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.485543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c28e707-aa53-4f43-a9e1-65a6e21482fd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.486112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c28e707-aa53-4f43-a9e1-65a6e21482fd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.488010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2bbee236-7cc8-4424-b4ea-ee7eca633d93 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:47.524294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2bbee236-7cc8-4424-b4ea-ee7eca633d93 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:47.526169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2bbee236-7cc8-4424-b4ea-ee7eca633d93 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:47.539910 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2bbee236-7cc8-4424-b4ea-ee7eca633d93 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2597 microversion: 2.42 time: 0.801983 Jul 20 04:24:47.541488 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1657/3384] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2597 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:47.614965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b99c22ae-4938-456e-bb0d-8e4f39a2e18a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:47.616991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b99c22ae-4938-456e-bb0d-8e4f39a2e18a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:47.629338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:47.637014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b99c22ae-4938-456e-bb0d-8e4f39a2e18a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.637717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b99c22ae-4938-456e-bb0d-8e4f39a2e18a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.638862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b99c22ae-4938-456e-bb0d-8e4f39a2e18a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.639718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b99c22ae-4938-456e-bb0d-8e4f39a2e18a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.240944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6c28e707-aa53-4f43-a9e1-65a6e21482fd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:48.250071 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6c28e707-aa53-4f43-a9e1-65a6e21482fd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1364 microversion: 2.1 time: 0.795467 Jul 20 04:24:48.251050 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1728/3385] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:47 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1364 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:48.256227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-bce7a8ef-5096-4695-b721-8d2a9b926720 req-e74c0f81-6a96-4a6e-ba45-203e728c4fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7547c2-1e5a-4c01-9dba-a4340f629ceb", "name": "network-vif-plugged", "status": "completed", "tag": "1fdb3a12-1979-42c4-ad4d-c0ab385f139e"}, {"server_uuid": "c037b53b-2303-44d0-bb77-c8fa405473bb", "name": "network-vif-plugged", "status": "completed", "tag": "86571be8-3cd1-44e0-856c-952546489890"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:48.266030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-bce7a8ef-5096-4695-b721-8d2a9b926720 req-e74c0f81-6a96-4a6e-ba45-203e728c4fb9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.266739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-bce7a8ef-5096-4695-b721-8d2a9b926720 req-e74c0f81-6a96-4a6e-ba45-203e728c4fb9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.282990 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-bce7a8ef-5096-4695-b721-8d2a9b926720 req-e74c0f81-6a96-4a6e-ba45-203e728c4fb9 service nova] Creating event network-vif-plugged:1fdb3a12-1979-42c4-ad4d-c0ab385f139e for instance be7547c2-1e5a-4c01-9dba-a4340f629ceb on n-h1-764485-11 Jul 20 04:24:48.283866 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-bce7a8ef-5096-4695-b721-8d2a9b926720 req-e74c0f81-6a96-4a6e-ba45-203e728c4fb9 service nova] Creating event network-vif-plugged:86571be8-3cd1-44e0-856c-952546489890 for instance c037b53b-2303-44d0-bb77-c8fa405473bb on n-h2-764485-11 Jul 20 04:24:48.293577 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-bce7a8ef-5096-4695-b721-8d2a9b926720 req-e74c0f81-6a96-4a6e-ba45-203e728c4fb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040692 Jul 20 04:24:48.295010 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1729/3386] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:48.417218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b99c22ae-4938-456e-bb0d-8e4f39a2e18a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:48.432053 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b99c22ae-4938-456e-bb0d-8e4f39a2e18a tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 0.824015 Jul 20 04:24:48.433366 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1658/3387] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:47 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:48.471437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-852db813-dd28-4209-af77-6e0a7e94c1b5 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:48.472501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-852db813-dd28-4209-af77-6e0a7e94c1b5 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:48.479702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-852db813-dd28-4209-af77-6e0a7e94c1b5 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.480601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-852db813-dd28-4209-af77-6e0a7e94c1b5 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.481660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-852db813-dd28-4209-af77-6e0a7e94c1b5 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.482101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-852db813-dd28-4209-af77-6e0a7e94c1b5 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.550820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d618bc92-3578-4dd0-aa1b-abdecbe1cd38 req-6d8c4e5f-1d2b-4cdd-89cf-2323afb5b2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-deleted", "tag": "5477bec5-e7f2-4638-a405-8b50b8e83faa"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:48.572872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d618bc92-3578-4dd0-aa1b-abdecbe1cd38 req-6d8c4e5f-1d2b-4cdd-89cf-2323afb5b2ec service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.574034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d618bc92-3578-4dd0-aa1b-abdecbe1cd38 req-6d8c4e5f-1d2b-4cdd-89cf-2323afb5b2ec service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.590010 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d618bc92-3578-4dd0-aa1b-abdecbe1cd38 req-6d8c4e5f-1d2b-4cdd-89cf-2323afb5b2ec service nova] Creating event network-vif-deleted:5477bec5-e7f2-4638-a405-8b50b8e83faa for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:24:48.597347 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d618bc92-3578-4dd0-aa1b-abdecbe1cd38 req-6d8c4e5f-1d2b-4cdd-89cf-2323afb5b2ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060697 Jul 20 04:24:48.599122 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1659/3388] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:48.620240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-90f53cd2-f99e-4ee3-a30e-cb29381bcdb8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:48.620962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-90f53cd2-f99e-4ee3-a30e-cb29381bcdb8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:48.636346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90f53cd2-f99e-4ee3-a30e-cb29381bcdb8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.637433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90f53cd2-f99e-4ee3-a30e-cb29381bcdb8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.638226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90f53cd2-f99e-4ee3-a30e-cb29381bcdb8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.638847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90f53cd2-f99e-4ee3-a30e-cb29381bcdb8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.645387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:48.674630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-852db813-dd28-4209-af77-6e0a7e94c1b5 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:48.696182 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-852db813-dd28-4209-af77-6e0a7e94c1b5 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1273 microversion: 2.1 time: 0.230463 Jul 20 04:24:48.709700 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1730/3389] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:48 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:49.268150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-46a06245-2ba5-4afb-b1e8-55f5bedfe536 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:49.269755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-46a06245-2ba5-4afb-b1e8-55f5bedfe536 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:49.290719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46a06245-2ba5-4afb-b1e8-55f5bedfe536 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.296804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46a06245-2ba5-4afb-b1e8-55f5bedfe536 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.300493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46a06245-2ba5-4afb-b1e8-55f5bedfe536 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.300979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46a06245-2ba5-4afb-b1e8-55f5bedfe536 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.310040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-90f53cd2-f99e-4ee3-a30e-cb29381bcdb8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:49.324424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-90f53cd2-f99e-4ee3-a30e-cb29381bcdb8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:49.326513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-90f53cd2-f99e-4ee3-a30e-cb29381bcdb8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:49.328795 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-90f53cd2-f99e-4ee3-a30e-cb29381bcdb8 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2259 microversion: 2.42 time: 0.727539 Jul 20 04:24:49.343465 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1660/3390] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:48 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2259 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:49.451598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-40e75dcc-c9ca-4981-87e4-4dd79382fdcf tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:49.452315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-40e75dcc-c9ca-4981-87e4-4dd79382fdcf tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:49.460582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40e75dcc-c9ca-4981-87e4-4dd79382fdcf tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.461432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40e75dcc-c9ca-4981-87e4-4dd79382fdcf tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.462476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40e75dcc-c9ca-4981-87e4-4dd79382fdcf tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.463135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40e75dcc-c9ca-4981-87e4-4dd79382fdcf tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.958382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-40e75dcc-c9ca-4981-87e4-4dd79382fdcf tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:50.966974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-46a06245-2ba5-4afb-b1e8-55f5bedfe536 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:50.969065 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-40e75dcc-c9ca-4981-87e4-4dd79382fdcf tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1355 microversion: 2.1 time: 1.523287 Jul 20 04:24:50.971698 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1661/3391] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:49 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1355 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:50.986542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d230df0c-9a84-42df-9733-707c9c88ec01 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:50.987184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d230df0c-9a84-42df-9733-707c9c88ec01 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:50.995258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d230df0c-9a84-42df-9733-707c9c88ec01 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.995780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d230df0c-9a84-42df-9733-707c9c88ec01 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.996749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d230df0c-9a84-42df-9733-707c9c88ec01 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.996856 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-46a06245-2ba5-4afb-b1e8-55f5bedfe536 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1364 microversion: 2.1 time: 1.733999 Jul 20 04:24:50.996980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d230df0c-9a84-42df-9733-707c9c88ec01 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.999789 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1731/3392] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:49 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1364 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:51.008451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67017578-0826-4da1-b2bb-c189ef50a2d6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:51.009383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67017578-0826-4da1-b2bb-c189ef50a2d6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:51.017836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67017578-0826-4da1-b2bb-c189ef50a2d6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.018689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67017578-0826-4da1-b2bb-c189ef50a2d6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.020297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67017578-0826-4da1-b2bb-c189ef50a2d6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.020972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67017578-0826-4da1-b2bb-c189ef50a2d6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.517982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d230df0c-9a84-42df-9733-707c9c88ec01 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:51.526324 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d230df0c-9a84-42df-9733-707c9c88ec01 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1315 microversion: 2.1 time: 0.553571 Jul 20 04:24:51.527170 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1662/3393] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:50 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:51.532651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-38eb218b-c229-4e70-b462-534d1c565bfa req-adb6df12-0d55-4da4-b6e1-879698adeb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-deleted", "tag": "f686daf0-a9f5-40b9-993f-1a05e9682dd5"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:51.541057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-38eb218b-c229-4e70-b462-534d1c565bfa req-adb6df12-0d55-4da4-b6e1-879698adeb6b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.541746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-38eb218b-c229-4e70-b462-534d1c565bfa req-adb6df12-0d55-4da4-b6e1-879698adeb6b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.554074 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-38eb218b-c229-4e70-b462-534d1c565bfa req-adb6df12-0d55-4da4-b6e1-879698adeb6b service nova] Creating event network-vif-deleted:f686daf0-a9f5-40b9-993f-1a05e9682dd5 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:24:51.561407 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-38eb218b-c229-4e70-b462-534d1c565bfa req-adb6df12-0d55-4da4-b6e1-879698adeb6b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032133 Jul 20 04:24:51.564386 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1663/3394] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:51.740613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67017578-0826-4da1-b2bb-c189ef50a2d6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:51.785701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67017578-0826-4da1-b2bb-c189ef50a2d6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:51.787676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67017578-0826-4da1-b2bb-c189ef50a2d6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:51.790001 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67017578-0826-4da1-b2bb-c189ef50a2d6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 2212 microversion: 2.42 time: 0.788226 Jul 20 04:24:51.808434 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1732/3395] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:51 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 2212 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:51.990146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-45f87fa2-6053-4226-9c5d-172425fe9056 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:51.991597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-45f87fa2-6053-4226-9c5d-172425fe9056 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:52.009591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45f87fa2-6053-4226-9c5d-172425fe9056 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.010389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45f87fa2-6053-4226-9c5d-172425fe9056 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.016753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0a7eae9b-7d73-421b-9c60-3324847e87cf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:52.018099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0a7eae9b-7d73-421b-9c60-3324847e87cf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:52.024410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45f87fa2-6053-4226-9c5d-172425fe9056 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.025640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45f87fa2-6053-4226-9c5d-172425fe9056 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.030923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a7eae9b-7d73-421b-9c60-3324847e87cf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.032490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a7eae9b-7d73-421b-9c60-3324847e87cf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.036376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a7eae9b-7d73-421b-9c60-3324847e87cf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.037420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a7eae9b-7d73-421b-9c60-3324847e87cf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.478599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-45f87fa2-6053-4226-9c5d-172425fe9056 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:52.487649 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-45f87fa2-6053-4226-9c5d-172425fe9056 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1806 microversion: 2.1 time: 0.501877 Jul 20 04:24:52.490158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0a7eae9b-7d73-421b-9c60-3324847e87cf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:52.498855 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0a7eae9b-7d73-421b-9c60-3324847e87cf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1551 microversion: 2.1 time: 0.486310 Jul 20 04:24:52.499598 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1733/3396] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:52 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1551 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:52.506587 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1664/3397] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:51 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1806 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:52.525142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5b986fc2-b914-44ed-99bb-9ff549ad96c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:52.526159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5b986fc2-b914-44ed-99bb-9ff549ad96c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:52.543472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b986fc2-b914-44ed-99bb-9ff549ad96c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.545878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b986fc2-b914-44ed-99bb-9ff549ad96c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.546976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b986fc2-b914-44ed-99bb-9ff549ad96c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.549468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b986fc2-b914-44ed-99bb-9ff549ad96c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.614201 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5b986fc2-b914-44ed-99bb-9ff549ad96c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb/ips" status: 200 len: 219 microversion: 2.1 time: 0.101490 Jul 20 04:24:52.623951 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1665/3398] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:24:52 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb/ips => generated 219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:52.629954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a8ec7c84-b163-4d03-9f91-fccb619e1579 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:52.630893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a8ec7c84-b163-4d03-9f91-fccb619e1579 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:52.639736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8ec7c84-b163-4d03-9f91-fccb619e1579 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.641361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8ec7c84-b163-4d03-9f91-fccb619e1579 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.642865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8ec7c84-b163-4d03-9f91-fccb619e1579 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.643242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8ec7c84-b163-4d03-9f91-fccb619e1579 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.727432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e317a3d-95ae-4e9a-80ee-615adad61bda tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:52.729700 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:24:52.729700 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:24:52.731747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e317a3d-95ae-4e9a-80ee-615adad61bda tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.733455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e317a3d-95ae-4e9a-80ee-615adad61bda tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.735709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e317a3d-95ae-4e9a-80ee-615adad61bda tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.736528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e317a3d-95ae-4e9a-80ee-615adad61bda tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.776313 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6e317a3d-95ae-4e9a-80ee-615adad61bda tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.275330 Jul 20 04:24:52.777270 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1734/3399] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:52 2022] GET /compute/v2.1/os-services => generated 949 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:52.790634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ea755087-6dca-47be-a511-ed09f499813d tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:52.791997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ea755087-6dca-47be-a511-ed09f499813d tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:52.801555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea755087-6dca-47be-a511-ed09f499813d tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.803141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea755087-6dca-47be-a511-ed09f499813d tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.804318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea755087-6dca-47be-a511-ed09f499813d tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.805084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea755087-6dca-47be-a511-ed09f499813d tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.925531 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a8ec7c84-b163-4d03-9f91-fccb619e1579 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.300176 Jul 20 04:24:52.926604 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1666/3400] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:24:52 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/os-interface => generated 284 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:52.932405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e1b2300b-e7c4-4bca-87c5-9618db3dd3a5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:52.933079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e1b2300b-e7c4-4bca-87c5-9618db3dd3a5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:52.949229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1b2300b-e7c4-4bca-87c5-9618db3dd3a5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.949709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1b2300b-e7c4-4bca-87c5-9618db3dd3a5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.955627 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1b2300b-e7c4-4bca-87c5-9618db3dd3a5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.956328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1b2300b-e7c4-4bca-87c5-9618db3dd3a5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.021015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e1b2300b-e7c4-4bca-87c5-9618db3dd3a5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:53.227060 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e1b2300b-e7c4-4bca-87c5-9618db3dd3a5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "DELETE /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 204 len: 0 microversion: 2.1 time: 0.298487 Jul 20 04:24:53.227809 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1667/3401] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:52 2022] DELETE /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:53.245771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-98da9410-0175-47a9-8b2f-14380e67932a tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:53.249138 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:24:53.249138 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:24:53.252587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98da9410-0175-47a9-8b2f-14380e67932a tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.254200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98da9410-0175-47a9-8b2f-14380e67932a tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.256253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98da9410-0175-47a9-8b2f-14380e67932a tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.257311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98da9410-0175-47a9-8b2f-14380e67932a tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.270194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ea755087-6dca-47be-a511-ed09f499813d tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:53.279589 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ea755087-6dca-47be-a511-ed09f499813d tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1315 microversion: 2.1 time: 0.500495 Jul 20 04:24:53.286741 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1735/3402] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:52 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:53.299837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dccf6a3a-eff8-4437-a4db-055acfda8734 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:53.303787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dccf6a3a-eff8-4437-a4db-055acfda8734 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:53.319898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dccf6a3a-eff8-4437-a4db-055acfda8734 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.324332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dccf6a3a-eff8-4437-a4db-055acfda8734 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.327439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dccf6a3a-eff8-4437-a4db-055acfda8734 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.328745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dccf6a3a-eff8-4437-a4db-055acfda8734 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.332399 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-98da9410-0175-47a9-8b2f-14380e67932a tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-764485-11" status: 200 len: 581 microversion: 2.1 time: 0.093199 Jul 20 04:24:53.333369 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1668/3403] 10.222.0.20 () {58 vars in 1173 bytes} [Wed Jul 20 04:24:53 2022] GET /compute/v2.1/os-services?host=n-d-764485-11 => generated 581 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:53.347584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96cc0377-48a7-442a-b749-5d936e478589 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:53.348336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96cc0377-48a7-442a-b749-5d936e478589 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:53.362283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96cc0377-48a7-442a-b749-5d936e478589 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.364109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96cc0377-48a7-442a-b749-5d936e478589 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.367009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96cc0377-48a7-442a-b749-5d936e478589 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.367461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96cc0377-48a7-442a-b749-5d936e478589 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.424955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dccf6a3a-eff8-4437-a4db-055acfda8734 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:53.449495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dccf6a3a-eff8-4437-a4db-055acfda8734 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:53.452777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dccf6a3a-eff8-4437-a4db-055acfda8734 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:53.457624 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dccf6a3a-eff8-4437-a4db-055acfda8734 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.168449 Jul 20 04:24:53.460538 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1736/3404] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:53 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:53.469946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6270399a-d9e9-4b1e-884b-7af2f5c90e9c tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:53.472453 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:24:53.472453 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:24:53.478171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6270399a-d9e9-4b1e-884b-7af2f5c90e9c tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.479000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6270399a-d9e9-4b1e-884b-7af2f5c90e9c tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.480016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6270399a-d9e9-4b1e-884b-7af2f5c90e9c tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.483779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6270399a-d9e9-4b1e-884b-7af2f5c90e9c tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.516293 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6270399a-d9e9-4b1e-884b-7af2f5c90e9c tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.054459 Jul 20 04:24:53.523404 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1737/3405] 10.222.0.20 () {58 vars in 1175 bytes} [Wed Jul 20 04:24:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:53.528508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ce7374f6-d99c-4daf-bdc0-2830065b2e2f tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:53.529920 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:24:53.529920 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:24:53.531933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce7374f6-d99c-4daf-bdc0-2830065b2e2f tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.532585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce7374f6-d99c-4daf-bdc0-2830065b2e2f tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.533725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce7374f6-d99c-4daf-bdc0-2830065b2e2f tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.534318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce7374f6-d99c-4daf-bdc0-2830065b2e2f tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.592079 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ce7374f6-d99c-4daf-bdc0-2830065b2e2f tempest-ServicesAdminTestJSON-241502661 tempest-ServicesAdminTestJSON-241502661-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.067237 Jul 20 04:24:53.593494 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1738/3406] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:53 2022] GET /compute/v2.1/os-services => generated 949 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:53.640799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-1cab7908-a59c-4e38-bf2b-ada0aedfc0d0 req-153b36d5-dffd-430e-b05c-6c5f1141dcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc742a1-7d7d-49a8-8164-16f52d0a4c9f", "name": "network-vif-deleted", "tag": "800cf352-aa0e-40db-9b0e-767c0447d749"}, {"name": "network-changed", "server_uuid": "7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0", "tag": "2d38dd21-312c-408b-8cd1-ec9098143685"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:53.661068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1cab7908-a59c-4e38-bf2b-ada0aedfc0d0 req-153b36d5-dffd-430e-b05c-6c5f1141dcd3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.661782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1cab7908-a59c-4e38-bf2b-ada0aedfc0d0 req-153b36d5-dffd-430e-b05c-6c5f1141dcd3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.682438 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-1cab7908-a59c-4e38-bf2b-ada0aedfc0d0 req-153b36d5-dffd-430e-b05c-6c5f1141dcd3 service nova] Creating event network-vif-deleted:800cf352-aa0e-40db-9b0e-767c0447d749 for instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f on n-h1-764485-11 Jul 20 04:24:53.683162 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-1cab7908-a59c-4e38-bf2b-ada0aedfc0d0 req-153b36d5-dffd-430e-b05c-6c5f1141dcd3 service nova] Creating event network-changed:2d38dd21-312c-408b-8cd1-ec9098143685 for instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 on n-h2-764485-11 Jul 20 04:24:53.695945 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-1cab7908-a59c-4e38-bf2b-ada0aedfc0d0 req-153b36d5-dffd-430e-b05c-6c5f1141dcd3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059593 Jul 20 04:24:53.697118 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1739/3407] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:24:53.875485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-96cc0377-48a7-442a-b749-5d936e478589 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:53.887437 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-96cc0377-48a7-442a-b749-5d936e478589 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1812 microversion: 2.1 time: 0.544333 Jul 20 04:24:53.899795 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1669/3408] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:53 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1812 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:54.304374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ab18ea06-cbe8-458b-9e8e-672972191c19 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:54.305172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ab18ea06-cbe8-458b-9e8e-672972191c19 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:54.312411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab18ea06-cbe8-458b-9e8e-672972191c19 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.313484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab18ea06-cbe8-458b-9e8e-672972191c19 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.314344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab18ea06-cbe8-458b-9e8e-672972191c19 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.314971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab18ea06-cbe8-458b-9e8e-672972191c19 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.477183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f209cd60-5029-4934-9d92-0b10b9ed70df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:54.478403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f209cd60-5029-4934-9d92-0b10b9ed70df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:54.488326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:54.493663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f209cd60-5029-4934-9d92-0b10b9ed70df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.495872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f209cd60-5029-4934-9d92-0b10b9ed70df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.505452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f209cd60-5029-4934-9d92-0b10b9ed70df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.506264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f209cd60-5029-4934-9d92-0b10b9ed70df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.582064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ab18ea06-cbe8-458b-9e8e-672972191c19 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:54.601034 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ab18ea06-cbe8-458b-9e8e-672972191c19 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1315 microversion: 2.1 time: 0.302288 Jul 20 04:24:54.612735 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1740/3409] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:54 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:54.674503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f209cd60-5029-4934-9d92-0b10b9ed70df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:54.686317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f209cd60-5029-4934-9d92-0b10b9ed70df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:54.688626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f209cd60-5029-4934-9d92-0b10b9ed70df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:54.690288 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f209cd60-5029-4934-9d92-0b10b9ed70df tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.217274 Jul 20 04:24:54.701951 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1670/3410] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:54 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:24:54.908118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c69ce09-74a7-4e45-a2ff-d74a8e794047 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:54.909206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9c69ce09-74a7-4e45-a2ff-d74a8e794047 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:54.916533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c69ce09-74a7-4e45-a2ff-d74a8e794047 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.917607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c69ce09-74a7-4e45-a2ff-d74a8e794047 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.918815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c69ce09-74a7-4e45-a2ff-d74a8e794047 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.919612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c69ce09-74a7-4e45-a2ff-d74a8e794047 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:55.517966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9c69ce09-74a7-4e45-a2ff-d74a8e794047 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:55.529545 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c69ce09-74a7-4e45-a2ff-d74a8e794047 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1812 microversion: 2.1 time: 0.626879 Jul 20 04:24:55.539652 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1741/3411] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:54 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1812 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:55.619022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a5feb67-2c30-4bb3-ab6f-9f6aa9af68c2 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:55.619676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7a5feb67-2c30-4bb3-ab6f-9f6aa9af68c2 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:55.635949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a5feb67-2c30-4bb3-ab6f-9f6aa9af68c2 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:55.636419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a5feb67-2c30-4bb3-ab6f-9f6aa9af68c2 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:55.637223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a5feb67-2c30-4bb3-ab6f-9f6aa9af68c2 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:55.637663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a5feb67-2c30-4bb3-ab6f-9f6aa9af68c2 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:55.709808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-40cbddfb-5c3b-4296-8dc5-8d8321800a8e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:55.710485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40cbddfb-5c3b-4296-8dc5-8d8321800a8e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:55.726130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40cbddfb-5c3b-4296-8dc5-8d8321800a8e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:55.726662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40cbddfb-5c3b-4296-8dc5-8d8321800a8e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:55.729425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40cbddfb-5c3b-4296-8dc5-8d8321800a8e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:55.729871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40cbddfb-5c3b-4296-8dc5-8d8321800a8e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:55.998233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-40cbddfb-5c3b-4296-8dc5-8d8321800a8e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:56.023491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-40cbddfb-5c3b-4296-8dc5-8d8321800a8e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:56.028102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-40cbddfb-5c3b-4296-8dc5-8d8321800a8e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:56.038307 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-40cbddfb-5c3b-4296-8dc5-8d8321800a8e tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.331970 Jul 20 04:24:56.041066 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1742/3412] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:55 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:56.104034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-c1f0a5bc-97e3-40e8-a2df-477de4f57ac2 req-12e9a687-0a9a-4965-b28c-ab7c53720bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c037b53b-2303-44d0-bb77-c8fa405473bb", "tag": "86571be8-3cd1-44e0-856c-952546489890"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:56.128239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c1f0a5bc-97e3-40e8-a2df-477de4f57ac2 req-12e9a687-0a9a-4965-b28c-ab7c53720bad service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:56.128704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c1f0a5bc-97e3-40e8-a2df-477de4f57ac2 req-12e9a687-0a9a-4965-b28c-ab7c53720bad service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:56.154135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:56.162651 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c1f0a5bc-97e3-40e8-a2df-477de4f57ac2 req-12e9a687-0a9a-4965-b28c-ab7c53720bad service nova] Creating event network-changed:86571be8-3cd1-44e0-856c-952546489890 for instance c037b53b-2303-44d0-bb77-c8fa405473bb on n-h2-764485-11 Jul 20 04:24:56.169346 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-c1f0a5bc-97e3-40e8-a2df-477de4f57ac2 req-12e9a687-0a9a-4965-b28c-ab7c53720bad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085528 Jul 20 04:24:56.170563 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1743/3413] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:56.553345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ddbb2304-42d4-4709-8eff-d7a9bf2b6342 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:56.554914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ddbb2304-42d4-4709-8eff-d7a9bf2b6342 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:56.574057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddbb2304-42d4-4709-8eff-d7a9bf2b6342 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:56.575969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddbb2304-42d4-4709-8eff-d7a9bf2b6342 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:56.577105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddbb2304-42d4-4709-8eff-d7a9bf2b6342 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:56.579617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddbb2304-42d4-4709-8eff-d7a9bf2b6342 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:56.965324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7a5feb67-2c30-4bb3-ab6f-9f6aa9af68c2 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:56.981905 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7a5feb67-2c30-4bb3-ab6f-9f6aa9af68c2 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1315 microversion: 2.1 time: 1.367097 Jul 20 04:24:56.982699 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1671/3414] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:55 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1315 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:57.059647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-acbd19f3-9d85-4caa-bc96-6f21db1e866c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:57.060259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-acbd19f3-9d85-4caa-bc96-6f21db1e866c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:57.075252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-acbd19f3-9d85-4caa-bc96-6f21db1e866c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:57.076072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-acbd19f3-9d85-4caa-bc96-6f21db1e866c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:57.076516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-acbd19f3-9d85-4caa-bc96-6f21db1e866c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:57.076956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-acbd19f3-9d85-4caa-bc96-6f21db1e866c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:57.852261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-acbd19f3-9d85-4caa-bc96-6f21db1e866c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:57.862862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-acbd19f3-9d85-4caa-bc96-6f21db1e866c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:57.873369 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-acbd19f3-9d85-4caa-bc96-6f21db1e866c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:57.874630 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-acbd19f3-9d85-4caa-bc96-6f21db1e866c tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.818924 Jul 20 04:24:57.900022 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1672/3415] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:57 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:57.909313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1eb7c029-875f-4f0a-8c37-6c36a6b5e6d9 req-c154d51d-4b09-42a4-abbd-1ef2241da737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7547c2-1e5a-4c01-9dba-a4340f629ceb", "name": "network-vif-deleted", "tag": "b4a1bdb4-6f66-4a99-b99c-11e705bfb8a7"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:57.932757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1eb7c029-875f-4f0a-8c37-6c36a6b5e6d9 req-c154d51d-4b09-42a4-abbd-1ef2241da737 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:57.933259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1eb7c029-875f-4f0a-8c37-6c36a6b5e6d9 req-c154d51d-4b09-42a4-abbd-1ef2241da737 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:57.956173 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1eb7c029-875f-4f0a-8c37-6c36a6b5e6d9 req-c154d51d-4b09-42a4-abbd-1ef2241da737 service nova] Creating event network-vif-deleted:b4a1bdb4-6f66-4a99-b99c-11e705bfb8a7 for instance be7547c2-1e5a-4c01-9dba-a4340f629ceb on n-h1-764485-11 Jul 20 04:24:57.963630 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1eb7c029-875f-4f0a-8c37-6c36a6b5e6d9 req-c154d51d-4b09-42a4-abbd-1ef2241da737 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061984 Jul 20 04:24:57.964535 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1673/3416] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:58.005402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3df85b4e-9185-4749-bbf2-14f84fba758a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:58.007120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3df85b4e-9185-4749-bbf2-14f84fba758a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:58.030761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3df85b4e-9185-4749-bbf2-14f84fba758a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:58.033878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3df85b4e-9185-4749-bbf2-14f84fba758a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:58.036681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3df85b4e-9185-4749-bbf2-14f84fba758a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:58.037331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3df85b4e-9185-4749-bbf2-14f84fba758a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:58.059956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ddbb2304-42d4-4709-8eff-d7a9bf2b6342 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:58.072768 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ddbb2304-42d4-4709-8eff-d7a9bf2b6342 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1812 microversion: 2.1 time: 1.525940 Jul 20 04:24:58.083499 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1744/3417] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:56 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1812 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:58.847820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3df85b4e-9185-4749-bbf2-14f84fba758a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:58.863112 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3df85b4e-9185-4749-bbf2-14f84fba758a tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1315 microversion: 2.1 time: 0.865366 Jul 20 04:24:58.865755 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1674/3418] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:57 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1315 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:58.900328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b48340c-9a6d-4d2d-8ab3-9d4e944fde14 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:58.901094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5b48340c-9a6d-4d2d-8ab3-9d4e944fde14 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:58.915156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b48340c-9a6d-4d2d-8ab3-9d4e944fde14 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:58.917476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b48340c-9a6d-4d2d-8ab3-9d4e944fde14 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:58.918738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b48340c-9a6d-4d2d-8ab3-9d4e944fde14 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:58.919439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b48340c-9a6d-4d2d-8ab3-9d4e944fde14 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:59.092585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-12baf10a-3ba9-48a0-82a4-e1ecb706f963 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:59.093195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-12baf10a-3ba9-48a0-82a4-e1ecb706f963 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:59.108494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12baf10a-3ba9-48a0-82a4-e1ecb706f963 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:59.109413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12baf10a-3ba9-48a0-82a4-e1ecb706f963 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:59.113361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12baf10a-3ba9-48a0-82a4-e1ecb706f963 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:59.114362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12baf10a-3ba9-48a0-82a4-e1ecb706f963 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:59.228244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b48340c-9a6d-4d2d-8ab3-9d4e944fde14 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:59.257805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b48340c-9a6d-4d2d-8ab3-9d4e944fde14 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:59.259797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b48340c-9a6d-4d2d-8ab3-9d4e944fde14 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:59.261255 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5b48340c-9a6d-4d2d-8ab3-9d4e944fde14 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.366037 Jul 20 04:24:59.263012 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1745/3419] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:58 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:59.878876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-12baf10a-3ba9-48a0-82a4-e1ecb706f963 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:59.886454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ea3fbcbe-fb2c-4239-8149-63c326389f27 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:59.887443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ea3fbcbe-fb2c-4239-8149-63c326389f27 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:59.900075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea3fbcbe-fb2c-4239-8149-63c326389f27 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:59.901766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea3fbcbe-fb2c-4239-8149-63c326389f27 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:59.902557 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-12baf10a-3ba9-48a0-82a4-e1ecb706f963 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1655 microversion: 2.1 time: 0.814892 Jul 20 04:24:59.904239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea3fbcbe-fb2c-4239-8149-63c326389f27 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:59.905283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea3fbcbe-fb2c-4239-8149-63c326389f27 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:59.913621 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1675/3420] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:59 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1655 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:00.435347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ea3fbcbe-fb2c-4239-8149-63c326389f27 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:00.449740 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ea3fbcbe-fb2c-4239-8149-63c326389f27 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1315 microversion: 2.1 time: 0.566952 Jul 20 04:25:00.465690 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1746/3421] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:59 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:00.486846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-1a04bab8-3952-477b-a24a-34bd74c02f17 req-b3589914-d28c-4c2c-97b0-c0845f42cd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7547c2-1e5a-4c01-9dba-a4340f629ceb", "name": "network-vif-deleted", "tag": "34883a48-b463-4133-9579-48abc49b901a"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:00.533161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1a04bab8-3952-477b-a24a-34bd74c02f17 req-b3589914-d28c-4c2c-97b0-c0845f42cd35 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:00.534475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1a04bab8-3952-477b-a24a-34bd74c02f17 req-b3589914-d28c-4c2c-97b0-c0845f42cd35 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:00.555184 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-1a04bab8-3952-477b-a24a-34bd74c02f17 req-b3589914-d28c-4c2c-97b0-c0845f42cd35 service nova] Creating event network-vif-deleted:34883a48-b463-4133-9579-48abc49b901a for instance be7547c2-1e5a-4c01-9dba-a4340f629ceb on n-h1-764485-11 Jul 20 04:25:00.587634 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-1a04bab8-3952-477b-a24a-34bd74c02f17 req-b3589914-d28c-4c2c-97b0-c0845f42cd35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113540 Jul 20 04:25:00.602114 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1747/3422] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:00.633371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d633f9c9-89f8-4200-939e-7e6dc6d09603 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:00.634478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d633f9c9-89f8-4200-939e-7e6dc6d09603 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:00.659921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d633f9c9-89f8-4200-939e-7e6dc6d09603 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:00.661753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d633f9c9-89f8-4200-939e-7e6dc6d09603 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:00.668384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d633f9c9-89f8-4200-939e-7e6dc6d09603 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:00.669118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d633f9c9-89f8-4200-939e-7e6dc6d09603 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:00.694916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1319043121", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "19473404-2bf3-4006-87de-d5f0fcfe4040"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:00.814640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] validate_networks() for [('19473404-2bf3-4006-87de-d5f0fcfe4040', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:00.848956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d633f9c9-89f8-4200-939e-7e6dc6d09603 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:00.862883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d633f9c9-89f8-4200-939e-7e6dc6d09603 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:00.866018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d633f9c9-89f8-4200-939e-7e6dc6d09603 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:00.867266 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d633f9c9-89f8-4200-939e-7e6dc6d09603 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.261436 Jul 20 04:25:00.872195 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1748/3423] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:00 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:00.878859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-d7608dc5-5f42-4508-8292-edab5e859e16 req-49f90383-10a9-4d06-a0b5-e2ef631a68a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7547c2-1e5a-4c01-9dba-a4340f629ceb", "name": "network-vif-unplugged", "status": "completed", "tag": "1fdb3a12-1979-42c4-ad4d-c0ab385f139e"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:00.891429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d7608dc5-5f42-4508-8292-edab5e859e16 req-49f90383-10a9-4d06-a0b5-e2ef631a68a9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:00.891920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d7608dc5-5f42-4508-8292-edab5e859e16 req-49f90383-10a9-4d06-a0b5-e2ef631a68a9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:00.912391 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-d7608dc5-5f42-4508-8292-edab5e859e16 req-49f90383-10a9-4d06-a0b5-e2ef631a68a9 service nova] Creating event network-vif-unplugged:1fdb3a12-1979-42c4-ad4d-c0ab385f139e for instance be7547c2-1e5a-4c01-9dba-a4340f629ceb on n-h1-764485-11 Jul 20 04:25:00.924809 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-d7608dc5-5f42-4508-8292-edab5e859e16 req-49f90383-10a9-4d06-a0b5-e2ef631a68a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050999 Jul 20 04:25:00.931440 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1749/3424] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:00.993824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d893b8bc-64ee-4d91-9a39-818800bd3ff6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:00.996936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d893b8bc-64ee-4d91-9a39-818800bd3ff6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:01.007295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d893b8bc-64ee-4d91-9a39-818800bd3ff6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:01.016977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d893b8bc-64ee-4d91-9a39-818800bd3ff6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:01.017938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d893b8bc-64ee-4d91-9a39-818800bd3ff6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:01.018391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d893b8bc-64ee-4d91-9a39-818800bd3ff6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:01.560039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d893b8bc-64ee-4d91-9a39-818800bd3ff6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:01.576063 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d893b8bc-64ee-4d91-9a39-818800bd3ff6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 200 len: 1455 microversion: 2.1 time: 0.638277 Jul 20 04:25:01.577412 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1750/3425] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:00 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 1455 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:01.814228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ecf1f59e-7e87-4b2d-9a05-1c3717d3bf60 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9c631dc0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:01.815882 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:25:01.815882 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:25:01.817363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ecf1f59e-7e87-4b2d-9a05-1c3717d3bf60 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:01.818047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ecf1f59e-7e87-4b2d-9a05-1c3717d3bf60 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:01.837202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ecf1f59e-7e87-4b2d-9a05-1c3717d3bf60 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:01.837664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ecf1f59e-7e87-4b2d-9a05-1c3717d3bf60 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:01.850825 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-ecf1f59e-7e87-4b2d-9a05-1c3717d3bf60 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] HTTP exception thrown: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ecf1f59e-7e87-4b2d-9a05-1c3717d3bf60 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Request method failure captured: Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: request: PUT /compute/v2.1/os-services/37b33260-ef8c-44e4-be47-105edf7c7420 HTTP/1.1 Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 56 Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14OduOKi283ulzQQdNVEyPfCtz5gbg52WLU9_jy80XkTxL_wQ3X4GiMqNx2KzLvpvR7bphjn4Ldiyh71-yqFbJ2jKmkm-m2e7wAPbCHcrry-yuwx0W5IW37i6RaauV1LZSYpI5h145wUuKZwrg3v92XhPBLY_kYtaKEbkZ0GAoTO5VM Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5b50a0d007e249e085b657d1d9f73ecd Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1880365040 Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b50a0d007e249e085b657d1d9f73ecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b50a0d007e249e085b657d1d9f73ecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b50a0d007e249e085b657d1d9f73ecd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b50a0d007e249e085b657d1d9f73ecd"}]}] Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1880365040 Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5b50a0d007e249e085b657d1d9f73ecd Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1880365040 Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 34dd53b080da48d6b15a644cf0dbb735 Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: exception: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '37b33260-ef8c-44e4-be47-105edf7c7420', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:01.855547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:01.861633 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:01.864679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ecf1f59e-7e87-4b2d-9a05-1c3717d3bf60 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Returning 404 to user: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:01.865764 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ecf1f59e-7e87-4b2d-9a05-1c3717d3bf60 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/37b33260-ef8c-44e4-be47-105edf7c7420" status: 404 len: 110 microversion: 2.53 time: 0.286463 Jul 20 04:25:01.868869 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1751/3426] 10.222.0.20 () {62 vars in 1308 bytes} [Wed Jul 20 04:25:01 2022] PUT /compute/v2.1/os-services/37b33260-ef8c-44e4-be47-105edf7c7420 => generated 110 bytes in 290 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:25:01.875988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a53856f-b6a2-4d0a-a3fb-cb6e1dbd586e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:01.876848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7a53856f-b6a2-4d0a-a3fb-cb6e1dbd586e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:01.888477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a53856f-b6a2-4d0a-a3fb-cb6e1dbd586e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:01.889183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a53856f-b6a2-4d0a-a3fb-cb6e1dbd586e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:01.890168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a53856f-b6a2-4d0a-a3fb-cb6e1dbd586e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:01.891008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a53856f-b6a2-4d0a-a3fb-cb6e1dbd586e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.056430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:02.058790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:02.059702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:02.060498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:02.061027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:02.081469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.083333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.085870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.086592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.091661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7a53856f-b6a2-4d0a-a3fb-cb6e1dbd586e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:02.101259 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7a53856f-b6a2-4d0a-a3fb-cb6e1dbd586e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1315 microversion: 2.1 time: 0.231144 Jul 20 04:25:02.102394 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1752/3427] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:01 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:02.107646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-661f8281-c58f-4d5b-92d4-890677193821 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9df800d0>, body: {"status": "disabled"} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:02.109068 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:25:02.109068 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:25:02.111325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-661f8281-c58f-4d5b-92d4-890677193821 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.112611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-661f8281-c58f-4d5b-92d4-890677193821 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.118543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-661f8281-c58f-4d5b-92d4-890677193821 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.118701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Getting quotas for project 48603f6325d940eba6da4b98f8e39fdc. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:02.118994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-661f8281-c58f-4d5b-92d4-890677193821 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.123897 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-661f8281-c58f-4d5b-92d4-890677193821 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] HTTP exception thrown: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:02.124782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Getting quotas for user 10f231b264ad47d187ac666ec3611d05 and project 48603f6325d940eba6da4b98f8e39fdc. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-661f8281-c58f-4d5b-92d4-890677193821 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Request method failure captured: Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: request: PUT /compute/v2.1/os-services/37b33260-ef8c-44e4-be47-105edf7c7420 HTTP/1.1 Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 22 Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14OduOKi283ulzQQdNVEyPfCtz5gbg52WLU9_jy80XkTxL_wQ3X4GiMqNx2KzLvpvR7bphjn4Ldiyh71-yqFbJ2jKmkm-m2e7wAPbCHcrry-yuwx0W5IW37i6RaauV1LZSYpI5h145wUuKZwrg3v92XhPBLY_kYtaKEbkZ0GAoTO5VM Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5b50a0d007e249e085b657d1d9f73ecd Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1880365040 Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b50a0d007e249e085b657d1d9f73ecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b50a0d007e249e085b657d1d9f73ecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b50a0d007e249e085b657d1d9f73ecd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b50a0d007e249e085b657d1d9f73ecd"}]}] Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1880365040 Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5b50a0d007e249e085b657d1d9f73ecd Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1880365040 Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 34dd53b080da48d6b15a644cf0dbb735 Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: {"status": "disabled"} Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: exception: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '37b33260-ef8c-44e4-be47-105edf7c7420', 'body': {'status': 'disabled'}} Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:02.126364 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:02.130509 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.132836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-661f8281-c58f-4d5b-92d4-890677193821 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Returning 404 to user: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:02.133828 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-661f8281-c58f-4d5b-92d4-890677193821 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/37b33260-ef8c-44e4-be47-105edf7c7420" status: 404 len: 110 microversion: 2.53 time: 0.030200 Jul 20 04:25:02.134670 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1753/3428] 10.222.0.20 () {62 vars in 1308 bytes} [Wed Jul 20 04:25:02 2022] PUT /compute/v2.1/os-services/37b33260-ef8c-44e4-be47-105edf7c7420 => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:25:02.138216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:02.140053 n-d-764485-11 devstack@n-api.service[119807]: WARNING nova.utils [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1319043121 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-131904312 Jul 20 04:25:02.141968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:02.142953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-936dffb7-cc4f-42eb-a75a-3c59246434e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:02.144011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-936dffb7-cc4f-42eb-a75a-3c59246434e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:02.152629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-936dffb7-cc4f-42eb-a75a-3c59246434e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.153306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-936dffb7-cc4f-42eb-a75a-3c59246434e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.154250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-936dffb7-cc4f-42eb-a75a-3c59246434e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.154855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-936dffb7-cc4f-42eb-a75a-3c59246434e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.198680 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ac77c5fe-4e58-40b5-bbd5-95f385d83b2f tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.282502 Jul 20 04:25:02.199356 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1676/3429] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:25:02.210093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f08eea8f-81cd-457f-bab7-666f3f245a7c tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Action: 'update', calling method: .version_select at 0x7fbf9c3c9310>, body: {"status": "enabled"} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:02.211929 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:25:02.211929 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:25:02.213540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f08eea8f-81cd-457f-bab7-666f3f245a7c tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.214436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f08eea8f-81cd-457f-bab7-666f3f245a7c tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.228521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f08eea8f-81cd-457f-bab7-666f3f245a7c tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.229773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f08eea8f-81cd-457f-bab7-666f3f245a7c tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.238069 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f08eea8f-81cd-457f-bab7-666f3f245a7c tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] HTTP exception thrown: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f08eea8f-81cd-457f-bab7-666f3f245a7c tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Request method failure captured: Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: request: PUT /compute/v2.1/os-services/37b33260-ef8c-44e4-be47-105edf7c7420 HTTP/1.1 Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 21 Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14OduOKi283ulzQQdNVEyPfCtz5gbg52WLU9_jy80XkTxL_wQ3X4GiMqNx2KzLvpvR7bphjn4Ldiyh71-yqFbJ2jKmkm-m2e7wAPbCHcrry-yuwx0W5IW37i6RaauV1LZSYpI5h145wUuKZwrg3v92XhPBLY_kYtaKEbkZ0GAoTO5VM Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 5b50a0d007e249e085b657d1d9f73ecd Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1880365040 Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b50a0d007e249e085b657d1d9f73ecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b50a0d007e249e085b657d1d9f73ecd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b50a0d007e249e085b657d1d9f73ecd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b50a0d007e249e085b657d1d9f73ecd"}]}] Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1880365040 Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 5b50a0d007e249e085b657d1d9f73ecd Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1880365040 Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 34dd53b080da48d6b15a644cf0dbb735 Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: {"status": "enabled"} Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: exception: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '37b33260-ef8c-44e4-be47-105edf7c7420', 'body': {'status': 'enabled'}} Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:02.240316 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f08eea8f-81cd-457f-bab7-666f3f245a7c tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Returning 404 to user: Service 37b33260-ef8c-44e4-be47-105edf7c7420 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f08eea8f-81cd-457f-bab7-666f3f245a7c tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/37b33260-ef8c-44e4-be47-105edf7c7420" status: 404 len: 110 microversion: 2.53 time: 0.041208 Jul 20 04:25:02.244513 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1677/3430] 10.222.0.20 () {62 vars in 1308 bytes} [Wed Jul 20 04:25:02 2022] PUT /compute/v2.1/os-services/37b33260-ef8c-44e4-be47-105edf7c7420 => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:25:02.250865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e3fcd2aa-f28b-48b7-98de-93d03e27cdab tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:02.251545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e3fcd2aa-f28b-48b7-98de-93d03e27cdab tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:02.286036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-936dffb7-cc4f-42eb-a75a-3c59246434e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:02.300852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-936dffb7-cc4f-42eb-a75a-3c59246434e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:02.302710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-936dffb7-cc4f-42eb-a75a-3c59246434e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:02.304136 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-936dffb7-cc4f-42eb-a75a-3c59246434e0 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.168258 Jul 20 04:25:02.305106 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1754/3431] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:02 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:02.320189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3edd68b1-a0d9-46e4-aa18-f788429eccb9 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:02.321956 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:25:02.321956 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:25:02.323209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3edd68b1-a0d9-46e4-aa18-f788429eccb9 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.323716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3edd68b1-a0d9-46e4-aa18-f788429eccb9 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.324687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3edd68b1-a0d9-46e4-aa18-f788429eccb9 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.325133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3edd68b1-a0d9-46e4-aa18-f788429eccb9 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.331705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e3fcd2aa-f28b-48b7-98de-93d03e27cdab tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:02.343335 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e3fcd2aa-f28b-48b7-98de-93d03e27cdab tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1232 microversion: 2.1 time: 0.099707 Jul 20 04:25:02.348641 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1678/3432] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:02 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1232 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:02.356601 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3edd68b1-a0d9-46e4-aa18-f788429eccb9 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.049503 Jul 20 04:25:02.357222 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1755/3433] 10.222.0.20 () {60 vars in 1177 bytes} [Wed Jul 20 04:25:02 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:02.368347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9a620ce6-d152-4891-b057-fa610e2f9dfc tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:02.370198 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:25:02.370198 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:25:02.371469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a620ce6-d152-4891-b057-fa610e2f9dfc tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.372144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a620ce6-d152-4891-b057-fa610e2f9dfc tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.373116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a620ce6-d152-4891-b057-fa610e2f9dfc tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.373548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a620ce6-d152-4891-b057-fa610e2f9dfc tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.401129 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9a620ce6-d152-4891-b057-fa610e2f9dfc tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.036864 Jul 20 04:25:02.408548 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1679/3434] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Jul 20 04:25:02 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:02.414450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-29157d4a-ad51-46ac-ba9a-6a3b1b37083f tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:02.415654 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:25:02.415654 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:25:02.416849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29157d4a-ad51-46ac-ba9a-6a3b1b37083f tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.417427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29157d4a-ad51-46ac-ba9a-6a3b1b37083f tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.418731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29157d4a-ad51-46ac-ba9a-6a3b1b37083f tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.419174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29157d4a-ad51-46ac-ba9a-6a3b1b37083f tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.445600 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-29157d4a-ad51-46ac-ba9a-6a3b1b37083f tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.035358 Jul 20 04:25:02.446225 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1756/3435] 10.222.0.20 () {60 vars in 1177 bytes} [Wed Jul 20 04:25:02 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:25:02.457378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d5960de5-1b24-4af1-a405-fbafe5644ed5 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:02.458950 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:25:02.458950 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:25:02.460917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5960de5-1b24-4af1-a405-fbafe5644ed5 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.461498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5960de5-1b24-4af1-a405-fbafe5644ed5 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.462319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5960de5-1b24-4af1-a405-fbafe5644ed5 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.463066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5960de5-1b24-4af1-a405-fbafe5644ed5 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.492716 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d5960de5-1b24-4af1-a405-fbafe5644ed5 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-764485-11&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.039543 Jul 20 04:25:02.493531 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1680/3436] 10.222.0.20 () {60 vars in 1236 bytes} [Wed Jul 20 04:25:02 2022] GET /compute/v2.1/os-services?host=n-d-764485-11&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:02.505371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-36d136be-5b81-49a7-beb2-e0ed2ab5a00b tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:02.506710 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:25:02.506710 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:25:02.507910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36d136be-5b81-49a7-beb2-e0ed2ab5a00b tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.508611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36d136be-5b81-49a7-beb2-e0ed2ab5a00b tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.510039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36d136be-5b81-49a7-beb2-e0ed2ab5a00b tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.510726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36d136be-5b81-49a7-beb2-e0ed2ab5a00b tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.540072 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-36d136be-5b81-49a7-beb2-e0ed2ab5a00b tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.038609 Jul 20 04:25:02.540908 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1757/3437] 10.222.0.20 () {60 vars in 1177 bytes} [Wed Jul 20 04:25:02 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:02.551938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8e675ec7-5bda-4651-ba71-2d5270dbafd7 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:02.553453 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:25:02.553453 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:25:02.554907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e675ec7-5bda-4651-ba71-2d5270dbafd7 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.555546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e675ec7-5bda-4651-ba71-2d5270dbafd7 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.556513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e675ec7-5bda-4651-ba71-2d5270dbafd7 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.557138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e675ec7-5bda-4651-ba71-2d5270dbafd7 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.584463 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8e675ec7-5bda-4651-ba71-2d5270dbafd7 tempest-ServicesAdminNegativeV253TestJSON-1880365040 tempest-ServicesAdminNegativeV253TestJSON-1880365040-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.036255 Jul 20 04:25:02.591755 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1681/3438] 10.222.0.20 () {60 vars in 1238 bytes} [Wed Jul 20 04:25:02 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:02.596915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bfee8c43-8b5d-46ab-9d5c-e8f95e549151 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:02.597513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bfee8c43-8b5d-46ab-9d5c-e8f95e549151 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:02.619755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfee8c43-8b5d-46ab-9d5c-e8f95e549151 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.620251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfee8c43-8b5d-46ab-9d5c-e8f95e549151 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.621067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfee8c43-8b5d-46ab-9d5c-e8f95e549151 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.621517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfee8c43-8b5d-46ab-9d5c-e8f95e549151 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.645158 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-bfee8c43-8b5d-46ab-9d5c-e8f95e549151 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] HTTP exception thrown: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bfee8c43-8b5d-46ab-9d5c-e8f95e549151 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Request method failure captured: Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb HTTP/1.1 Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14NUoWIHizY5l1dlw8h-7icLXaQC4Ffi9ZBpxz9u2NUv4Fn8ggyFaUykZ47ZsX-fkkbBPGjLJfLy2_zRF2sIe9uTzTZR_1oQqJ5xEFcTXQm4EBJ7g_Gr6ZLuHRyvu-pG76JgDSRHG0pkR2x-F0DmqYVNIXpKjKwsdpBaJGC313LEEHE Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 8d31e7a862bb417db2ddaf24d4c0f99b Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8d31e7a862bb417db2ddaf24d4c0f99b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8d31e7a862bb417db2ddaf24d4c0f99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8d31e7a862bb417db2ddaf24d4c0f99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8d31e7a862bb417db2ddaf24d4c0f99b"}]}] Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 8d31e7a862bb417db2ddaf24d4c0f99b Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestMultiNic-1045453900-project Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c3fccf60e600450c8d10e10e3311fbae Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestMultiNic-1045453900-project Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'be7547c2-1e5a-4c01-9dba-a4340f629ceb'} Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:02.646933 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.652094 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.652094 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:02.652094 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:02.652094 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:02.652094 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:02.652094 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:02.652094 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.657105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bfee8c43-8b5d-46ab-9d5c-e8f95e549151 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Returning 404 to user: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:02.658443 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bfee8c43-8b5d-46ab-9d5c-e8f95e549151 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 404 len: 111 microversion: 2.1 time: 0.066465 Jul 20 04:25:02.663276 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1758/3439] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:02 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:02.757527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-aa587041-c331-42d8-a19a-a93bf0e892dd req-d3998c26-8988-4a90-96aa-766b6980daa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7547c2-1e5a-4c01-9dba-a4340f629ceb", "name": "network-vif-deleted", "tag": "1fdb3a12-1979-42c4-ad4d-c0ab385f139e"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:02.776836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-aa587041-c331-42d8-a19a-a93bf0e892dd req-d3998c26-8988-4a90-96aa-766b6980daa4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:02.777351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-aa587041-c331-42d8-a19a-a93bf0e892dd req-d3998c26-8988-4a90-96aa-766b6980daa4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:02.801754 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-aa587041-c331-42d8-a19a-a93bf0e892dd req-d3998c26-8988-4a90-96aa-766b6980daa4 service nova] Creating event network-vif-deleted:1fdb3a12-1979-42c4-ad4d-c0ab385f139e for instance be7547c2-1e5a-4c01-9dba-a4340f629ceb on n-h1-764485-11 Jul 20 04:25:02.808546 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-aa587041-c331-42d8-a19a-a93bf0e892dd req-d3998c26-8988-4a90-96aa-766b6980daa4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055804 Jul 20 04:25:02.813494 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1759/3440] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:25:02.838727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6743f7c4-92c8-48d1-87a6-cd5159411cf8 tempest-ServicesAdminNegativeV253TestJSON-1292205202 tempest-ServicesAdminNegativeV253TestJSON-1292205202-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:02.840293 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:25:02.840293 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:25:02.841713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6743f7c4-92c8-48d1-87a6-cd5159411cf8 tempest-ServicesAdminNegativeV253TestJSON-1292205202 tempest-ServicesAdminNegativeV253TestJSON-1292205202-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '5315ce92e55e47e68ae1f3e280c9bd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b262965baf412999a65b0e2b516d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6743f7c4-92c8-48d1-87a6-cd5159411cf8 tempest-ServicesAdminNegativeV253TestJSON-1292205202 tempest-ServicesAdminNegativeV253TestJSON-1292205202-project] Request method failure captured: Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Oc_56ZzEf4Rgu8SNI_2K74XroTyDwX70X0cv5gPAxI54oRg4CejbuRdgwbhKhuFL6j2Hw53DrtYF9qEUo3RGjcGH7vqBoYs4BKe8FtbeKup5EciUAwWhuWJDfOxLzfqxVwRbgotd8gaJjkZ9SGcPskOVy5plsSwh6qojNhqPFpnY0 Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: f2b262965baf412999a65b0e2b516d84 Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1292205202 Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2b262965baf412999a65b0e2b516d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2b262965baf412999a65b0e2b516d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2b262965baf412999a65b0e2b516d84", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2b262965baf412999a65b0e2b516d84"}]}] Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1292205202 Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: f2b262965baf412999a65b0e2b516d84 Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1292205202 Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1292205202-project Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 5315ce92e55e47e68ae1f3e280c9bd68 Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1292205202-project Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: action_args: {} Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:25:02.843990 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.848594 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:02.848594 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.848594 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:02.848594 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:02.848594 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:02.848594 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:25:02.848594 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:25:02.848594 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:25:02.848594 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:02.850933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6743f7c4-92c8-48d1-87a6-cd5159411cf8 tempest-ServicesAdminNegativeV253TestJSON-1292205202 tempest-ServicesAdminNegativeV253TestJSON-1292205202-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:02.852099 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6743f7c4-92c8-48d1-87a6-cd5159411cf8 tempest-ServicesAdminNegativeV253TestJSON-1292205202 tempest-ServicesAdminNegativeV253TestJSON-1292205202-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.257256 Jul 20 04:25:02.853248 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1682/3441] 10.222.0.20 () {60 vars in 1177 bytes} [Wed Jul 20 04:25:02 2022] GET /compute/v2.1/os-services => generated 112 bytes in 261 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:25:03.007152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-541314ee-6c46-4acd-b236-afbe97b0f6c2 req-a684cac3-ae44-4fb6-ab05-c28bf8236736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0", "name": "network-vif-plugged", "status": "completed", "tag": "2d38dd21-312c-408b-8cd1-ec9098143685"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:03.027988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-541314ee-6c46-4acd-b236-afbe97b0f6c2 req-a684cac3-ae44-4fb6-ab05-c28bf8236736 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.028743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-541314ee-6c46-4acd-b236-afbe97b0f6c2 req-a684cac3-ae44-4fb6-ab05-c28bf8236736 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:03.048533 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-541314ee-6c46-4acd-b236-afbe97b0f6c2 req-a684cac3-ae44-4fb6-ab05-c28bf8236736 service nova] Creating event network-vif-plugged:2d38dd21-312c-408b-8cd1-ec9098143685 for instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 on n-h2-764485-11 Jul 20 04:25:03.076609 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-541314ee-6c46-4acd-b236-afbe97b0f6c2 req-a684cac3-ae44-4fb6-ab05-c28bf8236736 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078448 Jul 20 04:25:03.090202 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1760/3442] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:03.121857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2727cf0-7c7b-40d4-8c79-4e499786d69e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:03.123085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a2727cf0-7c7b-40d4-8c79-4e499786d69e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:03.143026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2727cf0-7c7b-40d4-8c79-4e499786d69e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.148046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2727cf0-7c7b-40d4-8c79-4e499786d69e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:03.149183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2727cf0-7c7b-40d4-8c79-4e499786d69e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.149650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2727cf0-7c7b-40d4-8c79-4e499786d69e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:03.160962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:03.324109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0d52c867-0797-4370-850a-d11b73c1c877 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:03.324830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0d52c867-0797-4370-850a-d11b73c1c877 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:03.340516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d52c867-0797-4370-850a-d11b73c1c877 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.340975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d52c867-0797-4370-850a-d11b73c1c877 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:03.341776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d52c867-0797-4370-850a-d11b73c1c877 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.342222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d52c867-0797-4370-850a-d11b73c1c877 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:03.601610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d52c867-0797-4370-850a-d11b73c1c877 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:03.617703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d52c867-0797-4370-850a-d11b73c1c877 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:03.621131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d52c867-0797-4370-850a-d11b73c1c877 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:03.626462 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0d52c867-0797-4370-850a-d11b73c1c877 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.305566 Jul 20 04:25:03.641423 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1761/3443] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:03 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:03.656929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6661d31f-cfac-41ee-852a-565e523be4e0 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:03.657576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6661d31f-cfac-41ee-852a-565e523be4e0 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:03.688921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6661d31f-cfac-41ee-852a-565e523be4e0 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.689503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6661d31f-cfac-41ee-852a-565e523be4e0 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:03.694101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6661d31f-cfac-41ee-852a-565e523be4e0 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.694585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6661d31f-cfac-41ee-852a-565e523be4e0 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:03.777454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a2727cf0-7c7b-40d4-8c79-4e499786d69e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:03.790351 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2727cf0-7c7b-40d4-8c79-4e499786d69e tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1315 microversion: 2.1 time: 0.670357 Jul 20 04:25:03.791236 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1683/3444] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:03 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:03.876885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6661d31f-cfac-41ee-852a-565e523be4e0 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:03.890088 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6661d31f-cfac-41ee-852a-565e523be4e0 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1302 microversion: 2.1 time: 0.246272 Jul 20 04:25:03.890751 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1762/3445] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:03 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1302 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:04.645973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4e2cf83e-98eb-4b5c-b412-25f42848cf73 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:04.647189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4e2cf83e-98eb-4b5c-b412-25f42848cf73 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:04.654519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e2cf83e-98eb-4b5c-b412-25f42848cf73 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:04.655180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e2cf83e-98eb-4b5c-b412-25f42848cf73 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:04.657012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e2cf83e-98eb-4b5c-b412-25f42848cf73 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:04.657643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e2cf83e-98eb-4b5c-b412-25f42848cf73 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:04.808793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c0f1375b-2b40-4f6e-9f46-5411974de047 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:04.809410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c0f1375b-2b40-4f6e-9f46-5411974de047 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:04.822137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0f1375b-2b40-4f6e-9f46-5411974de047 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:04.827433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0f1375b-2b40-4f6e-9f46-5411974de047 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:04.829347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0f1375b-2b40-4f6e-9f46-5411974de047 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:04.829964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0f1375b-2b40-4f6e-9f46-5411974de047 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:04.894675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4e2cf83e-98eb-4b5c-b412-25f42848cf73 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:04.909604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4e2cf83e-98eb-4b5c-b412-25f42848cf73 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:04.912004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4e2cf83e-98eb-4b5c-b412-25f42848cf73 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:04.915749 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4e2cf83e-98eb-4b5c-b412-25f42848cf73 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.273954 Jul 20 04:25:04.918772 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1684/3446] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:04 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:04.932386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac24ddb0-37cf-4761-a47e-ef81340ed2c8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:04.933006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac24ddb0-37cf-4761-a47e-ef81340ed2c8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:04.952860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac24ddb0-37cf-4761-a47e-ef81340ed2c8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:04.959035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac24ddb0-37cf-4761-a47e-ef81340ed2c8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:04.961253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac24ddb0-37cf-4761-a47e-ef81340ed2c8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:04.967723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac24ddb0-37cf-4761-a47e-ef81340ed2c8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:05.362943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c0f1375b-2b40-4f6e-9f46-5411974de047 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:05.380923 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c0f1375b-2b40-4f6e-9f46-5411974de047 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1315 microversion: 2.1 time: 0.576015 Jul 20 04:25:05.384363 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1763/3447] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:04 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:05.483181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ac24ddb0-37cf-4761-a47e-ef81340ed2c8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:05.496871 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ac24ddb0-37cf-4761-a47e-ef81340ed2c8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1332 microversion: 2.1 time: 0.568154 Jul 20 04:25:05.498221 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1685/3448] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:04 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1332 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:05.938502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df2f44e0-3d11-4d69-bfc8-cdd7a30395a7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:05.939130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df2f44e0-3d11-4d69-bfc8-cdd7a30395a7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:05.957110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df2f44e0-3d11-4d69-bfc8-cdd7a30395a7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:05.958293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df2f44e0-3d11-4d69-bfc8-cdd7a30395a7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:05.959753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df2f44e0-3d11-4d69-bfc8-cdd7a30395a7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:05.962518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df2f44e0-3d11-4d69-bfc8-cdd7a30395a7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:06.244412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df2f44e0-3d11-4d69-bfc8-cdd7a30395a7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:06.276819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df2f44e0-3d11-4d69-bfc8-cdd7a30395a7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:06.282542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df2f44e0-3d11-4d69-bfc8-cdd7a30395a7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:06.292360 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df2f44e0-3d11-4d69-bfc8-cdd7a30395a7 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.357943 Jul 20 04:25:06.296535 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1764/3449] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:05 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:06.402724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9b26105-fffc-4a9b-b0f5-25c02d104e55 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:06.403354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a9b26105-fffc-4a9b-b0f5-25c02d104e55 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:06.413557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9b26105-fffc-4a9b-b0f5-25c02d104e55 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:06.420733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9b26105-fffc-4a9b-b0f5-25c02d104e55 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:06.423904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9b26105-fffc-4a9b-b0f5-25c02d104e55 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:06.425113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9b26105-fffc-4a9b-b0f5-25c02d104e55 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:06.514437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a2434158-e955-46da-97e2-478b42500a39 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:06.516045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a2434158-e955-46da-97e2-478b42500a39 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:06.519072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:06.530235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2434158-e955-46da-97e2-478b42500a39 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:06.534962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2434158-e955-46da-97e2-478b42500a39 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:06.536254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2434158-e955-46da-97e2-478b42500a39 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:06.536954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2434158-e955-46da-97e2-478b42500a39 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:06.915019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a2434158-e955-46da-97e2-478b42500a39 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:06.940936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a9b26105-fffc-4a9b-b0f5-25c02d104e55 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:06.951389 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a2434158-e955-46da-97e2-478b42500a39 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1332 microversion: 2.1 time: 0.441010 Jul 20 04:25:06.958364 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1765/3450] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:06 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1332 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:06.965927 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a9b26105-fffc-4a9b-b0f5-25c02d104e55 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1504 microversion: 2.1 time: 0.565232 Jul 20 04:25:06.969952 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1686/3451] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:06 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1504 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:06.980586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-3633fca7-4586-4ca9-9b25-1584a1bd073b req-58f575dd-4958-4953-8a79-db866b9ef1ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600c8c47-0770-4158-ae45-3a47fea37227", "tag": "a8d254af-8af1-4396-a59c-948fbabfad2f"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:06.993777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f3b06b4f-7b4d-4868-8fdb-800380c64ddf tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:06.995583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f3b06b4f-7b4d-4868-8fdb-800380c64ddf tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:07.014801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3633fca7-4586-4ca9-9b25-1584a1bd073b req-58f575dd-4958-4953-8a79-db866b9ef1ba service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.017893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3b06b4f-7b4d-4868-8fdb-800380c64ddf tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.018649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3b06b4f-7b4d-4868-8fdb-800380c64ddf tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.019782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3633fca7-4586-4ca9-9b25-1584a1bd073b req-58f575dd-4958-4953-8a79-db866b9ef1ba service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.024927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3b06b4f-7b4d-4868-8fdb-800380c64ddf tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.026808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3b06b4f-7b4d-4868-8fdb-800380c64ddf tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.056916 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-3633fca7-4586-4ca9-9b25-1584a1bd073b req-58f575dd-4958-4953-8a79-db866b9ef1ba service nova] Creating event network-changed:a8d254af-8af1-4396-a59c-948fbabfad2f for instance 600c8c47-0770-4158-ae45-3a47fea37227 on n-h1-764485-11 Jul 20 04:25:07.068514 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-3633fca7-4586-4ca9-9b25-1584a1bd073b req-58f575dd-4958-4953-8a79-db866b9ef1ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107621 Jul 20 04:25:07.073508 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1766/3452] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:07.087002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f3b06b4f-7b4d-4868-8fdb-800380c64ddf tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:25:07.264685 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f3b06b4f-7b4d-4868-8fdb-800380c64ddf tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 204 len: 0 microversion: 2.1 time: 0.281822 Jul 20 04:25:07.266154 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1687/3453] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:06 2022] DELETE /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:25:07.275367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e417d6fa-1b47-4d38-8ec7-c7422bf8f12f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:07.276187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e417d6fa-1b47-4d38-8ec7-c7422bf8f12f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:07.291132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e417d6fa-1b47-4d38-8ec7-c7422bf8f12f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.294554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e417d6fa-1b47-4d38-8ec7-c7422bf8f12f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.295433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e417d6fa-1b47-4d38-8ec7-c7422bf8f12f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.295915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e417d6fa-1b47-4d38-8ec7-c7422bf8f12f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.314605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7de91a85-2d73-4a16-8662-639912142eeb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:07.315716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7de91a85-2d73-4a16-8662-639912142eeb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:07.329244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7de91a85-2d73-4a16-8662-639912142eeb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.330744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7de91a85-2d73-4a16-8662-639912142eeb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.336836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7de91a85-2d73-4a16-8662-639912142eeb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.337602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7de91a85-2d73-4a16-8662-639912142eeb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.591494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7de91a85-2d73-4a16-8662-639912142eeb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:07.611316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7de91a85-2d73-4a16-8662-639912142eeb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:07.617482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7de91a85-2d73-4a16-8662-639912142eeb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:07.618759 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7de91a85-2d73-4a16-8662-639912142eeb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.309465 Jul 20 04:25:07.621542 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1688/3454] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:07 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:07.978606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-53667589-011c-41b0-b771-fca4a9560e8a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:07.993315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-53667589-011c-41b0-b771-fca4a9560e8a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:08.012333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53667589-011c-41b0-b771-fca4a9560e8a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:08.015447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53667589-011c-41b0-b771-fca4a9560e8a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:08.018253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53667589-011c-41b0-b771-fca4a9560e8a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:08.019338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53667589-011c-41b0-b771-fca4a9560e8a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:08.195912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e417d6fa-1b47-4d38-8ec7-c7422bf8f12f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:08.199618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:08.208395 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e417d6fa-1b47-4d38-8ec7-c7422bf8f12f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1510 microversion: 2.1 time: 0.937530 Jul 20 04:25:08.211830 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1767/3455] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:07 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1510 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:08.448314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-53667589-011c-41b0-b771-fca4a9560e8a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:08.458059 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-53667589-011c-41b0-b771-fca4a9560e8a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1332 microversion: 2.1 time: 0.486953 Jul 20 04:25:08.460450 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1689/3456] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:07 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1332 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:08.643525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f88dda6e-4334-4cd2-bf72-51a4433da053 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:08.644237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f88dda6e-4334-4cd2-bf72-51a4433da053 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:08.656580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f88dda6e-4334-4cd2-bf72-51a4433da053 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:08.657405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f88dda6e-4334-4cd2-bf72-51a4433da053 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:08.658403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f88dda6e-4334-4cd2-bf72-51a4433da053 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:08.663034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f88dda6e-4334-4cd2-bf72-51a4433da053 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:08.881608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f88dda6e-4334-4cd2-bf72-51a4433da053 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:08.901214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f88dda6e-4334-4cd2-bf72-51a4433da053 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:08.902724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f88dda6e-4334-4cd2-bf72-51a4433da053 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:08.903969 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f88dda6e-4334-4cd2-bf72-51a4433da053 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.266270 Jul 20 04:25:08.904844 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1768/3457] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:08 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:09.231428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd7dec5f-ec0f-4a33-9d5c-ca36789e96af tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:09.232049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cd7dec5f-ec0f-4a33-9d5c-ca36789e96af tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:09.246051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd7dec5f-ec0f-4a33-9d5c-ca36789e96af tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.246716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd7dec5f-ec0f-4a33-9d5c-ca36789e96af tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.248424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd7dec5f-ec0f-4a33-9d5c-ca36789e96af tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.251935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd7dec5f-ec0f-4a33-9d5c-ca36789e96af tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.477341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-718079e3-795b-41c8-8478-3b3bb87c11d6 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:09.477958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-718079e3-795b-41c8-8478-3b3bb87c11d6 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:09.492783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-718079e3-795b-41c8-8478-3b3bb87c11d6 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.493503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-718079e3-795b-41c8-8478-3b3bb87c11d6 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.494447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-718079e3-795b-41c8-8478-3b3bb87c11d6 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.495046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-718079e3-795b-41c8-8478-3b3bb87c11d6 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.824146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cd7dec5f-ec0f-4a33-9d5c-ca36789e96af tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:09.837395 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd7dec5f-ec0f-4a33-9d5c-ca36789e96af tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1510 microversion: 2.1 time: 0.610805 Jul 20 04:25:09.838094 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1690/3458] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:09 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1510 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:09.926062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-247542d4-81ef-42b1-8919-d1b763e8191b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:09.926403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-247542d4-81ef-42b1-8919-d1b763e8191b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:09.937900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-247542d4-81ef-42b1-8919-d1b763e8191b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.939677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-247542d4-81ef-42b1-8919-d1b763e8191b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.940563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-247542d4-81ef-42b1-8919-d1b763e8191b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.942273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-247542d4-81ef-42b1-8919-d1b763e8191b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.004963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-718079e3-795b-41c8-8478-3b3bb87c11d6 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:10.027958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-718079e3-795b-41c8-8478-3b3bb87c11d6 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1332 microversion: 2.1 time: 0.551004 Jul 20 04:25:10.043880 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1769/3459] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:09 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1332 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:10.157574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1540058647", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "588293c2-195d-48d2-9224-60d613de164e"}, {"uuid": "f54a9100-da7d-4307-b44b-b108db098e11"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:10.241546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-247542d4-81ef-42b1-8919-d1b763e8191b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:10.252289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] validate_networks() for [('588293c2-195d-48d2-9224-60d613de164e', None, None, None, None, None), ('f54a9100-da7d-4307-b44b-b108db098e11', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:10.255837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-247542d4-81ef-42b1-8919-d1b763e8191b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:10.257562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-247542d4-81ef-42b1-8919-d1b763e8191b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:10.258848 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-247542d4-81ef-42b1-8919-d1b763e8191b tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.337736 Jul 20 04:25:10.271474 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1691/3460] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:09 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:25:10.535058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-fa5a5d35-af05-4ed1-9dd2-48d25be0bf56 req-0b302cad-fde5-4c6e-8e57-431291403939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0", "name": "network-vif-deleted", "tag": "2d38dd21-312c-408b-8cd1-ec9098143685"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:10.540000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:10.556065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fa5a5d35-af05-4ed1-9dd2-48d25be0bf56 req-0b302cad-fde5-4c6e-8e57-431291403939 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.556734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fa5a5d35-af05-4ed1-9dd2-48d25be0bf56 req-0b302cad-fde5-4c6e-8e57-431291403939 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.626326 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-fa5a5d35-af05-4ed1-9dd2-48d25be0bf56 req-0b302cad-fde5-4c6e-8e57-431291403939 service nova] Creating event network-vif-deleted:2d38dd21-312c-408b-8cd1-ec9098143685 for instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 on n-h2-764485-11 Jul 20 04:25:10.633460 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-fa5a5d35-af05-4ed1-9dd2-48d25be0bf56 req-0b302cad-fde5-4c6e-8e57-431291403939 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103059 Jul 20 04:25:10.634504 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1692/3461] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:10.857091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2e93b950-64bd-46cc-bad0-7663b19cebe7 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:10.857926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2e93b950-64bd-46cc-bad0-7663b19cebe7 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:10.868554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e93b950-64bd-46cc-bad0-7663b19cebe7 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.871356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e93b950-64bd-46cc-bad0-7663b19cebe7 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.872334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e93b950-64bd-46cc-bad0-7663b19cebe7 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.872942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e93b950-64bd-46cc-bad0-7663b19cebe7 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.946860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e93b950-64bd-46cc-bad0-7663b19cebe7 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.947404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e93b950-64bd-46cc-bad0-7663b19cebe7 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.948086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-2e93b950-64bd-46cc-bad0-7663b19cebe7 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lazy-loading 'fault' on Instance uuid 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:25:11.194295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2e93b950-64bd-46cc-bad0-7663b19cebe7 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3f567f63548ffb95a5d6d24dca135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54f1cbd9d674e7c899d15803e7186b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:11.207806 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2e93b950-64bd-46cc-bad0-7663b19cebe7 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 200 len: 1305 microversion: 2.1 time: 0.355357 Jul 20 04:25:11.212133 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1693/3462] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:10 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 1305 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:11.220784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a331fbf9-0f89-4161-8ae9-a0fabd0547e8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:11.225690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a331fbf9-0f89-4161-8ae9-a0fabd0547e8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:11.244236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a331fbf9-0f89-4161-8ae9-a0fabd0547e8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:11.245825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a331fbf9-0f89-4161-8ae9-a0fabd0547e8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:11.251109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a331fbf9-0f89-4161-8ae9-a0fabd0547e8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:11.256163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a331fbf9-0f89-4161-8ae9-a0fabd0547e8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.306747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a331fbf9-0f89-4161-8ae9-a0fabd0547e8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:12.320666 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a331fbf9-0f89-4161-8ae9-a0fabd0547e8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1332 microversion: 2.1 time: 1.106647 Jul 20 04:25:12.322171 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1694/3463] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:11 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1332 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:12.340188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b5968e0d-3c2e-4b71-b2ef-446199906cd6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:12.341165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b5968e0d-3c2e-4b71-b2ef-446199906cd6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:12.343582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:12.350579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5968e0d-3c2e-4b71-b2ef-446199906cd6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.351260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5968e0d-3c2e-4b71-b2ef-446199906cd6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.352248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5968e0d-3c2e-4b71-b2ef-446199906cd6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.353023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5968e0d-3c2e-4b71-b2ef-446199906cd6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.518729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b5968e0d-3c2e-4b71-b2ef-446199906cd6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:12.522300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=16 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:12.536398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b5968e0d-3c2e-4b71-b2ef-446199906cd6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:12.538001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b5968e0d-3c2e-4b71-b2ef-446199906cd6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:12.539496 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b5968e0d-3c2e-4b71-b2ef-446199906cd6 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.215709 Jul 20 04:25:12.540100 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1695/3464] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:12 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:12.544737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc0a5de4-8367-4726-b96c-46a8dcb902bc tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:12.545668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc0a5de4-8367-4726-b96c-46a8dcb902bc tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:12.553844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc0a5de4-8367-4726-b96c-46a8dcb902bc tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.554568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc0a5de4-8367-4726-b96c-46a8dcb902bc tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.555670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc0a5de4-8367-4726-b96c-46a8dcb902bc tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.556271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc0a5de4-8367-4726-b96c-46a8dcb902bc tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.571646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=14 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:12.573503 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-fc0a5de4-8367-4726-b96c-46a8dcb902bc tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] HTTP exception thrown: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc0a5de4-8367-4726-b96c-46a8dcb902bc tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Request method failure captured: Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 HTTP/1.1 Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14OKJMVahlV3NvvKk6SHgw2b8zEhDoMVVx33wX0Pev4in53taZjZCsnE5sVOaeFS0jZqNf_bX_rkESE4uj_i1DMYWBJJCaH5dmP1Zw-PJkgxvo7E-kK8VXSe0beMYgomW6U2CB9qsbHHkd4xs-i08KFy_PNuVBzgX-h6CX2DZ26clt0 Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d54f1cbd9d674e7c899d15803e7186b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}] Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1eb3f567f63548ffb95a5d6d24dca135 Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0'} Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.575375 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.580341 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.580341 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.580341 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.580341 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:12.580341 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:12.580341 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.580341 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.581958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc0a5de4-8367-4726-b96c-46a8dcb902bc tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Returning 404 to user: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:12.582998 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc0a5de4-8367-4726-b96c-46a8dcb902bc tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 404 len: 111 microversion: 2.1 time: 0.041736 Jul 20 04:25:12.584112 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1696/3465] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:12 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:12.594341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9e2fe08a-2c3e-4089-8130-3a0e0d479a1c tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1606301134", "metadata": {"image_type": "test"}}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:12.596249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9e2fe08a-2c3e-4089-8130-3a0e0d479a1c tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:12.604042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e2fe08a-2c3e-4089-8130-3a0e0d479a1c tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.604767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e2fe08a-2c3e-4089-8130-3a0e0d479a1c tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.605881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e2fe08a-2c3e-4089-8130-3a0e0d479a1c tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.607080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e2fe08a-2c3e-4089-8130-3a0e0d479a1c tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.624079 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-9e2fe08a-2c3e-4089-8130-3a0e0d479a1c tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] HTTP exception thrown: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9e2fe08a-2c3e-4089-8130-3a0e0d479a1c tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Request method failure captured: Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0/action HTTP/1.1 Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 112 Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14OKJMVahlV3NvvKk6SHgw2b8zEhDoMVVx33wX0Pev4in53taZjZCsnE5sVOaeFS0jZqNf_bX_rkESE4uj_i1DMYWBJJCaH5dmP1Zw-PJkgxvo7E-kK8VXSe0beMYgomW6U2CB9qsbHHkd4xs-i08KFy_PNuVBzgX-h6CX2DZ26clt0 Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d54f1cbd9d674e7c899d15803e7186b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}] Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1eb3f567f63548ffb95a5d6d24dca135 Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1606301134", "metadata": {"image_type": "test"}}} Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1606301134', 'metadata': {'image_type': 'test'}}}} Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:25:12.627388 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.632125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.634436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9e2fe08a-2c3e-4089-8130-3a0e0d479a1c tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Returning 404 to user: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:12.635459 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9e2fe08a-2c3e-4089-8130-3a0e0d479a1c tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "POST /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0/action" status: 404 len: 111 microversion: 2.1 time: 0.046531 Jul 20 04:25:12.636687 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1697/3466] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Jul 20 04:25:12 2022] POST /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:25:12.646748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4354d53e-7a1e-437a-9836-8918ec218216 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1730837201", "metadata": {"image_type": "test"}}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:12.648239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4354d53e-7a1e-437a-9836-8918ec218216 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Failed to fetch instance by id tempest-invalid-251419544 {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:25:12.649032 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-4354d53e-7a1e-437a-9836-8918ec218216 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] HTTP exception thrown: Instance tempest-invalid-251419544 could not be found. Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4354d53e-7a1e-437a-9836-8918ec218216 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Request method failure captured: Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/tempest-invalid-251419544/action HTTP/1.1 Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 112 Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14OKJMVahlV3NvvKk6SHgw2b8zEhDoMVVx33wX0Pev4in53taZjZCsnE5sVOaeFS0jZqNf_bX_rkESE4uj_i1DMYWBJJCaH5dmP1Zw-PJkgxvo7E-kK8VXSe0beMYgomW6U2CB9qsbHHkd4xs-i08KFy_PNuVBzgX-h6CX2DZ26clt0 Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d54f1cbd9d674e7c899d15803e7186b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}] Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1eb3f567f63548ffb95a5d6d24dca135 Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1730837201", "metadata": {"image_type": "test"}}} Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance tempest-invalid-251419544 could not be found. Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'tempest-invalid-251419544', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1730837201', 'metadata': {'image_type': 'test'}}}} Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-251419544 could not be found. Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:12.650793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-251419544 could not be found. Jul 20 04:25:12.655544 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.655544 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.655544 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.655544 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.655544 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.655544 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.655544 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:12.655544 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:12.655544 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-251419544 could not be found. Jul 20 04:25:12.655544 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.659009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4354d53e-7a1e-437a-9836-8918ec218216 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Returning 404 to user: Instance tempest-invalid-251419544 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:12.660059 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4354d53e-7a1e-437a-9836-8918ec218216 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "POST /compute/v2.1/servers/tempest-invalid-251419544/action" status: 404 len: 100 microversion: 2.1 time: 0.017259 Jul 20 04:25:12.665211 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1698/3467] 10.222.0.20 () {60 vars in 1245 bytes} [Wed Jul 20 04:25:12 2022] POST /compute/v2.1/servers/tempest-invalid-251419544/action => generated 100 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:12.675300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6ae03da8-6691-48dd-a137-d45a1a07f1b9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-610819669"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:12.676589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6ae03da8-6691-48dd-a137-d45a1a07f1b9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:25:12.677251 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-6ae03da8-6691-48dd-a137-d45a1a07f1b9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6ae03da8-6691-48dd-a137-d45a1a07f1b9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Request method failure captured: Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 56 Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14OKJMVahlV3NvvKk6SHgw2b8zEhDoMVVx33wX0Pev4in53taZjZCsnE5sVOaeFS0jZqNf_bX_rkESE4uj_i1DMYWBJJCaH5dmP1Zw-PJkgxvo7E-kK8VXSe0beMYgomW6U2CB9qsbHHkd4xs-i08KFy_PNuVBzgX-h6CX2DZ26clt0 Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d54f1cbd9d674e7c899d15803e7186b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}] Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1eb3f567f63548ffb95a5d6d24dca135 Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: {"createImage": {"name": "tempest-test-snap-610819669"}} Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-610819669'}}} Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:25:12.679707 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.684439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.684439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.684439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.684439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.684439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.684439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:12.684439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:12.684439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:25:12.684439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.686010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6ae03da8-6691-48dd-a137-d45a1a07f1b9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:12.687719 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6ae03da8-6691-48dd-a137-d45a1a07f1b9 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.020635 Jul 20 04:25:12.695599 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1699/3468] 10.222.0.20 () {60 vars in 1274 bytes} [Wed Jul 20 04:25:12 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:12.709097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-44e1ff37-07db-4c21-a3c1-63e94f41c36f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-707626181"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:12.710359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-44e1ff37-07db-4c21-a3c1-63e94f41c36f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:25:12.711252 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-44e1ff37-07db-4c21-a3c1-63e94f41c36f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-44e1ff37-07db-4c21-a3c1-63e94f41c36f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Request method failure captured: Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 56 Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14OKJMVahlV3NvvKk6SHgw2b8zEhDoMVVx33wX0Pev4in53taZjZCsnE5sVOaeFS0jZqNf_bX_rkESE4uj_i1DMYWBJJCaH5dmP1Zw-PJkgxvo7E-kK8VXSe0beMYgomW6U2CB9qsbHHkd4xs-i08KFy_PNuVBzgX-h6CX2DZ26clt0 Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d54f1cbd9d674e7c899d15803e7186b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}] Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1eb3f567f63548ffb95a5d6d24dca135 Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: {"createImage": {"name": "tempest-test-snap-707626181"}} Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-707626181'}}} Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:25:12.713195 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.717924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.717924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.717924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.717924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.717924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.717924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:12.717924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:12.717924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:25:12.717924 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.720230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-44e1ff37-07db-4c21-a3c1-63e94f41c36f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:12.721694 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-44e1ff37-07db-4c21-a3c1-63e94f41c36f tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.018292 Jul 20 04:25:12.726676 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1700/3469] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Jul 20 04:25:12 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:12.732345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0bfc1924-a751-4039-9f0c-3d0b7a08cf86 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:12.733098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0bfc1924-a751-4039-9f0c-3d0b7a08cf86 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:12.741192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0bfc1924-a751-4039-9f0c-3d0b7a08cf86 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.741903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0bfc1924-a751-4039-9f0c-3d0b7a08cf86 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.742829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0bfc1924-a751-4039-9f0c-3d0b7a08cf86 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.743423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0bfc1924-a751-4039-9f0c-3d0b7a08cf86 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.760036 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-0bfc1924-a751-4039-9f0c-3d0b7a08cf86 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] HTTP exception thrown: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0bfc1924-a751-4039-9f0c-3d0b7a08cf86 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Request method failure captured: Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 HTTP/1.1 Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14OKJMVahlV3NvvKk6SHgw2b8zEhDoMVVx33wX0Pev4in53taZjZCsnE5sVOaeFS0jZqNf_bX_rkESE4uj_i1DMYWBJJCaH5dmP1Zw-PJkgxvo7E-kK8VXSe0beMYgomW6U2CB9qsbHHkd4xs-i08KFy_PNuVBzgX-h6CX2DZ26clt0 Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d54f1cbd9d674e7c899d15803e7186b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}] Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1eb3f567f63548ffb95a5d6d24dca135 Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0'} Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:12.773496 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0bfc1924-a751-4039-9f0c-3d0b7a08cf86 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Returning 404 to user: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0bfc1924-a751-4039-9f0c-3d0b7a08cf86 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 404 len: 111 microversion: 2.1 time: 0.046862 Jul 20 04:25:12.777583 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1701/3470] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:12 2022] DELETE /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:12.788701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f869f81-77f7-458e-9534-b39f04b1fa38 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:12.790648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0f869f81-77f7-458e-9534-b39f04b1fa38 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] [instance: 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:12.798358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f869f81-77f7-458e-9534-b39f04b1fa38 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.799188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f869f81-77f7-458e-9534-b39f04b1fa38 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.800602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f869f81-77f7-458e-9534-b39f04b1fa38 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.801243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f869f81-77f7-458e-9534-b39f04b1fa38 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.819315 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-0f869f81-77f7-458e-9534-b39f04b1fa38 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] HTTP exception thrown: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f869f81-77f7-458e-9534-b39f04b1fa38 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Request method failure captured: Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 HTTP/1.1 Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14OKJMVahlV3NvvKk6SHgw2b8zEhDoMVVx33wX0Pev4in53taZjZCsnE5sVOaeFS0jZqNf_bX_rkESE4uj_i1DMYWBJJCaH5dmP1Zw-PJkgxvo7E-kK8VXSe0beMYgomW6U2CB9qsbHHkd4xs-i08KFy_PNuVBzgX-h6CX2DZ26clt0 Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d54f1cbd9d674e7c899d15803e7186b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d54f1cbd9d674e7c899d15803e7186b2"}]}] Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d54f1cbd9d674e7c899d15803e7186b2 Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1313160747 Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1eb3f567f63548ffb95a5d6d24dca135 Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesNegativeTestJSON-1313160747-project Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0'} Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:12.822857 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.826917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:12.826917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:12.826917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:12.826917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:12.826917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:12.826917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. Jul 20 04:25:12.826917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:12.829497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f869f81-77f7-458e-9534-b39f04b1fa38 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] Returning 404 to user: Instance 7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:12.830733 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f869f81-77f7-458e-9534-b39f04b1fa38 tempest-ImagesNegativeTestJSON-1313160747 tempest-ImagesNegativeTestJSON-1313160747-project] 10.222.0.20 "GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0" status: 404 len: 111 microversion: 2.1 time: 0.050878 Jul 20 04:25:12.832295 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1702/3471] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:12 2022] GET /compute/v2.1/servers/7ccc9bf7-08db-4b4e-bc78-9a8b36b008c0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:13.143785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:13.144470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:13.145151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:13.150301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:13.150959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:13.196906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:13.203975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:13.211037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:13.220718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:13.276030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Getting quotas for project 8d31e7a862bb417db2ddaf24d4c0f99b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:13.287657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Getting quotas for user c3fccf60e600450c8d10e10e3311fbae and project 8d31e7a862bb417db2ddaf24d4c0f99b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:13.326551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:13.334741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:13.340337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-23e988cb-1747-4f9d-a61a-3e537edc4c46 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:13.342989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-23e988cb-1747-4f9d-a61a-3e537edc4c46 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:13.362882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23e988cb-1747-4f9d-a61a-3e537edc4c46 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:13.365512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23e988cb-1747-4f9d-a61a-3e537edc4c46 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:13.367367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23e988cb-1747-4f9d-a61a-3e537edc4c46 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:13.368408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23e988cb-1747-4f9d-a61a-3e537edc4c46 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:13.473010 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9dc1774e-c2fe-4959-89bb-34d8c32309d5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.322792 Jul 20 04:25:13.489028 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1770/3472] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:25:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:25:13.500323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91849686-e276-482c-9eba-bb797fb82871 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:13.500924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91849686-e276-482c-9eba-bb797fb82871 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:13.787166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91849686-e276-482c-9eba-bb797fb82871 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:13.803582 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91849686-e276-482c-9eba-bb797fb82871 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1213 microversion: 2.1 time: 0.313256 Jul 20 04:25:13.804170 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1771/3473] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:13 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1213 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:13.810550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8bcc3612-8093-4fd2-aaaa-1187d42fba3a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:13.811373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8bcc3612-8093-4fd2-aaaa-1187d42fba3a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:13.824821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bcc3612-8093-4fd2-aaaa-1187d42fba3a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:13.825260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bcc3612-8093-4fd2-aaaa-1187d42fba3a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:13.833447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bcc3612-8093-4fd2-aaaa-1187d42fba3a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:13.833818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bcc3612-8093-4fd2-aaaa-1187d42fba3a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:13.876259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-23e988cb-1747-4f9d-a61a-3e537edc4c46 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:13.884213 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-23e988cb-1747-4f9d-a61a-3e537edc4c46 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1332 microversion: 2.1 time: 0.549756 Jul 20 04:25:13.913661 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1703/3474] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:13 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1332 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:14.030200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8bcc3612-8093-4fd2-aaaa-1187d42fba3a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:14.047959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8bcc3612-8093-4fd2-aaaa-1187d42fba3a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:14.051804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8bcc3612-8093-4fd2-aaaa-1187d42fba3a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7514410e1d348ea87a3ce1bc13a7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081d522e2dcb4382a220a60f6570caf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:14.066359 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8bcc3612-8093-4fd2-aaaa-1187d42fba3a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 200 len: 1605 microversion: 2.42 time: 0.248152 Jul 20 04:25:14.068355 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1772/3475] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:13 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 1605 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:14.821141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9e06a556-e82d-4730-a825-7edde6e89b7d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:14.822521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9e06a556-e82d-4730-a825-7edde6e89b7d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:14.838180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e06a556-e82d-4730-a825-7edde6e89b7d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.838641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e06a556-e82d-4730-a825-7edde6e89b7d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:14.839440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e06a556-e82d-4730-a825-7edde6e89b7d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.839910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e06a556-e82d-4730-a825-7edde6e89b7d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:14.856493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:14.901479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b7d5f514-16a4-48b8-beb2-64812f2c6629 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:14.902102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b7d5f514-16a4-48b8-beb2-64812f2c6629 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:14.916601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7d5f514-16a4-48b8-beb2-64812f2c6629 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.917058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7d5f514-16a4-48b8-beb2-64812f2c6629 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:14.920307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7d5f514-16a4-48b8-beb2-64812f2c6629 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.920762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7d5f514-16a4-48b8-beb2-64812f2c6629 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:15.039828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9e06a556-e82d-4730-a825-7edde6e89b7d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:15.052007 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9e06a556-e82d-4730-a825-7edde6e89b7d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1265 microversion: 2.1 time: 0.234645 Jul 20 04:25:15.052608 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1704/3476] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:14 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:15.090519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-01749a57-9b66-447f-8d62-8f9f0f870d0a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:15.091398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-01749a57-9b66-447f-8d62-8f9f0f870d0a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:15.107907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01749a57-9b66-447f-8d62-8f9f0f870d0a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:15.108599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01749a57-9b66-447f-8d62-8f9f0f870d0a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:15.110491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01749a57-9b66-447f-8d62-8f9f0f870d0a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:15.111125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01749a57-9b66-447f-8d62-8f9f0f870d0a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:15.148578 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-01749a57-9b66-447f-8d62-8f9f0f870d0a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] HTTP exception thrown: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-01749a57-9b66-447f-8d62-8f9f0f870d0a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Request method failure captured: Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f HTTP/1.1 Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14IJfMahgSdpfKiEdpER0PsfMCBSyVoaAguknXxu-4HoJ8D1t6aDf1FtrOuJcmAWP-a5FwmsjA9hbpzCQT0UOQRdJKUL0ohfvTRQQ70zgOpYBtz7Cz71aRzc22GvWYFuCRMTB9mNl_XCjc2suxdhUrxCqhhKwbGryI3s_jsrZwNILMY Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 081d522e2dcb4382a220a60f6570caf0 Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1492570714 Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/081d522e2dcb4382a220a60f6570caf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/081d522e2dcb4382a220a60f6570caf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_081d522e2dcb4382a220a60f6570caf0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/081d522e2dcb4382a220a60f6570caf0"}]}] Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1492570714 Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 081d522e2dcb4382a220a60f6570caf0 Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1492570714 Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TaggedBootDevicesTest_v242-1492570714-project Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: f7514410e1d348ea87a3ce1bc13a7d92 Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1492570714-project Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '0cc742a1-7d7d-49a8-8164-16f52d0a4c9f'} Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:15.168426 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:15.173768 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:15.173768 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:15.173768 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:15.173768 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:15.173768 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:15.173768 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:15.173768 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:15.173768 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:15.175321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-01749a57-9b66-447f-8d62-8f9f0f870d0a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Returning 404 to user: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:15.176396 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-01749a57-9b66-447f-8d62-8f9f0f870d0a tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 404 len: 111 microversion: 2.42 time: 0.090552 Jul 20 04:25:15.177159 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1705/3477] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:15 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:25:15.191893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5ae67fe-99a3-4472-97cc-6f47cef72645 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '.version_select at 0x7fbf9c5120d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:15.226274 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5ae67fe-99a3-4472-97cc-6f47cef72645 tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1521659503" status: 204 len: 0 microversion: 2.42 time: 0.043550 Jul 20 04:25:15.227645 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1706/3478] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Jul 20 04:25:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1521659503 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:25:15.914489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b7d5f514-16a4-48b8-beb2-64812f2c6629 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:15.925947 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b7d5f514-16a4-48b8-beb2-64812f2c6629 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1332 microversion: 2.1 time: 1.028176 Jul 20 04:25:15.936228 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1773/3479] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:14 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1332 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:16.070238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5435577a-60e5-480b-b5ef-c05aedc0f8e6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:16.070849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5435577a-60e5-480b-b5ef-c05aedc0f8e6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:16.083029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5435577a-60e5-480b-b5ef-c05aedc0f8e6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.087820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5435577a-60e5-480b-b5ef-c05aedc0f8e6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:16.088903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5435577a-60e5-480b-b5ef-c05aedc0f8e6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.089508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5435577a-60e5-480b-b5ef-c05aedc0f8e6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:16.242980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5435577a-60e5-480b-b5ef-c05aedc0f8e6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:16.251440 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5435577a-60e5-480b-b5ef-c05aedc0f8e6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1271 microversion: 2.1 time: 0.185932 Jul 20 04:25:16.253045 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1707/3480] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:16 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1271 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:16.944647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e7983535-c60d-42af-8e49-cee74d200eca tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:16.946037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e7983535-c60d-42af-8e49-cee74d200eca tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:16.978329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7983535-c60d-42af-8e49-cee74d200eca tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.979088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7983535-c60d-42af-8e49-cee74d200eca tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:16.980117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7983535-c60d-42af-8e49-cee74d200eca tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.982543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7983535-c60d-42af-8e49-cee74d200eca tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:17.007852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1c5e96d9-8671-4cf9-9a6a-ad2bb963f264 req-f7faecdf-fc72-4599-9c34-fcc95e989547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600c8c47-0770-4158-ae45-3a47fea37227", "name": "network-vif-plugged", "status": "completed", "tag": "a8d254af-8af1-4396-a59c-948fbabfad2f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:17.031429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1c5e96d9-8671-4cf9-9a6a-ad2bb963f264 req-f7faecdf-fc72-4599-9c34-fcc95e989547 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:17.042551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1c5e96d9-8671-4cf9-9a6a-ad2bb963f264 req-f7faecdf-fc72-4599-9c34-fcc95e989547 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:17.092864 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1c5e96d9-8671-4cf9-9a6a-ad2bb963f264 req-f7faecdf-fc72-4599-9c34-fcc95e989547 service nova] Creating event network-vif-plugged:a8d254af-8af1-4396-a59c-948fbabfad2f for instance 600c8c47-0770-4158-ae45-3a47fea37227 on n-h1-764485-11 Jul 20 04:25:17.106918 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1c5e96d9-8671-4cf9-9a6a-ad2bb963f264 req-f7faecdf-fc72-4599-9c34-fcc95e989547 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104793 Jul 20 04:25:17.108966 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1708/3481] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:25:17.275006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ce6441c-cc62-45ad-8c67-ad285009ff5c tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:17.275997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ce6441c-cc62-45ad-8c67-ad285009ff5c tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:17.297106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ce6441c-cc62-45ad-8c67-ad285009ff5c tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:17.298818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ce6441c-cc62-45ad-8c67-ad285009ff5c tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:17.299934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ce6441c-cc62-45ad-8c67-ad285009ff5c tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:17.301739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ce6441c-cc62-45ad-8c67-ad285009ff5c tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:17.801023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e7983535-c60d-42af-8e49-cee74d200eca tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:17.814026 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e7983535-c60d-42af-8e49-cee74d200eca tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1332 microversion: 2.1 time: 0.874220 Jul 20 04:25:17.814633 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1774/3482] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:16 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1332 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:17.868236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1ce6441c-cc62-45ad-8c67-ad285009ff5c tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:17.893622 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ce6441c-cc62-45ad-8c67-ad285009ff5c tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1313 microversion: 2.1 time: 0.622966 Jul 20 04:25:17.894515 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1709/3483] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:17 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:18.831704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2302ac96-6e02-46e3-bd9e-bf9d40428a87 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:18.833012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2302ac96-6e02-46e3-bd9e-bf9d40428a87 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:18.847056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2302ac96-6e02-46e3-bd9e-bf9d40428a87 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:18.847893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2302ac96-6e02-46e3-bd9e-bf9d40428a87 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:18.848799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2302ac96-6e02-46e3-bd9e-bf9d40428a87 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:18.849385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2302ac96-6e02-46e3-bd9e-bf9d40428a87 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:18.916648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-617cb5ec-e836-44ef-856c-cd938cc1c510 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:18.917275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-617cb5ec-e836-44ef-856c-cd938cc1c510 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:18.940242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-617cb5ec-e836-44ef-856c-cd938cc1c510 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:18.942039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-617cb5ec-e836-44ef-856c-cd938cc1c510 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:18.942961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-617cb5ec-e836-44ef-856c-cd938cc1c510 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:18.951847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-617cb5ec-e836-44ef-856c-cd938cc1c510 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:19.428794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2302ac96-6e02-46e3-bd9e-bf9d40428a87 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:19.440171 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2302ac96-6e02-46e3-bd9e-bf9d40428a87 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1332 microversion: 2.1 time: 0.613010 Jul 20 04:25:19.456950 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1775/3484] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:18 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1332 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:19.470140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-617cb5ec-e836-44ef-856c-cd938cc1c510 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:19.490649 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-617cb5ec-e836-44ef-856c-cd938cc1c510 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1334 microversion: 2.1 time: 0.583125 Jul 20 04:25:19.491802 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1710/3485] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:18 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1334 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:20.005569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-52495426-93b2-4bbd-962e-d6c65f7c1f36 req-ff894929-3738-4005-bcb0-ff33c7cc0b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff16920-5ec8-48a6-9ca4-f6d07e0dfe95", "tag": "b9f8c391-5632-461b-9b6a-6a13113292c4"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:20.029509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-52495426-93b2-4bbd-962e-d6c65f7c1f36 req-ff894929-3738-4005-bcb0-ff33c7cc0b24 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:20.030313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-52495426-93b2-4bbd-962e-d6c65f7c1f36 req-ff894929-3738-4005-bcb0-ff33c7cc0b24 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:20.057872 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-52495426-93b2-4bbd-962e-d6c65f7c1f36 req-ff894929-3738-4005-bcb0-ff33c7cc0b24 service nova] Creating event network-changed:b9f8c391-5632-461b-9b6a-6a13113292c4 for instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 on n-h2-764485-11 Jul 20 04:25:20.064958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-52495426-93b2-4bbd-962e-d6c65f7c1f36 req-ff894929-3738-4005-bcb0-ff33c7cc0b24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071508 Jul 20 04:25:20.072801 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1776/3486] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:25:20.141362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-188382369", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "0bc47de2-cbfa-49f6-abce-274b01379099"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:20.264178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] validate_networks() for [('0bc47de2-cbfa-49f6-abce-274b01379099', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:20.458756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7f438881-1efa-4cee-b931-4369de3f801a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:20.459846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7f438881-1efa-4cee-b931-4369de3f801a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:20.476529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f438881-1efa-4cee-b931-4369de3f801a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:20.478140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f438881-1efa-4cee-b931-4369de3f801a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:20.479174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f438881-1efa-4cee-b931-4369de3f801a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:20.482242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f438881-1efa-4cee-b931-4369de3f801a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:21.587488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:21.592240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:21.594586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:21.595290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:21.596856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:21.611312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:21.612268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:21.613578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:21.614255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:21.654227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Getting quotas for project c64e9245e26f4a27b8ed7115b60efb79. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:21.660842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Getting quotas for user b5e47ff480c94e60b9c635a1efd84645 and project c64e9245e26f4a27b8ed7115b60efb79. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:21.676948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:21.679744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:21.751274 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-304910a7-45ac-4386-ae44-de6ef82b8d47 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.684344 Jul 20 04:25:21.752726 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1711/3487] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:25:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:25:21.765524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0437e81a-bf8e-4494-9eca-3ec05c05ccd2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:21.767845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0437e81a-bf8e-4494-9eca-3ec05c05ccd2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:21.779248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0437e81a-bf8e-4494-9eca-3ec05c05ccd2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:21.780150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0437e81a-bf8e-4494-9eca-3ec05c05ccd2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:21.781299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0437e81a-bf8e-4494-9eca-3ec05c05ccd2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:21.788350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7f438881-1efa-4cee-b931-4369de3f801a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:21.808666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0437e81a-bf8e-4494-9eca-3ec05c05ccd2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:21.825800 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7f438881-1efa-4cee-b931-4369de3f801a tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1536 microversion: 2.1 time: 1.368208 Jul 20 04:25:21.843661 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1777/3488] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:20 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1536 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:21.862195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6bc3b464-b9e0-4018-a9a5-1550edd212fb tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:21.862830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6bc3b464-b9e0-4018-a9a5-1550edd212fb tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:22.230121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6bc3b464-b9e0-4018-a9a5-1550edd212fb tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:22.244790 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6bc3b464-b9e0-4018-a9a5-1550edd212fb tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1223 microversion: 2.1 time: 0.396638 Jul 20 04:25:22.246729 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1778/3489] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:21 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1223 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:22.267669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d654497d-38d4-4c02-849f-2210da56264c tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Action: 'create', calling method: .version_select at 0x7fbf9c5c6c10>, body: {"pool": "7c850665-4c6d-46f2-aa23-038d4cc04131"} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:22.636305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0437e81a-bf8e-4494-9eca-3ec05c05ccd2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:22.659646 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0437e81a-bf8e-4494-9eca-3ec05c05ccd2 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1334 microversion: 2.1 time: 0.900105 Jul 20 04:25:22.677205 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1712/3490] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:21 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1334 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:23.262655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:23.266943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3c8cb592-6592-4771-b1a7-a6cdc76c34b2 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:23.267607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3c8cb592-6592-4771-b1a7-a6cdc76c34b2 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:23.283792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c8cb592-6592-4771-b1a7-a6cdc76c34b2 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:23.285295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c8cb592-6592-4771-b1a7-a6cdc76c34b2 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:23.286441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c8cb592-6592-4771-b1a7-a6cdc76c34b2 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:23.291841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c8cb592-6592-4771-b1a7-a6cdc76c34b2 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:23.607763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3c8cb592-6592-4771-b1a7-a6cdc76c34b2 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:23.625572 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3c8cb592-6592-4771-b1a7-a6cdc76c34b2 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1275 microversion: 2.1 time: 0.364316 Jul 20 04:25:23.629218 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1713/3491] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:23 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1275 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:23.635684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b1ab071-aa58-45b9-8324-0f60bebccfbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:23.636623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0b1ab071-aa58-45b9-8324-0f60bebccfbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:23.645230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b1ab071-aa58-45b9-8324-0f60bebccfbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:23.645831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b1ab071-aa58-45b9-8324-0f60bebccfbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:23.646734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b1ab071-aa58-45b9-8324-0f60bebccfbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:23.647179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b1ab071-aa58-45b9-8324-0f60bebccfbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:23.666445 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-0b1ab071-aa58-45b9-8324-0f60bebccfbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] HTTP exception thrown: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b1ab071-aa58-45b9-8324-0f60bebccfbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Request method failure captured: Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f HTTP/1.1 Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14IJfMahgSdpfKiEdpER0PsfMCBSyVoaAguknXxu-4HoJ8D1t6aDf1FtrOuJcmAWP-a5FwmsjA9hbpzCQT0UOQRdJKUL0ohfvTRQQ70zgOpYBtz7Cz71aRzc22GvWYFuCRMTB9mNl_XCjc2suxdhUrxCqhhKwbGryI3s_jsrZwNILMY Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 081d522e2dcb4382a220a60f6570caf0 Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1492570714 Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/081d522e2dcb4382a220a60f6570caf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/081d522e2dcb4382a220a60f6570caf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_081d522e2dcb4382a220a60f6570caf0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/081d522e2dcb4382a220a60f6570caf0"}]}] Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1492570714 Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 081d522e2dcb4382a220a60f6570caf0 Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1492570714 Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TaggedBootDevicesTest_v242-1492570714-project Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: f7514410e1d348ea87a3ce1bc13a7d92 Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1492570714-project Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '0cc742a1-7d7d-49a8-8164-16f52d0a4c9f'} Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:23.668180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:23.673928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:23.673928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:23.673928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:23.673928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:23.673928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:23.673928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:23.673928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:23.673928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:23.673928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:23.673928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:23.673928 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:23.675541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b1ab071-aa58-45b9-8324-0f60bebccfbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Returning 404 to user: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:23.676599 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0b1ab071-aa58-45b9-8324-0f60bebccfbb tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 404 len: 111 microversion: 2.42 time: 0.046059 Jul 20 04:25:23.677181 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1714/3492] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:25:23 2022] DELETE /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:25:23.685785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0510315-adfa-45df-a9fb-c4eae0beca8f tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:23.686871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b0510315-adfa-45df-a9fb-c4eae0beca8f tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] [instance: 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:23.693404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0510315-adfa-45df-a9fb-c4eae0beca8f tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:23.694012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0510315-adfa-45df-a9fb-c4eae0beca8f tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:23.694913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0510315-adfa-45df-a9fb-c4eae0beca8f tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:23.695474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0510315-adfa-45df-a9fb-c4eae0beca8f tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:23.719535 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b0510315-adfa-45df-a9fb-c4eae0beca8f tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] HTTP exception thrown: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0510315-adfa-45df-a9fb-c4eae0beca8f tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Request method failure captured: Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f HTTP/1.1 Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14IJfMahgSdpfKiEdpER0PsfMCBSyVoaAguknXxu-4HoJ8D1t6aDf1FtrOuJcmAWP-a5FwmsjA9hbpzCQT0UOQRdJKUL0ohfvTRQQ70zgOpYBtz7Cz71aRzc22GvWYFuCRMTB9mNl_XCjc2suxdhUrxCqhhKwbGryI3s_jsrZwNILMY Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 081d522e2dcb4382a220a60f6570caf0 Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1492570714 Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/081d522e2dcb4382a220a60f6570caf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/081d522e2dcb4382a220a60f6570caf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_081d522e2dcb4382a220a60f6570caf0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/081d522e2dcb4382a220a60f6570caf0"}]}] Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1492570714 Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 081d522e2dcb4382a220a60f6570caf0 Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1492570714 Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TaggedBootDevicesTest_v242-1492570714-project Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: f7514410e1d348ea87a3ce1bc13a7d92 Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1492570714-project Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '0cc742a1-7d7d-49a8-8164-16f52d0a4c9f'} Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:23.737456 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:23.741646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:23.741646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:23.741646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:23.741646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:23.741646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:23.741646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:23.741646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. Jul 20 04:25:23.741646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:23.741646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0510315-adfa-45df-a9fb-c4eae0beca8f tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] Returning 404 to user: Instance 0cc742a1-7d7d-49a8-8164-16f52d0a4c9f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:23.741646 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0510315-adfa-45df-a9fb-c4eae0beca8f tempest-TaggedBootDevicesTest_v242-1492570714 tempest-TaggedBootDevicesTest_v242-1492570714-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f" status: 404 len: 111 microversion: 2.42 time: 0.057698 Jul 20 04:25:23.745524 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1715/3493] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:23 2022] GET /compute/v2.1/servers/0cc742a1-7d7d-49a8-8164-16f52d0a4c9f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:25:23.751032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f6667c46-ddf7-42ea-8509-f5f29127b9c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:23.751863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f6667c46-ddf7-42ea-8509-f5f29127b9c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:23.763348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6667c46-ddf7-42ea-8509-f5f29127b9c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:23.763851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6667c46-ddf7-42ea-8509-f5f29127b9c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:23.765146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6667c46-ddf7-42ea-8509-f5f29127b9c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:23.765543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6667c46-ddf7-42ea-8509-f5f29127b9c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.700131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f6667c46-ddf7-42ea-8509-f5f29127b9c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:24.718749 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f6667c46-ddf7-42ea-8509-f5f29127b9c5 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1334 microversion: 2.1 time: 0.971359 Jul 20 04:25:24.719322 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1716/3494] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:23 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1334 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:24.732489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8edfdbf9-9312-4034-aab5-32e6da34ecd6 req-22fb4286-29d5-4840-becc-25ff04514d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff16920-5ec8-48a6-9ca4-f6d07e0dfe95", "tag": "d5e0c31a-3b2c-46c0-b6d0-ccf8ce1eb7fa"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:24.741122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8edfdbf9-9312-4034-aab5-32e6da34ecd6 req-22fb4286-29d5-4840-becc-25ff04514d19 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.741953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8edfdbf9-9312-4034-aab5-32e6da34ecd6 req-22fb4286-29d5-4840-becc-25ff04514d19 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.757728 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8edfdbf9-9312-4034-aab5-32e6da34ecd6 req-22fb4286-29d5-4840-becc-25ff04514d19 service nova] Creating event network-changed:d5e0c31a-3b2c-46c0-b6d0-ccf8ce1eb7fa for instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 on n-h2-764485-11 Jul 20 04:25:24.797748 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8edfdbf9-9312-4034-aab5-32e6da34ecd6 req-22fb4286-29d5-4840-becc-25ff04514d19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075127 Jul 20 04:25:24.799914 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1717/3495] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:24.813387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-77911bdd-7d68-46dd-8cd2-2911da02281a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:24.814971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-77911bdd-7d68-46dd-8cd2-2911da02281a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:24.825863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77911bdd-7d68-46dd-8cd2-2911da02281a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.826646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77911bdd-7d68-46dd-8cd2-2911da02281a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.828162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77911bdd-7d68-46dd-8cd2-2911da02281a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.828910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77911bdd-7d68-46dd-8cd2-2911da02281a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.977423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-77911bdd-7d68-46dd-8cd2-2911da02281a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:24.994169 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-77911bdd-7d68-46dd-8cd2-2911da02281a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1281 microversion: 2.1 time: 0.192426 Jul 20 04:25:24.995318 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1718/3496] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:24 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:25.227922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1383285067", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:25.290639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:25.989912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:25.990531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:25.990930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:25.993686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:25.994329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:26.012390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.012949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:26.015619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.025964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:26.056365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Getting quotas for project dd3d006bc13b41a7aaf83838cef7e2df. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:26.082827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Getting quotas for user a4c1d61479ce41e883c1a4ad2795a230 and project dd3d006bc13b41a7aaf83838cef7e2df. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:26.103894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:26.106541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:26.166018 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b98346ce-5196-4b20-9ece-b27d47aa7043 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.101136 Jul 20 04:25:26.166966 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1719/3497] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:25:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:25:26.175428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc8a209d-e624-462e-9f48-6c780d44c4ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:26.176875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc8a209d-e624-462e-9f48-6c780d44c4ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:26.185328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc8a209d-e624-462e-9f48-6c780d44c4ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.186167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc8a209d-e624-462e-9f48-6c780d44c4ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:26.187570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc8a209d-e624-462e-9f48-6c780d44c4ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.188264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc8a209d-e624-462e-9f48-6c780d44c4ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:26.695940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fc8a209d-e624-462e-9f48-6c780d44c4ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:26.715069 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc8a209d-e624-462e-9f48-6c780d44c4ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1334 microversion: 2.1 time: 0.546355 Jul 20 04:25:26.717907 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1720/3498] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:26 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1334 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:26.724329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-de47ee34-24ee-4b51-8baa-c1f10eec207f tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:26.725292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-de47ee34-24ee-4b51-8baa-c1f10eec207f tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:26.732633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de47ee34-24ee-4b51-8baa-c1f10eec207f tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.733519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de47ee34-24ee-4b51-8baa-c1f10eec207f tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:26.734702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de47ee34-24ee-4b51-8baa-c1f10eec207f tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.736657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de47ee34-24ee-4b51-8baa-c1f10eec207f tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:27.531866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-de47ee34-24ee-4b51-8baa-c1f10eec207f tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:27.541628 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-de47ee34-24ee-4b51-8baa-c1f10eec207f tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1323 microversion: 2.1 time: 0.822250 Jul 20 04:25:27.551939 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1721/3499] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:26 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1323 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:27.557207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9e80e3f9-0863-4e94-81f6-eedaad7ba3c4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:27.558133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9e80e3f9-0863-4e94-81f6-eedaad7ba3c4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:27.566064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e80e3f9-0863-4e94-81f6-eedaad7ba3c4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:27.566795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e80e3f9-0863-4e94-81f6-eedaad7ba3c4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:27.567890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e80e3f9-0863-4e94-81f6-eedaad7ba3c4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:27.568507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e80e3f9-0863-4e94-81f6-eedaad7ba3c4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:27.721995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9e80e3f9-0863-4e94-81f6-eedaad7ba3c4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:27.737201 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9e80e3f9-0863-4e94-81f6-eedaad7ba3c4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1287 microversion: 2.1 time: 0.183700 Jul 20 04:25:27.748706 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1722/3500] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:27 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1287 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:27.754221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b938c926-316b-4eac-a13c-6fb86c4ecb1f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:27.755301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b938c926-316b-4eac-a13c-6fb86c4ecb1f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:27.763871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b938c926-316b-4eac-a13c-6fb86c4ecb1f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:27.765139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b938c926-316b-4eac-a13c-6fb86c4ecb1f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:27.766796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b938c926-316b-4eac-a13c-6fb86c4ecb1f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:27.768282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b938c926-316b-4eac-a13c-6fb86c4ecb1f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:27.998393 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d654497d-38d4-4c02-849f-2210da56264c tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.739814 Jul 20 04:25:27.999643 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1779/3501] 10.222.0.20 () {60 vars in 1169 bytes} [Wed Jul 20 04:25:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:28.012984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d35a058d-d2cb-4d2b-9104-453a2d185677 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Action: 'action', calling method: .version_select at 0x7fbfa025a940>, body: {"addFloatingIp": {"address": "172.25.1.245"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:28.014118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d35a058d-d2cb-4d2b-9104-453a2d185677 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:28.031703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d35a058d-d2cb-4d2b-9104-453a2d185677 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.032157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d35a058d-d2cb-4d2b-9104-453a2d185677 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:28.032955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d35a058d-d2cb-4d2b-9104-453a2d185677 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.033397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d35a058d-d2cb-4d2b-9104-453a2d185677 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:28.103340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d35a058d-d2cb-4d2b-9104-453a2d185677 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Acquired lock "refresh_cache-600c8c47-0770-4158-ae45-3a47fea37227" {{(pid=119808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:25:28.108165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b938c926-316b-4eac-a13c-6fb86c4ecb1f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:28.117364 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b938c926-316b-4eac-a13c-6fb86c4ecb1f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1334 microversion: 2.1 time: 0.367133 Jul 20 04:25:28.120160 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1723/3502] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:27 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1334 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:28.559869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2c8477ae-3819-4031-9278-2597a6f801b7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:28.561493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2c8477ae-3819-4031-9278-2597a6f801b7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:28.569177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c8477ae-3819-4031-9278-2597a6f801b7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.570011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c8477ae-3819-4031-9278-2597a6f801b7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:28.571024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c8477ae-3819-4031-9278-2597a6f801b7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.571738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c8477ae-3819-4031-9278-2597a6f801b7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:28.844379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2c8477ae-3819-4031-9278-2597a6f801b7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:28.853965 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2c8477ae-3819-4031-9278-2597a6f801b7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1323 microversion: 2.1 time: 0.299489 Jul 20 04:25:28.857268 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1724/3503] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:28 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1323 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:28.869383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a3b80df9-20af-4d6a-a710-da2803893e40 req-33e0ac70-77bd-43be-962a-3a20a1b00dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a811c37a-837f-4a64-a696-21879b8df872", "tag": "80a56e5f-9e4f-4102-aae0-c184e07381df"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:28.878107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a3b80df9-20af-4d6a-a710-da2803893e40 req-33e0ac70-77bd-43be-962a-3a20a1b00dd2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.878792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a3b80df9-20af-4d6a-a710-da2803893e40 req-33e0ac70-77bd-43be-962a-3a20a1b00dd2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:28.914922 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a3b80df9-20af-4d6a-a710-da2803893e40 req-33e0ac70-77bd-43be-962a-3a20a1b00dd2 service nova] Creating event network-changed:80a56e5f-9e4f-4102-aae0-c184e07381df for instance a811c37a-837f-4a64-a696-21879b8df872 on n-h1-764485-11 Jul 20 04:25:28.929276 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a3b80df9-20af-4d6a-a710-da2803893e40 req-33e0ac70-77bd-43be-962a-3a20a1b00dd2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070570 Jul 20 04:25:28.938566 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1725/3504] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:28.950096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6ea51ec1-b5b1-4ec0-bb24-83bc783288cb tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:28.950891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6ea51ec1-b5b1-4ec0-bb24-83bc783288cb tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:28.966190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ea51ec1-b5b1-4ec0-bb24-83bc783288cb tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.966651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ea51ec1-b5b1-4ec0-bb24-83bc783288cb tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:28.969682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ea51ec1-b5b1-4ec0-bb24-83bc783288cb tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.970145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ea51ec1-b5b1-4ec0-bb24-83bc783288cb tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.108403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6ea51ec1-b5b1-4ec0-bb24-83bc783288cb tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:29.116215 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6ea51ec1-b5b1-4ec0-bb24-83bc783288cb tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1287 microversion: 2.1 time: 0.176153 Jul 20 04:25:29.116797 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1726/3505] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:28 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1287 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:29.138671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c555d232-cb4e-47f2-9ad2-cd752c0aa85f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:29.139282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c555d232-cb4e-47f2-9ad2-cd752c0aa85f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:29.148909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c555d232-cb4e-47f2-9ad2-cd752c0aa85f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.150444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c555d232-cb4e-47f2-9ad2-cd752c0aa85f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.151214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c555d232-cb4e-47f2-9ad2-cd752c0aa85f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.151662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c555d232-cb4e-47f2-9ad2-cd752c0aa85f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.157520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:29.520017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c555d232-cb4e-47f2-9ad2-cd752c0aa85f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:29.531018 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c555d232-cb4e-47f2-9ad2-cd752c0aa85f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1334 microversion: 2.1 time: 0.396997 Jul 20 04:25:29.531907 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1727/3506] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:29 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1334 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:29.875236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-df6004c2-5abc-4fd8-b6dd-be27f7c4e03d tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:29.876432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-df6004c2-5abc-4fd8-b6dd-be27f7c4e03d tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:29.884128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df6004c2-5abc-4fd8-b6dd-be27f7c4e03d tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.884485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df6004c2-5abc-4fd8-b6dd-be27f7c4e03d tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.885546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df6004c2-5abc-4fd8-b6dd-be27f7c4e03d tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.886037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df6004c2-5abc-4fd8-b6dd-be27f7c4e03d tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:30.462761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-df6004c2-5abc-4fd8-b6dd-be27f7c4e03d tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:30.472346 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-df6004c2-5abc-4fd8-b6dd-be27f7c4e03d tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1323 microversion: 2.1 time: 0.602021 Jul 20 04:25:30.473153 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1728/3507] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:29 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1323 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:30.487808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4f279ea1-4d1b-45b8-88a0-28f25e92eed8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:30.489147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4f279ea1-4d1b-45b8-88a0-28f25e92eed8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:30.495908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:30.497657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f279ea1-4d1b-45b8-88a0-28f25e92eed8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:30.498028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f279ea1-4d1b-45b8-88a0-28f25e92eed8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:30.498982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f279ea1-4d1b-45b8-88a0-28f25e92eed8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:30.499468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f279ea1-4d1b-45b8-88a0-28f25e92eed8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:30.609602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4f279ea1-4d1b-45b8-88a0-28f25e92eed8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:30.618994 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4f279ea1-4d1b-45b8-88a0-28f25e92eed8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1275 microversion: 2.1 time: 0.135804 Jul 20 04:25:30.619825 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1729/3508] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:30 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:30.625228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5a23a07a-0325-4af4-9a28-c7047173e29e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:30.625985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a23a07a-0325-4af4-9a28-c7047173e29e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:30.632777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a23a07a-0325-4af4-9a28-c7047173e29e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:30.633229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a23a07a-0325-4af4-9a28-c7047173e29e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:30.634003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a23a07a-0325-4af4-9a28-c7047173e29e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:30.634440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a23a07a-0325-4af4-9a28-c7047173e29e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.100535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a23a07a-0325-4af4-9a28-c7047173e29e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:31.111310 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5a23a07a-0325-4af4-9a28-c7047173e29e tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1334 microversion: 2.1 time: 0.490478 Jul 20 04:25:31.117953 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1730/3509] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:30 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1334 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:31.122277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-d35a058d-d2cb-4d2b-9104-453a2d185677 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Building network info cache for instance {{(pid=119808) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:25:31.160514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-dfa3ca29-09f9-49dd-ac02-5b7a3c63815b req-b27c4cd0-f1e1-4a02-bab2-643e5d16e4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600c8c47-0770-4158-ae45-3a47fea37227", "tag": "a8d254af-8af1-4396-a59c-948fbabfad2f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:31.175061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dfa3ca29-09f9-49dd-ac02-5b7a3c63815b req-b27c4cd0-f1e1-4a02-bab2-643e5d16e4b3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:31.177141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dfa3ca29-09f9-49dd-ac02-5b7a3c63815b req-b27c4cd0-f1e1-4a02-bab2-643e5d16e4b3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.199412 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-dfa3ca29-09f9-49dd-ac02-5b7a3c63815b req-b27c4cd0-f1e1-4a02-bab2-643e5d16e4b3 service nova] Creating event network-changed:a8d254af-8af1-4396-a59c-948fbabfad2f for instance 600c8c47-0770-4158-ae45-3a47fea37227 on n-h1-764485-11 Jul 20 04:25:31.208914 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-dfa3ca29-09f9-49dd-ac02-5b7a3c63815b req-b27c4cd0-f1e1-4a02-bab2-643e5d16e4b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052148 Jul 20 04:25:31.211549 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1731/3510] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:31.469888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a8a13368-5400-4b0a-ab49-9728920fb145 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69dca151-a669-420c-839e-da50cf1daf91"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:31.474850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a8a13368-5400-4b0a-ab49-9728920fb145 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:31.484669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8a13368-5400-4b0a-ab49-9728920fb145 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:31.484669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8a13368-5400-4b0a-ab49-9728920fb145 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.485572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8a13368-5400-4b0a-ab49-9728920fb145 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:31.485864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8a13368-5400-4b0a-ab49-9728920fb145 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:32.243694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=10 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:32.332548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-d35a058d-d2cb-4d2b-9104-453a2d185677 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Updating instance_info_cache with network_info: [{"id": "a8d254af-8af1-4396-a59c-948fbabfad2f", "address": "fa:16:3e:9e:00:99", "network": {"id": "19473404-2bf3-4006-87de-d5f0fcfe4040", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1464702407-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "48603f6325d940eba6da4b98f8e39fdc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa8d254af-8a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119808) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:25:32.357896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d35a058d-d2cb-4d2b-9104-453a2d185677 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Releasing lock "refresh_cache-600c8c47-0770-4158-ae45-3a47fea37227" {{(pid=119808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:25:32.359456 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d35a058d-d2cb-4d2b-9104-453a2d185677 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action" status: 202 len: 0 microversion: 2.1 time: 4.350820 Jul 20 04:25:32.360597 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1780/3511] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:25:28 2022] POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action => generated 0 bytes in 4352 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:25:32.365385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0827dc5c-0af8-44e7-afc1-fd3fd5bb81c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:32.367149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0827dc5c-0af8-44e7-afc1-fd3fd5bb81c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:32.381869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0827dc5c-0af8-44e7-afc1-fd3fd5bb81c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:32.382331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0827dc5c-0af8-44e7-afc1-fd3fd5bb81c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:32.383112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0827dc5c-0af8-44e7-afc1-fd3fd5bb81c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:32.383573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0827dc5c-0af8-44e7-afc1-fd3fd5bb81c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:32.654927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0827dc5c-0af8-44e7-afc1-fd3fd5bb81c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:32.662906 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0827dc5c-0af8-44e7-afc1-fd3fd5bb81c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1323 microversion: 2.1 time: 0.301063 Jul 20 04:25:32.663498 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1781/3512] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:32 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1323 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:32.680028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52642b5e-25ea-4074-999d-27a45673f1d5 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:32.680962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52642b5e-25ea-4074-999d-27a45673f1d5 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:32.694042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52642b5e-25ea-4074-999d-27a45673f1d5 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:32.695027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52642b5e-25ea-4074-999d-27a45673f1d5 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:32.697510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52642b5e-25ea-4074-999d-27a45673f1d5 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:32.699876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52642b5e-25ea-4074-999d-27a45673f1d5 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:33.090788 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a8a13368-5400-4b0a-ab49-9728920fb145 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.628544 Jul 20 04:25:33.097859 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1732/3513] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:25:31 2022] POST /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments => generated 194 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:33.105436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a0dabcd7-a9b0-4627-ba43-c5d1a680bf76 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:33.108958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a0dabcd7-a9b0-4627-ba43-c5d1a680bf76 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:33.128546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0dabcd7-a9b0-4627-ba43-c5d1a680bf76 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:33.129923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0dabcd7-a9b0-4627-ba43-c5d1a680bf76 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:33.131849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0dabcd7-a9b0-4627-ba43-c5d1a680bf76 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:33.132508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0dabcd7-a9b0-4627-ba43-c5d1a680bf76 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:33.974034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52642b5e-25ea-4074-999d-27a45673f1d5 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:33.986742 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52642b5e-25ea-4074-999d-27a45673f1d5 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1317 microversion: 2.1 time: 1.318683 Jul 20 04:25:33.989202 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1782/3514] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:32 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1317 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:33.995363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7605685b-b371-4ef9-bae9-8d8dc7ac2236 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Action: 'create', calling method: .version_select at 0x7fbf9c6313a0>, body: {"pool": "7c850665-4c6d-46f2-aa23-038d4cc04131"} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:34.031781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a0dabcd7-a9b0-4627-ba43-c5d1a680bf76 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:34.043210 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a0dabcd7-a9b0-4627-ba43-c5d1a680bf76 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1334 microversion: 2.1 time: 0.943048 Jul 20 04:25:34.044103 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1733/3515] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:33 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1334 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:34.049635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2d7efd2-7b90-491d-aced-168bdafff2a6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:34.051041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a2d7efd2-7b90-491d-aced-168bdafff2a6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:34.057876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2d7efd2-7b90-491d-aced-168bdafff2a6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:34.059568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2d7efd2-7b90-491d-aced-168bdafff2a6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:34.060934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2d7efd2-7b90-491d-aced-168bdafff2a6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:34.062229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2d7efd2-7b90-491d-aced-168bdafff2a6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:34.628205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a2d7efd2-7b90-491d-aced-168bdafff2a6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:34.639911 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2d7efd2-7b90-491d-aced-168bdafff2a6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1323 microversion: 2.1 time: 0.594420 Jul 20 04:25:34.641549 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1734/3516] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:34 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1323 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:34.788243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-93b20f80-0677-499f-971a-85ffa602051c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:34.789346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-93b20f80-0677-499f-971a-85ffa602051c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:34.801920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93b20f80-0677-499f-971a-85ffa602051c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:34.803655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93b20f80-0677-499f-971a-85ffa602051c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:34.811268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93b20f80-0677-499f-971a-85ffa602051c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:34.812126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93b20f80-0677-499f-971a-85ffa602051c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:34.856507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-93b20f80-0677-499f-971a-85ffa602051c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:25:35.017916 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-93b20f80-0677-499f-971a-85ffa602051c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 204 len: 0 microversion: 2.32 time: 0.373675 Jul 20 04:25:35.021949 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1735/3517] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:25:34 2022] DELETE /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:25:35.036504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-552d6165-6f2d-4584-99ae-8ea290793652 req-d387ca6c-017c-4c41-90e4-53599f664ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8bb3a9-3f84-40e4-98f5-df941562cc99", "tag": "373329f2-04a7-4cd4-9161-6e1cf125f9e8"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:35.052494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-552d6165-6f2d-4584-99ae-8ea290793652 req-d387ca6c-017c-4c41-90e4-53599f664ea4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:35.053608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-552d6165-6f2d-4584-99ae-8ea290793652 req-d387ca6c-017c-4c41-90e4-53599f664ea4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:35.086779 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-552d6165-6f2d-4584-99ae-8ea290793652 req-d387ca6c-017c-4c41-90e4-53599f664ea4 service nova] Creating event network-changed:373329f2-04a7-4cd4-9161-6e1cf125f9e8 for instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 on n-h2-764485-11 Jul 20 04:25:35.097216 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-552d6165-6f2d-4584-99ae-8ea290793652 req-d387ca6c-017c-4c41-90e4-53599f664ea4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071675 Jul 20 04:25:35.098475 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1736/3518] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:35.105819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e4dd8b6-fcab-42ea-ac4b-4ca76d8a7a53 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:35.106790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7e4dd8b6-fcab-42ea-ac4b-4ca76d8a7a53 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:35.115873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e4dd8b6-fcab-42ea-ac4b-4ca76d8a7a53 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:35.116662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e4dd8b6-fcab-42ea-ac4b-4ca76d8a7a53 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:35.117763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e4dd8b6-fcab-42ea-ac4b-4ca76d8a7a53 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:35.119042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e4dd8b6-fcab-42ea-ac4b-4ca76d8a7a53 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:35.545093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7e4dd8b6-fcab-42ea-ac4b-4ca76d8a7a53 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:35.556046 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7e4dd8b6-fcab-42ea-ac4b-4ca76d8a7a53 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1317 microversion: 2.1 time: 0.455750 Jul 20 04:25:35.557035 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1737/3519] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:35 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:35.564340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-92949456-01fc-4841-bbc5-906ce96a5e5b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:35.565425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92949456-01fc-4841-bbc5-906ce96a5e5b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:35.576094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92949456-01fc-4841-bbc5-906ce96a5e5b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:35.577512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92949456-01fc-4841-bbc5-906ce96a5e5b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:35.578671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92949456-01fc-4841-bbc5-906ce96a5e5b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:35.581790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92949456-01fc-4841-bbc5-906ce96a5e5b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.036562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:36.066250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-92949456-01fc-4841-bbc5-906ce96a5e5b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:36.076651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-92949456-01fc-4841-bbc5-906ce96a5e5b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:36.079162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-92949456-01fc-4841-bbc5-906ce96a5e5b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:36.080685 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-92949456-01fc-4841-bbc5-906ce96a5e5b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 2955 microversion: 2.32 time: 0.522367 Jul 20 04:25:36.083909 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1738/3520] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:35 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 2955 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:36.090328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3e2aff1b-5009-4b2a-97af-e3a8c73f7852 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:36.091733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3e2aff1b-5009-4b2a-97af-e3a8c73f7852 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:36.094695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=12 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:36.101678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e2aff1b-5009-4b2a-97af-e3a8c73f7852 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.102347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e2aff1b-5009-4b2a-97af-e3a8c73f7852 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.104965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e2aff1b-5009-4b2a-97af-e3a8c73f7852 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.105719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e2aff1b-5009-4b2a-97af-e3a8c73f7852 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.368687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3e2aff1b-5009-4b2a-97af-e3a8c73f7852 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:36.379629 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3e2aff1b-5009-4b2a-97af-e3a8c73f7852 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1334 microversion: 2.1 time: 0.293983 Jul 20 04:25:36.380211 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1739/3521] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:36 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1334 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:36.385240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-bdb44589-705d-48e4-859c-d5327314259d req-b9f5d5e0-6104-4047-92f0-153714310bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff16920-5ec8-48a6-9ca4-f6d07e0dfe95", "name": "network-vif-plugged", "status": "completed", "tag": "b9f8c391-5632-461b-9b6a-6a13113292c4"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:36.396104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-bdb44589-705d-48e4-859c-d5327314259d req-b9f5d5e0-6104-4047-92f0-153714310bc3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.396828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-bdb44589-705d-48e4-859c-d5327314259d req-b9f5d5e0-6104-4047-92f0-153714310bc3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.411689 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-bdb44589-705d-48e4-859c-d5327314259d req-b9f5d5e0-6104-4047-92f0-153714310bc3 service nova] Creating event network-vif-plugged:b9f8c391-5632-461b-9b6a-6a13113292c4 for instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 on n-h2-764485-11 Jul 20 04:25:36.419089 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-bdb44589-705d-48e4-859c-d5327314259d req-b9f5d5e0-6104-4047-92f0-153714310bc3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037004 Jul 20 04:25:36.420932 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1740/3522] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:36.428647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e52e1016-afee-4478-9f6f-e3a7240a63bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:36.429661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e52e1016-afee-4478-9f6f-e3a7240a63bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:36.438250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e52e1016-afee-4478-9f6f-e3a7240a63bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.439209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e52e1016-afee-4478-9f6f-e3a7240a63bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.440500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e52e1016-afee-4478-9f6f-e3a7240a63bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.441221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e52e1016-afee-4478-9f6f-e3a7240a63bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.696870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e52e1016-afee-4478-9f6f-e3a7240a63bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:36.711894 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e52e1016-afee-4478-9f6f-e3a7240a63bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1323 microversion: 2.1 time: 0.289359 Jul 20 04:25:36.721890 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1741/3523] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:36 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1323 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:36.721890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-018134d3-92d6-42a6-a720-42e35cf94aca tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:36.729197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-018134d3-92d6-42a6-a720-42e35cf94aca tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:36.740357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-018134d3-92d6-42a6-a720-42e35cf94aca tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.740816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-018134d3-92d6-42a6-a720-42e35cf94aca tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.741616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-018134d3-92d6-42a6-a720-42e35cf94aca tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.742061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-018134d3-92d6-42a6-a720-42e35cf94aca tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.424474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-018134d3-92d6-42a6-a720-42e35cf94aca tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:37.441797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:37.460715 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-018134d3-92d6-42a6-a720-42e35cf94aca tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1317 microversion: 2.1 time: 0.744033 Jul 20 04:25:37.461783 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1742/3524] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:36 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1317 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:37.478031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a848b2e-44af-43f4-8d5a-eddf69307512 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:37.479026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4a848b2e-44af-43f4-8d5a-eddf69307512 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:37.489685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a848b2e-44af-43f4-8d5a-eddf69307512 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.493716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a848b2e-44af-43f4-8d5a-eddf69307512 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.495553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a848b2e-44af-43f4-8d5a-eddf69307512 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.496976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a848b2e-44af-43f4-8d5a-eddf69307512 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.798332 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7605685b-b371-4ef9-bae9-8d8dc7ac2236 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.807797 Jul 20 04:25:37.800523 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1783/3525] 10.222.0.20 () {60 vars in 1169 bytes} [Wed Jul 20 04:25:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:37.807167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3ad1add4-2019-4396-a525-203689da4d7f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:37.808847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3ad1add4-2019-4396-a525-203689da4d7f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:37.818339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:37.822563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ad1add4-2019-4396-a525-203689da4d7f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.824187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ad1add4-2019-4396-a525-203689da4d7f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.825894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ad1add4-2019-4396-a525-203689da4d7f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.826355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ad1add4-2019-4396-a525-203689da4d7f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.852909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a848b2e-44af-43f4-8d5a-eddf69307512 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:37.872063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a848b2e-44af-43f4-8d5a-eddf69307512 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:37.875150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a848b2e-44af-43f4-8d5a-eddf69307512 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:37.876384 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a848b2e-44af-43f4-8d5a-eddf69307512 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 2955 microversion: 2.32 time: 0.411059 Jul 20 04:25:37.876995 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1743/3526] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:37 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 2955 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:37.890165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-01ebd79b-44f5-416a-8b84-82b3fb36c4bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:37.892512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-01ebd79b-44f5-416a-8b84-82b3fb36c4bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:37.902204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01ebd79b-44f5-416a-8b84-82b3fb36c4bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.902917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01ebd79b-44f5-416a-8b84-82b3fb36c4bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.904101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01ebd79b-44f5-416a-8b84-82b3fb36c4bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.905600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01ebd79b-44f5-416a-8b84-82b3fb36c4bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:38.102390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3ad1add4-2019-4396-a525-203689da4d7f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:38.114453 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3ad1add4-2019-4396-a525-203689da4d7f tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1334 microversion: 2.1 time: 0.312324 Jul 20 04:25:38.116307 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1784/3527] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:37 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1334 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:38.124803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.69"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:38.127086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:38.135172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:38.136106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:38.137645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:38.138268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:38.143496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-01ebd79b-44f5-416a-8b84-82b3fb36c4bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:38.154177 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-01ebd79b-44f5-416a-8b84-82b3fb36c4bd tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1323 microversion: 2.1 time: 0.269095 Jul 20 04:25:38.165963 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1744/3528] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:37 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:38.178674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Acquired lock "refresh_cache-600c8c47-0770-4158-ae45-3a47fea37227" {{(pid=119808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:25:38.449753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3a6e08d7-1c62-43bb-a04b-0444c4097c37 req-274cdec0-b2fc-4450-b76a-53230237f30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a811c37a-837f-4a64-a696-21879b8df872", "name": "network-vif-plugged", "status": "completed", "tag": "80a56e5f-9e4f-4102-aae0-c184e07381df"}, {"server_uuid": "cff16920-5ec8-48a6-9ca4-f6d07e0dfe95", "name": "network-vif-plugged", "status": "completed", "tag": "d5e0c31a-3b2c-46c0-b6d0-ccf8ce1eb7fa"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:38.467325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3a6e08d7-1c62-43bb-a04b-0444c4097c37 req-274cdec0-b2fc-4450-b76a-53230237f30d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:38.468607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3a6e08d7-1c62-43bb-a04b-0444c4097c37 req-274cdec0-b2fc-4450-b76a-53230237f30d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:38.501095 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3a6e08d7-1c62-43bb-a04b-0444c4097c37 req-274cdec0-b2fc-4450-b76a-53230237f30d service nova] Creating event network-vif-plugged:80a56e5f-9e4f-4102-aae0-c184e07381df for instance a811c37a-837f-4a64-a696-21879b8df872 on n-h1-764485-11 Jul 20 04:25:38.504144 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3a6e08d7-1c62-43bb-a04b-0444c4097c37 req-274cdec0-b2fc-4450-b76a-53230237f30d service nova] Creating event network-vif-plugged:d5e0c31a-3b2c-46c0-b6d0-ccf8ce1eb7fa for instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 on n-h2-764485-11 Jul 20 04:25:38.531924 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3a6e08d7-1c62-43bb-a04b-0444c4097c37 req-274cdec0-b2fc-4450-b76a-53230237f30d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085701 Jul 20 04:25:38.533680 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1745/3529] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:25:38.539588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-27fc2ee4-eacb-44e9-a2f7-78702425e059 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:38.541849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-27fc2ee4-eacb-44e9-a2f7-78702425e059 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:38.547625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27fc2ee4-eacb-44e9-a2f7-78702425e059 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:38.548092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27fc2ee4-eacb-44e9-a2f7-78702425e059 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:38.548882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27fc2ee4-eacb-44e9-a2f7-78702425e059 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:38.549332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27fc2ee4-eacb-44e9-a2f7-78702425e059 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.450810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-27fc2ee4-eacb-44e9-a2f7-78702425e059 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:39.457525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG neutronclient.v2_0.client [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.69 (3421b5e7-b69d-4ff2-a7f7-ae5a4f2e3dde) with port a8d254af-8af1-4396-a59c-948fbabfad2f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 7c850665-4c6d-46f2-aa23-038d4cc04131.", "detail": ""}} {{(pid=119808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:25:39.458647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Releasing lock "refresh_cache-600c8c47-0770-4158-ae45-3a47fea37227" {{(pid=119808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:25:39.459366 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.69 (3421b5e7-b69d-4ff2-a7f7-ae5a4f2e3dde) with port a8d254af-8af1-4396-a59c-948fbabfad2f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 7c850665-4c6d-46f2-aa23-038d4cc04131. Jul 20 04:25:39.459366 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-8c1866ba-93ae-4f90-9526-dca35ad810e1'] Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Request method failure captured: Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action HTTP/1.1 Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 45 Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Ob5zq3J2x7vBL38TcW7275moOFX840bj0S4TUEX1G6WXdZ0O-anmUU_b-WF4shdTo1igxtN1gAj57U2OlqTjqxgAgkwLSgVggrikkV8lGZn39A0k3GivkLPmUzSc6RTLEm6irU0fLe3hWvThpzfQSSPpvlIx0s1CT_lrInNZVyHDg Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 48603f6325d940eba6da4b98f8e39fdc Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48603f6325d940eba6da4b98f8e39fdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48603f6325d940eba6da4b98f8e39fdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48603f6325d940eba6da4b98f8e39fdc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48603f6325d940eba6da4b98f8e39fdc"}]}] Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 48603f6325d940eba6da4b98f8e39fdc Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 10f231b264ad47d187ac666ec3611d05 Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: {"addFloatingIp": {"address": "172.25.1.69"}} Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: exception: Cannot associate floating IP 172.25.1.69 (3421b5e7-b69d-4ff2-a7f7-ae5a4f2e3dde) with port a8d254af-8af1-4396-a59c-948fbabfad2f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 7c850665-4c6d-46f2-aa23-038d4cc04131. Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-8c1866ba-93ae-4f90-9526-dca35ad810e1'] Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '600c8c47-0770-4158-ae45-3a47fea37227', 'body': {'addFloatingIp': {'address': '172.25.1.69'}}} Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:25:39.461742 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.69 (3421b5e7-b69d-4ff2-a7f7-ae5a4f2e3dde) with port a8d254af-8af1-4396-a59c-948fbabfad2f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 7c850665-4c6d-46f2-aa23-038d4cc04131. Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c1866ba-93ae-4f90-9526-dca35ad810e1'] Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.69 (3421b5e7-b69d-4ff2-a7f7-ae5a4f2e3dde) with port a8d254af-8af1-4396-a59c-948fbabfad2f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 7c850665-4c6d-46f2-aa23-038d4cc04131. Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c1866ba-93ae-4f90-9526-dca35ad810e1'] Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.69 (3421b5e7-b69d-4ff2-a7f7-ae5a4f2e3dde) with port a8d254af-8af1-4396-a59c-948fbabfad2f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 7c850665-4c6d-46f2-aa23-038d4cc04131. Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c1866ba-93ae-4f90-9526-dca35ad810e1'] Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.69 (3421b5e7-b69d-4ff2-a7f7-ae5a4f2e3dde) with port a8d254af-8af1-4396-a59c-948fbabfad2f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 7c850665-4c6d-46f2-aa23-038d4cc04131. Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c1866ba-93ae-4f90-9526-dca35ad810e1'] Jul 20 04:25:39.466577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:39.470353 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-27fc2ee4-eacb-44e9-a2f7-78702425e059 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1317 microversion: 2.1 time: 0.926913 Jul 20 04:25:39.470353 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1746/3530] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:38 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1317 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:39.473447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0fc51a1a-ae74-43f8-8ed1-c438f7b5c56b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:39.473589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Returning 400 to user: Cannot associate floating IP 172.25.1.69 (3421b5e7-b69d-4ff2-a7f7-ae5a4f2e3dde) with port a8d254af-8af1-4396-a59c-948fbabfad2f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 7c850665-4c6d-46f2-aa23-038d4cc04131. Jul 20 04:25:39.473589 n-d-764485-11 devstack@n-api.service[119808]: Neutron server returns request_ids: ['req-8c1866ba-93ae-4f90-9526-dca35ad810e1'] {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:39.473979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0fc51a1a-ae74-43f8-8ed1-c438f7b5c56b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:39.474079 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-58bc256f-ee9c-4082-875a-45f6babd1839 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action" status: 400 len: 380 microversion: 2.1 time: 1.355180 Jul 20 04:25:39.474583 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1785/3531] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:25:38 2022] POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action => generated 380 bytes in 1357 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:25:39.481768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5961431-e412-4f6b-a082-70d5b692c427 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:39.482567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d5961431-e412-4f6b-a082-70d5b692c427 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:39.484397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0fc51a1a-ae74-43f8-8ed1-c438f7b5c56b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.484855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0fc51a1a-ae74-43f8-8ed1-c438f7b5c56b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.485807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0fc51a1a-ae74-43f8-8ed1-c438f7b5c56b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.486422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0fc51a1a-ae74-43f8-8ed1-c438f7b5c56b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.492891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5961431-e412-4f6b-a082-70d5b692c427 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.492891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5961431-e412-4f6b-a082-70d5b692c427 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.493542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5961431-e412-4f6b-a082-70d5b692c427 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.493996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5961431-e412-4f6b-a082-70d5b692c427 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.518932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=77,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:40.078267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d5961431-e412-4f6b-a082-70d5b692c427 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:40.093680 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d5961431-e412-4f6b-a082-70d5b692c427 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1334 microversion: 2.1 time: 0.617817 Jul 20 04:25:40.108880 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1786/3532] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:39 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1334 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:40.122964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9dd2a41d-0f78-4b14-b8bc-ad4be2f85e14 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:40.124173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9dd2a41d-0f78-4b14-b8bc-ad4be2f85e14 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:40.135152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dd2a41d-0f78-4b14-b8bc-ad4be2f85e14 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:40.135643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dd2a41d-0f78-4b14-b8bc-ad4be2f85e14 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:40.136447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dd2a41d-0f78-4b14-b8bc-ad4be2f85e14 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:40.136899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dd2a41d-0f78-4b14-b8bc-ad4be2f85e14 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:40.148601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0fc51a1a-ae74-43f8-8ed1-c438f7b5c56b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:40.164383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0fc51a1a-ae74-43f8-8ed1-c438f7b5c56b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:40.166163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0fc51a1a-ae74-43f8-8ed1-c438f7b5c56b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:40.170373 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0fc51a1a-ae74-43f8-8ed1-c438f7b5c56b tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 2955 microversion: 2.32 time: 0.704080 Jul 20 04:25:40.174339 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1747/3533] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:39 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 2955 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:40.179174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d0a5fcf3-3f3e-4147-a87d-f071dd4d97b6 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '.version_select at 0x7fbf9c350ee0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:40.932359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9dd2a41d-0f78-4b14-b8bc-ad4be2f85e14 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:40.942971 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9dd2a41d-0f78-4b14-b8bc-ad4be2f85e14 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1323 microversion: 2.1 time: 0.832775 Jul 20 04:25:40.955293 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1787/3534] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:40 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1323 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:40.960937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d7bb300f-2edc-4872-9e69-dad28818da09 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:40.961809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d7bb300f-2edc-4872-9e69-dad28818da09 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:40.972097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d7bb300f-2edc-4872-9e69-dad28818da09 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:40.972822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d7bb300f-2edc-4872-9e69-dad28818da09 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:40.973771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d7bb300f-2edc-4872-9e69-dad28818da09 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:40.975172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d7bb300f-2edc-4872-9e69-dad28818da09 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.430046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d7bb300f-2edc-4872-9e69-dad28818da09 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:41.448306 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d7bb300f-2edc-4872-9e69-dad28818da09 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1317 microversion: 2.1 time: 0.491494 Jul 20 04:25:41.448916 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1788/3535] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:40 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:41.455318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-77a2b132-2928-4290-aca1-27fd84ab56ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:41.455959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-77a2b132-2928-4290-aca1-27fd84ab56ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:41.476204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-77a2b132-2928-4290-aca1-27fd84ab56ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.476660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-77a2b132-2928-4290-aca1-27fd84ab56ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.477517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-77a2b132-2928-4290-aca1-27fd84ab56ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.477986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-77a2b132-2928-4290-aca1-27fd84ab56ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.879926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-77a2b132-2928-4290-aca1-27fd84ab56ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:41.891651 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-77a2b132-2928-4290-aca1-27fd84ab56ba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1671 microversion: 2.1 time: 0.439791 Jul 20 04:25:41.906569 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1789/3536] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:41 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1671 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:41.912000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-42f9d7ee-b38f-4ea2-a58b-e22c33d010cb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:41.912820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-42f9d7ee-b38f-4ea2-a58b-e22c33d010cb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:41.921403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42f9d7ee-b38f-4ea2-a58b-e22c33d010cb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.922200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42f9d7ee-b38f-4ea2-a58b-e22c33d010cb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.923152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42f9d7ee-b38f-4ea2-a58b-e22c33d010cb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.923794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42f9d7ee-b38f-4ea2-a58b-e22c33d010cb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.375547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-42f9d7ee-b38f-4ea2-a58b-e22c33d010cb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:42.394358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-42f9d7ee-b38f-4ea2-a58b-e22c33d010cb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:42.398493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-42f9d7ee-b38f-4ea2-a58b-e22c33d010cb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:42.400791 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-42f9d7ee-b38f-4ea2-a58b-e22c33d010cb tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 2934 microversion: 2.32 time: 0.492621 Jul 20 04:25:42.403315 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1790/3537] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:41 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 2934 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:42.410084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-cf2f96a8-c2fe-4d20-afa0-a3e9b9b91c27 req-78b18cd5-77fa-4016-bef9-8d5420999cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-unplugged", "status": "completed", "tag": "a5a8eb43-fc76-4f14-ba26-ef8b675f4786"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:42.424854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cf2f96a8-c2fe-4d20-afa0-a3e9b9b91c27 req-78b18cd5-77fa-4016-bef9-8d5420999cdb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.426016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cf2f96a8-c2fe-4d20-afa0-a3e9b9b91c27 req-78b18cd5-77fa-4016-bef9-8d5420999cdb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.455398 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-cf2f96a8-c2fe-4d20-afa0-a3e9b9b91c27 req-78b18cd5-77fa-4016-bef9-8d5420999cdb service nova] Creating event network-vif-unplugged:a5a8eb43-fc76-4f14-ba26-ef8b675f4786 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:25:42.474030 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-cf2f96a8-c2fe-4d20-afa0-a3e9b9b91c27 req-78b18cd5-77fa-4016-bef9-8d5420999cdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069190 Jul 20 04:25:42.477286 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1791/3538] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:42.484906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-40b09242-3dcf-4278-8c7e-0d7b5c050197 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:42.490106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40b09242-3dcf-4278-8c7e-0d7b5c050197 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:42.509684 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d0a5fcf3-3f3e-4147-a87d-f071dd4d97b6 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/3421b5e7-b69d-4ff2-a7f7-ae5a4f2e3dde" status: 202 len: 0 microversion: 2.1 time: 2.333946 Jul 20 04:25:42.510897 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1748/3539] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:25:40 2022] DELETE /compute/v2.1/os-floating-ips/3421b5e7-b69d-4ff2-a7f7-ae5a4f2e3dde => generated 0 bytes in 2336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:25:42.513090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40b09242-3dcf-4278-8c7e-0d7b5c050197 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.513675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40b09242-3dcf-4278-8c7e-0d7b5c050197 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.516853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40b09242-3dcf-4278-8c7e-0d7b5c050197 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.517463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40b09242-3dcf-4278-8c7e-0d7b5c050197 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.518648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bac1d068-2ae7-4ee6-b893-ea822c08382a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:42.522284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bac1d068-2ae7-4ee6-b893-ea822c08382a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:42.535223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bac1d068-2ae7-4ee6-b893-ea822c08382a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.539786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bac1d068-2ae7-4ee6-b893-ea822c08382a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.540956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bac1d068-2ae7-4ee6-b893-ea822c08382a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.542307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bac1d068-2ae7-4ee6-b893-ea822c08382a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.565000 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-40b09242-3dcf-4278-8c7e-0d7b5c050197 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95/ips" status: 200 len: 181 microversion: 2.1 time: 0.084717 Jul 20 04:25:42.565886 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1792/3540] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:25:42 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95/ips => generated 181 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:42.575353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1ef52a94-be1a-4e76-a981-003def3dbb16 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:42.577696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1ef52a94-be1a-4e76-a981-003def3dbb16 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:42.587778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ef52a94-be1a-4e76-a981-003def3dbb16 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.588592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ef52a94-be1a-4e76-a981-003def3dbb16 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.589559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ef52a94-be1a-4e76-a981-003def3dbb16 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.590168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ef52a94-be1a-4e76-a981-003def3dbb16 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:43.070846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bac1d068-2ae7-4ee6-b893-ea822c08382a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:43.078040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1ef52a94-be1a-4e76-a981-003def3dbb16 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:43.089527 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bac1d068-2ae7-4ee6-b893-ea822c08382a tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1520 microversion: 2.1 time: 0.572062 Jul 20 04:25:43.090496 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1749/3541] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:42 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1520 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:43.092616 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1ef52a94-be1a-4e76-a981-003def3dbb16 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1317 microversion: 2.1 time: 0.525387 Jul 20 04:25:43.093383 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1793/3542] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:42 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:43.107032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a393ea0b-a519-4e03-bb7d-92dd17de4248 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:43.111058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b66038d7-8b23-498f-9052-a871d8c83cc7 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Action: 'action', calling method: .version_select at 0x7fbfa03ca1f0>, body: {"removeFloatingIp": {"address": "172.25.1.245"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:43.111979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a393ea0b-a519-4e03-bb7d-92dd17de4248 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:43.138500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a393ea0b-a519-4e03-bb7d-92dd17de4248 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:43.139787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a393ea0b-a519-4e03-bb7d-92dd17de4248 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:43.141148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a393ea0b-a519-4e03-bb7d-92dd17de4248 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:43.141794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a393ea0b-a519-4e03-bb7d-92dd17de4248 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:43.175644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a393ea0b-a519-4e03-bb7d-92dd17de4248 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:25:43.342681 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a393ea0b-a519-4e03-bb7d-92dd17de4248 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 204 len: 0 microversion: 2.1 time: 0.238765 Jul 20 04:25:43.343764 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1794/3543] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:43 2022] DELETE /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:43.358611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61dec74a-7f4d-406b-8884-ffa8d0891ed4 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Action: 'create', calling method: .version_select at 0x7fbf9c631700>, body: {"pool": null} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:43.453934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b66038d7-8b23-498f-9052-a871d8c83cc7 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:43.461388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b66038d7-8b23-498f-9052-a871d8c83cc7 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:43.461849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b66038d7-8b23-498f-9052-a871d8c83cc7 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:43.464490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b66038d7-8b23-498f-9052-a871d8c83cc7 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:43.465010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b66038d7-8b23-498f-9052-a871d8c83cc7 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:44.014414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b66038d7-8b23-498f-9052-a871d8c83cc7 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Acquired lock "refresh_cache-600c8c47-0770-4158-ae45-3a47fea37227" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:25:46.399944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-b66038d7-8b23-498f-9052-a871d8c83cc7 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Building network info cache for instance {{(pid=119807) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:25:47.860699 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-61dec74a-7f4d-406b-8884-ffa8d0891ed4 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.515224 Jul 20 04:25:47.861498 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1795/3544] 10.222.0.20 () {60 vars in 1169 bytes} [Wed Jul 20 04:25:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:47.882805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d536eca-cfbc-4aa9-a1b9-abb1ba1addba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:47.883910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d536eca-cfbc-4aa9-a1b9-abb1ba1addba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:47.914380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d536eca-cfbc-4aa9-a1b9-abb1ba1addba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:47.916370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d536eca-cfbc-4aa9-a1b9-abb1ba1addba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:47.919114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d536eca-cfbc-4aa9-a1b9-abb1ba1addba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:47.924835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d536eca-cfbc-4aa9-a1b9-abb1ba1addba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:48.377863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2d536eca-cfbc-4aa9-a1b9-abb1ba1addba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fccf60e600450c8d10e10e3311fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d31e7a862bb417db2ddaf24d4c0f99b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:48.387374 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d536eca-cfbc-4aa9-a1b9-abb1ba1addba tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 200 len: 1656 microversion: 2.1 time: 0.516450 Jul 20 04:25:48.390472 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1796/3545] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:47 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 1656 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:48.401405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-732a1936-8b72-44ef-9ff4-83bdf8c46d98 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:48.402295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-732a1936-8b72-44ef-9ff4-83bdf8c46d98 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:48.416027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-732a1936-8b72-44ef-9ff4-83bdf8c46d98 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:48.416482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-732a1936-8b72-44ef-9ff4-83bdf8c46d98 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:48.422786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-732a1936-8b72-44ef-9ff4-83bdf8c46d98 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:48.423340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-732a1936-8b72-44ef-9ff4-83bdf8c46d98 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:48.437819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-b66038d7-8b23-498f-9052-a871d8c83cc7 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Updating instance_info_cache with network_info: [{"id": "a8d254af-8af1-4396-a59c-948fbabfad2f", "address": "fa:16:3e:9e:00:99", "network": {"id": "19473404-2bf3-4006-87de-d5f0fcfe4040", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1464702407-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "48603f6325d940eba6da4b98f8e39fdc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa8d254af-8a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:25:48.456837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b66038d7-8b23-498f-9052-a871d8c83cc7 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Releasing lock "refresh_cache-600c8c47-0770-4158-ae45-3a47fea37227" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:25:48.457895 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b66038d7-8b23-498f-9052-a871d8c83cc7 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action" status: 202 len: 0 microversion: 2.1 time: 5.366259 Jul 20 04:25:48.458840 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1750/3546] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:25:43 2022] POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action => generated 0 bytes in 5368 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:25:48.726210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-fef82705-6151-4539-8a52-438ee63d6791 req-3ae8dee9-c650-46db-bd7f-156665947b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-deleted", "tag": "48db0174-8198-40fd-8530-6c031438c060"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:48.738048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fef82705-6151-4539-8a52-438ee63d6791 req-3ae8dee9-c650-46db-bd7f-156665947b50 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:48.739677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fef82705-6151-4539-8a52-438ee63d6791 req-3ae8dee9-c650-46db-bd7f-156665947b50 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:48.760836 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-fef82705-6151-4539-8a52-438ee63d6791 req-3ae8dee9-c650-46db-bd7f-156665947b50 service nova] Creating event network-vif-deleted:48db0174-8198-40fd-8530-6c031438c060 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:25:48.770337 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-fef82705-6151-4539-8a52-438ee63d6791 req-3ae8dee9-c650-46db-bd7f-156665947b50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309925 Jul 20 04:25:48.774180 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1751/3547] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:48.788897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b47fe7f9-0875-411f-af06-20c5b931b65a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:48.790649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b47fe7f9-0875-411f-af06-20c5b931b65a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:48.810008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b47fe7f9-0875-411f-af06-20c5b931b65a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:48.812734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b47fe7f9-0875-411f-af06-20c5b931b65a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:48.813893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b47fe7f9-0875-411f-af06-20c5b931b65a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:48.814579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b47fe7f9-0875-411f-af06-20c5b931b65a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:48.973881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-732a1936-8b72-44ef-9ff4-83bdf8c46d98 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:49.007244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-732a1936-8b72-44ef-9ff4-83bdf8c46d98 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:49.025648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-732a1936-8b72-44ef-9ff4-83bdf8c46d98 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:49.027019 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-732a1936-8b72-44ef-9ff4-83bdf8c46d98 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 2819 microversion: 2.32 time: 0.634422 Jul 20 04:25:49.037153 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1797/3548] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:48 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 2819 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:49.037153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-f142ae00-0316-4088-9113-5e5fb5ece728 req-f4bce038-241b-498e-9b82-01b6ca72fc7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-unplugged", "status": "completed", "tag": "0f94531b-fcec-4091-9be6-24327def4b79"}, {"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-unplugged", "status": "completed", "tag": "97289e02-4c46-41f5-8198-449586f93c1d"}, {"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-unplugged", "status": "completed", "tag": "fc8882d0-d375-49a4-bfcc-f16a0141386d"}, {"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-unplugged", "status": "completed", "tag": "48db0174-8198-40fd-8530-6c031438c060"}, {"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-unplugged", "status": "completed", "tag": "0e68e0df-9766-4b20-b15c-1fe9625a0d15"}, {"server_uuid": "4f8bb3a9-3f84-40e4-98f5-df941562cc99", "name": "network-vif-plugged", "status": "completed", "tag": "373329f2-04a7-4cd4-9161-6e1cf125f9e8"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:49.046005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f142ae00-0316-4088-9113-5e5fb5ece728 req-f4bce038-241b-498e-9b82-01b6ca72fc7a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:49.047042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f142ae00-0316-4088-9113-5e5fb5ece728 req-f4bce038-241b-498e-9b82-01b6ca72fc7a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:49.080842 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f142ae00-0316-4088-9113-5e5fb5ece728 req-f4bce038-241b-498e-9b82-01b6ca72fc7a service nova] Creating event network-vif-unplugged:0f94531b-fcec-4091-9be6-24327def4b79 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:25:49.081549 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f142ae00-0316-4088-9113-5e5fb5ece728 req-f4bce038-241b-498e-9b82-01b6ca72fc7a service nova] Creating event network-vif-unplugged:97289e02-4c46-41f5-8198-449586f93c1d for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:25:49.082079 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f142ae00-0316-4088-9113-5e5fb5ece728 req-f4bce038-241b-498e-9b82-01b6ca72fc7a service nova] Creating event network-vif-unplugged:fc8882d0-d375-49a4-bfcc-f16a0141386d for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:25:49.082597 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f142ae00-0316-4088-9113-5e5fb5ece728 req-f4bce038-241b-498e-9b82-01b6ca72fc7a service nova] Creating event network-vif-unplugged:48db0174-8198-40fd-8530-6c031438c060 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:25:49.085805 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f142ae00-0316-4088-9113-5e5fb5ece728 req-f4bce038-241b-498e-9b82-01b6ca72fc7a service nova] Creating event network-vif-unplugged:0e68e0df-9766-4b20-b15c-1fe9625a0d15 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:25:49.087605 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f142ae00-0316-4088-9113-5e5fb5ece728 req-f4bce038-241b-498e-9b82-01b6ca72fc7a service nova] Creating event network-vif-plugged:373329f2-04a7-4cd4-9161-6e1cf125f9e8 for instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 on n-h2-764485-11 Jul 20 04:25:49.114317 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-f142ae00-0316-4088-9113-5e5fb5ece728 req-f4bce038-241b-498e-9b82-01b6ca72fc7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1048 microversion: 2.1 time: 0.082890 Jul 20 04:25:49.122716 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1798/3549] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 1048 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:49.150126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f16943df-39e6-40d9-b1f1-1d1809adb61a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:49.170100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f16943df-39e6-40d9-b1f1-1d1809adb61a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:49.214500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f16943df-39e6-40d9-b1f1-1d1809adb61a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:49.214987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f16943df-39e6-40d9-b1f1-1d1809adb61a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:49.219447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f16943df-39e6-40d9-b1f1-1d1809adb61a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:49.220177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f16943df-39e6-40d9-b1f1-1d1809adb61a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:49.284918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-f16943df-39e6-40d9-b1f1-1d1809adb61a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lazy-loading 'flavor' on Instance uuid 45e1887b-7d01-481c-a707-dd7d60a9a97b {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:25:49.557385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b47fe7f9-0875-411f-af06-20c5b931b65a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:49.571081 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b47fe7f9-0875-411f-af06-20c5b931b65a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1317 microversion: 2.1 time: 0.793975 Jul 20 04:25:49.572086 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1752/3550] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:48 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1317 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:49.587410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1780360696", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "0bc47de2-cbfa-49f6-abce-274b01379099"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:49.592791 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f16943df-39e6-40d9-b1f1-1d1809adb61a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/action" status: 200 len: 32 microversion: 2.1 time: 0.465340 Jul 20 04:25:49.593423 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1799/3551] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:25:49 2022] POST /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/action => generated 32 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:25:49.598842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7be53af0-481c-44d8-a71a-18506323aab0 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '.version_select at 0x7fbf9c5ce550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:49.674038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] validate_networks() for [('0bc47de2-cbfa-49f6-abce-274b01379099', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:51.886424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:51.887092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:51.887335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:51.887788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:51.888212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:51.908170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:51.908631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:51.909440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:51.909886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:51.958689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Getting quotas for project c64e9245e26f4a27b8ed7115b60efb79. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:51.973112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Getting quotas for user b5e47ff480c94e60b9c635a1efd84645 and project c64e9245e26f4a27b8ed7115b60efb79. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:52.011649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:52.019421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:52.132539 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1a026e0b-351c-4895-bb50-afb2192aec3e tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.545760 Jul 20 04:25:52.133887 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1753/3552] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:25:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:25:52.138837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e2846cb4-9631-4a84-9131-d6fe894d12f3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:52.144396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e2846cb4-9631-4a84-9131-d6fe894d12f3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:52.160685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2846cb4-9631-4a84-9131-d6fe894d12f3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:52.169345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2846cb4-9631-4a84-9131-d6fe894d12f3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:52.172472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2846cb4-9631-4a84-9131-d6fe894d12f3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:52.173116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2846cb4-9631-4a84-9131-d6fe894d12f3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:52.230437 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e2846cb4-9631-4a84-9131-d6fe894d12f3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] HTTP exception thrown: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e2846cb4-9631-4a84-9131-d6fe894d12f3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Request method failure captured: Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 HTTP/1.1 Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14NUoWIHizY5l1dlw8h-7icLXaQC4Ffi9ZBpxz9u2NUv4Fn8ggyFaUykZ47ZsX-fkkbBPGjLJfLy2_zRF2sIe9uTzTZR_1oQqJ5xEFcTXQm4EBJ7g_Gr6ZLuHRyvu-pG76JgDSRHG0pkR2x-F0DmqYVNIXpKjKwsdpBaJGC313LEEHE Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 8d31e7a862bb417db2ddaf24d4c0f99b Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8d31e7a862bb417db2ddaf24d4c0f99b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8d31e7a862bb417db2ddaf24d4c0f99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8d31e7a862bb417db2ddaf24d4c0f99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8d31e7a862bb417db2ddaf24d4c0f99b"}]}] Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 8d31e7a862bb417db2ddaf24d4c0f99b Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestMultiNic-1045453900-project Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c3fccf60e600450c8d10e10e3311fbae Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestMultiNic-1045453900-project Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'cff16920-5ec8-48a6-9ca4-f6d07e0dfe95'} Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:52.234403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:52.239179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:52.239179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:52.239179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:52.239179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:52.239179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:52.239179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:52.239179 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:52.247295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e2846cb4-9631-4a84-9131-d6fe894d12f3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Returning 404 to user: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:52.250895 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e2846cb4-9631-4a84-9131-d6fe894d12f3 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 404 len: 111 microversion: 2.1 time: 0.115758 Jul 20 04:25:52.262177 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1754/3553] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:52 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:52.272783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6284f9da-fcc6-439f-8d17-5593adf36721 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:52.274238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6284f9da-fcc6-439f-8d17-5593adf36721 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:52.286825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6284f9da-fcc6-439f-8d17-5593adf36721 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:52.288675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6284f9da-fcc6-439f-8d17-5593adf36721 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:52.292676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6284f9da-fcc6-439f-8d17-5593adf36721 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:52.293561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6284f9da-fcc6-439f-8d17-5593adf36721 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:52.760314 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7be53af0-481c-44d8-a71a-18506323aab0 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/5f9e69cd-a74f-49aa-a538-aab5f5df060e" status: 202 len: 0 microversion: 2.1 time: 3.165538 Jul 20 04:25:52.761276 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1800/3554] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:25:49 2022] DELETE /compute/v2.1/os-floating-ips/5f9e69cd-a74f-49aa-a538-aab5f5df060e => generated 0 bytes in 3167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:25:52.771937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0baae916-852b-4cb5-b7ff-a758ef298f52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:52.781804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0baae916-852b-4cb5-b7ff-a758ef298f52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:52.794050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0baae916-852b-4cb5-b7ff-a758ef298f52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:52.797490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0baae916-852b-4cb5-b7ff-a758ef298f52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:52.798384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0baae916-852b-4cb5-b7ff-a758ef298f52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:52.802691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0baae916-852b-4cb5-b7ff-a758ef298f52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:52.943258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6284f9da-fcc6-439f-8d17-5593adf36721 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:52.955833 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6284f9da-fcc6-439f-8d17-5593adf36721 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 0.692071 Jul 20 04:25:52.968959 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1755/3555] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:52 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:52.983601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3738bb88-b7f8-43fb-ab1f-ae7f0287c2b8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:52.985495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3738bb88-b7f8-43fb-ab1f-ae7f0287c2b8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:53.004747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3738bb88-b7f8-43fb-ab1f-ae7f0287c2b8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.006203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3738bb88-b7f8-43fb-ab1f-ae7f0287c2b8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:53.007663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3738bb88-b7f8-43fb-ab1f-ae7f0287c2b8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.008127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3738bb88-b7f8-43fb-ab1f-ae7f0287c2b8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:53.347063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0baae916-852b-4cb5-b7ff-a758ef298f52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:53.363367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0baae916-852b-4cb5-b7ff-a758ef298f52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:53.364964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0baae916-852b-4cb5-b7ff-a758ef298f52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:53.366600 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0baae916-852b-4cb5-b7ff-a758ef298f52 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 2611 microversion: 2.32 time: 0.604356 Jul 20 04:25:53.390162 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1801/3556] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:52 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 2611 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:53.402169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-cdb34a79-3b4b-4e91-87af-4e2160dbd05c req-c07c2d0a-3317-41ed-90d9-d3f65222d31b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600c8c47-0770-4158-ae45-3a47fea37227", "tag": "a8d254af-8af1-4396-a59c-948fbabfad2f"}, {"server_uuid": "cff16920-5ec8-48a6-9ca4-f6d07e0dfe95", "name": "network-vif-deleted", "tag": "b9f8c391-5632-461b-9b6a-6a13113292c4"}, {"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-deleted", "tag": "0e68e0df-9766-4b20-b15c-1fe9625a0d15"}, {"server_uuid": "cff16920-5ec8-48a6-9ca4-f6d07e0dfe95", "name": "network-vif-deleted", "tag": "d5e0c31a-3b2c-46c0-b6d0-ccf8ce1eb7fa"}, {"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-deleted", "tag": "a5a8eb43-fc76-4f14-ba26-ef8b675f4786"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:53.430752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cdb34a79-3b4b-4e91-87af-4e2160dbd05c req-c07c2d0a-3317-41ed-90d9-d3f65222d31b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.431490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cdb34a79-3b4b-4e91-87af-4e2160dbd05c req-c07c2d0a-3317-41ed-90d9-d3f65222d31b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:53.440075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3738bb88-b7f8-43fb-ab1f-ae7f0287c2b8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:53.461459 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-cdb34a79-3b4b-4e91-87af-4e2160dbd05c req-c07c2d0a-3317-41ed-90d9-d3f65222d31b service nova] Creating event network-changed:a8d254af-8af1-4396-a59c-948fbabfad2f for instance 600c8c47-0770-4158-ae45-3a47fea37227 on n-h1-764485-11 Jul 20 04:25:53.463780 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3738bb88-b7f8-43fb-ab1f-ae7f0287c2b8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1467 microversion: 2.1 time: 0.492301 Jul 20 04:25:53.464131 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-cdb34a79-3b4b-4e91-87af-4e2160dbd05c req-c07c2d0a-3317-41ed-90d9-d3f65222d31b service nova] Creating event network-vif-deleted:b9f8c391-5632-461b-9b6a-6a13113292c4 for instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 on n-h2-764485-11 Jul 20 04:25:53.464835 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-cdb34a79-3b4b-4e91-87af-4e2160dbd05c req-c07c2d0a-3317-41ed-90d9-d3f65222d31b service nova] Creating event network-vif-deleted:0e68e0df-9766-4b20-b15c-1fe9625a0d15 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:25:53.465511 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-cdb34a79-3b4b-4e91-87af-4e2160dbd05c req-c07c2d0a-3317-41ed-90d9-d3f65222d31b service nova] Creating event network-vif-deleted:d5e0c31a-3b2c-46c0-b6d0-ccf8ce1eb7fa for instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 on n-h2-764485-11 Jul 20 04:25:53.465654 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1756/3557] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:52 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1467 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:53.468121 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-cdb34a79-3b4b-4e91-87af-4e2160dbd05c req-c07c2d0a-3317-41ed-90d9-d3f65222d31b service nova] Creating event network-vif-deleted:a5a8eb43-fc76-4f14-ba26-ef8b675f4786 for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:25:53.486083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-027b5085-7652-4dd9-a31c-2ae72d0b5488 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:53.489043 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-cdb34a79-3b4b-4e91-87af-4e2160dbd05c req-c07c2d0a-3317-41ed-90d9-d3f65222d31b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 863 microversion: 2.1 time: 0.097457 Jul 20 04:25:53.489557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-027b5085-7652-4dd9-a31c-2ae72d0b5488 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:53.492279 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1802/3558] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 863 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:53.502134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f370d1fa-2b87-4271-b60f-666ed5825275 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f370d1fa-2b87-4271-b60f-666ed5825275 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Request method failure captured: Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action HTTP/1.1 Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 34 Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Ob5zq3J2x7vBL38TcW7275moOFX840bj0S4TUEX1G6WXdZ0O-anmUU_b-WF4shdTo1igxtN1gAj57U2OlqTjqxgAgkwLSgVggrikkV8lGZn39A0k3GivkLPmUzSc6RTLEm6irU0fLe3hWvThpzfQSSPpvlIx0s1CT_lrInNZVyHDg Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 48603f6325d940eba6da4b98f8e39fdc Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48603f6325d940eba6da4b98f8e39fdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48603f6325d940eba6da4b98f8e39fdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48603f6325d940eba6da4b98f8e39fdc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48603f6325d940eba6da4b98f8e39fdc"}]}] Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 48603f6325d940eba6da4b98f8e39fdc Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 10f231b264ad47d187ac666ec3611d05 Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: {"addFloatingIp": {"address": ""}} Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '600c8c47-0770-4158-ae45-3a47fea37227', 'body': {'addFloatingIp': {'address': ''}}} Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi '' Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:25:53.505318 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:25:53.510167 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:25:53.510167 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 04:25:53.510167 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:53.510167 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:53.510167 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:53.510167 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:53.510167 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:53.510167 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:53.510167 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:25:53.510167 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:25:53.510167 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 04:25:53.510167 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:53.512033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f370d1fa-2b87-4271-b60f-666ed5825275 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:53.513196 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f370d1fa-2b87-4271-b60f-666ed5825275 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action" status: 400 len: 142 microversion: 2.1 time: 0.017445 Jul 20 04:25:53.515043 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1803/3559] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:25:53 2022] POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action => generated 142 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:25:53.518305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-027b5085-7652-4dd9-a31c-2ae72d0b5488 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.520325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-027b5085-7652-4dd9-a31c-2ae72d0b5488 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:53.523024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-027b5085-7652-4dd9-a31c-2ae72d0b5488 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.527685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-027b5085-7652-4dd9-a31c-2ae72d0b5488 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:53.648895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1512531329", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "d987f25d-4efc-4f73-bb18-1e7a51a7fa42"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:53.741150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] validate_networks() for [('d987f25d-4efc-4f73-bb18-1e7a51a7fa42', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:53.967310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-027b5085-7652-4dd9-a31c-2ae72d0b5488 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:54.001901 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-027b5085-7652-4dd9-a31c-2ae72d0b5488 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1220 microversion: 2.1 time: 0.532834 Jul 20 04:25:54.003193 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1757/3560] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:53 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1220 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:54.009513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-414e0412-c581-483c-9303-219870f1e0d6 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-441183866", "metadata": {"image_type": "test"}}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:54.010930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-414e0412-c581-483c-9303-219870f1e0d6 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:54.019406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-414e0412-c581-483c-9303-219870f1e0d6 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:54.020255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-414e0412-c581-483c-9303-219870f1e0d6 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:54.021368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-414e0412-c581-483c-9303-219870f1e0d6 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:54.022008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-414e0412-c581-483c-9303-219870f1e0d6 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:54.121840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-414e0412-c581-483c-9303-219870f1e0d6 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Getting quotas for project dd3d006bc13b41a7aaf83838cef7e2df. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:54.136191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-414e0412-c581-483c-9303-219870f1e0d6 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Getting quotas for user a4c1d61479ce41e883c1a4ad2795a230 and project dd3d006bc13b41a7aaf83838cef7e2df. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:54.676773 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-414e0412-c581-483c-9303-219870f1e0d6 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "POST /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99/action" status: 202 len: 0 microversion: 2.1 time: 0.671733 Jul 20 04:25:54.682497 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1758/3561] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:25:54 2022] POST /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99/action => generated 0 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:25:54.688717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f1310aac-a54c-4238-ac6b-c13f4b2321f8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Action: 'action', calling method: .version_select at 0x7fbfa0247c10>, body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:54.689975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f1310aac-a54c-4238-ac6b-c13f4b2321f8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:54.709011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1310aac-a54c-4238-ac6b-c13f4b2321f8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:54.709710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1310aac-a54c-4238-ac6b-c13f4b2321f8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:54.710668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1310aac-a54c-4238-ac6b-c13f4b2321f8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:54.712026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1310aac-a54c-4238-ac6b-c13f4b2321f8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:54.768252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1310aac-a54c-4238-ac6b-c13f4b2321f8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Acquired lock "refresh_cache-600c8c47-0770-4158-ae45-3a47fea37227" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:25:55.459025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1310aac-a54c-4238-ac6b-c13f4b2321f8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Releasing lock "refresh_cache-600c8c47-0770-4158-ae45-3a47fea37227" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:25:55.459712 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f1310aac-a54c-4238-ac6b-c13f4b2321f8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] HTTP exception thrown: floating IP not found Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f1310aac-a54c-4238-ac6b-c13f4b2321f8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Request method failure captured: Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action HTTP/1.1 Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 41 Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Ob5zq3J2x7vBL38TcW7275moOFX840bj0S4TUEX1G6WXdZ0O-anmUU_b-WF4shdTo1igxtN1gAj57U2OlqTjqxgAgkwLSgVggrikkV8lGZn39A0k3GivkLPmUzSc6RTLEm6irU0fLe3hWvThpzfQSSPpvlIx0s1CT_lrInNZVyHDg Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 48603f6325d940eba6da4b98f8e39fdc Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48603f6325d940eba6da4b98f8e39fdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48603f6325d940eba6da4b98f8e39fdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48603f6325d940eba6da4b98f8e39fdc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48603f6325d940eba6da4b98f8e39fdc"}]}] Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 48603f6325d940eba6da4b98f8e39fdc Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 10f231b264ad47d187ac666ec3611d05 Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: exception: floating IP not found Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '600c8c47-0770-4158-ae45-3a47fea37227', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 20 04:25:55.461570 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:55.466526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:55.466526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:55.466526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:55.466526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:55.466526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:55.466526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:55.466526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:55.466526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 20 04:25:55.466526 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:25:55.469968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f1310aac-a54c-4238-ac6b-c13f4b2321f8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Returning 404 to user: floating IP not found {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:55.470871 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f1310aac-a54c-4238-ac6b-c13f4b2321f8 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action" status: 404 len: 67 microversion: 2.1 time: 0.787153 Jul 20 04:25:55.472773 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1759/3562] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:25:54 2022] POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action => generated 67 bytes in 789 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:25:55.480354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0da588f8-683e-479e-8e53-8ac9c2149344 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:55.482029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0da588f8-683e-479e-8e53-8ac9c2149344 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:55.489671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0da588f8-683e-479e-8e53-8ac9c2149344 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:55.490132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0da588f8-683e-479e-8e53-8ac9c2149344 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:55.490924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0da588f8-683e-479e-8e53-8ac9c2149344 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:55.491372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0da588f8-683e-479e-8e53-8ac9c2149344 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:55.713226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:55.713961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:55.714908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:55.715600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:55.716114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:55.727441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:55.728062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:55.728967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:55.729489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:55.758500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Getting quotas for project 5f8ccc7dacc04e47a05400c8f552bc6b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:55.766501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Getting quotas for user c24e9eee3baa4aa1b7f40f9bbf7b5fcc and project 5f8ccc7dacc04e47a05400c8f552bc6b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:55.786035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:55.788634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:55.845448 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.329081 Jul 20 04:25:55.847611 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1804/3563] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:25:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:25:55.852864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ab0a53da-da84-47ea-bfdb-f14099298d23 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:55.857981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ab0a53da-da84-47ea-bfdb-f14099298d23 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:55.868698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab0a53da-da84-47ea-bfdb-f14099298d23 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:55.869429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab0a53da-da84-47ea-bfdb-f14099298d23 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:55.870618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab0a53da-da84-47ea-bfdb-f14099298d23 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:55.871255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab0a53da-da84-47ea-bfdb-f14099298d23 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:55.902798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:55.960015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0da588f8-683e-479e-8e53-8ac9c2149344 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:55.964993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:55.981851 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0da588f8-683e-479e-8e53-8ac9c2149344 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 0.507621 Jul 20 04:25:55.982923 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1760/3564] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:55 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:55.991145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-46c9ca6c-96dc-467e-ada3-a0a8184a3196 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c40a820>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:56.039644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ab0a53da-da84-47ea-bfdb-f14099298d23 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:56.055274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ab0a53da-da84-47ea-bfdb-f14099298d23 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:56.064533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ab0a53da-da84-47ea-bfdb-f14099298d23 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:56.065797 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ab0a53da-da84-47ea-bfdb-f14099298d23 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1603 microversion: 2.32 time: 0.216988 Jul 20 04:25:56.070204 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-46c9ca6c-96dc-467e-ada3-a0a8184a3196 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 0.085421 Jul 20 04:25:56.071343 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1761/3565] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:55 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:56.076045 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1805/3566] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:55 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1603 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:56.084243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-872f0a3a-80be-4a6f-9047-47f1a5ffc6a5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:56.084988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-872f0a3a-80be-4a6f-9047-47f1a5ffc6a5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:56.097397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2da2e165-a77c-4b48-a514-73cf5ceb41ac tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Action: 'action', calling method: .version_select at 0x7fbfa025ae50>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:56.099458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-872f0a3a-80be-4a6f-9047-47f1a5ffc6a5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.102089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-872f0a3a-80be-4a6f-9047-47f1a5ffc6a5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:56.102996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-872f0a3a-80be-4a6f-9047-47f1a5ffc6a5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.108728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-872f0a3a-80be-4a6f-9047-47f1a5ffc6a5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:56.434338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-872f0a3a-80be-4a6f-9047-47f1a5ffc6a5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:56.440777 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-2da2e165-a77c-4b48-a514-73cf5ceb41ac tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2da2e165-a77c-4b48-a514-73cf5ceb41ac tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Request method failure captured: Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action HTTP/1.1 Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 44 Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Ob5zq3J2x7vBL38TcW7275moOFX840bj0S4TUEX1G6WXdZ0O-anmUU_b-WF4shdTo1igxtN1gAj57U2OlqTjqxgAgkwLSgVggrikkV8lGZn39A0k3GivkLPmUzSc6RTLEm6irU0fLe3hWvThpzfQSSPpvlIx0s1CT_lrInNZVyHDg Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 48603f6325d940eba6da4b98f8e39fdc Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48603f6325d940eba6da4b98f8e39fdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48603f6325d940eba6da4b98f8e39fdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48603f6325d940eba6da4b98f8e39fdc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48603f6325d940eba6da4b98f8e39fdc"}]}] Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 48603f6325d940eba6da4b98f8e39fdc Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 10f231b264ad47d187ac666ec3611d05 Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: exception: Floating IP not found for address 0.0.0.0. Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '600c8c47-0770-4158-ae45-3a47fea37227', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 20 04:25:56.442582 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 20 04:25:56.447785 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 20 04:25:56.447785 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.447785 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:56.447785 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.447785 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:56.447785 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:56.447785 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:56.447785 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:56.447785 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:56.447785 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 20 04:25:56.447785 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.450450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2da2e165-a77c-4b48-a514-73cf5ceb41ac tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:56.453924 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2da2e165-a77c-4b48-a514-73cf5ceb41ac tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action" status: 404 len: 88 microversion: 2.1 time: 0.375312 Jul 20 04:25:56.455611 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1806/3567] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:25:56 2022] POST /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227/action => generated 88 bytes in 379 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:25:56.489020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-683a6492-a066-42c6-bb65-a8a9f156a9a6 req-5495092c-fb89-48b3-ab5e-0173094f44e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-deleted", "tag": "97289e02-4c46-41f5-8198-449586f93c1d"}, {"server_uuid": "ad51269a-7007-4586-84a5-29568e9c86dc", "name": "network-vif-deleted", "tag": "fc8882d0-d375-49a4-bfcc-f16a0141386d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:56.489277 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-872f0a3a-80be-4a6f-9047-47f1a5ffc6a5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1282 microversion: 2.1 time: 0.416435 Jul 20 04:25:56.493313 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1762/3568] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:56 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1282 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:56.501478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bf7c5cf6-37cc-4769-a732-b594ab5a1549 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:56.503324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bf7c5cf6-37cc-4769-a732-b594ab5a1549 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:56.512779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-683a6492-a066-42c6-bb65-a8a9f156a9a6 req-5495092c-fb89-48b3-ab5e-0173094f44e5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.513233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-683a6492-a066-42c6-bb65-a8a9f156a9a6 req-5495092c-fb89-48b3-ab5e-0173094f44e5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:56.527209 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-683a6492-a066-42c6-bb65-a8a9f156a9a6 req-5495092c-fb89-48b3-ab5e-0173094f44e5 service nova] Creating event network-vif-deleted:97289e02-4c46-41f5-8198-449586f93c1d for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:25:56.528106 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-683a6492-a066-42c6-bb65-a8a9f156a9a6 req-5495092c-fb89-48b3-ab5e-0173094f44e5 service nova] Creating event network-vif-deleted:fc8882d0-d375-49a4-bfcc-f16a0141386d for instance ad51269a-7007-4586-84a5-29568e9c86dc on n-h1-764485-11 Jul 20 04:25:56.534299 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-683a6492-a066-42c6-bb65-a8a9f156a9a6 req-5495092c-fb89-48b3-ab5e-0173094f44e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076072 Jul 20 04:25:56.539422 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1807/3569] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:56.570853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-193acdff-1b40-4caa-b61a-21bc89117666 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:56.571601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-193acdff-1b40-4caa-b61a-21bc89117666 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:56.589130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-193acdff-1b40-4caa-b61a-21bc89117666 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.589861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-193acdff-1b40-4caa-b61a-21bc89117666 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:56.593818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-193acdff-1b40-4caa-b61a-21bc89117666 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.594786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-193acdff-1b40-4caa-b61a-21bc89117666 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:56.614240 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-193acdff-1b40-4caa-b61a-21bc89117666 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] HTTP exception thrown: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-193acdff-1b40-4caa-b61a-21bc89117666 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Request method failure captured: Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 HTTP/1.1 Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14NUoWIHizY5l1dlw8h-7icLXaQC4Ffi9ZBpxz9u2NUv4Fn8ggyFaUykZ47ZsX-fkkbBPGjLJfLy2_zRF2sIe9uTzTZR_1oQqJ5xEFcTXQm4EBJ7g_Gr6ZLuHRyvu-pG76JgDSRHG0pkR2x-F0DmqYVNIXpKjKwsdpBaJGC313LEEHE Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 8d31e7a862bb417db2ddaf24d4c0f99b Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8d31e7a862bb417db2ddaf24d4c0f99b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8d31e7a862bb417db2ddaf24d4c0f99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8d31e7a862bb417db2ddaf24d4c0f99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8d31e7a862bb417db2ddaf24d4c0f99b"}]}] Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 8d31e7a862bb417db2ddaf24d4c0f99b Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestMultiNic-1045453900-project Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c3fccf60e600450c8d10e10e3311fbae Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestMultiNic-1045453900-project Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'cff16920-5ec8-48a6-9ca4-f6d07e0dfe95'} Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:56.616402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:56.621087 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:56.621087 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.621087 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:56.621087 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.621087 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:56.621087 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:56.621087 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:56.621087 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:56.621087 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:56.621087 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:56.621087 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.622978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-193acdff-1b40-4caa-b61a-21bc89117666 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Returning 404 to user: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:56.626108 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-193acdff-1b40-4caa-b61a-21bc89117666 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 404 len: 111 microversion: 2.1 time: 0.084597 Jul 20 04:25:56.630311 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1808/3570] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:56 2022] DELETE /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:56.635846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b214c66-309d-4c7c-add4-36407e970ceb tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:56.636557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b214c66-309d-4c7c-add4-36407e970ceb tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:56.651738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b214c66-309d-4c7c-add4-36407e970ceb tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.652475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b214c66-309d-4c7c-add4-36407e970ceb tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:56.653468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b214c66-309d-4c7c-add4-36407e970ceb tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.653917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b214c66-309d-4c7c-add4-36407e970ceb tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:56.682564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b214c66-309d-4c7c-add4-36407e970ceb tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:25:56.849281 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b214c66-309d-4c7c-add4-36407e970ceb tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 204 len: 0 microversion: 2.1 time: 0.217152 Jul 20 04:25:56.850926 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1809/3571] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:56 2022] DELETE /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:56.857073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4cd61e1b-f527-4747-96b7-e6c5240ccd8d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:56.860472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4cd61e1b-f527-4747-96b7-e6c5240ccd8d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: cff16920-5ec8-48a6-9ca4-f6d07e0dfe95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:56.867367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cd61e1b-f527-4747-96b7-e6c5240ccd8d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.868199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cd61e1b-f527-4747-96b7-e6c5240ccd8d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:56.869242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cd61e1b-f527-4747-96b7-e6c5240ccd8d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.879952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cd61e1b-f527-4747-96b7-e6c5240ccd8d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:56.888133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bf7c5cf6-37cc-4769-a732-b594ab5a1549 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:56.903133 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bf7c5cf6-37cc-4769-a732-b594ab5a1549 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1217 microversion: 2.1 time: 0.405325 Jul 20 04:25:56.906295 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1763/3572] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:56 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1217 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:56.915422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-627ee420-f006-4dee-94e9-71bb9a7ebe83 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:56.920820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-627ee420-f006-4dee-94e9-71bb9a7ebe83 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:56.930741 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-4cd61e1b-f527-4747-96b7-e6c5240ccd8d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] HTTP exception thrown: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4cd61e1b-f527-4747-96b7-e6c5240ccd8d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Request method failure captured: Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 HTTP/1.1 Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14NUoWIHizY5l1dlw8h-7icLXaQC4Ffi9ZBpxz9u2NUv4Fn8ggyFaUykZ47ZsX-fkkbBPGjLJfLy2_zRF2sIe9uTzTZR_1oQqJ5xEFcTXQm4EBJ7g_Gr6ZLuHRyvu-pG76JgDSRHG0pkR2x-F0DmqYVNIXpKjKwsdpBaJGC313LEEHE Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 8d31e7a862bb417db2ddaf24d4c0f99b Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8d31e7a862bb417db2ddaf24d4c0f99b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8d31e7a862bb417db2ddaf24d4c0f99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8d31e7a862bb417db2ddaf24d4c0f99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8d31e7a862bb417db2ddaf24d4c0f99b"}]}] Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 8d31e7a862bb417db2ddaf24d4c0f99b Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestMultiNic-1045453900-project Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c3fccf60e600450c8d10e10e3311fbae Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestMultiNic-1045453900-project Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'cff16920-5ec8-48a6-9ca4-f6d07e0dfe95'} Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:56.940655 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.946221 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:56.946221 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:56.946221 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:56.946221 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:56.946221 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:56.946221 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. Jul 20 04:25:56.946221 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:56.946221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4cd61e1b-f527-4747-96b7-e6c5240ccd8d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Returning 404 to user: Instance cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:56.946221 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4cd61e1b-f527-4747-96b7-e6c5240ccd8d tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95" status: 404 len: 111 microversion: 2.1 time: 0.089963 Jul 20 04:25:56.946221 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1810/3573] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:56 2022] GET /compute/v2.1/servers/cff16920-5ec8-48a6-9ca4-f6d07e0dfe95 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:56.949466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-627ee420-f006-4dee-94e9-71bb9a7ebe83 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.949931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-627ee420-f006-4dee-94e9-71bb9a7ebe83 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:56.956317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-627ee420-f006-4dee-94e9-71bb9a7ebe83 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.957874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-627ee420-f006-4dee-94e9-71bb9a7ebe83 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:56.961761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b9574c36-a183-4ff0-b09f-dabdec908aa6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:56.962311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b9574c36-a183-4ff0-b09f-dabdec908aa6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:56.978533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9574c36-a183-4ff0-b09f-dabdec908aa6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.978910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9574c36-a183-4ff0-b09f-dabdec908aa6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:56.979804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9574c36-a183-4ff0-b09f-dabdec908aa6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:56.980258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9574c36-a183-4ff0-b09f-dabdec908aa6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.041645 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-b9574c36-a183-4ff0-b09f-dabdec908aa6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] HTTP exception thrown: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b9574c36-a183-4ff0-b09f-dabdec908aa6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Request method failure captured: Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb HTTP/1.1 Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14NUoWIHizY5l1dlw8h-7icLXaQC4Ffi9ZBpxz9u2NUv4Fn8ggyFaUykZ47ZsX-fkkbBPGjLJfLy2_zRF2sIe9uTzTZR_1oQqJ5xEFcTXQm4EBJ7g_Gr6ZLuHRyvu-pG76JgDSRHG0pkR2x-F0DmqYVNIXpKjKwsdpBaJGC313LEEHE Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 8d31e7a862bb417db2ddaf24d4c0f99b Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8d31e7a862bb417db2ddaf24d4c0f99b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8d31e7a862bb417db2ddaf24d4c0f99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8d31e7a862bb417db2ddaf24d4c0f99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8d31e7a862bb417db2ddaf24d4c0f99b"}]}] Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 8d31e7a862bb417db2ddaf24d4c0f99b Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestMultiNic-1045453900-project Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c3fccf60e600450c8d10e10e3311fbae Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestMultiNic-1045453900-project Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'be7547c2-1e5a-4c01-9dba-a4340f629ceb'} Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:57.043212 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:57.047789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:57.047789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:57.047789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:57.047789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:57.047789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:57.047789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:57.047789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:57.047789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:57.047789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:57.047789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:57.047789 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:57.049690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b9574c36-a183-4ff0-b09f-dabdec908aa6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Returning 404 to user: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:57.049690 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b9574c36-a183-4ff0-b09f-dabdec908aa6 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "DELETE /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 404 len: 111 microversion: 2.1 time: 0.097173 Jul 20 04:25:57.050283 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1811/3574] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:56 2022] DELETE /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:57.064386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0cf3d439-2f07-41d5-b5a3-a8a191ef3088 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:57.065010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0cf3d439-2f07-41d5-b5a3-a8a191ef3088 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:57.080880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0cf3d439-2f07-41d5-b5a3-a8a191ef3088 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.084106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0cf3d439-2f07-41d5-b5a3-a8a191ef3088 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.084940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0cf3d439-2f07-41d5-b5a3-a8a191ef3088 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.085388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0cf3d439-2f07-41d5-b5a3-a8a191ef3088 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.433869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0cf3d439-2f07-41d5-b5a3-a8a191ef3088 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:57.445360 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0cf3d439-2f07-41d5-b5a3-a8a191ef3088 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 0.385679 Jul 20 04:25:57.445506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-627ee420-f006-4dee-94e9-71bb9a7ebe83 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:57.448174 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1812/3575] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:57 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:57.454344 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-627ee420-f006-4dee-94e9-71bb9a7ebe83 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1542 microversion: 2.1 time: 0.546345 Jul 20 04:25:57.455480 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1764/3576] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:56 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1542 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:57.459682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd9f4729-9e8f-4161-92da-d335022d73b8 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:57.460311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dd9f4729-9e8f-4161-92da-d335022d73b8 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] [instance: be7547c2-1e5a-4c01-9dba-a4340f629ceb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:57.460728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2f087ee-e117-4a12-b146-c528b2ff7f3e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c3689d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:57.475951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd9f4729-9e8f-4161-92da-d335022d73b8 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.476407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd9f4729-9e8f-4161-92da-d335022d73b8 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.479838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd9f4729-9e8f-4161-92da-d335022d73b8 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.481627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd9f4729-9e8f-4161-92da-d335022d73b8 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.517502 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2f087ee-e117-4a12-b146-c528b2ff7f3e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 0.060419 Jul 20 04:25:57.518331 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-dd9f4729-9e8f-4161-92da-d335022d73b8 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] HTTP exception thrown: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:57.519139 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1765/3577] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:57 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd9f4729-9e8f-4161-92da-d335022d73b8 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Request method failure captured: Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb HTTP/1.1 Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14NUoWIHizY5l1dlw8h-7icLXaQC4Ffi9ZBpxz9u2NUv4Fn8ggyFaUykZ47ZsX-fkkbBPGjLJfLy2_zRF2sIe9uTzTZR_1oQqJ5xEFcTXQm4EBJ7g_Gr6ZLuHRyvu-pG76JgDSRHG0pkR2x-F0DmqYVNIXpKjKwsdpBaJGC313LEEHE Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 8d31e7a862bb417db2ddaf24d4c0f99b Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8d31e7a862bb417db2ddaf24d4c0f99b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8d31e7a862bb417db2ddaf24d4c0f99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8d31e7a862bb417db2ddaf24d4c0f99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8d31e7a862bb417db2ddaf24d4c0f99b"}]}] Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 8d31e7a862bb417db2ddaf24d4c0f99b Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestMultiNic-1045453900 Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestMultiNic-1045453900-project Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c3fccf60e600450c8d10e10e3311fbae Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestMultiNic-1045453900-project Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'be7547c2-1e5a-4c01-9dba-a4340f629ceb'} Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:57.520025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:57.524902 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:57.524902 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:57.524902 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:57.524902 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:57.524902 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:57.524902 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. Jul 20 04:25:57.524902 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:25:57.524902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd9f4729-9e8f-4161-92da-d335022d73b8 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] Returning 404 to user: Instance be7547c2-1e5a-4c01-9dba-a4340f629ceb could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:57.524902 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dd9f4729-9e8f-4161-92da-d335022d73b8 tempest-ServersTestMultiNic-1045453900 tempest-ServersTestMultiNic-1045453900-project] 10.222.0.20 "GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb" status: 404 len: 111 microversion: 2.1 time: 0.072805 Jul 20 04:25:57.531100 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1813/3578] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:57 2022] GET /compute/v2.1/servers/be7547c2-1e5a-4c01-9dba-a4340f629ceb => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:57.539414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d89ae2f0-d4cf-4a3e-8b7c-9f4f0a8c6881 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:57.542872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d89ae2f0-d4cf-4a3e-8b7c-9f4f0a8c6881 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:57.547128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee055f30-4535-459b-8018-23089442f3cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:57.551263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d89ae2f0-d4cf-4a3e-8b7c-9f4f0a8c6881 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.552150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d89ae2f0-d4cf-4a3e-8b7c-9f4f0a8c6881 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.552288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ee055f30-4535-459b-8018-23089442f3cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:57.553230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d89ae2f0-d4cf-4a3e-8b7c-9f4f0a8c6881 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.553836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d89ae2f0-d4cf-4a3e-8b7c-9f4f0a8c6881 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.566644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee055f30-4535-459b-8018-23089442f3cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.567103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee055f30-4535-459b-8018-23089442f3cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.579930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee055f30-4535-459b-8018-23089442f3cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.580773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee055f30-4535-459b-8018-23089442f3cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.744610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ee055f30-4535-459b-8018-23089442f3cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:57.766313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ee055f30-4535-459b-8018-23089442f3cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:57.771128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ee055f30-4535-459b-8018-23089442f3cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:57.773776 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ee055f30-4535-459b-8018-23089442f3cf tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1872 microversion: 2.32 time: 0.247638 Jul 20 04:25:57.784653 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1766/3579] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:57 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1872 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:57.922954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-743fe076-7185-4bf1-81d9-4078a22f556a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:57.923626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-743fe076-7185-4bf1-81d9-4078a22f556a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:57.926932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:57.949744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-743fe076-7185-4bf1-81d9-4078a22f556a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.950209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-743fe076-7185-4bf1-81d9-4078a22f556a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.951016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-743fe076-7185-4bf1-81d9-4078a22f556a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.952224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-743fe076-7185-4bf1-81d9-4078a22f556a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:58.160896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-743fe076-7185-4bf1-81d9-4078a22f556a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:58.170705 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-743fe076-7185-4bf1-81d9-4078a22f556a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1287 microversion: 2.1 time: 0.251302 Jul 20 04:25:58.177169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d89ae2f0-d4cf-4a3e-8b7c-9f4f0a8c6881 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:58.178833 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1767/3580] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:57 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1287 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:58.195433 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d89ae2f0-d4cf-4a3e-8b7c-9f4f0a8c6881 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1324 microversion: 2.1 time: 0.662801 Jul 20 04:25:58.196313 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1814/3581] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:57 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1324 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:58.462191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-53a9a59b-e198-4740-bb48-8572b4e2b85b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:58.463071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-53a9a59b-e198-4740-bb48-8572b4e2b85b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:58.472899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-19310307-c3b4-4902-b4e3-33a1aeb08a72 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:58.473518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-19310307-c3b4-4902-b4e3-33a1aeb08a72 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:58.474809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53a9a59b-e198-4740-bb48-8572b4e2b85b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:58.476559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53a9a59b-e198-4740-bb48-8572b4e2b85b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:58.479312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53a9a59b-e198-4740-bb48-8572b4e2b85b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:58.479990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53a9a59b-e198-4740-bb48-8572b4e2b85b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:58.487622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19310307-c3b4-4902-b4e3-33a1aeb08a72 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:58.488092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19310307-c3b4-4902-b4e3-33a1aeb08a72 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:58.495418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19310307-c3b4-4902-b4e3-33a1aeb08a72 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:58.495944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19310307-c3b4-4902-b4e3-33a1aeb08a72 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.507610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-53a9a59b-e198-4740-bb48-8572b4e2b85b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:59.523166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-19310307-c3b4-4902-b4e3-33a1aeb08a72 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:59.528524 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-53a9a59b-e198-4740-bb48-8572b4e2b85b tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 1.070087 Jul 20 04:25:59.531255 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1768/3582] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:58 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:59.538619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9fb72a00-179a-4948-93f8-359d2880c51e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c4535e0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:59.542065 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-19310307-c3b4-4902-b4e3-33a1aeb08a72 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1542 microversion: 2.1 time: 1.073483 Jul 20 04:25:59.542669 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1815/3583] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:58 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1542 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:59.562480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-481113e9-5f33-4d3b-ad1d-32beea70b68c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:59.579283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-481113e9-5f33-4d3b-ad1d-32beea70b68c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:59.592098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-481113e9-5f33-4d3b-ad1d-32beea70b68c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:59.592746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-481113e9-5f33-4d3b-ad1d-32beea70b68c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.594648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-481113e9-5f33-4d3b-ad1d-32beea70b68c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:59.594901 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9fb72a00-179a-4948-93f8-359d2880c51e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 0.061784 Jul 20 04:25:59.595347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-481113e9-5f33-4d3b-ad1d-32beea70b68c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.601446 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1769/3584] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:59 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:59.606903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-45c10785-6734-4a16-8b50-a70cfa16c644 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:59.607877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-45c10785-6734-4a16-8b50-a70cfa16c644 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:59.615443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45c10785-6734-4a16-8b50-a70cfa16c644 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:59.616191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45c10785-6734-4a16-8b50-a70cfa16c644 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.617136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45c10785-6734-4a16-8b50-a70cfa16c644 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:59.617741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45c10785-6734-4a16-8b50-a70cfa16c644 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.742457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-481113e9-5f33-4d3b-ad1d-32beea70b68c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:59.756536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-481113e9-5f33-4d3b-ad1d-32beea70b68c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:59.758478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-481113e9-5f33-4d3b-ad1d-32beea70b68c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:59.760020 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-481113e9-5f33-4d3b-ad1d-32beea70b68c tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1872 microversion: 2.32 time: 0.216408 Jul 20 04:25:59.772589 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1816/3585] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:25:59 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1872 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:25:59.777909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c0b3f1f1-aa9e-47d6-bdb1-389cadb13262 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:59.778822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c0b3f1f1-aa9e-47d6-bdb1-389cadb13262 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:59.786647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0b3f1f1-aa9e-47d6-bdb1-389cadb13262 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:59.787425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0b3f1f1-aa9e-47d6-bdb1-389cadb13262 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.788483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0b3f1f1-aa9e-47d6-bdb1-389cadb13262 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:59.789151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0b3f1f1-aa9e-47d6-bdb1-389cadb13262 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.804858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-45c10785-6734-4a16-8b50-a70cfa16c644 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:59.820762 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-45c10785-6734-4a16-8b50-a70cfa16c644 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1275 microversion: 2.1 time: 0.217947 Jul 20 04:25:59.833439 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1770/3586] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:59 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1275 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:59.836014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-11ec3f99-7d36-4b7d-886f-845fca06f0ec tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:59.836744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-11ec3f99-7d36-4b7d-886f-845fca06f0ec tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:59.845941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11ec3f99-7d36-4b7d-886f-845fca06f0ec tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:59.846669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11ec3f99-7d36-4b7d-886f-845fca06f0ec tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.847464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11ec3f99-7d36-4b7d-886f-845fca06f0ec tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:59.847934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11ec3f99-7d36-4b7d-886f-845fca06f0ec tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:00.456722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c0b3f1f1-aa9e-47d6-bdb1-389cadb13262 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:00.467311 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c0b3f1f1-aa9e-47d6-bdb1-389cadb13262 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1324 microversion: 2.1 time: 0.692665 Jul 20 04:26:00.468170 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1817/3587] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:59 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1324 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:00.476829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-11ec3f99-7d36-4b7d-886f-845fca06f0ec tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:00.485841 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-11ec3f99-7d36-4b7d-886f-845fca06f0ec tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.654555 Jul 20 04:26:00.486560 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1771/3588] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:59 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:00.503479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f3896971-1d27-4f76-b04c-e1eba38e8b1d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:00.504415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f3896971-1d27-4f76-b04c-e1eba38e8b1d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:00.510893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3896971-1d27-4f76-b04c-e1eba38e8b1d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:00.511600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3896971-1d27-4f76-b04c-e1eba38e8b1d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:00.512378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3896971-1d27-4f76-b04c-e1eba38e8b1d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:00.512819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3896971-1d27-4f76-b04c-e1eba38e8b1d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:00.548857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3af0b8c4-38f4-45bb-aa14-85c80626de75 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:00.549488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3af0b8c4-38f4-45bb-aa14-85c80626de75 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:00.562540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3af0b8c4-38f4-45bb-aa14-85c80626de75 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:00.563179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3af0b8c4-38f4-45bb-aa14-85c80626de75 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:00.564403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3af0b8c4-38f4-45bb-aa14-85c80626de75 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:00.565271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3af0b8c4-38f4-45bb-aa14-85c80626de75 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.153930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f3896971-1d27-4f76-b04c-e1eba38e8b1d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:01.162716 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f3896971-1d27-4f76-b04c-e1eba38e8b1d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.663005 Jul 20 04:26:01.163600 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1818/3589] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:00 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:01.168547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0093740f-72a2-43e9-9914-9c7cbc4a0bbd tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:01.169370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0093740f-72a2-43e9-9914-9c7cbc4a0bbd tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:01.178884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0093740f-72a2-43e9-9914-9c7cbc4a0bbd tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.179608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0093740f-72a2-43e9-9914-9c7cbc4a0bbd tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.180563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0093740f-72a2-43e9-9914-9c7cbc4a0bbd tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.181232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0093740f-72a2-43e9-9914-9c7cbc4a0bbd tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.194539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3af0b8c4-38f4-45bb-aa14-85c80626de75 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:01.210164 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3af0b8c4-38f4-45bb-aa14-85c80626de75 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 0.666455 Jul 20 04:26:01.210618 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1772/3590] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:00 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:01.219360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-52a914e7-d73e-44df-a084-e453aabb5687 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c378820>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:01.319182 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-52a914e7-d73e-44df-a084-e453aabb5687 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 0.107303 Jul 20 04:26:01.319790 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1773/3591] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:01 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:01.324475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1136758a-2cb2-47ca-b319-8512b3864e73 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:01.325101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1136758a-2cb2-47ca-b319-8512b3864e73 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:01.339340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0093740f-72a2-43e9-9914-9c7cbc4a0bbd tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f231b264ad47d187ac666ec3611d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48603f6325d940eba6da4b98f8e39fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:01.344756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1136758a-2cb2-47ca-b319-8512b3864e73 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.345488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1136758a-2cb2-47ca-b319-8512b3864e73 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.346724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1136758a-2cb2-47ca-b319-8512b3864e73 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.347852 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0093740f-72a2-43e9-9914-9c7cbc4a0bbd tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 200 len: 1317 microversion: 2.1 time: 0.183025 Jul 20 04:26:01.348456 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1819/3592] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:01 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:01.356542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a307e1d0-b0cb-4c18-b64a-2e2bdf1c8efd tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:01.357215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1136758a-2cb2-47ca-b319-8512b3864e73 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.366676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a307e1d0-b0cb-4c18-b64a-2e2bdf1c8efd tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:01.381825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a307e1d0-b0cb-4c18-b64a-2e2bdf1c8efd tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.382307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a307e1d0-b0cb-4c18-b64a-2e2bdf1c8efd tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.383113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a307e1d0-b0cb-4c18-b64a-2e2bdf1c8efd tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.392224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a307e1d0-b0cb-4c18-b64a-2e2bdf1c8efd tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.515402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1136758a-2cb2-47ca-b319-8512b3864e73 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:01.530973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1136758a-2cb2-47ca-b319-8512b3864e73 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:01.538031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1136758a-2cb2-47ca-b319-8512b3864e73 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:01.539658 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1136758a-2cb2-47ca-b319-8512b3864e73 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1872 microversion: 2.32 time: 0.218703 Jul 20 04:26:01.541567 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1774/3593] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:01 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1872 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:01.552267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-5c184908-a200-468e-94ad-395056bcad47 req-0ea77518-deda-4734-b348-0f2d3d2f938d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600c8c47-0770-4158-ae45-3a47fea37227", "name": "network-vif-deleted", "tag": "a8d254af-8af1-4396-a59c-948fbabfad2f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:01.586108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5c184908-a200-468e-94ad-395056bcad47 req-0ea77518-deda-4734-b348-0f2d3d2f938d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.586663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5c184908-a200-468e-94ad-395056bcad47 req-0ea77518-deda-4734-b348-0f2d3d2f938d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.622378 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-5c184908-a200-468e-94ad-395056bcad47 req-0ea77518-deda-4734-b348-0f2d3d2f938d service nova] Creating event network-vif-deleted:a8d254af-8af1-4396-a59c-948fbabfad2f for instance 600c8c47-0770-4158-ae45-3a47fea37227 on n-h1-764485-11 Jul 20 04:26:01.636516 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-5c184908-a200-468e-94ad-395056bcad47 req-0ea77518-deda-4734-b348-0f2d3d2f938d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093180 Jul 20 04:26:01.637746 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1775/3594] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:01.647698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-64e16208-3dcf-48c3-b69f-81d638d531d5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:01.648816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-64e16208-3dcf-48c3-b69f-81d638d531d5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:01.658851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64e16208-3dcf-48c3-b69f-81d638d531d5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.659643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64e16208-3dcf-48c3-b69f-81d638d531d5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.660619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64e16208-3dcf-48c3-b69f-81d638d531d5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.662586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64e16208-3dcf-48c3-b69f-81d638d531d5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.922769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:02.086460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a307e1d0-b0cb-4c18-b64a-2e2bdf1c8efd tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:02.099542 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a307e1d0-b0cb-4c18-b64a-2e2bdf1c8efd tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1317 microversion: 2.1 time: 0.745420 Jul 20 04:26:02.110916 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1820/3595] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:01 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1317 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:02.116640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da9bd04a-0634-419e-a044-a5f7e726cee5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:02.117790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-da9bd04a-0634-419e-a044-a5f7e726cee5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:02.125961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da9bd04a-0634-419e-a044-a5f7e726cee5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.126415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da9bd04a-0634-419e-a044-a5f7e726cee5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.127557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da9bd04a-0634-419e-a044-a5f7e726cee5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.128003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da9bd04a-0634-419e-a044-a5f7e726cee5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.308402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-64e16208-3dcf-48c3-b69f-81d638d531d5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:02.320145 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-64e16208-3dcf-48c3-b69f-81d638d531d5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.678054 Jul 20 04:26:02.321970 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1776/3596] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:01 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:02.386695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b6648373-e617-4cdb-aa90-b8cd228bf2d6 req-f542720c-5424-4265-a6e1-3bc5371cc646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8bb3a9-3f84-40e4-98f5-df941562cc99", "name": "network-vif-plugged", "status": "completed", "tag": "373329f2-04a7-4cd4-9161-6e1cf125f9e8"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:02.396415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b6648373-e617-4cdb-aa90-b8cd228bf2d6 req-f542720c-5424-4265-a6e1-3bc5371cc646 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.397193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b6648373-e617-4cdb-aa90-b8cd228bf2d6 req-f542720c-5424-4265-a6e1-3bc5371cc646 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.412165 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b6648373-e617-4cdb-aa90-b8cd228bf2d6 req-f542720c-5424-4265-a6e1-3bc5371cc646 service nova] Creating event network-vif-plugged:373329f2-04a7-4cd4-9161-6e1cf125f9e8 for instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 on n-h2-764485-11 Jul 20 04:26:02.418300 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b6648373-e617-4cdb-aa90-b8cd228bf2d6 req-f542720c-5424-4265-a6e1-3bc5371cc646 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096244 Jul 20 04:26:02.424722 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1777/3597] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:02.431008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b69b0b8-be05-4a9a-b9aa-0c5a3188366e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:02.432392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0b69b0b8-be05-4a9a-b9aa-0c5a3188366e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:02.446389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b69b0b8-be05-4a9a-b9aa-0c5a3188366e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.447473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b69b0b8-be05-4a9a-b9aa-0c5a3188366e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.448514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b69b0b8-be05-4a9a-b9aa-0c5a3188366e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.449177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b69b0b8-be05-4a9a-b9aa-0c5a3188366e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.157302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-da9bd04a-0634-419e-a044-a5f7e726cee5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:03.170147 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da9bd04a-0634-419e-a044-a5f7e726cee5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1324 microversion: 2.1 time: 1.057358 Jul 20 04:26:03.185291 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1821/3598] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:02 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1324 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:03.203968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c495ef15-79c0-4971-a041-b0d30799f589 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c67c9d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:03.273127 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c495ef15-79c0-4971-a041-b0d30799f589 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 0.085836 Jul 20 04:26:03.274319 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1822/3599] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:03 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:03.280431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-256a092e-a186-4f49-b91c-9d5c5cc187bd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-887958788"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:03.282031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-256a092e-a186-4f49-b91c-9d5c5cc187bd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:03.289368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-256a092e-a186-4f49-b91c-9d5c5cc187bd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.290165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-256a092e-a186-4f49-b91c-9d5c5cc187bd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.291329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-256a092e-a186-4f49-b91c-9d5c5cc187bd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.292035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-256a092e-a186-4f49-b91c-9d5c5cc187bd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.490592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0b69b0b8-be05-4a9a-b9aa-0c5a3188366e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:03.507828 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0b69b0b8-be05-4a9a-b9aa-0c5a3188366e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 1.078174 Jul 20 04:26:03.510138 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1778/3600] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:02 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:03.525979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2418271-5fbf-4eb5-983f-b33781b50929 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:03.529835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a2418271-5fbf-4eb5-983f-b33781b50929 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] [instance: 600c8c47-0770-4158-ae45-3a47fea37227] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:03.546906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2418271-5fbf-4eb5-983f-b33781b50929 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.547715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2418271-5fbf-4eb5-983f-b33781b50929 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.549042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2418271-5fbf-4eb5-983f-b33781b50929 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.553169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2418271-5fbf-4eb5-983f-b33781b50929 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.588912 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a2418271-5fbf-4eb5-983f-b33781b50929 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] HTTP exception thrown: Instance 600c8c47-0770-4158-ae45-3a47fea37227 could not be found. Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2418271-5fbf-4eb5-983f-b33781b50929 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Request method failure captured: Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 HTTP/1.1 Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Ob5zq3J2x7vBL38TcW7275moOFX840bj0S4TUEX1G6WXdZ0O-anmUU_b-WF4shdTo1igxtN1gAj57U2OlqTjqxgAgkwLSgVggrikkV8lGZn39A0k3GivkLPmUzSc6RTLEm6irU0fLe3hWvThpzfQSSPpvlIx0s1CT_lrInNZVyHDg Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 48603f6325d940eba6da4b98f8e39fdc Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48603f6325d940eba6da4b98f8e39fdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48603f6325d940eba6da4b98f8e39fdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48603f6325d940eba6da4b98f8e39fdc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48603f6325d940eba6da4b98f8e39fdc"}]}] Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 48603f6325d940eba6da4b98f8e39fdc Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 10f231b264ad47d187ac666ec3611d05 Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 600c8c47-0770-4158-ae45-3a47fea37227 could not be found. Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '600c8c47-0770-4158-ae45-3a47fea37227'} Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 600c8c47-0770-4158-ae45-3a47fea37227 could not be found. Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 600c8c47-0770-4158-ae45-3a47fea37227 could not be found. Jul 20 04:26:03.590622 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:03.595110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:03.595110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:03.595110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:03.595110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:03.595110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:03.595110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:03.595110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:03.595110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 600c8c47-0770-4158-ae45-3a47fea37227 could not be found. Jul 20 04:26:03.595110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:03.595110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2418271-5fbf-4eb5-983f-b33781b50929 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] Returning 404 to user: Instance 600c8c47-0770-4158-ae45-3a47fea37227 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:03.595110 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2418271-5fbf-4eb5-983f-b33781b50929 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417 tempest-FloatingIPsAssociationNegativeTestJSON-1382229417-project] 10.222.0.20 "GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227" status: 404 len: 111 microversion: 2.1 time: 0.080610 Jul 20 04:26:03.595110 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1779/3601] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:03 2022] GET /compute/v2.1/servers/600c8c47-0770-4158-ae45-3a47fea37227 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:03.617234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c12783f-52ff-4fe4-a6ca-79e989b91c83 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:03.618265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4c12783f-52ff-4fe4-a6ca-79e989b91c83 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:03.632662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c12783f-52ff-4fe4-a6ca-79e989b91c83 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.634660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c12783f-52ff-4fe4-a6ca-79e989b91c83 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.636847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c12783f-52ff-4fe4-a6ca-79e989b91c83 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.637831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c12783f-52ff-4fe4-a6ca-79e989b91c83 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.785041 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-256a092e-a186-4f49-b91c-9d5c5cc187bd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.509036 Jul 20 04:26:03.803839 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1823/3602] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:03 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 20 04:26:03.818461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5ec801ec-9be7-4381-b79f-17144bcc285d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:03.822287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5ec801ec-9be7-4381-b79f-17144bcc285d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:03.840127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ec801ec-9be7-4381-b79f-17144bcc285d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.841009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ec801ec-9be7-4381-b79f-17144bcc285d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.842406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ec801ec-9be7-4381-b79f-17144bcc285d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.843607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ec801ec-9be7-4381-b79f-17144bcc285d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.905319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:04.048522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4c12783f-52ff-4fe4-a6ca-79e989b91c83 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:04.089170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4c12783f-52ff-4fe4-a6ca-79e989b91c83 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:04.097524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4c12783f-52ff-4fe4-a6ca-79e989b91c83 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:04.102185 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4c12783f-52ff-4fe4-a6ca-79e989b91c83 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1872 microversion: 2.32 time: 0.494917 Jul 20 04:26:04.103690 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1780/3603] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:03 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1872 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:04.110291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c753b6a1-d7c8-4933-afa3-f0ced482fd06 req-9f9becb1-f384-419c-a8f5-fde2b4cf0b64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a345673-f1c9-4573-801a-2f0387cc9513", "tag": "74acd543-9406-46a0-a9e7-8fea4e0f1476"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:04.121821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c753b6a1-d7c8-4933-afa3-f0ced482fd06 req-9f9becb1-f384-419c-a8f5-fde2b4cf0b64 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:04.124273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c753b6a1-d7c8-4933-afa3-f0ced482fd06 req-9f9becb1-f384-419c-a8f5-fde2b4cf0b64 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:04.149203 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c753b6a1-d7c8-4933-afa3-f0ced482fd06 req-9f9becb1-f384-419c-a8f5-fde2b4cf0b64 service nova] Creating event network-changed:74acd543-9406-46a0-a9e7-8fea4e0f1476 for instance 1a345673-f1c9-4573-801a-2f0387cc9513 on n-h2-764485-11 Jul 20 04:26:04.157311 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c753b6a1-d7c8-4933-afa3-f0ced482fd06 req-9f9becb1-f384-419c-a8f5-fde2b4cf0b64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051183 Jul 20 04:26:04.158658 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1781/3604] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:04.205877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1a689a21-d99b-4a52-b77a-3a9d20a2a99b tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:04.206975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1a689a21-d99b-4a52-b77a-3a9d20a2a99b tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:04.215353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a689a21-d99b-4a52-b77a-3a9d20a2a99b tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:04.216426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a689a21-d99b-4a52-b77a-3a9d20a2a99b tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:04.218676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a689a21-d99b-4a52-b77a-3a9d20a2a99b tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:04.219666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a689a21-d99b-4a52-b77a-3a9d20a2a99b tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:04.646088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1a689a21-d99b-4a52-b77a-3a9d20a2a99b tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:04.656292 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1a689a21-d99b-4a52-b77a-3a9d20a2a99b tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1324 microversion: 2.1 time: 0.465222 Jul 20 04:26:04.663730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5ec801ec-9be7-4381-b79f-17144bcc285d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:04.668508 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1782/3605] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:04 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:04.675792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f4372dfb-0fd6-4733-83dc-85f1f2c2395d tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c4e1c10>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:04.680386 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5ec801ec-9be7-4381-b79f-17144bcc285d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1317 microversion: 2.1 time: 0.872798 Jul 20 04:26:04.681173 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1824/3606] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:03 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1317 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:04.691202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a75fcdae-81f7-4881-9f9c-d126ed33bebc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:04.707422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a75fcdae-81f7-4881-9f9c-d126ed33bebc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:04.715244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a75fcdae-81f7-4881-9f9c-d126ed33bebc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:04.716034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a75fcdae-81f7-4881-9f9c-d126ed33bebc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:04.717040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a75fcdae-81f7-4881-9f9c-d126ed33bebc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:04.717641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a75fcdae-81f7-4881-9f9c-d126ed33bebc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:04.771965 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f4372dfb-0fd6-4733-83dc-85f1f2c2395d tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 0.100086 Jul 20 04:26:04.774111 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1783/3607] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:04 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:05.076727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a75fcdae-81f7-4881-9f9c-d126ed33bebc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:05.090052 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a75fcdae-81f7-4881-9f9c-d126ed33bebc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 0.407665 Jul 20 04:26:05.096597 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1825/3608] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:04 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:05.124846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-db5d2c68-ae75-4c10-861f-4364367ad0af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:05.125484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-db5d2c68-ae75-4c10-861f-4364367ad0af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:05.140443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db5d2c68-ae75-4c10-861f-4364367ad0af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:05.148810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db5d2c68-ae75-4c10-861f-4364367ad0af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:05.150185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db5d2c68-ae75-4c10-861f-4364367ad0af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:05.150876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db5d2c68-ae75-4c10-861f-4364367ad0af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:05.293929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-db5d2c68-ae75-4c10-861f-4364367ad0af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:05.304968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-db5d2c68-ae75-4c10-861f-4364367ad0af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:05.313854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-db5d2c68-ae75-4c10-861f-4364367ad0af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:05.315574 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-db5d2c68-ae75-4c10-861f-4364367ad0af tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1872 microversion: 2.32 time: 0.196932 Jul 20 04:26:05.320741 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1784/3609] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:05 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1872 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:05.687542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b5840c2-ff87-404b-a1e2-2a731b3a71c1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:05.688762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b5840c2-ff87-404b-a1e2-2a731b3a71c1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:05.691040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:05.698748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0d3a6af9-1b82-413b-8a34-08741747d50f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:05.700157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0d3a6af9-1b82-413b-8a34-08741747d50f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:05.726666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d3a6af9-1b82-413b-8a34-08741747d50f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:05.730652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d3a6af9-1b82-413b-8a34-08741747d50f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:05.734055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b5840c2-ff87-404b-a1e2-2a731b3a71c1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:05.735459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d3a6af9-1b82-413b-8a34-08741747d50f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:05.741054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d3a6af9-1b82-413b-8a34-08741747d50f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:05.746883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b5840c2-ff87-404b-a1e2-2a731b3a71c1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:05.754846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b5840c2-ff87-404b-a1e2-2a731b3a71c1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:05.759210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b5840c2-ff87-404b-a1e2-2a731b3a71c1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:05.764844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:05.790745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:06.198224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0d3a6af9-1b82-413b-8a34-08741747d50f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:06.207448 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0d3a6af9-1b82-413b-8a34-08741747d50f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1317 microversion: 2.1 time: 0.512851 Jul 20 04:26:06.210875 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1785/3610] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:05 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:06.215825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f4c1f40-902d-4cf1-9065-91d8ceb3e450 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c368ca0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:06.257469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b5840c2-ff87-404b-a1e2-2a731b3a71c1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:06.273381 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b5840c2-ff87-404b-a1e2-2a731b3a71c1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1324 microversion: 2.1 time: 0.591747 Jul 20 04:26:06.283643 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1826/3611] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:05 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1324 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:06.301528 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f4c1f40-902d-4cf1-9065-91d8ceb3e450 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 0.089341 Jul 20 04:26:06.302365 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1786/3612] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:06 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:06.305684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cfacd46e-b5f3-4059-a280-677c4528298f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:06.306314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cfacd46e-b5f3-4059-a280-677c4528298f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:06.321109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-548a8db8-5355-48ea-bc57-50647577c431 req-f60d4a8a-280c-4fd5-9685-b8821526e609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f8d838-800b-4d61-baaf-b3c61a950142", "tag": "8581cbe4-3a4f-40ca-a8ae-af19bb7821ef"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:06.327501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cfacd46e-b5f3-4059-a280-677c4528298f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:06.337947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cfacd46e-b5f3-4059-a280-677c4528298f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:06.340886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cfacd46e-b5f3-4059-a280-677c4528298f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:06.346698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cfacd46e-b5f3-4059-a280-677c4528298f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:06.347553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-548a8db8-5355-48ea-bc57-50647577c431 req-f60d4a8a-280c-4fd5-9685-b8821526e609 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:06.349116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-548a8db8-5355-48ea-bc57-50647577c431 req-f60d4a8a-280c-4fd5-9685-b8821526e609 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:06.374420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:06.379069 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-548a8db8-5355-48ea-bc57-50647577c431 req-f60d4a8a-280c-4fd5-9685-b8821526e609 service nova] Creating event network-changed:8581cbe4-3a4f-40ca-a8ae-af19bb7821ef for instance d4f8d838-800b-4d61-baaf-b3c61a950142 on n-h2-764485-11 Jul 20 04:26:06.387490 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-548a8db8-5355-48ea-bc57-50647577c431 req-f60d4a8a-280c-4fd5-9685-b8821526e609 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082359 Jul 20 04:26:06.389830 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1787/3613] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:06.398537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d92c32b9-6d40-42d8-83b5-7376dd2db7f2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:06.399785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d92c32b9-6d40-42d8-83b5-7376dd2db7f2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:06.410975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d92c32b9-6d40-42d8-83b5-7376dd2db7f2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:06.412042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d92c32b9-6d40-42d8-83b5-7376dd2db7f2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:06.413173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d92c32b9-6d40-42d8-83b5-7376dd2db7f2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:06.413788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d92c32b9-6d40-42d8-83b5-7376dd2db7f2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:06.665179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d92c32b9-6d40-42d8-83b5-7376dd2db7f2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:06.682090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d92c32b9-6d40-42d8-83b5-7376dd2db7f2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:06.688525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d92c32b9-6d40-42d8-83b5-7376dd2db7f2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:06.697438 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d92c32b9-6d40-42d8-83b5-7376dd2db7f2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1872 microversion: 2.32 time: 0.306030 Jul 20 04:26:06.708551 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1788/3614] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:06 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1872 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:07.228945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b8d3b9b2-a1b3-4766-bfd4-7bca70cf374f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:07.229951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b8d3b9b2-a1b3-4766-bfd4-7bca70cf374f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:07.244707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:07.260946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8d3b9b2-a1b3-4766-bfd4-7bca70cf374f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:07.261811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8d3b9b2-a1b3-4766-bfd4-7bca70cf374f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:07.266256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8d3b9b2-a1b3-4766-bfd4-7bca70cf374f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:07.269221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8d3b9b2-a1b3-4766-bfd4-7bca70cf374f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:07.662896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cfacd46e-b5f3-4059-a280-677c4528298f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:07.675458 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cfacd46e-b5f3-4059-a280-677c4528298f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 1.390277 Jul 20 04:26:07.678300 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1827/3615] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:06 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:07.691194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2f4fd430-7f25-4233-b74f-86d1ce9ad2d5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:07.696214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2f4fd430-7f25-4233-b74f-86d1ce9ad2d5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:07.710410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f4fd430-7f25-4233-b74f-86d1ce9ad2d5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:07.711352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f4fd430-7f25-4233-b74f-86d1ce9ad2d5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:07.713257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f4fd430-7f25-4233-b74f-86d1ce9ad2d5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:07.717550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f4fd430-7f25-4233-b74f-86d1ce9ad2d5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:08.273020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b8d3b9b2-a1b3-4766-bfd4-7bca70cf374f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:08.299874 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b8d3b9b2-a1b3-4766-bfd4-7bca70cf374f tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1317 microversion: 2.1 time: 1.072823 Jul 20 04:26:08.300684 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1789/3616] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:07 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1317 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:08.339222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2d33a80a-cbe0-4451-9289-8a13b5225dfb tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c512670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:08.439685 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2d33a80a-cbe0-4451-9289-8a13b5225dfb tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 0.133349 Jul 20 04:26:08.444122 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1790/3617] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:08 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:08.456740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f3d70cbc-e83e-4189-b717-12905b2155c8 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:08.457371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f3d70cbc-e83e-4189-b717-12905b2155c8 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:08.480051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3d70cbc-e83e-4189-b717-12905b2155c8 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:08.486748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3d70cbc-e83e-4189-b717-12905b2155c8 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:08.488174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3d70cbc-e83e-4189-b717-12905b2155c8 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:08.490107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3d70cbc-e83e-4189-b717-12905b2155c8 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:09.151653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f3d70cbc-e83e-4189-b717-12905b2155c8 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:09.162935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f3d70cbc-e83e-4189-b717-12905b2155c8 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:09.175296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f3d70cbc-e83e-4189-b717-12905b2155c8 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:09.176629 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f3d70cbc-e83e-4189-b717-12905b2155c8 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1872 microversion: 2.32 time: 0.725325 Jul 20 04:26:09.187731 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1791/3618] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:08 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1872 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:09.200404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b3c387b4-38d2-421a-8923-a56d0d0a87f1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:09.201606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b3c387b4-38d2-421a-8923-a56d0d0a87f1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:09.216831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3c387b4-38d2-421a-8923-a56d0d0a87f1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:09.217057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3c387b4-38d2-421a-8923-a56d0d0a87f1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:09.217671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3c387b4-38d2-421a-8923-a56d0d0a87f1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:09.218127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3c387b4-38d2-421a-8923-a56d0d0a87f1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:09.636046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f4fd430-7f25-4233-b74f-86d1ce9ad2d5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:09.662747 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2f4fd430-7f25-4233-b74f-86d1ce9ad2d5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1324 microversion: 2.1 time: 1.983192 Jul 20 04:26:09.669067 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1828/3619] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:07 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1324 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:09.707926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-03e6043e-504e-4a12-98c2-f70c7ed2420c tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:09.710855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-03e6043e-504e-4a12-98c2-f70c7ed2420c tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:09.730637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03e6043e-504e-4a12-98c2-f70c7ed2420c tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:09.736000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03e6043e-504e-4a12-98c2-f70c7ed2420c tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:09.745166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03e6043e-504e-4a12-98c2-f70c7ed2420c tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:09.745805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03e6043e-504e-4a12-98c2-f70c7ed2420c tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:10.675697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-03e6043e-504e-4a12-98c2-f70c7ed2420c tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:10.699502 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-03e6043e-504e-4a12-98c2-f70c7ed2420c tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1317 microversion: 2.1 time: 1.025443 Jul 20 04:26:10.702954 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1829/3620] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:09 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1317 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:10.715005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b3c387b4-38d2-421a-8923-a56d0d0a87f1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:10.721772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5adc2b99-8501-4fbc-8a8e-3f192940f5fc tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c5d10d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:10.725758 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b3c387b4-38d2-421a-8923-a56d0d0a87f1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 1.534406 Jul 20 04:26:10.734473 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1792/3621] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:09 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:10.757398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95f1dd22-c0a5-4732-a1e4-d33ddc3d58b2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:10.758233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95f1dd22-c0a5-4732-a1e4-d33ddc3d58b2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:10.786750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95f1dd22-c0a5-4732-a1e4-d33ddc3d58b2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:10.787821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95f1dd22-c0a5-4732-a1e4-d33ddc3d58b2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:10.798877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95f1dd22-c0a5-4732-a1e4-d33ddc3d58b2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:10.800277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95f1dd22-c0a5-4732-a1e4-d33ddc3d58b2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:10.824527 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5adc2b99-8501-4fbc-8a8e-3f192940f5fc tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 0.118151 Jul 20 04:26:10.825032 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1830/3622] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:10 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:10.830837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b9c33377-4a57-408d-992b-304cd9d438fe tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:10.831455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b9c33377-4a57-408d-992b-304cd9d438fe tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:10.843297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9c33377-4a57-408d-992b-304cd9d438fe tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:10.843782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9c33377-4a57-408d-992b-304cd9d438fe tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:10.844573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9c33377-4a57-408d-992b-304cd9d438fe tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:10.850938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9c33377-4a57-408d-992b-304cd9d438fe tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.255954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95f1dd22-c0a5-4732-a1e4-d33ddc3d58b2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:11.285844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95f1dd22-c0a5-4732-a1e4-d33ddc3d58b2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:11.287418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95f1dd22-c0a5-4732-a1e4-d33ddc3d58b2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:11.288732 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95f1dd22-c0a5-4732-a1e4-d33ddc3d58b2 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1872 microversion: 2.32 time: 0.550285 Jul 20 04:26:11.289320 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1793/3623] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:10 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1872 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:11.687402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b9c33377-4a57-408d-992b-304cd9d438fe tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:11.720276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e9ec8bc-09e4-42d6-9b28-0174608195f9 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:11.722140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7e9ec8bc-09e4-42d6-9b28-0174608195f9 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:11.733638 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b9c33377-4a57-408d-992b-304cd9d438fe tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1324 microversion: 2.1 time: 0.903994 Jul 20 04:26:11.735762 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1831/3624] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:10 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1324 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:11.760840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e9ec8bc-09e4-42d6-9b28-0174608195f9 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.761957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e9ec8bc-09e4-42d6-9b28-0174608195f9 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.770547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9087f906-a872-4683-8888-8fc01627cf65 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:11.771428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e9ec8bc-09e4-42d6-9b28-0174608195f9 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.771941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9087f906-a872-4683-8888-8fc01627cf65 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:11.772581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e9ec8bc-09e4-42d6-9b28-0174608195f9 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.794820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9087f906-a872-4683-8888-8fc01627cf65 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.803085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9087f906-a872-4683-8888-8fc01627cf65 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.807291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9087f906-a872-4683-8888-8fc01627cf65 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.810146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9087f906-a872-4683-8888-8fc01627cf65 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:12.361261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9087f906-a872-4683-8888-8fc01627cf65 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:12.370214 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9087f906-a872-4683-8888-8fc01627cf65 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 0.622716 Jul 20 04:26:12.377928 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1832/3625] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:11 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:12.391484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-342863b8-0be1-49cb-8ac6-ac24986203a8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c5c64c0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:12.469240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7e9ec8bc-09e4-42d6-9b28-0174608195f9 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:12.480572 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7e9ec8bc-09e4-42d6-9b28-0174608195f9 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1317 microversion: 2.1 time: 0.765034 Jul 20 04:26:12.481192 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1794/3626] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:11 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1317 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:12.507154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a19c831f-ee0f-4587-bb43-679745f07288 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:12.510073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a19c831f-ee0f-4587-bb43-679745f07288 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:12.533256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a19c831f-ee0f-4587-bb43-679745f07288 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:12.533913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a19c831f-ee0f-4587-bb43-679745f07288 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:12.537242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a19c831f-ee0f-4587-bb43-679745f07288 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:12.537693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a19c831f-ee0f-4587-bb43-679745f07288 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:12.757365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a19c831f-ee0f-4587-bb43-679745f07288 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:12.776785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a19c831f-ee0f-4587-bb43-679745f07288 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:12.782731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a19c831f-ee0f-4587-bb43-679745f07288 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:12.784039 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a19c831f-ee0f-4587-bb43-679745f07288 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1872 microversion: 2.32 time: 0.292853 Jul 20 04:26:12.785575 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1795/3627] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:12 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1872 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:12.795494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ef67ec92-333c-4292-a69d-13aecdb993a1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:12.797042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ef67ec92-333c-4292-a69d-13aecdb993a1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:12.815471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef67ec92-333c-4292-a69d-13aecdb993a1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:12.816366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef67ec92-333c-4292-a69d-13aecdb993a1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:12.818158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef67ec92-333c-4292-a69d-13aecdb993a1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:12.819053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef67ec92-333c-4292-a69d-13aecdb993a1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:13.082970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ef67ec92-333c-4292-a69d-13aecdb993a1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:13.094841 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ef67ec92-333c-4292-a69d-13aecdb993a1 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1324 microversion: 2.1 time: 0.307396 Jul 20 04:26:13.098844 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1796/3628] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:12 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1324 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:13.394958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c195482-c537-4f2c-b98b-16eb7554bd5e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:13.395642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4c195482-c537-4f2c-b98b-16eb7554bd5e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:13.403762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c195482-c537-4f2c-b98b-16eb7554bd5e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:13.405136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c195482-c537-4f2c-b98b-16eb7554bd5e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:13.406468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c195482-c537-4f2c-b98b-16eb7554bd5e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:13.407099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c195482-c537-4f2c-b98b-16eb7554bd5e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:13.516293 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-342863b8-0be1-49cb-8ac6-ac24986203a8 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 1.137015 Jul 20 04:26:13.525039 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1833/3629] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:12 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:13.536181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e256b1e7-8082-4c12-ac1d-cdb66b106a8b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:13.537083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e256b1e7-8082-4c12-ac1d-cdb66b106a8b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:13.546691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e256b1e7-8082-4c12-ac1d-cdb66b106a8b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:13.547434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e256b1e7-8082-4c12-ac1d-cdb66b106a8b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:13.548708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e256b1e7-8082-4c12-ac1d-cdb66b106a8b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:13.549329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e256b1e7-8082-4c12-ac1d-cdb66b106a8b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:13.760983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4c195482-c537-4f2c-b98b-16eb7554bd5e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:13.771209 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4c195482-c537-4f2c-b98b-16eb7554bd5e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 0.380396 Jul 20 04:26:13.771832 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1797/3630] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:13 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:13.781603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c8a86b2d-4ea7-413c-946c-863a838840c1 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Calling method '.version_select at 0x7fbf9c4cc790>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:13.817464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e256b1e7-8082-4c12-ac1d-cdb66b106a8b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:13.831657 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e256b1e7-8082-4c12-ac1d-cdb66b106a8b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1317 microversion: 2.1 time: 0.301215 Jul 20 04:26:13.842315 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1834/3631] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:13 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:13.842315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3cca9f7b-25d8-4be8-a700-0de20162da68 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:13.842586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3cca9f7b-25d8-4be8-a700-0de20162da68 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:13.856704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cca9f7b-25d8-4be8-a700-0de20162da68 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:13.858390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cca9f7b-25d8-4be8-a700-0de20162da68 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:13.860266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cca9f7b-25d8-4be8-a700-0de20162da68 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:13.861338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cca9f7b-25d8-4be8-a700-0de20162da68 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:13.872290 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c8a86b2d-4ea7-413c-946c-863a838840c1 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94" status: 200 len: 637 microversion: 2.1 time: 0.095512 Jul 20 04:26:13.873874 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1798/3632] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:13 2022] GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94 => generated 637 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:13.889308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-985b10ec-6916-4b52-9a88-d32fa22dc6bf tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Action: 'update_all', calling method: .version_select at 0x7fbf9c34c1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:13.999221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-985b10ec-6916-4b52-9a88-d32fa22dc6bf tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:14.028623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-985b10ec-6916-4b52-9a88-d32fa22dc6bf tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for user 020e7cd2fdcb42febd8554c1aafa9734 and project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:14.074701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3cca9f7b-25d8-4be8-a700-0de20162da68 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:14.100662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3cca9f7b-25d8-4be8-a700-0de20162da68 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:14.109500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3cca9f7b-25d8-4be8-a700-0de20162da68 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22189fc24b5342789bde2c421fb2e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a907925a4a4e2ea021a5a033582218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:14.113327 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3cca9f7b-25d8-4be8-a700-0de20162da68 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 200 len: 1872 microversion: 2.32 time: 0.279418 Jul 20 04:26:14.117788 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1835/3633] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:13 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 1872 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:14.129653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0bfd0fcc-f9db-49eb-9599-867b7b642126 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:14.135435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0bfd0fcc-f9db-49eb-9599-867b7b642126 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:14.160156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bfd0fcc-f9db-49eb-9599-867b7b642126 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.162624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bfd0fcc-f9db-49eb-9599-867b7b642126 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.163812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bfd0fcc-f9db-49eb-9599-867b7b642126 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.170994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bfd0fcc-f9db-49eb-9599-867b7b642126 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.566968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0bfd0fcc-f9db-49eb-9599-867b7b642126 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:14.577922 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0bfd0fcc-f9db-49eb-9599-867b7b642126 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1324 microversion: 2.1 time: 0.458656 Jul 20 04:26:14.579903 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1836/3634] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:14 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1324 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:14.585894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-56f704d4-fa38-4348-a751-19a8e4170ca7 req-a0700ad2-3dfa-402a-b5d7-2ba7cead5b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a345673-f1c9-4573-801a-2f0387cc9513", "name": "network-vif-plugged", "status": "completed", "tag": "74acd543-9406-46a0-a9e7-8fea4e0f1476"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:14.602924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-56f704d4-fa38-4348-a751-19a8e4170ca7 req-a0700ad2-3dfa-402a-b5d7-2ba7cead5b8e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.603367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-56f704d4-fa38-4348-a751-19a8e4170ca7 req-a0700ad2-3dfa-402a-b5d7-2ba7cead5b8e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.633744 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-56f704d4-fa38-4348-a751-19a8e4170ca7 req-a0700ad2-3dfa-402a-b5d7-2ba7cead5b8e service nova] Creating event network-vif-plugged:74acd543-9406-46a0-a9e7-8fea4e0f1476 for instance 1a345673-f1c9-4573-801a-2f0387cc9513 on n-h2-764485-11 Jul 20 04:26:14.647730 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-56f704d4-fa38-4348-a751-19a8e4170ca7 req-a0700ad2-3dfa-402a-b5d7-2ba7cead5b8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065754 Jul 20 04:26:14.652527 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1837/3635] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:14.669416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62f855ce-37c4-4e45-9dd3-6e9b65b29e0a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9df800d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:14.751640 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-985b10ec-6916-4b52-9a88-d32fa22dc6bf tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 61 microversion: 2.1 time: 0.866590 Jul 20 04:26:14.752927 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1799/3636] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:26:13 2022] PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 61 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:26:14.763646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-286e9e2c-38ae-465f-8593-e2fd3f0d8cf8 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Calling method '.version_select at 0x7fbf9c44f9d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:14.849655 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-62f855ce-37c4-4e45-9dd3-6e9b65b29e0a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 0.194544 Jul 20 04:26:14.850776 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1838/3637] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:14 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:14.865070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57b3c8b2-bd6a-4f62-aa07-0641aed1be2a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:14.877470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-57b3c8b2-bd6a-4f62-aa07-0641aed1be2a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:14.886877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57b3c8b2-bd6a-4f62-aa07-0641aed1be2a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.888748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57b3c8b2-bd6a-4f62-aa07-0641aed1be2a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.890097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57b3c8b2-bd6a-4f62-aa07-0641aed1be2a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.890827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57b3c8b2-bd6a-4f62-aa07-0641aed1be2a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.075278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-57b3c8b2-bd6a-4f62-aa07-0641aed1be2a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:15.085672 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57b3c8b2-bd6a-4f62-aa07-0641aed1be2a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 0.233573 Jul 20 04:26:15.087260 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1839/3638] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:14 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:15.093072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1fb381b0-efd2-4b44-954f-5b4bbe2ae74b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:15.093981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1fb381b0-efd2-4b44-954f-5b4bbe2ae74b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:15.101044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fb381b0-efd2-4b44-954f-5b4bbe2ae74b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.101963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fb381b0-efd2-4b44-954f-5b4bbe2ae74b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.102591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fb381b0-efd2-4b44-954f-5b4bbe2ae74b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.103859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fb381b0-efd2-4b44-954f-5b4bbe2ae74b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.315470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1fb381b0-efd2-4b44-954f-5b4bbe2ae74b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:15.332302 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1fb381b0-efd2-4b44-954f-5b4bbe2ae74b tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1317 microversion: 2.1 time: 0.242891 Jul 20 04:26:15.333258 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1840/3639] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:15 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:15.347582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-40624e98-3dc7-4ac8-81fe-63f7c99a25ae tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:15.348275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40624e98-3dc7-4ac8-81fe-63f7c99a25ae tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:15.355363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40624e98-3dc7-4ac8-81fe-63f7c99a25ae tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.356117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40624e98-3dc7-4ac8-81fe-63f7c99a25ae tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.357261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40624e98-3dc7-4ac8-81fe-63f7c99a25ae tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.358047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40624e98-3dc7-4ac8-81fe-63f7c99a25ae tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.376607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-40624e98-3dc7-4ac8-81fe-63f7c99a25ae tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] HTTP exception thrown: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-40624e98-3dc7-4ac8-81fe-63f7c99a25ae tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Request method failure captured: Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc HTTP/1.1 Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14I1rNvYnYX1hRjwgoPK3fBWUmnRrRBgaa0vIaMi4Ake2xSkYhfwdJAiyie7i3YWtc7JV5fUUs2TmteQcXkFQJ7_Zfs7TRhRSoFro22b2lklYDO6aVX2qV_rh-H-nJ7-D3Xo6WPSc2SWL1HWB4DK1Tm0IHEvAn0w7_Jksrq4RCK1ipo Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 11a907925a4a4e2ea021a5a033582218 Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TaggedBootDevicesTest-1644088757 Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/11a907925a4a4e2ea021a5a033582218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/11a907925a4a4e2ea021a5a033582218"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_11a907925a4a4e2ea021a5a033582218", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/11a907925a4a4e2ea021a5a033582218"}]}] Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TaggedBootDevicesTest-1644088757 Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 11a907925a4a4e2ea021a5a033582218 Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1644088757 Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TaggedBootDevicesTest-1644088757-project Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 22189fc24b5342789bde2c421fb2e75a Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TaggedBootDevicesTest-1644088757-project Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ad51269a-7007-4586-84a5-29568e9c86dc'} Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:15.378884 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:15.388025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:15.388025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:15.388025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:15.388025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:15.388025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:15.388025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:15.388025 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:15.388025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-40624e98-3dc7-4ac8-81fe-63f7c99a25ae tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Returning 404 to user: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:15.388025 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-40624e98-3dc7-4ac8-81fe-63f7c99a25ae tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 404 len: 111 microversion: 2.32 time: 0.047484 Jul 20 04:26:15.388025 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1841/3640] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:15 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:26:15.394411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-11dd1dd4-c347-4026-a4b5-ac1ccdddd53f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '.version_select at 0x7fbf9df05b80>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:15.431386 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-286e9e2c-38ae-465f-8593-e2fd3f0d8cf8 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "DELETE /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.673629 Jul 20 04:26:15.432574 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1800/3641] 10.222.0.20 () {58 vars in 1295 bytes} [Wed Jul 20 04:26:14 2022] DELETE /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata/os_version => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:15.438021 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-11dd1dd4-c347-4026-a4b5-ac1ccdddd53f tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-507360018" status: 204 len: 0 microversion: 2.32 time: 0.049473 Jul 20 04:26:15.438748 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1842/3642] 10.222.0.20 () {60 vars in 1258 bytes} [Wed Jul 20 04:26:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-507360018 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:26:15.441603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b2529356-d501-4b8e-9c9a-891922aa65d4 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Calling method '.version_select at 0x7fbf9c4c0b80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:15.487033 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b2529356-d501-4b8e-9c9a-891922aa65d4 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 37 microversion: 2.1 time: 0.049651 Jul 20 04:26:15.498785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-08aa7f56-2611-4a7b-8700-d037fa98b339 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Action: 'update_all', calling method: .version_select at 0x7fbf9c4f5ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:15.499720 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1801/3643] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jul 20 04:26:15 2022] GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 37 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:26:15.597782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c839cb00-2fca-4d96-bb9f-f84b4c8e9ed9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:15.599028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c839cb00-2fca-4d96-bb9f-f84b4c8e9ed9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:15.606477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-08aa7f56-2611-4a7b-8700-d037fa98b339 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:15.609901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c839cb00-2fca-4d96-bb9f-f84b4c8e9ed9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.610583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c839cb00-2fca-4d96-bb9f-f84b4c8e9ed9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.611602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c839cb00-2fca-4d96-bb9f-f84b4c8e9ed9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.612244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c839cb00-2fca-4d96-bb9f-f84b4c8e9ed9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.624081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-08aa7f56-2611-4a7b-8700-d037fa98b339 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for user 020e7cd2fdcb42febd8554c1aafa9734 and project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:15.943551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c839cb00-2fca-4d96-bb9f-f84b4c8e9ed9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:15.952166 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c839cb00-2fca-4d96-bb9f-f84b4c8e9ed9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1324 microversion: 2.1 time: 0.359626 Jul 20 04:26:15.952866 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1802/3644] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:15 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1324 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:15.974125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d8677e96-e050-459c-acf8-74d28aa41df2 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c4c0dc0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:16.035810 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d8677e96-e050-459c-acf8-74d28aa41df2 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 0.072802 Jul 20 04:26:16.066577 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1803/3645] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:15 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:16.110774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-77a3e720-d03a-41b3-b253-a146ac9bb1f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:16.111475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-77a3e720-d03a-41b3-b253-a146ac9bb1f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:16.121696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77a3e720-d03a-41b3-b253-a146ac9bb1f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:16.123817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77a3e720-d03a-41b3-b253-a146ac9bb1f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:16.124984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77a3e720-d03a-41b3-b253-a146ac9bb1f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:16.126169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77a3e720-d03a-41b3-b253-a146ac9bb1f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:16.296361 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-08aa7f56-2611-4a7b-8700-d037fa98b339 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 61 microversion: 2.1 time: 0.802157 Jul 20 04:26:16.297194 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1843/3646] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:26:15 2022] PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 61 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:26:16.306197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-822c9093-aa54-49ff-98e9-466c6575e460 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Calling method '.version_select at 0x7fbf9c5643a0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:16.359490 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-822c9093-aa54-49ff-98e9-466c6575e460 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.057093 Jul 20 04:26:16.360756 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1844/3647] 10.222.0.20 () {58 vars in 1289 bytes} [Wed Jul 20 04:26:16 2022] GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata/os_distro => generated 33 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:26:16.376922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cb6a6762-ea32-4093-bb02-25c6fc3e89f4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:16.383332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cb6a6762-ea32-4093-bb02-25c6fc3e89f4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:16.394888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb6a6762-ea32-4093-bb02-25c6fc3e89f4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:16.398613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb6a6762-ea32-4093-bb02-25c6fc3e89f4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:16.399766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb6a6762-ea32-4093-bb02-25c6fc3e89f4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:16.401697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb6a6762-ea32-4093-bb02-25c6fc3e89f4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:16.560512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-77a3e720-d03a-41b3-b253-a146ac9bb1f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:16.574439 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-77a3e720-d03a-41b3-b253-a146ac9bb1f6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1736 microversion: 2.1 time: 0.468267 Jul 20 04:26:16.576870 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1804/3648] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:16 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1736 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:16.582708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d6c4bc29-11cf-420d-a87e-238fb8ae8541 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Action: 'update_all', calling method: .version_select at 0x7fbf9c4e1670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:16.651267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-d6c4bc29-11cf-420d-a87e-238fb8ae8541 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:16.658820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-d6c4bc29-11cf-420d-a87e-238fb8ae8541 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for user 020e7cd2fdcb42febd8554c1aafa9734 and project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:16.815223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cb6a6762-ea32-4093-bb02-25c6fc3e89f4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:16.839539 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cb6a6762-ea32-4093-bb02-25c6fc3e89f4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1317 microversion: 2.1 time: 0.477117 Jul 20 04:26:16.852909 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1845/3649] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:16 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:16.859908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2e8322b2-0787-49d9-bfbe-24d83dbfdce0 req-dbcb7a1a-bc36-471a-95ed-e6bdbb06c992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c037b53b-2303-44d0-bb77-c8fa405473bb", "name": "network-vif-plugged", "status": "completed", "tag": "86571be8-3cd1-44e0-856c-952546489890"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:16.871020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2e8322b2-0787-49d9-bfbe-24d83dbfdce0 req-dbcb7a1a-bc36-471a-95ed-e6bdbb06c992 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:16.874159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2e8322b2-0787-49d9-bfbe-24d83dbfdce0 req-dbcb7a1a-bc36-471a-95ed-e6bdbb06c992 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:16.888944 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2e8322b2-0787-49d9-bfbe-24d83dbfdce0 req-dbcb7a1a-bc36-471a-95ed-e6bdbb06c992 service nova] Creating event network-vif-plugged:86571be8-3cd1-44e0-856c-952546489890 for instance c037b53b-2303-44d0-bb77-c8fa405473bb on n-h2-764485-11 Jul 20 04:26:16.896319 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2e8322b2-0787-49d9-bfbe-24d83dbfdce0 req-dbcb7a1a-bc36-471a-95ed-e6bdbb06c992 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041794 Jul 20 04:26:16.902892 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1846/3650] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:16.981455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a452d5f-f4ec-48be-9549-b0fa1b608e65 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:16.983545 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d6c4bc29-11cf-420d-a87e-238fb8ae8541 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 61 microversion: 2.1 time: 0.405049 Jul 20 04:26:16.987237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3a452d5f-f4ec-48be-9549-b0fa1b608e65 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:16.988930 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1805/3651] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:26:16 2022] PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 61 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:26:16.999156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a452d5f-f4ec-48be-9549-b0fa1b608e65 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:16.999646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a452d5f-f4ec-48be-9549-b0fa1b608e65 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.000500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a452d5f-f4ec-48be-9549-b0fa1b608e65 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:17.001760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a452d5f-f4ec-48be-9549-b0fa1b608e65 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.005162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9107c73d-e12c-4a19-80e1-ef15aeeffc8c tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Calling method '.version_select at 0x7fbf9c52a8b0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:17.066297 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9107c73d-e12c-4a19-80e1-ef15aeeffc8c tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 61 microversion: 2.1 time: 0.070325 Jul 20 04:26:17.074247 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1806/3652] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jul 20 04:26:16 2022] GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 61 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:26:17.081723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6a31ccf3-9b4a-41df-8584-65413ef1408d tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Action: 'update_all', calling method: .version_select at 0x7fbf9c52adc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:17.171696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-6a31ccf3-9b4a-41df-8584-65413ef1408d tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:17.192441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-6a31ccf3-9b4a-41df-8584-65413ef1408d tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for user 020e7cd2fdcb42febd8554c1aafa9734 and project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:17.627664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3a452d5f-f4ec-48be-9549-b0fa1b608e65 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:17.636805 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a452d5f-f4ec-48be-9549-b0fa1b608e65 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1324 microversion: 2.1 time: 0.670515 Jul 20 04:26:17.639578 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1847/3653] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:16 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1324 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:17.659492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c33dabb-4040-4f1f-8405-1998abd0c95e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c4f5820>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:17.774406 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6a31ccf3-9b4a-41df-8584-65413ef1408d tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 61 microversion: 2.1 time: 0.697761 Jul 20 04:26:17.775253 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1807/3654] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:26:17 2022] PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 61 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:26:17.797775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0dcd8efa-f988-4e5d-bd18-d65845daa062 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:17.801637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0dcd8efa-f988-4e5d-bd18-d65845daa062 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:17.844781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0dcd8efa-f988-4e5d-bd18-d65845daa062 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:17.847418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0dcd8efa-f988-4e5d-bd18-d65845daa062 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.850040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0dcd8efa-f988-4e5d-bd18-d65845daa062 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:17.851330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0dcd8efa-f988-4e5d-bd18-d65845daa062 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.880187 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0c33dabb-4040-4f1f-8405-1998abd0c95e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1423 microversion: 2.1 time: 0.236550 Jul 20 04:26:17.882577 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1848/3655] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:17 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1423 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:17.915568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c19f1267-6f16-4286-af56-0b8642802a0d tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Action: 'update_all', calling method: .version_select at 0x7fbf9c5253a0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:18.579077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0dcd8efa-f988-4e5d-bd18-d65845daa062 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:18.593565 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0dcd8efa-f988-4e5d-bd18-d65845daa062 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1716 microversion: 2.1 time: 0.807863 Jul 20 04:26:18.593817 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1808/3656] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:17 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1716 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:18.599053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ea40f2b-4504-480b-92fa-5caebae6eaa4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:18.605357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ea40f2b-4504-480b-92fa-5caebae6eaa4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:18.644242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ea40f2b-4504-480b-92fa-5caebae6eaa4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.645711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ea40f2b-4504-480b-92fa-5caebae6eaa4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.646759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ea40f2b-4504-480b-92fa-5caebae6eaa4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.647392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ea40f2b-4504-480b-92fa-5caebae6eaa4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:19.456685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1ea40f2b-4504-480b-92fa-5caebae6eaa4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:19.465886 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ea40f2b-4504-480b-92fa-5caebae6eaa4 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1317 microversion: 2.1 time: 0.870794 Jul 20 04:26:19.472178 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1809/3657] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:18 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1317 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:19.487604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-720de802-c029-4808-91a6-98f3f329aef3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:19.493620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-720de802-c029-4808-91a6-98f3f329aef3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:19.511721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-720de802-c029-4808-91a6-98f3f329aef3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:19.512299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-720de802-c029-4808-91a6-98f3f329aef3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:19.513182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-720de802-c029-4808-91a6-98f3f329aef3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:19.515456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-720de802-c029-4808-91a6-98f3f329aef3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:20.441142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-720de802-c029-4808-91a6-98f3f329aef3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:20.458014 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-720de802-c029-4808-91a6-98f3f329aef3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 200 len: 1520 microversion: 2.1 time: 0.974974 Jul 20 04:26:20.459033 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1810/3658] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:19 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 1520 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:20.484275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6eb1ff2b-e97a-4bf4-aa2d-902c6980b604 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:20.485118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6eb1ff2b-e97a-4bf4-aa2d-902c6980b604 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:20.521709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6eb1ff2b-e97a-4bf4-aa2d-902c6980b604 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:20.527139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6eb1ff2b-e97a-4bf4-aa2d-902c6980b604 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:20.528481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6eb1ff2b-e97a-4bf4-aa2d-902c6980b604 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:20.529212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6eb1ff2b-e97a-4bf4-aa2d-902c6980b604 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:20.747154 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-6eb1ff2b-e97a-4bf4-aa2d-902c6980b604 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] HTTP exception thrown: Cannot 'detach_volume' instance 45e1887b-7d01-481c-a707-dd7d60a9a97b while it is in vm_state rescued Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6eb1ff2b-e97a-4bf4-aa2d-902c6980b604 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Request method failure captured: Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments/69dca151-a669-420c-839e-da50cf1daf91 HTTP/1.1 Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14LpvtEmNd4QrXIrUEvb-GSk-Q8Zjd0l-zF-kIlevLuoBgLZ_00_u1yvp6j7dRA_htG5kpVqZoVpEsFwn0RHk_cOjeEIbaoK3R2iKcoauuThhWzyvVf6At0QhXQxlwDjTmkqLnzcd5YkB5Z5aPRc9SOgHjbdPHPXD-aflxJrD9yhloY Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ba21f0dfdc04e41a9a30fa3dddf3e90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}] Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a25a4e3b560846ec98b871b954481f09 Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: exception: Cannot 'detach_volume' instance 45e1887b-7d01-481c-a707-dd7d60a9a97b while it is in vm_state rescued Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'server_id': '45e1887b-7d01-481c-a707-dd7d60a9a97b', 'id': '69dca151-a669-420c-839e-da50cf1daf91'} Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45e1887b-7d01-481c-a707-dd7d60a9a97b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 45e1887b-7d01-481c-a707-dd7d60a9a97b while it is in vm_state rescued Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:20.749849 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:20.753997 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:20.753997 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:20.753997 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:20.753997 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:20.753997 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 45e1887b-7d01-481c-a707-dd7d60a9a97b while it is in vm_state rescued Jul 20 04:26:20.753997 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:20.759669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6eb1ff2b-e97a-4bf4-aa2d-902c6980b604 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Returning 409 to user: Cannot 'detach_volume' instance 45e1887b-7d01-481c-a707-dd7d60a9a97b while it is in vm_state rescued {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:20.761066 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6eb1ff2b-e97a-4bf4-aa2d-902c6980b604 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments/69dca151-a669-420c-839e-da50cf1daf91" status: 409 len: 152 microversion: 2.1 time: 0.296828 Jul 20 04:26:20.761888 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1811/3659] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:26:20 2022] DELETE /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments/69dca151-a669-420c-839e-da50cf1daf91 => generated 152 bytes in 298 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:26:20.774735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7955fcc5-3a05-4534-be68-f42ad22d936a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c4e1b80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:22.759296 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7955fcc5-3a05-4534-be68-f42ad22d936a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1432 microversion: 2.1 time: 1.996061 Jul 20 04:26:22.761094 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1812/3660] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:20 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1432 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:22.767180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-c19f1267-6f16-4286-af56-0b8642802a0d tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:22.773095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-94df6f52-047b-43c5-8190-4262f30cad35 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.176"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:22.782306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-94df6f52-047b-43c5-8190-4262f30cad35 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:22.786788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-c19f1267-6f16-4286-af56-0b8642802a0d tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for user 020e7cd2fdcb42febd8554c1aafa9734 and project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:22.804729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94df6f52-047b-43c5-8190-4262f30cad35 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:22.807606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94df6f52-047b-43c5-8190-4262f30cad35 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:22.809524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94df6f52-047b-43c5-8190-4262f30cad35 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:22.814411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94df6f52-047b-43c5-8190-4262f30cad35 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:22.927358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94df6f52-047b-43c5-8190-4262f30cad35 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Acquired lock "refresh_cache-a811c37a-837f-4a64-a696-21879b8df872" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:26:23.522152 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c19f1267-6f16-4286-af56-0b8642802a0d tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 64 microversion: 2.1 time: 5.633672 Jul 20 04:26:23.522993 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1849/3661] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:26:17 2022] PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 64 bytes in 5639 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:26:23.533813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-baf796bb-ca00-4585-999d-0337f779b1f0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:23.534681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-baf796bb-ca00-4585-999d-0337f779b1f0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:23.541577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-baf796bb-ca00-4585-999d-0337f779b1f0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:23.542290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-baf796bb-ca00-4585-999d-0337f779b1f0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:23.543250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-baf796bb-ca00-4585-999d-0337f779b1f0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:23.545351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-baf796bb-ca00-4585-999d-0337f779b1f0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:24.029264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-baf796bb-ca00-4585-999d-0337f779b1f0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:24.031680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:24.042376 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-baf796bb-ca00-4585-999d-0337f779b1f0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1317 microversion: 2.1 time: 0.513571 Jul 20 04:26:24.055835 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1850/3662] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:23 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:24.061477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1518d910-e026-4837-81f6-f67d3a64815f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:24.062810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1518d910-e026-4837-81f6-f67d3a64815f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:24.079927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1518d910-e026-4837-81f6-f67d3a64815f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:24.080422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1518d910-e026-4837-81f6-f67d3a64815f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:24.081329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1518d910-e026-4837-81f6-f67d3a64815f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:24.081783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1518d910-e026-4837-81f6-f67d3a64815f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:24.249418 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1518d910-e026-4837-81f6-f67d3a64815f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/action" status: 202 len: 0 microversion: 2.1 time: 0.191859 Jul 20 04:26:24.250226 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1851/3663] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:24 2022] POST /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:26:24.255644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-73725d50-1834-4651-86a7-3c6b0f06d7bd tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c552700>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:24.306620 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-73725d50-1834-4651-86a7-3c6b0f06d7bd tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 200 len: 1432 microversion: 2.1 time: 0.055078 Jul 20 04:26:24.307220 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1852/3664] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:24 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 1432 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:24.317227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4f088666-8dd4-43c3-9be6-d0148fd6e8eb req-abe78024-330f-44c7-b9ae-fb48512c7e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f8d838-800b-4d61-baaf-b3c61a950142", "name": "network-vif-plugged", "status": "completed", "tag": "8581cbe4-3a4f-40ca-a8ae-af19bb7821ef"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:24.327868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4f088666-8dd4-43c3-9be6-d0148fd6e8eb req-abe78024-330f-44c7-b9ae-fb48512c7e17 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:24.328620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4f088666-8dd4-43c3-9be6-d0148fd6e8eb req-abe78024-330f-44c7-b9ae-fb48512c7e17 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:24.353813 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4f088666-8dd4-43c3-9be6-d0148fd6e8eb req-abe78024-330f-44c7-b9ae-fb48512c7e17 service nova] Creating event network-vif-plugged:8581cbe4-3a4f-40ca-a8ae-af19bb7821ef for instance d4f8d838-800b-4d61-baaf-b3c61a950142 on n-h2-764485-11 Jul 20 04:26:24.360278 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4f088666-8dd4-43c3-9be6-d0148fd6e8eb req-abe78024-330f-44c7-b9ae-fb48512c7e17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051514 Jul 20 04:26:24.361209 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1853/3665] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:24.382603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-26c9b597-3294-42bb-bc73-d95a4671ae3d tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Calling method '.version_select at 0x7fbf9c5cea60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:24.473117 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-26c9b597-3294-42bb-bc73-d95a4671ae3d tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 64 microversion: 2.1 time: 0.110159 Jul 20 04:26:24.474234 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1854/3666] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jul 20 04:26:24 2022] GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 64 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:26:24.481392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-173e8e90-6bca-4730-8b31-a0ca96b781e4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:24.483135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-173e8e90-6bca-4730-8b31-a0ca96b781e4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:24.490108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-173e8e90-6bca-4730-8b31-a0ca96b781e4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:24.490918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-173e8e90-6bca-4730-8b31-a0ca96b781e4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:24.491972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-173e8e90-6bca-4730-8b31-a0ca96b781e4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:24.492728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-173e8e90-6bca-4730-8b31-a0ca96b781e4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:25.296074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-173e8e90-6bca-4730-8b31-a0ca96b781e4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:25.305628 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-173e8e90-6bca-4730-8b31-a0ca96b781e4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1724 microversion: 2.1 time: 0.829762 Jul 20 04:26:25.314567 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1855/3667] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:24 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1724 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:25.320801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec681f60-8fbe-4e75-a8da-b1733339d7a4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:25.325120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ec681f60-8fbe-4e75-a8da-b1733339d7a4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:25.343572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec681f60-8fbe-4e75-a8da-b1733339d7a4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:25.344320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec681f60-8fbe-4e75-a8da-b1733339d7a4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:25.345286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec681f60-8fbe-4e75-a8da-b1733339d7a4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:25.345896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec681f60-8fbe-4e75-a8da-b1733339d7a4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:25.901340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ec681f60-8fbe-4e75-a8da-b1733339d7a4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:25.914800 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ec681f60-8fbe-4e75-a8da-b1733339d7a4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1467 microversion: 2.1 time: 0.597800 Jul 20 04:26:25.915614 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1856/3668] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:25 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1467 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:25.926858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bcf551cd-2649-4f0e-a6a9-37ed376ee617 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:25.929727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bcf551cd-2649-4f0e-a6a9-37ed376ee617 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:25.943088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcf551cd-2649-4f0e-a6a9-37ed376ee617 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:25.943985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcf551cd-2649-4f0e-a6a9-37ed376ee617 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:25.945333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcf551cd-2649-4f0e-a6a9-37ed376ee617 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:25.947162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcf551cd-2649-4f0e-a6a9-37ed376ee617 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:25.978173 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-bcf551cd-2649-4f0e-a6a9-37ed376ee617 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] HTTP exception thrown: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bcf551cd-2649-4f0e-a6a9-37ed376ee617 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Request method failure captured: Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc HTTP/1.1 Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14I1rNvYnYX1hRjwgoPK3fBWUmnRrRBgaa0vIaMi4Ake2xSkYhfwdJAiyie7i3YWtc7JV5fUUs2TmteQcXkFQJ7_Zfs7TRhRSoFro22b2lklYDO6aVX2qV_rh-H-nJ7-D3Xo6WPSc2SWL1HWB4DK1Tm0IHEvAn0w7_Jksrq4RCK1ipo Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 11a907925a4a4e2ea021a5a033582218 Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TaggedBootDevicesTest-1644088757 Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/11a907925a4a4e2ea021a5a033582218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/11a907925a4a4e2ea021a5a033582218"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_11a907925a4a4e2ea021a5a033582218", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/11a907925a4a4e2ea021a5a033582218"}]}] Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TaggedBootDevicesTest-1644088757 Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 11a907925a4a4e2ea021a5a033582218 Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1644088757 Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TaggedBootDevicesTest-1644088757-project Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 22189fc24b5342789bde2c421fb2e75a Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TaggedBootDevicesTest-1644088757-project Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ad51269a-7007-4586-84a5-29568e9c86dc'} Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:25.985018 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:25.991158 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:25.991158 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:25.991158 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:25.991158 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:25.991158 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:25.991158 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:25.991158 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:25.991158 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:25.991158 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:25.991158 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:25.991158 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:25.995347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bcf551cd-2649-4f0e-a6a9-37ed376ee617 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Returning 404 to user: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:25.996469 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bcf551cd-2649-4f0e-a6a9-37ed376ee617 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 404 len: 111 microversion: 2.32 time: 0.076220 Jul 20 04:26:26.000608 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1857/3669] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:26:25 2022] DELETE /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:26:26.015081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e04adfd8-6a46-4005-9887-a49a944b70a1 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Action: 'update_all', calling method: .version_select at 0x7fbf9c6f8040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:26.118628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e04adfd8-6a46-4005-9887-a49a944b70a1 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:26.132793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e04adfd8-6a46-4005-9887-a49a944b70a1 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for user 020e7cd2fdcb42febd8554c1aafa9734 and project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:26.833594 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e04adfd8-6a46-4005-9887-a49a944b70a1 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 61 microversion: 2.1 time: 0.831521 Jul 20 04:26:26.834921 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1858/3670] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:26:26 2022] PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 61 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:26:26.844722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-53811bf2-5db8-4456-9a94-ea4297255b05 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:26.845859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-53811bf2-5db8-4456-9a94-ea4297255b05 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:26.871236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53811bf2-5db8-4456-9a94-ea4297255b05 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:26.873611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53811bf2-5db8-4456-9a94-ea4297255b05 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:26.876823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53811bf2-5db8-4456-9a94-ea4297255b05 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:26.878581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53811bf2-5db8-4456-9a94-ea4297255b05 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:27.218658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=12 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:27.412000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-94df6f52-047b-43c5-8190-4262f30cad35 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Building network info cache for instance {{(pid=119807) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:26:27.507055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-53811bf2-5db8-4456-9a94-ea4297255b05 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:27.518714 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-53811bf2-5db8-4456-9a94-ea4297255b05 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1506 microversion: 2.1 time: 0.681978 Jul 20 04:26:27.524460 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1859/3671] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:26 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:27.542667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-907ad4d4-a51c-4d11-a717-19c9b68322d3 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c536280>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:27.612689 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-907ad4d4-a51c-4d11-a717-19c9b68322d3 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/bd7de922-6028-4caa-9dbc-4c1d87dfda55" status: 200 len: 784 microversion: 2.1 time: 0.073812 Jul 20 04:26:27.613859 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1860/3672] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:27 2022] GET /compute/v2.1/images/bd7de922-6028-4caa-9dbc-4c1d87dfda55 => generated 784 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:27.618582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0818f695-ce1b-418a-a3d4-3914d3f88ab0 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:27.619354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0818f695-ce1b-418a-a3d4-3914d3f88ab0 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] [instance: ad51269a-7007-4586-84a5-29568e9c86dc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:27.628926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0818f695-ce1b-418a-a3d4-3914d3f88ab0 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:27.629664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0818f695-ce1b-418a-a3d4-3914d3f88ab0 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:27.630787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0818f695-ce1b-418a-a3d4-3914d3f88ab0 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:27.633320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0818f695-ce1b-418a-a3d4-3914d3f88ab0 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:27.669553 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-0818f695-ce1b-418a-a3d4-3914d3f88ab0 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] HTTP exception thrown: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0818f695-ce1b-418a-a3d4-3914d3f88ab0 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Request method failure captured: Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc HTTP/1.1 Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14I1rNvYnYX1hRjwgoPK3fBWUmnRrRBgaa0vIaMi4Ake2xSkYhfwdJAiyie7i3YWtc7JV5fUUs2TmteQcXkFQJ7_Zfs7TRhRSoFro22b2lklYDO6aVX2qV_rh-H-nJ7-D3Xo6WPSc2SWL1HWB4DK1Tm0IHEvAn0w7_Jksrq4RCK1ipo Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 11a907925a4a4e2ea021a5a033582218 Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TaggedBootDevicesTest-1644088757 Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/11a907925a4a4e2ea021a5a033582218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/11a907925a4a4e2ea021a5a033582218"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_11a907925a4a4e2ea021a5a033582218", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/11a907925a4a4e2ea021a5a033582218"}]}] Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TaggedBootDevicesTest-1644088757 Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 11a907925a4a4e2ea021a5a033582218 Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1644088757 Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TaggedBootDevicesTest-1644088757-project Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 22189fc24b5342789bde2c421fb2e75a Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TaggedBootDevicesTest-1644088757-project Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ad51269a-7007-4586-84a5-29568e9c86dc'} Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:27.677231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:27.682428 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:27.682428 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:27.682428 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:27.682428 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:27.682428 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:27.682428 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. Jul 20 04:26:27.682428 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:27.688478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0818f695-ce1b-418a-a3d4-3914d3f88ab0 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] Returning 404 to user: Instance ad51269a-7007-4586-84a5-29568e9c86dc could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:27.689598 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0818f695-ce1b-418a-a3d4-3914d3f88ab0 tempest-TaggedBootDevicesTest-1644088757 tempest-TaggedBootDevicesTest-1644088757-project] 10.222.0.20 "GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc" status: 404 len: 111 microversion: 2.32 time: 0.074598 Jul 20 04:26:27.690354 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1861/3673] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:27 2022] GET /compute/v2.1/servers/ad51269a-7007-4586-84a5-29568e9c86dc => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:26:27.702020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df37fca7-4bc3-4bbe-95ef-6698bcd844b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:27.702830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df37fca7-4bc3-4bbe-95ef-6698bcd844b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:27.716836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df37fca7-4bc3-4bbe-95ef-6698bcd844b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:27.720390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df37fca7-4bc3-4bbe-95ef-6698bcd844b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:27.721651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df37fca7-4bc3-4bbe-95ef-6698bcd844b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:27.722263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df37fca7-4bc3-4bbe-95ef-6698bcd844b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:28.592563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df37fca7-4bc3-4bbe-95ef-6698bcd844b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:28.607277 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df37fca7-4bc3-4bbe-95ef-6698bcd844b0 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1724 microversion: 2.1 time: 0.915651 Jul 20 04:26:28.614930 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1862/3674] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:27 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1724 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:28.627311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-d63463d3-62b8-49da-977f-2d5c80de83ad req-7f36a8c4-a1d0-4d73-a421-c534388943cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8bb3a9-3f84-40e4-98f5-df941562cc99", "name": "network-vif-unplugged", "status": "completed", "tag": "373329f2-04a7-4cd4-9161-6e1cf125f9e8"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:28.647959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d63463d3-62b8-49da-977f-2d5c80de83ad req-7f36a8c4-a1d0-4d73-a421-c534388943cb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:28.652797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d63463d3-62b8-49da-977f-2d5c80de83ad req-7f36a8c4-a1d0-4d73-a421-c534388943cb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:28.681108 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-d63463d3-62b8-49da-977f-2d5c80de83ad req-7f36a8c4-a1d0-4d73-a421-c534388943cb service nova] Creating event network-vif-unplugged:373329f2-04a7-4cd4-9161-6e1cf125f9e8 for instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 on n-h2-764485-11 Jul 20 04:26:28.698878 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-d63463d3-62b8-49da-977f-2d5c80de83ad req-7f36a8c4-a1d0-4d73-a421-c534388943cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079860 Jul 20 04:26:28.704720 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1863/3675] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:28.726049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9118d015-b76e-4a1e-b9c7-beac6533dc0a tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Action: 'update', calling method: .version_select at 0x7fbf9c4e0f70>, body: {"meta": {"os_version": "alt"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:28.840986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-9118d015-b76e-4a1e-b9c7-beac6533dc0a tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:28.853535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-9118d015-b76e-4a1e-b9c7-beac6533dc0a tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for user 020e7cd2fdcb42febd8554c1aafa9734 and project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:29.352550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-94df6f52-047b-43c5-8190-4262f30cad35 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Updating instance_info_cache with network_info: [{"id": "80a56e5f-9e4f-4102-aae0-c184e07381df", "address": "fa:16:3e:b1:89:5d", "network": {"id": "0bc47de2-cbfa-49f6-abce-274b01379099", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1948826361-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c64e9245e26f4a27b8ed7115b60efb79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap80a56e5f-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:26:29.371095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=99,nova_cell1:SAVEPOINT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:29.382071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94df6f52-047b-43c5-8190-4262f30cad35 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Releasing lock "refresh_cache-a811c37a-837f-4a64-a696-21879b8df872" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:26:29.383042 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-94df6f52-047b-43c5-8190-4262f30cad35 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "POST /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872/action" status: 202 len: 0 microversion: 2.1 time: 6.620687 Jul 20 04:26:29.383687 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1813/3676] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:22 2022] POST /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872/action => generated 0 bytes in 6622 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:26:29.391879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-7b94e0a2-0096-47bd-95c1-9ff46fc9c6df req-b45053cf-0a9a-40fa-90dd-ca709538338a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a811c37a-837f-4a64-a696-21879b8df872", "tag": "80a56e5f-9e4f-4102-aae0-c184e07381df"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:29.406190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=90 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:29.422256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7b94e0a2-0096-47bd-95c1-9ff46fc9c6df req-b45053cf-0a9a-40fa-90dd-ca709538338a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.425302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7b94e0a2-0096-47bd-95c1-9ff46fc9c6df req-b45053cf-0a9a-40fa-90dd-ca709538338a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:29.451991 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-7b94e0a2-0096-47bd-95c1-9ff46fc9c6df req-b45053cf-0a9a-40fa-90dd-ca709538338a service nova] Creating event network-changed:80a56e5f-9e4f-4102-aae0-c184e07381df for instance a811c37a-837f-4a64-a696-21879b8df872 on n-h1-764485-11 Jul 20 04:26:29.463641 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-7b94e0a2-0096-47bd-95c1-9ff46fc9c6df req-b45053cf-0a9a-40fa-90dd-ca709538338a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077234 Jul 20 04:26:29.469446 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1814/3677] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:29.491364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2ff52f52-8d2e-41e6-8f3b-c8f35c9b8f8e tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:29.492068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2ff52f52-8d2e-41e6-8f3b-c8f35c9b8f8e tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:29.507209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ff52f52-8d2e-41e6-8f3b-c8f35c9b8f8e tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.507729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ff52f52-8d2e-41e6-8f3b-c8f35c9b8f8e tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:29.510731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ff52f52-8d2e-41e6-8f3b-c8f35c9b8f8e tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.511235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ff52f52-8d2e-41e6-8f3b-c8f35c9b8f8e tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:29.590851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2ff52f52-8d2e-41e6-8f3b-c8f35c9b8f8e tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:29.596616 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2ff52f52-8d2e-41e6-8f3b-c8f35c9b8f8e tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142/os-instance-actions/req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67" status: 200 len: 313 microversion: 2.1 time: 0.119495 Jul 20 04:26:29.597802 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1815/3678] 10.222.0.20 () {58 vars in 1418 bytes} [Wed Jul 20 04:26:29 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142/os-instance-actions/req-d17f2393-d244-4a88-9c8b-8c0d0a6cca67 => generated 313 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:29.605995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-61ab8687-9450-4d28-81cf-30dc9df201e5 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:29.629593 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-61ab8687-9450-4d28-81cf-30dc9df201e5 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030409 Jul 20 04:26:29.630249 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1816/3679] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:26:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:29.788178 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9118d015-b76e-4a1e-b9c7-beac6533dc0a tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.079405 Jul 20 04:26:29.788957 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1864/3680] 10.222.0.20 () {60 vars in 1312 bytes} [Wed Jul 20 04:26:28 2022] PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata/os_version => generated 31 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:26:29.801467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.176"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:29.806495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:29.823493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.829209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:29.831296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.832531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:29.926394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Acquired lock "refresh_cache-1a345673-f1c9-4573-801a-2f0387cc9513" {{(pid=119808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:26:29.997588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-668600362", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "9cdacc80-9ca0-43c9-ac06-5dd04d922b8c"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:30.126423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] validate_networks() for [('9cdacc80-9ca0-43c9-ac06-5dd04d922b8c', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:26:32.567283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:26:32.567971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:26:32.568484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:26:32.569096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:26:32.569532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:26:32.601409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:32.602768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:32.609046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:32.609839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:32.675286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Getting quotas for project d582deaa5e004a74896f52dcd144ad78. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:32.690704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Getting quotas for user fbf1033ee8b84c3a89c31b2f44479f8b and project d582deaa5e004a74896f52dcd144ad78. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:32.720911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:26:32.733599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:26:32.843784 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-68bd3c38-9117-4e9f-9848-66177a457f02 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.210914 Jul 20 04:26:32.859759 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1817/3681] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:26:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:26:32.897758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4fa112ab-1e6e-48dd-9adf-24efc2bd8a06 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:32.900184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4fa112ab-1e6e-48dd-9adf-24efc2bd8a06 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:32.909393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fa112ab-1e6e-48dd-9adf-24efc2bd8a06 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:32.910117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fa112ab-1e6e-48dd-9adf-24efc2bd8a06 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:32.911129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fa112ab-1e6e-48dd-9adf-24efc2bd8a06 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:32.911858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fa112ab-1e6e-48dd-9adf-24efc2bd8a06 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:33.048848 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4fa112ab-1e6e-48dd-9adf-24efc2bd8a06 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "POST /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142/action" status: 202 len: 0 microversion: 2.1 time: 0.175860 Jul 20 04:26:33.051851 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1818/3682] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:32 2022] POST /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:26:33.066337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f5febd12-d5a4-42c9-b04e-340e607b5071 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:33.068746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f5febd12-d5a4-42c9-b04e-340e607b5071 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:33.091316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5febd12-d5a4-42c9-b04e-340e607b5071 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:33.093062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5febd12-d5a4-42c9-b04e-340e607b5071 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:33.094361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5febd12-d5a4-42c9-b04e-340e607b5071 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:33.098413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5febd12-d5a4-42c9-b04e-340e607b5071 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:33.936383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f5febd12-d5a4-42c9-b04e-340e607b5071 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:33.959875 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f5febd12-d5a4-42c9-b04e-340e607b5071 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1730 microversion: 2.1 time: 0.906153 Jul 20 04:26:33.960515 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1819/3683] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:33 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1730 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:33.977072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4bed4372-d447-46a8-81ef-dcd523ee1545 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c5efca0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:35.166331 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4bed4372-d447-46a8-81ef-dcd523ee1545 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "DELETE /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 204 len: 0 microversion: 2.1 time: 1.204753 Jul 20 04:26:35.166945 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1820/3684] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:33 2022] DELETE /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 0 bytes in 1206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:35.175289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a5f55b2d-b098-473f-a833-ca3d168f855d tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Calling method '.version_select at 0x7fbf9c37b5e0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:35.279654 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a5f55b2d-b098-473f-a833-ca3d168f855d tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 58 microversion: 2.1 time: 0.108006 Jul 20 04:26:35.285017 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1821/3685] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jul 20 04:26:35 2022] GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 58 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:26:35.286386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ca1b3dbd-2fce-4d8f-8dfb-5988a3f33e3a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:35.287016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ca1b3dbd-2fce-4d8f-8dfb-5988a3f33e3a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:35.294473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ca1b3dbd-2fce-4d8f-8dfb-5988a3f33e3a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:35.294920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ca1b3dbd-2fce-4d8f-8dfb-5988a3f33e3a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:35.295758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ca1b3dbd-2fce-4d8f-8dfb-5988a3f33e3a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:35.296200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ca1b3dbd-2fce-4d8f-8dfb-5988a3f33e3a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:35.504850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ca1b3dbd-2fce-4d8f-8dfb-5988a3f33e3a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:35.525243 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ca1b3dbd-2fce-4d8f-8dfb-5988a3f33e3a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1275 microversion: 2.1 time: 0.241807 Jul 20 04:26:35.527387 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1822/3686] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:35 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1275 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:35.542038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-22a4263a-b75d-46e1-8243-be51da6120f5 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:35.543133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-22a4263a-b75d-46e1-8243-be51da6120f5 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:35.558207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22a4263a-b75d-46e1-8243-be51da6120f5 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:35.561373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22a4263a-b75d-46e1-8243-be51da6120f5 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:35.563689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22a4263a-b75d-46e1-8243-be51da6120f5 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:35.564406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22a4263a-b75d-46e1-8243-be51da6120f5 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:36.051531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-22a4263a-b75d-46e1-8243-be51da6120f5 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:36.061423 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-22a4263a-b75d-46e1-8243-be51da6120f5 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1508 microversion: 2.1 time: 0.532540 Jul 20 04:26:36.079953 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1823/3687] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:35 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1508 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:36.089895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-394bf995-cf26-4af8-8603-513f53fa73dc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:36.090405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-394bf995-cf26-4af8-8603-513f53fa73dc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:36.107939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-394bf995-cf26-4af8-8603-513f53fa73dc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:36.108391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-394bf995-cf26-4af8-8603-513f53fa73dc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:36.109391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-394bf995-cf26-4af8-8603-513f53fa73dc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:36.110001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-394bf995-cf26-4af8-8603-513f53fa73dc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:36.364470 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-394bf995-cf26-4af8-8603-513f53fa73dc tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283123 Jul 20 04:26:36.366374 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1824/3688] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:26:36 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-interface => generated 284 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:36.371458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f87180e9-9e3d-458b-bc59-fe829c3ab45a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c34cc10>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:36.415677 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f87180e9-9e3d-458b-bc59-fe829c3ab45a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] HTTP exception thrown: Image not found. Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f87180e9-9e3d-458b-bc59-fe829c3ab45a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Request method failure captured: Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb HTTP/1.1 Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14O0HrwFUvnERLttPzHhOhBFfkSzUugPnN8SRYjVbAO2NJceWDZlyVS-cc-dVBeZ3ZN1u1BTFzKHSXPvapowC4dHiPe39R30lXutiEU90o8gCeQmh2PV7qAYgSoxNNvhvtyNyeggsx0u3KVBrCS6XmB_NDeXEbGon2jtL63TlYfIVqw Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: dd3d006bc13b41a7aaf83838cef7e2df Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesOneServerTestJSON-1627437150 Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dd3d006bc13b41a7aaf83838cef7e2df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd3d006bc13b41a7aaf83838cef7e2df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dd3d006bc13b41a7aaf83838cef7e2df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd3d006bc13b41a7aaf83838cef7e2df"}]}] Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesOneServerTestJSON-1627437150 Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: dd3d006bc13b41a7aaf83838cef7e2df Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1627437150 Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesOneServerTestJSON-1627437150-project Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a4c1d61479ce41e883c1a4ad2795a230 Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesOneServerTestJSON-1627437150-project Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '5a31be74-f0b1-434d-abb8-1bb53f1b9dfb'} Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5a31be74-f0b1-434d-abb8-1bb53f1b9dfb Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:26:36.418153 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a31be74-f0b1-434d-abb8-1bb53f1b9dfb could not be found. Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:36.423189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f87180e9-9e3d-458b-bc59-fe829c3ab45a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:36.431375 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f87180e9-9e3d-458b-bc59-fe829c3ab45a tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 404 len: 62 microversion: 2.1 time: 0.052160 Jul 20 04:26:36.434968 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1825/3689] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:36 2022] GET /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:26:36.448585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2977eadb-0cce-4211-88a1-7ad83ffefb2a tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Action: 'update_all', calling method: .version_select at 0x7fbf9c5ef310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:36.598807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-2977eadb-0cce-4211-88a1-7ad83ffefb2a tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:36.627963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-2977eadb-0cce-4211-88a1-7ad83ffefb2a tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for user 020e7cd2fdcb42febd8554c1aafa9734 and project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:37.474577 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2977eadb-0cce-4211-88a1-7ad83ffefb2a tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 61 microversion: 2.1 time: 1.038328 Jul 20 04:26:37.479177 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1826/3690] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:26:36 2022] PUT /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 61 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:26:37.480965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3b859b45-6e95-4694-80e5-6d2e437bd46f tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-266208489"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:37.482672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3b859b45-6e95-4694-80e5-6d2e437bd46f tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:37.498023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b859b45-6e95-4694-80e5-6d2e437bd46f tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:37.505070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b859b45-6e95-4694-80e5-6d2e437bd46f tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:37.506161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b859b45-6e95-4694-80e5-6d2e437bd46f tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:37.507270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b859b45-6e95-4694-80e5-6d2e437bd46f tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:37.742188 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.network.neutron [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] re-assign floating IP 172.25.1.176 from instance a811c37a-837f-4a64-a696-21879b8df872 Jul 20 04:26:37.861837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Building network info cache for instance {{(pid=119808) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:26:38.205323 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3b859b45-6e95-4694-80e5-6d2e437bd46f tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "POST /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99/action" status: 202 len: 0 microversion: 2.1 time: 0.728183 Jul 20 04:26:38.206375 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1827/3691] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:37 2022] POST /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99/action => generated 0 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:26:38.214969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-06b038a3-2c51-4ec2-82f8-85719c900584 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:38.224327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-06b038a3-2c51-4ec2-82f8-85719c900584 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:38.242662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06b038a3-2c51-4ec2-82f8-85719c900584 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:38.248117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06b038a3-2c51-4ec2-82f8-85719c900584 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:38.256825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06b038a3-2c51-4ec2-82f8-85719c900584 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:38.259995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06b038a3-2c51-4ec2-82f8-85719c900584 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:38.853719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-06b038a3-2c51-4ec2-82f8-85719c900584 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:38.863392 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-06b038a3-2c51-4ec2-82f8-85719c900584 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1317 microversion: 2.1 time: 0.654628 Jul 20 04:26:38.866349 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1828/3692] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:38 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1317 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:38.876129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e07dc0cd-0e34-4a2d-88f0-78966613048d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:38.879608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=16 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:38.881195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e07dc0cd-0e34-4a2d-88f0-78966613048d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:38.894828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e07dc0cd-0e34-4a2d-88f0-78966613048d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:38.897819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e07dc0cd-0e34-4a2d-88f0-78966613048d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:38.898856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e07dc0cd-0e34-4a2d-88f0-78966613048d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:38.900105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e07dc0cd-0e34-4a2d-88f0-78966613048d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:39.368569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e07dc0cd-0e34-4a2d-88f0-78966613048d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:39.378400 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e07dc0cd-0e34-4a2d-88f0-78966613048d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1506 microversion: 2.1 time: 0.510461 Jul 20 04:26:39.384888 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1829/3693] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:38 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1506 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:39.390221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-7f58d2c8-7d05-4734-83c0-66b40aa0c2a2 req-02290e80-e00e-4739-83d8-a6f1f47e4f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a811c37a-837f-4a64-a696-21879b8df872", "tag": "80a56e5f-9e4f-4102-aae0-c184e07381df"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:39.410581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7f58d2c8-7d05-4734-83c0-66b40aa0c2a2 req-02290e80-e00e-4739-83d8-a6f1f47e4f75 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:39.412544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7f58d2c8-7d05-4734-83c0-66b40aa0c2a2 req-02290e80-e00e-4739-83d8-a6f1f47e4f75 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:39.445608 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-7f58d2c8-7d05-4734-83c0-66b40aa0c2a2 req-02290e80-e00e-4739-83d8-a6f1f47e4f75 service nova] Creating event network-changed:80a56e5f-9e4f-4102-aae0-c184e07381df for instance a811c37a-837f-4a64-a696-21879b8df872 on n-h1-764485-11 Jul 20 04:26:39.468453 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-7f58d2c8-7d05-4734-83c0-66b40aa0c2a2 req-02290e80-e00e-4739-83d8-a6f1f47e4f75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081970 Jul 20 04:26:39.470538 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1830/3694] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:39.495256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d6fc8c07-35d7-438c-8401-3f751cd1a953 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Action: 'create', calling method: .version_select at 0x7fbf9c52aca0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:39.711475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-d6fc8c07-35d7-438c-8401-3f751cd1a953 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:39.722043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-d6fc8c07-35d7-438c-8401-3f751cd1a953 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Getting quotas for user 020e7cd2fdcb42febd8554c1aafa9734 and project 4554dc6d8b6549f0a34670278b6a34da. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:39.819373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:40.536131 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d6fc8c07-35d7-438c-8401-3f751cd1a953 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "POST /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 85 microversion: 2.1 time: 1.046617 Jul 20 04:26:40.537391 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1831/3695] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Jul 20 04:26:39 2022] POST /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 85 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:26:40.545542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-45bcb278-6862-4f0e-9b52-3e43d93c7839 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c5089d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:40.682487 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-45bcb278-6862-4f0e-9b52-3e43d93c7839 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1428 microversion: 2.1 time: 0.143806 Jul 20 04:26:40.683420 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1832/3696] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:40 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1428 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:40.836624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-2561686d-4f46-4a07-91c3-affbd500cef1 req-1e1fdf6f-2e32-4c3e-99e6-c8ed74e31605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e1887b-7d01-481c-a707-dd7d60a9a97b", "tag": "4e249346-af6b-4c8d-98eb-93eec710477c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:40.858061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2561686d-4f46-4a07-91c3-affbd500cef1 req-1e1fdf6f-2e32-4c3e-99e6-c8ed74e31605 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:40.858513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2561686d-4f46-4a07-91c3-affbd500cef1 req-1e1fdf6f-2e32-4c3e-99e6-c8ed74e31605 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:40.879626 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-2561686d-4f46-4a07-91c3-affbd500cef1 req-1e1fdf6f-2e32-4c3e-99e6-c8ed74e31605 service nova] Creating event network-changed:4e249346-af6b-4c8d-98eb-93eec710477c for instance 45e1887b-7d01-481c-a707-dd7d60a9a97b on n-h1-764485-11 Jul 20 04:26:40.888925 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-2561686d-4f46-4a07-91c3-affbd500cef1 req-1e1fdf6f-2e32-4c3e-99e6-c8ed74e31605 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203328 Jul 20 04:26:40.894113 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1833/3697] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:40.907659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-73a4502c-f053-4474-a376-ab3d2bc503d0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '.version_select at 0x7fbf9c508820>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:40.908657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-73a4502c-f053-4474-a376-ab3d2bc503d0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:40.919353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73a4502c-f053-4474-a376-ab3d2bc503d0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:40.922669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73a4502c-f053-4474-a376-ab3d2bc503d0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:40.923683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73a4502c-f053-4474-a376-ab3d2bc503d0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:40.928412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73a4502c-f053-4474-a376-ab3d2bc503d0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:41.017162 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-73a4502c-f053-4474-a376-ab3d2bc503d0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.121362 Jul 20 04:26:41.017692 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1834/3698] 10.222.0.20 () {58 vars in 1295 bytes} [Wed Jul 20 04:26:40 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142/os-instance-actions => generated 611 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:41.026556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-deb80aea-14c0-4865-ba3c-7b1d06e42884 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:41.029539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-deb80aea-14c0-4865-ba3c-7b1d06e42884 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:41.039865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-deb80aea-14c0-4865-ba3c-7b1d06e42884 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:41.040568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-deb80aea-14c0-4865-ba3c-7b1d06e42884 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:41.041504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-deb80aea-14c0-4865-ba3c-7b1d06e42884 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:41.042104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-deb80aea-14c0-4865-ba3c-7b1d06e42884 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:41.637551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Updating instance_info_cache with network_info: [{"id": "80a56e5f-9e4f-4102-aae0-c184e07381df", "address": "fa:16:3e:b1:89:5d", "network": {"id": "0bc47de2-cbfa-49f6-abce-274b01379099", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1948826361-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c64e9245e26f4a27b8ed7115b60efb79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap80a56e5f-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119808) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:26:41.672932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Building network info cache for instance {{(pid=119808) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:26:41.871020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-deb80aea-14c0-4865-ba3c-7b1d06e42884 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:41.881015 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-deb80aea-14c0-4865-ba3c-7b1d06e42884 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1317 microversion: 2.1 time: 0.862221 Jul 20 04:26:41.881627 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1835/3699] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:41 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1317 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:41.903408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7ac772b7-9f52-4fb2-9a18-f996e7855a95 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] Calling method '.version_select at 0x7fbf9c4e1670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:41.982926 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7ac772b7-9f52-4fb2-9a18-f996e7855a95 tempest-ImagesMetadataTestJSON-635516016 tempest-ImagesMetadataTestJSON-635516016-project] 10.222.0.20 "GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata" status: 200 len: 85 microversion: 2.1 time: 0.099847 Jul 20 04:26:41.988057 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1836/3700] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jul 20 04:26:41 2022] GET /compute/v2.1/images/7e6679f3-0983-4928-a2e8-d65d464c5a94/metadata => generated 85 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:26:41.997879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-897fbde2-ffeb-4de9-ad11-48bb62634763 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:41.998765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-897fbde2-ffeb-4de9-ad11-48bb62634763 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:42.019114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-897fbde2-ffeb-4de9-ad11-48bb62634763 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:42.019623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-897fbde2-ffeb-4de9-ad11-48bb62634763 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:42.020420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-897fbde2-ffeb-4de9-ad11-48bb62634763 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:42.025606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-897fbde2-ffeb-4de9-ad11-48bb62634763 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:42.089507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-897fbde2-ffeb-4de9-ad11-48bb62634763 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:26:42.168333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:SELECT=93,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:42.270136 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-897fbde2-ffeb-4de9-ad11-48bb62634763 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 204 len: 0 microversion: 2.1 time: 0.284164 Jul 20 04:26:42.273808 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1837/3701] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:41 2022] DELETE /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:42.288034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-57e94390-ee00-4b61-80fe-98c0829dff4e req-1e213eba-8794-4ea5-aace-145c773561d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a345673-f1c9-4573-801a-2f0387cc9513", "tag": "74acd543-9406-46a0-a9e7-8fea4e0f1476"}, {"name": "network-changed", "server_uuid": "956eebcb-bc8b-45dd-91ea-3a07ce83a20c", "tag": "8412272b-9b7a-4804-b16d-98129e77eb04"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:42.298653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-57e94390-ee00-4b61-80fe-98c0829dff4e req-1e213eba-8794-4ea5-aace-145c773561d4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:42.299111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-57e94390-ee00-4b61-80fe-98c0829dff4e req-1e213eba-8794-4ea5-aace-145c773561d4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:42.313162 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-57e94390-ee00-4b61-80fe-98c0829dff4e req-1e213eba-8794-4ea5-aace-145c773561d4 service nova] Creating event network-changed:74acd543-9406-46a0-a9e7-8fea4e0f1476 for instance 1a345673-f1c9-4573-801a-2f0387cc9513 on n-h2-764485-11 Jul 20 04:26:42.314010 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-57e94390-ee00-4b61-80fe-98c0829dff4e req-1e213eba-8794-4ea5-aace-145c773561d4 service nova] Creating event network-changed:8412272b-9b7a-4804-b16d-98129e77eb04 for instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c on n-h1-764485-11 Jul 20 04:26:42.324488 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-57e94390-ee00-4b61-80fe-98c0829dff4e req-1e213eba-8794-4ea5-aace-145c773561d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051828 Jul 20 04:26:42.332533 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1838/3702] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:42.340990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-daef6b3d-6023-48eb-a597-42304a1b8912 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c4e11f0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:42.523933 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-daef6b3d-6023-48eb-a597-42304a1b8912 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1428 microversion: 2.1 time: 0.189675 Jul 20 04:26:42.529935 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1839/3703] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:42 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1428 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:42.539323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9d082b3a-1d0b-4c1f-b900-51a559c54cf0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:42.540361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9d082b3a-1d0b-4c1f-b900-51a559c54cf0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:42.557911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d082b3a-1d0b-4c1f-b900-51a559c54cf0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:42.558281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d082b3a-1d0b-4c1f-b900-51a559c54cf0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:42.559138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d082b3a-1d0b-4c1f-b900-51a559c54cf0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:42.560302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d082b3a-1d0b-4c1f-b900-51a559c54cf0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:42.650120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:42.977307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9d082b3a-1d0b-4c1f-b900-51a559c54cf0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:42.993198 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9d082b3a-1d0b-4c1f-b900-51a559c54cf0 tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1512 microversion: 2.1 time: 0.467214 Jul 20 04:26:42.994054 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1840/3704] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:42 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:43.000824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-beb20e52-036a-4058-9b35-2f8f439c7ebc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:43.001742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-beb20e52-036a-4058-9b35-2f8f439c7ebc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:43.011030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-beb20e52-036a-4058-9b35-2f8f439c7ebc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:43.011920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-beb20e52-036a-4058-9b35-2f8f439c7ebc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:43.014568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-beb20e52-036a-4058-9b35-2f8f439c7ebc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:43.015829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-beb20e52-036a-4058-9b35-2f8f439c7ebc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:43.523668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Updating instance_info_cache with network_info: [{"id": "74acd543-9406-46a0-a9e7-8fea4e0f1476", "address": "fa:16:3e:1c:e2:de", "network": {"id": "0bc47de2-cbfa-49f6-abce-274b01379099", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1948826361-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c64e9245e26f4a27b8ed7115b60efb79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap74acd543-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119808) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:26:43.551659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Releasing lock "refresh_cache-1a345673-f1c9-4573-801a-2f0387cc9513" {{(pid=119808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:26:43.552778 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a8e4e83a-14ea-40d8-aa13-97246c5c40ce tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "POST /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513/action" status: 202 len: 0 microversion: 2.1 time: 13.762147 Jul 20 04:26:43.552925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-beb20e52-036a-4058-9b35-2f8f439c7ebc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:43.553570 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1865/3705] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:29 2022] POST /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513/action => generated 0 bytes in 13764 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:26:43.558739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-47391a94-b764-4b69-bd8c-4e6929a70aa3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:43.560163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-47391a94-b764-4b69-bd8c-4e6929a70aa3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:43.563962 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-beb20e52-036a-4058-9b35-2f8f439c7ebc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 0.568152 Jul 20 04:26:43.567559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47391a94-b764-4b69-bd8c-4e6929a70aa3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:43.568234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47391a94-b764-4b69-bd8c-4e6929a70aa3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:43.568381 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1841/3706] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:42 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:43.569477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47391a94-b764-4b69-bd8c-4e6929a70aa3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:43.570120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47391a94-b764-4b69-bd8c-4e6929a70aa3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:43.579766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-75830bf5-b0d2-4358-9f06-122fa5825ccb req-35367805-bd32-4a09-9e07-2478948eee66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e1887b-7d01-481c-a707-dd7d60a9a97b", "tag": "4e249346-af6b-4c8d-98eb-93eec710477c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:43.589020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-75830bf5-b0d2-4358-9f06-122fa5825ccb req-35367805-bd32-4a09-9e07-2478948eee66 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:43.589548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-75830bf5-b0d2-4358-9f06-122fa5825ccb req-35367805-bd32-4a09-9e07-2478948eee66 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:43.610320 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-75830bf5-b0d2-4358-9f06-122fa5825ccb req-35367805-bd32-4a09-9e07-2478948eee66 service nova] Creating event network-changed:4e249346-af6b-4c8d-98eb-93eec710477c for instance 45e1887b-7d01-481c-a707-dd7d60a9a97b on n-h1-764485-11 Jul 20 04:26:43.617081 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-75830bf5-b0d2-4358-9f06-122fa5825ccb req-35367805-bd32-4a09-9e07-2478948eee66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045819 Jul 20 04:26:43.622563 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1842/3707] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:43.628381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f63bd3da-dd05-40fd-bf63-626571d42cb0 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c5140d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:43.697438 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f63bd3da-dd05-40fd-bf63-626571d42cb0 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1428 microversion: 2.1 time: 0.073210 Jul 20 04:26:43.698230 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1843/3708] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:43 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:43.716318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f73ee2e4-19e1-4c0e-9dbc-710255fc3275 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.176"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:43.912806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-47391a94-b764-4b69-bd8c-4e6929a70aa3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:43.934070 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-47391a94-b764-4b69-bd8c-4e6929a70aa3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1317 microversion: 2.1 time: 0.379075 Jul 20 04:26:43.934868 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1866/3709] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:43 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:44.017535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5e1d8049-056d-41bb-991f-27509c3408bf tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:44.019956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5e1d8049-056d-41bb-991f-27509c3408bf tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:44.031023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e1d8049-056d-41bb-991f-27509c3408bf tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:44.031719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e1d8049-056d-41bb-991f-27509c3408bf tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.031849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f73ee2e4-19e1-4c0e-9dbc-710255fc3275 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:44.033360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e1d8049-056d-41bb-991f-27509c3408bf tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:44.034906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e1d8049-056d-41bb-991f-27509c3408bf tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.052163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f73ee2e4-19e1-4c0e-9dbc-710255fc3275 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:44.052639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f73ee2e4-19e1-4c0e-9dbc-710255fc3275 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.053448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f73ee2e4-19e1-4c0e-9dbc-710255fc3275 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:44.053899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f73ee2e4-19e1-4c0e-9dbc-710255fc3275 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.406986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5e1d8049-056d-41bb-991f-27509c3408bf tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:44.414678 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5e1d8049-056d-41bb-991f-27509c3408bf tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1512 microversion: 2.1 time: 0.407663 Jul 20 04:26:44.415186 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1867/3710] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:44 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:44.459389 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f73ee2e4-19e1-4c0e-9dbc-710255fc3275 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] HTTP exception thrown: Floating IP 172.25.1.176 is not associated with instance a811c37a-837f-4a64-a696-21879b8df872. Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f73ee2e4-19e1-4c0e-9dbc-710255fc3275 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Request method failure captured: Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872/action HTTP/1.1 Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 49 Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14OvnHBJ6rr2ImBPkaJim190gkRJXA_K7A8F_jSS2pzW9YOwhgeLADG9Nq-Mc0emjoh8TdIx2YRhgZMVU9Tg85zkp_b9PcJCeCYUHIluKZuGxH_u7Wyuu8oOjMFaUTDMygArrW2zauFlVd8aqRg-ivJ8b_mCExWbgDVTZDWPQ7SSmCs Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: c64e9245e26f4a27b8ed7115b60efb79 Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1139550606 Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c64e9245e26f4a27b8ed7115b60efb79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c64e9245e26f4a27b8ed7115b60efb79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c64e9245e26f4a27b8ed7115b60efb79", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c64e9245e26f4a27b8ed7115b60efb79"}]}] Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1139550606 Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: c64e9245e26f4a27b8ed7115b60efb79 Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1139550606 Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-FloatingIPsAssociationTestJSON-1139550606-project Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: b5e47ff480c94e60b9c635a1efd84645 Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1139550606-project Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: {"removeFloatingIp": {"address": "172.25.1.176"}} Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: exception: Floating IP 172.25.1.176 is not associated with instance a811c37a-837f-4a64-a696-21879b8df872. Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a811c37a-837f-4a64-a696-21879b8df872', 'body': {'removeFloatingIp': {'address': '172.25.1.176'}}} Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.176 is not associated with instance a811c37a-837f-4a64-a696-21879b8df872. Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.176 is not associated with instance a811c37a-837f-4a64-a696-21879b8df872. Jul 20 04:26:44.461015 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.465929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f73ee2e4-19e1-4c0e-9dbc-710255fc3275 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Returning 409 to user: Floating IP 172.25.1.176 is not associated with instance a811c37a-837f-4a64-a696-21879b8df872. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:44.465929 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f73ee2e4-19e1-4c0e-9dbc-710255fc3275 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "POST /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872/action" status: 409 len: 146 microversion: 2.1 time: 0.757761 Jul 20 04:26:44.465929 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1844/3711] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:43 2022] POST /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872/action => generated 146 bytes in 767 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:26:44.473873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2011780-a9c1-4f26-80d0-9d6f9a108321 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.176"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:44.566607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-710b7fa6-1cff-4ef5-9a9b-f70d8357f989 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] 10.222.0.20 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.150201 Jul 20 04:26:44.571063 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1868/3712] 10.222.0.20 () {58 vars in 1127 bytes} [Wed Jul 20 04:26:44 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:26:44.577468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2df2f729-c68d-49bf-bb46-f313988037ab tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Calling method '.version_select at 0x7fbf9c539160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:44.598172 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-2df2f729-c68d-49bf-bb46-f313988037ab tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] HTTP exception thrown: Image not found. Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2df2f729-c68d-49bf-bb46-f313988037ab tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Request method failure captured: Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14QEPvYsE67po6z7Np6UO8KfL10Z-_gN7HjP-Xu2V9dhoHAi2WrRL59oQj25ZcbHS9EIPl3RbkRZeEIgfWZSE5fagBRiylKqg082uDWPNh5fe6ofyfdJbuyOzxOFMFc_9fol-3J5rzvzPAysCzr5rVxwQR4aZEOcMClxaIXay9MuRJM Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 18ef47c70944408897872af9a14ea600 Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/18ef47c70944408897872af9a14ea600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ef47c70944408897872af9a14ea600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_18ef47c70944408897872af9a14ea600", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ef47c70944408897872af9a14ea600"}]}] Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 18ef47c70944408897872af9a14ea600 Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesDeleteNegativeTestJSON-727711123-project Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c7b2c846cad349d48ac0ef42717d2249 Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-727711123-project Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: exception: Image not found. Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '-1'} Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.600078 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2df2f729-c68d-49bf-bb46-f313988037ab tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Returning 404 to user: Image not found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2df2f729-c68d-49bf-bb46-f313988037ab tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] 10.222.0.20 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.029236 Jul 20 04:26:44.605284 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1869/3713] 10.222.0.20 () {58 vars in 1133 bytes} [Wed Jul 20 04:26:44 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:26:44.609413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-def383c2-03dc-44b8-a282-da9a48e82751 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:44.609413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-def383c2-03dc-44b8-a282-da9a48e82751 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:44.616125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-def383c2-03dc-44b8-a282-da9a48e82751 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:44.616391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a2011780-a9c1-4f26-80d0-9d6f9a108321 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:44.616582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-def383c2-03dc-44b8-a282-da9a48e82751 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.617548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-def383c2-03dc-44b8-a282-da9a48e82751 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:44.618158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-def383c2-03dc-44b8-a282-da9a48e82751 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.624900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2011780-a9c1-4f26-80d0-9d6f9a108321 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:44.625360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2011780-a9c1-4f26-80d0-9d6f9a108321 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.626142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2011780-a9c1-4f26-80d0-9d6f9a108321 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:44.626583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2011780-a9c1-4f26-80d0-9d6f9a108321 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.836812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-def383c2-03dc-44b8-a282-da9a48e82751 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:44.847084 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-def383c2-03dc-44b8-a282-da9a48e82751 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 0.243538 Jul 20 04:26:44.847877 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1870/3714] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:44 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:44.852106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9d9f204a-dd87-4821-8d50-0a23a71bc9ec tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Calling method '.version_select at 0x7fbf9c499040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:44.889153 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-9d9f204a-dd87-4821-8d50-0a23a71bc9ec tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] HTTP exception thrown: Image not found. Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9d9f204a-dd87-4821-8d50-0a23a71bc9ec tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Request method failure captured: Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/images/f0307a28-8d77-4e06-bbec-84ddefd815bj HTTP/1.1 Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14QEPvYsE67po6z7Np6UO8KfL10Z-_gN7HjP-Xu2V9dhoHAi2WrRL59oQj25ZcbHS9EIPl3RbkRZeEIgfWZSE5fagBRiylKqg082uDWPNh5fe6ofyfdJbuyOzxOFMFc_9fol-3J5rzvzPAysCzr5rVxwQR4aZEOcMClxaIXay9MuRJM Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 18ef47c70944408897872af9a14ea600 Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/18ef47c70944408897872af9a14ea600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ef47c70944408897872af9a14ea600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_18ef47c70944408897872af9a14ea600", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ef47c70944408897872af9a14ea600"}]}] Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 18ef47c70944408897872af9a14ea600 Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesDeleteNegativeTestJSON-727711123-project Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c7b2c846cad349d48ac0ef42717d2249 Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-727711123-project Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: exception: Image not found. Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'f0307a28-8d77-4e06-bbec-84ddefd815bj'} Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f0307a28-8d77-4e06-bbec-84ddefd815bj to delete Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f0307a28-8d77-4e06-bbec-84ddefd815bj could not be found. Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:44.891943 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:26:44.897163 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.900501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9d9f204a-dd87-4821-8d50-0a23a71bc9ec tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Returning 404 to user: Image not found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:44.901525 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9d9f204a-dd87-4821-8d50-0a23a71bc9ec tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] 10.222.0.20 "DELETE /compute/v2.1/images/f0307a28-8d77-4e06-bbec-84ddefd815bj" status: 404 len: 62 microversion: 2.1 time: 0.052921 Jul 20 04:26:44.902251 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1871/3715] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:44 2022] DELETE /compute/v2.1/images/f0307a28-8d77-4e06-bbec-84ddefd815bj => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:26:44.911334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-68a09123-9892-4a7a-b0b0-d0cbfa914e0d tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c4f5550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:44.923221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2011780-a9c1-4f26-80d0-9d6f9a108321 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Acquired lock "refresh_cache-1a345673-f1c9-4573-801a-2f0387cc9513" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:26:44.962379 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-68a09123-9892-4a7a-b0b0-d0cbfa914e0d tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1428 microversion: 2.1 time: 0.058189 Jul 20 04:26:44.963934 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1872/3716] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:44 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1428 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:44.972524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2b2c65c-41ad-4ee2-b4a2-35091a602336 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Calling method '.version_select at 0x7fbf9c4f58b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:44.993514 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f2b2c65c-41ad-4ee2-b4a2-35091a602336 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] HTTP exception thrown: Image not found. Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2b2c65c-41ad-4ee2-b4a2-35091a602336 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Request method failure captured: Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/images/e63dac93-15ef-4239-8677-001dc5306e061 HTTP/1.1 Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14QEPvYsE67po6z7Np6UO8KfL10Z-_gN7HjP-Xu2V9dhoHAi2WrRL59oQj25ZcbHS9EIPl3RbkRZeEIgfWZSE5fagBRiylKqg082uDWPNh5fe6ofyfdJbuyOzxOFMFc_9fol-3J5rzvzPAysCzr5rVxwQR4aZEOcMClxaIXay9MuRJM Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 18ef47c70944408897872af9a14ea600 Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/18ef47c70944408897872af9a14ea600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ef47c70944408897872af9a14ea600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_18ef47c70944408897872af9a14ea600", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ef47c70944408897872af9a14ea600"}]}] Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 18ef47c70944408897872af9a14ea600 Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesDeleteNegativeTestJSON-727711123-project Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c7b2c846cad349d48ac0ef42717d2249 Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-727711123-project Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: exception: Image not found. Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'e63dac93-15ef-4239-8677-001dc5306e061'} Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e63dac93-15ef-4239-8677-001dc5306e061 to delete Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e63dac93-15ef-4239-8677-001dc5306e061 could not be found. Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:44.995340 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:45.001127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2b2c65c-41ad-4ee2-b4a2-35091a602336 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Returning 404 to user: Image not found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:45.002970 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f2b2c65c-41ad-4ee2-b4a2-35091a602336 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] 10.222.0.20 "DELETE /compute/v2.1/images/e63dac93-15ef-4239-8677-001dc5306e061" status: 404 len: 62 microversion: 2.1 time: 0.034456 Jul 20 04:26:45.008937 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1873/3717] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:44 2022] DELETE /compute/v2.1/images/e63dac93-15ef-4239-8677-001dc5306e061 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:26:45.014429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-894975f4-3b5f-4783-8692-9493812f8b54 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:45.015055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-894975f4-3b5f-4783-8692-9493812f8b54 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:45.025869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-894975f4-3b5f-4783-8692-9493812f8b54 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:45.027791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-894975f4-3b5f-4783-8692-9493812f8b54 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:45.028568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-894975f4-3b5f-4783-8692-9493812f8b54 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:45.029333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-894975f4-3b5f-4783-8692-9493812f8b54 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:45.596031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-894975f4-3b5f-4783-8692-9493812f8b54 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:45.605352 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-894975f4-3b5f-4783-8692-9493812f8b54 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1317 microversion: 2.1 time: 0.594536 Jul 20 04:26:45.606615 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1874/3718] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:45 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:45.612978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd02b201-b8f4-4503-b97d-09e670dbaf32 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Calling method '.version_select at 0x7fbf9c5649d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:45.637008 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-dd02b201-b8f4-4503-b97d-09e670dbaf32 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] HTTP exception thrown: Image not found. Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd02b201-b8f4-4503-b97d-09e670dbaf32 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Request method failure captured: Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/images/tempest-invalid-1890834882 HTTP/1.1 Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14QEPvYsE67po6z7Np6UO8KfL10Z-_gN7HjP-Xu2V9dhoHAi2WrRL59oQj25ZcbHS9EIPl3RbkRZeEIgfWZSE5fagBRiylKqg082uDWPNh5fe6ofyfdJbuyOzxOFMFc_9fol-3J5rzvzPAysCzr5rVxwQR4aZEOcMClxaIXay9MuRJM Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 18ef47c70944408897872af9a14ea600 Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/18ef47c70944408897872af9a14ea600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ef47c70944408897872af9a14ea600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_18ef47c70944408897872af9a14ea600", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ef47c70944408897872af9a14ea600"}]}] Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 18ef47c70944408897872af9a14ea600 Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesDeleteNegativeTestJSON-727711123-project Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c7b2c846cad349d48ac0ef42717d2249 Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-727711123-project Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: exception: Image not found. Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'tempest-invalid-1890834882'} Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1890834882 to delete Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1890834882 could not be found. Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:45.640362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:26:45.644703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:45.647774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd02b201-b8f4-4503-b97d-09e670dbaf32 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Returning 404 to user: Image not found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:45.649060 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dd02b201-b8f4-4503-b97d-09e670dbaf32 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] 10.222.0.20 "DELETE /compute/v2.1/images/tempest-invalid-1890834882" status: 404 len: 62 microversion: 2.1 time: 0.040697 Jul 20 04:26:45.649857 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1875/3719] 10.222.0.20 () {58 vars in 1205 bytes} [Wed Jul 20 04:26:45 2022] DELETE /compute/v2.1/images/tempest-invalid-1890834882 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:26:45.656760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7b98625b-1fa0-4885-abd9-07dca924184a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:45.657694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7b98625b-1fa0-4885-abd9-07dca924184a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:45.667783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b98625b-1fa0-4885-abd9-07dca924184a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:45.668588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b98625b-1fa0-4885-abd9-07dca924184a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:45.669692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b98625b-1fa0-4885-abd9-07dca924184a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:45.670874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b98625b-1fa0-4885-abd9-07dca924184a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:46.193128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7b98625b-1fa0-4885-abd9-07dca924184a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e9eee3baa4aa1b7f40f9bbf7b5fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ccc7dacc04e47a05400c8f552bc6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:46.204482 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7b98625b-1fa0-4885-abd9-07dca924184a tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 200 len: 1512 microversion: 2.1 time: 0.553257 Jul 20 04:26:46.205331 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1876/3720] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:45 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 1512 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:46.210243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-165abf11-2d95-4ea6-a059-d5a384e95de7 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Calling method '.version_select at 0x7fbf9c5d18b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:46.234169 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-165abf11-2d95-4ea6-a059-d5a384e95de7 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] HTTP exception thrown: Image not found. Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-165abf11-2d95-4ea6-a059-d5a384e95de7 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Request method failure captured: Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/images/47b27912-55a5-4ecc-92f3-5a71ffe445b9 HTTP/1.1 Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14QEPvYsE67po6z7Np6UO8KfL10Z-_gN7HjP-Xu2V9dhoHAi2WrRL59oQj25ZcbHS9EIPl3RbkRZeEIgfWZSE5fagBRiylKqg082uDWPNh5fe6ofyfdJbuyOzxOFMFc_9fol-3J5rzvzPAysCzr5rVxwQR4aZEOcMClxaIXay9MuRJM Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 18ef47c70944408897872af9a14ea600 Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/18ef47c70944408897872af9a14ea600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ef47c70944408897872af9a14ea600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_18ef47c70944408897872af9a14ea600", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ef47c70944408897872af9a14ea600"}]}] Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 18ef47c70944408897872af9a14ea600 Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-727711123 Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesDeleteNegativeTestJSON-727711123-project Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c7b2c846cad349d48ac0ef42717d2249 Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-727711123-project Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: exception: Image not found. Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '47b27912-55a5-4ecc-92f3-5a71ffe445b9'} Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 47b27912-55a5-4ecc-92f3-5a71ffe445b9 to delete Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 47b27912-55a5-4ecc-92f3-5a71ffe445b9 could not be found. Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:46.236583 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:26:46.241581 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:46.244315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-165abf11-2d95-4ea6-a059-d5a384e95de7 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] Returning 404 to user: Image not found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:46.245809 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-165abf11-2d95-4ea6-a059-d5a384e95de7 tempest-ImagesDeleteNegativeTestJSON-727711123 tempest-ImagesDeleteNegativeTestJSON-727711123-project] 10.222.0.20 "DELETE /compute/v2.1/images/47b27912-55a5-4ecc-92f3-5a71ffe445b9" status: 404 len: 62 microversion: 2.1 time: 0.039375 Jul 20 04:26:46.252710 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1877/3721] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:46 2022] DELETE /compute/v2.1/images/47b27912-55a5-4ecc-92f3-5a71ffe445b9 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:26:46.258346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b7b2863-3f7a-4003-80f4-2eb79e680893 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:46.259185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b7b2863-3f7a-4003-80f4-2eb79e680893 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:46.268657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b7b2863-3f7a-4003-80f4-2eb79e680893 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:46.269380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b7b2863-3f7a-4003-80f4-2eb79e680893 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:46.270325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b7b2863-3f7a-4003-80f4-2eb79e680893 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:46.270962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b7b2863-3f7a-4003-80f4-2eb79e680893 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:47.126852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b7b2863-3f7a-4003-80f4-2eb79e680893 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:47.130278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:47.136721 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b7b2863-3f7a-4003-80f4-2eb79e680893 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.882651 Jul 20 04:26:47.148597 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1878/3722] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:46 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:47.156727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2e1137c1-cd0f-4077-ba24-30be6b1a355f tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c5d18b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:47.203682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-a2011780-a9c1-4f26-80d0-9d6f9a108321 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Building network info cache for instance {{(pid=119807) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:26:47.233034 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2e1137c1-cd0f-4077-ba24-30be6b1a355f tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1428 microversion: 2.1 time: 0.082980 Jul 20 04:26:47.235294 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1879/3723] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:47 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:47.246266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-304340aa-a542-4448-970e-8f56c47aa427 req-576f1d20-f914-42b1-b5ae-26d85e6e36ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8bb3a9-3f84-40e4-98f5-df941562cc99", "name": "network-vif-plugged", "status": "completed", "tag": "373329f2-04a7-4cd4-9161-6e1cf125f9e8"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:47.270417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-304340aa-a542-4448-970e-8f56c47aa427 req-576f1d20-f914-42b1-b5ae-26d85e6e36ff service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:47.271275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-304340aa-a542-4448-970e-8f56c47aa427 req-576f1d20-f914-42b1-b5ae-26d85e6e36ff service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:47.288066 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-304340aa-a542-4448-970e-8f56c47aa427 req-576f1d20-f914-42b1-b5ae-26d85e6e36ff service nova] Creating event network-vif-plugged:373329f2-04a7-4cd4-9161-6e1cf125f9e8 for instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 on n-h2-764485-11 Jul 20 04:26:47.317848 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-304340aa-a542-4448-970e-8f56c47aa427 req-576f1d20-f914-42b1-b5ae-26d85e6e36ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080257 Jul 20 04:26:47.318877 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1880/3724] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:47.325312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-11a6e70e-f54d-4268-b293-f65fd1cecb0b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:47.326347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-11a6e70e-f54d-4268-b293-f65fd1cecb0b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:47.341499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11a6e70e-f54d-4268-b293-f65fd1cecb0b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:47.344033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11a6e70e-f54d-4268-b293-f65fd1cecb0b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:47.345805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11a6e70e-f54d-4268-b293-f65fd1cecb0b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:47.346710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11a6e70e-f54d-4268-b293-f65fd1cecb0b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.023547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-11a6e70e-f54d-4268-b293-f65fd1cecb0b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:48.034995 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-11a6e70e-f54d-4268-b293-f65fd1cecb0b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1317 microversion: 2.1 time: 0.714669 Jul 20 04:26:48.047169 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1881/3725] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:47 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1317 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:48.052796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9ee4786e-5b00-416f-a76f-626315c3b9b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1281101272"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:48.055714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9ee4786e-5b00-416f-a76f-626315c3b9b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:48.099376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ee4786e-5b00-416f-a76f-626315c3b9b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.100373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ee4786e-5b00-416f-a76f-626315c3b9b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.101832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ee4786e-5b00-416f-a76f-626315c3b9b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.106112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9ee4786e-5b00-416f-a76f-626315c3b9b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.652219 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9ee4786e-5b00-416f-a76f-626315c3b9b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.603121 Jul 20 04:26:48.658449 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1882/3726] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:48 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 20 04:26:48.670979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3867e463-5cd7-45e0-96b3-d1e76e1f587d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:48.674097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3867e463-5cd7-45e0-96b3-d1e76e1f587d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] [instance: d4f8d838-800b-4d61-baaf-b3c61a950142] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:48.689118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3867e463-5cd7-45e0-96b3-d1e76e1f587d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.690055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3867e463-5cd7-45e0-96b3-d1e76e1f587d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.691164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3867e463-5cd7-45e0-96b3-d1e76e1f587d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.693265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3867e463-5cd7-45e0-96b3-d1e76e1f587d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.713785 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-3867e463-5cd7-45e0-96b3-d1e76e1f587d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] HTTP exception thrown: Instance d4f8d838-800b-4d61-baaf-b3c61a950142 could not be found. Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3867e463-5cd7-45e0-96b3-d1e76e1f587d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Request method failure captured: Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 HTTP/1.1 Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14PQ3OyWDY1aML3XNFpIzLmi-dEv03Z9m8g6XuQy3KPmf93p8_Yj43xCPcmCmskAT-dM2X6SOP5DtOuIIEvmsJ-hAYRimM-H68TXP3j7AlkFUdl_2wm_ynbM_saxGvRsvbciRF_7q9k11-MrnbrZK2m67uM2pieDko1I98Y0BDNCxK0 Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 5f8ccc7dacc04e47a05400c8f552bc6b Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-InstanceActionsTestJSON-688605501 Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f8ccc7dacc04e47a05400c8f552bc6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f8ccc7dacc04e47a05400c8f552bc6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f8ccc7dacc04e47a05400c8f552bc6b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f8ccc7dacc04e47a05400c8f552bc6b"}]}] Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-InstanceActionsTestJSON-688605501 Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 5f8ccc7dacc04e47a05400c8f552bc6b Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-InstanceActionsTestJSON-688605501 Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-InstanceActionsTestJSON-688605501-project Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c24e9eee3baa4aa1b7f40f9bbf7b5fcc Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-InstanceActionsTestJSON-688605501-project Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance d4f8d838-800b-4d61-baaf-b3c61a950142 could not be found. Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'd4f8d838-800b-4d61-baaf-b3c61a950142'} Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f8d838-800b-4d61-baaf-b3c61a950142 could not be found. Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f8d838-800b-4d61-baaf-b3c61a950142 could not be found. Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:48.716898 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:48.722824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:48.722824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:48.722824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:48.722824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:48.722824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:48.722824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f8d838-800b-4d61-baaf-b3c61a950142 could not be found. Jul 20 04:26:48.722824 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:26:48.726213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3867e463-5cd7-45e0-96b3-d1e76e1f587d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] Returning 404 to user: Instance d4f8d838-800b-4d61-baaf-b3c61a950142 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:48.727771 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3867e463-5cd7-45e0-96b3-d1e76e1f587d tempest-InstanceActionsTestJSON-688605501 tempest-InstanceActionsTestJSON-688605501-project] 10.222.0.20 "GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142" status: 404 len: 111 microversion: 2.1 time: 0.069450 Jul 20 04:26:48.729340 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1883/3727] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:48 2022] GET /compute/v2.1/servers/d4f8d838-800b-4d61-baaf-b3c61a950142 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:48.742457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6e6f0f0b-8617-4c03-8229-26af91c2bd7d req-673353f7-763f-4f69-9d19-7b8264a93570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a345673-f1c9-4573-801a-2f0387cc9513", "tag": "74acd543-9406-46a0-a9e7-8fea4e0f1476"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:48.764475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6e6f0f0b-8617-4c03-8229-26af91c2bd7d req-673353f7-763f-4f69-9d19-7b8264a93570 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.769946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6e6f0f0b-8617-4c03-8229-26af91c2bd7d req-673353f7-763f-4f69-9d19-7b8264a93570 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.795788 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6e6f0f0b-8617-4c03-8229-26af91c2bd7d req-673353f7-763f-4f69-9d19-7b8264a93570 service nova] Creating event network-changed:74acd543-9406-46a0-a9e7-8fea4e0f1476 for instance 1a345673-f1c9-4573-801a-2f0387cc9513 on n-h2-764485-11 Jul 20 04:26:48.801930 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6e6f0f0b-8617-4c03-8229-26af91c2bd7d req-673353f7-763f-4f69-9d19-7b8264a93570 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071004 Jul 20 04:26:48.803180 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1884/3728] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:48.811258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8440d6fe-ce1e-4570-9732-2ed4728aba06 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c489820>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:48.945476 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8440d6fe-ce1e-4570-9732-2ed4728aba06 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1428 microversion: 2.1 time: 0.140821 Jul 20 04:26:48.946608 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1885/3729] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:48 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1428 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:49.058188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4e165d57-aa9f-4437-ba67-eaee3af850c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:49.059320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-a2011780-a9c1-4f26-80d0-9d6f9a108321 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Updating instance_info_cache with network_info: [{"id": "74acd543-9406-46a0-a9e7-8fea4e0f1476", "address": "fa:16:3e:1c:e2:de", "network": {"id": "0bc47de2-cbfa-49f6-abce-274b01379099", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1948826361-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c64e9245e26f4a27b8ed7115b60efb79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap74acd543-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:26:49.064150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4e165d57-aa9f-4437-ba67-eaee3af850c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:49.080931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e165d57-aa9f-4437-ba67-eaee3af850c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.082377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e165d57-aa9f-4437-ba67-eaee3af850c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.084701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e165d57-aa9f-4437-ba67-eaee3af850c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.086433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e165d57-aa9f-4437-ba67-eaee3af850c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.091822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2011780-a9c1-4f26-80d0-9d6f9a108321 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Releasing lock "refresh_cache-1a345673-f1c9-4573-801a-2f0387cc9513" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:26:49.096070 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2011780-a9c1-4f26-80d0-9d6f9a108321 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "POST /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513/action" status: 202 len: 0 microversion: 2.1 time: 4.624766 Jul 20 04:26:49.103400 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1845/3730] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:44 2022] POST /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513/action => generated 0 bytes in 4634 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 20 04:26:49.129229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-75fa90a2-7355-4803-9167-8562fd386bf6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:49.132384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-75fa90a2-7355-4803-9167-8562fd386bf6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:49.174094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75fa90a2-7355-4803-9167-8562fd386bf6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.174576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75fa90a2-7355-4803-9167-8562fd386bf6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.175385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75fa90a2-7355-4803-9167-8562fd386bf6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.175869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75fa90a2-7355-4803-9167-8562fd386bf6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.250377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-75fa90a2-7355-4803-9167-8562fd386bf6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:26:49.414768 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-75fa90a2-7355-4803-9167-8562fd386bf6 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 204 len: 0 microversion: 2.1 time: 0.303745 Jul 20 04:26:49.415933 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1846/3731] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:49 2022] DELETE /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:49.430829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d49f9627-dba7-4244-adfd-481a300d5913 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.176"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:49.432491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d49f9627-dba7-4244-adfd-481a300d5913 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:49.462503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d49f9627-dba7-4244-adfd-481a300d5913 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.463441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d49f9627-dba7-4244-adfd-481a300d5913 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.469036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d49f9627-dba7-4244-adfd-481a300d5913 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.469036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d49f9627-dba7-4244-adfd-481a300d5913 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.550486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d49f9627-dba7-4244-adfd-481a300d5913 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Acquired lock "refresh_cache-a811c37a-837f-4a64-a696-21879b8df872" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:26:49.564290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4e165d57-aa9f-4437-ba67-eaee3af850c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:49.578013 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4e165d57-aa9f-4437-ba67-eaee3af850c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1317 microversion: 2.1 time: 0.529698 Jul 20 04:26:49.578839 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1886/3732] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:49 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:49.597862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-87fb3019-25b8-429a-b4ad-0ab3286d60ac req-9b04c439-d784-45aa-b421-cbaf583afc55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956eebcb-bc8b-45dd-91ea-3a07ce83a20c", "name": "network-vif-plugged", "status": "completed", "tag": "8412272b-9b7a-4804-b16d-98129e77eb04"}, {"server_uuid": "c037b53b-2303-44d0-bb77-c8fa405473bb", "name": "network-vif-unplugged", "status": "completed", "tag": "86571be8-3cd1-44e0-856c-952546489890"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:49.625707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-87fb3019-25b8-429a-b4ad-0ab3286d60ac req-9b04c439-d784-45aa-b421-cbaf583afc55 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.627973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-87fb3019-25b8-429a-b4ad-0ab3286d60ac req-9b04c439-d784-45aa-b421-cbaf583afc55 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.661629 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-87fb3019-25b8-429a-b4ad-0ab3286d60ac req-9b04c439-d784-45aa-b421-cbaf583afc55 service nova] Creating event network-vif-plugged:8412272b-9b7a-4804-b16d-98129e77eb04 for instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c on n-h1-764485-11 Jul 20 04:26:49.665658 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-87fb3019-25b8-429a-b4ad-0ab3286d60ac req-9b04c439-d784-45aa-b421-cbaf583afc55 service nova] Creating event network-vif-unplugged:86571be8-3cd1-44e0-856c-952546489890 for instance c037b53b-2303-44d0-bb77-c8fa405473bb on n-h2-764485-11 Jul 20 04:26:49.684513 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-87fb3019-25b8-429a-b4ad-0ab3286d60ac req-9b04c439-d784-45aa-b421-cbaf583afc55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.103593 Jul 20 04:26:49.688924 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1887/3733] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:49.741183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=14 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:49.965122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7d3c15d6-bc1c-464e-915a-4b0805b14455 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c45b1f0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:50.074270 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7d3c15d6-bc1c-464e-915a-4b0805b14455 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1428 microversion: 2.1 time: 0.118386 Jul 20 04:26:50.078880 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1888/3734] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:49 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:50.595368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6bcb2b02-5d2a-41f1-9b13-be10c5596653 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:50.596881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6bcb2b02-5d2a-41f1-9b13-be10c5596653 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:50.605419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6bcb2b02-5d2a-41f1-9b13-be10c5596653 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:50.612031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6bcb2b02-5d2a-41f1-9b13-be10c5596653 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:50.613283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6bcb2b02-5d2a-41f1-9b13-be10c5596653 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:50.615020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6bcb2b02-5d2a-41f1-9b13-be10c5596653 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:51.240979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6bcb2b02-5d2a-41f1-9b13-be10c5596653 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:51.250451 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6bcb2b02-5d2a-41f1-9b13-be10c5596653 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1317 microversion: 2.1 time: 0.660130 Jul 20 04:26:51.261159 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1889/3735] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:50 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1317 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:51.267052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-3c2b5745-7993-44a4-887f-4854215ddf4c req-08d8ae36-86ae-4a26-a555-4d63b33fb504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f8d838-800b-4d61-baaf-b3c61a950142", "name": "network-vif-deleted", "tag": "8581cbe4-3a4f-40ca-a8ae-af19bb7821ef"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:51.276563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3c2b5745-7993-44a4-887f-4854215ddf4c req-08d8ae36-86ae-4a26-a555-4d63b33fb504 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:51.277317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3c2b5745-7993-44a4-887f-4854215ddf4c req-08d8ae36-86ae-4a26-a555-4d63b33fb504 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:51.297011 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-3c2b5745-7993-44a4-887f-4854215ddf4c req-08d8ae36-86ae-4a26-a555-4d63b33fb504 service nova] Creating event network-vif-deleted:8581cbe4-3a4f-40ca-a8ae-af19bb7821ef for instance d4f8d838-800b-4d61-baaf-b3c61a950142 on n-h2-764485-11 Jul 20 04:26:51.304488 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-3c2b5745-7993-44a4-887f-4854215ddf4c req-08d8ae36-86ae-4a26-a555-4d63b33fb504 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040739 Jul 20 04:26:51.305442 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1890/3736] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:51.313647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3ba1d364-2c50-4481-8fb1-e6dba630b876 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c489820>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:51.419766 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3ba1d364-2c50-4481-8fb1-e6dba630b876 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1428 microversion: 2.1 time: 0.111621 Jul 20 04:26:51.426824 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1891/3737] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:51 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:52.273611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-348410e2-b290-4b04-813f-539ab6664ad3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:52.274505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-348410e2-b290-4b04-813f-539ab6664ad3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:52.293883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-348410e2-b290-4b04-813f-539ab6664ad3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:52.295718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-348410e2-b290-4b04-813f-539ab6664ad3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:52.298170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-348410e2-b290-4b04-813f-539ab6664ad3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:52.298817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-348410e2-b290-4b04-813f-539ab6664ad3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:52.860482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-348410e2-b290-4b04-813f-539ab6664ad3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:52.870814 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-348410e2-b290-4b04-813f-539ab6664ad3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1508 microversion: 2.1 time: 0.605253 Jul 20 04:26:52.876575 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1892/3738] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:52 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1508 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:52.890139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-25d971b4-3d5f-4fc2-98f8-bbdfc0ae4c5e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c536040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:53.024791 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-25d971b4-3d5f-4fc2-98f8-bbdfc0ae4c5e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1428 microversion: 2.1 time: 0.141814 Jul 20 04:26:53.025452 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1893/3739] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:52 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1428 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:53.031201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b5555ebd-7ca6-45c1-95c8-08dc289df6e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:53.046277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b5555ebd-7ca6-45c1-95c8-08dc289df6e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:53.064317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5555ebd-7ca6-45c1-95c8-08dc289df6e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.065465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5555ebd-7ca6-45c1-95c8-08dc289df6e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.066521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5555ebd-7ca6-45c1-95c8-08dc289df6e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.067367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5555ebd-7ca6-45c1-95c8-08dc289df6e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.782670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b5555ebd-7ca6-45c1-95c8-08dc289df6e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:53.792604 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b5555ebd-7ca6-45c1-95c8-08dc289df6e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1508 microversion: 2.1 time: 0.765320 Jul 20 04:26:53.798865 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1894/3740] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:53 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1508 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:53.815589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:53.817635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:53.831996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.832712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.833680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.834276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:54.077595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:26:54.084512 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:26:54.085303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:26:54.085889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:26:54.087498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:26:54.310990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:54.319951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:54.320400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:54.321192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:54.322135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:54.400189 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8feb4636-254e-430e-bbf2-ec53dc1175c1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "POST /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c/action" status: 202 len: 1110 microversion: 2.1 time: 0.578150 Jul 20 04:26:54.401303 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1895/3741] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:53 2022] POST /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c/action => generated 1110 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 20 04:26:54.406399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dfa68d4a-bd30-401f-947d-f815587537ff tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c4f5790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:54.484671 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dfa68d4a-bd30-401f-947d-f815587537ff tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1428 microversion: 2.1 time: 0.082036 Jul 20 04:26:54.486294 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1896/3742] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:54 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1428 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:54.491087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62259c9a-95f2-47eb-8cea-420fdfe1dd6f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:54.495024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-62259c9a-95f2-47eb-8cea-420fdfe1dd6f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:54.509198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62259c9a-95f2-47eb-8cea-420fdfe1dd6f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:54.513925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62259c9a-95f2-47eb-8cea-420fdfe1dd6f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:54.517446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62259c9a-95f2-47eb-8cea-420fdfe1dd6f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:54.518177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62259c9a-95f2-47eb-8cea-420fdfe1dd6f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.660547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-62259c9a-95f2-47eb-8cea-420fdfe1dd6f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:55.674708 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-62259c9a-95f2-47eb-8cea-420fdfe1dd6f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1515 microversion: 2.1 time: 1.187181 Jul 20 04:26:55.682446 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1897/3743] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:54 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1515 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:55.689139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-87a7b8d9-9416-4690-8aca-59e45f4d452e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c552b80>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:55.796796 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-87a7b8d9-9416-4690-8aca-59e45f4d452e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1428 microversion: 2.1 time: 0.112181 Jul 20 04:26:55.802228 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1898/3744] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:55 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1428 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:55.815600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-e2cfc22d-b5d1-4680-a477-f4cd67a9c046 req-b2ac657a-21f2-4534-8661-d53e14ffb3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a345673-f1c9-4573-801a-2f0387cc9513", "name": "network-vif-deleted", "tag": "74acd543-9406-46a0-a9e7-8fea4e0f1476"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:55.846920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e2cfc22d-b5d1-4680-a477-f4cd67a9c046 req-b2ac657a-21f2-4534-8661-d53e14ffb3c8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.852167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e2cfc22d-b5d1-4680-a477-f4cd67a9c046 req-b2ac657a-21f2-4534-8661-d53e14ffb3c8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.878028 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e2cfc22d-b5d1-4680-a477-f4cd67a9c046 req-b2ac657a-21f2-4534-8661-d53e14ffb3c8 service nova] Creating event network-vif-deleted:74acd543-9406-46a0-a9e7-8fea4e0f1476 for instance 1a345673-f1c9-4573-801a-2f0387cc9513 on n-h2-764485-11 Jul 20 04:26:55.895152 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-e2cfc22d-b5d1-4680-a477-f4cd67a9c046 req-b2ac657a-21f2-4534-8661-d53e14ffb3c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090989 Jul 20 04:26:55.897084 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1899/3745] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:56.473755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-d49f9627-dba7-4244-adfd-481a300d5913 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Building network info cache for instance {{(pid=119807) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:26:56.697903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14f0261a-013f-4c8c-8e0e-e811b685a47c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:56.698724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-14f0261a-013f-4c8c-8e0e-e811b685a47c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:56.734775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14f0261a-013f-4c8c-8e0e-e811b685a47c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.735271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14f0261a-013f-4c8c-8e0e-e811b685a47c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:56.736378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14f0261a-013f-4c8c-8e0e-e811b685a47c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.740449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14f0261a-013f-4c8c-8e0e-e811b685a47c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:57.468005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-14f0261a-013f-4c8c-8e0e-e811b685a47c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:57.476408 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-14f0261a-013f-4c8c-8e0e-e811b685a47c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1515 microversion: 2.1 time: 0.784482 Jul 20 04:26:57.476993 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1900/3746] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:56 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1515 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:57.492337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-35845ed9-e5b6-4714-bd4b-1c7795375607 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c552040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:57.586695 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-35845ed9-e5b6-4714-bd4b-1c7795375607 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1428 microversion: 2.1 time: 0.097798 Jul 20 04:26:57.595070 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1901/3747] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:57 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:57.961049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a96978e9-ed47-496d-9975-16710c060039 req-344dc01c-ee6b-4bab-980a-64af28dc5834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a811c37a-837f-4a64-a696-21879b8df872", "tag": "80a56e5f-9e4f-4102-aae0-c184e07381df"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:57.977991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a96978e9-ed47-496d-9975-16710c060039 req-344dc01c-ee6b-4bab-980a-64af28dc5834 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:57.980086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a96978e9-ed47-496d-9975-16710c060039 req-344dc01c-ee6b-4bab-980a-64af28dc5834 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:58.007775 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a96978e9-ed47-496d-9975-16710c060039 req-344dc01c-ee6b-4bab-980a-64af28dc5834 service nova] Creating event network-changed:80a56e5f-9e4f-4102-aae0-c184e07381df for instance a811c37a-837f-4a64-a696-21879b8df872 on n-h1-764485-11 Jul 20 04:26:58.024167 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a96978e9-ed47-496d-9975-16710c060039 req-344dc01c-ee6b-4bab-980a-64af28dc5834 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068619 Jul 20 04:26:58.024851 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1902/3748] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:26:58.496551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-98c45484-b18c-4f7c-b882-31e32cdf7ffe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:58.497286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-98c45484-b18c-4f7c-b882-31e32cdf7ffe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:58.517123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98c45484-b18c-4f7c-b882-31e32cdf7ffe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:58.521160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98c45484-b18c-4f7c-b882-31e32cdf7ffe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:58.526037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98c45484-b18c-4f7c-b882-31e32cdf7ffe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:58.526561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98c45484-b18c-4f7c-b882-31e32cdf7ffe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.443588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:59.931823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-d49f9627-dba7-4244-adfd-481a300d5913 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Updating instance_info_cache with network_info: [{"id": "80a56e5f-9e4f-4102-aae0-c184e07381df", "address": "fa:16:3e:b1:89:5d", "network": {"id": "0bc47de2-cbfa-49f6-abce-274b01379099", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1948826361-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c64e9245e26f4a27b8ed7115b60efb79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap80a56e5f-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:26:59.964698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d49f9627-dba7-4244-adfd-481a300d5913 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Releasing lock "refresh_cache-a811c37a-837f-4a64-a696-21879b8df872" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:26:59.973988 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d49f9627-dba7-4244-adfd-481a300d5913 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "POST /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872/action" status: 202 len: 0 microversion: 2.1 time: 10.548155 Jul 20 04:26:59.976267 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1847/3749] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:49 2022] POST /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872/action => generated 0 bytes in 10552 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 20 04:26:59.983729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8ba166f9-ca60-4d79-b6dd-8c425ddff221 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c5d21f0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:00.069461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-98c45484-b18c-4f7c-b882-31e32cdf7ffe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:00.084805 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-98c45484-b18c-4f7c-b882-31e32cdf7ffe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1515 microversion: 2.1 time: 1.594502 Jul 20 04:27:00.099221 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1903/3750] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:58 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1515 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:00.128491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9620c3c7-354f-4d99-b545-b0fd1fd2ff0c req-6f651856-3a89-4ead-becb-65847654ef96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c037b53b-2303-44d0-bb77-c8fa405473bb", "name": "network-vif-plugged", "status": "completed", "tag": "86571be8-3cd1-44e0-856c-952546489890"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:00.157324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9620c3c7-354f-4d99-b545-b0fd1fd2ff0c req-6f651856-3a89-4ead-becb-65847654ef96 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.162481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9620c3c7-354f-4d99-b545-b0fd1fd2ff0c req-6f651856-3a89-4ead-becb-65847654ef96 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.194005 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9620c3c7-354f-4d99-b545-b0fd1fd2ff0c req-6f651856-3a89-4ead-becb-65847654ef96 service nova] Creating event network-vif-plugged:86571be8-3cd1-44e0-856c-952546489890 for instance c037b53b-2303-44d0-bb77-c8fa405473bb on n-h2-764485-11 Jul 20 04:27:00.215163 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9620c3c7-354f-4d99-b545-b0fd1fd2ff0c req-6f651856-3a89-4ead-becb-65847654ef96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098850 Jul 20 04:27:00.222571 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1904/3751] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:00.524266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6714c824-13d8-4370-801c-ff49b065a49f tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1454474597", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:00.526248 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-6714c824-13d8-4370-801c-ff49b065a49f tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] HTTP exception thrown: min_count must be <= max_count Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6714c824-13d8-4370-801c-ff49b065a49f tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Request method failure captured: Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 184 Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14QSdiDjikqOnSFrhdyzjqdqFZ_1x4FZIdYcHifLJoi6NUz19DFtlXB4GhZgeBH15z15PF93xAMFw0EHQ8c5lSOYB_5iljnlDeQc42vEDhEOLSOpXWCYhXypUF3mO6a8RnVobGT5y2TPXLZZIE8cl60A1mx6b207bC9BUJK3IN1Hlrw Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: da938c5e7af3472ebde3be36f14cf44e Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da938c5e7af3472ebde3be36f14cf44e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da938c5e7af3472ebde3be36f14cf44e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da938c5e7af3472ebde3be36f14cf44e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da938c5e7af3472ebde3be36f14cf44e"}]}] Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: da938c5e7af3472ebde3be36f14cf44e Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-MultipleCreateNegativeTestJSON-1840556433-project Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 9ee094a8b87140e5b8c7a0c7cf167817 Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1840556433-project Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1454474597", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: exception: min_count must be <= max_count Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1454474597', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 20 04:27:00.536004 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:00.551159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6714c824-13d8-4370-801c-ff49b065a49f tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Returning 400 to user: min_count must be <= max_count {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:00.551159 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6714c824-13d8-4370-801c-ff49b065a49f tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.312905 Jul 20 04:27:00.551159 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1905/3752] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:00 2022] POST /compute/v2.1/servers => generated 74 bytes in 317 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:27:00.551159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f4363ecc-1008-4d9d-9a93-423916a9593f tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '.version_select at 0x7fbf9c489c10>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:01.333372 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f4363ecc-1008-4d9d-9a93-423916a9593f tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/b4131eae-f47b-4ca8-bbc8-6fa47724c076" status: 200 len: 185 microversion: 2.1 time: 0.791257 Jul 20 04:27:01.341104 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1906/3753] 10.222.0.20 () {58 vars in 1259 bytes} [Wed Jul 20 04:27:00 2022] GET /compute/v2.1/os-floating-ips/b4131eae-f47b-4ca8-bbc8-6fa47724c076 => generated 185 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:01.346050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eec2c247-0ac4-499e-900b-f53172a3c3a7 tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-318219714", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "max_count": 0}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eec2c247-0ac4-499e-900b-f53172a3c3a7 tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Request method failure captured: Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 167 Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14QSdiDjikqOnSFrhdyzjqdqFZ_1x4FZIdYcHifLJoi6NUz19DFtlXB4GhZgeBH15z15PF93xAMFw0EHQ8c5lSOYB_5iljnlDeQc42vEDhEOLSOpXWCYhXypUF3mO6a8RnVobGT5y2TPXLZZIE8cl60A1mx6b207bC9BUJK3IN1Hlrw Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: da938c5e7af3472ebde3be36f14cf44e Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da938c5e7af3472ebde3be36f14cf44e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da938c5e7af3472ebde3be36f14cf44e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da938c5e7af3472ebde3be36f14cf44e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da938c5e7af3472ebde3be36f14cf44e"}]}] Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: da938c5e7af3472ebde3be36f14cf44e Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-MultipleCreateNegativeTestJSON-1840556433-project Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 9ee094a8b87140e5b8c7a0c7cf167817 Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1840556433-project Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-318219714", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "max_count": 0}} Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-318219714', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'max_count': 0}}} Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 0 Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:27:01.353487 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:27:01.359227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:01.361985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eec2c247-0ac4-499e-900b-f53172a3c3a7 tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:01.363069 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eec2c247-0ac4-499e-900b-f53172a3c3a7 tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020918 Jul 20 04:27:01.364161 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1907/3754] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:01 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:01.370601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0a1fb44d-d0cb-4c79-a7df-3efbb68736ab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:01.385558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0a1fb44d-d0cb-4c79-a7df-3efbb68736ab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:01.413497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a1fb44d-d0cb-4c79-a7df-3efbb68736ab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:01.414641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a1fb44d-d0cb-4c79-a7df-3efbb68736ab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:01.418858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a1fb44d-d0cb-4c79-a7df-3efbb68736ab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:01.422478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a1fb44d-d0cb-4c79-a7df-3efbb68736ab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:01.478103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:02.030565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0a1fb44d-d0cb-4c79-a7df-3efbb68736ab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:02.043729 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0a1fb44d-d0cb-4c79-a7df-3efbb68736ab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1515 microversion: 2.1 time: 0.676011 Jul 20 04:27:02.044400 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1908/3755] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:01 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1515 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:02.067267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57db2563-38bf-4d59-a926-1a7daac30354 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.176"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:02.353321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-57db2563-38bf-4d59-a926-1a7daac30354 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:02.361779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57db2563-38bf-4d59-a926-1a7daac30354 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.362498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57db2563-38bf-4d59-a926-1a7daac30354 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.363462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57db2563-38bf-4d59-a926-1a7daac30354 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.367128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57db2563-38bf-4d59-a926-1a7daac30354 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:03.644358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57db2563-38bf-4d59-a926-1a7daac30354 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Acquired lock "refresh_cache-a811c37a-837f-4a64-a696-21879b8df872" {{(pid=119808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:27:06.598170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-57db2563-38bf-4d59-a926-1a7daac30354 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Building network info cache for instance {{(pid=119808) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:27:08.830664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-57db2563-38bf-4d59-a926-1a7daac30354 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Updating instance_info_cache with network_info: [{"id": "80a56e5f-9e4f-4102-aae0-c184e07381df", "address": "fa:16:3e:b1:89:5d", "network": {"id": "0bc47de2-cbfa-49f6-abce-274b01379099", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1948826361-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c64e9245e26f4a27b8ed7115b60efb79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap80a56e5f-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119808) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:27:08.847356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57db2563-38bf-4d59-a926-1a7daac30354 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Releasing lock "refresh_cache-a811c37a-837f-4a64-a696-21879b8df872" {{(pid=119808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:27:08.848348 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57db2563-38bf-4d59-a926-1a7daac30354 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "POST /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872/action" status: 202 len: 0 microversion: 2.1 time: 6.802847 Jul 20 04:27:08.849142 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1909/3756] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:27:02 2022] POST /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872/action => generated 0 bytes in 6804 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:27:08.876695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da7f8594-c255-491c-aaa0-6bf867769724 tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-342958033", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "max_count": 2.5}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da7f8594-c255-491c-aaa0-6bf867769724 tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Request method failure captured: Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 169 Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14QSdiDjikqOnSFrhdyzjqdqFZ_1x4FZIdYcHifLJoi6NUz19DFtlXB4GhZgeBH15z15PF93xAMFw0EHQ8c5lSOYB_5iljnlDeQc42vEDhEOLSOpXWCYhXypUF3mO6a8RnVobGT5y2TPXLZZIE8cl60A1mx6b207bC9BUJK3IN1Hlrw Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: da938c5e7af3472ebde3be36f14cf44e Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da938c5e7af3472ebde3be36f14cf44e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da938c5e7af3472ebde3be36f14cf44e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da938c5e7af3472ebde3be36f14cf44e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da938c5e7af3472ebde3be36f14cf44e"}]}] Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: da938c5e7af3472ebde3be36f14cf44e Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-MultipleCreateNegativeTestJSON-1840556433-project Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 9ee094a8b87140e5b8c7a0c7cf167817 Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1840556433-project Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-342958033", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "max_count": 2.5}} Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-342958033', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'max_count': 2.5}}} Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 2.5 Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:27:08.885500 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da7f8594-c255-491c-aaa0-6bf867769724 tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:08.892774 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da7f8594-c255-491c-aaa0-6bf867769724 tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032035 Jul 20 04:27:08.912938 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1910/3757] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:08 2022] POST /compute/v2.1/servers => generated 139 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:08.927450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f14ea866-6d55-4237-9d07-32ca7de95cfa tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:08.929390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f14ea866-6d55-4237-9d07-32ca7de95cfa tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:08.957745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f14ea866-6d55-4237-9d07-32ca7de95cfa tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:08.959100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f14ea866-6d55-4237-9d07-32ca7de95cfa tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:08.960387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f14ea866-6d55-4237-9d07-32ca7de95cfa tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:08.967606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f14ea866-6d55-4237-9d07-32ca7de95cfa tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.420490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f14ea866-6d55-4237-9d07-32ca7de95cfa tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:09.432837 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f14ea866-6d55-4237-9d07-32ca7de95cfa tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1515 microversion: 2.1 time: 0.518147 Jul 20 04:27:09.438947 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1911/3758] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:08 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1515 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:09.455103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-11d7d086-fb22-414f-bd3e-3a397f9fadcb req-fba75dae-6e6f-480b-bc2b-2cd464a0af59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a811c37a-837f-4a64-a696-21879b8df872", "tag": "80a56e5f-9e4f-4102-aae0-c184e07381df"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:09.474721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-11d7d086-fb22-414f-bd3e-3a397f9fadcb req-fba75dae-6e6f-480b-bc2b-2cd464a0af59 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.477504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-11d7d086-fb22-414f-bd3e-3a397f9fadcb req-fba75dae-6e6f-480b-bc2b-2cd464a0af59 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.508540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-11d7d086-fb22-414f-bd3e-3a397f9fadcb req-fba75dae-6e6f-480b-bc2b-2cd464a0af59 service nova] Creating event network-changed:80a56e5f-9e4f-4102-aae0-c184e07381df for instance a811c37a-837f-4a64-a696-21879b8df872 on n-h1-764485-11 Jul 20 04:27:09.521286 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-11d7d086-fb22-414f-bd3e-3a397f9fadcb req-fba75dae-6e6f-480b-bc2b-2cd464a0af59 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077832 Jul 20 04:27:09.522056 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1912/3759] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:09.554554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7d779c14-c29f-429e-bc4e-8fff23fcfdb3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:09.559493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7d779c14-c29f-429e-bc4e-8fff23fcfdb3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:09.581083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d779c14-c29f-429e-bc4e-8fff23fcfdb3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.581752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d779c14-c29f-429e-bc4e-8fff23fcfdb3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.585709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d779c14-c29f-429e-bc4e-8fff23fcfdb3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.586429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d779c14-c29f-429e-bc4e-8fff23fcfdb3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.622655 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8ba166f9-ca60-4d79-b6dd-8c425ddff221 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1437 microversion: 2.1 time: 9.643676 Jul 20 04:27:09.630742 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1848/3760] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:59 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1437 bytes in 9653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:09.645799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b933f77-7881-4ec0-9328-9abc2fad0c73 tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1785794421", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "min_count": 0}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:09.646089 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-7d779c14-c29f-429e-bc4e-8fff23fcfdb3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] HTTP exception thrown: Instance 1a345673-f1c9-4573-801a-2f0387cc9513 could not be found. Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7d779c14-c29f-429e-bc4e-8fff23fcfdb3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Request method failure captured: Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 HTTP/1.1 Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14OvnHBJ6rr2ImBPkaJim190gkRJXA_K7A8F_jSS2pzW9YOwhgeLADG9Nq-Mc0emjoh8TdIx2YRhgZMVU9Tg85zkp_b9PcJCeCYUHIluKZuGxH_u7Wyuu8oOjMFaUTDMygArrW2zauFlVd8aqRg-ivJ8b_mCExWbgDVTZDWPQ7SSmCs Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: c64e9245e26f4a27b8ed7115b60efb79 Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1139550606 Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c64e9245e26f4a27b8ed7115b60efb79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c64e9245e26f4a27b8ed7115b60efb79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c64e9245e26f4a27b8ed7115b60efb79", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c64e9245e26f4a27b8ed7115b60efb79"}]}] Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1139550606 Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: c64e9245e26f4a27b8ed7115b60efb79 Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1139550606 Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FloatingIPsAssociationTestJSON-1139550606-project Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b5e47ff480c94e60b9c635a1efd84645 Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1139550606-project Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 1a345673-f1c9-4573-801a-2f0387cc9513 could not be found. Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1a345673-f1c9-4573-801a-2f0387cc9513'} Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a345673-f1c9-4573-801a-2f0387cc9513 could not be found. Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:09.652188 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:09.657611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a345673-f1c9-4573-801a-2f0387cc9513 could not be found. Jul 20 04:27:09.657611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.657611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:09.657611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.657611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:09.657611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:09.657611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:09.657611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:09.657611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:09.657611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a345673-f1c9-4573-801a-2f0387cc9513 could not be found. Jul 20 04:27:09.657611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.661087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7d779c14-c29f-429e-bc4e-8fff23fcfdb3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Returning 404 to user: Instance 1a345673-f1c9-4573-801a-2f0387cc9513 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b933f77-7881-4ec0-9328-9abc2fad0c73 tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Request method failure captured: Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 168 Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14QSdiDjikqOnSFrhdyzjqdqFZ_1x4FZIdYcHifLJoi6NUz19DFtlXB4GhZgeBH15z15PF93xAMFw0EHQ8c5lSOYB_5iljnlDeQc42vEDhEOLSOpXWCYhXypUF3mO6a8RnVobGT5y2TPXLZZIE8cl60A1mx6b207bC9BUJK3IN1Hlrw Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: da938c5e7af3472ebde3be36f14cf44e Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da938c5e7af3472ebde3be36f14cf44e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da938c5e7af3472ebde3be36f14cf44e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da938c5e7af3472ebde3be36f14cf44e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da938c5e7af3472ebde3be36f14cf44e"}]}] Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: da938c5e7af3472ebde3be36f14cf44e Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-MultipleCreateNegativeTestJSON-1840556433-project Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 9ee094a8b87140e5b8c7a0c7cf167817 Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1840556433-project Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1785794421", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "min_count": 0}} Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1785794421', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'min_count': 0}}} Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 0 Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:27:09.661298 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b933f77-7881-4ec0-9328-9abc2fad0c73 tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0b933f77-7881-4ec0-9328-9abc2fad0c73 tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.035842 Jul 20 04:27:09.671917 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1849/3761] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:09 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:09.674232 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7d779c14-c29f-429e-bc4e-8fff23fcfdb3 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 404 len: 111 microversion: 2.1 time: 0.137917 Jul 20 04:27:09.675036 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1913/3762] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:09 2022] DELETE /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:09.682661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fec27beb-3fed-45e0-be3c-be2749fe9f16 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c5d24c0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:09.687390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df11b27c-5689-40f3-96cf-bb1b033c16c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:09.688210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df11b27c-5689-40f3-96cf-bb1b033c16c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: 1a345673-f1c9-4573-801a-2f0387cc9513] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:09.717550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df11b27c-5689-40f3-96cf-bb1b033c16c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.718026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df11b27c-5689-40f3-96cf-bb1b033c16c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.719105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df11b27c-5689-40f3-96cf-bb1b033c16c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.719629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df11b27c-5689-40f3-96cf-bb1b033c16c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.739646 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-df11b27c-5689-40f3-96cf-bb1b033c16c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] HTTP exception thrown: Instance 1a345673-f1c9-4573-801a-2f0387cc9513 could not be found. Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df11b27c-5689-40f3-96cf-bb1b033c16c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Request method failure captured: Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 HTTP/1.1 Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14OvnHBJ6rr2ImBPkaJim190gkRJXA_K7A8F_jSS2pzW9YOwhgeLADG9Nq-Mc0emjoh8TdIx2YRhgZMVU9Tg85zkp_b9PcJCeCYUHIluKZuGxH_u7Wyuu8oOjMFaUTDMygArrW2zauFlVd8aqRg-ivJ8b_mCExWbgDVTZDWPQ7SSmCs Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: c64e9245e26f4a27b8ed7115b60efb79 Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1139550606 Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c64e9245e26f4a27b8ed7115b60efb79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c64e9245e26f4a27b8ed7115b60efb79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c64e9245e26f4a27b8ed7115b60efb79", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c64e9245e26f4a27b8ed7115b60efb79"}]}] Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1139550606 Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: c64e9245e26f4a27b8ed7115b60efb79 Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1139550606 Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-FloatingIPsAssociationTestJSON-1139550606-project Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b5e47ff480c94e60b9c635a1efd84645 Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1139550606-project Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 1a345673-f1c9-4573-801a-2f0387cc9513 could not be found. Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1a345673-f1c9-4573-801a-2f0387cc9513'} Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a345673-f1c9-4573-801a-2f0387cc9513 could not be found. Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a345673-f1c9-4573-801a-2f0387cc9513 could not be found. Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.741386 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:09.747587 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.747587 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:09.747587 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:09.747587 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:09.747587 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:09.747587 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:09.747587 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a345673-f1c9-4573-801a-2f0387cc9513 could not be found. Jul 20 04:27:09.747587 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:09.747587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df11b27c-5689-40f3-96cf-bb1b033c16c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Returning 404 to user: Instance 1a345673-f1c9-4573-801a-2f0387cc9513 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:09.747587 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df11b27c-5689-40f3-96cf-bb1b033c16c9 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513" status: 404 len: 111 microversion: 2.1 time: 0.060573 Jul 20 04:27:09.748916 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1914/3763] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:09 2022] GET /compute/v2.1/servers/1a345673-f1c9-4573-801a-2f0387cc9513 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:09.755992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5c21a478-05fc-4524-b042-5c70866381dc tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '.version_select at 0x7fbf9c5ceee0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:09.799917 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fec27beb-3fed-45e0-be3c-be2749fe9f16 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 200 len: 1437 microversion: 2.1 time: 0.126829 Jul 20 04:27:09.806779 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1850/3764] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 04:27:09 2022] GET /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 1437 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:09.820057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-66852028-832d-4ab6-83d9-2b6ba3642d8d tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:09.821086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-66852028-832d-4ab6-83d9-2b6ba3642d8d tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:09.829358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66852028-832d-4ab6-83d9-2b6ba3642d8d tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.830143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66852028-832d-4ab6-83d9-2b6ba3642d8d tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.831170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66852028-832d-4ab6-83d9-2b6ba3642d8d tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.831840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66852028-832d-4ab6-83d9-2b6ba3642d8d tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.537705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-66852028-832d-4ab6-83d9-2b6ba3642d8d tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:10.551220 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-66852028-832d-4ab6-83d9-2b6ba3642d8d tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1480 microversion: 2.1 time: 0.742908 Jul 20 04:27:10.553441 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1851/3765] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:09 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1480 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:10.569200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a833514a-1bbf-45d9-892e-2fdcdde21f6a tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1936739194", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "min_count": 2.5}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a833514a-1bbf-45d9-892e-2fdcdde21f6a tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Request method failure captured: Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 170 Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14QSdiDjikqOnSFrhdyzjqdqFZ_1x4FZIdYcHifLJoi6NUz19DFtlXB4GhZgeBH15z15PF93xAMFw0EHQ8c5lSOYB_5iljnlDeQc42vEDhEOLSOpXWCYhXypUF3mO6a8RnVobGT5y2TPXLZZIE8cl60A1mx6b207bC9BUJK3IN1Hlrw Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: da938c5e7af3472ebde3be36f14cf44e Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da938c5e7af3472ebde3be36f14cf44e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da938c5e7af3472ebde3be36f14cf44e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da938c5e7af3472ebde3be36f14cf44e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da938c5e7af3472ebde3be36f14cf44e"}]}] Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: da938c5e7af3472ebde3be36f14cf44e Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1840556433 Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-MultipleCreateNegativeTestJSON-1840556433-project Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 9ee094a8b87140e5b8c7a0c7cf167817 Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1840556433-project Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1936739194", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "min_count": 2.5}} Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1936739194', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'min_count': 2.5}}} Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 2.5 Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:27:10.572541 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:27:10.579863 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:10.585246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a833514a-1bbf-45d9-892e-2fdcdde21f6a tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:10.587920 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a833514a-1bbf-45d9-892e-2fdcdde21f6a tempest-MultipleCreateNegativeTestJSON-1840556433 tempest-MultipleCreateNegativeTestJSON-1840556433-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.031755 Jul 20 04:27:10.592959 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1852/3766] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:10 2022] POST /compute/v2.1/servers => generated 139 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:11.345995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-65a5b97e-7f02-4695-b2ee-5411f3d0e7ab tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] Action: 'create', calling method: .version_select at 0x7fbf9d5a53a0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:11.378411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-65a5b97e-7f02-4695-b2ee-5411f3d0e7ab tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] Getting quotas for project 32883f4b399048a08e6dca32bd594905. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:11.385204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-65a5b97e-7f02-4695-b2ee-5411f3d0e7ab tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] Getting quotas for user 8dcd9a026f654b6a96821a9427d1e6c3 and project 32883f4b399048a08e6dca32bd594905. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:11.441221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-65a5b97e-7f02-4695-b2ee-5411f3d0e7ab tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] Getting quotas for project 32883f4b399048a08e6dca32bd594905. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:11.448434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-65a5b97e-7f02-4695-b2ee-5411f3d0e7ab tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] Getting quotas for user 8dcd9a026f654b6a96821a9427d1e6c3 and project 32883f4b399048a08e6dca32bd594905. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:11.502143 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-65a5b97e-7f02-4695-b2ee-5411f3d0e7ab tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.906950 Jul 20 04:27:11.503349 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1853/3767] 10.222.0.20 () {62 vars in 1213 bytes} [Wed Jul 20 04:27:10 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:27:11.516653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1e6b5c97-b95f-42e2-a018-827f9aa58f33 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:11.520967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1e6b5c97-b95f-42e2-a018-827f9aa58f33 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:11.547462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e6b5c97-b95f-42e2-a018-827f9aa58f33 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:11.548584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e6b5c97-b95f-42e2-a018-827f9aa58f33 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:11.550979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e6b5c97-b95f-42e2-a018-827f9aa58f33 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:11.551893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e6b5c97-b95f-42e2-a018-827f9aa58f33 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.100492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1e6b5c97-b95f-42e2-a018-827f9aa58f33 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.112685 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1e6b5c97-b95f-42e2-a018-827f9aa58f33 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1515 microversion: 2.1 time: 0.605827 Jul 20 04:27:12.122470 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1854/3768] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:11 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1515 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:12.126848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d4339145-3689-4ca1-b89d-ddaae3bd643f tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.211021 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5c21a478-05fc-4524-b042-5c70866381dc tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/b4131eae-f47b-4ca8-bbc8-6fa47724c076" status: 202 len: 0 microversion: 2.1 time: 2.461159 Jul 20 04:27:12.212676 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d4339145-3689-4ca1-b89d-ddaae3bd643f tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.088994 Jul 20 04:27:12.213338 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1915/3769] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:27:09 2022] DELETE /compute/v2.1/os-floating-ips/b4131eae-f47b-4ca8-bbc8-6fa47724c076 => generated 0 bytes in 2464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:27:12.219349 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1855/3770] 10.222.0.20 () {60 vars in 1192 bytes} [Wed Jul 20 04:27:12 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:27:12.224298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49a2fd5c-a098-4cda-aabb-d62a1927b826 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.225189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-49a2fd5c-a098-4cda-aabb-d62a1927b826 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:12.227366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2dc01647-5c20-4d52-985f-0899851649d6 tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.239949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=65 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:12.242585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49a2fd5c-a098-4cda-aabb-d62a1927b826 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.243220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49a2fd5c-a098-4cda-aabb-d62a1927b826 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.244243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49a2fd5c-a098-4cda-aabb-d62a1927b826 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.246435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49a2fd5c-a098-4cda-aabb-d62a1927b826 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.265154 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2dc01647-5c20-4d52-985f-0899851649d6 tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/7c6f99b7-a2f6-428d-a110-5b792f2585b9" status: 200 len: 235 microversion: 2.64 time: 0.042724 Jul 20 04:27:12.273682 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1856/3771] 10.222.0.20 () {60 vars in 1303 bytes} [Wed Jul 20 04:27:12 2022] GET /compute/v2.1/os-server-groups/7c6f99b7-a2f6-428d-a110-5b792f2585b9 => generated 235 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:27:12.289100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ce9dc006-d7a6-4284-aa9c-19f33dceffc5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.293133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ce9dc006-d7a6-4284-aa9c-19f33dceffc5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:12.312218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce9dc006-d7a6-4284-aa9c-19f33dceffc5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.312687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce9dc006-d7a6-4284-aa9c-19f33dceffc5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.313488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce9dc006-d7a6-4284-aa9c-19f33dceffc5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.313957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce9dc006-d7a6-4284-aa9c-19f33dceffc5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.328130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:12.387195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ce9dc006-d7a6-4284-aa9c-19f33dceffc5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:12.634104 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ce9dc006-d7a6-4284-aa9c-19f33dceffc5 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 204 len: 0 microversion: 2.1 time: 0.358886 Jul 20 04:27:12.638395 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1857/3772] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:12 2022] DELETE /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:12.663193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-06b01f3d-9c97-4e95-877a-2ddf879c09d4 tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.690482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-49a2fd5c-a098-4cda-aabb-d62a1927b826 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.707952 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-49a2fd5c-a098-4cda-aabb-d62a1927b826 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1467 microversion: 2.1 time: 0.493140 Jul 20 04:27:12.709439 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1916/3773] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:12 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1467 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:12.715794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9f1cd23a-51ee-4892-8af5-efa396c360be tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.717739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9f1cd23a-51ee-4892-8af5-efa396c360be tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:12.725809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f1cd23a-51ee-4892-8af5-efa396c360be tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.726279 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-06b01f3d-9c97-4e95-877a-2ddf879c09d4 tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/7c6f99b7-a2f6-428d-a110-5b792f2585b9" status: 204 len: 0 microversion: 2.64 time: 0.083979 Jul 20 04:27:12.727071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f1cd23a-51ee-4892-8af5-efa396c360be tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.727798 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1858/3774] 10.222.0.20 () {60 vars in 1306 bytes} [Wed Jul 20 04:27:12 2022] DELETE /compute/v2.1/os-server-groups/7c6f99b7-a2f6-428d-a110-5b792f2585b9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:27:12.728375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f1cd23a-51ee-4892-8af5-efa396c360be tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.729081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f1cd23a-51ee-4892-8af5-efa396c360be tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.751023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b02f75dc-890c-4766-b648-d51d5f8b0585 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c4e1ee0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:13.060001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9f1cd23a-51ee-4892-8af5-efa396c360be tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:13.069412 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9f1cd23a-51ee-4892-8af5-efa396c360be tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1526 microversion: 2.1 time: 0.358322 Jul 20 04:27:13.076977 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1917/3775] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:12 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1526 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:13.098618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1cc4a4b5-8835-451d-bbf2-8fdecaab6ef3 tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:13.117566 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-1cc4a4b5-8835-451d-bbf2-8fdecaab6ef3 tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] HTTP exception thrown: Instance group 7c6f99b7-a2f6-428d-a110-5b792f2585b9 could not be found. Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1cc4a4b5-8835-451d-bbf2-8fdecaab6ef3 tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] Request method failure captured: Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-server-groups/7c6f99b7-a2f6-428d-a110-5b792f2585b9 HTTP/1.1 Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Qd8U4nEQvoSgLuaK0gcePrNeR8jW0ZdLJXIzXazaPK05BVnU0Mo9ikQ685-mj-Nhh0Bn-QV8YqDXUMZCq4hp6yOtGMaVDhMpXXfldaTFEC1PbS9_GRg1F_IYGW3Xo_8JMXUFZdmM_txSrGTh_a_KeoYd-iBUrzTqUlxR1yKmdoCTs Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.64 Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 32883f4b399048a08e6dca32bd594905 Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerGroup264TestJSON-1547778698 Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/32883f4b399048a08e6dca32bd594905"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/32883f4b399048a08e6dca32bd594905"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_32883f4b399048a08e6dca32bd594905", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/32883f4b399048a08e6dca32bd594905"}]}] Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerGroup264TestJSON-1547778698 Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 32883f4b399048a08e6dca32bd594905 Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1547778698 Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerGroup264TestJSON-1547778698-project Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8dcd9a026f654b6a96821a9427d1e6c3 Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerGroup264TestJSON-1547778698-project Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance group 7c6f99b7-a2f6-428d-a110-5b792f2585b9 could not be found. Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '7c6f99b7-a2f6-428d-a110-5b792f2585b9'} Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7c6f99b7-a2f6-428d-a110-5b792f2585b9 could not be found. Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7c6f99b7-a2f6-428d-a110-5b792f2585b9 could not be found. Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:13.127379 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:13.132853 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:13.132853 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:13.132853 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:13.132853 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:13.132853 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7c6f99b7-a2f6-428d-a110-5b792f2585b9 could not be found. Jul 20 04:27:13.132853 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:13.146322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1cc4a4b5-8835-451d-bbf2-8fdecaab6ef3 tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] Returning 404 to user: Instance group 7c6f99b7-a2f6-428d-a110-5b792f2585b9 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:13.155889 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1cc4a4b5-8835-451d-bbf2-8fdecaab6ef3 tempest-ServerGroup264TestJSON-1547778698 tempest-ServerGroup264TestJSON-1547778698-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/7c6f99b7-a2f6-428d-a110-5b792f2585b9" status: 404 len: 117 microversion: 2.64 time: 0.077452 Jul 20 04:27:13.203590 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1918/3776] 10.222.0.20 () {60 vars in 1306 bytes} [Wed Jul 20 04:27:13 2022] DELETE /compute/v2.1/os-server-groups/7c6f99b7-a2f6-428d-a110-5b792f2585b9 => generated 117 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:13.229846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0fdb5e11-62b1-451f-921d-bc48727f67a0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:13.230735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0fdb5e11-62b1-451f-921d-bc48727f67a0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:13.274062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0fdb5e11-62b1-451f-921d-bc48727f67a0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:13.275607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0fdb5e11-62b1-451f-921d-bc48727f67a0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:13.278683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0fdb5e11-62b1-451f-921d-bc48727f67a0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:13.281396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0fdb5e11-62b1-451f-921d-bc48727f67a0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.123709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0fdb5e11-62b1-451f-921d-bc48727f67a0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.133349 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0fdb5e11-62b1-451f-921d-bc48727f67a0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1515 microversion: 2.1 time: 0.927661 Jul 20 04:27:14.144371 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1919/3777] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:13 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1515 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:14.151137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f21b19fb-a84a-47f1-ab50-4f69733f5df7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:14.159374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f21b19fb-a84a-47f1-ab50-4f69733f5df7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:14.188623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f21b19fb-a84a-47f1-ab50-4f69733f5df7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.192398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f21b19fb-a84a-47f1-ab50-4f69733f5df7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.194690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f21b19fb-a84a-47f1-ab50-4f69733f5df7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.196977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f21b19fb-a84a-47f1-ab50-4f69733f5df7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.225620 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b02f75dc-890c-4766-b648-d51d5f8b0585 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "DELETE /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb" status: 204 len: 0 microversion: 2.1 time: 1.495800 Jul 20 04:27:14.230729 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1859/3778] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:12 2022] DELETE /compute/v2.1/images/c0958753-b15a-4fee-8400-49b4aff061fb => generated 0 bytes in 1499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:14.237136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a4f2a304-e50e-450d-89e5-82cb1415f7d4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '.version_select at 0x7fbf9c63a790>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:14.367756 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a4f2a304-e50e-450d-89e5-82cb1415f7d4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] HTTP exception thrown: Image not found. Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a4f2a304-e50e-450d-89e5-82cb1415f7d4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Request method failure captured: Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb HTTP/1.1 Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14O0HrwFUvnERLttPzHhOhBFfkSzUugPnN8SRYjVbAO2NJceWDZlyVS-cc-dVBeZ3ZN1u1BTFzKHSXPvapowC4dHiPe39R30lXutiEU90o8gCeQmh2PV7qAYgSoxNNvhvtyNyeggsx0u3KVBrCS6XmB_NDeXEbGon2jtL63TlYfIVqw Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: dd3d006bc13b41a7aaf83838cef7e2df Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ImagesOneServerTestJSON-1627437150 Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dd3d006bc13b41a7aaf83838cef7e2df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd3d006bc13b41a7aaf83838cef7e2df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dd3d006bc13b41a7aaf83838cef7e2df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd3d006bc13b41a7aaf83838cef7e2df"}]}] Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ImagesOneServerTestJSON-1627437150 Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: dd3d006bc13b41a7aaf83838cef7e2df Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1627437150 Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ImagesOneServerTestJSON-1627437150-project Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a4c1d61479ce41e883c1a4ad2795a230 Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ImagesOneServerTestJSON-1627437150-project Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: exception: Image not found. Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '5a31be74-f0b1-434d-abb8-1bb53f1b9dfb'} Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5a31be74-f0b1-434d-abb8-1bb53f1b9dfb to delete Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a31be74-f0b1-434d-abb8-1bb53f1b9dfb could not be found. Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:14.370027 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a4f2a304-e50e-450d-89e5-82cb1415f7d4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Returning 404 to user: Image not found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:14.375840 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a4f2a304-e50e-450d-89e5-82cb1415f7d4 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "DELETE /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb" status: 404 len: 62 microversion: 2.1 time: 0.139952 Jul 20 04:27:14.382783 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1860/3779] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:14 2022] DELETE /compute/v2.1/images/5a31be74-f0b1-434d-abb8-1bb53f1b9dfb => generated 62 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:27:14.399411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5fdfbc6b-bf1e-4e38-9ecc-7db1f9342e12 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:14.404111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5fdfbc6b-bf1e-4e38-9ecc-7db1f9342e12 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:14.429669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5fdfbc6b-bf1e-4e38-9ecc-7db1f9342e12 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.430120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5fdfbc6b-bf1e-4e38-9ecc-7db1f9342e12 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.430909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5fdfbc6b-bf1e-4e38-9ecc-7db1f9342e12 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.431356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5fdfbc6b-bf1e-4e38-9ecc-7db1f9342e12 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.495164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5fdfbc6b-bf1e-4e38-9ecc-7db1f9342e12 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:14.754274 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5fdfbc6b-bf1e-4e38-9ecc-7db1f9342e12 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 204 len: 0 microversion: 2.1 time: 0.369611 Jul 20 04:27:14.755425 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1861/3780] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:14 2022] DELETE /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:14.760026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5fdfbc6b-bf1e-4e38-9ecc-7db1f9342e12 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:14.763479 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5fdfbc6b-bf1e-4e38-9ecc-7db1f9342e12 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005638 Jul 20 04:27:14.767138 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1862/3781] 10.222.0.20 () {56 vars in 885 bytes} [Wed Jul 20 04:27:14 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:27:14.791866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a8b08f39-c067-46cd-841e-734fd84d0b6b tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:14.798066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a8b08f39-c067-46cd-841e-734fd84d0b6b tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:14.819693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8b08f39-c067-46cd-841e-734fd84d0b6b tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.820170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8b08f39-c067-46cd-841e-734fd84d0b6b tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.826576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8b08f39-c067-46cd-841e-734fd84d0b6b tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.827049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8b08f39-c067-46cd-841e-734fd84d0b6b tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.960698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f21b19fb-a84a-47f1-ab50-4f69733f5df7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.969856 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f21b19fb-a84a-47f1-ab50-4f69733f5df7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1526 microversion: 2.1 time: 0.823609 Jul 20 04:27:14.987984 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1920/3782] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:14 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1526 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:15.000260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f21b19fb-a84a-47f1-ab50-4f69733f5df7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:15.001798 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f21b19fb-a84a-47f1-ab50-4f69733f5df7 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004991 Jul 20 04:27:15.004230 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1921/3783] 10.222.0.20 () {54 vars in 1034 bytes} [Wed Jul 20 04:27:14 2022] GET /compute/v2/ => generated 379 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 20 04:27:15.014454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-519177df-ed87-445a-8a70-f70a8c37050d req-7561d094-4a20-4ea1-87ee-92efce533e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8bb3a9-3f84-40e4-98f5-df941562cc99", "name": "network-vif-unplugged", "status": "completed", "tag": "373329f2-04a7-4cd4-9161-6e1cf125f9e8"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:15.053302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-519177df-ed87-445a-8a70-f70a8c37050d req-7561d094-4a20-4ea1-87ee-92efce533e03 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:15.053750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-519177df-ed87-445a-8a70-f70a8c37050d req-7561d094-4a20-4ea1-87ee-92efce533e03 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:15.082164 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-519177df-ed87-445a-8a70-f70a8c37050d req-7561d094-4a20-4ea1-87ee-92efce533e03 service nova] Creating event network-vif-unplugged:373329f2-04a7-4cd4-9161-6e1cf125f9e8 for instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 on n-h2-764485-11 Jul 20 04:27:15.092013 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-519177df-ed87-445a-8a70-f70a8c37050d req-7561d094-4a20-4ea1-87ee-92efce533e03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086273 Jul 20 04:27:15.097370 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1922/3784] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:15.099086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-519177df-ed87-445a-8a70-f70a8c37050d req-7561d094-4a20-4ea1-87ee-92efce533e03 service nova] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:15.103630 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-519177df-ed87-445a-8a70-f70a8c37050d req-7561d094-4a20-4ea1-87ee-92efce533e03 service nova] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.004983 Jul 20 04:27:15.109262 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1923/3785] 10.222.0.20 () {54 vars in 1040 bytes} [Wed Jul 20 04:27:15 2022] GET /compute/v2.1/ => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:15.119112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-519177df-ed87-445a-8a70-f70a8c37050d req-7561d094-4a20-4ea1-87ee-92efce533e03 service nova] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:15.120404 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-519177df-ed87-445a-8a70-f70a8c37050d req-7561d094-4a20-4ea1-87ee-92efce533e03 service nova] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001681 Jul 20 04:27:15.121021 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1924/3786] 10.222.0.20 () {56 vars in 885 bytes} [Wed Jul 20 04:27:15 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 20 04:27:15.158355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dea14305-f4dc-4382-9ad1-57d6cf832cd9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:15.159333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dea14305-f4dc-4382-9ad1-57d6cf832cd9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:15.172389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dea14305-f4dc-4382-9ad1-57d6cf832cd9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:15.175043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dea14305-f4dc-4382-9ad1-57d6cf832cd9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:15.176359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dea14305-f4dc-4382-9ad1-57d6cf832cd9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:15.178991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dea14305-f4dc-4382-9ad1-57d6cf832cd9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:15.958725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dea14305-f4dc-4382-9ad1-57d6cf832cd9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:15.973066 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dea14305-f4dc-4382-9ad1-57d6cf832cd9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1515 microversion: 2.1 time: 0.819221 Jul 20 04:27:15.976225 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1925/3787] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:15 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1515 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:15.992387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6a60988d-d23a-42d5-9237-ca1aee4d1acb tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:15.993720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6a60988d-d23a-42d5-9237-ca1aee4d1acb tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:16.003015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a8b08f39-c067-46cd-841e-734fd84d0b6b tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:16.017013 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a8b08f39-c067-46cd-841e-734fd84d0b6b tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1473 microversion: 2.1 time: 1.240393 Jul 20 04:27:16.018318 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1863/3788] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:14 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1473 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:16.018448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a60988d-d23a-42d5-9237-ca1aee4d1acb tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:16.020359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a60988d-d23a-42d5-9237-ca1aee4d1acb tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:16.021099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a60988d-d23a-42d5-9237-ca1aee4d1acb tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:16.021549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a60988d-d23a-42d5-9237-ca1aee4d1acb tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:16.313199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6a60988d-d23a-42d5-9237-ca1aee4d1acb tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:16.326125 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6a60988d-d23a-42d5-9237-ca1aee4d1acb tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1526 microversion: 2.1 time: 0.337848 Jul 20 04:27:16.332318 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1926/3789] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:15 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1526 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:16.994123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-908f82e9-b811-4695-b562-cefb977ea629 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:16.995074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-908f82e9-b811-4695-b562-cefb977ea629 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:17.007741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-908f82e9-b811-4695-b562-cefb977ea629 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:17.013435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-908f82e9-b811-4695-b562-cefb977ea629 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:17.014805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-908f82e9-b811-4695-b562-cefb977ea629 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:17.016755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-908f82e9-b811-4695-b562-cefb977ea629 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:17.036144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b63199d-ee8f-4252-b937-405b6d1e593e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:17.037542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b63199d-ee8f-4252-b937-405b6d1e593e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:17.057223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b63199d-ee8f-4252-b937-405b6d1e593e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:17.061494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b63199d-ee8f-4252-b937-405b6d1e593e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:17.064064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b63199d-ee8f-4252-b937-405b6d1e593e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:17.068550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b63199d-ee8f-4252-b937-405b6d1e593e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.340874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b63199d-ee8f-4252-b937-405b6d1e593e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:18.359147 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b63199d-ee8f-4252-b937-405b6d1e593e tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1473 microversion: 2.1 time: 1.318992 Jul 20 04:27:18.369051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-908f82e9-b811-4695-b562-cefb977ea629 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:18.369759 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1927/3790] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:17 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1473 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:18.383918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-32564f6a-d3d5-418f-a427-11570ec0a0df tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:18.384563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-32564f6a-d3d5-418f-a427-11570ec0a0df tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:18.406960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32564f6a-d3d5-418f-a427-11570ec0a0df tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.407299 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-908f82e9-b811-4695-b562-cefb977ea629 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1515 microversion: 2.1 time: 1.416993 Jul 20 04:27:18.409255 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1864/3791] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:16 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1515 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:18.414257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32564f6a-d3d5-418f-a427-11570ec0a0df tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.415356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32564f6a-d3d5-418f-a427-11570ec0a0df tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.423049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32564f6a-d3d5-418f-a427-11570ec0a0df tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.429646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-29a384a2-e4bf-4fd9-af2f-3b3ecfc76faf req-7a79eab2-e135-44c3-a550-06333fb18c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a811c37a-837f-4a64-a696-21879b8df872", "name": "network-vif-deleted", "tag": "80a56e5f-9e4f-4102-aae0-c184e07381df"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:18.464991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-29a384a2-e4bf-4fd9-af2f-3b3ecfc76faf req-7a79eab2-e135-44c3-a550-06333fb18c9c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.468322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-29a384a2-e4bf-4fd9-af2f-3b3ecfc76faf req-7a79eab2-e135-44c3-a550-06333fb18c9c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.502875 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-29a384a2-e4bf-4fd9-af2f-3b3ecfc76faf req-7a79eab2-e135-44c3-a550-06333fb18c9c service nova] Creating event network-vif-deleted:80a56e5f-9e4f-4102-aae0-c184e07381df for instance a811c37a-837f-4a64-a696-21879b8df872 on n-h1-764485-11 Jul 20 04:27:18.537986 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-29a384a2-e4bf-4fd9-af2f-3b3ecfc76faf req-7a79eab2-e135-44c3-a550-06333fb18c9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127182 Jul 20 04:27:18.540549 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1865/3792] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:18.547106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32564f6a-d3d5-418f-a427-11570ec0a0df tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.547637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32564f6a-d3d5-418f-a427-11570ec0a0df tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.548115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-32564f6a-d3d5-418f-a427-11570ec0a0df tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lazy-loading 'fault' on Instance uuid a811c37a-837f-4a64-a696-21879b8df872 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:27:19.097450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-32564f6a-d3d5-418f-a427-11570ec0a0df tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5e47ff480c94e60b9c635a1efd84645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64e9245e26f4a27b8ed7115b60efb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:19.106507 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-32564f6a-d3d5-418f-a427-11570ec0a0df tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 200 len: 1313 microversion: 2.1 time: 0.733334 Jul 20 04:27:19.107106 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1928/3793] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:18 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:19.379273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3978da41-239d-4848-9418-5d22649acdc2 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:19.380068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3978da41-239d-4848-9418-5d22649acdc2 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:19.396219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3978da41-239d-4848-9418-5d22649acdc2 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:19.397781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3978da41-239d-4848-9418-5d22649acdc2 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:19.400762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3978da41-239d-4848-9418-5d22649acdc2 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:19.401385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3978da41-239d-4848-9418-5d22649acdc2 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:19.444707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5bbcfd78-05d4-4ef6-b549-02d083f98362 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Action: 'create', calling method: .version_select at 0x7fbf9c512f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1558565627"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:19.682698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3978da41-239d-4848-9418-5d22649acdc2 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4c1d61479ce41e883c1a4ad2795a230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d006bc13b41a7aaf83838cef7e2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:19.691354 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3978da41-239d-4848-9418-5d22649acdc2 tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 200 len: 1302 microversion: 2.1 time: 0.317729 Jul 20 04:27:19.697446 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1929/3794] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:19 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 1302 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:19.711173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49d41d71-b665-43c1-9683-d38bbc267767 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:19.713000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-49d41d71-b665-43c1-9683-d38bbc267767 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:19.727985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49d41d71-b665-43c1-9683-d38bbc267767 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:19.731491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49d41d71-b665-43c1-9683-d38bbc267767 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:19.733590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49d41d71-b665-43c1-9683-d38bbc267767 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:19.736400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49d41d71-b665-43c1-9683-d38bbc267767 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:20.405352 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5bbcfd78-05d4-4ef6-b549-02d083f98362 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.319849 Jul 20 04:27:20.416149 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1866/3795] 10.222.0.20 () {60 vars in 1154 bytes} [Wed Jul 20 04:27:19 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1332 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 20 04:27:20.421689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cdbea7f3-6ab6-4974-86f1-e8abf46f0d56 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:20.425136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cdbea7f3-6ab6-4974-86f1-e8abf46f0d56 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] [instance: a811c37a-837f-4a64-a696-21879b8df872] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:20.442922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdbea7f3-6ab6-4974-86f1-e8abf46f0d56 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:20.446880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdbea7f3-6ab6-4974-86f1-e8abf46f0d56 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:20.447943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdbea7f3-6ab6-4974-86f1-e8abf46f0d56 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:20.448553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdbea7f3-6ab6-4974-86f1-e8abf46f0d56 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:20.484491 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-cdbea7f3-6ab6-4974-86f1-e8abf46f0d56 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] HTTP exception thrown: Instance a811c37a-837f-4a64-a696-21879b8df872 could not be found. Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cdbea7f3-6ab6-4974-86f1-e8abf46f0d56 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Request method failure captured: Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 HTTP/1.1 Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14OvnHBJ6rr2ImBPkaJim190gkRJXA_K7A8F_jSS2pzW9YOwhgeLADG9Nq-Mc0emjoh8TdIx2YRhgZMVU9Tg85zkp_b9PcJCeCYUHIluKZuGxH_u7Wyuu8oOjMFaUTDMygArrW2zauFlVd8aqRg-ivJ8b_mCExWbgDVTZDWPQ7SSmCs Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: c64e9245e26f4a27b8ed7115b60efb79 Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1139550606 Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c64e9245e26f4a27b8ed7115b60efb79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c64e9245e26f4a27b8ed7115b60efb79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c64e9245e26f4a27b8ed7115b60efb79", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c64e9245e26f4a27b8ed7115b60efb79"}]}] Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1139550606 Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: c64e9245e26f4a27b8ed7115b60efb79 Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1139550606 Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-FloatingIPsAssociationTestJSON-1139550606-project Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: b5e47ff480c94e60b9c635a1efd84645 Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1139550606-project Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance a811c37a-837f-4a64-a696-21879b8df872 could not be found. Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a811c37a-837f-4a64-a696-21879b8df872'} Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a811c37a-837f-4a64-a696-21879b8df872 could not be found. Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a811c37a-837f-4a64-a696-21879b8df872 could not be found. Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:20.493446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:20.501124 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:20.501124 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:20.501124 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:20.501124 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:20.501124 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:20.501124 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:20.501124 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a811c37a-837f-4a64-a696-21879b8df872 could not be found. Jul 20 04:27:20.501124 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:20.505005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cdbea7f3-6ab6-4974-86f1-e8abf46f0d56 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] Returning 404 to user: Instance a811c37a-837f-4a64-a696-21879b8df872 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:20.508586 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cdbea7f3-6ab6-4974-86f1-e8abf46f0d56 tempest-FloatingIPsAssociationTestJSON-1139550606 tempest-FloatingIPsAssociationTestJSON-1139550606-project] 10.222.0.20 "GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872" status: 404 len: 111 microversion: 2.1 time: 0.090813 Jul 20 04:27:20.509753 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1867/3796] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:20 2022] GET /compute/v2.1/servers/a811c37a-837f-4a64-a696-21879b8df872 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:20.512653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-49d41d71-b665-43c1-9683-d38bbc267767 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:20.522735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fb90b31c-7a87-429a-896b-df2e13d63e0d tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c4e1ca0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:20.527816 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-49d41d71-b665-43c1-9683-d38bbc267767 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1515 microversion: 2.1 time: 0.816785 Jul 20 04:27:20.530730 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1930/3797] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:19 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1515 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:20.668308 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fb90b31c-7a87-429a-896b-df2e13d63e0d tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3" status: 200 len: 345 microversion: 2.1 time: 0.157154 Jul 20 04:27:20.668910 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1868/3798] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:27:20 2022] GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 => generated 345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:20.714293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b8656da7-cb8d-4298-a6cf-212bcfc4f4ff tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:20.714919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b8656da7-cb8d-4298-a6cf-212bcfc4f4ff tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] [instance: 4f8bb3a9-3f84-40e4-98f5-df941562cc99] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:20.725541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8656da7-cb8d-4298-a6cf-212bcfc4f4ff tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:20.726004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8656da7-cb8d-4298-a6cf-212bcfc4f4ff tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:20.726798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8656da7-cb8d-4298-a6cf-212bcfc4f4ff tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:20.727246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8656da7-cb8d-4298-a6cf-212bcfc4f4ff tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:20.789421 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-b8656da7-cb8d-4298-a6cf-212bcfc4f4ff tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] HTTP exception thrown: Instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 could not be found. Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b8656da7-cb8d-4298-a6cf-212bcfc4f4ff tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Request method failure captured: Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 HTTP/1.1 Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14O0HrwFUvnERLttPzHhOhBFfkSzUugPnN8SRYjVbAO2NJceWDZlyVS-cc-dVBeZ3ZN1u1BTFzKHSXPvapowC4dHiPe39R30lXutiEU90o8gCeQmh2PV7qAYgSoxNNvhvtyNyeggsx0u3KVBrCS6XmB_NDeXEbGon2jtL63TlYfIVqw Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: dd3d006bc13b41a7aaf83838cef7e2df Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ImagesOneServerTestJSON-1627437150 Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dd3d006bc13b41a7aaf83838cef7e2df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd3d006bc13b41a7aaf83838cef7e2df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dd3d006bc13b41a7aaf83838cef7e2df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd3d006bc13b41a7aaf83838cef7e2df"}]}] Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ImagesOneServerTestJSON-1627437150 Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: dd3d006bc13b41a7aaf83838cef7e2df Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1627437150 Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ImagesOneServerTestJSON-1627437150-project Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: a4c1d61479ce41e883c1a4ad2795a230 Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ImagesOneServerTestJSON-1627437150-project Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 could not be found. Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '4f8bb3a9-3f84-40e4-98f5-df941562cc99'} Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 could not be found. Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 could not be found. Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:20.791122 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:20.796545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:20.796545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:20.796545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:20.796545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:20.796545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:20.796545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 could not be found. Jul 20 04:27:20.796545 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:20.796545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b8656da7-cb8d-4298-a6cf-212bcfc4f4ff tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] Returning 404 to user: Instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:20.796545 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b8656da7-cb8d-4298-a6cf-212bcfc4f4ff tempest-ImagesOneServerTestJSON-1627437150 tempest-ImagesOneServerTestJSON-1627437150-project] 10.222.0.20 "GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99" status: 404 len: 111 microversion: 2.1 time: 0.082994 Jul 20 04:27:20.800010 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1931/3799] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:20 2022] GET /compute/v2.1/servers/4f8bb3a9-3f84-40e4-98f5-df941562cc99 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:21.046469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a041aa73-d14f-4c2f-93e4-70e31270cc08 req-2ab213e0-68c2-49c7-8cc3-e519668fe665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8bb3a9-3f84-40e4-98f5-df941562cc99", "name": "network-vif-deleted", "tag": "373329f2-04a7-4cd4-9161-6e1cf125f9e8"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:21.078186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a041aa73-d14f-4c2f-93e4-70e31270cc08 req-2ab213e0-68c2-49c7-8cc3-e519668fe665 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.079001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a041aa73-d14f-4c2f-93e4-70e31270cc08 req-2ab213e0-68c2-49c7-8cc3-e519668fe665 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.142068 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a041aa73-d14f-4c2f-93e4-70e31270cc08 req-2ab213e0-68c2-49c7-8cc3-e519668fe665 service nova] Creating event network-vif-deleted:373329f2-04a7-4cd4-9161-6e1cf125f9e8 for instance 4f8bb3a9-3f84-40e4-98f5-df941562cc99 on n-h2-764485-11 Jul 20 04:27:21.159472 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a041aa73-d14f-4c2f-93e4-70e31270cc08 req-2ab213e0-68c2-49c7-8cc3-e519668fe665 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118013 Jul 20 04:27:21.168387 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1869/3800] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:21.549953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ddb8797-a429-4458-9b6a-54fd9d38d74d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:21.560054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8ddb8797-a429-4458-9b6a-54fd9d38d74d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:21.575617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ddb8797-a429-4458-9b6a-54fd9d38d74d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.590264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ddb8797-a429-4458-9b6a-54fd9d38d74d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.592648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ddb8797-a429-4458-9b6a-54fd9d38d74d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.595571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ddb8797-a429-4458-9b6a-54fd9d38d74d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.683307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-de13134e-5772-46f5-83a5-417793f426d4 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c3780d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:21.711662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:21.835082 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-de13134e-5772-46f5-83a5-417793f426d4 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3" status: 200 len: 345 microversion: 2.1 time: 0.156190 Jul 20 04:27:21.843790 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1870/3801] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:27:21 2022] GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 => generated 345 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:22.850777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6562db8e-fac5-4eb5-9b86-c1f53b767556 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9d65a820>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:23.010289 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6562db8e-fac5-4eb5-9b86-c1f53b767556 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3" status: 200 len: 346 microversion: 2.1 time: 0.163995 Jul 20 04:27:23.011196 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1871/3802] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:27:22 2022] GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 => generated 346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:23.024681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e54f59cc-d465-47fc-986b-e59ec5666c6f tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Action: 'create', calling method: .version_select at 0x7fbf9d380160>, body: {"snapshot": {"volume_id": "2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1858876242"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:23.088004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8ddb8797-a429-4458-9b6a-54fd9d38d74d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:23.159637 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8ddb8797-a429-4458-9b6a-54fd9d38d74d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1515 microversion: 2.1 time: 1.582504 Jul 20 04:27:23.160287 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1932/3803] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:21 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1515 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:23.485374 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e54f59cc-d465-47fc-986b-e59ec5666c6f tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.465812 Jul 20 04:27:23.486369 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1872/3804] 10.222.0.20 () {60 vars in 1161 bytes} [Wed Jul 20 04:27:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:23.496947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-67f0f336-4437-4905-bfe5-46a256a6f94c tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c3780d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:23.595779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1356825093", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "33f1ce61-d383-4a8c-8e63-b9df66a1622a"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:23.680020 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-67f0f336-4437-4905-bfe5-46a256a6f94c tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b" status: 200 len: 287 microversion: 2.1 time: 0.187624 Jul 20 04:27:23.680894 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1873/3805] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 04:27:23 2022] GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b => generated 287 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:23.692186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-696e04b4-f631-4d6a-848b-3d885a6354fb tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c52ac10>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:23.780338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] validate_networks() for [('33f1ce61-d383-4a8c-8e63-b9df66a1622a', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:27:23.870362 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-696e04b4-f631-4d6a-848b-3d885a6354fb tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.182398 Jul 20 04:27:23.876137 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1874/3806] 10.222.0.20 () {58 vars in 1139 bytes} [Wed Jul 20 04:27:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:23.882511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-add0283a-2489-4337-8ff5-970a832e2c8e tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c512d30>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:23.984182 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-add0283a-2489-4337-8ff5-970a832e2c8e tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b" status: 200 len: 287 microversion: 2.1 time: 0.104448 Jul 20 04:27:23.985262 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1875/3807] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 04:27:23 2022] GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:24.177423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-948e3ad8-562b-41e2-9ceb-3c9bc702a3f8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:24.178251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-948e3ad8-562b-41e2-9ceb-3c9bc702a3f8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:24.190685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-948e3ad8-562b-41e2-9ceb-3c9bc702a3f8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:24.194014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-948e3ad8-562b-41e2-9ceb-3c9bc702a3f8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:24.194973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-948e3ad8-562b-41e2-9ceb-3c9bc702a3f8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:24.195502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-948e3ad8-562b-41e2-9ceb-3c9bc702a3f8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:25.485344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-948e3ad8-562b-41e2-9ceb-3c9bc702a3f8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:25.505146 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-948e3ad8-562b-41e2-9ceb-3c9bc702a3f8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1521 microversion: 2.1 time: 1.332062 Jul 20 04:27:25.516744 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1876/3808] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:24 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1521 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:25.534527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-38756655-90da-4c44-919e-d760c7788e18 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9d65a700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:25.638112 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-38756655-90da-4c44-919e-d760c7788e18 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b" status: 200 len: 287 microversion: 2.1 time: 0.117114 Jul 20 04:27:25.639141 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1877/3809] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 04:27:25 2022] GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:26.300623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-77bf9c27-0e81-4743-8e14-2b38f3a5bdd2 req-fa484db0-7626-4e85-9ba8-c3c3960ca824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956eebcb-bc8b-45dd-91ea-3a07ce83a20c", "name": "network-vif-unplugged", "status": "completed", "tag": "8412272b-9b7a-4804-b16d-98129e77eb04"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:26.332141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-77bf9c27-0e81-4743-8e14-2b38f3a5bdd2 req-fa484db0-7626-4e85-9ba8-c3c3960ca824 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.338286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-77bf9c27-0e81-4743-8e14-2b38f3a5bdd2 req-fa484db0-7626-4e85-9ba8-c3c3960ca824 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.344023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:27:26.344594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:27:26.345299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:27:26.345734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:27:26.346231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:27:26.362250 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-77bf9c27-0e81-4743-8e14-2b38f3a5bdd2 req-fa484db0-7626-4e85-9ba8-c3c3960ca824 service nova] Creating event network-vif-unplugged:8412272b-9b7a-4804-b16d-98129e77eb04 for instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c on n-h1-764485-11 Jul 20 04:27:26.372843 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-77bf9c27-0e81-4743-8e14-2b38f3a5bdd2 req-fa484db0-7626-4e85-9ba8-c3c3960ca824 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085141 Jul 20 04:27:26.374257 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1878/3810] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:26.382443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.383169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.384349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.385029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.397806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1559903e-6fdc-41d6-914c-7be8040212e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:26.398531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1559903e-6fdc-41d6-914c-7be8040212e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:26.402075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:26.412786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1559903e-6fdc-41d6-914c-7be8040212e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.419883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Getting quotas for project ca00c658fb854aa1abfd6e6549a928bb. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:26.427733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1559903e-6fdc-41d6-914c-7be8040212e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.428604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1559903e-6fdc-41d6-914c-7be8040212e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.429060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1559903e-6fdc-41d6-914c-7be8040212e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.432007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Getting quotas for user 3883da20a4a54cd091663d353d6f4072 and project ca00c658fb854aa1abfd6e6549a928bb. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:26.470039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:27:26.481783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:27:26.604651 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-07d72700-b118-4326-aa57-c9e9510d8873 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.394048 Jul 20 04:27:26.607201 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1933/3811] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:27:26.621960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ff661045-f3aa-4f99-839a-40cb4866a7e0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:26.623056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ff661045-f3aa-4f99-839a-40cb4866a7e0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:26.630136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff661045-f3aa-4f99-839a-40cb4866a7e0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.630910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff661045-f3aa-4f99-839a-40cb4866a7e0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.632302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff661045-f3aa-4f99-839a-40cb4866a7e0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.632941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff661045-f3aa-4f99-839a-40cb4866a7e0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:27.132548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1559903e-6fdc-41d6-914c-7be8040212e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:27.146218 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1559903e-6fdc-41d6-914c-7be8040212e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.758617 Jul 20 04:27:27.164629 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1879/3812] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:26 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:27.178037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8b20961c-3c72-4c6d-a275-a41757d5f975 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:27.178662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8b20961c-3c72-4c6d-a275-a41757d5f975 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:27.220279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ff661045-f3aa-4f99-839a-40cb4866a7e0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:27.233809 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ff661045-f3aa-4f99-839a-40cb4866a7e0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1521 microversion: 2.1 time: 0.616762 Jul 20 04:27:27.240301 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1934/3813] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:26 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:27.251538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1cd9f052-6df9-4a4c-81da-5a395be990b2 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c4f5040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:27.333399 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1cd9f052-6df9-4a4c-81da-5a395be990b2 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b" status: 200 len: 287 microversion: 2.1 time: 0.091713 Jul 20 04:27:27.333988 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1935/3814] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 04:27:27 2022] GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:27.343361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-13b25712-0ebc-4b30-90c1-c559ddc6abde tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1584939838"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:27.344640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-13b25712-0ebc-4b30-90c1-c559ddc6abde tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:27.375846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13b25712-0ebc-4b30-90c1-c559ddc6abde tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:27.376448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13b25712-0ebc-4b30-90c1-c559ddc6abde tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:27.379947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13b25712-0ebc-4b30-90c1-c559ddc6abde tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:27.379947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13b25712-0ebc-4b30-90c1-c559ddc6abde tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:27.412347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8b20961c-3c72-4c6d-a275-a41757d5f975 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:27.419901 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8b20961c-3c72-4c6d-a275-a41757d5f975 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1224 microversion: 2.1 time: 0.253933 Jul 20 04:27:27.420508 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1880/3815] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:27 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1224 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:28.131024 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-13b25712-0ebc-4b30-90c1-c559ddc6abde tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.790592 Jul 20 04:27:28.134351 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1936/3816] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:27:27 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 20 04:27:28.146346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c62fd5b-92e3-4658-98e5-8e301422fce0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:28.147821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4c62fd5b-92e3-4658-98e5-8e301422fce0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:28.166467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c62fd5b-92e3-4658-98e5-8e301422fce0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.175289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c62fd5b-92e3-4658-98e5-8e301422fce0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.190695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c62fd5b-92e3-4658-98e5-8e301422fce0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.192544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c62fd5b-92e3-4658-98e5-8e301422fce0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.265912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eadc810e-28ec-47d9-9a42-cfc0b231f384 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:28.266884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eadc810e-28ec-47d9-9a42-cfc0b231f384 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:28.306957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eadc810e-28ec-47d9-9a42-cfc0b231f384 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.307965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eadc810e-28ec-47d9-9a42-cfc0b231f384 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.311164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eadc810e-28ec-47d9-9a42-cfc0b231f384 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.324543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eadc810e-28ec-47d9-9a42-cfc0b231f384 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.553276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4c62fd5b-92e3-4658-98e5-8e301422fce0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:28.562433 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4c62fd5b-92e3-4658-98e5-8e301422fce0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.426570 Jul 20 04:27:28.569667 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1881/3817] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:28 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:28.587164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0d7dceb1-b6ce-47ee-8f8b-c24627d9ef72 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c63ae50>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:28.668098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-eadc810e-28ec-47d9-9a42-cfc0b231f384 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:28.678692 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0d7dceb1-b6ce-47ee-8f8b-c24627d9ef72 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b" status: 200 len: 288 microversion: 2.1 time: 0.104301 Jul 20 04:27:28.678692 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1882/3818] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 04:27:28 2022] GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b => generated 288 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:28.684908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-542d53d4-d3ff-4f57-abed-010ffe11e402 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:28.685626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-542d53d4-d3ff-4f57-abed-010ffe11e402 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:28.686908 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eadc810e-28ec-47d9-9a42-cfc0b231f384 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1521 microversion: 2.1 time: 0.432408 Jul 20 04:27:28.689956 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1937/3819] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:28 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:28.702606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61b3fe1a-4329-4608-a667-c2c5a3f846c8 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c489dc0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:28.707628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-542d53d4-d3ff-4f57-abed-010ffe11e402 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.708382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-542d53d4-d3ff-4f57-abed-010ffe11e402 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.713635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-542d53d4-d3ff-4f57-abed-010ffe11e402 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.714735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-542d53d4-d3ff-4f57-abed-010ffe11e402 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.866901 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-61b3fe1a-4329-4608-a667-c2c5a3f846c8 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b" status: 202 len: 0 microversion: 2.1 time: 0.174533 Jul 20 04:27:28.871026 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1938/3820] 10.222.0.20 () {58 vars in 1253 bytes} [Wed Jul 20 04:27:28 2022] DELETE /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:27:28.876093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b129f1ca-beef-437f-94c7-f0970b1dd244 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbfa284c8b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:28.898772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-542d53d4-d3ff-4f57-abed-010ffe11e402 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:28.907792 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-542d53d4-d3ff-4f57-abed-010ffe11e402 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1276 microversion: 2.1 time: 0.230417 Jul 20 04:27:28.910272 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1883/3821] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:28 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1276 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:28.959690 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b129f1ca-beef-437f-94c7-f0970b1dd244 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b" status: 200 len: 287 microversion: 2.1 time: 0.087067 Jul 20 04:27:28.960540 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1939/3822] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 04:27:28 2022] GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:29.586526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ffeb8594-0573-4c03-8c1c-9e769f4a76cb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:29.587226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ffeb8594-0573-4c03-8c1c-9e769f4a76cb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:29.603435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffeb8594-0573-4c03-8c1c-9e769f4a76cb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:29.607807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffeb8594-0573-4c03-8c1c-9e769f4a76cb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:29.609576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffeb8594-0573-4c03-8c1c-9e769f4a76cb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:29.610034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffeb8594-0573-4c03-8c1c-9e769f4a76cb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:29.706165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-302d09be-5a8d-4967-93f6-96d143b1fec8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:29.706915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-302d09be-5a8d-4967-93f6-96d143b1fec8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:29.719966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-302d09be-5a8d-4967-93f6-96d143b1fec8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:29.720675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-302d09be-5a8d-4967-93f6-96d143b1fec8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:29.721886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-302d09be-5a8d-4967-93f6-96d143b1fec8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:29.722490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-302d09be-5a8d-4967-93f6-96d143b1fec8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.454099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-302d09be-5a8d-4967-93f6-96d143b1fec8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:30.462387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ffeb8594-0573-4c03-8c1c-9e769f4a76cb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:30.465713 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-302d09be-5a8d-4967-93f6-96d143b1fec8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1521 microversion: 2.1 time: 0.763241 Jul 20 04:27:30.472593 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1940/3823] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:29 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1521 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:30.475672 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ffeb8594-0573-4c03-8c1c-9e769f4a76cb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.891110 Jul 20 04:27:30.476805 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1884/3824] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:29 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:30.486788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9fb110e7-4b69-4210-bac9-1889fe8b0803 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c512dc0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:30.493555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3c3d9199-4a36-41a7-89f5-fe230da5780e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:30.502174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3c3d9199-4a36-41a7-89f5-fe230da5780e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:30.544427 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9fb110e7-4b69-4210-bac9-1889fe8b0803 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b" status: 200 len: 287 microversion: 2.1 time: 0.066316 Jul 20 04:27:30.545024 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1885/3825] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 04:27:30 2022] GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:30.553559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3c3d9199-4a36-41a7-89f5-fe230da5780e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.554006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3c3d9199-4a36-41a7-89f5-fe230da5780e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.554834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3c3d9199-4a36-41a7-89f5-fe230da5780e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.555464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3c3d9199-4a36-41a7-89f5-fe230da5780e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.556930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-692b3ec4-a66b-42b4-8f2d-1585548e555b req-4682452c-ea63-471c-91bf-773da33cc3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956eebcb-bc8b-45dd-91ea-3a07ce83a20c", "name": "network-vif-plugged", "status": "completed", "tag": "8412272b-9b7a-4804-b16d-98129e77eb04"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:30.575802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-692b3ec4-a66b-42b4-8f2d-1585548e555b req-4682452c-ea63-471c-91bf-773da33cc3e6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.579926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-692b3ec4-a66b-42b4-8f2d-1585548e555b req-4682452c-ea63-471c-91bf-773da33cc3e6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.619829 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-692b3ec4-a66b-42b4-8f2d-1585548e555b req-4682452c-ea63-471c-91bf-773da33cc3e6 service nova] Creating event network-vif-plugged:8412272b-9b7a-4804-b16d-98129e77eb04 for instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c on n-h1-764485-11 Jul 20 04:27:30.635259 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-692b3ec4-a66b-42b4-8f2d-1585548e555b req-4682452c-ea63-471c-91bf-773da33cc3e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088683 Jul 20 04:27:30.637052 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1886/3826] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:30.643662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1aa0a8a5-80d7-440b-b1e3-5890dc51eda2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:30.644505 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1aa0a8a5-80d7-440b-b1e3-5890dc51eda2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:30.668038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1aa0a8a5-80d7-440b-b1e3-5890dc51eda2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.668786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1aa0a8a5-80d7-440b-b1e3-5890dc51eda2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.670086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1aa0a8a5-80d7-440b-b1e3-5890dc51eda2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.670815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1aa0a8a5-80d7-440b-b1e3-5890dc51eda2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.770960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3c3d9199-4a36-41a7-89f5-fe230da5780e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:30.781676 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3c3d9199-4a36-41a7-89f5-fe230da5780e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1282 microversion: 2.1 time: 0.304700 Jul 20 04:27:30.784670 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1941/3827] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:30 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1282 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:30.875214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-1aa0a8a5-80d7-440b-b1e3-5890dc51eda2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lazy-loading 'services' on Instance uuid 45e1887b-7d01-481c-a707-dd7d60a9a97b {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:27:31.048638 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1aa0a8a5-80d7-440b-b1e3-5890dc51eda2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments/69dca151-a669-420c-839e-da50cf1daf91" status: 202 len: 0 microversion: 2.1 time: 0.409434 Jul 20 04:27:31.049600 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1887/3828] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:27:30 2022] DELETE /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments/69dca151-a669-420c-839e-da50cf1daf91 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:27:31.062895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b5fadc4-ae8e-4dba-8398-a642784e9fb1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:31.063497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5b5fadc4-ae8e-4dba-8398-a642784e9fb1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:31.087479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b5fadc4-ae8e-4dba-8398-a642784e9fb1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.088150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b5fadc4-ae8e-4dba-8398-a642784e9fb1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:31.100174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b5fadc4-ae8e-4dba-8398-a642784e9fb1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.100685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b5fadc4-ae8e-4dba-8398-a642784e9fb1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:31.212461 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5b5fadc4-ae8e-4dba-8398-a642784e9fb1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158708 Jul 20 04:27:31.219773 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1942/3829] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:27:31 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:31.491385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2eaf4150-be0f-4276-8a1f-0af981813527 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:31.494087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d2f5a37c-5220-4d01-896c-aea70314fc1f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:31.494624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d2f5a37c-5220-4d01-896c-aea70314fc1f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:31.500984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2eaf4150-be0f-4276-8a1f-0af981813527 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:31.511489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2f5a37c-5220-4d01-896c-aea70314fc1f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.512237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2f5a37c-5220-4d01-896c-aea70314fc1f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:31.513247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2f5a37c-5220-4d01-896c-aea70314fc1f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.520293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2f5a37c-5220-4d01-896c-aea70314fc1f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:31.528265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eaf4150-be0f-4276-8a1f-0af981813527 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.529033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eaf4150-be0f-4276-8a1f-0af981813527 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:31.530064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eaf4150-be0f-4276-8a1f-0af981813527 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.530708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eaf4150-be0f-4276-8a1f-0af981813527 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.264718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2eaf4150-be0f-4276-8a1f-0af981813527 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:32.279131 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2eaf4150-be0f-4276-8a1f-0af981813527 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1521 microversion: 2.1 time: 0.789207 Jul 20 04:27:32.279831 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1888/3830] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:31 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1521 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:32.300436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b1c1c632-f8be-4385-8cd5-3997970057dd tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c512dc0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:32.331662 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b1c1c632-f8be-4385-8cd5-3997970057dd tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] HTTP exception thrown: Snapshot f2846457-270c-47fa-9def-1607135c4c1b could not be found. Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b1c1c632-f8be-4385-8cd5-3997970057dd tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Request method failure captured: Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b HTTP/1.1 Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14QmEPJzge5lSLAm07ZEQ169Mp_Iq7ewpA4R7-GT9uRdaiOI0F5ergM17VBB9JMc_bu5bKeUBlY2qv6h5qn-o20SU3QwLOmPmVT_nIpkA45Ng5LMimBIvnaUbq_KpxbEpBla1RUyojOO7BMKxcTRvLnbpDSWrbI9V3k1gSjkU7IhGBM Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2113944b52454af2999b9784f72aba24 Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1839159869 Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2113944b52454af2999b9784f72aba24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2113944b52454af2999b9784f72aba24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2113944b52454af2999b9784f72aba24", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2113944b52454af2999b9784f72aba24"}]}] Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1839159869 Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2113944b52454af2999b9784f72aba24 Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1839159869 Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-VolumesSnapshotsTestJSON-1839159869-project Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 59f0115eed6d4189b12e47cf662638a0 Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1839159869-project Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: exception: Snapshot f2846457-270c-47fa-9def-1607135c4c1b could not be found. Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'f2846457-270c-47fa-9def-1607135c4c1b'} Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f2846457-270c-47fa-9def-1607135c4c1b could not be found. (HTTP 404) (Request-ID: req-80f1e105-3247-4160-9093-c6e886258b03) Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:27:32.336335 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f2846457-270c-47fa-9def-1607135c4c1b could not be found. Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f2846457-270c-47fa-9def-1607135c4c1b could not be found. Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f2846457-270c-47fa-9def-1607135c4c1b could not be found. Jul 20 04:27:32.343307 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:32.351122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d2f5a37c-5220-4d01-896c-aea70314fc1f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:32.351665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b1c1c632-f8be-4385-8cd5-3997970057dd tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Returning 404 to user: Snapshot f2846457-270c-47fa-9def-1607135c4c1b could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:32.351665 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b1c1c632-f8be-4385-8cd5-3997970057dd tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b" status: 404 len: 111 microversion: 2.1 time: 0.068257 Jul 20 04:27:32.352861 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1889/3831] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 04:27:32 2022] GET /compute/v2.1/os-snapshots/f2846457-270c-47fa-9def-1607135c4c1b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:32.354805 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d2f5a37c-5220-4d01-896c-aea70314fc1f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.864650 Jul 20 04:27:32.357128 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1943/3832] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:31 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:32.359234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-150016e3-d921-47be-9f64-6da43d207f73 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:32.360178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-150016e3-d921-47be-9f64-6da43d207f73 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:32.369369 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-150016e3-d921-47be-9f64-6da43d207f73 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:32.370164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-150016e3-d921-47be-9f64-6da43d207f73 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.371307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-150016e3-d921-47be-9f64-6da43d207f73 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:32.372046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-150016e3-d921-47be-9f64-6da43d207f73 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.377881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:32.378946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9e802094-7f55-4a67-a13f-5633285d2da3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:32.380630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9e802094-7f55-4a67-a13f-5633285d2da3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:32.415298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e802094-7f55-4a67-a13f-5633285d2da3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:32.417711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e802094-7f55-4a67-a13f-5633285d2da3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.422860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e802094-7f55-4a67-a13f-5633285d2da3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:32.424857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e802094-7f55-4a67-a13f-5633285d2da3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.472898 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9e802094-7f55-4a67-a13f-5633285d2da3 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108421 Jul 20 04:27:32.474310 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1944/3833] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:27:32 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:32.480057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-123c0ef1-c2a5-4ca7-8855-287c0f562fcd tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c45b160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:32.621446 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-123c0ef1-c2a5-4ca7-8855-287c0f562fcd tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3" status: 202 len: 0 microversion: 2.1 time: 0.144591 Jul 20 04:27:32.622317 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1945/3834] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:27:32 2022] DELETE /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:27:32.638565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4085e031-bacc-427c-b426-bd95cf8ec361 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c45b4c0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:32.753115 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4085e031-bacc-427c-b426-bd95cf8ec361 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3" status: 200 len: 345 microversion: 2.1 time: 0.126488 Jul 20 04:27:32.754237 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1946/3835] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:27:32 2022] GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:32.767932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-e9c5bf22-1e84-4e64-bcd5-8876398ccb59 req-c107acea-e929-498e-bf9c-1aa2903b7f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c037b53b-2303-44d0-bb77-c8fa405473bb", "name": "network-vif-unplugged", "status": "completed", "tag": "86571be8-3cd1-44e0-856c-952546489890"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:32.793799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e9c5bf22-1e84-4e64-bcd5-8876398ccb59 req-c107acea-e929-498e-bf9c-1aa2903b7f4d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:32.794178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e9c5bf22-1e84-4e64-bcd5-8876398ccb59 req-c107acea-e929-498e-bf9c-1aa2903b7f4d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.838534 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e9c5bf22-1e84-4e64-bcd5-8876398ccb59 req-c107acea-e929-498e-bf9c-1aa2903b7f4d service nova] Creating event network-vif-unplugged:86571be8-3cd1-44e0-856c-952546489890 for instance c037b53b-2303-44d0-bb77-c8fa405473bb on n-h2-764485-11 Jul 20 04:27:32.855385 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-e9c5bf22-1e84-4e64-bcd5-8876398ccb59 req-c107acea-e929-498e-bf9c-1aa2903b7f4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090670 Jul 20 04:27:32.856121 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1947/3836] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:33.297886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b836bfdb-fd29-468c-8d66-a819a5f6d622 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:33.298687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b836bfdb-fd29-468c-8d66-a819a5f6d622 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:33.311856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b836bfdb-fd29-468c-8d66-a819a5f6d622 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:33.312313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b836bfdb-fd29-468c-8d66-a819a5f6d622 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:33.313105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b836bfdb-fd29-468c-8d66-a819a5f6d622 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:33.313550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b836bfdb-fd29-468c-8d66-a819a5f6d622 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:33.918992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-150016e3-d921-47be-9f64-6da43d207f73 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:33.934541 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-150016e3-d921-47be-9f64-6da43d207f73 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1324 microversion: 2.1 time: 1.579227 Jul 20 04:27:33.938644 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1890/3837] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:32 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1324 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:33.946594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4fbb127d-a9c0-4fb4-88b5-1e9e033cc44f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:33.947741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4fbb127d-a9c0-4fb4-88b5-1e9e033cc44f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:33.966651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fbb127d-a9c0-4fb4-88b5-1e9e033cc44f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:33.967357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fbb127d-a9c0-4fb4-88b5-1e9e033cc44f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:33.970588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fbb127d-a9c0-4fb4-88b5-1e9e033cc44f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:33.971215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fbb127d-a9c0-4fb4-88b5-1e9e033cc44f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.344874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b836bfdb-fd29-468c-8d66-a819a5f6d622 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:34.358028 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b836bfdb-fd29-468c-8d66-a819a5f6d622 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1506 microversion: 2.1 time: 1.065190 Jul 20 04:27:34.358957 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1948/3838] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:33 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1506 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:34.363795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2ba0a6fc-b401-4382-953a-c43aebc8a8df tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:34.364728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2ba0a6fc-b401-4382-953a-c43aebc8a8df tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:34.381950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ba0a6fc-b401-4382-953a-c43aebc8a8df tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:34.382409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ba0a6fc-b401-4382-953a-c43aebc8a8df tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.383192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ba0a6fc-b401-4382-953a-c43aebc8a8df tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:34.383668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ba0a6fc-b401-4382-953a-c43aebc8a8df tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.450380 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2ba0a6fc-b401-4382-953a-c43aebc8a8df tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090301 Jul 20 04:27:34.450982 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1949/3839] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:27:34 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:34.467454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9b8c2a6d-a6a1-4129-91bf-ff05a360dad4 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c49d4c0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:34.572305 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9b8c2a6d-a6a1-4129-91bf-ff05a360dad4 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3" status: 200 len: 345 microversion: 2.1 time: 0.120249 Jul 20 04:27:34.572892 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1950/3840] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:27:34 2022] GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 => generated 345 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:34.582543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0bfe37eb-4a18-4d47-9035-177829a9d5e9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:34.583159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0bfe37eb-4a18-4d47-9035-177829a9d5e9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:34.603815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bfe37eb-4a18-4d47-9035-177829a9d5e9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:34.604503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bfe37eb-4a18-4d47-9035-177829a9d5e9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.605275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bfe37eb-4a18-4d47-9035-177829a9d5e9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:34.605723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bfe37eb-4a18-4d47-9035-177829a9d5e9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.868352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4fbb127d-a9c0-4fb4-88b5-1e9e033cc44f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:34.881049 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4fbb127d-a9c0-4fb4-88b5-1e9e033cc44f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1687 microversion: 2.1 time: 0.939257 Jul 20 04:27:34.884262 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1891/3841] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:33 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1687 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:35.178563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-462c7f0b-ba14-46b7-9d7b-d1ea15f3a1af tempest-AZV2TestJSON-1437145267 tempest-AZV2TestJSON-1437145267-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:35.181635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-462c7f0b-ba14-46b7-9d7b-d1ea15f3a1af tempest-AZV2TestJSON-1437145267 tempest-AZV2TestJSON-1437145267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.182317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-462c7f0b-ba14-46b7-9d7b-d1ea15f3a1af tempest-AZV2TestJSON-1437145267 tempest-AZV2TestJSON-1437145267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.184199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-462c7f0b-ba14-46b7-9d7b-d1ea15f3a1af tempest-AZV2TestJSON-1437145267 tempest-AZV2TestJSON-1437145267-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.184856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-462c7f0b-ba14-46b7-9d7b-d1ea15f3a1af tempest-AZV2TestJSON-1437145267 tempest-AZV2TestJSON-1437145267-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.218311 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-462c7f0b-ba14-46b7-9d7b-d1ea15f3a1af tempest-AZV2TestJSON-1437145267 tempest-AZV2TestJSON-1437145267-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.330059 Jul 20 04:27:35.232708 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1892/3842] 10.222.0.20 () {58 vars in 1163 bytes} [Wed Jul 20 04:27:34 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:27:35.246886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5a1f5218-d760-49e9-a371-46c2c8b7eb9e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:35.248532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a1f5218-d760-49e9-a371-46c2c8b7eb9e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:35.264271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:35.268395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a1f5218-d760-49e9-a371-46c2c8b7eb9e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.269282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a1f5218-d760-49e9-a371-46c2c8b7eb9e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.273576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a1f5218-d760-49e9-a371-46c2c8b7eb9e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.274394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a1f5218-d760-49e9-a371-46c2c8b7eb9e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.331838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0bfe37eb-4a18-4d47-9035-177829a9d5e9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:35.342370 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0bfe37eb-4a18-4d47-9035-177829a9d5e9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 200 len: 1506 microversion: 2.1 time: 0.763411 Jul 20 04:27:35.355868 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1951/3843] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:34 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 1506 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:35.361696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-752630b4-b1b8-476e-b206-caa46da76aa8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:35.369370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-752630b4-b1b8-476e-b206-caa46da76aa8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:35.384949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-752630b4-b1b8-476e-b206-caa46da76aa8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.388166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-752630b4-b1b8-476e-b206-caa46da76aa8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.389227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-752630b4-b1b8-476e-b206-caa46da76aa8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.390007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-752630b4-b1b8-476e-b206-caa46da76aa8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.446853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-752630b4-b1b8-476e-b206-caa46da76aa8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:35.639459 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-752630b4-b1b8-476e-b206-caa46da76aa8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "DELETE /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 204 len: 0 microversion: 2.1 time: 0.281152 Jul 20 04:27:35.640914 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1952/3844] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:35 2022] DELETE /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:35.654014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-685e42a9-8612-433a-b0e4-8a5ff7129d71 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:35.655612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-685e42a9-8612-433a-b0e4-8a5ff7129d71 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:35.672809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-685e42a9-8612-433a-b0e4-8a5ff7129d71 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.673825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-685e42a9-8612-433a-b0e4-8a5ff7129d71 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.676490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-685e42a9-8612-433a-b0e4-8a5ff7129d71 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.678928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-685e42a9-8612-433a-b0e4-8a5ff7129d71 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.756689 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-685e42a9-8612-433a-b0e4-8a5ff7129d71 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112684 Jul 20 04:27:35.759889 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1953/3845] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:27:35 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:35.771629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-99c5b7d7-6120-48d1-9b69-30e18b8ce2a6 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c40cdc0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:35.900777 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-99c5b7d7-6120-48d1-9b69-30e18b8ce2a6 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3" status: 200 len: 345 microversion: 2.1 time: 0.139391 Jul 20 04:27:35.902766 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1954/3846] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:27:35 2022] GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 => generated 345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:35.908221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-94c1608f-2387-4bd5-b078-844b92f4ae68 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:35.909223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-94c1608f-2387-4bd5-b078-844b92f4ae68 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:35.923577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94c1608f-2387-4bd5-b078-844b92f4ae68 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.924457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94c1608f-2387-4bd5-b078-844b92f4ae68 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.925540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94c1608f-2387-4bd5-b078-844b92f4ae68 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.943776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94c1608f-2387-4bd5-b078-844b92f4ae68 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.952275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:36.325691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a1f5218-d760-49e9-a371-46c2c8b7eb9e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:36.354998 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5a1f5218-d760-49e9-a371-46c2c8b7eb9e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1324 microversion: 2.1 time: 1.115344 Jul 20 04:27:36.356654 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1893/3847] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:35 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1324 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:36.361993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1376243429", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "9cdacc80-9ca0-43c9-ac06-5dd04d922b8c"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:36.402309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:36.449251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:36.464087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] validate_networks() for [('9cdacc80-9ca0-43c9-ac06-5dd04d922b8c', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:27:36.781467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94c1608f-2387-4bd5-b078-844b92f4ae68 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:36.800639 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-94c1608f-2387-4bd5-b078-844b92f4ae68 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1687 microversion: 2.1 time: 0.896461 Jul 20 04:27:36.809377 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1955/3848] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:35 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1687 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:36.829656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04143f5d-d000-4a46-8c30-5772f2dfb8db tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:36.832625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-04143f5d-d000-4a46-8c30-5772f2dfb8db tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:36.841401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04143f5d-d000-4a46-8c30-5772f2dfb8db tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.842237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04143f5d-d000-4a46-8c30-5772f2dfb8db tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.843304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04143f5d-d000-4a46-8c30-5772f2dfb8db tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.844017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04143f5d-d000-4a46-8c30-5772f2dfb8db tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.885174 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-04143f5d-d000-4a46-8c30-5772f2dfb8db tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071290 Jul 20 04:27:36.886781 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1956/3849] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:27:36 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:36.916393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49d5d9fd-2ebc-456e-b63e-5312d3bb904f tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c582820>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:36.985592 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-49d5d9fd-2ebc-456e-b63e-5312d3bb904f tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] HTTP exception thrown: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49d5d9fd-2ebc-456e-b63e-5312d3bb904f tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Request method failure captured: Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 HTTP/1.1 Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14QmEPJzge5lSLAm07ZEQ169Mp_Iq7ewpA4R7-GT9uRdaiOI0F5ergM17VBB9JMc_bu5bKeUBlY2qv6h5qn-o20SU3QwLOmPmVT_nIpkA45Ng5LMimBIvnaUbq_KpxbEpBla1RUyojOO7BMKxcTRvLnbpDSWrbI9V3k1gSjkU7IhGBM Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2113944b52454af2999b9784f72aba24 Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1839159869 Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2113944b52454af2999b9784f72aba24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2113944b52454af2999b9784f72aba24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2113944b52454af2999b9784f72aba24", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2113944b52454af2999b9784f72aba24"}]}] Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1839159869 Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2113944b52454af2999b9784f72aba24 Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1839159869 Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-VolumesSnapshotsTestJSON-1839159869-project Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 59f0115eed6d4189b12e47cf662638a0 Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1839159869-project Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: exception: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3'} Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. (HTTP 404) (Request-ID: req-e1809539-bc79-4403-bf58-120caa136a51) Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:27:36.989243 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49d5d9fd-2ebc-456e-b63e-5312d3bb904f tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Returning 404 to user: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-49d5d9fd-2ebc-456e-b63e-5312d3bb904f tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3" status: 404 len: 109 microversion: 2.1 time: 0.080100 Jul 20 04:27:36.994394 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1957/3850] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:27:36 2022] GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:37.006320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-792166b9-fcdf-41f8-88e4-374aa7a04668 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c45b280>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:37.057976 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-792166b9-fcdf-41f8-88e4-374aa7a04668 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] HTTP exception thrown: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-792166b9-fcdf-41f8-88e4-374aa7a04668 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Request method failure captured: Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 HTTP/1.1 Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14QmEPJzge5lSLAm07ZEQ169Mp_Iq7ewpA4R7-GT9uRdaiOI0F5ergM17VBB9JMc_bu5bKeUBlY2qv6h5qn-o20SU3QwLOmPmVT_nIpkA45Ng5LMimBIvnaUbq_KpxbEpBla1RUyojOO7BMKxcTRvLnbpDSWrbI9V3k1gSjkU7IhGBM Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2113944b52454af2999b9784f72aba24 Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1839159869 Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2113944b52454af2999b9784f72aba24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2113944b52454af2999b9784f72aba24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2113944b52454af2999b9784f72aba24", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2113944b52454af2999b9784f72aba24"}]}] Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1839159869 Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2113944b52454af2999b9784f72aba24 Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1839159869 Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-VolumesSnapshotsTestJSON-1839159869-project Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 59f0115eed6d4189b12e47cf662638a0 Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1839159869-project Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: exception: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3'} Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. (HTTP 404) (Request-ID: req-bcc7f078-6a44-480a-a470-689175c3e1d0) Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:27:37.059977 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-792166b9-fcdf-41f8-88e4-374aa7a04668 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Returning 404 to user: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-792166b9-fcdf-41f8-88e4-374aa7a04668 tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3" status: 404 len: 109 microversion: 2.1 time: 0.060965 Jul 20 04:27:37.065278 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1958/3851] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:27:36 2022] DELETE /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:37.070463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f5348d9c-f673-4df6-a841-f26f7f0d78ef tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Calling method '.version_select at 0x7fbf9c46c8b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:37.139846 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f5348d9c-f673-4df6-a841-f26f7f0d78ef tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] HTTP exception thrown: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f5348d9c-f673-4df6-a841-f26f7f0d78ef tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Request method failure captured: Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 HTTP/1.1 Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14QmEPJzge5lSLAm07ZEQ169Mp_Iq7ewpA4R7-GT9uRdaiOI0F5ergM17VBB9JMc_bu5bKeUBlY2qv6h5qn-o20SU3QwLOmPmVT_nIpkA45Ng5LMimBIvnaUbq_KpxbEpBla1RUyojOO7BMKxcTRvLnbpDSWrbI9V3k1gSjkU7IhGBM Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2113944b52454af2999b9784f72aba24 Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1839159869 Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2113944b52454af2999b9784f72aba24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2113944b52454af2999b9784f72aba24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2113944b52454af2999b9784f72aba24", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2113944b52454af2999b9784f72aba24"}]}] Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1839159869 Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2113944b52454af2999b9784f72aba24 Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1839159869 Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-VolumesSnapshotsTestJSON-1839159869-project Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 59f0115eed6d4189b12e47cf662638a0 Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1839159869-project Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: exception: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3'} Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. (HTTP 404) (Request-ID: req-721339c2-9d50-4c0c-8440-b66f70b3c65f) Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:27:37.141828 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f5348d9c-f673-4df6-a841-f26f7f0d78ef tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] Returning 404 to user: Volume 2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f5348d9c-f673-4df6-a841-f26f7f0d78ef tempest-VolumesSnapshotsTestJSON-1839159869 tempest-VolumesSnapshotsTestJSON-1839159869-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3" status: 404 len: 109 microversion: 2.1 time: 0.077030 Jul 20 04:27:37.147254 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1959/3852] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:27:37 2022] GET /compute/v2.1/os-volumes/2ca4eeeb-4ae6-4e30-90c2-b434a63cf4d3 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:37.372679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9b14186c-308d-444a-9ded-fe59bdc24e07 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:37.374890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9b14186c-308d-444a-9ded-fe59bdc24e07 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:37.392094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9b14186c-308d-444a-9ded-fe59bdc24e07 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:37.394679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9b14186c-308d-444a-9ded-fe59bdc24e07 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:37.398025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9b14186c-308d-444a-9ded-fe59bdc24e07 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:37.398919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9b14186c-308d-444a-9ded-fe59bdc24e07 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:37.421522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:39.158338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9b14186c-308d-444a-9ded-fe59bdc24e07 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:39.175904 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9b14186c-308d-444a-9ded-fe59bdc24e07 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1324 microversion: 2.1 time: 1.807610 Jul 20 04:27:39.176503 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1960/3853] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:37 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1324 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:39.196621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d81cf0e3-4162-4f34-b1c1-00e8b4e922b7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:39.197250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d81cf0e3-4162-4f34-b1c1-00e8b4e922b7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:39.225031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81cf0e3-4162-4f34-b1c1-00e8b4e922b7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.225523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81cf0e3-4162-4f34-b1c1-00e8b4e922b7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:39.226283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81cf0e3-4162-4f34-b1c1-00e8b4e922b7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.226725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81cf0e3-4162-4f34-b1c1-00e8b4e922b7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:40.973097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d81cf0e3-4162-4f34-b1c1-00e8b4e922b7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:41.007103 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d81cf0e3-4162-4f34-b1c1-00e8b4e922b7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 1.828288 Jul 20 04:27:41.009619 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1961/3854] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:39 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:41.046388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b3efa55-62b8-4259-8388-cbe68c66c64c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:41.053565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b3efa55-62b8-4259-8388-cbe68c66c64c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:41.077539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b3efa55-62b8-4259-8388-cbe68c66c64c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.079374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b3efa55-62b8-4259-8388-cbe68c66c64c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.081671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b3efa55-62b8-4259-8388-cbe68c66c64c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.083111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b3efa55-62b8-4259-8388-cbe68c66c64c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.175496 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b3efa55-62b8-4259-8388-cbe68c66c64c tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159711 Jul 20 04:27:41.179232 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1962/3855] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:27:41 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:41.196938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-cc5db434-6563-4d49-9bb4-590bdaa46f5d req-a25deb5f-d059-4e75-ab4f-a28df0a89df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c037b53b-2303-44d0-bb77-c8fa405473bb", "name": "network-vif-plugged", "status": "completed", "tag": "86571be8-3cd1-44e0-856c-952546489890"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:41.236817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cc5db434-6563-4d49-9bb4-590bdaa46f5d req-a25deb5f-d059-4e75-ab4f-a28df0a89df4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.237536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cc5db434-6563-4d49-9bb4-590bdaa46f5d req-a25deb5f-d059-4e75-ab4f-a28df0a89df4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.282272 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-cc5db434-6563-4d49-9bb4-590bdaa46f5d req-a25deb5f-d059-4e75-ab4f-a28df0a89df4 service nova] Creating event network-vif-plugged:86571be8-3cd1-44e0-856c-952546489890 for instance c037b53b-2303-44d0-bb77-c8fa405473bb on n-h2-764485-11 Jul 20 04:27:41.300598 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-cc5db434-6563-4d49-9bb4-590bdaa46f5d req-a25deb5f-d059-4e75-ab4f-a28df0a89df4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119728 Jul 20 04:27:41.301984 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1963/3856] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:41.329578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d07387bc-1ed3-4ec6-82bc-58467ed112a2 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:41.331963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d07387bc-1ed3-4ec6-82bc-58467ed112a2 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:41.356085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d07387bc-1ed3-4ec6-82bc-58467ed112a2 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.359000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d07387bc-1ed3-4ec6-82bc-58467ed112a2 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.361502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d07387bc-1ed3-4ec6-82bc-58467ed112a2 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.362056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d07387bc-1ed3-4ec6-82bc-58467ed112a2 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.864781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:27:41.865457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:27:41.866887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:27:41.867328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:27:41.867862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:27:41.891053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.891818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.892696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.893585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.952608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Getting quotas for project d582deaa5e004a74896f52dcd144ad78. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:41.966163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Getting quotas for user fbf1033ee8b84c3a89c31b2f44479f8b and project d582deaa5e004a74896f52dcd144ad78. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:42.005042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:27:42.008552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:27:42.103784 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-96783a18-98b4-4492-89dc-de4947f4eb30 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.745662 Jul 20 04:27:42.110505 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1894/3857] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 5753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:27:42.129918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d07387bc-1ed3-4ec6-82bc-58467ed112a2 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.131263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0b265d4b-eb0d-49a3-be28-aa86d621947c req-920dc6a6-db92-4f69-b9bc-9de2e8f8e405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956eebcb-bc8b-45dd-91ea-3a07ce83a20c", "name": "network-vif-deleted", "tag": "8412272b-9b7a-4804-b16d-98129e77eb04"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:42.138562 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d07387bc-1ed3-4ec6-82bc-58467ed112a2 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1324 microversion: 2.1 time: 0.833917 Jul 20 04:27:42.146287 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1964/3858] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:41 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1324 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:42.161011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-fa4ae626-9c97-4f64-99a8-04dd76f2f856 req-2ecde6f3-6c66-4a77-9786-b2a1613fafe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "773e7378-c53e-47f7-a8a9-f2ce1c9d217f", "tag": "368ef665-25d9-4f0e-ae65-a454f166a9d0"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:42.199190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0b265d4b-eb0d-49a3-be28-aa86d621947c req-920dc6a6-db92-4f69-b9bc-9de2e8f8e405 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.199701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0b265d4b-eb0d-49a3-be28-aa86d621947c req-920dc6a6-db92-4f69-b9bc-9de2e8f8e405 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.209851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-fa4ae626-9c97-4f64-99a8-04dd76f2f856 req-2ecde6f3-6c66-4a77-9786-b2a1613fafe2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.211847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-fa4ae626-9c97-4f64-99a8-04dd76f2f856 req-2ecde6f3-6c66-4a77-9786-b2a1613fafe2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.260732 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-fa4ae626-9c97-4f64-99a8-04dd76f2f856 req-2ecde6f3-6c66-4a77-9786-b2a1613fafe2 service nova] Creating event network-changed:368ef665-25d9-4f0e-ae65-a454f166a9d0 for instance 773e7378-c53e-47f7-a8a9-f2ce1c9d217f on n-h2-764485-11 Jul 20 04:27:42.261382 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0b265d4b-eb0d-49a3-be28-aa86d621947c req-920dc6a6-db92-4f69-b9bc-9de2e8f8e405 service nova] Creating event network-vif-deleted:8412272b-9b7a-4804-b16d-98129e77eb04 for instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c on n-h1-764485-11 Jul 20 04:27:42.278620 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-fa4ae626-9c97-4f64-99a8-04dd76f2f856 req-2ecde6f3-6c66-4a77-9786-b2a1613fafe2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130479 Jul 20 04:27:42.282295 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1965/3859] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:42.292407 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0b265d4b-eb0d-49a3-be28-aa86d621947c req-920dc6a6-db92-4f69-b9bc-9de2e8f8e405 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179443 Jul 20 04:27:42.302912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cf58cea8-048a-49cf-a098-db38e1dd8186 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:42.304972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cf58cea8-048a-49cf-a098-db38e1dd8186 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:42.305153 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1895/3860] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:42.315997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:42.332276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-72807c16-289d-41ca-96ee-ab049233c2be tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:42.335294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-72807c16-289d-41ca-96ee-ab049233c2be tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:42.342632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf58cea8-048a-49cf-a098-db38e1dd8186 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.343250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf58cea8-048a-49cf-a098-db38e1dd8186 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.345345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf58cea8-048a-49cf-a098-db38e1dd8186 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.348634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf58cea8-048a-49cf-a098-db38e1dd8186 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.701591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-72807c16-289d-41ca-96ee-ab049233c2be tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.710751 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-72807c16-289d-41ca-96ee-ab049233c2be tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1218 microversion: 2.1 time: 0.403121 Jul 20 04:27:42.711369 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1896/3861] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:42 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1218 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:42.733122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa94733b-1a7e-4672-88ca-8333b8f95782 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:42.734067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa94733b-1a7e-4672-88ca-8333b8f95782 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:42.762871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa94733b-1a7e-4672-88ca-8333b8f95782 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.767930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa94733b-1a7e-4672-88ca-8333b8f95782 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.769364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa94733b-1a7e-4672-88ca-8333b8f95782 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.772284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa94733b-1a7e-4672-88ca-8333b8f95782 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.886561 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fa94733b-1a7e-4672-88ca-8333b8f95782 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.173892 Jul 20 04:27:42.894663 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1897/3862] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:27:42 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b/os-volume_attachments => generated 25 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:27:43.591842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cf58cea8-048a-49cf-a098-db38e1dd8186 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.600909 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cf58cea8-048a-49cf-a098-db38e1dd8186 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 1.317057 Jul 20 04:27:43.607718 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1966/3863] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:42 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:43.612920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d95553cd-cbf0-4130-823d-0bf055104d73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:43.615256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d95553cd-cbf0-4130-823d-0bf055104d73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:43.635215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d95553cd-cbf0-4130-823d-0bf055104d73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.638461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d95553cd-cbf0-4130-823d-0bf055104d73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.653592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d95553cd-cbf0-4130-823d-0bf055104d73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.654347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d95553cd-cbf0-4130-823d-0bf055104d73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.697405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-961011765", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:43.755149 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-d95553cd-cbf0-4130-823d-0bf055104d73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] HTTP exception thrown: Cannot 'reboot' instance 425d15e8-b80e-4921-89e1-c81e97829f29 while it is in vm_state rescued Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d95553cd-cbf0-4130-823d-0bf055104d73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Request method failure captured: Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29/action HTTP/1.1 Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 28 Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14LpvtEmNd4QrXIrUEvb-GSk-Q8Zjd0l-zF-kIlevLuoBgLZ_00_u1yvp6j7dRA_htG5kpVqZoVpEsFwn0RHk_cOjeEIbaoK3R2iKcoauuThhWzyvVf6At0QhXQxlwDjTmkqLnzcd5YkB5Z5aPRc9SOgHjbdPHPXD-aflxJrD9yhloY Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ba21f0dfdc04e41a9a30fa3dddf3e90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}] Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: a25a4e3b560846ec98b871b954481f09 Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: {"reboot": {"type": "HARD"}} Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: exception: Cannot 'reboot' instance 425d15e8-b80e-4921-89e1-c81e97829f29 while it is in vm_state rescued Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '425d15e8-b80e-4921-89e1-c81e97829f29', 'body': {'reboot': {'type': 'HARD'}}} Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 425d15e8-b80e-4921-89e1-c81e97829f29 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:27:43.757144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:27:43.762312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 425d15e8-b80e-4921-89e1-c81e97829f29 while it is in vm_state rescued Jul 20 04:27:43.762312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:43.762312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:43.762312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:43.762312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:43.762312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:43.762312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:43.762312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:43.762312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:43.762312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 425d15e8-b80e-4921-89e1-c81e97829f29 while it is in vm_state rescued Jul 20 04:27:43.762312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:43.781075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d95553cd-cbf0-4130-823d-0bf055104d73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Returning 409 to user: Cannot 'reboot' instance 425d15e8-b80e-4921-89e1-c81e97829f29 while it is in vm_state rescued {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:43.783266 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d95553cd-cbf0-4130-823d-0bf055104d73 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29/action" status: 409 len: 145 microversion: 2.1 time: 0.174238 Jul 20 04:27:43.788165 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1967/3864] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:27:43 2022] POST /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29/action => generated 145 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:27:43.798323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b40a4343-d415-4528-b14d-3f8f3822dd46 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:43.817085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b40a4343-d415-4528-b14d-3f8f3822dd46 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:43.838019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] validate_networks() for [('21342575-0af4-45cf-b915-261134658c11', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:27:43.846427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b40a4343-d415-4528-b14d-3f8f3822dd46 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.856691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b40a4343-d415-4528-b14d-3f8f3822dd46 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.857799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b40a4343-d415-4528-b14d-3f8f3822dd46 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.858692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b40a4343-d415-4528-b14d-3f8f3822dd46 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.362657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b40a4343-d415-4528-b14d-3f8f3822dd46 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:44.376293 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b40a4343-d415-4528-b14d-3f8f3822dd46 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1324 microversion: 2.1 time: 0.586703 Jul 20 04:27:44.377872 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1968/3865] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:43 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1324 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:44.399353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-035676a5-11d7-4906-aec7-607fe9b07c09 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:44.403589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-035676a5-11d7-4906-aec7-607fe9b07c09 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:44.425234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-035676a5-11d7-4906-aec7-607fe9b07c09 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.429629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-035676a5-11d7-4906-aec7-607fe9b07c09 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.430734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-035676a5-11d7-4906-aec7-607fe9b07c09 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.432689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-035676a5-11d7-4906-aec7-607fe9b07c09 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.859658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-035676a5-11d7-4906-aec7-607fe9b07c09 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:44.875792 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-035676a5-11d7-4906-aec7-607fe9b07c09 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1270 microversion: 2.1 time: 0.492433 Jul 20 04:27:44.876794 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1969/3866] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:44 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1270 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:44.892626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9d904806-f384-4d94-82b0-900c4d39db4a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:44.895055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9d904806-f384-4d94-82b0-900c4d39db4a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:44.909165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d904806-f384-4d94-82b0-900c4d39db4a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.911356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d904806-f384-4d94-82b0-900c4d39db4a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.912472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d904806-f384-4d94-82b0-900c4d39db4a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.915551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d904806-f384-4d94-82b0-900c4d39db4a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:45.005680 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-9d904806-f384-4d94-82b0-900c4d39db4a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] HTTP exception thrown: Cannot 'rebuild' instance 425d15e8-b80e-4921-89e1-c81e97829f29 while it is in vm_state rescued Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9d904806-f384-4d94-82b0-900c4d39db4a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Request method failure captured: Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29/action HTTP/1.1 Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 65 Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14LpvtEmNd4QrXIrUEvb-GSk-Q8Zjd0l-zF-kIlevLuoBgLZ_00_u1yvp6j7dRA_htG5kpVqZoVpEsFwn0RHk_cOjeEIbaoK3R2iKcoauuThhWzyvVf6At0QhXQxlwDjTmkqLnzcd5YkB5Z5aPRc9SOgHjbdPHPXD-aflxJrD9yhloY Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ba21f0dfdc04e41a9a30fa3dddf3e90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}] Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: a25a4e3b560846ec98b871b954481f09 Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: exception: Cannot 'rebuild' instance 425d15e8-b80e-4921-89e1-c81e97829f29 while it is in vm_state rescued Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '425d15e8-b80e-4921-89e1-c81e97829f29', 'body': {'rebuild': {'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55'}}} Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 425d15e8-b80e-4921-89e1-c81e97829f29 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:45.010667 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 425d15e8-b80e-4921-89e1-c81e97829f29 while it is in vm_state rescued Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 425d15e8-b80e-4921-89e1-c81e97829f29 while it is in vm_state rescued Jul 20 04:27:45.015552 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:45.023341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9d904806-f384-4d94-82b0-900c4d39db4a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Returning 409 to user: Cannot 'rebuild' instance 425d15e8-b80e-4921-89e1-c81e97829f29 while it is in vm_state rescued {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:45.027132 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9d904806-f384-4d94-82b0-900c4d39db4a tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "POST /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29/action" status: 409 len: 146 microversion: 2.1 time: 0.147939 Jul 20 04:27:45.034169 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1970/3867] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:27:44 2022] POST /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29/action => generated 146 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:27:45.049069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-736a1e89-ff9f-45d8-bdf8-84d2cf81676c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:45.062398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-736a1e89-ff9f-45d8-bdf8-84d2cf81676c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:45.082780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-736a1e89-ff9f-45d8-bdf8-84d2cf81676c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:45.089794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-736a1e89-ff9f-45d8-bdf8-84d2cf81676c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:45.092992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-736a1e89-ff9f-45d8-bdf8-84d2cf81676c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:45.096326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-736a1e89-ff9f-45d8-bdf8-84d2cf81676c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:45.449712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:27:45.455934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:27:45.457023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:27:45.457679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:27:45.458334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:27:45.480704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:45.481870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:45.487463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:45.488019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:45.548722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Getting quotas for project e1a37e6cca334ee693d9d8ae5345c155. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:45.562664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Getting quotas for user f850c33c9ec04a7980db7386c854f00f and project e1a37e6cca334ee693d9d8ae5345c155. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:45.612946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:27:45.629273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:27:45.767834 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1c228271-a582-4eaf-845e-35eb19a15920 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.868587 Jul 20 04:27:45.768506 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1898/3868] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 2871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:27:45.794652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0483cc42-6ec8-41a0-bf72-e9fa3823d0a6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:45.795166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0483cc42-6ec8-41a0-bf72-e9fa3823d0a6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:45.824729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0483cc42-6ec8-41a0-bf72-e9fa3823d0a6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:45.825481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0483cc42-6ec8-41a0-bf72-e9fa3823d0a6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:45.833511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0483cc42-6ec8-41a0-bf72-e9fa3823d0a6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:45.834004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0483cc42-6ec8-41a0-bf72-e9fa3823d0a6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:45.908502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0483cc42-6ec8-41a0-bf72-e9fa3823d0a6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:46.084470 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0483cc42-6ec8-41a0-bf72-e9fa3823d0a6 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 204 len: 0 microversion: 2.1 time: 0.303088 Jul 20 04:27:46.085895 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1899/3869] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:45 2022] DELETE /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:46.128015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3a0946af-cd97-452b-b20f-ae05e4d21b1e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:46.128807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3a0946af-cd97-452b-b20f-ae05e4d21b1e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:46.150320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a0946af-cd97-452b-b20f-ae05e4d21b1e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.150724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a0946af-cd97-452b-b20f-ae05e4d21b1e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.154753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a0946af-cd97-452b-b20f-ae05e4d21b1e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.158056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a0946af-cd97-452b-b20f-ae05e4d21b1e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.352723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3a0946af-cd97-452b-b20f-ae05e4d21b1e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:47.379330 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3a0946af-cd97-452b-b20f-ae05e4d21b1e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1324 microversion: 2.1 time: 1.271926 Jul 20 04:27:47.382660 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1900/3870] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:46 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1324 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:47.395793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6545a339-4475-44a1-9ff9-fac51027bf2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:47.401722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6545a339-4475-44a1-9ff9-fac51027bf2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:47.432007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6545a339-4475-44a1-9ff9-fac51027bf2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.437553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6545a339-4475-44a1-9ff9-fac51027bf2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.453319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6545a339-4475-44a1-9ff9-fac51027bf2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.457402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6545a339-4475-44a1-9ff9-fac51027bf2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.675904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-736a1e89-ff9f-45d8-bdf8-84d2cf81676c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:47.689140 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-736a1e89-ff9f-45d8-bdf8-84d2cf81676c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 2.651678 Jul 20 04:27:47.689984 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1971/3871] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:45 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 2655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:47.703923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-113a5596-20dd-4023-ba80-20b5f419afbf tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:47.706365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-113a5596-20dd-4023-ba80-20b5f419afbf tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:47.727110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6545a339-4475-44a1-9ff9-fac51027bf2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:47.727593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-113a5596-20dd-4023-ba80-20b5f419afbf tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.728292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-113a5596-20dd-4023-ba80-20b5f419afbf tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.733697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-113a5596-20dd-4023-ba80-20b5f419afbf tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.734604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-113a5596-20dd-4023-ba80-20b5f419afbf tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.747739 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6545a339-4475-44a1-9ff9-fac51027bf2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1217 microversion: 2.1 time: 0.359656 Jul 20 04:27:47.748867 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1901/3872] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:47 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1217 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:47.762057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9c693edf-daf3-4017-aba3-0236cfe7629f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:47.762985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9c693edf-daf3-4017-aba3-0236cfe7629f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:47.777328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c693edf-daf3-4017-aba3-0236cfe7629f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.778937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c693edf-daf3-4017-aba3-0236cfe7629f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.780398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c693edf-daf3-4017-aba3-0236cfe7629f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.783145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c693edf-daf3-4017-aba3-0236cfe7629f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:48.747364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-113a5596-20dd-4023-ba80-20b5f419afbf tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:48.755236 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-113a5596-20dd-4023-ba80-20b5f419afbf tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1318 microversion: 2.1 time: 1.062443 Jul 20 04:27:48.765828 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1972/3873] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:47 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1318 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:48.786241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bc3bfc31-e78e-4ce5-bfd1-77ece9e2921d tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:48.790492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bc3bfc31-e78e-4ce5-bfd1-77ece9e2921d tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:48.827003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc3bfc31-e78e-4ce5-bfd1-77ece9e2921d tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:48.827812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc3bfc31-e78e-4ce5-bfd1-77ece9e2921d tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:48.828841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc3bfc31-e78e-4ce5-bfd1-77ece9e2921d tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:48.830474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc3bfc31-e78e-4ce5-bfd1-77ece9e2921d tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:49.211939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9c693edf-daf3-4017-aba3-0236cfe7629f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:49.232357 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9c693edf-daf3-4017-aba3-0236cfe7629f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1690 microversion: 2.1 time: 1.482209 Jul 20 04:27:49.234603 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1902/3874] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:47 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1690 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:49.257426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-05b20162-8300-4710-a913-2ca34f9b5c00 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:49.259284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-05b20162-8300-4710-a913-2ca34f9b5c00 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:49.268195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05b20162-8300-4710-a913-2ca34f9b5c00 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:49.268942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05b20162-8300-4710-a913-2ca34f9b5c00 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:49.270845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05b20162-8300-4710-a913-2ca34f9b5c00 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:49.271618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05b20162-8300-4710-a913-2ca34f9b5c00 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:49.828569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bc3bfc31-e78e-4ce5-bfd1-77ece9e2921d tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:49.879998 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bc3bfc31-e78e-4ce5-bfd1-77ece9e2921d tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1324 microversion: 2.1 time: 1.084461 Jul 20 04:27:49.879998 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1973/3875] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:48 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1324 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:49.884294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f027a8d0-846e-4432-9dd2-2564a7cf565f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:49.886276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f027a8d0-846e-4432-9dd2-2564a7cf565f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:49.904296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f027a8d0-846e-4432-9dd2-2564a7cf565f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:49.906461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f027a8d0-846e-4432-9dd2-2564a7cf565f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:49.909768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f027a8d0-846e-4432-9dd2-2564a7cf565f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:49.910782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f027a8d0-846e-4432-9dd2-2564a7cf565f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.402330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f027a8d0-846e-4432-9dd2-2564a7cf565f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:50.415925 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f027a8d0-846e-4432-9dd2-2564a7cf565f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1271 microversion: 2.1 time: 0.546643 Jul 20 04:27:50.424913 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1974/3876] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:49 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1271 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:50.448847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7fb03c70-fc0d-4f78-b163-4936df313cab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:50.451049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7fb03c70-fc0d-4f78-b163-4936df313cab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:50.467523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7fb03c70-fc0d-4f78-b163-4936df313cab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.469719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7fb03c70-fc0d-4f78-b163-4936df313cab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.472088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7fb03c70-fc0d-4f78-b163-4936df313cab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.474105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7fb03c70-fc0d-4f78-b163-4936df313cab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.814371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-05b20162-8300-4710-a913-2ca34f9b5c00 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:50.824123 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-05b20162-8300-4710-a913-2ca34f9b5c00 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 1.573080 Jul 20 04:27:50.827893 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1903/3877] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:49 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:50.839179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0113ccea-c298-488a-9e6e-0f140f3c4671 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:50.840301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0113ccea-c298-488a-9e6e-0f140f3c4671 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:50.859584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0113ccea-c298-488a-9e6e-0f140f3c4671 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.860361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0113ccea-c298-488a-9e6e-0f140f3c4671 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.861370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0113ccea-c298-488a-9e6e-0f140f3c4671 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.862026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0113ccea-c298-488a-9e6e-0f140f3c4671 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.256774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0113ccea-c298-488a-9e6e-0f140f3c4671 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:52.268736 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0113ccea-c298-488a-9e6e-0f140f3c4671 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1690 microversion: 2.1 time: 1.438530 Jul 20 04:27:52.271032 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1904/3878] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:50 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1690 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:52.285131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fcf1849a-4395-45f8-8f43-c1a4f46477c0 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:52.287447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fcf1849a-4395-45f8-8f43-c1a4f46477c0 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:52.315247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fcf1849a-4395-45f8-8f43-c1a4f46477c0 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.315760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fcf1849a-4395-45f8-8f43-c1a4f46477c0 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.316878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fcf1849a-4395-45f8-8f43-c1a4f46477c0 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.317352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fcf1849a-4395-45f8-8f43-c1a4f46477c0 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.590246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7fb03c70-fc0d-4f78-b163-4936df313cab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:52.600617 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7fb03c70-fc0d-4f78-b163-4936df313cab tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1318 microversion: 2.1 time: 2.171634 Jul 20 04:27:52.604825 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1975/3879] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:50 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1318 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:52.617089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-102e0592-e7a2-44f9-b70a-299639e0dd1a req-a6cdf1a6-774d-47dc-89b3-9b6ed268635e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "773e7378-c53e-47f7-a8a9-f2ce1c9d217f", "name": "network-vif-plugged", "status": "completed", "tag": "368ef665-25d9-4f0e-ae65-a454f166a9d0"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:52.640157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-102e0592-e7a2-44f9-b70a-299639e0dd1a req-a6cdf1a6-774d-47dc-89b3-9b6ed268635e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.640987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-102e0592-e7a2-44f9-b70a-299639e0dd1a req-a6cdf1a6-774d-47dc-89b3-9b6ed268635e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.668668 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-102e0592-e7a2-44f9-b70a-299639e0dd1a req-a6cdf1a6-774d-47dc-89b3-9b6ed268635e service nova] Creating event network-vif-plugged:368ef665-25d9-4f0e-ae65-a454f166a9d0 for instance 773e7378-c53e-47f7-a8a9-f2ce1c9d217f on n-h2-764485-11 Jul 20 04:27:52.685211 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-102e0592-e7a2-44f9-b70a-299639e0dd1a req-a6cdf1a6-774d-47dc-89b3-9b6ed268635e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078009 Jul 20 04:27:52.687734 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1976/3880] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:52.706888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7691aba0-8698-467a-be95-80a1b89ab69d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:52.709360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7691aba0-8698-467a-be95-80a1b89ab69d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:52.740474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7691aba0-8698-467a-be95-80a1b89ab69d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.741162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7691aba0-8698-467a-be95-80a1b89ab69d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.745810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7691aba0-8698-467a-be95-80a1b89ab69d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.746684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7691aba0-8698-467a-be95-80a1b89ab69d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.816935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:53.024062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7691aba0-8698-467a-be95-80a1b89ab69d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:53.046750 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7691aba0-8698-467a-be95-80a1b89ab69d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1271 microversion: 2.1 time: 0.357376 Jul 20 04:27:53.047687 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1977/3881] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:52 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1271 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:53.056656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da3302a0-5b8f-42ee-84c8-2cce33fd80e5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:53.058134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-da3302a0-5b8f-42ee-84c8-2cce33fd80e5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:53.087965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da3302a0-5b8f-42ee-84c8-2cce33fd80e5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.089440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da3302a0-5b8f-42ee-84c8-2cce33fd80e5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:53.093073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da3302a0-5b8f-42ee-84c8-2cce33fd80e5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.093726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da3302a0-5b8f-42ee-84c8-2cce33fd80e5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:53.790312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fcf1849a-4395-45f8-8f43-c1a4f46477c0 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:53.821701 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fcf1849a-4395-45f8-8f43-c1a4f46477c0 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1324 microversion: 2.1 time: 1.548952 Jul 20 04:27:53.831737 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1905/3882] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:52 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1324 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:53.839718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8370daef-74ac-4a44-935d-1b0ace65e13e req-692688dd-a0a4-4426-b2fd-9e7a0d462528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d9ab53-f449-4a04-b486-8b0779bb779d", "tag": "6a4b8160-93fd-4f13-8a8f-fc94796544fd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:53.858509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8370daef-74ac-4a44-935d-1b0ace65e13e req-692688dd-a0a4-4426-b2fd-9e7a0d462528 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.860023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8370daef-74ac-4a44-935d-1b0ace65e13e req-692688dd-a0a4-4426-b2fd-9e7a0d462528 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:53.891149 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8370daef-74ac-4a44-935d-1b0ace65e13e req-692688dd-a0a4-4426-b2fd-9e7a0d462528 service nova] Creating event network-changed:6a4b8160-93fd-4f13-8a8f-fc94796544fd for instance 36d9ab53-f449-4a04-b486-8b0779bb779d on n-h1-764485-11 Jul 20 04:27:53.912740 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8370daef-74ac-4a44-935d-1b0ace65e13e req-692688dd-a0a4-4426-b2fd-9e7a0d462528 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078413 Jul 20 04:27:53.915736 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1906/3883] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:53.931095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4093fb92-154e-4109-9a3a-3b11a956bd9f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:53.933018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4093fb92-154e-4109-9a3a-3b11a956bd9f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:53.952996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4093fb92-154e-4109-9a3a-3b11a956bd9f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.972833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4093fb92-154e-4109-9a3a-3b11a956bd9f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:53.973856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4093fb92-154e-4109-9a3a-3b11a956bd9f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.976303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4093fb92-154e-4109-9a3a-3b11a956bd9f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.370314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-da3302a0-5b8f-42ee-84c8-2cce33fd80e5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:54.389008 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da3302a0-5b8f-42ee-84c8-2cce33fd80e5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 1.340324 Jul 20 04:27:54.399993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4093fb92-154e-4109-9a3a-3b11a956bd9f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:54.401173 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1978/3884] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:53 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:54.416923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-20b29656-8a01-4d64-ae82-93467e4f9857 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:54.420785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-20b29656-8a01-4d64-ae82-93467e4f9857 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:54.430549 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4093fb92-154e-4109-9a3a-3b11a956bd9f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1622 microversion: 2.1 time: 0.512514 Jul 20 04:27:54.449436 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1907/3885] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:53 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1622 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:54.461176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cb55a0a6-e2d3-4869-8f0b-f38481dedb42 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:54.464923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20b29656-8a01-4d64-ae82-93467e4f9857 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.465716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20b29656-8a01-4d64-ae82-93467e4f9857 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.466724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20b29656-8a01-4d64-ae82-93467e4f9857 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.467392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20b29656-8a01-4d64-ae82-93467e4f9857 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.468303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cb55a0a6-e2d3-4869-8f0b-f38481dedb42 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:54.506408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb55a0a6-e2d3-4869-8f0b-f38481dedb42 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.506892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb55a0a6-e2d3-4869-8f0b-f38481dedb42 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.509136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb55a0a6-e2d3-4869-8f0b-f38481dedb42 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.513598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb55a0a6-e2d3-4869-8f0b-f38481dedb42 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:55.338687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-20b29656-8a01-4d64-ae82-93467e4f9857 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:55.351799 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-20b29656-8a01-4d64-ae82-93467e4f9857 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1318 microversion: 2.1 time: 0.949245 Jul 20 04:27:55.360390 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1979/3886] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:54 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1318 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:55.371275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ea18e274-fc1c-4e7f-be84-d7915628ddcb req-defd82ce-a893-4716-831f-76d3e45e3853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e1887b-7d01-481c-a707-dd7d60a9a97b", "name": "network-vif-unplugged", "status": "completed", "tag": "4e249346-af6b-4c8d-98eb-93eec710477c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:55.405438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ea18e274-fc1c-4e7f-be84-d7915628ddcb req-defd82ce-a893-4716-831f-76d3e45e3853 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:55.410870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ea18e274-fc1c-4e7f-be84-d7915628ddcb req-defd82ce-a893-4716-831f-76d3e45e3853 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:55.425390 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ea18e274-fc1c-4e7f-be84-d7915628ddcb req-defd82ce-a893-4716-831f-76d3e45e3853 service nova] Creating event network-vif-unplugged:4e249346-af6b-4c8d-98eb-93eec710477c for instance 45e1887b-7d01-481c-a707-dd7d60a9a97b on n-h1-764485-11 Jul 20 04:27:55.441990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cb55a0a6-e2d3-4869-8f0b-f38481dedb42 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:55.445005 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ea18e274-fc1c-4e7f-be84-d7915628ddcb req-defd82ce-a893-4716-831f-76d3e45e3853 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082703 Jul 20 04:27:55.445721 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1980/3887] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:55.457945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74f6d06c-f66a-45b6-94dd-5e48f0f691a8 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:55.462665 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cb55a0a6-e2d3-4869-8f0b-f38481dedb42 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1313 microversion: 2.1 time: 1.017730 Jul 20 04:27:55.464556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74f6d06c-f66a-45b6-94dd-5e48f0f691a8 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:55.466714 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1908/3888] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:54 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1313 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:55.487140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-44072661-5f9a-4772-945d-5a8e6bf62809 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:55.489068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f6d06c-f66a-45b6-94dd-5e48f0f691a8 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:55.489523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f6d06c-f66a-45b6-94dd-5e48f0f691a8 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:55.490303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f6d06c-f66a-45b6-94dd-5e48f0f691a8 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:55.490881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-44072661-5f9a-4772-945d-5a8e6bf62809 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:55.491122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f6d06c-f66a-45b6-94dd-5e48f0f691a8 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:55.511833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44072661-5f9a-4772-945d-5a8e6bf62809 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:55.512816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44072661-5f9a-4772-945d-5a8e6bf62809 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:55.514963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44072661-5f9a-4772-945d-5a8e6bf62809 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:55.515724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44072661-5f9a-4772-945d-5a8e6bf62809 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:55.533646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:55.562099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:55.596723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=14 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:56.107378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-44072661-5f9a-4772-945d-5a8e6bf62809 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:56.121707 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-44072661-5f9a-4772-945d-5a8e6bf62809 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 0.651819 Jul 20 04:27:56.132605 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1909/3889] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:55 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:56.147742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d6d8a3da-49a9-4587-a6ff-a3f136f866fa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:56.156532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d6d8a3da-49a9-4587-a6ff-a3f136f866fa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:56.175435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6d8a3da-49a9-4587-a6ff-a3f136f866fa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:56.182660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6d8a3da-49a9-4587-a6ff-a3f136f866fa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:56.183564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6d8a3da-49a9-4587-a6ff-a3f136f866fa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:56.191336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6d8a3da-49a9-4587-a6ff-a3f136f866fa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:56.565204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d6d8a3da-49a9-4587-a6ff-a3f136f866fa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:56.577888 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d6d8a3da-49a9-4587-a6ff-a3f136f866fa tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 200 len: 1331 microversion: 2.1 time: 0.443477 Jul 20 04:27:56.594132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-74f6d06c-f66a-45b6-94dd-5e48f0f691a8 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:56.612981 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74f6d06c-f66a-45b6-94dd-5e48f0f691a8 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1520 microversion: 2.1 time: 1.166032 Jul 20 04:27:56.624185 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1910/3890] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:56 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 1331 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:56.635967 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1981/3891] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:55 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1520 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:56.654005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-50de0b00-f8d8-4ca7-bd4e-ccb8d321018f req-c2ef44f0-8cd1-438f-9b3b-d44a82f5134a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e1887b-7d01-481c-a707-dd7d60a9a97b", "name": "network-vif-deleted", "tag": "4e249346-af6b-4c8d-98eb-93eec710477c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:56.684693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-50de0b00-f8d8-4ca7-bd4e-ccb8d321018f req-c2ef44f0-8cd1-438f-9b3b-d44a82f5134a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:56.685416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-50de0b00-f8d8-4ca7-bd4e-ccb8d321018f req-c2ef44f0-8cd1-438f-9b3b-d44a82f5134a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:56.700049 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-50de0b00-f8d8-4ca7-bd4e-ccb8d321018f req-c2ef44f0-8cd1-438f-9b3b-d44a82f5134a service nova] Creating event network-vif-deleted:4e249346-af6b-4c8d-98eb-93eec710477c for instance 45e1887b-7d01-481c-a707-dd7d60a9a97b on n-h1-764485-11 Jul 20 04:27:56.717744 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-50de0b00-f8d8-4ca7-bd4e-ccb8d321018f req-c2ef44f0-8cd1-438f-9b3b-d44a82f5134a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080033 Jul 20 04:27:56.722876 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1982/3892] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:56.742418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8edab9e6-9714-48d8-94b3-85fed9977780 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:56.747991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8edab9e6-9714-48d8-94b3-85fed9977780 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:56.776934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8edab9e6-9714-48d8-94b3-85fed9977780 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:56.779213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8edab9e6-9714-48d8-94b3-85fed9977780 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:56.781327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8edab9e6-9714-48d8-94b3-85fed9977780 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:56.786421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8edab9e6-9714-48d8-94b3-85fed9977780 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:57.262491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2d82822-c732-4857-ab00-d094c76e03df tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Action: 'create', calling method: .version_select at 0x7fbf9d3854c0>, body: {"keypair": {"name": "tempest-keypair-636263257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfDROZE+yZ2FHNjJ3k1AM2XtQ2srCGgDTrgLnGRLGMj5YFFadKvxUhYlKQXzqQmIXpJWFYjHHfYq0JQsOZGnsr9TQjaOhD0foldDOtt66WwXwCzwXgSA0XfzJARb6eScw=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:57.302383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c2d82822-c732-4857-ab00-d094c76e03df tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Getting quotas for project a18380616f974a7eb7e798cae18a13d0. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:57.314301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c2d82822-c732-4857-ab00-d094c76e03df tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Getting quotas for user 3269f1507e534b3ca92190602926eaa4 and project a18380616f974a7eb7e798cae18a13d0. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:57.375143 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2d82822-c732-4857-ab00-d094c76e03df tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.748718 Jul 20 04:27:57.379597 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1911/3893] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:27:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:57.396511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ab793cee-2eb6-48c5-8cf6-b6d88bd11d4e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:57.403876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ab793cee-2eb6-48c5-8cf6-b6d88bd11d4e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:57.414679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab793cee-2eb6-48c5-8cf6-b6d88bd11d4e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:57.415598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab793cee-2eb6-48c5-8cf6-b6d88bd11d4e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:57.417040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab793cee-2eb6-48c5-8cf6-b6d88bd11d4e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:57.419755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab793cee-2eb6-48c5-8cf6-b6d88bd11d4e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:57.583255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8edab9e6-9714-48d8-94b3-85fed9977780 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:57.595586 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8edab9e6-9714-48d8-94b3-85fed9977780 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1318 microversion: 2.1 time: 0.870281 Jul 20 04:27:57.599370 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1983/3894] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:56 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1318 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:57.609839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ff123caa-f2f6-4867-bbf3-207bb0475c1e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1289400182", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "33f1ce61-d383-4a8c-8e63-b9df66a1622a"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ff123caa-f2f6-4867-bbf3-207bb0475c1e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Request method failure captured: Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 243 Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Qq3PGqAEE19MS-GcrfO4ytvWBk9q4FerRkE0rnqCQLcZ8KNcvDpiF6Jbe1_Y24bqxw4O6tRYdSsEZrOLwIYY8pUU_-FRzics6-zsG_jBIc2vyMnIfET7k6Zs07rSHPKGS2rGcODKR-bd7SB8ryNttaA5EEMy3kFb72zzgO5aywXsI Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca00c658fb854aa1abfd6e6549a928bb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}] Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3883da20a4a54cd091663d353d6f4072 Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1289400182", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "33f1ce61-d383-4a8c-8e63-b9df66a1622a"}]}} Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1289400182', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '33f1ce61-d383-4a8c-8e63-b9df66a1622a'}]}}} Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:57.621651 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:57.628373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:57.633082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ff123caa-f2f6-4867-bbf3-207bb0475c1e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:57.636246 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ff123caa-f2f6-4867-bbf3-207bb0475c1e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.035563 Jul 20 04:27:57.643251 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1984/3895] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:57 2022] POST /compute/v2.1/servers => generated 175 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:57.660942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c69a2715-0c46-4771-a9ea-8ed031d1905c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:57.664996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c69a2715-0c46-4771-a9ea-8ed031d1905c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:57.687078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c69a2715-0c46-4771-a9ea-8ed031d1905c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:57.688002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c69a2715-0c46-4771-a9ea-8ed031d1905c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:57.690785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c69a2715-0c46-4771-a9ea-8ed031d1905c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:57.691795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c69a2715-0c46-4771-a9ea-8ed031d1905c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:58.104934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c69a2715-0c46-4771-a9ea-8ed031d1905c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:58.114234 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c69a2715-0c46-4771-a9ea-8ed031d1905c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 0.468390 Jul 20 04:27:58.140865 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1985/3896] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:57 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:58.164631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5ff7a24e-3f7e-4059-ad86-6ee78f95bf85 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:58.169195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5ff7a24e-3f7e-4059-ad86-6ee78f95bf85 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 45e1887b-7d01-481c-a707-dd7d60a9a97b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:58.201755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ff7a24e-3f7e-4059-ad86-6ee78f95bf85 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:58.219873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ff7a24e-3f7e-4059-ad86-6ee78f95bf85 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:58.221098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ff7a24e-3f7e-4059-ad86-6ee78f95bf85 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:58.221673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ff7a24e-3f7e-4059-ad86-6ee78f95bf85 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:58.232726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ab793cee-2eb6-48c5-8cf6-b6d88bd11d4e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:58.250713 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ab793cee-2eb6-48c5-8cf6-b6d88bd11d4e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1313 microversion: 2.1 time: 0.869585 Jul 20 04:27:58.264608 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1912/3897] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:57 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1313 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:58.278322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b53942a2-5134-4c01-9b9c-9d91518b866a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:58.283944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b53942a2-5134-4c01-9b9c-9d91518b866a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 311c29bb-5a97-4d84-9860-eb0b669b8695] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:58.286465 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-5ff7a24e-3f7e-4059-ad86-6ee78f95bf85 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] HTTP exception thrown: Instance 45e1887b-7d01-481c-a707-dd7d60a9a97b could not be found. Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5ff7a24e-3f7e-4059-ad86-6ee78f95bf85 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Request method failure captured: Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b HTTP/1.1 Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14LpvtEmNd4QrXIrUEvb-GSk-Q8Zjd0l-zF-kIlevLuoBgLZ_00_u1yvp6j7dRA_htG5kpVqZoVpEsFwn0RHk_cOjeEIbaoK3R2iKcoauuThhWzyvVf6At0QhXQxlwDjTmkqLnzcd5YkB5Z5aPRc9SOgHjbdPHPXD-aflxJrD9yhloY Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ba21f0dfdc04e41a9a30fa3dddf3e90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}] Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: a25a4e3b560846ec98b871b954481f09 Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 45e1887b-7d01-481c-a707-dd7d60a9a97b could not be found. Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '45e1887b-7d01-481c-a707-dd7d60a9a97b'} Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e1887b-7d01-481c-a707-dd7d60a9a97b could not be found. Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e1887b-7d01-481c-a707-dd7d60a9a97b could not be found. Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.294296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.299703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.299703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.299703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.299703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.299703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:58.299703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:58.299703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e1887b-7d01-481c-a707-dd7d60a9a97b could not be found. Jul 20 04:27:58.299703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.301405 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b53942a2-5134-4c01-9b9c-9d91518b866a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] HTTP exception thrown: Instance 311c29bb-5a97-4d84-9860-eb0b669b8695 could not be found. Jul 20 04:27:58.302476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5ff7a24e-3f7e-4059-ad86-6ee78f95bf85 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Returning 404 to user: Instance 45e1887b-7d01-481c-a707-dd7d60a9a97b could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:58.303637 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5ff7a24e-3f7e-4059-ad86-6ee78f95bf85 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b" status: 404 len: 111 microversion: 2.1 time: 0.167564 Jul 20 04:27:58.304857 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1986/3898] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:58 2022] GET /compute/v2.1/servers/45e1887b-7d01-481c-a707-dd7d60a9a97b => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b53942a2-5134-4c01-9b9c-9d91518b866a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Request method failure captured: Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/311c29bb-5a97-4d84-9860-eb0b669b8695/metadata HTTP/1.1 Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Qq3PGqAEE19MS-GcrfO4ytvWBk9q4FerRkE0rnqCQLcZ8KNcvDpiF6Jbe1_Y24bqxw4O6tRYdSsEZrOLwIYY8pUU_-FRzics6-zsG_jBIc2vyMnIfET7k6Zs07rSHPKGS2rGcODKR-bd7SB8ryNttaA5EEMy3kFb72zzgO5aywXsI Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca00c658fb854aa1abfd6e6549a928bb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}] Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 3883da20a4a54cd091663d353d6f4072 Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 311c29bb-5a97-4d84-9860-eb0b669b8695 could not be found. Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'server_id': '311c29bb-5a97-4d84-9860-eb0b669b8695'} Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311c29bb-5a97-4d84-9860-eb0b669b8695 could not be found. Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311c29bb-5a97-4d84-9860-eb0b669b8695 could not be found. Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.315025 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.321123 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:58.321123 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:58.321123 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311c29bb-5a97-4d84-9860-eb0b669b8695 could not be found. Jul 20 04:27:58.321123 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.325402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b53942a2-5134-4c01-9b9c-9d91518b866a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Returning 404 to user: Instance 311c29bb-5a97-4d84-9860-eb0b669b8695 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:58.326581 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b53942a2-5134-4c01-9b9c-9d91518b866a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/311c29bb-5a97-4d84-9860-eb0b669b8695/metadata" status: 404 len: 111 microversion: 2.1 time: 0.060625 Jul 20 04:27:58.327297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e86904c9-acda-4466-8cc9-a4d3f2d0a477 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '.version_select at 0x7fbf9c38de50>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:58.327862 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1913/3899] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:27:58 2022] GET /compute/v2.1/servers/311c29bb-5a97-4d84-9860-eb0b669b8695/metadata => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:58.396038 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e86904c9-acda-4466-8cc9-a4d3f2d0a477 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129299152" status: 202 len: 0 microversion: 2.1 time: 0.077189 Jul 20 04:27:58.397644 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1987/3900] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 04:27:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129299152 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:27:58.419173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2636aae1-0f21-4ee3-a2a6-3e1d2ff07e5d tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1968336398", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "33f1ce61-d383-4a8c-8e63-b9df66a1622a"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2636aae1-0f21-4ee3-a2a6-3e1d2ff07e5d tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Request method failure captured: Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 499 Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Qq3PGqAEE19MS-GcrfO4ytvWBk9q4FerRkE0rnqCQLcZ8KNcvDpiF6Jbe1_Y24bqxw4O6tRYdSsEZrOLwIYY8pUU_-FRzics6-zsG_jBIc2vyMnIfET7k6Zs07rSHPKGS2rGcODKR-bd7SB8ryNttaA5EEMy3kFb72zzgO5aywXsI Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca00c658fb854aa1abfd6e6549a928bb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}] Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 3883da20a4a54cd091663d353d6f4072 Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1968336398", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "33f1ce61-d383-4a8c-8e63-b9df66a1622a"}]}} Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1968336398', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '33f1ce61-d383-4a8c-8e63-b9df66a1622a'}]}}} Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:27:58.428778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.433096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.439212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2636aae1-0f21-4ee3-a2a6-3e1d2ff07e5d tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:58.442816 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2636aae1-0f21-4ee3-a2a6-3e1d2ff07e5d tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.029302 Jul 20 04:27:58.444598 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1914/3901] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:58 2022] POST /compute/v2.1/servers => generated 687 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:58.524765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d7901bd-feb6-426c-9b1f-d1a63dc7f25b tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1272432508", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "33f1ce61-d383-4a8c-8e63-b9df66a1622a"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d7901bd-feb6-426c-9b1f-d1a63dc7f25b tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Request method failure captured: Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 500 Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Qq3PGqAEE19MS-GcrfO4ytvWBk9q4FerRkE0rnqCQLcZ8KNcvDpiF6Jbe1_Y24bqxw4O6tRYdSsEZrOLwIYY8pUU_-FRzics6-zsG_jBIc2vyMnIfET7k6Zs07rSHPKGS2rGcODKR-bd7SB8ryNttaA5EEMy3kFb72zzgO5aywXsI Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca00c658fb854aa1abfd6e6549a928bb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}] Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3883da20a4a54cd091663d353d6f4072 Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1272432508", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "33f1ce61-d383-4a8c-8e63-b9df66a1622a"}]}} Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1272432508', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '33f1ce61-d383-4a8c-8e63-b9df66a1622a'}]}}} Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:27:58.529580 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.533743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d7901bd-feb6-426c-9b1f-d1a63dc7f25b tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:58.537567 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5d7901bd-feb6-426c-9b1f-d1a63dc7f25b tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.016680 Jul 20 04:27:58.538117 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1988/3902] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:58 2022] POST /compute/v2.1/servers => generated 689 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:27:58.619968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-75e1cb6f-4d3a-4b5d-90bd-2ee7dc7b7e6b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:58.619968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-75e1cb6f-4d3a-4b5d-90bd-2ee7dc7b7e6b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:58.627728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5753ba3-807f-4881-9a13-96830fd5f862 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1351224123", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "33f1ce61-d383-4a8c-8e63-b9df66a1622a"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5753ba3-807f-4881-9a13-96830fd5f862 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Request method failure captured: Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 754 Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Qq3PGqAEE19MS-GcrfO4ytvWBk9q4FerRkE0rnqCQLcZ8KNcvDpiF6Jbe1_Y24bqxw4O6tRYdSsEZrOLwIYY8pUU_-FRzics6-zsG_jBIc2vyMnIfET7k6Zs07rSHPKGS2rGcODKR-bd7SB8ryNttaA5EEMy3kFb72zzgO5aywXsI Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca00c658fb854aa1abfd6e6549a928bb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}] Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3883da20a4a54cd091663d353d6f4072 Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1351224123", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "33f1ce61-d383-4a8c-8e63-b9df66a1622a"}]}} Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1351224123', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '33f1ce61-d383-4a8c-8e63-b9df66a1622a'}]}}} Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:58.633915 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:58.637979 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:58.641310 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.641310 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.644724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5753ba3-807f-4881-9a13-96830fd5f862 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:58.652505 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d5753ba3-807f-4881-9a13-96830fd5f862 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.029534 Jul 20 04:27:58.654676 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1989/3903] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:58 2022] POST /compute/v2.1/servers => generated 1197 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jul 20 04:27:58.654841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75e1cb6f-4d3a-4b5d-90bd-2ee7dc7b7e6b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:58.664716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75e1cb6f-4d3a-4b5d-90bd-2ee7dc7b7e6b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:58.666709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75e1cb6f-4d3a-4b5d-90bd-2ee7dc7b7e6b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:58.668786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75e1cb6f-4d3a-4b5d-90bd-2ee7dc7b7e6b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:58.785772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4672fc22-0e42-4fb1-8a26-4e1cd20971f3 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1742589207", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "33f1ce61-d383-4a8c-8e63-b9df66a1622a"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4672fc22-0e42-4fb1-8a26-4e1cd20971f3 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Request method failure captured: Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 1266 Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Qq3PGqAEE19MS-GcrfO4ytvWBk9q4FerRkE0rnqCQLcZ8KNcvDpiF6Jbe1_Y24bqxw4O6tRYdSsEZrOLwIYY8pUU_-FRzics6-zsG_jBIc2vyMnIfET7k6Zs07rSHPKGS2rGcODKR-bd7SB8ryNttaA5EEMy3kFb72zzgO5aywXsI Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca00c658fb854aa1abfd6e6549a928bb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}] Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3883da20a4a54cd091663d353d6f4072 Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1742589207", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "33f1ce61-d383-4a8c-8e63-b9df66a1622a"}]}} Jul 20 04:27:58.796517 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1742589207', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '33f1ce61-d383-4a8c-8e63-b9df66a1622a'}]}}} Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.800471 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:58.801960 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:58.805585 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:27:58.805585 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.808775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4672fc22-0e42-4fb1-8a26-4e1cd20971f3 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:58.812413 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4672fc22-0e42-4fb1-8a26-4e1cd20971f3 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.032515 Jul 20 04:27:58.815037 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1990/3904] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Jul 20 04:27:58 2022] POST /compute/v2.1/servers => generated 2221 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 20 04:27:58.878757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-92c00dc3-bdf3-43cb-9065-dafe5f15fa91 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:58.893375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-92c00dc3-bdf3-43cb-9065-dafe5f15fa91 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 0137efc6-5e67-403c-a3a2-e20e26a60529] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:58.926858 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-92c00dc3-bdf3-43cb-9065-dafe5f15fa91 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] HTTP exception thrown: Instance 0137efc6-5e67-403c-a3a2-e20e26a60529 could not be found. Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-92c00dc3-bdf3-43cb-9065-dafe5f15fa91 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Request method failure captured: Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/0137efc6-5e67-403c-a3a2-e20e26a60529/metadata/test2 HTTP/1.1 Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Qq3PGqAEE19MS-GcrfO4ytvWBk9q4FerRkE0rnqCQLcZ8KNcvDpiF6Jbe1_Y24bqxw4O6tRYdSsEZrOLwIYY8pUU_-FRzics6-zsG_jBIc2vyMnIfET7k6Zs07rSHPKGS2rGcODKR-bd7SB8ryNttaA5EEMy3kFb72zzgO5aywXsI Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca00c658fb854aa1abfd6e6549a928bb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}] Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3883da20a4a54cd091663d353d6f4072 Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 0137efc6-5e67-403c-a3a2-e20e26a60529 could not be found. Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'server_id': '0137efc6-5e67-403c-a3a2-e20e26a60529', 'id': 'test2'} Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0137efc6-5e67-403c-a3a2-e20e26a60529 could not be found. Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0137efc6-5e67-403c-a3a2-e20e26a60529 could not be found. Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:58.940278 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:58.946175 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:58.946175 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:58.946175 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0137efc6-5e67-403c-a3a2-e20e26a60529 could not be found. Jul 20 04:27:58.946175 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:27:58.949783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-92c00dc3-bdf3-43cb-9065-dafe5f15fa91 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Returning 404 to user: Instance 0137efc6-5e67-403c-a3a2-e20e26a60529 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:58.957068 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-92c00dc3-bdf3-43cb-9065-dafe5f15fa91 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/0137efc6-5e67-403c-a3a2-e20e26a60529/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.132311 Jul 20 04:27:58.964797 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1991/3905] 10.222.0.20 () {58 vars in 1280 bytes} [Wed Jul 20 04:27:58 2022] GET /compute/v2.1/servers/0137efc6-5e67-403c-a3a2-e20e26a60529/metadata/test2 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:58.991147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3df47cb4-3ce9-4a56-8ee2-4ee47d861d4a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:58.991445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3df47cb4-3ce9-4a56-8ee2-4ee47d861d4a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:59.026531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3df47cb4-3ce9-4a56-8ee2-4ee47d861d4a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:59.033897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3df47cb4-3ce9-4a56-8ee2-4ee47d861d4a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:59.047117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3df47cb4-3ce9-4a56-8ee2-4ee47d861d4a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:59.048360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3df47cb4-3ce9-4a56-8ee2-4ee47d861d4a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:59.182378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3df47cb4-3ce9-4a56-8ee2-4ee47d861d4a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:59.411828 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3df47cb4-3ce9-4a56-8ee2-4ee47d861d4a tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "DELETE /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 204 len: 0 microversion: 2.1 time: 0.431162 Jul 20 04:27:59.415564 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1992/3906] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:58 2022] DELETE /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:59.432291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-75e1cb6f-4d3a-4b5d-90bd-2ee7dc7b7e6b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:59.438378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-8cf59a34-95eb-47e0-b7ff-03460f37e30d req-7d36cea2-de82-428e-9917-26a62051f193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3e1ac9-4958-4b26-b26b-b21a0c35be26", "tag": "ddaf2de6-3964-405a-8c9c-f2b502893883"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:59.451660 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-75e1cb6f-4d3a-4b5d-90bd-2ee7dc7b7e6b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1318 microversion: 2.1 time: 0.838365 Jul 20 04:27:59.453758 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1915/3907] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:58 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:59.459702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-8cf59a34-95eb-47e0-b7ff-03460f37e30d req-7d36cea2-de82-428e-9917-26a62051f193 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:59.462252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-8cf59a34-95eb-47e0-b7ff-03460f37e30d req-7d36cea2-de82-428e-9917-26a62051f193 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:59.484629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7cde18b3-25e2-4bee-8ece-a8c6307fca72 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:59.489040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7cde18b3-25e2-4bee-8ece-a8c6307fca72 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:59.492915 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-8cf59a34-95eb-47e0-b7ff-03460f37e30d req-7d36cea2-de82-428e-9917-26a62051f193 service nova] Creating event network-changed:ddaf2de6-3964-405a-8c9c-f2b502893883 for instance af3e1ac9-4958-4b26-b26b-b21a0c35be26 on n-h2-764485-11 Jul 20 04:27:59.504011 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-8cf59a34-95eb-47e0-b7ff-03460f37e30d req-7d36cea2-de82-428e-9917-26a62051f193 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083569 Jul 20 04:27:59.508624 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1993/3908] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:59.521659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-069eb0f4-eb21-47a6-9901-40131d6900d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:59.523960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-069eb0f4-eb21-47a6-9901-40131d6900d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:59.540045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-069eb0f4-eb21-47a6-9901-40131d6900d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:59.542404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-069eb0f4-eb21-47a6-9901-40131d6900d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:59.545862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-069eb0f4-eb21-47a6-9901-40131d6900d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:59.546728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-069eb0f4-eb21-47a6-9901-40131d6900d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:59.547969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7cde18b3-25e2-4bee-8ece-a8c6307fca72 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:59.548591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7cde18b3-25e2-4bee-8ece-a8c6307fca72 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:59.557328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7cde18b3-25e2-4bee-8ece-a8c6307fca72 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:59.557898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7cde18b3-25e2-4bee-8ece-a8c6307fca72 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:00.107043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7cde18b3-25e2-4bee-8ece-a8c6307fca72 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:00.119280 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7cde18b3-25e2-4bee-8ece-a8c6307fca72 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 0.661145 Jul 20 04:28:00.123036 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1916/3909] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:59 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:00.129719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5c8431ab-1479-4074-bfc9-93a2cf53f84f tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:00.130638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5c8431ab-1479-4074-bfc9-93a2cf53f84f tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:00.150040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c8431ab-1479-4074-bfc9-93a2cf53f84f tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:00.152821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c8431ab-1479-4074-bfc9-93a2cf53f84f tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:00.153871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c8431ab-1479-4074-bfc9-93a2cf53f84f tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:00.156984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c8431ab-1479-4074-bfc9-93a2cf53f84f tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:00.775389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-069eb0f4-eb21-47a6-9901-40131d6900d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:00.784418 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-069eb0f4-eb21-47a6-9901-40131d6900d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1313 microversion: 2.1 time: 1.272947 Jul 20 04:28:00.788290 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1994/3910] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:59 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1313 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:01.289319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5c8431ab-1479-4074-bfc9-93a2cf53f84f tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:01.310834 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5c8431ab-1479-4074-bfc9-93a2cf53f84f tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1526 microversion: 2.1 time: 1.186203 Jul 20 04:28:01.312202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1270010795", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "e96165be-36c7-40d3-ba95-0b516f17441a"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:01.321856 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1917/3911] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:00 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1526 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:01.336871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-961cebe2-c662-4176-b791-4926128c4b5b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:01.341247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-961cebe2-c662-4176-b791-4926128c4b5b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:01.361559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-961cebe2-c662-4176-b791-4926128c4b5b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:01.364678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-961cebe2-c662-4176-b791-4926128c4b5b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:01.368785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-961cebe2-c662-4176-b791-4926128c4b5b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:01.370360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-961cebe2-c662-4176-b791-4926128c4b5b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:01.425537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] validate_networks() for [('e96165be-36c7-40d3-ba95-0b516f17441a', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:02.524653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-961cebe2-c662-4176-b791-4926128c4b5b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:02.535836 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-961cebe2-c662-4176-b791-4926128c4b5b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1318 microversion: 2.1 time: 1.219643 Jul 20 04:28:02.540456 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1918/3912] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:01 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1318 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:02.558751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-15378c0d-9e60-43c2-925f-81aa9219b5fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:02.562248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-15378c0d-9e60-43c2-925f-81aa9219b5fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:02.577371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15378c0d-9e60-43c2-925f-81aa9219b5fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.577837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15378c0d-9e60-43c2-925f-81aa9219b5fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:02.578630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15378c0d-9e60-43c2-925f-81aa9219b5fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.579259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15378c0d-9e60-43c2-925f-81aa9219b5fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:03.089062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:03.089589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:03.089977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:03.090402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:03.090830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:03.105826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:03.106292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:03.107103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:03.107585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:03.143629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Getting quotas for project 7384f1853e4443ae932c8effd5fffad4. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:03.152669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Getting quotas for user e924df2458ab4aaf87dacb79e43a926c and project 7384f1853e4443ae932c8effd5fffad4. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:03.192222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:03.213320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:03.342967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-15378c0d-9e60-43c2-925f-81aa9219b5fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:03.366756 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-15378c0d-9e60-43c2-925f-81aa9219b5fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 0.824507 Jul 20 04:28:03.400352 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1919/3913] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:02 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:03.404488 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-03430302-9818-4dcb-8514-dbfeabb9b374 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.609178 Jul 20 04:28:03.412090 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1995/3914] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:28:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2623 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:28:03.424908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-40c4bfb3-0cd4-48e3-a70c-06d6418c357c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:03.425280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "c5da486b-29a8-47f5-82fb-686b8ece0d34"}], "security_groups": [{"name": "tempest-securitygroup--102060454"}], "key_name": "tempest-keypair-636263257", "user_data": "}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:03.427810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40c4bfb3-0cd4-48e3-a70c-06d6418c357c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:03.457199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40c4bfb3-0cd4-48e3-a70c-06d6418c357c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:03.458008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40c4bfb3-0cd4-48e3-a70c-06d6418c357c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:03.460890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40c4bfb3-0cd4-48e3-a70c-06d6418c357c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:03.461650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40c4bfb3-0cd4-48e3-a70c-06d6418c357c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:03.779352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-40c4bfb3-0cd4-48e3-a70c-06d6418c357c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:03.796987 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-40c4bfb3-0cd4-48e3-a70c-06d6418c357c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1313 microversion: 2.1 time: 0.378920 Jul 20 04:28:03.798075 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1996/3915] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:03 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:03.812760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a2e49ac1-b63b-42e3-9a38-258649ff236e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:03.816302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a2e49ac1-b63b-42e3-9a38-258649ff236e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:03.835257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2e49ac1-b63b-42e3-9a38-258649ff236e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:03.837204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2e49ac1-b63b-42e3-9a38-258649ff236e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:03.842025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2e49ac1-b63b-42e3-9a38-258649ff236e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:03.843282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2e49ac1-b63b-42e3-9a38-258649ff236e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:04.039285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] validate_networks() for [('c5da486b-29a8-47f5-82fb-686b8ece0d34', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:04.876305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a2e49ac1-b63b-42e3-9a38-258649ff236e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3883da20a4a54cd091663d353d6f4072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca00c658fb854aa1abfd6e6549a928bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:04.890307 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a2e49ac1-b63b-42e3-9a38-258649ff236e tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 200 len: 1526 microversion: 2.1 time: 1.086086 Jul 20 04:28:04.891278 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1997/3916] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:03 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 1526 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:04.904803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-86a58fb5-d33c-4d13-8fd6-32aad0f89384 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:04.914371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-86a58fb5-d33c-4d13-8fd6-32aad0f89384 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:04.944228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86a58fb5-d33c-4d13-8fd6-32aad0f89384 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:04.944839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86a58fb5-d33c-4d13-8fd6-32aad0f89384 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:04.945753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86a58fb5-d33c-4d13-8fd6-32aad0f89384 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:04.946424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86a58fb5-d33c-4d13-8fd6-32aad0f89384 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:05.169211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:06.191321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-86a58fb5-d33c-4d13-8fd6-32aad0f89384 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:06.206345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-86a58fb5-d33c-4d13-8fd6-32aad0f89384 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:06.207718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-86a58fb5-d33c-4d13-8fd6-32aad0f89384 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:06.217008 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-86a58fb5-d33c-4d13-8fd6-32aad0f89384 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 200 len: 1311 microversion: 2.21 time: 1.317625 Jul 20 04:28:06.221524 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1998/3917] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:04 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 1311 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:06.230541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-89b5b65e-d7f4-4019-a2d8-9e8c5c3eb928 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:06.238788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-89b5b65e-d7f4-4019-a2d8-9e8c5c3eb928 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:06.255572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89b5b65e-d7f4-4019-a2d8-9e8c5c3eb928 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.256312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89b5b65e-d7f4-4019-a2d8-9e8c5c3eb928 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.260354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89b5b65e-d7f4-4019-a2d8-9e8c5c3eb928 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.261133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89b5b65e-d7f4-4019-a2d8-9e8c5c3eb928 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.276287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:06.276936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:06.277496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:06.277927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:06.278510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:06.306066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.306578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.307427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.307913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.408446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Getting quotas for project a18380616f974a7eb7e798cae18a13d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:06.428245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Getting quotas for user 3269f1507e534b3ca92190602926eaa4 and project a18380616f974a7eb7e798cae18a13d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:06.462471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:06.469256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:06.673003 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-57df4197-940f-40ec-9f4a-fc0f1294c8eb tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.270748 Jul 20 04:28:06.677114 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1920/3918] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:28:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 3276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:28:06.685484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-cc9dddc3-d42b-4e79-994c-30e234b8b448 req-737b6925-18ba-40d5-9709-a8b707653fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d9ab53-f449-4a04-b486-8b0779bb779d", "name": "network-vif-plugged", "status": "completed", "tag": "6a4b8160-93fd-4f13-8a8f-fc94796544fd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:06.706959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-cc9dddc3-d42b-4e79-994c-30e234b8b448 req-737b6925-18ba-40d5-9709-a8b707653fa4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.707416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-cc9dddc3-d42b-4e79-994c-30e234b8b448 req-737b6925-18ba-40d5-9709-a8b707653fa4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.742636 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-cc9dddc3-d42b-4e79-994c-30e234b8b448 req-737b6925-18ba-40d5-9709-a8b707653fa4 service nova] Creating event network-vif-plugged:6a4b8160-93fd-4f13-8a8f-fc94796544fd for instance 36d9ab53-f449-4a04-b486-8b0779bb779d on n-h1-764485-11 Jul 20 04:28:06.774020 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-cc9dddc3-d42b-4e79-994c-30e234b8b448 req-737b6925-18ba-40d5-9709-a8b707653fa4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094837 Jul 20 04:28:06.777891 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1921/3919] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:06.796538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-89b5b65e-d7f4-4019-a2d8-9e8c5c3eb928 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:06.799597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-21e3b584-5b5b-4252-9a8a-4a5c9a88afda tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:06.802599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-21e3b584-5b5b-4252-9a8a-4a5c9a88afda tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:06.810936 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-89b5b65e-d7f4-4019-a2d8-9e8c5c3eb928 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1318 microversion: 2.1 time: 0.587684 Jul 20 04:28:06.821783 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 1999/3920] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:06 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1318 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:06.835050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2f3c1a64-c925-4668-a0e4-4085d7e48329 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:06.837017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2f3c1a64-c925-4668-a0e4-4085d7e48329 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:06.846431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21e3b584-5b5b-4252-9a8a-4a5c9a88afda tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.848847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f3c1a64-c925-4668-a0e4-4085d7e48329 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.849550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f3c1a64-c925-4668-a0e4-4085d7e48329 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.850578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f3c1a64-c925-4668-a0e4-4085d7e48329 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.851279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f3c1a64-c925-4668-a0e4-4085d7e48329 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.851443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21e3b584-5b5b-4252-9a8a-4a5c9a88afda tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.853666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21e3b584-5b5b-4252-9a8a-4a5c9a88afda tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:06.855585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21e3b584-5b5b-4252-9a8a-4a5c9a88afda tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.532734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f3c1a64-c925-4668-a0e4-4085d7e48329 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:09.548957 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2f3c1a64-c925-4668-a0e4-4085d7e48329 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1313 microversion: 2.1 time: 2.723813 Jul 20 04:28:09.549572 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2000/3921] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:06 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1313 bytes in 2726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:09.565611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-335196ad-a17f-43d6-945d-c889aba191d7 req-faa8e80f-bd60-4cf8-b206-c1be07500ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "773e7378-c53e-47f7-a8a9-f2ce1c9d217f", "name": "network-vif-deleted", "tag": "368ef665-25d9-4f0e-ae65-a454f166a9d0"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:09.592626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-335196ad-a17f-43d6-945d-c889aba191d7 req-faa8e80f-bd60-4cf8-b206-c1be07500ea9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:09.594044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-335196ad-a17f-43d6-945d-c889aba191d7 req-faa8e80f-bd60-4cf8-b206-c1be07500ea9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.615581 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-335196ad-a17f-43d6-945d-c889aba191d7 req-faa8e80f-bd60-4cf8-b206-c1be07500ea9 service nova] Creating event network-vif-deleted:368ef665-25d9-4f0e-ae65-a454f166a9d0 for instance 773e7378-c53e-47f7-a8a9-f2ce1c9d217f on n-h2-764485-11 Jul 20 04:28:09.622015 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-335196ad-a17f-43d6-945d-c889aba191d7 req-faa8e80f-bd60-4cf8-b206-c1be07500ea9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065089 Jul 20 04:28:09.622210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-21e3b584-5b5b-4252-9a8a-4a5c9a88afda tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:09.623912 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2001/3922] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:09.633940 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-21e3b584-5b5b-4252-9a8a-4a5c9a88afda tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 2.849727 Jul 20 04:28:09.639924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eea2626f-4d58-4076-9cd4-430f72479480 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:09.641185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eea2626f-4d58-4076-9cd4-430f72479480 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] [instance: 773e7378-c53e-47f7-a8a9-f2ce1c9d217f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:09.652355 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1922/3923] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:06 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 2874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:09.668624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eea2626f-4d58-4076-9cd4-430f72479480 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:09.669410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eea2626f-4d58-4076-9cd4-430f72479480 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.670373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eea2626f-4d58-4076-9cd4-430f72479480 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:09.671209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eea2626f-4d58-4076-9cd4-430f72479480 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.678231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9f27490-8366-41c7-9e19-45dee097b09c tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:09.678861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e9f27490-8366-41c7-9e19-45dee097b09c tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:09.698737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9f27490-8366-41c7-9e19-45dee097b09c tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:09.703120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9f27490-8366-41c7-9e19-45dee097b09c tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.704356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9f27490-8366-41c7-9e19-45dee097b09c tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:09.705096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9f27490-8366-41c7-9e19-45dee097b09c tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.705355 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-eea2626f-4d58-4076-9cd4-430f72479480 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] HTTP exception thrown: Instance 773e7378-c53e-47f7-a8a9-f2ce1c9d217f could not be found. Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eea2626f-4d58-4076-9cd4-430f72479480 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Request method failure captured: Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f HTTP/1.1 Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Qq3PGqAEE19MS-GcrfO4ytvWBk9q4FerRkE0rnqCQLcZ8KNcvDpiF6Jbe1_Y24bqxw4O6tRYdSsEZrOLwIYY8pUU_-FRzics6-zsG_jBIc2vyMnIfET7k6Zs07rSHPKGS2rGcODKR-bd7SB8ryNttaA5EEMy3kFb72zzgO5aywXsI Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca00c658fb854aa1abfd6e6549a928bb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca00c658fb854aa1abfd6e6549a928bb"}]}] Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ca00c658fb854aa1abfd6e6549a928bb Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-109548929 Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3883da20a4a54cd091663d353d6f4072 Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-109548929-project Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 773e7378-c53e-47f7-a8a9-f2ce1c9d217f could not be found. Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '773e7378-c53e-47f7-a8a9-f2ce1c9d217f'} Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 773e7378-c53e-47f7-a8a9-f2ce1c9d217f could not be found. Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 773e7378-c53e-47f7-a8a9-f2ce1c9d217f could not be found. Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:28:09.708413 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:09.713594 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:28:09.713594 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:09.713594 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:09.713594 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:09.713594 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:09.713594 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:09.713594 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 773e7378-c53e-47f7-a8a9-f2ce1c9d217f could not be found. Jul 20 04:28:09.713594 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:28:09.713594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eea2626f-4d58-4076-9cd4-430f72479480 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] Returning 404 to user: Instance 773e7378-c53e-47f7-a8a9-f2ce1c9d217f could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:09.715648 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eea2626f-4d58-4076-9cd4-430f72479480 tempest-ServerMetadataNegativeTestJSON-109548929 tempest-ServerMetadataNegativeTestJSON-109548929-project] 10.222.0.20 "GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f" status: 404 len: 111 microversion: 2.1 time: 0.088065 Jul 20 04:28:09.731599 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2002/3924] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:09 2022] GET /compute/v2.1/servers/773e7378-c53e-47f7-a8a9-f2ce1c9d217f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:28:09.749312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4d1461c5-5fa2-4f6e-ad64-8e4ddf33dc8f tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:09.753188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4d1461c5-5fa2-4f6e-ad64-8e4ddf33dc8f tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:09.769239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d1461c5-5fa2-4f6e-ad64-8e4ddf33dc8f tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:09.769973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d1461c5-5fa2-4f6e-ad64-8e4ddf33dc8f tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.770950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d1461c5-5fa2-4f6e-ad64-8e4ddf33dc8f tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:09.771586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d1461c5-5fa2-4f6e-ad64-8e4ddf33dc8f tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.777863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:09.989248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e9f27490-8366-41c7-9e19-45dee097b09c tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:10.004265 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e9f27490-8366-41c7-9e19-45dee097b09c tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1283 microversion: 2.1 time: 0.344798 Jul 20 04:28:10.005242 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1923/3925] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:09 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1283 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:10.011802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9360dc02-8477-4a56-bc37-d48be504d3f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:10.025532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9360dc02-8477-4a56-bc37-d48be504d3f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:10.040117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9360dc02-8477-4a56-bc37-d48be504d3f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.043377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9360dc02-8477-4a56-bc37-d48be504d3f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:10.044550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9360dc02-8477-4a56-bc37-d48be504d3f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.047244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9360dc02-8477-4a56-bc37-d48be504d3f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:10.576629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4d1461c5-5fa2-4f6e-ad64-8e4ddf33dc8f tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:10.593975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4d1461c5-5fa2-4f6e-ad64-8e4ddf33dc8f tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:10.595851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4d1461c5-5fa2-4f6e-ad64-8e4ddf33dc8f tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:10.601784 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4d1461c5-5fa2-4f6e-ad64-8e4ddf33dc8f tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 200 len: 1359 microversion: 2.21 time: 0.867319 Jul 20 04:28:10.607312 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2003/3926] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:09 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 1359 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:10.613578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-1ecbe24e-303b-4195-a573-a5f4547bcc99 req-91dfb6cf-181c-4d37-91d7-b62d071c7a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efbc68ee-0b06-4477-b30e-a3a5dc229f67", "tag": "073f5d74-39a0-407e-8b99-4f1de05c3ec4"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:10.635271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1ecbe24e-303b-4195-a573-a5f4547bcc99 req-91dfb6cf-181c-4d37-91d7-b62d071c7a24 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.645484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1ecbe24e-303b-4195-a573-a5f4547bcc99 req-91dfb6cf-181c-4d37-91d7-b62d071c7a24 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:10.679229 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-1ecbe24e-303b-4195-a573-a5f4547bcc99 req-91dfb6cf-181c-4d37-91d7-b62d071c7a24 service nova] Creating event network-changed:073f5d74-39a0-407e-8b99-4f1de05c3ec4 for instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 on n-h1-764485-11 Jul 20 04:28:10.692781 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-1ecbe24e-303b-4195-a573-a5f4547bcc99 req-91dfb6cf-181c-4d37-91d7-b62d071c7a24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083778 Jul 20 04:28:10.698635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9360dc02-8477-4a56-bc37-d48be504d3f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:10.708544 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2004/3927] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:10.712622 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9360dc02-8477-4a56-bc37-d48be504d3f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1318 microversion: 2.1 time: 0.704960 Jul 20 04:28:10.729917 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1924/3928] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:10 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:10.742732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e1a4eef-cd39-4b2a-be46-ad8402cba3a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:10.748787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7e1a4eef-cd39-4b2a-be46-ad8402cba3a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:10.773572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e1a4eef-cd39-4b2a-be46-ad8402cba3a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.774143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e1a4eef-cd39-4b2a-be46-ad8402cba3a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:10.774971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e1a4eef-cd39-4b2a-be46-ad8402cba3a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.775417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e1a4eef-cd39-4b2a-be46-ad8402cba3a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:10.784719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9dc8a44c-bfce-4baa-be1b-a764a7daddfe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:10.787568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9dc8a44c-bfce-4baa-be1b-a764a7daddfe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:10.814954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dc8a44c-bfce-4baa-be1b-a764a7daddfe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.815595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dc8a44c-bfce-4baa-be1b-a764a7daddfe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:10.816566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dc8a44c-bfce-4baa-be1b-a764a7daddfe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.817677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dc8a44c-bfce-4baa-be1b-a764a7daddfe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.285518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7e1a4eef-cd39-4b2a-be46-ad8402cba3a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:11.302953 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7e1a4eef-cd39-4b2a-be46-ad8402cba3a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1682 microversion: 2.1 time: 0.568476 Jul 20 04:28:11.314146 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1925/3929] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:10 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1682 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:11.316188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b1e738f8-e612-481f-8a9f-d340771d2df4 req-521fec20-e60f-4248-9c61-b7aa6f19fc60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3e1ac9-4958-4b26-b26b-b21a0c35be26", "name": "network-vif-plugged", "status": "completed", "tag": "ddaf2de6-3964-405a-8c9c-f2b502893883"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:11.336575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b1e738f8-e612-481f-8a9f-d340771d2df4 req-521fec20-e60f-4248-9c61-b7aa6f19fc60 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:11.337066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b1e738f8-e612-481f-8a9f-d340771d2df4 req-521fec20-e60f-4248-9c61-b7aa6f19fc60 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.361616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9dc8a44c-bfce-4baa-be1b-a764a7daddfe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:11.370299 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b1e738f8-e612-481f-8a9f-d340771d2df4 req-521fec20-e60f-4248-9c61-b7aa6f19fc60 service nova] Creating event network-vif-plugged:ddaf2de6-3964-405a-8c9c-f2b502893883 for instance af3e1ac9-4958-4b26-b26b-b21a0c35be26 on n-h2-764485-11 Jul 20 04:28:11.370453 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9dc8a44c-bfce-4baa-be1b-a764a7daddfe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1313 microversion: 2.1 time: 0.660191 Jul 20 04:28:11.378710 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2005/3930] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:10 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1313 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:11.382021 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b1e738f8-e612-481f-8a9f-d340771d2df4 req-521fec20-e60f-4248-9c61-b7aa6f19fc60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075476 Jul 20 04:28:11.382701 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1926/3931] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:11.414670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aab41ded-0460-4b3d-b03d-5c797a6e1557 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:11.418585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aab41ded-0460-4b3d-b03d-5c797a6e1557 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:11.446513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aab41ded-0460-4b3d-b03d-5c797a6e1557 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:11.448350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aab41ded-0460-4b3d-b03d-5c797a6e1557 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.453030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aab41ded-0460-4b3d-b03d-5c797a6e1557 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:11.453495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aab41ded-0460-4b3d-b03d-5c797a6e1557 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.623550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b10d4fce-170c-4190-9edd-135aa7e2eceb tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:11.624187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b10d4fce-170c-4190-9edd-135aa7e2eceb tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:11.641113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b10d4fce-170c-4190-9edd-135aa7e2eceb tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:11.652333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b10d4fce-170c-4190-9edd-135aa7e2eceb tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.654452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b10d4fce-170c-4190-9edd-135aa7e2eceb tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:11.655473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b10d4fce-170c-4190-9edd-135aa7e2eceb tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.718622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aab41ded-0460-4b3d-b03d-5c797a6e1557 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:11.727386 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aab41ded-0460-4b3d-b03d-5c797a6e1557 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1283 microversion: 2.1 time: 0.347343 Jul 20 04:28:11.732751 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2006/3932] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:11 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1283 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:11.742673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bb692b61-4676-41fe-9f72-1d05dd9d174c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:11.748487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bb692b61-4676-41fe-9f72-1d05dd9d174c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:11.757234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb692b61-4676-41fe-9f72-1d05dd9d174c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:11.760560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb692b61-4676-41fe-9f72-1d05dd9d174c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.764040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb692b61-4676-41fe-9f72-1d05dd9d174c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:11.764681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb692b61-4676-41fe-9f72-1d05dd9d174c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:12.338152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bb692b61-4676-41fe-9f72-1d05dd9d174c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:12.352392 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bb692b61-4676-41fe-9f72-1d05dd9d174c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1509 microversion: 2.1 time: 0.617743 Jul 20 04:28:12.363587 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2007/3933] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:11 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1509 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:12.363587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-474b2752-1dc1-415f-9282-ee6cc55f9799 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:12.363587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-474b2752-1dc1-415f-9282-ee6cc55f9799 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:12.366079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-474b2752-1dc1-415f-9282-ee6cc55f9799 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:12.366748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-474b2752-1dc1-415f-9282-ee6cc55f9799 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:12.367920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-474b2752-1dc1-415f-9282-ee6cc55f9799 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:12.368545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-474b2752-1dc1-415f-9282-ee6cc55f9799 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:12.536671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b10d4fce-170c-4190-9edd-135aa7e2eceb tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:12.550523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b10d4fce-170c-4190-9edd-135aa7e2eceb tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:12.552344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b10d4fce-170c-4190-9edd-135aa7e2eceb tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:12.555365 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b10d4fce-170c-4190-9edd-135aa7e2eceb tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 200 len: 1359 microversion: 2.21 time: 0.938521 Jul 20 04:28:12.567372 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1927/3934] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:11 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 1359 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:28:12.570701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f6132d65-5f64-4bca-945b-ec1e7507e805 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:12.571715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f6132d65-5f64-4bca-945b-ec1e7507e805 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:12.584446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6132d65-5f64-4bca-945b-ec1e7507e805 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:12.588204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6132d65-5f64-4bca-945b-ec1e7507e805 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:12.592414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6132d65-5f64-4bca-945b-ec1e7507e805 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:12.593120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6132d65-5f64-4bca-945b-ec1e7507e805 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:12.842666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-474b2752-1dc1-415f-9282-ee6cc55f9799 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:12.857174 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-474b2752-1dc1-415f-9282-ee6cc55f9799 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.502535 Jul 20 04:28:12.857571 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2008/3935] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:12 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:12.862439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bf4703ee-f0ab-4e83-8b75-5ba24ce2c1c0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:12.868469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bf4703ee-f0ab-4e83-8b75-5ba24ce2c1c0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:12.887893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:12.889566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf4703ee-f0ab-4e83-8b75-5ba24ce2c1c0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:12.890065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf4703ee-f0ab-4e83-8b75-5ba24ce2c1c0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:12.890752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf4703ee-f0ab-4e83-8b75-5ba24ce2c1c0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:12.897342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf4703ee-f0ab-4e83-8b75-5ba24ce2c1c0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:13.130124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:13.183798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:13.203733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f6132d65-5f64-4bca-945b-ec1e7507e805 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:13.215254 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f6132d65-5f64-4bca-945b-ec1e7507e805 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1509 microversion: 2.1 time: 0.655865 Jul 20 04:28:13.216586 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1928/3936] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:12 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1509 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:13.232040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-76aaa5b7-d880-45d5-a917-4e400e266e11 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:13.232930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-76aaa5b7-d880-45d5-a917-4e400e266e11 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:13.248217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76aaa5b7-d880-45d5-a917-4e400e266e11 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:13.251060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76aaa5b7-d880-45d5-a917-4e400e266e11 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:13.252426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76aaa5b7-d880-45d5-a917-4e400e266e11 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:13.263878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-76aaa5b7-d880-45d5-a917-4e400e266e11 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:13.582665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bf4703ee-f0ab-4e83-8b75-5ba24ce2c1c0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:13.598204 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bf4703ee-f0ab-4e83-8b75-5ba24ce2c1c0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1313 microversion: 2.1 time: 0.734690 Jul 20 04:28:13.599228 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2009/3937] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:12 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1313 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:13.609868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d27de279-e029-44dc-b7dd-7dfaf16b4a8d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:13.610752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d27de279-e029-44dc-b7dd-7dfaf16b4a8d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:13.627643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d27de279-e029-44dc-b7dd-7dfaf16b4a8d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:13.628386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d27de279-e029-44dc-b7dd-7dfaf16b4a8d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:13.629788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d27de279-e029-44dc-b7dd-7dfaf16b4a8d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:13.630602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d27de279-e029-44dc-b7dd-7dfaf16b4a8d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:14.237939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-76aaa5b7-d880-45d5-a917-4e400e266e11 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:14.260336 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-76aaa5b7-d880-45d5-a917-4e400e266e11 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1350 microversion: 2.1 time: 1.042305 Jul 20 04:28:14.262288 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1929/3938] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:13 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1350 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:14.277782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c96e1b02-4ef5-4adc-a379-42647f71f7c0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:14.279396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c96e1b02-4ef5-4adc-a379-42647f71f7c0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:14.299196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c96e1b02-4ef5-4adc-a379-42647f71f7c0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:14.299851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c96e1b02-4ef5-4adc-a379-42647f71f7c0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:14.300934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c96e1b02-4ef5-4adc-a379-42647f71f7c0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:14.301729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c96e1b02-4ef5-4adc-a379-42647f71f7c0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:14.424598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:14.464699 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c96e1b02-4ef5-4adc-a379-42647f71f7c0 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "PUT /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1081 microversion: 2.1 time: 0.195296 Jul 20 04:28:14.466408 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1930/3939] 10.222.0.20 () {60 vars in 1255 bytes} [Wed Jul 20 04:28:14 2022] PUT /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1081 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:14.477440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d27de279-e029-44dc-b7dd-7dfaf16b4a8d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:14.483243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-15c33030-4893-4371-a97c-f18f03ec28b1 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:14.484420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-15c33030-4893-4371-a97c-f18f03ec28b1 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:14.487454 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d27de279-e029-44dc-b7dd-7dfaf16b4a8d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.886722 Jul 20 04:28:14.494709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15c33030-4893-4371-a97c-f18f03ec28b1 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:14.495466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15c33030-4893-4371-a97c-f18f03ec28b1 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:14.495880 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2010/3940] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:13 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:14.496702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15c33030-4893-4371-a97c-f18f03ec28b1 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:14.497431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15c33030-4893-4371-a97c-f18f03ec28b1 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:14.500735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-328a645f-8108-4b5c-a10c-f503c62cfe20 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:14.516452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-328a645f-8108-4b5c-a10c-f503c62cfe20 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:14.541529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-328a645f-8108-4b5c-a10c-f503c62cfe20 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:14.542048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-328a645f-8108-4b5c-a10c-f503c62cfe20 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:14.542875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-328a645f-8108-4b5c-a10c-f503c62cfe20 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:14.543323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-328a645f-8108-4b5c-a10c-f503c62cfe20 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:15.113599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-15c33030-4893-4371-a97c-f18f03ec28b1 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:15.143302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-15c33030-4893-4371-a97c-f18f03ec28b1 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:15.145517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-15c33030-4893-4371-a97c-f18f03ec28b1 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:15.147895 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-15c33030-4893-4371-a97c-f18f03ec28b1 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 200 len: 1359 microversion: 2.21 time: 0.679996 Jul 20 04:28:15.149418 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1931/3941] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:14 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 1359 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:15.154103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a963eaf9-e202-4eab-8afe-82ba046b1b7e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:15.155195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a963eaf9-e202-4eab-8afe-82ba046b1b7e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:15.163915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a963eaf9-e202-4eab-8afe-82ba046b1b7e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:15.164973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a963eaf9-e202-4eab-8afe-82ba046b1b7e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:15.166155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a963eaf9-e202-4eab-8afe-82ba046b1b7e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:15.167619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a963eaf9-e202-4eab-8afe-82ba046b1b7e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:15.228222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-328a645f-8108-4b5c-a10c-f503c62cfe20 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:15.248129 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-328a645f-8108-4b5c-a10c-f503c62cfe20 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1507 microversion: 2.1 time: 0.749967 Jul 20 04:28:15.249773 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2011/3942] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:14 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1507 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:15.255500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-05792e06-64b5-43d1-8546-8715f2af1cb5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:15.257707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-05792e06-64b5-43d1-8546-8715f2af1cb5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:15.279960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05792e06-64b5-43d1-8546-8715f2af1cb5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:15.280712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05792e06-64b5-43d1-8546-8715f2af1cb5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:15.283264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05792e06-64b5-43d1-8546-8715f2af1cb5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:15.285844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05792e06-64b5-43d1-8546-8715f2af1cb5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:15.330280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-05792e06-64b5-43d1-8546-8715f2af1cb5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:28:15.484783 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-05792e06-64b5-43d1-8546-8715f2af1cb5 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 204 len: 0 microversion: 2.1 time: 0.232342 Jul 20 04:28:15.486503 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2012/3943] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:28:15 2022] DELETE /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:28:15.494158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9dc2b914-3948-49ec-ae78-446fd171187a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:15.495674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9dc2b914-3948-49ec-ae78-446fd171187a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:15.503783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dc2b914-3948-49ec-ae78-446fd171187a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:15.504546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dc2b914-3948-49ec-ae78-446fd171187a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:15.505849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dc2b914-3948-49ec-ae78-446fd171187a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:15.506568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dc2b914-3948-49ec-ae78-446fd171187a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:15.659113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a963eaf9-e202-4eab-8afe-82ba046b1b7e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:15.667906 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a963eaf9-e202-4eab-8afe-82ba046b1b7e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1500 microversion: 2.1 time: 0.517308 Jul 20 04:28:15.670101 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1932/3944] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:15 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1500 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:15.678031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ee2b218-924a-4906-86b6-85dda9274515 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:15.684215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ee2b218-924a-4906-86b6-85dda9274515 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:15.692280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ee2b218-924a-4906-86b6-85dda9274515 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:15.692917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ee2b218-924a-4906-86b6-85dda9274515 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:15.694726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ee2b218-924a-4906-86b6-85dda9274515 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:15.695346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ee2b218-924a-4906-86b6-85dda9274515 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:16.069946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9dc2b914-3948-49ec-ae78-446fd171187a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:16.084905 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9dc2b914-3948-49ec-ae78-446fd171187a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1507 microversion: 2.1 time: 0.596548 Jul 20 04:28:16.097377 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2013/3945] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:15 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1507 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:16.106189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2b386961-f4d1-46ef-8635-7c20aca36cb2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:16.106809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2b386961-f4d1-46ef-8635-7c20aca36cb2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:16.116923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ee2b218-924a-4906-86b6-85dda9274515 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:16.126756 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ee2b218-924a-4906-86b6-85dda9274515 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1350 microversion: 2.1 time: 0.454799 Jul 20 04:28:16.127256 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1933/3946] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:15 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1350 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:16.143499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b386961-f4d1-46ef-8635-7c20aca36cb2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:16.154396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b386961-f4d1-46ef-8635-7c20aca36cb2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:16.155730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b386961-f4d1-46ef-8635-7c20aca36cb2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:16.156355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b386961-f4d1-46ef-8635-7c20aca36cb2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:16.161455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95d2a974-32a3-433c-81f6-f1180e295c13 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:16.168060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95d2a974-32a3-433c-81f6-f1180e295c13 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:16.201384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95d2a974-32a3-433c-81f6-f1180e295c13 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:16.202286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95d2a974-32a3-433c-81f6-f1180e295c13 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:16.205716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95d2a974-32a3-433c-81f6-f1180e295c13 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:16.206418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95d2a974-32a3-433c-81f6-f1180e295c13 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:16.294311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-95d2a974-32a3-433c-81f6-f1180e295c13 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lazy-loading 'flavor' on Instance uuid af3e1ac9-4958-4b26-b26b-b21a0c35be26 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:28:16.365752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:16.454445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:16.467792 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95d2a974-32a3-433c-81f6-f1180e295c13 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "POST /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26/action" status: 200 len: 32 microversion: 2.1 time: 0.322501 Jul 20 04:28:16.480422 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1934/3947] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:28:16 2022] POST /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:28:16.502053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:16.504521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:16.513364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:16.514199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:16.515162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:16.515798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:16.656500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:16.657289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:16.657934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:16.658508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:16.659093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:16.799532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:16.825997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:16.827784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:16.828946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:16.831608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:16.950002 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-71b3a31f-a4cf-4ece-825e-771fa479de9f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "POST /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d/action" status: 202 len: 1113 microversion: 2.1 time: 0.467927 Jul 20 04:28:16.959220 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1935/3948] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:28:16 2022] POST /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d/action => generated 1113 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:28:16.959220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2adddab3-cf45-4dd4-ac6b-8c0a37d0b434 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:16.959220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2adddab3-cf45-4dd4-ac6b-8c0a37d0b434 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:16.977383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2adddab3-cf45-4dd4-ac6b-8c0a37d0b434 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:16.977834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2adddab3-cf45-4dd4-ac6b-8c0a37d0b434 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:16.979680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2adddab3-cf45-4dd4-ac6b-8c0a37d0b434 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:16.980307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2adddab3-cf45-4dd4-ac6b-8c0a37d0b434 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:17.335560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2b386961-f4d1-46ef-8635-7c20aca36cb2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:17.356444 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2b386961-f4d1-46ef-8635-7c20aca36cb2 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 200 len: 1507 microversion: 2.1 time: 1.256211 Jul 20 04:28:17.358639 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2014/3949] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:16 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 1507 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:17.371300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-acef000c-652e-47d4-9e13-94e56f9da73e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:17.375253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-acef000c-652e-47d4-9e13-94e56f9da73e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:17.387499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-acef000c-652e-47d4-9e13-94e56f9da73e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:17.392044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-acef000c-652e-47d4-9e13-94e56f9da73e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:17.393286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-acef000c-652e-47d4-9e13-94e56f9da73e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:17.393914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-acef000c-652e-47d4-9e13-94e56f9da73e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:17.603839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2adddab3-cf45-4dd4-ac6b-8c0a37d0b434 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:17.615996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2adddab3-cf45-4dd4-ac6b-8c0a37d0b434 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:17.625627 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2adddab3-cf45-4dd4-ac6b-8c0a37d0b434 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:17.627462 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2adddab3-cf45-4dd4-ac6b-8c0a37d0b434 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 200 len: 1359 microversion: 2.21 time: 0.675177 Jul 20 04:28:17.628160 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1936/3950] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:16 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 1359 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:17.639976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-759198c5-4872-4f9f-9b8e-0ba7d2a15b0e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:17.640916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-759198c5-4872-4f9f-9b8e-0ba7d2a15b0e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:17.648830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-759198c5-4872-4f9f-9b8e-0ba7d2a15b0e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:17.649435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-759198c5-4872-4f9f-9b8e-0ba7d2a15b0e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:17.650717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-759198c5-4872-4f9f-9b8e-0ba7d2a15b0e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:17.651599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-759198c5-4872-4f9f-9b8e-0ba7d2a15b0e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:17.928414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-acef000c-652e-47d4-9e13-94e56f9da73e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:17.942581 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-acef000c-652e-47d4-9e13-94e56f9da73e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.582642 Jul 20 04:28:17.943193 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2015/3951] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:17 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:17.958034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-f47a3c66-e69f-40dd-9267-0b19a13b19b8 req-9c47f86c-0e64-4949-b598-d8673c570e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ffdfab-9da8-46f5-83ee-20735f6b4164", "tag": "de0d7b91-90f1-4e53-a48b-3c82a0802c32"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:17.978851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f47a3c66-e69f-40dd-9267-0b19a13b19b8 req-9c47f86c-0e64-4949-b598-d8673c570e0f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:17.979313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f47a3c66-e69f-40dd-9267-0b19a13b19b8 req-9c47f86c-0e64-4949-b598-d8673c570e0f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:18.003398 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f47a3c66-e69f-40dd-9267-0b19a13b19b8 req-9c47f86c-0e64-4949-b598-d8673c570e0f service nova] Creating event network-changed:de0d7b91-90f1-4e53-a48b-3c82a0802c32 for instance 05ffdfab-9da8-46f5-83ee-20735f6b4164 on n-h2-764485-11 Jul 20 04:28:18.013499 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-f47a3c66-e69f-40dd-9267-0b19a13b19b8 req-9c47f86c-0e64-4949-b598-d8673c570e0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068984 Jul 20 04:28:18.016807 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2016/3952] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:18.024291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-f9972eb7-38cd-48be-bcb1-70e9b9afd491 req-de839720-30a3-4c6e-9ed3-961a75dc5826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c037b53b-2303-44d0-bb77-c8fa405473bb", "name": "network-vif-unplugged", "status": "completed", "tag": "86571be8-3cd1-44e0-856c-952546489890"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:18.039088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f9972eb7-38cd-48be-bcb1-70e9b9afd491 req-de839720-30a3-4c6e-9ed3-961a75dc5826 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.041667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f9972eb7-38cd-48be-bcb1-70e9b9afd491 req-de839720-30a3-4c6e-9ed3-961a75dc5826 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:18.060174 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f9972eb7-38cd-48be-bcb1-70e9b9afd491 req-de839720-30a3-4c6e-9ed3-961a75dc5826 service nova] Creating event network-vif-unplugged:86571be8-3cd1-44e0-856c-952546489890 for instance c037b53b-2303-44d0-bb77-c8fa405473bb on n-h2-764485-11 Jul 20 04:28:18.066736 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-f9972eb7-38cd-48be-bcb1-70e9b9afd491 req-de839720-30a3-4c6e-9ed3-961a75dc5826 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046124 Jul 20 04:28:18.068141 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2017/3953] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:18.076223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-449724b5-d68a-41a6-90ae-dd351012139d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:18.077120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-449724b5-d68a-41a6-90ae-dd351012139d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:18.087911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-449724b5-d68a-41a6-90ae-dd351012139d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.089525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-449724b5-d68a-41a6-90ae-dd351012139d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:18.090712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-449724b5-d68a-41a6-90ae-dd351012139d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.091521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-449724b5-d68a-41a6-90ae-dd351012139d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:18.830083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-759198c5-4872-4f9f-9b8e-0ba7d2a15b0e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:18.844247 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-759198c5-4872-4f9f-9b8e-0ba7d2a15b0e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 1.210581 Jul 20 04:28:18.856371 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1937/3954] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:17 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:18.865751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f46e9cbe-8007-4e1d-b02b-4710dd77e570 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:18.867535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f46e9cbe-8007-4e1d-b02b-4710dd77e570 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:18.876180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f46e9cbe-8007-4e1d-b02b-4710dd77e570 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.877029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f46e9cbe-8007-4e1d-b02b-4710dd77e570 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:18.878068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f46e9cbe-8007-4e1d-b02b-4710dd77e570 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.878729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f46e9cbe-8007-4e1d-b02b-4710dd77e570 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.013973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-449724b5-d68a-41a6-90ae-dd351012139d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:19.025515 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-449724b5-d68a-41a6-90ae-dd351012139d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1518 microversion: 2.1 time: 0.954579 Jul 20 04:28:19.026310 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2018/3955] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:18 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1518 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:19.032623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-7b7e94d7-dd80-4650-98b1-c59a23efc7af req-91fbf796-bafa-4652-9c5d-da5b93b3fa47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425d15e8-b80e-4921-89e1-c81e97829f29", "name": "network-vif-deleted", "tag": "6df7a16c-fb5a-4718-9c5e-d12d30b2a431"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:19.058545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7b7e94d7-dd80-4650-98b1-c59a23efc7af req-91fbf796-bafa-4652-9c5d-da5b93b3fa47 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.059577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7b7e94d7-dd80-4650-98b1-c59a23efc7af req-91fbf796-bafa-4652-9c5d-da5b93b3fa47 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.075752 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7b7e94d7-dd80-4650-98b1-c59a23efc7af req-91fbf796-bafa-4652-9c5d-da5b93b3fa47 service nova] Creating event network-vif-deleted:6df7a16c-fb5a-4718-9c5e-d12d30b2a431 for instance 425d15e8-b80e-4921-89e1-c81e97829f29 on n-h1-764485-11 Jul 20 04:28:19.081688 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-7b7e94d7-dd80-4650-98b1-c59a23efc7af req-91fbf796-bafa-4652-9c5d-da5b93b3fa47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052629 Jul 20 04:28:19.083489 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2019/3956] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:19.091110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bfe04734-72b0-4284-9974-9ca9b345a0e9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:19.092120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bfe04734-72b0-4284-9974-9ca9b345a0e9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:19.099794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfe04734-72b0-4284-9974-9ca9b345a0e9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.100568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfe04734-72b0-4284-9974-9ca9b345a0e9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.101522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfe04734-72b0-4284-9974-9ca9b345a0e9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.102228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfe04734-72b0-4284-9974-9ca9b345a0e9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.122092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f46e9cbe-8007-4e1d-b02b-4710dd77e570 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:19.132164 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f46e9cbe-8007-4e1d-b02b-4710dd77e570 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1350 microversion: 2.1 time: 0.271911 Jul 20 04:28:19.141449 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1938/3957] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:18 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1350 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:19.141449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8e5f9d47-481f-44c5-ab05-74db3fd0a7bf tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:19.141449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8e5f9d47-481f-44c5-ab05-74db3fd0a7bf tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: 425d15e8-b80e-4921-89e1-c81e97829f29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:19.145706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e5f9d47-481f-44c5-ab05-74db3fd0a7bf tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.146476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e5f9d47-481f-44c5-ab05-74db3fd0a7bf tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.147287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e5f9d47-481f-44c5-ab05-74db3fd0a7bf tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.147771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e5f9d47-481f-44c5-ab05-74db3fd0a7bf tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.173360 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-8e5f9d47-481f-44c5-ab05-74db3fd0a7bf tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] HTTP exception thrown: Instance 425d15e8-b80e-4921-89e1-c81e97829f29 could not be found. Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8e5f9d47-481f-44c5-ab05-74db3fd0a7bf tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Request method failure captured: Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 HTTP/1.1 Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14LpvtEmNd4QrXIrUEvb-GSk-Q8Zjd0l-zF-kIlevLuoBgLZ_00_u1yvp6j7dRA_htG5kpVqZoVpEsFwn0RHk_cOjeEIbaoK3R2iKcoauuThhWzyvVf6At0QhXQxlwDjTmkqLnzcd5YkB5Z5aPRc9SOgHjbdPHPXD-aflxJrD9yhloY Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ba21f0dfdc04e41a9a30fa3dddf3e90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}] Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a25a4e3b560846ec98b871b954481f09 Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 425d15e8-b80e-4921-89e1-c81e97829f29 could not be found. Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '425d15e8-b80e-4921-89e1-c81e97829f29'} Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425d15e8-b80e-4921-89e1-c81e97829f29 could not be found. Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425d15e8-b80e-4921-89e1-c81e97829f29 could not be found. Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:19.175659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:19.182108 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:19.182108 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:19.182108 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:19.182108 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:19.182108 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:19.182108 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:19.182108 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425d15e8-b80e-4921-89e1-c81e97829f29 could not be found. Jul 20 04:28:19.182108 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:19.182108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8e5f9d47-481f-44c5-ab05-74db3fd0a7bf tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Returning 404 to user: Instance 425d15e8-b80e-4921-89e1-c81e97829f29 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:19.182108 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8e5f9d47-481f-44c5-ab05-74db3fd0a7bf tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29" status: 404 len: 111 microversion: 2.1 time: 0.043111 Jul 20 04:28:19.182108 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1939/3958] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:19 2022] GET /compute/v2.1/servers/425d15e8-b80e-4921-89e1-c81e97829f29 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:28:19.183848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9d03fbc-4e55-42e3-b51b-71b506624e21 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:19.184000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e9d03fbc-4e55-42e3-b51b-71b506624e21 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:19.191750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9d03fbc-4e55-42e3-b51b-71b506624e21 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.191750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9d03fbc-4e55-42e3-b51b-71b506624e21 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.192603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9d03fbc-4e55-42e3-b51b-71b506624e21 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.193086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9d03fbc-4e55-42e3-b51b-71b506624e21 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.357986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bfe04734-72b0-4284-9974-9ca9b345a0e9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:19.362265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:19.381156 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bfe04734-72b0-4284-9974-9ca9b345a0e9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.295588 Jul 20 04:28:19.383564 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2020/3959] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:19 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:19.390830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d9e25bb6-e373-43f7-b051-3099c994747f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:19.391643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d9e25bb6-e373-43f7-b051-3099c994747f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:19.398907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9e25bb6-e373-43f7-b051-3099c994747f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.399458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9e25bb6-e373-43f7-b051-3099c994747f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.401584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9e25bb6-e373-43f7-b051-3099c994747f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.402858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9e25bb6-e373-43f7-b051-3099c994747f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.446476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d9e25bb6-e373-43f7-b051-3099c994747f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:28:19.484452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e9d03fbc-4e55-42e3-b51b-71b506624e21 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:19.493120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e9d03fbc-4e55-42e3-b51b-71b506624e21 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:19.495946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e9d03fbc-4e55-42e3-b51b-71b506624e21 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:19.497540 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e9d03fbc-4e55-42e3-b51b-71b506624e21 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 200 len: 1359 microversion: 2.21 time: 0.318477 Jul 20 04:28:19.499052 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1940/3960] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:19 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 1359 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:19.516679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c451f57e-a1c3-4fc8-a275-915700d92d5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:19.517230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c451f57e-a1c3-4fc8-a275-915700d92d5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:19.523480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c451f57e-a1c3-4fc8-a275-915700d92d5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.524276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c451f57e-a1c3-4fc8-a275-915700d92d5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.525379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c451f57e-a1c3-4fc8-a275-915700d92d5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.526643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c451f57e-a1c3-4fc8-a275-915700d92d5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.567906 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d9e25bb6-e373-43f7-b051-3099c994747f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 204 len: 0 microversion: 2.1 time: 0.181067 Jul 20 04:28:19.569727 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2021/3961] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:28:19 2022] DELETE /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:28:19.580406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-75d2608a-272c-4e54-a1ce-b07180b6faf4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:19.581486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-75d2608a-272c-4e54-a1ce-b07180b6faf4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:19.589990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75d2608a-272c-4e54-a1ce-b07180b6faf4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.590707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75d2608a-272c-4e54-a1ce-b07180b6faf4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.591982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75d2608a-272c-4e54-a1ce-b07180b6faf4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.592608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75d2608a-272c-4e54-a1ce-b07180b6faf4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.797228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c451f57e-a1c3-4fc8-a275-915700d92d5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:19.811054 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c451f57e-a1c3-4fc8-a275-915700d92d5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.310894 Jul 20 04:28:19.812344 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1941/3962] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:19 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:19.829053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a505920b-7a95-4a86-8c4d-efba3dd0daa2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:19.830313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a505920b-7a95-4a86-8c4d-efba3dd0daa2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:19.838604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a505920b-7a95-4a86-8c4d-efba3dd0daa2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.844631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a505920b-7a95-4a86-8c4d-efba3dd0daa2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.845611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a505920b-7a95-4a86-8c4d-efba3dd0daa2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.846165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a505920b-7a95-4a86-8c4d-efba3dd0daa2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.871766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-75d2608a-272c-4e54-a1ce-b07180b6faf4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:19.880985 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-75d2608a-272c-4e54-a1ce-b07180b6faf4 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.306411 Jul 20 04:28:19.881292 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2022/3963] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:19 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:19.889668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-807e5820-9186-4d23-aefe-1c0464e51d4c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:19.890504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-807e5820-9186-4d23-aefe-1c0464e51d4c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:19.909569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-807e5820-9186-4d23-aefe-1c0464e51d4c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.909569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-807e5820-9186-4d23-aefe-1c0464e51d4c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.910511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-807e5820-9186-4d23-aefe-1c0464e51d4c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.911026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-807e5820-9186-4d23-aefe-1c0464e51d4c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.963537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:19.975106 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a505920b-7a95-4a86-8c4d-efba3dd0daa2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.149804 Jul 20 04:28:19.975976 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1942/3964] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:28:19 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:28:19.988494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-40c6c773-a060-4f2e-8c8d-2b3d037cb96a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:19.989528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-40c6c773-a060-4f2e-8c8d-2b3d037cb96a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:19.997796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40c6c773-a060-4f2e-8c8d-2b3d037cb96a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:19.998546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40c6c773-a060-4f2e-8c8d-2b3d037cb96a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:19.999539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40c6c773-a060-4f2e-8c8d-2b3d037cb96a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.000146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40c6c773-a060-4f2e-8c8d-2b3d037cb96a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.152999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-807e5820-9186-4d23-aefe-1c0464e51d4c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.164364 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-807e5820-9186-4d23-aefe-1c0464e51d4c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.281910 Jul 20 04:28:20.165199 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2023/3965] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:19 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:20.170903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec2f1800-a2e7-4584-97b0-a40e87b8b7ce tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:20.171962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ec2f1800-a2e7-4584-97b0-a40e87b8b7ce tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:20.187349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec2f1800-a2e7-4584-97b0-a40e87b8b7ce tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.190578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec2f1800-a2e7-4584-97b0-a40e87b8b7ce tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.190578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec2f1800-a2e7-4584-97b0-a40e87b8b7ce tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.190578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec2f1800-a2e7-4584-97b0-a40e87b8b7ce tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.232668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-40c6c773-a060-4f2e-8c8d-2b3d037cb96a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.241824 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-40c6c773-a060-4f2e-8c8d-2b3d037cb96a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1671 microversion: 2.1 time: 0.260790 Jul 20 04:28:20.247923 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1943/3966] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:19 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1671 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:20.258737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-fccd8a56-09a5-46e3-abd7-b612f66cfc66 req-02442f81-4025-40a3-92a3-79af64647182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbc68ee-0b06-4477-b30e-a3a5dc229f67", "name": "network-vif-plugged", "status": "completed", "tag": "073f5d74-39a0-407e-8b99-4f1de05c3ec4"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:20.273611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fccd8a56-09a5-46e3-abd7-b612f66cfc66 req-02442f81-4025-40a3-92a3-79af64647182 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.274571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fccd8a56-09a5-46e3-abd7-b612f66cfc66 req-02442f81-4025-40a3-92a3-79af64647182 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.298357 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-fccd8a56-09a5-46e3-abd7-b612f66cfc66 req-02442f81-4025-40a3-92a3-79af64647182 service nova] Creating event network-vif-plugged:073f5d74-39a0-407e-8b99-4f1de05c3ec4 for instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 on n-h1-764485-11 Jul 20 04:28:20.306480 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-fccd8a56-09a5-46e3-abd7-b612f66cfc66 req-02442f81-4025-40a3-92a3-79af64647182 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056603 Jul 20 04:28:20.307326 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1944/3967] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:20.314258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0fd2528d-9005-40e5-9109-4736fa653181 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:20.315649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0fd2528d-9005-40e5-9109-4736fa653181 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:20.323074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0fd2528d-9005-40e5-9109-4736fa653181 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.324108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0fd2528d-9005-40e5-9109-4736fa653181 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.325062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0fd2528d-9005-40e5-9109-4736fa653181 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.325680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0fd2528d-9005-40e5-9109-4736fa653181 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.441010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ec2f1800-a2e7-4584-97b0-a40e87b8b7ce tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.449968 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ec2f1800-a2e7-4584-97b0-a40e87b8b7ce tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1518 microversion: 2.1 time: 0.283089 Jul 20 04:28:20.453914 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2024/3968] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:20 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1518 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:20.521001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a032e2ae-bbd3-4e17-9fe6-9231ae956c89 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:20.521892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a032e2ae-bbd3-4e17-9fe6-9231ae956c89 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:20.533001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a032e2ae-bbd3-4e17-9fe6-9231ae956c89 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.533766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a032e2ae-bbd3-4e17-9fe6-9231ae956c89 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.534825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a032e2ae-bbd3-4e17-9fe6-9231ae956c89 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.535458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a032e2ae-bbd3-4e17-9fe6-9231ae956c89 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.701906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0fd2528d-9005-40e5-9109-4736fa653181 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.711840 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0fd2528d-9005-40e5-9109-4736fa653181 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1350 microversion: 2.1 time: 0.403003 Jul 20 04:28:20.716187 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1945/3969] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:20 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1350 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:20.898615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-808085b8-1b3f-4e50-9771-29a088e508e1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:20.900613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-808085b8-1b3f-4e50-9771-29a088e508e1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:20.919673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a032e2ae-bbd3-4e17-9fe6-9231ae956c89 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.932488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a032e2ae-bbd3-4e17-9fe6-9231ae956c89 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.934262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a032e2ae-bbd3-4e17-9fe6-9231ae956c89 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.935441 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a032e2ae-bbd3-4e17-9fe6-9231ae956c89 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 200 len: 1359 microversion: 2.21 time: 0.418330 Jul 20 04:28:20.936061 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2025/3970] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:20 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 1359 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:28:20.936199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-808085b8-1b3f-4e50-9771-29a088e508e1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.936969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-808085b8-1b3f-4e50-9771-29a088e508e1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.946078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-808085b8-1b3f-4e50-9771-29a088e508e1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.956942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-808085b8-1b3f-4e50-9771-29a088e508e1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.123924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-808085b8-1b3f-4e50-9771-29a088e508e1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:21.131656 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-808085b8-1b3f-4e50-9771-29a088e508e1 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.237766 Jul 20 04:28:21.132501 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1946/3971] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:20 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:21.184161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-72181252-8960-412d-93d5-2ddb4a6c4027 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:21.184788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-72181252-8960-412d-93d5-2ddb4a6c4027 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:21.191621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72181252-8960-412d-93d5-2ddb4a6c4027 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.192017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72181252-8960-412d-93d5-2ddb4a6c4027 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.193160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72181252-8960-412d-93d5-2ddb4a6c4027 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.193742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72181252-8960-412d-93d5-2ddb4a6c4027 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.264892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ff20e6a1-793b-4100-adcf-ea2940aff8a4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:21.265530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ff20e6a1-793b-4100-adcf-ea2940aff8a4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:21.274064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff20e6a1-793b-4100-adcf-ea2940aff8a4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.274840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff20e6a1-793b-4100-adcf-ea2940aff8a4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.275755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff20e6a1-793b-4100-adcf-ea2940aff8a4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.276408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff20e6a1-793b-4100-adcf-ea2940aff8a4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.387549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-72181252-8960-412d-93d5-2ddb4a6c4027 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:21.395282 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-72181252-8960-412d-93d5-2ddb4a6c4027 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.215518 Jul 20 04:28:21.405293 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2026/3972] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:21 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:21.460873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ff20e6a1-793b-4100-adcf-ea2940aff8a4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:21.476194 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ff20e6a1-793b-4100-adcf-ea2940aff8a4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1671 microversion: 2.1 time: 0.220398 Jul 20 04:28:21.479818 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1947/3973] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:21 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1671 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:21.480884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8db157d8-0fd4-424b-b0d0-6427b4a9e5c9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:21.481762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8db157d8-0fd4-424b-b0d0-6427b4a9e5c9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:21.494705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8db157d8-0fd4-424b-b0d0-6427b4a9e5c9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.495547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8db157d8-0fd4-424b-b0d0-6427b4a9e5c9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.500495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8db157d8-0fd4-424b-b0d0-6427b4a9e5c9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.501389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8db157d8-0fd4-424b-b0d0-6427b4a9e5c9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.687205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8db157d8-0fd4-424b-b0d0-6427b4a9e5c9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:21.696482 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8db157d8-0fd4-424b-b0d0-6427b4a9e5c9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1518 microversion: 2.1 time: 0.225637 Jul 20 04:28:21.697174 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2027/3974] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:21 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1518 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:21.733317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d9d19deb-47c1-419a-8a4a-91abedd7f38e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:21.734062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d9d19deb-47c1-419a-8a4a-91abedd7f38e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:21.740869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d19deb-47c1-419a-8a4a-91abedd7f38e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.741609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d19deb-47c1-419a-8a4a-91abedd7f38e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.742775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d19deb-47c1-419a-8a4a-91abedd7f38e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.744050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9d19deb-47c1-419a-8a4a-91abedd7f38e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.818618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8db157d8-0fd4-424b-b0d0-6427b4a9e5c9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:21.819901 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8db157d8-0fd4-424b-b0d0-6427b4a9e5c9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001473 Jul 20 04:28:21.820310 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2028/3975] 10.222.0.20 () {56 vars in 885 bytes} [Wed Jul 20 04:28:21 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 20 04:28:21.914697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d9d19deb-47c1-419a-8a4a-91abedd7f38e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:21.930146 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d9d19deb-47c1-419a-8a4a-91abedd7f38e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1350 microversion: 2.1 time: 0.200830 Jul 20 04:28:21.934086 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1948/3976] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:21 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1350 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:21.955651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-47ca3066-d854-4160-9330-e362ac9484df tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:21.957163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-47ca3066-d854-4160-9330-e362ac9484df tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:21.968040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47ca3066-d854-4160-9330-e362ac9484df tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.968774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47ca3066-d854-4160-9330-e362ac9484df tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.970464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47ca3066-d854-4160-9330-e362ac9484df tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.971465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47ca3066-d854-4160-9330-e362ac9484df tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.129475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-47ca3066-d854-4160-9330-e362ac9484df tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.139338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-47ca3066-d854-4160-9330-e362ac9484df tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.140893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-47ca3066-d854-4160-9330-e362ac9484df tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.142065 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-47ca3066-d854-4160-9330-e362ac9484df tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 200 len: 1552 microversion: 2.21 time: 0.192857 Jul 20 04:28:22.142957 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2029/3977] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:21 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 1552 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:22.149222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aca42fa8-f037-4f4a-b1c5-8d6715f3ddf7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:22.151381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aca42fa8-f037-4f4a-b1c5-8d6715f3ddf7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:22.158143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aca42fa8-f037-4f4a-b1c5-8d6715f3ddf7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.158908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aca42fa8-f037-4f4a-b1c5-8d6715f3ddf7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.159952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aca42fa8-f037-4f4a-b1c5-8d6715f3ddf7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.160632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aca42fa8-f037-4f4a-b1c5-8d6715f3ddf7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.160763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a20c9f92-b58a-4675-9b72-ea99f8072232 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:22.161289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a20c9f92-b58a-4675-9b72-ea99f8072232 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:22.170605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a20c9f92-b58a-4675-9b72-ea99f8072232 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.170605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a20c9f92-b58a-4675-9b72-ea99f8072232 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.170605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a20c9f92-b58a-4675-9b72-ea99f8072232 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.170605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a20c9f92-b58a-4675-9b72-ea99f8072232 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.211307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a20c9f92-b58a-4675-9b72-ea99f8072232 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:28:22.311878 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a20c9f92-b58a-4675-9b72-ea99f8072232 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "DELETE /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 204 len: 0 microversion: 2.21 time: 0.153570 Jul 20 04:28:22.315774 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2030/3978] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:28:22 2022] DELETE /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:28:22.322798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ad0836b4-5cbe-4644-8532-ca1d93da73c7 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:22.324019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ad0836b4-5cbe-4644-8532-ca1d93da73c7 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:22.330865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad0836b4-5cbe-4644-8532-ca1d93da73c7 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.331441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad0836b4-5cbe-4644-8532-ca1d93da73c7 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.332580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad0836b4-5cbe-4644-8532-ca1d93da73c7 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.333137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad0836b4-5cbe-4644-8532-ca1d93da73c7 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.352275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aca42fa8-f037-4f4a-b1c5-8d6715f3ddf7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.361515 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aca42fa8-f037-4f4a-b1c5-8d6715f3ddf7 tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.216015 Jul 20 04:28:22.371546 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1949/3979] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:22 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:22.425031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7bea512b-7177-4728-a85e-680fe71ae145 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:22.425675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7bea512b-7177-4728-a85e-680fe71ae145 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:22.440775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bea512b-7177-4728-a85e-680fe71ae145 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.441518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bea512b-7177-4728-a85e-680fe71ae145 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.442535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bea512b-7177-4728-a85e-680fe71ae145 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.443363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bea512b-7177-4728-a85e-680fe71ae145 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.708417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ad0836b4-5cbe-4644-8532-ca1d93da73c7 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.716575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ad0836b4-5cbe-4644-8532-ca1d93da73c7 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.718111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ad0836b4-5cbe-4644-8532-ca1d93da73c7 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.719306 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ad0836b4-5cbe-4644-8532-ca1d93da73c7 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 200 len: 1558 microversion: 2.21 time: 0.402146 Jul 20 04:28:22.731345 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2031/3980] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:22 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 1558 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:22.736201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8005f833-e731-4002-bc3f-7ce813d08ca0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:22.736802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8005f833-e731-4002-bc3f-7ce813d08ca0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:22.754688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8005f833-e731-4002-bc3f-7ce813d08ca0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.755022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8005f833-e731-4002-bc3f-7ce813d08ca0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.755851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8005f833-e731-4002-bc3f-7ce813d08ca0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.756301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8005f833-e731-4002-bc3f-7ce813d08ca0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.849440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7bea512b-7177-4728-a85e-680fe71ae145 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.857768 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7bea512b-7177-4728-a85e-680fe71ae145 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.448373 Jul 20 04:28:22.858369 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1950/3981] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:22 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:22.872422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3981062c-7670-463f-a9e1-6291b284cbfb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:22.873286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3981062c-7670-463f-a9e1-6291b284cbfb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:22.888101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3981062c-7670-463f-a9e1-6291b284cbfb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.888564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3981062c-7670-463f-a9e1-6291b284cbfb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.904822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3981062c-7670-463f-a9e1-6291b284cbfb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.907881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3981062c-7670-463f-a9e1-6291b284cbfb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.246674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8005f833-e731-4002-bc3f-7ce813d08ca0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:23.261915 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8005f833-e731-4002-bc3f-7ce813d08ca0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1671 microversion: 2.1 time: 0.534650 Jul 20 04:28:23.262667 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2032/3982] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:22 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1671 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:23.267380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4fc49c23-69eb-4ac0-8b78-73eb04c094fa tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:23.268034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4fc49c23-69eb-4ac0-8b78-73eb04c094fa tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:23.296986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fc49c23-69eb-4ac0-8b78-73eb04c094fa tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:23.300710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fc49c23-69eb-4ac0-8b78-73eb04c094fa tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.301545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fc49c23-69eb-4ac0-8b78-73eb04c094fa tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:23.301998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fc49c23-69eb-4ac0-8b78-73eb04c094fa tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.523215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3981062c-7670-463f-a9e1-6291b284cbfb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:23.534723 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3981062c-7670-463f-a9e1-6291b284cbfb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1518 microversion: 2.1 time: 0.675057 Jul 20 04:28:23.546742 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1951/3983] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:22 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1518 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:23.552786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9da22007-e013-4646-8d7f-baef5eea145f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:23.553859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9da22007-e013-4646-8d7f-baef5eea145f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:23.564746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9da22007-e013-4646-8d7f-baef5eea145f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:23.566360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9da22007-e013-4646-8d7f-baef5eea145f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.568139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9da22007-e013-4646-8d7f-baef5eea145f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:23.568767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9da22007-e013-4646-8d7f-baef5eea145f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.772641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4fc49c23-69eb-4ac0-8b78-73eb04c094fa tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:23.787019 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4fc49c23-69eb-4ac0-8b78-73eb04c094fa tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1350 microversion: 2.1 time: 0.523242 Jul 20 04:28:23.803251 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2033/3984] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:23 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1350 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:23.809740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9e47bbe0-c5e0-4541-b49d-af08f3737651 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:23.810365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9e47bbe0-c5e0-4541-b49d-af08f3737651 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:23.830528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e47bbe0-c5e0-4541-b49d-af08f3737651 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:23.832586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e47bbe0-c5e0-4541-b49d-af08f3737651 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.833724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e47bbe0-c5e0-4541-b49d-af08f3737651 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:23.834410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e47bbe0-c5e0-4541-b49d-af08f3737651 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.014009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9da22007-e013-4646-8d7f-baef5eea145f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a4e3b560846ec98b871b954481f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba21f0dfdc04e41a9a30fa3dddf3e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:24.024462 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9da22007-e013-4646-8d7f-baef5eea145f tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 200 len: 1521 microversion: 2.1 time: 0.476059 Jul 20 04:28:24.037043 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1952/3985] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:23 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:24.043339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a8b000e-1e17-4018-b52c-e5ab900921ac tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:24.046674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7a8b000e-1e17-4018-b52c-e5ab900921ac tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:24.060669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a8b000e-1e17-4018-b52c-e5ab900921ac tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.063435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a8b000e-1e17-4018-b52c-e5ab900921ac tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.064533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a8b000e-1e17-4018-b52c-e5ab900921ac tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.068381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a8b000e-1e17-4018-b52c-e5ab900921ac tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.284691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e47bbe0-c5e0-4541-b49d-af08f3737651 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:24.309038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e47bbe0-c5e0-4541-b49d-af08f3737651 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:24.311208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e47bbe0-c5e0-4541-b49d-af08f3737651 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:24.313051 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9e47bbe0-c5e0-4541-b49d-af08f3737651 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 200 len: 1558 microversion: 2.21 time: 0.508495 Jul 20 04:28:24.330059 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2034/3986] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:23 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 1558 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:24.339288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-d9be07a7-849e-4b54-b8f0-7a4d090697ae req-009c099f-528b-4f0c-84a8-cc4a5fe24204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9c53e05-cfbb-479b-80a3-6a17db52e44f", "name": "network-vif-deleted", "tag": "2b0d25d8-a589-4667-878e-c90799c2b8b1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:24.354668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d9be07a7-849e-4b54-b8f0-7a4d090697ae req-009c099f-528b-4f0c-84a8-cc4a5fe24204 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.355450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d9be07a7-849e-4b54-b8f0-7a4d090697ae req-009c099f-528b-4f0c-84a8-cc4a5fe24204 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.362936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:24.377841 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-d9be07a7-849e-4b54-b8f0-7a4d090697ae req-009c099f-528b-4f0c-84a8-cc4a5fe24204 service nova] Creating event network-vif-deleted:2b0d25d8-a589-4667-878e-c90799c2b8b1 for instance c9c53e05-cfbb-479b-80a3-6a17db52e44f on n-h2-764485-11 Jul 20 04:28:24.386402 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-d9be07a7-849e-4b54-b8f0-7a4d090697ae req-009c099f-528b-4f0c-84a8-cc4a5fe24204 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055008 Jul 20 04:28:24.387967 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2035/3987] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:24.396437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-22fcb5e4-af34-4a6d-846a-19e99b0ee04f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:24.397704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-22fcb5e4-af34-4a6d-846a-19e99b0ee04f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:24.408716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22fcb5e4-af34-4a6d-846a-19e99b0ee04f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.409544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22fcb5e4-af34-4a6d-846a-19e99b0ee04f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.410835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22fcb5e4-af34-4a6d-846a-19e99b0ee04f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.411876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22fcb5e4-af34-4a6d-846a-19e99b0ee04f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.464770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7a8b000e-1e17-4018-b52c-e5ab900921ac tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:24.484667 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7a8b000e-1e17-4018-b52c-e5ab900921ac tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.445999 Jul 20 04:28:24.486143 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1953/3988] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:24 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:24.552718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-10c39e98-509e-47fe-bfd9-204dca2bc8ff tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:24.554031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-10c39e98-509e-47fe-bfd9-204dca2bc8ff tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:24.563442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10c39e98-509e-47fe-bfd9-204dca2bc8ff tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.564282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10c39e98-509e-47fe-bfd9-204dca2bc8ff tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.565449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10c39e98-509e-47fe-bfd9-204dca2bc8ff tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.566098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10c39e98-509e-47fe-bfd9-204dca2bc8ff tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.854410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-22fcb5e4-af34-4a6d-846a-19e99b0ee04f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:24.868479 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-22fcb5e4-af34-4a6d-846a-19e99b0ee04f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1671 microversion: 2.1 time: 0.477959 Jul 20 04:28:24.869484 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2036/3989] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:24 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1671 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:24.874374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3de73a42-7125-4d20-b683-c4e86347d284 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:24.879710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3de73a42-7125-4d20-b683-c4e86347d284 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:24.892106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3de73a42-7125-4d20-b683-c4e86347d284 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.892886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3de73a42-7125-4d20-b683-c4e86347d284 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.893931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3de73a42-7125-4d20-b683-c4e86347d284 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.894602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3de73a42-7125-4d20-b683-c4e86347d284 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.037030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-10c39e98-509e-47fe-bfd9-204dca2bc8ff tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:25.065363 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-10c39e98-509e-47fe-bfd9-204dca2bc8ff tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1518 microversion: 2.1 time: 0.517526 Jul 20 04:28:25.067983 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1954/3990] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:24 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1518 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:25.080084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-9d7409a7-0425-49f6-b76f-067ff35e9c0c req-65f23bdc-bdec-492a-bcef-11e7b614f2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ffdfab-9da8-46f5-83ee-20735f6b4164", "name": "network-vif-plugged", "status": "completed", "tag": "de0d7b91-90f1-4e53-a48b-3c82a0802c32"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:25.132224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9d7409a7-0425-49f6-b76f-067ff35e9c0c req-65f23bdc-bdec-492a-bcef-11e7b614f2ee service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.132999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9d7409a7-0425-49f6-b76f-067ff35e9c0c req-65f23bdc-bdec-492a-bcef-11e7b614f2ee service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.159316 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-9d7409a7-0425-49f6-b76f-067ff35e9c0c req-65f23bdc-bdec-492a-bcef-11e7b614f2ee service nova] Creating event network-vif-plugged:de0d7b91-90f1-4e53-a48b-3c82a0802c32 for instance 05ffdfab-9da8-46f5-83ee-20735f6b4164 on n-h2-764485-11 Jul 20 04:28:25.169593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3de73a42-7125-4d20-b683-c4e86347d284 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:25.169972 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-9d7409a7-0425-49f6-b76f-067ff35e9c0c req-65f23bdc-bdec-492a-bcef-11e7b614f2ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098474 Jul 20 04:28:25.172836 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1955/3991] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:25.182581 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3de73a42-7125-4d20-b683-c4e86347d284 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1350 microversion: 2.1 time: 0.311728 Jul 20 04:28:25.183187 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2037/3992] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:24 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1350 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:25.194858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-047a9ec9-2619-4135-af05-5a6d29386b9e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:25.195615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-047a9ec9-2619-4135-af05-5a6d29386b9e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] [instance: c9c53e05-cfbb-479b-80a3-6a17db52e44f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:25.204670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-047a9ec9-2619-4135-af05-5a6d29386b9e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.205161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-047a9ec9-2619-4135-af05-5a6d29386b9e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.206013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-047a9ec9-2619-4135-af05-5a6d29386b9e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.206401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-047a9ec9-2619-4135-af05-5a6d29386b9e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.224730 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-047a9ec9-2619-4135-af05-5a6d29386b9e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] HTTP exception thrown: Instance c9c53e05-cfbb-479b-80a3-6a17db52e44f could not be found. Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-047a9ec9-2619-4135-af05-5a6d29386b9e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Request method failure captured: Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f HTTP/1.1 Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14LpvtEmNd4QrXIrUEvb-GSk-Q8Zjd0l-zF-kIlevLuoBgLZ_00_u1yvp6j7dRA_htG5kpVqZoVpEsFwn0RHk_cOjeEIbaoK3R2iKcoauuThhWzyvVf6At0QhXQxlwDjTmkqLnzcd5YkB5Z5aPRc9SOgHjbdPHPXD-aflxJrD9yhloY Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ba21f0dfdc04e41a9a30fa3dddf3e90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ba21f0dfdc04e41a9a30fa3dddf3e90"}]}] Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2ba21f0dfdc04e41a9a30fa3dddf3e90 Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1356314540 Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a25a4e3b560846ec98b871b954481f09 Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1356314540-project Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance c9c53e05-cfbb-479b-80a3-6a17db52e44f could not be found. Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'c9c53e05-cfbb-479b-80a3-6a17db52e44f'} Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9c53e05-cfbb-479b-80a3-6a17db52e44f could not be found. Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9c53e05-cfbb-479b-80a3-6a17db52e44f could not be found. Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:25.226986 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:25.233159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:25.233159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:25.233159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:25.233159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:25.233159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:25.233159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:25.233159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9c53e05-cfbb-479b-80a3-6a17db52e44f could not be found. Jul 20 04:28:25.233159 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:25.235814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-047a9ec9-2619-4135-af05-5a6d29386b9e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] Returning 404 to user: Instance c9c53e05-cfbb-479b-80a3-6a17db52e44f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:25.237090 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-047a9ec9-2619-4135-af05-5a6d29386b9e tempest-ServerRescueNegativeTestJSON-1356314540 tempest-ServerRescueNegativeTestJSON-1356314540-project] 10.222.0.20 "GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f" status: 404 len: 111 microversion: 2.1 time: 0.061512 Jul 20 04:28:25.241532 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1956/3993] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:25 2022] GET /compute/v2.1/servers/c9c53e05-cfbb-479b-80a3-6a17db52e44f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:28:25.348290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:25.350119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:25.373453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.377690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.383542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.386060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.493295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.496867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.503133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-988fbb9b-2bee-4a9d-a27f-c145dd8ca8c8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:25.504999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-988fbb9b-2bee-4a9d-a27f-c145dd8ca8c8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:25.514040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lazy-loading 'fault' on Instance uuid efbc68ee-0b06-4477-b30e-a3a5dc229f67 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:28:25.528114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-988fbb9b-2bee-4a9d-a27f-c145dd8ca8c8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.531202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-988fbb9b-2bee-4a9d-a27f-c145dd8ca8c8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.538943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-988fbb9b-2bee-4a9d-a27f-c145dd8ca8c8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.539327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-988fbb9b-2bee-4a9d-a27f-c145dd8ca8c8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.612709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:25.635476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:25.640906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e924df2458ab4aaf87dacb79e43a926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7384f1853e4443ae932c8effd5fffad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:25.643093 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1dd0044a-e359-485a-91cc-3f51e6edc1cf tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 200 len: 1349 microversion: 2.21 time: 0.299938 Jul 20 04:28:25.661433 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2038/3994] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:25 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 1349 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:25.776057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-988fbb9b-2bee-4a9d-a27f-c145dd8ca8c8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:25.804911 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-988fbb9b-2bee-4a9d-a27f-c145dd8ca8c8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.306060 Jul 20 04:28:25.808208 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1957/3995] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:25 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:25.888009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8b8fd1a5-12d3-42e7-9fd9-085e04fad517 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:25.888630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8b8fd1a5-12d3-42e7-9fd9-085e04fad517 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:25.900949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b8fd1a5-12d3-42e7-9fd9-085e04fad517 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.901404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b8fd1a5-12d3-42e7-9fd9-085e04fad517 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.902188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b8fd1a5-12d3-42e7-9fd9-085e04fad517 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.902627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b8fd1a5-12d3-42e7-9fd9-085e04fad517 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.077463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8b8fd1a5-12d3-42e7-9fd9-085e04fad517 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:26.096176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c4481060-eefa-4750-936c-20d72acbe5bc tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:26.097148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c4481060-eefa-4750-936c-20d72acbe5bc tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:26.110564 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8b8fd1a5-12d3-42e7-9fd9-085e04fad517 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.227881 Jul 20 04:28:26.112206 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2039/3996] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:25 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:26.113411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4481060-eefa-4750-936c-20d72acbe5bc tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.113865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4481060-eefa-4750-936c-20d72acbe5bc tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.114647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4481060-eefa-4750-936c-20d72acbe5bc tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.115086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4481060-eefa-4750-936c-20d72acbe5bc tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.128637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91071dff-9a13-47d3-8147-841ad6aa4bd2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:26.130036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91071dff-9a13-47d3-8147-841ad6aa4bd2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:26.144226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91071dff-9a13-47d3-8147-841ad6aa4bd2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.149680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91071dff-9a13-47d3-8147-841ad6aa4bd2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.150660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91071dff-9a13-47d3-8147-841ad6aa4bd2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.151158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91071dff-9a13-47d3-8147-841ad6aa4bd2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.394907 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91071dff-9a13-47d3-8147-841ad6aa4bd2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 200 len: 324 microversion: 2.1 time: 0.270274 Jul 20 04:28:26.396294 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2040/3997] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:28:26 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 324 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:26.410468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc67412f-d149-4e53-bd2c-1509ba23930b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:26.411546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc67412f-d149-4e53-bd2c-1509ba23930b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:26.419306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc67412f-d149-4e53-bd2c-1509ba23930b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.419962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc67412f-d149-4e53-bd2c-1509ba23930b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.421505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc67412f-d149-4e53-bd2c-1509ba23930b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.422354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc67412f-d149-4e53-bd2c-1509ba23930b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.526084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c4481060-eefa-4750-936c-20d72acbe5bc tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:26.534791 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c4481060-eefa-4750-936c-20d72acbe5bc tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1518 microversion: 2.1 time: 0.453220 Jul 20 04:28:26.549274 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1958/3998] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:26 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1518 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:26.555457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7748449e-0389-4f60-9bd5-2920eae97652 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:26.557989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7748449e-0389-4f60-9bd5-2920eae97652 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:26.565727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7748449e-0389-4f60-9bd5-2920eae97652 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.566450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7748449e-0389-4f60-9bd5-2920eae97652 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.568222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7748449e-0389-4f60-9bd5-2920eae97652 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.569083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7748449e-0389-4f60-9bd5-2920eae97652 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.843915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7748449e-0389-4f60-9bd5-2920eae97652 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:26.854818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cc67412f-d149-4e53-bd2c-1509ba23930b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:26.862655 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7748449e-0389-4f60-9bd5-2920eae97652 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.311813 Jul 20 04:28:26.867847 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cc67412f-d149-4e53-bd2c-1509ba23930b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1350 microversion: 2.1 time: 0.470050 Jul 20 04:28:26.869352 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2041/3999] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:26 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1350 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:26.877923 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1959/4000] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:26 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:26.907401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-808cf17b-ea02-4bbd-bb21-b925d3aa7588 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:26.908070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-808cf17b-ea02-4bbd-bb21-b925d3aa7588 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:26.910284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-e29f876f-cb95-4d8f-baf3-e7e627486d91 req-9b4e9f7d-dfcf-4337-8c4e-1ed78d603079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbc68ee-0b06-4477-b30e-a3a5dc229f67", "name": "network-vif-deleted", "tag": "073f5d74-39a0-407e-8b99-4f1de05c3ec4"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:26.923851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-808cf17b-ea02-4bbd-bb21-b925d3aa7588 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.925109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-808cf17b-ea02-4bbd-bb21-b925d3aa7588 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.929858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-808cf17b-ea02-4bbd-bb21-b925d3aa7588 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.930636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-808cf17b-ea02-4bbd-bb21-b925d3aa7588 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.945826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e29f876f-cb95-4d8f-baf3-e7e627486d91 req-9b4e9f7d-dfcf-4337-8c4e-1ed78d603079 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.946319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e29f876f-cb95-4d8f-baf3-e7e627486d91 req-9b4e9f7d-dfcf-4337-8c4e-1ed78d603079 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.981910 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-808cf17b-ea02-4bbd-bb21-b925d3aa7588 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] HTTP exception thrown: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:26.984738 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e29f876f-cb95-4d8f-baf3-e7e627486d91 req-9b4e9f7d-dfcf-4337-8c4e-1ed78d603079 service nova] Creating event network-vif-deleted:073f5d74-39a0-407e-8b99-4f1de05c3ec4 for instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 on n-h1-764485-11 Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-808cf17b-ea02-4bbd-bb21-b925d3aa7588 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Request method failure captured: Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 HTTP/1.1 Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14RPr5RtUjVhgCTRYvEzm1qOeSVbeJNZFjKB-y1IGcjcAmpNU9bQcmzEhmHGj8pm0Q6o3RIBPUSH1HqyiuEsU__2LRGZ-bAPYnfn09WxWVkuIxBSSk8hr-V2vjzPyyScMFHyzX4NlCls4M4A49mwA0VSh-2dKNvU17EFaBmfMcBCVHc Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7384f1853e4443ae932c8effd5fffad4 Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1130015190 Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7384f1853e4443ae932c8effd5fffad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7384f1853e4443ae932c8effd5fffad4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7384f1853e4443ae932c8effd5fffad4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7384f1853e4443ae932c8effd5fffad4"}]}] Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-InstanceActionsV221TestJSON-1130015190 Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7384f1853e4443ae932c8effd5fffad4 Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1130015190 Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-InstanceActionsV221TestJSON-1130015190-project Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: e924df2458ab4aaf87dacb79e43a926c Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-InstanceActionsV221TestJSON-1130015190-project Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'efbc68ee-0b06-4477-b30e-a3a5dc229f67'} Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:26.989711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:26.997760 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:26.997760 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:26.997760 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:26.997760 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:26.997760 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:26.997760 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:26.997760 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:26.997760 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:26.999042 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-e29f876f-cb95-4d8f-baf3-e7e627486d91 req-9b4e9f7d-dfcf-4337-8c4e-1ed78d603079 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096863 Jul 20 04:28:26.999042 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2042/4001] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:26.999373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-808cf17b-ea02-4bbd-bb21-b925d3aa7588 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Returning 404 to user: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:27.002093 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-808cf17b-ea02-4bbd-bb21-b925d3aa7588 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 404 len: 111 microversion: 2.21 time: 0.121702 Jul 20 04:28:27.002743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-76a1cfb1-df58-4141-bb22-e2deb4e65f8c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:27.003657 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1960/4002] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:26 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:28:27.006253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-76a1cfb1-df58-4141-bb22-e2deb4e65f8c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:27.018612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6ba8371e-4446-44ec-a36b-98d9186692b2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:27.021446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6ba8371e-4446-44ec-a36b-98d9186692b2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:27.022406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76a1cfb1-df58-4141-bb22-e2deb4e65f8c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.023064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76a1cfb1-df58-4141-bb22-e2deb4e65f8c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.029207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76a1cfb1-df58-4141-bb22-e2deb4e65f8c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.030138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76a1cfb1-df58-4141-bb22-e2deb4e65f8c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.050607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:27.057067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ba8371e-4446-44ec-a36b-98d9186692b2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.059727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ba8371e-4446-44ec-a36b-98d9186692b2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.062354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ba8371e-4446-44ec-a36b-98d9186692b2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.064183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ba8371e-4446-44ec-a36b-98d9186692b2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.461479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-76a1cfb1-df58-4141-bb22-e2deb4e65f8c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:27.476228 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-76a1cfb1-df58-4141-bb22-e2deb4e65f8c tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.477436 Jul 20 04:28:27.478743 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2043/4003] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:26 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:27.498063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8d9c8ef8-adde-4ec8-8122-6f9aad0c45cd tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '.version_select at 0x7fbf9c4f0ee0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:27.509453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8d9c8ef8-adde-4ec8-8122-6f9aad0c45cd tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:27.526419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d9c8ef8-adde-4ec8-8122-6f9aad0c45cd tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.527292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d9c8ef8-adde-4ec8-8122-6f9aad0c45cd tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.528953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d9c8ef8-adde-4ec8-8122-6f9aad0c45cd tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.532121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d9c8ef8-adde-4ec8-8122-6f9aad0c45cd tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.666790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6ba8371e-4446-44ec-a36b-98d9186692b2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:27.704698 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6ba8371e-4446-44ec-a36b-98d9186692b2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.693634 Jul 20 04:28:27.707812 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1961/4004] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:27 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:27.728355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8a3a3da1-0a12-4aec-84a2-5ac39c36bf2c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:27.730693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8a3a3da1-0a12-4aec-84a2-5ac39c36bf2c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:27.751026 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8d9c8ef8-adde-4ec8-8122-6f9aad0c45cd tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.268079 Jul 20 04:28:27.756179 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2044/4005] 10.222.0.20 () {60 vars in 1336 bytes} [Wed Jul 20 04:28:27 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67/os-instance-actions => generated 611 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:28:27.760237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a3a3da1-0a12-4aec-84a2-5ac39c36bf2c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.760701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a3a3da1-0a12-4aec-84a2-5ac39c36bf2c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.764591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a3a3da1-0a12-4aec-84a2-5ac39c36bf2c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.764591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a3a3da1-0a12-4aec-84a2-5ac39c36bf2c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.765240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:27.770112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-229341b8-e440-4a4b-b7ba-94f805c1d2ad tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:27.772657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-229341b8-e440-4a4b-b7ba-94f805c1d2ad tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:27.789414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-229341b8-e440-4a4b-b7ba-94f805c1d2ad tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.790294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-229341b8-e440-4a4b-b7ba-94f805c1d2ad tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.793521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-229341b8-e440-4a4b-b7ba-94f805c1d2ad tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.794705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-229341b8-e440-4a4b-b7ba-94f805c1d2ad tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:28.682046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8a3a3da1-0a12-4aec-84a2-5ac39c36bf2c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:28.694636 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8a3a3da1-0a12-4aec-84a2-5ac39c36bf2c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1518 microversion: 2.1 time: 0.983301 Jul 20 04:28:28.701338 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1962/4006] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:27 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1518 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:28.720985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa521abe-2b2b-4565-8fbb-5651501f2c56 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:28.722263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa521abe-2b2b-4565-8fbb-5651501f2c56 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:28.753381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa521abe-2b2b-4565-8fbb-5651501f2c56 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:28.753918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa521abe-2b2b-4565-8fbb-5651501f2c56 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:28.754751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa521abe-2b2b-4565-8fbb-5651501f2c56 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:28.755201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa521abe-2b2b-4565-8fbb-5651501f2c56 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:28.793564 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-fa521abe-2b2b-4565-8fbb-5651501f2c56 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] HTTP exception thrown: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa521abe-2b2b-4565-8fbb-5651501f2c56 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Request method failure captured: Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 HTTP/1.1 Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14RPr5RtUjVhgCTRYvEzm1qOeSVbeJNZFjKB-y1IGcjcAmpNU9bQcmzEhmHGj8pm0Q6o3RIBPUSH1HqyiuEsU__2LRGZ-bAPYnfn09WxWVkuIxBSSk8hr-V2vjzPyyScMFHyzX4NlCls4M4A49mwA0VSh-2dKNvU17EFaBmfMcBCVHc Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7384f1853e4443ae932c8effd5fffad4 Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1130015190 Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7384f1853e4443ae932c8effd5fffad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7384f1853e4443ae932c8effd5fffad4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7384f1853e4443ae932c8effd5fffad4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7384f1853e4443ae932c8effd5fffad4"}]}] Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-InstanceActionsV221TestJSON-1130015190 Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7384f1853e4443ae932c8effd5fffad4 Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1130015190 Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-InstanceActionsV221TestJSON-1130015190-project Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: e924df2458ab4aaf87dacb79e43a926c Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-InstanceActionsV221TestJSON-1130015190-project Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'efbc68ee-0b06-4477-b30e-a3a5dc229f67'} Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:28.795864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:28.801464 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:28.801464 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:28.801464 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:28.801464 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:28.801464 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:28.801464 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:28.801464 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:28.801464 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:28.801464 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:28.801464 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:28.801464 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:28.806176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa521abe-2b2b-4565-8fbb-5651501f2c56 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Returning 404 to user: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:28.807543 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fa521abe-2b2b-4565-8fbb-5651501f2c56 tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "DELETE /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 404 len: 111 microversion: 2.21 time: 0.104620 Jul 20 04:28:28.812964 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1963/4007] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:28:28 2022] DELETE /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:28:28.824959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-89f12787-a23d-47b8-aee4-bdb6ef84a7dd tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:28.826955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-89f12787-a23d-47b8-aee4-bdb6ef84a7dd tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:28.842999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89f12787-a23d-47b8-aee4-bdb6ef84a7dd tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:28.843871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89f12787-a23d-47b8-aee4-bdb6ef84a7dd tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:28.844896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89f12787-a23d-47b8-aee4-bdb6ef84a7dd tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:28.845512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89f12787-a23d-47b8-aee4-bdb6ef84a7dd tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.100134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-229341b8-e440-4a4b-b7ba-94f805c1d2ad tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:29.114966 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-229341b8-e440-4a4b-b7ba-94f805c1d2ad tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 1.348716 Jul 20 04:28:29.132158 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2045/4008] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:27 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:29.149092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eed3416d-5075-4057-8c66-9fce239038b8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:29.149917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eed3416d-5075-4057-8c66-9fce239038b8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:29.162401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eed3416d-5075-4057-8c66-9fce239038b8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.163164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eed3416d-5075-4057-8c66-9fce239038b8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.164267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eed3416d-5075-4057-8c66-9fce239038b8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.165518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eed3416d-5075-4057-8c66-9fce239038b8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.234027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89f12787-a23d-47b8-aee4-bdb6ef84a7dd tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:29.252055 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-89f12787-a23d-47b8-aee4-bdb6ef84a7dd tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1540 microversion: 2.1 time: 0.437616 Jul 20 04:28:29.252674 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1964/4009] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:28 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1540 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:29.266017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5fadbc80-bbd2-48ff-8f9c-24971ec362ad tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:29.267183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5fadbc80-bbd2-48ff-8f9c-24971ec362ad tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] [instance: efbc68ee-0b06-4477-b30e-a3a5dc229f67] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:29.279757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5fadbc80-bbd2-48ff-8f9c-24971ec362ad tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.281425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5fadbc80-bbd2-48ff-8f9c-24971ec362ad tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.285435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5fadbc80-bbd2-48ff-8f9c-24971ec362ad tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.287124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5fadbc80-bbd2-48ff-8f9c-24971ec362ad tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.321331 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-5fadbc80-bbd2-48ff-8f9c-24971ec362ad tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] HTTP exception thrown: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5fadbc80-bbd2-48ff-8f9c-24971ec362ad tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Request method failure captured: Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 HTTP/1.1 Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14RPr5RtUjVhgCTRYvEzm1qOeSVbeJNZFjKB-y1IGcjcAmpNU9bQcmzEhmHGj8pm0Q6o3RIBPUSH1HqyiuEsU__2LRGZ-bAPYnfn09WxWVkuIxBSSk8hr-V2vjzPyyScMFHyzX4NlCls4M4A49mwA0VSh-2dKNvU17EFaBmfMcBCVHc Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7384f1853e4443ae932c8effd5fffad4 Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1130015190 Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7384f1853e4443ae932c8effd5fffad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7384f1853e4443ae932c8effd5fffad4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7384f1853e4443ae932c8effd5fffad4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7384f1853e4443ae932c8effd5fffad4"}]}] Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-InstanceActionsV221TestJSON-1130015190 Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7384f1853e4443ae932c8effd5fffad4 Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1130015190 Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-InstanceActionsV221TestJSON-1130015190-project Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: e924df2458ab4aaf87dacb79e43a926c Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-InstanceActionsV221TestJSON-1130015190-project Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'efbc68ee-0b06-4477-b30e-a3a5dc229f67'} Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:29.323362 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:29.328957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:29.328957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:29.328957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:29.328957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:29.328957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:29.328957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:29.328957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. Jul 20 04:28:29.328957 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:28:29.332300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5fadbc80-bbd2-48ff-8f9c-24971ec362ad tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] Returning 404 to user: Instance efbc68ee-0b06-4477-b30e-a3a5dc229f67 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:29.334267 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5fadbc80-bbd2-48ff-8f9c-24971ec362ad tempest-InstanceActionsV221TestJSON-1130015190 tempest-InstanceActionsV221TestJSON-1130015190-project] 10.222.0.20 "GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67" status: 404 len: 111 microversion: 2.21 time: 0.080601 Jul 20 04:28:29.335207 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1965/4010] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:29 2022] GET /compute/v2.1/servers/efbc68ee-0b06-4477-b30e-a3a5dc229f67 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:28:29.343153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5df3f74e-ce58-4502-b6af-be679e16a67c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:29.345068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5df3f74e-ce58-4502-b6af-be679e16a67c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:29.362281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5df3f74e-ce58-4502-b6af-be679e16a67c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.363042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5df3f74e-ce58-4502-b6af-be679e16a67c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.364062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5df3f74e-ce58-4502-b6af-be679e16a67c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.366100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5df3f74e-ce58-4502-b6af-be679e16a67c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.559119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-eed3416d-5075-4057-8c66-9fce239038b8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:29.569453 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eed3416d-5075-4057-8c66-9fce239038b8 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.435034 Jul 20 04:28:29.570199 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2046/4011] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:29 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:29.579522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2adbab2d-2c16-4569-a5c6-9221f2b45fbf tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:29.580561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2adbab2d-2c16-4569-a5c6-9221f2b45fbf tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:29.589149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2adbab2d-2c16-4569-a5c6-9221f2b45fbf tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.589856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2adbab2d-2c16-4569-a5c6-9221f2b45fbf tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.590877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2adbab2d-2c16-4569-a5c6-9221f2b45fbf tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.591732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2adbab2d-2c16-4569-a5c6-9221f2b45fbf tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.860783 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2adbab2d-2c16-4569-a5c6-9221f2b45fbf tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.289157 Jul 20 04:28:29.862202 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2047/4012] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:28:29 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164/os-interface => generated 284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:29.864896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5df3f74e-ce58-4502-b6af-be679e16a67c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:29.869888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09004f78-ceb2-4e68-9e9b-b6ec55dde2e5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:29.870656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-09004f78-ceb2-4e68-9e9b-b6ec55dde2e5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:29.878076 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5df3f74e-ce58-4502-b6af-be679e16a67c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.539650 Jul 20 04:28:29.882642 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1966/4013] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:29 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:29.904348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09004f78-ceb2-4e68-9e9b-b6ec55dde2e5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.905236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09004f78-ceb2-4e68-9e9b-b6ec55dde2e5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.906293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09004f78-ceb2-4e68-9e9b-b6ec55dde2e5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.906967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09004f78-ceb2-4e68-9e9b-b6ec55dde2e5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:30.168162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-353532459", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "1a7e8d9c-f123-4816-a77b-51f1b199a341"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:30.282860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] validate_networks() for [('1a7e8d9c-f123-4816-a77b-51f1b199a341', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:30.953803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-09004f78-ceb2-4e68-9e9b-b6ec55dde2e5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:30.963238 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-09004f78-ceb2-4e68-9e9b-b6ec55dde2e5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1518 microversion: 2.1 time: 1.099513 Jul 20 04:28:30.966121 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2048/4014] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:29 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1518 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:30.981287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0bdc8a0d-8a71-400e-82e6-203aaa4c7743 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:30.981927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0bdc8a0d-8a71-400e-82e6-203aaa4c7743 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:30.989257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bdc8a0d-8a71-400e-82e6-203aaa4c7743 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:30.989719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bdc8a0d-8a71-400e-82e6-203aaa4c7743 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:30.990515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bdc8a0d-8a71-400e-82e6-203aaa4c7743 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:30.990963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0bdc8a0d-8a71-400e-82e6-203aaa4c7743 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:31.505503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0bdc8a0d-8a71-400e-82e6-203aaa4c7743 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:31.513793 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0bdc8a0d-8a71-400e-82e6-203aaa4c7743 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.548896 Jul 20 04:28:31.514404 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2049/4015] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:30 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:31.981001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6fe7303d-8cc4-4948-895c-9f2b4face1f5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:31.982688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6fe7303d-8cc4-4948-895c-9f2b4face1f5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:31.985311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:32.001364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fe7303d-8cc4-4948-895c-9f2b4face1f5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.003352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fe7303d-8cc4-4948-895c-9f2b4face1f5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.006403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fe7303d-8cc4-4948-895c-9f2b4face1f5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.010622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fe7303d-8cc4-4948-895c-9f2b4face1f5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.400307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:32.400849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:32.401227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:32.402299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:32.402912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:32.420696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.421492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.422605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.425376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.474915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Getting quotas for project 1be9144d8b214ecb8e416318d92b92ea. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:32.492024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Getting quotas for user b559a8f5a1724682831d18c3f7ddfdf2 and project 1be9144d8b214ecb8e416318d92b92ea. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:32.515820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:32.518115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:32.634474 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e8affc10-b999-40bf-ab88-736d9e0b2c64 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.474012 Jul 20 04:28:32.639441 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1967/4016] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:28:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:28:32.654911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9e43a6e1-655e-4c14-ba2b-10ca5efc0c17 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:32.655954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9e43a6e1-655e-4c14-ba2b-10ca5efc0c17 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:32.683137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e43a6e1-655e-4c14-ba2b-10ca5efc0c17 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.683965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e43a6e1-655e-4c14-ba2b-10ca5efc0c17 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.687255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e43a6e1-655e-4c14-ba2b-10ca5efc0c17 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.688146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e43a6e1-655e-4c14-ba2b-10ca5efc0c17 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.845629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6fe7303d-8cc4-4948-895c-9f2b4face1f5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:32.869686 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6fe7303d-8cc4-4948-895c-9f2b4face1f5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1518 microversion: 2.1 time: 0.892657 Jul 20 04:28:32.880942 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2050/4017] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:31 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1518 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:32.883751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-08405d44-9de9-4951-84a4-8200080de169 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:32.884437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-08405d44-9de9-4951-84a4-8200080de169 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:33.241420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-08405d44-9de9-4951-84a4-8200080de169 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:33.250287 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-08405d44-9de9-4951-84a4-8200080de169 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1214 microversion: 2.1 time: 0.378259 Jul 20 04:28:33.250766 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2051/4018] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:32 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1214 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:33.411209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9e43a6e1-655e-4c14-ba2b-10ca5efc0c17 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:33.424067 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9e43a6e1-655e-4c14-ba2b-10ca5efc0c17 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.780753 Jul 20 04:28:33.436489 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1968/4019] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:32 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:33.887055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cf86cab7-d3d3-4e0b-9ccc-c6bb4b627b3e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:33.887999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cf86cab7-d3d3-4e0b-9ccc-c6bb4b627b3e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:33.895072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf86cab7-d3d3-4e0b-9ccc-c6bb4b627b3e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:33.905566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf86cab7-d3d3-4e0b-9ccc-c6bb4b627b3e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:33.907673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf86cab7-d3d3-4e0b-9ccc-c6bb4b627b3e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:33.910407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf86cab7-d3d3-4e0b-9ccc-c6bb4b627b3e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:34.206012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-2679b66e-7ac2-43b9-8cae-d2509f1b3963 req-5606ca8c-0f4a-495a-8b09-8f7dba3f6ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ffdfab-9da8-46f5-83ee-20735f6b4164", "tag": "de0d7b91-90f1-4e53-a48b-3c82a0802c32"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:34.225630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2679b66e-7ac2-43b9-8cae-d2509f1b3963 req-5606ca8c-0f4a-495a-8b09-8f7dba3f6ce7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:34.226089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2679b66e-7ac2-43b9-8cae-d2509f1b3963 req-5606ca8c-0f4a-495a-8b09-8f7dba3f6ce7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:34.278366 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-2679b66e-7ac2-43b9-8cae-d2509f1b3963 req-5606ca8c-0f4a-495a-8b09-8f7dba3f6ce7 service nova] Creating event network-changed:de0d7b91-90f1-4e53-a48b-3c82a0802c32 for instance 05ffdfab-9da8-46f5-83ee-20735f6b4164 on n-h2-764485-11 Jul 20 04:28:34.301737 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-2679b66e-7ac2-43b9-8cae-d2509f1b3963 req-5606ca8c-0f4a-495a-8b09-8f7dba3f6ce7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099435 Jul 20 04:28:34.309968 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1969/4020] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:28:34.317516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1327291a-aaf9-43af-bb4a-9a1848530336 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:34.328112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1327291a-aaf9-43af-bb4a-9a1848530336 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:34.354295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1327291a-aaf9-43af-bb4a-9a1848530336 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:34.354818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1327291a-aaf9-43af-bb4a-9a1848530336 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:34.355717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1327291a-aaf9-43af-bb4a-9a1848530336 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:34.356163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1327291a-aaf9-43af-bb4a-9a1848530336 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:34.764116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cf86cab7-d3d3-4e0b-9ccc-c6bb4b627b3e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:34.781452 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cf86cab7-d3d3-4e0b-9ccc-c6bb4b627b3e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1536 microversion: 2.1 time: 0.898346 Jul 20 04:28:34.786768 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2052/4021] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:33 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1536 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:34.802102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-692505e1-cdd4-4f85-a39f-d895a6f75ece tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:34.802594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-692505e1-cdd4-4f85-a39f-d895a6f75ece tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:34.817584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-692505e1-cdd4-4f85-a39f-d895a6f75ece tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:34.821830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-692505e1-cdd4-4f85-a39f-d895a6f75ece tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:34.822820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-692505e1-cdd4-4f85-a39f-d895a6f75ece tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:34.823277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-692505e1-cdd4-4f85-a39f-d895a6f75ece tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:34.846226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1327291a-aaf9-43af-bb4a-9a1848530336 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:34.859306 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1327291a-aaf9-43af-bb4a-9a1848530336 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1266 microversion: 2.1 time: 0.546464 Jul 20 04:28:34.861192 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1970/4022] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:34 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1266 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:35.485233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-692505e1-cdd4-4f85-a39f-d895a6f75ece tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:35.493908 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-692505e1-cdd4-4f85-a39f-d895a6f75ece tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.705377 Jul 20 04:28:35.497722 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2053/4023] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:34 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:35.799749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1d9ec324-315d-4f64-b8b6-669877d5bc9a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:35.800499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1d9ec324-315d-4f64-b8b6-669877d5bc9a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:35.813741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d9ec324-315d-4f64-b8b6-669877d5bc9a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:35.814209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d9ec324-315d-4f64-b8b6-669877d5bc9a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:35.815016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d9ec324-315d-4f64-b8b6-669877d5bc9a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:35.828068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d9ec324-315d-4f64-b8b6-669877d5bc9a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:35.879131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ddeef15d-223c-4598-937e-f56f8919ea08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:35.879955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ddeef15d-223c-4598-937e-f56f8919ea08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:35.892993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddeef15d-223c-4598-937e-f56f8919ea08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:35.896080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddeef15d-223c-4598-937e-f56f8919ea08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:35.896916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddeef15d-223c-4598-937e-f56f8919ea08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:35.897371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddeef15d-223c-4598-937e-f56f8919ea08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:35.950586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:36.161873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ddeef15d-223c-4598-937e-f56f8919ea08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:36.192012 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ddeef15d-223c-4598-937e-f56f8919ea08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1274 microversion: 2.1 time: 0.318251 Jul 20 04:28:36.194377 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2054/4024] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:35 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1274 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:36.514715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c3406e8-9a3d-4577-ad07-1f82f124449b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:36.516142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8c3406e8-9a3d-4577-ad07-1f82f124449b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:36.533794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c3406e8-9a3d-4577-ad07-1f82f124449b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:36.534521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c3406e8-9a3d-4577-ad07-1f82f124449b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:36.535539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c3406e8-9a3d-4577-ad07-1f82f124449b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:36.536161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c3406e8-9a3d-4577-ad07-1f82f124449b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:36.856430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1d9ec324-315d-4f64-b8b6-669877d5bc9a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:36.872621 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1d9ec324-315d-4f64-b8b6-669877d5bc9a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1524 microversion: 2.1 time: 1.076250 Jul 20 04:28:36.875141 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1971/4025] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:35 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1524 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:37.003881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8c3406e8-9a3d-4577-ad07-1f82f124449b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:37.015630 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8c3406e8-9a3d-4577-ad07-1f82f124449b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.505023 Jul 20 04:28:37.020430 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2055/4026] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:36 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:37.061005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e5ed5ac4-b5c1-4d4f-b675-d60446d06f4f req-95eb59ea-2b82-48e4-a44b-fdae3188ddfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d9ab53-f449-4a04-b486-8b0779bb779d", "name": "network-vif-unplugged", "status": "completed", "tag": "6a4b8160-93fd-4f13-8a8f-fc94796544fd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:37.083824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e5ed5ac4-b5c1-4d4f-b675-d60446d06f4f req-95eb59ea-2b82-48e4-a44b-fdae3188ddfc service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:37.084276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e5ed5ac4-b5c1-4d4f-b675-d60446d06f4f req-95eb59ea-2b82-48e4-a44b-fdae3188ddfc service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:37.158743 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e5ed5ac4-b5c1-4d4f-b675-d60446d06f4f req-95eb59ea-2b82-48e4-a44b-fdae3188ddfc service nova] Creating event network-vif-unplugged:6a4b8160-93fd-4f13-8a8f-fc94796544fd for instance 36d9ab53-f449-4a04-b486-8b0779bb779d on n-h1-764485-11 Jul 20 04:28:37.169783 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e5ed5ac4-b5c1-4d4f-b675-d60446d06f4f req-95eb59ea-2b82-48e4-a44b-fdae3188ddfc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113532 Jul 20 04:28:37.174324 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1972/4027] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:37.214393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-048e88be-dbdd-4043-a13f-4ebc15fe97a7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:37.215327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-048e88be-dbdd-4043-a13f-4ebc15fe97a7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:37.239860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-048e88be-dbdd-4043-a13f-4ebc15fe97a7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:37.241861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-048e88be-dbdd-4043-a13f-4ebc15fe97a7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:37.244071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-048e88be-dbdd-4043-a13f-4ebc15fe97a7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:37.244946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-048e88be-dbdd-4043-a13f-4ebc15fe97a7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:37.504982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-048e88be-dbdd-4043-a13f-4ebc15fe97a7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:37.521670 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-048e88be-dbdd-4043-a13f-4ebc15fe97a7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1272 microversion: 2.1 time: 0.311223 Jul 20 04:28:37.522219 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2056/4028] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:37 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1272 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:37.896767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ba6bbeed-801a-435c-a86c-27e6238367d4 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:37.898212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ba6bbeed-801a-435c-a86c-27e6238367d4 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:37.912663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba6bbeed-801a-435c-a86c-27e6238367d4 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:37.913122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba6bbeed-801a-435c-a86c-27e6238367d4 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:37.913922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba6bbeed-801a-435c-a86c-27e6238367d4 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:37.914366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba6bbeed-801a-435c-a86c-27e6238367d4 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:38.037475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a809af00-059c-4616-b2ee-0e66e9802881 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:38.038651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a809af00-059c-4616-b2ee-0e66e9802881 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:38.065647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a809af00-059c-4616-b2ee-0e66e9802881 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:38.068191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a809af00-059c-4616-b2ee-0e66e9802881 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:38.072681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a809af00-059c-4616-b2ee-0e66e9802881 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:38.074600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a809af00-059c-4616-b2ee-0e66e9802881 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:38.760023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a809af00-059c-4616-b2ee-0e66e9802881 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:38.771613 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a809af00-059c-4616-b2ee-0e66e9802881 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.737269 Jul 20 04:28:38.777473 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2057/4029] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:38 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:38.789124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57f5384e-9f0b-4ad0-b63d-9138a21011f1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:38.796191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-57f5384e-9f0b-4ad0-b63d-9138a21011f1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:38.812027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57f5384e-9f0b-4ad0-b63d-9138a21011f1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:38.813136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57f5384e-9f0b-4ad0-b63d-9138a21011f1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:38.814212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57f5384e-9f0b-4ad0-b63d-9138a21011f1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:38.814956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57f5384e-9f0b-4ad0-b63d-9138a21011f1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:38.889274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ba6bbeed-801a-435c-a86c-27e6238367d4 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:38.906784 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ba6bbeed-801a-435c-a86c-27e6238367d4 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1524 microversion: 2.1 time: 1.016894 Jul 20 04:28:38.924040 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1973/4030] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:37 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1524 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:39.354924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-57f5384e-9f0b-4ad0-b63d-9138a21011f1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:39.393709 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57f5384e-9f0b-4ad0-b63d-9138a21011f1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1314 microversion: 2.1 time: 0.602718 Jul 20 04:28:39.393709 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2058/4031] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:38 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:39.791942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6b8b146e-16fb-4e80-b420-6216a48f0f9e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:39.792838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6b8b146e-16fb-4e80-b420-6216a48f0f9e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:39.802885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b8b146e-16fb-4e80-b420-6216a48f0f9e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.804383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b8b146e-16fb-4e80-b420-6216a48f0f9e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.806870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b8b146e-16fb-4e80-b420-6216a48f0f9e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.808652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6b8b146e-16fb-4e80-b420-6216a48f0f9e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.219574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6a057325-adb7-4007-9f39-19d79860b5e5 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Action: 'create', calling method: .version_select at 0x7fbf9c564940>, body: {"keypair": {"name": "tempest-keypair-133672360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPG5IDUIvPQ7elim3pTLEy9SkSjZrk9oA4YDMmobusueSVS95x0KO/Q6pVy9u7K9lOyLjMKoPH3UU9fVbrFNzXL3FDcRir/OxRqS3Ma3//ieda6OoGCHLSTU/I2F0zM3Ag=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:40.261461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6b8b146e-16fb-4e80-b420-6216a48f0f9e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:40.265108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-6a057325-adb7-4007-9f39-19d79860b5e5 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Getting quotas for project b57ef1075ca8492c829c3814ef2aa111. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:40.269602 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6b8b146e-16fb-4e80-b420-6216a48f0f9e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.482203 Jul 20 04:28:40.273834 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1974/4032] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:39 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:40.281915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3d873072-a705-4f96-8a2d-85ff43de0320 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:40.282249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-6a057325-adb7-4007-9f39-19d79860b5e5 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Getting quotas for user d3153bab9eac4da0b257c291da3767ef and project b57ef1075ca8492c829c3814ef2aa111. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:40.283065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3d873072-a705-4f96-8a2d-85ff43de0320 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:40.303762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d873072-a705-4f96-8a2d-85ff43de0320 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.309911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d873072-a705-4f96-8a2d-85ff43de0320 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.311225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d873072-a705-4f96-8a2d-85ff43de0320 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.312173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d873072-a705-4f96-8a2d-85ff43de0320 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.334568 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6a057325-adb7-4007-9f39-19d79860b5e5 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.431227 Jul 20 04:28:40.335200 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2059/4033] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:28:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:28:40.354039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-81a84498-2889-4e8d-aa8b-6be47e6ddf21 req-8271282c-ce36-412c-a09f-7112ae45e2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48738f5-dd70-4d38-ae59-ddd1b3a03c36", "tag": "833ba1d8-16e2-493c-ab15-8538117a4f3b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:40.373654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-81a84498-2889-4e8d-aa8b-6be47e6ddf21 req-8271282c-ce36-412c-a09f-7112ae45e2c5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.374459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-81a84498-2889-4e8d-aa8b-6be47e6ddf21 req-8271282c-ce36-412c-a09f-7112ae45e2c5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.407229 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-81a84498-2889-4e8d-aa8b-6be47e6ddf21 req-8271282c-ce36-412c-a09f-7112ae45e2c5 service nova] Creating event network-changed:833ba1d8-16e2-493c-ab15-8538117a4f3b for instance a48738f5-dd70-4d38-ae59-ddd1b3a03c36 on n-h1-764485-11 Jul 20 04:28:40.420208 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-81a84498-2889-4e8d-aa8b-6be47e6ddf21 req-8271282c-ce36-412c-a09f-7112ae45e2c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080040 Jul 20 04:28:40.423938 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2060/4034] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:40.439780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-958ed9d1-a04f-4313-b09c-e647d6152a96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:40.446727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-958ed9d1-a04f-4313-b09c-e647d6152a96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:40.462321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-958ed9d1-a04f-4313-b09c-e647d6152a96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.467021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-958ed9d1-a04f-4313-b09c-e647d6152a96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.469473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-958ed9d1-a04f-4313-b09c-e647d6152a96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.473503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-958ed9d1-a04f-4313-b09c-e647d6152a96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.982531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-958ed9d1-a04f-4313-b09c-e647d6152a96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:40.991296 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-958ed9d1-a04f-4313-b09c-e647d6152a96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1314 microversion: 2.1 time: 0.565853 Jul 20 04:28:40.996407 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2061/4035] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:40 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:41.036168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3d873072-a705-4f96-8a2d-85ff43de0320 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:41.059151 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3d873072-a705-4f96-8a2d-85ff43de0320 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1524 microversion: 2.1 time: 0.778654 Jul 20 04:28:41.061010 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1975/4036] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:40 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1524 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:41.292387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e13094e7-716e-40a8-8198-83f303c862ff tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:41.293728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e13094e7-716e-40a8-8198-83f303c862ff tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:41.303434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e13094e7-716e-40a8-8198-83f303c862ff tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.311668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e13094e7-716e-40a8-8198-83f303c862ff tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.312815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e13094e7-716e-40a8-8198-83f303c862ff tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.313479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e13094e7-716e-40a8-8198-83f303c862ff tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.013388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1c0bc95e-ee08-4792-b182-3935e48de78d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:42.014180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1c0bc95e-ee08-4792-b182-3935e48de78d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:42.040975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c0bc95e-ee08-4792-b182-3935e48de78d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.043396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c0bc95e-ee08-4792-b182-3935e48de78d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.044288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c0bc95e-ee08-4792-b182-3935e48de78d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.044733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c0bc95e-ee08-4792-b182-3935e48de78d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.117546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e13094e7-716e-40a8-8198-83f303c862ff tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:42.136324 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e13094e7-716e-40a8-8198-83f303c862ff tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.849592 Jul 20 04:28:42.136856 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2062/4037] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:41 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:42.162852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4d4939b8-756c-4b25-9874-77dd2dde5e05 req-d716fd00-25e2-4c86-af6f-838e0075b90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d9ab53-f449-4a04-b486-8b0779bb779d", "name": "network-vif-plugged", "status": "completed", "tag": "6a4b8160-93fd-4f13-8a8f-fc94796544fd"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:42.216195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4d4939b8-756c-4b25-9874-77dd2dde5e05 req-d716fd00-25e2-4c86-af6f-838e0075b90f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.218081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4d4939b8-756c-4b25-9874-77dd2dde5e05 req-d716fd00-25e2-4c86-af6f-838e0075b90f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.269199 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4d4939b8-756c-4b25-9874-77dd2dde5e05 req-d716fd00-25e2-4c86-af6f-838e0075b90f service nova] Creating event network-vif-plugged:6a4b8160-93fd-4f13-8a8f-fc94796544fd for instance 36d9ab53-f449-4a04-b486-8b0779bb779d on n-h1-764485-11 Jul 20 04:28:42.284579 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4d4939b8-756c-4b25-9874-77dd2dde5e05 req-d716fd00-25e2-4c86-af6f-838e0075b90f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142871 Jul 20 04:28:42.285817 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2063/4038] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:42.298196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-43ac8840-94e9-49b2-bf53-b351d8bc76b9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:42.299585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-43ac8840-94e9-49b2-bf53-b351d8bc76b9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:42.308284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43ac8840-94e9-49b2-bf53-b351d8bc76b9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.309064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43ac8840-94e9-49b2-bf53-b351d8bc76b9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.310101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43ac8840-94e9-49b2-bf53-b351d8bc76b9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.310772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43ac8840-94e9-49b2-bf53-b351d8bc76b9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.446407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:42.511774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:42.588933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1c0bc95e-ee08-4792-b182-3935e48de78d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:42.606597 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1c0bc95e-ee08-4792-b182-3935e48de78d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1314 microversion: 2.1 time: 0.597840 Jul 20 04:28:42.607229 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1976/4039] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:42 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:42.740920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-43ac8840-94e9-49b2-bf53-b351d8bc76b9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:42.752318 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-43ac8840-94e9-49b2-bf53-b351d8bc76b9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1524 microversion: 2.1 time: 0.460972 Jul 20 04:28:42.753152 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2064/4040] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:42 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1524 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:43.153294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d7988c4e-6235-4ce6-befc-6a3841d253db tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:43.154019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d7988c4e-6235-4ce6-befc-6a3841d253db tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:43.169029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7988c4e-6235-4ce6-befc-6a3841d253db tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:43.169949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7988c4e-6235-4ce6-befc-6a3841d253db tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:43.172877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7988c4e-6235-4ce6-befc-6a3841d253db tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:43.174022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7988c4e-6235-4ce6-befc-6a3841d253db tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:43.624379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c757558b-32f9-4f76-847e-dffff9b2b0d7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:43.625703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c757558b-32f9-4f76-847e-dffff9b2b0d7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:43.646475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c757558b-32f9-4f76-847e-dffff9b2b0d7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:43.648197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c757558b-32f9-4f76-847e-dffff9b2b0d7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:43.652999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c757558b-32f9-4f76-847e-dffff9b2b0d7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:43.654384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c757558b-32f9-4f76-847e-dffff9b2b0d7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:44.497649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d7988c4e-6235-4ce6-befc-6a3841d253db tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:44.514171 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d7988c4e-6235-4ce6-befc-6a3841d253db tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 1.361529 Jul 20 04:28:44.524031 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1977/4041] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:43 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:44.526913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0fa4bd6d-867a-49c1-a601-31d3e1dd7303 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:44.541603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0fa4bd6d-867a-49c1-a601-31d3e1dd7303 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:44.559748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0fa4bd6d-867a-49c1-a601-31d3e1dd7303 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:44.567211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0fa4bd6d-867a-49c1-a601-31d3e1dd7303 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:44.568024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0fa4bd6d-867a-49c1-a601-31d3e1dd7303 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:44.568472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0fa4bd6d-867a-49c1-a601-31d3e1dd7303 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:44.869535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c757558b-32f9-4f76-847e-dffff9b2b0d7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:44.879770 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c757558b-32f9-4f76-847e-dffff9b2b0d7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1314 microversion: 2.1 time: 1.259784 Jul 20 04:28:44.880378 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2065/4042] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:43 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1314 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:45.096241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0fa4bd6d-867a-49c1-a601-31d3e1dd7303 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:45.125369 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0fa4bd6d-867a-49c1-a601-31d3e1dd7303 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1524 microversion: 2.1 time: 0.596593 Jul 20 04:28:45.137383 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1978/4043] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:44 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1524 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:45.397547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-496145758", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f20fd2cb-4f15-4aa3-b329-7ef6a1fa5321"}], "security_groups": [{"name": "tempest-securitygroup--1372997012"}], "key_name": "tempest-keypair-133672360", "user_data": "}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:45.540772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ca7c76f-2aad-429e-949e-491e7db9ccde tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:45.544612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ca7c76f-2aad-429e-949e-491e7db9ccde tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:45.584327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ca7c76f-2aad-429e-949e-491e7db9ccde tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:45.584983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ca7c76f-2aad-429e-949e-491e7db9ccde tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:45.587987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ca7c76f-2aad-429e-949e-491e7db9ccde tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:45.589620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ca7c76f-2aad-429e-949e-491e7db9ccde tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:45.784806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] validate_networks() for [('f20fd2cb-4f15-4aa3-b329-7ef6a1fa5321', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:46.163908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ca7c76f-2aad-429e-949e-491e7db9ccde tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:46.177521 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ca7c76f-2aad-429e-949e-491e7db9ccde tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.649802 Jul 20 04:28:46.180647 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1979/4044] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:45 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:46.193028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d7def8a9-2dcf-4dd3-a655-0753ef8759fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:46.195621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d7def8a9-2dcf-4dd3-a655-0753ef8759fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:46.217269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7def8a9-2dcf-4dd3-a655-0753ef8759fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.218169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7def8a9-2dcf-4dd3-a655-0753ef8759fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.226845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7def8a9-2dcf-4dd3-a655-0753ef8759fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.227438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d7def8a9-2dcf-4dd3-a655-0753ef8759fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.731449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:46.732498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:46.733184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:46.733789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:46.734417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:46.755965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.756705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.757697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.758390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.802639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Getting quotas for project b57ef1075ca8492c829c3814ef2aa111. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:46.810545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Getting quotas for user d3153bab9eac4da0b257c291da3767ef and project b57ef1075ca8492c829c3814ef2aa111. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:46.814821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d7def8a9-2dcf-4dd3-a655-0753ef8759fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:46.825688 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d7def8a9-2dcf-4dd3-a655-0753ef8759fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1314 microversion: 2.1 time: 0.643064 Jul 20 04:28:46.827651 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1980/4045] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:46 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:46.833575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8a381fb6-fcc9-4084-afd2-435ea8f842e2 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:46.842275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8a381fb6-fcc9-4084-afd2-435ea8f842e2 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:46.851037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:46.855924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:46.861720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a381fb6-fcc9-4084-afd2-435ea8f842e2 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.862071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a381fb6-fcc9-4084-afd2-435ea8f842e2 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.862868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a381fb6-fcc9-4084-afd2-435ea8f842e2 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.863439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a381fb6-fcc9-4084-afd2-435ea8f842e2 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.998797 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-87eaabed-2cd3-495a-979e-5b397bf47638 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.609527 Jul 20 04:28:46.999865 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2066/4046] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:28:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:28:47.013890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-118b8e49-2019-4a3b-b13a-a3a910b28a56 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:47.018472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-118b8e49-2019-4a3b-b13a-a3a910b28a56 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:47.491054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8a381fb6-fcc9-4084-afd2-435ea8f842e2 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:47.508710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-118b8e49-2019-4a3b-b13a-a3a910b28a56 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:47.518336 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8a381fb6-fcc9-4084-afd2-435ea8f842e2 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1509 microversion: 2.1 time: 0.673696 Jul 20 04:28:47.519546 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1981/4047] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:46 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1509 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:47.521514 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-118b8e49-2019-4a3b-b13a-a3a910b28a56 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1236 microversion: 2.1 time: 0.512553 Jul 20 04:28:47.535268 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2067/4048] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:47 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1236 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:47.557767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2cdeabb8-ec16-4bde-8fc5-08ec0aa7b3b9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:47.560815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2cdeabb8-ec16-4bde-8fc5-08ec0aa7b3b9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:47.561906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2292c4c8-138a-4d74-8257-d55be81921d5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:47.563896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2292c4c8-138a-4d74-8257-d55be81921d5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:47.570492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cdeabb8-ec16-4bde-8fc5-08ec0aa7b3b9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.571825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cdeabb8-ec16-4bde-8fc5-08ec0aa7b3b9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.573222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cdeabb8-ec16-4bde-8fc5-08ec0aa7b3b9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.574468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cdeabb8-ec16-4bde-8fc5-08ec0aa7b3b9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.581325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2292c4c8-138a-4d74-8257-d55be81921d5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.582106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:47.582258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2292c4c8-138a-4d74-8257-d55be81921d5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.584347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2292c4c8-138a-4d74-8257-d55be81921d5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.586200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2292c4c8-138a-4d74-8257-d55be81921d5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.963863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2cdeabb8-ec16-4bde-8fc5-08ec0aa7b3b9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:47.974432 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2cdeabb8-ec16-4bde-8fc5-08ec0aa7b3b9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.438242 Jul 20 04:28:47.975312 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1982/4049] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:47 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:47.980986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-654ae448-db69-4097-80a9-4a6778e1b1ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:47.982425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-654ae448-db69-4097-80a9-4a6778e1b1ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:47.990127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-654ae448-db69-4097-80a9-4a6778e1b1ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.990737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2292c4c8-138a-4d74-8257-d55be81921d5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:47.991473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-654ae448-db69-4097-80a9-4a6778e1b1ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.992704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-654ae448-db69-4097-80a9-4a6778e1b1ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.993781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-654ae448-db69-4097-80a9-4a6778e1b1ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:48.006737 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2292c4c8-138a-4d74-8257-d55be81921d5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 200 len: 1509 microversion: 2.1 time: 0.466559 Jul 20 04:28:48.010601 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2068/4050] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:47 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 1509 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:48.031348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7c5fddf-136b-4c97-8a47-f7f79229e48c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:48.031884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a7c5fddf-136b-4c97-8a47-f7f79229e48c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:48.047359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7c5fddf-136b-4c97-8a47-f7f79229e48c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:48.047841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7c5fddf-136b-4c97-8a47-f7f79229e48c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:48.048669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7c5fddf-136b-4c97-8a47-f7f79229e48c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:48.049113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7c5fddf-136b-4c97-8a47-f7f79229e48c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:48.113923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a7c5fddf-136b-4c97-8a47-f7f79229e48c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:28:48.267385 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a7c5fddf-136b-4c97-8a47-f7f79229e48c tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "DELETE /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 204 len: 0 microversion: 2.1 time: 0.240115 Jul 20 04:28:48.271827 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2069/4051] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:28:48 2022] DELETE /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:28:48.424733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1908149751", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "9cdacc80-9ca0-43c9-ac06-5dd04d922b8c"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:48.490804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] validate_networks() for [('9cdacc80-9ca0-43c9-ac06-5dd04d922b8c', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:48.530733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-654ae448-db69-4097-80a9-4a6778e1b1ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:48.547679 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-654ae448-db69-4097-80a9-4a6778e1b1ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1314 microversion: 2.1 time: 0.569479 Jul 20 04:28:48.548460 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1983/4052] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:47 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:48.561911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-190f19e2-d0f2-4204-8147-966e8af723a0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:48.564129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-190f19e2-d0f2-4204-8147-966e8af723a0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:48.578952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-190f19e2-d0f2-4204-8147-966e8af723a0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:48.579433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-190f19e2-d0f2-4204-8147-966e8af723a0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:48.580274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-190f19e2-d0f2-4204-8147-966e8af723a0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:48.580726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-190f19e2-d0f2-4204-8147-966e8af723a0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:48.793176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-190f19e2-d0f2-4204-8147-966e8af723a0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:48.802357 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-190f19e2-d0f2-4204-8147-966e8af723a0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1288 microversion: 2.1 time: 0.251155 Jul 20 04:28:48.816663 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1984/4053] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:48 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1288 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:48.992344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-636caa96-a6a4-4ad6-b9e9-55028a189c06 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:48.992939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-636caa96-a6a4-4ad6-b9e9-55028a189c06 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:48.999990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-636caa96-a6a4-4ad6-b9e9-55028a189c06 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:49.001161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-636caa96-a6a4-4ad6-b9e9-55028a189c06 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:49.002212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-636caa96-a6a4-4ad6-b9e9-55028a189c06 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:49.003329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-636caa96-a6a4-4ad6-b9e9-55028a189c06 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.170855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-636caa96-a6a4-4ad6-b9e9-55028a189c06 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:50.186824 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-636caa96-a6a4-4ad6-b9e9-55028a189c06 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 1.197827 Jul 20 04:28:50.192326 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1985/4054] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:48 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:50.197979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-45ed228c-a968-49fa-a9d9-1721385d2be4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:50.205328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-45ed228c-a968-49fa-a9d9-1721385d2be4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:50.223024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45ed228c-a968-49fa-a9d9-1721385d2be4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.228739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45ed228c-a968-49fa-a9d9-1721385d2be4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.229904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45ed228c-a968-49fa-a9d9-1721385d2be4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.232638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45ed228c-a968-49fa-a9d9-1721385d2be4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.482443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:50.483011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:50.483338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:50.483784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:50.484202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:50.505505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.505961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.506764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.507208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.552759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Getting quotas for project d582deaa5e004a74896f52dcd144ad78. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:50.558910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Getting quotas for user fbf1033ee8b84c3a89c31b2f44479f8b and project d582deaa5e004a74896f52dcd144ad78. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:50.579438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:50.582221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:50.688689 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d430253b-ac4b-4a43-ab4d-8830049b2136 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.268327 Jul 20 04:28:50.691451 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2070/4055] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:28:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:28:50.712235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d0e2d78b-e6cd-4967-bb5a-93939bf11564 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:50.713367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d0e2d78b-e6cd-4967-bb5a-93939bf11564 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:50.740503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-45ed228c-a968-49fa-a9d9-1721385d2be4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:50.750307 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-45ed228c-a968-49fa-a9d9-1721385d2be4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1314 microversion: 2.1 time: 0.556571 Jul 20 04:28:50.755717 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1986/4056] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:50 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:50.768802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0e2d78b-e6cd-4967-bb5a-93939bf11564 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.769626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0e2d78b-e6cd-4967-bb5a-93939bf11564 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.771308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0e2d78b-e6cd-4967-bb5a-93939bf11564 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.798318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d0e2d78b-e6cd-4967-bb5a-93939bf11564 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.805939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-fb940b2a-faa0-432f-b8c8-50a188f0d74c req-0d8bcccb-a1f2-4c8d-92e3-e295fad9d97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48738f5-dd70-4d38-ae59-ddd1b3a03c36", "name": "network-vif-plugged", "status": "completed", "tag": "833ba1d8-16e2-493c-ab15-8538117a4f3b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:50.841673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fb940b2a-faa0-432f-b8c8-50a188f0d74c req-0d8bcccb-a1f2-4c8d-92e3-e295fad9d97d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.843386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fb940b2a-faa0-432f-b8c8-50a188f0d74c req-0d8bcccb-a1f2-4c8d-92e3-e295fad9d97d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.866910 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-fb940b2a-faa0-432f-b8c8-50a188f0d74c req-0d8bcccb-a1f2-4c8d-92e3-e295fad9d97d service nova] Creating event network-vif-plugged:833ba1d8-16e2-493c-ab15-8538117a4f3b for instance a48738f5-dd70-4d38-ae59-ddd1b3a03c36 on n-h1-764485-11 Jul 20 04:28:50.875004 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-fb940b2a-faa0-432f-b8c8-50a188f0d74c req-0d8bcccb-a1f2-4c8d-92e3-e295fad9d97d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104782 Jul 20 04:28:50.879090 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1987/4057] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:50.886235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cea82bcb-ff60-4647-ba9b-f5a48b641a41 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:50.886994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cea82bcb-ff60-4647-ba9b-f5a48b641a41 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:51.301552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d0e2d78b-e6cd-4967-bb5a-93939bf11564 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:51.313711 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d0e2d78b-e6cd-4967-bb5a-93939bf11564 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1294 microversion: 2.1 time: 0.620894 Jul 20 04:28:51.319650 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2071/4058] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:50 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1294 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:51.338191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ad2c40f4-d655-403c-aad0-5d28e8edeafc req-49d731cf-1c32-44f4-9e38-1e99a1ebcc43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d9ab53-f449-4a04-b486-8b0779bb779d", "name": "network-vif-deleted", "tag": "6a4b8160-93fd-4f13-8a8f-fc94796544fd"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:51.364414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ad2c40f4-d655-403c-aad0-5d28e8edeafc req-49d731cf-1c32-44f4-9e38-1e99a1ebcc43 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:51.369948 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ad2c40f4-d655-403c-aad0-5d28e8edeafc req-49d731cf-1c32-44f4-9e38-1e99a1ebcc43 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:51.372717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cea82bcb-ff60-4647-ba9b-f5a48b641a41 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:51.389274 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cea82bcb-ff60-4647-ba9b-f5a48b641a41 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1218 microversion: 2.1 time: 0.508659 Jul 20 04:28:51.389939 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1988/4059] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:50 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1218 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:51.409448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e56bde55-fd09-46da-a8d3-2a72fe53eb4a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:51.411804 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ad2c40f4-d655-403c-aad0-5d28e8edeafc req-49d731cf-1c32-44f4-9e38-1e99a1ebcc43 service nova] Creating event network-vif-deleted:6a4b8160-93fd-4f13-8a8f-fc94796544fd for instance 36d9ab53-f449-4a04-b486-8b0779bb779d on n-h1-764485-11 Jul 20 04:28:51.423360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e56bde55-fd09-46da-a8d3-2a72fe53eb4a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:51.425434 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ad2c40f4-d655-403c-aad0-5d28e8edeafc req-49d731cf-1c32-44f4-9e38-1e99a1ebcc43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092910 Jul 20 04:28:51.429080 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2072/4060] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:51.465021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e56bde55-fd09-46da-a8d3-2a72fe53eb4a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:51.465923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e56bde55-fd09-46da-a8d3-2a72fe53eb4a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:51.469564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e56bde55-fd09-46da-a8d3-2a72fe53eb4a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:51.470278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e56bde55-fd09-46da-a8d3-2a72fe53eb4a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:51.816133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-263332462", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "55e7c15d-e0c3-4a26-99b5-e05acbb7cd51"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:52.003125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] validate_networks() for [('55e7c15d-e0c3-4a26-99b5-e05acbb7cd51', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:52.052279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e56bde55-fd09-46da-a8d3-2a72fe53eb4a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:52.060262 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e56bde55-fd09-46da-a8d3-2a72fe53eb4a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.658711 Jul 20 04:28:52.060860 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1989/4061] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:51 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:52.073529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3c7f1104-40f9-4c1c-9682-7a56ffc04c3f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:52.074152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3c7f1104-40f9-4c1c-9682-7a56ffc04c3f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:52.100379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c7f1104-40f9-4c1c-9682-7a56ffc04c3f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:52.100840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c7f1104-40f9-4c1c-9682-7a56ffc04c3f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:52.101646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c7f1104-40f9-4c1c-9682-7a56ffc04c3f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:52.103492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c7f1104-40f9-4c1c-9682-7a56ffc04c3f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:52.713856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3c7f1104-40f9-4c1c-9682-7a56ffc04c3f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:52.732375 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3c7f1104-40f9-4c1c-9682-7a56ffc04c3f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1314 microversion: 2.1 time: 0.663295 Jul 20 04:28:52.733004 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1990/4062] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:52 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:52.746202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6663b6b2-48d3-4d5a-afe6-9440fd1df4cd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:52.746922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6663b6b2-48d3-4d5a-afe6-9440fd1df4cd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:52.753722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6663b6b2-48d3-4d5a-afe6-9440fd1df4cd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:52.754184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6663b6b2-48d3-4d5a-afe6-9440fd1df4cd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:52.755077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6663b6b2-48d3-4d5a-afe6-9440fd1df4cd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:52.755542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6663b6b2-48d3-4d5a-afe6-9440fd1df4cd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:52.888193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6663b6b2-48d3-4d5a-afe6-9440fd1df4cd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:52.896227 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6663b6b2-48d3-4d5a-afe6-9440fd1df4cd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1294 microversion: 2.1 time: 0.161985 Jul 20 04:28:52.897557 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1991/4063] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:52 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1294 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:52.902998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-77b7cdc7-dd8d-463a-898d-e1b1b1fd5194 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:52.903864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-77b7cdc7-dd8d-463a-898d-e1b1b1fd5194 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:52.910640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77b7cdc7-dd8d-463a-898d-e1b1b1fd5194 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:52.911375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77b7cdc7-dd8d-463a-898d-e1b1b1fd5194 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:52.912355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77b7cdc7-dd8d-463a-898d-e1b1b1fd5194 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:52.912968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77b7cdc7-dd8d-463a-898d-e1b1b1fd5194 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:53.176034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-77b7cdc7-dd8d-463a-898d-e1b1b1fd5194 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:53.194936 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-77b7cdc7-dd8d-463a-898d-e1b1b1fd5194 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1214 microversion: 2.1 time: 0.294699 Jul 20 04:28:53.210301 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1992/4064] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:52 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1214 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:53.218550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a34cc0f6-ef53-4e57-b3c1-57744523a861 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:53.220502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a34cc0f6-ef53-4e57-b3c1-57744523a861 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:53.255836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a34cc0f6-ef53-4e57-b3c1-57744523a861 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:53.256295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a34cc0f6-ef53-4e57-b3c1-57744523a861 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:53.263207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a34cc0f6-ef53-4e57-b3c1-57744523a861 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:53.263852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a34cc0f6-ef53-4e57-b3c1-57744523a861 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.057375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a34cc0f6-ef53-4e57-b3c1-57744523a861 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:54.069521 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a34cc0f6-ef53-4e57-b3c1-57744523a861 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1506 microversion: 2.1 time: 0.857571 Jul 20 04:28:54.071401 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1993/4065] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:53 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1506 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:54.080529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-31b956f5-fed3-4ece-add9-cb89a84034f0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:54.082904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-31b956f5-fed3-4ece-add9-cb89a84034f0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:54.099130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31b956f5-fed3-4ece-add9-cb89a84034f0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.100551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31b956f5-fed3-4ece-add9-cb89a84034f0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.105672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31b956f5-fed3-4ece-add9-cb89a84034f0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.107449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31b956f5-fed3-4ece-add9-cb89a84034f0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.511456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:54.512676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:54.513854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:54.514627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:54.515915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:54.531894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.532467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.533531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.534212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.568491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:54.575705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Getting quotas for project d282b4ab77e646e3b7a7f93c84323c1a. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:54.619253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Getting quotas for user b83ad35722124814aec8d8812e21f1a7 and project d282b4ab77e646e3b7a7f93c84323c1a. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:54.665196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:54.671324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:54.754797 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ae096feb-bcd2-4f42-99f8-0ae248e88b68 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.320493 Jul 20 04:28:54.755971 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2073/4066] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:28:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:28:54.764332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f4eaac29-3b6e-4b65-84e5-3bde68ae6826 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:54.765563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f4eaac29-3b6e-4b65-84e5-3bde68ae6826 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:54.780199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4eaac29-3b6e-4b65-84e5-3bde68ae6826 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.780989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4eaac29-3b6e-4b65-84e5-3bde68ae6826 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.793079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4eaac29-3b6e-4b65-84e5-3bde68ae6826 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.797048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4eaac29-3b6e-4b65-84e5-3bde68ae6826 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.112503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-31b956f5-fed3-4ece-add9-cb89a84034f0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:55.125000 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-31b956f5-fed3-4ece-add9-cb89a84034f0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1502 microversion: 2.1 time: 1.049158 Jul 20 04:28:55.126886 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1994/4067] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:54 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1502 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:55.142242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2d2fe590-ab79-4832-955e-cd479fac125a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:55.145296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2d2fe590-ab79-4832-955e-cd479fac125a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:55.158779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d2fe590-ab79-4832-955e-cd479fac125a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.168889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d2fe590-ab79-4832-955e-cd479fac125a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.170601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d2fe590-ab79-4832-955e-cd479fac125a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.171168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d2fe590-ab79-4832-955e-cd479fac125a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.439318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2d2fe590-ab79-4832-955e-cd479fac125a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:55.450674 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2d2fe590-ab79-4832-955e-cd479fac125a tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1276 microversion: 2.1 time: 0.320798 Jul 20 04:28:55.463331 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1995/4068] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:55 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1276 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:55.470992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7c1d11b8-e762-4fcf-8ba8-d251af44b28d tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:55.472647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7c1d11b8-e762-4fcf-8ba8-d251af44b28d tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:55.659693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f4eaac29-3b6e-4b65-84e5-3bde68ae6826 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:55.674694 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f4eaac29-3b6e-4b65-84e5-3bde68ae6826 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1362 microversion: 2.1 time: 0.917238 Jul 20 04:28:55.681205 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2074/4069] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:54 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1362 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:55.699113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2b6ab15a-662f-4aea-b061-f8549fb4e757 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:55.701217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2b6ab15a-662f-4aea-b061-f8549fb4e757 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:55.716309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b6ab15a-662f-4aea-b061-f8549fb4e757 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.716931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b6ab15a-662f-4aea-b061-f8549fb4e757 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.718487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b6ab15a-662f-4aea-b061-f8549fb4e757 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.719369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b6ab15a-662f-4aea-b061-f8549fb4e757 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.733006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7c1d11b8-e762-4fcf-8ba8-d251af44b28d tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:55.744119 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7c1d11b8-e762-4fcf-8ba8-d251af44b28d tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1224 microversion: 2.1 time: 0.278156 Jul 20 04:28:55.744743 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1996/4070] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:55 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1224 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:55.757213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e92a3808-7d72-4077-8498-a7c7be6d15fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:55.760014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:55.765732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e92a3808-7d72-4077-8498-a7c7be6d15fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.766204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e92a3808-7d72-4077-8498-a7c7be6d15fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.797472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e92a3808-7d72-4077-8498-a7c7be6d15fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Going to try to stop instance {{(pid=119807) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:28:55.868946 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e92a3808-7d72-4077-8498-a7c7be6d15fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36/action" status: 202 len: 0 microversion: 2.1 time: 0.122867 Jul 20 04:28:55.869567 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1997/4071] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:28:55 2022] POST /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:28:55.891495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-90884747-bf97-43a3-a367-a4cc5f406610 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:55.892269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-90884747-bf97-43a3-a367-a4cc5f406610 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:55.903485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90884747-bf97-43a3-a367-a4cc5f406610 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.905861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90884747-bf97-43a3-a367-a4cc5f406610 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.907598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90884747-bf97-43a3-a367-a4cc5f406610 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.908672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90884747-bf97-43a3-a367-a4cc5f406610 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:56.293664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2b6ab15a-662f-4aea-b061-f8549fb4e757 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:56.308419 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2b6ab15a-662f-4aea-b061-f8549fb4e757 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1486 microversion: 2.1 time: 0.625566 Jul 20 04:28:56.311861 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2075/4072] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:55 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1486 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:56.449940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-90884747-bf97-43a3-a367-a4cc5f406610 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:56.462501 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-90884747-bf97-43a3-a367-a4cc5f406610 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.585205 Jul 20 04:28:56.471132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2dae6f83-7786-4803-ba6e-a8d4db822c64 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:56.472688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2dae6f83-7786-4803-ba6e-a8d4db822c64 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:56.488734 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1998/4073] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:55 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:56.495272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2dae6f83-7786-4803-ba6e-a8d4db822c64 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:56.496210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2dae6f83-7786-4803-ba6e-a8d4db822c64 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:56.497283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2dae6f83-7786-4803-ba6e-a8d4db822c64 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:56.498044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2dae6f83-7786-4803-ba6e-a8d4db822c64 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:56.668527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1334769041", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:56.713581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2dae6f83-7786-4803-ba6e-a8d4db822c64 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:56.725752 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2dae6f83-7786-4803-ba6e-a8d4db822c64 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1276 microversion: 2.1 time: 0.260968 Jul 20 04:28:56.727847 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2076/4074] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:56 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:56.756860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7be6d401-974a-4c5d-b71e-95a3acc85f9e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:56.757559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7be6d401-974a-4c5d-b71e-95a3acc85f9e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:56.777269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] validate_networks() for [('21342575-0af4-45cf-b915-261134658c11', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:56.784208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7be6d401-974a-4c5d-b71e-95a3acc85f9e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:56.786219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7be6d401-974a-4c5d-b71e-95a3acc85f9e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:56.787070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7be6d401-974a-4c5d-b71e-95a3acc85f9e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:56.787548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7be6d401-974a-4c5d-b71e-95a3acc85f9e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:57.378776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7be6d401-974a-4c5d-b71e-95a3acc85f9e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:57.395067 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7be6d401-974a-4c5d-b71e-95a3acc85f9e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1362 microversion: 2.1 time: 0.665026 Jul 20 04:28:57.396713 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2077/4075] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:56 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1362 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:57.408669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f15c6e7-1c55-417e-a4e3-3b311b2d4df4 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:57.409357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1f15c6e7-1c55-417e-a4e3-3b311b2d4df4 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:57.426087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f15c6e7-1c55-417e-a4e3-3b311b2d4df4 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:57.426555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f15c6e7-1c55-417e-a4e3-3b311b2d4df4 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:57.429574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f15c6e7-1c55-417e-a4e3-3b311b2d4df4 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:57.430082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f15c6e7-1c55-417e-a4e3-3b311b2d4df4 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:57.612291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1f15c6e7-1c55-417e-a4e3-3b311b2d4df4 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:57.620667 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f15c6e7-1c55-417e-a4e3-3b311b2d4df4 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1282 microversion: 2.1 time: 0.222788 Jul 20 04:28:57.621751 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2078/4076] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:57 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1282 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:58.056814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-404739949", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "bd050657-89c4-4b58-a39d-91e2402b0bc8"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:58.193466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] validate_networks() for [('bd050657-89c4-4b58-a39d-91e2402b0bc8', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:59.357941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:59.359116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:59.360182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:59.361179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:59.361865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:59.365363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:59.379500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.380245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.381295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.381994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.424787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Getting quotas for project e1a37e6cca334ee693d9d8ae5345c155. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:59.432756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Getting quotas for user f850c33c9ec04a7980db7386c854f00f and project e1a37e6cca334ee693d9d8ae5345c155. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:59.454504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:59.461659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:59.596712 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-67f7a478-89ef-45cc-b3de-4dee5a52441e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.933831 Jul 20 04:28:59.601629 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 1999/4077] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:28:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:28:59.619971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-84430127-993f-47d8-98af-10e8619e2994 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:59.620854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-84430127-993f-47d8-98af-10e8619e2994 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:59.628292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84430127-993f-47d8-98af-10e8619e2994 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.629082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84430127-993f-47d8-98af-10e8619e2994 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.630219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84430127-993f-47d8-98af-10e8619e2994 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.630822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84430127-993f-47d8-98af-10e8619e2994 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:00.429336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-84430127-993f-47d8-98af-10e8619e2994 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:00.438707 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-84430127-993f-47d8-98af-10e8619e2994 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.834922 Jul 20 04:29:00.439399 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2000/4078] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:59 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:00.444310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1813e61f-2944-4042-941b-6dbbffa81ce7 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:00.444978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1813e61f-2944-4042-941b-6dbbffa81ce7 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:00.454195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:29:00.454912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:29:00.456380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:29:00.456987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:29:00.457184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1813e61f-2944-4042-941b-6dbbffa81ce7 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:00.457760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1813e61f-2944-4042-941b-6dbbffa81ce7 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:00.458225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:29:00.459784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1813e61f-2944-4042-941b-6dbbffa81ce7 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:00.462298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1813e61f-2944-4042-941b-6dbbffa81ce7 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:00.471910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:00.472635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:00.473673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:00.474454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:00.494591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:00.502430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Getting quotas for project 497770f5a4194c549e20ba97678db788. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:00.510504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Getting quotas for user 1a785c6a928b434987940ca5d3e8637f and project 497770f5a4194c549e20ba97678db788. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:00.532738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:29:00.535196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:00.600646 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-994dcb53-6e2c-4681-b323-7fc5b069d992 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.977715 Jul 20 04:29:00.601799 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2079/4079] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:28:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2979 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:29:00.608774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-818d22a7-4351-4d25-8b1b-4a437606eda3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:00.609392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-818d22a7-4351-4d25-8b1b-4a437606eda3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:00.619016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-818d22a7-4351-4d25-8b1b-4a437606eda3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:00.619813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-818d22a7-4351-4d25-8b1b-4a437606eda3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:00.621157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-818d22a7-4351-4d25-8b1b-4a437606eda3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:00.621905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-818d22a7-4351-4d25-8b1b-4a437606eda3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.003187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1813e61f-2944-4042-941b-6dbbffa81ce7 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:01.013073 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1813e61f-2944-4042-941b-6dbbffa81ce7 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1318 microversion: 2.1 time: 0.572602 Jul 20 04:29:01.013676 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2001/4080] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:00 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:01.026706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6818231-e916-4756-ba47-49e32dfe4fba tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:01.027281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e6818231-e916-4756-ba47-49e32dfe4fba tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:01.036198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6818231-e916-4756-ba47-49e32dfe4fba tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.036652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6818231-e916-4756-ba47-49e32dfe4fba tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.037445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6818231-e916-4756-ba47-49e32dfe4fba tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.038018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6818231-e916-4756-ba47-49e32dfe4fba tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.108168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-818d22a7-4351-4d25-8b1b-4a437606eda3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:01.116512 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-818d22a7-4351-4d25-8b1b-4a437606eda3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1362 microversion: 2.1 time: 0.513516 Jul 20 04:29:01.118724 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2080/4081] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:00 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1362 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:01.134169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-cdc51d6a-048d-441d-b8e5-d9e3a871aeea req-5310b5b9-693e-47c5-b271-d96b9d6165ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8d5de4-7985-4933-8867-3352bf84a16b", "tag": "98d95473-ef58-4c7b-b571-36edf82efa0c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:01.150103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cdc51d6a-048d-441d-b8e5-d9e3a871aeea req-5310b5b9-693e-47c5-b271-d96b9d6165ed service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.157334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cdc51d6a-048d-441d-b8e5-d9e3a871aeea req-5310b5b9-693e-47c5-b271-d96b9d6165ed service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.190495 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-cdc51d6a-048d-441d-b8e5-d9e3a871aeea req-5310b5b9-693e-47c5-b271-d96b9d6165ed service nova] Creating event network-changed:98d95473-ef58-4c7b-b571-36edf82efa0c for instance bd8d5de4-7985-4933-8867-3352bf84a16b on n-h1-764485-11 Jul 20 04:29:01.201491 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-cdc51d6a-048d-441d-b8e5-d9e3a871aeea req-5310b5b9-693e-47c5-b271-d96b9d6165ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080481 Jul 20 04:29:01.204422 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2081/4082] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:01.219251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a788fd1f-374f-4921-8417-4148141d86e9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:01.220289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a788fd1f-374f-4921-8417-4148141d86e9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:01.235749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a788fd1f-374f-4921-8417-4148141d86e9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.236320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a788fd1f-374f-4921-8417-4148141d86e9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.237233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a788fd1f-374f-4921-8417-4148141d86e9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.237785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a788fd1f-374f-4921-8417-4148141d86e9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.529352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a788fd1f-374f-4921-8417-4148141d86e9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:01.543577 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a788fd1f-374f-4921-8417-4148141d86e9 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1284 microversion: 2.1 time: 0.337772 Jul 20 04:29:01.544848 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2082/4083] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:01 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:01.557257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ecbd5244-7f35-4c10-80a6-224aac26f104 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:01.560459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ecbd5244-7f35-4c10-80a6-224aac26f104 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:01.575924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ecbd5244-7f35-4c10-80a6-224aac26f104 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.576911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ecbd5244-7f35-4c10-80a6-224aac26f104 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.577917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ecbd5244-7f35-4c10-80a6-224aac26f104 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.580009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ecbd5244-7f35-4c10-80a6-224aac26f104 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.735053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ecbd5244-7f35-4c10-80a6-224aac26f104 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:01.744534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ecbd5244-7f35-4c10-80a6-224aac26f104 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:01.749037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ecbd5244-7f35-4c10-80a6-224aac26f104 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:01.756132 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ecbd5244-7f35-4c10-80a6-224aac26f104 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1257 microversion: 2.26 time: 0.209969 Jul 20 04:29:01.756867 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2083/4084] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:01 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1257 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:01.776955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-846c67c3-6c1f-43db-b286-f70a220f4df4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:01.781667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-846c67c3-6c1f-43db-b286-f70a220f4df4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:01.792404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-846c67c3-6c1f-43db-b286-f70a220f4df4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.796481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-846c67c3-6c1f-43db-b286-f70a220f4df4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.798368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-846c67c3-6c1f-43db-b286-f70a220f4df4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.800709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-846c67c3-6c1f-43db-b286-f70a220f4df4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.833576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e6818231-e916-4756-ba47-49e32dfe4fba tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:01.844379 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e6818231-e916-4756-ba47-49e32dfe4fba tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1324 microversion: 2.1 time: 0.823594 Jul 20 04:29:01.848397 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2002/4085] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:01 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1324 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:02.030411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-78b1a513-a188-485f-9549-c6554817b3b3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:02.031244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-78b1a513-a188-485f-9549-c6554817b3b3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:02.040259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78b1a513-a188-485f-9549-c6554817b3b3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:02.040729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78b1a513-a188-485f-9549-c6554817b3b3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:02.041536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78b1a513-a188-485f-9549-c6554817b3b3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:02.041997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78b1a513-a188-485f-9549-c6554817b3b3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:02.402865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-846c67c3-6c1f-43db-b286-f70a220f4df4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:02.410571 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-846c67c3-6c1f-43db-b286-f70a220f4df4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.652255 Jul 20 04:29:02.411362 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2084/4086] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:01 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:02.427089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8026b191-df02-4a27-8fb9-1415bcf2d146 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:02.427984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8026b191-df02-4a27-8fb9-1415bcf2d146 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:02.435306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8026b191-df02-4a27-8fb9-1415bcf2d146 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:02.436264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8026b191-df02-4a27-8fb9-1415bcf2d146 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:02.437155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8026b191-df02-4a27-8fb9-1415bcf2d146 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:02.437661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8026b191-df02-4a27-8fb9-1415bcf2d146 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:02.537932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-78b1a513-a188-485f-9549-c6554817b3b3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:02.548762 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-78b1a513-a188-485f-9549-c6554817b3b3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1318 microversion: 2.1 time: 0.521842 Jul 20 04:29:02.550239 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2003/4087] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:02 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:02.566754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-637d4bf2-7f5b-4d23-9d34-43db6665238d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:02.568013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-637d4bf2-7f5b-4d23-9d34-43db6665238d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:02.579620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-637d4bf2-7f5b-4d23-9d34-43db6665238d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:02.580344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-637d4bf2-7f5b-4d23-9d34-43db6665238d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:02.581422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-637d4bf2-7f5b-4d23-9d34-43db6665238d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:02.582198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-637d4bf2-7f5b-4d23-9d34-43db6665238d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.324432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8026b191-df02-4a27-8fb9-1415bcf2d146 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:03.334443 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8026b191-df02-4a27-8fb9-1415bcf2d146 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1362 microversion: 2.1 time: 0.911546 Jul 20 04:29:03.345691 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2085/4088] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:02 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1362 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:03.353160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-637d4bf2-7f5b-4d23-9d34-43db6665238d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:03.353843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2550ef6-fed6-4821-94b7-e2a33ddf2c29 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:03.354918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c2550ef6-fed6-4821-94b7-e2a33ddf2c29 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:03.362031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2550ef6-fed6-4821-94b7-e2a33ddf2c29 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.362718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2550ef6-fed6-4821-94b7-e2a33ddf2c29 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.363836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2550ef6-fed6-4821-94b7-e2a33ddf2c29 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.364485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2550ef6-fed6-4821-94b7-e2a33ddf2c29 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.385293 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-637d4bf2-7f5b-4d23-9d34-43db6665238d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1314 microversion: 2.1 time: 0.826895 Jul 20 04:29:03.386237 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2004/4089] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:02 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1314 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:03.394863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a7f5565c-ce07-424a-9880-5c32060847c3 req-a25b1fa3-6dc1-4313-b0ec-b5285a248d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c7f77fd-f2ed-4d3a-a420-a4914119382c", "tag": "2ea61db4-6fbb-493f-a760-815a661a2d8f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:03.424863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a7f5565c-ce07-424a-9880-5c32060847c3 req-a25b1fa3-6dc1-4313-b0ec-b5285a248d8e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.425425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a7f5565c-ce07-424a-9880-5c32060847c3 req-a25b1fa3-6dc1-4313-b0ec-b5285a248d8e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.455309 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a7f5565c-ce07-424a-9880-5c32060847c3 req-a25b1fa3-6dc1-4313-b0ec-b5285a248d8e service nova] Creating event network-changed:2ea61db4-6fbb-493f-a760-815a661a2d8f for instance 4c7f77fd-f2ed-4d3a-a420-a4914119382c on n-h2-764485-11 Jul 20 04:29:03.461585 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a7f5565c-ce07-424a-9880-5c32060847c3 req-a25b1fa3-6dc1-4313-b0ec-b5285a248d8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071004 Jul 20 04:29:03.463074 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2005/4090] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:03.470118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-83c2f2c7-f6bd-4495-b47a-5a2dd14e52ea tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:03.471257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-83c2f2c7-f6bd-4495-b47a-5a2dd14e52ea tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:03.480266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83c2f2c7-f6bd-4495-b47a-5a2dd14e52ea tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.481031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83c2f2c7-f6bd-4495-b47a-5a2dd14e52ea tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.482040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83c2f2c7-f6bd-4495-b47a-5a2dd14e52ea tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.482648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83c2f2c7-f6bd-4495-b47a-5a2dd14e52ea tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.494532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c2550ef6-fed6-4821-94b7-e2a33ddf2c29 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:03.503384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c2550ef6-fed6-4821-94b7-e2a33ddf2c29 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:03.512332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c2550ef6-fed6-4821-94b7-e2a33ddf2c29 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:03.513547 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c2550ef6-fed6-4821-94b7-e2a33ddf2c29 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1321 microversion: 2.26 time: 0.166083 Jul 20 04:29:03.514138 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2086/4091] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:03 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:03.532309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-907ed4b1-98a2-47df-b18e-215991d20796 req-4212825b-126a-4ade-880a-212214955b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48", "tag": "315ccd0d-89cb-41bb-9a01-ae929f013595"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:03.555858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-907ed4b1-98a2-47df-b18e-215991d20796 req-4212825b-126a-4ade-880a-212214955b27 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.556341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-907ed4b1-98a2-47df-b18e-215991d20796 req-4212825b-126a-4ade-880a-212214955b27 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.575921 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-907ed4b1-98a2-47df-b18e-215991d20796 req-4212825b-126a-4ade-880a-212214955b27 service nova] Creating event network-changed:315ccd0d-89cb-41bb-9a01-ae929f013595 for instance c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 on n-h2-764485-11 Jul 20 04:29:03.581641 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-907ed4b1-98a2-47df-b18e-215991d20796 req-4212825b-126a-4ade-880a-212214955b27 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054489 Jul 20 04:29:03.582254 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2087/4092] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:03.589400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ebef4b67-c8ff-4a31-aca6-fb4e548d0bc5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:03.590109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ebef4b67-c8ff-4a31-aca6-fb4e548d0bc5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:03.596666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ebef4b67-c8ff-4a31-aca6-fb4e548d0bc5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.597387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ebef4b67-c8ff-4a31-aca6-fb4e548d0bc5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.598597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ebef4b67-c8ff-4a31-aca6-fb4e548d0bc5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.599022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ebef4b67-c8ff-4a31-aca6-fb4e548d0bc5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.798467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-83c2f2c7-f6bd-4495-b47a-5a2dd14e52ea tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:03.807787 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-83c2f2c7-f6bd-4495-b47a-5a2dd14e52ea tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1324 microversion: 2.1 time: 0.343320 Jul 20 04:29:03.818048 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2006/4093] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:03 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:03.825307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b4e946a8-1878-49ab-89b8-a35ae056cbe3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:03.826702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b4e946a8-1878-49ab-89b8-a35ae056cbe3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:03.833684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4e946a8-1878-49ab-89b8-a35ae056cbe3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.834136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4e946a8-1878-49ab-89b8-a35ae056cbe3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.835205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4e946a8-1878-49ab-89b8-a35ae056cbe3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.835678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4e946a8-1878-49ab-89b8-a35ae056cbe3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.906730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ebef4b67-c8ff-4a31-aca6-fb4e548d0bc5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:03.916540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ebef4b67-c8ff-4a31-aca6-fb4e548d0bc5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.332823 Jul 20 04:29:03.917899 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2088/4094] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:03 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:04.092435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b4e946a8-1878-49ab-89b8-a35ae056cbe3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:04.105820 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b4e946a8-1878-49ab-89b8-a35ae056cbe3 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1318 microversion: 2.1 time: 0.284764 Jul 20 04:29:04.106609 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2007/4095] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:03 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:04.352859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4ebae80c-877d-464c-8d68-76fbd6df64b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:04.354066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4ebae80c-877d-464c-8d68-76fbd6df64b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:04.360701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ebae80c-877d-464c-8d68-76fbd6df64b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:04.361332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ebae80c-877d-464c-8d68-76fbd6df64b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:04.362282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ebae80c-877d-464c-8d68-76fbd6df64b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:04.362863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ebae80c-877d-464c-8d68-76fbd6df64b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:04.402519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-32fe7c0c-5384-44aa-beb0-739fb5c3f1b4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:04.403132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-32fe7c0c-5384-44aa-beb0-739fb5c3f1b4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:04.410725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-32fe7c0c-5384-44aa-beb0-739fb5c3f1b4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:04.412119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-32fe7c0c-5384-44aa-beb0-739fb5c3f1b4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:04.416545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-32fe7c0c-5384-44aa-beb0-739fb5c3f1b4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:04.417053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-32fe7c0c-5384-44aa-beb0-739fb5c3f1b4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:04.745285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-32fe7c0c-5384-44aa-beb0-739fb5c3f1b4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:04.753077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4ebae80c-877d-464c-8d68-76fbd6df64b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:04.755055 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-32fe7c0c-5384-44aa-beb0-739fb5c3f1b4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1314 microversion: 2.1 time: 0.355769 Jul 20 04:29:04.765203 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2008/4096] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:04 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:04.765708 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4ebae80c-877d-464c-8d68-76fbd6df64b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1362 microversion: 2.1 time: 0.415855 Jul 20 04:29:04.767082 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2089/4097] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:04 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1362 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:04.770656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-577a53ef-e2c7-410f-aca0-87d455c9098e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:04.771284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-577a53ef-e2c7-410f-aca0-87d455c9098e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:04.779586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-577a53ef-e2c7-410f-aca0-87d455c9098e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:04.780054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-577a53ef-e2c7-410f-aca0-87d455c9098e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:04.780847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-577a53ef-e2c7-410f-aca0-87d455c9098e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:04.781756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-577a53ef-e2c7-410f-aca0-87d455c9098e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:04.827734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-76b94f7e-2f10-495d-8dfc-37be6bbd143c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:04.827734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-76b94f7e-2f10-495d-8dfc-37be6bbd143c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:04.835285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76b94f7e-2f10-495d-8dfc-37be6bbd143c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:04.836859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76b94f7e-2f10-495d-8dfc-37be6bbd143c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:04.837910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76b94f7e-2f10-495d-8dfc-37be6bbd143c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:04.838358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76b94f7e-2f10-495d-8dfc-37be6bbd143c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:04.862609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-577a53ef-e2c7-410f-aca0-87d455c9098e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:04.874936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-577a53ef-e2c7-410f-aca0-87d455c9098e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:04.876724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-577a53ef-e2c7-410f-aca0-87d455c9098e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:04.878566 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-577a53ef-e2c7-410f-aca0-87d455c9098e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1319 microversion: 2.26 time: 0.112133 Jul 20 04:29:04.879345 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2009/4098] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:04 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1319 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:04.935232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95579962-8a6f-45b1-9590-39b32f824bc9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:04.936066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95579962-8a6f-45b1-9590-39b32f824bc9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:04.943703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95579962-8a6f-45b1-9590-39b32f824bc9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:04.944159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95579962-8a6f-45b1-9590-39b32f824bc9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:04.944938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95579962-8a6f-45b1-9590-39b32f824bc9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:04.945374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95579962-8a6f-45b1-9590-39b32f824bc9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:05.111673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-76b94f7e-2f10-495d-8dfc-37be6bbd143c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:05.122695 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-76b94f7e-2f10-495d-8dfc-37be6bbd143c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1324 microversion: 2.1 time: 0.301613 Jul 20 04:29:05.133491 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2090/4099] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:04 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1324 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:05.148270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3d662bf2-aea0-4e77-bc62-ca949877a093 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:05.150352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3d662bf2-aea0-4e77-bc62-ca949877a093 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:05.159157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d662bf2-aea0-4e77-bc62-ca949877a093 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:05.159961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d662bf2-aea0-4e77-bc62-ca949877a093 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:05.160948 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d662bf2-aea0-4e77-bc62-ca949877a093 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:05.161586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d662bf2-aea0-4e77-bc62-ca949877a093 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:05.245847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95579962-8a6f-45b1-9590-39b32f824bc9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:05.278213 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95579962-8a6f-45b1-9590-39b32f824bc9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.348218 Jul 20 04:29:05.285880 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2010/4100] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:04 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:05.410975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3d662bf2-aea0-4e77-bc62-ca949877a093 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:05.419495 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3d662bf2-aea0-4e77-bc62-ca949877a093 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1318 microversion: 2.1 time: 0.283772 Jul 20 04:29:05.420509 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2091/4101] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:05 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:05.609218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-fb88753e-cbc1-483d-a372-538f238948fc req-3c7b7a1e-ce15-47d6-adc7-569258c2b1ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ba8e33-ceff-434c-801c-a1cc88157e79", "tag": "c02ffd7c-52fb-4892-9191-b73b520455ad"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:05.620863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fb88753e-cbc1-483d-a372-538f238948fc req-3c7b7a1e-ce15-47d6-adc7-569258c2b1ae service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:05.621315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fb88753e-cbc1-483d-a372-538f238948fc req-3c7b7a1e-ce15-47d6-adc7-569258c2b1ae service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:05.634572 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-fb88753e-cbc1-483d-a372-538f238948fc req-3c7b7a1e-ce15-47d6-adc7-569258c2b1ae service nova] Creating event network-changed:c02ffd7c-52fb-4892-9191-b73b520455ad for instance a8ba8e33-ceff-434c-801c-a1cc88157e79 on n-h1-764485-11 Jul 20 04:29:05.639958 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-fb88753e-cbc1-483d-a372-538f238948fc req-3c7b7a1e-ce15-47d6-adc7-569258c2b1ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034679 Jul 20 04:29:05.640853 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2011/4102] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:29:05.775210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-caacb4a2-75fe-4ae1-8115-503aba1c450a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:05.775862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-caacb4a2-75fe-4ae1-8115-503aba1c450a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:05.783094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caacb4a2-75fe-4ae1-8115-503aba1c450a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:05.783578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caacb4a2-75fe-4ae1-8115-503aba1c450a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:05.785794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caacb4a2-75fe-4ae1-8115-503aba1c450a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:05.786474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caacb4a2-75fe-4ae1-8115-503aba1c450a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:05.787141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-723ab141-5470-4869-85fc-60ed23888350 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:05.788115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-723ab141-5470-4869-85fc-60ed23888350 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:05.798767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-723ab141-5470-4869-85fc-60ed23888350 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:05.802467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-723ab141-5470-4869-85fc-60ed23888350 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:05.804396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-723ab141-5470-4869-85fc-60ed23888350 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:05.806616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-723ab141-5470-4869-85fc-60ed23888350 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.020792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-caacb4a2-75fe-4ae1-8115-503aba1c450a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:06.031443 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-caacb4a2-75fe-4ae1-8115-503aba1c450a tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1314 microversion: 2.1 time: 0.260328 Jul 20 04:29:06.032563 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2092/4103] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:05 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:06.041536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-723ab141-5470-4869-85fc-60ed23888350 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:06.051663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ddd9ff2c-e408-41ce-b7a5-e4208c8bf871 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:06.052362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ddd9ff2c-e408-41ce-b7a5-e4208c8bf871 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:06.058531 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-723ab141-5470-4869-85fc-60ed23888350 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1362 microversion: 2.1 time: 0.277322 Jul 20 04:29:06.062840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddd9ff2c-e408-41ce-b7a5-e4208c8bf871 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.063296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddd9ff2c-e408-41ce-b7a5-e4208c8bf871 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.064111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddd9ff2c-e408-41ce-b7a5-e4208c8bf871 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.064549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddd9ff2c-e408-41ce-b7a5-e4208c8bf871 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.064950 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2012/4104] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:05 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:06.143441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-29c7f78c-afdf-4e2a-9dfd-23a6c5767ee6 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:06.144099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-29c7f78c-afdf-4e2a-9dfd-23a6c5767ee6 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:06.153758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29c7f78c-afdf-4e2a-9dfd-23a6c5767ee6 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.154280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29c7f78c-afdf-4e2a-9dfd-23a6c5767ee6 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.155853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29c7f78c-afdf-4e2a-9dfd-23a6c5767ee6 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.156314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29c7f78c-afdf-4e2a-9dfd-23a6c5767ee6 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.339137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ddd9ff2c-e408-41ce-b7a5-e4208c8bf871 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:06.353642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ddd9ff2c-e408-41ce-b7a5-e4208c8bf871 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:06.356186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ddd9ff2c-e408-41ce-b7a5-e4208c8bf871 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:06.357890 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ddd9ff2c-e408-41ce-b7a5-e4208c8bf871 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1361 microversion: 2.26 time: 0.324092 Jul 20 04:29:06.358793 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2093/4105] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:06 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1361 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:06.363964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-30e703fa-0024-490f-bb43-e5ec7273cc39 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:06.364784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-30e703fa-0024-490f-bb43-e5ec7273cc39 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:06.374338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30e703fa-0024-490f-bb43-e5ec7273cc39 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.374811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30e703fa-0024-490f-bb43-e5ec7273cc39 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.375629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30e703fa-0024-490f-bb43-e5ec7273cc39 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.376081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30e703fa-0024-490f-bb43-e5ec7273cc39 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.380998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:06.484266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-29c7f78c-afdf-4e2a-9dfd-23a6c5767ee6 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:06.494129 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-29c7f78c-afdf-4e2a-9dfd-23a6c5767ee6 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1324 microversion: 2.1 time: 0.356990 Jul 20 04:29:06.506437 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2013/4106] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:06 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1324 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:06.512986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8283f2d6-ad26-44f5-93cd-c08cf388d17b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:06.513862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8283f2d6-ad26-44f5-93cd-c08cf388d17b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:06.522799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8283f2d6-ad26-44f5-93cd-c08cf388d17b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.523819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8283f2d6-ad26-44f5-93cd-c08cf388d17b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.524961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8283f2d6-ad26-44f5-93cd-c08cf388d17b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.525791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8283f2d6-ad26-44f5-93cd-c08cf388d17b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.582200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-30e703fa-0024-490f-bb43-e5ec7273cc39 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:06.591168 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-30e703fa-0024-490f-bb43-e5ec7273cc39 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.231018 Jul 20 04:29:06.591991 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2094/4107] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:06 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:06.688558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8283f2d6-ad26-44f5-93cd-c08cf388d17b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:06.696953 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8283f2d6-ad26-44f5-93cd-c08cf388d17b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1318 microversion: 2.1 time: 0.189129 Jul 20 04:29:06.697822 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2014/4108] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:06 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:07.051063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-59c5f7bc-d76c-4691-9556-0ec9f9b56c82 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:07.052346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-59c5f7bc-d76c-4691-9556-0ec9f9b56c82 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:07.062665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59c5f7bc-d76c-4691-9556-0ec9f9b56c82 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.063410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59c5f7bc-d76c-4691-9556-0ec9f9b56c82 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.064561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59c5f7bc-d76c-4691-9556-0ec9f9b56c82 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.065097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59c5f7bc-d76c-4691-9556-0ec9f9b56c82 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.076280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86e6e305-a4ad-437e-9cd2-2b37cd60139d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:07.076910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-86e6e305-a4ad-437e-9cd2-2b37cd60139d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:07.089331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86e6e305-a4ad-437e-9cd2-2b37cd60139d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.089791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86e6e305-a4ad-437e-9cd2-2b37cd60139d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.090760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86e6e305-a4ad-437e-9cd2-2b37cd60139d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.092380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86e6e305-a4ad-437e-9cd2-2b37cd60139d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.579101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-59c5f7bc-d76c-4691-9556-0ec9f9b56c82 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:07.585469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-86e6e305-a4ad-437e-9cd2-2b37cd60139d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:07.601948 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-59c5f7bc-d76c-4691-9556-0ec9f9b56c82 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1314 microversion: 2.1 time: 0.555387 Jul 20 04:29:07.604904 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-86e6e305-a4ad-437e-9cd2-2b37cd60139d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1362 microversion: 2.1 time: 0.532440 Jul 20 04:29:07.614076 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2015/4109] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:07 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1362 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:07.616782 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2095/4110] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:07 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:07.621868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-89c511ce-04bd-4a00-b806-e2e5ed837fab tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:07.626750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d589d5f8-c3c3-4961-9b90-7952fa9fd0b6 req-e0e2735e-d778-427e-ba03-41483cc37fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8d5de4-7985-4933-8867-3352bf84a16b", "name": "network-vif-plugged", "status": "completed", "tag": "98d95473-ef58-4c7b-b571-36edf82efa0c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:07.629089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-89c511ce-04bd-4a00-b806-e2e5ed837fab tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:07.638688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d589d5f8-c3c3-4961-9b90-7952fa9fd0b6 req-e0e2735e-d778-427e-ba03-41483cc37fe9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.639141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d589d5f8-c3c3-4961-9b90-7952fa9fd0b6 req-e0e2735e-d778-427e-ba03-41483cc37fe9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.639634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89c511ce-04bd-4a00-b806-e2e5ed837fab tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.640285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89c511ce-04bd-4a00-b806-e2e5ed837fab tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.641548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89c511ce-04bd-4a00-b806-e2e5ed837fab tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.642067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89c511ce-04bd-4a00-b806-e2e5ed837fab tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.653279 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d589d5f8-c3c3-4961-9b90-7952fa9fd0b6 req-e0e2735e-d778-427e-ba03-41483cc37fe9 service nova] Creating event network-vif-plugged:98d95473-ef58-4c7b-b571-36edf82efa0c for instance bd8d5de4-7985-4933-8867-3352bf84a16b on n-h1-764485-11 Jul 20 04:29:07.658934 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d589d5f8-c3c3-4961-9b90-7952fa9fd0b6 req-e0e2735e-d778-427e-ba03-41483cc37fe9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042262 Jul 20 04:29:07.659595 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2016/4111] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:07.668112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2726f32e-daef-481a-a951-c1df4e8c7366 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:07.669014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2726f32e-daef-481a-a951-c1df4e8c7366 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:07.677781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2726f32e-daef-481a-a951-c1df4e8c7366 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.678924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2726f32e-daef-481a-a951-c1df4e8c7366 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.681902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2726f32e-daef-481a-a951-c1df4e8c7366 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.683110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2726f32e-daef-481a-a951-c1df4e8c7366 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.382371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2726f32e-daef-481a-a951-c1df4e8c7366 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:08.391043 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2726f32e-daef-481a-a951-c1df4e8c7366 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1324 microversion: 2.1 time: 0.730059 Jul 20 04:29:08.392054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-89c511ce-04bd-4a00-b806-e2e5ed837fab tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:08.392274 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2017/4112] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:07 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1324 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:08.397840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7ff6fa06-07d3-4c8d-83c2-cdde73d2175b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.399287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7ff6fa06-07d3-4c8d-83c2-cdde73d2175b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.405845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ff6fa06-07d3-4c8d-83c2-cdde73d2175b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.406233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ff6fa06-07d3-4c8d-83c2-cdde73d2175b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.407225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ff6fa06-07d3-4c8d-83c2-cdde73d2175b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.407812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ff6fa06-07d3-4c8d-83c2-cdde73d2175b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.410494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-89c511ce-04bd-4a00-b806-e2e5ed837fab tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:08.413257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-89c511ce-04bd-4a00-b806-e2e5ed837fab tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:08.415295 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-89c511ce-04bd-4a00-b806-e2e5ed837fab tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1361 microversion: 2.26 time: 0.797324 Jul 20 04:29:08.416047 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2096/4113] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:07 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1361 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:08.428639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-741b93dd-38c9-4b66-b1ed-7a6511d87c1b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.429865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-741b93dd-38c9-4b66-b1ed-7a6511d87c1b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.437483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-741b93dd-38c9-4b66-b1ed-7a6511d87c1b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.438029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-741b93dd-38c9-4b66-b1ed-7a6511d87c1b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.439095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-741b93dd-38c9-4b66-b1ed-7a6511d87c1b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.439629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-741b93dd-38c9-4b66-b1ed-7a6511d87c1b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.734267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7ff6fa06-07d3-4c8d-83c2-cdde73d2175b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:08.738713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-741b93dd-38c9-4b66-b1ed-7a6511d87c1b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:08.749746 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7ff6fa06-07d3-4c8d-83c2-cdde73d2175b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.354025 Jul 20 04:29:08.751311 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2018/4114] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:08 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:08.752116 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-741b93dd-38c9-4b66-b1ed-7a6511d87c1b tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1318 microversion: 2.1 time: 0.334321 Jul 20 04:29:08.754112 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2097/4115] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:08 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:08.768212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dc312820-a417-4afd-9b53-0dd3136c0c22 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.769160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dc312820-a417-4afd-9b53-0dd3136c0c22 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.776407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8e80f43a-e8d2-41b2-8fa4-8bde2862fd09 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.778591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8e80f43a-e8d2-41b2-8fa4-8bde2862fd09 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.780223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc312820-a417-4afd-9b53-0dd3136c0c22 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.780669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc312820-a417-4afd-9b53-0dd3136c0c22 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.781501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc312820-a417-4afd-9b53-0dd3136c0c22 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.782280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc312820-a417-4afd-9b53-0dd3136c0c22 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.794648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e80f43a-e8d2-41b2-8fa4-8bde2862fd09 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.800674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e80f43a-e8d2-41b2-8fa4-8bde2862fd09 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.801715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e80f43a-e8d2-41b2-8fa4-8bde2862fd09 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.802407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e80f43a-e8d2-41b2-8fa4-8bde2862fd09 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:09.024097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dc312820-a417-4afd-9b53-0dd3136c0c22 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:09.027152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:09.038057 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dc312820-a417-4afd-9b53-0dd3136c0c22 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1362 microversion: 2.1 time: 0.284791 Jul 20 04:29:09.039306 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2019/4116] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:08 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:09.046085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-9b6f864f-e65f-4a9c-95d4-456af8d914e5 req-c205b787-1fce-4fa5-a79e-20475e6e11de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acc05c1d-a97f-4a93-bc62-0aa1a7c47c54", "tag": "975648a9-1347-4ce4-8604-d1a3fa54879f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:09.059832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8e80f43a-e8d2-41b2-8fa4-8bde2862fd09 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:09.061396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9b6f864f-e65f-4a9c-95d4-456af8d914e5 req-c205b787-1fce-4fa5-a79e-20475e6e11de service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.062350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9b6f864f-e65f-4a9c-95d4-456af8d914e5 req-c205b787-1fce-4fa5-a79e-20475e6e11de service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:09.071205 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8e80f43a-e8d2-41b2-8fa4-8bde2862fd09 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1314 microversion: 2.1 time: 0.314942 Jul 20 04:29:09.077447 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-9b6f864f-e65f-4a9c-95d4-456af8d914e5 req-c205b787-1fce-4fa5-a79e-20475e6e11de service nova] Creating event network-changed:975648a9-1347-4ce4-8604-d1a3fa54879f for instance acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 on n-h1-764485-11 Jul 20 04:29:09.082458 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2098/4117] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:08 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:09.085002 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-9b6f864f-e65f-4a9c-95d4-456af8d914e5 req-c205b787-1fce-4fa5-a79e-20475e6e11de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043550 Jul 20 04:29:09.085373 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2020/4118] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:09.411104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c00bdd20-70ac-4de2-957a-acc25a9e13be tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:09.412647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c00bdd20-70ac-4de2-957a-acc25a9e13be tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:09.424300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c00bdd20-70ac-4de2-957a-acc25a9e13be tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.425128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c00bdd20-70ac-4de2-957a-acc25a9e13be tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:09.426470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c00bdd20-70ac-4de2-957a-acc25a9e13be tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.427113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c00bdd20-70ac-4de2-957a-acc25a9e13be tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:09.434657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:09.440242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7041233c-8485-4e16-a76e-fe9c41c5726d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:09.441069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7041233c-8485-4e16-a76e-fe9c41c5726d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:09.452912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:09.460273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7041233c-8485-4e16-a76e-fe9c41c5726d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.460800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7041233c-8485-4e16-a76e-fe9c41c5726d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:09.461950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7041233c-8485-4e16-a76e-fe9c41c5726d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.462410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7041233c-8485-4e16-a76e-fe9c41c5726d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:09.822502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c00bdd20-70ac-4de2-957a-acc25a9e13be tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:09.834168 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c00bdd20-70ac-4de2-957a-acc25a9e13be tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1324 microversion: 2.1 time: 0.429403 Jul 20 04:29:09.839828 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2099/4119] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:09 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1324 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:09.849017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-95d3249c-693c-4bf2-b4ac-b4205a0d0b2b req-cdc42d2e-e93d-4632-84a4-58889acb5fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7f77fd-f2ed-4d3a-a420-a4914119382c", "name": "network-vif-plugged", "status": "completed", "tag": "2ea61db4-6fbb-493f-a760-815a661a2d8f"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:09.870125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-95d3249c-693c-4bf2-b4ac-b4205a0d0b2b req-cdc42d2e-e93d-4632-84a4-58889acb5fe6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.871442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7041233c-8485-4e16-a76e-fe9c41c5726d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:09.872025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-95d3249c-693c-4bf2-b4ac-b4205a0d0b2b req-cdc42d2e-e93d-4632-84a4-58889acb5fe6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:09.884808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7041233c-8485-4e16-a76e-fe9c41c5726d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:09.886315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7041233c-8485-4e16-a76e-fe9c41c5726d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:09.887463 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7041233c-8485-4e16-a76e-fe9c41c5726d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1361 microversion: 2.26 time: 0.455800 Jul 20 04:29:09.898973 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-95d3249c-693c-4bf2-b4ac-b4205a0d0b2b req-cdc42d2e-e93d-4632-84a4-58889acb5fe6 service nova] Creating event network-vif-plugged:2ea61db4-6fbb-493f-a760-815a661a2d8f for instance 4c7f77fd-f2ed-4d3a-a420-a4914119382c on n-h2-764485-11 Jul 20 04:29:09.898973 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-95d3249c-693c-4bf2-b4ac-b4205a0d0b2b req-cdc42d2e-e93d-4632-84a4-58889acb5fe6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053699 Jul 20 04:29:09.898973 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2100/4120] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:09.900225 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2021/4121] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:09 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1361 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:29:09.902625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-65441203-0230-4107-8ee6-67022f64eb99 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:09.903422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-65441203-0230-4107-8ee6-67022f64eb99 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:09.905932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c239d851-57dd-4c02-8d18-a4be21f6823f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:09.906701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c239d851-57dd-4c02-8d18-a4be21f6823f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:09.910424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65441203-0230-4107-8ee6-67022f64eb99 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.910906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65441203-0230-4107-8ee6-67022f64eb99 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:09.911810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65441203-0230-4107-8ee6-67022f64eb99 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.912337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65441203-0230-4107-8ee6-67022f64eb99 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:09.913746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c239d851-57dd-4c02-8d18-a4be21f6823f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.914218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c239d851-57dd-4c02-8d18-a4be21f6823f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:09.915009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c239d851-57dd-4c02-8d18-a4be21f6823f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.915991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c239d851-57dd-4c02-8d18-a4be21f6823f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:10.221459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c239d851-57dd-4c02-8d18-a4be21f6823f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:10.231464 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c239d851-57dd-4c02-8d18-a4be21f6823f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1318 microversion: 2.1 time: 0.329637 Jul 20 04:29:10.233555 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2022/4122] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:09 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:10.254220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-65441203-0230-4107-8ee6-67022f64eb99 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:10.263306 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-65441203-0230-4107-8ee6-67022f64eb99 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.365678 Jul 20 04:29:10.264088 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2101/4123] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:09 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:10.272659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eae46b40-d757-460b-ac30-76a01516972b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:10.273883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-434d2af5-c349-4e3a-9152-76a2645b0e1e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:10.273996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eae46b40-d757-460b-ac30-76a01516972b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:10.274925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-434d2af5-c349-4e3a-9152-76a2645b0e1e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:10.280363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eae46b40-d757-460b-ac30-76a01516972b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:10.280816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eae46b40-d757-460b-ac30-76a01516972b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:10.281471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-434d2af5-c349-4e3a-9152-76a2645b0e1e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:10.281572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eae46b40-d757-460b-ac30-76a01516972b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:10.282161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-434d2af5-c349-4e3a-9152-76a2645b0e1e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:10.282280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eae46b40-d757-460b-ac30-76a01516972b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:10.282717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-434d2af5-c349-4e3a-9152-76a2645b0e1e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:10.283159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-434d2af5-c349-4e3a-9152-76a2645b0e1e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:10.489644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-eae46b40-d757-460b-ac30-76a01516972b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:10.493704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:10.497483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-434d2af5-c349-4e3a-9152-76a2645b0e1e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:10.500488 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eae46b40-d757-460b-ac30-76a01516972b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1314 microversion: 2.1 time: 0.235000 Jul 20 04:29:10.501646 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2102/4124] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:10 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:10.506837 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-434d2af5-c349-4e3a-9152-76a2645b0e1e tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1547 microversion: 2.1 time: 0.271296 Jul 20 04:29:10.508157 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2023/4125] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:10 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1547 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:10.524441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-51561c29-3fda-46de-89d3-94ef98df4289 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:10.525229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-51561c29-3fda-46de-89d3-94ef98df4289 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:10.527083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=32 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:10.532808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51561c29-3fda-46de-89d3-94ef98df4289 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:10.533259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51561c29-3fda-46de-89d3-94ef98df4289 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:10.534017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51561c29-3fda-46de-89d3-94ef98df4289 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:10.534584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51561c29-3fda-46de-89d3-94ef98df4289 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:10.615942 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-51561c29-3fda-46de-89d3-94ef98df4289 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096028 Jul 20 04:29:10.617138 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2103/4126] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:29:10 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:10.859027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4dd7c6a0-39fe-44ce-8245-7dcb24b72f8a tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:10.861035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4dd7c6a0-39fe-44ce-8245-7dcb24b72f8a tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:10.874516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4dd7c6a0-39fe-44ce-8245-7dcb24b72f8a tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:10.875942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4dd7c6a0-39fe-44ce-8245-7dcb24b72f8a tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:10.877515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4dd7c6a0-39fe-44ce-8245-7dcb24b72f8a tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:10.879137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4dd7c6a0-39fe-44ce-8245-7dcb24b72f8a tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:10.910254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9bf40ad3-e03d-4d15-8cca-791210169968 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:10.911610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9bf40ad3-e03d-4d15-8cca-791210169968 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:10.928802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bf40ad3-e03d-4d15-8cca-791210169968 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:10.931814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bf40ad3-e03d-4d15-8cca-791210169968 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:10.932694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bf40ad3-e03d-4d15-8cca-791210169968 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:10.933917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bf40ad3-e03d-4d15-8cca-791210169968 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:11.306907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4dd7c6a0-39fe-44ce-8245-7dcb24b72f8a tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:11.318712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9bf40ad3-e03d-4d15-8cca-791210169968 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:11.324416 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4dd7c6a0-39fe-44ce-8245-7dcb24b72f8a tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1324 microversion: 2.1 time: 0.473511 Jul 20 04:29:11.325462 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2024/4127] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:10 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1324 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:11.330149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-26a9f452-8ebf-4fba-95ce-b5ecf29a6fde tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:11.330754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-26a9f452-8ebf-4fba-95ce-b5ecf29a6fde tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:11.334841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9bf40ad3-e03d-4d15-8cca-791210169968 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:11.337100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9bf40ad3-e03d-4d15-8cca-791210169968 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:11.337615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26a9f452-8ebf-4fba-95ce-b5ecf29a6fde tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:11.338229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26a9f452-8ebf-4fba-95ce-b5ecf29a6fde tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:11.338359 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9bf40ad3-e03d-4d15-8cca-791210169968 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1361 microversion: 2.26 time: 0.435019 Jul 20 04:29:11.338842 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2104/4128] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:10 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:11.339006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26a9f452-8ebf-4fba-95ce-b5ecf29a6fde tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:11.339686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26a9f452-8ebf-4fba-95ce-b5ecf29a6fde tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:11.346408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-24af9911-d089-492a-b50c-502e0642d7f9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:11.347481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-24af9911-d089-492a-b50c-502e0642d7f9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:11.354730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24af9911-d089-492a-b50c-502e0642d7f9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:11.355635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24af9911-d089-492a-b50c-502e0642d7f9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:11.356385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24af9911-d089-492a-b50c-502e0642d7f9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:11.357082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24af9911-d089-492a-b50c-502e0642d7f9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:11.705881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-24af9911-d089-492a-b50c-502e0642d7f9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:11.714071 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-24af9911-d089-492a-b50c-502e0642d7f9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.371534 Jul 20 04:29:11.715046 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2105/4129] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:11 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:11.729989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6b62d62-4d4a-492f-93a1-4b3d6f582fe1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:11.730718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f6b62d62-4d4a-492f-93a1-4b3d6f582fe1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:11.738102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6b62d62-4d4a-492f-93a1-4b3d6f582fe1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:11.738768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6b62d62-4d4a-492f-93a1-4b3d6f582fe1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:11.739576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-26a9f452-8ebf-4fba-95ce-b5ecf29a6fde tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:11.740470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6b62d62-4d4a-492f-93a1-4b3d6f582fe1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:11.741626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6b62d62-4d4a-492f-93a1-4b3d6f582fe1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:11.751693 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-26a9f452-8ebf-4fba-95ce-b5ecf29a6fde tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1318 microversion: 2.1 time: 0.424767 Jul 20 04:29:11.753652 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2025/4130] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:11 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:11.915540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e9f12431-5da7-42e0-a0e7-046fef296ec3 req-525ef4a4-a459-4b7e-9405-59f3fdf5ee13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ba8e33-ceff-434c-801c-a1cc88157e79", "name": "network-vif-plugged", "status": "completed", "tag": "c02ffd7c-52fb-4892-9191-b73b520455ad"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:11.925183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e9f12431-5da7-42e0-a0e7-046fef296ec3 req-525ef4a4-a459-4b7e-9405-59f3fdf5ee13 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:11.925743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e9f12431-5da7-42e0-a0e7-046fef296ec3 req-525ef4a4-a459-4b7e-9405-59f3fdf5ee13 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:11.938409 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e9f12431-5da7-42e0-a0e7-046fef296ec3 req-525ef4a4-a459-4b7e-9405-59f3fdf5ee13 service nova] Creating event network-vif-plugged:c02ffd7c-52fb-4892-9191-b73b520455ad for instance a8ba8e33-ceff-434c-801c-a1cc88157e79 on n-h1-764485-11 Jul 20 04:29:11.944210 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e9f12431-5da7-42e0-a0e7-046fef296ec3 req-525ef4a4-a459-4b7e-9405-59f3fdf5ee13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034125 Jul 20 04:29:11.945057 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2026/4131] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:29:11.986473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f6b62d62-4d4a-492f-93a1-4b3d6f582fe1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:11.996520 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f6b62d62-4d4a-492f-93a1-4b3d6f582fe1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1500 microversion: 2.1 time: 0.269959 Jul 20 04:29:11.997338 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2106/4132] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:11 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1500 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:12.013951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1b8e981a-f5c3-4bfa-8ecc-a5cdb83326a0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:12.015188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1b8e981a-f5c3-4bfa-8ecc-a5cdb83326a0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:12.022249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b8e981a-f5c3-4bfa-8ecc-a5cdb83326a0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.022719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b8e981a-f5c3-4bfa-8ecc-a5cdb83326a0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.023880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b8e981a-f5c3-4bfa-8ecc-a5cdb83326a0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.024353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b8e981a-f5c3-4bfa-8ecc-a5cdb83326a0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.049503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-1b8e981a-f5c3-4bfa-8ecc-a5cdb83326a0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lazy-loading 'flavor' on Instance uuid 4c7f77fd-f2ed-4d3a-a420-a4914119382c {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:12.126439 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1b8e981a-f5c3-4bfa-8ecc-a5cdb83326a0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "POST /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c/action" status: 200 len: 32 microversion: 2.1 time: 0.116873 Jul 20 04:29:12.127371 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2027/4133] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:29:12 2022] POST /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c/action => generated 32 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:12.137648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-daed9475-9436-4a11-93d5-f9c02a25c923 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:12.138478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-daed9475-9436-4a11-93d5-f9c02a25c923 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:12.145404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-daed9475-9436-4a11-93d5-f9c02a25c923 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.145890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-daed9475-9436-4a11-93d5-f9c02a25c923 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.146619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-daed9475-9436-4a11-93d5-f9c02a25c923 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.147155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-daed9475-9436-4a11-93d5-f9c02a25c923 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.344294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-11fb0d71-75bf-450a-9342-4951d6900218 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:12.345624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-11fb0d71-75bf-450a-9342-4951d6900218 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:12.357547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11fb0d71-75bf-450a-9342-4951d6900218 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.358016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11fb0d71-75bf-450a-9342-4951d6900218 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.359750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11fb0d71-75bf-450a-9342-4951d6900218 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.360946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11fb0d71-75bf-450a-9342-4951d6900218 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.917053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-11fb0d71-75bf-450a-9342-4951d6900218 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:12.919114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-daed9475-9436-4a11-93d5-f9c02a25c923 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:12.927488 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-daed9475-9436-4a11-93d5-f9c02a25c923 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.794048 Jul 20 04:29:12.930866 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2107/4134] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:12 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:12.936637 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-11fb0d71-75bf-450a-9342-4951d6900218 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1324 microversion: 2.1 time: 0.598243 Jul 20 04:29:12.937703 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2028/4135] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:12 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1324 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:12.945358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2851e4a3-6f61-47b0-b688-ba5c4054f5be tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:12.946272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2851e4a3-6f61-47b0-b688-ba5c4054f5be tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:12.950130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-457d03a0-e498-46b7-839a-db39d6b93b55 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:12.950963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-457d03a0-e498-46b7-839a-db39d6b93b55 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:12.954776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2851e4a3-6f61-47b0-b688-ba5c4054f5be tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.957705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-457d03a0-e498-46b7-839a-db39d6b93b55 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.958500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2851e4a3-6f61-47b0-b688-ba5c4054f5be tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.959477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2851e4a3-6f61-47b0-b688-ba5c4054f5be tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.960301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2851e4a3-6f61-47b0-b688-ba5c4054f5be tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.966101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-457d03a0-e498-46b7-839a-db39d6b93b55 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.966975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-457d03a0-e498-46b7-839a-db39d6b93b55 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.967422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-457d03a0-e498-46b7-839a-db39d6b93b55 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.334642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2851e4a3-6f61-47b0-b688-ba5c4054f5be tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:13.345764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2851e4a3-6f61-47b0-b688-ba5c4054f5be tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:13.347554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2851e4a3-6f61-47b0-b688-ba5c4054f5be tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:13.349438 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2851e4a3-6f61-47b0-b688-ba5c4054f5be tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1361 microversion: 2.26 time: 0.413566 Jul 20 04:29:13.350371 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2108/4136] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:12 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1361 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:13.364064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e8d95eea-d1c8-46c1-9c5b-5d2344e3d8f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:13.365136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e8d95eea-d1c8-46c1-9c5b-5d2344e3d8f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:13.370869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-457d03a0-e498-46b7-839a-db39d6b93b55 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:13.372397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e8d95eea-d1c8-46c1-9c5b-5d2344e3d8f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.372995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e8d95eea-d1c8-46c1-9c5b-5d2344e3d8f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.374215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e8d95eea-d1c8-46c1-9c5b-5d2344e3d8f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.374793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e8d95eea-d1c8-46c1-9c5b-5d2344e3d8f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.387212 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-457d03a0-e498-46b7-839a-db39d6b93b55 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.448154 Jul 20 04:29:13.388706 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2029/4137] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:12 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:13.405630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a16320be-6a78-4317-9951-6682e718090f req-376e9a31-080f-4b0f-848c-ea7cb542ab6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8d5de4-7985-4933-8867-3352bf84a16b", "tag": "98d95473-ef58-4c7b-b571-36edf82efa0c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:13.418192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a16320be-6a78-4317-9951-6682e718090f req-376e9a31-080f-4b0f-848c-ea7cb542ab6c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.418920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a16320be-6a78-4317-9951-6682e718090f req-376e9a31-080f-4b0f-848c-ea7cb542ab6c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.437641 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a16320be-6a78-4317-9951-6682e718090f req-376e9a31-080f-4b0f-848c-ea7cb542ab6c service nova] Creating event network-changed:98d95473-ef58-4c7b-b571-36edf82efa0c for instance bd8d5de4-7985-4933-8867-3352bf84a16b on n-h1-764485-11 Jul 20 04:29:13.443377 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a16320be-6a78-4317-9951-6682e718090f req-376e9a31-080f-4b0f-848c-ea7cb542ab6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053252 Jul 20 04:29:13.446231 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2030/4138] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:13.573090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e8d95eea-d1c8-46c1-9c5b-5d2344e3d8f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:13.582488 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e8d95eea-d1c8-46c1-9c5b-5d2344e3d8f1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1318 microversion: 2.1 time: 0.230820 Jul 20 04:29:13.583187 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2109/4139] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:13 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:13.959198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3675d2d4-5ed8-4d34-a16c-5402ce4c0a0f tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:13.960025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a2a83220-9917-4a7c-9151-59aa4b27ce1f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:13.961998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a2a83220-9917-4a7c-9151-59aa4b27ce1f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:13.962772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3675d2d4-5ed8-4d34-a16c-5402ce4c0a0f tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:13.970769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2a83220-9917-4a7c-9151-59aa4b27ce1f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.971562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2a83220-9917-4a7c-9151-59aa4b27ce1f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.972816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2a83220-9917-4a7c-9151-59aa4b27ce1f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.973495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2a83220-9917-4a7c-9151-59aa4b27ce1f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.978799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3675d2d4-5ed8-4d34-a16c-5402ce4c0a0f tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.980917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3675d2d4-5ed8-4d34-a16c-5402ce4c0a0f tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.983245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3675d2d4-5ed8-4d34-a16c-5402ce4c0a0f tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.986657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3675d2d4-5ed8-4d34-a16c-5402ce4c0a0f tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.308165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a2a83220-9917-4a7c-9151-59aa4b27ce1f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:14.321303 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a2a83220-9917-4a7c-9151-59aa4b27ce1f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.365191 Jul 20 04:29:14.323691 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2110/4140] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:13 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:14.326580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3675d2d4-5ed8-4d34-a16c-5402ce4c0a0f tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:14.335616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ef32cb02-c483-48cf-ae91-ce61df6ade38 req-64e0c512-8e0c-431a-969a-061c2cc3a6de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48", "name": "network-vif-plugged", "status": "completed", "tag": "315ccd0d-89cb-41bb-9a01-ae929f013595"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:14.343004 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3675d2d4-5ed8-4d34-a16c-5402ce4c0a0f tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1324 microversion: 2.1 time: 0.389160 Jul 20 04:29:14.348140 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2031/4141] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:13 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1324 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:14.371293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7125c93e-9305-4e58-aa5b-6efb113b6cdf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:14.372338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7125c93e-9305-4e58-aa5b-6efb113b6cdf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:14.372625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:14.379161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ef32cb02-c483-48cf-ae91-ce61df6ade38 req-64e0c512-8e0c-431a-969a-061c2cc3a6de service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.379901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ef32cb02-c483-48cf-ae91-ce61df6ade38 req-64e0c512-8e0c-431a-969a-061c2cc3a6de service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.393684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7125c93e-9305-4e58-aa5b-6efb113b6cdf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.393839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7125c93e-9305-4e58-aa5b-6efb113b6cdf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.395251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7125c93e-9305-4e58-aa5b-6efb113b6cdf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.399371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7125c93e-9305-4e58-aa5b-6efb113b6cdf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.413410 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ef32cb02-c483-48cf-ae91-ce61df6ade38 req-64e0c512-8e0c-431a-969a-061c2cc3a6de service nova] Creating event network-vif-plugged:315ccd0d-89cb-41bb-9a01-ae929f013595 for instance c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 on n-h2-764485-11 Jul 20 04:29:14.429492 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ef32cb02-c483-48cf-ae91-ce61df6ade38 req-64e0c512-8e0c-431a-969a-061c2cc3a6de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103929 Jul 20 04:29:14.431210 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2111/4142] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:14.439466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c3432d71-beec-4e75-bb0f-3a836b451ab1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:14.440391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c3432d71-beec-4e75-bb0f-3a836b451ab1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:14.448156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3432d71-beec-4e75-bb0f-3a836b451ab1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.448887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3432d71-beec-4e75-bb0f-3a836b451ab1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.449994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3432d71-beec-4e75-bb0f-3a836b451ab1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.450614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3432d71-beec-4e75-bb0f-3a836b451ab1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.473855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:14.815792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c3432d71-beec-4e75-bb0f-3a836b451ab1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:14.824679 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c3432d71-beec-4e75-bb0f-3a836b451ab1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.391982 Jul 20 04:29:14.825422 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2112/4143] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:14 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:14.831218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ae5dbb66-1041-40fd-ade6-a9bdd8dcd246 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:14.832044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ae5dbb66-1041-40fd-ade6-a9bdd8dcd246 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:14.838348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7125c93e-9305-4e58-aa5b-6efb113b6cdf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:14.846288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae5dbb66-1041-40fd-ade6-a9bdd8dcd246 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.847030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae5dbb66-1041-40fd-ade6-a9bdd8dcd246 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.848311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae5dbb66-1041-40fd-ade6-a9bdd8dcd246 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.848952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7125c93e-9305-4e58-aa5b-6efb113b6cdf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:14.849342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae5dbb66-1041-40fd-ade6-a9bdd8dcd246 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.852256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7125c93e-9305-4e58-aa5b-6efb113b6cdf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:14.854133 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7125c93e-9305-4e58-aa5b-6efb113b6cdf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1361 microversion: 2.26 time: 0.488354 Jul 20 04:29:14.855430 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2032/4144] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:14 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1361 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:15.059615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ae5dbb66-1041-40fd-ade6-a9bdd8dcd246 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:15.070285 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ae5dbb66-1041-40fd-ade6-a9bdd8dcd246 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1318 microversion: 2.1 time: 0.243292 Jul 20 04:29:15.071021 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2113/4145] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:14 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:15.338906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-745757e9-5df8-469e-9f10-4f1adefb2528 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:15.339788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-745757e9-5df8-469e-9f10-4f1adefb2528 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:15.346728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-745757e9-5df8-469e-9f10-4f1adefb2528 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.347482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-745757e9-5df8-469e-9f10-4f1adefb2528 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.348277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-745757e9-5df8-469e-9f10-4f1adefb2528 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.348896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-745757e9-5df8-469e-9f10-4f1adefb2528 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.364885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-92ca03c9-d19c-4cc2-9e20-7efe619293a5 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:15.365525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-92ca03c9-d19c-4cc2-9e20-7efe619293a5 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:15.375688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92ca03c9-d19c-4cc2-9e20-7efe619293a5 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.376673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92ca03c9-d19c-4cc2-9e20-7efe619293a5 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.378909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92ca03c9-d19c-4cc2-9e20-7efe619293a5 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.380762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92ca03c9-d19c-4cc2-9e20-7efe619293a5 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.603007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-745757e9-5df8-469e-9f10-4f1adefb2528 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:15.606430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-92ca03c9-d19c-4cc2-9e20-7efe619293a5 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:15.611220 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-745757e9-5df8-469e-9f10-4f1adefb2528 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.276913 Jul 20 04:29:15.612052 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2033/4146] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:15 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:15.615194 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-92ca03c9-d19c-4cc2-9e20-7efe619293a5 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1522 microversion: 2.1 time: 0.254343 Jul 20 04:29:15.615969 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2114/4147] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:15 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:15.632912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a95f3534-e42a-40d4-9617-ae35c126baa2 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:15.633483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a95f3534-e42a-40d4-9617-ae35c126baa2 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:15.640092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a95f3534-e42a-40d4-9617-ae35c126baa2 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.640552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a95f3534-e42a-40d4-9617-ae35c126baa2 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.641487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a95f3534-e42a-40d4-9617-ae35c126baa2 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.641944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a95f3534-e42a-40d4-9617-ae35c126baa2 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.671639 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a95f3534-e42a-40d4-9617-ae35c126baa2 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] HTTP exception thrown: Action 999 not found Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a95f3534-e42a-40d4-9617-ae35c126baa2 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Request method failure captured: Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79/os-instance-actions/999 HTTP/1.1 Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14SCofW9GCglXuAkkHh8UfprPZx4vr5-isLugBfRInIYzZAB4QLx74vtyhW18uTYQND3pdMR_g5Yy3w_19CeOQkyFNf6ktcb6krADpH28j57NorclZMw7_QTVpqgYR-_Ug6sNufmJJQbj_Gt16V3Iw-lVUW-akSJ4u3pZV36HKcz3GM Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d282b4ab77e646e3b7a7f93c84323c1a Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2000507132 Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d282b4ab77e646e3b7a7f93c84323c1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d282b4ab77e646e3b7a7f93c84323c1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d282b4ab77e646e3b7a7f93c84323c1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d282b4ab77e646e3b7a7f93c84323c1a"}]}] Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2000507132 Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d282b4ab77e646e3b7a7f93c84323c1a Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2000507132 Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-InstanceActionsNegativeTestJSON-2000507132-project Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: b83ad35722124814aec8d8812e21f1a7 Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2000507132-project Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: exception: Action 999 not found Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'server_id': 'a8ba8e33-ceff-434c-801c-a1cc88157e79', 'id': '999'} Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 20 04:29:15.675683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:15.678640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a95f3534-e42a-40d4-9617-ae35c126baa2 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Returning 404 to user: Action 999 not found {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:15.678640 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a95f3534-e42a-40d4-9617-ae35c126baa2 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.048811 Jul 20 04:29:15.678640 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2034/4148] 10.222.0.20 () {58 vars in 1307 bytes} [Wed Jul 20 04:29:15 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79/os-instance-actions/999 => generated 66 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:29:15.687550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04e44295-9539-448f-b9a4-94dd829caa52 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '.version_select at 0x7fbf9c611790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:15.688346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-04e44295-9539-448f-b9a4-94dd829caa52 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: d6c5bc70-64a4-4e2d-9d85-925992d5efb7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:15.694183 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-04e44295-9539-448f-b9a4-94dd829caa52 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] HTTP exception thrown: Instance d6c5bc70-64a4-4e2d-9d85-925992d5efb7 could not be found. Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04e44295-9539-448f-b9a4-94dd829caa52 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Request method failure captured: Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/d6c5bc70-64a4-4e2d-9d85-925992d5efb7/os-instance-actions HTTP/1.1 Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14SCofW9GCglXuAkkHh8UfprPZx4vr5-isLugBfRInIYzZAB4QLx74vtyhW18uTYQND3pdMR_g5Yy3w_19CeOQkyFNf6ktcb6krADpH28j57NorclZMw7_QTVpqgYR-_Ug6sNufmJJQbj_Gt16V3Iw-lVUW-akSJ4u3pZV36HKcz3GM Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: d282b4ab77e646e3b7a7f93c84323c1a Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2000507132 Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d282b4ab77e646e3b7a7f93c84323c1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d282b4ab77e646e3b7a7f93c84323c1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d282b4ab77e646e3b7a7f93c84323c1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d282b4ab77e646e3b7a7f93c84323c1a"}]}] Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2000507132 Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: d282b4ab77e646e3b7a7f93c84323c1a Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2000507132 Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-InstanceActionsNegativeTestJSON-2000507132-project Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b83ad35722124814aec8d8812e21f1a7 Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2000507132-project Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance d6c5bc70-64a4-4e2d-9d85-925992d5efb7 could not be found. Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'server_id': 'd6c5bc70-64a4-4e2d-9d85-925992d5efb7'} Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c5bc70-64a4-4e2d-9d85-925992d5efb7 could not be found. Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:15.697233 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c5bc70-64a4-4e2d-9d85-925992d5efb7 could not be found. Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c5bc70-64a4-4e2d-9d85-925992d5efb7 could not be found. Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04e44295-9539-448f-b9a4-94dd829caa52 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Returning 404 to user: Instance d6c5bc70-64a4-4e2d-9d85-925992d5efb7 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-04e44295-9539-448f-b9a4-94dd829caa52 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/d6c5bc70-64a4-4e2d-9d85-925992d5efb7/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.015302 Jul 20 04:29:15.701502 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2115/4149] 10.222.0.20 () {58 vars in 1295 bytes} [Wed Jul 20 04:29:15 2022] GET /compute/v2.1/servers/d6c5bc70-64a4-4e2d-9d85-925992d5efb7/os-instance-actions => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:15.709630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08d85533-8203-44ea-806a-8ad9464a5ead tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:15.710148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-08d85533-8203-44ea-806a-8ad9464a5ead tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:15.717098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08d85533-8203-44ea-806a-8ad9464a5ead tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.717559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08d85533-8203-44ea-806a-8ad9464a5ead tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.718342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08d85533-8203-44ea-806a-8ad9464a5ead tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.718789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08d85533-8203-44ea-806a-8ad9464a5ead tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.746009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-08d85533-8203-44ea-806a-8ad9464a5ead tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:29:15.771340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:15.831955 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-08d85533-8203-44ea-806a-8ad9464a5ead tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 204 len: 0 microversion: 2.1 time: 0.125828 Jul 20 04:29:15.833027 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2035/4150] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:15 2022] DELETE /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:29:15.841768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0115b1f6-d9e9-4fea-b165-1f107aa2be08 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:15.842634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0115b1f6-d9e9-4fea-b165-1f107aa2be08 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:15.850709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0115b1f6-d9e9-4fea-b165-1f107aa2be08 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.852238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0115b1f6-d9e9-4fea-b165-1f107aa2be08 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.853633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0115b1f6-d9e9-4fea-b165-1f107aa2be08 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.854308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0115b1f6-d9e9-4fea-b165-1f107aa2be08 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.022194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0115b1f6-d9e9-4fea-b165-1f107aa2be08 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:16.032017 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0115b1f6-d9e9-4fea-b165-1f107aa2be08 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1528 microversion: 2.1 time: 0.194307 Jul 20 04:29:16.033023 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2116/4151] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:15 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1528 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:16.038697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7e6727a3-2fdc-4ee9-a0ac-dec75e9dff65 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:16.039452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7e6727a3-2fdc-4ee9-a0ac-dec75e9dff65 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:16.045448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7e6727a3-2fdc-4ee9-a0ac-dec75e9dff65 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.046127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7e6727a3-2fdc-4ee9-a0ac-dec75e9dff65 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.047742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7e6727a3-2fdc-4ee9-a0ac-dec75e9dff65 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.048347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7e6727a3-2fdc-4ee9-a0ac-dec75e9dff65 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.163043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe427e06-9114-481c-867e-d85103be715a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:16.164062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe427e06-9114-481c-867e-d85103be715a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:16.171726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe427e06-9114-481c-867e-d85103be715a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.172190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe427e06-9114-481c-867e-d85103be715a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.172992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe427e06-9114-481c-867e-d85103be715a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.173433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe427e06-9114-481c-867e-d85103be715a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.204927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7e6727a3-2fdc-4ee9-a0ac-dec75e9dff65 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:16.214285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7e6727a3-2fdc-4ee9-a0ac-dec75e9dff65 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:16.215896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7e6727a3-2fdc-4ee9-a0ac-dec75e9dff65 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:16.217065 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7e6727a3-2fdc-4ee9-a0ac-dec75e9dff65 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1361 microversion: 2.26 time: 0.182456 Jul 20 04:29:16.217796 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2117/4152] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:16 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:16.226053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d294734d-58ec-4586-9d27-8ab1b80385ac tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:16.227078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d294734d-58ec-4586-9d27-8ab1b80385ac tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:16.240420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d294734d-58ec-4586-9d27-8ab1b80385ac tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.241492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d294734d-58ec-4586-9d27-8ab1b80385ac tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.243477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d294734d-58ec-4586-9d27-8ab1b80385ac tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.244279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d294734d-58ec-4586-9d27-8ab1b80385ac tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.403235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe427e06-9114-481c-867e-d85103be715a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:16.412581 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe427e06-9114-481c-867e-d85103be715a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.573557 Jul 20 04:29:16.414367 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2036/4153] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:15 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:16.449901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-545cf0c2-2e77-45ab-b5ef-df0be351bf22 req-b765b880-41d3-4675-9e26-2e38f0ad9ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc05c1d-a97f-4a93-bc62-0aa1a7c47c54", "name": "network-vif-plugged", "status": "completed", "tag": "975648a9-1347-4ce4-8604-d1a3fa54879f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:16.457320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d294734d-58ec-4586-9d27-8ab1b80385ac tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:16.459970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-545cf0c2-2e77-45ab-b5ef-df0be351bf22 req-b765b880-41d3-4675-9e26-2e38f0ad9ba6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.460815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-545cf0c2-2e77-45ab-b5ef-df0be351bf22 req-b765b880-41d3-4675-9e26-2e38f0ad9ba6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.466418 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d294734d-58ec-4586-9d27-8ab1b80385ac tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1318 microversion: 2.1 time: 0.247084 Jul 20 04:29:16.467199 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2118/4154] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:16 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:16.479847 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-545cf0c2-2e77-45ab-b5ef-df0be351bf22 req-b765b880-41d3-4675-9e26-2e38f0ad9ba6 service nova] Creating event network-vif-plugged:975648a9-1347-4ce4-8604-d1a3fa54879f for instance acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 on n-h1-764485-11 Jul 20 04:29:16.484898 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-545cf0c2-2e77-45ab-b5ef-df0be351bf22 req-b765b880-41d3-4675-9e26-2e38f0ad9ba6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038680 Jul 20 04:29:16.485509 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2037/4155] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:29:16.629425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e34af0a2-33a7-4a87-85c3-27b19073b733 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:16.630139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e34af0a2-33a7-4a87-85c3-27b19073b733 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:16.636913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e34af0a2-33a7-4a87-85c3-27b19073b733 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.637364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e34af0a2-33a7-4a87-85c3-27b19073b733 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.638124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e34af0a2-33a7-4a87-85c3-27b19073b733 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.638563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e34af0a2-33a7-4a87-85c3-27b19073b733 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.782937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e34af0a2-33a7-4a87-85c3-27b19073b733 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:16.791303 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e34af0a2-33a7-4a87-85c3-27b19073b733 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.166141 Jul 20 04:29:16.791923 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2119/4156] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:16 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:17.050669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ff83a822-e7e5-4339-baa0-a1f5ddfd3ddf tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.051377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ff83a822-e7e5-4339-baa0-a1f5ddfd3ddf tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.059682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff83a822-e7e5-4339-baa0-a1f5ddfd3ddf tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.060142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff83a822-e7e5-4339-baa0-a1f5ddfd3ddf tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.060932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff83a822-e7e5-4339-baa0-a1f5ddfd3ddf tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.061380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff83a822-e7e5-4339-baa0-a1f5ddfd3ddf tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.231156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ff83a822-e7e5-4339-baa0-a1f5ddfd3ddf tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:17.244892 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ff83a822-e7e5-4339-baa0-a1f5ddfd3ddf tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1528 microversion: 2.1 time: 0.198155 Jul 20 04:29:17.246047 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2038/4157] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:17 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1528 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:17.250289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1cb58d4b-259e-4776-9af2-d6e566345364 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.252069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1cb58d4b-259e-4776-9af2-d6e566345364 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.265079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cb58d4b-259e-4776-9af2-d6e566345364 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.265811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cb58d4b-259e-4776-9af2-d6e566345364 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.267086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cb58d4b-259e-4776-9af2-d6e566345364 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.267853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cb58d4b-259e-4776-9af2-d6e566345364 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.413026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1cb58d4b-259e-4776-9af2-d6e566345364 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:17.421691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1cb58d4b-259e-4776-9af2-d6e566345364 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:17.423261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1cb58d4b-259e-4776-9af2-d6e566345364 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:17.424911 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1cb58d4b-259e-4776-9af2-d6e566345364 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1361 microversion: 2.26 time: 0.184655 Jul 20 04:29:17.425661 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2120/4158] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:17 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:17.430911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e941fba0-c278-45c4-bd31-cb81f881d9fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.432688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e941fba0-c278-45c4-bd31-cb81f881d9fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.439956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e941fba0-c278-45c4-bd31-cb81f881d9fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.440449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e941fba0-c278-45c4-bd31-cb81f881d9fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.441228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e941fba0-c278-45c4-bd31-cb81f881d9fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.441677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e941fba0-c278-45c4-bd31-cb81f881d9fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.485406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1863f15d-5f3a-49c6-a601-b2d51b1f8991 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.486039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1863f15d-5f3a-49c6-a601-b2d51b1f8991 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.492244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1863f15d-5f3a-49c6-a601-b2d51b1f8991 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.492709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1863f15d-5f3a-49c6-a601-b2d51b1f8991 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.493649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1863f15d-5f3a-49c6-a601-b2d51b1f8991 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.494102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1863f15d-5f3a-49c6-a601-b2d51b1f8991 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.662673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e941fba0-c278-45c4-bd31-cb81f881d9fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:17.672453 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e941fba0-c278-45c4-bd31-cb81f881d9fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.245717 Jul 20 04:29:17.673062 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2039/4159] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:17 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:17.740766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1863f15d-5f3a-49c6-a601-b2d51b1f8991 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:17.748854 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1863f15d-5f3a-49c6-a601-b2d51b1f8991 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1509 microversion: 2.1 time: 0.267461 Jul 20 04:29:17.749480 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2121/4160] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:17 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1509 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:17.765482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1999a9b9-f998-4f42-9c40-6ac73290c00d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.766189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1999a9b9-f998-4f42-9c40-6ac73290c00d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.768508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:17.774917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1999a9b9-f998-4f42-9c40-6ac73290c00d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.775377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1999a9b9-f998-4f42-9c40-6ac73290c00d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.776233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1999a9b9-f998-4f42-9c40-6ac73290c00d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.776738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1999a9b9-f998-4f42-9c40-6ac73290c00d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.809428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-98f8b2f7-0694-4325-a2d5-84020451362e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.810520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-98f8b2f7-0694-4325-a2d5-84020451362e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.817282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98f8b2f7-0694-4325-a2d5-84020451362e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.817864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98f8b2f7-0694-4325-a2d5-84020451362e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.818747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98f8b2f7-0694-4325-a2d5-84020451362e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.819363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98f8b2f7-0694-4325-a2d5-84020451362e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.354853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1999a9b9-f998-4f42-9c40-6ac73290c00d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:18.362642 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1999a9b9-f998-4f42-9c40-6ac73290c00d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1509 microversion: 2.1 time: 0.601440 Jul 20 04:29:18.374730 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2040/4161] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:17 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1509 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:18.385359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-98f8b2f7-0694-4325-a2d5-84020451362e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:18.396353 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-98f8b2f7-0694-4325-a2d5-84020451362e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.591681 Jul 20 04:29:18.397142 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2122/4162] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:17 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:18.397784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ce7d585b-2e52-4cb5-8a13-55373d3b577c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:18.400130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ce7d585b-2e52-4cb5-8a13-55373d3b577c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:18.403083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-97054269-5fdf-4680-a214-62332490b454 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:18.404568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-97054269-5fdf-4680-a214-62332490b454 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:18.409220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce7d585b-2e52-4cb5-8a13-55373d3b577c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.409929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce7d585b-2e52-4cb5-8a13-55373d3b577c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.410739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce7d585b-2e52-4cb5-8a13-55373d3b577c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.411713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce7d585b-2e52-4cb5-8a13-55373d3b577c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.418984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97054269-5fdf-4680-a214-62332490b454 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.419848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97054269-5fdf-4680-a214-62332490b454 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.420645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97054269-5fdf-4680-a214-62332490b454 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.421107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97054269-5fdf-4680-a214-62332490b454 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.504793 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-97054269-5fdf-4680-a214-62332490b454 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "PUT /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1081 microversion: 2.1 time: 0.106159 Jul 20 04:29:18.515058 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2123/4163] 10.222.0.20 () {60 vars in 1255 bytes} [Wed Jul 20 04:29:18 2022] PUT /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1081 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:18.520022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-65d07613-e78c-43a0-8fa3-2ab3ec30c62d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:18.520895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-65d07613-e78c-43a0-8fa3-2ab3ec30c62d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:18.532746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65d07613-e78c-43a0-8fa3-2ab3ec30c62d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.533342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65d07613-e78c-43a0-8fa3-2ab3ec30c62d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.534154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65d07613-e78c-43a0-8fa3-2ab3ec30c62d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.534591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65d07613-e78c-43a0-8fa3-2ab3ec30c62d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.720648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ce7d585b-2e52-4cb5-8a13-55373d3b577c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83ad35722124814aec8d8812e21f1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd282b4ab77e646e3b7a7f93c84323c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:18.732530 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ce7d585b-2e52-4cb5-8a13-55373d3b577c tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 200 len: 1528 microversion: 2.1 time: 0.356334 Jul 20 04:29:18.735850 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2041/4164] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:18 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 1528 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:18.746301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b3411fdb-4c87-4760-b7ca-bd96abb7aed9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:18.746301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b3411fdb-4c87-4760-b7ca-bd96abb7aed9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:18.756149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3411fdb-4c87-4760-b7ca-bd96abb7aed9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.756668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3411fdb-4c87-4760-b7ca-bd96abb7aed9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.758797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3411fdb-4c87-4760-b7ca-bd96abb7aed9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.759248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3411fdb-4c87-4760-b7ca-bd96abb7aed9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.921271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-65d07613-e78c-43a0-8fa3-2ab3ec30c62d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:18.933752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-65d07613-e78c-43a0-8fa3-2ab3ec30c62d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:18.939168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-65d07613-e78c-43a0-8fa3-2ab3ec30c62d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:18.940600 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-65d07613-e78c-43a0-8fa3-2ab3ec30c62d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1361 microversion: 2.26 time: 0.424471 Jul 20 04:29:18.941449 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2124/4165] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:18 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1361 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:18.948925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-329b6ac6-cafb-4a63-b7b4-38cc5caa1684 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:18.949967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-329b6ac6-cafb-4a63-b7b4-38cc5caa1684 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:18.957123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-329b6ac6-cafb-4a63-b7b4-38cc5caa1684 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.957745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-329b6ac6-cafb-4a63-b7b4-38cc5caa1684 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.958876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-329b6ac6-cafb-4a63-b7b4-38cc5caa1684 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.959466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-329b6ac6-cafb-4a63-b7b4-38cc5caa1684 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.005084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b3411fdb-4c87-4760-b7ca-bd96abb7aed9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:19.018439 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b3411fdb-4c87-4760-b7ca-bd96abb7aed9 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1507 microversion: 2.1 time: 0.281151 Jul 20 04:29:19.024314 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2042/4166] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:18 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:19.029178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8e4a9b51-da5d-4bab-b325-126ca5b5e944 req-b1585df1-b3cc-48c0-a8fb-98db41e242df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ba8e33-ceff-434c-801c-a1cc88157e79", "name": "network-vif-deleted", "tag": "c02ffd7c-52fb-4892-9191-b73b520455ad"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:19.050495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8e4a9b51-da5d-4bab-b325-126ca5b5e944 req-b1585df1-b3cc-48c0-a8fb-98db41e242df service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.051206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8e4a9b51-da5d-4bab-b325-126ca5b5e944 req-b1585df1-b3cc-48c0-a8fb-98db41e242df service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.064502 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8e4a9b51-da5d-4bab-b325-126ca5b5e944 req-b1585df1-b3cc-48c0-a8fb-98db41e242df service nova] Creating event network-vif-deleted:c02ffd7c-52fb-4892-9191-b73b520455ad for instance a8ba8e33-ceff-434c-801c-a1cc88157e79 on n-h1-764485-11 Jul 20 04:29:19.069763 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8e4a9b51-da5d-4bab-b325-126ca5b5e944 req-b1585df1-b3cc-48c0-a8fb-98db41e242df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044041 Jul 20 04:29:19.071113 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2043/4167] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:19.076912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3270ff54-1a16-4503-8140-b9735beb85e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.077700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3270ff54-1a16-4503-8140-b9735beb85e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.084714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3270ff54-1a16-4503-8140-b9735beb85e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.085273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3270ff54-1a16-4503-8140-b9735beb85e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.086349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3270ff54-1a16-4503-8140-b9735beb85e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.086999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3270ff54-1a16-4503-8140-b9735beb85e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.152741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-329b6ac6-cafb-4a63-b7b4-38cc5caa1684 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:19.161799 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-329b6ac6-cafb-4a63-b7b4-38cc5caa1684 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.219136 Jul 20 04:29:19.162547 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2125/4168] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:18 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:19.255555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3270ff54-1a16-4503-8140-b9735beb85e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:19.264441 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3270ff54-1a16-4503-8140-b9735beb85e8 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1507 microversion: 2.1 time: 0.191947 Jul 20 04:29:19.265191 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2044/4169] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:19 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:19.281528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-96d9be6a-1cbd-417c-ae88-3320da4e27cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:19.282713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-96d9be6a-1cbd-417c-ae88-3320da4e27cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.289831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96d9be6a-1cbd-417c-ae88-3320da4e27cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.290296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96d9be6a-1cbd-417c-ae88-3320da4e27cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.291079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96d9be6a-1cbd-417c-ae88-3320da4e27cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.291547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96d9be6a-1cbd-417c-ae88-3320da4e27cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.356903 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-96d9be6a-1cbd-417c-ae88-3320da4e27cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "PUT /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1083 microversion: 2.1 time: 0.080032 Jul 20 04:29:19.366146 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2126/4170] 10.222.0.20 () {60 vars in 1255 bytes} [Wed Jul 20 04:29:19 2022] PUT /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1083 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:19.371918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e2f32731-858e-4620-accb-43dd83f3eea5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.372535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e2f32731-858e-4620-accb-43dd83f3eea5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.380311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2f32731-858e-4620-accb-43dd83f3eea5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.380704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2f32731-858e-4620-accb-43dd83f3eea5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.381601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2f32731-858e-4620-accb-43dd83f3eea5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.382902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2f32731-858e-4620-accb-43dd83f3eea5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.414562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6da43fc0-0c6e-4ea8-bfa2-53128476b645 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.415613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6da43fc0-0c6e-4ea8-bfa2-53128476b645 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.422699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6da43fc0-0c6e-4ea8-bfa2-53128476b645 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.423168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6da43fc0-0c6e-4ea8-bfa2-53128476b645 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.423989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6da43fc0-0c6e-4ea8-bfa2-53128476b645 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.424444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6da43fc0-0c6e-4ea8-bfa2-53128476b645 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.636572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e2f32731-858e-4620-accb-43dd83f3eea5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:19.645341 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e2f32731-858e-4620-accb-43dd83f3eea5 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1509 microversion: 2.1 time: 0.277210 Jul 20 04:29:19.648481 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2045/4171] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:19 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:19.649939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6da43fc0-0c6e-4ea8-bfa2-53128476b645 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:19.663705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ef1aca8d-b0a6-4c67-b79d-dd109c4c04fe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.664587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ef1aca8d-b0a6-4c67-b79d-dd109c4c04fe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.675830 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6da43fc0-0c6e-4ea8-bfa2-53128476b645 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.264480 Jul 20 04:29:19.676695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef1aca8d-b0a6-4c67-b79d-dd109c4c04fe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.677158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef1aca8d-b0a6-4c67-b79d-dd109c4c04fe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.677953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef1aca8d-b0a6-4c67-b79d-dd109c4c04fe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.678393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef1aca8d-b0a6-4c67-b79d-dd109c4c04fe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.682564 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2127/4172] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:19 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:19.752805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-46009699-be81-4ede-a3c4-ea8addc07f86 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.753697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-46009699-be81-4ede-a3c4-ea8addc07f86 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] [instance: a8ba8e33-ceff-434c-801c-a1cc88157e79] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.761285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46009699-be81-4ede-a3c4-ea8addc07f86 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.761752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46009699-be81-4ede-a3c4-ea8addc07f86 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.762530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46009699-be81-4ede-a3c4-ea8addc07f86 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.762973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46009699-be81-4ede-a3c4-ea8addc07f86 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.779165 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-46009699-be81-4ede-a3c4-ea8addc07f86 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] HTTP exception thrown: Instance a8ba8e33-ceff-434c-801c-a1cc88157e79 could not be found. Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-46009699-be81-4ede-a3c4-ea8addc07f86 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Request method failure captured: Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 HTTP/1.1 Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14SCofW9GCglXuAkkHh8UfprPZx4vr5-isLugBfRInIYzZAB4QLx74vtyhW18uTYQND3pdMR_g5Yy3w_19CeOQkyFNf6ktcb6krADpH28j57NorclZMw7_QTVpqgYR-_Ug6sNufmJJQbj_Gt16V3Iw-lVUW-akSJ4u3pZV36HKcz3GM Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: d282b4ab77e646e3b7a7f93c84323c1a Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2000507132 Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d282b4ab77e646e3b7a7f93c84323c1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d282b4ab77e646e3b7a7f93c84323c1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d282b4ab77e646e3b7a7f93c84323c1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d282b4ab77e646e3b7a7f93c84323c1a"}]}] Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2000507132 Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: d282b4ab77e646e3b7a7f93c84323c1a Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2000507132 Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-InstanceActionsNegativeTestJSON-2000507132-project Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b83ad35722124814aec8d8812e21f1a7 Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2000507132-project Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance a8ba8e33-ceff-434c-801c-a1cc88157e79 could not be found. Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a8ba8e33-ceff-434c-801c-a1cc88157e79'} Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ba8e33-ceff-434c-801c-a1cc88157e79 could not be found. Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ba8e33-ceff-434c-801c-a1cc88157e79 could not be found. Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:19.780776 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:19.784517 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:19.784517 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:19.784517 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:19.784517 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:19.784517 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:19.784517 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:19.784517 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ba8e33-ceff-434c-801c-a1cc88157e79 could not be found. Jul 20 04:29:19.784517 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:19.785760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-46009699-be81-4ede-a3c4-ea8addc07f86 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] Returning 404 to user: Instance a8ba8e33-ceff-434c-801c-a1cc88157e79 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:19.786794 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-46009699-be81-4ede-a3c4-ea8addc07f86 tempest-InstanceActionsNegativeTestJSON-2000507132 tempest-InstanceActionsNegativeTestJSON-2000507132-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79" status: 404 len: 111 microversion: 2.1 time: 0.038104 Jul 20 04:29:19.787370 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2128/4173] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:19 2022] GET /compute/v2.1/servers/a8ba8e33-ceff-434c-801c-a1cc88157e79 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:29:19.825251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ef1aca8d-b0a6-4c67-b79d-dd109c4c04fe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:19.836761 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ef1aca8d-b0a6-4c67-b79d-dd109c4c04fe tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1509 microversion: 2.1 time: 0.177885 Jul 20 04:29:19.837547 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2046/4174] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:19 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:19.853295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e1b2a862-1d18-4126-afd4-7566780b5801 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.853803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e1b2a862-1d18-4126-afd4-7566780b5801 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.860086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1b2a862-1d18-4126-afd4-7566780b5801 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.860551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1b2a862-1d18-4126-afd4-7566780b5801 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.861335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1b2a862-1d18-4126-afd4-7566780b5801 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.861786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1b2a862-1d18-4126-afd4-7566780b5801 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.882059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:19.896321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e1b2a862-1d18-4126-afd4-7566780b5801 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:29:19.961609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bd4839c2-f754-4d14-a813-23fcc1e31c9d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.962463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bd4839c2-f754-4d14-a813-23fcc1e31c9d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.969716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd4839c2-f754-4d14-a813-23fcc1e31c9d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.970170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd4839c2-f754-4d14-a813-23fcc1e31c9d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.971599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd4839c2-f754-4d14-a813-23fcc1e31c9d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.972667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd4839c2-f754-4d14-a813-23fcc1e31c9d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.999813 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e1b2a862-1d18-4126-afd4-7566780b5801 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 204 len: 0 microversion: 2.1 time: 0.150199 Jul 20 04:29:20.002313 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2129/4175] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:19 2022] DELETE /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:29:20.016707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bb9c1b22-c44b-442a-8e93-319263c31bed tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.017508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bb9c1b22-c44b-442a-8e93-319263c31bed tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.024126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb9c1b22-c44b-442a-8e93-319263c31bed tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.024854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb9c1b22-c44b-442a-8e93-319263c31bed tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.028478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb9c1b22-c44b-442a-8e93-319263c31bed tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.029293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb9c1b22-c44b-442a-8e93-319263c31bed tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.057487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bb9c1b22-c44b-442a-8e93-319263c31bed tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:29:20.109177 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.compute.api [None req-bb9c1b22-c44b-442a-8e93-319263c31bed tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Instance is already in deleting state, ignoring this request Jul 20 04:29:20.110236 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bb9c1b22-c44b-442a-8e93-319263c31bed tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 204 len: 0 microversion: 2.1 time: 0.100713 Jul 20 04:29:20.111331 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2130/4176] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:20 2022] DELETE /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:29:20.121590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-71d77205-57dc-40c4-995b-0c6ea5023d4d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.122463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-71d77205-57dc-40c4-995b-0c6ea5023d4d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.129286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71d77205-57dc-40c4-995b-0c6ea5023d4d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.130031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71d77205-57dc-40c4-995b-0c6ea5023d4d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.130991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71d77205-57dc-40c4-995b-0c6ea5023d4d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.131643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71d77205-57dc-40c4-995b-0c6ea5023d4d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.135842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bd4839c2-f754-4d14-a813-23fcc1e31c9d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:20.145211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bd4839c2-f754-4d14-a813-23fcc1e31c9d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:20.148029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bd4839c2-f754-4d14-a813-23fcc1e31c9d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:20.149613 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bd4839c2-f754-4d14-a813-23fcc1e31c9d tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1543 microversion: 2.26 time: 0.193470 Jul 20 04:29:20.150515 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2047/4177] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:19 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1543 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:29:20.169758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9d15d160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.186099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.186795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.187279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.195090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.195969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.196918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.197516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.225770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.227309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.253416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.254005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.283735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:20.295031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-71d77205-57dc-40c4-995b-0c6ea5023d4d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:20.302866 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-71d77205-57dc-40c4-995b-0c6ea5023d4d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1515 microversion: 2.1 time: 0.187117 Jul 20 04:29:20.303575 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ee4b0cf2-59ad-4091-913a-d76515db68cf tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-1084668936" status: 201 len: 0 microversion: 2.26 time: 0.137768 Jul 20 04:29:20.311562 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2048/4178] 10.222.0.20 () {62 vars in 1379 bytes} [Wed Jul 20 04:29:20 2022] PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-1084668936 => generated 0 bytes in 139 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jul 20 04:29:20.311562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8595da94-51b4-4bd6-92b8-3757f0e1b8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.311562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8595da94-51b4-4bd6-92b8-3757f0e1b8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.312405 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2131/4179] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:20 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:20.320747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8595da94-51b4-4bd6-92b8-3757f0e1b8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.321205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8595da94-51b4-4bd6-92b8-3757f0e1b8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.322107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8595da94-51b4-4bd6-92b8-3757f0e1b8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.322406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8595da94-51b4-4bd6-92b8-3757f0e1b8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.325287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-217dfddb-3544-427a-8041-7ba577806f1c tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9c3fdd30>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.333716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-217dfddb-3544-427a-8041-7ba577806f1c tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.334403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-217dfddb-3544-427a-8041-7ba577806f1c tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.351127 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-217dfddb-3544-427a-8041-7ba577806f1c tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-1084668936" status: 204 len: 0 microversion: 2.26 time: 0.029779 Jul 20 04:29:20.351886 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2132/4180] 10.222.0.20 () {60 vars in 1360 bytes} [Wed Jul 20 04:29:20 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-1084668936 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:29:20.360171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e971a803-a8f1-48b0-bf67-c5dcd3cf547a tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9dfb4790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.368193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e971a803-a8f1-48b0-bf67-c5dcd3cf547a tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.368655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e971a803-a8f1-48b0-bf67-c5dcd3cf547a tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.369140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e971a803-a8f1-48b0-bf67-c5dcd3cf547a tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.375346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e971a803-a8f1-48b0-bf67-c5dcd3cf547a tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.375839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e971a803-a8f1-48b0-bf67-c5dcd3cf547a tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.376840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e971a803-a8f1-48b0-bf67-c5dcd3cf547a tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.377290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e971a803-a8f1-48b0-bf67-c5dcd3cf547a tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.403932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e971a803-a8f1-48b0-bf67-c5dcd3cf547a tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.404319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e971a803-a8f1-48b0-bf67-c5dcd3cf547a tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.419964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-e971a803-a8f1-48b0-bf67-c5dcd3cf547a tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:20.439935 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e971a803-a8f1-48b0-bf67-c5dcd3cf547a tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags" status: 204 len: 0 microversion: 2.26 time: 0.083623 Jul 20 04:29:20.440608 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2133/4181] 10.222.0.20 () {60 vars in 1294 bytes} [Wed Jul 20 04:29:20 2022] DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:29:20.450379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b84b93d1-df0b-420d-aa12-99406d1d6c87 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9c611d30>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.458201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b84b93d1-df0b-420d-aa12-99406d1d6c87 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.458653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b84b93d1-df0b-420d-aa12-99406d1d6c87 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.469841 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b84b93d1-df0b-420d-aa12-99406d1d6c87 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags" status: 200 len: 12 microversion: 2.26 time: 0.023319 Jul 20 04:29:20.470475 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2134/4182] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 20 04:29:20 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:20.482699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8595da94-51b4-4bd6-92b8-3757f0e1b8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:20.482887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbfa276f940>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.490750 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8595da94-51b4-4bd6-92b8-3757f0e1b8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.185317 Jul 20 04:29:20.491333 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2049/4183] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:20 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:20.493167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.493775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.495782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.502630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.503083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.503875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.504980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.533460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.533918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.543251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.543746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.567712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:20.584369 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e70e8595-e8fe-4813-bdec-8a743d77b567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-398174611" status: 201 len: 0 microversion: 2.26 time: 0.106418 Jul 20 04:29:20.589348 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2135/4184] 10.222.0.20 () {62 vars in 1376 bytes} [Wed Jul 20 04:29:20 2022] PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-398174611 => generated 0 bytes in 109 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Jul 20 04:29:20.594707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e8a287bf-41b3-42d3-a9cf-b0b9b6856c36 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9d4505e0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.603126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8a287bf-41b3-42d3-a9cf-b0b9b6856c36 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.603605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8a287bf-41b3-42d3-a9cf-b0b9b6856c36 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.612987 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e8a287bf-41b3-42d3-a9cf-b0b9b6856c36 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags" status: 200 len: 35 microversion: 2.26 time: 0.022196 Jul 20 04:29:20.613604 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2050/4185] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 20 04:29:20 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags => generated 35 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:20.625949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a597c29-7aa8-4235-901f-c843a481dd19 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbfa284ca60>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.635962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a597c29-7aa8-4235-901f-c843a481dd19 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.636406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a597c29-7aa8-4235-901f-c843a481dd19 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.637064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7a597c29-7aa8-4235-901f-c843a481dd19 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.644399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a597c29-7aa8-4235-901f-c843a481dd19 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.644851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a597c29-7aa8-4235-901f-c843a481dd19 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.645616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a597c29-7aa8-4235-901f-c843a481dd19 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.646058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a597c29-7aa8-4235-901f-c843a481dd19 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.670494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a597c29-7aa8-4235-901f-c843a481dd19 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.671103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a597c29-7aa8-4235-901f-c843a481dd19 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.695946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-7a597c29-7aa8-4235-901f-c843a481dd19 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:20.701488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c0be1554-9d4c-4faf-983d-33b2c1d8c4a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.702278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c0be1554-9d4c-4faf-983d-33b2c1d8c4a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.715536 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7a597c29-7aa8-4235-901f-c843a481dd19 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-398174611" status: 204 len: 0 microversion: 2.26 time: 0.095248 Jul 20 04:29:20.717000 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2136/4186] 10.222.0.20 () {60 vars in 1360 bytes} [Wed Jul 20 04:29:20 2022] DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-398174611 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:29:20.725046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0be1554-9d4c-4faf-983d-33b2c1d8c4a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.725508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0be1554-9d4c-4faf-983d-33b2c1d8c4a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.728432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-913bce01-42a7-4791-952b-594099cfabcc tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbfa276fdc0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.729592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0be1554-9d4c-4faf-983d-33b2c1d8c4a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.731351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0be1554-9d4c-4faf-983d-33b2c1d8c4a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.738566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-913bce01-42a7-4791-952b-594099cfabcc tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.739108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-913bce01-42a7-4791-952b-594099cfabcc tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.750815 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-913bce01-42a7-4791-952b-594099cfabcc tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags" status: 200 len: 12 microversion: 2.26 time: 0.028925 Jul 20 04:29:20.756879 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2137/4187] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 20 04:29:20 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:20.762940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b6230fdd-a72e-4740-b7e2-fc5a16f6f444 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9c6255e0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.764333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:20.771780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6230fdd-a72e-4740-b7e2-fc5a16f6f444 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.772388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6230fdd-a72e-4740-b7e2-fc5a16f6f444 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.772906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b6230fdd-a72e-4740-b7e2-fc5a16f6f444 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.780415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6230fdd-a72e-4740-b7e2-fc5a16f6f444 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.781225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6230fdd-a72e-4740-b7e2-fc5a16f6f444 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.781832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6230fdd-a72e-4740-b7e2-fc5a16f6f444 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.782273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6230fdd-a72e-4740-b7e2-fc5a16f6f444 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.816477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6230fdd-a72e-4740-b7e2-fc5a16f6f444 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.816935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6230fdd-a72e-4740-b7e2-fc5a16f6f444 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.830632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-b6230fdd-a72e-4740-b7e2-fc5a16f6f444 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:20.852801 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b6230fdd-a72e-4740-b7e2-fc5a16f6f444 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags" status: 204 len: 0 microversion: 2.26 time: 0.093932 Jul 20 04:29:20.853758 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2138/4188] 10.222.0.20 () {60 vars in 1294 bytes} [Wed Jul 20 04:29:20 2022] DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:29:20.864038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9d1495e0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.876536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.876994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.877477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.884146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.884596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.885367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.885808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.902807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c0be1554-9d4c-4faf-983d-33b2c1d8c4a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:20.911820 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c0be1554-9d4c-4faf-983d-33b2c1d8c4a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.214420 Jul 20 04:29:20.916580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.917192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.922834 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2051/4189] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:20 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:20.930695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.931832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.941755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=3,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:20.966860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:20.988006 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5b7acab0-ce8c-40e2-9011-62df6e6f1485 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-963644559" status: 201 len: 0 microversion: 2.26 time: 0.127852 Jul 20 04:29:20.989226 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2139/4190] 10.222.0.20 () {62 vars in 1376 bytes} [Wed Jul 20 04:29:20 2022] PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-963644559 => generated 0 bytes in 130 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 20 04:29:20.998551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9da6c4c0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.009136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.009666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.010346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:21.016544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.016994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.017758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.018192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.045624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.045955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.056070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.056520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.089885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:21.110157 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-147e2eab-f4dd-4647-b7b7-feda00ac75c0 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-313186553" status: 201 len: 0 microversion: 2.26 time: 0.115525 Jul 20 04:29:21.112276 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2052/4191] 10.222.0.20 () {62 vars in 1376 bytes} [Wed Jul 20 04:29:20 2022] PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-313186553 => generated 0 bytes in 118 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Jul 20 04:29:21.125468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e36ea609-7d72-41b0-9fd0-8a84f131a12e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9c6259d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.137081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e36ea609-7d72-41b0-9fd0-8a84f131a12e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.137712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e36ea609-7d72-41b0-9fd0-8a84f131a12e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.138207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e36ea609-7d72-41b0-9fd0-8a84f131a12e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:21.144908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e36ea609-7d72-41b0-9fd0-8a84f131a12e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.145370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e36ea609-7d72-41b0-9fd0-8a84f131a12e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.146151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e36ea609-7d72-41b0-9fd0-8a84f131a12e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.146786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e36ea609-7d72-41b0-9fd0-8a84f131a12e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.173949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e36ea609-7d72-41b0-9fd0-8a84f131a12e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.174297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e36ea609-7d72-41b0-9fd0-8a84f131a12e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.198060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-e36ea609-7d72-41b0-9fd0-8a84f131a12e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:21.219361 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e36ea609-7d72-41b0-9fd0-8a84f131a12e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags" status: 204 len: 0 microversion: 2.26 time: 0.099949 Jul 20 04:29:21.220453 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2140/4192] 10.222.0.20 () {60 vars in 1294 bytes} [Wed Jul 20 04:29:21 2022] DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:29:21.231443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-907b5eb0-788a-499f-8517-e1d02bd4f462 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9d5f33a0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.240817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-907b5eb0-788a-499f-8517-e1d02bd4f462 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.241277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-907b5eb0-788a-499f-8517-e1d02bd4f462 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.255153 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-907b5eb0-788a-499f-8517-e1d02bd4f462 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags" status: 200 len: 12 microversion: 2.26 time: 0.029595 Jul 20 04:29:21.256411 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2053/4193] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 20 04:29:21 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:21.267439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-543894fd-0baf-41e4-9a18-3e5484612e5b tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9c3e4ca0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.275767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-543894fd-0baf-41e4-9a18-3e5484612e5b tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.276312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-543894fd-0baf-41e4-9a18-3e5484612e5b tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.276856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-543894fd-0baf-41e4-9a18-3e5484612e5b tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:21.284211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-543894fd-0baf-41e4-9a18-3e5484612e5b tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.284783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-543894fd-0baf-41e4-9a18-3e5484612e5b tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.285632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-543894fd-0baf-41e4-9a18-3e5484612e5b tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.286229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-543894fd-0baf-41e4-9a18-3e5484612e5b tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.312835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-543894fd-0baf-41e4-9a18-3e5484612e5b tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.312835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-543894fd-0baf-41e4-9a18-3e5484612e5b tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.326069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-953a2879-1640-45a5-9ec7-94959b9e13cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.326704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-953a2879-1640-45a5-9ec7-94959b9e13cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:21.336738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-953a2879-1640-45a5-9ec7-94959b9e13cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.338086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-953a2879-1640-45a5-9ec7-94959b9e13cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.338086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-953a2879-1640-45a5-9ec7-94959b9e13cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.340002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-953a2879-1640-45a5-9ec7-94959b9e13cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.341254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-543894fd-0baf-41e4-9a18-3e5484612e5b tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:21.372777 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-543894fd-0baf-41e4-9a18-3e5484612e5b tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags" status: 204 len: 0 microversion: 2.26 time: 0.110152 Jul 20 04:29:21.373858 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2141/4194] 10.222.0.20 () {60 vars in 1294 bytes} [Wed Jul 20 04:29:21 2022] DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:29:21.385166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9c625280>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.398258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.399229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.400124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:21.407791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.408632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.409668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.410296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.459010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.459676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.473523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.474135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.509974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:21.528984 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c6dcfa9a-790b-4f5f-af3f-82a52c7482b7 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-340789604" status: 201 len: 0 microversion: 2.26 time: 0.149439 Jul 20 04:29:21.531749 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2142/4195] 10.222.0.20 () {62 vars in 1376 bytes} [Wed Jul 20 04:29:21 2022] PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-340789604 => generated 0 bytes in 153 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Jul 20 04:29:21.537242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-953a2879-1640-45a5-9ec7-94959b9e13cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:21.537760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1cdf8b8a-cdb0-49d5-9b04-a9d5e7d391ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.539400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1cdf8b8a-cdb0-49d5-9b04-a9d5e7d391ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:21.546331 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-953a2879-1640-45a5-9ec7-94959b9e13cb tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1515 microversion: 2.1 time: 0.224082 Jul 20 04:29:21.547245 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2054/4196] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:21 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:21.551801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cdf8b8a-cdb0-49d5-9b04-a9d5e7d391ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.551801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cdf8b8a-cdb0-49d5-9b04-a9d5e7d391ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.551801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cdf8b8a-cdb0-49d5-9b04-a9d5e7d391ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.551801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cdf8b8a-cdb0-49d5-9b04-a9d5e7d391ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.556749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9d67b040>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.567326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.568273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.569064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:21.576114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.576809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.577767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.578990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.609320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.610121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.622610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.623387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.659541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:21.693066 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ae6ccaa-657f-4e8b-af25-22555508b9dd tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-445690012" status: 201 len: 0 microversion: 2.26 time: 0.144498 Jul 20 04:29:21.693915 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2055/4197] 10.222.0.20 () {62 vars in 1376 bytes} [Wed Jul 20 04:29:21 2022] PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags/tempest-tag-445690012 => generated 0 bytes in 146 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 20 04:29:21.703780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c9bc9c55-ce00-4654-ba7f-211c0ff56440 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Action: 'update_all', calling method: .version_select at 0x7fbf9c512670>, body: {"tags": ["tempest-tag-218206573", "tempest-tag-137684351"]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:21.713394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9bc9c55-ce00-4654-ba7f-211c0ff56440 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.713839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9bc9c55-ce00-4654-ba7f-211c0ff56440 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.714485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c9bc9c55-ce00-4654-ba7f-211c0ff56440 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:21.736496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9bc9c55-ce00-4654-ba7f-211c0ff56440 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.737209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9bc9c55-ce00-4654-ba7f-211c0ff56440 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.738161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9bc9c55-ce00-4654-ba7f-211c0ff56440 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.738789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9bc9c55-ce00-4654-ba7f-211c0ff56440 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.774337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9bc9c55-ce00-4654-ba7f-211c0ff56440 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.775066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9bc9c55-ce00-4654-ba7f-211c0ff56440 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.789742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1cdf8b8a-cdb0-49d5-9b04-a9d5e7d391ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:21.798639 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1cdf8b8a-cdb0-49d5-9b04-a9d5e7d391ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1512 microversion: 2.1 time: 0.265551 Jul 20 04:29:21.799295 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2143/4198] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:21 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:21.803002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-c9bc9c55-ce00-4654-ba7f-211c0ff56440 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:21.826151 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c9bc9c55-ce00-4654-ba7f-211c0ff56440 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags" status: 200 len: 60 microversion: 2.26 time: 0.126564 Jul 20 04:29:21.831813 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2056/4199] 10.222.0.20 () {62 vars in 1311 bytes} [Wed Jul 20 04:29:21 2022] PUT /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags => generated 60 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:21.838996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f70f7357-212d-4b06-a3e9-e4ccc91b8567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9c4f03a0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.855036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f70f7357-212d-4b06-a3e9-e4ccc91b8567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.855528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f70f7357-212d-4b06-a3e9-e4ccc91b8567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.879082 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f70f7357-212d-4b06-a3e9-e4ccc91b8567 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags" status: 200 len: 60 microversion: 2.26 time: 0.044994 Jul 20 04:29:21.887230 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2144/4200] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Jul 20 04:29:21 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags => generated 60 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:21.893655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0c133d1-feb0-4a73-930d-5ce23972d194 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '.version_select at 0x7fbf9dbb0c10>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.905562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0c133d1-feb0-4a73-930d-5ce23972d194 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.907120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0c133d1-feb0-4a73-930d-5ce23972d194 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.907859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e0c133d1-feb0-4a73-930d-5ce23972d194 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:21.915434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0c133d1-feb0-4a73-930d-5ce23972d194 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.916492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0c133d1-feb0-4a73-930d-5ce23972d194 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.917530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0c133d1-feb0-4a73-930d-5ce23972d194 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.918514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0c133d1-feb0-4a73-930d-5ce23972d194 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.930348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5aa2051e-8ce2-436c-b346-e8be8f2e41a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.930988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5aa2051e-8ce2-436c-b346-e8be8f2e41a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:21.940709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5aa2051e-8ce2-436c-b346-e8be8f2e41a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.948155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5aa2051e-8ce2-436c-b346-e8be8f2e41a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.949729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5aa2051e-8ce2-436c-b346-e8be8f2e41a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.950325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5aa2051e-8ce2-436c-b346-e8be8f2e41a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.972145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0c133d1-feb0-4a73-930d-5ce23972d194 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.972870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0c133d1-feb0-4a73-930d-5ce23972d194 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:22.009859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-e0c133d1-feb0-4a73-930d-5ce23972d194 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lazy-loading 'flavor' on Instance uuid acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:22.035612 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e0c133d1-feb0-4a73-930d-5ce23972d194 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags" status: 204 len: 0 microversion: 2.26 time: 0.149468 Jul 20 04:29:22.036968 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2057/4201] 10.222.0.20 () {60 vars in 1294 bytes} [Wed Jul 20 04:29:21 2022] DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54/tags => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:29:22.046392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cdedd9e1-4140-48a0-948b-176241986545 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:22.046904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cdedd9e1-4140-48a0-948b-176241986545 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:22.054577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdedd9e1-4140-48a0-948b-176241986545 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:22.055152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdedd9e1-4140-48a0-948b-176241986545 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:22.056004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdedd9e1-4140-48a0-948b-176241986545 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:22.056461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdedd9e1-4140-48a0-948b-176241986545 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:22.120255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cdedd9e1-4140-48a0-948b-176241986545 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:29:22.263409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5aa2051e-8ce2-436c-b346-e8be8f2e41a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:22.289448 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5aa2051e-8ce2-436c-b346-e8be8f2e41a5 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.363252 Jul 20 04:29:22.292537 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2145/4202] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:21 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:22.326452 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cdedd9e1-4140-48a0-948b-176241986545 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 204 len: 0 microversion: 2.26 time: 0.283619 Jul 20 04:29:22.327431 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2058/4203] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:29:22 2022] DELETE /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:29:22.337340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2383f3de-7a80-4b17-bfe4-1f39771cb400 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:22.338316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2383f3de-7a80-4b17-bfe4-1f39771cb400 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:22.348386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2383f3de-7a80-4b17-bfe4-1f39771cb400 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:22.348989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2383f3de-7a80-4b17-bfe4-1f39771cb400 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:22.349852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2383f3de-7a80-4b17-bfe4-1f39771cb400 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:22.350453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2383f3de-7a80-4b17-bfe4-1f39771cb400 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:22.516951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e6d9be97-015f-4e47-99fa-3d22e53d02be req-159ab421-42c1-4b06-b3bb-da71dc6d2dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48", "name": "network-vif-deleted", "tag": "315ccd0d-89cb-41bb-9a01-ae929f013595"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:22.560637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e6d9be97-015f-4e47-99fa-3d22e53d02be req-159ab421-42c1-4b06-b3bb-da71dc6d2dbe service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:22.561346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e6d9be97-015f-4e47-99fa-3d22e53d02be req-159ab421-42c1-4b06-b3bb-da71dc6d2dbe service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:22.575100 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e6d9be97-015f-4e47-99fa-3d22e53d02be req-159ab421-42c1-4b06-b3bb-da71dc6d2dbe service nova] Creating event network-vif-deleted:315ccd0d-89cb-41bb-9a01-ae929f013595 for instance c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 on n-h2-764485-11 Jul 20 04:29:22.583133 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e6d9be97-015f-4e47-99fa-3d22e53d02be req-159ab421-42c1-4b06-b3bb-da71dc6d2dbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072756 Jul 20 04:29:22.584317 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2059/4204] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:29:22.592114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dc86e6a2-bb06-469b-b2f9-880bf53beee1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:22.593446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dc86e6a2-bb06-469b-b2f9-880bf53beee1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:22.603718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc86e6a2-bb06-469b-b2f9-880bf53beee1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:22.604554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc86e6a2-bb06-469b-b2f9-880bf53beee1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:22.612062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc86e6a2-bb06-469b-b2f9-880bf53beee1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:22.613069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc86e6a2-bb06-469b-b2f9-880bf53beee1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:22.635923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2383f3de-7a80-4b17-bfe4-1f39771cb400 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:22.647418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2383f3de-7a80-4b17-bfe4-1f39771cb400 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:22.649631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2383f3de-7a80-4b17-bfe4-1f39771cb400 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:22.651298 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2383f3de-7a80-4b17-bfe4-1f39771cb400 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1549 microversion: 2.26 time: 0.319696 Jul 20 04:29:22.652607 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2146/4205] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:22 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1549 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:22.769670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dc86e6a2-bb06-469b-b2f9-880bf53beee1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbf1033ee8b84c3a89c31b2f44479f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582deaa5e004a74896f52dcd144ad78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:22.781963 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dc86e6a2-bb06-469b-b2f9-880bf53beee1 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 200 len: 1303 microversion: 2.1 time: 0.195872 Jul 20 04:29:22.783115 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2060/4206] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:22 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 1303 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:22.816119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bb66c8cf-e178-40c0-963f-e30268d43a24 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:22.816741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bb66c8cf-e178-40c0-963f-e30268d43a24 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:22.824252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb66c8cf-e178-40c0-963f-e30268d43a24 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:22.824712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb66c8cf-e178-40c0-963f-e30268d43a24 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:22.826263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb66c8cf-e178-40c0-963f-e30268d43a24 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:22.826720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb66c8cf-e178-40c0-963f-e30268d43a24 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.169305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bb66c8cf-e178-40c0-963f-e30268d43a24 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:23.182174 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bb66c8cf-e178-40c0-963f-e30268d43a24 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1489 microversion: 2.1 time: 0.369796 Jul 20 04:29:23.194870 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2147/4207] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:22 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1489 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:23.207688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9946e75-a79b-48aa-aab5-183d95d9eefc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:23.213556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b9946e75-a79b-48aa-aab5-183d95d9eefc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:23.235990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9946e75-a79b-48aa-aab5-183d95d9eefc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:23.235990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9946e75-a79b-48aa-aab5-183d95d9eefc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.235990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9946e75-a79b-48aa-aab5-183d95d9eefc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:23.242800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9946e75-a79b-48aa-aab5-183d95d9eefc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.309394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-34ddf17c-8558-4ffe-9fd0-8558403b94da tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:23.310048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-34ddf17c-8558-4ffe-9fd0-8558403b94da tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:23.317447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34ddf17c-8558-4ffe-9fd0-8558403b94da tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:23.318231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34ddf17c-8558-4ffe-9fd0-8558403b94da tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.319162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34ddf17c-8558-4ffe-9fd0-8558403b94da tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:23.319864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34ddf17c-8558-4ffe-9fd0-8558403b94da tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.321233 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b9946e75-a79b-48aa-aab5-183d95d9eefc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 200 len: 117 microversion: 2.1 time: 0.124695 Jul 20 04:29:23.327627 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2061/4208] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:29:23 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 117 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:29:23.333235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7266669-8aac-4bd1-9cb9-1c66db04a80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:23.334544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c7266669-8aac-4bd1-9cb9-1c66db04a80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:23.343917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7266669-8aac-4bd1-9cb9-1c66db04a80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:23.345059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7266669-8aac-4bd1-9cb9-1c66db04a80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.345964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7266669-8aac-4bd1-9cb9-1c66db04a80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:23.346743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7266669-8aac-4bd1-9cb9-1c66db04a80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.668628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-34ddf17c-8558-4ffe-9fd0-8558403b94da tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:23.677919 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-34ddf17c-8558-4ffe-9fd0-8558403b94da tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.375714 Jul 20 04:29:23.680431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c7266669-8aac-4bd1-9cb9-1c66db04a80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:23.680707 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2148/4209] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:23 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:23.683586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:23.688202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e7fff5f4-1819-4ab2-bc6f-fe24e3ed5a92 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:23.689234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e7fff5f4-1819-4ab2-bc6f-fe24e3ed5a92 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:23.696589 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c7266669-8aac-4bd1-9cb9-1c66db04a80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.367442 Jul 20 04:29:23.697210 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2062/4210] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:23 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:23.698260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7fff5f4-1819-4ab2-bc6f-fe24e3ed5a92 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:23.700509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7fff5f4-1819-4ab2-bc6f-fe24e3ed5a92 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.701346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7fff5f4-1819-4ab2-bc6f-fe24e3ed5a92 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:23.703593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7fff5f4-1819-4ab2-bc6f-fe24e3ed5a92 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.723735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9d69ada5-c90a-408c-9443-ae6f69ea8d5a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:23.724374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9d69ada5-c90a-408c-9443-ae6f69ea8d5a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:23.749714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d69ada5-c90a-408c-9443-ae6f69ea8d5a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:23.750185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d69ada5-c90a-408c-9443-ae6f69ea8d5a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.751088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d69ada5-c90a-408c-9443-ae6f69ea8d5a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:23.751606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d69ada5-c90a-408c-9443-ae6f69ea8d5a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.152691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9d69ada5-c90a-408c-9443-ae6f69ea8d5a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:24.176768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e7fff5f4-1819-4ab2-bc6f-fe24e3ed5a92 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:24.185316 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9d69ada5-c90a-408c-9443-ae6f69ea8d5a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.465647 Jul 20 04:29:24.187220 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2063/4211] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:23 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:24.200633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e7fff5f4-1819-4ab2-bc6f-fe24e3ed5a92 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:24.200633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e7fff5f4-1819-4ab2-bc6f-fe24e3ed5a92 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:24.207795 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e7fff5f4-1819-4ab2-bc6f-fe24e3ed5a92 tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1549 microversion: 2.26 time: 0.525317 Jul 20 04:29:24.211951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8aad6309-d214-46cf-8981-7aba9cb6e17d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:24.213498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8aad6309-d214-46cf-8981-7aba9cb6e17d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:24.221056 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2149/4212] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:23 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1549 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:24.225039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8aad6309-d214-46cf-8981-7aba9cb6e17d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.227096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8aad6309-d214-46cf-8981-7aba9cb6e17d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.229881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8aad6309-d214-46cf-8981-7aba9cb6e17d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.230527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8aad6309-d214-46cf-8981-7aba9cb6e17d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.235685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-36797609-3fe6-4b4e-aaa4-9b923016d843 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:24.236322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-36797609-3fe6-4b4e-aaa4-9b923016d843 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:24.239978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:24.249216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36797609-3fe6-4b4e-aaa4-9b923016d843 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.249683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36797609-3fe6-4b4e-aaa4-9b923016d843 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.250474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36797609-3fe6-4b4e-aaa4-9b923016d843 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.250903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36797609-3fe6-4b4e-aaa4-9b923016d843 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.269479 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-8aad6309-d214-46cf-8981-7aba9cb6e17d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] HTTP exception thrown: Instance c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 could not be found. Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8aad6309-d214-46cf-8981-7aba9cb6e17d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Request method failure captured: Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 HTTP/1.1 Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14P0vSuYaRy59X5F7XWm7-RDvDQa2pw52sE2M0_P36zz3zHyG-Qx0MSvMCojvfrovB64xOknfukSlDgF8yjknk2cTpaZOKSU_rC_BcUqcoKRbwiWUXVKORHQBb13h7Z1BcivyhEd3yfkbeb9Mqdnwuqux-IVdVFy3BQJVPw_mpgYEtQ Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d582deaa5e004a74896f52dcd144ad78 Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d582deaa5e004a74896f52dcd144ad78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d582deaa5e004a74896f52dcd144ad78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d582deaa5e004a74896f52dcd144ad78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d582deaa5e004a74896f52dcd144ad78"}]}] Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d582deaa5e004a74896f52dcd144ad78 Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerDiskConfigTestJSON-720778619-project Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: fbf1033ee8b84c3a89c31b2f44479f8b Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerDiskConfigTestJSON-720778619-project Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 could not be found. Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48'} Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 could not be found. Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 could not be found. Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:24.271721 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.276185 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.276185 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:24.276185 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:24.276185 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:24.276185 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:24.276185 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 could not be found. Jul 20 04:29:24.276185 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.278919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8aad6309-d214-46cf-8981-7aba9cb6e17d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Returning 404 to user: Instance c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:24.282628 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8aad6309-d214-46cf-8981-7aba9cb6e17d tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48" status: 404 len: 111 microversion: 2.1 time: 0.075310 Jul 20 04:29:24.283546 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2064/4213] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:24 2022] GET /compute/v2.1/servers/c199d2ad-b9ce-4859-b7f6-c7ca2ee5da48 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:24.306420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cc92b85f-b2bc-40df-8176-d277eb25d3d6 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:24.307009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cc92b85f-b2bc-40df-8176-d277eb25d3d6 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:24.321253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc92b85f-b2bc-40df-8176-d277eb25d3d6 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.322929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc92b85f-b2bc-40df-8176-d277eb25d3d6 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.324755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc92b85f-b2bc-40df-8176-d277eb25d3d6 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.325753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc92b85f-b2bc-40df-8176-d277eb25d3d6 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.343994 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-cc92b85f-b2bc-40df-8176-d277eb25d3d6 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] HTTP exception thrown: Instance 36d9ab53-f449-4a04-b486-8b0779bb779d could not be found. Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cc92b85f-b2bc-40df-8176-d277eb25d3d6 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Request method failure captured: Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d HTTP/1.1 Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14P0vSuYaRy59X5F7XWm7-RDvDQa2pw52sE2M0_P36zz3zHyG-Qx0MSvMCojvfrovB64xOknfukSlDgF8yjknk2cTpaZOKSU_rC_BcUqcoKRbwiWUXVKORHQBb13h7Z1BcivyhEd3yfkbeb9Mqdnwuqux-IVdVFy3BQJVPw_mpgYEtQ Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d582deaa5e004a74896f52dcd144ad78 Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d582deaa5e004a74896f52dcd144ad78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d582deaa5e004a74896f52dcd144ad78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d582deaa5e004a74896f52dcd144ad78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d582deaa5e004a74896f52dcd144ad78"}]}] Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d582deaa5e004a74896f52dcd144ad78 Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerDiskConfigTestJSON-720778619-project Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: fbf1033ee8b84c3a89c31b2f44479f8b Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerDiskConfigTestJSON-720778619-project Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 36d9ab53-f449-4a04-b486-8b0779bb779d could not be found. Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '36d9ab53-f449-4a04-b486-8b0779bb779d'} Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d9ab53-f449-4a04-b486-8b0779bb779d could not be found. Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:24.345711 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d9ab53-f449-4a04-b486-8b0779bb779d could not be found. Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d9ab53-f449-4a04-b486-8b0779bb779d could not be found. Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cc92b85f-b2bc-40df-8176-d277eb25d3d6 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Returning 404 to user: Instance 36d9ab53-f449-4a04-b486-8b0779bb779d could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cc92b85f-b2bc-40df-8176-d277eb25d3d6 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "DELETE /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 404 len: 111 microversion: 2.1 time: 0.058800 Jul 20 04:29:24.349218 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2065/4214] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:24 2022] DELETE /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:24.361290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cc64cc3b-f725-4e16-9bf8-28ef43febd12 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:24.362137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cc64cc3b-f725-4e16-9bf8-28ef43febd12 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 36d9ab53-f449-4a04-b486-8b0779bb779d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:24.371233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc64cc3b-f725-4e16-9bf8-28ef43febd12 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.372071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc64cc3b-f725-4e16-9bf8-28ef43febd12 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.373051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc64cc3b-f725-4e16-9bf8-28ef43febd12 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.373773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc64cc3b-f725-4e16-9bf8-28ef43febd12 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.394803 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-cc64cc3b-f725-4e16-9bf8-28ef43febd12 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] HTTP exception thrown: Instance 36d9ab53-f449-4a04-b486-8b0779bb779d could not be found. Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cc64cc3b-f725-4e16-9bf8-28ef43febd12 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Request method failure captured: Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d HTTP/1.1 Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14P0vSuYaRy59X5F7XWm7-RDvDQa2pw52sE2M0_P36zz3zHyG-Qx0MSvMCojvfrovB64xOknfukSlDgF8yjknk2cTpaZOKSU_rC_BcUqcoKRbwiWUXVKORHQBb13h7Z1BcivyhEd3yfkbeb9Mqdnwuqux-IVdVFy3BQJVPw_mpgYEtQ Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d582deaa5e004a74896f52dcd144ad78 Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d582deaa5e004a74896f52dcd144ad78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d582deaa5e004a74896f52dcd144ad78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d582deaa5e004a74896f52dcd144ad78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d582deaa5e004a74896f52dcd144ad78"}]}] Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d582deaa5e004a74896f52dcd144ad78 Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerDiskConfigTestJSON-720778619-project Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: fbf1033ee8b84c3a89c31b2f44479f8b Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerDiskConfigTestJSON-720778619-project Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 36d9ab53-f449-4a04-b486-8b0779bb779d could not be found. Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '36d9ab53-f449-4a04-b486-8b0779bb779d'} Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d9ab53-f449-4a04-b486-8b0779bb779d could not be found. Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d9ab53-f449-4a04-b486-8b0779bb779d could not be found. Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:24.396568 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.400229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.400229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:24.400229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:24.400229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:24.400229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:24.400229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d9ab53-f449-4a04-b486-8b0779bb779d could not be found. Jul 20 04:29:24.400229 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.400229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cc64cc3b-f725-4e16-9bf8-28ef43febd12 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Returning 404 to user: Instance 36d9ab53-f449-4a04-b486-8b0779bb779d could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:24.400229 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cc64cc3b-f725-4e16-9bf8-28ef43febd12 tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d" status: 404 len: 111 microversion: 2.1 time: 0.041477 Jul 20 04:29:24.400229 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2066/4215] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:24 2022] GET /compute/v2.1/servers/36d9ab53-f449-4a04-b486-8b0779bb779d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:24.407351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6caf9e7d-5ba2-4a1b-8da5-351df37df01f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:24.408619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6caf9e7d-5ba2-4a1b-8da5-351df37df01f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:24.416034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6caf9e7d-5ba2-4a1b-8da5-351df37df01f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.416624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6caf9e7d-5ba2-4a1b-8da5-351df37df01f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.418041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6caf9e7d-5ba2-4a1b-8da5-351df37df01f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.418643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6caf9e7d-5ba2-4a1b-8da5-351df37df01f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.447527 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-6caf9e7d-5ba2-4a1b-8da5-351df37df01f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] HTTP exception thrown: Instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c could not be found. Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6caf9e7d-5ba2-4a1b-8da5-351df37df01f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Request method failure captured: Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c HTTP/1.1 Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14P0vSuYaRy59X5F7XWm7-RDvDQa2pw52sE2M0_P36zz3zHyG-Qx0MSvMCojvfrovB64xOknfukSlDgF8yjknk2cTpaZOKSU_rC_BcUqcoKRbwiWUXVKORHQBb13h7Z1BcivyhEd3yfkbeb9Mqdnwuqux-IVdVFy3BQJVPw_mpgYEtQ Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d582deaa5e004a74896f52dcd144ad78 Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d582deaa5e004a74896f52dcd144ad78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d582deaa5e004a74896f52dcd144ad78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d582deaa5e004a74896f52dcd144ad78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d582deaa5e004a74896f52dcd144ad78"}]}] Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d582deaa5e004a74896f52dcd144ad78 Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerDiskConfigTestJSON-720778619-project Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: fbf1033ee8b84c3a89c31b2f44479f8b Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerDiskConfigTestJSON-720778619-project Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c could not be found. Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '956eebcb-bc8b-45dd-91ea-3a07ce83a20c'} Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c could not be found. Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:24.449214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c could not be found. Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c could not be found. Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6caf9e7d-5ba2-4a1b-8da5-351df37df01f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Returning 404 to user: Instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6caf9e7d-5ba2-4a1b-8da5-351df37df01f tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "DELETE /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 404 len: 111 microversion: 2.1 time: 0.047262 Jul 20 04:29:24.453358 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2067/4216] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:24 2022] DELETE /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:29:24.459832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f8739137-c129-4a13-a144-ceca1480cd9e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:24.460568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f8739137-c129-4a13-a144-ceca1480cd9e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] [instance: 956eebcb-bc8b-45dd-91ea-3a07ce83a20c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:24.467429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8739137-c129-4a13-a144-ceca1480cd9e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.468200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8739137-c129-4a13-a144-ceca1480cd9e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.469135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8739137-c129-4a13-a144-ceca1480cd9e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.469859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8739137-c129-4a13-a144-ceca1480cd9e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.493883 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f8739137-c129-4a13-a144-ceca1480cd9e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] HTTP exception thrown: Instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c could not be found. Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f8739137-c129-4a13-a144-ceca1480cd9e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Request method failure captured: Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c HTTP/1.1 Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14P0vSuYaRy59X5F7XWm7-RDvDQa2pw52sE2M0_P36zz3zHyG-Qx0MSvMCojvfrovB64xOknfukSlDgF8yjknk2cTpaZOKSU_rC_BcUqcoKRbwiWUXVKORHQBb13h7Z1BcivyhEd3yfkbeb9Mqdnwuqux-IVdVFy3BQJVPw_mpgYEtQ Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d582deaa5e004a74896f52dcd144ad78 Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d582deaa5e004a74896f52dcd144ad78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d582deaa5e004a74896f52dcd144ad78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d582deaa5e004a74896f52dcd144ad78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d582deaa5e004a74896f52dcd144ad78"}]}] Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d582deaa5e004a74896f52dcd144ad78 Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-720778619 Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerDiskConfigTestJSON-720778619-project Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: fbf1033ee8b84c3a89c31b2f44479f8b Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerDiskConfigTestJSON-720778619-project Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c could not be found. Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '956eebcb-bc8b-45dd-91ea-3a07ce83a20c'} Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c could not be found. Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c could not be found. Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:24.497277 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.504420 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:24.504420 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:24.504420 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:24.504420 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:24.504420 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:24.504420 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c could not be found. Jul 20 04:29:24.504420 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:24.504420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f8739137-c129-4a13-a144-ceca1480cd9e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] Returning 404 to user: Instance 956eebcb-bc8b-45dd-91ea-3a07ce83a20c could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:24.504420 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f8739137-c129-4a13-a144-ceca1480cd9e tempest-ServerDiskConfigTestJSON-720778619 tempest-ServerDiskConfigTestJSON-720778619-project] 10.222.0.20 "GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c" status: 404 len: 111 microversion: 2.1 time: 0.043338 Jul 20 04:29:24.504420 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2068/4217] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:24 2022] GET /compute/v2.1/servers/956eebcb-bc8b-45dd-91ea-3a07ce83a20c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:29:24.574310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-36797609-3fe6-4b4e-aaa4-9b923016d843 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:24.589188 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-36797609-3fe6-4b4e-aaa4-9b923016d843 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.366927 Jul 20 04:29:24.589831 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2150/4218] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:24 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:24.608298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5f017dba-33ec-46cb-94ad-84d76163e05b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:24.608914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5f017dba-33ec-46cb-94ad-84d76163e05b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:24.629164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f017dba-33ec-46cb-94ad-84d76163e05b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.629626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f017dba-33ec-46cb-94ad-84d76163e05b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.645164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f017dba-33ec-46cb-94ad-84d76163e05b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.645937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f017dba-33ec-46cb-94ad-84d76163e05b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.701779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c178a415-c6c6-4fc7-bb84-70b811b15171 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:24.703088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c178a415-c6c6-4fc7-bb84-70b811b15171 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:24.715384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c178a415-c6c6-4fc7-bb84-70b811b15171 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.717655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c178a415-c6c6-4fc7-bb84-70b811b15171 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.720532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c178a415-c6c6-4fc7-bb84-70b811b15171 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.720993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c178a415-c6c6-4fc7-bb84-70b811b15171 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:25.418357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5f017dba-33ec-46cb-94ad-84d76163e05b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:25.430792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c178a415-c6c6-4fc7-bb84-70b811b15171 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:25.434181 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5f017dba-33ec-46cb-94ad-84d76163e05b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.830112 Jul 20 04:29:25.435765 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2069/4219] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:24 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:25.441866 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c178a415-c6c6-4fc7-bb84-70b811b15171 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.748672 Jul 20 04:29:25.443872 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2151/4220] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:24 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:25.447079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-230f2e7c-c4e4-4b2d-8aed-2c9577f7dd4f tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:25.447882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-230f2e7c-c4e4-4b2d-8aed-2c9577f7dd4f tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:25.461964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-230f2e7c-c4e4-4b2d-8aed-2c9577f7dd4f tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:25.462427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-230f2e7c-c4e4-4b2d-8aed-2c9577f7dd4f tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:25.463252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-230f2e7c-c4e4-4b2d-8aed-2c9577f7dd4f tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:25.463904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-230f2e7c-c4e4-4b2d-8aed-2c9577f7dd4f tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:25.635326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-418763898", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "1a7e8d9c-f123-4816-a77b-51f1b199a341"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:25.738237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] validate_networks() for [('1a7e8d9c-f123-4816-a77b-51f1b199a341', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:29:25.902897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-230f2e7c-c4e4-4b2d-8aed-2c9577f7dd4f tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:25.920762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-230f2e7c-c4e4-4b2d-8aed-2c9577f7dd4f tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:25.925294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-230f2e7c-c4e4-4b2d-8aed-2c9577f7dd4f tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a785c6a928b434987940ca5d3e8637f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497770f5a4194c549e20ba97678db788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:25.927400 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-230f2e7c-c4e4-4b2d-8aed-2c9577f7dd4f tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 200 len: 1549 microversion: 2.26 time: 0.489478 Jul 20 04:29:25.928526 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2070/4221] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:25 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 1549 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:25.936809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-5ee43680-027d-4b26-9b6f-4bf31761ae90 req-68623cb0-a44e-4480-be2a-52478e137226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc05c1d-a97f-4a93-bc62-0aa1a7c47c54", "name": "network-vif-deleted", "tag": "975648a9-1347-4ce4-8604-d1a3fa54879f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:25.973928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5ee43680-027d-4b26-9b6f-4bf31761ae90 req-68623cb0-a44e-4480-be2a-52478e137226 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:25.974403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5ee43680-027d-4b26-9b6f-4bf31761ae90 req-68623cb0-a44e-4480-be2a-52478e137226 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.011368 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-5ee43680-027d-4b26-9b6f-4bf31761ae90 req-68623cb0-a44e-4480-be2a-52478e137226 service nova] Creating event network-vif-deleted:975648a9-1347-4ce4-8604-d1a3fa54879f for instance acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 on n-h1-764485-11 Jul 20 04:29:26.027423 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-5ee43680-027d-4b26-9b6f-4bf31761ae90 req-68623cb0-a44e-4480-be2a-52478e137226 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095665 Jul 20 04:29:26.029555 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2071/4222] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:26.462294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ce3013e0-59c4-4efc-bb16-becd9a9796a4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:26.463889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ce3013e0-59c4-4efc-bb16-becd9a9796a4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:26.472685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce3013e0-59c4-4efc-bb16-becd9a9796a4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:26.473474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce3013e0-59c4-4efc-bb16-becd9a9796a4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.474835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce3013e0-59c4-4efc-bb16-becd9a9796a4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:26.475817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce3013e0-59c4-4efc-bb16-becd9a9796a4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.593904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:29:26.595445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:29:26.596121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:29:26.596561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:29:26.596974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:29:26.608560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:26.609258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.610060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:26.610501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.636422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Getting quotas for project 1be9144d8b214ecb8e416318d92b92ea. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:26.642423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Getting quotas for user b559a8f5a1724682831d18c3f7ddfdf2 and project 1be9144d8b214ecb8e416318d92b92ea. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:26.656862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:29:26.660105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:26.707587 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-86696b50-97bf-4c9e-8d60-df494622e64b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082728 Jul 20 04:29:26.708629 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2152/4223] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:29:26.732718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8f45db5c-1e7f-47bd-93bc-a861369289d4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:26.733553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8f45db5c-1e7f-47bd-93bc-a861369289d4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:26.750016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ce3013e0-59c4-4efc-bb16-becd9a9796a4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:26.766207 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ce3013e0-59c4-4efc-bb16-becd9a9796a4 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.307513 Jul 20 04:29:26.770239 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2072/4224] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:26 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:26.834648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8f45db5c-1e7f-47bd-93bc-a861369289d4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:26.849677 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8f45db5c-1e7f-47bd-93bc-a861369289d4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1214 microversion: 2.1 time: 0.121507 Jul 20 04:29:26.860691 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2153/4225] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:26 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:26.949882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d3c157b5-201c-4b6a-ad86-c0857d86dd3e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:26.950966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d3c157b5-201c-4b6a-ad86-c0857d86dd3e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] [instance: acc05c1d-a97f-4a93-bc62-0aa1a7c47c54] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:26.965130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d3c157b5-201c-4b6a-ad86-c0857d86dd3e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:26.966355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d3c157b5-201c-4b6a-ad86-c0857d86dd3e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.968298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d3c157b5-201c-4b6a-ad86-c0857d86dd3e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:26.970184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d3c157b5-201c-4b6a-ad86-c0857d86dd3e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:27.005268 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-d3c157b5-201c-4b6a-ad86-c0857d86dd3e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] HTTP exception thrown: Instance acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 could not be found. Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d3c157b5-201c-4b6a-ad86-c0857d86dd3e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Request method failure captured: Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 HTTP/1.1 Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14SIvua0FoTok82pxlVPTwoZWKxmT6c1m-4ESovLMfQx3LNwdb2zG3ooKEqvDwVF58j4mKDGya_TBbPXcZ3rkjvuaSxCNS4yNQeu3XpAO7N4GPjEHo_8oyQTJXFpbIWTT8RhHEcjTGKdiWiQTZhSe7OGQQVWUD4VL55hg2QhNRbqmrY Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.26 Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 497770f5a4194c549e20ba97678db788 Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerTagsTestJSON-630101062 Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/497770f5a4194c549e20ba97678db788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/497770f5a4194c549e20ba97678db788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_497770f5a4194c549e20ba97678db788", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/497770f5a4194c549e20ba97678db788"}]}] Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerTagsTestJSON-630101062 Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 497770f5a4194c549e20ba97678db788 Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerTagsTestJSON-630101062 Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerTagsTestJSON-630101062-project Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1a785c6a928b434987940ca5d3e8637f Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerTagsTestJSON-630101062-project Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 could not be found. Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'acc05c1d-a97f-4a93-bc62-0aa1a7c47c54'} Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 could not be found. Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 could not be found. Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:27.011690 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:27.015421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:27.015421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:27.015421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:27.015421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:27.015421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:27.015421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 could not be found. Jul 20 04:29:27.015421 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:29:27.015421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d3c157b5-201c-4b6a-ad86-c0857d86dd3e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] Returning 404 to user: Instance acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:27.015421 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d3c157b5-201c-4b6a-ad86-c0857d86dd3e tempest-ServerTagsTestJSON-630101062 tempest-ServerTagsTestJSON-630101062-project] 10.222.0.20 "GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54" status: 404 len: 111 microversion: 2.26 time: 0.070764 Jul 20 04:29:27.018193 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2073/4226] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:26 2022] GET /compute/v2.1/servers/acc05c1d-a97f-4a93-bc62-0aa1a7c47c54 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:29:27.787308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f17297b-d05b-4b9e-a26c-de107c6c8a8d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:27.788872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1f17297b-d05b-4b9e-a26c-de107c6c8a8d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:27.799781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f17297b-d05b-4b9e-a26c-de107c6c8a8d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:27.805361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f17297b-d05b-4b9e-a26c-de107c6c8a8d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:27.806565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f17297b-d05b-4b9e-a26c-de107c6c8a8d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:27.808898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f17297b-d05b-4b9e-a26c-de107c6c8a8d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:27.877034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-51eba2cd-b135-4980-b7c9-02e5669b878a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:27.878295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-51eba2cd-b135-4980-b7c9-02e5669b878a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:27.892193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51eba2cd-b135-4980-b7c9-02e5669b878a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:27.893822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51eba2cd-b135-4980-b7c9-02e5669b878a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:27.896782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51eba2cd-b135-4980-b7c9-02e5669b878a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:27.898035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51eba2cd-b135-4980-b7c9-02e5669b878a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:28.081796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-51eba2cd-b135-4980-b7c9-02e5669b878a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:28.095452 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-51eba2cd-b135-4980-b7c9-02e5669b878a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1210 microversion: 2.1 time: 0.222182 Jul 20 04:29:28.101462 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2074/4227] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:27 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1210 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:28.284792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1f17297b-d05b-4b9e-a26c-de107c6c8a8d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:28.301705 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f17297b-d05b-4b9e-a26c-de107c6c8a8d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.518267 Jul 20 04:29:28.302520 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2154/4228] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:27 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:29.119307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3224ab02-6f15-45da-a197-315a4515a11a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:29.120551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3224ab02-6f15-45da-a197-315a4515a11a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:29.146146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3224ab02-6f15-45da-a197-315a4515a11a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:29.146613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3224ab02-6f15-45da-a197-315a4515a11a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:29.154756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3224ab02-6f15-45da-a197-315a4515a11a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:29.155412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3224ab02-6f15-45da-a197-315a4515a11a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:29.319026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15a2a830-d719-4927-ae2a-c91441f2f1d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:29.320543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-15a2a830-d719-4927-ae2a-c91441f2f1d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:29.336837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15a2a830-d719-4927-ae2a-c91441f2f1d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:29.337519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15a2a830-d719-4927-ae2a-c91441f2f1d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:29.338497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15a2a830-d719-4927-ae2a-c91441f2f1d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:29.339308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15a2a830-d719-4927-ae2a-c91441f2f1d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:29.344467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:29.950811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3224ab02-6f15-45da-a197-315a4515a11a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:29.961146 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3224ab02-6f15-45da-a197-315a4515a11a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1272 microversion: 2.1 time: 0.846785 Jul 20 04:29:29.962292 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2075/4229] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:29 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1272 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:30.366768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-15a2a830-d719-4927-ae2a-c91441f2f1d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:30.379384 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-15a2a830-d719-4927-ae2a-c91441f2f1d0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 1.064218 Jul 20 04:29:30.380650 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2155/4230] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:29 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:30.978902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ec57ac6-9ccf-404e-9ca2-90366c4d0220 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:30.980358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ec57ac6-9ccf-404e-9ca2-90366c4d0220 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:30.996021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ec57ac6-9ccf-404e-9ca2-90366c4d0220 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:30.997472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ec57ac6-9ccf-404e-9ca2-90366c4d0220 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:30.998565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ec57ac6-9ccf-404e-9ca2-90366c4d0220 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:30.999595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ec57ac6-9ccf-404e-9ca2-90366c4d0220 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:31.397660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8719fff5-7166-4549-8cea-bbbc19241572 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:31.398554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8719fff5-7166-4549-8cea-bbbc19241572 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:31.406513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8719fff5-7166-4549-8cea-bbbc19241572 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:31.407298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8719fff5-7166-4549-8cea-bbbc19241572 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:31.408361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8719fff5-7166-4549-8cea-bbbc19241572 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:31.409052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8719fff5-7166-4549-8cea-bbbc19241572 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:31.746726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1ec57ac6-9ccf-404e-9ca2-90366c4d0220 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:31.791940 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ec57ac6-9ccf-404e-9ca2-90366c4d0220 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1314 microversion: 2.1 time: 0.817078 Jul 20 04:29:31.792890 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2076/4231] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:30 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:31.873566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8719fff5-7166-4549-8cea-bbbc19241572 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:31.886200 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8719fff5-7166-4549-8cea-bbbc19241572 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.492692 Jul 20 04:29:31.896300 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2156/4232] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:31 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:31.989922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-511993f0-897a-4e03-b0db-60e68d0db55b tempest-PortsAdminExtendedAttrsTestJSON-1120845163 tempest-PortsAdminExtendedAttrsTestJSON-1120845163-project-admin] Calling method '.version_select at 0x7fbf9d5919d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:31.990929 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:29:31.990929 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:29:31.998177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-511993f0-897a-4e03-b0db-60e68d0db55b tempest-PortsAdminExtendedAttrsTestJSON-1120845163 tempest-PortsAdminExtendedAttrsTestJSON-1120845163-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:31.998177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-511993f0-897a-4e03-b0db-60e68d0db55b tempest-PortsAdminExtendedAttrsTestJSON-1120845163 tempest-PortsAdminExtendedAttrsTestJSON-1120845163-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:32.025287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-511993f0-897a-4e03-b0db-60e68d0db55b tempest-PortsAdminExtendedAttrsTestJSON-1120845163 tempest-PortsAdminExtendedAttrsTestJSON-1120845163-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:32.026024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-511993f0-897a-4e03-b0db-60e68d0db55b tempest-PortsAdminExtendedAttrsTestJSON-1120845163 tempest-PortsAdminExtendedAttrsTestJSON-1120845163-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:32.040844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-511993f0-897a-4e03-b0db-60e68d0db55b tempest-PortsAdminExtendedAttrsTestJSON-1120845163 tempest-PortsAdminExtendedAttrsTestJSON-1120845163-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:32.041410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-511993f0-897a-4e03-b0db-60e68d0db55b tempest-PortsAdminExtendedAttrsTestJSON-1120845163 tempest-PortsAdminExtendedAttrsTestJSON-1120845163-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:32.056399 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-511993f0-897a-4e03-b0db-60e68d0db55b tempest-PortsAdminExtendedAttrsTestJSON-1120845163 tempest-PortsAdminExtendedAttrsTestJSON-1120845163-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.262381 Jul 20 04:29:32.057011 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2077/4233] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:29:31 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:32.783824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-df078a5b-0538-44f7-a8b2-c70fef5757f4 req-c312a866-3e21-40dd-bf68-574022a7e454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff0a57fe-dc37-41d4-b516-8f3589bc54bd", "tag": "bd187d04-ead6-4418-b4a8-75497697df42"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:32.797944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-df078a5b-0538-44f7-a8b2-c70fef5757f4 req-c312a866-3e21-40dd-bf68-574022a7e454 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:32.800189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-df078a5b-0538-44f7-a8b2-c70fef5757f4 req-c312a866-3e21-40dd-bf68-574022a7e454 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:32.809295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95f597de-de23-49f1-bd2f-a4f9e96c0db3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:32.809924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95f597de-de23-49f1-bd2f-a4f9e96c0db3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:32.822591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95f597de-de23-49f1-bd2f-a4f9e96c0db3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:32.826660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95f597de-de23-49f1-bd2f-a4f9e96c0db3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:32.827880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95f597de-de23-49f1-bd2f-a4f9e96c0db3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:32.828542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95f597de-de23-49f1-bd2f-a4f9e96c0db3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:32.839501 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-df078a5b-0538-44f7-a8b2-c70fef5757f4 req-c312a866-3e21-40dd-bf68-574022a7e454 service nova] Creating event network-changed:bd187d04-ead6-4418-b4a8-75497697df42 for instance ff0a57fe-dc37-41d4-b516-8f3589bc54bd on n-h1-764485-11 Jul 20 04:29:32.847978 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-df078a5b-0538-44f7-a8b2-c70fef5757f4 req-c312a866-3e21-40dd-bf68-574022a7e454 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067989 Jul 20 04:29:32.849342 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2157/4234] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:29:32.915883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9af6d812-a607-4127-92d4-0b229af1dac2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:32.917519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9af6d812-a607-4127-92d4-0b229af1dac2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:32.941770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9af6d812-a607-4127-92d4-0b229af1dac2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:32.942575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9af6d812-a607-4127-92d4-0b229af1dac2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:32.943883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9af6d812-a607-4127-92d4-0b229af1dac2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:32.948990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9af6d812-a607-4127-92d4-0b229af1dac2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:33.334607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9af6d812-a607-4127-92d4-0b229af1dac2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:33.368753 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9af6d812-a607-4127-92d4-0b229af1dac2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.459201 Jul 20 04:29:33.370708 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2158/4235] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:32 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:33.371250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95f597de-de23-49f1-bd2f-a4f9e96c0db3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:33.383197 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95f597de-de23-49f1-bd2f-a4f9e96c0db3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1314 microversion: 2.1 time: 0.576703 Jul 20 04:29:33.395310 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2078/4236] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:32 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:34.397164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e170d4a5-1fcc-4bba-baf5-fde2958dc8a7 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:34.401185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e00bb64e-d75c-4ce4-87a6-d2db3b7d49bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:34.402405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e00bb64e-d75c-4ce4-87a6-d2db3b7d49bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:34.402966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e170d4a5-1fcc-4bba-baf5-fde2958dc8a7 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:34.413727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e00bb64e-d75c-4ce4-87a6-d2db3b7d49bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:34.418034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e00bb64e-d75c-4ce4-87a6-d2db3b7d49bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:34.419145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e00bb64e-d75c-4ce4-87a6-d2db3b7d49bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:34.420043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e00bb64e-d75c-4ce4-87a6-d2db3b7d49bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:34.421172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e170d4a5-1fcc-4bba-baf5-fde2958dc8a7 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:34.421172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e170d4a5-1fcc-4bba-baf5-fde2958dc8a7 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:34.422072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e170d4a5-1fcc-4bba-baf5-fde2958dc8a7 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:34.424774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e170d4a5-1fcc-4bba-baf5-fde2958dc8a7 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:34.801622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e170d4a5-1fcc-4bba-baf5-fde2958dc8a7 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:34.821159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e00bb64e-d75c-4ce4-87a6-d2db3b7d49bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:34.832985 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e00bb64e-d75c-4ce4-87a6-d2db3b7d49bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1314 microversion: 2.1 time: 0.436340 Jul 20 04:29:34.834917 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e170d4a5-1fcc-4bba-baf5-fde2958dc8a7 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.450660 Jul 20 04:29:34.835836 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2079/4237] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:34 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:34.849012 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2159/4238] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:34 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:35.851676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-10a121f1-7087-4491-ab0d-7f26a0848269 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:35.852291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-10a121f1-7087-4491-ab0d-7f26a0848269 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:35.858230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7b063c9d-730f-41e1-864e-e239da1e3ca0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:35.859380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7b063c9d-730f-41e1-864e-e239da1e3ca0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:35.863132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10a121f1-7087-4491-ab0d-7f26a0848269 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:35.864128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10a121f1-7087-4491-ab0d-7f26a0848269 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:35.866138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10a121f1-7087-4491-ab0d-7f26a0848269 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:35.866629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10a121f1-7087-4491-ab0d-7f26a0848269 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:35.874728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b063c9d-730f-41e1-864e-e239da1e3ca0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:35.875221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b063c9d-730f-41e1-864e-e239da1e3ca0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:35.876010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b063c9d-730f-41e1-864e-e239da1e3ca0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:35.876459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b063c9d-730f-41e1-864e-e239da1e3ca0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:36.620004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:36.683015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-10a121f1-7087-4491-ab0d-7f26a0848269 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:36.697830 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-10a121f1-7087-4491-ab0d-7f26a0848269 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1314 microversion: 2.1 time: 0.850178 Jul 20 04:29:36.698650 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2080/4239] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:35 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1314 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:36.698906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7b063c9d-730f-41e1-864e-e239da1e3ca0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:36.718781 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7b063c9d-730f-41e1-864e-e239da1e3ca0 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.869553 Jul 20 04:29:36.724768 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2160/4240] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:35 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:37.715410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6b9a72e-0037-4319-a6cf-b5a97b3daf6d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:37.716069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e6b9a72e-0037-4319-a6cf-b5a97b3daf6d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:37.718965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:37.731572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6b9a72e-0037-4319-a6cf-b5a97b3daf6d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.731905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6b9a72e-0037-4319-a6cf-b5a97b3daf6d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.737002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6b9a72e-0037-4319-a6cf-b5a97b3daf6d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.742930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6b9a72e-0037-4319-a6cf-b5a97b3daf6d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.743206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-26d43ace-6bcf-4e23-93ed-aa3da97b88dd tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:37.743986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-26d43ace-6bcf-4e23-93ed-aa3da97b88dd tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:37.753488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:37.760748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26d43ace-6bcf-4e23-93ed-aa3da97b88dd tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.762670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26d43ace-6bcf-4e23-93ed-aa3da97b88dd tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.764904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26d43ace-6bcf-4e23-93ed-aa3da97b88dd tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.767229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26d43ace-6bcf-4e23-93ed-aa3da97b88dd tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:38.412691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-26d43ace-6bcf-4e23-93ed-aa3da97b88dd tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:38.421253 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-26d43ace-6bcf-4e23-93ed-aa3da97b88dd tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.684063 Jul 20 04:29:38.449390 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2161/4241] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:37 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:38.452499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e6b9a72e-0037-4319-a6cf-b5a97b3daf6d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:38.464373 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e6b9a72e-0037-4319-a6cf-b5a97b3daf6d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1314 microversion: 2.1 time: 0.753350 Jul 20 04:29:38.465385 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2081/4242] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:37 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:39.420673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-628463461", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "f5a15846-e41e-4cc9-8821-7b5f278d3ad8"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:39.470439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-505039c5-f678-41fc-b6f4-8d8b2e6d2515 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:39.472537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-505039c5-f678-41fc-b6f4-8d8b2e6d2515 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:39.501693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-505039c5-f678-41fc-b6f4-8d8b2e6d2515 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:39.504526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-505039c5-f678-41fc-b6f4-8d8b2e6d2515 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.510874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-505039c5-f678-41fc-b6f4-8d8b2e6d2515 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:39.514075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-505039c5-f678-41fc-b6f4-8d8b2e6d2515 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.531896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] validate_networks() for [('f5a15846-e41e-4cc9-8821-7b5f278d3ad8', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:29:40.137963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-505039c5-f678-41fc-b6f4-8d8b2e6d2515 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:40.146455 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-505039c5-f678-41fc-b6f4-8d8b2e6d2515 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.683096 Jul 20 04:29:40.147459 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2082/4243] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:39 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:40.162321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-782a0288-f630-4b36-a0a3-468d12f2dc5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:40.163821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-782a0288-f630-4b36-a0a3-468d12f2dc5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:40.170405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-782a0288-f630-4b36-a0a3-468d12f2dc5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:40.170861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-782a0288-f630-4b36-a0a3-468d12f2dc5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:40.171681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-782a0288-f630-4b36-a0a3-468d12f2dc5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:40.172120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-782a0288-f630-4b36-a0a3-468d12f2dc5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:40.956792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-782a0288-f630-4b36-a0a3-468d12f2dc5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:40.981176 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-782a0288-f630-4b36-a0a3-468d12f2dc5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1314 microversion: 2.1 time: 0.829154 Jul 20 04:29:40.982777 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2083/4244] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:40 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1314 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:40.996376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6bf0e639-6caf-44eb-82c8-d22ac45d42dc req-37789990-aac4-43cb-83f1-0015f2307f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff0a57fe-dc37-41d4-b516-8f3589bc54bd", "name": "network-vif-plugged", "status": "completed", "tag": "bd187d04-ead6-4418-b4a8-75497697df42"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:41.013224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6bf0e639-6caf-44eb-82c8-d22ac45d42dc req-37789990-aac4-43cb-83f1-0015f2307f60 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:41.015076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6bf0e639-6caf-44eb-82c8-d22ac45d42dc req-37789990-aac4-43cb-83f1-0015f2307f60 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:41.043564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:41.046168 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-6bf0e639-6caf-44eb-82c8-d22ac45d42dc req-37789990-aac4-43cb-83f1-0015f2307f60 service nova] Creating event network-vif-plugged:bd187d04-ead6-4418-b4a8-75497697df42 for instance ff0a57fe-dc37-41d4-b516-8f3589bc54bd on n-h1-764485-11 Jul 20 04:29:41.052670 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6bf0e639-6caf-44eb-82c8-d22ac45d42dc req-37789990-aac4-43cb-83f1-0015f2307f60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065012 Jul 20 04:29:41.054088 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2084/4245] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:41.167910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-032ccc42-9cd8-4104-9cbc-e65e089ac864 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:41.169060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-032ccc42-9cd8-4104-9cbc-e65e089ac864 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:41.178541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-032ccc42-9cd8-4104-9cbc-e65e089ac864 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:41.179821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-032ccc42-9cd8-4104-9cbc-e65e089ac864 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:41.180893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-032ccc42-9cd8-4104-9cbc-e65e089ac864 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:41.181623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-032ccc42-9cd8-4104-9cbc-e65e089ac864 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:41.567409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:29:41.568298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:29:41.568960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:29:41.569986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:29:41.570681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:29:41.590548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:41.591153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:41.592120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:41.592673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:41.623064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Getting quotas for project 21121109b75843408806778a28790f0f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:41.629452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Getting quotas for user fd1e95f3abd3472c8a1e5fdbb4f07914 and project 21121109b75843408806778a28790f0f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:41.645296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:29:41.649228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:41.735065 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-02ebb407-755d-4606-82c6-9bbf096be58a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514637 Jul 20 04:29:41.736076 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2162/4246] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:29:41.749245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-032ccc42-9cd8-4104-9cbc-e65e089ac864 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:41.751363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0e3e2893-66a6-4a85-9d34-7fc20cb6988f tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:41.753734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0e3e2893-66a6-4a85-9d34-7fc20cb6988f tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:41.781927 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-032ccc42-9cd8-4104-9cbc-e65e089ac864 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.618773 Jul 20 04:29:41.783201 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2085/4247] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:41 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:41.989354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0e3e2893-66a6-4a85-9d34-7fc20cb6988f tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:42.003089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bdc77d74-8b5e-4c98-a14b-f667c653af89 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:42.004934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bdc77d74-8b5e-4c98-a14b-f667c653af89 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:42.011541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bdc77d74-8b5e-4c98-a14b-f667c653af89 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:42.012337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bdc77d74-8b5e-4c98-a14b-f667c653af89 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:42.013276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bdc77d74-8b5e-4c98-a14b-f667c653af89 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:42.013865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bdc77d74-8b5e-4c98-a14b-f667c653af89 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:42.015457 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0e3e2893-66a6-4a85-9d34-7fc20cb6988f tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1224 microversion: 2.1 time: 0.269476 Jul 20 04:29:42.016594 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2163/4248] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:41 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1224 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:42.331592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bdc77d74-8b5e-4c98-a14b-f667c653af89 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:42.340219 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bdc77d74-8b5e-4c98-a14b-f667c653af89 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1314 microversion: 2.1 time: 0.343482 Jul 20 04:29:42.341993 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2086/4249] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:41 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:42.805030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-573aed5d-4bf5-4fce-98e9-56fd108b63eb tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:42.805805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-573aed5d-4bf5-4fce-98e9-56fd108b63eb tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:42.836649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-573aed5d-4bf5-4fce-98e9-56fd108b63eb tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:42.838450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-573aed5d-4bf5-4fce-98e9-56fd108b63eb tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:42.842020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-573aed5d-4bf5-4fce-98e9-56fd108b63eb tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:42.844880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-573aed5d-4bf5-4fce-98e9-56fd108b63eb tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:43.042178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-57b79338-e7d8-42fa-a665-87e4aa723202 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:43.046300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-57b79338-e7d8-42fa-a665-87e4aa723202 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:43.077109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57b79338-e7d8-42fa-a665-87e4aa723202 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:43.084067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57b79338-e7d8-42fa-a665-87e4aa723202 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:43.092946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57b79338-e7d8-42fa-a665-87e4aa723202 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:43.094908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57b79338-e7d8-42fa-a665-87e4aa723202 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:43.248485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-573aed5d-4bf5-4fce-98e9-56fd108b63eb tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:43.252210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-57b79338-e7d8-42fa-a665-87e4aa723202 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:43.264447 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-57b79338-e7d8-42fa-a665-87e4aa723202 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1220 microversion: 2.1 time: 0.233367 Jul 20 04:29:43.265712 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2087/4250] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:43 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1220 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:43.270781 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-573aed5d-4bf5-4fce-98e9-56fd108b63eb tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.473495 Jul 20 04:29:43.271762 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2164/4251] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:42 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:43.359744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4f1c9d5d-ef44-4a4f-acc2-9425ba9bd866 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:43.360681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4f1c9d5d-ef44-4a4f-acc2-9425ba9bd866 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:43.390992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f1c9d5d-ef44-4a4f-acc2-9425ba9bd866 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:43.392552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f1c9d5d-ef44-4a4f-acc2-9425ba9bd866 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:43.394909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f1c9d5d-ef44-4a4f-acc2-9425ba9bd866 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:43.398898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f1c9d5d-ef44-4a4f-acc2-9425ba9bd866 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:44.160999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4f1c9d5d-ef44-4a4f-acc2-9425ba9bd866 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:44.176970 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4f1c9d5d-ef44-4a4f-acc2-9425ba9bd866 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1314 microversion: 2.1 time: 0.821927 Jul 20 04:29:44.187537 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2088/4252] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:43 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:44.295008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1b3ed278-6e92-4b68-b54c-b3054a97f87e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:44.295932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1b3ed278-6e92-4b68-b54c-b3054a97f87e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:44.296803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-84ac2829-47f5-4365-829a-4ecde8c25676 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:44.300913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-84ac2829-47f5-4365-829a-4ecde8c25676 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:44.312599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b3ed278-6e92-4b68-b54c-b3054a97f87e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:44.315648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-84ac2829-47f5-4365-829a-4ecde8c25676 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:44.316446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b3ed278-6e92-4b68-b54c-b3054a97f87e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:44.317443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b3ed278-6e92-4b68-b54c-b3054a97f87e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:44.318036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b3ed278-6e92-4b68-b54c-b3054a97f87e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:44.319861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-84ac2829-47f5-4365-829a-4ecde8c25676 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:44.325049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-84ac2829-47f5-4365-829a-4ecde8c25676 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:44.325725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-84ac2829-47f5-4365-829a-4ecde8c25676 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:44.542582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1b3ed278-6e92-4b68-b54c-b3054a97f87e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:44.556959 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1b3ed278-6e92-4b68-b54c-b3054a97f87e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1282 microversion: 2.1 time: 0.265730 Jul 20 04:29:44.567309 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2089/4253] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:44 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:45.198876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-94f5a831-d954-4835-9ba9-8aea529ac467 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:45.200961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-94f5a831-d954-4835-9ba9-8aea529ac467 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:45.218321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94f5a831-d954-4835-9ba9-8aea529ac467 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:45.219130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94f5a831-d954-4835-9ba9-8aea529ac467 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:45.221529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94f5a831-d954-4835-9ba9-8aea529ac467 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:45.227948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94f5a831-d954-4835-9ba9-8aea529ac467 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:45.807772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-84ac2829-47f5-4365-829a-4ecde8c25676 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:45.821876 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-84ac2829-47f5-4365-829a-4ecde8c25676 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 1.537219 Jul 20 04:29:45.825046 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2165/4254] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:44 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:45.836223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-083a5305-60cb-4bc2-9a74-153386b65224 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:45.839319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-083a5305-60cb-4bc2-9a74-153386b65224 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:45.858406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-083a5305-60cb-4bc2-9a74-153386b65224 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:45.858789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-083a5305-60cb-4bc2-9a74-153386b65224 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:45.859566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-083a5305-60cb-4bc2-9a74-153386b65224 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:45.860014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-083a5305-60cb-4bc2-9a74-153386b65224 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:46.151194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-083a5305-60cb-4bc2-9a74-153386b65224 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:46.160553 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-083a5305-60cb-4bc2-9a74-153386b65224 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1282 microversion: 2.1 time: 0.334154 Jul 20 04:29:46.165128 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2166/4255] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:45 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1282 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:46.260146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-94f5a831-d954-4835-9ba9-8aea529ac467 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:46.272987 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-94f5a831-d954-4835-9ba9-8aea529ac467 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1502 microversion: 2.1 time: 1.081349 Jul 20 04:29:46.274138 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2090/4256] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:45 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1502 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:46.290353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-889fe0e2-f489-44b0-bc97-4c46b0ae40a8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:46.291358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-889fe0e2-f489-44b0-bc97-4c46b0ae40a8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:46.301382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-889fe0e2-f489-44b0-bc97-4c46b0ae40a8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:46.301846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-889fe0e2-f489-44b0-bc97-4c46b0ae40a8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:46.302639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-889fe0e2-f489-44b0-bc97-4c46b0ae40a8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:46.303121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-889fe0e2-f489-44b0-bc97-4c46b0ae40a8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:46.395317 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-889fe0e2-f489-44b0-bc97-4c46b0ae40a8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd/action" status: 200 len: 14 microversion: 2.1 time: 0.108894 Jul 20 04:29:46.396415 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2167/4257] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:29:46 2022] POST /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:46.848206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4dd6b47a-d695-4c0c-a6c6-f809c0dd421b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:46.850597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4dd6b47a-d695-4c0c-a6c6-f809c0dd421b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:46.868046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4dd6b47a-d695-4c0c-a6c6-f809c0dd421b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:46.869067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4dd6b47a-d695-4c0c-a6c6-f809c0dd421b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:46.871062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4dd6b47a-d695-4c0c-a6c6-f809c0dd421b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:46.872076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4dd6b47a-d695-4c0c-a6c6-f809c0dd421b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.183672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2984ec6-de93-4d05-80ec-a54f2d07c1be tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:47.184400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c2984ec6-de93-4d05-80ec-a54f2d07c1be tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:47.207873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2984ec6-de93-4d05-80ec-a54f2d07c1be tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.208338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2984ec6-de93-4d05-80ec-a54f2d07c1be tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.211062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2984ec6-de93-4d05-80ec-a54f2d07c1be tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.214798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2984ec6-de93-4d05-80ec-a54f2d07c1be tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.600911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c2984ec6-de93-4d05-80ec-a54f2d07c1be tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:47.614535 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c2984ec6-de93-4d05-80ec-a54f2d07c1be tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1282 microversion: 2.1 time: 0.436742 Jul 20 04:29:47.615176 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2168/4258] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:47 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1282 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:47.627861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8b55394b-e780-420b-9c9f-8cbe73b27ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:47.628815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8b55394b-e780-420b-9c9f-8cbe73b27ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:47.654364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b55394b-e780-420b-9c9f-8cbe73b27ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.654833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b55394b-e780-420b-9c9f-8cbe73b27ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.655688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b55394b-e780-420b-9c9f-8cbe73b27ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.656145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b55394b-e780-420b-9c9f-8cbe73b27ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.737098 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8b55394b-e780-420b-9c9f-8cbe73b27ac5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd/action" status: 200 len: 14 microversion: 2.1 time: 0.119327 Jul 20 04:29:47.738349 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2169/4259] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:29:47 2022] POST /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:47.870505 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4dd6b47a-d695-4c0c-a6c6-f809c0dd421b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:47.879737 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4dd6b47a-d695-4c0c-a6c6-f809c0dd421b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 1.041287 Jul 20 04:29:47.890906 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2091/4260] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:46 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:48.168820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-620104107", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "be069fc8-30ed-40bc-8dbd-2efb24615595"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:48.235179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] validate_networks() for [('be069fc8-30ed-40bc-8dbd-2efb24615595', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:29:48.302032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8b74e2dc-176d-4231-9b6c-0dcf2ccd76e2 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:48.303983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8b74e2dc-176d-4231-9b6c-0dcf2ccd76e2 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:48.325818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b74e2dc-176d-4231-9b6c-0dcf2ccd76e2 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:48.327103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b74e2dc-176d-4231-9b6c-0dcf2ccd76e2 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:48.328136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b74e2dc-176d-4231-9b6c-0dcf2ccd76e2 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:48.329015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b74e2dc-176d-4231-9b6c-0dcf2ccd76e2 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:48.363954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8b74e2dc-176d-4231-9b6c-0dcf2ccd76e2 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:29:48.529951 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8b74e2dc-176d-4231-9b6c-0dcf2ccd76e2 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "DELETE /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 204 len: 0 microversion: 2.1 time: 0.234126 Jul 20 04:29:48.537147 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2092/4261] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:48 2022] DELETE /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:29:48.565833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9b2bb9dd-e0cc-43c8-942c-903f38c69f1a tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:48.566648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9b2bb9dd-e0cc-43c8-942c-903f38c69f1a tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:48.581526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9dd-e0cc-43c8-942c-903f38c69f1a tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:48.581975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9dd-e0cc-43c8-942c-903f38c69f1a tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:48.582778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9dd-e0cc-43c8-942c-903f38c69f1a tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:48.583225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b2bb9dd-e0cc-43c8-942c-903f38c69f1a tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:48.997400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9b2bb9dd-e0cc-43c8-942c-903f38c69f1a tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:49.011299 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9b2bb9dd-e0cc-43c8-942c-903f38c69f1a tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1664 microversion: 2.1 time: 0.456709 Jul 20 04:29:49.012522 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2093/4262] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:48 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1664 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:49.023260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f4d8ef4e-b029-40cc-9cd5-b8fbc7fe7691 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:49.026387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f4d8ef4e-b029-40cc-9cd5-b8fbc7fe7691 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:49.044891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f4d8ef4e-b029-40cc-9cd5-b8fbc7fe7691 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:49.045779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f4d8ef4e-b029-40cc-9cd5-b8fbc7fe7691 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:49.047578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f4d8ef4e-b029-40cc-9cd5-b8fbc7fe7691 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:49.048334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f4d8ef4e-b029-40cc-9cd5-b8fbc7fe7691 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:49.829599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f4d8ef4e-b029-40cc-9cd5-b8fbc7fe7691 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:49.838422 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f4d8ef4e-b029-40cc-9cd5-b8fbc7fe7691 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1324 microversion: 2.1 time: 0.822334 Jul 20 04:29:49.839020 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2094/4263] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:49 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1324 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:49.958629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:29:49.959165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:29:49.959864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:29:49.960288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:29:49.960709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:29:49.973687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1659814792", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "f9f5da6a-475a-4b0b-997f-4a1b22e5ba33"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:49.988824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:49.989893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:49.992710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:49.993405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:50.034835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:50.050599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for user 7d38b1e323c5490fbb4c0023034874c8 and project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:50.060375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] validate_networks() for [('f9f5da6a-475a-4b0b-997f-4a1b22e5ba33', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:29:50.080881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:29:50.083856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:50.174117 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-762d0f10-5867-439c-997c-2b37fdab7b3c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.069230 Jul 20 04:29:50.176427 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2170/4264] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:29:50.224342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c300c8d5-cda9-4518-a085-e58b5d5c2375 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:50.226724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c300c8d5-cda9-4518-a085-e58b5d5c2375 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:50.249483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c300c8d5-cda9-4518-a085-e58b5d5c2375 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:50.251968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c300c8d5-cda9-4518-a085-e58b5d5c2375 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:50.253887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c300c8d5-cda9-4518-a085-e58b5d5c2375 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:50.255188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c300c8d5-cda9-4518-a085-e58b5d5c2375 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:50.306983 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c300c8d5-cda9-4518-a085-e58b5d5c2375 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd/action" status: 200 len: 14 microversion: 2.1 time: 0.107573 Jul 20 04:29:50.309287 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2171/4265] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:29:50 2022] POST /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:50.315424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f1dfbded-091f-4d40-b880-018cd3b95e2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:50.316265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f1dfbded-091f-4d40-b880-018cd3b95e2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:50.336661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1dfbded-091f-4d40-b880-018cd3b95e2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:50.337564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1dfbded-091f-4d40-b880-018cd3b95e2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:50.339600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1dfbded-091f-4d40-b880-018cd3b95e2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:50.340183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1dfbded-091f-4d40-b880-018cd3b95e2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.328868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f1dfbded-091f-4d40-b880-018cd3b95e2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:51.343051 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f1dfbded-091f-4d40-b880-018cd3b95e2e tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1486 microversion: 2.1 time: 1.032230 Jul 20 04:29:51.344040 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2172/4266] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:50 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1486 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:51.351418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9acddc62-4a82-4dcb-b352-94743c58dc3e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:51.352086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9acddc62-4a82-4dcb-b352-94743c58dc3e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:51.367245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9acddc62-4a82-4dcb-b352-94743c58dc3e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.367726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9acddc62-4a82-4dcb-b352-94743c58dc3e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.368538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9acddc62-4a82-4dcb-b352-94743c58dc3e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.368985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9acddc62-4a82-4dcb-b352-94743c58dc3e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.595533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:29:51.596718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:29:51.597898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:29:51.598825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:29:51.599452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:29:51.600207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9acddc62-4a82-4dcb-b352-94743c58dc3e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:51.615367 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9acddc62-4a82-4dcb-b352-94743c58dc3e tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1597 microversion: 2.1 time: 0.270040 Jul 20 04:29:51.619624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.620508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.621910 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2173/4267] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:51 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1597 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:51.622233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.623093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.632878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1518e643-67ee-4752-9512-8ced2d292148 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:51.633465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1518e643-67ee-4752-9512-8ced2d292148 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:51.661494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Getting quotas for project 13b42286633d47d39ad489a6bc1a317d. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:51.664372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1518e643-67ee-4752-9512-8ced2d292148 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.665046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1518e643-67ee-4752-9512-8ced2d292148 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.668508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Getting quotas for user ebfcc66c53e0447fa28b53a30ec47bc6 and project 13b42286633d47d39ad489a6bc1a317d. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:51.674232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1518e643-67ee-4752-9512-8ced2d292148 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.674717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1518e643-67ee-4752-9512-8ced2d292148 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.689220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:29:51.700281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:51.829050 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-56d833a1-5e85-449b-8d86-8c718a0ead5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.977569 Jul 20 04:29:51.842455 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2095/4268] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:29:51.861586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa8811d2-d7a1-4f00-a8ca-05b3656d5c12 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:51.862303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa8811d2-d7a1-4f00-a8ca-05b3656d5c12 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:51.884703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa8811d2-d7a1-4f00-a8ca-05b3656d5c12 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.885491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa8811d2-d7a1-4f00-a8ca-05b3656d5c12 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.888479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa8811d2-d7a1-4f00-a8ca-05b3656d5c12 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.889700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa8811d2-d7a1-4f00-a8ca-05b3656d5c12 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.933566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1518e643-67ee-4752-9512-8ced2d292148 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:51.944249 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1518e643-67ee-4752-9512-8ced2d292148 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1244 microversion: 2.1 time: 0.320498 Jul 20 04:29:51.966847 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2174/4269] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:51 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1244 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:51.977654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be063b7b-45fe-47a0-b784-ae81ab4338a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:51.990084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-be063b7b-45fe-47a0-b784-ae81ab4338a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:52.030127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be063b7b-45fe-47a0-b784-ae81ab4338a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:52.030646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be063b7b-45fe-47a0-b784-ae81ab4338a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.037068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be063b7b-45fe-47a0-b784-ae81ab4338a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:52.037550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be063b7b-45fe-47a0-b784-ae81ab4338a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.127005 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-be063b7b-45fe-47a0-b784-ae81ab4338a9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd/action" status: 200 len: 14 microversion: 2.1 time: 0.158020 Jul 20 04:29:52.128395 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2175/4270] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:29:51 2022] POST /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:52.135114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9712748d-1b8d-4b2e-a95c-faf3e652c07d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:52.139467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9712748d-1b8d-4b2e-a95c-faf3e652c07d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:52.164650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9712748d-1b8d-4b2e-a95c-faf3e652c07d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:52.165132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9712748d-1b8d-4b2e-a95c-faf3e652c07d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.165965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9712748d-1b8d-4b2e-a95c-faf3e652c07d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:52.185651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9712748d-1b8d-4b2e-a95c-faf3e652c07d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.264862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:52.332520 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9712748d-1b8d-4b2e-a95c-faf3e652c07d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "POST /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c/action" status: 202 len: 0 microversion: 2.1 time: 0.201895 Jul 20 04:29:52.344614 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2176/4271] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:29:52 2022] POST /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:29:52.355486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9553429d-aa08-44d6-999f-e2e23009c46c req-a62a24fa-f6e1-4533-b57e-bf4fe515a095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8b86ac9-d7cc-4afa-9be9-be583eba6598", "tag": "1082187f-8c8a-4b79-8b92-bbadee906300"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:52.362936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:52.376479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9553429d-aa08-44d6-999f-e2e23009c46c req-a62a24fa-f6e1-4533-b57e-bf4fe515a095 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:52.377099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9553429d-aa08-44d6-999f-e2e23009c46c req-a62a24fa-f6e1-4533-b57e-bf4fe515a095 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.395705 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9553429d-aa08-44d6-999f-e2e23009c46c req-a62a24fa-f6e1-4533-b57e-bf4fe515a095 service nova] Creating event network-changed:1082187f-8c8a-4b79-8b92-bbadee906300 for instance b8b86ac9-d7cc-4afa-9be9-be583eba6598 on n-h1-764485-11 Jul 20 04:29:52.402141 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9553429d-aa08-44d6-999f-e2e23009c46c req-a62a24fa-f6e1-4533-b57e-bf4fe515a095 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050615 Jul 20 04:29:52.403314 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2177/4272] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:52.412073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f9d05105-9079-4654-83e3-7a1b4fc21e58 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:52.414055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f9d05105-9079-4654-83e3-7a1b4fc21e58 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:52.616147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f9d05105-9079-4654-83e3-7a1b4fc21e58 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:52.629313 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f9d05105-9079-4654-83e3-7a1b4fc21e58 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1217 microversion: 2.1 time: 0.224561 Jul 20 04:29:52.630592 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2178/4273] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:52 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1217 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:52.638685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c5577770-f1b9-4fa2-940c-823e223645af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:52.644540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c5577770-f1b9-4fa2-940c-823e223645af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:52.661462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5577770-f1b9-4fa2-940c-823e223645af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:52.663400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5577770-f1b9-4fa2-940c-823e223645af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.667912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5577770-f1b9-4fa2-940c-823e223645af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:52.669336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5577770-f1b9-4fa2-940c-823e223645af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.893722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fa8811d2-d7a1-4f00-a8ca-05b3656d5c12 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:52.905810 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fa8811d2-d7a1-4f00-a8ca-05b3656d5c12 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1324 microversion: 2.1 time: 1.061802 Jul 20 04:29:52.906760 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2096/4274] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:51 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1324 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:52.918101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eba55fe9-c9b8-4faf-be25-623757b4e432 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:52.922103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eba55fe9-c9b8-4faf-be25-623757b4e432 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:52.934437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eba55fe9-c9b8-4faf-be25-623757b4e432 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:52.939647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eba55fe9-c9b8-4faf-be25-623757b4e432 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.940804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eba55fe9-c9b8-4faf-be25-623757b4e432 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:52.943797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eba55fe9-c9b8-4faf-be25-623757b4e432 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.027978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eba55fe9-c9b8-4faf-be25-623757b4e432 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.030867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eba55fe9-c9b8-4faf-be25-623757b4e432 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.031473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-eba55fe9-c9b8-4faf-be25-623757b4e432 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lazy-loading 'fault' on Instance uuid 05ffdfab-9da8-46f5-83ee-20735f6b4164 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:53.167465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eba55fe9-c9b8-4faf-be25-623757b4e432 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269f1507e534b3ca92190602926eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18380616f974a7eb7e798cae18a13d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:53.182326 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eba55fe9-c9b8-4faf-be25-623757b4e432 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 200 len: 1315 microversion: 2.1 time: 0.272516 Jul 20 04:29:53.182972 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2097/4275] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:52 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:53.205679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1556916d-dacd-4e2d-901f-9a695d0a26f5 req-cdee6493-4158-4a6b-92d0-50889c3a5d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ffdfab-9da8-46f5-83ee-20735f6b4164", "name": "network-vif-deleted", "tag": "de0d7b91-90f1-4e53-a48b-3c82a0802c32"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:53.228191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1556916d-dacd-4e2d-901f-9a695d0a26f5 req-cdee6493-4158-4a6b-92d0-50889c3a5d7d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.228653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1556916d-dacd-4e2d-901f-9a695d0a26f5 req-cdee6493-4158-4a6b-92d0-50889c3a5d7d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.287878 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1556916d-dacd-4e2d-901f-9a695d0a26f5 req-cdee6493-4158-4a6b-92d0-50889c3a5d7d service nova] Creating event network-vif-deleted:de0d7b91-90f1-4e53-a48b-3c82a0802c32 for instance 05ffdfab-9da8-46f5-83ee-20735f6b4164 on n-h2-764485-11 Jul 20 04:29:53.301514 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1556916d-dacd-4e2d-901f-9a695d0a26f5 req-cdee6493-4158-4a6b-92d0-50889c3a5d7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104030 Jul 20 04:29:53.302502 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2098/4276] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:53.316639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95c74616-1af2-4fd8-933d-9fe115656619 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:53.319328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95c74616-1af2-4fd8-933d-9fe115656619 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:53.337077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c74616-1af2-4fd8-933d-9fe115656619 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.338959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c74616-1af2-4fd8-933d-9fe115656619 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.340190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c74616-1af2-4fd8-933d-9fe115656619 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.340800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c74616-1af2-4fd8-933d-9fe115656619 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.473682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95c74616-1af2-4fd8-933d-9fe115656619 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:53.498556 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95c74616-1af2-4fd8-933d-9fe115656619 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1250 microversion: 2.1 time: 0.192776 Jul 20 04:29:53.516221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c5577770-f1b9-4fa2-940c-823e223645af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:53.524786 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c5577770-f1b9-4fa2-940c-823e223645af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1494 microversion: 2.1 time: 0.892804 Jul 20 04:29:53.527590 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2099/4277] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:53 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1250 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:53.531819 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2179/4278] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:52 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1494 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:53.536320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0c8a2c11-e859-4719-9b88-3f877f97aac0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:53.546443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0c8a2c11-e859-4719-9b88-3f877f97aac0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:53.558910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c8a2c11-e859-4719-9b88-3f877f97aac0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.566081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c8a2c11-e859-4719-9b88-3f877f97aac0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.566923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c8a2c11-e859-4719-9b88-3f877f97aac0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.567418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c8a2c11-e859-4719-9b88-3f877f97aac0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.648060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e8433a13-5472-47ed-a96e-6f3775a13948 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:53.648770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e8433a13-5472-47ed-a96e-6f3775a13948 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:53.665209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e8433a13-5472-47ed-a96e-6f3775a13948 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.665922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e8433a13-5472-47ed-a96e-6f3775a13948 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.666871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e8433a13-5472-47ed-a96e-6f3775a13948 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.667527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e8433a13-5472-47ed-a96e-6f3775a13948 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.837977 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0c8a2c11-e859-4719-9b88-3f877f97aac0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd/action" status: 200 len: 14 microversion: 2.1 time: 0.308130 Jul 20 04:29:53.838933 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2100/4279] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:29:53 2022] POST /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd/action => generated 14 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:53.908341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e8433a13-5472-47ed-a96e-6f3775a13948 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:53.921562 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e8433a13-5472-47ed-a96e-6f3775a13948 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1269 microversion: 2.1 time: 0.278323 Jul 20 04:29:53.925014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a83e554-2344-4ad3-b501-b32a8e8d396a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:53.925789 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2180/4280] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:53 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1269 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:53.926680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a83e554-2344-4ad3-b501-b32a8e8d396a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:53.941602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a83e554-2344-4ad3-b501-b32a8e8d396a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.943089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a83e554-2344-4ad3-b501-b32a8e8d396a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.948655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a83e554-2344-4ad3-b501-b32a8e8d396a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.949412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a83e554-2344-4ad3-b501-b32a8e8d396a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.967559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:54.201897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f4debbad-565e-4220-a81d-afbb72ba7f7b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:54.202760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f4debbad-565e-4220-a81d-afbb72ba7f7b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] [instance: 05ffdfab-9da8-46f5-83ee-20735f6b4164] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:54.211457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4debbad-565e-4220-a81d-afbb72ba7f7b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:54.213257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4debbad-565e-4220-a81d-afbb72ba7f7b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:54.214624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4debbad-565e-4220-a81d-afbb72ba7f7b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:54.215378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4debbad-565e-4220-a81d-afbb72ba7f7b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:54.268584 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f4debbad-565e-4220-a81d-afbb72ba7f7b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] HTTP exception thrown: Instance 05ffdfab-9da8-46f5-83ee-20735f6b4164 could not be found. Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f4debbad-565e-4220-a81d-afbb72ba7f7b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Request method failure captured: Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 HTTP/1.1 Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14RL22U2MkaFV304jKTDe2f6VXTgvnoi7XlttSuhAxvEhm-3wNND4j7Sgk83rWD7s-jBU__IniFd3qWQhzULiBrtuJzwMwCaZ2UohT_8EA_EiXi2CDOlnSZFC7C8r8mnmOSHu950yFJDLp3CApXQtqILJ5IJPumq3bmopO8hXdC-y7g Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a18380616f974a7eb7e798cae18a13d0 Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestFqdnHostnames-1451423060 Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a18380616f974a7eb7e798cae18a13d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a18380616f974a7eb7e798cae18a13d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a18380616f974a7eb7e798cae18a13d0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a18380616f974a7eb7e798cae18a13d0"}]}] Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestFqdnHostnames-1451423060 Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a18380616f974a7eb7e798cae18a13d0 Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1451423060 Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestFqdnHostnames-1451423060-project Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 3269f1507e534b3ca92190602926eaa4 Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestFqdnHostnames-1451423060-project Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 05ffdfab-9da8-46f5-83ee-20735f6b4164 could not be found. Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '05ffdfab-9da8-46f5-83ee-20735f6b4164'} Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ffdfab-9da8-46f5-83ee-20735f6b4164 could not be found. Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ffdfab-9da8-46f5-83ee-20735f6b4164 could not be found. Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:54.273244 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:54.279102 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:54.279102 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:54.279102 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:54.279102 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:54.279102 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:54.279102 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ffdfab-9da8-46f5-83ee-20735f6b4164 could not be found. Jul 20 04:29:54.279102 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:29:54.281521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f4debbad-565e-4220-a81d-afbb72ba7f7b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Returning 404 to user: Instance 05ffdfab-9da8-46f5-83ee-20735f6b4164 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:54.284297 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f4debbad-565e-4220-a81d-afbb72ba7f7b tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164" status: 404 len: 111 microversion: 2.1 time: 0.087324 Jul 20 04:29:54.287266 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2181/4281] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:54 2022] GET /compute/v2.1/servers/05ffdfab-9da8-46f5-83ee-20735f6b4164 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:29:54.298758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ae8be11-201c-4742-9aae-e14565d3b271 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] Calling method '.version_select at 0x7fbf9dcb2040>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:54.367310 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8ae8be11-201c-4742-9aae-e14565d3b271 tempest-ServersTestFqdnHostnames-1451423060 tempest-ServersTestFqdnHostnames-1451423060-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-636263257" status: 202 len: 0 microversion: 2.1 time: 0.070053 Jul 20 04:29:54.376707 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2182/4282] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 20 04:29:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-636263257 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:29:54.520965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-893857c8-ca8c-45d4-825a-28b3f9dc1c03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:54.522368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-893857c8-ca8c-45d4-825a-28b3f9dc1c03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:54.565408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-893857c8-ca8c-45d4-825a-28b3f9dc1c03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:54.566123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-893857c8-ca8c-45d4-825a-28b3f9dc1c03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:54.567088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-893857c8-ca8c-45d4-825a-28b3f9dc1c03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:54.567710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-893857c8-ca8c-45d4-825a-28b3f9dc1c03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:55.090716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-893857c8-ca8c-45d4-825a-28b3f9dc1c03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:55.102797 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-893857c8-ca8c-45d4-825a-28b3f9dc1c03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1250 microversion: 2.1 time: 0.587423 Jul 20 04:29:55.105626 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2183/4283] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:54 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1250 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:55.127789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ab4de221-a4de-4c76-9940-828d9fe33ebe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:55.128891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ab4de221-a4de-4c76-9940-828d9fe33ebe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:55.137512 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab4de221-a4de-4c76-9940-828d9fe33ebe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:55.138442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab4de221-a4de-4c76-9940-828d9fe33ebe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:55.140951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab4de221-a4de-4c76-9940-828d9fe33ebe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:55.141649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab4de221-a4de-4c76-9940-828d9fe33ebe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:55.383307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a83e554-2344-4ad3-b501-b32a8e8d396a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:55.395297 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a83e554-2344-4ad3-b501-b32a8e8d396a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1324 microversion: 2.1 time: 1.471343 Jul 20 04:29:55.396149 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2101/4284] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:53 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1324 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:55.409269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1b9bdc18-111b-4f42-a794-87440a3e7099 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:55.410214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1b9bdc18-111b-4f42-a794-87440a3e7099 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:55.417726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b9bdc18-111b-4f42-a794-87440a3e7099 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:55.418404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b9bdc18-111b-4f42-a794-87440a3e7099 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:55.419385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b9bdc18-111b-4f42-a794-87440a3e7099 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:55.420016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b9bdc18-111b-4f42-a794-87440a3e7099 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:55.586626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ab4de221-a4de-4c76-9940-828d9fe33ebe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:55.599123 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ab4de221-a4de-4c76-9940-828d9fe33ebe tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1494 microversion: 2.1 time: 0.488586 Jul 20 04:29:55.610631 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2184/4285] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:55 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1494 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:55.616190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-05e73f1e-0003-4b7d-963d-a66c10dd6d1d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:55.622935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-05e73f1e-0003-4b7d-963d-a66c10dd6d1d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:55.639312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05e73f1e-0003-4b7d-963d-a66c10dd6d1d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:55.642379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05e73f1e-0003-4b7d-963d-a66c10dd6d1d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:55.643368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05e73f1e-0003-4b7d-963d-a66c10dd6d1d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:55.644603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-05e73f1e-0003-4b7d-963d-a66c10dd6d1d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:55.868942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-05e73f1e-0003-4b7d-963d-a66c10dd6d1d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:55.877450 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-05e73f1e-0003-4b7d-963d-a66c10dd6d1d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1275 microversion: 2.1 time: 0.265656 Jul 20 04:29:55.888399 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2185/4286] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:55 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1275 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:56.122447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9d0e748d-3d8a-4ee2-84ab-69177546e5be tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:56.123298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9d0e748d-3d8a-4ee2-84ab-69177546e5be tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:56.131918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d0e748d-3d8a-4ee2-84ab-69177546e5be tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:56.134065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d0e748d-3d8a-4ee2-84ab-69177546e5be tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:56.137071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d0e748d-3d8a-4ee2-84ab-69177546e5be tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:56.138765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d0e748d-3d8a-4ee2-84ab-69177546e5be tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:56.398311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9d0e748d-3d8a-4ee2-84ab-69177546e5be tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:56.414430 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9d0e748d-3d8a-4ee2-84ab-69177546e5be tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1292 microversion: 2.1 time: 0.295802 Jul 20 04:29:56.415498 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2186/4287] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:56 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1292 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:56.425079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e94c491c-0249-4bc0-96e9-bfa4a2aca776 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:56.426565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e94c491c-0249-4bc0-96e9-bfa4a2aca776 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:56.436009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e94c491c-0249-4bc0-96e9-bfa4a2aca776 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:56.438882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e94c491c-0249-4bc0-96e9-bfa4a2aca776 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:56.440760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e94c491c-0249-4bc0-96e9-bfa4a2aca776 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:56.441476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e94c491c-0249-4bc0-96e9-bfa4a2aca776 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:56.698799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e94c491c-0249-4bc0-96e9-bfa4a2aca776 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:56.712655 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e94c491c-0249-4bc0-96e9-bfa4a2aca776 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1324 microversion: 2.1 time: 0.295240 Jul 20 04:29:56.713291 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2187/4288] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:56 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:56.719950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db373ac3-efe4-499b-9217-6a7a188e51ee tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:56.720903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-db373ac3-efe4-499b-9217-6a7a188e51ee tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:56.731150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db373ac3-efe4-499b-9217-6a7a188e51ee tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:56.732241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db373ac3-efe4-499b-9217-6a7a188e51ee tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:56.733053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db373ac3-efe4-499b-9217-6a7a188e51ee tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:56.733892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db373ac3-efe4-499b-9217-6a7a188e51ee tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.013012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-db373ac3-efe4-499b-9217-6a7a188e51ee tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:57.027293 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-db373ac3-efe4-499b-9217-6a7a188e51ee tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1494 microversion: 2.1 time: 0.311234 Jul 20 04:29:57.030304 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2188/4289] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:56 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1494 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:57.044697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ce525a72-8e86-4edc-8502-c6021d1a9879 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:57.045315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ce525a72-8e86-4edc-8502-c6021d1a9879 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:57.055431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce525a72-8e86-4edc-8502-c6021d1a9879 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.055938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce525a72-8e86-4edc-8502-c6021d1a9879 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.056730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce525a72-8e86-4edc-8502-c6021d1a9879 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.057221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce525a72-8e86-4edc-8502-c6021d1a9879 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.155323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ce525a72-8e86-4edc-8502-c6021d1a9879 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:57.171874 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ce525a72-8e86-4edc-8502-c6021d1a9879 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1275 microversion: 2.1 time: 0.130343 Jul 20 04:29:57.171874 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2189/4290] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:57 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1275 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:57.176735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-dfeac9e6-494d-4067-843c-597ca8cc822f req-3e20a1b0-6d58-4a41-b393-2c09896678c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b20769a-b7f7-42e9-a508-0a69841e33c5", "tag": "c279d121-fd2b-4719-a1ea-6cc519800111"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:57.193266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dfeac9e6-494d-4067-843c-597ca8cc822f req-3e20a1b0-6d58-4a41-b393-2c09896678c8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.194370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dfeac9e6-494d-4067-843c-597ca8cc822f req-3e20a1b0-6d58-4a41-b393-2c09896678c8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.207676 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-dfeac9e6-494d-4067-843c-597ca8cc822f req-3e20a1b0-6d58-4a41-b393-2c09896678c8 service nova] Creating event network-changed:c279d121-fd2b-4719-a1ea-6cc519800111 for instance 8b20769a-b7f7-42e9-a508-0a69841e33c5 on n-h2-764485-11 Jul 20 04:29:57.213178 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-dfeac9e6-494d-4067-843c-597ca8cc822f req-3e20a1b0-6d58-4a41-b393-2c09896678c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040043 Jul 20 04:29:57.213983 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2190/4291] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:57.434732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0a53e033-9828-42d3-b7d7-e95eb8b6e6c2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:57.435448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0a53e033-9828-42d3-b7d7-e95eb8b6e6c2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:57.442454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a53e033-9828-42d3-b7d7-e95eb8b6e6c2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.443140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a53e033-9828-42d3-b7d7-e95eb8b6e6c2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.444993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a53e033-9828-42d3-b7d7-e95eb8b6e6c2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.445599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a53e033-9828-42d3-b7d7-e95eb8b6e6c2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.528705 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1b9bdc18-111b-4f42-a794-87440a3e7099 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd/action" status: 200 len: 16400 microversion: 2.1 time: 2.130170 Jul 20 04:29:57.532501 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2102/4292] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:29:55 2022] POST /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd/action => generated 16400 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:29:57.543594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-469d859f-6be9-48c0-a883-cc65b7eda6e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:57.548113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-469d859f-6be9-48c0-a883-cc65b7eda6e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:57.562411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-469d859f-6be9-48c0-a883-cc65b7eda6e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.563210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-469d859f-6be9-48c0-a883-cc65b7eda6e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.564798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-469d859f-6be9-48c0-a883-cc65b7eda6e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.565539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-469d859f-6be9-48c0-a883-cc65b7eda6e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.957001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0a53e033-9828-42d3-b7d7-e95eb8b6e6c2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:57.972639 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0a53e033-9828-42d3-b7d7-e95eb8b6e6c2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1292 microversion: 2.1 time: 0.542478 Jul 20 04:29:57.983611 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2191/4293] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:57 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1292 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:57.994322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-caea187e-f350-4243-8302-27dc4110513b tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:57.995998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-caea187e-f350-4243-8302-27dc4110513b tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:58.004948 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caea187e-f350-4243-8302-27dc4110513b tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.006365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caea187e-f350-4243-8302-27dc4110513b tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.011729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caea187e-f350-4243-8302-27dc4110513b tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.012417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caea187e-f350-4243-8302-27dc4110513b tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.094737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-469d859f-6be9-48c0-a883-cc65b7eda6e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:58.106546 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-469d859f-6be9-48c0-a883-cc65b7eda6e1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.570861 Jul 20 04:29:58.108428 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2103/4294] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:57 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:58.126328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95c1d8d4-7602-4083-9c0e-f72cab332b5b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:58.126328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95c1d8d4-7602-4083-9c0e-f72cab332b5b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:58.148407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c1d8d4-7602-4083-9c0e-f72cab332b5b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.148863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c1d8d4-7602-4083-9c0e-f72cab332b5b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.149642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c1d8d4-7602-4083-9c0e-f72cab332b5b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.153894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95c1d8d4-7602-4083-9c0e-f72cab332b5b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.633941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-caea187e-f350-4243-8302-27dc4110513b tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:58.642712 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-caea187e-f350-4243-8302-27dc4110513b tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1324 microversion: 2.1 time: 0.657760 Jul 20 04:29:58.643496 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2192/4295] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:57 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1324 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:58.658435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c8fbb451-a771-4381-9985-62f4cf15a8c4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:58.659954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c8fbb451-a771-4381-9985-62f4cf15a8c4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:58.667370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8fbb451-a771-4381-9985-62f4cf15a8c4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.667849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8fbb451-a771-4381-9985-62f4cf15a8c4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.669067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8fbb451-a771-4381-9985-62f4cf15a8c4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.669184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8fbb451-a771-4381-9985-62f4cf15a8c4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.759452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95c1d8d4-7602-4083-9c0e-f72cab332b5b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:58.767614 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95c1d8d4-7602-4083-9c0e-f72cab332b5b tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1494 microversion: 2.1 time: 0.657739 Jul 20 04:29:58.768109 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2104/4296] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:58 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1494 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:58.773502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1387af89-2bb2-448a-8e75-6236860abe08 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:58.774322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1387af89-2bb2-448a-8e75-6236860abe08 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:58.780696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1387af89-2bb2-448a-8e75-6236860abe08 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.781150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1387af89-2bb2-448a-8e75-6236860abe08 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.781968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1387af89-2bb2-448a-8e75-6236860abe08 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.782408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1387af89-2bb2-448a-8e75-6236860abe08 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.971760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1387af89-2bb2-448a-8e75-6236860abe08 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:58.997529 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1387af89-2bb2-448a-8e75-6236860abe08 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1275 microversion: 2.1 time: 0.228176 Jul 20 04:29:59.009909 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2105/4297] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:58 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1275 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:59.015480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-221a84af-3c6d-482e-a754-25131e5f6f91 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:59.016941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-221a84af-3c6d-482e-a754-25131e5f6f91 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:59.035428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-221a84af-3c6d-482e-a754-25131e5f6f91 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:59.035771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-221a84af-3c6d-482e-a754-25131e5f6f91 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:59.036737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-221a84af-3c6d-482e-a754-25131e5f6f91 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:59.037908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-221a84af-3c6d-482e-a754-25131e5f6f91 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:59.739495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c8fbb451-a771-4381-9985-62f4cf15a8c4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:59.756933 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c8fbb451-a771-4381-9985-62f4cf15a8c4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 1.103185 Jul 20 04:29:59.768383 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2193/4298] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:58 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:59.774672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3889f81f-3f4b-42e4-a6cf-70e274f37f75 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:59.775661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3889f81f-3f4b-42e4-a6cf-70e274f37f75 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:59.783800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3889f81f-3f4b-42e4-a6cf-70e274f37f75 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:59.784581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3889f81f-3f4b-42e4-a6cf-70e274f37f75 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:59.785794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3889f81f-3f4b-42e4-a6cf-70e274f37f75 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:59.786744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3889f81f-3f4b-42e4-a6cf-70e274f37f75 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.013364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:00.316199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-221a84af-3c6d-482e-a754-25131e5f6f91 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:00.335745 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-221a84af-3c6d-482e-a754-25131e5f6f91 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1292 microversion: 2.1 time: 1.322532 Jul 20 04:30:00.339947 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2106/4299] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:59 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1292 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:00.348916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dc7b2470-b736-4990-a15e-e098d6d7a661 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:00.350286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dc7b2470-b736-4990-a15e-e098d6d7a661 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:00.358590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc7b2470-b736-4990-a15e-e098d6d7a661 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.359477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc7b2470-b736-4990-a15e-e098d6d7a661 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.360662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc7b2470-b736-4990-a15e-e098d6d7a661 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.375754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc7b2470-b736-4990-a15e-e098d6d7a661 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.683684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3889f81f-3f4b-42e4-a6cf-70e274f37f75 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:00.700270 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3889f81f-3f4b-42e4-a6cf-70e274f37f75 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1324 microversion: 2.1 time: 0.928521 Jul 20 04:30:00.701751 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2194/4300] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:59 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1324 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:00.716514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a291d14b-9f98-496a-9aca-13f19f8b1eca tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:00.719031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a291d14b-9f98-496a-9aca-13f19f8b1eca tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:00.726304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a291d14b-9f98-496a-9aca-13f19f8b1eca tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.727165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a291d14b-9f98-496a-9aca-13f19f8b1eca tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.728215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a291d14b-9f98-496a-9aca-13f19f8b1eca tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.728883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a291d14b-9f98-496a-9aca-13f19f8b1eca tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.872139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dc7b2470-b736-4990-a15e-e098d6d7a661 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:00.888217 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dc7b2470-b736-4990-a15e-e098d6d7a661 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.545377 Jul 20 04:30:00.899917 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2107/4301] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:00 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:00.905822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ffbbf459-774b-460b-ac89-07dd6ca8d364 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:00.906663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ffbbf459-774b-460b-ac89-07dd6ca8d364 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:00.913880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffbbf459-774b-460b-ac89-07dd6ca8d364 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.914606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffbbf459-774b-460b-ac89-07dd6ca8d364 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.915718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffbbf459-774b-460b-ac89-07dd6ca8d364 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.916371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffbbf459-774b-460b-ac89-07dd6ca8d364 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.172229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a291d14b-9f98-496a-9aca-13f19f8b1eca tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:01.174601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:01.185565 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a291d14b-9f98-496a-9aca-13f19f8b1eca tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1500 microversion: 2.1 time: 0.470577 Jul 20 04:30:01.185565 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2195/4302] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:00 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1500 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:01.195151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21264c9a-9d29-4886-8aae-9667fb88b136 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:01.196194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21264c9a-9d29-4886-8aae-9667fb88b136 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:01.203669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21264c9a-9d29-4886-8aae-9667fb88b136 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.204380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21264c9a-9d29-4886-8aae-9667fb88b136 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.205352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21264c9a-9d29-4886-8aae-9667fb88b136 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.205796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21264c9a-9d29-4886-8aae-9667fb88b136 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.346643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ffbbf459-774b-460b-ac89-07dd6ca8d364 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:01.363606 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ffbbf459-774b-460b-ac89-07dd6ca8d364 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1317 microversion: 2.1 time: 0.462152 Jul 20 04:30:01.368267 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2108/4303] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:00 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:01.375345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eda6c72a-a727-4509-9981-2093365c3261 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:01.376158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eda6c72a-a727-4509-9981-2093365c3261 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:01.395979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eda6c72a-a727-4509-9981-2093365c3261 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.397468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eda6c72a-a727-4509-9981-2093365c3261 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.398631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eda6c72a-a727-4509-9981-2093365c3261 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.403746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eda6c72a-a727-4509-9981-2093365c3261 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.455122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eda6c72a-a727-4509-9981-2093365c3261 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:01.577924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-21264c9a-9d29-4886-8aae-9667fb88b136 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:01.589144 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eda6c72a-a727-4509-9981-2093365c3261 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 204 len: 0 microversion: 2.1 time: 0.219308 Jul 20 04:30:01.590180 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2109/4304] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:01 2022] DELETE /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:01.593570 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21264c9a-9d29-4886-8aae-9667fb88b136 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.406077 Jul 20 04:30:01.594386 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2196/4305] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:01 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:01.605753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39581141-a07f-4c4b-8a5b-7f31934a0b6d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:01.608514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-39581141-a07f-4c4b-8a5b-7f31934a0b6d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:01.615970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7274f22e-4c59-4e93-afa2-43ec6b7719ef tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:01.619466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7274f22e-4c59-4e93-afa2-43ec6b7719ef tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:01.622704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39581141-a07f-4c4b-8a5b-7f31934a0b6d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.623172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39581141-a07f-4c4b-8a5b-7f31934a0b6d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.628401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39581141-a07f-4c4b-8a5b-7f31934a0b6d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.628867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39581141-a07f-4c4b-8a5b-7f31934a0b6d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.634731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7274f22e-4c59-4e93-afa2-43ec6b7719ef tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.637104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7274f22e-4c59-4e93-afa2-43ec6b7719ef tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.638067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7274f22e-4c59-4e93-afa2-43ec6b7719ef tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.638732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7274f22e-4c59-4e93-afa2-43ec6b7719ef tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.687310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:01.688979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:01.960267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39581141-a07f-4c4b-8a5b-7f31934a0b6d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:01.977354 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39581141-a07f-4c4b-8a5b-7f31934a0b6d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1292 microversion: 2.1 time: 0.378402 Jul 20 04:30:01.978625 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2197/4306] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:01 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1292 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:02.000242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b601a32c-3834-42f3-9f7e-b45a60fff350 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:02.001878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b601a32c-3834-42f3-9f7e-b45a60fff350 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:02.011199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b601a32c-3834-42f3-9f7e-b45a60fff350 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.011697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b601a32c-3834-42f3-9f7e-b45a60fff350 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.012602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b601a32c-3834-42f3-9f7e-b45a60fff350 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.013056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b601a32c-3834-42f3-9f7e-b45a60fff350 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.057424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7274f22e-4c59-4e93-afa2-43ec6b7719ef tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:02.069123 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7274f22e-4c59-4e93-afa2-43ec6b7719ef tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.457480 Jul 20 04:30:02.079679 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2110/4307] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:01 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:02.082244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8ca8a43a-2c6a-4e69-95d5-909713357b65 req-48596ab6-a323-408b-8876-3880bbe40a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b86ac9-d7cc-4afa-9be9-be583eba6598", "name": "network-vif-plugged", "status": "completed", "tag": "1082187f-8c8a-4b79-8b92-bbadee906300"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:02.097832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8ca8a43a-2c6a-4e69-95d5-909713357b65 req-48596ab6-a323-408b-8876-3880bbe40a10 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.098646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8ca8a43a-2c6a-4e69-95d5-909713357b65 req-48596ab6-a323-408b-8876-3880bbe40a10 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.114080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b601a32c-3834-42f3-9f7e-b45a60fff350 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Locking {{(pid=119808) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 20 04:30:02.133710 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8ca8a43a-2c6a-4e69-95d5-909713357b65 req-48596ab6-a323-408b-8876-3880bbe40a10 service nova] Creating event network-vif-plugged:1082187f-8c8a-4b79-8b92-bbadee906300 for instance b8b86ac9-d7cc-4afa-9be9-be583eba6598 on n-h1-764485-11 Jul 20 04:30:02.148828 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8ca8a43a-2c6a-4e69-95d5-909713357b65 req-48596ab6-a323-408b-8876-3880bbe40a10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067750 Jul 20 04:30:02.172735 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2111/4308] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:02.194549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-caa2b6b0-439e-4166-882d-f275ac638cb6 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:02.195448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-caa2b6b0-439e-4166-882d-f275ac638cb6 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:02.217233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-caa2b6b0-439e-4166-882d-f275ac638cb6 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.219146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-caa2b6b0-439e-4166-882d-f275ac638cb6 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.221832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-caa2b6b0-439e-4166-882d-f275ac638cb6 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.222729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-caa2b6b0-439e-4166-882d-f275ac638cb6 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.244005 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b601a32c-3834-42f3-9f7e-b45a60fff350 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.263058 Jul 20 04:30:02.245142 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2198/4309] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:01 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:30:02.253199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-03fbbb18-f054-4e55-8f36-a50c313dd04a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:02.254373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-03fbbb18-f054-4e55-8f36-a50c313dd04a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:02.269939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03fbbb18-f054-4e55-8f36-a50c313dd04a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.270864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03fbbb18-f054-4e55-8f36-a50c313dd04a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.273247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03fbbb18-f054-4e55-8f36-a50c313dd04a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.279858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03fbbb18-f054-4e55-8f36-a50c313dd04a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.622862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=16 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:02.712408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-03fbbb18-f054-4e55-8f36-a50c313dd04a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:02.725192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-caa2b6b0-439e-4166-882d-f275ac638cb6 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:02.734522 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-03fbbb18-f054-4e55-8f36-a50c313dd04a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.482663 Jul 20 04:30:02.736268 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2199/4310] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:02 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:02.743596 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-caa2b6b0-439e-4166-882d-f275ac638cb6 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1324 microversion: 2.1 time: 0.569030 Jul 20 04:30:02.747833 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2112/4311] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:02 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1324 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:02.763307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a4b18739-d8fc-4d04-b455-8e51cc06b51d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:02.764250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a4b18739-d8fc-4d04-b455-8e51cc06b51d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:02.771031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-14712970-ba06-42bd-b4ba-bab1d8d63443 req-e6de655f-59fb-4ddf-838d-3a67d3ca5fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4372f5b0-7f1d-44b8-8186-6927036eae91", "tag": "de2cdb51-eb69-48ef-9bce-341a3c69715a"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:02.777681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4b18739-d8fc-4d04-b455-8e51cc06b51d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.781629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4b18739-d8fc-4d04-b455-8e51cc06b51d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.782726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4b18739-d8fc-4d04-b455-8e51cc06b51d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.783358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4b18739-d8fc-4d04-b455-8e51cc06b51d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.790970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-14712970-ba06-42bd-b4ba-bab1d8d63443 req-e6de655f-59fb-4ddf-838d-3a67d3ca5fca service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.794195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-14712970-ba06-42bd-b4ba-bab1d8d63443 req-e6de655f-59fb-4ddf-838d-3a67d3ca5fca service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.821991 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-14712970-ba06-42bd-b4ba-bab1d8d63443 req-e6de655f-59fb-4ddf-838d-3a67d3ca5fca service nova] Creating event network-changed:de2cdb51-eb69-48ef-9bce-341a3c69715a for instance 4372f5b0-7f1d-44b8-8186-6927036eae91 on n-h1-764485-11 Jul 20 04:30:02.827693 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-14712970-ba06-42bd-b4ba-bab1d8d63443 req-e6de655f-59fb-4ddf-838d-3a67d3ca5fca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067580 Jul 20 04:30:02.828711 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2113/4312] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:02.837824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-535a1f91-bed7-48dc-8f68-6d5a75fb327c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:02.851074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-535a1f91-bed7-48dc-8f68-6d5a75fb327c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.853342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-535a1f91-bed7-48dc-8f68-6d5a75fb327c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.884746 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-535a1f91-bed7-48dc-8f68-6d5a75fb327c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] HTTP exception thrown: Instance c037b53b-2303-44d0-bb77-c8fa405473bb is locked Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-535a1f91-bed7-48dc-8f68-6d5a75fb327c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Request method failure captured: Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action HTTP/1.1 Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 15 Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14NwtqXY4gJOJdaQfNhy2FGHL1vHP3OiKcVH-Gr5N9oC3B6qjABKjSyLs8P6SaKylJs19ApYqqg5fwES-KSkLNqcl2qKzDVVeJngnxSlM4ze5o2Ef233SlZPhPTfozKQmRa8qo1Tc7EzdNN77K3K55Vks8oY9WaU6RPAKu1A_e5bvFE Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1be9144d8b214ecb8e416318d92b92ea Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1be9144d8b214ecb8e416318d92b92ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1be9144d8b214ecb8e416318d92b92ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1be9144d8b214ecb8e416318d92b92ea", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1be9144d8b214ecb8e416318d92b92ea"}]}] Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1be9144d8b214ecb8e416318d92b92ea Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerActionsTestJSON-1421550179-project Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: b559a8f5a1724682831d18c3f7ddfdf2 Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerActionsTestJSON-1421550179-project Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: {"os-stop": {}} Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance c037b53b-2303-44d0-bb77-c8fa405473bb is locked Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'c037b53b-2303-44d0-bb77-c8fa405473bb', 'body': {'os-stop': {}}} Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance c037b53b-2303-44d0-bb77-c8fa405473bb is locked Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance c037b53b-2303-44d0-bb77-c8fa405473bb is locked Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c037b53b-2303-44d0-bb77-c8fa405473bb is locked Jul 20 04:30:02.886977 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:02.893919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-535a1f91-bed7-48dc-8f68-6d5a75fb327c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Returning 409 to user: Instance c037b53b-2303-44d0-bb77-c8fa405473bb is locked {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:02.894854 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-535a1f91-bed7-48dc-8f68-6d5a75fb327c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 409 len: 107 microversion: 2.1 time: 0.064426 Jul 20 04:30:02.895558 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2114/4313] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:02 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 107 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:30:02.906698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-155ad8c9-25da-4402-acf3-b159d4f31a2f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:02.907464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-155ad8c9-25da-4402-acf3-b159d4f31a2f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:02.916030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-155ad8c9-25da-4402-acf3-b159d4f31a2f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.916919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-155ad8c9-25da-4402-acf3-b159d4f31a2f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.917626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-155ad8c9-25da-4402-acf3-b159d4f31a2f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.918219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-155ad8c9-25da-4402-acf3-b159d4f31a2f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.985030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-155ad8c9-25da-4402-acf3-b159d4f31a2f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Unlocking {{(pid=119807) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 20 04:30:03.034579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:03.050185 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-155ad8c9-25da-4402-acf3-b159d4f31a2f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.148510 Jul 20 04:30:03.050930 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2115/4314] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:02 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:30:03.059258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cb4edffb-cefc-456a-9f2a-a698c58f0095 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:03.059978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cb4edffb-cefc-456a-9f2a-a698c58f0095 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:03.066547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb4edffb-cefc-456a-9f2a-a698c58f0095 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.067105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb4edffb-cefc-456a-9f2a-a698c58f0095 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.068254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb4edffb-cefc-456a-9f2a-a698c58f0095 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.068664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb4edffb-cefc-456a-9f2a-a698c58f0095 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.275948 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a4b18739-d8fc-4d04-b455-8e51cc06b51d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:03.285962 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a4b18739-d8fc-4d04-b455-8e51cc06b51d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1317 microversion: 2.1 time: 0.546801 Jul 20 04:30:03.287466 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2200/4315] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:02 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:03.294683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1ef6f2cd-627e-4870-8ae0-e323a9385b5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:03.301636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ef6f2cd-627e-4870-8ae0-e323a9385b5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.302340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ef6f2cd-627e-4870-8ae0-e323a9385b5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.334254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1ef6f2cd-627e-4870-8ae0-e323a9385b5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Going to try to stop instance {{(pid=119808) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:30:03.427262 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1ef6f2cd-627e-4870-8ae0-e323a9385b5c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.137786 Jul 20 04:30:03.429020 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2201/4316] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:03 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:30:03.432826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cb4edffb-cefc-456a-9f2a-a698c58f0095 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:03.435761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a8401e67-4fd4-4078-9e2f-69e13f797a2f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:03.436626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a8401e67-4fd4-4078-9e2f-69e13f797a2f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:03.445219 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cb4edffb-cefc-456a-9f2a-a698c58f0095 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1292 microversion: 2.1 time: 0.391361 Jul 20 04:30:03.446087 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2116/4317] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:03 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1292 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:03.452427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-258c248f-364a-4e52-b378-a090b78257ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:03.453245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-258c248f-364a-4e52-b378-a090b78257ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:03.455596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:03.457229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8401e67-4fd4-4078-9e2f-69e13f797a2f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.459120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8401e67-4fd4-4078-9e2f-69e13f797a2f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.462835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8401e67-4fd4-4078-9e2f-69e13f797a2f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.463874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8401e67-4fd4-4078-9e2f-69e13f797a2f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.481734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-258c248f-364a-4e52-b378-a090b78257ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.482256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-258c248f-364a-4e52-b378-a090b78257ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.483671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-258c248f-364a-4e52-b378-a090b78257ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.484159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-258c248f-364a-4e52-b378-a090b78257ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.757416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a8401e67-4fd4-4078-9e2f-69e13f797a2f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:03.765656 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a8401e67-4fd4-4078-9e2f-69e13f797a2f tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.335438 Jul 20 04:30:03.766495 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2202/4318] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:03 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:03.804483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-258c248f-364a-4e52-b378-a090b78257ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:03.814212 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-258c248f-364a-4e52-b378-a090b78257ed tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.366277 Jul 20 04:30:03.815026 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2117/4319] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:03 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:03.823119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe232da3-e9a5-4811-a97f-296c30e453b3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:03.823765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe232da3-e9a5-4811-a97f-296c30e453b3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:03.832089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe232da3-e9a5-4811-a97f-296c30e453b3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.832540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe232da3-e9a5-4811-a97f-296c30e453b3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.833689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe232da3-e9a5-4811-a97f-296c30e453b3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.835186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe232da3-e9a5-4811-a97f-296c30e453b3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.919212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7b8c8f9e-bfbc-4cef-aa4a-bde201470e51 tempest-ComputeTenantNetworksTest-1691861081 tempest-ComputeTenantNetworksTest-1691861081-project] Calling method '.version_select at 0x7fbf9dcb23a0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:04.532170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe232da3-e9a5-4811-a97f-296c30e453b3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:04.542075 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe232da3-e9a5-4811-a97f-296c30e453b3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1324 microversion: 2.1 time: 0.726155 Jul 20 04:30:04.542936 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2118/4320] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:03 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1324 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:04.548948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b85cb8c5-5189-4bf8-8c51-4513d2e3a32c tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:04.549641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b85cb8c5-5189-4bf8-8c51-4513d2e3a32c tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:04.558388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b85cb8c5-5189-4bf8-8c51-4513d2e3a32c tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:04.558964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b85cb8c5-5189-4bf8-8c51-4513d2e3a32c tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:04.560144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b85cb8c5-5189-4bf8-8c51-4513d2e3a32c tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:04.560589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b85cb8c5-5189-4bf8-8c51-4513d2e3a32c tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:04.575125 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7b8c8f9e-bfbc-4cef-aa4a-bde201470e51 tempest-ComputeTenantNetworksTest-1691861081 tempest-ComputeTenantNetworksTest-1691861081-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.799946 Jul 20 04:30:04.576965 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2203/4321] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 04:30:03 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:04.587211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f4b621c6-320c-47ae-bc55-6dab500e9f1b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:04.589842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f4b621c6-320c-47ae-bc55-6dab500e9f1b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:04.598047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4b621c6-320c-47ae-bc55-6dab500e9f1b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:04.600742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4b621c6-320c-47ae-bc55-6dab500e9f1b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:04.602024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4b621c6-320c-47ae-bc55-6dab500e9f1b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:04.602701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4b621c6-320c-47ae-bc55-6dab500e9f1b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:04.874925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b85cb8c5-5189-4bf8-8c51-4513d2e3a32c tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:04.883600 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b85cb8c5-5189-4bf8-8c51-4513d2e3a32c tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1317 microversion: 2.1 time: 0.339381 Jul 20 04:30:04.884361 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2119/4322] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:04 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:04.898355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0afa131f-fad3-4f12-929e-49cf05649817 tempest-ComputeTenantNetworksTest-1691861081 tempest-ComputeTenantNetworksTest-1691861081-project] Calling method '.version_select at 0x7fbf9c2c5670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:04.903014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f4b621c6-320c-47ae-bc55-6dab500e9f1b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:04.911328 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f4b621c6-320c-47ae-bc55-6dab500e9f1b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1292 microversion: 2.1 time: 0.332750 Jul 20 04:30:04.925833 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2204/4323] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:04 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1292 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:04.930953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a8773ab1-9dfc-42b4-9849-768cb4e48494 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:04.931599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a8773ab1-9dfc-42b4-9849-768cb4e48494 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:04.937927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8773ab1-9dfc-42b4-9849-768cb4e48494 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:04.938678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8773ab1-9dfc-42b4-9849-768cb4e48494 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:04.939631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8773ab1-9dfc-42b4-9849-768cb4e48494 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:04.940266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8773ab1-9dfc-42b4-9849-768cb4e48494 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.113214 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0afa131f-fad3-4f12-929e-49cf05649817 tempest-ComputeTenantNetworksTest-1691861081 tempest-ComputeTenantNetworksTest-1691861081-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks/a1d5a569-2133-4ceb-adbe-9f51b651301c" status: 200 len: 140 microversion: 2.1 time: 0.218812 Jul 20 04:30:05.119138 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2120/4324] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:30:04 2022] GET /compute/v2.1/os-tenant-networks/a1d5a569-2133-4ceb-adbe-9f51b651301c => generated 140 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:05.150104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7c37d18b-e0fa-4848-9b3f-8faa33d8b80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:05.151783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7c37d18b-e0fa-4848-9b3f-8faa33d8b80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:05.198319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c37d18b-e0fa-4848-9b3f-8faa33d8b80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.200224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c37d18b-e0fa-4848-9b3f-8faa33d8b80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.202558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c37d18b-e0fa-4848-9b3f-8faa33d8b80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.203029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c37d18b-e0fa-4848-9b3f-8faa33d8b80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.229167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a8773ab1-9dfc-42b4-9849-768cb4e48494 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:05.238540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a8773ab1-9dfc-42b4-9849-768cb4e48494 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.311019 Jul 20 04:30:05.239876 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2205/4325] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:04 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:05.406704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7c37d18b-e0fa-4848-9b3f-8faa33d8b80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:05.417683 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7c37d18b-e0fa-4848-9b3f-8faa33d8b80e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.290902 Jul 20 04:30:05.433323 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2121/4326] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:05 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:05.560268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7e381c91-acb0-4dfd-9514-95f1c7e4ea9e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:05.561132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7e381c91-acb0-4dfd-9514-95f1c7e4ea9e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:05.572014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7e381c91-acb0-4dfd-9514-95f1c7e4ea9e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.572479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7e381c91-acb0-4dfd-9514-95f1c7e4ea9e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.574095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7e381c91-acb0-4dfd-9514-95f1c7e4ea9e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.574701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7e381c91-acb0-4dfd-9514-95f1c7e4ea9e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.749769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7e381c91-acb0-4dfd-9514-95f1c7e4ea9e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:05.762564 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7e381c91-acb0-4dfd-9514-95f1c7e4ea9e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1522 microversion: 2.1 time: 0.206889 Jul 20 04:30:05.763162 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2206/4327] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:05 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:05.781759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-466762b8-6306-4c3e-bcb3-110234809515 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:05.782269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-466762b8-6306-4c3e-bcb3-110234809515 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:05.791417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-466762b8-6306-4c3e-bcb3-110234809515 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.791930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-466762b8-6306-4c3e-bcb3-110234809515 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.792901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-466762b8-6306-4c3e-bcb3-110234809515 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.793350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-466762b8-6306-4c3e-bcb3-110234809515 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.832400 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-466762b8-6306-4c3e-bcb3-110234809515 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] HTTP exception thrown: Instance is not a member of specified network Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-466762b8-6306-4c3e-bcb3-110234809515 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Request method failure captured: Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598/ips/invalid HTTP/1.1 Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14SzF5OOPveeV7S0NN5E5EA7fpnrmp0LZFnj_cJnAmLm1xJE4kxOjSyWdEEVdoYm2cNFl_2JJ2_z7V-Lhk_0tAlISXxZcdO1iSUDoEpMDDZdlhfkdV1yIpIkdUtjJM38mHGDOalmxJIY2AuuWnjOZPzZ1z3SdNxyKoHjJ8wj9fF9zDQ Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 21121109b75843408806778a28790f0f Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2107998555 Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/21121109b75843408806778a28790f0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21121109b75843408806778a28790f0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_21121109b75843408806778a28790f0f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21121109b75843408806778a28790f0f"}]}] Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2107998555 Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 21121109b75843408806778a28790f0f Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2107998555 Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerAddressesNegativeTestJSON-2107998555-project Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: fd1e95f3abd3472c8a1e5fdbb4f07914 Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2107998555-project Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance is not a member of specified network Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'server_id': 'b8b86ac9-d7cc-4afa-9be9-be583eba6598', 'id': 'invalid'} Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 20 04:30:05.847716 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:05.853741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-466762b8-6306-4c3e-bcb3-110234809515 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:05.857910 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-466762b8-6306-4c3e-bcb3-110234809515 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.080797 Jul 20 04:30:05.859071 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2122/4328] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:30:05 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598/ips/invalid => generated 91 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:30:05.874584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a77893e1-0194-44d4-9869-eba2d8a32799 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:05.875407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a77893e1-0194-44d4-9869-eba2d8a32799 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Failed to fetch instance by id 999 {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:30:05.876112 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-a77893e1-0194-44d4-9869-eba2d8a32799 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] HTTP exception thrown: Instance 999 could not be found. Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a77893e1-0194-44d4-9869-eba2d8a32799 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Request method failure captured: Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14SzF5OOPveeV7S0NN5E5EA7fpnrmp0LZFnj_cJnAmLm1xJE4kxOjSyWdEEVdoYm2cNFl_2JJ2_z7V-Lhk_0tAlISXxZcdO1iSUDoEpMDDZdlhfkdV1yIpIkdUtjJM38mHGDOalmxJIY2AuuWnjOZPzZ1z3SdNxyKoHjJ8wj9fF9zDQ Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 21121109b75843408806778a28790f0f Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2107998555 Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/21121109b75843408806778a28790f0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21121109b75843408806778a28790f0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_21121109b75843408806778a28790f0f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21121109b75843408806778a28790f0f"}]}] Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2107998555 Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 21121109b75843408806778a28790f0f Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2107998555 Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerAddressesNegativeTestJSON-2107998555-project Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: fd1e95f3abd3472c8a1e5fdbb4f07914 Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2107998555-project Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 999 could not be found. Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'server_id': '999'} Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 20 04:30:05.878071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:05.885216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a77893e1-0194-44d4-9869-eba2d8a32799 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:05.886330 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a77893e1-0194-44d4-9869-eba2d8a32799 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.018969 Jul 20 04:30:05.892289 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2207/4329] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Jul 20 04:30:05 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:30:05.901237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c302262c-0128-4cc5-bbce-409273286c24 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:05.902201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c302262c-0128-4cc5-bbce-409273286c24 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:05.903545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ab6b794-789b-487d-ba86-b5dc5433cc0a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:05.905239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ab6b794-789b-487d-ba86-b5dc5433cc0a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:05.913677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c302262c-0128-4cc5-bbce-409273286c24 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.914843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c302262c-0128-4cc5-bbce-409273286c24 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.915918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c302262c-0128-4cc5-bbce-409273286c24 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.916581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c302262c-0128-4cc5-bbce-409273286c24 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.920716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ab6b794-789b-487d-ba86-b5dc5433cc0a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.923378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ab6b794-789b-487d-ba86-b5dc5433cc0a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.924504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ab6b794-789b-487d-ba86-b5dc5433cc0a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.924957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ab6b794-789b-487d-ba86-b5dc5433cc0a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.979011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ab6b794-789b-487d-ba86-b5dc5433cc0a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:06.081402 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ab6b794-789b-487d-ba86-b5dc5433cc0a tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 204 len: 0 microversion: 2.1 time: 0.184593 Jul 20 04:30:06.082900 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2123/4330] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:05 2022] DELETE /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:06.089974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ed2b8bf2-f70f-4b2c-bd0e-bb896a786347 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:06.090684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ed2b8bf2-f70f-4b2c-bd0e-bb896a786347 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:06.097214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed2b8bf2-f70f-4b2c-bd0e-bb896a786347 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.097931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed2b8bf2-f70f-4b2c-bd0e-bb896a786347 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.098707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed2b8bf2-f70f-4b2c-bd0e-bb896a786347 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.099157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed2b8bf2-f70f-4b2c-bd0e-bb896a786347 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.159024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c302262c-0128-4cc5-bbce-409273286c24 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:06.167839 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c302262c-0128-4cc5-bbce-409273286c24 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1317 microversion: 2.1 time: 0.271600 Jul 20 04:30:06.169073 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2208/4331] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:05 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:06.174282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5f51d50-08a7-4023-bb6c-a30e24371042 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:06.175307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d5f51d50-08a7-4023-bb6c-a30e24371042 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:06.182639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5f51d50-08a7-4023-bb6c-a30e24371042 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.183437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5f51d50-08a7-4023-bb6c-a30e24371042 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.184649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5f51d50-08a7-4023-bb6c-a30e24371042 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.185583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5f51d50-08a7-4023-bb6c-a30e24371042 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.410136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ed2b8bf2-f70f-4b2c-bd0e-bb896a786347 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:06.420320 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ed2b8bf2-f70f-4b2c-bd0e-bb896a786347 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1292 microversion: 2.1 time: 0.335171 Jul 20 04:30:06.436147 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2124/4332] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:06 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1292 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:06.444873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-54a465eb-b485-420d-a80f-59cddaffa74d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:06.445877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-54a465eb-b485-420d-a80f-59cddaffa74d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:06.453860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54a465eb-b485-420d-a80f-59cddaffa74d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.454805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54a465eb-b485-420d-a80f-59cddaffa74d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.456022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54a465eb-b485-420d-a80f-59cddaffa74d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.456625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54a465eb-b485-420d-a80f-59cddaffa74d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.474708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d5f51d50-08a7-4023-bb6c-a30e24371042 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:06.495975 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d5f51d50-08a7-4023-bb6c-a30e24371042 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1528 microversion: 2.1 time: 0.324250 Jul 20 04:30:06.499758 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2209/4333] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:06 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1528 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:06.518864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-85c0d7fd-0048-4add-bb8a-8e3730859257 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:06.520504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-85c0d7fd-0048-4add-bb8a-8e3730859257 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:06.528475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85c0d7fd-0048-4add-bb8a-8e3730859257 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.529242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85c0d7fd-0048-4add-bb8a-8e3730859257 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.530375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85c0d7fd-0048-4add-bb8a-8e3730859257 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.530974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85c0d7fd-0048-4add-bb8a-8e3730859257 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.916896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-54a465eb-b485-420d-a80f-59cddaffa74d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:06.924499 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-54a465eb-b485-420d-a80f-59cddaffa74d tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1506 microversion: 2.1 time: 0.487426 Jul 20 04:30:06.925084 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2125/4334] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:06 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:06.945709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-85c0d7fd-0048-4add-bb8a-8e3730859257 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:06.949227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:06.954961 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-85c0d7fd-0048-4add-bb8a-8e3730859257 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.445307 Jul 20 04:30:06.955938 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2210/4335] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:06 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:07.188234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a7d7757-4211-4380-8c69-2faa7416fd5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:07.189301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7a7d7757-4211-4380-8c69-2faa7416fd5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:07.203424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a7d7757-4211-4380-8c69-2faa7416fd5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.205205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a7d7757-4211-4380-8c69-2faa7416fd5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.207901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a7d7757-4211-4380-8c69-2faa7416fd5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.211820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a7d7757-4211-4380-8c69-2faa7416fd5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.216672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-21d507e3-9773-4060-88bf-6ea0b0d19f47 req-3ccbc197-e143-4e39-be6d-e59fec04c397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b20769a-b7f7-42e9-a508-0a69841e33c5", "name": "network-vif-plugged", "status": "completed", "tag": "c279d121-fd2b-4719-a1ea-6cc519800111"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:07.247790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-21d507e3-9773-4060-88bf-6ea0b0d19f47 req-3ccbc197-e143-4e39-be6d-e59fec04c397 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.250347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-21d507e3-9773-4060-88bf-6ea0b0d19f47 req-3ccbc197-e143-4e39-be6d-e59fec04c397 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.271705 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-21d507e3-9773-4060-88bf-6ea0b0d19f47 req-3ccbc197-e143-4e39-be6d-e59fec04c397 service nova] Creating event network-vif-plugged:c279d121-fd2b-4719-a1ea-6cc519800111 for instance 8b20769a-b7f7-42e9-a508-0a69841e33c5 on n-h2-764485-11 Jul 20 04:30:07.278892 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-21d507e3-9773-4060-88bf-6ea0b0d19f47 req-3ccbc197-e143-4e39-be6d-e59fec04c397 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066763 Jul 20 04:30:07.280466 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2211/4336] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:07.439365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dbb39f84-fe66-4da6-a4c1-0f68d289ab48 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:07.440116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dbb39f84-fe66-4da6-a4c1-0f68d289ab48 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:07.447374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbb39f84-fe66-4da6-a4c1-0f68d289ab48 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.448219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbb39f84-fe66-4da6-a4c1-0f68d289ab48 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.450751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbb39f84-fe66-4da6-a4c1-0f68d289ab48 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.451355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbb39f84-fe66-4da6-a4c1-0f68d289ab48 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.683890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7a7d7757-4211-4380-8c69-2faa7416fd5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:07.693857 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7a7d7757-4211-4380-8c69-2faa7416fd5b tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1317 microversion: 2.1 time: 0.511529 Jul 20 04:30:07.694408 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2126/4337] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:07 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:07.703264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-178f7953-a6ed-4bd2-9ffd-219aee22673e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:07.703264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-178f7953-a6ed-4bd2-9ffd-219aee22673e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:07.707490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-178f7953-a6ed-4bd2-9ffd-219aee22673e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.708097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-178f7953-a6ed-4bd2-9ffd-219aee22673e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.708910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-178f7953-a6ed-4bd2-9ffd-219aee22673e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.709533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-178f7953-a6ed-4bd2-9ffd-219aee22673e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.878127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dbb39f84-fe66-4da6-a4c1-0f68d289ab48 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:07.893511 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dbb39f84-fe66-4da6-a4c1-0f68d289ab48 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1292 microversion: 2.1 time: 0.458736 Jul 20 04:30:07.897182 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2212/4338] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:07 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1292 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:07.941712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8439afcb-c2ab-4095-8263-454fa0eac998 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:07.942549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8439afcb-c2ab-4095-8263-454fa0eac998 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:07.952817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8439afcb-c2ab-4095-8263-454fa0eac998 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.953935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8439afcb-c2ab-4095-8263-454fa0eac998 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.954900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8439afcb-c2ab-4095-8263-454fa0eac998 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.955537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8439afcb-c2ab-4095-8263-454fa0eac998 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.076814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8439afcb-c2ab-4095-8263-454fa0eac998 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:08.097988 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8439afcb-c2ab-4095-8263-454fa0eac998 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1464 microversion: 2.1 time: 0.159732 Jul 20 04:30:08.100005 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2213/4339] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:07 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:08.119397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-681b0be2-6d6b-4f70-8b8b-9cfe21de1c4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:08.122529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-681b0be2-6d6b-4f70-8b8b-9cfe21de1c4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:08.127411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-178f7953-a6ed-4bd2-9ffd-219aee22673e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:08.132992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-681b0be2-6d6b-4f70-8b8b-9cfe21de1c4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.133767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-681b0be2-6d6b-4f70-8b8b-9cfe21de1c4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.135379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-681b0be2-6d6b-4f70-8b8b-9cfe21de1c4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.136097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-681b0be2-6d6b-4f70-8b8b-9cfe21de1c4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.136953 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-178f7953-a6ed-4bd2-9ffd-219aee22673e tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1528 microversion: 2.1 time: 0.441416 Jul 20 04:30:08.137555 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2127/4340] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:07 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1528 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:08.145631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d443da42-1742-49e6-b162-49ff6c3e22ae req-a3581620-d628-4e13-b01d-34b803cc4baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7f77fd-f2ed-4d3a-a420-a4914119382c", "name": "network-vif-deleted", "tag": "2ea61db4-6fbb-493f-a760-815a661a2d8f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:08.166129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d443da42-1742-49e6-b162-49ff6c3e22ae req-a3581620-d628-4e13-b01d-34b803cc4baa service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.166583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d443da42-1742-49e6-b162-49ff6c3e22ae req-a3581620-d628-4e13-b01d-34b803cc4baa service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.189570 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d443da42-1742-49e6-b162-49ff6c3e22ae req-a3581620-d628-4e13-b01d-34b803cc4baa service nova] Creating event network-vif-deleted:2ea61db4-6fbb-493f-a760-815a661a2d8f for instance 4c7f77fd-f2ed-4d3a-a420-a4914119382c on n-h2-764485-11 Jul 20 04:30:08.214697 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d443da42-1742-49e6-b162-49ff6c3e22ae req-a3581620-d628-4e13-b01d-34b803cc4baa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073555 Jul 20 04:30:08.215870 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2128/4341] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:08.422655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-681b0be2-6d6b-4f70-8b8b-9cfe21de1c4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:08.437139 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-681b0be2-6d6b-4f70-8b8b-9cfe21de1c4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.335469 Jul 20 04:30:08.446962 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2214/4342] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:08 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:08.711137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-04f4609d-210f-4336-accb-8ba1ac59bef8 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:08.711880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-04f4609d-210f-4336-accb-8ba1ac59bef8 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:08.718482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-04f4609d-210f-4336-accb-8ba1ac59bef8 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.719213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-04f4609d-210f-4336-accb-8ba1ac59bef8 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.720187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-04f4609d-210f-4336-accb-8ba1ac59bef8 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.720779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-04f4609d-210f-4336-accb-8ba1ac59bef8 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.913157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b2b26a8d-f53f-4f75-9d6e-bcab33448e59 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:08.914160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b2b26a8d-f53f-4f75-9d6e-bcab33448e59 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:08.922408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2b26a8d-f53f-4f75-9d6e-bcab33448e59 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.923202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2b26a8d-f53f-4f75-9d6e-bcab33448e59 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.924337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2b26a8d-f53f-4f75-9d6e-bcab33448e59 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.925127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2b26a8d-f53f-4f75-9d6e-bcab33448e59 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.983651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-04f4609d-210f-4336-accb-8ba1ac59bef8 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:08.992977 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-04f4609d-210f-4336-accb-8ba1ac59bef8 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1317 microversion: 2.1 time: 0.285966 Jul 20 04:30:08.994199 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2129/4343] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:08 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:09.122879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2b168fec-d687-442f-bf70-5d6b3674f1ab tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:09.123753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2b168fec-d687-442f-bf70-5d6b3674f1ab tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:09.138684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b168fec-d687-442f-bf70-5d6b3674f1ab tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.139293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b168fec-d687-442f-bf70-5d6b3674f1ab tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.140332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b168fec-d687-442f-bf70-5d6b3674f1ab tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.140873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b168fec-d687-442f-bf70-5d6b3674f1ab tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.200806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b2b26a8d-f53f-4f75-9d6e-bcab33448e59 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:09.210842 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b2b26a8d-f53f-4f75-9d6e-bcab33448e59 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1292 microversion: 2.1 time: 0.302342 Jul 20 04:30:09.214500 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2215/4344] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:08 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1292 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:09.220161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c5d2a310-3e03-4ef7-ab70-8dab8bb82e08 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:09.220984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c5d2a310-3e03-4ef7-ab70-8dab8bb82e08 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:09.231790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5d2a310-3e03-4ef7-ab70-8dab8bb82e08 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.232400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5d2a310-3e03-4ef7-ab70-8dab8bb82e08 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.233493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5d2a310-3e03-4ef7-ab70-8dab8bb82e08 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.234064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5d2a310-3e03-4ef7-ab70-8dab8bb82e08 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.243695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b168fec-d687-442f-bf70-5d6b3674f1ab tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.245065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b168fec-d687-442f-bf70-5d6b3674f1ab tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.246833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-2b168fec-d687-442f-bf70-5d6b3674f1ab tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lazy-loading 'fault' on Instance uuid 4c7f77fd-f2ed-4d3a-a420-a4914119382c {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:30:09.485220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2b168fec-d687-442f-bf70-5d6b3674f1ab tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:09.500258 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2b168fec-d687-442f-bf70-5d6b3674f1ab tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 200 len: 1304 microversion: 2.1 time: 0.383676 Jul 20 04:30:09.502871 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2130/4345] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:09 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 1304 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:09.516300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-12e62ae5-786d-4f69-9b0d-ed7195372e0b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:09.517146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-12e62ae5-786d-4f69-9b0d-ed7195372e0b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:09.526871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12e62ae5-786d-4f69-9b0d-ed7195372e0b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.527714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12e62ae5-786d-4f69-9b0d-ed7195372e0b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.529186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12e62ae5-786d-4f69-9b0d-ed7195372e0b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.529787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12e62ae5-786d-4f69-9b0d-ed7195372e0b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.723874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c5d2a310-3e03-4ef7-ab70-8dab8bb82e08 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:09.736122 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c5d2a310-3e03-4ef7-ab70-8dab8bb82e08 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1528 microversion: 2.1 time: 0.519978 Jul 20 04:30:09.737076 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2216/4346] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:09 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1528 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:09.961621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-12e62ae5-786d-4f69-9b0d-ed7195372e0b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:09.969796 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-12e62ae5-786d-4f69-9b0d-ed7195372e0b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.464405 Jul 20 04:30:09.970400 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2131/4347] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:09 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:10.011116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5165b3c5-fd82-4218-91dd-ef2f6c6224de tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:10.011810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5165b3c5-fd82-4218-91dd-ef2f6c6224de tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:10.027858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5165b3c5-fd82-4218-91dd-ef2f6c6224de tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.029786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5165b3c5-fd82-4218-91dd-ef2f6c6224de tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.031153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5165b3c5-fd82-4218-91dd-ef2f6c6224de tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.034810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5165b3c5-fd82-4218-91dd-ef2f6c6224de tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.242251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-091d5a73-320f-461a-bc40-1ba8aa47c04a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:10.243715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-091d5a73-320f-461a-bc40-1ba8aa47c04a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:10.252417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-091d5a73-320f-461a-bc40-1ba8aa47c04a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.253798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-091d5a73-320f-461a-bc40-1ba8aa47c04a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.255274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-091d5a73-320f-461a-bc40-1ba8aa47c04a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.256009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-091d5a73-320f-461a-bc40-1ba8aa47c04a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.263745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:10.861651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-091d5a73-320f-461a-bc40-1ba8aa47c04a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:10.879069 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-091d5a73-320f-461a-bc40-1ba8aa47c04a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1472 microversion: 2.1 time: 0.651430 Jul 20 04:30:10.885612 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2132/4348] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:10 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1472 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:10.910338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2a263e3f-5ab5-4fd0-afcf-2c9ed8f722d1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:10.912285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2a263e3f-5ab5-4fd0-afcf-2c9ed8f722d1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: 4c7f77fd-f2ed-4d3a-a420-a4914119382c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:10.920454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5165b3c5-fd82-4218-91dd-ef2f6c6224de tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:10.943943 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5165b3c5-fd82-4218-91dd-ef2f6c6224de tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1317 microversion: 2.1 time: 0.936271 Jul 20 04:30:10.946577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a263e3f-5ab5-4fd0-afcf-2c9ed8f722d1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.946953 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2217/4349] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:10 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1317 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:10.953552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-883568d5-f921-4af4-86f7-c48b593c68a3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:10.958350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a263e3f-5ab5-4fd0-afcf-2c9ed8f722d1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.959723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a263e3f-5ab5-4fd0-afcf-2c9ed8f722d1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.966524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a263e3f-5ab5-4fd0-afcf-2c9ed8f722d1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.977373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-883568d5-f921-4af4-86f7-c48b593c68a3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:11.014778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-883568d5-f921-4af4-86f7-c48b593c68a3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.020507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-883568d5-f921-4af4-86f7-c48b593c68a3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.027642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-883568d5-f921-4af4-86f7-c48b593c68a3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.029564 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-2a263e3f-5ab5-4fd0-afcf-2c9ed8f722d1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] HTTP exception thrown: Instance 4c7f77fd-f2ed-4d3a-a420-a4914119382c could not be found. Jul 20 04:30:11.029938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-883568d5-f921-4af4-86f7-c48b593c68a3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2a263e3f-5ab5-4fd0-afcf-2c9ed8f722d1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Request method failure captured: Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c HTTP/1.1 Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Q-vwf0MkT_A_vW-xQLzYJ8Iar3eTaver1iDhPB9JMsStxSY0ip61ZizkmtcPvv2c9DD9FCh9CZNLu540__iQ4h5v7cjF8LhDs46EkJsA-djyv_hAdGwrSBcMgXLglyhU98b9qLVkGOv4OXluka-LfhQtaQlV_3el7BvLqHEV-yCbQ Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: e1a37e6cca334ee693d9d8ae5345c155 Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerRescueTestJSON-462674329 Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1a37e6cca334ee693d9d8ae5345c155"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1a37e6cca334ee693d9d8ae5345c155"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1a37e6cca334ee693d9d8ae5345c155", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1a37e6cca334ee693d9d8ae5345c155"}]}] Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerRescueTestJSON-462674329 Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: e1a37e6cca334ee693d9d8ae5345c155 Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerRescueTestJSON-462674329 Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerRescueTestJSON-462674329-project Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: f850c33c9ec04a7980db7386c854f00f Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerRescueTestJSON-462674329-project Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 4c7f77fd-f2ed-4d3a-a420-a4914119382c could not be found. Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '4c7f77fd-f2ed-4d3a-a420-a4914119382c'} Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c7f77fd-f2ed-4d3a-a420-a4914119382c could not be found. Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c7f77fd-f2ed-4d3a-a420-a4914119382c could not be found. Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:11.031481 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:11.035479 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:11.035479 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:11.035479 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:11.035479 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:11.035479 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:11.035479 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c7f77fd-f2ed-4d3a-a420-a4914119382c could not be found. Jul 20 04:30:11.035479 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:11.037721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2a263e3f-5ab5-4fd0-afcf-2c9ed8f722d1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Returning 404 to user: Instance 4c7f77fd-f2ed-4d3a-a420-a4914119382c could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:11.040262 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2a263e3f-5ab5-4fd0-afcf-2c9ed8f722d1 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c" status: 404 len: 111 microversion: 2.1 time: 0.152150 Jul 20 04:30:11.043914 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2133/4350] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:10 2022] GET /compute/v2.1/servers/4c7f77fd-f2ed-4d3a-a420-a4914119382c => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:11.053408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c4c1e6fb-da54-448c-9247-7d938a70846e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:11.061650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c4c1e6fb-da54-448c-9247-7d938a70846e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:11.075175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4c1e6fb-da54-448c-9247-7d938a70846e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.076408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4c1e6fb-da54-448c-9247-7d938a70846e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.078048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4c1e6fb-da54-448c-9247-7d938a70846e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.082694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4c1e6fb-da54-448c-9247-7d938a70846e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.648399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-883568d5-f921-4af4-86f7-c48b593c68a3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1e95f3abd3472c8a1e5fdbb4f07914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21121109b75843408806778a28790f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:11.665830 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-883568d5-f921-4af4-86f7-c48b593c68a3 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 200 len: 1528 microversion: 2.1 time: 0.715263 Jul 20 04:30:11.668414 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2218/4351] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:10 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 1528 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:11.683401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3839d89b-89ed-44a0-a50b-f3d39012b001 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:11.684273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3839d89b-89ed-44a0-a50b-f3d39012b001 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:11.701565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3839d89b-89ed-44a0-a50b-f3d39012b001 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.702165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3839d89b-89ed-44a0-a50b-f3d39012b001 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.705049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3839d89b-89ed-44a0-a50b-f3d39012b001 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.707590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3839d89b-89ed-44a0-a50b-f3d39012b001 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.769949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3839d89b-89ed-44a0-a50b-f3d39012b001 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:11.912895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c4c1e6fb-da54-448c-9247-7d938a70846e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:11.945089 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c4c1e6fb-da54-448c-9247-7d938a70846e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.899012 Jul 20 04:30:11.948259 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2134/4352] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:11 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:11.956243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-265304146", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:11.994708 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3839d89b-89ed-44a0-a50b-f3d39012b001 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 204 len: 0 microversion: 2.1 time: 0.320913 Jul 20 04:30:11.995388 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2219/4353] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:11 2022] DELETE /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:12.005480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8419d11b-7c1b-4fab-b08d-51e02a82a62a tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:12.006887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8419d11b-7c1b-4fab-b08d-51e02a82a62a tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:12.026110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8419d11b-7c1b-4fab-b08d-51e02a82a62a tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:12.030692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8419d11b-7c1b-4fab-b08d-51e02a82a62a tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:12.031948 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8419d11b-7c1b-4fab-b08d-51e02a82a62a tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:12.032612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8419d11b-7c1b-4fab-b08d-51e02a82a62a tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:12.125285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] validate_networks() for [('be069fc8-30ed-40bc-8dbd-2efb24615595', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:12.887603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8419d11b-7c1b-4fab-b08d-51e02a82a62a tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:12.896949 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8419d11b-7c1b-4fab-b08d-51e02a82a62a tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1317 microversion: 2.1 time: 0.899422 Jul 20 04:30:12.897509 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2220/4354] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:11 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1317 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:12.930377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3fa9ac36-01fc-4917-a314-8fb5eadcda59 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:12.931005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3fa9ac36-01fc-4917-a314-8fb5eadcda59 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:12.979998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fa9ac36-01fc-4917-a314-8fb5eadcda59 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:12.982567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fa9ac36-01fc-4917-a314-8fb5eadcda59 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:12.985476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fa9ac36-01fc-4917-a314-8fb5eadcda59 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:12.987129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fa9ac36-01fc-4917-a314-8fb5eadcda59 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:13.554282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3fa9ac36-01fc-4917-a314-8fb5eadcda59 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:13.576871 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3fa9ac36-01fc-4917-a314-8fb5eadcda59 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1492 microversion: 2.1 time: 0.653417 Jul 20 04:30:13.585925 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2221/4355] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:12 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1492 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:13.611550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-397f0f97-60d8-4836-9310-76c9d8258625 req-7704f9d6-6ba9-4b0c-9b2c-895223e38c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4372f5b0-7f1d-44b8-8186-6927036eae91", "name": "network-vif-plugged", "status": "completed", "tag": "de2cdb51-eb69-48ef-9bce-341a3c69715a"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:13.637315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-397f0f97-60d8-4836-9310-76c9d8258625 req-7704f9d6-6ba9-4b0c-9b2c-895223e38c6a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:13.638565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-397f0f97-60d8-4836-9310-76c9d8258625 req-7704f9d6-6ba9-4b0c-9b2c-895223e38c6a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:13.678864 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-397f0f97-60d8-4836-9310-76c9d8258625 req-7704f9d6-6ba9-4b0c-9b2c-895223e38c6a service nova] Creating event network-vif-plugged:de2cdb51-eb69-48ef-9bce-341a3c69715a for instance 4372f5b0-7f1d-44b8-8186-6927036eae91 on n-h1-764485-11 Jul 20 04:30:13.694710 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-397f0f97-60d8-4836-9310-76c9d8258625 req-7704f9d6-6ba9-4b0c-9b2c-895223e38c6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106257 Jul 20 04:30:13.699694 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2222/4356] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:13.707996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-87032129-1769-4589-b43b-877b0f459859 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:13.709643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-87032129-1769-4589-b43b-877b0f459859 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] [instance: b8b86ac9-d7cc-4afa-9be9-be583eba6598] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:13.717621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87032129-1769-4589-b43b-877b0f459859 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:13.718263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87032129-1769-4589-b43b-877b0f459859 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:13.719219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87032129-1769-4589-b43b-877b0f459859 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:13.719849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87032129-1769-4589-b43b-877b0f459859 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:13.747322 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-87032129-1769-4589-b43b-877b0f459859 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] HTTP exception thrown: Instance b8b86ac9-d7cc-4afa-9be9-be583eba6598 could not be found. Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-87032129-1769-4589-b43b-877b0f459859 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Request method failure captured: Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 HTTP/1.1 Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14SzF5OOPveeV7S0NN5E5EA7fpnrmp0LZFnj_cJnAmLm1xJE4kxOjSyWdEEVdoYm2cNFl_2JJ2_z7V-Lhk_0tAlISXxZcdO1iSUDoEpMDDZdlhfkdV1yIpIkdUtjJM38mHGDOalmxJIY2AuuWnjOZPzZ1z3SdNxyKoHjJ8wj9fF9zDQ Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 21121109b75843408806778a28790f0f Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2107998555 Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/21121109b75843408806778a28790f0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21121109b75843408806778a28790f0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_21121109b75843408806778a28790f0f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21121109b75843408806778a28790f0f"}]}] Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2107998555 Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 21121109b75843408806778a28790f0f Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2107998555 Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerAddressesNegativeTestJSON-2107998555-project Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: fd1e95f3abd3472c8a1e5fdbb4f07914 Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2107998555-project Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance b8b86ac9-d7cc-4afa-9be9-be583eba6598 could not be found. Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'b8b86ac9-d7cc-4afa-9be9-be583eba6598'} Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b86ac9-d7cc-4afa-9be9-be583eba6598 could not be found. Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b86ac9-d7cc-4afa-9be9-be583eba6598 could not be found. Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:13.749311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:13.757978 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:13.757978 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:13.757978 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:13.757978 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:13.757978 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:13.757978 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:13.757978 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b86ac9-d7cc-4afa-9be9-be583eba6598 could not be found. Jul 20 04:30:13.757978 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:13.757978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-87032129-1769-4589-b43b-877b0f459859 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] Returning 404 to user: Instance b8b86ac9-d7cc-4afa-9be9-be583eba6598 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:13.757978 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-87032129-1769-4589-b43b-877b0f459859 tempest-ServerAddressesNegativeTestJSON-2107998555 tempest-ServerAddressesNegativeTestJSON-2107998555-project] 10.222.0.20 "GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598" status: 404 len: 111 microversion: 2.1 time: 0.049363 Jul 20 04:30:13.757978 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2223/4357] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:13 2022] GET /compute/v2.1/servers/b8b86ac9-d7cc-4afa-9be9-be583eba6598 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:13.769296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ba0342b1-a90d-4be3-acae-9733e4d05f60 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:13.769940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ba0342b1-a90d-4be3-acae-9733e4d05f60 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:13.777259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:13.781452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ba0342b1-a90d-4be3-acae-9733e4d05f60 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:13.781452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ba0342b1-a90d-4be3-acae-9733e4d05f60 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:13.782109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ba0342b1-a90d-4be3-acae-9733e4d05f60 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:13.782701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ba0342b1-a90d-4be3-acae-9733e4d05f60 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.145308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:14.147222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:14.147970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:14.148455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:14.148969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:14.161566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.165285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.166472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.167152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.194238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:14.200622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for user 7d38b1e323c5490fbb4c0023034874c8 and project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:14.217604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:14.221231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 49ab8313-40ac-443f-b9e8-be2cec2b3469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:14.268098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ba0342b1-a90d-4be3-acae-9733e4d05f60 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:14.281591 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ba0342b1-a90d-4be3-acae-9733e4d05f60 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.528662 Jul 20 04:30:14.282571 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2224/4358] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:13 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:14.288222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-5dcd4b4f-50f8-4387-81fa-5112514d071f req-9f894bed-48be-461b-9f56-e248a2752314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b86ac9-d7cc-4afa-9be9-be583eba6598", "name": "network-vif-deleted", "tag": "1082187f-8c8a-4b79-8b92-bbadee906300"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:14.297715 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bec4b61a-9127-47a2-a94b-0367326faa29 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.347858 Jul 20 04:30:14.298863 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2135/4359] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:30:14.299009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5dcd4b4f-50f8-4387-81fa-5112514d071f req-9f894bed-48be-461b-9f56-e248a2752314 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.299703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5dcd4b4f-50f8-4387-81fa-5112514d071f req-9f894bed-48be-461b-9f56-e248a2752314 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.304222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ea6951dd-83e2-45f8-9bc9-761304c979c2 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:14.305166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ea6951dd-83e2-45f8-9bc9-761304c979c2 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:14.312962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea6951dd-83e2-45f8-9bc9-761304c979c2 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.313908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea6951dd-83e2-45f8-9bc9-761304c979c2 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.315027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea6951dd-83e2-45f8-9bc9-761304c979c2 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.315824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea6951dd-83e2-45f8-9bc9-761304c979c2 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.315967 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-5dcd4b4f-50f8-4387-81fa-5112514d071f req-9f894bed-48be-461b-9f56-e248a2752314 service nova] Creating event network-vif-deleted:1082187f-8c8a-4b79-8b92-bbadee906300 for instance b8b86ac9-d7cc-4afa-9be9-be583eba6598 on n-h1-764485-11 Jul 20 04:30:14.322140 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-5dcd4b4f-50f8-4387-81fa-5112514d071f req-9f894bed-48be-461b-9f56-e248a2752314 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037991 Jul 20 04:30:14.323864 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2225/4360] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:14.329682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-00e90a87-d62f-4944-b91e-b7499eb04c40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:14.330475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-00e90a87-d62f-4944-b91e-b7499eb04c40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 49ab8313-40ac-443f-b9e8-be2cec2b3469] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:14.365984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-00e90a87-d62f-4944-b91e-b7499eb04c40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 49ab8313-40ac-443f-b9e8-be2cec2b3469] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:14.803866 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.scheduler.client.report [None req-00e90a87-d62f-4944-b91e-b7499eb04c40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Deleted allocations for instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 Jul 20 04:30:14.813495 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.compute.api [None req-00e90a87-d62f-4944-b91e-b7499eb04c40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 49ab8313-40ac-443f-b9e8-be2cec2b3469] Instance Mapping does not exist while attempting local delete cleanup. Jul 20 04:30:14.813495 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-00e90a87-d62f-4944-b91e-b7499eb04c40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49ab8313-40ac-443f-b9e8-be2cec2b3469" status: 204 len: 0 microversion: 2.1 time: 0.488147 Jul 20 04:30:14.818499 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2226/4361] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:14 2022] DELETE /compute/v2.1/servers/49ab8313-40ac-443f-b9e8-be2cec2b3469 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:14.826075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ad3e881c-41db-4103-b7b8-cceb82676200 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:14.826810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ad3e881c-41db-4103-b7b8-cceb82676200 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:14.838252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad3e881c-41db-4103-b7b8-cceb82676200 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.839285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad3e881c-41db-4103-b7b8-cceb82676200 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.840180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad3e881c-41db-4103-b7b8-cceb82676200 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.840772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad3e881c-41db-4103-b7b8-cceb82676200 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:15.308870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ea6951dd-83e2-45f8-9bc9-761304c979c2 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:15.327979 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ea6951dd-83e2-45f8-9bc9-761304c979c2 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1317 microversion: 2.1 time: 1.026789 Jul 20 04:30:15.337717 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2136/4362] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:14 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1317 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:15.348212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-60498b9b-9505-4fb2-bf08-fbf1fe3d571c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:15.350757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-60498b9b-9505-4fb2-bf08-fbf1fe3d571c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 49ab8313-40ac-443f-b9e8-be2cec2b3469] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:15.359311 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-60498b9b-9505-4fb2-bf08-fbf1fe3d571c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-60498b9b-9505-4fb2-bf08-fbf1fe3d571c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/49ab8313-40ac-443f-b9e8-be2cec2b3469 HTTP/1.1 Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '49ab8313-40ac-443f-b9e8-be2cec2b3469'} Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:15.361389 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:15.366297 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:15.366297 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:15.366297 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:30:15.366297 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:15.368501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-60498b9b-9505-4fb2-bf08-fbf1fe3d571c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:15.369609 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-60498b9b-9505-4fb2-bf08-fbf1fe3d571c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/49ab8313-40ac-443f-b9e8-be2cec2b3469" status: 404 len: 111 microversion: 2.1 time: 0.030652 Jul 20 04:30:15.371127 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2137/4363] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:15 2022] GET /compute/v2.1/servers/49ab8313-40ac-443f-b9e8-be2cec2b3469 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:15.396235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa7e5b0f-ce7f-4df8-a54e-3b71e5a89f7c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:15.397829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa7e5b0f-ce7f-4df8-a54e-3b71e5a89f7c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:15.406450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa7e5b0f-ce7f-4df8-a54e-3b71e5a89f7c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:15.407409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa7e5b0f-ce7f-4df8-a54e-3b71e5a89f7c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:15.408289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa7e5b0f-ce7f-4df8-a54e-3b71e5a89f7c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:15.409235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa7e5b0f-ce7f-4df8-a54e-3b71e5a89f7c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:15.434910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ad3e881c-41db-4103-b7b8-cceb82676200 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:15.454388 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ad3e881c-41db-4103-b7b8-cceb82676200 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1492 microversion: 2.1 time: 0.629983 Jul 20 04:30:15.455354 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2227/4364] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:14 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1492 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:15.460865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1229521862", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "be069fc8-30ed-40bc-8dbd-2efb24615595"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:15.526770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] validate_networks() for [('be069fc8-30ed-40bc-8dbd-2efb24615595', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:15.887336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fa7e5b0f-ce7f-4df8-a54e-3b71e5a89f7c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:15.898051 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fa7e5b0f-ce7f-4df8-a54e-3b71e5a89f7c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.525584 Jul 20 04:30:15.899268 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2138/4365] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:15 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:16.349099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-011f41e7-8afa-4a26-b94b-1447bf7be072 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:16.351549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-011f41e7-8afa-4a26-b94b-1447bf7be072 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:16.370916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-011f41e7-8afa-4a26-b94b-1447bf7be072 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.373619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-011f41e7-8afa-4a26-b94b-1447bf7be072 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.375013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-011f41e7-8afa-4a26-b94b-1447bf7be072 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.376568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-011f41e7-8afa-4a26-b94b-1447bf7be072 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.600561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:16.601060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:16.601491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:16.601918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:16.602641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:16.619081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.619451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.624163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.626194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.648121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-011f41e7-8afa-4a26-b94b-1447bf7be072 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:16.660131 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-011f41e7-8afa-4a26-b94b-1447bf7be072 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1507 microversion: 2.1 time: 0.317097 Jul 20 04:30:16.661435 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2139/4366] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:16 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:16.676063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0ae5fe9d-64bb-4e36-b598-9ebe261d9ba2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:16.679030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:16.683437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0ae5fe9d-64bb-4e36-b598-9ebe261d9ba2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:16.688575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for user 7d38b1e323c5490fbb4c0023034874c8 and project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:16.697107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ae5fe9d-64bb-4e36-b598-9ebe261d9ba2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.701669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ae5fe9d-64bb-4e36-b598-9ebe261d9ba2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.703245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ae5fe9d-64bb-4e36-b598-9ebe261d9ba2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.703880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ae5fe9d-64bb-4e36-b598-9ebe261d9ba2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.704475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:16.707675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:16.800756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ae5fe9d-64bb-4e36-b598-9ebe261d9ba2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.801405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ae5fe9d-64bb-4e36-b598-9ebe261d9ba2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.802052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-0ae5fe9d-64bb-4e36-b598-9ebe261d9ba2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lazy-loading 'fault' on Instance uuid af3e1ac9-4958-4b26-b26b-b21a0c35be26 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:30:16.843077 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-22796030-0bab-4fdd-a7b4-473d576ca59d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382402 Jul 20 04:30:16.844901 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2228/4367] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:30:16.881111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a7a1a79d-5187-483e-9263-1f410b3d7c6b req-d7b3b0af-899d-47f9-9c44-ed3b4da57a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3e1ac9-4958-4b26-b26b-b21a0c35be26", "name": "network-vif-deleted", "tag": "ddaf2de6-3964-405a-8c9c-f2b502893883"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:16.899667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a7a1a79d-5187-483e-9263-1f410b3d7c6b req-d7b3b0af-899d-47f9-9c44-ed3b4da57a7b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.900126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a7a1a79d-5187-483e-9263-1f410b3d7c6b req-d7b3b0af-899d-47f9-9c44-ed3b4da57a7b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.964043 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a7a1a79d-5187-483e-9263-1f410b3d7c6b req-d7b3b0af-899d-47f9-9c44-ed3b4da57a7b service nova] Creating event network-vif-deleted:ddaf2de6-3964-405a-8c9c-f2b502893883 for instance af3e1ac9-4958-4b26-b26b-b21a0c35be26 on n-h2-764485-11 Jul 20 04:30:16.997056 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a7a1a79d-5187-483e-9263-1f410b3d7c6b req-d7b3b0af-899d-47f9-9c44-ed3b4da57a7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145355 Jul 20 04:30:17.004033 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2229/4368] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:17.018504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-99a16bd9-205d-4a40-8d02-9d97314c7770 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:17.021299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-99a16bd9-205d-4a40-8d02-9d97314c7770 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:17.073576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99a16bd9-205d-4a40-8d02-9d97314c7770 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.074049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99a16bd9-205d-4a40-8d02-9d97314c7770 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.074933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99a16bd9-205d-4a40-8d02-9d97314c7770 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.075378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99a16bd9-205d-4a40-8d02-9d97314c7770 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.197091 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-99a16bd9-205d-4a40-8d02-9d97314c7770 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91/ips" status: 200 len: 110 microversion: 2.1 time: 0.188917 Jul 20 04:30:17.197808 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2230/4369] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:30:17 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91/ips => generated 110 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:17.210269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a5a774f-b85b-42ec-bf54-822b5cf63796 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:17.211377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3a5a774f-b85b-42ec-bf54-822b5cf63796 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:17.370834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0ae5fe9d-64bb-4e36-b598-9ebe261d9ba2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c33c9ec04a7980db7386c854f00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1a37e6cca334ee693d9d8ae5345c155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:17.380982 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0ae5fe9d-64bb-4e36-b598-9ebe261d9ba2 tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 200 len: 1303 microversion: 2.1 time: 0.718000 Jul 20 04:30:17.385691 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2140/4370] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:16 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 1303 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:17.390957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1e2615b6-6b78-411e-9dac-2726d339bae5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:17.400630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1e2615b6-6b78-411e-9dac-2726d339bae5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:17.421575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e2615b6-6b78-411e-9dac-2726d339bae5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.422416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e2615b6-6b78-411e-9dac-2726d339bae5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.424653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e2615b6-6b78-411e-9dac-2726d339bae5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.428205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e2615b6-6b78-411e-9dac-2726d339bae5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.611729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3a5a774f-b85b-42ec-bf54-822b5cf63796 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:17.626518 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a5a774f-b85b-42ec-bf54-822b5cf63796 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1221 microversion: 2.1 time: 0.416748 Jul 20 04:30:17.628444 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2231/4371] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:17 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1221 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:17.637412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-086cdf94-44a3-41c4-8941-2267562022dd tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:17.648372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-086cdf94-44a3-41c4-8941-2267562022dd tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:17.655447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-086cdf94-44a3-41c4-8941-2267562022dd tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.656284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-086cdf94-44a3-41c4-8941-2267562022dd tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.657274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-086cdf94-44a3-41c4-8941-2267562022dd tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.664237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-086cdf94-44a3-41c4-8941-2267562022dd tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.706776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:17.716349 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-086cdf94-44a3-41c4-8941-2267562022dd tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91/ips" status: 200 len: 110 microversion: 2.1 time: 0.086555 Jul 20 04:30:17.720565 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2232/4372] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:30:17 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91/ips => generated 110 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:17.737082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1eb3e857-ed93-4ff6-9634-2b4ca52f0b20 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:17.737999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1eb3e857-ed93-4ff6-9634-2b4ca52f0b20 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:17.764510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1eb3e857-ed93-4ff6-9634-2b4ca52f0b20 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.765170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1eb3e857-ed93-4ff6-9634-2b4ca52f0b20 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.766684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1eb3e857-ed93-4ff6-9634-2b4ca52f0b20 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.767907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1eb3e857-ed93-4ff6-9634-2b4ca52f0b20 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.844053 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1eb3e857-ed93-4ff6-9634-2b4ca52f0b20 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91/ips/tempest-ServerAddressesTestJSON-2011449379-network" status: 200 len: 95 microversion: 2.1 time: 0.113016 Jul 20 04:30:17.850414 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2233/4373] 10.222.0.20 () {58 vars in 1400 bytes} [Wed Jul 20 04:30:17 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91/ips/tempest-ServerAddressesTestJSON-2011449379-network => generated 95 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:30:17.862508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fb8bd349-85c4-46a9-9542-08e4a726daa3 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:17.862508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fb8bd349-85c4-46a9-9542-08e4a726daa3 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:17.884370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb8bd349-85c4-46a9-9542-08e4a726daa3 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.884843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb8bd349-85c4-46a9-9542-08e4a726daa3 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.887789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb8bd349-85c4-46a9-9542-08e4a726daa3 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.889403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb8bd349-85c4-46a9-9542-08e4a726daa3 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.905696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1e2615b6-6b78-411e-9dac-2726d339bae5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:17.928572 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1e2615b6-6b78-411e-9dac-2726d339bae5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.540357 Jul 20 04:30:17.934476 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2141/4374] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:17 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:17.980028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fb8bd349-85c4-46a9-9542-08e4a726daa3 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:18.144347 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fb8bd349-85c4-46a9-9542-08e4a726daa3 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 204 len: 0 microversion: 2.1 time: 0.291098 Jul 20 04:30:18.145454 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2234/4375] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:17 2022] DELETE /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:30:18.157871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d440cbb2-7450-4dee-a376-77965b18b302 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:18.160008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d440cbb2-7450-4dee-a376-77965b18b302 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:18.172121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d440cbb2-7450-4dee-a376-77965b18b302 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.173795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d440cbb2-7450-4dee-a376-77965b18b302 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.175908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d440cbb2-7450-4dee-a376-77965b18b302 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.176795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d440cbb2-7450-4dee-a376-77965b18b302 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.404228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7fb989f2-3aef-45cb-a780-b93e069804af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:18.404965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7fb989f2-3aef-45cb-a780-b93e069804af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] [instance: af3e1ac9-4958-4b26-b26b-b21a0c35be26] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:18.419248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7fb989f2-3aef-45cb-a780-b93e069804af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.419746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7fb989f2-3aef-45cb-a780-b93e069804af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.420592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7fb989f2-3aef-45cb-a780-b93e069804af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.420961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7fb989f2-3aef-45cb-a780-b93e069804af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.467467 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-7fb989f2-3aef-45cb-a780-b93e069804af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] HTTP exception thrown: Instance af3e1ac9-4958-4b26-b26b-b21a0c35be26 could not be found. Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7fb989f2-3aef-45cb-a780-b93e069804af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Request method failure captured: Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 HTTP/1.1 Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Q-vwf0MkT_A_vW-xQLzYJ8Iar3eTaver1iDhPB9JMsStxSY0ip61ZizkmtcPvv2c9DD9FCh9CZNLu540__iQ4h5v7cjF8LhDs46EkJsA-djyv_hAdGwrSBcMgXLglyhU98b9qLVkGOv4OXluka-LfhQtaQlV_3el7BvLqHEV-yCbQ Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: e1a37e6cca334ee693d9d8ae5345c155 Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerRescueTestJSON-462674329 Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1a37e6cca334ee693d9d8ae5345c155"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1a37e6cca334ee693d9d8ae5345c155"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1a37e6cca334ee693d9d8ae5345c155", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1a37e6cca334ee693d9d8ae5345c155"}]}] Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerRescueTestJSON-462674329 Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: e1a37e6cca334ee693d9d8ae5345c155 Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerRescueTestJSON-462674329 Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerRescueTestJSON-462674329-project Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: f850c33c9ec04a7980db7386c854f00f Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerRescueTestJSON-462674329-project Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance af3e1ac9-4958-4b26-b26b-b21a0c35be26 could not be found. Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'af3e1ac9-4958-4b26-b26b-b21a0c35be26'} Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3e1ac9-4958-4b26-b26b-b21a0c35be26 could not be found. Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3e1ac9-4958-4b26-b26b-b21a0c35be26 could not be found. Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:18.469271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:18.473256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:18.473256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:18.473256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:18.473256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:18.473256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:18.473256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3e1ac9-4958-4b26-b26b-b21a0c35be26 could not be found. Jul 20 04:30:18.473256 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:18.473256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7fb989f2-3aef-45cb-a780-b93e069804af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] Returning 404 to user: Instance af3e1ac9-4958-4b26-b26b-b21a0c35be26 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:18.480011 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7fb989f2-3aef-45cb-a780-b93e069804af tempest-ServerRescueTestJSON-462674329 tempest-ServerRescueTestJSON-462674329-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26" status: 404 len: 111 microversion: 2.1 time: 0.081194 Jul 20 04:30:18.480977 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2235/4376] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:18 2022] GET /compute/v2.1/servers/af3e1ac9-4958-4b26-b26b-b21a0c35be26 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:30:18.523817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d440cbb2-7450-4dee-a376-77965b18b302 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:18.533935 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d440cbb2-7450-4dee-a376-77965b18b302 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1513 microversion: 2.1 time: 0.382908 Jul 20 04:30:18.535426 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2142/4377] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:18 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1513 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:18.648671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ff824d72-73ec-467e-94e1-134a94a44f4c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:18.650140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ff824d72-73ec-467e-94e1-134a94a44f4c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:18.657109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff824d72-73ec-467e-94e1-134a94a44f4c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.663993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff824d72-73ec-467e-94e1-134a94a44f4c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.670567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff824d72-73ec-467e-94e1-134a94a44f4c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.674742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff824d72-73ec-467e-94e1-134a94a44f4c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.946536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-adc91b5e-5a71-465d-92be-53fc5412e0b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:18.947412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-adc91b5e-5a71-465d-92be-53fc5412e0b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:18.958061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-adc91b5e-5a71-465d-92be-53fc5412e0b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.959112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-adc91b5e-5a71-465d-92be-53fc5412e0b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.960124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-adc91b5e-5a71-465d-92be-53fc5412e0b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.965468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-adc91b5e-5a71-465d-92be-53fc5412e0b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:19.108465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ff824d72-73ec-467e-94e1-134a94a44f4c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:19.118734 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ff824d72-73ec-467e-94e1-134a94a44f4c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1273 microversion: 2.1 time: 0.477191 Jul 20 04:30:19.120133 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2236/4378] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:18 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1273 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:19.325944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-adc91b5e-5a71-465d-92be-53fc5412e0b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:19.341031 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-adc91b5e-5a71-465d-92be-53fc5412e0b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.398372 Jul 20 04:30:19.342123 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2143/4379] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:18 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:19.554172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d08863f4-ae7b-46c5-84c0-6e4c7399958d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:19.554955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d08863f4-ae7b-46c5-84c0-6e4c7399958d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:19.562539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d08863f4-ae7b-46c5-84c0-6e4c7399958d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:19.563314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d08863f4-ae7b-46c5-84c0-6e4c7399958d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:19.564328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d08863f4-ae7b-46c5-84c0-6e4c7399958d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:19.565014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d08863f4-ae7b-46c5-84c0-6e4c7399958d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:19.953896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d08863f4-ae7b-46c5-84c0-6e4c7399958d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:19.969167 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d08863f4-ae7b-46c5-84c0-6e4c7399958d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1513 microversion: 2.1 time: 0.419461 Jul 20 04:30:19.980806 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2237/4380] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:19 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1513 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:20.162359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-79620a5f-dff7-4cb0-af00-a6cae66501ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:20.162993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-79620a5f-dff7-4cb0-af00-a6cae66501ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:20.173472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79620a5f-dff7-4cb0-af00-a6cae66501ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.173932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79620a5f-dff7-4cb0-af00-a6cae66501ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:20.174725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79620a5f-dff7-4cb0-af00-a6cae66501ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.180715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79620a5f-dff7-4cb0-af00-a6cae66501ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:20.359616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74f8ce86-f821-4f85-bfca-100d878aede3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:20.360238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74f8ce86-f821-4f85-bfca-100d878aede3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:20.366035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-79620a5f-dff7-4cb0-af00-a6cae66501ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:20.369536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f8ce86-f821-4f85-bfca-100d878aede3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.369998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f8ce86-f821-4f85-bfca-100d878aede3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:20.370788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f8ce86-f821-4f85-bfca-100d878aede3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.371224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74f8ce86-f821-4f85-bfca-100d878aede3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:20.389711 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-79620a5f-dff7-4cb0-af00-a6cae66501ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1279 microversion: 2.1 time: 0.249226 Jul 20 04:30:20.392498 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2144/4381] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:20 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1279 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:20.992345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa97367d-27e2-4446-a918-efe5a5f28c98 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:20.994168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa97367d-27e2-4446-a918-efe5a5f28c98 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:21.009348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa97367d-27e2-4446-a918-efe5a5f28c98 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.010164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa97367d-27e2-4446-a918-efe5a5f28c98 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.024086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa97367d-27e2-4446-a918-efe5a5f28c98 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.024548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa97367d-27e2-4446-a918-efe5a5f28c98 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.405790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-74f8ce86-f821-4f85-bfca-100d878aede3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:21.414708 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74f8ce86-f821-4f85-bfca-100d878aede3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 1.058998 Jul 20 04:30:21.434105 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2238/4382] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:20 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:21.439300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-64de3b4c-e1d5-4e81-9313-947a63b86b8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:21.442096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-64de3b4c-e1d5-4e81-9313-947a63b86b8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:21.453826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64de3b4c-e1d5-4e81-9313-947a63b86b8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.458517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64de3b4c-e1d5-4e81-9313-947a63b86b8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.459568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64de3b4c-e1d5-4e81-9313-947a63b86b8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.462672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64de3b4c-e1d5-4e81-9313-947a63b86b8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.689151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fa97367d-27e2-4446-a918-efe5a5f28c98 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:21.707093 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fa97367d-27e2-4446-a918-efe5a5f28c98 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1513 microversion: 2.1 time: 0.723627 Jul 20 04:30:21.710974 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2145/4383] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:20 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1513 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:22.000693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-64de3b4c-e1d5-4e81-9313-947a63b86b8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:22.017899 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-64de3b4c-e1d5-4e81-9313-947a63b86b8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1321 microversion: 2.1 time: 0.581417 Jul 20 04:30:22.029152 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2239/4384] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:21 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1321 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:22.436400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3fc73d5f-fa16-4f8f-92a9-60953b056438 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:22.437379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3fc73d5f-fa16-4f8f-92a9-60953b056438 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:22.452277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fc73d5f-fa16-4f8f-92a9-60953b056438 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:22.454978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fc73d5f-fa16-4f8f-92a9-60953b056438 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:22.455987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fc73d5f-fa16-4f8f-92a9-60953b056438 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:22.456433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fc73d5f-fa16-4f8f-92a9-60953b056438 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:22.729345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0195b7d4-ea87-48a1-81f5-ae6f969b5453 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:22.731273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0195b7d4-ea87-48a1-81f5-ae6f969b5453 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:22.743497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0195b7d4-ea87-48a1-81f5-ae6f969b5453 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:22.744330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0195b7d4-ea87-48a1-81f5-ae6f969b5453 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:22.745333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0195b7d4-ea87-48a1-81f5-ae6f969b5453 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:22.745976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0195b7d4-ea87-48a1-81f5-ae6f969b5453 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:22.964623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0195b7d4-ea87-48a1-81f5-ae6f969b5453 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcc66c53e0447fa28b53a30ec47bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b42286633d47d39ad489a6bc1a317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:22.973736 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0195b7d4-ea87-48a1-81f5-ae6f969b5453 tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 200 len: 1471 microversion: 2.1 time: 0.249693 Jul 20 04:30:22.978730 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2240/4385] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:22 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 1471 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:22.998035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-b986a8a3-c651-4a2c-a14f-ec199a89facc req-712e0850-a5ff-471b-943a-952e0b77a9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4372f5b0-7f1d-44b8-8186-6927036eae91", "name": "network-vif-deleted", "tag": "de2cdb51-eb69-48ef-9bce-341a3c69715a"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:23.013497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b986a8a3-c651-4a2c-a14f-ec199a89facc req-712e0850-a5ff-471b-943a-952e0b77a9ea service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.013954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b986a8a3-c651-4a2c-a14f-ec199a89facc req-712e0850-a5ff-471b-943a-952e0b77a9ea service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.038519 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-b986a8a3-c651-4a2c-a14f-ec199a89facc req-712e0850-a5ff-471b-943a-952e0b77a9ea service nova] Creating event network-vif-deleted:de2cdb51-eb69-48ef-9bce-341a3c69715a for instance 4372f5b0-7f1d-44b8-8186-6927036eae91 on n-h1-764485-11 Jul 20 04:30:23.045169 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-b986a8a3-c651-4a2c-a14f-ec199a89facc req-712e0850-a5ff-471b-943a-952e0b77a9ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064033 Jul 20 04:30:23.047638 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2241/4386] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:23.059859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67684e75-f5cd-4608-ae2b-ccc009f6356a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:23.063971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67684e75-f5cd-4608-ae2b-ccc009f6356a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:23.079860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67684e75-f5cd-4608-ae2b-ccc009f6356a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.080723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67684e75-f5cd-4608-ae2b-ccc009f6356a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.081668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67684e75-f5cd-4608-ae2b-ccc009f6356a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.082261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67684e75-f5cd-4608-ae2b-ccc009f6356a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.194787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3fc73d5f-fa16-4f8f-92a9-60953b056438 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:23.211141 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3fc73d5f-fa16-4f8f-92a9-60953b056438 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1656 microversion: 2.1 time: 0.778958 Jul 20 04:30:23.212388 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2146/4387] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:22 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1656 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:23.229495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-104d5209-d3d4-47da-9a5e-3acc5e809abb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:23.243855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-104d5209-d3d4-47da-9a5e-3acc5e809abb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.244583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-104d5209-d3d4-47da-9a5e-3acc5e809abb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.270660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-104d5209-d3d4-47da-9a5e-3acc5e809abb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Going to try to start instance {{(pid=119807) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:30:23.329517 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-104d5209-d3d4-47da-9a5e-3acc5e809abb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.104649 Jul 20 04:30:23.336172 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2147/4388] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:23 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:30:23.343130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f7450731-c51b-4c0d-b36e-867eb17e5bdb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:23.344760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f7450731-c51b-4c0d-b36e-867eb17e5bdb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:23.354149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7450731-c51b-4c0d-b36e-867eb17e5bdb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.354622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7450731-c51b-4c0d-b36e-867eb17e5bdb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.355566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7450731-c51b-4c0d-b36e-867eb17e5bdb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.356589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f7450731-c51b-4c0d-b36e-867eb17e5bdb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.670736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67684e75-f5cd-4608-ae2b-ccc009f6356a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:23.680038 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67684e75-f5cd-4608-ae2b-ccc009f6356a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1321 microversion: 2.1 time: 0.630178 Jul 20 04:30:23.689985 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2242/4389] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:23 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1321 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:24.183144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:24.207983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:24.217258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e715b0b5-4b2f-4a34-ba01-444e3bfe75a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Action: 'create', calling method: .version_select at 0x7fbf9d477430>, body: {"keypair": {"name": "tempest-keypair-470258869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIUe/u3djUKtSzGpBjUQ7y0D7bIA5RDjAkYsKCUWvvgtUY5breb7avz+IcW0mPIjwJ4JjaRYUNgWFlmcsUn+6DZyFw1179W2EIX4Qh2ItkRasRaevBEUbPaQIQV805jVg=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:24.252564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e715b0b5-4b2f-4a34-ba01-444e3bfe75a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Getting quotas for project 991c8e8abd6b465bad948f659373c920. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:24.260937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e715b0b5-4b2f-4a34-ba01-444e3bfe75a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Getting quotas for user 6e3f2f4e6d644b1d9c4743e9753aa9d2 and project 991c8e8abd6b465bad948f659373c920. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:24.312736 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e715b0b5-4b2f-4a34-ba01-444e3bfe75a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.406207 Jul 20 04:30:24.313574 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2243/4390] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jul 20 04:30:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 408 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:30:24.320428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b7b18a51-1b6e-4f36-843c-5c5f6c96017d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:24.321112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b7b18a51-1b6e-4f36-843c-5c5f6c96017d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] [instance: 4372f5b0-7f1d-44b8-8186-6927036eae91] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:24.330956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7b18a51-1b6e-4f36-843c-5c5f6c96017d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:24.331472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7b18a51-1b6e-4f36-843c-5c5f6c96017d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:24.332818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7b18a51-1b6e-4f36-843c-5c5f6c96017d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:24.334119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7b18a51-1b6e-4f36-843c-5c5f6c96017d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:24.355315 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-b7b18a51-1b6e-4f36-843c-5c5f6c96017d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] HTTP exception thrown: Instance 4372f5b0-7f1d-44b8-8186-6927036eae91 could not be found. Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b7b18a51-1b6e-4f36-843c-5c5f6c96017d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Request method failure captured: Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 HTTP/1.1 Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14S8G-FrsqkKR5Yqb8Tun9oRPb3xl0ln2K9ITUcrKZ-qU-dW0omQHS83-m2Bkw13ezfQAnLP7TJZdB_Ii8Fvi8bvIx1fLR7TqUuHgDOx9cGVcsbO1wuzof3hEWvHSICDLdra9Pco6bkkaMvTMPOcQzWk_3owITygBpNW_VCa9OOgkkc Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 13b42286633d47d39ad489a6bc1a317d Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerAddressesTestJSON-1736300895 Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13b42286633d47d39ad489a6bc1a317d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13b42286633d47d39ad489a6bc1a317d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13b42286633d47d39ad489a6bc1a317d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13b42286633d47d39ad489a6bc1a317d"}]}] Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerAddressesTestJSON-1736300895 Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 13b42286633d47d39ad489a6bc1a317d Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1736300895 Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerAddressesTestJSON-1736300895-project Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: ebfcc66c53e0447fa28b53a30ec47bc6 Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerAddressesTestJSON-1736300895-project Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 4372f5b0-7f1d-44b8-8186-6927036eae91 could not be found. Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '4372f5b0-7f1d-44b8-8186-6927036eae91'} Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4372f5b0-7f1d-44b8-8186-6927036eae91 could not be found. Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4372f5b0-7f1d-44b8-8186-6927036eae91 could not be found. Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:24.357093 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:24.360894 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:24.360894 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:24.360894 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:24.360894 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:24.360894 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:24.360894 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4372f5b0-7f1d-44b8-8186-6927036eae91 could not be found. Jul 20 04:30:24.360894 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:30:24.360894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b7b18a51-1b6e-4f36-843c-5c5f6c96017d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] Returning 404 to user: Instance 4372f5b0-7f1d-44b8-8186-6927036eae91 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:24.360894 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b7b18a51-1b6e-4f36-843c-5c5f6c96017d tempest-ServerAddressesTestJSON-1736300895 tempest-ServerAddressesTestJSON-1736300895-project] 10.222.0.20 "GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91" status: 404 len: 111 microversion: 2.1 time: 0.044055 Jul 20 04:30:24.360894 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2244/4391] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:24 2022] GET /compute/v2.1/servers/4372f5b0-7f1d-44b8-8186-6927036eae91 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:24.699558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-71740942-30d7-4ee1-b5fd-45a5e8f636e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:24.700613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-71740942-30d7-4ee1-b5fd-45a5e8f636e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:24.707838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71740942-30d7-4ee1-b5fd-45a5e8f636e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:24.709376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71740942-30d7-4ee1-b5fd-45a5e8f636e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:24.710465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71740942-30d7-4ee1-b5fd-45a5e8f636e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:24.711132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71740942-30d7-4ee1-b5fd-45a5e8f636e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:24.758634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f7450731-c51b-4c0d-b36e-867eb17e5bdb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:24.768876 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f7450731-c51b-4c0d-b36e-867eb17e5bdb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1665 microversion: 2.1 time: 1.430974 Jul 20 04:30:24.783800 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2148/4392] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:23 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1665 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:25.383837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-71740942-30d7-4ee1-b5fd-45a5e8f636e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:25.395051 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-71740942-30d7-4ee1-b5fd-45a5e8f636e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1321 microversion: 2.1 time: 0.701377 Jul 20 04:30:25.401676 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2245/4393] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:24 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1321 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:25.790267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d85cfcd1-734d-43ae-861d-2ed9c02e7978 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:25.791486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d85cfcd1-734d-43ae-861d-2ed9c02e7978 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:25.803834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d85cfcd1-734d-43ae-861d-2ed9c02e7978 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:25.811282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d85cfcd1-734d-43ae-861d-2ed9c02e7978 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:25.812399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d85cfcd1-734d-43ae-861d-2ed9c02e7978 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:25.812997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d85cfcd1-734d-43ae-861d-2ed9c02e7978 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.418170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a33f50d4-7a75-4e4c-8ed8-559d06622b75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:26.418662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a33f50d4-7a75-4e4c-8ed8-559d06622b75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:26.441822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a33f50d4-7a75-4e4c-8ed8-559d06622b75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.442203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a33f50d4-7a75-4e4c-8ed8-559d06622b75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.445963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a33f50d4-7a75-4e4c-8ed8-559d06622b75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.447643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a33f50d4-7a75-4e4c-8ed8-559d06622b75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.546016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d85cfcd1-734d-43ae-861d-2ed9c02e7978 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:26.563928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:26.586809 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d85cfcd1-734d-43ae-861d-2ed9c02e7978 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1665 microversion: 2.1 time: 0.799777 Jul 20 04:30:26.594336 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2149/4394] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:25 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1665 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:26.613167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-049e1e58-0c5b-400a-b780-91f89b87c0ec req-86599aae-3dcb-434b-8bfc-2d2a1c2b1d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e", "tag": "362251ea-ae21-47c6-aea7-9d20930ce7b1"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:26.632918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-049e1e58-0c5b-400a-b780-91f89b87c0ec req-86599aae-3dcb-434b-8bfc-2d2a1c2b1d64 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.633584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-049e1e58-0c5b-400a-b780-91f89b87c0ec req-86599aae-3dcb-434b-8bfc-2d2a1c2b1d64 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.647422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:26.653817 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-049e1e58-0c5b-400a-b780-91f89b87c0ec req-86599aae-3dcb-434b-8bfc-2d2a1c2b1d64 service nova] Creating event network-changed:362251ea-ae21-47c6-aea7-9d20930ce7b1 for instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e on n-h2-764485-11 Jul 20 04:30:26.664433 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-049e1e58-0c5b-400a-b780-91f89b87c0ec req-86599aae-3dcb-434b-8bfc-2d2a1c2b1d64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065320 Jul 20 04:30:26.665652 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2150/4395] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:26.997210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a33f50d4-7a75-4e4c-8ed8-559d06622b75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:27.007063 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a33f50d4-7a75-4e4c-8ed8-559d06622b75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1321 microversion: 2.1 time: 0.593017 Jul 20 04:30:27.010408 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2246/4396] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:26 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1321 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:27.569609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-52b848df-5c6b-4b50-9f9c-3e3a7e54c4c0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:27.570203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-52b848df-5c6b-4b50-9f9c-3e3a7e54c4c0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:27.593938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52b848df-5c6b-4b50-9f9c-3e3a7e54c4c0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.594653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52b848df-5c6b-4b50-9f9c-3e3a7e54c4c0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:27.596608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52b848df-5c6b-4b50-9f9c-3e3a7e54c4c0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.600627 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52b848df-5c6b-4b50-9f9c-3e3a7e54c4c0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:27.611176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f11a626b-997a-4299-9697-3de413662d26 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:27.612416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f11a626b-997a-4299-9697-3de413662d26 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:27.649493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f11a626b-997a-4299-9697-3de413662d26 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.654660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f11a626b-997a-4299-9697-3de413662d26 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:27.657601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f11a626b-997a-4299-9697-3de413662d26 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.658315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f11a626b-997a-4299-9697-3de413662d26 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:27.763739 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-52b848df-5c6b-4b50-9f9c-3e3a7e54c4c0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/ips" status: 200 len: 143 microversion: 2.1 time: 0.191734 Jul 20 04:30:27.770647 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2151/4397] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:30:27 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/ips => generated 143 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:28.026946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c787937-c4e1-41e6-9a81-e497542f2b01 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:28.033410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4c787937-c4e1-41e6-9a81-e497542f2b01 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:28.051540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c787937-c4e1-41e6-9a81-e497542f2b01 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:28.052155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c787937-c4e1-41e6-9a81-e497542f2b01 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:28.053038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c787937-c4e1-41e6-9a81-e497542f2b01 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:28.062830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c787937-c4e1-41e6-9a81-e497542f2b01 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:28.783465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f11a626b-997a-4299-9697-3de413662d26 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:28.848141 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f11a626b-997a-4299-9697-3de413662d26 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 1.240818 Jul 20 04:30:28.859933 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2247/4398] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:27 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:28.909204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67be77c7-6e20-4f52-95e9-35ec9b0f12ab tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:28.913725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67be77c7-6e20-4f52-95e9-35ec9b0f12ab tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:28.995024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67be77c7-6e20-4f52-95e9-35ec9b0f12ab tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:28.997942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67be77c7-6e20-4f52-95e9-35ec9b0f12ab tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:29.003054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4c787937-c4e1-41e6-9a81-e497542f2b01 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:29.006455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67be77c7-6e20-4f52-95e9-35ec9b0f12ab tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:29.007250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67be77c7-6e20-4f52-95e9-35ec9b0f12ab tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:29.032992 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4c787937-c4e1-41e6-9a81-e497542f2b01 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1321 microversion: 2.1 time: 1.008371 Jul 20 04:30:29.044522 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2152/4399] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:28 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1321 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:30.070556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-47648b47-1d1a-462c-a920-5413e370e8b2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:30.074821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-47648b47-1d1a-462c-a920-5413e370e8b2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:30.096315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47648b47-1d1a-462c-a920-5413e370e8b2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.097079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47648b47-1d1a-462c-a920-5413e370e8b2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:30.098296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47648b47-1d1a-462c-a920-5413e370e8b2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.099848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47648b47-1d1a-462c-a920-5413e370e8b2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.118727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67be77c7-6e20-4f52-95e9-35ec9b0f12ab tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:31.135657 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67be77c7-6e20-4f52-95e9-35ec9b0f12ab tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 2.266783 Jul 20 04:30:31.164861 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2248/4400] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:28 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:31.176178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ff8cb0e9-5ddf-4912-8ef1-0b768914c2d4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:31.177267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ff8cb0e9-5ddf-4912-8ef1-0b768914c2d4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:31.203388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff8cb0e9-5ddf-4912-8ef1-0b768914c2d4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.204282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff8cb0e9-5ddf-4912-8ef1-0b768914c2d4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.205417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff8cb0e9-5ddf-4912-8ef1-0b768914c2d4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.210538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff8cb0e9-5ddf-4912-8ef1-0b768914c2d4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.312849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ff8cb0e9-5ddf-4912-8ef1-0b768914c2d4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Unlocking {{(pid=119808) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 20 04:30:31.329840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:31.430707 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ff8cb0e9-5ddf-4912-8ef1-0b768914c2d4 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.264376 Jul 20 04:30:31.432244 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2249/4401] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:31 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:30:31.450517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b4405200-5121-46c4-91da-d8bb17281313 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:31.451780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b4405200-5121-46c4-91da-d8bb17281313 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:31.466369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4405200-5121-46c4-91da-d8bb17281313 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.467271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4405200-5121-46c4-91da-d8bb17281313 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.469717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4405200-5121-46c4-91da-d8bb17281313 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.472084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4405200-5121-46c4-91da-d8bb17281313 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.665017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-47648b47-1d1a-462c-a920-5413e370e8b2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:31.677943 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-47648b47-1d1a-462c-a920-5413e370e8b2 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1321 microversion: 2.1 time: 1.628242 Jul 20 04:30:31.683439 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2153/4402] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:30 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1321 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:31.783702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-13f41362-2367-45c0-9c39-dd129c96aa0b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5797e04-3d29-41bf-b75d-d795e8529799"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:31.785321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-13f41362-2367-45c0-9c39-dd129c96aa0b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:31.799232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-13f41362-2367-45c0-9c39-dd129c96aa0b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.799232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-13f41362-2367-45c0-9c39-dd129c96aa0b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.803607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-13f41362-2367-45c0-9c39-dd129c96aa0b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.805169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-13f41362-2367-45c0-9c39-dd129c96aa0b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.217095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b4405200-5121-46c4-91da-d8bb17281313 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:32.233541 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b4405200-5121-46c4-91da-d8bb17281313 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.791975 Jul 20 04:30:32.239783 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2250/4403] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:31 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:32.261403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4256f4c0-fd12-4dd7-a20e-114d5fd54765 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:32.266822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4256f4c0-fd12-4dd7-a20e-114d5fd54765 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:32.289870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4256f4c0-fd12-4dd7-a20e-114d5fd54765 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.295375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4256f4c0-fd12-4dd7-a20e-114d5fd54765 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.297569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4256f4c0-fd12-4dd7-a20e-114d5fd54765 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.299422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4256f4c0-fd12-4dd7-a20e-114d5fd54765 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.363086 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-13f41362-2367-45c0-9c39-dd129c96aa0b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "POST /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.584116 Jul 20 04:30:32.364058 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2154/4404] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:30:31 2022] POST /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/os-volume_attachments => generated 194 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:32.697846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b921906f-2556-4898-b885-6b1d0997df95 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:32.699060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b921906f-2556-4898-b885-6b1d0997df95 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:32.718150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b921906f-2556-4898-b885-6b1d0997df95 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.726756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b921906f-2556-4898-b885-6b1d0997df95 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.727917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b921906f-2556-4898-b885-6b1d0997df95 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.731788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b921906f-2556-4898-b885-6b1d0997df95 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.096737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b921906f-2556-4898-b885-6b1d0997df95 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:33.111999 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b921906f-2556-4898-b885-6b1d0997df95 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1321 microversion: 2.1 time: 0.418023 Jul 20 04:30:33.112632 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2155/4405] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:32 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:33.115662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4256f4c0-fd12-4dd7-a20e-114d5fd54765 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:33.129152 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4256f4c0-fd12-4dd7-a20e-114d5fd54765 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.874001 Jul 20 04:30:33.132067 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2251/4406] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:32 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:33.152335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3a22f022-0c53-4436-b704-cefb5f3340d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:33.153196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3a22f022-0c53-4436-b704-cefb5f3340d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:33.165523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:33.194272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a22f022-0c53-4436-b704-cefb5f3340d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.195021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a22f022-0c53-4436-b704-cefb5f3340d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.201554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a22f022-0c53-4436-b704-cefb5f3340d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.203989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a22f022-0c53-4436-b704-cefb5f3340d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.444895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-87861064", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd3052d7-ce52-4831-a899-60c23768265e"}], "security_groups": [{"name": "tempest-securitygroup--1149490896"}], "key_name": "tempest-keypair-470258869", "user_data": "}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:33.898160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3a22f022-0c53-4436-b704-cefb5f3340d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:33.923103 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3a22f022-0c53-4436-b704-cefb5f3340d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.775425 Jul 20 04:30:33.927541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] validate_networks() for [('bd3052d7-ce52-4831-a899-60c23768265e', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:33.928793 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2156/4407] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:33 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:33.969449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e384b6cd-5e6e-494d-aa5d-da16ed8d6bb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:33.974285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e384b6cd-5e6e-494d-aa5d-da16ed8d6bb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:34.078522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e384b6cd-5e6e-494d-aa5d-da16ed8d6bb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:34.079808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e384b6cd-5e6e-494d-aa5d-da16ed8d6bb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:34.085127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e384b6cd-5e6e-494d-aa5d-da16ed8d6bb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:34.088027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e384b6cd-5e6e-494d-aa5d-da16ed8d6bb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:34.262262 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e384b6cd-5e6e-494d-aa5d-da16ed8d6bb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.313126 Jul 20 04:30:34.267761 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2157/4408] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:33 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:30:34.274317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=14 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:34.287774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c51cb74b-ba55-42e5-9a94-3825f0be5203 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:34.290191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c51cb74b-ba55-42e5-9a94-3825f0be5203 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:34.320120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c51cb74b-ba55-42e5-9a94-3825f0be5203 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:34.321229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c51cb74b-ba55-42e5-9a94-3825f0be5203 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:34.322894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c51cb74b-ba55-42e5-9a94-3825f0be5203 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:34.323604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c51cb74b-ba55-42e5-9a94-3825f0be5203 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:34.947238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c51cb74b-ba55-42e5-9a94-3825f0be5203 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:34.967788 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c51cb74b-ba55-42e5-9a94-3825f0be5203 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1321 microversion: 2.1 time: 0.695174 Jul 20 04:30:34.968433 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2158/4409] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:34 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1321 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:34.982135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d2df86c0-916f-48a5-b82b-496c07e98c4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:34.985133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d2df86c0-916f-48a5-b82b-496c07e98c4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:35.005511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2df86c0-916f-48a5-b82b-496c07e98c4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:35.008421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2df86c0-916f-48a5-b82b-496c07e98c4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:35.022764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2df86c0-916f-48a5-b82b-496c07e98c4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:35.031941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:35.032968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d2df86c0-916f-48a5-b82b-496c07e98c4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.799835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:36.800287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:36.800741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:36.801159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:36.801700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:36.829123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.837005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.837719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.840075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.852856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d2df86c0-916f-48a5-b82b-496c07e98c4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:36.873877 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d2df86c0-916f-48a5-b82b-496c07e98c4c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1654 microversion: 2.1 time: 1.901287 Jul 20 04:30:36.884295 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2159/4410] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:34 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1654 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:36.900496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Getting quotas for project 991c8e8abd6b465bad948f659373c920. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:36.901081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a7311bc7-12ae-4261-a587-504c57717066 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:36.901709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a7311bc7-12ae-4261-a587-504c57717066 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:36.910679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7311bc7-12ae-4261-a587-504c57717066 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.914674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Getting quotas for user 6e3f2f4e6d644b1d9c4743e9753aa9d2 and project 991c8e8abd6b465bad948f659373c920. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:36.923477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7311bc7-12ae-4261-a587-504c57717066 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.932059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7311bc7-12ae-4261-a587-504c57717066 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.932371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7311bc7-12ae-4261-a587-504c57717066 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.960170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:36.962482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:37.121779 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0105b04b-34a7-4771-ac25-103b02b40b98 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.683279 Jul 20 04:30:37.123081 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2252/4411] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:30:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 3685 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 20 04:30:37.135350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fc05256e-c790-4a91-b49d-bc0d80d87bae tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:37.146579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fc05256e-c790-4a91-b49d-bc0d80d87bae tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:37.158979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc05256e-c790-4a91-b49d-bc0d80d87bae tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.159782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc05256e-c790-4a91-b49d-bc0d80d87bae tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.160806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc05256e-c790-4a91-b49d-bc0d80d87bae tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.164435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc05256e-c790-4a91-b49d-bc0d80d87bae tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.359398 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fc05256e-c790-4a91-b49d-bc0d80d87bae tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.234641 Jul 20 04:30:37.360045 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2253/4412] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:37 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:30:37.375026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-203f862b-6bff-43e8-877a-25b18488fc3c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:37.377014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-203f862b-6bff-43e8-877a-25b18488fc3c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:37.561014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a7311bc7-12ae-4261-a587-504c57717066 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:37.591360 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a7311bc7-12ae-4261-a587-504c57717066 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1321 microversion: 2.1 time: 0.705705 Jul 20 04:30:37.597483 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2160/4413] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:36 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1321 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:37.616095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a62283ba-6677-4129-8f4d-6e94d6264914 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:37.618554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a62283ba-6677-4129-8f4d-6e94d6264914 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:37.644093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a62283ba-6677-4129-8f4d-6e94d6264914 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.644609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a62283ba-6677-4129-8f4d-6e94d6264914 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.647783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a62283ba-6677-4129-8f4d-6e94d6264914 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.650592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a62283ba-6677-4129-8f4d-6e94d6264914 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.753251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-203f862b-6bff-43e8-877a-25b18488fc3c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:37.787606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-203f862b-6bff-43e8-877a-25b18488fc3c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:37.789858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-203f862b-6bff-43e8-877a-25b18488fc3c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:37.799204 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-203f862b-6bff-43e8-877a-25b18488fc3c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1279 microversion: 2.20 time: 0.437637 Jul 20 04:30:37.799862 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2254/4414] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:37 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1279 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:37.819324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-0326552c-6e5f-4636-8615-53069973efc7 req-746227a7-fba4-4a75-b644-73dbf66c65cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e", "name": "network-vif-plugged", "status": "completed", "tag": "362251ea-ae21-47c6-aea7-9d20930ce7b1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:37.850580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0326552c-6e5f-4636-8615-53069973efc7 req-746227a7-fba4-4a75-b644-73dbf66c65cb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.851972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0326552c-6e5f-4636-8615-53069973efc7 req-746227a7-fba4-4a75-b644-73dbf66c65cb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.870120 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-0326552c-6e5f-4636-8615-53069973efc7 req-746227a7-fba4-4a75-b644-73dbf66c65cb service nova] Creating event network-vif-plugged:362251ea-ae21-47c6-aea7-9d20930ce7b1 for instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e on n-h2-764485-11 Jul 20 04:30:37.876716 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-0326552c-6e5f-4636-8615-53069973efc7 req-746227a7-fba4-4a75-b644-73dbf66c65cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067678 Jul 20 04:30:37.878185 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2255/4415] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:38.624339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1a9faad8-84eb-4f1e-b0c5-abe5660fe353 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:38.625795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1a9faad8-84eb-4f1e-b0c5-abe5660fe353 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:38.642800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a9faad8-84eb-4f1e-b0c5-abe5660fe353 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:38.646505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a9faad8-84eb-4f1e-b0c5-abe5660fe353 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:38.651687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a9faad8-84eb-4f1e-b0c5-abe5660fe353 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:38.652504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a9faad8-84eb-4f1e-b0c5-abe5660fe353 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:38.732953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a62283ba-6677-4129-8f4d-6e94d6264914 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:38.748655 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a62283ba-6677-4129-8f4d-6e94d6264914 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 1.148451 Jul 20 04:30:38.750018 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2161/4416] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:37 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:38.769294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e5f78a18-4496-41ea-b1ad-e15e7d87cae7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:38.773005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e5f78a18-4496-41ea-b1ad-e15e7d87cae7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:38.782161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5f78a18-4496-41ea-b1ad-e15e7d87cae7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:38.788409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5f78a18-4496-41ea-b1ad-e15e7d87cae7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:38.789597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5f78a18-4496-41ea-b1ad-e15e7d87cae7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:38.790382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5f78a18-4496-41ea-b1ad-e15e7d87cae7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:39.960549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1a9faad8-84eb-4f1e-b0c5-abe5660fe353 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:39.999314 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1a9faad8-84eb-4f1e-b0c5-abe5660fe353 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1321 microversion: 2.1 time: 1.387296 Jul 20 04:30:40.002060 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2256/4417] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:38 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1321 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:40.029739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-af42da71-a0e5-428e-ab5e-fbe89a098612 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.031803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-af42da71-a0e5-428e-ab5e-fbe89a098612 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:40.046888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af42da71-a0e5-428e-ab5e-fbe89a098612 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.047675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af42da71-a0e5-428e-ab5e-fbe89a098612 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.050667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e5f78a18-4496-41ea-b1ad-e15e7d87cae7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:40.052124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af42da71-a0e5-428e-ab5e-fbe89a098612 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.054627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af42da71-a0e5-428e-ab5e-fbe89a098612 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.073635 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e5f78a18-4496-41ea-b1ad-e15e7d87cae7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 1.309868 Jul 20 04:30:40.080861 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2162/4418] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:38 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:40.103829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a168239-711f-4bbb-b20c-0746816dce91 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.107717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4a168239-711f-4bbb-b20c-0746816dce91 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:40.138350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a168239-711f-4bbb-b20c-0746816dce91 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.145633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a168239-711f-4bbb-b20c-0746816dce91 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.147300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a168239-711f-4bbb-b20c-0746816dce91 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.152205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a168239-711f-4bbb-b20c-0746816dce91 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.649128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af42da71-a0e5-428e-ab5e-fbe89a098612 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:40.660792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af42da71-a0e5-428e-ab5e-fbe89a098612 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:40.665626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af42da71-a0e5-428e-ab5e-fbe89a098612 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:40.675906 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-af42da71-a0e5-428e-ab5e-fbe89a098612 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1337 microversion: 2.20 time: 0.664987 Jul 20 04:30:40.681012 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2257/4419] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:40 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1337 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:41.018613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2717cb0-48fa-44ae-bbd6-9ce7c98bf2b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:41.019315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f2717cb0-48fa-44ae-bbd6-9ce7c98bf2b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:41.034200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2717cb0-48fa-44ae-bbd6-9ce7c98bf2b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.038592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2717cb0-48fa-44ae-bbd6-9ce7c98bf2b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.042078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2717cb0-48fa-44ae-bbd6-9ce7c98bf2b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.044391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2717cb0-48fa-44ae-bbd6-9ce7c98bf2b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.155601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a168239-711f-4bbb-b20c-0746816dce91 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:41.172969 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a168239-711f-4bbb-b20c-0746816dce91 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 1.082205 Jul 20 04:30:41.184877 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2163/4420] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:40 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:41.205899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-808d045d-64fd-4014-86be-aad61bfeeb34 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:41.211048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-808d045d-64fd-4014-86be-aad61bfeeb34 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:41.240317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-808d045d-64fd-4014-86be-aad61bfeeb34 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.241213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-808d045d-64fd-4014-86be-aad61bfeeb34 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.244325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-808d045d-64fd-4014-86be-aad61bfeeb34 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.247328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-808d045d-64fd-4014-86be-aad61bfeeb34 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.164503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f2717cb0-48fa-44ae-bbd6-9ce7c98bf2b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:42.174909 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f2717cb0-48fa-44ae-bbd6-9ce7c98bf2b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1502 microversion: 2.1 time: 1.160377 Jul 20 04:30:42.191255 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2258/4421] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:41 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1502 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:42.205458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e50892f4-655a-4894-ad95-d7b9044accd8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:42.209041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e50892f4-655a-4894-ad95-d7b9044accd8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:42.224110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e50892f4-655a-4894-ad95-d7b9044accd8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.225379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e50892f4-655a-4894-ad95-d7b9044accd8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.228407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e50892f4-655a-4894-ad95-d7b9044accd8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.229939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e50892f4-655a-4894-ad95-d7b9044accd8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.237545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-808d045d-64fd-4014-86be-aad61bfeeb34 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:42.251603 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-808d045d-64fd-4014-86be-aad61bfeeb34 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 1.061458 Jul 20 04:30:42.267644 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2164/4422] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:41 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:42.274826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2ebd56e7-807a-428f-9a17-a3a06e287618 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:42.275801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2ebd56e7-807a-428f-9a17-a3a06e287618 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:42.283068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ebd56e7-807a-428f-9a17-a3a06e287618 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.284049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ebd56e7-807a-428f-9a17-a3a06e287618 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.285000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ebd56e7-807a-428f-9a17-a3a06e287618 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.285731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ebd56e7-807a-428f-9a17-a3a06e287618 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.292008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:42.569124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e50892f4-655a-4894-ad95-d7b9044accd8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:42.584555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e50892f4-655a-4894-ad95-d7b9044accd8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:42.590770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e50892f4-655a-4894-ad95-d7b9044accd8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:42.592223 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e50892f4-655a-4894-ad95-d7b9044accd8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1337 microversion: 2.20 time: 0.397446 Jul 20 04:30:42.597307 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2259/4423] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:42 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1337 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:42.602650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a82a4e45-e61b-4972-b6cf-4903223221fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:42.607080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a82a4e45-e61b-4972-b6cf-4903223221fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:42.622528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a82a4e45-e61b-4972-b6cf-4903223221fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.627442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a82a4e45-e61b-4972-b6cf-4903223221fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.628353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a82a4e45-e61b-4972-b6cf-4903223221fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.628814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a82a4e45-e61b-4972-b6cf-4903223221fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.499973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2ebd56e7-807a-428f-9a17-a3a06e287618 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:43.507351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a82a4e45-e61b-4972-b6cf-4903223221fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:43.512460 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2ebd56e7-807a-428f-9a17-a3a06e287618 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1502 microversion: 2.1 time: 1.243283 Jul 20 04:30:43.514062 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2165/4424] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:42 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1502 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:43.529973 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a82a4e45-e61b-4972-b6cf-4903223221fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.931026 Jul 20 04:30:43.530911 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2260/4425] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:42 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:43.542171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ff2724fb-07e1-4f7b-ab48-79320a1903d6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:43.542171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ff2724fb-07e1-4f7b-ab48-79320a1903d6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:43.548767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6517b409-b718-4526-99da-9d091ace27fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:43.548989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff2724fb-07e1-4f7b-ab48-79320a1903d6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.549887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6517b409-b718-4526-99da-9d091ace27fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:43.550493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff2724fb-07e1-4f7b-ab48-79320a1903d6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.552930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff2724fb-07e1-4f7b-ab48-79320a1903d6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.554424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff2724fb-07e1-4f7b-ab48-79320a1903d6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.558640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6517b409-b718-4526-99da-9d091ace27fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.559962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6517b409-b718-4526-99da-9d091ace27fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.561071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6517b409-b718-4526-99da-9d091ace27fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.561754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6517b409-b718-4526-99da-9d091ace27fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.629265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ff2724fb-07e1-4f7b-ab48-79320a1903d6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:43.850004 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ff2724fb-07e1-4f7b-ab48-79320a1903d6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 204 len: 0 microversion: 2.1 time: 0.318789 Jul 20 04:30:43.850845 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2166/4426] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:43 2022] DELETE /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:43.858799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-29da38f0-ace1-40b1-aaa8-2127efc9e31a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:43.859613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-29da38f0-ace1-40b1-aaa8-2127efc9e31a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:43.868290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29da38f0-ace1-40b1-aaa8-2127efc9e31a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.869774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29da38f0-ace1-40b1-aaa8-2127efc9e31a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.870813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29da38f0-ace1-40b1-aaa8-2127efc9e31a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.871459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29da38f0-ace1-40b1-aaa8-2127efc9e31a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:44.870564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-29da38f0-ace1-40b1-aaa8-2127efc9e31a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:44.882023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-29da38f0-ace1-40b1-aaa8-2127efc9e31a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:44.889488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-29da38f0-ace1-40b1-aaa8-2127efc9e31a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:44.890876 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-29da38f0-ace1-40b1-aaa8-2127efc9e31a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1405 microversion: 2.20 time: 1.038627 Jul 20 04:30:44.900371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6517b409-b718-4526-99da-9d091ace27fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:44.905247 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2167/4427] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:43 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1405 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:44.915801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b7aea24d-4803-40f8-935f-b963930cf602 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:44.916660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b7aea24d-4803-40f8-935f-b963930cf602 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:44.918012 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6517b409-b718-4526-99da-9d091ace27fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 1.373790 Jul 20 04:30:44.924254 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2261/4428] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:43 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:44.932948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b7aea24d-4803-40f8-935f-b963930cf602 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:44.938986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b7aea24d-4803-40f8-935f-b963930cf602 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:44.940038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b7aea24d-4803-40f8-935f-b963930cf602 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:44.941061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b7aea24d-4803-40f8-935f-b963930cf602 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.310031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ba7d5873-216e-4684-8282-dffb0dde6caa tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Action: 'create', calling method: .version_select at 0x7fbf9d3af9d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-110359417", "policies": ["affinity"]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:45.358384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ba7d5873-216e-4684-8282-dffb0dde6caa tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:45.387018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ba7d5873-216e-4684-8282-dffb0dde6caa tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:45.407569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b7aea24d-4803-40f8-935f-b963930cf602 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:45.427869 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b7aea24d-4803-40f8-935f-b963930cf602 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1508 microversion: 2.1 time: 0.521243 Jul 20 04:30:45.430869 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2168/4429] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:44 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1508 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:45.496683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ba7d5873-216e-4684-8282-dffb0dde6caa tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:45.503868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ba7d5873-216e-4684-8282-dffb0dde6caa tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:45.537790 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ba7d5873-216e-4684-8282-dffb0dde6caa tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.611998 Jul 20 04:30:45.539042 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2262/4430] 10.222.0.20 () {60 vars in 1173 bytes} [Wed Jul 20 04:30:44 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:45.566377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8181f5a6-812a-449f-8ef6-e8a11115da12 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Action: 'create', calling method: .version_select at 0x7fbf9c2bab80>, body: {"server_group": {"name": "tempest-server-group-221468168", "policies": ["affinity"]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:45.605752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-8181f5a6-812a-449f-8ef6-e8a11115da12 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:45.613057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-8181f5a6-812a-449f-8ef6-e8a11115da12 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:45.682669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-8181f5a6-812a-449f-8ef6-e8a11115da12 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:45.695104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-8181f5a6-812a-449f-8ef6-e8a11115da12 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:45.736177 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8181f5a6-812a-449f-8ef6-e8a11115da12 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.189782 Jul 20 04:30:45.737570 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2169/4431] 10.222.0.20 () {60 vars in 1172 bytes} [Wed Jul 20 04:30:45 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:45.748235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fee67716-4314-441c-b98c-52f40b118e25 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Action: 'create', calling method: .version_select at 0x7fbf9c86fc10>, body: {"server_group": {"name": "tempest-server-group-221468168", "policies": ["affinity"]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:45.791044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-fee67716-4314-441c-b98c-52f40b118e25 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:45.799329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-fee67716-4314-441c-b98c-52f40b118e25 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:45.861589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-fee67716-4314-441c-b98c-52f40b118e25 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:45.873404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-fee67716-4314-441c-b98c-52f40b118e25 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:45.890964 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fee67716-4314-441c-b98c-52f40b118e25 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.147031 Jul 20 04:30:45.892363 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2263/4432] 10.222.0.20 () {60 vars in 1172 bytes} [Wed Jul 20 04:30:45 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:45.902571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fee83c80-c51b-4e50-8f4a-0fb08b39d83a tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:45.922537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8767e523-218a-4739-a910-d2cc9fe42d0c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:45.923486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8767e523-218a-4739-a910-d2cc9fe42d0c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:45.935019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8767e523-218a-4739-a910-d2cc9fe42d0c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.936904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8767e523-218a-4739-a910-d2cc9fe42d0c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.939417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8767e523-218a-4739-a910-d2cc9fe42d0c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.940969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8767e523-218a-4739-a910-d2cc9fe42d0c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.989963 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fee83c80-c51b-4e50-8f4a-0fb08b39d83a tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/3d94f302-39bc-4ba1-883a-30f7a354c2ce" status: 204 len: 0 microversion: 2.1 time: 0.087533 Jul 20 04:30:45.991495 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2170/4433] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:45 2022] DELETE /compute/v2.1/os-server-groups/3d94f302-39bc-4ba1-883a-30f7a354c2ce => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:45.999321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-df31c872-6547-4c84-bc69-f8d995683070 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.048888 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-df31c872-6547-4c84-bc69-f8d995683070 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.053229 Jul 20 04:30:46.062982 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2171/4434] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:30:45 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:46.068826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee9ea4d8-4000-4be3-9caf-7d5bef0e8cc6 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.111923 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ee9ea4d8-4000-4be3-9caf-7d5bef0e8cc6 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/546bfea4-dd8a-493e-a9f8-e0f3061f5bee" status: 204 len: 0 microversion: 2.1 time: 0.047056 Jul 20 04:30:46.114342 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2172/4435] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:46 2022] DELETE /compute/v2.1/os-server-groups/546bfea4-dd8a-493e-a9f8-e0f3061f5bee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:46.124871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5121d386-4281-4b62-b6b4-d574b5578eec tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.149376 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5121d386-4281-4b62-b6b4-d574b5578eec tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029110 Jul 20 04:30:46.153112 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2173/4436] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:30:46 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:46.169205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-042c31b1-8750-4392-a298-4f8e004dc372 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Action: 'create', calling method: .version_select at 0x7fbf9c2c5d30>, body: {"server_group": {"name": "tempest-server-group-1922543934", "policies": ["affinity"]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:46.226083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-042c31b1-8750-4392-a298-4f8e004dc372 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:46.247355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-042c31b1-8750-4392-a298-4f8e004dc372 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:46.346586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-042c31b1-8750-4392-a298-4f8e004dc372 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:46.349559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:46.358568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-042c31b1-8750-4392-a298-4f8e004dc372 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:46.382538 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-042c31b1-8750-4392-a298-4f8e004dc372 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.224864 Jul 20 04:30:46.389594 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2174/4437] 10.222.0.20 () {60 vars in 1172 bytes} [Wed Jul 20 04:30:46 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:46.396464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4645f8fb-7fb7-4b19-ae6a-8527bc6c6be2 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.453003 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4645f8fb-7fb7-4b19-ae6a-8527bc6c6be2 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/ee59def6-9c0e-485f-8e4c-571df9f4522a" status: 204 len: 0 microversion: 2.1 time: 0.060275 Jul 20 04:30:46.456583 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2175/4438] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:46 2022] DELETE /compute/v2.1/os-server-groups/ee59def6-9c0e-485f-8e4c-571df9f4522a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:46.467310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f62f21e1-175f-49fc-ac9f-bbfbcb56ab20 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.467975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f62f21e1-175f-49fc-ac9f-bbfbcb56ab20 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:46.476375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f62f21e1-175f-49fc-ac9f-bbfbcb56ab20 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.477240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f62f21e1-175f-49fc-ac9f-bbfbcb56ab20 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.479227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f62f21e1-175f-49fc-ac9f-bbfbcb56ab20 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.484796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f62f21e1-175f-49fc-ac9f-bbfbcb56ab20 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.750414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8767e523-218a-4739-a910-d2cc9fe42d0c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:46.765356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8767e523-218a-4739-a910-d2cc9fe42d0c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:46.768431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8767e523-218a-4739-a910-d2cc9fe42d0c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:46.777917 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8767e523-218a-4739-a910-d2cc9fe42d0c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1405 microversion: 2.20 time: 0.858943 Jul 20 04:30:46.780080 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2264/4439] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:45 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1405 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:30:46.786510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-86f4e4a7-5dec-4e7f-aae7-91466467c8b3 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.805761 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-86f4e4a7-5dec-4e7f-aae7-91466467c8b3 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.023964 Jul 20 04:30:46.807236 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2265/4440] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:30:46 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:46.820123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a5129ec-8794-4e66-8d75-6eea62e3bf41 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Action: 'create', calling method: .version_select at 0x7fbf9c7fe8b0>, body: {"server_group": {"name": "tempest-server-group-354131648", "policies": ["anti-affinity"]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:46.845709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3a5129ec-8794-4e66-8d75-6eea62e3bf41 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:46.853776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:46.861217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3a5129ec-8794-4e66-8d75-6eea62e3bf41 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:46.874851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:46.926074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3a5129ec-8794-4e66-8d75-6eea62e3bf41 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:46.933658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3a5129ec-8794-4e66-8d75-6eea62e3bf41 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_groups'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:46.946664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f62f21e1-175f-49fc-ac9f-bbfbcb56ab20 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:46.952233 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a5129ec-8794-4e66-8d75-6eea62e3bf41 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.137395 Jul 20 04:30:46.953031 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2266/4441] 10.222.0.20 () {60 vars in 1172 bytes} [Wed Jul 20 04:30:46 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:46.963674 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f62f21e1-175f-49fc-ac9f-bbfbcb56ab20 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 200 len: 1508 microversion: 2.1 time: 0.505832 Jul 20 04:30:46.964229 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2176/4442] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:46 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 1508 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:46.978303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ccb3f405-bc5a-46ea-bbed-5af261d6ebc3 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:47.036862 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ccb3f405-bc5a-46ea-bbed-5af261d6ebc3 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/a8f29d63-44b2-42d0-b427-21b5c733a934" status: 204 len: 0 microversion: 2.1 time: 0.077562 Jul 20 04:30:47.041323 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2267/4443] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:46 2022] DELETE /compute/v2.1/os-server-groups/a8f29d63-44b2-42d0-b427-21b5c733a934 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:30:47.051933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f5130c4-306d-4c59-8bdb-70a9987f4afc tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:47.079146 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2f5130c4-306d-4c59-8bdb-70a9987f4afc tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.031976 Jul 20 04:30:47.097209 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2177/4444] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:30:47 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:47.370061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-325846760", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2934adb1-625b-4ea3-82a6-7fd0037ea7a2"}]}, "os:scheduler_hints": {"group": "c326f59d-5db2-496e-8669-4ff9d32aa900"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:47.442347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c74af2a4-5978-407b-8df6-2c0e51ebd958 req-52b7d751-07b4-4c6e-b847-977b4706c674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e", "name": "network-vif-deleted", "tag": "362251ea-ae21-47c6-aea7-9d20930ce7b1"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:47.470328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] validate_networks() for [('2934adb1-625b-4ea3-82a6-7fd0037ea7a2', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:47.482143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c74af2a4-5978-407b-8df6-2c0e51ebd958 req-52b7d751-07b4-4c6e-b847-977b4706c674 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.482615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c74af2a4-5978-407b-8df6-2c0e51ebd958 req-52b7d751-07b4-4c6e-b847-977b4706c674 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:47.541802 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c74af2a4-5978-407b-8df6-2c0e51ebd958 req-52b7d751-07b4-4c6e-b847-977b4706c674 service nova] Creating event network-vif-deleted:362251ea-ae21-47c6-aea7-9d20930ce7b1 for instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e on n-h2-764485-11 Jul 20 04:30:47.558049 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c74af2a4-5978-407b-8df6-2c0e51ebd958 req-52b7d751-07b4-4c6e-b847-977b4706c674 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123387 Jul 20 04:30:47.559889 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2178/4445] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:47.841549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b21ef82f-fa0d-40c6-bf31-b22b51b360a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:47.844074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b21ef82f-fa0d-40c6-bf31-b22b51b360a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:47.860638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b21ef82f-fa0d-40c6-bf31-b22b51b360a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.863086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b21ef82f-fa0d-40c6-bf31-b22b51b360a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:47.865830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b21ef82f-fa0d-40c6-bf31-b22b51b360a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.867387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b21ef82f-fa0d-40c6-bf31-b22b51b360a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:48.403878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b21ef82f-fa0d-40c6-bf31-b22b51b360a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:48.416561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b21ef82f-fa0d-40c6-bf31-b22b51b360a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:48.418153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b21ef82f-fa0d-40c6-bf31-b22b51b360a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:48.419314 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b21ef82f-fa0d-40c6-bf31-b22b51b360a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1405 microversion: 2.20 time: 0.624877 Jul 20 04:30:48.423971 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2179/4446] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:47 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1405 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:48.433450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9c5a9e9-330d-46a3-a4ff-602a14808c5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:48.434071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b9c5a9e9-330d-46a3-a4ff-602a14808c5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:48.448143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9c5a9e9-330d-46a3-a4ff-602a14808c5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:48.448611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9c5a9e9-330d-46a3-a4ff-602a14808c5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:48.449385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9c5a9e9-330d-46a3-a4ff-602a14808c5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:48.449812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9c5a9e9-330d-46a3-a4ff-602a14808c5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:48.485124 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b9c5a9e9-330d-46a3-a4ff-602a14808c5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9c5a9e9-330d-46a3-a4ff-602a14808c5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e HTTP/1.1 Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e'} Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.487054 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:48.491527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:48.491527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:48.491527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:48.491527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:48.491527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:30:48.491527 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:30:48.493283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9c5a9e9-330d-46a3-a4ff-602a14808c5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:48.494379 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b9c5a9e9-330d-46a3-a4ff-602a14808c5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 404 len: 111 microversion: 2.1 time: 0.069541 Jul 20 04:30:48.508439 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2180/4447] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:48 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:48.515493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ab3342ab-9a1b-42df-9f9e-4193e9547288 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'create', calling method: .version_select at 0x7fbf9da049d0>, body: {"keypair": {"name": "tempest-key-2024397217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ4h5rLCjCocXf+nki2eqkNkln0qTKMt1+5YBxWj9p7vo+qcFofwWJ2icneTOidAoFEuS4EBAIUxx1k6hA+uH3zmFcVGFYyGB/GY8yM9BWN77Z6qzQi2gnXu9mCfXifIA=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:48.552531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ab3342ab-9a1b-42df-9f9e-4193e9547288 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for project abea957d3266410c8c9dab8b52a7c170. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:48.568723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ab3342ab-9a1b-42df-9f9e-4193e9547288 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for user 7d38b1e323c5490fbb4c0023034874c8 and project abea957d3266410c8c9dab8b52a7c170. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:48.684958 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ab3342ab-9a1b-42df-9f9e-4193e9547288 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.174676 Jul 20 04:30:48.685596 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2181/4448] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:30:48 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:48.703761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9fa47579-fea5-4982-9499-fb2db755ef0b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '.version_select at 0x7fbf9c259700>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:48.710924 n-d-764485-11 devstack@n-api.service[119807]: WARNING oslo_db.sqlalchemy.utils [None req-9fa47579-fea5-4982-9499-fb2db755ef0b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:30:48.733423 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9fa47579-fea5-4982-9499-fb2db755ef0b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.037682 Jul 20 04:30:48.734111 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2182/4449] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:30:48 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:48.809140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:48.809646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:48.810232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:48.810956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:48.811578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:48.862197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:48.863109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:48.864047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:48.864615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:48.932929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:48.945940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:48.963603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:48.966404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:49.018490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119808) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 20 04:30:49.056311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-963800264", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "key_name": "tempest-key-2024397217", "networks": [{"uuid": "be069fc8-30ed-40bc-8dbd-2efb24615595"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:49.070379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_group_members'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:49.078401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_group_members'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:49.142639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] validate_networks() for [('be069fc8-30ed-40bc-8dbd-2efb24615595', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:49.204059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_group_members'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:49.220910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Getting quotas for user 4eee80ad4f764b3cbc2c19ec8e3559b0 and project ae939314deaf4daf8fa564f351b9671b. Resources: {'server_group_members'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:49.288863 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f3602c7f-dee5-43d1-b752-8be8155bc874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.922700 Jul 20 04:30:49.289911 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2268/4450] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:30:49.306740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6acce366-250e-43cc-a11b-1d107061682c tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:49.307425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6acce366-250e-43cc-a11b-1d107061682c tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:49.439566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6acce366-250e-43cc-a11b-1d107061682c tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:49.449816 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6acce366-250e-43cc-a11b-1d107061682c tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1212 microversion: 2.1 time: 0.154279 Jul 20 04:30:49.459917 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2269/4451] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:49 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1212 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:49.465006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67b6e3b2-e846-4e78-99f2-2847a306072f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:49.474846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67b6e3b2-e846-4e78-99f2-2847a306072f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:49.490232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67b6e3b2-e846-4e78-99f2-2847a306072f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:49.491098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67b6e3b2-e846-4e78-99f2-2847a306072f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:49.492506 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67b6e3b2-e846-4e78-99f2-2847a306072f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:49.495472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67b6e3b2-e846-4e78-99f2-2847a306072f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:50.220420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67b6e3b2-e846-4e78-99f2-2847a306072f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:50.244288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67b6e3b2-e846-4e78-99f2-2847a306072f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:50.251206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67b6e3b2-e846-4e78-99f2-2847a306072f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:50.262047 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67b6e3b2-e846-4e78-99f2-2847a306072f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1405 microversion: 2.20 time: 0.800737 Jul 20 04:30:50.264831 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2270/4452] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:49 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1405 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:50.348872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:50.350026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:50.350666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:50.351549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:50.352126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:50.370621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:50.371323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:50.373443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:50.375042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:50.446611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:50.456800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for user 7d38b1e323c5490fbb4c0023034874c8 and project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:50.499526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:50.508538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:50.563059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6f326c50-f79e-4719-ac6f-dc5c28e1a8ef req-dcb9c0f9-8b99-40ca-9490-5f6f702c3417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76d5764-986d-4d3f-806f-1f8b1c5a73c1", "tag": "f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:50.596159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6f326c50-f79e-4719-ac6f-dc5c28e1a8ef req-dcb9c0f9-8b99-40ca-9490-5f6f702c3417 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:50.599742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6f326c50-f79e-4719-ac6f-dc5c28e1a8ef req-dcb9c0f9-8b99-40ca-9490-5f6f702c3417 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:50.647820 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6f326c50-f79e-4719-ac6f-dc5c28e1a8ef req-dcb9c0f9-8b99-40ca-9490-5f6f702c3417 service nova] Creating event network-changed:f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981 for instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 on n-h1-764485-11 Jul 20 04:30:50.659543 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6f326c50-f79e-4719-ac6f-dc5c28e1a8ef req-dcb9c0f9-8b99-40ca-9490-5f6f702c3417 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.392077 Jul 20 04:30:50.667269 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2271/4453] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:50.685113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1cb20a9c-ee8e-487f-aa8b-a86ee0ed5db6 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:50.685840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1cb20a9c-ee8e-487f-aa8b-a86ee0ed5db6 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:50.690153 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f1c0338f-f327-4d8e-b471-bac6a06e7f7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.647674 Jul 20 04:30:50.695212 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2183/4454] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:30:50.713242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cb20a9c-ee8e-487f-aa8b-a86ee0ed5db6 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:50.716141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cb20a9c-ee8e-487f-aa8b-a86ee0ed5db6 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:50.717141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f3a13c52-ded2-436e-abcf-80cf786f6e67 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:50.719307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cb20a9c-ee8e-487f-aa8b-a86ee0ed5db6 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:50.719992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cb20a9c-ee8e-487f-aa8b-a86ee0ed5db6 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:50.724938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f3a13c52-ded2-436e-abcf-80cf786f6e67 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:50.837316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f3a13c52-ded2-436e-abcf-80cf786f6e67 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:50.847019 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f3a13c52-ded2-436e-abcf-80cf786f6e67 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1228 microversion: 2.1 time: 0.145575 Jul 20 04:30:50.852484 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2184/4455] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:50 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1228 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:50.909771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1cb20a9c-ee8e-487f-aa8b-a86ee0ed5db6 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:50.922794 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1cb20a9c-ee8e-487f-aa8b-a86ee0ed5db6 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1264 microversion: 2.1 time: 0.253120 Jul 20 04:30:50.929570 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2272/4456] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:50 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:51.282502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cf1b9cc2-5319-4845-9f85-062e1aa367cd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:51.283128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cf1b9cc2-5319-4845-9f85-062e1aa367cd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:51.295070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf1b9cc2-5319-4845-9f85-062e1aa367cd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:51.298768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf1b9cc2-5319-4845-9f85-062e1aa367cd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:51.304819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf1b9cc2-5319-4845-9f85-062e1aa367cd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:51.305544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf1b9cc2-5319-4845-9f85-062e1aa367cd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:51.659395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf1b9cc2-5319-4845-9f85-062e1aa367cd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:51.666859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf1b9cc2-5319-4845-9f85-062e1aa367cd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:51.674345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf1b9cc2-5319-4845-9f85-062e1aa367cd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:51.676312 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cf1b9cc2-5319-4845-9f85-062e1aa367cd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1405 microversion: 2.20 time: 0.397713 Jul 20 04:30:51.690117 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2185/4457] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:51 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:51.870427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cfae01f0-b5bd-4894-ad31-ee08a5335177 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:51.872434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cfae01f0-b5bd-4894-ad31-ee08a5335177 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:51.888344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cfae01f0-b5bd-4894-ad31-ee08a5335177 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:51.894199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cfae01f0-b5bd-4894-ad31-ee08a5335177 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:51.909206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cfae01f0-b5bd-4894-ad31-ee08a5335177 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:51.911933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cfae01f0-b5bd-4894-ad31-ee08a5335177 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:51.947078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-feef340b-0d59-4e2e-93ba-f9b36439cd6b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:51.947736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-feef340b-0d59-4e2e-93ba-f9b36439cd6b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:51.975754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-feef340b-0d59-4e2e-93ba-f9b36439cd6b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:51.976648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-feef340b-0d59-4e2e-93ba-f9b36439cd6b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:51.979600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-feef340b-0d59-4e2e-93ba-f9b36439cd6b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:51.981061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-feef340b-0d59-4e2e-93ba-f9b36439cd6b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:52.349207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-feef340b-0d59-4e2e-93ba-f9b36439cd6b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:52.362527 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-feef340b-0d59-4e2e-93ba-f9b36439cd6b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1270 microversion: 2.1 time: 0.419627 Jul 20 04:30:52.366068 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2186/4458] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:51 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1270 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:52.376339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cfae01f0-b5bd-4894-ad31-ee08a5335177 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:52.379736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:52.399022 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cfae01f0-b5bd-4894-ad31-ee08a5335177 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1224 microversion: 2.1 time: 0.533608 Jul 20 04:30:52.402222 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2273/4459] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:51 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1224 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:52.698931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-52a698d8-8cef-45dc-b361-a3d5d403b38c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:52.699601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-52a698d8-8cef-45dc-b361-a3d5d403b38c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:52.714285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52a698d8-8cef-45dc-b361-a3d5d403b38c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:52.719229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52a698d8-8cef-45dc-b361-a3d5d403b38c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:52.720386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52a698d8-8cef-45dc-b361-a3d5d403b38c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:52.721006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52a698d8-8cef-45dc-b361-a3d5d403b38c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:53.265856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1ca6f837-281d-4ac7-89b5-1b23c5d56a85 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:53.293383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ca6f837-281d-4ac7-89b5-1b23c5d56a85 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:53.293852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1ca6f837-281d-4ac7-89b5-1b23c5d56a85 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:53.338298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1ca6f837-281d-4ac7-89b5-1b23c5d56a85 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Going to try to stop instance {{(pid=119808) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:30:53.437608 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1ca6f837-281d-4ac7-89b5-1b23c5d56a85 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "POST /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/action" status: 202 len: 0 microversion: 2.1 time: 0.169720 Jul 20 04:30:53.441115 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2274/4460] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:53 2022] POST /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:30:53.446879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4afba14a-317c-4d19-9989-d7c84e8c0874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:53.447681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4afba14a-317c-4d19-9989-d7c84e8c0874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:53.459186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4afba14a-317c-4d19-9989-d7c84e8c0874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:53.460627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4afba14a-317c-4d19-9989-d7c84e8c0874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:53.462266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4afba14a-317c-4d19-9989-d7c84e8c0874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:53.462899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4afba14a-317c-4d19-9989-d7c84e8c0874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:53.811038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4afba14a-317c-4d19-9989-d7c84e8c0874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:53.820107 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4afba14a-317c-4d19-9989-d7c84e8c0874 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1270 microversion: 2.1 time: 0.379434 Jul 20 04:30:53.821307 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2275/4461] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:53 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1270 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:53.827294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b1d80699-9806-4266-bd9d-11b282597cfc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:53.828377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b1d80699-9806-4266-bd9d-11b282597cfc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:53.836834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1d80699-9806-4266-bd9d-11b282597cfc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:53.837618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1d80699-9806-4266-bd9d-11b282597cfc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:53.838586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1d80699-9806-4266-bd9d-11b282597cfc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:53.839024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1d80699-9806-4266-bd9d-11b282597cfc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:54.152202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b1d80699-9806-4266-bd9d-11b282597cfc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:54.166893 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b1d80699-9806-4266-bd9d-11b282597cfc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1286 microversion: 2.1 time: 0.343079 Jul 20 04:30:54.167878 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2276/4462] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:53 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1286 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:54.173835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ed94ac46-cda3-4a76-a40d-e4d83552a88a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:54.174657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ed94ac46-cda3-4a76-a40d-e4d83552a88a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:54.184210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed94ac46-cda3-4a76-a40d-e4d83552a88a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:54.184906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed94ac46-cda3-4a76-a40d-e4d83552a88a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:54.187279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed94ac46-cda3-4a76-a40d-e4d83552a88a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:54.188066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed94ac46-cda3-4a76-a40d-e4d83552a88a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:54.430010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-52a698d8-8cef-45dc-b361-a3d5d403b38c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:54.441018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-52a698d8-8cef-45dc-b361-a3d5d403b38c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:54.459432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-52a698d8-8cef-45dc-b361-a3d5d403b38c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:54.462738 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-52a698d8-8cef-45dc-b361-a3d5d403b38c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1405 microversion: 2.20 time: 1.766981 Jul 20 04:30:54.464419 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2187/4463] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:52 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1405 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:54.575204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-249465795", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:54.693907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] validate_networks() for [('2601f58c-d54c-42c1-850f-a93d0087b3cf', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:55.125297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ed94ac46-cda3-4a76-a40d-e4d83552a88a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:55.137579 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ed94ac46-cda3-4a76-a40d-e4d83552a88a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1720 microversion: 2.1 time: 0.968062 Jul 20 04:30:55.147330 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2277/4464] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:54 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1720 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:55.159620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aa886e94-1074-4422-929f-230af11ed13a tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:55.161500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aa886e94-1074-4422-929f-230af11ed13a tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:55.175481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa886e94-1074-4422-929f-230af11ed13a tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:55.176009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa886e94-1074-4422-929f-230af11ed13a tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:55.176828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa886e94-1074-4422-929f-230af11ed13a tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:55.177265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa886e94-1074-4422-929f-230af11ed13a tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:55.798292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aa886e94-1074-4422-929f-230af11ed13a tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:55.822100 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aa886e94-1074-4422-929f-230af11ed13a tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1312 microversion: 2.1 time: 0.672580 Jul 20 04:30:55.829093 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2278/4465] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:55 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1312 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:55.840166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6d290bf2-b05b-4154-b189-d3669de1bbe0 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:55.841142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6d290bf2-b05b-4154-b189-d3669de1bbe0 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:55.849643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d290bf2-b05b-4154-b189-d3669de1bbe0 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:55.850094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d290bf2-b05b-4154-b189-d3669de1bbe0 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:55.850868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d290bf2-b05b-4154-b189-d3669de1bbe0 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:55.851308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d290bf2-b05b-4154-b189-d3669de1bbe0 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:56.057070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6d290bf2-b05b-4154-b189-d3669de1bbe0 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:56.068209 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6d290bf2-b05b-4154-b189-d3669de1bbe0 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1286 microversion: 2.1 time: 0.234023 Jul 20 04:30:56.069553 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2279/4466] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:55 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1286 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:56.076603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ee417ff5-eb4e-46bd-92b1-b3007761dab5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:56.077492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ee417ff5-eb4e-46bd-92b1-b3007761dab5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:56.088872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee417ff5-eb4e-46bd-92b1-b3007761dab5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:56.089510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee417ff5-eb4e-46bd-92b1-b3007761dab5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:56.090307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee417ff5-eb4e-46bd-92b1-b3007761dab5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:56.091781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee417ff5-eb4e-46bd-92b1-b3007761dab5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.186293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee417ff5-eb4e-46bd-92b1-b3007761dab5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:57.200030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee417ff5-eb4e-46bd-92b1-b3007761dab5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:57.203307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee417ff5-eb4e-46bd-92b1-b3007761dab5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:57.204532 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ee417ff5-eb4e-46bd-92b1-b3007761dab5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1405 microversion: 2.20 time: 1.132800 Jul 20 04:30:57.209215 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2280/4467] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:56 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1405 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:57.223884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-883e560a-b8a2-46e0-b3c1-a7a5d8bc80f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:57.226663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-883e560a-b8a2-46e0-b3c1-a7a5d8bc80f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:57.240837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:57.243301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-883e560a-b8a2-46e0-b3c1-a7a5d8bc80f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.246405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-883e560a-b8a2-46e0-b3c1-a7a5d8bc80f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.248793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-883e560a-b8a2-46e0-b3c1-a7a5d8bc80f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.249425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-883e560a-b8a2-46e0-b3c1-a7a5d8bc80f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.437301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:57.437947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:57.438661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:57.439083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:57.439525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:57.465209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.473211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.475885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.477181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.518029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Getting quotas for project 2bb95832b0b941c98c6d555d2066ff3b. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:57.529912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Getting quotas for user c6ac8188b69c4089858c1fdc6fbdbf66 and project 2bb95832b0b941c98c6d555d2066ff3b. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:57.543996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-883e560a-b8a2-46e0-b3c1-a7a5d8bc80f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:57.549827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:57.554661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:57.560910 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-883e560a-b8a2-46e0-b3c1-a7a5d8bc80f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1720 microversion: 2.1 time: 0.348919 Jul 20 04:30:57.562016 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2281/4468] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:57 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1720 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:57.573983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a2f350f7-6810-44b2-9b6a-e2127f40c594 req-0affeefe-053f-48a9-b7c0-10b5cdb0292f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76d5764-986d-4d3f-806f-1f8b1c5a73c1", "name": "network-vif-plugged", "status": "completed", "tag": "f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:57.596207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a2f350f7-6810-44b2-9b6a-e2127f40c594 req-0affeefe-053f-48a9-b7c0-10b5cdb0292f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.599618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a2f350f7-6810-44b2-9b6a-e2127f40c594 req-0affeefe-053f-48a9-b7c0-10b5cdb0292f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.634601 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a2f350f7-6810-44b2-9b6a-e2127f40c594 req-0affeefe-053f-48a9-b7c0-10b5cdb0292f service nova] Creating event network-vif-plugged:f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981 for instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 on n-h1-764485-11 Jul 20 04:30:57.654671 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a2f350f7-6810-44b2-9b6a-e2127f40c594 req-0affeefe-053f-48a9-b7c0-10b5cdb0292f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089118 Jul 20 04:30:57.657488 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2282/4469] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:57.668927 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7d3131d4-a8cb-44fd-9a57-40aa4f7308ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.203124 Jul 20 04:30:57.672286 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2188/4470] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:30:57.683325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88a9dcfa-fd85-4edf-8851-13fc49f2b59f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:57.684078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88a9dcfa-fd85-4edf-8851-13fc49f2b59f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:57.686208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-627f7064-af5e-47b7-a8eb-f382d8200709 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:57.686856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-627f7064-af5e-47b7-a8eb-f382d8200709 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:57.702636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88a9dcfa-fd85-4edf-8851-13fc49f2b59f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.705303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88a9dcfa-fd85-4edf-8851-13fc49f2b59f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.709004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88a9dcfa-fd85-4edf-8851-13fc49f2b59f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.709638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-627f7064-af5e-47b7-a8eb-f382d8200709 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.710107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-627f7064-af5e-47b7-a8eb-f382d8200709 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.710229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88a9dcfa-fd85-4edf-8851-13fc49f2b59f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.713907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-627f7064-af5e-47b7-a8eb-f382d8200709 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.716609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-627f7064-af5e-47b7-a8eb-f382d8200709 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:58.589558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-627f7064-af5e-47b7-a8eb-f382d8200709 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:58.605611 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-627f7064-af5e-47b7-a8eb-f382d8200709 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 0.931959 Jul 20 04:30:58.606215 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2189/4471] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:57 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:58.625178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-240de391-9e01-4767-bed6-483a6febb8ba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:58.627741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-240de391-9e01-4767-bed6-483a6febb8ba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:58.634693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88a9dcfa-fd85-4edf-8851-13fc49f2b59f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:58.653882 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88a9dcfa-fd85-4edf-8851-13fc49f2b59f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1312 microversion: 2.1 time: 0.994923 Jul 20 04:30:58.654502 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2283/4472] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:57 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1312 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:58.676647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a67ffb34-1c9e-4c99-8766-ab82026a0e6e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:58.677738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a67ffb34-1c9e-4c99-8766-ab82026a0e6e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:58.697488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a67ffb34-1c9e-4c99-8766-ab82026a0e6e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:58.697953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a67ffb34-1c9e-4c99-8766-ab82026a0e6e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:58.708243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a67ffb34-1c9e-4c99-8766-ab82026a0e6e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:58.708816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a67ffb34-1c9e-4c99-8766-ab82026a0e6e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:58.889884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:58.892597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-240de391-9e01-4767-bed6-483a6febb8ba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:58.902352 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-240de391-9e01-4767-bed6-483a6febb8ba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1216 microversion: 2.1 time: 0.285594 Jul 20 04:30:58.908695 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2190/4473] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:58 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1216 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:58.914560 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-addfbf55-71cc-4667-b1f3-8eab9cc35727 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:58.919330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-addfbf55-71cc-4667-b1f3-8eab9cc35727 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:58.954285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-addfbf55-71cc-4667-b1f3-8eab9cc35727 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:58.955166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-addfbf55-71cc-4667-b1f3-8eab9cc35727 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:58.956188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-addfbf55-71cc-4667-b1f3-8eab9cc35727 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:58.956815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-addfbf55-71cc-4667-b1f3-8eab9cc35727 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:59.452115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=48 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:59.564900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a67ffb34-1c9e-4c99-8766-ab82026a0e6e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:59.586396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a67ffb34-1c9e-4c99-8766-ab82026a0e6e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:59.601279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a67ffb34-1c9e-4c99-8766-ab82026a0e6e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:59.610410 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a67ffb34-1c9e-4c99-8766-ab82026a0e6e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1405 microversion: 2.20 time: 0.947515 Jul 20 04:30:59.611287 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2284/4474] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:58 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1405 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:59.651094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6aff1c33-374a-4762-8b92-ab945a35df8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:59.655293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6aff1c33-374a-4762-8b92-ab945a35df8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:59.680160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6aff1c33-374a-4762-8b92-ab945a35df8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:59.681494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6aff1c33-374a-4762-8b92-ab945a35df8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:59.683357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6aff1c33-374a-4762-8b92-ab945a35df8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:59.684874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6aff1c33-374a-4762-8b92-ab945a35df8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:59.824177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-addfbf55-71cc-4667-b1f3-8eab9cc35727 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:59.838756 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-addfbf55-71cc-4667-b1f3-8eab9cc35727 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1720 microversion: 2.1 time: 0.928703 Jul 20 04:30:59.840290 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2191/4475] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:58 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1720 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:59.849256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2860616c-0379-424e-85af-9ea4ff42218b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:59.855171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2860616c-0379-424e-85af-9ea4ff42218b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:59.869931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2860616c-0379-424e-85af-9ea4ff42218b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:59.871037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2860616c-0379-424e-85af-9ea4ff42218b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:59.873408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2860616c-0379-424e-85af-9ea4ff42218b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:59.873875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2860616c-0379-424e-85af-9ea4ff42218b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:00.424421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2860616c-0379-424e-85af-9ea4ff42218b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:00.434427 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2860616c-0379-424e-85af-9ea4ff42218b tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1312 microversion: 2.1 time: 0.592825 Jul 20 04:31:00.446720 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2192/4476] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:59 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1312 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:00.463206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cba29e25-5194-405d-8ef7-8cc8e841d9de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:00.463921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cba29e25-5194-405d-8ef7-8cc8e841d9de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:00.498546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cba29e25-5194-405d-8ef7-8cc8e841d9de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:00.499011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cba29e25-5194-405d-8ef7-8cc8e841d9de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:00.499836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cba29e25-5194-405d-8ef7-8cc8e841d9de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:00.500279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cba29e25-5194-405d-8ef7-8cc8e841d9de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:00.646857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6aff1c33-374a-4762-8b92-ab945a35df8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:00.658450 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6aff1c33-374a-4762-8b92-ab945a35df8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 1.029061 Jul 20 04:31:00.669425 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2285/4477] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:59 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:00.681081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-e4e4b4b2-dd7b-4e81-82a8-a88c672ec38c req-036fd0ce-2008-4378-b500-3560b421dc28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9777f396-9873-4ba1-8c76-55a9f1cf28c6", "tag": "d88039bf-f27b-47eb-a161-b374a889aafe"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:00.700424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e4e4b4b2-dd7b-4e81-82a8-a88c672ec38c req-036fd0ce-2008-4378-b500-3560b421dc28 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:00.700876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e4e4b4b2-dd7b-4e81-82a8-a88c672ec38c req-036fd0ce-2008-4378-b500-3560b421dc28 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:00.726896 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e4e4b4b2-dd7b-4e81-82a8-a88c672ec38c req-036fd0ce-2008-4378-b500-3560b421dc28 service nova] Creating event network-changed:d88039bf-f27b-47eb-a161-b374a889aafe for instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 on n-h2-764485-11 Jul 20 04:31:00.740640 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-e4e4b4b2-dd7b-4e81-82a8-a88c672ec38c req-036fd0ce-2008-4378-b500-3560b421dc28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064617 Jul 20 04:31:00.742239 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2286/4478] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:00.747714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cfad09f5-7ebf-46d0-9275-af08adad3f05 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:00.748415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cfad09f5-7ebf-46d0-9275-af08adad3f05 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:00.772607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cfad09f5-7ebf-46d0-9275-af08adad3f05 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:00.773231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cfad09f5-7ebf-46d0-9275-af08adad3f05 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:00.774110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cfad09f5-7ebf-46d0-9275-af08adad3f05 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:00.774715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cfad09f5-7ebf-46d0-9275-af08adad3f05 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:00.873601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cba29e25-5194-405d-8ef7-8cc8e841d9de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:00.897457 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cba29e25-5194-405d-8ef7-8cc8e841d9de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1276 microversion: 2.1 time: 0.449096 Jul 20 04:31:00.898298 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2193/4479] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:00 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1276 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:00.911141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f64f4d9-9aee-462c-a262-d59fd1666c02 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:00.912306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2f64f4d9-9aee-462c-a262-d59fd1666c02 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:00.932588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f64f4d9-9aee-462c-a262-d59fd1666c02 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:00.933549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f64f4d9-9aee-462c-a262-d59fd1666c02 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:00.934387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f64f4d9-9aee-462c-a262-d59fd1666c02 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:00.936605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f64f4d9-9aee-462c-a262-d59fd1666c02 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:01.590831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cfad09f5-7ebf-46d0-9275-af08adad3f05 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:01.602093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cfad09f5-7ebf-46d0-9275-af08adad3f05 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:01.607648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cfad09f5-7ebf-46d0-9275-af08adad3f05 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:01.630595 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cfad09f5-7ebf-46d0-9275-af08adad3f05 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1596 microversion: 2.20 time: 0.884415 Jul 20 04:31:01.631256 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2287/4480] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:00 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1596 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:01.650077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c1bd967b-3a8c-4c8c-bba8-5c29f3d5da1c tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:01.655053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c1bd967b-3a8c-4c8c-bba8-5c29f3d5da1c tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:01.663492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1bd967b-3a8c-4c8c-bba8-5c29f3d5da1c tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:01.664150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1bd967b-3a8c-4c8c-bba8-5c29f3d5da1c tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:01.664767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1bd967b-3a8c-4c8c-bba8-5c29f3d5da1c tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:01.665213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1bd967b-3a8c-4c8c-bba8-5c29f3d5da1c tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:01.900781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2f64f4d9-9aee-462c-a262-d59fd1666c02 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:01.922367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:01.958672 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2f64f4d9-9aee-462c-a262-d59fd1666c02 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1720 microversion: 2.1 time: 1.058875 Jul 20 04:31:01.967686 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2194/4481] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:00 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1720 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:01.973445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1d04a4d7-97da-4160-b064-b6f9679848d4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:01.982961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1d04a4d7-97da-4160-b064-b6f9679848d4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:01.997577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d04a4d7-97da-4160-b064-b6f9679848d4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:01.998038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d04a4d7-97da-4160-b064-b6f9679848d4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:01.998831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d04a4d7-97da-4160-b064-b6f9679848d4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:01.999291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d04a4d7-97da-4160-b064-b6f9679848d4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:02.230327 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1d04a4d7-97da-4160-b064-b6f9679848d4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.261042 Jul 20 04:31:02.231185 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2195/4482] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Jul 20 04:31:01 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-interface => generated 284 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:31:02.237586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-439647fe-2333-4056-8bd3-515aff4e9e21 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:02.240119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-439647fe-2333-4056-8bd3-515aff4e9e21 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:02.247693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-439647fe-2333-4056-8bd3-515aff4e9e21 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:02.248326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-439647fe-2333-4056-8bd3-515aff4e9e21 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:02.249261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-439647fe-2333-4056-8bd3-515aff4e9e21 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:02.250436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-439647fe-2333-4056-8bd3-515aff4e9e21 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:02.342656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c1bd967b-3a8c-4c8c-bba8-5c29f3d5da1c tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:02.373772 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c1bd967b-3a8c-4c8c-bba8-5c29f3d5da1c tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1312 microversion: 2.1 time: 0.741339 Jul 20 04:31:02.374918 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2288/4483] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:01 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1312 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:02.491982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1635825211", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:02.559373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] validate_networks() for [('740bf1ad-16f0-4a85-9284-0887f4146119', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:31:03.365278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-439647fe-2333-4056-8bd3-515aff4e9e21 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:03.396982 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-439647fe-2333-4056-8bd3-515aff4e9e21 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 1.164295 Jul 20 04:31:03.408285 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2196/4484] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:02 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:03.416578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ad27cc7-fe5a-4fbd-9e24-c2a7415c6847 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:03.418429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ad27cc7-fe5a-4fbd-9e24-c2a7415c6847 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:03.426464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:INSERT=7 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:03.428723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ad27cc7-fe5a-4fbd-9e24-c2a7415c6847 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.429496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ad27cc7-fe5a-4fbd-9e24-c2a7415c6847 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:03.430783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ad27cc7-fe5a-4fbd-9e24-c2a7415c6847 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.431695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ad27cc7-fe5a-4fbd-9e24-c2a7415c6847 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:03.648904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ad27cc7-fe5a-4fbd-9e24-c2a7415c6847 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:03.660579 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ad27cc7-fe5a-4fbd-9e24-c2a7415c6847 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1274 microversion: 2.1 time: 0.248638 Jul 20 04:31:03.661780 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2197/4485] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:03 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1274 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:03.667287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-127d1706-f738-4fef-8191-6763922926fc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:03.682814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-127d1706-f738-4fef-8191-6763922926fc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:03.689558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-127d1706-f738-4fef-8191-6763922926fc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.692733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-127d1706-f738-4fef-8191-6763922926fc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:03.693777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-127d1706-f738-4fef-8191-6763922926fc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.694567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-127d1706-f738-4fef-8191-6763922926fc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:04.227409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:04.229056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:04.237582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:04.239730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:04.240424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:04.257441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:04.258123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:04.263014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:04.263770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:04.301506 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Getting quotas for project 116cfb4e5a1641e99cebbc25a71b268e. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:04.307705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Getting quotas for user d5b5e8cf752a4731b3ffb91e016a2a8f and project 116cfb4e5a1641e99cebbc25a71b268e. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:04.322469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:04.324841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:04.403413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-127d1706-f738-4fef-8191-6763922926fc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:04.416952 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-68496536-ab46-4626-99ce-3c635d492dbb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.033132 Jul 20 04:31:04.417634 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2289/4486] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:31:04.422789 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-127d1706-f738-4fef-8191-6763922926fc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1720 microversion: 2.1 time: 0.753613 Jul 20 04:31:04.422789 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2198/4487] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:03 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1720 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:04.434555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-607ce6ae-f817-4e45-aba2-10438266480e req-f95d9aa8-bbca-4f4b-bc81-57503ab89b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dcf7980-51fd-4f6c-9d31-833631d4419e", "tag": "bc39e903-f322-475c-ae40-9c774e4eb8aa"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:04.438740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-179267c5-18f0-45ce-b87b-55fd7a59e750 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:04.440465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-179267c5-18f0-45ce-b87b-55fd7a59e750 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:04.450056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-607ce6ae-f817-4e45-aba2-10438266480e req-f95d9aa8-bbca-4f4b-bc81-57503ab89b7a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:04.451292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-179267c5-18f0-45ce-b87b-55fd7a59e750 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:04.451977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-179267c5-18f0-45ce-b87b-55fd7a59e750 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:04.452918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-179267c5-18f0-45ce-b87b-55fd7a59e750 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:04.453521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-179267c5-18f0-45ce-b87b-55fd7a59e750 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:04.473718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-607ce6ae-f817-4e45-aba2-10438266480e req-f95d9aa8-bbca-4f4b-bc81-57503ab89b7a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:04.489233 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-607ce6ae-f817-4e45-aba2-10438266480e req-f95d9aa8-bbca-4f4b-bc81-57503ab89b7a service nova] Creating event network-changed:bc39e903-f322-475c-ae40-9c774e4eb8aa for instance 6dcf7980-51fd-4f6c-9d31-833631d4419e on n-h2-764485-11 Jul 20 04:31:04.494974 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-607ce6ae-f817-4e45-aba2-10438266480e req-f95d9aa8-bbca-4f4b-bc81-57503ab89b7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065819 Jul 20 04:31:04.496284 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2199/4488] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:04.501640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1b4004db-ffc8-4691-823b-c463cc34a20c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:04.502434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1b4004db-ffc8-4691-823b-c463cc34a20c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:04.510273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b4004db-ffc8-4691-823b-c463cc34a20c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:04.511034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b4004db-ffc8-4691-823b-c463cc34a20c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:04.512082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b4004db-ffc8-4691-823b-c463cc34a20c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:04.512818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b4004db-ffc8-4691-823b-c463cc34a20c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:05.086334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-179267c5-18f0-45ce-b87b-55fd7a59e750 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:05.120920 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-179267c5-18f0-45ce-b87b-55fd7a59e750 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1312 microversion: 2.1 time: 0.701905 Jul 20 04:31:05.123109 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2290/4489] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:04 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1312 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:05.130479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-23ddf6fa-b483-4b0c-9e01-324b48c5ba28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:05.131919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-23ddf6fa-b483-4b0c-9e01-324b48c5ba28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:05.140665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23ddf6fa-b483-4b0c-9e01-324b48c5ba28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.141875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23ddf6fa-b483-4b0c-9e01-324b48c5ba28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:05.143721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23ddf6fa-b483-4b0c-9e01-324b48c5ba28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.144631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23ddf6fa-b483-4b0c-9e01-324b48c5ba28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:05.196794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:05.242282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1b4004db-ffc8-4691-823b-c463cc34a20c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:05.258548 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1b4004db-ffc8-4691-823b-c463cc34a20c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 0.760835 Jul 20 04:31:05.264888 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2200/4490] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:04 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:05.270950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6bcde095-c2d4-402f-9575-85a38edcae38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:05.272511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6bcde095-c2d4-402f-9575-85a38edcae38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:05.284086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6bcde095-c2d4-402f-9575-85a38edcae38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.284535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6bcde095-c2d4-402f-9575-85a38edcae38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:05.286236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6bcde095-c2d4-402f-9575-85a38edcae38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.286818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6bcde095-c2d4-402f-9575-85a38edcae38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:05.828312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-23ddf6fa-b483-4b0c-9e01-324b48c5ba28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:05.837151 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-23ddf6fa-b483-4b0c-9e01-324b48c5ba28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1227 microversion: 2.1 time: 0.711728 Jul 20 04:31:05.837749 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2291/4491] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:05 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1227 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:05.850443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b32c1804-6153-4306-b90b-7d8539880a95 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:05.852029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b32c1804-6153-4306-b90b-7d8539880a95 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:05.873063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b32c1804-6153-4306-b90b-7d8539880a95 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.873616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b32c1804-6153-4306-b90b-7d8539880a95 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:05.874449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b32c1804-6153-4306-b90b-7d8539880a95 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.875083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b32c1804-6153-4306-b90b-7d8539880a95 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:06.333462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6bcde095-c2d4-402f-9575-85a38edcae38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:06.348796 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6bcde095-c2d4-402f-9575-85a38edcae38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1316 microversion: 2.1 time: 1.081877 Jul 20 04:31:06.350060 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2201/4492] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:05 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1316 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:06.358185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f540e70-f094-4f30-8d2d-25022aeb3eff tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:06.359607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0f540e70-f094-4f30-8d2d-25022aeb3eff tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:06.368527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f540e70-f094-4f30-8d2d-25022aeb3eff tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:06.369088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f540e70-f094-4f30-8d2d-25022aeb3eff tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:06.370191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f540e70-f094-4f30-8d2d-25022aeb3eff tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:06.371499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f540e70-f094-4f30-8d2d-25022aeb3eff tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:06.699251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b32c1804-6153-4306-b90b-7d8539880a95 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:06.711166 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b32c1804-6153-4306-b90b-7d8539880a95 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1720 microversion: 2.1 time: 0.868278 Jul 20 04:31:06.726414 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2292/4493] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:05 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1720 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:06.735570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b25d2721-b32f-4ec3-a492-5c8bb66a099d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:06.737022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b25d2721-b32f-4ec3-a492-5c8bb66a099d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:06.745606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b25d2721-b32f-4ec3-a492-5c8bb66a099d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:06.746975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b25d2721-b32f-4ec3-a492-5c8bb66a099d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:06.748813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b25d2721-b32f-4ec3-a492-5c8bb66a099d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:06.749977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b25d2721-b32f-4ec3-a492-5c8bb66a099d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:06.954687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0f540e70-f094-4f30-8d2d-25022aeb3eff tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:06.972235 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f540e70-f094-4f30-8d2d-25022aeb3eff tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1312 microversion: 2.1 time: 0.618092 Jul 20 04:31:06.974049 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2202/4494] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:06 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1312 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:06.978893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4b611f9a-7e02-41f1-9c45-2cb78d85ba22 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:06.981940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4b611f9a-7e02-41f1-9c45-2cb78d85ba22 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:07.000249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b611f9a-7e02-41f1-9c45-2cb78d85ba22 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:07.000756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b611f9a-7e02-41f1-9c45-2cb78d85ba22 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:07.001644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b611f9a-7e02-41f1-9c45-2cb78d85ba22 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:07.002097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b611f9a-7e02-41f1-9c45-2cb78d85ba22 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:07.210076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4b611f9a-7e02-41f1-9c45-2cb78d85ba22 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:07.219270 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4b611f9a-7e02-41f1-9c45-2cb78d85ba22 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1281 microversion: 2.1 time: 0.243965 Jul 20 04:31:07.227229 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2203/4495] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:06 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1281 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:07.341451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b25d2721-b32f-4ec3-a492-5c8bb66a099d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:07.354011 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b25d2721-b32f-4ec3-a492-5c8bb66a099d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 0.625879 Jul 20 04:31:07.360102 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2293/4496] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:06 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:07.381474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-820fc782-9ef9-407c-b3f8-f8a77cde3a1d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:07.382743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-820fc782-9ef9-407c-b3f8-f8a77cde3a1d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:07.397556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-820fc782-9ef9-407c-b3f8-f8a77cde3a1d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:07.398020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-820fc782-9ef9-407c-b3f8-f8a77cde3a1d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:07.401581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-820fc782-9ef9-407c-b3f8-f8a77cde3a1d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:07.402917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-820fc782-9ef9-407c-b3f8-f8a77cde3a1d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:07.504261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:07.730240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-278caf94-8092-4408-8520-ff81629046f1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:07.730876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-278caf94-8092-4408-8520-ff81629046f1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:07.751451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-278caf94-8092-4408-8520-ff81629046f1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:07.754329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-278caf94-8092-4408-8520-ff81629046f1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:07.756247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-278caf94-8092-4408-8520-ff81629046f1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:07.758515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-278caf94-8092-4408-8520-ff81629046f1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:08.043852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-820fc782-9ef9-407c-b3f8-f8a77cde3a1d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:08.075753 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-820fc782-9ef9-407c-b3f8-f8a77cde3a1d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1316 microversion: 2.1 time: 0.683880 Jul 20 04:31:08.079420 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2204/4497] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:07 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1316 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:08.096923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d030d790-59ec-4e79-9557-d30449ef1996 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:08.099268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d030d790-59ec-4e79-9557-d30449ef1996 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:08.119424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d030d790-59ec-4e79-9557-d30449ef1996 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:08.120310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d030d790-59ec-4e79-9557-d30449ef1996 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:08.124367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d030d790-59ec-4e79-9557-d30449ef1996 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:08.125170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d030d790-59ec-4e79-9557-d30449ef1996 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:08.518880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-278caf94-8092-4408-8520-ff81629046f1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:08.531584 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-278caf94-8092-4408-8520-ff81629046f1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1720 microversion: 2.1 time: 0.805662 Jul 20 04:31:08.539465 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2294/4498] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:07 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1720 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:08.547758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-aa4513f1-e9bf-45b3-a73b-d4daae05175d req-6efe580b-d71c-49f8-b7f9-2e3c8a149f9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76d5764-986d-4d3f-806f-1f8b1c5a73c1", "tag": "f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:08.571331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-aa4513f1-e9bf-45b3-a73b-d4daae05175d req-6efe580b-d71c-49f8-b7f9-2e3c8a149f9d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:08.573916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-aa4513f1-e9bf-45b3-a73b-d4daae05175d req-6efe580b-d71c-49f8-b7f9-2e3c8a149f9d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:08.597184 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-aa4513f1-e9bf-45b3-a73b-d4daae05175d req-6efe580b-d71c-49f8-b7f9-2e3c8a149f9d service nova] Creating event network-changed:f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981 for instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 on n-h1-764485-11 Jul 20 04:31:08.614091 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-aa4513f1-e9bf-45b3-a73b-d4daae05175d req-6efe580b-d71c-49f8-b7f9-2e3c8a149f9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069359 Jul 20 04:31:08.615319 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2295/4499] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:08.628184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6f9ee855-736b-465e-8da6-aed148b1cc78 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:08.630152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6f9ee855-736b-465e-8da6-aed148b1cc78 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:08.645321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f9ee855-736b-465e-8da6-aed148b1cc78 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:08.648111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f9ee855-736b-465e-8da6-aed148b1cc78 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:08.649326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f9ee855-736b-465e-8da6-aed148b1cc78 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:08.652111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f9ee855-736b-465e-8da6-aed148b1cc78 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:08.901773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=36 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:08.905554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d030d790-59ec-4e79-9557-d30449ef1996 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:08.917975 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d030d790-59ec-4e79-9557-d30449ef1996 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1312 microversion: 2.1 time: 0.837263 Jul 20 04:31:08.918574 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2205/4500] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:08 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1312 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:08.958224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-801d19fe-7980-4d2f-b6aa-c2b9b4f87dcb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:08.961284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-801d19fe-7980-4d2f-b6aa-c2b9b4f87dcb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:09.000192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-801d19fe-7980-4d2f-b6aa-c2b9b4f87dcb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:09.000856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-801d19fe-7980-4d2f-b6aa-c2b9b4f87dcb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:09.002005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-801d19fe-7980-4d2f-b6aa-c2b9b4f87dcb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:09.002623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-801d19fe-7980-4d2f-b6aa-c2b9b4f87dcb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.095358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6f9ee855-736b-465e-8da6-aed148b1cc78 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:10.114966 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6f9ee855-736b-465e-8da6-aed148b1cc78 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1323 microversion: 2.1 time: 1.497792 Jul 20 04:31:10.120941 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2296/4501] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:08 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1323 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:10.135757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62902eff-aaf4-4dfe-9d7d-e86da1af5756 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:10.136906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-62902eff-aaf4-4dfe-9d7d-e86da1af5756 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:10.146959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62902eff-aaf4-4dfe-9d7d-e86da1af5756 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.147832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62902eff-aaf4-4dfe-9d7d-e86da1af5756 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.148873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62902eff-aaf4-4dfe-9d7d-e86da1af5756 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.150144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62902eff-aaf4-4dfe-9d7d-e86da1af5756 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.412923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-801d19fe-7980-4d2f-b6aa-c2b9b4f87dcb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:10.425027 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-801d19fe-7980-4d2f-b6aa-c2b9b4f87dcb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 1.488335 Jul 20 04:31:10.436470 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2206/4502] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:08 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:10.442665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2e1a70a3-0db2-425f-bdcb-50e56f0b98b8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:10.443707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2e1a70a3-0db2-425f-bdcb-50e56f0b98b8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:10.452032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e1a70a3-0db2-425f-bdcb-50e56f0b98b8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.453201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e1a70a3-0db2-425f-bdcb-50e56f0b98b8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.454377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e1a70a3-0db2-425f-bdcb-50e56f0b98b8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.455081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e1a70a3-0db2-425f-bdcb-50e56f0b98b8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.712598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-62902eff-aaf4-4dfe-9d7d-e86da1af5756 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:10.720295 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-62902eff-aaf4-4dfe-9d7d-e86da1af5756 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1316 microversion: 2.1 time: 0.597988 Jul 20 04:31:10.720898 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2297/4503] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:10 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:10.733093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a0a5ebfa-69ef-4b5f-b08d-456b9fe9e9b8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:10.739738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a0a5ebfa-69ef-4b5f-b08d-456b9fe9e9b8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:10.756243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0a5ebfa-69ef-4b5f-b08d-456b9fe9e9b8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.763869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0a5ebfa-69ef-4b5f-b08d-456b9fe9e9b8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.765047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0a5ebfa-69ef-4b5f-b08d-456b9fe9e9b8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.767165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0a5ebfa-69ef-4b5f-b08d-456b9fe9e9b8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.808084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2e1a70a3-0db2-425f-bdcb-50e56f0b98b8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:10.835934 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2e1a70a3-0db2-425f-bdcb-50e56f0b98b8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1697 microversion: 2.1 time: 0.396997 Jul 20 04:31:10.853379 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2207/4504] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:10 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1697 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:11.014325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ddf597fd-3b0d-4dac-bb9e-ce839306ed11 req-ca2176fa-2b52-44e2-aa86-97ea7c562794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9777f396-9873-4ba1-8c76-55a9f1cf28c6", "name": "network-vif-plugged", "status": "completed", "tag": "d88039bf-f27b-47eb-a161-b374a889aafe"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:11.032626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ddf597fd-3b0d-4dac-bb9e-ce839306ed11 req-ca2176fa-2b52-44e2-aa86-97ea7c562794 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:11.035871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ddf597fd-3b0d-4dac-bb9e-ce839306ed11 req-ca2176fa-2b52-44e2-aa86-97ea7c562794 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:11.053938 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ddf597fd-3b0d-4dac-bb9e-ce839306ed11 req-ca2176fa-2b52-44e2-aa86-97ea7c562794 service nova] Creating event network-vif-plugged:d88039bf-f27b-47eb-a161-b374a889aafe for instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 on n-h2-764485-11 Jul 20 04:31:11.061173 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ddf597fd-3b0d-4dac-bb9e-ce839306ed11 req-ca2176fa-2b52-44e2-aa86-97ea7c562794 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206048 Jul 20 04:31:11.063124 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2208/4505] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:11.070975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-67a867bf-df9e-433d-a7b5-52403b6a1d81 req-d2e1a3d2-550b-4d58-b07d-4f390eacba51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44750009-3372-4838-91b8-69f3c34ca9c5", "tag": "92fae5a0-fed9-40e1-aa84-cac47de3dc23"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:11.085346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-67a867bf-df9e-433d-a7b5-52403b6a1d81 req-d2e1a3d2-550b-4d58-b07d-4f390eacba51 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:11.087328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-67a867bf-df9e-433d-a7b5-52403b6a1d81 req-d2e1a3d2-550b-4d58-b07d-4f390eacba51 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:11.103266 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-67a867bf-df9e-433d-a7b5-52403b6a1d81 req-d2e1a3d2-550b-4d58-b07d-4f390eacba51 service nova] Creating event network-changed:92fae5a0-fed9-40e1-aa84-cac47de3dc23 for instance 44750009-3372-4838-91b8-69f3c34ca9c5 on n-h2-764485-11 Jul 20 04:31:11.115294 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-67a867bf-df9e-433d-a7b5-52403b6a1d81 req-d2e1a3d2-550b-4d58-b07d-4f390eacba51 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050308 Jul 20 04:31:11.116452 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2209/4506] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:11.122701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-9d7ef06d-21df-49fb-93bb-e865d557c82e req-b334f76e-f151-4b7f-a811-a698978bc303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2f3226f-82c7-4e50-9a7d-ca0721979912", "tag": "e8a977e2-08d6-4a53-9757-e0d3ee9db0ff"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:11.151213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9d7ef06d-21df-49fb-93bb-e865d557c82e req-b334f76e-f151-4b7f-a811-a698978bc303 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:11.153652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9d7ef06d-21df-49fb-93bb-e865d557c82e req-b334f76e-f151-4b7f-a811-a698978bc303 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:11.199033 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-9d7ef06d-21df-49fb-93bb-e865d557c82e req-b334f76e-f151-4b7f-a811-a698978bc303 service nova] Creating event network-changed:e8a977e2-08d6-4a53-9757-e0d3ee9db0ff for instance a2f3226f-82c7-4e50-9a7d-ca0721979912 on n-h1-764485-11 Jul 20 04:31:11.219825 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-9d7ef06d-21df-49fb-93bb-e865d557c82e req-b334f76e-f151-4b7f-a811-a698978bc303 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091095 Jul 20 04:31:11.223110 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2210/4507] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:11.247475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1d67a9a1-0867-45da-a7c2-af651e5ad779 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:11.268425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d67a9a1-0867-45da-a7c2-af651e5ad779 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:11.270842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d67a9a1-0867-45da-a7c2-af651e5ad779 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:11.286084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a0a5ebfa-69ef-4b5f-b08d-456b9fe9e9b8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:11.294981 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a0a5ebfa-69ef-4b5f-b08d-456b9fe9e9b8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1312 microversion: 2.1 time: 0.570006 Jul 20 04:31:11.301093 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2298/4508] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:10 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1312 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:11.312498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fd9f4bb3-3397-4e9b-9762-44e7afc176be tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:11.323126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fd9f4bb3-3397-4e9b-9762-44e7afc176be tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:11.324681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1d67a9a1-0867-45da-a7c2-af651e5ad779 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Going to try to start instance {{(pid=119807) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:31:11.342468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fd9f4bb3-3397-4e9b-9762-44e7afc176be tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:11.346684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fd9f4bb3-3397-4e9b-9762-44e7afc176be tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:11.348547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fd9f4bb3-3397-4e9b-9762-44e7afc176be tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:11.349171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fd9f4bb3-3397-4e9b-9762-44e7afc176be tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:11.420102 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1d67a9a1-0867-45da-a7c2-af651e5ad779 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "POST /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/action" status: 202 len: 0 microversion: 2.1 time: 0.194429 Jul 20 04:31:11.420954 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2211/4509] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:31:11 2022] POST /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:31:11.436431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-28c3b745-8ef5-4406-9a13-9d534ab3fc2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:11.438594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-28c3b745-8ef5-4406-9a13-9d534ab3fc2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:11.463233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28c3b745-8ef5-4406-9a13-9d534ab3fc2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:11.463594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28c3b745-8ef5-4406-9a13-9d534ab3fc2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:11.464405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28c3b745-8ef5-4406-9a13-9d534ab3fc2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:11.464858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28c3b745-8ef5-4406-9a13-9d534ab3fc2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:11.877993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fd9f4bb3-3397-4e9b-9762-44e7afc176be tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:11.888209 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fd9f4bb3-3397-4e9b-9762-44e7afc176be tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1323 microversion: 2.1 time: 0.582497 Jul 20 04:31:11.892115 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2299/4510] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:11 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1323 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:11.903192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a482814e-611c-417c-aee0-24b518f6b9b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:11.903860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a482814e-611c-417c-aee0-24b518f6b9b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:11.911251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a482814e-611c-417c-aee0-24b518f6b9b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:11.911844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a482814e-611c-417c-aee0-24b518f6b9b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:11.912877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a482814e-611c-417c-aee0-24b518f6b9b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:11.913565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a482814e-611c-417c-aee0-24b518f6b9b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.073169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-28c3b745-8ef5-4406-9a13-9d534ab3fc2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:12.093610 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-28c3b745-8ef5-4406-9a13-9d534ab3fc2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1706 microversion: 2.1 time: 0.668032 Jul 20 04:31:12.094979 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2212/4511] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:11 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1706 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:12.100217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ae8b05bc-fc98-46f2-8af7-fa2ceba5398a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:12.100828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ae8b05bc-fc98-46f2-8af7-fa2ceba5398a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:12.123341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae8b05bc-fc98-46f2-8af7-fa2ceba5398a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.124470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae8b05bc-fc98-46f2-8af7-fa2ceba5398a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.125262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae8b05bc-fc98-46f2-8af7-fa2ceba5398a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.125704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae8b05bc-fc98-46f2-8af7-fa2ceba5398a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.152955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:12.304200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a482814e-611c-417c-aee0-24b518f6b9b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:12.331433 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a482814e-611c-417c-aee0-24b518f6b9b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 0.437615 Jul 20 04:31:12.333913 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2300/4512] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:11 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:12.341275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3df285aa-4387-4a20-b61d-ecee826fc12d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:12.344183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3df285aa-4387-4a20-b61d-ecee826fc12d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:12.358941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3df285aa-4387-4a20-b61d-ecee826fc12d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.359867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3df285aa-4387-4a20-b61d-ecee826fc12d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.360881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3df285aa-4387-4a20-b61d-ecee826fc12d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.367935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ae8b05bc-fc98-46f2-8af7-fa2ceba5398a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:12.368335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3df285aa-4387-4a20-b61d-ecee826fc12d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.384957 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ae8b05bc-fc98-46f2-8af7-fa2ceba5398a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1316 microversion: 2.1 time: 0.288557 Jul 20 04:31:12.385891 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2213/4513] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:12 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:12.638037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3df285aa-4387-4a20-b61d-ecee826fc12d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:12.656528 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3df285aa-4387-4a20-b61d-ecee826fc12d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1312 microversion: 2.1 time: 0.321153 Jul 20 04:31:12.657510 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2301/4514] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:12 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1312 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:12.909695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e402f463-2e4e-4462-aa9c-71619d6e5c9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:12.910884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e402f463-2e4e-4462-aa9c-71619d6e5c9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:12.918025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e402f463-2e4e-4462-aa9c-71619d6e5c9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.918490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e402f463-2e4e-4462-aa9c-71619d6e5c9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.919297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e402f463-2e4e-4462-aa9c-71619d6e5c9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.919780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e402f463-2e4e-4462-aa9c-71619d6e5c9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.072026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e402f463-2e4e-4462-aa9c-71619d6e5c9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:13.079936 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e402f463-2e4e-4462-aa9c-71619d6e5c9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1323 microversion: 2.1 time: 0.174405 Jul 20 04:31:13.080532 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2214/4515] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:12 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1323 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:13.111393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d07d0d32-d63a-4f08-b9c9-f3e93fd1d336 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:13.112042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d07d0d32-d63a-4f08-b9c9-f3e93fd1d336 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:13.119362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d07d0d32-d63a-4f08-b9c9-f3e93fd1d336 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:13.120041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d07d0d32-d63a-4f08-b9c9-f3e93fd1d336 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.124897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d07d0d32-d63a-4f08-b9c9-f3e93fd1d336 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:13.125385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d07d0d32-d63a-4f08-b9c9-f3e93fd1d336 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.295162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d07d0d32-d63a-4f08-b9c9-f3e93fd1d336 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:13.304081 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d07d0d32-d63a-4f08-b9c9-f3e93fd1d336 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1706 microversion: 2.1 time: 0.196939 Jul 20 04:31:13.304616 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2302/4516] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:13 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1706 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:13.350576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fad6d0c2-d513-4679-aa08-5b940b503aeb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:13.351296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fad6d0c2-d513-4679-aa08-5b940b503aeb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:13.357465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fad6d0c2-d513-4679-aa08-5b940b503aeb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:13.357941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fad6d0c2-d513-4679-aa08-5b940b503aeb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.358732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fad6d0c2-d513-4679-aa08-5b940b503aeb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:13.359161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fad6d0c2-d513-4679-aa08-5b940b503aeb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.403240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-abafdf75-ddf0-47e1-bb3d-fdab16325c88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:13.406461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-abafdf75-ddf0-47e1-bb3d-fdab16325c88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:13.412188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abafdf75-ddf0-47e1-bb3d-fdab16325c88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:13.412639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abafdf75-ddf0-47e1-bb3d-fdab16325c88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.413414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abafdf75-ddf0-47e1-bb3d-fdab16325c88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:13.414044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abafdf75-ddf0-47e1-bb3d-fdab16325c88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.546135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fad6d0c2-d513-4679-aa08-5b940b503aeb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:13.556496 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fad6d0c2-d513-4679-aa08-5b940b503aeb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 0.210179 Jul 20 04:31:13.557098 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2215/4517] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:13 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:13.585449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-abafdf75-ddf0-47e1-bb3d-fdab16325c88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:13.594177 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-abafdf75-ddf0-47e1-bb3d-fdab16325c88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1316 microversion: 2.1 time: 0.195398 Jul 20 04:31:13.594846 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2303/4518] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:13 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:13.674600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a721bf58-9f1c-43bb-bee8-744534b779ef tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:13.675210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a721bf58-9f1c-43bb-bee8-744534b779ef tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:13.682639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a721bf58-9f1c-43bb-bee8-744534b779ef tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:13.683092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a721bf58-9f1c-43bb-bee8-744534b779ef tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.683904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a721bf58-9f1c-43bb-bee8-744534b779ef tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:13.684340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a721bf58-9f1c-43bb-bee8-744534b779ef tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.860964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a721bf58-9f1c-43bb-bee8-744534b779ef tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:13.870075 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a721bf58-9f1c-43bb-bee8-744534b779ef tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1312 microversion: 2.1 time: 0.199661 Jul 20 04:31:13.872139 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2216/4519] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:13 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:14.099839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-847f0085-f7e2-4296-b6b4-b16936f5aa28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:14.100462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-847f0085-f7e2-4296-b6b4-b16936f5aa28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:14.115027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-847f0085-f7e2-4296-b6b4-b16936f5aa28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:14.115490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-847f0085-f7e2-4296-b6b4-b16936f5aa28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:14.116309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-847f0085-f7e2-4296-b6b4-b16936f5aa28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:14.116748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-847f0085-f7e2-4296-b6b4-b16936f5aa28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:14.288977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:14.317764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:14.323298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-184e22c3-41e1-4c3b-b0b3-b8b1924e67b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:14.324088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-184e22c3-41e1-4c3b-b0b3-b8b1924e67b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:14.339114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-184e22c3-41e1-4c3b-b0b3-b8b1924e67b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:14.342084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-184e22c3-41e1-4c3b-b0b3-b8b1924e67b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:14.343004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-184e22c3-41e1-4c3b-b0b3-b8b1924e67b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:14.345497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-184e22c3-41e1-4c3b-b0b3-b8b1924e67b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:14.408865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-847f0085-f7e2-4296-b6b4-b16936f5aa28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:14.422096 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-847f0085-f7e2-4296-b6b4-b16936f5aa28 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1323 microversion: 2.1 time: 0.327849 Jul 20 04:31:14.425171 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2304/4520] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:14 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1323 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:14.574235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b608525e-1f32-455a-b886-d83f6d0b5e7f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:14.575782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b608525e-1f32-455a-b886-d83f6d0b5e7f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:14.583056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b608525e-1f32-455a-b886-d83f6d0b5e7f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:14.583500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b608525e-1f32-455a-b886-d83f6d0b5e7f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:14.584460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b608525e-1f32-455a-b886-d83f6d0b5e7f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:14.585058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b608525e-1f32-455a-b886-d83f6d0b5e7f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:14.867382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-184e22c3-41e1-4c3b-b0b3-b8b1924e67b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:14.885062 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-184e22c3-41e1-4c3b-b0b3-b8b1924e67b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1706 microversion: 2.1 time: 0.566467 Jul 20 04:31:14.886184 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2217/4521] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:14 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1706 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:14.891880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ba04a9e7-bfb3-4da9-979a-895b53921109 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:14.892937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ba04a9e7-bfb3-4da9-979a-895b53921109 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:14.902321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba04a9e7-bfb3-4da9-979a-895b53921109 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:14.903280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba04a9e7-bfb3-4da9-979a-895b53921109 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:14.904270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba04a9e7-bfb3-4da9-979a-895b53921109 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:14.904893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba04a9e7-bfb3-4da9-979a-895b53921109 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:14.988443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b608525e-1f32-455a-b886-d83f6d0b5e7f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:15.005837 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b608525e-1f32-455a-b886-d83f6d0b5e7f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 0.431863 Jul 20 04:31:15.027682 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2305/4522] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:14 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:15.039717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88860053-2f8b-47af-b1bb-9fc8855864fb tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:15.044300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88860053-2f8b-47af-b1bb-9fc8855864fb tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:15.062673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88860053-2f8b-47af-b1bb-9fc8855864fb tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:15.063392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88860053-2f8b-47af-b1bb-9fc8855864fb tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:15.065242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88860053-2f8b-47af-b1bb-9fc8855864fb tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:15.068169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88860053-2f8b-47af-b1bb-9fc8855864fb tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:15.783968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ba04a9e7-bfb3-4da9-979a-895b53921109 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:15.797445 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ba04a9e7-bfb3-4da9-979a-895b53921109 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1316 microversion: 2.1 time: 0.909804 Jul 20 04:31:15.807280 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2218/4523] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:14 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1316 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:15.807280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd1221d4-a021-4c90-a3e6-b997a3c82268 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:15.807280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cd1221d4-a021-4c90-a3e6-b997a3c82268 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:15.813391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd1221d4-a021-4c90-a3e6-b997a3c82268 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:15.814007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd1221d4-a021-4c90-a3e6-b997a3c82268 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:15.814785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd1221d4-a021-4c90-a3e6-b997a3c82268 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:15.815285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd1221d4-a021-4c90-a3e6-b997a3c82268 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:15.931256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88860053-2f8b-47af-b1bb-9fc8855864fb tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:15.941113 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88860053-2f8b-47af-b1bb-9fc8855864fb tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1497 microversion: 2.1 time: 0.911520 Jul 20 04:31:15.942097 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2306/4524] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:15 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1497 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:15.960508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8aca2054-9fea-44f8-a809-93d960a7fd8c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:15.961474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8aca2054-9fea-44f8-a809-93d960a7fd8c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:15.977182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8aca2054-9fea-44f8-a809-93d960a7fd8c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:15.977961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8aca2054-9fea-44f8-a809-93d960a7fd8c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:15.978943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8aca2054-9fea-44f8-a809-93d960a7fd8c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:15.979601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8aca2054-9fea-44f8-a809-93d960a7fd8c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.167270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cd1221d4-a021-4c90-a3e6-b997a3c82268 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:16.178146 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd1221d4-a021-4c90-a3e6-b997a3c82268 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1323 microversion: 2.1 time: 0.375915 Jul 20 04:31:16.179139 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2219/4525] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:15 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:16.191690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8998dd84-9197-44b0-a3c5-c606a440dd2f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:16.205201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.compute.server_groups [None req-8998dd84-9197-44b0-a3c5-c606a440dd2f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Querying cell de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) for 1 instances {{(pid=119807) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:31:16.206002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8998dd84-9197-44b0-a3c5-c606a440dd2f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.207351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8998dd84-9197-44b0-a3c5-c606a440dd2f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.249484 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8998dd84-9197-44b0-a3c5-c606a440dd2f tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/c326f59d-5db2-496e-8669-4ff9d32aa900" status: 200 len: 221 microversion: 2.1 time: 0.067322 Jul 20 04:31:16.256349 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2220/4526] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:31:16 2022] GET /compute/v2.1/os-server-groups/c326f59d-5db2-496e-8669-4ff9d32aa900 => generated 221 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:16.261971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1097578c-12b8-427e-a2a0-5f07d357cb6f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:16.262858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1097578c-12b8-427e-a2a0-5f07d357cb6f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:16.271898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1097578c-12b8-427e-a2a0-5f07d357cb6f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.272706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1097578c-12b8-427e-a2a0-5f07d357cb6f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.273758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1097578c-12b8-427e-a2a0-5f07d357cb6f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.274479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1097578c-12b8-427e-a2a0-5f07d357cb6f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.300976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8aca2054-9fea-44f8-a809-93d960a7fd8c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:16.313624 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8aca2054-9fea-44f8-a809-93d960a7fd8c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1706 microversion: 2.1 time: 0.358258 Jul 20 04:31:16.314397 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2307/4527] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:15 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1706 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:16.344823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14e2c23a-fc97-4dd5-b82d-1aabd3733ed3 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:16.345336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-14e2c23a-fc97-4dd5-b82d-1aabd3733ed3 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:16.357100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14e2c23a-fc97-4dd5-b82d-1aabd3733ed3 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.357568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14e2c23a-fc97-4dd5-b82d-1aabd3733ed3 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.358542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14e2c23a-fc97-4dd5-b82d-1aabd3733ed3 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.360329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14e2c23a-fc97-4dd5-b82d-1aabd3733ed3 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.419026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-14e2c23a-fc97-4dd5-b82d-1aabd3733ed3 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:16.429664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:16.514038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1097578c-12b8-427e-a2a0-5f07d357cb6f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:16.527753 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1097578c-12b8-427e-a2a0-5f07d357cb6f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 0.269882 Jul 20 04:31:16.528836 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2221/4528] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:16 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:16.567901 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-14e2c23a-fc97-4dd5-b82d-1aabd3733ed3 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 204 len: 0 microversion: 2.1 time: 0.227337 Jul 20 04:31:16.568608 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2308/4529] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:16 2022] DELETE /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:31:16.577484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-65bd148f-deb4-4901-8c60-34cc10e398ac tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:16.578108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-65bd148f-deb4-4901-8c60-34cc10e398ac tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:16.585332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65bd148f-deb4-4901-8c60-34cc10e398ac tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.585793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65bd148f-deb4-4901-8c60-34cc10e398ac tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.586818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65bd148f-deb4-4901-8c60-34cc10e398ac tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.587022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65bd148f-deb4-4901-8c60-34cc10e398ac tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.814607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-65bd148f-deb4-4901-8c60-34cc10e398ac tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:16.823086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a059ce7c-4d8f-4e3e-947e-46bcc1269b6e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:16.825290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a059ce7c-4d8f-4e3e-947e-46bcc1269b6e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:16.830096 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-65bd148f-deb4-4901-8c60-34cc10e398ac tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1503 microversion: 2.1 time: 0.256802 Jul 20 04:31:16.831784 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2222/4530] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:16 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:16.837359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a059ce7c-4d8f-4e3e-947e-46bcc1269b6e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.837993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a059ce7c-4d8f-4e3e-947e-46bcc1269b6e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.838795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a059ce7c-4d8f-4e3e-947e-46bcc1269b6e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.839240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a059ce7c-4d8f-4e3e-947e-46bcc1269b6e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.002450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a059ce7c-4d8f-4e3e-947e-46bcc1269b6e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:17.015061 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a059ce7c-4d8f-4e3e-947e-46bcc1269b6e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1316 microversion: 2.1 time: 0.203192 Jul 20 04:31:17.015345 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2309/4531] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:16 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:17.194306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9b46a671-eb37-4736-8d37-c392b0cc4456 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:17.194839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9b46a671-eb37-4736-8d37-c392b0cc4456 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:17.201417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b46a671-eb37-4736-8d37-c392b0cc4456 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.202133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b46a671-eb37-4736-8d37-c392b0cc4456 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.203133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b46a671-eb37-4736-8d37-c392b0cc4456 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.203788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9b46a671-eb37-4736-8d37-c392b0cc4456 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.333512 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-382feb5d-2242-4ee1-8515-45f604193846 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:17.334144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-382feb5d-2242-4ee1-8515-45f604193846 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:17.340854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-382feb5d-2242-4ee1-8515-45f604193846 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.341313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-382feb5d-2242-4ee1-8515-45f604193846 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.342094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-382feb5d-2242-4ee1-8515-45f604193846 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.344234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-382feb5d-2242-4ee1-8515-45f604193846 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.391604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9b46a671-eb37-4736-8d37-c392b0cc4456 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:17.409464 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9b46a671-eb37-4736-8d37-c392b0cc4456 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1323 microversion: 2.1 time: 0.218896 Jul 20 04:31:17.423061 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2223/4532] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:17 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1323 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:17.553359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-61730b16-fa61-44f3-9496-b7cfb53472f8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:17.554216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-61730b16-fa61-44f3-9496-b7cfb53472f8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:17.567356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-61730b16-fa61-44f3-9496-b7cfb53472f8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.567966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-61730b16-fa61-44f3-9496-b7cfb53472f8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.568993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-61730b16-fa61-44f3-9496-b7cfb53472f8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.569672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-61730b16-fa61-44f3-9496-b7cfb53472f8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.616961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-382feb5d-2242-4ee1-8515-45f604193846 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:17.625807 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-382feb5d-2242-4ee1-8515-45f604193846 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1710 microversion: 2.1 time: 0.298213 Jul 20 04:31:17.626956 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2310/4533] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:17 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1710 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:17.797143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-22f47d59-d00b-4efe-b497-25315b53a856 req-91553c10-8162-4b68-9ac2-4329c2fed5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcf7980-51fd-4f6c-9d31-833631d4419e", "name": "network-vif-plugged", "status": "completed", "tag": "bc39e903-f322-475c-ae40-9c774e4eb8aa"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:17.817022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-22f47d59-d00b-4efe-b497-25315b53a856 req-91553c10-8162-4b68-9ac2-4329c2fed5d6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.818763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-22f47d59-d00b-4efe-b497-25315b53a856 req-91553c10-8162-4b68-9ac2-4329c2fed5d6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.849332 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-22f47d59-d00b-4efe-b497-25315b53a856 req-91553c10-8162-4b68-9ac2-4329c2fed5d6 service nova] Creating event network-vif-plugged:bc39e903-f322-475c-ae40-9c774e4eb8aa for instance 6dcf7980-51fd-4f6c-9d31-833631d4419e on n-h2-764485-11 Jul 20 04:31:17.859596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-61730b16-fa61-44f3-9496-b7cfb53472f8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:17.869482 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-22f47d59-d00b-4efe-b497-25315b53a856 req-91553c10-8162-4b68-9ac2-4329c2fed5d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076327 Jul 20 04:31:17.871729 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-61730b16-fa61-44f3-9496-b7cfb53472f8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 0.329617 Jul 20 04:31:17.872364 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2311/4534] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:17.873619 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2224/4535] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:17 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:17.885289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1e556254-5c2a-4618-98fa-fd351471f5b4 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:17.886016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1e556254-5c2a-4618-98fa-fd351471f5b4 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:17.918782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e556254-5c2a-4618-98fa-fd351471f5b4 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.919846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e556254-5c2a-4618-98fa-fd351471f5b4 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.920799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e556254-5c2a-4618-98fa-fd351471f5b4 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.921552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e556254-5c2a-4618-98fa-fd351471f5b4 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.031889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a26db47-7d47-453e-b772-14f88925e4bf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:18.032515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4a26db47-7d47-453e-b772-14f88925e4bf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:18.041692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a26db47-7d47-453e-b772-14f88925e4bf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.042149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a26db47-7d47-453e-b772-14f88925e4bf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.042945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a26db47-7d47-453e-b772-14f88925e4bf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.043391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a26db47-7d47-453e-b772-14f88925e4bf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.260590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1e556254-5c2a-4618-98fa-fd351471f5b4 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:18.273807 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1e556254-5c2a-4618-98fa-fd351471f5b4 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1503 microversion: 2.1 time: 0.396707 Jul 20 04:31:18.276642 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2312/4536] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:17 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1503 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:18.349886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a26db47-7d47-453e-b772-14f88925e4bf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:18.375580 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a26db47-7d47-453e-b772-14f88925e4bf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1316 microversion: 2.1 time: 0.344425 Jul 20 04:31:18.376903 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2225/4537] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:18 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:18.429733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c95dd1db-314f-4d1c-924c-64025f907fcc tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:18.430537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c95dd1db-314f-4d1c-924c-64025f907fcc tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:18.445885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c95dd1db-314f-4d1c-924c-64025f907fcc tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.447083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c95dd1db-314f-4d1c-924c-64025f907fcc tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.448522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c95dd1db-314f-4d1c-924c-64025f907fcc tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.449276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c95dd1db-314f-4d1c-924c-64025f907fcc tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.677032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c95dd1db-314f-4d1c-924c-64025f907fcc tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:18.684701 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c95dd1db-314f-4d1c-924c-64025f907fcc tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1323 microversion: 2.1 time: 0.261358 Jul 20 04:31:18.694846 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2313/4538] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:18 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1323 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:18.891676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5f466445-96a4-4097-a964-a79d769cf054 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:18.893072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5f466445-96a4-4097-a964-a79d769cf054 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:18.900236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f466445-96a4-4097-a964-a79d769cf054 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.901319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f466445-96a4-4097-a964-a79d769cf054 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.902265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f466445-96a4-4097-a964-a79d769cf054 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.902887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f466445-96a4-4097-a964-a79d769cf054 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.121178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5f466445-96a4-4097-a964-a79d769cf054 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:19.134563 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5f466445-96a4-4097-a964-a79d769cf054 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 0.248034 Jul 20 04:31:19.135162 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2226/4539] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:18 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:19.295297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-85917074-39c8-49cb-bc47-a18acb98a7f8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:19.297098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-85917074-39c8-49cb-bc47-a18acb98a7f8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:19.308870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85917074-39c8-49cb-bc47-a18acb98a7f8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.309409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85917074-39c8-49cb-bc47-a18acb98a7f8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.310450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85917074-39c8-49cb-bc47-a18acb98a7f8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.311390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85917074-39c8-49cb-bc47-a18acb98a7f8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.396585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a7d8485e-bf91-4406-8f0b-e47df82d2382 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:19.397834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a7d8485e-bf91-4406-8f0b-e47df82d2382 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:19.405340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d8485e-bf91-4406-8f0b-e47df82d2382 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.406591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d8485e-bf91-4406-8f0b-e47df82d2382 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.408426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d8485e-bf91-4406-8f0b-e47df82d2382 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.409043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d8485e-bf91-4406-8f0b-e47df82d2382 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.785259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-85917074-39c8-49cb-bc47-a18acb98a7f8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:19.803121 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-85917074-39c8-49cb-bc47-a18acb98a7f8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1503 microversion: 2.1 time: 0.514355 Jul 20 04:31:19.804249 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2314/4540] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:19 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1503 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:19.809057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8d9f230b-0223-4265-afac-1579472cc7ee tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:19.809882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8d9f230b-0223-4265-afac-1579472cc7ee tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:19.817857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d9f230b-0223-4265-afac-1579472cc7ee tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.818529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d9f230b-0223-4265-afac-1579472cc7ee tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.819658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d9f230b-0223-4265-afac-1579472cc7ee tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.820233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d9f230b-0223-4265-afac-1579472cc7ee tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.997749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a7d8485e-bf91-4406-8f0b-e47df82d2382 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:20.006510 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a7d8485e-bf91-4406-8f0b-e47df82d2382 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1316 microversion: 2.1 time: 0.616947 Jul 20 04:31:20.007115 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2227/4541] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:19 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1316 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:20.016428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6cca5a8b-92d5-4f39-bcc1-9175047622ac req-88403ca3-a8ba-40f9-a176-db9f70a85e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f3226f-82c7-4e50-9a7d-ca0721979912", "name": "network-vif-plugged", "status": "completed", "tag": "e8a977e2-08d6-4a53-9757-e0d3ee9db0ff"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:20.046137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6cca5a8b-92d5-4f39-bcc1-9175047622ac req-88403ca3-a8ba-40f9-a176-db9f70a85e78 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.046854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6cca5a8b-92d5-4f39-bcc1-9175047622ac req-88403ca3-a8ba-40f9-a176-db9f70a85e78 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.068629 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-6cca5a8b-92d5-4f39-bcc1-9175047622ac req-88403ca3-a8ba-40f9-a176-db9f70a85e78 service nova] Creating event network-vif-plugged:e8a977e2-08d6-4a53-9757-e0d3ee9db0ff for instance a2f3226f-82c7-4e50-9a7d-ca0721979912 on n-h1-764485-11 Jul 20 04:31:20.078039 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6cca5a8b-92d5-4f39-bcc1-9175047622ac req-88403ca3-a8ba-40f9-a176-db9f70a85e78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064749 Jul 20 04:31:20.082663 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2228/4542] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:20.153891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a075327-41e0-449b-b574-c61368c9c7e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:20.154713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4a075327-41e0-449b-b574-c61368c9c7e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:20.160245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8d9f230b-0223-4265-afac-1579472cc7ee tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:20.166391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a075327-41e0-449b-b574-c61368c9c7e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.168434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a075327-41e0-449b-b574-c61368c9c7e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.169396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a075327-41e0-449b-b574-c61368c9c7e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.169910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a075327-41e0-449b-b574-c61368c9c7e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.172754 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8d9f230b-0223-4265-afac-1579472cc7ee tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1323 microversion: 2.1 time: 0.367228 Jul 20 04:31:20.173553 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2315/4543] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:19 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1323 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:20.503928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-282053f8-7b6b-4dc9-aa8e-781c0d40237a req-da6aed61-2113-4039-ae06-6b72412f2cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9777f396-9873-4ba1-8c76-55a9f1cf28c6", "name": "network-vif-deleted", "tag": "d88039bf-f27b-47eb-a161-b374a889aafe"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:20.521523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-282053f8-7b6b-4dc9-aa8e-781c0d40237a req-da6aed61-2113-4039-ae06-6b72412f2cb7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.524165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-282053f8-7b6b-4dc9-aa8e-781c0d40237a req-da6aed61-2113-4039-ae06-6b72412f2cb7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.550311 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-282053f8-7b6b-4dc9-aa8e-781c0d40237a req-da6aed61-2113-4039-ae06-6b72412f2cb7 service nova] Creating event network-vif-deleted:d88039bf-f27b-47eb-a161-b374a889aafe for instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 on n-h2-764485-11 Jul 20 04:31:20.559174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a075327-41e0-449b-b574-c61368c9c7e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:20.564297 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-282053f8-7b6b-4dc9-aa8e-781c0d40237a req-da6aed61-2113-4039-ae06-6b72412f2cb7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065103 Jul 20 04:31:20.570191 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2316/4544] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:31:20.573433 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a075327-41e0-449b-b574-c61368c9c7e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1328 microversion: 2.1 time: 0.422544 Jul 20 04:31:20.584835 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2229/4545] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:20 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1328 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:20.822182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d43fdc36-cfea-44ea-bafa-5a6e463ef63d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:20.823045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d43fdc36-cfea-44ea-bafa-5a6e463ef63d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:20.829570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d43fdc36-cfea-44ea-bafa-5a6e463ef63d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.830136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d43fdc36-cfea-44ea-bafa-5a6e463ef63d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.830980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d43fdc36-cfea-44ea-bafa-5a6e463ef63d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.832103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d43fdc36-cfea-44ea-bafa-5a6e463ef63d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.870104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d43fdc36-cfea-44ea-bafa-5a6e463ef63d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.870911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d43fdc36-cfea-44ea-bafa-5a6e463ef63d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.871603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-d43fdc36-cfea-44ea-bafa-5a6e463ef63d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lazy-loading 'fault' on Instance uuid 9777f396-9873-4ba1-8c76-55a9f1cf28c6 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:31:20.928497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d43fdc36-cfea-44ea-bafa-5a6e463ef63d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eee80ad4f764b3cbc2c19ec8e3559b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae939314deaf4daf8fa564f351b9671b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:20.936446 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d43fdc36-cfea-44ea-bafa-5a6e463ef63d tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 200 len: 1302 microversion: 2.1 time: 0.118615 Jul 20 04:31:20.937051 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2317/4546] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:20 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 1302 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:21.025744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4f8a1744-dac7-4e7d-a3b7-fa1efdf4ca3e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:21.026369 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4f8a1744-dac7-4e7d-a3b7-fa1efdf4ca3e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:21.035831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f8a1744-dac7-4e7d-a3b7-fa1efdf4ca3e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.036479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f8a1744-dac7-4e7d-a3b7-fa1efdf4ca3e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.037445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f8a1744-dac7-4e7d-a3b7-fa1efdf4ca3e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.037972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f8a1744-dac7-4e7d-a3b7-fa1efdf4ca3e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.191275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a282243-7d4a-4bd5-a633-4753fa74a981 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:21.191951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3a282243-7d4a-4bd5-a633-4753fa74a981 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:21.208338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a282243-7d4a-4bd5-a633-4753fa74a981 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.208989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a282243-7d4a-4bd5-a633-4753fa74a981 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.209895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a282243-7d4a-4bd5-a633-4753fa74a981 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.211692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a282243-7d4a-4bd5-a633-4753fa74a981 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.223938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4f8a1744-dac7-4e7d-a3b7-fa1efdf4ca3e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:21.238407 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4f8a1744-dac7-4e7d-a3b7-fa1efdf4ca3e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1316 microversion: 2.1 time: 0.216554 Jul 20 04:31:21.239485 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2230/4547] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:21 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:21.379710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3a282243-7d4a-4bd5-a633-4753fa74a981 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:21.387342 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a282243-7d4a-4bd5-a633-4753fa74a981 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1323 microversion: 2.1 time: 0.200883 Jul 20 04:31:21.387967 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2318/4548] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:21 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1323 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:21.591340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b1ed9a6a-4bab-40c4-90f2-209bd45f787e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:21.591783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b1ed9a6a-4bab-40c4-90f2-209bd45f787e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:21.599471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b1ed9a6a-4bab-40c4-90f2-209bd45f787e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.600208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b1ed9a6a-4bab-40c4-90f2-209bd45f787e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.601003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b1ed9a6a-4bab-40c4-90f2-209bd45f787e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.601449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b1ed9a6a-4bab-40c4-90f2-209bd45f787e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.605912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:21.828771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b1ed9a6a-4bab-40c4-90f2-209bd45f787e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:21.837907 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b1ed9a6a-4bab-40c4-90f2-209bd45f787e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1508 microversion: 2.1 time: 0.250461 Jul 20 04:31:21.839018 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2231/4549] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:21 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:21.856599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a082a6c2-4b1a-4315-97e1-27c61490e528 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:21.857793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a082a6c2-4b1a-4315-97e1-27c61490e528 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:21.867416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a082a6c2-4b1a-4315-97e1-27c61490e528 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.868153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a082a6c2-4b1a-4315-97e1-27c61490e528 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.869332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a082a6c2-4b1a-4315-97e1-27c61490e528 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.870057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a082a6c2-4b1a-4315-97e1-27c61490e528 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.955081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3505a5af-31bc-427f-9fca-098c1197f3c5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:21.956134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3505a5af-31bc-427f-9fca-098c1197f3c5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:21.963832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3505a5af-31bc-427f-9fca-098c1197f3c5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.964543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3505a5af-31bc-427f-9fca-098c1197f3c5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.965694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3505a5af-31bc-427f-9fca-098c1197f3c5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.966298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3505a5af-31bc-427f-9fca-098c1197f3c5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.982966 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-3505a5af-31bc-427f-9fca-098c1197f3c5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] HTTP exception thrown: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3505a5af-31bc-427f-9fca-098c1197f3c5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Request method failure captured: Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 HTTP/1.1 Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T0aKFZpRIymMmP-UrciO8loQtIVD9dblyI6nHTq8mg1F1nPwCQsFmCitUilMFEb5BvSFWe2LiwWxhtNCMOLgHD1X7P2K9k34eu2dVK5lzHm6bOPYjtN4fn0T-Nb0rureApw4N185lPMIXQMpHI1-AgmFAz0atyMqHDAw9YBR5iwsY Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae939314deaf4daf8fa564f351b9671b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}] Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 4eee80ad4f764b3cbc2c19ec8e3559b0 Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '9777f396-9873-4ba1-8c76-55a9f1cf28c6'} Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:21.984952 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:21.990248 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:21.990248 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:21.990248 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:21.990248 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:21.990248 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:21.990248 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:21.990248 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:21.992518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3505a5af-31bc-427f-9fca-098c1197f3c5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Returning 404 to user: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:21.993628 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3505a5af-31bc-427f-9fca-098c1197f3c5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 404 len: 111 microversion: 2.1 time: 0.042603 Jul 20 04:31:21.999746 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2232/4550] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:21 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:22.006125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ead2fb1d-46c7-4a6a-8930-b7b0d20e23ed tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.025514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.compute.server_groups [None req-ead2fb1d-46c7-4a6a-8930-b7b0d20e23ed tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Querying cell de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) for 1 instances {{(pid=119807) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:31:22.026755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ead2fb1d-46c7-4a6a-8930-b7b0d20e23ed tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.027961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ead2fb1d-46c7-4a6a-8930-b7b0d20e23ed tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.042744 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ead2fb1d-46c7-4a6a-8930-b7b0d20e23ed tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.041168 Jul 20 04:31:22.050932 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2233/4551] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:31:21 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:22.060566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3f862320-5866-4df0-a190-656c45b35bf5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.094197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.compute.server_groups [None req-3f862320-5866-4df0-a190-656c45b35bf5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Querying cell de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) for 1 instances {{(pid=119807) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:31:22.095376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f862320-5866-4df0-a190-656c45b35bf5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.096046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f862320-5866-4df0-a190-656c45b35bf5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.125372 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3f862320-5866-4df0-a190-656c45b35bf5 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/c326f59d-5db2-496e-8669-4ff9d32aa900" status: 200 len: 183 microversion: 2.1 time: 0.072795 Jul 20 04:31:22.129021 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2234/4552] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:31:22 2022] GET /compute/v2.1/os-server-groups/c326f59d-5db2-496e-8669-4ff9d32aa900 => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:22.138776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0c36da4-36c8-4f6f-9471-f744bb448992 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.140623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e0c36da4-36c8-4f6f-9471-f744bb448992 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:22.158351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0c36da4-36c8-4f6f-9471-f744bb448992 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.159148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0c36da4-36c8-4f6f-9471-f744bb448992 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.161899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0c36da4-36c8-4f6f-9471-f744bb448992 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.163866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0c36da4-36c8-4f6f-9471-f744bb448992 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.198711 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e0c36da4-36c8-4f6f-9471-f744bb448992 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] HTTP exception thrown: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0c36da4-36c8-4f6f-9471-f744bb448992 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Request method failure captured: Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 HTTP/1.1 Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T0aKFZpRIymMmP-UrciO8loQtIVD9dblyI6nHTq8mg1F1nPwCQsFmCitUilMFEb5BvSFWe2LiwWxhtNCMOLgHD1X7P2K9k34eu2dVK5lzHm6bOPYjtN4fn0T-Nb0rureApw4N185lPMIXQMpHI1-AgmFAz0atyMqHDAw9YBR5iwsY Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae939314deaf4daf8fa564f351b9671b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}] Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 4eee80ad4f764b3cbc2c19ec8e3559b0 Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '9777f396-9873-4ba1-8c76-55a9f1cf28c6'} Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:22.211467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:22.215581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:22.215581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.215581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:22.215581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.215581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:22.215581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:22.215581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:22.215581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:22.215581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:22.215581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:22.215581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.220050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0c36da4-36c8-4f6f-9471-f744bb448992 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Returning 404 to user: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:22.221108 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e0c36da4-36c8-4f6f-9471-f744bb448992 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 404 len: 111 microversion: 2.1 time: 0.086518 Jul 20 04:31:22.223362 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2235/4553] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:22 2022] DELETE /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:31:22.237039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a082a6c2-4b1a-4315-97e1-27c61490e528 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:22.242163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f4fe6d71-4b2c-4fe8-a054-21b092f437e9 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.246991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f4fe6d71-4b2c-4fe8-a054-21b092f437e9 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] [instance: 9777f396-9873-4ba1-8c76-55a9f1cf28c6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:22.247122 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a082a6c2-4b1a-4315-97e1-27c61490e528 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1508 microversion: 2.1 time: 0.394559 Jul 20 04:31:22.248772 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2319/4554] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:21 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:22.257105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-839961d4-5530-46f4-ae35-cceec6448d88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.259141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-839961d4-5530-46f4-ae35-cceec6448d88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:22.264544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f4fe6d71-4b2c-4fe8-a054-21b092f437e9 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.267490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f4fe6d71-4b2c-4fe8-a054-21b092f437e9 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.268644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f4fe6d71-4b2c-4fe8-a054-21b092f437e9 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.272135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f4fe6d71-4b2c-4fe8-a054-21b092f437e9 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.278510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:22.294782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-839961d4-5530-46f4-ae35-cceec6448d88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.297336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-839961d4-5530-46f4-ae35-cceec6448d88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.298892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-839961d4-5530-46f4-ae35-cceec6448d88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.299581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-839961d4-5530-46f4-ae35-cceec6448d88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.317495 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f4fe6d71-4b2c-4fe8-a054-21b092f437e9 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] HTTP exception thrown: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f4fe6d71-4b2c-4fe8-a054-21b092f437e9 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Request method failure captured: Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 HTTP/1.1 Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T0aKFZpRIymMmP-UrciO8loQtIVD9dblyI6nHTq8mg1F1nPwCQsFmCitUilMFEb5BvSFWe2LiwWxhtNCMOLgHD1X7P2K9k34eu2dVK5lzHm6bOPYjtN4fn0T-Nb0rureApw4N185lPMIXQMpHI1-AgmFAz0atyMqHDAw9YBR5iwsY Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae939314deaf4daf8fa564f351b9671b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}] Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 4eee80ad4f764b3cbc2c19ec8e3559b0 Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '9777f396-9873-4ba1-8c76-55a9f1cf28c6'} Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:22.319300 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.322908 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:22.322908 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:22.322908 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:22.322908 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:22.322908 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:22.322908 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. Jul 20 04:31:22.322908 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.325028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f4fe6d71-4b2c-4fe8-a054-21b092f437e9 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Returning 404 to user: Instance 9777f396-9873-4ba1-8c76-55a9f1cf28c6 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:22.326369 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f4fe6d71-4b2c-4fe8-a054-21b092f437e9 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6" status: 404 len: 111 microversion: 2.1 time: 0.098835 Jul 20 04:31:22.340370 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2236/4555] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:22 2022] GET /compute/v2.1/servers/9777f396-9873-4ba1-8c76-55a9f1cf28c6 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:22.355891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f1475fb0-0c81-47c4-8565-23f76fe6c8e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.356809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f1475fb0-0c81-47c4-8565-23f76fe6c8e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:22.364025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1475fb0-0c81-47c4-8565-23f76fe6c8e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.364930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1475fb0-0c81-47c4-8565-23f76fe6c8e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.365919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1475fb0-0c81-47c4-8565-23f76fe6c8e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.366592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f1475fb0-0c81-47c4-8565-23f76fe6c8e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.409948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f1475fb0-0c81-47c4-8565-23f76fe6c8e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:22.546955 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f1475fb0-0c81-47c4-8565-23f76fe6c8e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 204 len: 0 microversion: 2.1 time: 0.203831 Jul 20 04:31:22.548014 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2237/4556] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:22 2022] DELETE /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:31:22.555465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ad9722fd-7f45-4b14-bf4a-672c7b7ead57 req-e874ffae-6fc9-488c-a556-10788657c25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44750009-3372-4838-91b8-69f3c34ca9c5", "name": "network-vif-plugged", "status": "completed", "tag": "92fae5a0-fed9-40e1-aa84-cac47de3dc23"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:22.568132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ad9722fd-7f45-4b14-bf4a-672c7b7ead57 req-e874ffae-6fc9-488c-a556-10788657c25b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.569514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ad9722fd-7f45-4b14-bf4a-672c7b7ead57 req-e874ffae-6fc9-488c-a556-10788657c25b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.609161 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ad9722fd-7f45-4b14-bf4a-672c7b7ead57 req-e874ffae-6fc9-488c-a556-10788657c25b service nova] Creating event network-vif-plugged:92fae5a0-fed9-40e1-aa84-cac47de3dc23 for instance 44750009-3372-4838-91b8-69f3c34ca9c5 on n-h2-764485-11 Jul 20 04:31:22.613870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-839961d4-5530-46f4-ae35-cceec6448d88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:22.616451 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ad9722fd-7f45-4b14-bf4a-672c7b7ead57 req-e874ffae-6fc9-488c-a556-10788657c25b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066494 Jul 20 04:31:22.618179 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2238/4557] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:22.623019 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-839961d4-5530-46f4-ae35-cceec6448d88 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.372464 Jul 20 04:31:22.626091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f20537e6-0f28-47aa-84a6-66d1de221caa tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.626921 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2320/4558] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:22 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:22.634779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-13afb044-93d1-4d63-9710-a8ba251d516a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.636383 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f20537e6-0f28-47aa-84a6-66d1de221caa tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] HTTP exception thrown: Instance group a8f29d63-44b2-42d0-b427-21b5c733a934 could not be found. Jul 20 04:31:22.638084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-13afb044-93d1-4d63-9710-a8ba251d516a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f20537e6-0f28-47aa-84a6-66d1de221caa tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Request method failure captured: Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-server-groups/a8f29d63-44b2-42d0-b427-21b5c733a934 HTTP/1.1 Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T0aKFZpRIymMmP-UrciO8loQtIVD9dblyI6nHTq8mg1F1nPwCQsFmCitUilMFEb5BvSFWe2LiwWxhtNCMOLgHD1X7P2K9k34eu2dVK5lzHm6bOPYjtN4fn0T-Nb0rureApw4N185lPMIXQMpHI1-AgmFAz0atyMqHDAw9YBR5iwsY Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae939314deaf4daf8fa564f351b9671b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}] Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 4eee80ad4f764b3cbc2c19ec8e3559b0 Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance group a8f29d63-44b2-42d0-b427-21b5c733a934 could not be found. Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a8f29d63-44b2-42d0-b427-21b5c733a934'} Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a8f29d63-44b2-42d0-b427-21b5c733a934 could not be found. Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a8f29d63-44b2-42d0-b427-21b5c733a934 could not be found. Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.638754 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:22.643269 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:22.643269 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:22.643269 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:22.643269 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:22.643269 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a8f29d63-44b2-42d0-b427-21b5c733a934 could not be found. Jul 20 04:31:22.643269 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:22.643269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f20537e6-0f28-47aa-84a6-66d1de221caa tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Returning 404 to user: Instance group a8f29d63-44b2-42d0-b427-21b5c733a934 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:22.643269 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f20537e6-0f28-47aa-84a6-66d1de221caa tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/a8f29d63-44b2-42d0-b427-21b5c733a934" status: 404 len: 117 microversion: 2.1 time: 0.021086 Jul 20 04:31:22.645511 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2239/4559] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:31:22 2022] DELETE /compute/v2.1/os-server-groups/a8f29d63-44b2-42d0-b427-21b5c733a934 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:22.651669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e48939c8-704a-4bf8-830c-d32c8eb713ae tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.652769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e48939c8-704a-4bf8-830c-d32c8eb713ae tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:22.658257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13afb044-93d1-4d63-9710-a8ba251d516a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.662369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13afb044-93d1-4d63-9710-a8ba251d516a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.663310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13afb044-93d1-4d63-9710-a8ba251d516a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.663799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e48939c8-704a-4bf8-830c-d32c8eb713ae tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.664254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e48939c8-704a-4bf8-830c-d32c8eb713ae tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.664434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13afb044-93d1-4d63-9710-a8ba251d516a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.666181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e48939c8-704a-4bf8-830c-d32c8eb713ae tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.666782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e48939c8-704a-4bf8-830c-d32c8eb713ae tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.971207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-13afb044-93d1-4d63-9710-a8ba251d516a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:22.975547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e48939c8-704a-4bf8-830c-d32c8eb713ae tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:22.989691 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-13afb044-93d1-4d63-9710-a8ba251d516a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1323 microversion: 2.1 time: 0.358522 Jul 20 04:31:22.990284 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2321/4560] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:22 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1323 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:22.994815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e7f9984c-f7a5-464f-95c5-b84ab8351cb8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.997597 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e48939c8-704a-4bf8-830c-d32c8eb713ae tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1514 microversion: 2.1 time: 0.351008 Jul 20 04:31:22.998349 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2240/4561] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:22 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1514 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:23.002727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1889668409", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:23.014327 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-e7f9984c-f7a5-464f-95c5-b84ab8351cb8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] HTTP exception thrown: Instance group ee59def6-9c0e-485f-8e4c-571df9f4522a could not be found. Jul 20 04:31:23.017355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e7f9984c-f7a5-464f-95c5-b84ab8351cb8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Request method failure captured: Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-server-groups/ee59def6-9c0e-485f-8e4c-571df9f4522a HTTP/1.1 Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T0aKFZpRIymMmP-UrciO8loQtIVD9dblyI6nHTq8mg1F1nPwCQsFmCitUilMFEb5BvSFWe2LiwWxhtNCMOLgHD1X7P2K9k34eu2dVK5lzHm6bOPYjtN4fn0T-Nb0rureApw4N185lPMIXQMpHI1-AgmFAz0atyMqHDAw9YBR5iwsY Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae939314deaf4daf8fa564f351b9671b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}] Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 4eee80ad4f764b3cbc2c19ec8e3559b0 Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance group ee59def6-9c0e-485f-8e4c-571df9f4522a could not be found. Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ee59def6-9c0e-485f-8e4c-571df9f4522a'} Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ee59def6-9c0e-485f-8e4c-571df9f4522a could not be found. Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ee59def6-9c0e-485f-8e4c-571df9f4522a could not be found. Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.019578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:23.023805 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:23.023805 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:23.023805 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:23.023805 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:23.023805 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ee59def6-9c0e-485f-8e4c-571df9f4522a could not be found. Jul 20 04:31:23.023805 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.023805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e7f9984c-f7a5-464f-95c5-b84ab8351cb8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Returning 404 to user: Instance group ee59def6-9c0e-485f-8e4c-571df9f4522a could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:23.023805 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e7f9984c-f7a5-464f-95c5-b84ab8351cb8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/ee59def6-9c0e-485f-8e4c-571df9f4522a" status: 404 len: 117 microversion: 2.1 time: 0.030286 Jul 20 04:31:23.023805 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2322/4562] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:31:22 2022] DELETE /compute/v2.1/os-server-groups/ee59def6-9c0e-485f-8e4c-571df9f4522a => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:23.031949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-702af985-e949-4e39-8cde-2f2d42a2aed8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:23.039778 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-702af985-e949-4e39-8cde-2f2d42a2aed8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] HTTP exception thrown: Instance group 546bfea4-dd8a-493e-a9f8-e0f3061f5bee could not be found. Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-702af985-e949-4e39-8cde-2f2d42a2aed8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Request method failure captured: Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-server-groups/546bfea4-dd8a-493e-a9f8-e0f3061f5bee HTTP/1.1 Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T0aKFZpRIymMmP-UrciO8loQtIVD9dblyI6nHTq8mg1F1nPwCQsFmCitUilMFEb5BvSFWe2LiwWxhtNCMOLgHD1X7P2K9k34eu2dVK5lzHm6bOPYjtN4fn0T-Nb0rureApw4N185lPMIXQMpHI1-AgmFAz0atyMqHDAw9YBR5iwsY Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae939314deaf4daf8fa564f351b9671b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}] Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 4eee80ad4f764b3cbc2c19ec8e3559b0 Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance group 546bfea4-dd8a-493e-a9f8-e0f3061f5bee could not be found. Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '546bfea4-dd8a-493e-a9f8-e0f3061f5bee'} Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 546bfea4-dd8a-493e-a9f8-e0f3061f5bee could not be found. Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 546bfea4-dd8a-493e-a9f8-e0f3061f5bee could not be found. Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.041525 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:23.045740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:23.045740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:23.045740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:23.045740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:23.045740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 546bfea4-dd8a-493e-a9f8-e0f3061f5bee could not be found. Jul 20 04:31:23.045740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.048840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-702af985-e949-4e39-8cde-2f2d42a2aed8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Returning 404 to user: Instance group 546bfea4-dd8a-493e-a9f8-e0f3061f5bee could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:23.068455 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-702af985-e949-4e39-8cde-2f2d42a2aed8 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/546bfea4-dd8a-493e-a9f8-e0f3061f5bee" status: 404 len: 117 microversion: 2.1 time: 0.024682 Jul 20 04:31:23.072581 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2323/4563] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:31:23 2022] DELETE /compute/v2.1/os-server-groups/546bfea4-dd8a-493e-a9f8-e0f3061f5bee => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:23.090199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be27de07-6463-43f4-9f3f-bdce1a090afe tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:23.098156 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-be27de07-6463-43f4-9f3f-bdce1a090afe tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] HTTP exception thrown: Instance group 3d94f302-39bc-4ba1-883a-30f7a354c2ce could not be found. Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be27de07-6463-43f4-9f3f-bdce1a090afe tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Request method failure captured: Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/os-server-groups/3d94f302-39bc-4ba1-883a-30f7a354c2ce HTTP/1.1 Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T0aKFZpRIymMmP-UrciO8loQtIVD9dblyI6nHTq8mg1F1nPwCQsFmCitUilMFEb5BvSFWe2LiwWxhtNCMOLgHD1X7P2K9k34eu2dVK5lzHm6bOPYjtN4fn0T-Nb0rureApw4N185lPMIXQMpHI1-AgmFAz0atyMqHDAw9YBR5iwsY Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae939314deaf4daf8fa564f351b9671b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae939314deaf4daf8fa564f351b9671b"}]}] Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ae939314deaf4daf8fa564f351b9671b Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerGroupTestJSON-1889900982 Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 4eee80ad4f764b3cbc2c19ec8e3559b0 Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerGroupTestJSON-1889900982-project Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance group 3d94f302-39bc-4ba1-883a-30f7a354c2ce could not be found. Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '3d94f302-39bc-4ba1-883a-30f7a354c2ce'} Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3d94f302-39bc-4ba1-883a-30f7a354c2ce could not be found. Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3d94f302-39bc-4ba1-883a-30f7a354c2ce could not be found. Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.100128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:23.104692 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:23.104692 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:23.104692 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:23.104692 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:23.104692 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3d94f302-39bc-4ba1-883a-30f7a354c2ce could not be found. Jul 20 04:31:23.104692 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:23.104692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be27de07-6463-43f4-9f3f-bdce1a090afe tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Returning 404 to user: Instance group 3d94f302-39bc-4ba1-883a-30f7a354c2ce could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:23.107956 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-be27de07-6463-43f4-9f3f-bdce1a090afe tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/3d94f302-39bc-4ba1-883a-30f7a354c2ce" status: 404 len: 117 microversion: 2.1 time: 0.024026 Jul 20 04:31:23.108820 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2324/4564] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:31:23 2022] DELETE /compute/v2.1/os-server-groups/3d94f302-39bc-4ba1-883a-30f7a354c2ce => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:23.123968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-19e3d3c5-7345-42f0-a9c0-f5edbfe1a5a9 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:23.136785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] validate_networks() for [('2601f58c-d54c-42c1-850f-a93d0087b3cf', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:31:23.166304 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-19e3d3c5-7345-42f0-a9c0-f5edbfe1a5a9 tempest-ServerGroupTestJSON-1889900982 tempest-ServerGroupTestJSON-1889900982-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/c326f59d-5db2-496e-8669-4ff9d32aa900" status: 204 len: 0 microversion: 2.1 time: 0.052323 Jul 20 04:31:23.167269 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2325/4565] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:31:23 2022] DELETE /compute/v2.1/os-server-groups/c326f59d-5db2-496e-8669-4ff9d32aa900 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:31:23.565847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:23.566427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:23.567071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:23.567484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:23.567923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:23.579096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:23.579568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:23.580365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:23.580800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:23.600982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Getting quotas for project 2bb95832b0b941c98c6d555d2066ff3b. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:23.607181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Getting quotas for user c6ac8188b69c4089858c1fdc6fbdbf66 and project 2bb95832b0b941c98c6d555d2066ff3b. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:23.621409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:23.623791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:23.674420 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-932a694d-ed79-482f-ab9c-4a60676a7efa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675182 Jul 20 04:31:23.675276 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2241/4566] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:31:23.685756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-af512e74-aae4-48a5-aaec-b0ceaae4d14a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:23.686771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-af512e74-aae4-48a5-aaec-b0ceaae4d14a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:23.781540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af512e74-aae4-48a5-aaec-b0ceaae4d14a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:23.790636 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-af512e74-aae4-48a5-aaec-b0ceaae4d14a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1217 microversion: 2.1 time: 0.109203 Jul 20 04:31:23.796955 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2326/4567] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:23 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:24.009249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-90d4c8cd-9063-4220-a566-1614afade3a4 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:24.010020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-90d4c8cd-9063-4220-a566-1614afade3a4 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:24.018053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90d4c8cd-9063-4220-a566-1614afade3a4 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.019070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90d4c8cd-9063-4220-a566-1614afade3a4 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.020002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90d4c8cd-9063-4220-a566-1614afade3a4 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.020411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7b3eac4e-392a-44de-a9bb-6f552c762663 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:24.021204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90d4c8cd-9063-4220-a566-1614afade3a4 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.022269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7b3eac4e-392a-44de-a9bb-6f552c762663 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:24.045542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b3eac4e-392a-44de-a9bb-6f552c762663 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.046009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b3eac4e-392a-44de-a9bb-6f552c762663 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.047101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b3eac4e-392a-44de-a9bb-6f552c762663 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.047745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b3eac4e-392a-44de-a9bb-6f552c762663 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.280415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-90d4c8cd-9063-4220-a566-1614afade3a4 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:24.289404 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-90d4c8cd-9063-4220-a566-1614afade3a4 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1323 microversion: 2.1 time: 0.286236 Jul 20 04:31:24.310972 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2242/4568] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:24 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:24.361838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7b3eac4e-392a-44de-a9bb-6f552c762663 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:24.395878 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7b3eac4e-392a-44de-a9bb-6f552c762663 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1514 microversion: 2.1 time: 0.369866 Jul 20 04:31:24.396547 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2327/4569] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:24 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1514 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:24.808829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95fd7269-33b4-4b59-b5dc-179e99c392b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:24.809359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95fd7269-33b4-4b59-b5dc-179e99c392b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:24.817388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95fd7269-33b4-4b59-b5dc-179e99c392b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.817842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95fd7269-33b4-4b59-b5dc-179e99c392b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.818627 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95fd7269-33b4-4b59-b5dc-179e99c392b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.819069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95fd7269-33b4-4b59-b5dc-179e99c392b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.921040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95fd7269-33b4-4b59-b5dc-179e99c392b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:24.930320 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95fd7269-33b4-4b59-b5dc-179e99c392b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1269 microversion: 2.1 time: 0.126283 Jul 20 04:31:24.930923 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2243/4570] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:24 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1269 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:25.321416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1412b143-b41d-42f4-91dd-e6c3ffbc3bc5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:25.322562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1412b143-b41d-42f4-91dd-e6c3ffbc3bc5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:25.329417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1412b143-b41d-42f4-91dd-e6c3ffbc3bc5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.330121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1412b143-b41d-42f4-91dd-e6c3ffbc3bc5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.331062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1412b143-b41d-42f4-91dd-e6c3ffbc3bc5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.331998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1412b143-b41d-42f4-91dd-e6c3ffbc3bc5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.422761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1047ddfe-bde4-4ee4-8e8e-a801cabdda75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:25.431490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1047ddfe-bde4-4ee4-8e8e-a801cabdda75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:25.445839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1047ddfe-bde4-4ee4-8e8e-a801cabdda75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.446302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1047ddfe-bde4-4ee4-8e8e-a801cabdda75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.447110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1047ddfe-bde4-4ee4-8e8e-a801cabdda75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.448004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1047ddfe-bde4-4ee4-8e8e-a801cabdda75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.783472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1412b143-b41d-42f4-91dd-e6c3ffbc3bc5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:25.794795 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1412b143-b41d-42f4-91dd-e6c3ffbc3bc5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1323 microversion: 2.1 time: 0.482154 Jul 20 04:31:25.800562 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2328/4571] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:25 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1323 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:25.948006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-788f02e3-938c-4fa4-aba8-ffaabb5f74ea tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:25.948899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-788f02e3-938c-4fa4-aba8-ffaabb5f74ea tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:25.958803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-788f02e3-938c-4fa4-aba8-ffaabb5f74ea tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.959588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-788f02e3-938c-4fa4-aba8-ffaabb5f74ea tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.968069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-788f02e3-938c-4fa4-aba8-ffaabb5f74ea tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.968537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-788f02e3-938c-4fa4-aba8-ffaabb5f74ea tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.013591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1047ddfe-bde4-4ee4-8e8e-a801cabdda75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:26.021907 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1047ddfe-bde4-4ee4-8e8e-a801cabdda75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 200 len: 1514 microversion: 2.1 time: 0.610001 Jul 20 04:31:26.028987 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2244/4572] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:25 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 1514 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:26.087841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-788f02e3-938c-4fa4-aba8-ffaabb5f74ea tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:26.090407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:26.106486 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-788f02e3-938c-4fa4-aba8-ffaabb5f74ea tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1275 microversion: 2.1 time: 0.159373 Jul 20 04:31:26.115979 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2329/4573] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:25 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:26.216508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-785cfe6a-efab-4476-a86e-5dfeb13c851e req-3e39b5b1-8238-4e45-8d3c-974f2c8679c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcf7980-51fd-4f6c-9d31-833631d4419e", "name": "network-vif-deleted", "tag": "bc39e903-f322-475c-ae40-9c774e4eb8aa"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:26.229950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-785cfe6a-efab-4476-a86e-5dfeb13c851e req-3e39b5b1-8238-4e45-8d3c-974f2c8679c2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.232313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-785cfe6a-efab-4476-a86e-5dfeb13c851e req-3e39b5b1-8238-4e45-8d3c-974f2c8679c2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.259807 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-785cfe6a-efab-4476-a86e-5dfeb13c851e req-3e39b5b1-8238-4e45-8d3c-974f2c8679c2 service nova] Creating event network-vif-deleted:bc39e903-f322-475c-ae40-9c774e4eb8aa for instance 6dcf7980-51fd-4f6c-9d31-833631d4419e on n-h2-764485-11 Jul 20 04:31:26.268079 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-785cfe6a-efab-4476-a86e-5dfeb13c851e req-3e39b5b1-8238-4e45-8d3c-974f2c8679c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055225 Jul 20 04:31:26.274025 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2245/4574] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:26.812958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d1f03348-c35b-44ab-9e2d-b4208a1e5f91 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:26.813579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d1f03348-c35b-44ab-9e2d-b4208a1e5f91 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:26.825293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1f03348-c35b-44ab-9e2d-b4208a1e5f91 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.825776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1f03348-c35b-44ab-9e2d-b4208a1e5f91 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.826576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1f03348-c35b-44ab-9e2d-b4208a1e5f91 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.827017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1f03348-c35b-44ab-9e2d-b4208a1e5f91 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.048583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-65b0da26-ee07-4c59-90f4-bdbd95a202ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:27.049986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-65b0da26-ee07-4c59-90f4-bdbd95a202ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:27.059146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65b0da26-ee07-4c59-90f4-bdbd95a202ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.066570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65b0da26-ee07-4c59-90f4-bdbd95a202ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.067545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65b0da26-ee07-4c59-90f4-bdbd95a202ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.069926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65b0da26-ee07-4c59-90f4-bdbd95a202ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.098864 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-65b0da26-ee07-4c59-90f4-bdbd95a202ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-65b0da26-ee07-4c59-90f4-bdbd95a202ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e HTTP/1.1 Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '6dcf7980-51fd-4f6c-9d31-833631d4419e'} Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:27.117332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:27.121939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:27.121939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:27.121939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:27.121939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:27.121939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:31:27.121939 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:27.122925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-65b0da26-ee07-4c59-90f4-bdbd95a202ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:27.135774 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-65b0da26-ee07-4c59-90f4-bdbd95a202ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 404 len: 111 microversion: 2.1 time: 0.084190 Jul 20 04:31:27.136914 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2246/4575] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:27 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:27.143357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5c1de2d4-e8ea-41f9-a709-63d120fdf4a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:27.149024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5c1de2d4-e8ea-41f9-a709-63d120fdf4a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:27.157526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c1de2d4-e8ea-41f9-a709-63d120fdf4a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.168345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c1de2d4-e8ea-41f9-a709-63d120fdf4a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.169299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c1de2d4-e8ea-41f9-a709-63d120fdf4a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.169863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c1de2d4-e8ea-41f9-a709-63d120fdf4a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.490074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5c1de2d4-e8ea-41f9-a709-63d120fdf4a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:27.498495 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5c1de2d4-e8ea-41f9-a709-63d120fdf4a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1317 microversion: 2.1 time: 0.360381 Jul 20 04:31:27.503952 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2247/4576] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:27 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:27.517924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e056d85d-3af9-4358-b0d7-7e061dbb6b68 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '.version_select at 0x7fbf9c26b550>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:27.548630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d1f03348-c35b-44ab-9e2d-b4208a1e5f91 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:27.563077 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d1f03348-c35b-44ab-9e2d-b4208a1e5f91 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1518 microversion: 2.1 time: 0.752507 Jul 20 04:31:27.563990 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e056d85d-3af9-4358-b0d7-7e061dbb6b68 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-key-2024397217" status: 202 len: 0 microversion: 2.1 time: 0.049836 Jul 20 04:31:27.564711 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2248/4577] 10.222.0.20 () {58 vars in 1208 bytes} [Wed Jul 20 04:31:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2024397217 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:31:27.567364 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2330/4578] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:26 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1518 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:27.575215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0bbeb68f-ab80-4621-95c9-19fde7c9a861 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:27.585230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0bbeb68f-ab80-4621-95c9-19fde7c9a861 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:27.594274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8375c979-87cb-4706-bea0-fd0d8cbc36ec tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:27.595304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8375c979-87cb-4706-bea0-fd0d8cbc36ec tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:27.602617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0bbeb68f-ab80-4621-95c9-19fde7c9a861 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.603114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0bbeb68f-ab80-4621-95c9-19fde7c9a861 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.603987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0bbeb68f-ab80-4621-95c9-19fde7c9a861 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.606459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0bbeb68f-ab80-4621-95c9-19fde7c9a861 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.623993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8375c979-87cb-4706-bea0-fd0d8cbc36ec tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.624671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8375c979-87cb-4706-bea0-fd0d8cbc36ec tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.625644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8375c979-87cb-4706-bea0-fd0d8cbc36ec tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.626245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8375c979-87cb-4706-bea0-fd0d8cbc36ec tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.728740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-8375c979-87cb-4706-bea0-fd0d8cbc36ec tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lazy-loading 'flavor' on Instance uuid 44750009-3372-4838-91b8-69f3c34ca9c5 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:31:27.827452 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0bbeb68f-ab80-4621-95c9-19fde7c9a861 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.244111 Jul 20 04:31:27.836821 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2249/4579] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:31:27 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:31:27.843435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9a80430b-3a14-40c0-9922-48a014324aa3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:27.844252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9a80430b-3a14-40c0-9922-48a014324aa3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:27.861102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a80430b-3a14-40c0-9922-48a014324aa3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.861565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a80430b-3a14-40c0-9922-48a014324aa3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.862986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a80430b-3a14-40c0-9922-48a014324aa3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.863444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a80430b-3a14-40c0-9922-48a014324aa3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.970612 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8375c979-87cb-4706-bea0-fd0d8cbc36ec tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "POST /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5/action" status: 200 len: 32 microversion: 2.1 time: 0.378967 Jul 20 04:31:27.973212 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2331/4580] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:31:27 2022] POST /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5/action => generated 32 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:31:27.982587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1482699172", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "be069fc8-30ed-40bc-8dbd-2efb24615595"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:28.084728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] validate_networks() for [('be069fc8-30ed-40bc-8dbd-2efb24615595', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:31:28.558694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9a80430b-3a14-40c0-9922-48a014324aa3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:28.567280 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9a80430b-3a14-40c0-9922-48a014324aa3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1671 microversion: 2.1 time: 0.728489 Jul 20 04:31:28.577661 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2250/4581] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:27 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1671 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:28.583431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-316f01a5-5387-44e3-a847-f9089f726abf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:28.584319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-316f01a5-5387-44e3-a847-f9089f726abf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:28.600321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-316f01a5-5387-44e3-a847-f9089f726abf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:28.601052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-316f01a5-5387-44e3-a847-f9089f726abf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:28.602234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-316f01a5-5387-44e3-a847-f9089f726abf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:28.602998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-316f01a5-5387-44e3-a847-f9089f726abf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.040594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-316f01a5-5387-44e3-a847-f9089f726abf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:29.052635 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-316f01a5-5387-44e3-a847-f9089f726abf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.473546 Jul 20 04:31:29.073512 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2251/4582] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:28 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:29.086478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ba192a50-0c08-4556-b8ad-1891edd7b0cc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:29.087013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ba192a50-0c08-4556-b8ad-1891edd7b0cc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:29.115349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba192a50-0c08-4556-b8ad-1891edd7b0cc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.116068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba192a50-0c08-4556-b8ad-1891edd7b0cc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.117047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba192a50-0c08-4556-b8ad-1891edd7b0cc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.117637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba192a50-0c08-4556-b8ad-1891edd7b0cc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.562537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:29.563581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:29.564223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:29.564848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:29.566082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:29.579663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.581275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.582457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.583209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.608627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:29.616901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for user 7d38b1e323c5490fbb4c0023034874c8 and project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:29.632138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ba192a50-0c08-4556-b8ad-1891edd7b0cc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:29.658925 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ba192a50-0c08-4556-b8ad-1891edd7b0cc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1317 microversion: 2.1 time: 0.584167 Jul 20 04:31:29.662383 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2252/4583] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:29 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:29.663827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:29.666814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:29.676267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f6dd6c3b-8f04-409f-b323-6f97e7f8e593 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:29.677210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f6dd6c3b-8f04-409f-b323-6f97e7f8e593 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:29.686686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6dd6c3b-8f04-409f-b323-6f97e7f8e593 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.687297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6dd6c3b-8f04-409f-b323-6f97e7f8e593 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.689455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6dd6c3b-8f04-409f-b323-6f97e7f8e593 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.690175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6dd6c3b-8f04-409f-b323-6f97e7f8e593 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.751433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:29.865509 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c1b3588b-f21a-460d-9495-d5da6555e1f7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.889627 Jul 20 04:31:29.874704 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2332/4584] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:31:29.892133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0d725a6-e342-4b06-ab29-93a718d80f07 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:29.892800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b0d725a6-e342-4b06-ab29-93a718d80f07 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:30.145308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b0d725a6-e342-4b06-ab29-93a718d80f07 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:30.171894 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b0d725a6-e342-4b06-ab29-93a718d80f07 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1209 microversion: 2.1 time: 0.293405 Jul 20 04:31:30.184331 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2333/4585] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:29 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1209 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:30.193032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-03bbf173-6b7d-410b-889a-ac0c6757626e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:30.193817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-03bbf173-6b7d-410b-889a-ac0c6757626e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:30.212462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03bbf173-6b7d-410b-889a-ac0c6757626e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.213150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03bbf173-6b7d-410b-889a-ac0c6757626e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.221103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03bbf173-6b7d-410b-889a-ac0c6757626e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.221990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03bbf173-6b7d-410b-889a-ac0c6757626e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.511116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f6dd6c3b-8f04-409f-b323-6f97e7f8e593 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:30.540688 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f6dd6c3b-8f04-409f-b323-6f97e7f8e593 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1671 microversion: 2.1 time: 0.871954 Jul 20 04:31:30.543583 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2253/4586] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:29 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1671 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:30.684697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d219a7a6-ec2e-46e0-acf2-d5d239398ff4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:30.686055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d219a7a6-ec2e-46e0-acf2-d5d239398ff4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:30.695677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d219a7a6-ec2e-46e0-acf2-d5d239398ff4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.696131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d219a7a6-ec2e-46e0-acf2-d5d239398ff4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.696907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d219a7a6-ec2e-46e0-acf2-d5d239398ff4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.697345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d219a7a6-ec2e-46e0-acf2-d5d239398ff4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.806771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-03bbf173-6b7d-410b-889a-ac0c6757626e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:30.824329 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-03bbf173-6b7d-410b-889a-ac0c6757626e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.638498 Jul 20 04:31:30.824856 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2334/4587] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:30 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:31.056829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d219a7a6-ec2e-46e0-acf2-d5d239398ff4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:31.070188 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d219a7a6-ec2e-46e0-acf2-d5d239398ff4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1317 microversion: 2.1 time: 0.395347 Jul 20 04:31:31.070798 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2254/4588] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:30 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:31.099631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-fb526bbd-c17c-4b07-9c31-b1114a2e483e req-935392b3-74d7-4932-9eb7-b48db1d552fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2b9533-c850-4e02-afc0-68243a289fac", "tag": "3fc3002c-7430-471f-9dac-2c1a83f4270f"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:31.118315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-fb526bbd-c17c-4b07-9c31-b1114a2e483e req-935392b3-74d7-4932-9eb7-b48db1d552fa service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.122101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-fb526bbd-c17c-4b07-9c31-b1114a2e483e req-935392b3-74d7-4932-9eb7-b48db1d552fa service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.147862 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-fb526bbd-c17c-4b07-9c31-b1114a2e483e req-935392b3-74d7-4932-9eb7-b48db1d552fa service nova] Creating event network-changed:3fc3002c-7430-471f-9dac-2c1a83f4270f for instance de2b9533-c850-4e02-afc0-68243a289fac on n-h1-764485-11 Jul 20 04:31:31.167841 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-fb526bbd-c17c-4b07-9c31-b1114a2e483e req-935392b3-74d7-4932-9eb7-b48db1d552fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072809 Jul 20 04:31:31.171128 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2335/4589] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:31.207600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-31dd209d-7c3a-461b-b7eb-1d7f1994fa12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:31.209954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-31dd209d-7c3a-461b-b7eb-1d7f1994fa12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:31.229544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31dd209d-7c3a-461b-b7eb-1d7f1994fa12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.231108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31dd209d-7c3a-461b-b7eb-1d7f1994fa12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.232849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31dd209d-7c3a-461b-b7eb-1d7f1994fa12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.233705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31dd209d-7c3a-461b-b7eb-1d7f1994fa12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.344013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-31dd209d-7c3a-461b-b7eb-1d7f1994fa12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:31.356678 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-31dd209d-7c3a-461b-b7eb-1d7f1994fa12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1205 microversion: 2.1 time: 0.154489 Jul 20 04:31:31.357729 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2255/4590] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:31 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1205 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:31.563449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-32283f2a-9b5d-4a00-8c69-fd30a68c5a0c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:31.564413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-32283f2a-9b5d-4a00-8c69-fd30a68c5a0c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:31.574698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32283f2a-9b5d-4a00-8c69-fd30a68c5a0c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.575161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32283f2a-9b5d-4a00-8c69-fd30a68c5a0c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.575999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32283f2a-9b5d-4a00-8c69-fd30a68c5a0c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.576442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32283f2a-9b5d-4a00-8c69-fd30a68c5a0c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.842851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-57817995-841c-49d5-b72c-f92f3e1262f1 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:31.845757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-57817995-841c-49d5-b72c-f92f3e1262f1 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:31.855417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57817995-841c-49d5-b72c-f92f3e1262f1 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.856361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57817995-841c-49d5-b72c-f92f3e1262f1 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.858840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57817995-841c-49d5-b72c-f92f3e1262f1 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.860022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57817995-841c-49d5-b72c-f92f3e1262f1 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.388826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-32283f2a-9b5d-4a00-8c69-fd30a68c5a0c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:32.398598 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-32283f2a-9b5d-4a00-8c69-fd30a68c5a0c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.839974 Jul 20 04:31:32.399190 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2336/4591] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:31 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:32.404695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dc08f8df-d839-4e87-bd8d-974ba39f3f71 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:32.405482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dc08f8df-d839-4e87-bd8d-974ba39f3f71 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:32.415426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc08f8df-d839-4e87-bd8d-974ba39f3f71 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.416215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc08f8df-d839-4e87-bd8d-974ba39f3f71 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.417197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc08f8df-d839-4e87-bd8d-974ba39f3f71 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.417699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc08f8df-d839-4e87-bd8d-974ba39f3f71 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.645436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-57817995-841c-49d5-b72c-f92f3e1262f1 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:32.653067 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-57817995-841c-49d5-b72c-f92f3e1262f1 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.814670 Jul 20 04:31:32.653655 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2256/4592] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:31 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:32.662714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-25c6a0b1-80d1-4e30-ae31-a0c1133e8c4b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:32.662714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-25c6a0b1-80d1-4e30-ae31-a0c1133e8c4b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:32.665582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25c6a0b1-80d1-4e30-ae31-a0c1133e8c4b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.666039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25c6a0b1-80d1-4e30-ae31-a0c1133e8c4b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.666818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25c6a0b1-80d1-4e30-ae31-a0c1133e8c4b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.667264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25c6a0b1-80d1-4e30-ae31-a0c1133e8c4b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.793944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-25c6a0b1-80d1-4e30-ae31-a0c1133e8c4b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:32.799038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dc08f8df-d839-4e87-bd8d-974ba39f3f71 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:32.804754 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-25c6a0b1-80d1-4e30-ae31-a0c1133e8c4b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1267 microversion: 2.1 time: 0.149665 Jul 20 04:31:32.806976 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2257/4593] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:32 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:32.812243 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dc08f8df-d839-4e87-bd8d-974ba39f3f71 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1317 microversion: 2.1 time: 0.411474 Jul 20 04:31:32.829624 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2337/4594] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:32 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:32.968089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-154272928", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": "none"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:33.029924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:33.031266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:33.031968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:33.032577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:33.033188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:33.044939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.045602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.046644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.047321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.072077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Getting quotas for project ee1c2f49111c495c99caf9057f1a5eba. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:33.078247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Getting quotas for user e305572ed4a94f0f822be3f4f91fbd8e and project ee1c2f49111c495c99caf9057f1a5eba. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:33.094742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:33.097240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 8c07edb7-18cd-4424-8dfd-8b860c3d3929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:33.165785 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ac8226db-b1ad-4513-89ed-80d0ceb7032b tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.357248 Jul 20 04:31:33.168017 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2258/4595] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:31:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 360 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:31:33.181871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15aedc90-81ff-453a-857a-b965d077616d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:33.182752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-15aedc90-81ff-453a-857a-b965d077616d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 8c07edb7-18cd-4424-8dfd-8b860c3d3929] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:33.319501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-15aedc90-81ff-453a-857a-b965d077616d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:33.327650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-15aedc90-81ff-453a-857a-b965d077616d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:33.329178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-15aedc90-81ff-453a-857a-b965d077616d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:33.330342 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-15aedc90-81ff-453a-857a-b965d077616d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929" status: 200 len: 1277 microversion: 2.47 time: 0.156881 Jul 20 04:31:33.332552 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2338/4596] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:33 2022] GET /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:33.408872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-10695065", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": "none"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:33.469059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:33.469913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:33.470402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:33.470820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:33.471238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:33.485195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.485898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.486954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.492865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.524087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Getting quotas for project ee1c2f49111c495c99caf9057f1a5eba. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:33.531800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Getting quotas for user e305572ed4a94f0f822be3f4f91fbd8e and project ee1c2f49111c495c99caf9057f1a5eba. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:33.551893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:33.555234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:33.635183 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-781befe3-205d-4eba-9fcb-192890ed1452 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.231286 Jul 20 04:31:33.636483 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2259/4597] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:31:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:31:33.648536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-964487ca-14fc-4eda-a53a-0721c86ed847 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:33.650425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-964487ca-14fc-4eda-a53a-0721c86ed847 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:33.673390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ec19a63-eb22-44c2-ab67-cca9464b0f23 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:33.683070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ec19a63-eb22-44c2-ab67-cca9464b0f23 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:33.696685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ec19a63-eb22-44c2-ab67-cca9464b0f23 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.698017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ec19a63-eb22-44c2-ab67-cca9464b0f23 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.699628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ec19a63-eb22-44c2-ab67-cca9464b0f23 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.701043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ec19a63-eb22-44c2-ab67-cca9464b0f23 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.733313 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-964487ca-14fc-4eda-a53a-0721c86ed847 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "PUT /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 990 microversion: 2.47 time: 0.090101 Jul 20 04:31:33.734567 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2339/4598] 10.222.0.20 () {62 vars in 1296 bytes} [Wed Jul 20 04:31:33 2022] PUT /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 990 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:31:33.761217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b633321f-5dc2-4aa8-a005-755d0275c50a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:33.761718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b633321f-5dc2-4aa8-a005-755d0275c50a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:34.040605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b633321f-5dc2-4aa8-a005-755d0275c50a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.049452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b633321f-5dc2-4aa8-a005-755d0275c50a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.052028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b633321f-5dc2-4aa8-a005-755d0275c50a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.053785 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b633321f-5dc2-4aa8-a005-755d0275c50a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1276 microversion: 2.47 time: 0.304325 Jul 20 04:31:34.055385 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2340/4599] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:33 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1276 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:34.065170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0995d881-5838-482b-9ce9-aebb9008c8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:34.066027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0995d881-5838-482b-9ce9-aebb9008c8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:34.074477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0995d881-5838-482b-9ce9-aebb9008c8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.075123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0995d881-5838-482b-9ce9-aebb9008c8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.076074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0995d881-5838-482b-9ce9-aebb9008c8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.076790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0995d881-5838-482b-9ce9-aebb9008c8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.376465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ec19a63-eb22-44c2-ab67-cca9464b0f23 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.391790 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ec19a63-eb22-44c2-ab67-cca9464b0f23 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.719798 Jul 20 04:31:34.393022 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2260/4600] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:33 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:34.399129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-295927dd-60b2-4af8-882c-a43d3d64766e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:34.400120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-295927dd-60b2-4af8-882c-a43d3d64766e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:34.408189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-295927dd-60b2-4af8-882c-a43d3d64766e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.412101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-295927dd-60b2-4af8-882c-a43d3d64766e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.413373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-295927dd-60b2-4af8-882c-a43d3d64766e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.413991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-295927dd-60b2-4af8-882c-a43d3d64766e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.476908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0995d881-5838-482b-9ce9-aebb9008c8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.492245 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0995d881-5838-482b-9ce9-aebb9008c8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.431427 Jul 20 04:31:34.492928 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2341/4601] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:34 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:34.716393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-295927dd-60b2-4af8-882c-a43d3d64766e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.734395 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-295927dd-60b2-4af8-882c-a43d3d64766e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1317 microversion: 2.1 time: 0.339877 Jul 20 04:31:34.745931 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2261/4602] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:34 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:35.076706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b7865a7b-0455-4874-900d-b981c9c598a2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:35.078162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b7865a7b-0455-4874-900d-b981c9c598a2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:35.089500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7865a7b-0455-4874-900d-b981c9c598a2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.090344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7865a7b-0455-4874-900d-b981c9c598a2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.091373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7865a7b-0455-4874-900d-b981c9c598a2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.092315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7865a7b-0455-4874-900d-b981c9c598a2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.197362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b7865a7b-0455-4874-900d-b981c9c598a2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:35.216030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b7865a7b-0455-4874-900d-b981c9c598a2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:35.221383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b7865a7b-0455-4874-900d-b981c9c598a2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:35.225005 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b7865a7b-0455-4874-900d-b981c9c598a2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1328 microversion: 2.47 time: 0.154180 Jul 20 04:31:35.226229 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2342/4603] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:35 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1328 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:35.409573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-977176f0-07d7-4e99-9f2b-df3c05d3c597 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:35.410200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-977176f0-07d7-4e99-9f2b-df3c05d3c597 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:35.422213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-977176f0-07d7-4e99-9f2b-df3c05d3c597 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.427234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-977176f0-07d7-4e99-9f2b-df3c05d3c597 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.428313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-977176f0-07d7-4e99-9f2b-df3c05d3c597 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.429201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-977176f0-07d7-4e99-9f2b-df3c05d3c597 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.511750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-399e0ac3-5389-460e-bbe8-cb76fbf32961 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:35.512896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-399e0ac3-5389-460e-bbe8-cb76fbf32961 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:35.520487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-399e0ac3-5389-460e-bbe8-cb76fbf32961 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.521317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-399e0ac3-5389-460e-bbe8-cb76fbf32961 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.522322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-399e0ac3-5389-460e-bbe8-cb76fbf32961 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.523131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-399e0ac3-5389-460e-bbe8-cb76fbf32961 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.914895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-977176f0-07d7-4e99-9f2b-df3c05d3c597 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:35.928462 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-977176f0-07d7-4e99-9f2b-df3c05d3c597 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.523251 Jul 20 04:31:35.932544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-399e0ac3-5389-460e-bbe8-cb76fbf32961 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:35.944464 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-399e0ac3-5389-460e-bbe8-cb76fbf32961 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.436128 Jul 20 04:31:35.945681 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2343/4604] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:35 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:35.958702 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2262/4605] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:35 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:35.968053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3f2ce0c7-62c6-4473-bacc-a28f8faac64b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:35.969005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3f2ce0c7-62c6-4473-bacc-a28f8faac64b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:35.969429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-98a7ae98-9c8e-49e1-a5e2-cbc937421904 req-4b0db5ae-0817-44e4-84f9-bb76d0ebdf36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4805c1-47be-4944-b197-e890bf0e274e", "tag": "3d384aef-2b54-48db-b94b-28e5cde2b682"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:35.990174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f2ce0c7-62c6-4473-bacc-a28f8faac64b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.990630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f2ce0c7-62c6-4473-bacc-a28f8faac64b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.991282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-98a7ae98-9c8e-49e1-a5e2-cbc937421904 req-4b0db5ae-0817-44e4-84f9-bb76d0ebdf36 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.991755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-98a7ae98-9c8e-49e1-a5e2-cbc937421904 req-4b0db5ae-0817-44e4-84f9-bb76d0ebdf36 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.992012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f2ce0c7-62c6-4473-bacc-a28f8faac64b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.992630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f2ce0c7-62c6-4473-bacc-a28f8faac64b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.014588 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-98a7ae98-9c8e-49e1-a5e2-cbc937421904 req-4b0db5ae-0817-44e4-84f9-bb76d0ebdf36 service nova] Creating event network-changed:3d384aef-2b54-48db-b94b-28e5cde2b682 for instance cb4805c1-47be-4944-b197-e890bf0e274e on n-h2-764485-11 Jul 20 04:31:36.022441 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-98a7ae98-9c8e-49e1-a5e2-cbc937421904 req-4b0db5ae-0817-44e4-84f9-bb76d0ebdf36 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062397 Jul 20 04:31:36.024029 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2263/4606] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:36.246278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1d87c601-9880-4daa-b43d-c7fdc1752859 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:36.248038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1d87c601-9880-4daa-b43d-c7fdc1752859 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:36.264244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d87c601-9880-4daa-b43d-c7fdc1752859 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.265122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d87c601-9880-4daa-b43d-c7fdc1752859 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.266299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d87c601-9880-4daa-b43d-c7fdc1752859 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.266910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d87c601-9880-4daa-b43d-c7fdc1752859 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.324188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3f2ce0c7-62c6-4473-bacc-a28f8faac64b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:36.339942 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3f2ce0c7-62c6-4473-bacc-a28f8faac64b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1317 microversion: 2.1 time: 0.389042 Jul 20 04:31:36.341560 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2344/4607] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:35 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:36.374055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1d87c601-9880-4daa-b43d-c7fdc1752859 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:36.391602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1d87c601-9880-4daa-b43d-c7fdc1752859 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:36.395164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1d87c601-9880-4daa-b43d-c7fdc1752859 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:36.396994 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1d87c601-9880-4daa-b43d-c7fdc1752859 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1336 microversion: 2.47 time: 0.155794 Jul 20 04:31:36.398816 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2264/4608] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:36 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1336 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:36.945644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f600d6eb-c523-4291-85e3-f27506ba5566 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:36.946267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f600d6eb-c523-4291-85e3-f27506ba5566 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:36.952842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f600d6eb-c523-4291-85e3-f27506ba5566 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.953299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f600d6eb-c523-4291-85e3-f27506ba5566 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.954083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f600d6eb-c523-4291-85e3-f27506ba5566 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.954532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f600d6eb-c523-4291-85e3-f27506ba5566 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.965141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6c8b6119-8c10-4d1b-950e-b8036ba38151 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:36.965871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6c8b6119-8c10-4d1b-950e-b8036ba38151 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:36.979871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c8b6119-8c10-4d1b-950e-b8036ba38151 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.981833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c8b6119-8c10-4d1b-950e-b8036ba38151 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.983200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c8b6119-8c10-4d1b-950e-b8036ba38151 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.983803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c8b6119-8c10-4d1b-950e-b8036ba38151 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.308917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f600d6eb-c523-4291-85e3-f27506ba5566 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:37.314565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6c8b6119-8c10-4d1b-950e-b8036ba38151 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:37.321032 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f600d6eb-c523-4291-85e3-f27506ba5566 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.379171 Jul 20 04:31:37.324152 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6c8b6119-8c10-4d1b-950e-b8036ba38151 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.365117 Jul 20 04:31:37.324504 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2345/4609] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:36 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:37.339965 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2265/4610] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:36 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:37.358664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d971515c-09ee-4100-a92f-f6921567f88c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:37.359272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d971515c-09ee-4100-a92f-f6921567f88c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:37.374491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d971515c-09ee-4100-a92f-f6921567f88c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.375650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d971515c-09ee-4100-a92f-f6921567f88c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.376605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d971515c-09ee-4100-a92f-f6921567f88c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.377326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d971515c-09ee-4100-a92f-f6921567f88c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.417210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c354bfd9-e19c-44fd-81be-cbc69faa4d8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:37.417741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c354bfd9-e19c-44fd-81be-cbc69faa4d8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:37.436799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c354bfd9-e19c-44fd-81be-cbc69faa4d8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.437255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c354bfd9-e19c-44fd-81be-cbc69faa4d8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.438148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c354bfd9-e19c-44fd-81be-cbc69faa4d8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.438595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c354bfd9-e19c-44fd-81be-cbc69faa4d8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.999256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c354bfd9-e19c-44fd-81be-cbc69faa4d8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:38.014690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c354bfd9-e19c-44fd-81be-cbc69faa4d8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:38.022097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c354bfd9-e19c-44fd-81be-cbc69faa4d8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:38.025353 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c354bfd9-e19c-44fd-81be-cbc69faa4d8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1346 microversion: 2.47 time: 0.612403 Jul 20 04:31:38.030481 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2266/4611] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:37 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1346 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:38.079310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d971515c-09ee-4100-a92f-f6921567f88c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:38.087313 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d971515c-09ee-4100-a92f-f6921567f88c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1317 microversion: 2.1 time: 0.734108 Jul 20 04:31:38.088212 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2346/4612] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:37 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1317 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:38.341068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-72b9e21e-911f-4ea1-8295-89412f35a49a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:38.341782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-806592a2-9436-4a05-9a82-d11a2e63ff7e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:38.341893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-72b9e21e-911f-4ea1-8295-89412f35a49a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:38.342016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-806592a2-9436-4a05-9a82-d11a2e63ff7e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:38.351275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72b9e21e-911f-4ea1-8295-89412f35a49a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:38.351765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72b9e21e-911f-4ea1-8295-89412f35a49a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:38.352554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72b9e21e-911f-4ea1-8295-89412f35a49a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:38.353005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72b9e21e-911f-4ea1-8295-89412f35a49a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:38.353905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-806592a2-9436-4a05-9a82-d11a2e63ff7e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:38.354626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-806592a2-9436-4a05-9a82-d11a2e63ff7e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:38.355701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-806592a2-9436-4a05-9a82-d11a2e63ff7e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:38.356373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-806592a2-9436-4a05-9a82-d11a2e63ff7e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:38.572812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-806592a2-9436-4a05-9a82-d11a2e63ff7e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:38.583631 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-806592a2-9436-4a05-9a82-d11a2e63ff7e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.246400 Jul 20 04:31:38.585505 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2267/4613] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:38 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:38.605625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-72b9e21e-911f-4ea1-8295-89412f35a49a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:38.614097 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-72b9e21e-911f-4ea1-8295-89412f35a49a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.276702 Jul 20 04:31:38.615102 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2347/4614] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:38 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:38.773751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-47fb8a9d-2fe1-4669-915f-6656b6890f78 req-0380d242-bd54-47cf-886d-ed4843dda4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2b9533-c850-4e02-afc0-68243a289fac", "name": "network-vif-plugged", "status": "completed", "tag": "3fc3002c-7430-471f-9dac-2c1a83f4270f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:38.783398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-47fb8a9d-2fe1-4669-915f-6656b6890f78 req-0380d242-bd54-47cf-886d-ed4843dda4f5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:38.784688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-47fb8a9d-2fe1-4669-915f-6656b6890f78 req-0380d242-bd54-47cf-886d-ed4843dda4f5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:38.799768 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-47fb8a9d-2fe1-4669-915f-6656b6890f78 req-0380d242-bd54-47cf-886d-ed4843dda4f5 service nova] Creating event network-vif-plugged:3fc3002c-7430-471f-9dac-2c1a83f4270f for instance de2b9533-c850-4e02-afc0-68243a289fac on n-h1-764485-11 Jul 20 04:31:38.806356 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-47fb8a9d-2fe1-4669-915f-6656b6890f78 req-0380d242-bd54-47cf-886d-ed4843dda4f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037935 Jul 20 04:31:38.807706 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2268/4615] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:31:39.048956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b8ec9c2a-5f2b-43d5-9c55-4df1776c260a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:39.049740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b8ec9c2a-5f2b-43d5-9c55-4df1776c260a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:39.078716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8ec9c2a-5f2b-43d5-9c55-4df1776c260a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.079172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8ec9c2a-5f2b-43d5-9c55-4df1776c260a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.080168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8ec9c2a-5f2b-43d5-9c55-4df1776c260a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.080611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b8ec9c2a-5f2b-43d5-9c55-4df1776c260a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.106351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f0de0eb2-f5fe-4930-995e-b791127149b3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:39.107838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f0de0eb2-f5fe-4930-995e-b791127149b3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:39.110873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:39.123565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0de0eb2-f5fe-4930-995e-b791127149b3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.124332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0de0eb2-f5fe-4930-995e-b791127149b3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.125321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0de0eb2-f5fe-4930-995e-b791127149b3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.125918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0de0eb2-f5fe-4930-995e-b791127149b3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.209319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b8ec9c2a-5f2b-43d5-9c55-4df1776c260a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:39.225075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b8ec9c2a-5f2b-43d5-9c55-4df1776c260a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:39.227580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b8ec9c2a-5f2b-43d5-9c55-4df1776c260a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:39.235602 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b8ec9c2a-5f2b-43d5-9c55-4df1776c260a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1334 microversion: 2.47 time: 0.191011 Jul 20 04:31:39.237487 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2348/4616] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:39 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1334 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:39.339991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f0de0eb2-f5fe-4930-995e-b791127149b3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:39.348900 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f0de0eb2-f5fe-4930-995e-b791127149b3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1317 microversion: 2.1 time: 0.247362 Jul 20 04:31:39.349826 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2269/4617] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:39 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:39.601286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-85806e21-2d2d-4f21-99c1-eead4d11be88 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:39.601901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-85806e21-2d2d-4f21-99c1-eead4d11be88 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:39.605784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:39.609682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85806e21-2d2d-4f21-99c1-eead4d11be88 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.610136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85806e21-2d2d-4f21-99c1-eead4d11be88 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.610916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85806e21-2d2d-4f21-99c1-eead4d11be88 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.611350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-85806e21-2d2d-4f21-99c1-eead4d11be88 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.633438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f93b1b2d-3761-472b-921d-5517874d8598 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:39.634670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f93b1b2d-3761-472b-921d-5517874d8598 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:39.641227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f93b1b2d-3761-472b-921d-5517874d8598 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.641991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f93b1b2d-3761-472b-921d-5517874d8598 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.642976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f93b1b2d-3761-472b-921d-5517874d8598 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.643803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f93b1b2d-3761-472b-921d-5517874d8598 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.898171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-85806e21-2d2d-4f21-99c1-eead4d11be88 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:39.900634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f93b1b2d-3761-472b-921d-5517874d8598 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:39.900956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:39.910976 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f93b1b2d-3761-472b-921d-5517874d8598 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.281354 Jul 20 04:31:39.911893 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-85806e21-2d2d-4f21-99c1-eead4d11be88 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.315303 Jul 20 04:31:39.921293 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2349/4618] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:39 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:39.921808 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2270/4619] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:39 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:40.256530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-06db797b-3795-4026-9532-cbdc6631c156 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:40.257165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-06db797b-3795-4026-9532-cbdc6631c156 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:40.265108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06db797b-3795-4026-9532-cbdc6631c156 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.265869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06db797b-3795-4026-9532-cbdc6631c156 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.266656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06db797b-3795-4026-9532-cbdc6631c156 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.267102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-06db797b-3795-4026-9532-cbdc6631c156 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.345605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-06db797b-3795-4026-9532-cbdc6631c156 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:40.354895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-06db797b-3795-4026-9532-cbdc6631c156 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:40.356449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-06db797b-3795-4026-9532-cbdc6631c156 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:40.357951 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-06db797b-3795-4026-9532-cbdc6631c156 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1334 microversion: 2.47 time: 0.106137 Jul 20 04:31:40.374397 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2350/4620] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:40 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1334 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:40.376789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-51812861-7cdf-4ad2-8d74-65e5917610de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:40.377425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-51812861-7cdf-4ad2-8d74-65e5917610de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:40.385536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51812861-7cdf-4ad2-8d74-65e5917610de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.385996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51812861-7cdf-4ad2-8d74-65e5917610de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.386792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51812861-7cdf-4ad2-8d74-65e5917610de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.387238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51812861-7cdf-4ad2-8d74-65e5917610de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.529459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-51812861-7cdf-4ad2-8d74-65e5917610de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:40.538053 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-51812861-7cdf-4ad2-8d74-65e5917610de tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1317 microversion: 2.1 time: 0.165503 Jul 20 04:31:40.547610 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2271/4621] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:40 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:40.931493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8856a499-92de-451a-8764-a0ff3b3ba88d tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:40.932229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8856a499-92de-451a-8764-a0ff3b3ba88d tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:40.935755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-03e72dfa-560b-4ecd-b8c6-16bb8451dfb1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:40.936397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-03e72dfa-560b-4ecd-b8c6-16bb8451dfb1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:40.941514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8856a499-92de-451a-8764-a0ff3b3ba88d tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.942215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8856a499-92de-451a-8764-a0ff3b3ba88d tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.943169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8856a499-92de-451a-8764-a0ff3b3ba88d tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.943981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8856a499-92de-451a-8764-a0ff3b3ba88d tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.945711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03e72dfa-560b-4ecd-b8c6-16bb8451dfb1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.946288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03e72dfa-560b-4ecd-b8c6-16bb8451dfb1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.947244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03e72dfa-560b-4ecd-b8c6-16bb8451dfb1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.947884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03e72dfa-560b-4ecd-b8c6-16bb8451dfb1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.967959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:41.356341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8856a499-92de-451a-8764-a0ff3b3ba88d tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:41.365405 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8856a499-92de-451a-8764-a0ff3b3ba88d tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.438426 Jul 20 04:31:41.366455 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2272/4622] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:40 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:41.380885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4780cf3e-fe79-43fb-b2a5-e12b6136f92f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:41.382833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4780cf3e-fe79-43fb-b2a5-e12b6136f92f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:41.387906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-03e72dfa-560b-4ecd-b8c6-16bb8451dfb1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:41.392543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4780cf3e-fe79-43fb-b2a5-e12b6136f92f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.393805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4780cf3e-fe79-43fb-b2a5-e12b6136f92f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.394946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4780cf3e-fe79-43fb-b2a5-e12b6136f92f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.395392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4780cf3e-fe79-43fb-b2a5-e12b6136f92f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.406769 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-03e72dfa-560b-4ecd-b8c6-16bb8451dfb1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.482153 Jul 20 04:31:41.408716 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2351/4623] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:40 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:41.517173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4780cf3e-fe79-43fb-b2a5-e12b6136f92f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:41.527635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4780cf3e-fe79-43fb-b2a5-e12b6136f92f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:41.529267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4780cf3e-fe79-43fb-b2a5-e12b6136f92f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:41.530512 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4780cf3e-fe79-43fb-b2a5-e12b6136f92f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1334 microversion: 2.47 time: 0.155095 Jul 20 04:31:41.531194 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2273/4624] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:41 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1334 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:41.554466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-73d2fcc4-df10-4994-8e73-98bef07efe2d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:41.555090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-73d2fcc4-df10-4994-8e73-98bef07efe2d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:41.561962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-73d2fcc4-df10-4994-8e73-98bef07efe2d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.562630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-73d2fcc4-df10-4994-8e73-98bef07efe2d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.563637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-73d2fcc4-df10-4994-8e73-98bef07efe2d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.564247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-73d2fcc4-df10-4994-8e73-98bef07efe2d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.711340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-73d2fcc4-df10-4994-8e73-98bef07efe2d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:41.725546 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-73d2fcc4-df10-4994-8e73-98bef07efe2d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1507 microversion: 2.1 time: 0.174573 Jul 20 04:31:41.727482 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2352/4625] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:41 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:41.741842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-28d3605f-8d60-4645-8a2c-c012b6c16596 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:41.742352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-28d3605f-8d60-4645-8a2c-c012b6c16596 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:41.748555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28d3605f-8d60-4645-8a2c-c012b6c16596 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.749007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28d3605f-8d60-4645-8a2c-c012b6c16596 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.749983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28d3605f-8d60-4645-8a2c-c012b6c16596 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.750432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28d3605f-8d60-4645-8a2c-c012b6c16596 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.778617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-28d3605f-8d60-4645-8a2c-c012b6c16596 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:41.871704 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-28d3605f-8d60-4645-8a2c-c012b6c16596 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 204 len: 0 microversion: 2.1 time: 0.133355 Jul 20 04:31:41.881929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f70267e2-731a-4010-9656-e644f4d8b5f4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:41.882829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f70267e2-731a-4010-9656-e644f4d8b5f4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:41.886035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:41.886267 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2274/4626] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:41 2022] DELETE /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:31:41.890114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f70267e2-731a-4010-9656-e644f4d8b5f4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.890616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f70267e2-731a-4010-9656-e644f4d8b5f4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.891441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f70267e2-731a-4010-9656-e644f4d8b5f4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.891916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f70267e2-731a-4010-9656-e644f4d8b5f4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.036088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f70267e2-731a-4010-9656-e644f4d8b5f4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:42.044488 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f70267e2-731a-4010-9656-e644f4d8b5f4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1513 microversion: 2.1 time: 0.167069 Jul 20 04:31:42.045062 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2353/4627] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:41 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:42.383547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b4479fcd-a10d-4e40-9422-3e8c54edd4cf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:42.384264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b4479fcd-a10d-4e40-9422-3e8c54edd4cf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:42.391051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4479fcd-a10d-4e40-9422-3e8c54edd4cf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.391870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4479fcd-a10d-4e40-9422-3e8c54edd4cf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.392849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4479fcd-a10d-4e40-9422-3e8c54edd4cf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.393706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4479fcd-a10d-4e40-9422-3e8c54edd4cf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.426113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2f86aaff-5b64-42c8-a660-55912b6c2231 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:42.426769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2f86aaff-5b64-42c8-a660-55912b6c2231 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:42.433338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f86aaff-5b64-42c8-a660-55912b6c2231 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.433795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f86aaff-5b64-42c8-a660-55912b6c2231 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.434569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f86aaff-5b64-42c8-a660-55912b6c2231 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.435013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f86aaff-5b64-42c8-a660-55912b6c2231 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.629355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b4479fcd-a10d-4e40-9422-3e8c54edd4cf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:42.637340 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b4479fcd-a10d-4e40-9422-3e8c54edd4cf tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.257967 Jul 20 04:31:42.637934 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2275/4628] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:42 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:42.638382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f86aaff-5b64-42c8-a660-55912b6c2231 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:42.644323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bd7060f0-a2a7-41e1-a660-76f8808d10af tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:42.645097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bd7060f0-a2a7-41e1-a660-76f8808d10af tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:42.647958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2f86aaff-5b64-42c8-a660-55912b6c2231 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.226855 Jul 20 04:31:42.648850 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2354/4629] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:42 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:42.653544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd7060f0-a2a7-41e1-a660-76f8808d10af tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.654081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd7060f0-a2a7-41e1-a660-76f8808d10af tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.654886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd7060f0-a2a7-41e1-a660-76f8808d10af tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.655328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd7060f0-a2a7-41e1-a660-76f8808d10af tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.728942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bd7060f0-a2a7-41e1-a660-76f8808d10af tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:42.738497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bd7060f0-a2a7-41e1-a660-76f8808d10af tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:42.740069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bd7060f0-a2a7-41e1-a660-76f8808d10af tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:42.741224 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bd7060f0-a2a7-41e1-a660-76f8808d10af tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1334 microversion: 2.47 time: 0.102376 Jul 20 04:31:42.742343 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2276/4630] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:42 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:43.065401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-832924c1-cdff-4550-91cb-16b76be61704 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:43.067683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-832924c1-cdff-4550-91cb-16b76be61704 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:43.075621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-832924c1-cdff-4550-91cb-16b76be61704 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.076776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-832924c1-cdff-4550-91cb-16b76be61704 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.078071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-832924c1-cdff-4550-91cb-16b76be61704 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.078915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-832924c1-cdff-4550-91cb-16b76be61704 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.437360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-832924c1-cdff-4550-91cb-16b76be61704 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:43.456655 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-832924c1-cdff-4550-91cb-16b76be61704 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1513 microversion: 2.1 time: 0.397354 Jul 20 04:31:43.459633 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2355/4631] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:43 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1513 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:43.654461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f08ccd2-55f7-4145-a0ad-9b401f05755a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:43.655741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2f08ccd2-55f7-4145-a0ad-9b401f05755a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:43.664874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9027a66-1a16-4ad9-97ac-1e40166d731d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:43.665498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a9027a66-1a16-4ad9-97ac-1e40166d731d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:43.668446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:43.669423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=18 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:43.672925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9027a66-1a16-4ad9-97ac-1e40166d731d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.676011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9027a66-1a16-4ad9-97ac-1e40166d731d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.677173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9027a66-1a16-4ad9-97ac-1e40166d731d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.677910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9027a66-1a16-4ad9-97ac-1e40166d731d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.679884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f08ccd2-55f7-4145-a0ad-9b401f05755a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.680552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f08ccd2-55f7-4145-a0ad-9b401f05755a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.681538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f08ccd2-55f7-4145-a0ad-9b401f05755a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.682311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f08ccd2-55f7-4145-a0ad-9b401f05755a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.000404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9027a66-1a16-4ad9-97ac-1e40166d731d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.012293 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a9027a66-1a16-4ad9-97ac-1e40166d731d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.350686 Jul 20 04:31:44.022125 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2356/4632] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:43 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:44.022125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-665fd135-c12a-4c9b-8a0c-c093f285ee26 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:44.022125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-665fd135-c12a-4c9b-8a0c-c093f285ee26 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:44.026872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-665fd135-c12a-4c9b-8a0c-c093f285ee26 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.027330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-665fd135-c12a-4c9b-8a0c-c093f285ee26 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.028145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-665fd135-c12a-4c9b-8a0c-c093f285ee26 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.028589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-665fd135-c12a-4c9b-8a0c-c093f285ee26 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.046372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=14 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:44.151026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-665fd135-c12a-4c9b-8a0c-c093f285ee26 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.161038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-665fd135-c12a-4c9b-8a0c-c093f285ee26 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.162672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-665fd135-c12a-4c9b-8a0c-c093f285ee26 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.164005 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-665fd135-c12a-4c9b-8a0c-c093f285ee26 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1355 microversion: 2.47 time: 0.149538 Jul 20 04:31:44.165788 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2357/4633] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:44 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1355 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:44.188536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:44.191407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:44.197567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.198023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.198799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.199236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.296168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2f08ccd2-55f7-4145-a0ad-9b401f05755a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.311169 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2f08ccd2-55f7-4145-a0ad-9b401f05755a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.660475 Jul 20 04:31:44.312449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:44.312981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:44.313576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:44.314287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:44.315871 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2277/4634] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:43 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:44.316728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:44.412977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:44.423737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.425093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.426924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.427378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.481518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bb2b9f36-af9c-4b70-877b-c5f17be83925 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:44.482141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bb2b9f36-af9c-4b70-877b-c5f17be83925 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:44.488466 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2fdd4ab9-41d5-4d21-ac48-da3514a3c720 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "POST /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db/action" status: 202 len: 1077 microversion: 2.47 time: 0.309234 Jul 20 04:31:44.490999 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2358/4635] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:31:44 2022] POST /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db/action => generated 1077 bytes in 313 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 20 04:31:44.513921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1a456192-0e59-4f90-a061-b6b637de9918 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:44.516822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb2b9f36-af9c-4b70-877b-c5f17be83925 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.529195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb2b9f36-af9c-4b70-877b-c5f17be83925 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.530387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb2b9f36-af9c-4b70-877b-c5f17be83925 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.536225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1a456192-0e59-4f90-a061-b6b637de9918 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:44.536897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb2b9f36-af9c-4b70-877b-c5f17be83925 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.555456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a456192-0e59-4f90-a061-b6b637de9918 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.557922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a456192-0e59-4f90-a061-b6b637de9918 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.558957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a456192-0e59-4f90-a061-b6b637de9918 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.563088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a456192-0e59-4f90-a061-b6b637de9918 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.719002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bb2b9f36-af9c-4b70-877b-c5f17be83925 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.735051 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bb2b9f36-af9c-4b70-877b-c5f17be83925 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 200 len: 1471 microversion: 2.1 time: 0.262104 Jul 20 04:31:44.744846 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2278/4636] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:44 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 1471 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:44.751534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1a456192-0e59-4f90-a061-b6b637de9918 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.766320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1a456192-0e59-4f90-a061-b6b637de9918 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.774440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1a456192-0e59-4f90-a061-b6b637de9918 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.775957 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1a456192-0e59-4f90-a061-b6b637de9918 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.271624 Jul 20 04:31:44.777164 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2359/4637] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:44 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:44.806347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-58ecdef3-b6bd-4ac4-9d8d-ce85a77aecdb req-eccfd474-71c4-44b7-9851-e7b84bc661cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2b9533-c850-4e02-afc0-68243a289fac", "name": "network-vif-deleted", "tag": "3fc3002c-7430-471f-9dac-2c1a83f4270f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:44.822279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-58ecdef3-b6bd-4ac4-9d8d-ce85a77aecdb req-eccfd474-71c4-44b7-9851-e7b84bc661cb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.822801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-58ecdef3-b6bd-4ac4-9d8d-ce85a77aecdb req-eccfd474-71c4-44b7-9851-e7b84bc661cb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.846740 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-58ecdef3-b6bd-4ac4-9d8d-ce85a77aecdb req-eccfd474-71c4-44b7-9851-e7b84bc661cb service nova] Creating event network-vif-deleted:3fc3002c-7430-471f-9dac-2c1a83f4270f for instance de2b9533-c850-4e02-afc0-68243a289fac on n-h1-764485-11 Jul 20 04:31:44.855772 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-58ecdef3-b6bd-4ac4-9d8d-ce85a77aecdb req-eccfd474-71c4-44b7-9851-e7b84bc661cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053247 Jul 20 04:31:44.862202 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2279/4638] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:45.029895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d68b29bd-22bd-4f56-8bee-f0c67b5f7500 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:45.030661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d68b29bd-22bd-4f56-8bee-f0c67b5f7500 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:45.037969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d68b29bd-22bd-4f56-8bee-f0c67b5f7500 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.038866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d68b29bd-22bd-4f56-8bee-f0c67b5f7500 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.039740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d68b29bd-22bd-4f56-8bee-f0c67b5f7500 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.040408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d68b29bd-22bd-4f56-8bee-f0c67b5f7500 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.212429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d68b29bd-22bd-4f56-8bee-f0c67b5f7500 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:45.223982 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d68b29bd-22bd-4f56-8bee-f0c67b5f7500 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.197928 Jul 20 04:31:45.224969 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2360/4639] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:45 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:45.339945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f0d00f19-45b5-423f-86a9-7d84bd99fb31 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:45.342272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f0d00f19-45b5-423f-86a9-7d84bd99fb31 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:45.356076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0d00f19-45b5-423f-86a9-7d84bd99fb31 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.356836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0d00f19-45b5-423f-86a9-7d84bd99fb31 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.359025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0d00f19-45b5-423f-86a9-7d84bd99fb31 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.360002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0d00f19-45b5-423f-86a9-7d84bd99fb31 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.605292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f0d00f19-45b5-423f-86a9-7d84bd99fb31 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:45.613489 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f0d00f19-45b5-423f-86a9-7d84bd99fb31 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.287251 Jul 20 04:31:45.614071 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2280/4640] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:45 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:45.752926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e08abee8-c6c5-43e5-8b1a-da557a03f376 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:45.753874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e08abee8-c6c5-43e5-8b1a-da557a03f376 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:45.760807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e08abee8-c6c5-43e5-8b1a-da557a03f376 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.761270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e08abee8-c6c5-43e5-8b1a-da557a03f376 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.762048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e08abee8-c6c5-43e5-8b1a-da557a03f376 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.762490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e08abee8-c6c5-43e5-8b1a-da557a03f376 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.777208 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-e08abee8-c6c5-43e5-8b1a-da557a03f376 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e08abee8-c6c5-43e5-8b1a-da557a03f376 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac HTTP/1.1 Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'de2b9533-c850-4e02-afc0-68243a289fac'} Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:45.778873 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:45.783546 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:45.783546 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:45.783546 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:45.783546 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:45.783546 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:45.783546 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:31:45.783546 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:45.783546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e08abee8-c6c5-43e5-8b1a-da557a03f376 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:45.783546 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e08abee8-c6c5-43e5-8b1a-da557a03f376 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 404 len: 111 microversion: 2.1 time: 0.031966 Jul 20 04:31:45.783546 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2361/4641] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:45 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:45.789782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f355506c-342f-48e4-9f59-7e7c8cab4bc8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:45.790592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f355506c-342f-48e4-9f59-7e7c8cab4bc8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:45.797747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f355506c-342f-48e4-9f59-7e7c8cab4bc8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.798672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f355506c-342f-48e4-9f59-7e7c8cab4bc8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.799768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8f71d406-3d56-4854-b6a4-2547836f5f2f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:45.800173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f355506c-342f-48e4-9f59-7e7c8cab4bc8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.800393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8f71d406-3d56-4854-b6a4-2547836f5f2f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:45.801036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f355506c-342f-48e4-9f59-7e7c8cab4bc8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.807865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f71d406-3d56-4854-b6a4-2547836f5f2f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.808499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f71d406-3d56-4854-b6a4-2547836f5f2f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.809223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f71d406-3d56-4854-b6a4-2547836f5f2f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.809687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f71d406-3d56-4854-b6a4-2547836f5f2f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.927719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8f71d406-3d56-4854-b6a4-2547836f5f2f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:45.937065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8f71d406-3d56-4854-b6a4-2547836f5f2f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:45.938819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8f71d406-3d56-4854-b6a4-2547836f5f2f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:45.940872 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8f71d406-3d56-4854-b6a4-2547836f5f2f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.145172 Jul 20 04:31:45.941669 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2362/4642] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:45 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:46.059975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f355506c-342f-48e4-9f59-7e7c8cab4bc8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:46.069168 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f355506c-342f-48e4-9f59-7e7c8cab4bc8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.283362 Jul 20 04:31:46.069757 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2281/4643] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:45 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:46.186198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5aba4213-516f-4568-a03d-c6038a6ffceb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5aba4213-516f-4568-a03d-c6038a6ffceb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 163 Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": 12345, "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'networks': [{'uuid': '2601f58c-d54c-42c1-850f-a93d0087b3cf'}]}}} Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 12345 Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:46.188680 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5aba4213-516f-4568-a03d-c6038a6ffceb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5aba4213-516f-4568-a03d-c6038a6ffceb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.007811 Jul 20 04:31:46.194000 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2363/4644] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:46 2022] POST /compute/v2.1/servers => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:31:46.199467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4d73a97e-c02a-43c4-b075-b226d54345ab tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:46.200120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4d73a97e-c02a-43c4-b075-b226d54345ab tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:46.206445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d73a97e-c02a-43c4-b075-b226d54345ab tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.206892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d73a97e-c02a-43c4-b075-b226d54345ab tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.207701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d73a97e-c02a-43c4-b075-b226d54345ab tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.208141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d73a97e-c02a-43c4-b075-b226d54345ab tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.243398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c9721398-40e4-48ea-9729-f79790fd125a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:46.244041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c9721398-40e4-48ea-9729-f79790fd125a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:46.251602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9721398-40e4-48ea-9729-f79790fd125a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.252060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9721398-40e4-48ea-9729-f79790fd125a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.253870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9721398-40e4-48ea-9729-f79790fd125a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.254303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c9721398-40e4-48ea-9729-f79790fd125a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.695813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4d73a97e-c02a-43c4-b075-b226d54345ab tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:46.703464 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4d73a97e-c02a-43c4-b075-b226d54345ab tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.507854 Jul 20 04:31:46.704074 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2282/4645] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:46 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:46.709056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33860d22-09d7-457b-bcb8-45774086fb9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:46.710018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-33860d22-09d7-457b-bcb8-45774086fb9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:46.716963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33860d22-09d7-457b-bcb8-45774086fb9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.717437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33860d22-09d7-457b-bcb8-45774086fb9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.718235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33860d22-09d7-457b-bcb8-45774086fb9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.718685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33860d22-09d7-457b-bcb8-45774086fb9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.729788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c9721398-40e4-48ea-9729-f79790fd125a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:46.737515 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c9721398-40e4-48ea-9729-f79790fd125a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.497824 Jul 20 04:31:46.738419 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2364/4646] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:46 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:46.743067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b313b7c-9bb1-4c2a-b564-72230f7e620e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:46.743707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b313b7c-9bb1-4c2a-b564-72230f7e620e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:46.750604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b313b7c-9bb1-4c2a-b564-72230f7e620e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.751060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b313b7c-9bb1-4c2a-b564-72230f7e620e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.752052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b313b7c-9bb1-4c2a-b564-72230f7e620e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.752500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b313b7c-9bb1-4c2a-b564-72230f7e620e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.966904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-33860d22-09d7-457b-bcb8-45774086fb9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:46.974719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0b313b7c-9bb1-4c2a-b564-72230f7e620e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:46.984397 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-33860d22-09d7-457b-bcb8-45774086fb9a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.279274 Jul 20 04:31:46.992106 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b313b7c-9bb1-4c2a-b564-72230f7e620e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.252343 Jul 20 04:31:46.993087 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2283/4647] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:46 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:46.993087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c8db2086-6499-4357-bcba-3ab2dbc77c6c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:46.993087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c8db2086-6499-4357-bcba-3ab2dbc77c6c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:47.012741 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2365/4648] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:46 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:47.016444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8db2086-6499-4357-bcba-3ab2dbc77c6c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.016888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8db2086-6499-4357-bcba-3ab2dbc77c6c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.017812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8db2086-6499-4357-bcba-3ab2dbc77c6c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.019259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8db2086-6499-4357-bcba-3ab2dbc77c6c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.095821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c8db2086-6499-4357-bcba-3ab2dbc77c6c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:47.107817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c8db2086-6499-4357-bcba-3ab2dbc77c6c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:47.109703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c8db2086-6499-4357-bcba-3ab2dbc77c6c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:47.111160 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c8db2086-6499-4357-bcba-3ab2dbc77c6c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.117023 Jul 20 04:31:47.112701 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2284/4649] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:46 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:47.756588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df53255e-3d33-455a-8412-eed4321d251a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:47.757213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df53255e-3d33-455a-8412-eed4321d251a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:47.775462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df53255e-3d33-455a-8412-eed4321d251a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.776320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df53255e-3d33-455a-8412-eed4321d251a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.777388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df53255e-3d33-455a-8412-eed4321d251a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.778455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df53255e-3d33-455a-8412-eed4321d251a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.783447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:48.008749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df53255e-3d33-455a-8412-eed4321d251a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:48.009755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6a7dfa5d-afce-4c72-99e3-6495f2f3dbba tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:48.011888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6a7dfa5d-afce-4c72-99e3-6495f2f3dbba tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:48.018416 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df53255e-3d33-455a-8412-eed4321d251a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.267901 Jul 20 04:31:48.024457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a7dfa5d-afce-4c72-99e3-6495f2f3dbba tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.024910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a7dfa5d-afce-4c72-99e3-6495f2f3dbba tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.025696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a7dfa5d-afce-4c72-99e3-6495f2f3dbba tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.030296 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2366/4650] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:47 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:48.030977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a7dfa5d-afce-4c72-99e3-6495f2f3dbba tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.136553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6596aa98-4f92-49af-90ca-0b1aa586b8b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:48.137566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6596aa98-4f92-49af-90ca-0b1aa586b8b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:48.147293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6596aa98-4f92-49af-90ca-0b1aa586b8b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.148532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6596aa98-4f92-49af-90ca-0b1aa586b8b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.149550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6596aa98-4f92-49af-90ca-0b1aa586b8b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.150353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6596aa98-4f92-49af-90ca-0b1aa586b8b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.270970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6596aa98-4f92-49af-90ca-0b1aa586b8b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:48.281063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6596aa98-4f92-49af-90ca-0b1aa586b8b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:48.283399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6596aa98-4f92-49af-90ca-0b1aa586b8b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:48.285310 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6596aa98-4f92-49af-90ca-0b1aa586b8b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.158307 Jul 20 04:31:48.286466 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2367/4651] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:48 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:48.294665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6a7dfa5d-afce-4c72-99e3-6495f2f3dbba tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:48.306627 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6a7dfa5d-afce-4c72-99e3-6495f2f3dbba tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.300926 Jul 20 04:31:48.308356 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2285/4652] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:48 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:49.036827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a4ae7bc7-209f-434f-9bbe-cf3803904c93 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:49.038081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a4ae7bc7-209f-434f-9bbe-cf3803904c93 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:49.045167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4ae7bc7-209f-434f-9bbe-cf3803904c93 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.051403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4ae7bc7-209f-434f-9bbe-cf3803904c93 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.053034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4ae7bc7-209f-434f-9bbe-cf3803904c93 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.056001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4ae7bc7-209f-434f-9bbe-cf3803904c93 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.227433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a4ae7bc7-209f-434f-9bbe-cf3803904c93 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:49.235354 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a4ae7bc7-209f-434f-9bbe-cf3803904c93 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.204614 Jul 20 04:31:49.235989 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2368/4653] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:49 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:49.305911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-98c84d2d-b9e0-434e-9895-1eb35460415d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:49.306657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-98c84d2d-b9e0-434e-9895-1eb35460415d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:49.314098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98c84d2d-b9e0-434e-9895-1eb35460415d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.314559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98c84d2d-b9e0-434e-9895-1eb35460415d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.316294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98c84d2d-b9e0-434e-9895-1eb35460415d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.316734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98c84d2d-b9e0-434e-9895-1eb35460415d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.328332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a8b137a9-b090-4b9e-a2c0-a0da69055669 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:49.329666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a8b137a9-b090-4b9e-a2c0-a0da69055669 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:49.337633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8b137a9-b090-4b9e-a2c0-a0da69055669 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.338349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8b137a9-b090-4b9e-a2c0-a0da69055669 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.339196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8b137a9-b090-4b9e-a2c0-a0da69055669 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.339677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8b137a9-b090-4b9e-a2c0-a0da69055669 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.396218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-98c84d2d-b9e0-434e-9895-1eb35460415d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:49.405931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-98c84d2d-b9e0-434e-9895-1eb35460415d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:49.407454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-98c84d2d-b9e0-434e-9895-1eb35460415d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:49.414113 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-98c84d2d-b9e0-434e-9895-1eb35460415d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.112136 Jul 20 04:31:49.415141 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2286/4654] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:49 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:49.505756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a8b137a9-b090-4b9e-a2c0-a0da69055669 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:49.519987 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a8b137a9-b090-4b9e-a2c0-a0da69055669 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.197263 Jul 20 04:31:49.565382 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2369/4655] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:49 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:49.669366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-528d72cb-2f91-452f-974d-e7311a19ede0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-157098193", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e24f3b24-217a-43f6-b529-18dbf83666b9", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:49.731138 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-528d72cb-2f91-452f-974d-e7311a19ede0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Block Device e24f3b24-217a-43f6-b529-18dbf83666b9 is not bootable. Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-528d72cb-2f91-452f-974d-e7311a19ede0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 357 Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-157098193", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e24f3b24-217a-43f6-b529-18dbf83666b9", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: exception: Block Device e24f3b24-217a-43f6-b529-18dbf83666b9 is not bootable. Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-157098193', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'e24f3b24-217a-43f6-b529-18dbf83666b9'}], 'networks': [{'uuid': '2601f58c-d54c-42c1-850f-a93d0087b3cf'}]}}} Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device e24f3b24-217a-43f6-b529-18dbf83666b9 is not bootable. Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:49.737474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device e24f3b24-217a-43f6-b529-18dbf83666b9 is not bootable. Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device e24f3b24-217a-43f6-b529-18dbf83666b9 is not bootable. Jul 20 04:31:49.741755 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:49.744228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-528d72cb-2f91-452f-974d-e7311a19ede0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Block Device e24f3b24-217a-43f6-b529-18dbf83666b9 is not bootable. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:49.745773 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-528d72cb-2f91-452f-974d-e7311a19ede0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.080281 Jul 20 04:31:49.750278 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2287/4656] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:49 2022] POST /compute/v2.1/servers => generated 110 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:31:49.757857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-19ec5f89-aab1-434d-8337-84991bfb88fd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:49.758490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-19ec5f89-aab1-434d-8337-84991bfb88fd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:49.764885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ec5f89-aab1-434d-8337-84991bfb88fd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.765348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ec5f89-aab1-434d-8337-84991bfb88fd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.766334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ec5f89-aab1-434d-8337-84991bfb88fd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.766774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ec5f89-aab1-434d-8337-84991bfb88fd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.922656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-19ec5f89-aab1-434d-8337-84991bfb88fd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:49.931144 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-19ec5f89-aab1-434d-8337-84991bfb88fd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.180044 Jul 20 04:31:49.932361 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2370/4657] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:49 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:49.953623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f0b181e1-7dfe-411d-8975-807ab3cd8c17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:49.954159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f0b181e1-7dfe-411d-8975-807ab3cd8c17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:49.961992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0b181e1-7dfe-411d-8975-807ab3cd8c17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.962453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0b181e1-7dfe-411d-8975-807ab3cd8c17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.963245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0b181e1-7dfe-411d-8975-807ab3cd8c17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.963734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f0b181e1-7dfe-411d-8975-807ab3cd8c17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.088183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-d4059c9c-758d-476c-b31e-9160e6a171cd req-cbb1b994-656c-4f57-98be-09c1fedce726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4805c1-47be-4944-b197-e890bf0e274e", "name": "network-vif-plugged", "status": "completed", "tag": "3d384aef-2b54-48db-b94b-28e5cde2b682"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:50.102683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d4059c9c-758d-476c-b31e-9160e6a171cd req-cbb1b994-656c-4f57-98be-09c1fedce726 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.104214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d4059c9c-758d-476c-b31e-9160e6a171cd req-cbb1b994-656c-4f57-98be-09c1fedce726 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.108211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f0b181e1-7dfe-411d-8975-807ab3cd8c17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.116932 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f0b181e1-7dfe-411d-8975-807ab3cd8c17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.168164 Jul 20 04:31:50.117872 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2288/4658] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:49 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:50.123295 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-d4059c9c-758d-476c-b31e-9160e6a171cd req-cbb1b994-656c-4f57-98be-09c1fedce726 service nova] Creating event network-vif-plugged:3d384aef-2b54-48db-b94b-28e5cde2b682 for instance cb4805c1-47be-4944-b197-e890bf0e274e on n-h2-764485-11 Jul 20 04:31:50.129282 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-d4059c9c-758d-476c-b31e-9160e6a171cd req-cbb1b994-656c-4f57-98be-09c1fedce726 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046368 Jul 20 04:31:50.130388 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2371/4659] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:50.256922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c9854e95-c863-4618-b096-ae72f22f9ea1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:50.258014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c9854e95-c863-4618-b096-ae72f22f9ea1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:50.265611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9854e95-c863-4618-b096-ae72f22f9ea1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.266406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9854e95-c863-4618-b096-ae72f22f9ea1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.268686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9854e95-c863-4618-b096-ae72f22f9ea1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.269533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9854e95-c863-4618-b096-ae72f22f9ea1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.276037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:50.435306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9af8aa79-71e1-48e2-87b1-9dd373f93b8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:50.436235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9af8aa79-71e1-48e2-87b1-9dd373f93b8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:50.448993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9af8aa79-71e1-48e2-87b1-9dd373f93b8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.450761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9af8aa79-71e1-48e2-87b1-9dd373f93b8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.452562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9af8aa79-71e1-48e2-87b1-9dd373f93b8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.454254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9af8aa79-71e1-48e2-87b1-9dd373f93b8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.533597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c9854e95-c863-4618-b096-ae72f22f9ea1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.542119 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c9854e95-c863-4618-b096-ae72f22f9ea1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.291890 Jul 20 04:31:50.547297 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2289/4660] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:50 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:50.578530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa710d4d-e674-4236-9111-c2fd9dfc8ed6 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:50.579157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa710d4d-e674-4236-9111-c2fd9dfc8ed6 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:50.589177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa710d4d-e674-4236-9111-c2fd9dfc8ed6 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.595951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa710d4d-e674-4236-9111-c2fd9dfc8ed6 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.604342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa710d4d-e674-4236-9111-c2fd9dfc8ed6 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.604871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa710d4d-e674-4236-9111-c2fd9dfc8ed6 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.614023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9af8aa79-71e1-48e2-87b1-9dd373f93b8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.629642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9af8aa79-71e1-48e2-87b1-9dd373f93b8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.633362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9af8aa79-71e1-48e2-87b1-9dd373f93b8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.636572 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9af8aa79-71e1-48e2-87b1-9dd373f93b8c tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.206792 Jul 20 04:31:50.639573 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2372/4661] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:50 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:50.866808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fa710d4d-e674-4236-9111-c2fd9dfc8ed6 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.876815 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fa710d4d-e674-4236-9111-c2fd9dfc8ed6 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.302335 Jul 20 04:31:50.880147 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2290/4662] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:50 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:51.571343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-394da12e-8f75-44ab-8225-b9b98d1bf933 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:51.572583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-394da12e-8f75-44ab-8225-b9b98d1bf933 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:51.581046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-394da12e-8f75-44ab-8225-b9b98d1bf933 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.581743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-394da12e-8f75-44ab-8225-b9b98d1bf933 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.582712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-394da12e-8f75-44ab-8225-b9b98d1bf933 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.583310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-394da12e-8f75-44ab-8225-b9b98d1bf933 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.655669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ee89c60-23e6-459e-8d59-e71d0e03e6bb tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:51.656949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ee89c60-23e6-459e-8d59-e71d0e03e6bb tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:51.670432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ee89c60-23e6-459e-8d59-e71d0e03e6bb tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.675465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ee89c60-23e6-459e-8d59-e71d0e03e6bb tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.678408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ee89c60-23e6-459e-8d59-e71d0e03e6bb tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.678893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ee89c60-23e6-459e-8d59-e71d0e03e6bb tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.778891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-394da12e-8f75-44ab-8225-b9b98d1bf933 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:51.787905 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-394da12e-8f75-44ab-8225-b9b98d1bf933 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1309 microversion: 2.1 time: 0.225869 Jul 20 04:31:51.789070 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2373/4663] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:51 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1309 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:51.793807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-942efcaf-4167-4b87-9b52-bd5cb028cf16 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1839121348", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "destination_type": "local"}, {"source_type": "volume", "uuid": "a58babb8-0f3f-4e21-a8a2-ead709d196e8", "destination_type": "invalid"}], "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-942efcaf-4167-4b87-9b52-bd5cb028cf16 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 495 Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1839121348", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "destination_type": "local"}, {"source_type": "volume", "uuid": "a58babb8-0f3f-4e21-a8a2-ead709d196e8", "destination_type": "invalid"}], "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1839121348', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'a58babb8-0f3f-4e21-a8a2-ead709d196e8', 'destination_type': 'invalid'}], 'networks': [{'uuid': '2601f58c-d54c-42c1-850f-a93d0087b3cf'}]}}} Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:51.797216 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 04:31:51.801226 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:51.803933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-942efcaf-4167-4b87-9b52-bd5cb028cf16 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:51.805162 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-942efcaf-4167-4b87-9b52-bd5cb028cf16 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.014974 Jul 20 04:31:51.805964 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2374/4664] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:51 2022] POST /compute/v2.1/servers => generated 155 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:31:51.818695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1ee89c60-23e6-459e-8d59-e71d0e03e6bb tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:51.820355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-07d7a10d-58e5-4857-b94c-420aa6623e2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:51.821450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-07d7a10d-58e5-4857-b94c-420aa6623e2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:51.828815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1ee89c60-23e6-459e-8d59-e71d0e03e6bb tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:51.830386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1ee89c60-23e6-459e-8d59-e71d0e03e6bb tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:51.831632 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ee89c60-23e6-459e-8d59-e71d0e03e6bb tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.179930 Jul 20 04:31:51.832423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-07d7a10d-58e5-4857-b94c-420aa6623e2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.843082 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2291/4665] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:51 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:51.843976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-07d7a10d-58e5-4857-b94c-420aa6623e2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.844868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-07d7a10d-58e5-4857-b94c-420aa6623e2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.845330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-07d7a10d-58e5-4857-b94c-420aa6623e2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.900119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-87733517-952c-4d11-afd3-ec8162b0854f tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:51.900747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-87733517-952c-4d11-afd3-ec8162b0854f tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:51.931838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87733517-952c-4d11-afd3-ec8162b0854f tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.932311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87733517-952c-4d11-afd3-ec8162b0854f tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.933135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87733517-952c-4d11-afd3-ec8162b0854f tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.933586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87733517-952c-4d11-afd3-ec8162b0854f tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.132632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-07d7a10d-58e5-4857-b94c-420aa6623e2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:52.134968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-87733517-952c-4d11-afd3-ec8162b0854f tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:52.143770 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-87733517-952c-4d11-afd3-ec8162b0854f tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.247568 Jul 20 04:31:52.144614 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-07d7a10d-58e5-4857-b94c-420aa6623e2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.333992 Jul 20 04:31:52.154746 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2375/4666] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:51 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:52.155106 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2292/4667] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:51 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:52.178821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e59b8f9-f3b2-466f-9ac2-7c2c797eda14 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:52.179454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6e59b8f9-f3b2-466f-9ac2-7c2c797eda14 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:52.186718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e59b8f9-f3b2-466f-9ac2-7c2c797eda14 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.187466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e59b8f9-f3b2-466f-9ac2-7c2c797eda14 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.188543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e59b8f9-f3b2-466f-9ac2-7c2c797eda14 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.189208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e59b8f9-f3b2-466f-9ac2-7c2c797eda14 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.355788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6e59b8f9-f3b2-466f-9ac2-7c2c797eda14 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:52.365142 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6e59b8f9-f3b2-466f-9ac2-7c2c797eda14 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.191308 Jul 20 04:31:52.380761 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2376/4668] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:52 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:52.434614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33c203a5-b65c-4c02-baaf-54f4c4e2945d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1786840307", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33c203a5-b65c-4c02-baaf-54f4c4e2945d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 492 Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1786840307", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1786840307', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '2601f58c-d54c-42c1-850f-a93d0087b3cf'}]}}} Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 20 04:31:52.437332 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33c203a5-b65c-4c02-baaf-54f4c4e2945d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-33c203a5-b65c-4c02-baaf-54f4c4e2945d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.008605 Jul 20 04:31:52.441088 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2293/4669] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:52 2022] POST /compute/v2.1/servers => generated 624 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:31:52.448966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a2e20768-6073-4f85-b3de-f8e972aee188 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:52.449849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a2e20768-6073-4f85-b3de-f8e972aee188 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:52.456740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2e20768-6073-4f85-b3de-f8e972aee188 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.457573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2e20768-6073-4f85-b3de-f8e972aee188 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.458663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2e20768-6073-4f85-b3de-f8e972aee188 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.459170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2e20768-6073-4f85-b3de-f8e972aee188 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.617172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a2e20768-6073-4f85-b3de-f8e972aee188 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:52.627862 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a2e20768-6073-4f85-b3de-f8e972aee188 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.182731 Jul 20 04:31:52.628568 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2377/4670] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:52 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:52.646241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5b3eec8b-f940-4cec-b3b5-ec1ca0c952ef tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:52.646955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5b3eec8b-f940-4cec-b3b5-ec1ca0c952ef tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:52.654359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b3eec8b-f940-4cec-b3b5-ec1ca0c952ef tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.655201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b3eec8b-f940-4cec-b3b5-ec1ca0c952ef tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.656073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b3eec8b-f940-4cec-b3b5-ec1ca0c952ef tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.656619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b3eec8b-f940-4cec-b3b5-ec1ca0c952ef tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.807072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d30e8290-3a3b-4b23-878f-4e53833f9e47 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:52.807736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d30e8290-3a3b-4b23-878f-4e53833f9e47 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:52.817123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d30e8290-3a3b-4b23-878f-4e53833f9e47 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.817268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d30e8290-3a3b-4b23-878f-4e53833f9e47 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.820582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d30e8290-3a3b-4b23-878f-4e53833f9e47 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.824027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d30e8290-3a3b-4b23-878f-4e53833f9e47 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.853225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5b3eec8b-f940-4cec-b3b5-ec1ca0c952ef tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:52.861391 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5b3eec8b-f940-4cec-b3b5-ec1ca0c952ef tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.220152 Jul 20 04:31:52.875627 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2294/4671] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:52 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:52.875627 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8315ed1b-4c61-47ba-8f60-c9a4a568d61e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:52.875627 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8315ed1b-4c61-47ba-8f60-c9a4a568d61e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:52.882721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8315ed1b-4c61-47ba-8f60-c9a4a568d61e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.882721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8315ed1b-4c61-47ba-8f60-c9a4a568d61e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.882721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8315ed1b-4c61-47ba-8f60-c9a4a568d61e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.882721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8315ed1b-4c61-47ba-8f60-c9a4a568d61e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.014594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8315ed1b-4c61-47ba-8f60-c9a4a568d61e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.027839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8315ed1b-4c61-47ba-8f60-c9a4a568d61e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.030038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8315ed1b-4c61-47ba-8f60-c9a4a568d61e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.031896 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8315ed1b-4c61-47ba-8f60-c9a4a568d61e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.166291 Jul 20 04:31:53.032692 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2295/4672] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:52 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:53.039716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9ffe465-33e6-4132-b39f-0235b3085279 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9ffe465-33e6-4132-b39f-0235b3085279 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 416 Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'networks': [{'uuid': '2601f58c-d54c-42c1-850f-a93d0087b3cf'}]}}} Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:53.042778 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:31:53.045886 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:53.047747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d30e8290-3a3b-4b23-878f-4e53833f9e47 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.049265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9ffe465-33e6-4132-b39f-0235b3085279 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:53.050374 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e9ffe465-33e6-4132-b39f-0235b3085279 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.015851 Jul 20 04:31:53.051826 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2296/4673] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:53 2022] POST /compute/v2.1/servers => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:31:53.059587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-90d96711-7bc0-47be-a4c2-4c899c33f033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:53.059852 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d30e8290-3a3b-4b23-878f-4e53833f9e47 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1489 microversion: 2.1 time: 0.258598 Jul 20 04:31:53.060604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-90d96711-7bc0-47be-a4c2-4c899c33f033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:53.061180 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2378/4674] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:52 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1489 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:53.071642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90d96711-7bc0-47be-a4c2-4c899c33f033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.072398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90d96711-7bc0-47be-a4c2-4c899c33f033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.074143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90d96711-7bc0-47be-a4c2-4c899c33f033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.074867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90d96711-7bc0-47be-a4c2-4c899c33f033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.164525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44e4fd86-6f86-4c2b-bf0a-8e744e6f4c97 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:53.165163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44e4fd86-6f86-4c2b-bf0a-8e744e6f4c97 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:53.178375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44e4fd86-6f86-4c2b-bf0a-8e744e6f4c97 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.178815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44e4fd86-6f86-4c2b-bf0a-8e744e6f4c97 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.185196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44e4fd86-6f86-4c2b-bf0a-8e744e6f4c97 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.185854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44e4fd86-6f86-4c2b-bf0a-8e744e6f4c97 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.326008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-90d96711-7bc0-47be-a4c2-4c899c33f033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.337201 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-90d96711-7bc0-47be-a4c2-4c899c33f033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.281621 Jul 20 04:31:53.338305 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2297/4675] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:53 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:53.343041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1482699172", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "be069fc8-30ed-40bc-8dbd-2efb24615595"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:53.410318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44e4fd86-6f86-4c2b-bf0a-8e744e6f4c97 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.419982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] validate_networks() for [('be069fc8-30ed-40bc-8dbd-2efb24615595', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:31:53.426865 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44e4fd86-6f86-4c2b-bf0a-8e744e6f4c97 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.266762 Jul 20 04:31:53.436064 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2379/4676] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:53 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:53.436064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0d5b4e55-462c-4d56-9fae-15b4d27501c6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:53.436064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0d5b4e55-462c-4d56-9fae-15b4d27501c6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:53.441224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d5b4e55-462c-4d56-9fae-15b4d27501c6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.441685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d5b4e55-462c-4d56-9fae-15b4d27501c6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.442460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d5b4e55-462c-4d56-9fae-15b4d27501c6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.443863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d5b4e55-462c-4d56-9fae-15b4d27501c6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.750056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d5b4e55-462c-4d56-9fae-15b4d27501c6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.765756 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0d5b4e55-462c-4d56-9fae-15b4d27501c6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.335492 Jul 20 04:31:53.780917 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2380/4677] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:53 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:53.843818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-41fd7098-fed3-4276-8227-4eaea82b0411 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1479995933", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": -1, "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:53.860564 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-41fd7098-fed3-4276-8227-4eaea82b0411 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Flavor -1 could not be found. Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-41fd7098-fed3-4276-8227-4eaea82b0411 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 206 Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1479995933", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": -1, "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: exception: Flavor -1 could not be found. Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1479995933', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': -1, 'networks': [{'uuid': '2601f58c-d54c-42c1-850f-a93d0087b3cf'}]}}} Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:53.864304 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 20 04:31:53.869778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:53.872449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-41fd7098-fed3-4276-8227-4eaea82b0411 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:53.873556 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-41fd7098-fed3-4276-8227-4eaea82b0411 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.033837 Jul 20 04:31:53.877336 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2381/4678] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:53 2022] POST /compute/v2.1/servers => generated 73 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 20 04:31:53.883736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10da180e-cb60-4bad-933b-5e48a0b3323a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:53.884506 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-10da180e-cb60-4bad-933b-5e48a0b3323a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:53.897820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10da180e-cb60-4bad-933b-5e48a0b3323a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.898561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10da180e-cb60-4bad-933b-5e48a0b3323a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.899542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10da180e-cb60-4bad-933b-5e48a0b3323a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.900142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10da180e-cb60-4bad-933b-5e48a0b3323a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.130300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10da180e-cb60-4bad-933b-5e48a0b3323a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.138262 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-10da180e-cb60-4bad-933b-5e48a0b3323a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.259175 Jul 20 04:31:54.152566 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2382/4679] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:53 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:54.165296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3989e45b-6de3-447e-8703-eaabc4f2d32f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:54.166176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3989e45b-6de3-447e-8703-eaabc4f2d32f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:54.172876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3989e45b-6de3-447e-8703-eaabc4f2d32f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.173537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3989e45b-6de3-447e-8703-eaabc4f2d32f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.176386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3989e45b-6de3-447e-8703-eaabc4f2d32f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.177008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3989e45b-6de3-447e-8703-eaabc4f2d32f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.250417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:54.250874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:54.251334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:54.251785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:54.252263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:54.261662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.262127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.262948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.263404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.273065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3989e45b-6de3-447e-8703-eaabc4f2d32f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.285900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3989e45b-6de3-447e-8703-eaabc4f2d32f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.286263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:54.287571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3989e45b-6de3-447e-8703-eaabc4f2d32f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.288941 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3989e45b-6de3-447e-8703-eaabc4f2d32f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.135125 Jul 20 04:31:54.290423 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2383/4680] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:54 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:54.295300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61f285a1-ac2f-4fa3-902e-83f2321aae80 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:54.295946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-61f285a1-ac2f-4fa3-902e-83f2321aae80 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:54.302231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61f285a1-ac2f-4fa3-902e-83f2321aae80 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.302689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61f285a1-ac2f-4fa3-902e-83f2321aae80 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.302847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for user 7d38b1e323c5490fbb4c0023034874c8 and project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:54.303468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61f285a1-ac2f-4fa3-902e-83f2321aae80 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.303946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61f285a1-ac2f-4fa3-902e-83f2321aae80 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.323613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:54.325917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:54.374122 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bc107439-93c3-4392-884a-26a6f1db0b7e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.034563 Jul 20 04:31:54.375069 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2298/4681] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:31:54.385447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-24168ae0-02a0-47b3-b290-b612a92a7d1f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:54.388297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-24168ae0-02a0-47b3-b290-b612a92a7d1f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:54.472517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-24168ae0-02a0-47b3-b290-b612a92a7d1f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.487296 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-24168ae0-02a0-47b3-b290-b612a92a7d1f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1209 microversion: 2.1 time: 0.105669 Jul 20 04:31:54.488585 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2299/4682] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:54 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1209 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:54.493916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0057c8e7-a14c-4f40-b48d-ac9a72b1658c tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:54.495035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0057c8e7-a14c-4f40-b48d-ac9a72b1658c tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:54.502713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0057c8e7-a14c-4f40-b48d-ac9a72b1658c tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.504070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0057c8e7-a14c-4f40-b48d-ac9a72b1658c tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.505100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0057c8e7-a14c-4f40-b48d-ac9a72b1658c tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.505905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0057c8e7-a14c-4f40-b48d-ac9a72b1658c tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.523967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-61f285a1-ac2f-4fa3-902e-83f2321aae80 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.535088 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-61f285a1-ac2f-4fa3-902e-83f2321aae80 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.241822 Jul 20 04:31:54.536026 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2384/4683] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:54 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:54.612663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8b6bbc3f-c8b9-477f-a0a5-a13127c2e2c9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-978930370", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8b6bbc3f-c8b9-477f-a0a5-a13127c2e2c9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 172 Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-978930370", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-978930370', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '2601f58c-d54c-42c1-850f-a93d0087b3cf'}]}}} Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi -1 Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:54.616100 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 04:31:54.620070 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:54.622242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8b6bbc3f-c8b9-477f-a0a5-a13127c2e2c9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:54.623486 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8b6bbc3f-c8b9-477f-a0a5-a13127c2e2c9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.015416 Jul 20 04:31:54.624608 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2385/4684] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:54 2022] POST /compute/v2.1/servers => generated 145 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:31:54.634939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04d409bc-ddf7-42fa-a0cf-3446136165f8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:54.636128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-04d409bc-ddf7-42fa-a0cf-3446136165f8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:54.644745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04d409bc-ddf7-42fa-a0cf-3446136165f8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.645222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04d409bc-ddf7-42fa-a0cf-3446136165f8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.646210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04d409bc-ddf7-42fa-a0cf-3446136165f8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.646677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04d409bc-ddf7-42fa-a0cf-3446136165f8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.663566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:54.728378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0057c8e7-a14c-4f40-b48d-ac9a72b1658c tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.759303 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0057c8e7-a14c-4f40-b48d-ac9a72b1658c tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.268931 Jul 20 04:31:54.760289 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2300/4685] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:54 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:54.846875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-04d409bc-ddf7-42fa-a0cf-3446136165f8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.856296 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-04d409bc-ddf7-42fa-a0cf-3446136165f8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.226167 Jul 20 04:31:54.860533 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2386/4686] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:54 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:54.880902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7d29f3db-8881-42e4-bc3b-d3360e53ff87 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:54.881654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7d29f3db-8881-42e4-bc3b-d3360e53ff87 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:54.888731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d29f3db-8881-42e4-bc3b-d3360e53ff87 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.889504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d29f3db-8881-42e4-bc3b-d3360e53ff87 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.890516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d29f3db-8881-42e4-bc3b-d3360e53ff87 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.891003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d29f3db-8881-42e4-bc3b-d3360e53ff87 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.088714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7d29f3db-8881-42e4-bc3b-d3360e53ff87 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.102651 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7d29f3db-8881-42e4-bc3b-d3360e53ff87 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.227958 Jul 20 04:31:55.108745 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2301/4687] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:54 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:55.195434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da6ca747-5a7a-4ea5-98db-775bc981a13c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1402032776", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:55.198770 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-da6ca747-5a7a-4ea5-98db-775bc981a13c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da6ca747-5a7a-4ea5-98db-775bc981a13c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 216 Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1402032776", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1402032776', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:55.200447 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.204547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:55.204547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:55.204547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:55.204547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:55.204547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:55.204547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:31:55.204547 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:31:55.204547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da6ca747-5a7a-4ea5-98db-775bc981a13c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:55.204547 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da6ca747-5a7a-4ea5-98db-775bc981a13c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.011787 Jul 20 04:31:55.204547 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2387/4688] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:55 2022] POST /compute/v2.1/servers => generated 123 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:31:55.212052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e81f8040-0bc0-4e14-ba54-28710a1d841e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.213029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e81f8040-0bc0-4e14-ba54-28710a1d841e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:55.219890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e81f8040-0bc0-4e14-ba54-28710a1d841e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.220513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e81f8040-0bc0-4e14-ba54-28710a1d841e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.222009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e81f8040-0bc0-4e14-ba54-28710a1d841e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.222697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e81f8040-0bc0-4e14-ba54-28710a1d841e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.308489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9a7cd5a2-3700-46ca-b4df-203d3aca3804 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.309107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9a7cd5a2-3700-46ca-b4df-203d3aca3804 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:55.318794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a7cd5a2-3700-46ca-b4df-203d3aca3804 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.319258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a7cd5a2-3700-46ca-b4df-203d3aca3804 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.320085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a7cd5a2-3700-46ca-b4df-203d3aca3804 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.320534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a7cd5a2-3700-46ca-b4df-203d3aca3804 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.445574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9a7cd5a2-3700-46ca-b4df-203d3aca3804 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.452007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e81f8040-0bc0-4e14-ba54-28710a1d841e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.462100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9a7cd5a2-3700-46ca-b4df-203d3aca3804 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.466467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9a7cd5a2-3700-46ca-b4df-203d3aca3804 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.468527 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9a7cd5a2-3700-46ca-b4df-203d3aca3804 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.164036 Jul 20 04:31:55.475211 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2388/4689] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:55.488101 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e81f8040-0bc0-4e14-ba54-28710a1d841e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.280013 Jul 20 04:31:55.505541 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2302/4690] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:55.507428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09cfc5ff-8189-4a64-a6f4-3c7b22ab95f6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.508314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-09cfc5ff-8189-4a64-a6f4-3c7b22ab95f6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:55.518588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09cfc5ff-8189-4a64-a6f4-3c7b22ab95f6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.519391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09cfc5ff-8189-4a64-a6f4-3c7b22ab95f6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.520836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09cfc5ff-8189-4a64-a6f4-3c7b22ab95f6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.523657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09cfc5ff-8189-4a64-a6f4-3c7b22ab95f6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.524851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-87bbd2d7-c57c-4121-a63f-f7307e5874bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.528920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-87bbd2d7-c57c-4121-a63f-f7307e5874bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:55.550160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87bbd2d7-c57c-4121-a63f-f7307e5874bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.556824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87bbd2d7-c57c-4121-a63f-f7307e5874bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.557904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87bbd2d7-c57c-4121-a63f-f7307e5874bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.559230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87bbd2d7-c57c-4121-a63f-f7307e5874bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.620157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-09cfc5ff-8189-4a64-a6f4-3c7b22ab95f6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.632236 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-09cfc5ff-8189-4a64-a6f4-3c7b22ab95f6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1261 microversion: 2.1 time: 0.131944 Jul 20 04:31:55.633391 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2389/4691] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1261 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:55.776770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-208e1b09-a69f-4658-b690-30c9859750da tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.777395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-208e1b09-a69f-4658-b690-30c9859750da tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:55.791624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-208e1b09-a69f-4658-b690-30c9859750da tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.792067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-208e1b09-a69f-4658-b690-30c9859750da tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.792854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-208e1b09-a69f-4658-b690-30c9859750da tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.793301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-208e1b09-a69f-4658-b690-30c9859750da tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.060885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-87bbd2d7-c57c-4121-a63f-f7307e5874bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.069062 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-87bbd2d7-c57c-4121-a63f-f7307e5874bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.559018 Jul 20 04:31:56.070302 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2303/4692] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:56.129547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a41ceaf2-6758-422b-a10e-825abb7e1a68 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-622802316", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "key_name": "tempest-key-1394147847", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:56.181964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-a41ceaf2-6758-422b-a10e-825abb7e1a68 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] validate_networks() for [('2601f58c-d54c-42c1-850f-a93d0087b3cf', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:31:56.204339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-208e1b09-a69f-4658-b690-30c9859750da tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.213047 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-208e1b09-a69f-4658-b690-30c9859750da tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.440099 Jul 20 04:31:56.225272 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2390/4693] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:56.491874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-71fc89fd-a299-48e8-996b-b25ba46f8df4 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:56.492485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-71fc89fd-a299-48e8-996b-b25ba46f8df4 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.500236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71fc89fd-a299-48e8-996b-b25ba46f8df4 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.500697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71fc89fd-a299-48e8-996b-b25ba46f8df4 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.501536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71fc89fd-a299-48e8-996b-b25ba46f8df4 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.502073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-71fc89fd-a299-48e8-996b-b25ba46f8df4 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.668580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-71fc89fd-a299-48e8-996b-b25ba46f8df4 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.681354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-71fc89fd-a299-48e8-996b-b25ba46f8df4 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.685365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-71fc89fd-a299-48e8-996b-b25ba46f8df4 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.687124 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-71fc89fd-a299-48e8-996b-b25ba46f8df4 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.198992 Jul 20 04:31:56.688342 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2391/4694] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:56 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:56.693412 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a41ceaf2-6758-422b-a10e-825abb7e1a68 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Invalid key_name provided. Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a41ceaf2-6758-422b-a10e-825abb7e1a68 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 246 Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-622802316", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "key_name": "tempest-key-1394147847", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid key_name provided. Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-622802316', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'key_name': 'tempest-key-1394147847', 'networks': [{'uuid': '2601f58c-d54c-42c1-850f-a93d0087b3cf'}]}}} Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1394147847 not found for user c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:56.695500 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:56.699154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a41ceaf2-6758-422b-a10e-825abb7e1a68 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Invalid key_name provided. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:56.705045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a5739a4-a139-452e-a20d-7b431bfb7d36 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:56.705197 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a41ceaf2-6758-422b-a10e-825abb7e1a68 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.572446 Jul 20 04:31:56.705292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7a5739a4-a139-452e-a20d-7b431bfb7d36 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.705476 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2304/4695] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:56 2022] POST /compute/v2.1/servers => generated 70 bytes in 576 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:31:56.708223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-737da28c-019b-45e9-9d97-ec37c5d84b7f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:56.708846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-737da28c-019b-45e9-9d97-ec37c5d84b7f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.709290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a5739a4-a139-452e-a20d-7b431bfb7d36 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.709756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a5739a4-a139-452e-a20d-7b431bfb7d36 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.710541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a5739a4-a139-452e-a20d-7b431bfb7d36 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.711213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a5739a4-a139-452e-a20d-7b431bfb7d36 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.715289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-737da28c-019b-45e9-9d97-ec37c5d84b7f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.716256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-737da28c-019b-45e9-9d97-ec37c5d84b7f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.716543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-737da28c-019b-45e9-9d97-ec37c5d84b7f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.716984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-737da28c-019b-45e9-9d97-ec37c5d84b7f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.852126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7a5739a4-a139-452e-a20d-7b431bfb7d36 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.859676 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7a5739a4-a139-452e-a20d-7b431bfb7d36 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1267 microversion: 2.1 time: 0.169778 Jul 20 04:31:56.860358 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2392/4696] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:56 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:57.059547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-737da28c-019b-45e9-9d97-ec37c5d84b7f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.068161 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-737da28c-019b-45e9-9d97-ec37c5d84b7f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.363367 Jul 20 04:31:57.069265 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2305/4697] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:56 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:57.085550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ed6aecfa-e510-4983-b11b-1294fb65953d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:57.086422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ed6aecfa-e510-4983-b11b-1294fb65953d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:57.096722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed6aecfa-e510-4983-b11b-1294fb65953d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.098411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed6aecfa-e510-4983-b11b-1294fb65953d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.099355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed6aecfa-e510-4983-b11b-1294fb65953d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.100067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed6aecfa-e510-4983-b11b-1294fb65953d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.232393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ecfc26e-b0bc-498e-89b8-ffdab02f496b tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:57.233159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ecfc26e-b0bc-498e-89b8-ffdab02f496b tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:57.247570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ecfc26e-b0bc-498e-89b8-ffdab02f496b tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.248112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ecfc26e-b0bc-498e-89b8-ffdab02f496b tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.248960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ecfc26e-b0bc-498e-89b8-ffdab02f496b tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.249621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ecfc26e-b0bc-498e-89b8-ffdab02f496b tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.748471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ed6aecfa-e510-4983-b11b-1294fb65953d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.762898 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ed6aecfa-e510-4983-b11b-1294fb65953d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.680870 Jul 20 04:31:57.764601 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2393/4698] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:57 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:57.770807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4127510a-f442-4752-924f-03a3ebf624e1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:57.771527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4127510a-f442-4752-924f-03a3ebf624e1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:57.780804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4127510a-f442-4752-924f-03a3ebf624e1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.781408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4127510a-f442-4752-924f-03a3ebf624e1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.782710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4127510a-f442-4752-924f-03a3ebf624e1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.784188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4127510a-f442-4752-924f-03a3ebf624e1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.941744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4127510a-f442-4752-924f-03a3ebf624e1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.980148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4127510a-f442-4752-924f-03a3ebf624e1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.982761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4127510a-f442-4752-924f-03a3ebf624e1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.985008 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4127510a-f442-4752-924f-03a3ebf624e1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.219172 Jul 20 04:31:57.998422 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2394/4699] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:57 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:58.006260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a214997-28a7-4962-b599-6a218b75a4e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:58.009324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a214997-28a7-4962-b599-6a218b75a4e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:58.019636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a214997-28a7-4962-b599-6a218b75a4e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.021235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a214997-28a7-4962-b599-6a218b75a4e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.022329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a214997-28a7-4962-b599-6a218b75a4e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.022988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a214997-28a7-4962-b599-6a218b75a4e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.101988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ecfc26e-b0bc-498e-89b8-ffdab02f496b tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:58.116468 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ecfc26e-b0bc-498e-89b8-ffdab02f496b tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.888740 Jul 20 04:31:58.117076 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2306/4700] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:57 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:58.131102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-347e968e-39e5-4130-8e60-2076f66d045f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2132174930", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:58.374081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.security_group_api [None req-347e968e-39e5-4130-8e60-2076f66d045f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Neutron security group does_not_exist not found {{(pid=119807) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 20 04:31:58.374705 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-347e968e-39e5-4130-8e60-2076f66d045f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-347e968e-39e5-4130-8e60-2076f66d045f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 258 Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2132174930", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2132174930', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '2601f58c-d54c-42c1-850f-a93d0087b3cf'}]}}} Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 20 04:31:58.380174 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.383984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-347e968e-39e5-4130-8e60-2076f66d045f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:58.387257 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-347e968e-39e5-4130-8e60-2076f66d045f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.254827 Jul 20 04:31:58.387257 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2307/4701] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:58 2022] POST /compute/v2.1/servers => generated 106 bytes in 265 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:31:58.391780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ddbd0102-f661-4b35-8f87-1e77e38d79bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:58.392294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ddbd0102-f661-4b35-8f87-1e77e38d79bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:58.394857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5a214997-28a7-4962-b599-6a218b75a4e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:58.399585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddbd0102-f661-4b35-8f87-1e77e38d79bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.400029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddbd0102-f661-4b35-8f87-1e77e38d79bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.400820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddbd0102-f661-4b35-8f87-1e77e38d79bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.401266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddbd0102-f661-4b35-8f87-1e77e38d79bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.402721 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a214997-28a7-4962-b599-6a218b75a4e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1309 microversion: 2.1 time: 0.402018 Jul 20 04:31:58.403712 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2395/4702] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:57 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1309 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:58.697780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ddbd0102-f661-4b35-8f87-1e77e38d79bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:58.706993 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ddbd0102-f661-4b35-8f87-1e77e38d79bc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.319887 Jul 20 04:31:58.708375 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2308/4703] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:58 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:58.727387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8cf6358b-1edc-436a-bd75-43fea12790b6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:58.728387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8cf6358b-1edc-436a-bd75-43fea12790b6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:58.736888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8cf6358b-1edc-436a-bd75-43fea12790b6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.737792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8cf6358b-1edc-436a-bd75-43fea12790b6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.739241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8cf6358b-1edc-436a-bd75-43fea12790b6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.739924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8cf6358b-1edc-436a-bd75-43fea12790b6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.970706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8cf6358b-1edc-436a-bd75-43fea12790b6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:58.980838 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8cf6358b-1edc-436a-bd75-43fea12790b6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.257577 Jul 20 04:31:58.982123 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2396/4704] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:58 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:58.998641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9661810c-82d4-48cc-8a35-a466d044b8c5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:59.005548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5e204cd7-0756-4bdc-a7ce-002ce0edb704 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:59.006181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9661810c-82d4-48cc-8a35-a466d044b8c5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: 0a5b7b85-6e22-434e-ace5-9841e0bbe557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:59.009500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5e204cd7-0756-4bdc-a7ce-002ce0edb704 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:59.019242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:59.021692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e204cd7-0756-4bdc-a7ce-002ce0edb704 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.023361 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-9661810c-82d4-48cc-8a35-a466d044b8c5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance 0a5b7b85-6e22-434e-ace5-9841e0bbe557 could not be found. Jul 20 04:31:59.024123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e204cd7-0756-4bdc-a7ce-002ce0edb704 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9661810c-82d4-48cc-8a35-a466d044b8c5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/0a5b7b85-6e22-434e-ace5-9841e0bbe557 HTTP/1.1 Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 0a5b7b85-6e22-434e-ace5-9841e0bbe557 could not be found. Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '0a5b7b85-6e22-434e-ace5-9841e0bbe557'} Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5b7b85-6e22-434e-ace5-9841e0bbe557 could not be found. Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5b7b85-6e22-434e-ace5-9841e0bbe557 could not be found. Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:59.025876 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:59.029966 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:59.029966 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:59.029966 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:59.029966 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:59.029966 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:59.029966 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:59.029966 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5b7b85-6e22-434e-ace5-9841e0bbe557 could not be found. Jul 20 04:31:59.029966 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:31:59.032049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e204cd7-0756-4bdc-a7ce-002ce0edb704 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.032928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9661810c-82d4-48cc-8a35-a466d044b8c5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance 0a5b7b85-6e22-434e-ace5-9841e0bbe557 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:59.034156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e204cd7-0756-4bdc-a7ce-002ce0edb704 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.035351 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9661810c-82d4-48cc-8a35-a466d044b8c5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a5b7b85-6e22-434e-ace5-9841e0bbe557" status: 404 len: 111 microversion: 2.1 time: 0.040810 Jul 20 04:31:59.042115 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2309/4705] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:58 2022] DELETE /compute/v2.1/servers/0a5b7b85-6e22-434e-ace5-9841e0bbe557 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:59.047179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-48581130-d5e4-4533-8eb6-250692af9cc6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:59.051061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-48581130-d5e4-4533-8eb6-250692af9cc6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:59.071390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48581130-d5e4-4533-8eb6-250692af9cc6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.074426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48581130-d5e4-4533-8eb6-250692af9cc6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.075893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48581130-d5e4-4533-8eb6-250692af9cc6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.076573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48581130-d5e4-4533-8eb6-250692af9cc6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.178589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5e204cd7-0756-4bdc-a7ce-002ce0edb704 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.193744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5e204cd7-0756-4bdc-a7ce-002ce0edb704 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.197332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5e204cd7-0756-4bdc-a7ce-002ce0edb704 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.202481 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5e204cd7-0756-4bdc-a7ce-002ce0edb704 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.202056 Jul 20 04:31:59.203782 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2397/4706] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:58 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:59.209078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-66416b44-b8b9-46ca-bd44-c0e3708b1746 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:59.209957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-66416b44-b8b9-46ca-bd44-c0e3708b1746 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:59.219133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66416b44-b8b9-46ca-bd44-c0e3708b1746 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.220354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66416b44-b8b9-46ca-bd44-c0e3708b1746 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.222296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66416b44-b8b9-46ca-bd44-c0e3708b1746 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.223379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66416b44-b8b9-46ca-bd44-c0e3708b1746 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.405731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-48581130-d5e4-4533-8eb6-250692af9cc6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.415996 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-48581130-d5e4-4533-8eb6-250692af9cc6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.371883 Jul 20 04:31:59.430691 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2310/4707] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:59 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:59.436106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6ec63141-114a-4618-9ca5-4f6ec5a57b28 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:59.437006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6ec63141-114a-4618-9ca5-4f6ec5a57b28 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:59.447534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ec63141-114a-4618-9ca5-4f6ec5a57b28 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.460237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ec63141-114a-4618-9ca5-4f6ec5a57b28 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.461219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ec63141-114a-4618-9ca5-4f6ec5a57b28 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.461675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ec63141-114a-4618-9ca5-4f6ec5a57b28 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.735065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-66416b44-b8b9-46ca-bd44-c0e3708b1746 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.745803 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-66416b44-b8b9-46ca-bd44-c0e3708b1746 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.539471 Jul 20 04:31:59.747936 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2398/4708] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:59 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:59.753621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-23979d92-feeb-4d71-80c6-8936f600036f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:59.754252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-23979d92-feeb-4d71-80c6-8936f600036f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:59.776414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23979d92-feeb-4d71-80c6-8936f600036f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.777388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23979d92-feeb-4d71-80c6-8936f600036f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.779168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23979d92-feeb-4d71-80c6-8936f600036f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.781160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23979d92-feeb-4d71-80c6-8936f600036f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.858913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6ec63141-114a-4618-9ca5-4f6ec5a57b28 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.870713 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6ec63141-114a-4618-9ca5-4f6ec5a57b28 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1309 microversion: 2.1 time: 0.438688 Jul 20 04:31:59.874222 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2311/4709] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:59 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1309 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:59.883724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-baaf396e-30ef-442b-96ec-5859b579179a req-c2100689-1e4d-45d5-b603-6601408ce402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8167df7a-d77a-4e1e-ab7b-c7d2668bd76b", "tag": "852ae22e-b524-4fc4-95c2-589f911419d2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:59.896615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-baaf396e-30ef-442b-96ec-5859b579179a req-c2100689-1e4d-45d5-b603-6601408ce402 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.897337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-baaf396e-30ef-442b-96ec-5859b579179a req-c2100689-1e4d-45d5-b603-6601408ce402 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.911863 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-baaf396e-30ef-442b-96ec-5859b579179a req-c2100689-1e4d-45d5-b603-6601408ce402 service nova] Creating event network-changed:852ae22e-b524-4fc4-95c2-589f911419d2 for instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b on n-h1-764485-11 Jul 20 04:31:59.918680 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-baaf396e-30ef-442b-96ec-5859b579179a req-c2100689-1e4d-45d5-b603-6601408ce402 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042006 Jul 20 04:31:59.920185 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2312/4710] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:00.076805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-23979d92-feeb-4d71-80c6-8936f600036f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.084961 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-23979d92-feeb-4d71-80c6-8936f600036f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.335928 Jul 20 04:32:00.097541 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2399/4711] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:59 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:00.103917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86ee51e7-0df8-4720-ad74-c7ea781fd90d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.104416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-86ee51e7-0df8-4720-ad74-c7ea781fd90d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:32:00.104945 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-86ee51e7-0df8-4720-ad74-c7ea781fd90d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86ee51e7-0df8-4720-ad74-c7ea781fd90d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 9223372036854775808 could not be found. Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '9223372036854775808'} Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:00.106919 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:00.115270 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:00.115270 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:00.115270 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:00.115270 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 20 04:32:00.115270 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:00.115270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86ee51e7-0df8-4720-ad74-c7ea781fd90d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:00.115270 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-86ee51e7-0df8-4720-ad74-c7ea781fd90d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009823 Jul 20 04:32:00.115270 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2313/4712] 10.222.0.20 () {58 vars in 1187 bytes} [Wed Jul 20 04:32:00 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:32:00.117860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9575e55f-32fc-42ad-a382-254b00129996 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.118544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9575e55f-32fc-42ad-a382-254b00129996 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:00.125325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9575e55f-32fc-42ad-a382-254b00129996 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.125783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9575e55f-32fc-42ad-a382-254b00129996 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.127271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9575e55f-32fc-42ad-a382-254b00129996 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.127776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9575e55f-32fc-42ad-a382-254b00129996 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.224621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95e2b543-4a79-4042-af2d-c9ffdf6f722d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.225939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95e2b543-4a79-4042-af2d-c9ffdf6f722d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:00.241900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95e2b543-4a79-4042-af2d-c9ffdf6f722d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.242757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95e2b543-4a79-4042-af2d-c9ffdf6f722d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.243845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95e2b543-4a79-4042-af2d-c9ffdf6f722d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.244552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95e2b543-4a79-4042-af2d-c9ffdf6f722d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.282774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:00.383334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95e2b543-4a79-4042-af2d-c9ffdf6f722d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.399052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95e2b543-4a79-4042-af2d-c9ffdf6f722d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.401563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95e2b543-4a79-4042-af2d-c9ffdf6f722d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.403912 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95e2b543-4a79-4042-af2d-c9ffdf6f722d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.185648 Jul 20 04:32:00.405329 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2314/4713] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:00 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:32:00.427219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9575e55f-32fc-42ad-a382-254b00129996 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.445598 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9575e55f-32fc-42ad-a382-254b00129996 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.330553 Jul 20 04:32:00.448642 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2400/4714] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:00 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:00.467339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-025b553d-0e22-4d12-9704-91575111eaf5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.468830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-025b553d-0e22-4d12-9704-91575111eaf5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:00.477419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-025b553d-0e22-4d12-9704-91575111eaf5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.478190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-025b553d-0e22-4d12-9704-91575111eaf5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.479146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-025b553d-0e22-4d12-9704-91575111eaf5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.480380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-025b553d-0e22-4d12-9704-91575111eaf5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.653516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-025b553d-0e22-4d12-9704-91575111eaf5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.662627 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-025b553d-0e22-4d12-9704-91575111eaf5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.199973 Jul 20 04:32:00.663216 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2315/4715] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:00 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:00.679389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-387e0077-6d19-4a1d-b37c-a16eaae63df5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.679824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-387e0077-6d19-4a1d-b37c-a16eaae63df5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Failed to fetch instance by id -1 {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:32:00.680332 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-387e0077-6d19-4a1d-b37c-a16eaae63df5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance -1 could not be found. Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-387e0077-6d19-4a1d-b37c-a16eaae63df5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance -1 could not be found. Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '-1'} Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:00.681801 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:00.689970 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:00.689970 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:00.689970 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 20 04:32:00.689970 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:00.689970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-387e0077-6d19-4a1d-b37c-a16eaae63df5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:00.689970 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-387e0077-6d19-4a1d-b37c-a16eaae63df5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.007774 Jul 20 04:32:00.689970 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2401/4716] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:32:00 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:32:00.693695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7abef858-4e47-4536-b9b0-4ded3af56b07 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.694092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7abef858-4e47-4536-b9b0-4ded3af56b07 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:00.700611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7abef858-4e47-4536-b9b0-4ded3af56b07 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.701069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7abef858-4e47-4536-b9b0-4ded3af56b07 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.701861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7abef858-4e47-4536-b9b0-4ded3af56b07 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.702865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7abef858-4e47-4536-b9b0-4ded3af56b07 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.770131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-80cb9137-e1ac-41f3-99e0-21fff49e36af tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.776706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-80cb9137-e1ac-41f3-99e0-21fff49e36af tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:00.800965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80cb9137-e1ac-41f3-99e0-21fff49e36af tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.801736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80cb9137-e1ac-41f3-99e0-21fff49e36af tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.802738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80cb9137-e1ac-41f3-99e0-21fff49e36af tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.803384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80cb9137-e1ac-41f3-99e0-21fff49e36af tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.975692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7abef858-4e47-4536-b9b0-4ded3af56b07 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.983476 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7abef858-4e47-4536-b9b0-4ded3af56b07 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.294228 Jul 20 04:32:00.984106 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2316/4717] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:00 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:00.990123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8f9cd7c9-0296-4120-83c3-a5f1df534e66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.990974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8f9cd7c9-0296-4120-83c3-a5f1df534e66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.000151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f9cd7c9-0296-4120-83c3-a5f1df534e66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.000615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f9cd7c9-0296-4120-83c3-a5f1df534e66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.001411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f9cd7c9-0296-4120-83c3-a5f1df534e66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.002181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f9cd7c9-0296-4120-83c3-a5f1df534e66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.007300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-80cb9137-e1ac-41f3-99e0-21fff49e36af tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.015154 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-80cb9137-e1ac-41f3-99e0-21fff49e36af tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.252204 Jul 20 04:32:01.015708 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2402/4718] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:00 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:01.021569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44de31f8-6d04-4c06-a9b8-aa310f131b74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.022179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44de31f8-6d04-4c06-a9b8-aa310f131b74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.028383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44de31f8-6d04-4c06-a9b8-aa310f131b74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.029032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44de31f8-6d04-4c06-a9b8-aa310f131b74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.029942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44de31f8-6d04-4c06-a9b8-aa310f131b74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.030390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44de31f8-6d04-4c06-a9b8-aa310f131b74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.203668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8f9cd7c9-0296-4120-83c3-a5f1df534e66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.212710 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8f9cd7c9-0296-4120-83c3-a5f1df534e66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1309 microversion: 2.1 time: 0.226810 Jul 20 04:32:01.213626 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2317/4719] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:00 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1309 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:01.230614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44de31f8-6d04-4c06-a9b8-aa310f131b74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.239655 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44de31f8-6d04-4c06-a9b8-aa310f131b74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.222515 Jul 20 04:32:01.240236 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2403/4720] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:01.256089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e71a88ba-7696-4a97-bd62-b1a828759509 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:01.256648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e71a88ba-7696-4a97-bd62-b1a828759509 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: d9d03ff2-36bd-4ca6-bf3b-97bbda41a5dc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.262441 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e71a88ba-7696-4a97-bd62-b1a828759509 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance d9d03ff2-36bd-4ca6-bf3b-97bbda41a5dc could not be found. Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e71a88ba-7696-4a97-bd62-b1a828759509 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/d9d03ff2-36bd-4ca6-bf3b-97bbda41a5dc/action HTTP/1.1 Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 19 Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: {"forceDelete": {}} Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance d9d03ff2-36bd-4ca6-bf3b-97bbda41a5dc could not be found. Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'd9d03ff2-36bd-4ca6-bf3b-97bbda41a5dc', 'body': {'forceDelete': {}}} Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d03ff2-36bd-4ca6-bf3b-97bbda41a5dc could not be found. Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d03ff2-36bd-4ca6-bf3b-97bbda41a5dc could not be found. Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:01.266096 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:01.270807 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:01.270807 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:01.270807 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d03ff2-36bd-4ca6-bf3b-97bbda41a5dc could not be found. Jul 20 04:32:01.270807 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.270807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e71a88ba-7696-4a97-bd62-b1a828759509 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance d9d03ff2-36bd-4ca6-bf3b-97bbda41a5dc could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:01.270807 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e71a88ba-7696-4a97-bd62-b1a828759509 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/d9d03ff2-36bd-4ca6-bf3b-97bbda41a5dc/action" status: 404 len: 111 microversion: 2.1 time: 0.015819 Jul 20 04:32:01.270807 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2318/4721] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:01 2022] POST /compute/v2.1/servers/d9d03ff2-36bd-4ca6-bf3b-97bbda41a5dc/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:01.277557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-025f8479-ffa4-4731-85e2-a5ee9c02ae5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.278328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-025f8479-ffa4-4731-85e2-a5ee9c02ae5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.284787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-025f8479-ffa4-4731-85e2-a5ee9c02ae5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.285249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-025f8479-ffa4-4731-85e2-a5ee9c02ae5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.286173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-025f8479-ffa4-4731-85e2-a5ee9c02ae5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.286635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-025f8479-ffa4-4731-85e2-a5ee9c02ae5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.428368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c13e3b14-321d-4528-9991-11be45ed1103 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.429072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c13e3b14-321d-4528-9991-11be45ed1103 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.437395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-025f8479-ffa4-4731-85e2-a5ee9c02ae5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.442059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c13e3b14-321d-4528-9991-11be45ed1103 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.442525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c13e3b14-321d-4528-9991-11be45ed1103 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.444923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c13e3b14-321d-4528-9991-11be45ed1103 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.444923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c13e3b14-321d-4528-9991-11be45ed1103 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.445607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-025f8479-ffa4-4731-85e2-a5ee9c02ae5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.172161 Jul 20 04:32:01.458753 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2404/4722] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:01.469230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db4a095c-6ce8-4d01-937b-ae5ebab02c01 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.469858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-db4a095c-6ce8-4d01-937b-ae5ebab02c01 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.482785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db4a095c-6ce8-4d01-937b-ae5ebab02c01 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.483247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db4a095c-6ce8-4d01-937b-ae5ebab02c01 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.484064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db4a095c-6ce8-4d01-937b-ae5ebab02c01 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.484510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db4a095c-6ce8-4d01-937b-ae5ebab02c01 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.504343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:01.576409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c13e3b14-321d-4528-9991-11be45ed1103 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.587309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c13e3b14-321d-4528-9991-11be45ed1103 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.589198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c13e3b14-321d-4528-9991-11be45ed1103 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.590731 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c13e3b14-321d-4528-9991-11be45ed1103 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.170857 Jul 20 04:32:01.591866 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2319/4723] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:32:01.753629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-db4a095c-6ce8-4d01-937b-ae5ebab02c01 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.768436 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-db4a095c-6ce8-4d01-937b-ae5ebab02c01 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.303241 Jul 20 04:32:01.784922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c41717d2-a003-4f2b-918e-142dce98a087 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:01.786272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c41717d2-a003-4f2b-918e-142dce98a087 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: 95b69c7e-3e80-49d9-84ed-91531f555e28] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.792883 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-c41717d2-a003-4f2b-918e-142dce98a087 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance 95b69c7e-3e80-49d9-84ed-91531f555e28 could not be found. Jul 20 04:32:01.793217 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2405/4724] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c41717d2-a003-4f2b-918e-142dce98a087 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/95b69c7e-3e80-49d9-84ed-91531f555e28/action HTTP/1.1 Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 39 Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: {"os-getConsoleOutput": {"length": 10}} Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 95b69c7e-3e80-49d9-84ed-91531f555e28 could not be found. Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '95b69c7e-3e80-49d9-84ed-91531f555e28', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b69c7e-3e80-49d9-84ed-91531f555e28 could not be found. Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b69c7e-3e80-49d9-84ed-91531f555e28 could not be found. Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.797683 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.804429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:01.804429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:01.804429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:01.804429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:01.804429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b69c7e-3e80-49d9-84ed-91531f555e28 could not be found. Jul 20 04:32:01.804429 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.804429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c41717d2-a003-4f2b-918e-142dce98a087 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance 95b69c7e-3e80-49d9-84ed-91531f555e28 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:01.804429 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c41717d2-a003-4f2b-918e-142dce98a087 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/95b69c7e-3e80-49d9-84ed-91531f555e28/action" status: 404 len: 111 microversion: 2.1 time: 0.018942 Jul 20 04:32:01.804429 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2320/4725] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:01 2022] POST /compute/v2.1/servers/95b69c7e-3e80-49d9-84ed-91531f555e28/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:01.808935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f84f1c67-1e55-4a21-ac6b-7026f53ea5a5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.809562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f84f1c67-1e55-4a21-ac6b-7026f53ea5a5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.813522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:01.823399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f84f1c67-1e55-4a21-ac6b-7026f53ea5a5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.823882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f84f1c67-1e55-4a21-ac6b-7026f53ea5a5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.824671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f84f1c67-1e55-4a21-ac6b-7026f53ea5a5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.825109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f84f1c67-1e55-4a21-ac6b-7026f53ea5a5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.035717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c4e200b8-cc71-443f-9a29-21d03e42332a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:02.037256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c4e200b8-cc71-443f-9a29-21d03e42332a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:02.038797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f84f1c67-1e55-4a21-ac6b-7026f53ea5a5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.047947 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f84f1c67-1e55-4a21-ac6b-7026f53ea5a5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.242770 Jul 20 04:32:02.048978 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2406/4726] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:02.050388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4e200b8-cc71-443f-9a29-21d03e42332a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.050913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4e200b8-cc71-443f-9a29-21d03e42332a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.051791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4e200b8-cc71-443f-9a29-21d03e42332a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.052487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4e200b8-cc71-443f-9a29-21d03e42332a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.070046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8331f8da-2738-444b-a901-1770f7082d6d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:02.070957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8331f8da-2738-444b-a901-1770f7082d6d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:02.077342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8331f8da-2738-444b-a901-1770f7082d6d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.078015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8331f8da-2738-444b-a901-1770f7082d6d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.078964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8331f8da-2738-444b-a901-1770f7082d6d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.079638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8331f8da-2738-444b-a901-1770f7082d6d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.287884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c4e200b8-cc71-443f-9a29-21d03e42332a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.296557 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c4e200b8-cc71-443f-9a29-21d03e42332a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.266513 Jul 20 04:32:02.297781 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2321/4727] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:02 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:02.303029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9dd7052c-cbd3-4503-813f-42d47bc3a0ca tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:02.304113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9dd7052c-cbd3-4503-813f-42d47bc3a0ca tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:02.311797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dd7052c-cbd3-4503-813f-42d47bc3a0ca tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.312602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dd7052c-cbd3-4503-813f-42d47bc3a0ca tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.313628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dd7052c-cbd3-4503-813f-42d47bc3a0ca tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.314880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dd7052c-cbd3-4503-813f-42d47bc3a0ca tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.324943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8331f8da-2738-444b-a901-1770f7082d6d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.335604 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8331f8da-2738-444b-a901-1770f7082d6d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.269285 Jul 20 04:32:02.348665 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2407/4728] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:02 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:02.354613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15184d4b-86d6-496b-b1d8-474ae7d582dc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:02.355556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-15184d4b-86d6-496b-b1d8-474ae7d582dc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: 1c6b1ed7-d717-44ba-b8ea-be34a1c4efdf] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:02.361827 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-15184d4b-86d6-496b-b1d8-474ae7d582dc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance 1c6b1ed7-d717-44ba-b8ea-be34a1c4efdf could not be found. Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15184d4b-86d6-496b-b1d8-474ae7d582dc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/1c6b1ed7-d717-44ba-b8ea-be34a1c4efdf HTTP/1.1 Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 1c6b1ed7-d717-44ba-b8ea-be34a1c4efdf could not be found. Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1c6b1ed7-d717-44ba-b8ea-be34a1c4efdf'} Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c6b1ed7-d717-44ba-b8ea-be34a1c4efdf could not be found. Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c6b1ed7-d717-44ba-b8ea-be34a1c4efdf could not be found. Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:02.364274 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:02.368959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:02.368959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:02.368959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:02.368959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c6b1ed7-d717-44ba-b8ea-be34a1c4efdf could not be found. Jul 20 04:32:02.368959 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:02.376390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15184d4b-86d6-496b-b1d8-474ae7d582dc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance 1c6b1ed7-d717-44ba-b8ea-be34a1c4efdf could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:02.378424 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-15184d4b-86d6-496b-b1d8-474ae7d582dc tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/1c6b1ed7-d717-44ba-b8ea-be34a1c4efdf" status: 404 len: 111 microversion: 2.1 time: 0.028569 Jul 20 04:32:02.391689 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2408/4729] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:02 2022] GET /compute/v2.1/servers/1c6b1ed7-d717-44ba-b8ea-be34a1c4efdf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:02.400716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0ba2f195-2542-4ca9-8631-daf1ebad0531 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:02.401658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0ba2f195-2542-4ca9-8631-daf1ebad0531 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:02.413832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ba2f195-2542-4ca9-8631-daf1ebad0531 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.415889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ba2f195-2542-4ca9-8631-daf1ebad0531 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.417732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ba2f195-2542-4ca9-8631-daf1ebad0531 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.418664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ba2f195-2542-4ca9-8631-daf1ebad0531 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.496673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9dd7052c-cbd3-4503-813f-42d47bc3a0ca tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.506949 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9dd7052c-cbd3-4503-813f-42d47bc3a0ca tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1309 microversion: 2.1 time: 0.207889 Jul 20 04:32:02.508321 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2322/4730] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:02 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1309 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:02.600132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0ba2f195-2542-4ca9-8631-daf1ebad0531 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.610498 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0ba2f195-2542-4ca9-8631-daf1ebad0531 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.216663 Jul 20 04:32:02.626508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-edb1bd46-6137-41e9-8ad0-00736220f7b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:02.626508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-edb1bd46-6137-41e9-8ad0-00736220f7b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:02.626508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edb1bd46-6137-41e9-8ad0-00736220f7b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.626508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edb1bd46-6137-41e9-8ad0-00736220f7b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.628214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edb1bd46-6137-41e9-8ad0-00736220f7b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.628574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edb1bd46-6137-41e9-8ad0-00736220f7b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.630219 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2409/4731] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:02 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:02.637434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1eb4d9ac-ca44-4888-89c2-56f9d1bd8f17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:02.638135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1eb4d9ac-ca44-4888-89c2-56f9d1bd8f17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:02.645130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1eb4d9ac-ca44-4888-89c2-56f9d1bd8f17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.645855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1eb4d9ac-ca44-4888-89c2-56f9d1bd8f17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.646874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1eb4d9ac-ca44-4888-89c2-56f9d1bd8f17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.647972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1eb4d9ac-ca44-4888-89c2-56f9d1bd8f17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.699904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-edb1bd46-6137-41e9-8ad0-00736220f7b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.709926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-edb1bd46-6137-41e9-8ad0-00736220f7b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.711727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-edb1bd46-6137-41e9-8ad0-00736220f7b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.713027 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-edb1bd46-6137-41e9-8ad0-00736220f7b8 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.107347 Jul 20 04:32:02.714216 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2323/4732] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:02 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:02.817074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1eb4d9ac-ca44-4888-89c2-56f9d1bd8f17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.828795 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1eb4d9ac-ca44-4888-89c2-56f9d1bd8f17 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.197158 Jul 20 04:32:02.829386 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2410/4733] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:02 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:02.888449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd8b8968-5aad-487f-a46b-0a9f506a6ac6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2033916716", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd8b8968-5aad-487f-a46b-0a9f506a6ac6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 238 Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2033916716", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2033916716', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '2601f58c-d54c-42c1-850f-a93d0087b3cf'}]}}} Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:32:02.891392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd8b8968-5aad-487f-a46b-0a9f506a6ac6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd8b8968-5aad-487f-a46b-0a9f506a6ac6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011909 Jul 20 04:32:02.900612 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2324/4734] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:02 2022] POST /compute/v2.1/servers => generated 139 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:32:02.906345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b2c99782-6e3f-4d96-98c5-e268a03a5fc1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:02.906975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b2c99782-6e3f-4d96-98c5-e268a03a5fc1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:02.913643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2c99782-6e3f-4d96-98c5-e268a03a5fc1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.914107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2c99782-6e3f-4d96-98c5-e268a03a5fc1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.914883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2c99782-6e3f-4d96-98c5-e268a03a5fc1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.915328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2c99782-6e3f-4d96-98c5-e268a03a5fc1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.149956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b2c99782-6e3f-4d96-98c5-e268a03a5fc1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:03.166464 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b2c99782-6e3f-4d96-98c5-e268a03a5fc1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.264120 Jul 20 04:32:03.181910 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2411/4735] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:02 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:03.187224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4cabc99b-e2b3-4118-96d9-3ed7b58513c0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:03.187897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4cabc99b-e2b3-4118-96d9-3ed7b58513c0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:03.198165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4cabc99b-e2b3-4118-96d9-3ed7b58513c0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.198710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4cabc99b-e2b3-4118-96d9-3ed7b58513c0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.199644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4cabc99b-e2b3-4118-96d9-3ed7b58513c0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.200180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4cabc99b-e2b3-4118-96d9-3ed7b58513c0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.314700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-19f08e7c-b375-4d18-9d35-0b73c0c1fb27 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:03.315915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-19f08e7c-b375-4d18-9d35-0b73c0c1fb27 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:03.326590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19f08e7c-b375-4d18-9d35-0b73c0c1fb27 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.328204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19f08e7c-b375-4d18-9d35-0b73c0c1fb27 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.331550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19f08e7c-b375-4d18-9d35-0b73c0c1fb27 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.336769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19f08e7c-b375-4d18-9d35-0b73c0c1fb27 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.519730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4cabc99b-e2b3-4118-96d9-3ed7b58513c0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:03.553723 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4cabc99b-e2b3-4118-96d9-3ed7b58513c0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.371656 Jul 20 04:32:03.558754 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2325/4736] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:03 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:03.570186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0be2a317-9d4c-4c09-8820-2f767e6627a9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:03.577941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0be2a317-9d4c-4c09-8820-2f767e6627a9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:03.591271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0be2a317-9d4c-4c09-8820-2f767e6627a9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.591986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0be2a317-9d4c-4c09-8820-2f767e6627a9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.594180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0be2a317-9d4c-4c09-8820-2f767e6627a9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.600398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0be2a317-9d4c-4c09-8820-2f767e6627a9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.807558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-19f08e7c-b375-4d18-9d35-0b73c0c1fb27 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:03.828548 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-19f08e7c-b375-4d18-9d35-0b73c0c1fb27 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.518337 Jul 20 04:32:03.830128 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2412/4737] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:03 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:03.846401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d2b8a787-4e4d-4f85-ae80-1c688fe6a167 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1133207826", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d2b8a787-4e4d-4f85-ae80-1c688fe6a167 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 235 Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1133207826", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1133207826', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '2601f58c-d54c-42c1-850f-a93d0087b3cf'}]}}} Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:03.863127 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d2b8a787-4e4d-4f85-ae80-1c688fe6a167 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d2b8a787-4e4d-4f85-ae80-1c688fe6a167 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.033792 Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2413/4738] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:03 2022] POST /compute/v2.1/servers => generated 133 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:32:03.871988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-182087f3-4ccb-45a1-8630-097d85339b4a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:03.873901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-182087f3-4ccb-45a1-8630-097d85339b4a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:03.895606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-182087f3-4ccb-45a1-8630-097d85339b4a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.896057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-182087f3-4ccb-45a1-8630-097d85339b4a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.897029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-182087f3-4ccb-45a1-8630-097d85339b4a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.897626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-182087f3-4ccb-45a1-8630-097d85339b4a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.031143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-182087f3-4ccb-45a1-8630-097d85339b4a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:04.041843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-182087f3-4ccb-45a1-8630-097d85339b4a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:04.043641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-182087f3-4ccb-45a1-8630-097d85339b4a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:04.044915 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-182087f3-4ccb-45a1-8630-097d85339b4a tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.178191 Jul 20 04:32:04.045749 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2414/4739] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:03 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:04.052292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bf981afd-bb55-4126-9cb9-cbc1a214f81e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:04.052987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bf981afd-bb55-4126-9cb9-cbc1a214f81e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:04.059155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf981afd-bb55-4126-9cb9-cbc1a214f81e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.059950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf981afd-bb55-4126-9cb9-cbc1a214f81e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.060529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf981afd-bb55-4126-9cb9-cbc1a214f81e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.061036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf981afd-bb55-4126-9cb9-cbc1a214f81e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.064312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0be2a317-9d4c-4c09-8820-2f767e6627a9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:04.076035 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0be2a317-9d4c-4c09-8820-2f767e6627a9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1309 microversion: 2.1 time: 0.515065 Jul 20 04:32:04.085907 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2326/4740] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:03 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1309 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:04.213383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bf981afd-bb55-4126-9cb9-cbc1a214f81e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:04.222229 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bf981afd-bb55-4126-9cb9-cbc1a214f81e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.175165 Jul 20 04:32:04.222814 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2415/4741] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:04 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:04.241310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-94e49c0d-e001-47a0-83e0-b41a5f65b10e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:04.242137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-94e49c0d-e001-47a0-83e0-b41a5f65b10e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:04.248964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94e49c0d-e001-47a0-83e0-b41a5f65b10e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.249440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94e49c0d-e001-47a0-83e0-b41a5f65b10e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.250351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94e49c0d-e001-47a0-83e0-b41a5f65b10e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.250790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94e49c0d-e001-47a0-83e0-b41a5f65b10e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.272031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:04.409761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-94e49c0d-e001-47a0-83e0-b41a5f65b10e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:04.418065 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-94e49c0d-e001-47a0-83e0-b41a5f65b10e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.181093 Jul 20 04:32:04.418921 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2327/4742] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:04 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:04.435998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7ecf57d2-edb4-44c7-a560-8d7cbf393860 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:04.437284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7ecf57d2-edb4-44c7-a560-8d7cbf393860 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: 3026d055-d2cd-4a7e-a9a9-653e18ea808b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:04.445444 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-7ecf57d2-edb4-44c7-a560-8d7cbf393860 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance 3026d055-d2cd-4a7e-a9a9-653e18ea808b could not be found. Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7ecf57d2-edb4-44c7-a560-8d7cbf393860 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/3026d055-d2cd-4a7e-a9a9-653e18ea808b/action HTTP/1.1 Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 13 Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: {"pause": {}} Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 3026d055-d2cd-4a7e-a9a9-653e18ea808b could not be found. Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '3026d055-d2cd-4a7e-a9a9-653e18ea808b', 'body': {'pause': {}}} Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3026d055-d2cd-4a7e-a9a9-653e18ea808b could not be found. Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3026d055-d2cd-4a7e-a9a9-653e18ea808b could not be found. Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:04.451604 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:04.457169 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:04.457169 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:04.457169 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3026d055-d2cd-4a7e-a9a9-653e18ea808b could not be found. Jul 20 04:32:04.457169 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:04.458814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7ecf57d2-edb4-44c7-a560-8d7cbf393860 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance 3026d055-d2cd-4a7e-a9a9-653e18ea808b could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:04.459882 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7ecf57d2-edb4-44c7-a560-8d7cbf393860 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/3026d055-d2cd-4a7e-a9a9-653e18ea808b/action" status: 404 len: 111 microversion: 2.1 time: 0.028950 Jul 20 04:32:04.460584 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2416/4743] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:04 2022] POST /compute/v2.1/servers/3026d055-d2cd-4a7e-a9a9-653e18ea808b/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:04.474664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e7ed352c-3731-4d2c-b704-37cec617e866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:04.475297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e7ed352c-3731-4d2c-b704-37cec617e866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:04.482844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:04.484158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7ed352c-3731-4d2c-b704-37cec617e866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.484626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7ed352c-3731-4d2c-b704-37cec617e866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.485423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7ed352c-3731-4d2c-b704-37cec617e866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.485867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7ed352c-3731-4d2c-b704-37cec617e866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.681823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e7ed352c-3731-4d2c-b704-37cec617e866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:04.692333 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e7ed352c-3731-4d2c-b704-37cec617e866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.226946 Jul 20 04:32:04.703594 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2328/4744] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:04 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:04.711742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f53f8210-8fd2-4ec4-9f64-1af612f48397 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:04.712639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f53f8210-8fd2-4ec4-9f64-1af612f48397 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:04.722469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f53f8210-8fd2-4ec4-9f64-1af612f48397 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.723179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f53f8210-8fd2-4ec4-9f64-1af612f48397 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.724034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f53f8210-8fd2-4ec4-9f64-1af612f48397 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.724455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f53f8210-8fd2-4ec4-9f64-1af612f48397 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.847658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b565def8-6836-4d1e-848f-8dff34ebb22e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:04.849133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b565def8-6836-4d1e-848f-8dff34ebb22e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:04.858676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b565def8-6836-4d1e-848f-8dff34ebb22e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.859698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b565def8-6836-4d1e-848f-8dff34ebb22e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.860786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b565def8-6836-4d1e-848f-8dff34ebb22e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.861629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b565def8-6836-4d1e-848f-8dff34ebb22e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.902275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f53f8210-8fd2-4ec4-9f64-1af612f48397 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:04.911889 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f53f8210-8fd2-4ec4-9f64-1af612f48397 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.203311 Jul 20 04:32:04.925159 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2417/4745] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:04 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:04.935009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eca51054-a755-4f8e-91eb-dfcedc2d1033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:04.936131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eca51054-a755-4f8e-91eb-dfcedc2d1033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:04.944053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eca51054-a755-4f8e-91eb-dfcedc2d1033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.944962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eca51054-a755-4f8e-91eb-dfcedc2d1033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.945990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eca51054-a755-4f8e-91eb-dfcedc2d1033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.946621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eca51054-a755-4f8e-91eb-dfcedc2d1033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.036526 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eca51054-a755-4f8e-91eb-dfcedc2d1033 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 202 len: 0 microversion: 2.1 time: 0.109076 Jul 20 04:32:05.038347 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2418/4746] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:04 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:32:05.050073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7d3cf5e2-1cdf-428a-9f87-ff4ccec985e5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:05.052899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7d3cf5e2-1cdf-428a-9f87-ff4ccec985e5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:05.061799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d3cf5e2-1cdf-428a-9f87-ff4ccec985e5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.062315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d3cf5e2-1cdf-428a-9f87-ff4ccec985e5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.063202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d3cf5e2-1cdf-428a-9f87-ff4ccec985e5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.063913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d3cf5e2-1cdf-428a-9f87-ff4ccec985e5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.106725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b565def8-6836-4d1e-848f-8dff34ebb22e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:05.118164 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b565def8-6836-4d1e-848f-8dff34ebb22e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1524 microversion: 2.1 time: 0.275047 Jul 20 04:32:05.119457 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2329/4747] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:04 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1524 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:05.152907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-28529d89-a819-49e0-a79f-632a263e4fc2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:05.153834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-28529d89-a819-49e0-a79f-632a263e4fc2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:05.160460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28529d89-a819-49e0-a79f-632a263e4fc2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.161375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28529d89-a819-49e0-a79f-632a263e4fc2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.162482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28529d89-a819-49e0-a79f-632a263e4fc2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.163071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28529d89-a819-49e0-a79f-632a263e4fc2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.285902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-28529d89-a819-49e0-a79f-632a263e4fc2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:05.298604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-28529d89-a819-49e0-a79f-632a263e4fc2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:05.301550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-28529d89-a819-49e0-a79f-632a263e4fc2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:05.302995 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-28529d89-a819-49e0-a79f-632a263e4fc2 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.178944 Jul 20 04:32:05.304237 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2330/4748] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:05 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:05.304932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7d3cf5e2-1cdf-428a-9f87-ff4ccec985e5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:05.310836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ad44ea03-02b6-4e28-8db7-f974a6b41c97 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:05.311725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ad44ea03-02b6-4e28-8db7-f974a6b41c97 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:05.314556 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7d3cf5e2-1cdf-428a-9f87-ff4ccec985e5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1511 microversion: 2.1 time: 0.271520 Jul 20 04:32:05.324096 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2419/4749] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:05 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:05.324350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad44ea03-02b6-4e28-8db7-f974a6b41c97 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.324350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad44ea03-02b6-4e28-8db7-f974a6b41c97 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.324350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad44ea03-02b6-4e28-8db7-f974a6b41c97 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.324350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad44ea03-02b6-4e28-8db7-f974a6b41c97 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.485067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ad44ea03-02b6-4e28-8db7-f974a6b41c97 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:05.494248 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ad44ea03-02b6-4e28-8db7-f974a6b41c97 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1309 microversion: 2.1 time: 0.188784 Jul 20 04:32:05.495107 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2331/4750] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:05 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1309 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:06.136609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b201974-5da8-41f8-988c-03d1bade6d44 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:06.137818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5b201974-5da8-41f8-988c-03d1bade6d44 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:06.146180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b201974-5da8-41f8-988c-03d1bade6d44 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.146878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b201974-5da8-41f8-988c-03d1bade6d44 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.147871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b201974-5da8-41f8-988c-03d1bade6d44 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.148310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b201974-5da8-41f8-988c-03d1bade6d44 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.293980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b201974-5da8-41f8-988c-03d1bade6d44 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:06.305107 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5b201974-5da8-41f8-988c-03d1bade6d44 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1504 microversion: 2.1 time: 0.171339 Jul 20 04:32:06.306220 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2420/4751] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:06 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:06.323809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1f0c0fea-25c1-429d-9262-220a2e36874f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:06.325076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1f0c0fea-25c1-429d-9262-220a2e36874f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:06.326073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-90f33c8e-b6a6-46ed-932e-d29b19439ffd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Action: 'create', calling method: .version_select at 0x7fbf9c24a310>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-12212140", "description": "tempest-description-141190065"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:06.332929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f0c0fea-25c1-429d-9262-220a2e36874f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.333661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f0c0fea-25c1-429d-9262-220a2e36874f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.334624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f0c0fea-25c1-429d-9262-220a2e36874f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.335226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f0c0fea-25c1-429d-9262-220a2e36874f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.417851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1f0c0fea-25c1-429d-9262-220a2e36874f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:06.429108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1f0c0fea-25c1-429d-9262-220a2e36874f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:06.430960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1f0c0fea-25c1-429d-9262-220a2e36874f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:06.432633 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1f0c0fea-25c1-429d-9262-220a2e36874f tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.112890 Jul 20 04:32:06.433901 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2332/4752] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:06 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:06.439100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9abd2fd4-5589-4ac8-a2dd-e0ca48ecd8b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:06.440608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9abd2fd4-5589-4ac8-a2dd-e0ca48ecd8b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:06.447264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9abd2fd4-5589-4ac8-a2dd-e0ca48ecd8b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.448075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9abd2fd4-5589-4ac8-a2dd-e0ca48ecd8b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.449099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9abd2fd4-5589-4ac8-a2dd-e0ca48ecd8b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.449751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9abd2fd4-5589-4ac8-a2dd-e0ca48ecd8b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.595185 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-90f33c8e-b6a6-46ed-932e-d29b19439ffd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.275331 Jul 20 04:32:06.597333 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2421/4753] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Jul 20 04:32:06 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:06.612309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dab0a952-2c6b-4b4b-b721-4ef5701bfaee tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:06.613541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dab0a952-2c6b-4b4b-b721-4ef5701bfaee tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:06.623174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dab0a952-2c6b-4b4b-b721-4ef5701bfaee tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.623790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dab0a952-2c6b-4b4b-b721-4ef5701bfaee tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.624912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dab0a952-2c6b-4b4b-b721-4ef5701bfaee tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.625453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dab0a952-2c6b-4b4b-b721-4ef5701bfaee tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.640229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9abd2fd4-5589-4ac8-a2dd-e0ca48ecd8b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:06.644087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:06.650277 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9abd2fd4-5589-4ac8-a2dd-e0ca48ecd8b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1491 microversion: 2.1 time: 0.215039 Jul 20 04:32:06.651176 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2333/4754] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:06 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1491 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:06.657059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5824ca6e-2729-42bc-a97d-42a5c3e60193 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-12212140"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:06.658790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5824ca6e-2729-42bc-a97d-42a5c3e60193 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:06.666433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5824ca6e-2729-42bc-a97d-42a5c3e60193 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.667494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5824ca6e-2729-42bc-a97d-42a5c3e60193 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.668520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5824ca6e-2729-42bc-a97d-42a5c3e60193 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.669151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5824ca6e-2729-42bc-a97d-42a5c3e60193 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.867057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dab0a952-2c6b-4b4b-b721-4ef5701bfaee tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:06.880376 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dab0a952-2c6b-4b4b-b721-4ef5701bfaee tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1309 microversion: 2.1 time: 0.279210 Jul 20 04:32:06.884371 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2422/4755] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:06 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:06.897427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b5320754-a9f3-4b32-8a4d-a85ab2eece4b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:06.899836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b5320754-a9f3-4b32-8a4d-a85ab2eece4b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:06.904883 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.network.security_group_api [None req-5824ca6e-2729-42bc-a97d-42a5c3e60193 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Adding security group cd06034f-e252-4309-88cc-11ab94174933 to port 92fae5a0-fed9-40e1-aa84-cac47de3dc23 Jul 20 04:32:06.924400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5320754-a9f3-4b32-8a4d-a85ab2eece4b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.925042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5320754-a9f3-4b32-8a4d-a85ab2eece4b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.926249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5320754-a9f3-4b32-8a4d-a85ab2eece4b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.926903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5320754-a9f3-4b32-8a4d-a85ab2eece4b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.964314 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-b5320754-a9f3-4b32-8a4d-a85ab2eece4b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Cannot 'pause' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state paused Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b5320754-a9f3-4b32-8a4d-a85ab2eece4b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action HTTP/1.1 Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 13 Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: {"pause": {}} Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: exception: Cannot 'pause' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state paused Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a2f3226f-82c7-4e50-9a7d-ca0721979912', 'body': {'pause': {}}} Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 in vm_state paused. Cannot pause while the instance is in this state. Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state paused Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:06.966234 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:06.971964 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:06.971964 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:06.971964 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:06.971964 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state paused Jul 20 04:32:06.971964 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:06.971964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b5320754-a9f3-4b32-8a4d-a85ab2eece4b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 409 to user: Cannot 'pause' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state paused {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:06.971964 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b5320754-a9f3-4b32-8a4d-a85ab2eece4b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 409 len: 143 microversion: 2.1 time: 0.080725 Jul 20 04:32:06.971964 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2423/4756] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:06 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 143 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:32:06.984260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91c6220c-4ef8-4287-8201-76fbfea57d74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:06.984821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91c6220c-4ef8-4287-8201-76fbfea57d74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:06.991423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91c6220c-4ef8-4287-8201-76fbfea57d74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.991902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91c6220c-4ef8-4287-8201-76fbfea57d74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.992682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91c6220c-4ef8-4287-8201-76fbfea57d74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.993115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91c6220c-4ef8-4287-8201-76fbfea57d74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:07.037440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:07.078855 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91c6220c-4ef8-4287-8201-76fbfea57d74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 202 len: 0 microversion: 2.1 time: 0.103698 Jul 20 04:32:07.085340 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2424/4757] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:06 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:32:07.100709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-72cf57a2-411a-41f0-8604-869c94085d41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:07.101849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-72cf57a2-411a-41f0-8604-869c94085d41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:07.112567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72cf57a2-411a-41f0-8604-869c94085d41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:07.113016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72cf57a2-411a-41f0-8604-869c94085d41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:07.114399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72cf57a2-411a-41f0-8604-869c94085d41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:07.114559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72cf57a2-411a-41f0-8604-869c94085d41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:07.786466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-72cf57a2-411a-41f0-8604-869c94085d41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:07.795270 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-72cf57a2-411a-41f0-8604-869c94085d41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1498 microversion: 2.1 time: 0.708266 Jul 20 04:32:07.795902 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2425/4758] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:07 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1498 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:07.801225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4189f8a5-66c6-4984-8431-5745b84c3523 req-ca36a4f3-d943-4f6e-a975-e9019a7588c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8167df7a-d77a-4e1e-ab7b-c7d2668bd76b", "name": "network-vif-plugged", "status": "completed", "tag": "852ae22e-b524-4fc4-95c2-589f911419d2"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:07.809808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4189f8a5-66c6-4984-8431-5745b84c3523 req-ca36a4f3-d943-4f6e-a975-e9019a7588c2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:07.810537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4189f8a5-66c6-4984-8431-5745b84c3523 req-ca36a4f3-d943-4f6e-a975-e9019a7588c2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:07.822964 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4189f8a5-66c6-4984-8431-5745b84c3523 req-ca36a4f3-d943-4f6e-a975-e9019a7588c2 service nova] Creating event network-vif-plugged:852ae22e-b524-4fc4-95c2-589f911419d2 for instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b on n-h1-764485-11 Jul 20 04:32:07.828547 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4189f8a5-66c6-4984-8431-5745b84c3523 req-ca36a4f3-d943-4f6e-a975-e9019a7588c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031081 Jul 20 04:32:07.829458 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2426/4759] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:07.839438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c293f66-b82d-4266-8372-6ee0568c65bf tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:07.840918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4c293f66-b82d-4266-8372-6ee0568c65bf tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:07.848995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c293f66-b82d-4266-8372-6ee0568c65bf tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:07.850539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c293f66-b82d-4266-8372-6ee0568c65bf tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:07.851715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c293f66-b82d-4266-8372-6ee0568c65bf tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:07.852381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c293f66-b82d-4266-8372-6ee0568c65bf tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:07.902219 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5824ca6e-2729-42bc-a97d-42a5c3e60193 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "POST /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5/action" status: 202 len: 0 microversion: 2.1 time: 1.249630 Jul 20 04:32:07.903698 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2334/4760] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:06 2022] POST /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5/action => generated 0 bytes in 1252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:32:07.910022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bc65953c-e681-4d8a-85f6-eaec7bfea39b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:07.910883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bc65953c-e681-4d8a-85f6-eaec7bfea39b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:07.924898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc65953c-e681-4d8a-85f6-eaec7bfea39b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:07.925697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc65953c-e681-4d8a-85f6-eaec7bfea39b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:07.927501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc65953c-e681-4d8a-85f6-eaec7bfea39b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:07.928179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc65953c-e681-4d8a-85f6-eaec7bfea39b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.004982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4c293f66-b82d-4266-8372-6ee0568c65bf tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:08.016404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4c293f66-b82d-4266-8372-6ee0568c65bf tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:08.018259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4c293f66-b82d-4266-8372-6ee0568c65bf tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:08.019972 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4c293f66-b82d-4266-8372-6ee0568c65bf tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.184761 Jul 20 04:32:08.020902 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2427/4761] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:07 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:08.025930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be2f1f15-1ae1-4e18-a29c-2cf10a7cbb4e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-12212140"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:08.027086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-be2f1f15-1ae1-4e18-a29c-2cf10a7cbb4e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:08.035215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be2f1f15-1ae1-4e18-a29c-2cf10a7cbb4e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.035987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be2f1f15-1ae1-4e18-a29c-2cf10a7cbb4e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.036980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be2f1f15-1ae1-4e18-a29c-2cf10a7cbb4e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.037596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be2f1f15-1ae1-4e18-a29c-2cf10a7cbb4e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.301696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bc65953c-e681-4d8a-85f6-eaec7bfea39b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:08.309753 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bc65953c-e681-4d8a-85f6-eaec7bfea39b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1309 microversion: 2.1 time: 0.404372 Jul 20 04:32:08.318554 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2335/4762] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:07 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1309 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:08.324568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0962690c-1a89-4dc6-8986-04ddb3a73178 req-34ea4d67-4500-44de-8a48-efe6e45cecd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44750009-3372-4838-91b8-69f3c34ca9c5", "tag": "92fae5a0-fed9-40e1-aa84-cac47de3dc23"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:08.334703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0962690c-1a89-4dc6-8986-04ddb3a73178 req-34ea4d67-4500-44de-8a48-efe6e45cecd0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.335435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0962690c-1a89-4dc6-8986-04ddb3a73178 req-34ea4d67-4500-44de-8a48-efe6e45cecd0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.351221 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0962690c-1a89-4dc6-8986-04ddb3a73178 req-34ea4d67-4500-44de-8a48-efe6e45cecd0 service nova] Creating event network-changed:92fae5a0-fed9-40e1-aa84-cac47de3dc23 for instance 44750009-3372-4838-91b8-69f3c34ca9c5 on n-h2-764485-11 Jul 20 04:32:08.357531 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0962690c-1a89-4dc6-8986-04ddb3a73178 req-34ea4d67-4500-44de-8a48-efe6e45cecd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037332 Jul 20 04:32:08.358578 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2336/4763] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:08.441758 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.network.security_group_api [None req-be2f1f15-1ae1-4e18-a29c-2cf10a7cbb4e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Removing security group cd06034f-e252-4309-88cc-11ab94174933 from port 92fae5a0-fed9-40e1-aa84-cac47de3dc23 Jul 20 04:32:08.813873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d6f0ffa1-dbab-44ca-ad0a-5dfd960befdd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:08.815215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d6f0ffa1-dbab-44ca-ad0a-5dfd960befdd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:08.823685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6f0ffa1-dbab-44ca-ad0a-5dfd960befdd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.824484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6f0ffa1-dbab-44ca-ad0a-5dfd960befdd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.825636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6f0ffa1-dbab-44ca-ad0a-5dfd960befdd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.826155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6f0ffa1-dbab-44ca-ad0a-5dfd960befdd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.161615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d6f0ffa1-dbab-44ca-ad0a-5dfd960befdd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:09.173108 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d6f0ffa1-dbab-44ca-ad0a-5dfd960befdd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.362677 Jul 20 04:32:09.175417 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2337/4764] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:08 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:09.196413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a702f4ed-2d0f-4257-8850-fddbc2d7a9b1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:09.197297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a702f4ed-2d0f-4257-8850-fddbc2d7a9b1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:09.207874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a702f4ed-2d0f-4257-8850-fddbc2d7a9b1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.208751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a702f4ed-2d0f-4257-8850-fddbc2d7a9b1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.211030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a702f4ed-2d0f-4257-8850-fddbc2d7a9b1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.211714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a702f4ed-2d0f-4257-8850-fddbc2d7a9b1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.373859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a702f4ed-2d0f-4257-8850-fddbc2d7a9b1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:09.389395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a702f4ed-2d0f-4257-8850-fddbc2d7a9b1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:09.392225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a702f4ed-2d0f-4257-8850-fddbc2d7a9b1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:09.393569 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a702f4ed-2d0f-4257-8850-fddbc2d7a9b1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.216013 Jul 20 04:32:09.394147 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2338/4765] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:09 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:09.402825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0159c405-ee25-47eb-9d96-3cd025fca052 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:09.405090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0159c405-ee25-47eb-9d96-3cd025fca052 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:09.405231 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-be2f1f15-1ae1-4e18-a29c-2cf10a7cbb4e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "POST /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5/action" status: 202 len: 0 microversion: 2.1 time: 1.382888 Jul 20 04:32:09.405848 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2428/4766] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:08 2022] POST /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5/action => generated 0 bytes in 1384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:32:09.410844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4fdf5b0c-8a72-4f8f-9d9e-cd1ac5921766 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:09.411463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4fdf5b0c-8a72-4f8f-9d9e-cd1ac5921766 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:09.415265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0159c405-ee25-47eb-9d96-3cd025fca052 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.415931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0159c405-ee25-47eb-9d96-3cd025fca052 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.418488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0159c405-ee25-47eb-9d96-3cd025fca052 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.418987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0159c405-ee25-47eb-9d96-3cd025fca052 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.426050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fdf5b0c-8a72-4f8f-9d9e-cd1ac5921766 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.426504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fdf5b0c-8a72-4f8f-9d9e-cd1ac5921766 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.427289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fdf5b0c-8a72-4f8f-9d9e-cd1ac5921766 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.427764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fdf5b0c-8a72-4f8f-9d9e-cd1ac5921766 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.712051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4fdf5b0c-8a72-4f8f-9d9e-cd1ac5921766 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:09.725191 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4fdf5b0c-8a72-4f8f-9d9e-cd1ac5921766 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1309 microversion: 2.1 time: 0.318306 Jul 20 04:32:09.725799 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2429/4767] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:09 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1309 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:09.733898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49054c27-ee7e-4bc7-a30f-8d1496d350b4 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Action: 'create', calling method: .version_select at 0x7fbf9c40c3a0>, body: {"pool": null} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:09.817392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0159c405-ee25-47eb-9d96-3cd025fca052 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:09.829714 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0159c405-ee25-47eb-9d96-3cd025fca052 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.434296 Jul 20 04:32:09.833521 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2339/4768] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:09 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:09.850127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96ae8228-41ae-481a-8f0d-79904afe0af6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:09.851572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96ae8228-41ae-481a-8f0d-79904afe0af6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:09.866031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96ae8228-41ae-481a-8f0d-79904afe0af6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.866848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96ae8228-41ae-481a-8f0d-79904afe0af6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.870416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96ae8228-41ae-481a-8f0d-79904afe0af6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.871122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96ae8228-41ae-481a-8f0d-79904afe0af6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.901729 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-96ae8228-41ae-481a-8f0d-79904afe0af6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96ae8228-41ae-481a-8f0d-79904afe0af6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac/action HTTP/1.1 Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 28 Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: {"reboot": {"type": "SOFT"}} Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'de2b9533-c850-4e02-afc0-68243a289fac', 'body': {'reboot': {'type': 'SOFT'}}} Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:09.926796 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:09.932274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:32:09.932274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:09.932274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:09.932274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:09.932274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:09.932274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:09.932274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:09.932274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:09.932274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:09.932274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:32:09.932274 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:09.935457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96ae8228-41ae-481a-8f0d-79904afe0af6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:09.936408 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-96ae8228-41ae-481a-8f0d-79904afe0af6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac/action" status: 404 len: 111 microversion: 2.1 time: 0.091378 Jul 20 04:32:09.939954 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2340/4769] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:09 2022] POST /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac/action => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:32:09.949125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b843d6fe-b3f3-4a06-ac23-f03bb038634a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:09.949764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b843d6fe-b3f3-4a06-ac23-f03bb038634a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:09.966922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b843d6fe-b3f3-4a06-ac23-f03bb038634a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.968145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b843d6fe-b3f3-4a06-ac23-f03bb038634a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.970329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b843d6fe-b3f3-4a06-ac23-f03bb038634a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.972375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b843d6fe-b3f3-4a06-ac23-f03bb038634a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.201756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b843d6fe-b3f3-4a06-ac23-f03bb038634a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:10.210506 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b843d6fe-b3f3-4a06-ac23-f03bb038634a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.267621 Jul 20 04:32:10.212080 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2341/4770] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:09 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:10.232452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-44905131-ff29-4eaa-a49c-701e90e40581 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:10.234154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-44905131-ff29-4eaa-a49c-701e90e40581 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:10.243207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44905131-ff29-4eaa-a49c-701e90e40581 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.244547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44905131-ff29-4eaa-a49c-701e90e40581 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.246263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44905131-ff29-4eaa-a49c-701e90e40581 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.254763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44905131-ff29-4eaa-a49c-701e90e40581 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.489134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-44905131-ff29-4eaa-a49c-701e90e40581 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:10.497597 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-44905131-ff29-4eaa-a49c-701e90e40581 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.270111 Jul 20 04:32:10.507595 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2342/4771] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:10 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:10.507595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e185c6ed-f855-4066-93ff-33d8339c28ca req-13844140-b47d-4252-bcf8-5dc766a3adaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44750009-3372-4838-91b8-69f3c34ca9c5", "tag": "92fae5a0-fed9-40e1-aa84-cac47de3dc23"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:10.515347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e185c6ed-f855-4066-93ff-33d8339c28ca req-13844140-b47d-4252-bcf8-5dc766a3adaf service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.515985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e185c6ed-f855-4066-93ff-33d8339c28ca req-13844140-b47d-4252-bcf8-5dc766a3adaf service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.531168 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e185c6ed-f855-4066-93ff-33d8339c28ca req-13844140-b47d-4252-bcf8-5dc766a3adaf service nova] Creating event network-changed:92fae5a0-fed9-40e1-aa84-cac47de3dc23 for instance 44750009-3372-4838-91b8-69f3c34ca9c5 on n-h2-764485-11 Jul 20 04:32:10.537907 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e185c6ed-f855-4066-93ff-33d8339c28ca req-13844140-b47d-4252-bcf8-5dc766a3adaf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037539 Jul 20 04:32:10.539185 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2343/4772] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:10.545007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe62372e-d59e-4d67-9703-ffe744232eb1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:10.546993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe62372e-d59e-4d67-9703-ffe744232eb1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:10.557774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe62372e-d59e-4d67-9703-ffe744232eb1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.559038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe62372e-d59e-4d67-9703-ffe744232eb1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.560777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe62372e-d59e-4d67-9703-ffe744232eb1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.562101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe62372e-d59e-4d67-9703-ffe744232eb1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.684382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe62372e-d59e-4d67-9703-ffe744232eb1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:10.698501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe62372e-d59e-4d67-9703-ffe744232eb1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:10.700110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe62372e-d59e-4d67-9703-ffe744232eb1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:10.701342 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe62372e-d59e-4d67-9703-ffe744232eb1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.160916 Jul 20 04:32:10.701926 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2344/4773] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:10 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:10.713870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6fcbd089-97ff-441b-b160-356b7e864cfa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:10.713870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6fcbd089-97ff-441b-b160-356b7e864cfa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: c878026d-bb3a-4bde-99e2-bb3e0361b95f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:10.719541 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-6fcbd089-97ff-441b-b160-356b7e864cfa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance c878026d-bb3a-4bde-99e2-bb3e0361b95f could not be found. Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6fcbd089-97ff-441b-b160-356b7e864cfa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/c878026d-bb3a-4bde-99e2-bb3e0361b95f/action HTTP/1.1 Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 28 Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: {"reboot": {"type": "SOFT"}} Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance c878026d-bb3a-4bde-99e2-bb3e0361b95f could not be found. Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'c878026d-bb3a-4bde-99e2-bb3e0361b95f', 'body': {'reboot': {'type': 'SOFT'}}} Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c878026d-bb3a-4bde-99e2-bb3e0361b95f could not be found. Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c878026d-bb3a-4bde-99e2-bb3e0361b95f could not be found. Jul 20 04:32:10.721909 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:10.726659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:10.726659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:10.726659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:10.726659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:10.726659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:10.726659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:10.726659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:10.726659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c878026d-bb3a-4bde-99e2-bb3e0361b95f could not be found. Jul 20 04:32:10.726659 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:10.726659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6fcbd089-97ff-441b-b160-356b7e864cfa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance c878026d-bb3a-4bde-99e2-bb3e0361b95f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:10.726659 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6fcbd089-97ff-441b-b160-356b7e864cfa tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/c878026d-bb3a-4bde-99e2-bb3e0361b95f/action" status: 404 len: 111 microversion: 2.1 time: 0.016081 Jul 20 04:32:10.726659 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2345/4774] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:10 2022] POST /compute/v2.1/servers/c878026d-bb3a-4bde-99e2-bb3e0361b95f/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:10.734169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe1861c2-dc8f-4819-895a-38b6936401b9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:10.734807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe1861c2-dc8f-4819-895a-38b6936401b9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:10.742816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe1861c2-dc8f-4819-895a-38b6936401b9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.743296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe1861c2-dc8f-4819-895a-38b6936401b9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.744193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe1861c2-dc8f-4819-895a-38b6936401b9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.744648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe1861c2-dc8f-4819-895a-38b6936401b9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:11.118237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe1861c2-dc8f-4819-895a-38b6936401b9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:11.130098 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe1861c2-dc8f-4819-895a-38b6936401b9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.400316 Jul 20 04:32:11.146128 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2346/4775] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:10 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:11.153221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-01b2944e-2934-44fb-9dfe-b3f5d013cfac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:11.155206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-01b2944e-2934-44fb-9dfe-b3f5d013cfac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:11.163240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01b2944e-2934-44fb-9dfe-b3f5d013cfac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:11.164008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01b2944e-2934-44fb-9dfe-b3f5d013cfac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:11.165013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01b2944e-2934-44fb-9dfe-b3f5d013cfac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:11.165607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01b2944e-2934-44fb-9dfe-b3f5d013cfac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:11.544149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-01b2944e-2934-44fb-9dfe-b3f5d013cfac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:11.555028 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-01b2944e-2934-44fb-9dfe-b3f5d013cfac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1490 microversion: 2.1 time: 0.406446 Jul 20 04:32:11.556456 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2347/4776] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:11 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1490 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:11.561413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e21b49b2-e342-4dfd-a674-64d17ca2382a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:11.562103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e21b49b2-e342-4dfd-a674-64d17ca2382a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:11.568998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e21b49b2-e342-4dfd-a674-64d17ca2382a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:11.569461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e21b49b2-e342-4dfd-a674-64d17ca2382a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:11.570622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e21b49b2-e342-4dfd-a674-64d17ca2382a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:11.571136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e21b49b2-e342-4dfd-a674-64d17ca2382a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:11.862449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e21b49b2-e342-4dfd-a674-64d17ca2382a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:11.875368 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e21b49b2-e342-4dfd-a674-64d17ca2382a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.317509 Jul 20 04:32:11.877152 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2348/4777] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:11 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:11.896263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b05d4ce0-42ca-4b3d-9441-c86230c6f2db tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:11.897155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b05d4ce0-42ca-4b3d-9441-c86230c6f2db tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:11.910408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b05d4ce0-42ca-4b3d-9441-c86230c6f2db tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:11.911604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b05d4ce0-42ca-4b3d-9441-c86230c6f2db tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:11.912590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b05d4ce0-42ca-4b3d-9441-c86230c6f2db tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:11.913189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b05d4ce0-42ca-4b3d-9441-c86230c6f2db tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.138067 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-49054c27-ee7e-4bc7-a30f-8d1496d350b4 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.410732 Jul 20 04:32:12.138679 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2430/4778] 10.222.0.20 () {60 vars in 1169 bytes} [Wed Jul 20 04:32:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:12.143921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4b953bfd-ee2e-404c-b2fd-624136a27a1d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:12.144760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4b953bfd-ee2e-404c-b2fd-624136a27a1d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:12.153754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b953bfd-ee2e-404c-b2fd-624136a27a1d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.154390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b953bfd-ee2e-404c-b2fd-624136a27a1d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.155321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b953bfd-ee2e-404c-b2fd-624136a27a1d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.156806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b953bfd-ee2e-404c-b2fd-624136a27a1d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.157269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b05d4ce0-42ca-4b3d-9441-c86230c6f2db tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:12.167646 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b05d4ce0-42ca-4b3d-9441-c86230c6f2db tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1489 microversion: 2.1 time: 0.276787 Jul 20 04:32:12.168485 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2349/4779] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:11 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1489 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:12.174305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86a3cec4-785b-49ed-9653-8d22e911717e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:12.176399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-86a3cec4-785b-49ed-9653-8d22e911717e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:12.184217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86a3cec4-785b-49ed-9653-8d22e911717e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.184900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86a3cec4-785b-49ed-9653-8d22e911717e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.185842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86a3cec4-785b-49ed-9653-8d22e911717e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.186723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86a3cec4-785b-49ed-9653-8d22e911717e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.205732 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-86a3cec4-785b-49ed-9653-8d22e911717e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86a3cec4-785b-49ed-9653-8d22e911717e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac/action HTTP/1.1 Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 65 Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'de2b9533-c850-4e02-afc0-68243a289fac', 'body': {'rebuild': {'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55'}}} Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 04:32:12.208239 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:32:12.214008 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:12.218292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86a3cec4-785b-49ed-9653-8d22e911717e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:12.219530 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-86a3cec4-785b-49ed-9653-8d22e911717e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac/action" status: 404 len: 111 microversion: 2.1 time: 0.049920 Jul 20 04:32:12.220454 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2350/4780] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:12 2022] POST /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:12.225643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d8bd8426-8344-4e28-97d7-bbc4b500f4c8 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.18"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:12.226958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d8bd8426-8344-4e28-97d7-bbc4b500f4c8 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:12.233653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8bd8426-8344-4e28-97d7-bbc4b500f4c8 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.234331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8bd8426-8344-4e28-97d7-bbc4b500f4c8 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.235305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8bd8426-8344-4e28-97d7-bbc4b500f4c8 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.236702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8bd8426-8344-4e28-97d7-bbc4b500f4c8 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.238924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4b953bfd-ee2e-404c-b2fd-624136a27a1d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:12.251130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4b953bfd-ee2e-404c-b2fd-624136a27a1d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:12.253483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4b953bfd-ee2e-404c-b2fd-624136a27a1d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:12.255322 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4b953bfd-ee2e-404c-b2fd-624136a27a1d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.115690 Jul 20 04:32:12.256330 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2431/4781] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:12 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:12.262103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-97f3fdd1-788d-4b7c-90dc-231307913d56 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:12.262715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-97f3fdd1-788d-4b7c-90dc-231307913d56 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:12.268549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8bd8426-8344-4e28-97d7-bbc4b500f4c8 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Acquired lock "refresh_cache-44750009-3372-4838-91b8-69f3c34ca9c5" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:32:12.269643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97f3fdd1-788d-4b7c-90dc-231307913d56 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.272649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97f3fdd1-788d-4b7c-90dc-231307913d56 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.273527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97f3fdd1-788d-4b7c-90dc-231307913d56 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.273977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97f3fdd1-788d-4b7c-90dc-231307913d56 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.969076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-97f3fdd1-788d-4b7c-90dc-231307913d56 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:12.977962 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-97f3fdd1-788d-4b7c-90dc-231307913d56 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1490 microversion: 2.1 time: 0.719933 Jul 20 04:32:12.983557 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2432/4782] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:12 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1490 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:12.983861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2397d70d-1b31-49bb-9250-e7b1941d7d38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:12.984631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2397d70d-1b31-49bb-9250-e7b1941d7d38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:12.991782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2397d70d-1b31-49bb-9250-e7b1941d7d38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.992510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2397d70d-1b31-49bb-9250-e7b1941d7d38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.993296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2397d70d-1b31-49bb-9250-e7b1941d7d38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.993740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2397d70d-1b31-49bb-9250-e7b1941d7d38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:13.255098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2397d70d-1b31-49bb-9250-e7b1941d7d38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:13.268908 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2397d70d-1b31-49bb-9250-e7b1941d7d38 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.287246 Jul 20 04:32:13.268908 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2433/4783] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:12 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:13.277288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b6de2216-85a9-46b9-9b28-e57f3e36b337 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:13.278168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b6de2216-85a9-46b9-9b28-e57f3e36b337 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:13.289007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6de2216-85a9-46b9-9b28-e57f3e36b337 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:13.289455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6de2216-85a9-46b9-9b28-e57f3e36b337 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:13.290233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6de2216-85a9-46b9-9b28-e57f3e36b337 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:13.290667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6de2216-85a9-46b9-9b28-e57f3e36b337 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:13.328991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b6de2216-85a9-46b9-9b28-e57f3e36b337 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:32:13.477365 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b6de2216-85a9-46b9-9b28-e57f3e36b337 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 204 len: 0 microversion: 2.1 time: 0.207540 Jul 20 04:32:13.483707 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2434/4784] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:32:13 2022] DELETE /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:32:13.517532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-534ceed0-4bbb-45e1-99f1-37df42abeed1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:13.519309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-534ceed0-4bbb-45e1-99f1-37df42abeed1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:13.550509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-534ceed0-4bbb-45e1-99f1-37df42abeed1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:13.551279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-534ceed0-4bbb-45e1-99f1-37df42abeed1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:13.552626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-534ceed0-4bbb-45e1-99f1-37df42abeed1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:13.553553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-534ceed0-4bbb-45e1-99f1-37df42abeed1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:13.715779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-534ceed0-4bbb-45e1-99f1-37df42abeed1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:13.739073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-534ceed0-4bbb-45e1-99f1-37df42abeed1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:13.743404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-534ceed0-4bbb-45e1-99f1-37df42abeed1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:13.748094 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-534ceed0-4bbb-45e1-99f1-37df42abeed1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.261352 Jul 20 04:32:13.766048 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2435/4785] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:13 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:13.776300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-029bbc1f-2fe2-43c1-9760-df9e00125dd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:13.777431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-029bbc1f-2fe2-43c1-9760-df9e00125dd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:13.788765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-029bbc1f-2fe2-43c1-9760-df9e00125dd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:13.789594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-029bbc1f-2fe2-43c1-9760-df9e00125dd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:13.791004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-029bbc1f-2fe2-43c1-9760-df9e00125dd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:13.791841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-029bbc1f-2fe2-43c1-9760-df9e00125dd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.077258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-029bbc1f-2fe2-43c1-9760-df9e00125dd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:14.086467 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-029bbc1f-2fe2-43c1-9760-df9e00125dd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.318505 Jul 20 04:32:14.088450 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2436/4786] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:13 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:14.106939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-969cbc9a-3b5f-492e-8d48-e1a9356588d3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:14.107706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-969cbc9a-3b5f-492e-8d48-e1a9356588d3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:14.114922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-969cbc9a-3b5f-492e-8d48-e1a9356588d3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.115466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-969cbc9a-3b5f-492e-8d48-e1a9356588d3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.116469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-969cbc9a-3b5f-492e-8d48-e1a9356588d3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.117014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-969cbc9a-3b5f-492e-8d48-e1a9356588d3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.415287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-969cbc9a-3b5f-492e-8d48-e1a9356588d3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:14.423184 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-969cbc9a-3b5f-492e-8d48-e1a9356588d3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1496 microversion: 2.1 time: 0.320883 Jul 20 04:32:14.424355 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2437/4787] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:14 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1496 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:14.432211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f667220b-5d9c-47eb-a6ce-0fd28a7cd419 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:14.434186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f667220b-5d9c-47eb-a6ce-0fd28a7cd419 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: 27ec111a-3928-42ee-8c94-360cd98e9385] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:14.440692 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f667220b-5d9c-47eb-a6ce-0fd28a7cd419 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance 27ec111a-3928-42ee-8c94-360cd98e9385 could not be found. Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f667220b-5d9c-47eb-a6ce-0fd28a7cd419 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/27ec111a-3928-42ee-8c94-360cd98e9385/action HTTP/1.1 Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 65 Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 27ec111a-3928-42ee-8c94-360cd98e9385 could not be found. Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '27ec111a-3928-42ee-8c94-360cd98e9385', 'body': {'rebuild': {'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55'}}} Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ec111a-3928-42ee-8c94-360cd98e9385 could not be found. Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:32:14.442462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ec111a-3928-42ee-8c94-360cd98e9385 could not be found. Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ec111a-3928-42ee-8c94-360cd98e9385 could not be found. Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f667220b-5d9c-47eb-a6ce-0fd28a7cd419 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance 27ec111a-3928-42ee-8c94-360cd98e9385 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:14.446675 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f667220b-5d9c-47eb-a6ce-0fd28a7cd419 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/27ec111a-3928-42ee-8c94-360cd98e9385/action" status: 404 len: 111 microversion: 2.1 time: 0.018573 Jul 20 04:32:14.450322 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2438/4788] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:14 2022] POST /compute/v2.1/servers/27ec111a-3928-42ee-8c94-360cd98e9385/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:14.459057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a41ef0f7-9374-426d-b9dc-91cdf6a717f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:14.460523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a41ef0f7-9374-426d-b9dc-91cdf6a717f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:14.468511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a41ef0f7-9374-426d-b9dc-91cdf6a717f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.478201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a41ef0f7-9374-426d-b9dc-91cdf6a717f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.479119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a41ef0f7-9374-426d-b9dc-91cdf6a717f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.479494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a41ef0f7-9374-426d-b9dc-91cdf6a717f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.611452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-d8bd8426-8344-4e28-97d7-bbc4b500f4c8 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Building network info cache for instance {{(pid=119807) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:32:14.787662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a41ef0f7-9374-426d-b9dc-91cdf6a717f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:14.795598 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a41ef0f7-9374-426d-b9dc-91cdf6a717f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.346765 Jul 20 04:32:14.796531 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2439/4789] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:14 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:14.814097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-0e09e842-7501-4147-b8e2-1dfd1602a3ca req-c83392bf-f8e4-4ce0-9ac9-69713de393d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44750009-3372-4838-91b8-69f3c34ca9c5", "tag": "92fae5a0-fed9-40e1-aa84-cac47de3dc23"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:14.822595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0e09e842-7501-4147-b8e2-1dfd1602a3ca req-c83392bf-f8e4-4ce0-9ac9-69713de393d5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.823368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0e09e842-7501-4147-b8e2-1dfd1602a3ca req-c83392bf-f8e4-4ce0-9ac9-69713de393d5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.838761 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-0e09e842-7501-4147-b8e2-1dfd1602a3ca req-c83392bf-f8e4-4ce0-9ac9-69713de393d5 service nova] Creating event network-changed:92fae5a0-fed9-40e1-aa84-cac47de3dc23 for instance 44750009-3372-4838-91b8-69f3c34ca9c5 on n-h2-764485-11 Jul 20 04:32:14.844997 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-0e09e842-7501-4147-b8e2-1dfd1602a3ca req-c83392bf-f8e4-4ce0-9ac9-69713de393d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034932 Jul 20 04:32:14.847124 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2440/4790] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:14.852988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a6352fbe-c985-4345-bf10-594d6e83984e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:14.854274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a6352fbe-c985-4345-bf10-594d6e83984e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:14.865536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6352fbe-c985-4345-bf10-594d6e83984e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.865999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6352fbe-c985-4345-bf10-594d6e83984e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.866792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6352fbe-c985-4345-bf10-594d6e83984e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.867235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6352fbe-c985-4345-bf10-594d6e83984e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:15.013333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a6352fbe-c985-4345-bf10-594d6e83984e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:15.030034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a6352fbe-c985-4345-bf10-594d6e83984e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:15.035402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a6352fbe-c985-4345-bf10-594d6e83984e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:15.037519 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a6352fbe-c985-4345-bf10-594d6e83984e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.188740 Jul 20 04:32:15.038829 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2441/4791] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:14 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:15.044981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3f655fd0-1ad7-401c-a735-31cef2d98ebe tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:15.045905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3f655fd0-1ad7-401c-a735-31cef2d98ebe tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:15.056587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f655fd0-1ad7-401c-a735-31cef2d98ebe tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:15.057395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f655fd0-1ad7-401c-a735-31cef2d98ebe tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:15.058504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f655fd0-1ad7-401c-a735-31cef2d98ebe tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:15.059189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f655fd0-1ad7-401c-a735-31cef2d98ebe tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:15.733132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3f655fd0-1ad7-401c-a735-31cef2d98ebe tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:15.739849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:15.749198 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3f655fd0-1ad7-401c-a735-31cef2d98ebe tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.708818 Jul 20 04:32:15.761859 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2442/4792] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:15 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:15.768173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c1b9ed4-830b-4df3-a3fc-b280a7c9d98d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:15.769021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9c1b9ed4-830b-4df3-a3fc-b280a7c9d98d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:15.777634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c1b9ed4-830b-4df3-a3fc-b280a7c9d98d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:15.778331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c1b9ed4-830b-4df3-a3fc-b280a7c9d98d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:15.779342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c1b9ed4-830b-4df3-a3fc-b280a7c9d98d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:15.780049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c1b9ed4-830b-4df3-a3fc-b280a7c9d98d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:15.809650 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c1b9ed4-830b-4df3-a3fc-b280a7c9d98d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/ips" status: 200 len: 151 microversion: 2.20 time: 0.046246 Jul 20 04:32:15.816677 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2443/4793] 10.222.0.20 () {60 vars in 1288 bytes} [Wed Jul 20 04:32:15 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:32:15.822493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df2d98c9-ebbc-4be5-a5c9-ac2ea61397ab tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:15.823197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df2d98c9-ebbc-4be5-a5c9-ac2ea61397ab tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:15.839956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df2d98c9-ebbc-4be5-a5c9-ac2ea61397ab tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:15.839956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df2d98c9-ebbc-4be5-a5c9-ac2ea61397ab tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:15.840738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df2d98c9-ebbc-4be5-a5c9-ac2ea61397ab tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:15.841143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df2d98c9-ebbc-4be5-a5c9-ac2ea61397ab tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:16.461581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df2d98c9-ebbc-4be5-a5c9-ac2ea61397ab tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:16.472082 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df2d98c9-ebbc-4be5-a5c9-ac2ea61397ab tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 200 len: 1496 microversion: 2.1 time: 0.653795 Jul 20 04:32:16.473666 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2444/4794] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:15 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 1496 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:16.481177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f188cef8-2789-46ce-9707-a4497d26bd8e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:16.482092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f188cef8-2789-46ce-9707-a4497d26bd8e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: 894bc650-535b-4114-bb11-ebb5da593c01] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:16.493742 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f188cef8-2789-46ce-9707-a4497d26bd8e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance 894bc650-535b-4114-bb11-ebb5da593c01 could not be found. Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f188cef8-2789-46ce-9707-a4497d26bd8e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/894bc650-535b-4114-bb11-ebb5da593c01/action HTTP/1.1 Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 15 Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: {"restore": {}} Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 894bc650-535b-4114-bb11-ebb5da593c01 could not be found. Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '894bc650-535b-4114-bb11-ebb5da593c01', 'body': {'restore': {}}} Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894bc650-535b-4114-bb11-ebb5da593c01 could not be found. Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894bc650-535b-4114-bb11-ebb5da593c01 could not be found. Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:16.496548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:16.501845 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:16.501845 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:16.501845 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894bc650-535b-4114-bb11-ebb5da593c01 could not be found. Jul 20 04:32:16.501845 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:16.503231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f188cef8-2789-46ce-9707-a4497d26bd8e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance 894bc650-535b-4114-bb11-ebb5da593c01 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:16.509287 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f188cef8-2789-46ce-9707-a4497d26bd8e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/894bc650-535b-4114-bb11-ebb5da593c01/action" status: 404 len: 111 microversion: 2.1 time: 0.033602 Jul 20 04:32:16.509902 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2445/4795] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:16 2022] POST /compute/v2.1/servers/894bc650-535b-4114-bb11-ebb5da593c01/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:16.518532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f3202871-654a-40de-8b59-bdba975ce588 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:16.519157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f3202871-654a-40de-8b59-bdba975ce588 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:16.531162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3202871-654a-40de-8b59-bdba975ce588 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:16.531646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3202871-654a-40de-8b59-bdba975ce588 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:16.533762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3202871-654a-40de-8b59-bdba975ce588 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:16.533762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3202871-654a-40de-8b59-bdba975ce588 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:16.562971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-d8bd8426-8344-4e28-97d7-bbc4b500f4c8 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Updating instance_info_cache with network_info: [{"id": "92fae5a0-fed9-40e1-aa84-cac47de3dc23", "address": "fa:16:3e:b3:e3:df", "network": {"id": "740bf1ad-16f0-4a85-9284-0887f4146119", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1619900003-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "116cfb4e5a1641e99cebbc25a71b268e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap92fae5a0-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:32:16.592657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8bd8426-8344-4e28-97d7-bbc4b500f4c8 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Releasing lock "refresh_cache-44750009-3372-4838-91b8-69f3c34ca9c5" {{(pid=119807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:32:16.593819 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d8bd8426-8344-4e28-97d7-bbc4b500f4c8 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "POST /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5/action" status: 202 len: 0 microversion: 2.1 time: 4.372238 Jul 20 04:32:16.599167 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2351/4796] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:12 2022] POST /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5/action => generated 0 bytes in 4378 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:32:16.604754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-38d986fe-aa04-4cbf-9467-81e46a7de1f5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:16.605695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-38d986fe-aa04-4cbf-9467-81e46a7de1f5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:16.614907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38d986fe-aa04-4cbf-9467-81e46a7de1f5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:16.615471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38d986fe-aa04-4cbf-9467-81e46a7de1f5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:16.616393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38d986fe-aa04-4cbf-9467-81e46a7de1f5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:16.616966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38d986fe-aa04-4cbf-9467-81e46a7de1f5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:16.904358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f3202871-654a-40de-8b59-bdba975ce588 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:16.922772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f3202871-654a-40de-8b59-bdba975ce588 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:16.928973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f3202871-654a-40de-8b59-bdba975ce588 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:16.934803 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f3202871-654a-40de-8b59-bdba975ce588 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1364 microversion: 2.47 time: 0.420660 Jul 20 04:32:16.948600 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2446/4797] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:16 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1364 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:16.961463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a5e5520-893a-467b-88e2-fd71d5cfbbcb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.18"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:17.258007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-38d986fe-aa04-4cbf-9467-81e46a7de1f5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:17.305699 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-38d986fe-aa04-4cbf-9467-81e46a7de1f5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.705061 Jul 20 04:32:17.307039 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2352/4798] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:16 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:17.313614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d6e59798-f143-45ac-90e3-cca4c7aa0ea0 req-cc18266e-debc-443d-9656-f7c3ce0b198f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8167df7a-d77a-4e1e-ab7b-c7d2668bd76b", "name": "network-vif-deleted", "tag": "852ae22e-b524-4fc4-95c2-589f911419d2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:17.327455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d6e59798-f143-45ac-90e3-cca4c7aa0ea0 req-cc18266e-debc-443d-9656-f7c3ce0b198f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:17.328183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d6e59798-f143-45ac-90e3-cca4c7aa0ea0 req-cc18266e-debc-443d-9656-f7c3ce0b198f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:17.346316 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d6e59798-f143-45ac-90e3-cca4c7aa0ea0 req-cc18266e-debc-443d-9656-f7c3ce0b198f service nova] Creating event network-vif-deleted:852ae22e-b524-4fc4-95c2-589f911419d2 for instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b on n-h1-764485-11 Jul 20 04:32:17.359324 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d6e59798-f143-45ac-90e3-cca4c7aa0ea0 req-cc18266e-debc-443d-9656-f7c3ce0b198f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048844 Jul 20 04:32:17.360896 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2353/4799] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:17.373806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d66835bd-46cd-4464-98ad-c147b007c375 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:17.374993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d66835bd-46cd-4464-98ad-c147b007c375 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:17.386060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d66835bd-46cd-4464-98ad-c147b007c375 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:17.386614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d66835bd-46cd-4464-98ad-c147b007c375 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:17.387818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d66835bd-46cd-4464-98ad-c147b007c375 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:17.388411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d66835bd-46cd-4464-98ad-c147b007c375 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:17.412676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:17.445965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a5e5520-893a-467b-88e2-fd71d5cfbbcb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:17.456941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5e5520-893a-467b-88e2-fd71d5cfbbcb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:17.458983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5e5520-893a-467b-88e2-fd71d5cfbbcb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:17.460668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5e5520-893a-467b-88e2-fd71d5cfbbcb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:17.461513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5e5520-893a-467b-88e2-fd71d5cfbbcb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.327493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d66835bd-46cd-4464-98ad-c147b007c375 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:18.337856 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d66835bd-46cd-4464-98ad-c147b007c375 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.975694 Jul 20 04:32:18.339106 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2354/4800] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:17 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:18.344117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ddd84686-793b-4095-a6c0-fa21f949ae75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:18.344933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ddd84686-793b-4095-a6c0-fa21f949ae75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:18.351977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddd84686-793b-4095-a6c0-fa21f949ae75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.352732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddd84686-793b-4095-a6c0-fa21f949ae75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.354603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddd84686-793b-4095-a6c0-fa21f949ae75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.355238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddd84686-793b-4095-a6c0-fa21f949ae75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.380583 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-ddd84686-793b-4095-a6c0-fa21f949ae75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ddd84686-793b-4095-a6c0-fa21f949ae75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b HTTP/1.1 Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '8167df7a-d77a-4e1e-ab7b-c7d2668bd76b'} Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:18.382589 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:18.387360 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:18.387360 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:18.387360 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:18.387360 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:18.387360 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:32:18.387360 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:18.389318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ddd84686-793b-4095-a6c0-fa21f949ae75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:18.390372 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ddd84686-793b-4095-a6c0-fa21f949ae75 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 404 len: 111 microversion: 2.1 time: 0.050059 Jul 20 04:32:18.391469 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2355/4801] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:18 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:18.397280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-97f76347-7d0e-4333-b5eb-5234cac2fc08 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:18.397909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-97f76347-7d0e-4333-b5eb-5234cac2fc08 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:18.404963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97f76347-7d0e-4333-b5eb-5234cac2fc08 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.405441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97f76347-7d0e-4333-b5eb-5234cac2fc08 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.406241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97f76347-7d0e-4333-b5eb-5234cac2fc08 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.406696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97f76347-7d0e-4333-b5eb-5234cac2fc08 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.430497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5e5520-893a-467b-88e2-fd71d5cfbbcb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Acquired lock "refresh_cache-44750009-3372-4838-91b8-69f3c34ca9c5" {{(pid=119808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:32:18.530546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-97f76347-7d0e-4333-b5eb-5234cac2fc08 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:18.545043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-97f76347-7d0e-4333-b5eb-5234cac2fc08 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:18.546890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-97f76347-7d0e-4333-b5eb-5234cac2fc08 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:18.549461 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-97f76347-7d0e-4333-b5eb-5234cac2fc08 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1370 microversion: 2.47 time: 0.156247 Jul 20 04:32:18.550264 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2356/4802] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:18 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:18.557477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f24ceb0a-640a-45e6-94e9-8ebf4f7f1bcb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:18.558308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f24ceb0a-640a-45e6-94e9-8ebf4f7f1bcb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:18.566047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f24ceb0a-640a-45e6-94e9-8ebf4f7f1bcb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.566831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f24ceb0a-640a-45e6-94e9-8ebf4f7f1bcb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.567826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f24ceb0a-640a-45e6-94e9-8ebf4f7f1bcb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.568339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f24ceb0a-640a-45e6-94e9-8ebf4f7f1bcb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.603836 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f24ceb0a-640a-45e6-94e9-8ebf4f7f1bcb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Cannot 'restore' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f24ceb0a-640a-45e6-94e9-8ebf4f7f1bcb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action HTTP/1.1 Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 15 Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: {"restore": {}} Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: exception: Cannot 'restore' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a2f3226f-82c7-4e50-9a7d-ca0721979912', 'body': {'restore': {}}} Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 in vm_state active. Cannot restore while the instance is in this state. Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:18.605333 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:18.609617 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:18.609617 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:18.609617 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:18.609617 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:32:18.609617 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:18.609617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f24ceb0a-640a-45e6-94e9-8ebf4f7f1bcb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 409 to user: Cannot 'restore' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:18.609617 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f24ceb0a-640a-45e6-94e9-8ebf4f7f1bcb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 409 len: 145 microversion: 2.1 time: 0.057374 Jul 20 04:32:18.615156 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2357/4803] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:18 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 145 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:32:18.624270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5047176f-d5d3-4da7-8abd-5498841bde44 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:18.624796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5047176f-d5d3-4da7-8abd-5498841bde44 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:18.641878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5047176f-d5d3-4da7-8abd-5498841bde44 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.642420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5047176f-d5d3-4da7-8abd-5498841bde44 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.643871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5047176f-d5d3-4da7-8abd-5498841bde44 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.644502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5047176f-d5d3-4da7-8abd-5498841bde44 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.715058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5047176f-d5d3-4da7-8abd-5498841bde44 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:32:18.883175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:18.892422 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5047176f-d5d3-4da7-8abd-5498841bde44 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 204 len: 0 microversion: 2.1 time: 0.280420 Jul 20 04:32:18.893147 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2358/4804] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:32:18 2022] DELETE /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:32:18.900034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0afa8d8e-9b20-41c6-b4b6-97ed0c2a5015 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:18.901317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0afa8d8e-9b20-41c6-b4b6-97ed0c2a5015 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:18.909817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0afa8d8e-9b20-41c6-b4b6-97ed0c2a5015 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.910609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0afa8d8e-9b20-41c6-b4b6-97ed0c2a5015 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.911461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0afa8d8e-9b20-41c6-b4b6-97ed0c2a5015 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.912420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0afa8d8e-9b20-41c6-b4b6-97ed0c2a5015 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:19.174069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0afa8d8e-9b20-41c6-b4b6-97ed0c2a5015 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:19.192474 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0afa8d8e-9b20-41c6-b4b6-97ed0c2a5015 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.297884 Jul 20 04:32:19.193940 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2359/4805] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:18 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:19.200444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-347612bc-0815-430d-975d-eafcdba9e71f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:19.201229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-347612bc-0815-430d-975d-eafcdba9e71f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:19.212253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-347612bc-0815-430d-975d-eafcdba9e71f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:19.213081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-347612bc-0815-430d-975d-eafcdba9e71f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:19.213922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-347612bc-0815-430d-975d-eafcdba9e71f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:19.214358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-347612bc-0815-430d-975d-eafcdba9e71f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:19.509985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-5a5e5520-893a-467b-88e2-fd71d5cfbbcb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Building network info cache for instance {{(pid=119808) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:32:19.526213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-347612bc-0815-430d-975d-eafcdba9e71f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:19.543362 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-347612bc-0815-430d-975d-eafcdba9e71f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1495 microversion: 2.1 time: 0.344357 Jul 20 04:32:19.553108 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2360/4806] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:19 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1495 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:19.570049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-833512b8-3b01-4cf9-aade-07d88110f564 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:19.570616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-833512b8-3b01-4cf9-aade-07d88110f564 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:19.584120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-833512b8-3b01-4cf9-aade-07d88110f564 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:19.584592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-833512b8-3b01-4cf9-aade-07d88110f564 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:19.585394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-833512b8-3b01-4cf9-aade-07d88110f564 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:19.585836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-833512b8-3b01-4cf9-aade-07d88110f564 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:19.631705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-833512b8-3b01-4cf9-aade-07d88110f564 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lazy-loading 'flavor' on Instance uuid c76d5764-986d-4d3f-806f-1f8b1c5a73c1 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:32:20.018785 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-833512b8-3b01-4cf9-aade-07d88110f564 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "POST /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/action" status: 202 len: 0 microversion: 2.20 time: 0.472853 Jul 20 04:32:20.022493 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2361/4807] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:32:19 2022] POST /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:32:20.026554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b7ac5b1-9e71-4247-b0c9-e2f8210830f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:20.027823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0b7ac5b1-9e71-4247-b0c9-e2f8210830f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:20.036542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b7ac5b1-9e71-4247-b0c9-e2f8210830f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.037006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b7ac5b1-9e71-4247-b0c9-e2f8210830f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.038051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b7ac5b1-9e71-4247-b0c9-e2f8210830f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.038293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b7ac5b1-9e71-4247-b0c9-e2f8210830f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.325878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0b7ac5b1-9e71-4247-b0c9-e2f8210830f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:20.338581 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0b7ac5b1-9e71-4247-b0c9-e2f8210830f1 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.317451 Jul 20 04:32:20.350575 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2362/4808] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:20 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:20.368548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8bec69a0-3f05-4dc7-bc73-a18005621694 req-d7cfe58e-138b-429d-94ea-b0bd27bec440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44750009-3372-4838-91b8-69f3c34ca9c5", "tag": "92fae5a0-fed9-40e1-aa84-cac47de3dc23"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:20.394673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8bec69a0-3f05-4dc7-bc73-a18005621694 req-d7cfe58e-138b-429d-94ea-b0bd27bec440 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.395131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8bec69a0-3f05-4dc7-bc73-a18005621694 req-d7cfe58e-138b-429d-94ea-b0bd27bec440 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.426358 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8bec69a0-3f05-4dc7-bc73-a18005621694 req-d7cfe58e-138b-429d-94ea-b0bd27bec440 service nova] Creating event network-changed:92fae5a0-fed9-40e1-aa84-cac47de3dc23 for instance 44750009-3372-4838-91b8-69f3c34ca9c5 on n-h2-764485-11 Jul 20 04:32:20.433492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-5a5e5520-893a-467b-88e2-fd71d5cfbbcb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Updating instance_info_cache with network_info: [{"id": "92fae5a0-fed9-40e1-aa84-cac47de3dc23", "address": "fa:16:3e:b3:e3:df", "network": {"id": "740bf1ad-16f0-4a85-9284-0887f4146119", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1619900003-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "116cfb4e5a1641e99cebbc25a71b268e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap92fae5a0-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119808) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:32:20.433982 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8bec69a0-3f05-4dc7-bc73-a18005621694 req-d7cfe58e-138b-429d-94ea-b0bd27bec440 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089932 Jul 20 04:32:20.435021 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2363/4809] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:20.449715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d660669d-50a4-4345-a73e-3dfc78494798 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:20.450508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d660669d-50a4-4345-a73e-3dfc78494798 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:20.457885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a5e5520-893a-467b-88e2-fd71d5cfbbcb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Releasing lock "refresh_cache-44750009-3372-4838-91b8-69f3c34ca9c5" {{(pid=119808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:32:20.459360 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a5e5520-893a-467b-88e2-fd71d5cfbbcb tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "POST /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5/action" status: 202 len: 0 microversion: 2.1 time: 3.508968 Jul 20 04:32:20.460829 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2447/4810] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:16 2022] POST /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5/action => generated 0 bytes in 3511 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:32:20.467377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88615993-e410-4654-984a-ea941f605b0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:20.468247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88615993-e410-4654-984a-ea941f605b0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:20.474928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d660669d-50a4-4345-a73e-3dfc78494798 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.475381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d660669d-50a4-4345-a73e-3dfc78494798 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.476211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d660669d-50a4-4345-a73e-3dfc78494798 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.476654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d660669d-50a4-4345-a73e-3dfc78494798 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.477103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88615993-e410-4654-984a-ea941f605b0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.477567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88615993-e410-4654-984a-ea941f605b0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.478382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88615993-e410-4654-984a-ea941f605b0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.478859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88615993-e410-4654-984a-ea941f605b0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.617832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d660669d-50a4-4345-a73e-3dfc78494798 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:20.629213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d660669d-50a4-4345-a73e-3dfc78494798 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:20.635023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d660669d-50a4-4345-a73e-3dfc78494798 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:20.636573 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d660669d-50a4-4345-a73e-3dfc78494798 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1370 microversion: 2.47 time: 0.200249 Jul 20 04:32:20.647217 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2364/4811] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:20 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:20.654714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6f1e9bb-ab12-45c1-aeec-95cec86073ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:20.655276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a6f1e9bb-ab12-45c1-aeec-95cec86073ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: 5236d5df-c4e2-4654-a7b9-ca1014f4274d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:20.662882 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a6f1e9bb-ab12-45c1-aeec-95cec86073ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance 5236d5df-c4e2-4654-a7b9-ca1014f4274d could not be found. Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6f1e9bb-ab12-45c1-aeec-95cec86073ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/5236d5df-c4e2-4654-a7b9-ca1014f4274d/action HTTP/1.1 Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 14 Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: {"resume": {}} Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 5236d5df-c4e2-4654-a7b9-ca1014f4274d could not be found. Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '5236d5df-c4e2-4654-a7b9-ca1014f4274d', 'body': {'resume': {}}} Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5236d5df-c4e2-4654-a7b9-ca1014f4274d could not be found. Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5236d5df-c4e2-4654-a7b9-ca1014f4274d could not be found. Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:20.669865 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:20.675191 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:20.675191 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:20.675191 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5236d5df-c4e2-4654-a7b9-ca1014f4274d could not be found. Jul 20 04:32:20.675191 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:20.677071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6f1e9bb-ab12-45c1-aeec-95cec86073ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance 5236d5df-c4e2-4654-a7b9-ca1014f4274d could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:20.677993 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a6f1e9bb-ab12-45c1-aeec-95cec86073ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/5236d5df-c4e2-4654-a7b9-ca1014f4274d/action" status: 404 len: 111 microversion: 2.1 time: 0.029884 Jul 20 04:32:20.678965 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2365/4812] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:20 2022] POST /compute/v2.1/servers/5236d5df-c4e2-4654-a7b9-ca1014f4274d/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:20.686654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b612124d-3589-4390-a0ea-42e5756dfbb4 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '.version_select at 0x7fbf9ddeab80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:20.774304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88615993-e410-4654-984a-ea941f605b0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:20.789754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88615993-e410-4654-984a-ea941f605b0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:20.791886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88615993-e410-4654-984a-ea941f605b0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:20.793916 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88615993-e410-4654-984a-ea941f605b0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1721 microversion: 2.20 time: 0.331542 Jul 20 04:32:20.794602 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2448/4813] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:20 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1721 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:20.799739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be435438-9c36-4b15-a95a-ff47efccd3cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:20.800708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-be435438-9c36-4b15-a95a-ff47efccd3cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:20.809204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be435438-9c36-4b15-a95a-ff47efccd3cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.830193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be435438-9c36-4b15-a95a-ff47efccd3cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.831279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be435438-9c36-4b15-a95a-ff47efccd3cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.831820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be435438-9c36-4b15-a95a-ff47efccd3cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.161399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-be435438-9c36-4b15-a95a-ff47efccd3cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:21.170335 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-be435438-9c36-4b15-a95a-ff47efccd3cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1495 microversion: 2.1 time: 0.374358 Jul 20 04:32:21.171239 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2449/4814] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:20 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1495 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:21.176954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-37c1d752-1f2b-4b98-a9ac-eb0d30e11906 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:21.177905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-37c1d752-1f2b-4b98-a9ac-eb0d30e11906 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:21.193114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37c1d752-1f2b-4b98-a9ac-eb0d30e11906 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.193775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37c1d752-1f2b-4b98-a9ac-eb0d30e11906 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.195471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37c1d752-1f2b-4b98-a9ac-eb0d30e11906 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.196114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37c1d752-1f2b-4b98-a9ac-eb0d30e11906 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.636689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-37c1d752-1f2b-4b98-a9ac-eb0d30e11906 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:21.647920 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-37c1d752-1f2b-4b98-a9ac-eb0d30e11906 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.475275 Jul 20 04:32:21.650245 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2450/4815] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:21 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:21.656787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-af4218aa-aaa2-41d8-9965-b56593725dc1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:21.657747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-af4218aa-aaa2-41d8-9965-b56593725dc1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:21.670101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af4218aa-aaa2-41d8-9965-b56593725dc1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.671400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af4218aa-aaa2-41d8-9965-b56593725dc1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.672309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af4218aa-aaa2-41d8-9965-b56593725dc1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.673556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af4218aa-aaa2-41d8-9965-b56593725dc1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.819083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af4218aa-aaa2-41d8-9965-b56593725dc1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:21.832950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af4218aa-aaa2-41d8-9965-b56593725dc1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:21.835354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af4218aa-aaa2-41d8-9965-b56593725dc1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:21.837269 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-af4218aa-aaa2-41d8-9965-b56593725dc1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1370 microversion: 2.47 time: 0.184877 Jul 20 04:32:21.850671 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2451/4816] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:21 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:32:21.860959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b26b2637-6f36-49ce-ba2e-17a19b07a13d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:21.861783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b26b2637-6f36-49ce-ba2e-17a19b07a13d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:21.868110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b26b2637-6f36-49ce-ba2e-17a19b07a13d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.868563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b26b2637-6f36-49ce-ba2e-17a19b07a13d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.869564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b26b2637-6f36-49ce-ba2e-17a19b07a13d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.870015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b26b2637-6f36-49ce-ba2e-17a19b07a13d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:22.282178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b26b2637-6f36-49ce-ba2e-17a19b07a13d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:22.296265 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b26b2637-6f36-49ce-ba2e-17a19b07a13d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.439657 Jul 20 04:32:22.297277 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2452/4817] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:21 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:22.302898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0ccdc58b-2749-4871-b6ac-1068d35acf60 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:22.303499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0ccdc58b-2749-4871-b6ac-1068d35acf60 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:22.320251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ccdc58b-2749-4871-b6ac-1068d35acf60 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:22.321639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ccdc58b-2749-4871-b6ac-1068d35acf60 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:22.322772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ccdc58b-2749-4871-b6ac-1068d35acf60 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:22.323427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ccdc58b-2749-4871-b6ac-1068d35acf60 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:23.087501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0ccdc58b-2749-4871-b6ac-1068d35acf60 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:23.102927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0ccdc58b-2749-4871-b6ac-1068d35acf60 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:23.104480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0ccdc58b-2749-4871-b6ac-1068d35acf60 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:23.105664 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0ccdc58b-2749-4871-b6ac-1068d35acf60 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1721 microversion: 2.20 time: 0.807352 Jul 20 04:32:23.115275 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2453/4818] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:22 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1721 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:23.115275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9685c99-5f03-4d8b-9209-b8b9f497af03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:23.115275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a9685c99-5f03-4d8b-9209-b8b9f497af03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:23.118104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9685c99-5f03-4d8b-9209-b8b9f497af03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.118561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9685c99-5f03-4d8b-9209-b8b9f497af03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:23.119335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9685c99-5f03-4d8b-9209-b8b9f497af03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.119865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9685c99-5f03-4d8b-9209-b8b9f497af03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:23.127578 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b612124d-3589-4390-a0ea-42e5756dfbb4 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/f669b237-84dc-47f1-9ab2-deb2d601d251" status: 202 len: 0 microversion: 2.1 time: 2.447191 Jul 20 04:32:23.128175 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2366/4819] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 04:32:20 2022] DELETE /compute/v2.1/os-floating-ips/f669b237-84dc-47f1-9ab2-deb2d601d251 => generated 0 bytes in 2449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:32:23.140384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-389f9170-642d-40cd-a5d4-beb9dbf489d9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:23.141271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-389f9170-642d-40cd-a5d4-beb9dbf489d9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:23.148560 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-389f9170-642d-40cd-a5d4-beb9dbf489d9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.149088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-389f9170-642d-40cd-a5d4-beb9dbf489d9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:23.149945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-389f9170-642d-40cd-a5d4-beb9dbf489d9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.150456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-389f9170-642d-40cd-a5d4-beb9dbf489d9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:23.189835 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-389f9170-642d-40cd-a5d4-beb9dbf489d9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Cannot 'resume' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-389f9170-642d-40cd-a5d4-beb9dbf489d9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action HTTP/1.1 Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 14 Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: {"resume": {}} Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: exception: Cannot 'resume' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a2f3226f-82c7-4e50-9a7d-ca0721979912', 'body': {'resume': {}}} Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 in vm_state active. Cannot resume while the instance is in this state. Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:23.193912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:23.198381 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:23.198381 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:23.198381 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:23.198381 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:32:23.198381 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:23.199473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-389f9170-642d-40cd-a5d4-beb9dbf489d9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 409 to user: Cannot 'resume' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:23.200381 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-389f9170-642d-40cd-a5d4-beb9dbf489d9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 409 len: 144 microversion: 2.1 time: 0.064544 Jul 20 04:32:23.200964 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2367/4820] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:23 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 144 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:32:23.206848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-196f9abf-5048-49b4-a585-ba56e521e13d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:23.207755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-196f9abf-5048-49b4-a585-ba56e521e13d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:23.217286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-196f9abf-5048-49b4-a585-ba56e521e13d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.218292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-196f9abf-5048-49b4-a585-ba56e521e13d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:23.219255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-196f9abf-5048-49b4-a585-ba56e521e13d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.220198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-196f9abf-5048-49b4-a585-ba56e521e13d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:23.309381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-196f9abf-5048-49b4-a585-ba56e521e13d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:23.318697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-196f9abf-5048-49b4-a585-ba56e521e13d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:23.320708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-196f9abf-5048-49b4-a585-ba56e521e13d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:23.322114 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-196f9abf-5048-49b4-a585-ba56e521e13d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1370 microversion: 2.47 time: 0.120059 Jul 20 04:32:23.334852 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2368/4821] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:23 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1370 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:23.339947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f375fe76-f853-4190-9321-0bdac6803519 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '.version_select at 0x7fbf9d3fb5e0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:23.474940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9685c99-5f03-4d8b-9209-b8b9f497af03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:23.496187 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a9685c99-5f03-4d8b-9209-b8b9f497af03 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1495 microversion: 2.1 time: 0.388406 Jul 20 04:32:23.513905 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2454/4822] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:23 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1495 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:23.522517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a0ca2aa0-1f52-4b59-94be-3fdfde896f0a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:23.523356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a0ca2aa0-1f52-4b59-94be-3fdfde896f0a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:23.531503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0ca2aa0-1f52-4b59-94be-3fdfde896f0a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.536455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0ca2aa0-1f52-4b59-94be-3fdfde896f0a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:23.538185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0ca2aa0-1f52-4b59-94be-3fdfde896f0a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.539887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0ca2aa0-1f52-4b59-94be-3fdfde896f0a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:23.872937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a0ca2aa0-1f52-4b59-94be-3fdfde896f0a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:23.881513 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a0ca2aa0-1f52-4b59-94be-3fdfde896f0a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.366168 Jul 20 04:32:23.882374 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2455/4823] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:23 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:23.899189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-27e73c7e-2eef-4a45-8d3f-fd4b49dafb5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:23.900256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-27e73c7e-2eef-4a45-8d3f-fd4b49dafb5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:23.903336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:23.908394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27e73c7e-2eef-4a45-8d3f-fd4b49dafb5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.909096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27e73c7e-2eef-4a45-8d3f-fd4b49dafb5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:23.910062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27e73c7e-2eef-4a45-8d3f-fd4b49dafb5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.910826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27e73c7e-2eef-4a45-8d3f-fd4b49dafb5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.063099 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f375fe76-f853-4190-9321-0bdac6803519 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cd06034f-e252-4309-88cc-11ab94174933" status: 202 len: 0 microversion: 2.1 time: 0.726660 Jul 20 04:32:24.064321 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2369/4824] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 04:32:23 2022] DELETE /compute/v2.1/os-security-groups/cd06034f-e252-4309-88cc-11ab94174933 => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:32:24.074749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ea9a6f0-029a-46a1-aa83-2b17f793be1e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:24.075593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ea9a6f0-029a-46a1-aa83-2b17f793be1e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:24.088782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ea9a6f0-029a-46a1-aa83-2b17f793be1e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.089815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ea9a6f0-029a-46a1-aa83-2b17f793be1e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.091016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ea9a6f0-029a-46a1-aa83-2b17f793be1e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.091410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ea9a6f0-029a-46a1-aa83-2b17f793be1e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.150163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ea9a6f0-029a-46a1-aa83-2b17f793be1e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:32:24.222955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:24.232135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-27e73c7e-2eef-4a45-8d3f-fd4b49dafb5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.242574 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-27e73c7e-2eef-4a45-8d3f-fd4b49dafb5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.347305 Jul 20 04:32:24.243941 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2456/4825] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:23 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:24.254755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b9f9a0c3-73af-4502-8bbb-ef8d37bb0cfd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:24.274145 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ea9a6f0-029a-46a1-aa83-2b17f793be1e tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "DELETE /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 204 len: 0 microversion: 2.1 time: 0.203650 Jul 20 04:32:24.274865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b9f9a0c3-73af-4502-8bbb-ef8d37bb0cfd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:24.278554 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2370/4826] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:32:24 2022] DELETE /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:32:24.285296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-29880484-7bf8-4b53-8a01-d1b5c13697ff tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:24.286237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-29880484-7bf8-4b53-8a01-d1b5c13697ff tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:24.288020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9f9a0c3-73af-4502-8bbb-ef8d37bb0cfd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.291425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9f9a0c3-73af-4502-8bbb-ef8d37bb0cfd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.292156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9f9a0c3-73af-4502-8bbb-ef8d37bb0cfd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.293746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29880484-7bf8-4b53-8a01-d1b5c13697ff tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.294415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29880484-7bf8-4b53-8a01-d1b5c13697ff tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.294648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9f9a0c3-73af-4502-8bbb-ef8d37bb0cfd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.295743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29880484-7bf8-4b53-8a01-d1b5c13697ff tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.296455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29880484-7bf8-4b53-8a01-d1b5c13697ff tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.636773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b9f9a0c3-73af-4502-8bbb-ef8d37bb0cfd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.643452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-29880484-7bf8-4b53-8a01-d1b5c13697ff tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.653146 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-29880484-7bf8-4b53-8a01-d1b5c13697ff tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1510 microversion: 2.1 time: 0.372897 Jul 20 04:32:24.654038 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2371/4827] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:24 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1510 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:24.659113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b9f9a0c3-73af-4502-8bbb-ef8d37bb0cfd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.660681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b9f9a0c3-73af-4502-8bbb-ef8d37bb0cfd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.662253 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b9f9a0c3-73af-4502-8bbb-ef8d37bb0cfd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1721 microversion: 2.20 time: 0.417380 Jul 20 04:32:24.662976 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2457/4828] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:24 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1721 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:24.672012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-146daaa4-6087-4c8d-9fbe-5c99cb9eed27 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:24.675115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4bf8f4b6-fa27-4635-b395-1b870236d04e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-146daaa4-6087-4c8d-9fbe-5c99cb9eed27 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 160 Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "2601f58c-d54c-42c1-850f-a93d0087b3cf"}]}} Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'server': {'name': '', 'imageRef': 'bd7de922-6028-4caa-9dbc-4c1d87dfda55', 'flavorRef': '452', 'networks': [{'uuid': '2601f58c-d54c-42c1-850f-a93d0087b3cf'}]}}} Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi '' Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:32:24.676187 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:32:24.680196 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:32:24.680196 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:32:24.680196 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:24.680196 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:24.680196 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:24.680196 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:24.680196 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:24.680196 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:24.680196 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:32:24.680196 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:32:24.680196 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:32:24.680196 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:24.680910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4bf8f4b6-fa27-4635-b395-1b870236d04e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:24.680989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-146daaa4-6087-4c8d-9fbe-5c99cb9eed27 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:24.680989 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-146daaa4-6087-4c8d-9fbe-5c99cb9eed27 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.015161 Jul 20 04:32:24.680989 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2372/4829] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:24 2022] POST /compute/v2.1/servers => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:32:24.685163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9f9cbb5b-52d8-4d3a-b0fa-d50b67867ee3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:24.685796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9f9cbb5b-52d8-4d3a-b0fa-d50b67867ee3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:24.686283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4bf8f4b6-fa27-4635-b395-1b870236d04e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.686743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4bf8f4b6-fa27-4635-b395-1b870236d04e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.687540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4bf8f4b6-fa27-4635-b395-1b870236d04e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.687991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4bf8f4b6-fa27-4635-b395-1b870236d04e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.696683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f9cbb5b-52d8-4d3a-b0fa-d50b67867ee3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.697155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f9cbb5b-52d8-4d3a-b0fa-d50b67867ee3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.701735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f9cbb5b-52d8-4d3a-b0fa-d50b67867ee3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.701735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f9cbb5b-52d8-4d3a-b0fa-d50b67867ee3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.802397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4bf8f4b6-fa27-4635-b395-1b870236d04e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.804714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9f9cbb5b-52d8-4d3a-b0fa-d50b67867ee3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.811961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4bf8f4b6-fa27-4635-b395-1b870236d04e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.812436 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9f9cbb5b-52d8-4d3a-b0fa-d50b67867ee3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1453 microversion: 2.1 time: 0.132627 Jul 20 04:32:24.819010 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2373/4830] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:24 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:24.819198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4bf8f4b6-fa27-4635-b395-1b870236d04e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.819198 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4bf8f4b6-fa27-4635-b395-1b870236d04e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1355 microversion: 2.47 time: 0.150412 Jul 20 04:32:24.827716 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2458/4831] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:24 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1355 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:24.832982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-077d8180-cf37-48d2-9303-ac95a3dee6eb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:24.833603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-077d8180-cf37-48d2-9303-ac95a3dee6eb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:24.840041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-077d8180-cf37-48d2-9303-ac95a3dee6eb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.840498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-077d8180-cf37-48d2-9303-ac95a3dee6eb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.841267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-077d8180-cf37-48d2-9303-ac95a3dee6eb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.841700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-077d8180-cf37-48d2-9303-ac95a3dee6eb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.890233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-59968815-c9e0-4e99-8210-0a20a2de2027 req-27ce4b04-39c8-4635-93ac-28f121063c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4805c1-47be-4944-b197-e890bf0e274e", "name": "network-vif-deleted", "tag": "3d384aef-2b54-48db-b94b-28e5cde2b682"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:24.899762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-59968815-c9e0-4e99-8210-0a20a2de2027 req-27ce4b04-39c8-4635-93ac-28f121063c14 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.900309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-59968815-c9e0-4e99-8210-0a20a2de2027 req-27ce4b04-39c8-4635-93ac-28f121063c14 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.912701 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-59968815-c9e0-4e99-8210-0a20a2de2027 req-27ce4b04-39c8-4635-93ac-28f121063c14 service nova] Creating event network-vif-deleted:3d384aef-2b54-48db-b94b-28e5cde2b682 for instance cb4805c1-47be-4944-b197-e890bf0e274e on n-h2-764485-11 Jul 20 04:32:24.918536 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-59968815-c9e0-4e99-8210-0a20a2de2027 req-27ce4b04-39c8-4635-93ac-28f121063c14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104321 Jul 20 04:32:24.919443 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2374/4832] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:24.925463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-902ce99a-cbd6-4f36-aa70-60715f7e86dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:24.926059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-902ce99a-cbd6-4f36-aa70-60715f7e86dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:24.932922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-902ce99a-cbd6-4f36-aa70-60715f7e86dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.933380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-902ce99a-cbd6-4f36-aa70-60715f7e86dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.934261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-902ce99a-cbd6-4f36-aa70-60715f7e86dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.934730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-902ce99a-cbd6-4f36-aa70-60715f7e86dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.983856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-077d8180-cf37-48d2-9303-ac95a3dee6eb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.989559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:24.994953 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-077d8180-cf37-48d2-9303-ac95a3dee6eb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.166143 Jul 20 04:32:24.999565 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2459/4833] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:24 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:25.000689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:25.004535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:25.005404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Searching by: {'deleted': False, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:32:25.012216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.012809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.013723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.014231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.037799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-902ce99a-cbd6-4f36-aa70-60715f7e86dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lazy-loading 'services' on Instance uuid bd8d5de4-7985-4933-8867-3352bf84a16b {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:32:25.131147 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-902ce99a-cbd6-4f36-aa70-60715f7e86dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/os-volume_attachments/f5797e04-3d29-41bf-b75d-d795e8529799" status: 202 len: 0 microversion: 2.1 time: 0.209096 Jul 20 04:32:25.132998 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2375/4834] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:32:24 2022] DELETE /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/os-volume_attachments/f5797e04-3d29-41bf-b75d-d795e8529799 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:32:25.139783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-107c59a0-2981-4281-af2c-3d991742e468 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:25.141023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-107c59a0-2981-4281-af2c-3d991742e468 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:25.149355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-107c59a0-2981-4281-af2c-3d991742e468 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.150575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-107c59a0-2981-4281-af2c-3d991742e468 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.153322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-107c59a0-2981-4281-af2c-3d991742e468 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.154861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:32:25.155663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-107c59a0-2981-4281-af2c-3d991742e468 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.274076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:25.281351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.282432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.294841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:25.296683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:25.347381 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c412faf6-d64f-43c5-b382-59926122435e tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 2704 microversion: 2.47 time: 0.350157 Jul 20 04:32:25.349018 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2460/4835] 10.222.0.20 () {60 vars in 1186 bytes} [Wed Jul 20 04:32:24 2022] GET /compute/v2.1/servers/detail => generated 2704 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:25.373096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4fc3655f-6487-43c0-aa7a-b331494d72ad tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:25.373850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4fc3655f-6487-43c0-aa7a-b331494d72ad tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:25.380701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fc3655f-6487-43c0-aa7a-b331494d72ad tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.381146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fc3655f-6487-43c0-aa7a-b331494d72ad tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.382201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fc3655f-6487-43c0-aa7a-b331494d72ad tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.382806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fc3655f-6487-43c0-aa7a-b331494d72ad tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.383925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-107c59a0-2981-4281-af2c-3d991742e468 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:25.394053 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-107c59a0-2981-4281-af2c-3d991742e468 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.259284 Jul 20 04:32:25.399559 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2376/4836] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:25 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:25.411463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0029cfa6-ef75-4b64-b9fd-f55b2ed89351 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:25.412321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0029cfa6-ef75-4b64-b9fd-f55b2ed89351 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: fc3a22f1-6c7a-4f9a-8f01-a696a24b54c6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:25.418424 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-0029cfa6-ef75-4b64-b9fd-f55b2ed89351 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance fc3a22f1-6c7a-4f9a-8f01-a696a24b54c6 could not be found. Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0029cfa6-ef75-4b64-b9fd-f55b2ed89351 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/fc3a22f1-6c7a-4f9a-8f01-a696a24b54c6/action HTTP/1.1 Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 14 Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: {"shelve": {}} Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance fc3a22f1-6c7a-4f9a-8f01-a696a24b54c6 could not be found. Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'fc3a22f1-6c7a-4f9a-8f01-a696a24b54c6', 'body': {'shelve': {}}} Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc3a22f1-6c7a-4f9a-8f01-a696a24b54c6 could not be found. Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc3a22f1-6c7a-4f9a-8f01-a696a24b54c6 could not be found. Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:25.424454 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:25.428437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:25.428437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:25.428437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc3a22f1-6c7a-4f9a-8f01-a696a24b54c6 could not be found. Jul 20 04:32:25.428437 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:25.428437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0029cfa6-ef75-4b64-b9fd-f55b2ed89351 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance fc3a22f1-6c7a-4f9a-8f01-a696a24b54c6 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:25.428437 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0029cfa6-ef75-4b64-b9fd-f55b2ed89351 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/fc3a22f1-6c7a-4f9a-8f01-a696a24b54c6/action" status: 404 len: 111 microversion: 2.1 time: 0.019921 Jul 20 04:32:25.428437 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2377/4837] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:25 2022] POST /compute/v2.1/servers/fc3a22f1-6c7a-4f9a-8f01-a696a24b54c6/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:25.435631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-465e8702-712c-4b7e-acfa-d9a42e1cfc18 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:25.436427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-465e8702-712c-4b7e-acfa-d9a42e1cfc18 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:25.448125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-465e8702-712c-4b7e-acfa-d9a42e1cfc18 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.448288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-465e8702-712c-4b7e-acfa-d9a42e1cfc18 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.449359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-465e8702-712c-4b7e-acfa-d9a42e1cfc18 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.450044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-465e8702-712c-4b7e-acfa-d9a42e1cfc18 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.621765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-465e8702-712c-4b7e-acfa-d9a42e1cfc18 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:25.630981 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-465e8702-712c-4b7e-acfa-d9a42e1cfc18 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.199629 Jul 20 04:32:25.631652 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2378/4838] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:25 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:25.649644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08118b32-757c-41cc-aef5-3a228831e558 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:25.650268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-08118b32-757c-41cc-aef5-3a228831e558 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:25.656817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08118b32-757c-41cc-aef5-3a228831e558 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.657282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08118b32-757c-41cc-aef5-3a228831e558 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.658123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08118b32-757c-41cc-aef5-3a228831e558 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.658594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08118b32-757c-41cc-aef5-3a228831e558 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.698589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4fc3655f-6487-43c0-aa7a-b331494d72ad tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:32:25.786550 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4fc3655f-6487-43c0-aa7a-b331494d72ad tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 204 len: 0 microversion: 2.47 time: 0.417840 Jul 20 04:32:25.790190 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2461/4839] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:32:25 2022] DELETE /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:32:25.794158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2e428101-a273-4fa5-a858-ce07d1f4d8b5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:25.794866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2e428101-a273-4fa5-a858-ce07d1f4d8b5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:25.802427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e428101-a273-4fa5-a858-ce07d1f4d8b5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.802889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e428101-a273-4fa5-a858-ce07d1f4d8b5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.803718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e428101-a273-4fa5-a858-ce07d1f4d8b5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.804163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e428101-a273-4fa5-a858-ce07d1f4d8b5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.827923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-08118b32-757c-41cc-aef5-3a228831e558 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:25.837670 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-08118b32-757c-41cc-aef5-3a228831e558 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.191999 Jul 20 04:32:25.838496 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2379/4840] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:25 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:25.854362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dd24796a-b23f-4567-b15e-0436d9d4ccca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:25.854989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dd24796a-b23f-4567-b15e-0436d9d4ccca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:25.862942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd24796a-b23f-4567-b15e-0436d9d4ccca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.862942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd24796a-b23f-4567-b15e-0436d9d4ccca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.863538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd24796a-b23f-4567-b15e-0436d9d4ccca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.864020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd24796a-b23f-4567-b15e-0436d9d4ccca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.024531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2e428101-a273-4fa5-a858-ce07d1f4d8b5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:26.040688 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2e428101-a273-4fa5-a858-ce07d1f4d8b5 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1510 microversion: 2.1 time: 0.251346 Jul 20 04:32:26.041647 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2462/4841] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:25 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:26.050279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d61aa0ce-7ea3-46d2-a7da-2883075448b0 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:26.050907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d61aa0ce-7ea3-46d2-a7da-2883075448b0 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:26.059064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d61aa0ce-7ea3-46d2-a7da-2883075448b0 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:26.059645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d61aa0ce-7ea3-46d2-a7da-2883075448b0 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.060508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d61aa0ce-7ea3-46d2-a7da-2883075448b0 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:26.060952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d61aa0ce-7ea3-46d2-a7da-2883075448b0 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.076433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dd24796a-b23f-4567-b15e-0436d9d4ccca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:26.086220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dd24796a-b23f-4567-b15e-0436d9d4ccca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:26.087549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dd24796a-b23f-4567-b15e-0436d9d4ccca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:26.089304 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dd24796a-b23f-4567-b15e-0436d9d4ccca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1721 microversion: 2.20 time: 0.238779 Jul 20 04:32:26.090284 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2380/4842] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:25 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:26.100321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f193424d-452d-446a-8374-440c0ef6e8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:26.100959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f193424d-452d-446a-8374-440c0ef6e8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:26.107346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f193424d-452d-446a-8374-440c0ef6e8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:26.108212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f193424d-452d-446a-8374-440c0ef6e8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.109503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f193424d-452d-446a-8374-440c0ef6e8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:26.109950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f193424d-452d-446a-8374-440c0ef6e8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.140817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d61aa0ce-7ea3-46d2-a7da-2883075448b0 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:26.149959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d61aa0ce-7ea3-46d2-a7da-2883075448b0 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:26.151479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d61aa0ce-7ea3-46d2-a7da-2883075448b0 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:26.153200 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d61aa0ce-7ea3-46d2-a7da-2883075448b0 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1361 microversion: 2.47 time: 0.110381 Jul 20 04:32:26.154518 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2463/4843] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:26 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1361 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:26.160273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c95b3e1-f404-463c-8ae1-40b2346a555a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:26.161155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6c95b3e1-f404-463c-8ae1-40b2346a555a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:26.167893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c95b3e1-f404-463c-8ae1-40b2346a555a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:26.168351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c95b3e1-f404-463c-8ae1-40b2346a555a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.169131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c95b3e1-f404-463c-8ae1-40b2346a555a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:26.169575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c95b3e1-f404-463c-8ae1-40b2346a555a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.196810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-6c95b3e1-f404-463c-8ae1-40b2346a555a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lazy-loading 'flavor' on Instance uuid a2f3226f-82c7-4e50-9a7d-ca0721979912 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:32:26.211997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f193424d-452d-446a-8374-440c0ef6e8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:26.233206 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f193424d-452d-446a-8374-440c0ef6e8b3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1453 microversion: 2.1 time: 0.141428 Jul 20 04:32:26.240633 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2381/4844] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:26 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:26.584908 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6c95b3e1-f404-463c-8ae1-40b2346a555a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 202 len: 0 microversion: 2.1 time: 0.428897 Jul 20 04:32:26.585601 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2464/4845] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:26 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:32:26.596862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-84d8f31b-2714-4d40-b981-f96916946b0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:26.597821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-84d8f31b-2714-4d40-b981-f96916946b0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:26.607714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84d8f31b-2714-4d40-b981-f96916946b0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:26.608578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84d8f31b-2714-4d40-b981-f96916946b0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.609373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84d8f31b-2714-4d40-b981-f96916946b0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:26.609979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-84d8f31b-2714-4d40-b981-f96916946b0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.778200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-84d8f31b-2714-4d40-b981-f96916946b0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:26.788013 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-84d8f31b-2714-4d40-b981-f96916946b0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1512 microversion: 2.1 time: 0.196734 Jul 20 04:32:26.810800 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2382/4846] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:26 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1512 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:27.060065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39aa130f-b945-4617-8413-a25d6f64a549 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:27.060707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-39aa130f-b945-4617-8413-a25d6f64a549 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:27.072933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39aa130f-b945-4617-8413-a25d6f64a549 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.080849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39aa130f-b945-4617-8413-a25d6f64a549 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.087354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39aa130f-b945-4617-8413-a25d6f64a549 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.088116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39aa130f-b945-4617-8413-a25d6f64a549 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.109588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ebd38e19-6005-4566-b456-990c98485dd1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:27.111076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ebd38e19-6005-4566-b456-990c98485dd1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:27.125668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ebd38e19-6005-4566-b456-990c98485dd1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.127456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ebd38e19-6005-4566-b456-990c98485dd1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.128284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ebd38e19-6005-4566-b456-990c98485dd1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.128726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ebd38e19-6005-4566-b456-990c98485dd1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.475961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ebd38e19-6005-4566-b456-990c98485dd1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.495095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ebd38e19-6005-4566-b456-990c98485dd1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.497672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ebd38e19-6005-4566-b456-990c98485dd1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.498946 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ebd38e19-6005-4566-b456-990c98485dd1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1721 microversion: 2.20 time: 0.394157 Jul 20 04:32:27.510193 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2383/4847] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:27 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1721 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:32:27.510540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c63e22f4-20f9-4077-a057-58a15118d0ac tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:27.511130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c63e22f4-20f9-4077-a057-58a15118d0ac tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:27.522826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39aa130f-b945-4617-8413-a25d6f64a549 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.526654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c63e22f4-20f9-4077-a057-58a15118d0ac tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.527828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c63e22f4-20f9-4077-a057-58a15118d0ac tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.528961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c63e22f4-20f9-4077-a057-58a15118d0ac tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.529965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c63e22f4-20f9-4077-a057-58a15118d0ac tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.533323 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39aa130f-b945-4617-8413-a25d6f64a549 tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1510 microversion: 2.1 time: 0.478414 Jul 20 04:32:27.536501 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2465/4848] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:27 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:27.547967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df085c8d-26a2-41fb-9413-3c2e9059c568 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:27.552400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df085c8d-26a2-41fb-9413-3c2e9059c568 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:27.566572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df085c8d-26a2-41fb-9413-3c2e9059c568 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.567301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df085c8d-26a2-41fb-9413-3c2e9059c568 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.568440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df085c8d-26a2-41fb-9413-3c2e9059c568 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.572978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df085c8d-26a2-41fb-9413-3c2e9059c568 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.617953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df085c8d-26a2-41fb-9413-3c2e9059c568 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.618568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df085c8d-26a2-41fb-9413-3c2e9059c568 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.619067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-df085c8d-26a2-41fb-9413-3c2e9059c568 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lazy-loading 'fault' on Instance uuid cb4805c1-47be-4944-b197-e890bf0e274e {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:32:27.637444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c63e22f4-20f9-4077-a057-58a15118d0ac tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.648986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c63e22f4-20f9-4077-a057-58a15118d0ac tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.650866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c63e22f4-20f9-4077-a057-58a15118d0ac tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.652112 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c63e22f4-20f9-4077-a057-58a15118d0ac tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1361 microversion: 2.47 time: 0.145647 Jul 20 04:32:27.652680 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2384/4849] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:27 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:27.684154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df085c8d-26a2-41fb-9413-3c2e9059c568 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.697499 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df085c8d-26a2-41fb-9413-3c2e9059c568 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 200 len: 1299 microversion: 2.1 time: 0.159702 Jul 20 04:32:27.698098 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2466/4850] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:27 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 1299 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:27.812069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5c5b9b04-e7f9-4415-ac79-41687b4804df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:27.815193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5c5b9b04-e7f9-4415-ac79-41687b4804df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:27.840519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c5b9b04-e7f9-4415-ac79-41687b4804df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.842312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c5b9b04-e7f9-4415-ac79-41687b4804df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.843182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c5b9b04-e7f9-4415-ac79-41687b4804df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.849589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c5b9b04-e7f9-4415-ac79-41687b4804df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.935647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-10ff1fa7-363f-46cd-adc4-8a906ad36d2f req-c0937f32-debe-4dea-956b-212a20bfee3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44750009-3372-4838-91b8-69f3c34ca9c5", "name": "network-vif-deleted", "tag": "92fae5a0-fed9-40e1-aa84-cac47de3dc23"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:27.949307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-10ff1fa7-363f-46cd-adc4-8a906ad36d2f req-c0937f32-debe-4dea-956b-212a20bfee3a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.949755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-10ff1fa7-363f-46cd-adc4-8a906ad36d2f req-c0937f32-debe-4dea-956b-212a20bfee3a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.974486 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-10ff1fa7-363f-46cd-adc4-8a906ad36d2f req-c0937f32-debe-4dea-956b-212a20bfee3a service nova] Creating event network-vif-deleted:92fae5a0-fed9-40e1-aa84-cac47de3dc23 for instance 44750009-3372-4838-91b8-69f3c34ca9c5 on n-h2-764485-11 Jul 20 04:32:27.983760 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-10ff1fa7-363f-46cd-adc4-8a906ad36d2f req-c0937f32-debe-4dea-956b-212a20bfee3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052591 Jul 20 04:32:27.984534 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2467/4851] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:32:28.105228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5c5b9b04-e7f9-4415-ac79-41687b4804df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:28.118290 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5c5b9b04-e7f9-4415-ac79-41687b4804df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1512 microversion: 2.1 time: 0.308940 Jul 20 04:32:28.128437 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2385/4852] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:27 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1512 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:28.520905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b706967-7793-4f5f-8c6e-b97e6e5f7fca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:28.522462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b706967-7793-4f5f-8c6e-b97e6e5f7fca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:28.529632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b706967-7793-4f5f-8c6e-b97e6e5f7fca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.530332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b706967-7793-4f5f-8c6e-b97e6e5f7fca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.531717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b706967-7793-4f5f-8c6e-b97e6e5f7fca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.532722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b706967-7793-4f5f-8c6e-b97e6e5f7fca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.551839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5c6f5d89-4e2d-43cd-984f-91605d8a46dd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:28.552534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5c6f5d89-4e2d-43cd-984f-91605d8a46dd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:28.560191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c6f5d89-4e2d-43cd-984f-91605d8a46dd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.560656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c6f5d89-4e2d-43cd-984f-91605d8a46dd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.561453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c6f5d89-4e2d-43cd-984f-91605d8a46dd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.561907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c6f5d89-4e2d-43cd-984f-91605d8a46dd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.600101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c6f5d89-4e2d-43cd-984f-91605d8a46dd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.600705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c6f5d89-4e2d-43cd-984f-91605d8a46dd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.601226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-5c6f5d89-4e2d-43cd-984f-91605d8a46dd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lazy-loading 'fault' on Instance uuid 44750009-3372-4838-91b8-69f3c34ca9c5 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:32:28.666225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5c6f5d89-4e2d-43cd-984f-91605d8a46dd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5e8cf752a4731b3ffb91e016a2a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116cfb4e5a1641e99cebbc25a71b268e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:28.676017 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5c6f5d89-4e2d-43cd-984f-91605d8a46dd tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 200 len: 1313 microversion: 2.1 time: 0.128117 Jul 20 04:32:28.676616 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2386/4853] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:28 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 1313 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:28.682543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-77f794ac-faff-4800-af51-0fdec5d9175d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:28.683168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-77f794ac-faff-4800-af51-0fdec5d9175d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:28.691294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77f794ac-faff-4800-af51-0fdec5d9175d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.691874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77f794ac-faff-4800-af51-0fdec5d9175d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.692979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77f794ac-faff-4800-af51-0fdec5d9175d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.693432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77f794ac-faff-4800-af51-0fdec5d9175d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.778598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-77f794ac-faff-4800-af51-0fdec5d9175d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:28.786317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b706967-7793-4f5f-8c6e-b97e6e5f7fca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:28.788455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-77f794ac-faff-4800-af51-0fdec5d9175d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:28.790230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-77f794ac-faff-4800-af51-0fdec5d9175d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:28.791815 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-77f794ac-faff-4800-af51-0fdec5d9175d tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 200 len: 1361 microversion: 2.47 time: 0.114211 Jul 20 04:32:28.792784 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2387/4854] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:28 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 1361 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:28.797688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9404a41c-5581-4b25-8d1e-2190e2a26000 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:28.799067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9404a41c-5581-4b25-8d1e-2190e2a26000 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:28.806149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9404a41c-5581-4b25-8d1e-2190e2a26000 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.806612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9404a41c-5581-4b25-8d1e-2190e2a26000 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.807408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9404a41c-5581-4b25-8d1e-2190e2a26000 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.807881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9404a41c-5581-4b25-8d1e-2190e2a26000 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.812698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b706967-7793-4f5f-8c6e-b97e6e5f7fca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:28.814976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b706967-7793-4f5f-8c6e-b97e6e5f7fca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:28.816618 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b706967-7793-4f5f-8c6e-b97e6e5f7fca tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1721 microversion: 2.20 time: 0.302557 Jul 20 04:32:28.825298 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-9404a41c-5581-4b25-8d1e-2190e2a26000 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:32:28.827194 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2468/4855] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:28 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9404a41c-5581-4b25-8d1e-2190e2a26000 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e HTTP/1.1 Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'cb4805c1-47be-4944-b197-e890bf0e274e'} Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:28.827953 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:28.833989 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:28.833989 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:28.833989 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:28.833989 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:28.833989 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:32:28.833989 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:28.833989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9404a41c-5581-4b25-8d1e-2190e2a26000 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:28.833989 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9404a41c-5581-4b25-8d1e-2190e2a26000 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 404 len: 111 microversion: 2.1 time: 0.035661 Jul 20 04:32:28.833989 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2388/4856] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:28 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:28.954333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-690494999", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "be069fc8-30ed-40bc-8dbd-2efb24615595"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:29.023329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] validate_networks() for [('be069fc8-30ed-40bc-8dbd-2efb24615595', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:32:29.137814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e14ea495-b0fa-4998-911d-4901029c7fba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:29.139413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e14ea495-b0fa-4998-911d-4901029c7fba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:29.155171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e14ea495-b0fa-4998-911d-4901029c7fba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.156522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e14ea495-b0fa-4998-911d-4901029c7fba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.161254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e14ea495-b0fa-4998-911d-4901029c7fba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.162009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e14ea495-b0fa-4998-911d-4901029c7fba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.521131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e14ea495-b0fa-4998-911d-4901029c7fba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:29.527748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:29.530194 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e14ea495-b0fa-4998-911d-4901029c7fba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1512 microversion: 2.1 time: 0.398956 Jul 20 04:32:29.535377 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2389/4857] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:29 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1512 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:29.658257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:32:29.658761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:32:29.659249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:32:29.660079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:32:29.660500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:32:29.671295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.671786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.672599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.673263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.692424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:29.702856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cf05e616-fa1e-4cbc-bbea-3701599e939a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:29.702856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cf05e616-fa1e-4cbc-bbea-3701599e939a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] [instance: 44750009-3372-4838-91b8-69f3c34ca9c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:29.703305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for user 7d38b1e323c5490fbb4c0023034874c8 and project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:29.708448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf05e616-fa1e-4cbc-bbea-3701599e939a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.708983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf05e616-fa1e-4cbc-bbea-3701599e939a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.710505 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf05e616-fa1e-4cbc-bbea-3701599e939a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.711069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf05e616-fa1e-4cbc-bbea-3701599e939a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.721007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:32:29.724684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:32:29.735991 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-cf05e616-fa1e-4cbc-bbea-3701599e939a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] HTTP exception thrown: Instance 44750009-3372-4838-91b8-69f3c34ca9c5 could not be found. Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cf05e616-fa1e-4cbc-bbea-3701599e939a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Request method failure captured: Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 HTTP/1.1 Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14UFckaVJdXEjT7DwyzDk783vJ_e2z5TaQHZWnCo-LIOgEa4mJjpLTTXScFlg-HbAO2kE11aSZYyDWDOBp0qP4aIv9sus6tzF8tIMP0huBx7UzZOIAOMQr5ed1jKUwl3L-XO5xPNRON7k6OA2kb0xE1-g_Sw6pf9ZBRx3ospkrZzdvk Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 116cfb4e5a1641e99cebbc25a71b268e Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-365198784 Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/116cfb4e5a1641e99cebbc25a71b268e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/116cfb4e5a1641e99cebbc25a71b268e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_116cfb4e5a1641e99cebbc25a71b268e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/116cfb4e5a1641e99cebbc25a71b268e"}]}] Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-365198784 Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 116cfb4e5a1641e99cebbc25a71b268e Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-365198784 Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerRescueTestJSONUnderV235-365198784-project Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: d5b5e8cf752a4731b3ffb91e016a2a8f Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-365198784-project Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 44750009-3372-4838-91b8-69f3c34ca9c5 could not be found. Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '44750009-3372-4838-91b8-69f3c34ca9c5'} Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44750009-3372-4838-91b8-69f3c34ca9c5 could not be found. Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44750009-3372-4838-91b8-69f3c34ca9c5 could not be found. Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:29.738959 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:29.743188 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:29.743188 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:29.743188 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:29.743188 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:29.743188 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:29.743188 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:29.743188 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44750009-3372-4838-91b8-69f3c34ca9c5 could not be found. Jul 20 04:32:29.743188 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:29.743188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cf05e616-fa1e-4cbc-bbea-3701599e939a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] Returning 404 to user: Instance 44750009-3372-4838-91b8-69f3c34ca9c5 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:29.743188 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cf05e616-fa1e-4cbc-bbea-3701599e939a tempest-ServerRescueTestJSONUnderV235-365198784 tempest-ServerRescueTestJSONUnderV235-365198784-project] 10.222.0.20 "GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5" status: 404 len: 111 microversion: 2.1 time: 0.050964 Jul 20 04:32:29.749447 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2390/4858] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:29 2022] GET /compute/v2.1/servers/44750009-3372-4838-91b8-69f3c34ca9c5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:32:29.811441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-548e1739-c309-446f-a0f8-92d05c6b8a84 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:29.812474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-548e1739-c309-446f-a0f8-92d05c6b8a84 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 6d940caa-2b63-41f1-a899-d84c066d57db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:29.820476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-548e1739-c309-446f-a0f8-92d05c6b8a84 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.821419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-548e1739-c309-446f-a0f8-92d05c6b8a84 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.822446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-548e1739-c309-446f-a0f8-92d05c6b8a84 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.823157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-548e1739-c309-446f-a0f8-92d05c6b8a84 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.832541 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-14ae1be5-cf57-455e-a1b6-27fef99e7b16 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882451 Jul 20 04:32:29.835936 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2469/4859] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:32:29.844362 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-548e1739-c309-446f-a0f8-92d05c6b8a84 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] HTTP exception thrown: Instance 6d940caa-2b63-41f1-a899-d84c066d57db could not be found. Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-548e1739-c309-446f-a0f8-92d05c6b8a84 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Request method failure captured: Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db HTTP/1.1 Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Uk4OM2zexQRJdp7QHX4zbM1EX_Ln9DBQWBjXbs4BcONqR2JhiABJFc_E0yJcWEtA-RkvYl7YWVIBxIhX4EnMsBgu2M2_9scyHxUSBZCkviUa3TZgSf6z6dh5DfPY2qkFa53llgFUVg3KVJtvcxhwiwD1oF34kzBpP_I0_m2U_h9WM Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: ee1c2f49111c495c99caf9057f1a5eba Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerShowV247Test-1852294755 Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee1c2f49111c495c99caf9057f1a5eba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee1c2f49111c495c99caf9057f1a5eba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee1c2f49111c495c99caf9057f1a5eba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee1c2f49111c495c99caf9057f1a5eba"}]}] Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerShowV247Test-1852294755 Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: ee1c2f49111c495c99caf9057f1a5eba Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerShowV247Test-1852294755 Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerShowV247Test-1852294755-project Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: e305572ed4a94f0f822be3f4f91fbd8e Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerShowV247Test-1852294755-project Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 6d940caa-2b63-41f1-a899-d84c066d57db could not be found. Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '6d940caa-2b63-41f1-a899-d84c066d57db'} Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d940caa-2b63-41f1-a899-d84c066d57db could not be found. Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d940caa-2b63-41f1-a899-d84c066d57db could not be found. Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:29.849289 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:29.854125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:29.854125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:29.854125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:29.854125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:29.854125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:29.854125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d940caa-2b63-41f1-a899-d84c066d57db could not be found. Jul 20 04:32:29.854125 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:29.854125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-548e1739-c309-446f-a0f8-92d05c6b8a84 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Returning 404 to user: Instance 6d940caa-2b63-41f1-a899-d84c066d57db could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:29.854125 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-548e1739-c309-446f-a0f8-92d05c6b8a84 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db" status: 404 len: 111 microversion: 2.47 time: 0.041577 Jul 20 04:32:29.854125 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2391/4860] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:29 2022] GET /compute/v2.1/servers/6d940caa-2b63-41f1-a899-d84c066d57db => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:32:29.864566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e6dc4089-7e2c-41a0-ab8e-131092f26935 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:29.865503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e6dc4089-7e2c-41a0-ab8e-131092f26935 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:29.879818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6dc4089-7e2c-41a0-ab8e-131092f26935 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.880586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6dc4089-7e2c-41a0-ab8e-131092f26935 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.881675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6dc4089-7e2c-41a0-ab8e-131092f26935 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.882395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6dc4089-7e2c-41a0-ab8e-131092f26935 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.893002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0d03eb1b-8576-48bb-85fb-7b29224856d4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:29.894636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0d03eb1b-8576-48bb-85fb-7b29224856d4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:30.050810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0d03eb1b-8576-48bb-85fb-7b29224856d4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.065562 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0d03eb1b-8576-48bb-85fb-7b29224856d4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1208 microversion: 2.1 time: 0.196018 Jul 20 04:32:30.066489 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2392/4861] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:29 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1208 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:30.082150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8f902d61-28e9-4b4a-b888-32ff5455ea11 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:30.082680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8f902d61-28e9-4b4a-b888-32ff5455ea11 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 8c07edb7-18cd-4424-8dfd-8b860c3d3929] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:30.091904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f902d61-28e9-4b4a-b888-32ff5455ea11 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.093327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f902d61-28e9-4b4a-b888-32ff5455ea11 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.094474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f902d61-28e9-4b4a-b888-32ff5455ea11 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.095748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f902d61-28e9-4b4a-b888-32ff5455ea11 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.125161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8f902d61-28e9-4b4a-b888-32ff5455ea11 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 8c07edb7-18cd-4424-8dfd-8b860c3d3929] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:32:30.261200 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8f902d61-28e9-4b4a-b888-32ff5455ea11 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929" status: 204 len: 0 microversion: 2.47 time: 0.193427 Jul 20 04:32:30.262110 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2393/4862] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:32:30 2022] DELETE /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:32:30.272728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a26936d-4522-4b27-a69c-aa10e5157693 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:30.273815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4a26936d-4522-4b27-a69c-aa10e5157693 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 8c07edb7-18cd-4424-8dfd-8b860c3d3929] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:30.280420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a26936d-4522-4b27-a69c-aa10e5157693 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.281170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a26936d-4522-4b27-a69c-aa10e5157693 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.282609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a26936d-4522-4b27-a69c-aa10e5157693 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.285080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a26936d-4522-4b27-a69c-aa10e5157693 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.499714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a26936d-4522-4b27-a69c-aa10e5157693 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.505649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e6dc4089-7e2c-41a0-ab8e-131092f26935 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.515280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a26936d-4522-4b27-a69c-aa10e5157693 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.520607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e6dc4089-7e2c-41a0-ab8e-131092f26935 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.520999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a26936d-4522-4b27-a69c-aa10e5157693 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.523143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e6dc4089-7e2c-41a0-ab8e-131092f26935 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.523925 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a26936d-4522-4b27-a69c-aa10e5157693 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929" status: 200 len: 1362 microversion: 2.47 time: 0.255889 Jul 20 04:32:30.537011 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2394/4863] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:30 2022] GET /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:30.538652 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e6dc4089-7e2c-41a0-ab8e-131092f26935 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1721 microversion: 2.20 time: 0.698615 Jul 20 04:32:30.542464 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2470/4864] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:29 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1721 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:30.556453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a8658c00-52c5-4779-aa7a-5faca1295d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:30.557625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a8658c00-52c5-4779-aa7a-5faca1295d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:30.582768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8658c00-52c5-4779-aa7a-5faca1295d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.585187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8658c00-52c5-4779-aa7a-5faca1295d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.587063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8658c00-52c5-4779-aa7a-5faca1295d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.588978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a8658c00-52c5-4779-aa7a-5faca1295d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.903313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a8658c00-52c5-4779-aa7a-5faca1295d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.912885 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a8658c00-52c5-4779-aa7a-5faca1295d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1512 microversion: 2.1 time: 0.364854 Jul 20 04:32:30.913735 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2395/4865] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:30 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:31.083752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-230fa345-e3be-4600-ac31-b367bd8692ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:31.085839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-230fa345-e3be-4600-ac31-b367bd8692ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:31.098878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-230fa345-e3be-4600-ac31-b367bd8692ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.100926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-230fa345-e3be-4600-ac31-b367bd8692ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.103000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-230fa345-e3be-4600-ac31-b367bd8692ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.103921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-230fa345-e3be-4600-ac31-b367bd8692ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.247291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-230fa345-e3be-4600-ac31-b367bd8692ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:31.257986 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-230fa345-e3be-4600-ac31-b367bd8692ec tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1204 microversion: 2.1 time: 0.179092 Jul 20 04:32:31.259635 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2471/4866] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:31 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1204 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:31.553514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-56c407ba-c8c7-4561-8532-ec7e335dba40 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:31.554565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-56c407ba-c8c7-4561-8532-ec7e335dba40 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 8c07edb7-18cd-4424-8dfd-8b860c3d3929] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:31.560996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56c407ba-c8c7-4561-8532-ec7e335dba40 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.561525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56c407ba-c8c7-4561-8532-ec7e335dba40 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.562309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56c407ba-c8c7-4561-8532-ec7e335dba40 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.562450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fab07899-ec3d-4363-8aab-7ef653ff0bfa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:31.562752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56c407ba-c8c7-4561-8532-ec7e335dba40 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.562943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fab07899-ec3d-4363-8aab-7ef653ff0bfa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:31.571378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fab07899-ec3d-4363-8aab-7ef653ff0bfa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.572067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fab07899-ec3d-4363-8aab-7ef653ff0bfa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.572847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fab07899-ec3d-4363-8aab-7ef653ff0bfa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.573439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fab07899-ec3d-4363-8aab-7ef653ff0bfa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.720693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-56c407ba-c8c7-4561-8532-ec7e335dba40 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:31.730294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-56c407ba-c8c7-4561-8532-ec7e335dba40 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:31.731833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-56c407ba-c8c7-4561-8532-ec7e335dba40 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:31.733058 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-56c407ba-c8c7-4561-8532-ec7e335dba40 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929" status: 200 len: 1362 microversion: 2.47 time: 0.191124 Jul 20 04:32:31.744735 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2396/4867] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:31 2022] GET /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:31.825894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5a4c764b-6abd-45f4-8bdc-6a716ac61db4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:31.832536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a4c764b-6abd-45f4-8bdc-6a716ac61db4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.833072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a4c764b-6abd-45f4-8bdc-6a716ac61db4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.856581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a4c764b-6abd-45f4-8bdc-6a716ac61db4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Going to try to stop instance {{(pid=119807) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:32:31.899942 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5a4c764b-6abd-45f4-8bdc-6a716ac61db4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "POST /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/action" status: 202 len: 0 microversion: 2.1 time: 0.077882 Jul 20 04:32:31.900568 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2397/4868] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:31 2022] POST /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:32:31.909276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5827acdf-631b-456d-9c5a-75678a2299f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:31.909984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5827acdf-631b-456d-9c5a-75678a2299f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:31.916307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5827acdf-631b-456d-9c5a-75678a2299f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.917192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5827acdf-631b-456d-9c5a-75678a2299f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.918035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5827acdf-631b-456d-9c5a-75678a2299f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.918487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5827acdf-631b-456d-9c5a-75678a2299f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:32.398048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fab07899-ec3d-4363-8aab-7ef653ff0bfa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:32.410675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fab07899-ec3d-4363-8aab-7ef653ff0bfa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:32.414671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fab07899-ec3d-4363-8aab-7ef653ff0bfa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:32.416304 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fab07899-ec3d-4363-8aab-7ef653ff0bfa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1721 microversion: 2.20 time: 0.859283 Jul 20 04:32:32.416951 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2472/4869] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:31 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1721 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:32:32.421785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9393e2ea-f055-4cc8-80a0-0417af45144e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:32.422632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9393e2ea-f055-4cc8-80a0-0417af45144e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:32.429970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9393e2ea-f055-4cc8-80a0-0417af45144e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:32.430734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9393e2ea-f055-4cc8-80a0-0417af45144e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:32.431725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9393e2ea-f055-4cc8-80a0-0417af45144e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:32.432569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9393e2ea-f055-4cc8-80a0-0417af45144e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:32.438179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:32.752130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5827acdf-631b-456d-9c5a-75678a2299f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:32.759858 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5827acdf-631b-456d-9c5a-75678a2299f4 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1674 microversion: 2.1 time: 0.854894 Jul 20 04:32:32.760448 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2398/4870] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:31 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1674 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:32.765202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c689b5b7-09a9-40a5-829d-667c1641b603 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:32.765810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c689b5b7-09a9-40a5-829d-667c1641b603 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:32.772626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c689b5b7-09a9-40a5-829d-667c1641b603 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:32.773078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c689b5b7-09a9-40a5-829d-667c1641b603 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:32.773848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c689b5b7-09a9-40a5-829d-667c1641b603 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:32.774282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c689b5b7-09a9-40a5-829d-667c1641b603 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:32.837339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9393e2ea-f055-4cc8-80a0-0417af45144e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:32.852064 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9393e2ea-f055-4cc8-80a0-0417af45144e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1512 microversion: 2.1 time: 0.433688 Jul 20 04:32:32.853953 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2473/4871] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:32 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:32.860242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:32.863340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 8c07edb7-18cd-4424-8dfd-8b860c3d3929] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:32.875261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:32.876453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:32.877592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:32.878106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:32.898313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c689b5b7-09a9-40a5-829d-667c1641b603 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:32.907841 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c689b5b7-09a9-40a5-829d-667c1641b603 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1266 microversion: 2.1 time: 0.145412 Jul 20 04:32:32.908477 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2399/4872] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:32 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:32.929334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:32.929935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:32.930590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lazy-loading 'fault' on Instance uuid 8c07edb7-18cd-4424-8dfd-8b860c3d3929 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:32:33.013702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:33.025126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:33.033464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305572ed4a94f0f822be3f4f91fbd8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1c2f49111c495c99caf9057f1a5eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:33.035312 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ec40672c-f625-40a9-92f6-53daa1165744 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929" status: 200 len: 1367 microversion: 2.47 time: 0.180055 Jul 20 04:32:33.045666 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2474/4873] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:32 2022] GET /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:33.434382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-35f9602f-51fa-4a84-809d-7ef515ad0c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:33.434969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-35f9602f-51fa-4a84-809d-7ef515ad0c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:33.441589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35f9602f-51fa-4a84-809d-7ef515ad0c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:33.442309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35f9602f-51fa-4a84-809d-7ef515ad0c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:33.443274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35f9602f-51fa-4a84-809d-7ef515ad0c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:33.443916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35f9602f-51fa-4a84-809d-7ef515ad0c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:33.777451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-35f9602f-51fa-4a84-809d-7ef515ad0c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:33.778473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c65cd26-f370-4805-89cf-ae1429eacaba tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:33.780567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4c65cd26-f370-4805-89cf-ae1429eacaba tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:33.795024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-35f9602f-51fa-4a84-809d-7ef515ad0c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:33.796558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c65cd26-f370-4805-89cf-ae1429eacaba tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:33.797023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c65cd26-f370-4805-89cf-ae1429eacaba tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:33.798404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c65cd26-f370-4805-89cf-ae1429eacaba tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:33.798922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c65cd26-f370-4805-89cf-ae1429eacaba tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:33.799316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-35f9602f-51fa-4a84-809d-7ef515ad0c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:33.800799 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-35f9602f-51fa-4a84-809d-7ef515ad0c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1721 microversion: 2.20 time: 0.370541 Jul 20 04:32:33.802089 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2400/4874] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:33 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1721 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:33.870316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7670a6b9-22d4-4d50-91f1-7e9a312ef135 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:33.871324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7670a6b9-22d4-4d50-91f1-7e9a312ef135 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:33.878321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7670a6b9-22d4-4d50-91f1-7e9a312ef135 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:33.878992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7670a6b9-22d4-4d50-91f1-7e9a312ef135 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:33.879948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7670a6b9-22d4-4d50-91f1-7e9a312ef135 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:33.880542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7670a6b9-22d4-4d50-91f1-7e9a312ef135 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.277371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7670a6b9-22d4-4d50-91f1-7e9a312ef135 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:34.292091 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7670a6b9-22d4-4d50-91f1-7e9a312ef135 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1512 microversion: 2.1 time: 0.425533 Jul 20 04:32:34.296446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4c65cd26-f370-4805-89cf-ae1429eacaba tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:34.309617 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2401/4875] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:33 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1512 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:34.312578 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4c65cd26-f370-4805-89cf-ae1429eacaba tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1674 microversion: 2.1 time: 0.538363 Jul 20 04:32:34.316893 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2475/4876] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:33 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1674 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:34.328399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d19bb2f-7cca-470b-b18d-deb6df55e8f1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:34.329496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d19bb2f-7cca-470b-b18d-deb6df55e8f1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] [instance: 8c07edb7-18cd-4424-8dfd-8b860c3d3929] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:34.337507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d19bb2f-7cca-470b-b18d-deb6df55e8f1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:34.338692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d19bb2f-7cca-470b-b18d-deb6df55e8f1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.340153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d19bb2f-7cca-470b-b18d-deb6df55e8f1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:34.340931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d19bb2f-7cca-470b-b18d-deb6df55e8f1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.356729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4b670795-c7f6-4da9-8ebb-04f12e86dd6b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:34.357517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4b670795-c7f6-4da9-8ebb-04f12e86dd6b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:34.359465 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-2d19bb2f-7cca-470b-b18d-deb6df55e8f1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] HTTP exception thrown: Instance 8c07edb7-18cd-4424-8dfd-8b860c3d3929 could not be found. Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d19bb2f-7cca-470b-b18d-deb6df55e8f1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Request method failure captured: Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929 HTTP/1.1 Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Uk4OM2zexQRJdp7QHX4zbM1EX_Ln9DBQWBjXbs4BcONqR2JhiABJFc_E0yJcWEtA-RkvYl7YWVIBxIhX4EnMsBgu2M2_9scyHxUSBZCkviUa3TZgSf6z6dh5DfPY2qkFa53llgFUVg3KVJtvcxhwiwD1oF34kzBpP_I0_m2U_h9WM Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: ee1c2f49111c495c99caf9057f1a5eba Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerShowV247Test-1852294755 Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee1c2f49111c495c99caf9057f1a5eba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee1c2f49111c495c99caf9057f1a5eba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee1c2f49111c495c99caf9057f1a5eba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee1c2f49111c495c99caf9057f1a5eba"}]}] Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerShowV247Test-1852294755 Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: ee1c2f49111c495c99caf9057f1a5eba Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerShowV247Test-1852294755 Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerShowV247Test-1852294755-project Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: e305572ed4a94f0f822be3f4f91fbd8e Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerShowV247Test-1852294755-project Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 8c07edb7-18cd-4424-8dfd-8b860c3d3929 could not be found. Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '8c07edb7-18cd-4424-8dfd-8b860c3d3929'} Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c07edb7-18cd-4424-8dfd-8b860c3d3929 could not be found. Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c07edb7-18cd-4424-8dfd-8b860c3d3929 could not be found. Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:34.365053 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:34.369955 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:34.369955 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:34.369955 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:34.369955 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:34.369955 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:34.369955 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c07edb7-18cd-4424-8dfd-8b860c3d3929 could not be found. Jul 20 04:32:34.369955 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:34.371630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d19bb2f-7cca-470b-b18d-deb6df55e8f1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] Returning 404 to user: Instance 8c07edb7-18cd-4424-8dfd-8b860c3d3929 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:34.372800 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d19bb2f-7cca-470b-b18d-deb6df55e8f1 tempest-ServerShowV247Test-1852294755 tempest-ServerShowV247Test-1852294755-project] 10.222.0.20 "GET /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929" status: 404 len: 111 microversion: 2.47 time: 0.054431 Jul 20 04:32:34.377106 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2476/4877] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:34 2022] GET /compute/v2.1/servers/8c07edb7-18cd-4424-8dfd-8b860c3d3929 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:32:34.391041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b670795-c7f6-4da9-8ebb-04f12e86dd6b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:34.393707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b670795-c7f6-4da9-8ebb-04f12e86dd6b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.398670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b670795-c7f6-4da9-8ebb-04f12e86dd6b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:34.399356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b670795-c7f6-4da9-8ebb-04f12e86dd6b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.818993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-86ef0107-daf7-4772-b7cb-abba056f95cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:34.820234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-86ef0107-daf7-4772-b7cb-abba056f95cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:34.832888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86ef0107-daf7-4772-b7cb-abba056f95cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:34.833549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86ef0107-daf7-4772-b7cb-abba056f95cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.834856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86ef0107-daf7-4772-b7cb-abba056f95cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:34.835879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86ef0107-daf7-4772-b7cb-abba056f95cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.838815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4b670795-c7f6-4da9-8ebb-04f12e86dd6b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:34.855388 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4b670795-c7f6-4da9-8ebb-04f12e86dd6b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1308 microversion: 2.1 time: 0.543064 Jul 20 04:32:34.856315 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2402/4878] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:34 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1308 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:35.314617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e61216c-06a3-4ace-b2d9-b45548ce6210 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:35.315581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7e61216c-06a3-4ace-b2d9-b45548ce6210 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:35.317913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:35.330827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e61216c-06a3-4ace-b2d9-b45548ce6210 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:35.331712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e61216c-06a3-4ace-b2d9-b45548ce6210 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:35.333056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e61216c-06a3-4ace-b2d9-b45548ce6210 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:35.333797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e61216c-06a3-4ace-b2d9-b45548ce6210 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:35.372350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-86ef0107-daf7-4772-b7cb-abba056f95cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:35.382423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-86ef0107-daf7-4772-b7cb-abba056f95cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:35.383987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-86ef0107-daf7-4772-b7cb-abba056f95cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:35.392964 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-86ef0107-daf7-4772-b7cb-abba056f95cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1721 microversion: 2.20 time: 0.577805 Jul 20 04:32:35.395059 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2477/4879] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:34 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1721 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:32:35.400059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-69415e3f-c662-4313-b00f-582bc44d65dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:35.406387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-69415e3f-c662-4313-b00f-582bc44d65dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:35.413303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69415e3f-c662-4313-b00f-582bc44d65dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:35.413841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69415e3f-c662-4313-b00f-582bc44d65dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:35.414543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69415e3f-c662-4313-b00f-582bc44d65dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:35.414992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69415e3f-c662-4313-b00f-582bc44d65dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:36.322238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7e61216c-06a3-4ace-b2d9-b45548ce6210 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:36.337184 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7e61216c-06a3-4ace-b2d9-b45548ce6210 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1512 microversion: 2.1 time: 1.025676 Jul 20 04:32:36.338368 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2403/4880] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:35 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1512 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:36.350975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-929b87c3-7e65-43aa-9f6d-ed77b039b560 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:36.353665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-929b87c3-7e65-43aa-9f6d-ed77b039b560 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:36.367876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-929b87c3-7e65-43aa-9f6d-ed77b039b560 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:36.369159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-929b87c3-7e65-43aa-9f6d-ed77b039b560 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:36.372367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-929b87c3-7e65-43aa-9f6d-ed77b039b560 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:36.372862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-929b87c3-7e65-43aa-9f6d-ed77b039b560 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:36.602294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-69415e3f-c662-4313-b00f-582bc44d65dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:36.625868 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-69415e3f-c662-4313-b00f-582bc44d65dc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1674 microversion: 2.1 time: 1.227212 Jul 20 04:32:36.626508 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2478/4881] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:35 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1674 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:36.639454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f617e608-69f1-4dba-b0b2-858125db2a8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:36.640377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f617e608-69f1-4dba-b0b2-858125db2a8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:36.660726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f617e608-69f1-4dba-b0b2-858125db2a8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:36.665224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f617e608-69f1-4dba-b0b2-858125db2a8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:36.666391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f617e608-69f1-4dba-b0b2-858125db2a8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:36.668780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f617e608-69f1-4dba-b0b2-858125db2a8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:36.945898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-929b87c3-7e65-43aa-9f6d-ed77b039b560 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:36.960222 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-929b87c3-7e65-43aa-9f6d-ed77b039b560 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.618609 Jul 20 04:32:36.968243 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2404/4882] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:36 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:36.983316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9af247e-62a3-4e89-9cf8-f1d1103a7446 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:36.983970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b9af247e-62a3-4e89-9cf8-f1d1103a7446 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:36.996938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9af247e-62a3-4e89-9cf8-f1d1103a7446 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:36.997395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9af247e-62a3-4e89-9cf8-f1d1103a7446 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:37.002998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9af247e-62a3-4e89-9cf8-f1d1103a7446 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:37.003464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9af247e-62a3-4e89-9cf8-f1d1103a7446 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:37.239166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f617e608-69f1-4dba-b0b2-858125db2a8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:37.255964 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f617e608-69f1-4dba-b0b2-858125db2a8c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1308 microversion: 2.1 time: 0.627908 Jul 20 04:32:37.257421 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2479/4883] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:36 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1308 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:37.270614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-37dc430d-b128-4e56-80e4-b675dc30849e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:37.271300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-37dc430d-b128-4e56-80e4-b675dc30849e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:37.283110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37dc430d-b128-4e56-80e4-b675dc30849e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:37.283998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37dc430d-b128-4e56-80e4-b675dc30849e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:37.285300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37dc430d-b128-4e56-80e4-b675dc30849e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:37.285903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37dc430d-b128-4e56-80e4-b675dc30849e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:37.340954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9af247e-62a3-4e89-9cf8-f1d1103a7446 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:37.355438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9af247e-62a3-4e89-9cf8-f1d1103a7446 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:37.360440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9af247e-62a3-4e89-9cf8-f1d1103a7446 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:37.361981 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b9af247e-62a3-4e89-9cf8-f1d1103a7446 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1742 microversion: 2.20 time: 0.387466 Jul 20 04:32:37.365978 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2405/4884] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:36 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1742 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:37.370868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e60c3d48-3132-40f9-95aa-50f0bf7e3e41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:37.371479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e60c3d48-3132-40f9-95aa-50f0bf7e3e41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:37.392358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e60c3d48-3132-40f9-95aa-50f0bf7e3e41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:37.398932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e60c3d48-3132-40f9-95aa-50f0bf7e3e41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:37.399726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e60c3d48-3132-40f9-95aa-50f0bf7e3e41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:37.404827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e60c3d48-3132-40f9-95aa-50f0bf7e3e41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:37.409706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:38.056237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e60c3d48-3132-40f9-95aa-50f0bf7e3e41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:38.078915 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e60c3d48-3132-40f9-95aa-50f0bf7e3e41 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1512 microversion: 2.1 time: 0.711592 Jul 20 04:32:38.082714 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2406/4885] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:37 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1512 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:38.090921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6cb75e0c-9006-4983-a269-394af39d581c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:38.091999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6cb75e0c-9006-4983-a269-394af39d581c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:38.104551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6cb75e0c-9006-4983-a269-394af39d581c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.106019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6cb75e0c-9006-4983-a269-394af39d581c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.106214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-37dc430d-b128-4e56-80e4-b675dc30849e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:38.107801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6cb75e0c-9006-4983-a269-394af39d581c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.112770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6cb75e0c-9006-4983-a269-394af39d581c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.117163 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-37dc430d-b128-4e56-80e4-b675dc30849e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.858427 Jul 20 04:32:38.138303 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2480/4886] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:37 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:38.144183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-30147311-5d6e-4c46-8b4c-723b9e1f02a8 req-d9acdde0-c80b-47e7-92b7-dd4522a49891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b6a337-9b96-4c0a-8858-5c456313b327", "tag": "18cda90d-44d1-42ea-ad83-c0374e60aceb"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:38.158609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-30147311-5d6e-4c46-8b4c-723b9e1f02a8 req-d9acdde0-c80b-47e7-92b7-dd4522a49891 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.162687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-30147311-5d6e-4c46-8b4c-723b9e1f02a8 req-d9acdde0-c80b-47e7-92b7-dd4522a49891 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.178666 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-30147311-5d6e-4c46-8b4c-723b9e1f02a8 req-d9acdde0-c80b-47e7-92b7-dd4522a49891 service nova] Creating event network-changed:18cda90d-44d1-42ea-ad83-c0374e60aceb for instance f0b6a337-9b96-4c0a-8858-5c456313b327 on n-h2-764485-11 Jul 20 04:32:38.187160 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-30147311-5d6e-4c46-8b4c-723b9e1f02a8 req-d9acdde0-c80b-47e7-92b7-dd4522a49891 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046760 Jul 20 04:32:38.188274 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2481/4887] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:38.199016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-229f110d-3f43-45ca-93b1-3bbe45d3325b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:38.199833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-229f110d-3f43-45ca-93b1-3bbe45d3325b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:38.207702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-229f110d-3f43-45ca-93b1-3bbe45d3325b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.208191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-229f110d-3f43-45ca-93b1-3bbe45d3325b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.209341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-229f110d-3f43-45ca-93b1-3bbe45d3325b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.209883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-229f110d-3f43-45ca-93b1-3bbe45d3325b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.559089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6cb75e0c-9006-4983-a269-394af39d581c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:38.566751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-229f110d-3f43-45ca-93b1-3bbe45d3325b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:38.582078 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6cb75e0c-9006-4983-a269-394af39d581c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1674 microversion: 2.1 time: 0.497927 Jul 20 04:32:38.582699 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2407/4888] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:38 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1674 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:38.593208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5526a220-8a36-4bcf-9ac3-065dad686e3f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:38.594004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5526a220-8a36-4bcf-9ac3-065dad686e3f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:38.604558 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-229f110d-3f43-45ca-93b1-3bbe45d3325b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.410895 Jul 20 04:32:38.609072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5526a220-8a36-4bcf-9ac3-065dad686e3f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.609765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5526a220-8a36-4bcf-9ac3-065dad686e3f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.613839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5526a220-8a36-4bcf-9ac3-065dad686e3f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.614683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5526a220-8a36-4bcf-9ac3-065dad686e3f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.617178 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2482/4889] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:38 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:38.630035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-502986ef-92cf-4a66-91da-18bc8b0a5b26 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:38.631610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-502986ef-92cf-4a66-91da-18bc8b0a5b26 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:38.638593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-502986ef-92cf-4a66-91da-18bc8b0a5b26 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.639340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-502986ef-92cf-4a66-91da-18bc8b0a5b26 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.640415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-502986ef-92cf-4a66-91da-18bc8b0a5b26 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.641067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-502986ef-92cf-4a66-91da-18bc8b0a5b26 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.956974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-502986ef-92cf-4a66-91da-18bc8b0a5b26 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:38.959835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5526a220-8a36-4bcf-9ac3-065dad686e3f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:38.974383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-502986ef-92cf-4a66-91da-18bc8b0a5b26 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:38.979490 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5526a220-8a36-4bcf-9ac3-065dad686e3f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1308 microversion: 2.1 time: 0.395444 Jul 20 04:32:38.982855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-502986ef-92cf-4a66-91da-18bc8b0a5b26 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:38.983562 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2408/4890] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:38 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1308 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:38.987110 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-502986ef-92cf-4a66-91da-18bc8b0a5b26 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1742 microversion: 2.20 time: 0.368365 Jul 20 04:32:39.004314 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2483/4891] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:38 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1742 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:39.007344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9d26a38a-5aa3-4a6a-8b19-d8709f25a291 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:39.008343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9d26a38a-5aa3-4a6a-8b19-d8709f25a291 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:39.020274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d26a38a-5aa3-4a6a-8b19-d8709f25a291 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.021104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d26a38a-5aa3-4a6a-8b19-d8709f25a291 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.022155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d26a38a-5aa3-4a6a-8b19-d8709f25a291 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.022839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d26a38a-5aa3-4a6a-8b19-d8709f25a291 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.100029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d797c38-8c12-4dd5-8da0-4acde4509144 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:39.100692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d797c38-8c12-4dd5-8da0-4acde4509144 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:39.116869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d797c38-8c12-4dd5-8da0-4acde4509144 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.117519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d797c38-8c12-4dd5-8da0-4acde4509144 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.118940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d797c38-8c12-4dd5-8da0-4acde4509144 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.119952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d797c38-8c12-4dd5-8da0-4acde4509144 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.305099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9d26a38a-5aa3-4a6a-8b19-d8709f25a291 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:39.317192 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9d26a38a-5aa3-4a6a-8b19-d8709f25a291 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.332098 Jul 20 04:32:39.318254 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2409/4892] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:38 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:39.358318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2d797c38-8c12-4dd5-8da0-4acde4509144 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:39.370016 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d797c38-8c12-4dd5-8da0-4acde4509144 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1512 microversion: 2.1 time: 0.275562 Jul 20 04:32:39.371966 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2484/4893] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:39 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:39.530151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-399162622", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "1a7e8d9c-f123-4816-a77b-51f1b199a341"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:39.601456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ac0568b9-0677-486d-b04e-1e11dad28837 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:39.602628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ac0568b9-0677-486d-b04e-1e11dad28837 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:39.614570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ac0568b9-0677-486d-b04e-1e11dad28837 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.619941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ac0568b9-0677-486d-b04e-1e11dad28837 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.622495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ac0568b9-0677-486d-b04e-1e11dad28837 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.624269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ac0568b9-0677-486d-b04e-1e11dad28837 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.634215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] validate_networks() for [('1a7e8d9c-f123-4816-a77b-51f1b199a341', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:32:39.696012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:39.715783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:40.014942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ac0568b9-0677-486d-b04e-1e11dad28837 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:40.027452 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ac0568b9-0677-486d-b04e-1e11dad28837 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1674 microversion: 2.1 time: 0.431427 Jul 20 04:32:40.028342 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2485/4894] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:39 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1674 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:40.034514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-120fe27e-8674-4afa-a6d3-1097642678e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:40.036242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-120fe27e-8674-4afa-a6d3-1097642678e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:40.054854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:40.060974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-120fe27e-8674-4afa-a6d3-1097642678e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:40.061654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-120fe27e-8674-4afa-a6d3-1097642678e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:40.062581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-120fe27e-8674-4afa-a6d3-1097642678e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:40.064643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-120fe27e-8674-4afa-a6d3-1097642678e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:40.458406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-120fe27e-8674-4afa-a6d3-1097642678e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:40.466827 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-120fe27e-8674-4afa-a6d3-1097642678e6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1308 microversion: 2.1 time: 0.436642 Jul 20 04:32:40.468307 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2486/4895] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:40 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1308 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:40.477170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b9fcef05-98aa-4c8c-8d72-318ed63f8029 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:40.478267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b9fcef05-98aa-4c8c-8d72-318ed63f8029 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:40.485378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9fcef05-98aa-4c8c-8d72-318ed63f8029 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:40.486465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9fcef05-98aa-4c8c-8d72-318ed63f8029 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:40.488807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9fcef05-98aa-4c8c-8d72-318ed63f8029 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:40.491409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9fcef05-98aa-4c8c-8d72-318ed63f8029 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:40.833864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:32:40.835024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:32:40.836506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:32:40.837096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:32:40.837750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:32:40.850964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:40.851748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:40.852725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:40.853338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:40.876761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Getting quotas for project 1be9144d8b214ecb8e416318d92b92ea. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:40.899814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Getting quotas for user b559a8f5a1724682831d18c3f7ddfdf2 and project 1be9144d8b214ecb8e416318d92b92ea. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:40.909967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b9fcef05-98aa-4c8c-8d72-318ed63f8029 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:40.926048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b9fcef05-98aa-4c8c-8d72-318ed63f8029 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:40.927733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b9fcef05-98aa-4c8c-8d72-318ed63f8029 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:40.930684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:32:40.932555 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b9fcef05-98aa-4c8c-8d72-318ed63f8029 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1742 microversion: 2.20 time: 0.462869 Jul 20 04:32:40.937053 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2487/4896] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:40 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1742 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:40.945065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a67758f4-c9dc-41f7-af99-26653c0f667d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:40.945916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a67758f4-c9dc-41f7-af99-26653c0f667d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:40.947947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:32:40.953019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a67758f4-c9dc-41f7-af99-26653c0f667d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:40.954033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a67758f4-c9dc-41f7-af99-26653c0f667d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:40.955240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a67758f4-c9dc-41f7-af99-26653c0f667d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:40.956617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a67758f4-c9dc-41f7-af99-26653c0f667d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:41.044745 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-93ff5548-c306-467d-9cb3-ecd635da572b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.529696 Jul 20 04:32:41.055948 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2410/4897] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:32:41.312921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3b8df573-cddd-41fe-abbc-045d888a7581 tempest-ExtensionsTest-1499168795 tempest-ExtensionsTest-1499168795-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:41.314986 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3b8df573-cddd-41fe-abbc-045d888a7581 tempest-ExtensionsTest-1499168795 tempest-ExtensionsTest-1499168795-project] 10.222.0.20 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.257676 Jul 20 04:32:41.315659 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2411/4898] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Jul 20 04:32:41 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:41.331452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-54032f95-b6eb-481d-86a5-34072ded25c1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:41.332142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-54032f95-b6eb-481d-86a5-34072ded25c1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:41.347429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54032f95-b6eb-481d-86a5-34072ded25c1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:41.348478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54032f95-b6eb-481d-86a5-34072ded25c1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:41.349446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54032f95-b6eb-481d-86a5-34072ded25c1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:41.350050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54032f95-b6eb-481d-86a5-34072ded25c1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:41.866643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-54032f95-b6eb-481d-86a5-34072ded25c1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:41.874723 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-54032f95-b6eb-481d-86a5-34072ded25c1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1674 microversion: 2.1 time: 0.551577 Jul 20 04:32:41.875405 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2412/4899] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:41 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1674 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:41.881528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a0e7b1d6-f5a6-4f2b-b674-ed4b313ef704 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:41.882425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a0e7b1d6-f5a6-4f2b-b674-ed4b313ef704 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:41.890116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0e7b1d6-f5a6-4f2b-b674-ed4b313ef704 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:41.891067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0e7b1d6-f5a6-4f2b-b674-ed4b313ef704 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:41.892717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0e7b1d6-f5a6-4f2b-b674-ed4b313ef704 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:41.893461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0e7b1d6-f5a6-4f2b-b674-ed4b313ef704 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:41.937123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a67758f4-c9dc-41f7-af99-26653c0f667d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:41.953178 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a67758f4-c9dc-41f7-af99-26653c0f667d tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1512 microversion: 2.1 time: 1.014754 Jul 20 04:32:41.961380 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2488/4900] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:40 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1512 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:41.968098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-237a4f04-064b-4313-8262-95dc433c36ee req-49381e7f-9f43-47be-9b04-df45f78f2581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76d5764-986d-4d3f-806f-1f8b1c5a73c1", "name": "network-vif-plugged", "status": "completed", "tag": "f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:41.982330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-237a4f04-064b-4313-8262-95dc433c36ee req-49381e7f-9f43-47be-9b04-df45f78f2581 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:41.983845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-237a4f04-064b-4313-8262-95dc433c36ee req-49381e7f-9f43-47be-9b04-df45f78f2581 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:41.997456 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-237a4f04-064b-4313-8262-95dc433c36ee req-49381e7f-9f43-47be-9b04-df45f78f2581 service nova] Creating event network-vif-plugged:f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981 for instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 on n-h1-764485-11 Jul 20 04:32:42.006562 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-237a4f04-064b-4313-8262-95dc433c36ee req-49381e7f-9f43-47be-9b04-df45f78f2581 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043248 Jul 20 04:32:42.008250 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2489/4901] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:42.014663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ed84b962-c8c9-44d5-a1b7-e43e9fd47e70 tempest-ExtensionsTest-1499168795 tempest-ExtensionsTest-1499168795-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:42.018338 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ed84b962-c8c9-44d5-a1b7-e43e9fd47e70 tempest-ExtensionsTest-1499168795 tempest-ExtensionsTest-1499168795-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007726 Jul 20 04:32:42.020716 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2490/4902] 10.222.0.20 () {58 vars in 1133 bytes} [Wed Jul 20 04:32:42 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:32:42.027043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09bb2a52-912f-46f3-9f33-f006e9e1a824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:42.027949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-09bb2a52-912f-46f3-9f33-f006e9e1a824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:42.035451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09bb2a52-912f-46f3-9f33-f006e9e1a824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:42.039477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09bb2a52-912f-46f3-9f33-f006e9e1a824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:42.041035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09bb2a52-912f-46f3-9f33-f006e9e1a824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:42.042230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09bb2a52-912f-46f3-9f33-f006e9e1a824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:42.094961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a0e7b1d6-f5a6-4f2b-b674-ed4b313ef704 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:42.108451 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a0e7b1d6-f5a6-4f2b-b674-ed4b313ef704 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1210 microversion: 2.1 time: 0.231200 Jul 20 04:32:42.112570 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2413/4903] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:41 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1210 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:42.123909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8cd7308c-2008-4c92-b604-ad0cdb9fab89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:42.124537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8cd7308c-2008-4c92-b604-ad0cdb9fab89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:42.148865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cd7308c-2008-4c92-b604-ad0cdb9fab89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:42.152062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cd7308c-2008-4c92-b604-ad0cdb9fab89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:42.154705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cd7308c-2008-4c92-b604-ad0cdb9fab89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:42.155211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cd7308c-2008-4c92-b604-ad0cdb9fab89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:42.658340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8cd7308c-2008-4c92-b604-ad0cdb9fab89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:42.670294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8cd7308c-2008-4c92-b604-ad0cdb9fab89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:42.674503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8cd7308c-2008-4c92-b604-ad0cdb9fab89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:42.676364 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8cd7308c-2008-4c92-b604-ad0cdb9fab89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1742 microversion: 2.20 time: 0.562456 Jul 20 04:32:42.677587 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2414/4904] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:42 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1742 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:42.732632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-09bb2a52-912f-46f3-9f33-f006e9e1a824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:42.741815 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-09bb2a52-912f-46f3-9f33-f006e9e1a824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1308 microversion: 2.1 time: 0.719793 Jul 20 04:32:42.742770 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2491/4905] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:42 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1308 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:42.895246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0f26b74-feab-4bf7-b61b-96495cd76fbc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:42.896011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b0f26b74-feab-4bf7-b61b-96495cd76fbc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:42.919351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0f26b74-feab-4bf7-b61b-96495cd76fbc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:42.924621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0f26b74-feab-4bf7-b61b-96495cd76fbc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:42.928446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0f26b74-feab-4bf7-b61b-96495cd76fbc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:42.929540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0f26b74-feab-4bf7-b61b-96495cd76fbc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:42.983762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b18d1643-ca1c-4ad1-82e1-3b8109a0e2b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:42.984380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b18d1643-ca1c-4ad1-82e1-3b8109a0e2b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:43.003629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b18d1643-ca1c-4ad1-82e1-3b8109a0e2b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:43.004635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b18d1643-ca1c-4ad1-82e1-3b8109a0e2b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:43.005904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b18d1643-ca1c-4ad1-82e1-3b8109a0e2b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:43.013144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b18d1643-ca1c-4ad1-82e1-3b8109a0e2b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:43.056046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:43.673764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b0f26b74-feab-4bf7-b61b-96495cd76fbc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:43.686942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b18d1643-ca1c-4ad1-82e1-3b8109a0e2b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:43.692517 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0f26b74-feab-4bf7-b61b-96495cd76fbc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1674 microversion: 2.1 time: 0.801358 Jul 20 04:32:43.705579 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2415/4906] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:42 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1674 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:43.705801 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b18d1643-ca1c-4ad1-82e1-3b8109a0e2b5 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1533 microversion: 2.1 time: 0.726485 Jul 20 04:32:43.706768 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2492/4907] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:42 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1533 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:43.712040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c368d80e-c6c5-48fb-96d5-97c4225c603b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:43.713227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c368d80e-c6c5-48fb-96d5-97c4225c603b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:43.721525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c368d80e-c6c5-48fb-96d5-97c4225c603b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:43.722230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c368d80e-c6c5-48fb-96d5-97c4225c603b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:43.723869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c368d80e-c6c5-48fb-96d5-97c4225c603b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:43.727472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d835d784-1234-4d05-a5fd-8c4094a91daf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:43.728123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d835d784-1234-4d05-a5fd-8c4094a91daf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:43.735001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c368d80e-c6c5-48fb-96d5-97c4225c603b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:43.747170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d835d784-1234-4d05-a5fd-8c4094a91daf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:43.747915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d835d784-1234-4d05-a5fd-8c4094a91daf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:43.748892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d835d784-1234-4d05-a5fd-8c4094a91daf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:43.749506 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d835d784-1234-4d05-a5fd-8c4094a91daf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:44.034057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c368d80e-c6c5-48fb-96d5-97c4225c603b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:44.048616 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c368d80e-c6c5-48fb-96d5-97c4225c603b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1272 microversion: 2.1 time: 0.340146 Jul 20 04:32:44.049117 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2416/4908] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:43 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1272 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:44.080933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-18f20959-d556-4a1d-8b7e-cbebe35b1036 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:44.084914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-18f20959-d556-4a1d-8b7e-cbebe35b1036 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:44.108792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18f20959-d556-4a1d-8b7e-cbebe35b1036 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:44.111126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18f20959-d556-4a1d-8b7e-cbebe35b1036 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:44.112917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18f20959-d556-4a1d-8b7e-cbebe35b1036 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:44.113394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18f20959-d556-4a1d-8b7e-cbebe35b1036 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:44.303084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d835d784-1234-4d05-a5fd-8c4094a91daf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:44.321316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d835d784-1234-4d05-a5fd-8c4094a91daf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:44.323046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d835d784-1234-4d05-a5fd-8c4094a91daf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:44.326137 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d835d784-1234-4d05-a5fd-8c4094a91daf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1737 microversion: 2.20 time: 0.617300 Jul 20 04:32:44.328714 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2493/4909] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:43 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1737 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:44.665012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-18f20959-d556-4a1d-8b7e-cbebe35b1036 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:44.675175 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-18f20959-d556-4a1d-8b7e-cbebe35b1036 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1308 microversion: 2.1 time: 0.617889 Jul 20 04:32:44.688714 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2417/4910] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:44 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1308 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:44.728712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4f16c5ae-3808-459b-8574-8fe918cada64 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:44.734580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4f16c5ae-3808-459b-8574-8fe918cada64 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:44.748251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f16c5ae-3808-459b-8574-8fe918cada64 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:44.748716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f16c5ae-3808-459b-8574-8fe918cada64 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:44.749530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f16c5ae-3808-459b-8574-8fe918cada64 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:44.752482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f16c5ae-3808-459b-8574-8fe918cada64 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:44.861047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f8878419-8adc-4f80-ac35-b667db70fd80 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Action: 'create', calling method: .version_select at 0x7fbf9c2f8ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-444488917", "metadata": {"Type": "work"}}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f8878419-8adc-4f80-ac35-b667db70fd80 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Request method failure captured: Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 121 Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14VsN9ANAbNj_z73-X4AvFU_rjuBIiYwYSk05q2WWAvM3nPIGJ82MRPmRQOZ5-WvarpwoOHB7rkbzy6KL6XTNEzWZldL4X1jbfDaJQEiwzlYauXuUXJga9TEcbt6YJxOXM0YyedxEvL6WFM_1WgjwmDOEhTxVwX_z0k386iWeCsa56c Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 84c40177b6c542e1841d6229ffafbdfe Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84c40177b6c542e1841d6229ffafbdfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84c40177b6c542e1841d6229ffafbdfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84c40177b6c542e1841d6229ffafbdfe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84c40177b6c542e1841d6229ffafbdfe"}]}] Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 84c40177b6c542e1841d6229ffafbdfe Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-VolumesNegativeTest-993366174-project Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c8f7fae0f19248eb841b1322bb29f160 Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-VolumesNegativeTest-993366174-project Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-444488917", "metadata": {"Type": "work"}}} Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-444488917', 'metadata': {'Type': 'work'}}}} Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:32:44.864289 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:32:44.869562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 04:32:44.869562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:44.869562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:44.869562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:44.869562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:44.869562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:44.869562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:44.869562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:32:44.869562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:32:44.869562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 04:32:44.869562 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:44.874376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f8878419-8adc-4f80-ac35-b667db70fd80 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:44.877774 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f8878419-8adc-4f80-ac35-b667db70fd80 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.247948 Jul 20 04:32:44.880527 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2494/4911] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Jul 20 04:32:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:32:44.901294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04878355-693c-479a-8e30-64fa53f01ecd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:44.902188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-04878355-693c-479a-8e30-64fa53f01ecd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:44.906549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:44.912501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04878355-693c-479a-8e30-64fa53f01ecd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:44.915653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04878355-693c-479a-8e30-64fa53f01ecd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:44.928717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04878355-693c-479a-8e30-64fa53f01ecd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:44.929689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04878355-693c-479a-8e30-64fa53f01ecd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:46.005252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4f16c5ae-3808-459b-8574-8fe918cada64 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:46.015581 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4f16c5ae-3808-459b-8574-8fe918cada64 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1651 microversion: 2.1 time: 1.304179 Jul 20 04:32:46.020857 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2418/4912] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:44 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1651 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:46.037023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e185dd14-bde3-4d47-83e6-113d63bf6aa5 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Action: 'create', calling method: .version_select at 0x7fbf9d494ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1826467864", "metadata": {"Type": "work"}}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e185dd14-bde3-4d47-83e6-113d63bf6aa5 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Request method failure captured: Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 120 Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14VsN9ANAbNj_z73-X4AvFU_rjuBIiYwYSk05q2WWAvM3nPIGJ82MRPmRQOZ5-WvarpwoOHB7rkbzy6KL6XTNEzWZldL4X1jbfDaJQEiwzlYauXuUXJga9TEcbt6YJxOXM0YyedxEvL6WFM_1WgjwmDOEhTxVwX_z0k386iWeCsa56c Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 84c40177b6c542e1841d6229ffafbdfe Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84c40177b6c542e1841d6229ffafbdfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84c40177b6c542e1841d6229ffafbdfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84c40177b6c542e1841d6229ffafbdfe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84c40177b6c542e1841d6229ffafbdfe"}]}] Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 84c40177b6c542e1841d6229ffafbdfe Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-VolumesNegativeTest-993366174-project Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c8f7fae0f19248eb841b1322bb29f160 Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-VolumesNegativeTest-993366174-project Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1826467864", "metadata": {"Type": "work"}}} Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1826467864', 'metadata': {'Type': 'work'}}}} Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi '0' Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:32:46.042084 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:32:46.046349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 04:32:46.046349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:46.046349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:46.046349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:46.046349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:46.046349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:46.046349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:46.046349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:32:46.046349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:32:46.046349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 04:32:46.046349 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:46.048550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-04878355-693c-479a-8e30-64fa53f01ecd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:46.054028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e185dd14-bde3-4d47-83e6-113d63bf6aa5 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:46.058161 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e185dd14-bde3-4d47-83e6-113d63bf6aa5 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.035312 Jul 20 04:32:46.059448 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2419/4913] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Jul 20 04:32:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:32:46.066376 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-04878355-693c-479a-8e30-64fa53f01ecd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1533 microversion: 2.1 time: 1.180634 Jul 20 04:32:46.069762 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2495/4914] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:44 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1533 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:46.080622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9b07bd94-b098-47a9-a36b-171a6e8173ec tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:46.081353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9b07bd94-b098-47a9-a36b-171a6e8173ec tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:46.087346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4cdd3030-ab9c-4fbe-8465-b4be236e8e53 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:46.089938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4cdd3030-ab9c-4fbe-8465-b4be236e8e53 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:46.117259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9b07bd94-b098-47a9-a36b-171a6e8173ec tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.117719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9b07bd94-b098-47a9-a36b-171a6e8173ec tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:46.118486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4cdd3030-ab9c-4fbe-8465-b4be236e8e53 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.118621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9b07bd94-b098-47a9-a36b-171a6e8173ec tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.118946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9b07bd94-b098-47a9-a36b-171a6e8173ec tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:46.119676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4cdd3030-ab9c-4fbe-8465-b4be236e8e53 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:46.126304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4cdd3030-ab9c-4fbe-8465-b4be236e8e53 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.127132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4cdd3030-ab9c-4fbe-8465-b4be236e8e53 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:46.912236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4cdd3030-ab9c-4fbe-8465-b4be236e8e53 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:46.923946 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4cdd3030-ab9c-4fbe-8465-b4be236e8e53 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1314 microversion: 2.1 time: 0.856562 Jul 20 04:32:46.924566 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2420/4915] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:46 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1314 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:46.938827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-05e77c03-e6ff-4671-9414-4395a3278178 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:46.939929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-05e77c03-e6ff-4671-9414-4395a3278178 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:46.953002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05e77c03-e6ff-4671-9414-4395a3278178 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.957014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05e77c03-e6ff-4671-9414-4395a3278178 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:46.958035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05e77c03-e6ff-4671-9414-4395a3278178 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.959610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05e77c03-e6ff-4671-9414-4395a3278178 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:47.075564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9b07bd94-b098-47a9-a36b-171a6e8173ec tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:47.122998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9b07bd94-b098-47a9-a36b-171a6e8173ec tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:47.128716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9b07bd94-b098-47a9-a36b-171a6e8173ec tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:47.131103 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9b07bd94-b098-47a9-a36b-171a6e8173ec tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1737 microversion: 2.20 time: 1.054364 Jul 20 04:32:47.131731 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2496/4916] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:46 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1737 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:47.153738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dbb6f120-4cfe-4769-8cd4-ae9405d61661 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:47.171838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbb6f120-4cfe-4769-8cd4-ae9405d61661 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:47.173488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbb6f120-4cfe-4769-8cd4-ae9405d61661 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:47.243685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dbb6f120-4cfe-4769-8cd4-ae9405d61661 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Going to try to start instance {{(pid=119808) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:32:47.351175 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dbb6f120-4cfe-4769-8cd4-ae9405d61661 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "POST /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/action" status: 202 len: 0 microversion: 2.1 time: 0.206495 Jul 20 04:32:47.352699 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2497/4917] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:47 2022] POST /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:32:47.361499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10dc04d3-4a8f-403a-9742-1e0602314370 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Action: 'create', calling method: .version_select at 0x7fbf9c27adc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-160368307", "metadata": {"Type": "work"}}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10dc04d3-4a8f-403a-9742-1e0602314370 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Request method failure captured: Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 118 Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14VsN9ANAbNj_z73-X4AvFU_rjuBIiYwYSk05q2WWAvM3nPIGJ82MRPmRQOZ5-WvarpwoOHB7rkbzy6KL6XTNEzWZldL4X1jbfDaJQEiwzlYauXuUXJga9TEcbt6YJxOXM0YyedxEvL6WFM_1WgjwmDOEhTxVwX_z0k386iWeCsa56c Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 84c40177b6c542e1841d6229ffafbdfe Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84c40177b6c542e1841d6229ffafbdfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84c40177b6c542e1841d6229ffafbdfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84c40177b6c542e1841d6229ffafbdfe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84c40177b6c542e1841d6229ffafbdfe"}]}] Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 84c40177b6c542e1841d6229ffafbdfe Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-VolumesNegativeTest-993366174-project Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c8f7fae0f19248eb841b1322bb29f160 Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-VolumesNegativeTest-993366174-project Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-160368307", "metadata": {"Type": "work"}}} Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-160368307', 'metadata': {'Type': 'work'}}}} Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi '' Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:32:47.376482 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:32:47.380954 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 04:32:47.380954 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:47.380954 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:47.380954 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:47.380954 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:47.380954 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:47.380954 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:47.380954 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:32:47.380954 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:32:47.380954 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 04:32:47.380954 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:47.383811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10dc04d3-4a8f-403a-9742-1e0602314370 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:47.384916 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-10dc04d3-4a8f-403a-9742-1e0602314370 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030557 Jul 20 04:32:47.386167 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2498/4918] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Jul 20 04:32:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:32:47.394580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0e7a448c-cac9-4d04-881b-e1dd020a4e74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:47.395738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0e7a448c-cac9-4d04-881b-e1dd020a4e74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:47.404760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e7a448c-cac9-4d04-881b-e1dd020a4e74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:47.405595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e7a448c-cac9-4d04-881b-e1dd020a4e74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:47.406648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e7a448c-cac9-4d04-881b-e1dd020a4e74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:47.407313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e7a448c-cac9-4d04-881b-e1dd020a4e74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:48.158815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0e7a448c-cac9-4d04-881b-e1dd020a4e74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:48.170820 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0e7a448c-cac9-4d04-881b-e1dd020a4e74 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1533 microversion: 2.1 time: 0.783256 Jul 20 04:32:48.171403 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2499/4919] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:47 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1533 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:48.182421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-79c665da-8505-4543-98cc-e71e8413b926 req-af7c533d-3d07-4ce3-bb6b-071627bd5822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6a337-9b96-4c0a-8858-5c456313b327", "name": "network-vif-plugged", "status": "completed", "tag": "18cda90d-44d1-42ea-ad83-c0374e60aceb"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:48.204962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-79c665da-8505-4543-98cc-e71e8413b926 req-af7c533d-3d07-4ce3-bb6b-071627bd5822 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:48.205949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-79c665da-8505-4543-98cc-e71e8413b926 req-af7c533d-3d07-4ce3-bb6b-071627bd5822 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:48.228946 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-79c665da-8505-4543-98cc-e71e8413b926 req-af7c533d-3d07-4ce3-bb6b-071627bd5822 service nova] Creating event network-vif-plugged:18cda90d-44d1-42ea-ad83-c0374e60aceb for instance f0b6a337-9b96-4c0a-8858-5c456313b327 on n-h2-764485-11 Jul 20 04:32:48.246965 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-79c665da-8505-4543-98cc-e71e8413b926 req-af7c533d-3d07-4ce3-bb6b-071627bd5822 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073453 Jul 20 04:32:48.248031 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2500/4920] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:48.262172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-498b7690-695c-4a58-b35c-1a4e23199878 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:48.266495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-498b7690-695c-4a58-b35c-1a4e23199878 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:48.287357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-498b7690-695c-4a58-b35c-1a4e23199878 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:48.287956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-498b7690-695c-4a58-b35c-1a4e23199878 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:48.288766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-498b7690-695c-4a58-b35c-1a4e23199878 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:48.289212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-498b7690-695c-4a58-b35c-1a4e23199878 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:48.294356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-05e77c03-e6ff-4671-9414-4395a3278178 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:48.308557 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-05e77c03-e6ff-4671-9414-4395a3278178 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1308 microversion: 2.1 time: 1.381452 Jul 20 04:32:48.316200 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2421/4921] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:46 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1308 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:48.335496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b681277e-90eb-4c27-b6f7-87515b6b5ffd tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Calling method '.version_select at 0x7fbf9db22430>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:48.408442 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b681277e-90eb-4c27-b6f7-87515b6b5ffd tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] HTTP exception thrown: Volume tempest-invalid-796171176 could not be found. Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b681277e-90eb-4c27-b6f7-87515b6b5ffd tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Request method failure captured: Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-796171176 HTTP/1.1 Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14VsN9ANAbNj_z73-X4AvFU_rjuBIiYwYSk05q2WWAvM3nPIGJ82MRPmRQOZ5-WvarpwoOHB7rkbzy6KL6XTNEzWZldL4X1jbfDaJQEiwzlYauXuUXJga9TEcbt6YJxOXM0YyedxEvL6WFM_1WgjwmDOEhTxVwX_z0k386iWeCsa56c Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 84c40177b6c542e1841d6229ffafbdfe Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84c40177b6c542e1841d6229ffafbdfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84c40177b6c542e1841d6229ffafbdfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84c40177b6c542e1841d6229ffafbdfe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84c40177b6c542e1841d6229ffafbdfe"}]}] Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 84c40177b6c542e1841d6229ffafbdfe Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-VolumesNegativeTest-993366174-project Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c8f7fae0f19248eb841b1322bb29f160 Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-VolumesNegativeTest-993366174-project Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: exception: Volume tempest-invalid-796171176 could not be found. Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'tempest-invalid-796171176'} Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-796171176 could not be found. (HTTP 404) (Request-ID: req-c1809ea6-977c-402b-b950-c1eb4ce21aa3) Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:32:48.411430 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-796171176 could not be found. Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-796171176 could not be found. Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-796171176 could not be found. Jul 20 04:32:48.416103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:48.420287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b681277e-90eb-4c27-b6f7-87515b6b5ffd tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Returning 404 to user: Volume tempest-invalid-796171176 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:48.421394 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b681277e-90eb-4c27-b6f7-87515b6b5ffd tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-796171176" status: 404 len: 98 microversion: 2.1 time: 0.103990 Jul 20 04:32:48.422716 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2422/4922] 10.222.0.20 () {58 vars in 1214 bytes} [Wed Jul 20 04:32:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-796171176 => generated 98 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:32:48.428155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9f8b8137-5735-4d47-9946-aa5d1776470d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:48.430001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9f8b8137-5735-4d47-9946-aa5d1776470d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:48.440093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f8b8137-5735-4d47-9946-aa5d1776470d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:48.440887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f8b8137-5735-4d47-9946-aa5d1776470d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:48.441901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f8b8137-5735-4d47-9946-aa5d1776470d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:48.442554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f8b8137-5735-4d47-9946-aa5d1776470d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.656525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9f8b8137-5735-4d47-9946-aa5d1776470d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:49.677530 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9f8b8137-5735-4d47-9946-aa5d1776470d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1314 microversion: 2.1 time: 1.251397 Jul 20 04:32:49.678342 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2423/4923] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:48 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1314 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:49.698141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f9b93b6-bd5b-4513-ac9f-534165e5423a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:49.716730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2f9b93b6-bd5b-4513-ac9f-534165e5423a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:49.731216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-498b7690-695c-4a58-b35c-1a4e23199878 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:49.743700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f9b93b6-bd5b-4513-ac9f-534165e5423a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.746078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f9b93b6-bd5b-4513-ac9f-534165e5423a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.747452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f9b93b6-bd5b-4513-ac9f-534165e5423a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.753486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f9b93b6-bd5b-4513-ac9f-534165e5423a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.754213 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-498b7690-695c-4a58-b35c-1a4e23199878 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1660 microversion: 2.1 time: 1.504617 Jul 20 04:32:49.754853 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2501/4924] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:48 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1660 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:49.798242 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1c8419ff-a91f-4f6c-a625-e6022d505744 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.032150 Jul 20 04:32:49.804720 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2502/4925] 10.222.0.20 () {58 vars in 1139 bytes} [Wed Jul 20 04:32:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:32:49.821567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bc935f7f-8bb1-41b5-859a-b0cd9a6da04c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:49.830003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bc935f7f-8bb1-41b5-859a-b0cd9a6da04c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:49.851930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc935f7f-8bb1-41b5-859a-b0cd9a6da04c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.857688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc935f7f-8bb1-41b5-859a-b0cd9a6da04c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.859330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc935f7f-8bb1-41b5-859a-b0cd9a6da04c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.860289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bc935f7f-8bb1-41b5-859a-b0cd9a6da04c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:50.843273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bc935f7f-8bb1-41b5-859a-b0cd9a6da04c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:50.887379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:50.896437 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bc935f7f-8bb1-41b5-859a-b0cd9a6da04c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1528 microversion: 2.1 time: 1.090266 Jul 20 04:32:50.908493 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2503/4926] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:49 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1528 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:50.916840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:50.924877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-13c9d8c8-c362-40a2-a4e2-3ab2fc14793c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:50.925829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-13c9d8c8-c362-40a2-a4e2-3ab2fc14793c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:50.938556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13c9d8c8-c362-40a2-a4e2-3ab2fc14793c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:50.940161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13c9d8c8-c362-40a2-a4e2-3ab2fc14793c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:50.947379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13c9d8c8-c362-40a2-a4e2-3ab2fc14793c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:50.948505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13c9d8c8-c362-40a2-a4e2-3ab2fc14793c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:51.287482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2f9b93b6-bd5b-4513-ac9f-534165e5423a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:51.308263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2f9b93b6-bd5b-4513-ac9f-534165e5423a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:51.318698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2f9b93b6-bd5b-4513-ac9f-534165e5423a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:51.320348 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2f9b93b6-bd5b-4513-ac9f-534165e5423a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1737 microversion: 2.20 time: 1.629312 Jul 20 04:32:51.321496 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2424/4927] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:49 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1737 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:51.326322 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1064cae1-adf1-4187-a1cf-4bba47c7b83f tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003613 Jul 20 04:32:51.332820 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2425/4928] 10.222.0.20 () {58 vars in 1136 bytes} [Wed Jul 20 04:32:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:32:51.341728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0557a59c-6a1c-407e-916b-5ba9f1d8b792 req-79aad530-ddc9-40ea-a28d-bf41b2cde2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f3226f-82c7-4e50-9a7d-ca0721979912", "name": "network-vif-plugged", "status": "completed", "tag": "e8a977e2-08d6-4a53-9757-e0d3ee9db0ff"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:51.380127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0557a59c-6a1c-407e-916b-5ba9f1d8b792 req-79aad530-ddc9-40ea-a28d-bf41b2cde2d8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:51.387546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0557a59c-6a1c-407e-916b-5ba9f1d8b792 req-79aad530-ddc9-40ea-a28d-bf41b2cde2d8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:51.439638 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0557a59c-6a1c-407e-916b-5ba9f1d8b792 req-79aad530-ddc9-40ea-a28d-bf41b2cde2d8 service nova] Creating event network-vif-plugged:e8a977e2-08d6-4a53-9757-e0d3ee9db0ff for instance a2f3226f-82c7-4e50-9a7d-ca0721979912 on n-h1-764485-11 Jul 20 04:32:51.463309 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0557a59c-6a1c-407e-916b-5ba9f1d8b792 req-79aad530-ddc9-40ea-a28d-bf41b2cde2d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119417 Jul 20 04:32:51.464413 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2426/4929] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:51.497061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-af7527a2-5bfb-47b6-9fa0-e11a95b5c444 req-f7e19cf8-c255-4ae2-9008-4c3ab9db8341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62976333-e59c-48d3-8222-e07e6b0c043a", "tag": "04eefcfd-30b6-44aa-a955-5d97ac50f367"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:51.530860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-af7527a2-5bfb-47b6-9fa0-e11a95b5c444 req-f7e19cf8-c255-4ae2-9008-4c3ab9db8341 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:51.537604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-af7527a2-5bfb-47b6-9fa0-e11a95b5c444 req-f7e19cf8-c255-4ae2-9008-4c3ab9db8341 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:51.590196 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-af7527a2-5bfb-47b6-9fa0-e11a95b5c444 req-f7e19cf8-c255-4ae2-9008-4c3ab9db8341 service nova] Creating event network-changed:04eefcfd-30b6-44aa-a955-5d97ac50f367 for instance 62976333-e59c-48d3-8222-e07e6b0c043a on n-h1-764485-11 Jul 20 04:32:51.614886 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-af7527a2-5bfb-47b6-9fa0-e11a95b5c444 req-f7e19cf8-c255-4ae2-9008-4c3ab9db8341 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140404 Jul 20 04:32:51.616959 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2427/4930] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:51.629266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-41ae4c56-e626-480b-a2f2-33c121bf151f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:51.632376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-41ae4c56-e626-480b-a2f2-33c121bf151f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:51.654188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41ae4c56-e626-480b-a2f2-33c121bf151f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:51.660015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41ae4c56-e626-480b-a2f2-33c121bf151f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:51.661877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41ae4c56-e626-480b-a2f2-33c121bf151f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:51.662578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41ae4c56-e626-480b-a2f2-33c121bf151f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:53.050641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-13c9d8c8-c362-40a2-a4e2-3ab2fc14793c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:53.068603 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-13c9d8c8-c362-40a2-a4e2-3ab2fc14793c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1308 microversion: 2.1 time: 2.158566 Jul 20 04:32:53.070369 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-41ae4c56-e626-480b-a2f2-33c121bf151f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:53.072745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:53.074529 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2504/4931] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:50 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1308 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:53.082821 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-41ae4c56-e626-480b-a2f2-33c121bf151f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1314 microversion: 2.1 time: 1.464356 Jul 20 04:32:53.096126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-56e3f344-6054-429c-ad29-bf58c9221d42 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:53.100150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-56e3f344-6054-429c-ad29-bf58c9221d42 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:53.103541 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2428/4932] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:51 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1314 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:53.113328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4e0362f6-7710-4755-9a66-1bb50477e3f9 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Calling method '.version_select at 0x7fbf9d13c550>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:53.131246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56e3f344-6054-429c-ad29-bf58c9221d42 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:53.131608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56e3f344-6054-429c-ad29-bf58c9221d42 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:53.142292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56e3f344-6054-429c-ad29-bf58c9221d42 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:53.144034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56e3f344-6054-429c-ad29-bf58c9221d42 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:53.218301 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-4e0362f6-7710-4755-9a66-1bb50477e3f9 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] HTTP exception thrown: Volume 54f2a39d-6cf4-411a-8be3-19d1d6d69d4f could not be found. Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4e0362f6-7710-4755-9a66-1bb50477e3f9 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Request method failure captured: Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/os-volumes/54f2a39d-6cf4-411a-8be3-19d1d6d69d4f HTTP/1.1 Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14VsN9ANAbNj_z73-X4AvFU_rjuBIiYwYSk05q2WWAvM3nPIGJ82MRPmRQOZ5-WvarpwoOHB7rkbzy6KL6XTNEzWZldL4X1jbfDaJQEiwzlYauXuUXJga9TEcbt6YJxOXM0YyedxEvL6WFM_1WgjwmDOEhTxVwX_z0k386iWeCsa56c Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 84c40177b6c542e1841d6229ffafbdfe Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84c40177b6c542e1841d6229ffafbdfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84c40177b6c542e1841d6229ffafbdfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84c40177b6c542e1841d6229ffafbdfe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84c40177b6c542e1841d6229ffafbdfe"}]}] Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 84c40177b6c542e1841d6229ffafbdfe Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-VolumesNegativeTest-993366174-project Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c8f7fae0f19248eb841b1322bb29f160 Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-VolumesNegativeTest-993366174-project Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: exception: Volume 54f2a39d-6cf4-411a-8be3-19d1d6d69d4f could not be found. Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '54f2a39d-6cf4-411a-8be3-19d1d6d69d4f'} Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54f2a39d-6cf4-411a-8be3-19d1d6d69d4f could not be found. (HTTP 404) (Request-ID: req-b0343e09-354d-4f7b-afbe-93981208a344) Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:32:53.221026 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54f2a39d-6cf4-411a-8be3-19d1d6d69d4f could not be found. Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54f2a39d-6cf4-411a-8be3-19d1d6d69d4f could not be found. Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54f2a39d-6cf4-411a-8be3-19d1d6d69d4f could not be found. Jul 20 04:32:53.227470 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:32:53.231437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4e0362f6-7710-4755-9a66-1bb50477e3f9 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Returning 404 to user: Volume 54f2a39d-6cf4-411a-8be3-19d1d6d69d4f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:53.232534 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4e0362f6-7710-4755-9a66-1bb50477e3f9 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/54f2a39d-6cf4-411a-8be3-19d1d6d69d4f" status: 404 len: 109 microversion: 2.1 time: 0.127934 Jul 20 04:32:53.242115 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2429/4933] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:32:53 2022] DELETE /compute/v2.1/os-volumes/54f2a39d-6cf4-411a-8be3-19d1d6d69d4f => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:53.252252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dff3d1fb-d92b-4445-adc9-50f0e625d866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:53.253247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dff3d1fb-d92b-4445-adc9-50f0e625d866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:53.269049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dff3d1fb-d92b-4445-adc9-50f0e625d866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:53.273102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dff3d1fb-d92b-4445-adc9-50f0e625d866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:53.274304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dff3d1fb-d92b-4445-adc9-50f0e625d866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:53.274929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dff3d1fb-d92b-4445-adc9-50f0e625d866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.150397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dff3d1fb-d92b-4445-adc9-50f0e625d866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:54.215493 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dff3d1fb-d92b-4445-adc9-50f0e625d866 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1528 microversion: 2.1 time: 0.970108 Jul 20 04:32:54.217823 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2430/4934] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:53 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1528 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:54.232517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f9816d4b-54b9-4ebc-8895-4b6a3c4c1460 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:54.233555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f9816d4b-54b9-4ebc-8895-4b6a3c4c1460 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:54.244819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-56e3f344-6054-429c-ad29-bf58c9221d42 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:54.261359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9816d4b-54b9-4ebc-8895-4b6a3c4c1460 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.264564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9816d4b-54b9-4ebc-8895-4b6a3c4c1460 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.267392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9816d4b-54b9-4ebc-8895-4b6a3c4c1460 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.269119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9816d4b-54b9-4ebc-8895-4b6a3c4c1460 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.349112 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-56e3f344-6054-429c-ad29-bf58c9221d42 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1660 microversion: 2.1 time: 1.271056 Jul 20 04:32:54.350325 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2505/4935] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:53 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1660 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:54.355360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b91da071-7174-4330-a586-1a1be71d61a7 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Calling method '.version_select at 0x7fbf9c779d30>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:54.403281 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-b91da071-7174-4330-a586-1a1be71d61a7 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] HTTP exception thrown: Volume 3fc5ef6e-8034-4de8-b578-c4f9c547d400 could not be found. Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b91da071-7174-4330-a586-1a1be71d61a7 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Request method failure captured: Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/os-volumes/3fc5ef6e-8034-4de8-b578-c4f9c547d400 HTTP/1.1 Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14VsN9ANAbNj_z73-X4AvFU_rjuBIiYwYSk05q2WWAvM3nPIGJ82MRPmRQOZ5-WvarpwoOHB7rkbzy6KL6XTNEzWZldL4X1jbfDaJQEiwzlYauXuUXJga9TEcbt6YJxOXM0YyedxEvL6WFM_1WgjwmDOEhTxVwX_z0k386iWeCsa56c Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 84c40177b6c542e1841d6229ffafbdfe Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84c40177b6c542e1841d6229ffafbdfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84c40177b6c542e1841d6229ffafbdfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84c40177b6c542e1841d6229ffafbdfe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84c40177b6c542e1841d6229ffafbdfe"}]}] Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 84c40177b6c542e1841d6229ffafbdfe Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-VolumesNegativeTest-993366174 Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-VolumesNegativeTest-993366174-project Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c8f7fae0f19248eb841b1322bb29f160 Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-VolumesNegativeTest-993366174-project Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: method: Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: exception: Volume 3fc5ef6e-8034-4de8-b578-c4f9c547d400 could not be found. Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '3fc5ef6e-8034-4de8-b578-c4f9c547d400'} Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3fc5ef6e-8034-4de8-b578-c4f9c547d400 could not be found. (HTTP 404) (Request-ID: req-853ccfc7-8435-4024-8aca-04ac76f436d8) Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:32:54.405559 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3fc5ef6e-8034-4de8-b578-c4f9c547d400 could not be found. Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3fc5ef6e-8034-4de8-b578-c4f9c547d400 could not be found. Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3fc5ef6e-8034-4de8-b578-c4f9c547d400 could not be found. Jul 20 04:32:54.410410 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:32:54.413503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b91da071-7174-4330-a586-1a1be71d61a7 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] Returning 404 to user: Volume 3fc5ef6e-8034-4de8-b578-c4f9c547d400 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:54.414528 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b91da071-7174-4330-a586-1a1be71d61a7 tempest-VolumesNegativeTest-993366174 tempest-VolumesNegativeTest-993366174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3fc5ef6e-8034-4de8-b578-c4f9c547d400" status: 404 len: 109 microversion: 2.1 time: 0.062615 Jul 20 04:32:54.414805 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2506/4936] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:32:54 2022] GET /compute/v2.1/os-volumes/3fc5ef6e-8034-4de8-b578-c4f9c547d400 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:32:54.434941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9856998a-7714-4a6a-bf71-ca00159a8d05 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:54.446158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9856998a-7714-4a6a-bf71-ca00159a8d05 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:54.478614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9856998a-7714-4a6a-bf71-ca00159a8d05 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.481433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9856998a-7714-4a6a-bf71-ca00159a8d05 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.482524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9856998a-7714-4a6a-bf71-ca00159a8d05 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.494568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9856998a-7714-4a6a-bf71-ca00159a8d05 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.733610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f9816d4b-54b9-4ebc-8895-4b6a3c4c1460 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:54.749265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f9816d4b-54b9-4ebc-8895-4b6a3c4c1460 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:54.755802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f9816d4b-54b9-4ebc-8895-4b6a3c4c1460 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:54.759616 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f9816d4b-54b9-4ebc-8895-4b6a3c4c1460 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1737 microversion: 2.20 time: 0.537207 Jul 20 04:32:54.763852 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2431/4937] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:54 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1737 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:54.790119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-39bfa358-73ce-4ebf-ada0-2593ee202798 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:54.792407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-39bfa358-73ce-4ebf-ada0-2593ee202798 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:54.816030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39bfa358-73ce-4ebf-ada0-2593ee202798 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.816576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39bfa358-73ce-4ebf-ada0-2593ee202798 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.818284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39bfa358-73ce-4ebf-ada0-2593ee202798 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.827057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39bfa358-73ce-4ebf-ada0-2593ee202798 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.066975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9856998a-7714-4a6a-bf71-ca00159a8d05 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:55.079357 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9856998a-7714-4a6a-bf71-ca00159a8d05 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1488 microversion: 2.1 time: 0.660662 Jul 20 04:32:55.081114 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2507/4938] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:54 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1488 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:55.101332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b7026a3-e506-4a7e-9f77-1e1a6e6ffa5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:55.103007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b7026a3-e506-4a7e-9f77-1e1a6e6ffa5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:55.133315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b7026a3-e506-4a7e-9f77-1e1a6e6ffa5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.133791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b7026a3-e506-4a7e-9f77-1e1a6e6ffa5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.134596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b7026a3-e506-4a7e-9f77-1e1a6e6ffa5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.135046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b7026a3-e506-4a7e-9f77-1e1a6e6ffa5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.220840 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b7026a3-e506-4a7e-9f77-1e1a6e6ffa5e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "PUT /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1083 microversion: 2.1 time: 0.124615 Jul 20 04:32:55.222139 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2508/4939] 10.222.0.20 () {60 vars in 1255 bytes} [Wed Jul 20 04:32:55 2022] PUT /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1083 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:55.237284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2f8f546f-2af2-4c5b-ada6-1c723f7d1f66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:55.242549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2f8f546f-2af2-4c5b-ada6-1c723f7d1f66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:55.252203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f8f546f-2af2-4c5b-ada6-1c723f7d1f66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.253821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f8f546f-2af2-4c5b-ada6-1c723f7d1f66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.255206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f8f546f-2af2-4c5b-ada6-1c723f7d1f66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.255930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f8f546f-2af2-4c5b-ada6-1c723f7d1f66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.506140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-39bfa358-73ce-4ebf-ada0-2593ee202798 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:55.546568 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-39bfa358-73ce-4ebf-ada0-2593ee202798 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1314 microversion: 2.1 time: 0.776280 Jul 20 04:32:55.549410 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2432/4940] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:54 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:55.559735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8a3e8c78-0b49-42fa-88a5-32c8aa5bce9e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:55.566938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8a3e8c78-0b49-42fa-88a5-32c8aa5bce9e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:55.594710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a3e8c78-0b49-42fa-88a5-32c8aa5bce9e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.596682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a3e8c78-0b49-42fa-88a5-32c8aa5bce9e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.598750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a3e8c78-0b49-42fa-88a5-32c8aa5bce9e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.603910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a3e8c78-0b49-42fa-88a5-32c8aa5bce9e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:56.026657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f8f546f-2af2-4c5b-ada6-1c723f7d1f66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:56.036949 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2f8f546f-2af2-4c5b-ada6-1c723f7d1f66 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1509 microversion: 2.1 time: 0.803768 Jul 20 04:32:56.061023 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2509/4941] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:55 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1509 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:56.077523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-72ab0388-623e-4025-92b7-fe1264e524cc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:56.080083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-72ab0388-623e-4025-92b7-fe1264e524cc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:56.093684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72ab0388-623e-4025-92b7-fe1264e524cc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:56.094684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72ab0388-623e-4025-92b7-fe1264e524cc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:56.095879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72ab0388-623e-4025-92b7-fe1264e524cc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:56.096489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72ab0388-623e-4025-92b7-fe1264e524cc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:56.918214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8a3e8c78-0b49-42fa-88a5-32c8aa5bce9e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:56.934047 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8a3e8c78-0b49-42fa-88a5-32c8aa5bce9e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1528 microversion: 2.1 time: 1.376246 Jul 20 04:32:56.934980 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2433/4942] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:55 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1528 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:56.950232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8ddf9699-c5d2-436f-9d3b-ed27c8360c7d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:56.952150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8ddf9699-c5d2-436f-9d3b-ed27c8360c7d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:56.973650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8ddf9699-c5d2-436f-9d3b-ed27c8360c7d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:56.975257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8ddf9699-c5d2-436f-9d3b-ed27c8360c7d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:56.978235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8ddf9699-c5d2-436f-9d3b-ed27c8360c7d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:56.979221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8ddf9699-c5d2-436f-9d3b-ed27c8360c7d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.044449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-72ab0388-623e-4025-92b7-fe1264e524cc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:57.053636 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-72ab0388-623e-4025-92b7-fe1264e524cc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1664 microversion: 2.1 time: 0.991563 Jul 20 04:32:57.054233 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2510/4943] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:56 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1664 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:57.093674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9bc87fbf-d923-4ede-9767-878988d62d64 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:57.108030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9bc87fbf-d923-4ede-9767-878988d62d64 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:57.129825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bc87fbf-d923-4ede-9767-878988d62d64 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.132145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bc87fbf-d923-4ede-9767-878988d62d64 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.133170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bc87fbf-d923-4ede-9767-878988d62d64 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.134572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bc87fbf-d923-4ede-9767-878988d62d64 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.755942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9bc87fbf-d923-4ede-9767-878988d62d64 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:57.787822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8ddf9699-c5d2-436f-9d3b-ed27c8360c7d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:57.792206 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9bc87fbf-d923-4ede-9767-878988d62d64 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1509 microversion: 2.1 time: 0.718512 Jul 20 04:32:57.792927 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2511/4944] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:57 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1509 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:57.803395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8ddf9699-c5d2-436f-9d3b-ed27c8360c7d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:57.821843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8ddf9699-c5d2-436f-9d3b-ed27c8360c7d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:57.823095 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8ddf9699-c5d2-436f-9d3b-ed27c8360c7d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1737 microversion: 2.20 time: 0.878854 Jul 20 04:32:57.827644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2ca5390-cb8b-4915-bad7-b21e94dc0a6a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:57.830094 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2434/4945] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:56 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1737 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:57.831496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8ddf9699-c5d2-436f-9d3b-ed27c8360c7d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:57.833449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f2ca5390-cb8b-4915-bad7-b21e94dc0a6a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:57.834590 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8ddf9699-c5d2-436f-9d3b-ed27c8360c7d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003391 Jul 20 04:32:57.847380 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2435/4946] 10.222.0.20 () {56 vars in 885 bytes} [Wed Jul 20 04:32:57 2022] GET /compute/ => generated 377 bytes in 16 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:32:57.863981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4f280c20-944c-4b73-8d2a-8ba5a7ed3a26 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:57.865201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4f280c20-944c-4b73-8d2a-8ba5a7ed3a26 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:57.866290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2ca5390-cb8b-4915-bad7-b21e94dc0a6a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.874148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2ca5390-cb8b-4915-bad7-b21e94dc0a6a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.879562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2ca5390-cb8b-4915-bad7-b21e94dc0a6a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.887254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2ca5390-cb8b-4915-bad7-b21e94dc0a6a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.900614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f280c20-944c-4b73-8d2a-8ba5a7ed3a26 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.909856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f280c20-944c-4b73-8d2a-8ba5a7ed3a26 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.911020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f280c20-944c-4b73-8d2a-8ba5a7ed3a26 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.913973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f280c20-944c-4b73-8d2a-8ba5a7ed3a26 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.005466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:58.052894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4f280c20-944c-4b73-8d2a-8ba5a7ed3a26 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:32:58.315347 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4f280c20-944c-4b73-8d2a-8ba5a7ed3a26 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 204 len: 0 microversion: 2.1 time: 0.465230 Jul 20 04:32:58.317762 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2436/4947] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:32:57 2022] DELETE /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:32:58.326796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-030a05e1-70fd-4b3b-82dd-4313dba0b474 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:58.327973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-030a05e1-70fd-4b3b-82dd-4313dba0b474 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:58.336032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-030a05e1-70fd-4b3b-82dd-4313dba0b474 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.336851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-030a05e1-70fd-4b3b-82dd-4313dba0b474 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.337859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-030a05e1-70fd-4b3b-82dd-4313dba0b474 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.338525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-030a05e1-70fd-4b3b-82dd-4313dba0b474 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.742097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f2ca5390-cb8b-4915-bad7-b21e94dc0a6a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:58.758315 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f2ca5390-cb8b-4915-bad7-b21e94dc0a6a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1314 microversion: 2.1 time: 0.964249 Jul 20 04:32:58.760806 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2512/4948] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:57 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:58.782410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9737a1de-2960-4042-a31f-29fbea02d6dc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:58.784963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9737a1de-2960-4042-a31f-29fbea02d6dc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:58.811154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9737a1de-2960-4042-a31f-29fbea02d6dc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.815412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9737a1de-2960-4042-a31f-29fbea02d6dc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.820652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9737a1de-2960-4042-a31f-29fbea02d6dc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.822781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9737a1de-2960-4042-a31f-29fbea02d6dc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.587447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9737a1de-2960-4042-a31f-29fbea02d6dc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.599840 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9737a1de-2960-4042-a31f-29fbea02d6dc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1515 microversion: 2.1 time: 0.837557 Jul 20 04:32:59.613119 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2513/4949] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:58 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1515 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:59.632795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-198ed1ff-7cda-40cf-a206-93f5e72ee7d2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:59.633489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-198ed1ff-7cda-40cf-a206-93f5e72ee7d2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:59.670100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-198ed1ff-7cda-40cf-a206-93f5e72ee7d2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.670590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-198ed1ff-7cda-40cf-a206-93f5e72ee7d2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.671397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-198ed1ff-7cda-40cf-a206-93f5e72ee7d2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.676583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-198ed1ff-7cda-40cf-a206-93f5e72ee7d2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.772955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-030a05e1-70fd-4b3b-82dd-4313dba0b474 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.794851 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-030a05e1-70fd-4b3b-82dd-4313dba0b474 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1528 microversion: 2.1 time: 1.472253 Jul 20 04:32:59.802136 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2437/4950] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:58 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1528 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:59.837107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-92f5f978-aeff-4d53-9722-6def95e9935b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:59.839141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92f5f978-aeff-4d53-9722-6def95e9935b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:59.848629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f5f978-aeff-4d53-9722-6def95e9935b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.850043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f5f978-aeff-4d53-9722-6def95e9935b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.851356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f5f978-aeff-4d53-9722-6def95e9935b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.852681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f5f978-aeff-4d53-9722-6def95e9935b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.286447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-198ed1ff-7cda-40cf-a206-93f5e72ee7d2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:00.295671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-198ed1ff-7cda-40cf-a206-93f5e72ee7d2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:00.306260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-198ed1ff-7cda-40cf-a206-93f5e72ee7d2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:00.310631 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-198ed1ff-7cda-40cf-a206-93f5e72ee7d2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1737 microversion: 2.20 time: 0.693985 Jul 20 04:33:00.316751 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2514/4951] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:59 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1737 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:00.633182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a1ea40dd-05d2-4ef0-b9ed-0f6a9b571c69 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:00.634293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a1ea40dd-05d2-4ef0-b9ed-0f6a9b571c69 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:00.645999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1ea40dd-05d2-4ef0-b9ed-0f6a9b571c69 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.646697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1ea40dd-05d2-4ef0-b9ed-0f6a9b571c69 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.648208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1ea40dd-05d2-4ef0-b9ed-0f6a9b571c69 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.648386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1ea40dd-05d2-4ef0-b9ed-0f6a9b571c69 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.069980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-92f5f978-aeff-4d53-9722-6def95e9935b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:01.091021 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-92f5f978-aeff-4d53-9722-6def95e9935b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1314 microversion: 2.1 time: 1.268157 Jul 20 04:33:01.105933 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2438/4952] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:59 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1314 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:01.126636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ae7c6664-c48c-4edf-b35f-207cc7974b1a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:01.127108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ae7c6664-c48c-4edf-b35f-207cc7974b1a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:01.184394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae7c6664-c48c-4edf-b35f-207cc7974b1a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.186230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae7c6664-c48c-4edf-b35f-207cc7974b1a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.187302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae7c6664-c48c-4edf-b35f-207cc7974b1a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.191901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae7c6664-c48c-4edf-b35f-207cc7974b1a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:02.723787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a1ea40dd-05d2-4ef0-b9ed-0f6a9b571c69 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:02.734741 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a1ea40dd-05d2-4ef0-b9ed-0f6a9b571c69 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1515 microversion: 2.1 time: 2.106050 Jul 20 04:33:02.746507 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2515/4953] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:00 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1515 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:02.757694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dabd9fb4-ed4f-46b6-9b63-416e60cd9b84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:02.758332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dabd9fb4-ed4f-46b6-9b63-416e60cd9b84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:02.785979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dabd9fb4-ed4f-46b6-9b63-416e60cd9b84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.786485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dabd9fb4-ed4f-46b6-9b63-416e60cd9b84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:02.787237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dabd9fb4-ed4f-46b6-9b63-416e60cd9b84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.787713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dabd9fb4-ed4f-46b6-9b63-416e60cd9b84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.126458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ae7c6664-c48c-4edf-b35f-207cc7974b1a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:03.140284 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ae7c6664-c48c-4edf-b35f-207cc7974b1a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1528 microversion: 2.1 time: 2.028737 Jul 20 04:33:03.142848 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2439/4954] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:01 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1528 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:03.158503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b4d0aa9-9ef8-4dfb-ac9f-e5e255220323 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:03.159367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7b4d0aa9-9ef8-4dfb-ac9f-e5e255220323 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:03.175352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b4d0aa9-9ef8-4dfb-ac9f-e5e255220323 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.178364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b4d0aa9-9ef8-4dfb-ac9f-e5e255220323 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.179830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b4d0aa9-9ef8-4dfb-ac9f-e5e255220323 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.181023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b4d0aa9-9ef8-4dfb-ac9f-e5e255220323 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.590075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dabd9fb4-ed4f-46b6-9b63-416e60cd9b84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:03.612536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dabd9fb4-ed4f-46b6-9b63-416e60cd9b84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:03.624676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dabd9fb4-ed4f-46b6-9b63-416e60cd9b84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:03.637617 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dabd9fb4-ed4f-46b6-9b63-416e60cd9b84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1737 microversion: 2.20 time: 0.889342 Jul 20 04:33:03.641681 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2516/4955] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:02 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1737 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:03.753155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1b3dbf5b-6ba5-4c8d-844a-47fe8579190e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:03.754865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1b3dbf5b-6ba5-4c8d-844a-47fe8579190e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:03.770632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b3dbf5b-6ba5-4c8d-844a-47fe8579190e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.774230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b3dbf5b-6ba5-4c8d-844a-47fe8579190e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.775166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b3dbf5b-6ba5-4c8d-844a-47fe8579190e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.781384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b3dbf5b-6ba5-4c8d-844a-47fe8579190e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.587769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1b3dbf5b-6ba5-4c8d-844a-47fe8579190e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:04.599471 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1b3dbf5b-6ba5-4c8d-844a-47fe8579190e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1473 microversion: 2.1 time: 0.850925 Jul 20 04:33:04.604580 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2517/4956] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:03 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1473 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:04.616911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4be0010a-c898-4358-b3ea-c9486b2e830f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:04.617547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4be0010a-c898-4358-b3ea-c9486b2e830f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:04.634790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4be0010a-c898-4358-b3ea-c9486b2e830f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:04.637835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4be0010a-c898-4358-b3ea-c9486b2e830f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.638242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7b4d0aa9-9ef8-4dfb-ac9f-e5e255220323 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:04.639656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4be0010a-c898-4358-b3ea-c9486b2e830f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:04.642803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4be0010a-c898-4358-b3ea-c9486b2e830f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.658535 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7b4d0aa9-9ef8-4dfb-ac9f-e5e255220323 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1314 microversion: 2.1 time: 1.514302 Jul 20 04:33:04.675944 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2440/4957] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:03 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1314 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:04.686483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ebf72e5-9672-47c2-8dc9-244e014ea77c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:04.687108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ebf72e5-9672-47c2-8dc9-244e014ea77c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:04.725369 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ebf72e5-9672-47c2-8dc9-244e014ea77c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:04.725845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ebf72e5-9672-47c2-8dc9-244e014ea77c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.726649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ebf72e5-9672-47c2-8dc9-244e014ea77c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:04.727093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ebf72e5-9672-47c2-8dc9-244e014ea77c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.645934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4be0010a-c898-4358-b3ea-c9486b2e830f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:05.655377 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4be0010a-c898-4358-b3ea-c9486b2e830f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1528 microversion: 2.1 time: 1.049654 Jul 20 04:33:05.662196 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2518/4958] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:04 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1528 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:05.668703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-c70e5f25-2cba-4586-83df-57a247c71d61 req-1ad29cde-92de-4560-8dc0-013e0006d8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62976333-e59c-48d3-8222-e07e6b0c043a", "name": "network-vif-plugged", "status": "completed", "tag": "04eefcfd-30b6-44aa-a955-5d97ac50f367"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:05.715654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c70e5f25-2cba-4586-83df-57a247c71d61 req-1ad29cde-92de-4560-8dc0-013e0006d8f0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.716115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c70e5f25-2cba-4586-83df-57a247c71d61 req-1ad29cde-92de-4560-8dc0-013e0006d8f0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.750558 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c70e5f25-2cba-4586-83df-57a247c71d61 req-1ad29cde-92de-4560-8dc0-013e0006d8f0 service nova] Creating event network-vif-plugged:04eefcfd-30b6-44aa-a955-5d97ac50f367 for instance 62976333-e59c-48d3-8222-e07e6b0c043a on n-h1-764485-11 Jul 20 04:33:05.766507 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-c70e5f25-2cba-4586-83df-57a247c71d61 req-1ad29cde-92de-4560-8dc0-013e0006d8f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102276 Jul 20 04:33:05.767413 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2519/4959] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:05.779600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ebf72e5-9672-47c2-8dc9-244e014ea77c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:05.785457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9abdd4af-4a05-4622-a6c3-ee788f6ad797 req-51a8ea8b-fbe6-4a0f-935e-3e2b6a6974f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6a337-9b96-4c0a-8858-5c456313b327", "name": "network-vif-deleted", "tag": "18cda90d-44d1-42ea-ad83-c0374e60aceb"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:05.804923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ebf72e5-9672-47c2-8dc9-244e014ea77c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:05.807824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ebf72e5-9672-47c2-8dc9-244e014ea77c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:05.810351 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ebf72e5-9672-47c2-8dc9-244e014ea77c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1737 microversion: 2.20 time: 1.133221 Jul 20 04:33:05.810599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9abdd4af-4a05-4622-a6c3-ee788f6ad797 req-51a8ea8b-fbe6-4a0f-935e-3e2b6a6974f8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.811058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9abdd4af-4a05-4622-a6c3-ee788f6ad797 req-51a8ea8b-fbe6-4a0f-935e-3e2b6a6974f8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.824520 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2441/4960] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:04 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1737 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:05.832227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2b1c00ee-bee9-42ae-ba12-076787efac25 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:05.833569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2b1c00ee-bee9-42ae-ba12-076787efac25 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:05.835300 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9abdd4af-4a05-4622-a6c3-ee788f6ad797 req-51a8ea8b-fbe6-4a0f-935e-3e2b6a6974f8 service nova] Creating event network-vif-deleted:18cda90d-44d1-42ea-ad83-c0374e60aceb for instance f0b6a337-9b96-4c0a-8858-5c456313b327 on n-h2-764485-11 Jul 20 04:33:05.836339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:05.847468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b1c00ee-bee9-42ae-ba12-076787efac25 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.848834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b1c00ee-bee9-42ae-ba12-076787efac25 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.850335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b1c00ee-bee9-42ae-ba12-076787efac25 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.851337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b1c00ee-bee9-42ae-ba12-076787efac25 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.873538 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9abdd4af-4a05-4622-a6c3-ee788f6ad797 req-51a8ea8b-fbe6-4a0f-935e-3e2b6a6974f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104095 Jul 20 04:33:05.874342 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2520/4961] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:05.880357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2e140faa-5c68-4228-ac62-464419a812a2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:05.881088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2e140faa-5c68-4228-ac62-464419a812a2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:05.902483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b1c00ee-bee9-42ae-ba12-076787efac25 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.903090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b1c00ee-bee9-42ae-ba12-076787efac25 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.903977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-2b1c00ee-bee9-42ae-ba12-076787efac25 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lazy-loading 'fault' on Instance uuid f0b6a337-9b96-4c0a-8858-5c456313b327 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:33:05.915500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e140faa-5c68-4228-ac62-464419a812a2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.916107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e140faa-5c68-4228-ac62-464419a812a2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.917135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e140faa-5c68-4228-ac62-464419a812a2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.917405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e140faa-5c68-4228-ac62-464419a812a2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.030282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2b1c00ee-bee9-42ae-ba12-076787efac25 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:06.050146 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2b1c00ee-bee9-42ae-ba12-076787efac25 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 200 len: 1319 microversion: 2.1 time: 0.223910 Jul 20 04:33:06.052568 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2442/4962] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:05 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:06.480627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2e140faa-5c68-4228-ac62-464419a812a2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:06.506762 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2e140faa-5c68-4228-ac62-464419a812a2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1314 microversion: 2.1 time: 0.621870 Jul 20 04:33:06.518055 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2521/4963] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:05 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:06.680875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9cb1c701-37bb-45cc-908c-3e631593570c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:06.681526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9cb1c701-37bb-45cc-908c-3e631593570c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:06.699206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9cb1c701-37bb-45cc-908c-3e631593570c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.702364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9cb1c701-37bb-45cc-908c-3e631593570c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.703371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9cb1c701-37bb-45cc-908c-3e631593570c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.703910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9cb1c701-37bb-45cc-908c-3e631593570c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.842553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9e2acb92-864f-4167-83cd-cd27cb72b95d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:06.845677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9e2acb92-864f-4167-83cd-cd27cb72b95d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:06.867254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e2acb92-864f-4167-83cd-cd27cb72b95d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.867893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e2acb92-864f-4167-83cd-cd27cb72b95d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.868772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e2acb92-864f-4167-83cd-cd27cb72b95d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.870183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e2acb92-864f-4167-83cd-cd27cb72b95d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.216469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9cb1c701-37bb-45cc-908c-3e631593570c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:07.233866 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9cb1c701-37bb-45cc-908c-3e631593570c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1528 microversion: 2.1 time: 0.557702 Jul 20 04:33:07.239552 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2443/4964] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:06 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1528 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:07.250210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-55409c97-5882-4223-8b4f-b702fb2654b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:07.251337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-55409c97-5882-4223-8b4f-b702fb2654b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:07.260707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55409c97-5882-4223-8b4f-b702fb2654b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.261438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55409c97-5882-4223-8b4f-b702fb2654b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.262407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55409c97-5882-4223-8b4f-b702fb2654b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.263024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55409c97-5882-4223-8b4f-b702fb2654b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.283874 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-55409c97-5882-4223-8b4f-b702fb2654b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-55409c97-5882-4223-8b4f-b702fb2654b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 HTTP/1.1 Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'f0b6a337-9b96-4c0a-8858-5c456313b327'} Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:33:07.285840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:07.290813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:07.290813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:07.290813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:07.290813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:07.290813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:33:07.290813 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:33:07.301311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-55409c97-5882-4223-8b4f-b702fb2654b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:07.305099 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-55409c97-5882-4223-8b4f-b702fb2654b8 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 404 len: 111 microversion: 2.1 time: 0.064959 Jul 20 04:33:07.309284 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2444/4965] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:07 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:33:07.331791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e2acb92-864f-4167-83cd-cd27cb72b95d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:07.347104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e2acb92-864f-4167-83cd-cd27cb72b95d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:07.351700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e2acb92-864f-4167-83cd-cd27cb72b95d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:07.353189 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9e2acb92-864f-4167-83cd-cd27cb72b95d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1719 microversion: 2.20 time: 0.519811 Jul 20 04:33:07.368391 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2522/4966] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:06 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1719 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:07.503543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2044434204", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "be069fc8-30ed-40bc-8dbd-2efb24615595"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:07.525071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-87f1e881-ae2e-4870-8703-a59329ec3bf8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:07.526175 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-87f1e881-ae2e-4870-8703-a59329ec3bf8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:07.537083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87f1e881-ae2e-4870-8703-a59329ec3bf8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.540486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87f1e881-ae2e-4870-8703-a59329ec3bf8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.560549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87f1e881-ae2e-4870-8703-a59329ec3bf8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.561016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87f1e881-ae2e-4870-8703-a59329ec3bf8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.653609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] validate_networks() for [('be069fc8-30ed-40bc-8dbd-2efb24615595', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:33:08.047362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-87f1e881-ae2e-4870-8703-a59329ec3bf8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:08.055644 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-87f1e881-ae2e-4870-8703-a59329ec3bf8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1314 microversion: 2.1 time: 0.535718 Jul 20 04:33:08.085899 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2523/4967] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:07 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:08.258620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7cd563b5-0383-49fd-bea4-7a1756f328a9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:08.259585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7cd563b5-0383-49fd-bea4-7a1756f328a9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:08.269429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cd563b5-0383-49fd-bea4-7a1756f328a9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.276619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cd563b5-0383-49fd-bea4-7a1756f328a9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.278376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cd563b5-0383-49fd-bea4-7a1756f328a9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.283964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7cd563b5-0383-49fd-bea4-7a1756f328a9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.965883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7cd563b5-0383-49fd-bea4-7a1756f328a9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:08.978736 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7cd563b5-0383-49fd-bea4-7a1756f328a9 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1528 microversion: 2.1 time: 0.725465 Jul 20 04:33:08.985913 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2524/4968] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:08 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1528 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:08.991249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9bbeeddf-2888-4b8f-990e-b55cab0a55a6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:08.996830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9bbeeddf-2888-4b8f-990e-b55cab0a55a6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:09.010686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bbeeddf-2888-4b8f-990e-b55cab0a55a6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:09.013468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bbeeddf-2888-4b8f-990e-b55cab0a55a6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:09.016725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bbeeddf-2888-4b8f-990e-b55cab0a55a6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:09.017496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bbeeddf-2888-4b8f-990e-b55cab0a55a6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.075958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:33:10.076981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:33:10.077865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:33:10.078714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:33:10.079673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:33:10.094818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.100792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.102509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.103412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.197801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:10.217913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Getting quotas for user 7d38b1e323c5490fbb4c0023034874c8 and project abea957d3266410c8c9dab8b52a7c170. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:10.246661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9bbeeddf-2888-4b8f-990e-b55cab0a55a6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.268037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9bbeeddf-2888-4b8f-990e-b55cab0a55a6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.271683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9bbeeddf-2888-4b8f-990e-b55cab0a55a6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.274454 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9bbeeddf-2888-4b8f-990e-b55cab0a55a6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1719 microversion: 2.20 time: 1.285957 Jul 20 04:33:10.287007 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2525/4969] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:08 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1719 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:10.308184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:33:10.316964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:33:10.318518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9113a5bc-3aef-4cf9-bb55-7dac0fbc4393 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:10.319150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9113a5bc-3aef-4cf9-bb55-7dac0fbc4393 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:10.338140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9113a5bc-3aef-4cf9-bb55-7dac0fbc4393 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.338603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9113a5bc-3aef-4cf9-bb55-7dac0fbc4393 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.340114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9113a5bc-3aef-4cf9-bb55-7dac0fbc4393 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.340573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9113a5bc-3aef-4cf9-bb55-7dac0fbc4393 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.426621 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a229a925-b012-4894-8f22-30a058a710bc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.930289 Jul 20 04:33:10.427971 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2445/4970] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:33:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:33:10.432801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b58a881c-8bf3-4cee-a33b-d8658bc10c09 req-f7d38f78-d26e-42af-9b91-cd46b5dc3214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76d5764-986d-4d3f-806f-1f8b1c5a73c1", "name": "network-vif-unplugged", "status": "completed", "tag": "f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:10.465828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b58a881c-8bf3-4cee-a33b-d8658bc10c09 req-f7d38f78-d26e-42af-9b91-cd46b5dc3214 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.469368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b58a881c-8bf3-4cee-a33b-d8658bc10c09 req-f7d38f78-d26e-42af-9b91-cd46b5dc3214 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.510063 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b58a881c-8bf3-4cee-a33b-d8658bc10c09 req-f7d38f78-d26e-42af-9b91-cd46b5dc3214 service nova] Creating event network-vif-unplugged:f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981 for instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 on n-h1-764485-11 Jul 20 04:33:10.524358 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b58a881c-8bf3-4cee-a33b-d8658bc10c09 req-f7d38f78-d26e-42af-9b91-cd46b5dc3214 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095017 Jul 20 04:33:10.525781 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2446/4971] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:10.540467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-157f5ffb-b0fa-4ace-8bba-bf56b80df107 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:10.541364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-157f5ffb-b0fa-4ace-8bba-bf56b80df107 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:10.566427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-157f5ffb-b0fa-4ace-8bba-bf56b80df107 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.568816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-157f5ffb-b0fa-4ace-8bba-bf56b80df107 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.570930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-157f5ffb-b0fa-4ace-8bba-bf56b80df107 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.572570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-157f5ffb-b0fa-4ace-8bba-bf56b80df107 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.613242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:10.660580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9113a5bc-3aef-4cf9-bb55-7dac0fbc4393 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.680778 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9113a5bc-3aef-4cf9-bb55-7dac0fbc4393 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1502 microversion: 2.1 time: 0.375903 Jul 20 04:33:10.688454 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2526/4972] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:10 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1502 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:10.703546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1c6e10f2-33c1-4ce5-96af-8a1b977d9215 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:10.704353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1c6e10f2-33c1-4ce5-96af-8a1b977d9215 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:10.864647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1c6e10f2-33c1-4ce5-96af-8a1b977d9215 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.894229 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1c6e10f2-33c1-4ce5-96af-8a1b977d9215 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1209 microversion: 2.1 time: 0.202931 Jul 20 04:33:10.895248 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2527/4973] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:10 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1209 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:10.908138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7807914c-ced1-41a3-bf7a-67566082eb4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:10.912268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7807914c-ced1-41a3-bf7a-67566082eb4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:10.924022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7807914c-ced1-41a3-bf7a-67566082eb4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.926360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7807914c-ced1-41a3-bf7a-67566082eb4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.931400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7807914c-ced1-41a3-bf7a-67566082eb4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.932127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7807914c-ced1-41a3-bf7a-67566082eb4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.023281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-157f5ffb-b0fa-4ace-8bba-bf56b80df107 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:11.039884 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-157f5ffb-b0fa-4ace-8bba-bf56b80df107 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1528 microversion: 2.1 time: 0.505575 Jul 20 04:33:11.050662 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2447/4974] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:10 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1528 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:11.295196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5546ea4e-d872-4a33-b1ba-7b5eb875833d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:11.297592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5546ea4e-d872-4a33-b1ba-7b5eb875833d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:11.312327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5546ea4e-d872-4a33-b1ba-7b5eb875833d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.314911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5546ea4e-d872-4a33-b1ba-7b5eb875833d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.316325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5546ea4e-d872-4a33-b1ba-7b5eb875833d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.317278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5546ea4e-d872-4a33-b1ba-7b5eb875833d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.354716 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.network.security_group_api [None req-7807914c-ced1-41a3-bf7a-67566082eb4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Removing security group a50490b4-7648-43e2-819c-0e4ed06e687b from port 04eefcfd-30b6-44aa-a955-5d97ac50f367 Jul 20 04:33:11.720125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5546ea4e-d872-4a33-b1ba-7b5eb875833d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:11.735063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5546ea4e-d872-4a33-b1ba-7b5eb875833d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:11.737070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5546ea4e-d872-4a33-b1ba-7b5eb875833d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:11.738593 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5546ea4e-d872-4a33-b1ba-7b5eb875833d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1719 microversion: 2.20 time: 0.448919 Jul 20 04:33:11.739427 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2448/4975] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:11 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1719 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:33:11.923018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-db49e0de-2338-4729-bb2a-9e464d6f29cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:11.924345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-db49e0de-2338-4729-bb2a-9e464d6f29cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:11.964488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db49e0de-2338-4729-bb2a-9e464d6f29cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.965457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db49e0de-2338-4729-bb2a-9e464d6f29cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.969244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db49e0de-2338-4729-bb2a-9e464d6f29cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.970137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db49e0de-2338-4729-bb2a-9e464d6f29cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.137409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-db49e0de-2338-4729-bb2a-9e464d6f29cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:12.153420 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-db49e0de-2338-4729-bb2a-9e464d6f29cd tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1279 microversion: 2.1 time: 0.244478 Jul 20 04:33:12.154195 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2449/4976] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:11 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1279 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:12.158993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d5aa033e-8e0c-477d-9154-34f1c4f8566a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:12.165549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d5aa033e-8e0c-477d-9154-34f1c4f8566a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:12.177065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5aa033e-8e0c-477d-9154-34f1c4f8566a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.177765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5aa033e-8e0c-477d-9154-34f1c4f8566a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.178756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5aa033e-8e0c-477d-9154-34f1c4f8566a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.179366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5aa033e-8e0c-477d-9154-34f1c4f8566a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.477623 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7807914c-ced1-41a3-bf7a-67566082eb4b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a/action" status: 202 len: 0 microversion: 2.1 time: 1.579716 Jul 20 04:33:12.478546 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2528/4977] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:10 2022] POST /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a/action => generated 0 bytes in 1581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:12.486862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-318d0d25-9c7e-43fd-8cb1-35d1776d2e90 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:12.487750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-318d0d25-9c7e-43fd-8cb1-35d1776d2e90 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:12.506901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-318d0d25-9c7e-43fd-8cb1-35d1776d2e90 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.507601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-318d0d25-9c7e-43fd-8cb1-35d1776d2e90 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.508566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-318d0d25-9c7e-43fd-8cb1-35d1776d2e90 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.509354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-318d0d25-9c7e-43fd-8cb1-35d1776d2e90 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.955825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d5aa033e-8e0c-477d-9154-34f1c4f8566a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:12.968738 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d5aa033e-8e0c-477d-9154-34f1c4f8566a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1528 microversion: 2.1 time: 0.809586 Jul 20 04:33:12.985877 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2450/4978] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:12 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1528 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:12.992585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-318d0d25-9c7e-43fd-8cb1-35d1776d2e90 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.005102 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-318d0d25-9c7e-43fd-8cb1-35d1776d2e90 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1460 microversion: 2.1 time: 0.522405 Jul 20 04:33:13.005990 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2529/4979] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:12 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1460 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:13.011296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-93edc779-5a15-4c82-b266-54b4a74edf11 req-ced2d0fc-2f68-4d48-ab2f-1f5a63286ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62976333-e59c-48d3-8222-e07e6b0c043a", "tag": "04eefcfd-30b6-44aa-a955-5d97ac50f367"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:13.020265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-82db76ed-dfce-4ea5-a757-15f6614b0b78 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:13.021183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-82db76ed-dfce-4ea5-a757-15f6614b0b78 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:13.032076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82db76ed-dfce-4ea5-a757-15f6614b0b78 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.036174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82db76ed-dfce-4ea5-a757-15f6614b0b78 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.037158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82db76ed-dfce-4ea5-a757-15f6614b0b78 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.037678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82db76ed-dfce-4ea5-a757-15f6614b0b78 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.041031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-93edc779-5a15-4c82-b266-54b4a74edf11 req-ced2d0fc-2f68-4d48-ab2f-1f5a63286ed5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.042301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-93edc779-5a15-4c82-b266-54b4a74edf11 req-ced2d0fc-2f68-4d48-ab2f-1f5a63286ed5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.078582 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-93edc779-5a15-4c82-b266-54b4a74edf11 req-ced2d0fc-2f68-4d48-ab2f-1f5a63286ed5 service nova] Creating event network-changed:04eefcfd-30b6-44aa-a955-5d97ac50f367 for instance 62976333-e59c-48d3-8222-e07e6b0c043a on n-h1-764485-11 Jul 20 04:33:13.087047 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-93edc779-5a15-4c82-b266-54b4a74edf11 req-ced2d0fc-2f68-4d48-ab2f-1f5a63286ed5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094050 Jul 20 04:33:13.087922 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2451/4980] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:13.094527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-18286dcc-0bea-4b33-9832-2601e21ab900 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:13.096516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-18286dcc-0bea-4b33-9832-2601e21ab900 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:13.105199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18286dcc-0bea-4b33-9832-2601e21ab900 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.106840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18286dcc-0bea-4b33-9832-2601e21ab900 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.109982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18286dcc-0bea-4b33-9832-2601e21ab900 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.110632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-18286dcc-0bea-4b33-9832-2601e21ab900 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.662960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-82db76ed-dfce-4ea5-a757-15f6614b0b78 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.677566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-82db76ed-dfce-4ea5-a757-15f6614b0b78 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.679073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-82db76ed-dfce-4ea5-a757-15f6614b0b78 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.680304 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-82db76ed-dfce-4ea5-a757-15f6614b0b78 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1662 microversion: 2.20 time: 0.673200 Jul 20 04:33:13.681182 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2530/4981] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:13 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1662 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:13.696511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f9390ee-36ab-4fa9-84f1-03f77074187b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:13.697276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1f9390ee-36ab-4fa9-84f1-03f77074187b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:13.708006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-18286dcc-0bea-4b33-9832-2601e21ab900 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.713674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f9390ee-36ab-4fa9-84f1-03f77074187b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.715045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f9390ee-36ab-4fa9-84f1-03f77074187b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.718850 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-18286dcc-0bea-4b33-9832-2601e21ab900 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.629534 Jul 20 04:33:13.719605 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2452/4982] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:13 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:13.720047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f9390ee-36ab-4fa9-84f1-03f77074187b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.720622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f9390ee-36ab-4fa9-84f1-03f77074187b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.726252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-421caff3-8da3-415f-8300-f7a724ea4d33 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84d8b537-461f-4b36-8d33-ebacc1fb1c38"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:13.727787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-421caff3-8da3-415f-8300-f7a724ea4d33 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:13.740042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-421caff3-8da3-415f-8300-f7a724ea4d33 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.740869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-421caff3-8da3-415f-8300-f7a724ea4d33 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.741888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-421caff3-8da3-415f-8300-f7a724ea4d33 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.742409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-421caff3-8da3-415f-8300-f7a724ea4d33 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.765940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:13.913856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1f9390ee-36ab-4fa9-84f1-03f77074187b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.933758 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f9390ee-36ab-4fa9-84f1-03f77074187b tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1267 microversion: 2.1 time: 0.251307 Jul 20 04:33:13.934371 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2531/4983] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:13 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:14.260801 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-421caff3-8da3-415f-8300-f7a724ea4d33 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "POST /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.536621 Jul 20 04:33:14.263580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-26e89497-7880-4133-b146-36004fee7296 tempest-QuotasTestJSON-1853441197 tempest-QuotasTestJSON-1853441197-project] Calling method '.version_select at 0x7fbf9fe688b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:14.279170 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2453/4984] 10.222.0.20 () {62 vars in 1363 bytes} [Wed Jul 20 04:33:13 2022] POST /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments => generated 188 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:33:14.298793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-57d1163c-c9db-4a0a-b2ff-982cd7f66ead tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:14.304494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-57d1163c-c9db-4a0a-b2ff-982cd7f66ead tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:14.331312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57d1163c-c9db-4a0a-b2ff-982cd7f66ead tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.331933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57d1163c-c9db-4a0a-b2ff-982cd7f66ead tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:14.337264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57d1163c-c9db-4a0a-b2ff-982cd7f66ead tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.337773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57d1163c-c9db-4a0a-b2ff-982cd7f66ead tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:14.482238 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-26e89497-7880-4133-b146-36004fee7296 tempest-QuotasTestJSON-1853441197 tempest-QuotasTestJSON-1853441197-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/a92c57ab0e5b4495aaf0fe8f487a6617/defaults" status: 200 len: 371 microversion: 2.1 time: 0.540294 Jul 20 04:33:14.482926 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2532/4985] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:33:13 2022] GET /compute/v2.1/os-quota-sets/a92c57ab0e5b4495aaf0fe8f487a6617/defaults => generated 371 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:14.493009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-03a4c292-08e4-48d1-a2b6-76f12d4452e8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:14.493648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-03a4c292-08e4-48d1-a2b6-76f12d4452e8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:14.522628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03a4c292-08e4-48d1-a2b6-76f12d4452e8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.523281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03a4c292-08e4-48d1-a2b6-76f12d4452e8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:14.524163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03a4c292-08e4-48d1-a2b6-76f12d4452e8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.524642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03a4c292-08e4-48d1-a2b6-76f12d4452e8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.358960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-57d1163c-c9db-4a0a-b2ff-982cd7f66ead tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:15.369531 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-57d1163c-c9db-4a0a-b2ff-982cd7f66ead tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 1.088696 Jul 20 04:33:15.379543 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2454/4986] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:14 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:15.393300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-03a4c292-08e4-48d1-a2b6-76f12d4452e8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:15.394666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9a96f178-52a3-402d-990d-83c14b2fba47 tempest-QuotasTestJSON-1853441197 tempest-QuotasTestJSON-1853441197-project] Calling method '.version_select at 0x7fbf9d1354c0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:15.408997 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-03a4c292-08e4-48d1-a2b6-76f12d4452e8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1510 microversion: 2.1 time: 0.922325 Jul 20 04:33:15.410355 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2533/4987] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:14 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1510 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:15.423756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-08d49e29-d9fc-4a86-ac16-05c8d21f094f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:15.424969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-08d49e29-d9fc-4a86-ac16-05c8d21f094f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:15.432629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=73 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:15.434683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08d49e29-d9fc-4a86-ac16-05c8d21f094f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.435488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08d49e29-d9fc-4a86-ac16-05c8d21f094f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.436570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08d49e29-d9fc-4a86-ac16-05c8d21f094f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.437451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08d49e29-d9fc-4a86-ac16-05c8d21f094f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.559107 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-08d49e29-d9fc-4a86-ac16-05c8d21f094f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "POST /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/action" status: 202 len: 0 microversion: 2.20 time: 0.146733 Jul 20 04:33:15.560807 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2534/4988] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:33:15 2022] POST /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:33:15.568201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c0789a1-c1c4-41d6-829f-1b0514068a6c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:15.569835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6c0789a1-c1c4-41d6-829f-1b0514068a6c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:15.578476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c0789a1-c1c4-41d6-829f-1b0514068a6c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.579132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c0789a1-c1c4-41d6-829f-1b0514068a6c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.580647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c0789a1-c1c4-41d6-829f-1b0514068a6c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.581270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c0789a1-c1c4-41d6-829f-1b0514068a6c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.870755 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9a96f178-52a3-402d-990d-83c14b2fba47 tempest-QuotasTestJSON-1853441197 tempest-QuotasTestJSON-1853441197-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/a92c57ab0e5b4495aaf0fe8f487a6617" status: 200 len: 371 microversion: 2.1 time: 0.487264 Jul 20 04:33:15.871470 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2455/4989] 10.222.0.20 () {58 vars in 1241 bytes} [Wed Jul 20 04:33:15 2022] GET /compute/v2.1/os-quota-sets/a92c57ab0e5b4495aaf0fe8f487a6617 => generated 371 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:15.880748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0c60422-56a3-4dbe-a8d3-0cc3c643cb3c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:15.881771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b0c60422-56a3-4dbe-a8d3-0cc3c643cb3c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:15.892471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0c60422-56a3-4dbe-a8d3-0cc3c643cb3c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.894672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0c60422-56a3-4dbe-a8d3-0cc3c643cb3c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.896482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0c60422-56a3-4dbe-a8d3-0cc3c643cb3c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.897440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0c60422-56a3-4dbe-a8d3-0cc3c643cb3c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.122698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6c0789a1-c1c4-41d6-829f-1b0514068a6c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:16.134829 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6c0789a1-c1c4-41d6-829f-1b0514068a6c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1309 microversion: 2.1 time: 0.572711 Jul 20 04:33:16.136382 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2535/4990] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:15 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1309 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:16.155575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5ffab362-a71f-4490-a80f-f5ff66bd273b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:16.156579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5ffab362-a71f-4490-a80f-f5ff66bd273b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:16.177418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ffab362-a71f-4490-a80f-f5ff66bd273b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.177979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ffab362-a71f-4490-a80f-f5ff66bd273b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.178698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ffab362-a71f-4490-a80f-f5ff66bd273b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.179089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ffab362-a71f-4490-a80f-f5ff66bd273b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.382814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b0c60422-56a3-4dbe-a8d3-0cc3c643cb3c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:16.397431 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0c60422-56a3-4dbe-a8d3-0cc3c643cb3c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.524575 Jul 20 04:33:16.398030 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2456/4991] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:15 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:16.411158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d5d4254f-0b2e-4a09-8359-49f9d9de0f87 tempest-QuotasTestJSON-1853441197 tempest-QuotasTestJSON-1853441197-project] Calling method '.version_select at 0x7fbf9d135f70>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:16.532493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5ffab362-a71f-4490-a80f-f5ff66bd273b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:16.550341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5ffab362-a71f-4490-a80f-f5ff66bd273b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:16.551941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5ffab362-a71f-4490-a80f-f5ff66bd273b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:16.553380 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5ffab362-a71f-4490-a80f-f5ff66bd273b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1748 microversion: 2.20 time: 0.415992 Jul 20 04:33:16.553949 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2536/4992] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:16 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1748 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:16.560906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-87fea9ed-bf06-4bad-9420-8c7fafba55a5 req-978606ab-e2b0-42e2-981b-020888815666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f3226f-82c7-4e50-9a7d-ca0721979912", "name": "network-vif-unplugged", "status": "completed", "tag": "e8a977e2-08d6-4a53-9757-e0d3ee9db0ff"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:16.576317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-87fea9ed-bf06-4bad-9420-8c7fafba55a5 req-978606ab-e2b0-42e2-981b-020888815666 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.577528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-87fea9ed-bf06-4bad-9420-8c7fafba55a5 req-978606ab-e2b0-42e2-981b-020888815666 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.594389 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-87fea9ed-bf06-4bad-9420-8c7fafba55a5 req-978606ab-e2b0-42e2-981b-020888815666 service nova] Creating event network-vif-unplugged:e8a977e2-08d6-4a53-9757-e0d3ee9db0ff for instance a2f3226f-82c7-4e50-9a7d-ca0721979912 on n-h1-764485-11 Jul 20 04:33:16.602262 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-87fea9ed-bf06-4bad-9420-8c7fafba55a5 req-978606ab-e2b0-42e2-981b-020888815666 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044605 Jul 20 04:33:16.607248 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2537/4993] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:16.614000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bb6bba1b-4853-4177-b7f8-b6ca80fbe6b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:16.614992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bb6bba1b-4853-4177-b7f8-b6ca80fbe6b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:16.621719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb6bba1b-4853-4177-b7f8-b6ca80fbe6b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.622186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb6bba1b-4853-4177-b7f8-b6ca80fbe6b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.622964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb6bba1b-4853-4177-b7f8-b6ca80fbe6b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.623414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb6bba1b-4853-4177-b7f8-b6ca80fbe6b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.954747 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d5d4254f-0b2e-4a09-8359-49f9d9de0f87 tempest-QuotasTestJSON-1853441197 tempest-QuotasTestJSON-1853441197-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/a92c57ab0e5b4495aaf0fe8f487a6617/defaults" status: 200 len: 371 microversion: 2.1 time: 0.548543 Jul 20 04:33:16.955843 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2457/4994] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 04:33:16 2022] GET /compute/v2.1/os-quota-sets/a92c57ab0e5b4495aaf0fe8f487a6617/defaults => generated 371 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:16.969767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b65160a9-fa71-4436-bb39-def86619ee77 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:16.970740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b65160a9-fa71-4436-bb39-def86619ee77 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:16.980856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b65160a9-fa71-4436-bb39-def86619ee77 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.982158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b65160a9-fa71-4436-bb39-def86619ee77 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.984867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b65160a9-fa71-4436-bb39-def86619ee77 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.986059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b65160a9-fa71-4436-bb39-def86619ee77 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:17.197599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bb6bba1b-4853-4177-b7f8-b6ca80fbe6b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:17.211792 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bb6bba1b-4853-4177-b7f8-b6ca80fbe6b8 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.599556 Jul 20 04:33:17.215876 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2538/4995] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:16 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:17.227851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-e77b43eb-0413-4574-9643-e09bd389383c req-e12c143d-f1c4-4709-81c1-604766293d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bc8d51-b9c3-441b-8160-c27334808041", "tag": "4254f267-2a36-4654-ad52-6ee068bcdee1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:17.254464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e77b43eb-0413-4574-9643-e09bd389383c req-e12c143d-f1c4-4709-81c1-604766293d93 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:17.255933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e77b43eb-0413-4574-9643-e09bd389383c req-e12c143d-f1c4-4709-81c1-604766293d93 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:17.280495 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e77b43eb-0413-4574-9643-e09bd389383c req-e12c143d-f1c4-4709-81c1-604766293d93 service nova] Creating event network-changed:4254f267-2a36-4654-ad52-6ee068bcdee1 for instance 54bc8d51-b9c3-441b-8160-c27334808041 on n-h2-764485-11 Jul 20 04:33:17.287485 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-e77b43eb-0413-4574-9643-e09bd389383c req-e12c143d-f1c4-4709-81c1-604766293d93 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070587 Jul 20 04:33:17.288484 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2539/4996] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:17.295473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1933ccb4-c8a4-4fe5-8ca3-65d892f02a88 tempest-QuotasTestJSON-1853441197 tempest-QuotasTestJSON-1853441197-project] Calling method '.version_select at 0x7fbf9c6319d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:17.399109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b65160a9-fa71-4436-bb39-def86619ee77 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:17.410826 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b65160a9-fa71-4436-bb39-def86619ee77 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1513 microversion: 2.1 time: 0.444655 Jul 20 04:33:17.412404 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2458/4997] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:16 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1513 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:17.423023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7c7efb95-7c87-4e4c-9749-c30b5c507757 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:17.424120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7c7efb95-7c87-4e4c-9749-c30b5c507757 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:17.435759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c7efb95-7c87-4e4c-9749-c30b5c507757 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:17.436304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c7efb95-7c87-4e4c-9749-c30b5c507757 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:17.437747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c7efb95-7c87-4e4c-9749-c30b5c507757 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:17.438495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c7efb95-7c87-4e4c-9749-c30b5c507757 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:17.684860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7c7efb95-7c87-4e4c-9749-c30b5c507757 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:17.695387 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7c7efb95-7c87-4e4c-9749-c30b5c507757 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1309 microversion: 2.1 time: 0.281790 Jul 20 04:33:17.696688 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2459/4998] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:17 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1309 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:17.701958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-391946787", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "1a7e8d9c-f123-4816-a77b-51f1b199a341"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:17.764807 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1933ccb4-c8a4-4fe5-8ca3-65d892f02a88 tempest-QuotasTestJSON-1853441197 tempest-QuotasTestJSON-1853441197-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/a92c57ab0e5b4495aaf0fe8f487a6617" status: 200 len: 371 microversion: 2.1 time: 0.474371 Jul 20 04:33:17.770362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] validate_networks() for [('1a7e8d9c-f123-4816-a77b-51f1b199a341', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:33:17.771475 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2540/4999] 10.222.0.20 () {58 vars in 1241 bytes} [Wed Jul 20 04:33:17 2022] GET /compute/v2.1/os-quota-sets/a92c57ab0e5b4495aaf0fe8f487a6617 => generated 371 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:17.782655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a8451c0e-34e5-4e67-a1f1-f77286e1d6c7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:17.786982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a8451c0e-34e5-4e67-a1f1-f77286e1d6c7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:17.800809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8451c0e-34e5-4e67-a1f1-f77286e1d6c7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:17.804983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8451c0e-34e5-4e67-a1f1-f77286e1d6c7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:17.805912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8451c0e-34e5-4e67-a1f1-f77286e1d6c7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:17.807433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8451c0e-34e5-4e67-a1f1-f77286e1d6c7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.110580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a8451c0e-34e5-4e67-a1f1-f77286e1d6c7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:18.121836 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a8451c0e-34e5-4e67-a1f1-f77286e1d6c7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1453 microversion: 2.1 time: 0.349232 Jul 20 04:33:18.122447 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2541/5000] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:17 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1453 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:18.131063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4227f9f4-d6d8-4ea5-aa13-7baaa5b1b232 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:18.135273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4227f9f4-d6d8-4ea5-aa13-7baaa5b1b232 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:18.143738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4227f9f4-d6d8-4ea5-aa13-7baaa5b1b232 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.144554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4227f9f4-d6d8-4ea5-aa13-7baaa5b1b232 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.145505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4227f9f4-d6d8-4ea5-aa13-7baaa5b1b232 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.146115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4227f9f4-d6d8-4ea5-aa13-7baaa5b1b232 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.413535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4227f9f4-d6d8-4ea5-aa13-7baaa5b1b232 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:18.426687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4227f9f4-d6d8-4ea5-aa13-7baaa5b1b232 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:18.429904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4227f9f4-d6d8-4ea5-aa13-7baaa5b1b232 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:18.431869 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4227f9f4-d6d8-4ea5-aa13-7baaa5b1b232 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1750 microversion: 2.20 time: 0.306373 Jul 20 04:33:18.443736 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2542/5001] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:18 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1750 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:18.460223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a1f787b3-dfae-42f4-996a-cc045c18818c tempest-QuotasTestJSON-1853441197 tempest-QuotasTestJSON-1853441197-project] Calling method '.version_select at 0x7fbf9c6ee430>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:18.477971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:33:18.478449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:33:18.478877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:33:18.479295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:33:18.479759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:33:18.492573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.493169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.493983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.494429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.522995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Getting quotas for project 1be9144d8b214ecb8e416318d92b92ea. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:18.528810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Getting quotas for user b559a8f5a1724682831d18c3f7ddfdf2 and project 1be9144d8b214ecb8e416318d92b92ea. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:18.549066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:33:18.551832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:33:18.602454 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7b1c18e2-79d0-4378-a8cd-c72646655b96 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904452 Jul 20 04:33:18.603413 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2460/5002] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:33:18.608858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-88d369d3-bc3a-43fc-a6ac-7bd583e6b627 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:18.610362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-88d369d3-bc3a-43fc-a6ac-7bd583e6b627 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:18.618583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88d369d3-bc3a-43fc-a6ac-7bd583e6b627 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.619256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88d369d3-bc3a-43fc-a6ac-7bd583e6b627 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.620231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88d369d3-bc3a-43fc-a6ac-7bd583e6b627 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.620834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88d369d3-bc3a-43fc-a6ac-7bd583e6b627 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.650954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-88d369d3-bc3a-43fc-a6ac-7bd583e6b627 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lazy-loading 'flavor' on Instance uuid a2f3226f-82c7-4e50-9a7d-ca0721979912 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:33:18.689544 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-88d369d3-bc3a-43fc-a6ac-7bd583e6b627 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Cannot 'shelve' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state shelved_offloaded Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-88d369d3-bc3a-43fc-a6ac-7bd583e6b627 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action HTTP/1.1 Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 14 Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: {"shelve": {}} Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: exception: Cannot 'shelve' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state shelved_offloaded Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a2f3226f-82c7-4e50-9a7d-ca0721979912', 'body': {'shelve': {}}} Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 20 04:33:18.698476 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state shelved_offloaded Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state shelved_offloaded Jul 20 04:33:18.704076 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:33:18.705916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-88d369d3-bc3a-43fc-a6ac-7bd583e6b627 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 409 to user: Cannot 'shelve' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state shelved_offloaded {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:18.706954 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-88d369d3-bc3a-43fc-a6ac-7bd583e6b627 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 409 len: 155 microversion: 2.1 time: 0.102266 Jul 20 04:33:18.708257 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2461/5003] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:18 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 155 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:33:18.717591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2153a80-209d-4c29-8469-b5ea00cf43f9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:18.719691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a2153a80-209d-4c29-8469-b5ea00cf43f9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:18.812128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a2153a80-209d-4c29-8469-b5ea00cf43f9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:18.820608 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2153a80-209d-4c29-8469-b5ea00cf43f9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1214 microversion: 2.1 time: 0.110913 Jul 20 04:33:18.821932 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2462/5004] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:18 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:18.827750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7db394c1-15a8-4096-8326-7596c723527d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:18.829080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7db394c1-15a8-4096-8326-7596c723527d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:18.836395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7db394c1-15a8-4096-8326-7596c723527d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.837310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7db394c1-15a8-4096-8326-7596c723527d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.838726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7db394c1-15a8-4096-8326-7596c723527d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.839387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7db394c1-15a8-4096-8326-7596c723527d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.067719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7db394c1-15a8-4096-8326-7596c723527d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:19.079199 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7db394c1-15a8-4096-8326-7596c723527d tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1309 microversion: 2.1 time: 0.255428 Jul 20 04:33:19.080151 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2463/5005] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:18 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1309 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:19.085301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2ce40c5e-dd23-433a-9dbd-2ba6d21e72b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:19.086208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2ce40c5e-dd23-433a-9dbd-2ba6d21e72b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:19.101393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ce40c5e-dd23-433a-9dbd-2ba6d21e72b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.102237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ce40c5e-dd23-433a-9dbd-2ba6d21e72b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.103305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ce40c5e-dd23-433a-9dbd-2ba6d21e72b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.103946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ce40c5e-dd23-433a-9dbd-2ba6d21e72b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.107252 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a1f787b3-dfae-42f4-996a-cc045c18818c tempest-QuotasTestJSON-1853441197 tempest-QuotasTestJSON-1853441197-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/a92c57ab0e5b4495aaf0fe8f487a6617?user_id=5a4051fb47164d5db02a16376c8cc2cf" status: 200 len: 371 microversion: 2.1 time: 0.660938 Jul 20 04:33:19.107252 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2543/5006] 10.222.0.20 () {58 vars in 1322 bytes} [Wed Jul 20 04:33:18 2022] GET /compute/v2.1/os-quota-sets/a92c57ab0e5b4495aaf0fe8f487a6617?user_id=5a4051fb47164d5db02a16376c8cc2cf => generated 371 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:19.212868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:19.245246 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2ce40c5e-dd23-433a-9dbd-2ba6d21e72b7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 202 len: 0 microversion: 2.1 time: 0.162513 Jul 20 04:33:19.247773 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2464/5007] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:19 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:19.257972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7f6c3140-d58f-4520-9567-1e424460d3c4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:19.258645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7f6c3140-d58f-4520-9567-1e424460d3c4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:19.274091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f6c3140-d58f-4520-9567-1e424460d3c4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.277634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f6c3140-d58f-4520-9567-1e424460d3c4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.278447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f6c3140-d58f-4520-9567-1e424460d3c4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.278892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f6c3140-d58f-4520-9567-1e424460d3c4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.453297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-163ed414-0153-4fbf-b5ee-1781ee908f9f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:19.454554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-163ed414-0153-4fbf-b5ee-1781ee908f9f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:19.483971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-163ed414-0153-4fbf-b5ee-1781ee908f9f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.488149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-163ed414-0153-4fbf-b5ee-1781ee908f9f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.489186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-163ed414-0153-4fbf-b5ee-1781ee908f9f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.489845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7f6c3140-d58f-4520-9567-1e424460d3c4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:19.492823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-163ed414-0153-4fbf-b5ee-1781ee908f9f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.501298 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7f6c3140-d58f-4520-9567-1e424460d3c4 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1461 microversion: 2.1 time: 0.247109 Jul 20 04:33:19.513594 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2544/5008] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:19 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1461 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:19.838775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-17d58fd2-7786-43a0-8ded-39eb47977202 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:19.840071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-17d58fd2-7786-43a0-8ded-39eb47977202 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:19.868327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17d58fd2-7786-43a0-8ded-39eb47977202 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.868799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17d58fd2-7786-43a0-8ded-39eb47977202 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.874621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17d58fd2-7786-43a0-8ded-39eb47977202 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.875084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17d58fd2-7786-43a0-8ded-39eb47977202 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.926986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-163ed414-0153-4fbf-b5ee-1781ee908f9f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:19.943565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-163ed414-0153-4fbf-b5ee-1781ee908f9f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:19.945811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-163ed414-0153-4fbf-b5ee-1781ee908f9f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:19.952272 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-163ed414-0153-4fbf-b5ee-1781ee908f9f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1750 microversion: 2.20 time: 0.504367 Jul 20 04:33:19.953878 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2465/5009] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:19 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1750 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:20.080854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-17d58fd2-7786-43a0-8ded-39eb47977202 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:20.092598 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-17d58fd2-7786-43a0-8ded-39eb47977202 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1210 microversion: 2.1 time: 0.257647 Jul 20 04:33:20.094522 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2545/5010] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:19 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1210 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:20.099572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-52ab1b62-f10d-4ffc-ba64-0ef15dfaaf78 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:20.100385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-52ab1b62-f10d-4ffc-ba64-0ef15dfaaf78 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:20.128160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52ab1b62-f10d-4ffc-ba64-0ef15dfaaf78 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.129490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52ab1b62-f10d-4ffc-ba64-0ef15dfaaf78 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:20.131970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52ab1b62-f10d-4ffc-ba64-0ef15dfaaf78 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.132583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52ab1b62-f10d-4ffc-ba64-0ef15dfaaf78 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:20.503174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-52ab1b62-f10d-4ffc-ba64-0ef15dfaaf78 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:20.529656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-65d45199-1995-4326-ae5a-402336406b3a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:20.533673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-65d45199-1995-4326-ae5a-402336406b3a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:20.556572 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-52ab1b62-f10d-4ffc-ba64-0ef15dfaaf78 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1309 microversion: 2.1 time: 0.460628 Jul 20 04:33:20.561642 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2466/5011] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:20 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1309 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:20.563057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65d45199-1995-4326-ae5a-402336406b3a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.574343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65d45199-1995-4326-ae5a-402336406b3a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:20.587775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65d45199-1995-4326-ae5a-402336406b3a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.589682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65d45199-1995-4326-ae5a-402336406b3a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:20.972025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-895fb387-47c5-4b12-b2d2-b8b9a849de75 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:20.972655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-895fb387-47c5-4b12-b2d2-b8b9a849de75 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:20.986601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-895fb387-47c5-4b12-b2d2-b8b9a849de75 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.986991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-895fb387-47c5-4b12-b2d2-b8b9a849de75 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:20.988210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-895fb387-47c5-4b12-b2d2-b8b9a849de75 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.990496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-65d45199-1995-4326-ae5a-402336406b3a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:20.991195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-895fb387-47c5-4b12-b2d2-b8b9a849de75 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:20.998482 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-65d45199-1995-4326-ae5a-402336406b3a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1463 microversion: 2.1 time: 0.481028 Jul 20 04:33:20.999063 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2546/5012] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:20 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1463 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:21.111109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ca64ea2b-2955-4f1e-b597-8ea2605b2a1c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:21.112080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca64ea2b-2955-4f1e-b597-8ea2605b2a1c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:21.122104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca64ea2b-2955-4f1e-b597-8ea2605b2a1c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:21.128762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca64ea2b-2955-4f1e-b597-8ea2605b2a1c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.133395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca64ea2b-2955-4f1e-b597-8ea2605b2a1c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:21.133883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca64ea2b-2955-4f1e-b597-8ea2605b2a1c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.427239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ca64ea2b-2955-4f1e-b597-8ea2605b2a1c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:21.465703 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ca64ea2b-2955-4f1e-b597-8ea2605b2a1c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1272 microversion: 2.1 time: 0.359045 Jul 20 04:33:21.478907 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2547/5013] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:21 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:21.554992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-895fb387-47c5-4b12-b2d2-b8b9a849de75 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:21.567030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-895fb387-47c5-4b12-b2d2-b8b9a849de75 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:21.573619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-895fb387-47c5-4b12-b2d2-b8b9a849de75 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:21.575234 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-895fb387-47c5-4b12-b2d2-b8b9a849de75 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1750 microversion: 2.20 time: 0.607818 Jul 20 04:33:21.577157 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2467/5014] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:20 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1750 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:33:21.587833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9d634d8b-e3e6-4bcb-9b31-05cd5f3a811c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:21.588586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9d634d8b-e3e6-4bcb-9b31-05cd5f3a811c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:21.602048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d634d8b-e3e6-4bcb-9b31-05cd5f3a811c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:21.602517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d634d8b-e3e6-4bcb-9b31-05cd5f3a811c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.605093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d634d8b-e3e6-4bcb-9b31-05cd5f3a811c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:21.605914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d634d8b-e3e6-4bcb-9b31-05cd5f3a811c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.892613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9d634d8b-e3e6-4bcb-9b31-05cd5f3a811c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:21.905719 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9d634d8b-e3e6-4bcb-9b31-05cd5f3a811c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1309 microversion: 2.1 time: 0.332610 Jul 20 04:33:21.908808 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2548/5015] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:21 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1309 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:22.016895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a0c2d946-0ce1-4e58-abf0-76606dc87990 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:22.017752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a0c2d946-0ce1-4e58-abf0-76606dc87990 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:22.029591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0c2d946-0ce1-4e58-abf0-76606dc87990 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.030037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0c2d946-0ce1-4e58-abf0-76606dc87990 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.031476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0c2d946-0ce1-4e58-abf0-76606dc87990 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.032030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0c2d946-0ce1-4e58-abf0-76606dc87990 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.484460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a644f74b-6dab-4720-99df-59b393d18ef6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:22.485554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a644f74b-6dab-4720-99df-59b393d18ef6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:22.499994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a644f74b-6dab-4720-99df-59b393d18ef6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.500944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a644f74b-6dab-4720-99df-59b393d18ef6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.502109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a644f74b-6dab-4720-99df-59b393d18ef6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.507335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a644f74b-6dab-4720-99df-59b393d18ef6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.696094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a0c2d946-0ce1-4e58-abf0-76606dc87990 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:22.708436 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a0c2d946-0ce1-4e58-abf0-76606dc87990 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.696048 Jul 20 04:33:22.709363 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2468/5016] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:22 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:22.724948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f913024b-80a8-4295-8d5d-bdba64fc8554 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:22.725587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f913024b-80a8-4295-8d5d-bdba64fc8554 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:22.735800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f913024b-80a8-4295-8d5d-bdba64fc8554 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.737791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f913024b-80a8-4295-8d5d-bdba64fc8554 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.738633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f913024b-80a8-4295-8d5d-bdba64fc8554 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.740904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f913024b-80a8-4295-8d5d-bdba64fc8554 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.743949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f913024b-80a8-4295-8d5d-bdba64fc8554 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:23.747411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a644f74b-6dab-4720-99df-59b393d18ef6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:23.757735 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a644f74b-6dab-4720-99df-59b393d18ef6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1314 microversion: 2.1 time: 1.277846 Jul 20 04:33:23.762121 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2549/5017] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:22 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1314 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:23.770095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9fc5b088-f4b1-4510-85b8-3e38fb28501a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:23.775029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9fc5b088-f4b1-4510-85b8-3e38fb28501a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:23.776050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f913024b-80a8-4295-8d5d-bdba64fc8554 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:23.777790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f913024b-80a8-4295-8d5d-bdba64fc8554 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:23.782903 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f913024b-80a8-4295-8d5d-bdba64fc8554 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1750 microversion: 2.20 time: 1.072528 Jul 20 04:33:23.785382 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2469/5018] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:22 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1750 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:23.791228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9fc5b088-f4b1-4510-85b8-3e38fb28501a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:23.792098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9fc5b088-f4b1-4510-85b8-3e38fb28501a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.793171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9fc5b088-f4b1-4510-85b8-3e38fb28501a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:23.793965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9fc5b088-f4b1-4510-85b8-3e38fb28501a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.817524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-53841d97-5523-4665-940f-9646257faa5f req-e47ce402-cb88-4df2-b0da-a6b5f68c3b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce4bdd8-5b00-422f-9d57-bddb9ceac19f", "tag": "ded1351f-4cec-44a9-9f29-b24a7ae27ae8"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:23.854293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-53841d97-5523-4665-940f-9646257faa5f req-e47ce402-cb88-4df2-b0da-a6b5f68c3b81 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:23.854970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-53841d97-5523-4665-940f-9646257faa5f req-e47ce402-cb88-4df2-b0da-a6b5f68c3b81 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.870453 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-53841d97-5523-4665-940f-9646257faa5f req-e47ce402-cb88-4df2-b0da-a6b5f68c3b81 service nova] Creating event network-changed:ded1351f-4cec-44a9-9f29-b24a7ae27ae8 for instance fce4bdd8-5b00-422f-9d57-bddb9ceac19f on n-h2-764485-11 Jul 20 04:33:23.878925 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-53841d97-5523-4665-940f-9646257faa5f req-e47ce402-cb88-4df2-b0da-a6b5f68c3b81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084997 Jul 20 04:33:23.879977 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2470/5019] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:23.888158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0503c59d-475d-4f05-86cc-836830628f4a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:23.889120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0503c59d-475d-4f05-86cc-836830628f4a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:23.898204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0503c59d-475d-4f05-86cc-836830628f4a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:23.898921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0503c59d-475d-4f05-86cc-836830628f4a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.900342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0503c59d-475d-4f05-86cc-836830628f4a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:23.902033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0503c59d-475d-4f05-86cc-836830628f4a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.136942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9fc5b088-f4b1-4510-85b8-3e38fb28501a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:24.147653 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9fc5b088-f4b1-4510-85b8-3e38fb28501a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1309 microversion: 2.1 time: 0.383811 Jul 20 04:33:24.163899 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2550/5020] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:23 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1309 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:24.501121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0503c59d-475d-4f05-86cc-836830628f4a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:24.527367 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0503c59d-475d-4f05-86cc-836830628f4a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.640705 Jul 20 04:33:24.535792 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2471/5021] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:23 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:24.780935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7b8a4989-fc05-4d8c-a718-94022bbd17fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:24.782381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7b8a4989-fc05-4d8c-a718-94022bbd17fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:24.799458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b8a4989-fc05-4d8c-a718-94022bbd17fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.801562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b8a4989-fc05-4d8c-a718-94022bbd17fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.803491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b8a4989-fc05-4d8c-a718-94022bbd17fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.808178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b8a4989-fc05-4d8c-a718-94022bbd17fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.808847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2d248811-fbb9-4e24-bec2-bd73b30d6ae5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:24.809667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2d248811-fbb9-4e24-bec2-bd73b30d6ae5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:24.834973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d248811-fbb9-4e24-bec2-bd73b30d6ae5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.837661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d248811-fbb9-4e24-bec2-bd73b30d6ae5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.841623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d248811-fbb9-4e24-bec2-bd73b30d6ae5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.844350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d248811-fbb9-4e24-bec2-bd73b30d6ae5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.897442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:26.416070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2d248811-fbb9-4e24-bec2-bd73b30d6ae5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:26.421558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7b8a4989-fc05-4d8c-a718-94022bbd17fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:26.461564 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7b8a4989-fc05-4d8c-a718-94022bbd17fc tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1314 microversion: 2.1 time: 1.687180 Jul 20 04:33:26.478148 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2551/5022] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:24 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1314 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:26.486399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2d248811-fbb9-4e24-bec2-bd73b30d6ae5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:26.494913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2d248811-fbb9-4e24-bec2-bd73b30d6ae5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:26.498447 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2d248811-fbb9-4e24-bec2-bd73b30d6ae5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1750 microversion: 2.20 time: 1.696954 Jul 20 04:33:26.503208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-aa47e9b9-85d5-4b3d-ac7f-7917586a5555 req-b5e8822b-245c-483b-a54f-c3a4235e912b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bc8d51-b9c3-441b-8160-c27334808041", "name": "network-vif-plugged", "status": "completed", "tag": "4254f267-2a36-4654-ad52-6ee068bcdee1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:26.503690 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2472/5023] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:24 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1750 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:26.526769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9baa81b-4530-46a4-9418-c578f201d831 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:26.539289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e9baa81b-4530-46a4-9418-c578f201d831 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:26.551238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-aa47e9b9-85d5-4b3d-ac7f-7917586a5555 req-b5e8822b-245c-483b-a54f-c3a4235e912b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:26.553136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-aa47e9b9-85d5-4b3d-ac7f-7917586a5555 req-b5e8822b-245c-483b-a54f-c3a4235e912b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:26.566217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9baa81b-4530-46a4-9418-c578f201d831 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:26.567255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9baa81b-4530-46a4-9418-c578f201d831 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:26.571079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9baa81b-4530-46a4-9418-c578f201d831 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:26.572919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9baa81b-4530-46a4-9418-c578f201d831 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:26.596233 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-aa47e9b9-85d5-4b3d-ac7f-7917586a5555 req-b5e8822b-245c-483b-a54f-c3a4235e912b service nova] Creating event network-vif-plugged:4254f267-2a36-4654-ad52-6ee068bcdee1 for instance 54bc8d51-b9c3-441b-8160-c27334808041 on n-h2-764485-11 Jul 20 04:33:26.605467 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-aa47e9b9-85d5-4b3d-ac7f-7917586a5555 req-b5e8822b-245c-483b-a54f-c3a4235e912b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121585 Jul 20 04:33:26.606855 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2552/5024] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:26.625765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4d4420be-0a72-4f1c-9a7d-07f76c06fb72 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:26.629463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4d4420be-0a72-4f1c-9a7d-07f76c06fb72 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:26.641764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d4420be-0a72-4f1c-9a7d-07f76c06fb72 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:26.644906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d4420be-0a72-4f1c-9a7d-07f76c06fb72 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:26.649859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d4420be-0a72-4f1c-9a7d-07f76c06fb72 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:26.650600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d4420be-0a72-4f1c-9a7d-07f76c06fb72 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:27.060574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e9baa81b-4530-46a4-9418-c578f201d831 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:27.076239 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e9baa81b-4530-46a4-9418-c578f201d831 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1309 microversion: 2.1 time: 0.571265 Jul 20 04:33:27.080521 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2473/5025] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:26 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1309 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:27.093408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-05ce230e-1c37-466d-8b8b-24b08d5c7518 tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] Calling method '.version_select at 0x7fbf9d153f70>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:27.154181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4d4420be-0a72-4f1c-9a7d-07f76c06fb72 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:27.168913 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4d4420be-0a72-4f1c-9a7d-07f76c06fb72 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.560326 Jul 20 04:33:27.169776 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2553/5026] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:26 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:27.208096 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-05ce230e-1c37-466d-8b8b-24b08d5c7518 tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a297a5d9-9880-4294-9528-223e133c6955" status: 200 len: 351 microversion: 2.1 time: 0.124783 Jul 20 04:33:27.208959 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2474/5027] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:33:27 2022] GET /compute/v2.1/os-volumes/a297a5d9-9880-4294-9528-223e133c6955 => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:27.491890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ff0a6b08-a90c-487b-b80e-73905d13d8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:27.493957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ff0a6b08-a90c-487b-b80e-73905d13d8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:27.548106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-264fa45c-e8fd-432b-9b65-f5aa8a545806 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:27.552689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-264fa45c-e8fd-432b-9b65-f5aa8a545806 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:27.571957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff0a6b08-a90c-487b-b80e-73905d13d8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:27.578110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff0a6b08-a90c-487b-b80e-73905d13d8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:27.582316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:27.585142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff0a6b08-a90c-487b-b80e-73905d13d8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:27.589633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-264fa45c-e8fd-432b-9b65-f5aa8a545806 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:27.591140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff0a6b08-a90c-487b-b80e-73905d13d8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:27.604846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-264fa45c-e8fd-432b-9b65-f5aa8a545806 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:27.608926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-264fa45c-e8fd-432b-9b65-f5aa8a545806 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:27.611158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-264fa45c-e8fd-432b-9b65-f5aa8a545806 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:28.434558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ff0a6b08-a90c-487b-b80e-73905d13d8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:28.451244 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ff0a6b08-a90c-487b-b80e-73905d13d8d9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1314 microversion: 2.1 time: 0.971096 Jul 20 04:33:28.455183 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2554/5028] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:27 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1314 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:28.469229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-70994237-82ea-4c45-bc6a-d9b6624518fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:28.470250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-70994237-82ea-4c45-bc6a-d9b6624518fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:28.488091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70994237-82ea-4c45-bc6a-d9b6624518fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.489250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70994237-82ea-4c45-bc6a-d9b6624518fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:28.491030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70994237-82ea-4c45-bc6a-d9b6624518fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.495271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-264fa45c-e8fd-432b-9b65-f5aa8a545806 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:28.504647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70994237-82ea-4c45-bc6a-d9b6624518fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:28.505778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:28.520029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-264fa45c-e8fd-432b-9b65-f5aa8a545806 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:28.524077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-264fa45c-e8fd-432b-9b65-f5aa8a545806 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:28.527783 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-264fa45c-e8fd-432b-9b65-f5aa8a545806 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1750 microversion: 2.20 time: 1.014356 Jul 20 04:33:28.531708 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2475/5029] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:27 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1750 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:28.559413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6916b10f-f006-47c9-9bea-6679ff8c0032 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:28.567987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6916b10f-f006-47c9-9bea-6679ff8c0032 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:28.598072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6916b10f-f006-47c9-9bea-6679ff8c0032 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.598723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6916b10f-f006-47c9-9bea-6679ff8c0032 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:28.612251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6916b10f-f006-47c9-9bea-6679ff8c0032 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.612801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6916b10f-f006-47c9-9bea-6679ff8c0032 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:28.820100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=16 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:29.055732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:29.298539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-70994237-82ea-4c45-bc6a-d9b6624518fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:29.313482 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-70994237-82ea-4c45-bc6a-d9b6624518fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1309 microversion: 2.1 time: 0.856919 Jul 20 04:33:29.314106 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2555/5030] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:28 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1309 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:29.471491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-abd677ac-1a8c-4cfd-9e54-f429d95462fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:29.472138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-abd677ac-1a8c-4cfd-9e54-f429d95462fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:29.504295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abd677ac-1a8c-4cfd-9e54-f429d95462fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:29.508181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abd677ac-1a8c-4cfd-9e54-f429d95462fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:29.510963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abd677ac-1a8c-4cfd-9e54-f429d95462fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:29.512519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abd677ac-1a8c-4cfd-9e54-f429d95462fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:29.525457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6916b10f-f006-47c9-9bea-6679ff8c0032 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:29.541962 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6916b10f-f006-47c9-9bea-6679ff8c0032 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 1.008832 Jul 20 04:33:29.547854 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2476/5031] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:28 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:29.558691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b75f9d31-968e-4156-805b-da2c86e9d24d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:29.559655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b75f9d31-968e-4156-805b-da2c86e9d24d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:29.573639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b75f9d31-968e-4156-805b-da2c86e9d24d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:29.578356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b75f9d31-968e-4156-805b-da2c86e9d24d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:29.579548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b75f9d31-968e-4156-805b-da2c86e9d24d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:29.580170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b75f9d31-968e-4156-805b-da2c86e9d24d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:30.729907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-abd677ac-1a8c-4cfd-9e54-f429d95462fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:30.741375 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-abd677ac-1a8c-4cfd-9e54-f429d95462fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1314 microversion: 2.1 time: 1.274732 Jul 20 04:33:30.747852 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2556/5032] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:29 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1314 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:30.756104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e00c8622-b168-47e2-af1f-eff9ffe9ecf3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:30.758432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e00c8622-b168-47e2-af1f-eff9ffe9ecf3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:30.798404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e00c8622-b168-47e2-af1f-eff9ffe9ecf3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:30.801097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e00c8622-b168-47e2-af1f-eff9ffe9ecf3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:30.802309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e00c8622-b168-47e2-af1f-eff9ffe9ecf3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:30.804608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e00c8622-b168-47e2-af1f-eff9ffe9ecf3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:30.858848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b75f9d31-968e-4156-805b-da2c86e9d24d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:30.895148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b75f9d31-968e-4156-805b-da2c86e9d24d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:30.899541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b75f9d31-968e-4156-805b-da2c86e9d24d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:30.919783 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b75f9d31-968e-4156-805b-da2c86e9d24d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 1.368009 Jul 20 04:33:30.925373 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2477/5033] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:29 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:30.945271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c875ac63-7024-4d59-b007-347829dabebd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:30.946454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c875ac63-7024-4d59-b007-347829dabebd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:30.965203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c875ac63-7024-4d59-b007-347829dabebd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:30.967023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c875ac63-7024-4d59-b007-347829dabebd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:30.969634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c875ac63-7024-4d59-b007-347829dabebd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:30.971339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c875ac63-7024-4d59-b007-347829dabebd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.427183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e00c8622-b168-47e2-af1f-eff9ffe9ecf3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:31.454295 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e00c8622-b168-47e2-af1f-eff9ffe9ecf3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1490 microversion: 2.1 time: 0.701301 Jul 20 04:33:31.455379 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2557/5034] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:30 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1490 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:31.484831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61ad7a49-3b33-4c11-88af-3d28e6dec5b6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-116060103"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:31.486694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-61ad7a49-3b33-4c11-88af-3d28e6dec5b6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:31.516765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61ad7a49-3b33-4c11-88af-3d28e6dec5b6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.548368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61ad7a49-3b33-4c11-88af-3d28e6dec5b6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.549246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61ad7a49-3b33-4c11-88af-3d28e6dec5b6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.549955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61ad7a49-3b33-4c11-88af-3d28e6dec5b6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.588178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c875ac63-7024-4d59-b007-347829dabebd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:31.617822 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c875ac63-7024-4d59-b007-347829dabebd tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.690902 Jul 20 04:33:31.635261 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2478/5035] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:30 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:31.647165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3207d5d9-745d-45a8-b955-6aa490554f6e tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] Calling method '.version_select at 0x7fbf9d136a60>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:31.824730 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3207d5d9-745d-45a8-b955-6aa490554f6e tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/bb5ebbfa-c645-4ea1-b3c4-11667bb81273" status: 200 len: 351 microversion: 2.1 time: 0.182752 Jul 20 04:33:31.825333 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2479/5036] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:33:31 2022] GET /compute/v2.1/os-volumes/bb5ebbfa-c645-4ea1-b3c4-11667bb81273 => generated 351 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:31.829547 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-61ad7a49-3b33-4c11-88af-3d28e6dec5b6 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "PUT /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1074 microversion: 2.1 time: 0.361501 Jul 20 04:33:31.831728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7bf09144-685f-4c47-add1-715b1828fa10 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:31.832597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7bf09144-685f-4c47-add1-715b1828fa10 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:31.833726 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2558/5037] 10.222.0.20 () {60 vars in 1255 bytes} [Wed Jul 20 04:33:31 2022] PUT /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1074 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:31.857191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cb5a874c-e934-4fa0-8428-70097372b3fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:31.857896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cb5a874c-e934-4fa0-8428-70097372b3fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:31.860581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bf09144-685f-4c47-add1-715b1828fa10 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.861477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bf09144-685f-4c47-add1-715b1828fa10 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.862544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bf09144-685f-4c47-add1-715b1828fa10 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.863237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bf09144-685f-4c47-add1-715b1828fa10 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.907922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb5a874c-e934-4fa0-8428-70097372b3fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.909780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb5a874c-e934-4fa0-8428-70097372b3fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.913607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb5a874c-e934-4fa0-8428-70097372b3fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.917159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb5a874c-e934-4fa0-8428-70097372b3fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:32.660790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cb5a874c-e934-4fa0-8428-70097372b3fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:32.669743 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cb5a874c-e934-4fa0-8428-70097372b3fc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1500 microversion: 2.1 time: 0.827959 Jul 20 04:33:32.674824 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2559/5038] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:31 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1500 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:32.682569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-680ba254-401d-4a28-8dd7-e8599fe0b54e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:32.687019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-680ba254-401d-4a28-8dd7-e8599fe0b54e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:32.701707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7bf09144-685f-4c47-add1-715b1828fa10 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:32.719546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-680ba254-401d-4a28-8dd7-e8599fe0b54e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:32.721004 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7bf09144-685f-4c47-add1-715b1828fa10 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1314 microversion: 2.1 time: 0.893647 Jul 20 04:33:32.724138 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2480/5039] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:31 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1314 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:32.726275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-680ba254-401d-4a28-8dd7-e8599fe0b54e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:32.728577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-680ba254-401d-4a28-8dd7-e8599fe0b54e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:32.735090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-680ba254-401d-4a28-8dd7-e8599fe0b54e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:32.743296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-92b0db58-c3ae-4514-98d0-64615c5d8b89 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:32.744327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92b0db58-c3ae-4514-98d0-64615c5d8b89 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:32.769027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92b0db58-c3ae-4514-98d0-64615c5d8b89 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:32.769905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92b0db58-c3ae-4514-98d0-64615c5d8b89 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:32.772316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92b0db58-c3ae-4514-98d0-64615c5d8b89 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:32.773829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92b0db58-c3ae-4514-98d0-64615c5d8b89 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.266640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-680ba254-401d-4a28-8dd7-e8599fe0b54e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:33.288540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-680ba254-401d-4a28-8dd7-e8599fe0b54e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:33.297278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-680ba254-401d-4a28-8dd7-e8599fe0b54e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:33.299110 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-680ba254-401d-4a28-8dd7-e8599fe0b54e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.622890 Jul 20 04:33:33.301803 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2560/5040] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:32 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:33.319376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-af83748b-6af0-41ac-8963-b5a7701f017a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:33.328501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-af83748b-6af0-41ac-8963-b5a7701f017a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:33.355026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af83748b-6af0-41ac-8963-b5a7701f017a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.355026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af83748b-6af0-41ac-8963-b5a7701f017a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.355026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af83748b-6af0-41ac-8963-b5a7701f017a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.357160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af83748b-6af0-41ac-8963-b5a7701f017a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.514581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-92b0db58-c3ae-4514-98d0-64615c5d8b89 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:33.529628 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-92b0db58-c3ae-4514-98d0-64615c5d8b89 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.800400 Jul 20 04:33:33.530937 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2481/5041] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:32 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:33.545527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-70dee648-28d1-4f7b-a83b-ed90e668b126 req-015527d1-cd8b-4663-9b23-4571ebbdc701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce4bdd8-5b00-422f-9d57-bddb9ceac19f", "name": "network-vif-plugged", "status": "completed", "tag": "ded1351f-4cec-44a9-9f29-b24a7ae27ae8"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:33.556188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-70dee648-28d1-4f7b-a83b-ed90e668b126 req-015527d1-cd8b-4663-9b23-4571ebbdc701 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.556934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-70dee648-28d1-4f7b-a83b-ed90e668b126 req-015527d1-cd8b-4663-9b23-4571ebbdc701 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.572246 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-70dee648-28d1-4f7b-a83b-ed90e668b126 req-015527d1-cd8b-4663-9b23-4571ebbdc701 service nova] Creating event network-vif-plugged:ded1351f-4cec-44a9-9f29-b24a7ae27ae8 for instance fce4bdd8-5b00-422f-9d57-bddb9ceac19f on n-h2-764485-11 Jul 20 04:33:33.578586 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-70dee648-28d1-4f7b-a83b-ed90e668b126 req-015527d1-cd8b-4663-9b23-4571ebbdc701 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036835 Jul 20 04:33:33.579555 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2482/5042] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:33.741741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-509a6b21-fc19-4142-9c0b-29d042b4ee83 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:33.742751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-509a6b21-fc19-4142-9c0b-29d042b4ee83 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:33.769768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-509a6b21-fc19-4142-9c0b-29d042b4ee83 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.771361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-509a6b21-fc19-4142-9c0b-29d042b4ee83 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.777163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-509a6b21-fc19-4142-9c0b-29d042b4ee83 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.777882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-509a6b21-fc19-4142-9c0b-29d042b4ee83 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.319313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af83748b-6af0-41ac-8963-b5a7701f017a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:34.332532 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-af83748b-6af0-41ac-8963-b5a7701f017a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1500 microversion: 2.1 time: 1.027508 Jul 20 04:33:34.336924 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2561/5043] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:33 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1500 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:34.353051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-dd92ca11-d3a0-46c4-b6cb-4a0a4a034018 req-e38411b7-3e55-4820-8e01-12de765dee4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76d5764-986d-4d3f-806f-1f8b1c5a73c1", "tag": "f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:34.389459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dd92ca11-d3a0-46c4-b6cb-4a0a4a034018 req-e38411b7-3e55-4820-8e01-12de765dee4c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.400303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dd92ca11-d3a0-46c4-b6cb-4a0a4a034018 req-e38411b7-3e55-4820-8e01-12de765dee4c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.426487 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-dd92ca11-d3a0-46c4-b6cb-4a0a4a034018 req-e38411b7-3e55-4820-8e01-12de765dee4c service nova] Creating event network-changed:f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981 for instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 on n-h2-764485-11 Jul 20 04:33:34.461384 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-dd92ca11-d3a0-46c4-b6cb-4a0a4a034018 req-e38411b7-3e55-4820-8e01-12de765dee4c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122815 Jul 20 04:33:34.466006 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2562/5044] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:34.482902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b4223e3c-f867-47cc-ab31-9955bd1a1779 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:34.492190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b4223e3c-f867-47cc-ab31-9955bd1a1779 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:34.512454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4223e3c-f867-47cc-ab31-9955bd1a1779 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.525137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4223e3c-f867-47cc-ab31-9955bd1a1779 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.527215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4223e3c-f867-47cc-ab31-9955bd1a1779 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.529419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4223e3c-f867-47cc-ab31-9955bd1a1779 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.815210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-509a6b21-fc19-4142-9c0b-29d042b4ee83 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:34.825696 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-509a6b21-fc19-4142-9c0b-29d042b4ee83 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1314 microversion: 2.1 time: 1.089261 Jul 20 04:33:34.826310 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2483/5045] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:33 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1314 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:34.847912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7d88f4a9-6640-4639-89e2-9f7a8a550471 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:34.863265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d88f4a9-6640-4639-89e2-9f7a8a550471 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.863765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d88f4a9-6640-4639-89e2-9f7a8a550471 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.933981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7d88f4a9-6640-4639-89e2-9f7a8a550471 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Going to try to stop instance {{(pid=119807) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:33:34.948557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:35.174952 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7d88f4a9-6640-4639-89e2-9f7a8a550471 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "POST /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041/action" status: 202 len: 0 microversion: 2.1 time: 0.320475 Jul 20 04:33:35.178831 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2484/5046] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:34 2022] POST /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:35.205487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ae666b24-cfea-4f23-ad5c-fd3a31752319 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:35.206197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ae666b24-cfea-4f23-ad5c-fd3a31752319 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:35.228665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae666b24-cfea-4f23-ad5c-fd3a31752319 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.240255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae666b24-cfea-4f23-ad5c-fd3a31752319 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.241499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae666b24-cfea-4f23-ad5c-fd3a31752319 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.242110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae666b24-cfea-4f23-ad5c-fd3a31752319 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.306497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b4223e3c-f867-47cc-ab31-9955bd1a1779 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:35.355467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b4223e3c-f867-47cc-ab31-9955bd1a1779 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:35.380964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b4223e3c-f867-47cc-ab31-9955bd1a1779 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:35.382589 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b4223e3c-f867-47cc-ab31-9955bd1a1779 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.914907 Jul 20 04:33:35.383192 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2563/5047] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:34 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:35.397105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e0e25184-6351-4971-af60-42f9b2deea12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:35.412312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e0e25184-6351-4971-af60-42f9b2deea12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:35.443189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0e25184-6351-4971-af60-42f9b2deea12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.445199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0e25184-6351-4971-af60-42f9b2deea12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.447019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0e25184-6351-4971-af60-42f9b2deea12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.451098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0e25184-6351-4971-af60-42f9b2deea12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.580975 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:33:35.584534 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 04:33:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 (ip 10.222.0.20) !!! Jul 20 04:33:35.909959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ae666b24-cfea-4f23-ad5c-fd3a31752319 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:35.926639 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ae666b24-cfea-4f23-ad5c-fd3a31752319 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.747613 Jul 20 04:33:35.929517 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2485/5048] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:35 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:35.939017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dcc52a53-497c-476d-9883-0d1c752daded tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:35.942197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dcc52a53-497c-476d-9883-0d1c752daded tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:35.961891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcc52a53-497c-476d-9883-0d1c752daded tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.963543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcc52a53-497c-476d-9883-0d1c752daded tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.968031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcc52a53-497c-476d-9883-0d1c752daded tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.970380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcc52a53-497c-476d-9883-0d1c752daded tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.027990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e0e25184-6351-4971-af60-42f9b2deea12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:36.046972 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e0e25184-6351-4971-af60-42f9b2deea12 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.654096 Jul 20 04:33:36.050358 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2564/5049] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:35 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:36.179697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bc64c5ab-0bbb-491d-ae66-b86a557f3a1a tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] Calling method '.version_select at 0x7fbf9c6ee430>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:36.304231 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bc64c5ab-0bbb-491d-ae66-b86a557f3a1a tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c400ff86-a4b3-4b17-b88a-92d8df0728cb" status: 200 len: 351 microversion: 2.1 time: 0.129530 Jul 20 04:33:36.305716 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2565/5050] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:33:36 2022] GET /compute/v2.1/os-volumes/c400ff86-a4b3-4b17-b88a-92d8df0728cb => generated 351 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:36.318919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-90514103-76a5-4d98-8938-f9ec0684513f tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] Calling method '.version_select at 0x7fbf9c768d30>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:36.579541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dcc52a53-497c-476d-9883-0d1c752daded tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:36.590126 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dcc52a53-497c-476d-9883-0d1c752daded tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1314 microversion: 2.1 time: 0.659183 Jul 20 04:33:36.590955 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2486/5051] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:35 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:36.597510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-615985c8-57a1-4224-860e-50e82a9c9fb8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:36.598802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-615985c8-57a1-4224-860e-50e82a9c9fb8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:36.606865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-615985c8-57a1-4224-860e-50e82a9c9fb8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.607648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-615985c8-57a1-4224-860e-50e82a9c9fb8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.609189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-615985c8-57a1-4224-860e-50e82a9c9fb8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.610014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-615985c8-57a1-4224-860e-50e82a9c9fb8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.634997 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-90514103-76a5-4d98-8938-f9ec0684513f tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.318049 Jul 20 04:33:36.636579 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2566/5052] 10.222.0.20 () {58 vars in 1133 bytes} [Wed Jul 20 04:33:36 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:36.652570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6cb176c8-03b0-4516-bd33-5c66e85703bc tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] Calling method '.version_select at 0x7fbf9c8a6700>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:36.809350 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6cb176c8-03b0-4516-bd33-5c66e85703bc tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.161857 Jul 20 04:33:36.811404 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2567/5053] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Jul 20 04:33:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:36.826414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c8f8bc59-e3d7-4fa5-a428-0fb2754b9b8b tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] Calling method '.version_select at 0x7fbf9c768670>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:36.955359 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c8f8bc59-e3d7-4fa5-a428-0fb2754b9b8b tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.133613 Jul 20 04:33:36.958007 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2568/5054] 10.222.0.20 () {58 vars in 1133 bytes} [Wed Jul 20 04:33:36 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:36.965238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-45f1a3e7-3113-4553-9349-2de0491b3aa3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:36.966428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-45f1a3e7-3113-4553-9349-2de0491b3aa3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:36.977051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45f1a3e7-3113-4553-9349-2de0491b3aa3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.977890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45f1a3e7-3113-4553-9349-2de0491b3aa3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.978986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45f1a3e7-3113-4553-9349-2de0491b3aa3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.980930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45f1a3e7-3113-4553-9349-2de0491b3aa3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.013489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-615985c8-57a1-4224-860e-50e82a9c9fb8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:37.028794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-615985c8-57a1-4224-860e-50e82a9c9fb8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:37.038258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-615985c8-57a1-4224-860e-50e82a9c9fb8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:37.048026 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-615985c8-57a1-4224-860e-50e82a9c9fb8 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.455318 Jul 20 04:33:37.054918 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2487/5055] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:36 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:37.074357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a6a803d-f85c-4253-a74b-82861a2e1e5a tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] Calling method '.version_select at 0x7fbf9d1b0dc0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:37.185309 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:33:37.185309 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 04:33:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes?offset=1&limit=1 (ip 10.222.0.20) !!! Jul 20 04:33:37.271622 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7a6a803d-f85c-4253-a74b-82861a2e1e5a tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.214191 Jul 20 04:33:37.272964 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2488/5056] 10.222.0.20 () {58 vars in 1166 bytes} [Wed Jul 20 04:33:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:37.291967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bddd14cd-d97b-4026-a4c4-2b51407cf672 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:37.293515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bddd14cd-d97b-4026-a4c4-2b51407cf672 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:37.333579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bddd14cd-d97b-4026-a4c4-2b51407cf672 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.336505 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bddd14cd-d97b-4026-a4c4-2b51407cf672 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.338935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bddd14cd-d97b-4026-a4c4-2b51407cf672 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.341776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bddd14cd-d97b-4026-a4c4-2b51407cf672 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.487230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-45f1a3e7-3113-4553-9349-2de0491b3aa3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:37.505214 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-45f1a3e7-3113-4553-9349-2de0491b3aa3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.544818 Jul 20 04:33:37.506389 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2569/5057] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:36 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:37.511121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db4180fe-9d83-4dfa-8fd3-725e0ac1359b tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] Calling method '.version_select at 0x7fbf9c86f160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:37.666725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bddd14cd-d97b-4026-a4c4-2b51407cf672 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:37.682832 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bddd14cd-d97b-4026-a4c4-2b51407cf672 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.405186 Jul 20 04:33:37.683429 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2489/5058] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:37 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:37.695577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ada9a85-0896-4fe2-b1db-41f540fb7409 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:37.696521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ada9a85-0896-4fe2-b1db-41f540fb7409 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:37.710480 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-db4180fe-9d83-4dfa-8fd3-725e0ac1359b tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.202860 Jul 20 04:33:37.711089 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2570/5059] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Jul 20 04:33:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:37.728998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0396d975-41d9-4171-9b1b-13ae9253fb1b tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] Calling method '.version_select at 0x7fbf9c768820>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:37.737061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ada9a85-0896-4fe2-b1db-41f540fb7409 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.739313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ada9a85-0896-4fe2-b1db-41f540fb7409 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.740545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ada9a85-0896-4fe2-b1db-41f540fb7409 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.743303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ada9a85-0896-4fe2-b1db-41f540fb7409 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.866495 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0396d975-41d9-4171-9b1b-13ae9253fb1b tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.141213 Jul 20 04:33:37.867093 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2571/5060] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:33:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:37.880056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4d7f5d20-5583-4ad2-b489-424e3164b649 tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] Calling method '.version_select at 0x7fbf9c631af0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:38.101142 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4d7f5d20-5583-4ad2-b489-424e3164b649 tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.225690 Jul 20 04:33:38.102202 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2572/5061] 10.222.0.20 () {58 vars in 1187 bytes} [Wed Jul 20 04:33:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:38.114959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fe2377b9-9c96-466c-8ada-357c1fa35eab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:38.118134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fe2377b9-9c96-466c-8ada-357c1fa35eab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:38.147185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe2377b9-9c96-466c-8ada-357c1fa35eab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.148052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe2377b9-9c96-466c-8ada-357c1fa35eab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.149122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe2377b9-9c96-466c-8ada-357c1fa35eab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.151383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe2377b9-9c96-466c-8ada-357c1fa35eab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.361753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ada9a85-0896-4fe2-b1db-41f540fb7409 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:38.375205 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ada9a85-0896-4fe2-b1db-41f540fb7409 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1501 microversion: 2.1 time: 0.690318 Jul 20 04:33:38.376516 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2490/5062] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:37 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1501 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:38.401637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-319c401f-ab86-45df-bec1-d996a132ce77 tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] Calling method '.version_select at 0x7fbf9d136af0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:38.545106 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-319c401f-ab86-45df-bec1-d996a132ce77 tempest-VolumesTestJSON-1350427523 tempest-VolumesTestJSON-1350427523-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.165910 Jul 20 04:33:38.547390 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2491/5063] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:33:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:38.563261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e4b4f30b-359a-4028-b8a8-a56c608424ca tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:38.565304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e4b4f30b-359a-4028-b8a8-a56c608424ca tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:38.580498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4b4f30b-359a-4028-b8a8-a56c608424ca tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.582150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4b4f30b-359a-4028-b8a8-a56c608424ca tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.583850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4b4f30b-359a-4028-b8a8-a56c608424ca tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.584538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4b4f30b-359a-4028-b8a8-a56c608424ca tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.612903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fe2377b9-9c96-466c-8ada-357c1fa35eab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:38.630045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fe2377b9-9c96-466c-8ada-357c1fa35eab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:38.631681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fe2377b9-9c96-466c-8ada-357c1fa35eab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:38.632919 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fe2377b9-9c96-466c-8ada-357c1fa35eab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.529218 Jul 20 04:33:38.652173 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2573/5064] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:38 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:38.679911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6ccd81cb-f7d3-4e54-b7f9-650a285a70b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:38.681578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6ccd81cb-f7d3-4e54-b7f9-650a285a70b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:38.708764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ccd81cb-f7d3-4e54-b7f9-650a285a70b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.710080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ccd81cb-f7d3-4e54-b7f9-650a285a70b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.712260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ccd81cb-f7d3-4e54-b7f9-650a285a70b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.716061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6ccd81cb-f7d3-4e54-b7f9-650a285a70b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.803349 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e4b4f30b-359a-4028-b8a8-a56c608424ca tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f/action" status: 202 len: 0 microversion: 2.1 time: 0.253769 Jul 20 04:33:38.808889 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2492/5065] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:38 2022] POST /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:38.823105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-06f97637-b91a-4abe-86af-02b45e885470 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:38.832969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-06f97637-b91a-4abe-86af-02b45e885470 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:38.839994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06f97637-b91a-4abe-86af-02b45e885470 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.855715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06f97637-b91a-4abe-86af-02b45e885470 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.856590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06f97637-b91a-4abe-86af-02b45e885470 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.857038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06f97637-b91a-4abe-86af-02b45e885470 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.185207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6ccd81cb-f7d3-4e54-b7f9-650a285a70b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:39.199976 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6ccd81cb-f7d3-4e54-b7f9-650a285a70b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.541535 Jul 20 04:33:39.200978 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2574/5066] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:38 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:39.219926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f711b21a-6514-4750-a4f9-db152baf1938 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:39.220795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f711b21a-6514-4750-a4f9-db152baf1938 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:39.231372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f711b21a-6514-4750-a4f9-db152baf1938 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:39.232138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f711b21a-6514-4750-a4f9-db152baf1938 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.233794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f711b21a-6514-4750-a4f9-db152baf1938 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:39.234492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f711b21a-6514-4750-a4f9-db152baf1938 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.348869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-06f97637-b91a-4abe-86af-02b45e885470 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:39.358691 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-06f97637-b91a-4abe-86af-02b45e885470 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.548342 Jul 20 04:33:39.361962 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2493/5067] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:38 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:39.633095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f711b21a-6514-4750-a4f9-db152baf1938 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:39.642127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:39.657760 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f711b21a-6514-4750-a4f9-db152baf1938 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1486 microversion: 2.1 time: 0.453337 Jul 20 04:33:39.658725 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2575/5068] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:39 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1486 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:39.678172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fb21a1b4-ce1f-4409-b3ca-564bb4447f35 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:39.678880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fb21a1b4-ce1f-4409-b3ca-564bb4447f35 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:39.679089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6d88697b-fe15-4c01-9a47-b63d59bde67e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:39.679756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6d88697b-fe15-4c01-9a47-b63d59bde67e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:39.687921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb21a1b4-ce1f-4409-b3ca-564bb4447f35 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:39.688641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb21a1b4-ce1f-4409-b3ca-564bb4447f35 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.689641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb21a1b4-ce1f-4409-b3ca-564bb4447f35 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:39.690500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb21a1b4-ce1f-4409-b3ca-564bb4447f35 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.703359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d88697b-fe15-4c01-9a47-b63d59bde67e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:39.707086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d88697b-fe15-4c01-9a47-b63d59bde67e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.708171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d88697b-fe15-4c01-9a47-b63d59bde67e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:39.708775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d88697b-fe15-4c01-9a47-b63d59bde67e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.759600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-6d88697b-fe15-4c01-9a47-b63d59bde67e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lazy-loading 'flavor' on Instance uuid fce4bdd8-5b00-422f-9d57-bddb9ceac19f {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:33:40.017065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fb21a1b4-ce1f-4409-b3ca-564bb4447f35 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:40.035948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fb21a1b4-ce1f-4409-b3ca-564bb4447f35 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:40.039129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fb21a1b4-ce1f-4409-b3ca-564bb4447f35 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:40.041267 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fb21a1b4-ce1f-4409-b3ca-564bb4447f35 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.367957 Jul 20 04:33:40.042733 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2494/5069] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:39 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:40.243689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-383fdab4-82e8-478c-a862-86616f4fa016 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:40.245112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-383fdab4-82e8-478c-a862-86616f4fa016 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:40.262608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-383fdab4-82e8-478c-a862-86616f4fa016 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.268747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-383fdab4-82e8-478c-a862-86616f4fa016 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.272186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-383fdab4-82e8-478c-a862-86616f4fa016 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.273653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-383fdab4-82e8-478c-a862-86616f4fa016 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.425301 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6d88697b-fe15-4c01-9a47-b63d59bde67e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f/action" status: 202 len: 0 microversion: 2.1 time: 0.751616 Jul 20 04:33:40.428159 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2576/5070] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:39 2022] POST /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f/action => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:40.446761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8d8bb3ba-e74f-49a2-9517-e0c4fff3c9e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:40.447613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8d8bb3ba-e74f-49a2-9517-e0c4fff3c9e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:40.500687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d8bb3ba-e74f-49a2-9517-e0c4fff3c9e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.501214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d8bb3ba-e74f-49a2-9517-e0c4fff3c9e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.502063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d8bb3ba-e74f-49a2-9517-e0c4fff3c9e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.505358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d8bb3ba-e74f-49a2-9517-e0c4fff3c9e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.786992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-383fdab4-82e8-478c-a862-86616f4fa016 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:40.797469 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-383fdab4-82e8-478c-a862-86616f4fa016 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.579588 Jul 20 04:33:40.809669 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2495/5071] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:40 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:40.821581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f57b0b76-a8e0-4541-b6e6-dacd29259fb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:40.824264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f57b0b76-a8e0-4541-b6e6-dacd29259fb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:40.837887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f57b0b76-a8e0-4541-b6e6-dacd29259fb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.840049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f57b0b76-a8e0-4541-b6e6-dacd29259fb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.841347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f57b0b76-a8e0-4541-b6e6-dacd29259fb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.845595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f57b0b76-a8e0-4541-b6e6-dacd29259fb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.846760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8d8bb3ba-e74f-49a2-9517-e0c4fff3c9e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:40.856458 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8d8bb3ba-e74f-49a2-9517-e0c4fff3c9e4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.423462 Jul 20 04:33:40.857774 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2577/5072] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:40 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:41.071775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd064964-8b7a-474b-a151-3986b588c9ba tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:41.073082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dd064964-8b7a-474b-a151-3986b588c9ba tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:41.103608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd064964-8b7a-474b-a151-3986b588c9ba tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.105065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd064964-8b7a-474b-a151-3986b588c9ba tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.106780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd064964-8b7a-474b-a151-3986b588c9ba tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.110955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd064964-8b7a-474b-a151-3986b588c9ba tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.244660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f57b0b76-a8e0-4541-b6e6-dacd29259fb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:41.262448 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f57b0b76-a8e0-4541-b6e6-dacd29259fb7 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1492 microversion: 2.1 time: 0.449916 Jul 20 04:33:41.263055 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2496/5073] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:40 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1492 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:41.405542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dd064964-8b7a-474b-a151-3986b588c9ba tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:41.417845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dd064964-8b7a-474b-a151-3986b588c9ba tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:41.420047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dd064964-8b7a-474b-a151-3986b588c9ba tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:41.422217 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dd064964-8b7a-474b-a151-3986b588c9ba tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.364306 Jul 20 04:33:41.422997 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2578/5074] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:41 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:41.816558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c20242e8-b995-43fe-a66d-2afc2c88a9d6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:41.817157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c20242e8-b995-43fe-a66d-2afc2c88a9d6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:41.829904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c20242e8-b995-43fe-a66d-2afc2c88a9d6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.830367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c20242e8-b995-43fe-a66d-2afc2c88a9d6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.831162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c20242e8-b995-43fe-a66d-2afc2c88a9d6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.839567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c20242e8-b995-43fe-a66d-2afc2c88a9d6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.874818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f56a63cc-73bb-4ac1-92be-2a399a09ed15 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:41.876067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f56a63cc-73bb-4ac1-92be-2a399a09ed15 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:41.887696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f56a63cc-73bb-4ac1-92be-2a399a09ed15 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.888402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f56a63cc-73bb-4ac1-92be-2a399a09ed15 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.889603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f56a63cc-73bb-4ac1-92be-2a399a09ed15 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.890237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f56a63cc-73bb-4ac1-92be-2a399a09ed15 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:42.286904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c20242e8-b995-43fe-a66d-2afc2c88a9d6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:42.302320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f56a63cc-73bb-4ac1-92be-2a399a09ed15 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:42.303854 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c20242e8-b995-43fe-a66d-2afc2c88a9d6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.488869 Jul 20 04:33:42.314291 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2497/5075] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:41 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:42.320683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9a2d688f-c5ac-4239-9518-4ecb51bbae56 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:42.325682 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f56a63cc-73bb-4ac1-92be-2a399a09ed15 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.454859 Jul 20 04:33:42.327759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9a2d688f-c5ac-4239-9518-4ecb51bbae56 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:42.328642 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2579/5076] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:41 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:42.355904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a2d688f-c5ac-4239-9518-4ecb51bbae56 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:42.356797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a2d688f-c5ac-4239-9518-4ecb51bbae56 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:42.360220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a2d688f-c5ac-4239-9518-4ecb51bbae56 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:42.361185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a2d688f-c5ac-4239-9518-4ecb51bbae56 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:42.443437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a5d8a1b0-014e-4706-ade4-a6491a0665a2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:42.444598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a5d8a1b0-014e-4706-ade4-a6491a0665a2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:42.456297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a5d8a1b0-014e-4706-ade4-a6491a0665a2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:42.464649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a5d8a1b0-014e-4706-ade4-a6491a0665a2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:42.465900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a5d8a1b0-014e-4706-ade4-a6491a0665a2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:42.467976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a5d8a1b0-014e-4706-ade4-a6491a0665a2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:42.721489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9a2d688f-c5ac-4239-9518-4ecb51bbae56 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:42.733351 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9a2d688f-c5ac-4239-9518-4ecb51bbae56 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1492 microversion: 2.1 time: 0.424893 Jul 20 04:33:42.737249 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2498/5077] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:42 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1492 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:42.823440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a5d8a1b0-014e-4706-ade4-a6491a0665a2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:42.837805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a5d8a1b0-014e-4706-ade4-a6491a0665a2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:42.845843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a5d8a1b0-014e-4706-ade4-a6491a0665a2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:42.849824 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a5d8a1b0-014e-4706-ade4-a6491a0665a2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.411245 Jul 20 04:33:42.853716 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2580/5078] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:42 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:33:43.327793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3ef1860d-be32-4a36-b630-6263a959e417 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:43.329068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3ef1860d-be32-4a36-b630-6263a959e417 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:43.343780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fe231147-2268-40ad-9a26-e580e4d579f1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:43.345063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fe231147-2268-40ad-9a26-e580e4d579f1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:43.351364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ef1860d-be32-4a36-b630-6263a959e417 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:43.364408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ef1860d-be32-4a36-b630-6263a959e417 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:43.368130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe231147-2268-40ad-9a26-e580e4d579f1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:43.368805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe231147-2268-40ad-9a26-e580e4d579f1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:43.369237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ef1860d-be32-4a36-b630-6263a959e417 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:43.369936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe231147-2268-40ad-9a26-e580e4d579f1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:43.370549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe231147-2268-40ad-9a26-e580e4d579f1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:43.371148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ef1860d-be32-4a36-b630-6263a959e417 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:43.922442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fe231147-2268-40ad-9a26-e580e4d579f1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:43.934920 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fe231147-2268-40ad-9a26-e580e4d579f1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.592304 Jul 20 04:33:43.935767 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2581/5079] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:43 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:43.944561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3ef1860d-be32-4a36-b630-6263a959e417 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:43.957169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-af2e7ccd-25d5-4f64-aa84-39d07b7e9367 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:43.958357 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3ef1860d-be32-4a36-b630-6263a959e417 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.640199 Jul 20 04:33:43.959427 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2499/5080] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:43 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:43.960589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-af2e7ccd-25d5-4f64-aa84-39d07b7e9367 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:43.973122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-91971ae0-1e8c-4d3b-b95e-62bd06732795 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:43.974496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-91971ae0-1e8c-4d3b-b95e-62bd06732795 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:43.976279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af2e7ccd-25d5-4f64-aa84-39d07b7e9367 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:43.977770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af2e7ccd-25d5-4f64-aa84-39d07b7e9367 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:43.980352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af2e7ccd-25d5-4f64-aa84-39d07b7e9367 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:43.988795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af2e7ccd-25d5-4f64-aa84-39d07b7e9367 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:43.989865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91971ae0-1e8c-4d3b-b95e-62bd06732795 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:43.990620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91971ae0-1e8c-4d3b-b95e-62bd06732795 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:43.991632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91971ae0-1e8c-4d3b-b95e-62bd06732795 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:43.995624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91971ae0-1e8c-4d3b-b95e-62bd06732795 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:44.557989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-91971ae0-1e8c-4d3b-b95e-62bd06732795 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:44.571478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-91971ae0-1e8c-4d3b-b95e-62bd06732795 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:44.577752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-91971ae0-1e8c-4d3b-b95e-62bd06732795 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:44.591837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af2e7ccd-25d5-4f64-aa84-39d07b7e9367 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:44.603023 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-91971ae0-1e8c-4d3b-b95e-62bd06732795 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.641267 Jul 20 04:33:44.606660 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-af2e7ccd-25d5-4f64-aa84-39d07b7e9367 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1513 microversion: 2.1 time: 0.668414 Jul 20 04:33:44.617339 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2500/5081] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:43 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:44.621886 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2582/5082] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:43 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1513 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:44.953874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a45cbfe8-e98e-4a08-8937-c488d1d67ea5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:44.954506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a45cbfe8-e98e-4a08-8937-c488d1d67ea5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:44.963665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a45cbfe8-e98e-4a08-8937-c488d1d67ea5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:44.964021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a45cbfe8-e98e-4a08-8937-c488d1d67ea5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:44.974982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a45cbfe8-e98e-4a08-8937-c488d1d67ea5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:44.975726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a45cbfe8-e98e-4a08-8937-c488d1d67ea5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:44.977032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0f0d36cc-17b8-42d2-b9e5-7316a18a271a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:44.977760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0f0d36cc-17b8-42d2-b9e5-7316a18a271a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:44.985002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f0d36cc-17b8-42d2-b9e5-7316a18a271a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:44.988329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f0d36cc-17b8-42d2-b9e5-7316a18a271a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:44.990251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f0d36cc-17b8-42d2-b9e5-7316a18a271a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:44.991382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f0d36cc-17b8-42d2-b9e5-7316a18a271a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.110897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:45.702153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0f0d36cc-17b8-42d2-b9e5-7316a18a271a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:45.714129 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0f0d36cc-17b8-42d2-b9e5-7316a18a271a tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.741533 Jul 20 04:33:45.739288 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2583/5083] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:44 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:45.756673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67b92551-d8bd-422e-a2e0-a82033394c6b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:45.766502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67b92551-d8bd-422e-a2e0-a82033394c6b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:45.788615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a45cbfe8-e98e-4a08-8937-c488d1d67ea5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:45.807886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=94 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:45.819314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67b92551-d8bd-422e-a2e0-a82033394c6b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:45.824077 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a45cbfe8-e98e-4a08-8937-c488d1d67ea5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.869101 Jul 20 04:33:45.834871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67b92551-d8bd-422e-a2e0-a82033394c6b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.835879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67b92551-d8bd-422e-a2e0-a82033394c6b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:45.836996 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2501/5084] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:44 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:45.840612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67b92551-d8bd-422e-a2e0-a82033394c6b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.865652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5afbdfa5-645f-466a-8eea-a0709970c5b0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:45.867952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5afbdfa5-645f-466a-8eea-a0709970c5b0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:45.907208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5afbdfa5-645f-466a-8eea-a0709970c5b0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:45.911057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5afbdfa5-645f-466a-8eea-a0709970c5b0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.914452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5afbdfa5-645f-466a-8eea-a0709970c5b0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:45.917874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5afbdfa5-645f-466a-8eea-a0709970c5b0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.567113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5afbdfa5-645f-466a-8eea-a0709970c5b0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:46.591711 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5afbdfa5-645f-466a-8eea-a0709970c5b0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1513 microversion: 2.1 time: 0.750471 Jul 20 04:33:46.596562 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2502/5085] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:45 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1513 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:46.703951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67b92551-d8bd-422e-a2e0-a82033394c6b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:46.726920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67b92551-d8bd-422e-a2e0-a82033394c6b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:46.749624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc412589-fe52-4d6e-84b5-95479807aa13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:46.750458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc412589-fe52-4d6e-84b5-95479807aa13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:46.755718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67b92551-d8bd-422e-a2e0-a82033394c6b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:46.756980 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67b92551-d8bd-422e-a2e0-a82033394c6b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 1.015784 Jul 20 04:33:46.765176 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2584/5086] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:45 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:46.766770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc412589-fe52-4d6e-84b5-95479807aa13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.767339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc412589-fe52-4d6e-84b5-95479807aa13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.771292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc412589-fe52-4d6e-84b5-95479807aa13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.772942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc412589-fe52-4d6e-84b5-95479807aa13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.858874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c0f7bc52-7b01-43b3-9da6-58de3598f7c3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:46.859969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c0f7bc52-7b01-43b3-9da6-58de3598f7c3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:46.885991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0f7bc52-7b01-43b3-9da6-58de3598f7c3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.886560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0f7bc52-7b01-43b3-9da6-58de3598f7c3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.897413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0f7bc52-7b01-43b3-9da6-58de3598f7c3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.898501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0f7bc52-7b01-43b3-9da6-58de3598f7c3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:47.511394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c0f7bc52-7b01-43b3-9da6-58de3598f7c3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:47.539310 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c0f7bc52-7b01-43b3-9da6-58de3598f7c3 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.686337 Jul 20 04:33:47.541053 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2585/5087] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:46 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:47.587188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fc412589-fe52-4d6e-84b5-95479807aa13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:47.615081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-364b5357-d405-4c4c-99bf-466e583edb8f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:47.616422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-364b5357-d405-4c4c-99bf-466e583edb8f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:47.621864 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc412589-fe52-4d6e-84b5-95479807aa13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.878871 Jul 20 04:33:47.639559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-364b5357-d405-4c4c-99bf-466e583edb8f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:47.639559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-364b5357-d405-4c4c-99bf-466e583edb8f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:47.639559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-364b5357-d405-4c4c-99bf-466e583edb8f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:47.639559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-364b5357-d405-4c4c-99bf-466e583edb8f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:47.640738 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2503/5088] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:46 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:47.783854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4bcacd0d-7888-45a9-9430-432c86c7ae39 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:47.785082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4bcacd0d-7888-45a9-9430-432c86c7ae39 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:47.798108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4bcacd0d-7888-45a9-9430-432c86c7ae39 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:47.800683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4bcacd0d-7888-45a9-9430-432c86c7ae39 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:47.807198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4bcacd0d-7888-45a9-9430-432c86c7ae39 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:47.808200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4bcacd0d-7888-45a9-9430-432c86c7ae39 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.782071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-364b5357-d405-4c4c-99bf-466e583edb8f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:48.790083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4bcacd0d-7888-45a9-9430-432c86c7ae39 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:48.797160 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-364b5357-d405-4c4c-99bf-466e583edb8f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1513 microversion: 2.1 time: 1.186090 Jul 20 04:33:48.811076 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2586/5089] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:47 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1513 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:48.813040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4bcacd0d-7888-45a9-9430-432c86c7ae39 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:48.814871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4bcacd0d-7888-45a9-9430-432c86c7ae39 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:48.816657 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4bcacd0d-7888-45a9-9430-432c86c7ae39 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 1.038227 Jul 20 04:33:48.817770 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2504/5090] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:47 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:33:48.821762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7ee69f40-00dc-48eb-8438-c313d7bff3af tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:48.825827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7ee69f40-00dc-48eb-8438-c313d7bff3af tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:48.832591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-508cc1ac-b9dd-405f-baf8-115ab32730d7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:48.833449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-508cc1ac-b9dd-405f-baf8-115ab32730d7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:48.843240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-508cc1ac-b9dd-405f-baf8-115ab32730d7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.845653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ee69f40-00dc-48eb-8438-c313d7bff3af tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.848148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ee69f40-00dc-48eb-8438-c313d7bff3af tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.849230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-508cc1ac-b9dd-405f-baf8-115ab32730d7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.850133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ee69f40-00dc-48eb-8438-c313d7bff3af tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.850679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-508cc1ac-b9dd-405f-baf8-115ab32730d7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.851589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-508cc1ac-b9dd-405f-baf8-115ab32730d7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.852177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ee69f40-00dc-48eb-8438-c313d7bff3af tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.184291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-508cc1ac-b9dd-405f-baf8-115ab32730d7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:49.193654 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-508cc1ac-b9dd-405f-baf8-115ab32730d7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.374503 Jul 20 04:33:49.197699 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2505/5091] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:48 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:49.241121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7ee69f40-00dc-48eb-8438-c313d7bff3af tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:49.244250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-45720161-d38c-415e-b656-a5d8de89a01c req-8ceec777-c820-4662-bd4f-ae14edde967a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce4bdd8-5b00-422f-9d57-bddb9ceac19f", "name": "network-vif-plugged", "status": "completed", "tag": "ded1351f-4cec-44a9-9f29-b24a7ae27ae8"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:49.253427 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7ee69f40-00dc-48eb-8438-c313d7bff3af tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.440629 Jul 20 04:33:49.261188 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2587/5092] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:48 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:49.262662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-45720161-d38c-415e-b656-a5d8de89a01c req-8ceec777-c820-4662-bd4f-ae14edde967a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.265199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-45720161-d38c-415e-b656-a5d8de89a01c req-8ceec777-c820-4662-bd4f-ae14edde967a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.304738 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-45720161-d38c-415e-b656-a5d8de89a01c req-8ceec777-c820-4662-bd4f-ae14edde967a service nova] Creating event network-vif-plugged:ded1351f-4cec-44a9-9f29-b24a7ae27ae8 for instance fce4bdd8-5b00-422f-9d57-bddb9ceac19f on n-h2-764485-11 Jul 20 04:33:49.318060 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-45720161-d38c-415e-b656-a5d8de89a01c req-8ceec777-c820-4662-bd4f-ae14edde967a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105334 Jul 20 04:33:49.319466 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2506/5093] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:49.820679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e65036ab-44fd-41c4-a041-9e199131961b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:49.822265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e65036ab-44fd-41c4-a041-9e199131961b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:49.841522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bde8c83e-2c6e-4ef2-9657-c66a1ebd91a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:49.843354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bde8c83e-2c6e-4ef2-9657-c66a1ebd91a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:49.851745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e65036ab-44fd-41c4-a041-9e199131961b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.852665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e65036ab-44fd-41c4-a041-9e199131961b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.857177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e65036ab-44fd-41c4-a041-9e199131961b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.859709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e65036ab-44fd-41c4-a041-9e199131961b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.862200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bde8c83e-2c6e-4ef2-9657-c66a1ebd91a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.866078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bde8c83e-2c6e-4ef2-9657-c66a1ebd91a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.867293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bde8c83e-2c6e-4ef2-9657-c66a1ebd91a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.871639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bde8c83e-2c6e-4ef2-9657-c66a1ebd91a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.551452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e65036ab-44fd-41c4-a041-9e199131961b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:50.560763 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e65036ab-44fd-41c4-a041-9e199131961b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.745622 Jul 20 04:33:50.567701 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2588/5094] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:49 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:50.578384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b5e4fd27-2edb-4fb9-ba31-febd2f8a6298 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:50.579194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b5e4fd27-2edb-4fb9-ba31-febd2f8a6298 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:50.595963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5e4fd27-2edb-4fb9-ba31-febd2f8a6298 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.596696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5e4fd27-2edb-4fb9-ba31-febd2f8a6298 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.597701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5e4fd27-2edb-4fb9-ba31-febd2f8a6298 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.598301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5e4fd27-2edb-4fb9-ba31-febd2f8a6298 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.742109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bde8c83e-2c6e-4ef2-9657-c66a1ebd91a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:50.752732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bde8c83e-2c6e-4ef2-9657-c66a1ebd91a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:50.763493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bde8c83e-2c6e-4ef2-9657-c66a1ebd91a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:50.765626 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bde8c83e-2c6e-4ef2-9657-c66a1ebd91a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.933577 Jul 20 04:33:50.766387 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2507/5095] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:49 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:50.780800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-46bc5bf5-024a-4bce-83fc-3735b0c49bac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:50.781698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-46bc5bf5-024a-4bce-83fc-3735b0c49bac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:50.788496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46bc5bf5-024a-4bce-83fc-3735b0c49bac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.789204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46bc5bf5-024a-4bce-83fc-3735b0c49bac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.790612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46bc5bf5-024a-4bce-83fc-3735b0c49bac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.791061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46bc5bf5-024a-4bce-83fc-3735b0c49bac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:51.193917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b5e4fd27-2edb-4fb9-ba31-febd2f8a6298 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:51.212427 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b5e4fd27-2edb-4fb9-ba31-febd2f8a6298 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.643464 Jul 20 04:33:51.226176 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2589/5096] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:50 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:51.268345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-46bc5bf5-024a-4bce-83fc-3735b0c49bac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:51.283460 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-46bc5bf5-024a-4bce-83fc-3735b0c49bac tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.515845 Jul 20 04:33:51.284750 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2508/5097] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:50 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:51.334688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-046c3676-6831-4116-b0e9-e6278813be16 req-6190695a-94c6-40cc-b7a2-4d8a3175dcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f3226f-82c7-4e50-9a7d-ca0721979912", "name": "network-vif-plugged", "status": "completed", "tag": "e8a977e2-08d6-4a53-9757-e0d3ee9db0ff"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:51.351073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-046c3676-6831-4116-b0e9-e6278813be16 req-6190695a-94c6-40cc-b7a2-4d8a3175dcd9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:51.351808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-046c3676-6831-4116-b0e9-e6278813be16 req-6190695a-94c6-40cc-b7a2-4d8a3175dcd9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:51.372086 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-046c3676-6831-4116-b0e9-e6278813be16 req-6190695a-94c6-40cc-b7a2-4d8a3175dcd9 service nova] Creating event network-vif-plugged:e8a977e2-08d6-4a53-9757-e0d3ee9db0ff for instance a2f3226f-82c7-4e50-9a7d-ca0721979912 on n-h1-764485-11 Jul 20 04:33:51.380897 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-046c3676-6831-4116-b0e9-e6278813be16 req-6190695a-94c6-40cc-b7a2-4d8a3175dcd9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050149 Jul 20 04:33:51.385385 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2590/5098] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:51.585882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c51e4f89-c41b-4de3-af84-c25471720c5d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:51.586726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c51e4f89-c41b-4de3-af84-c25471720c5d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:51.616653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c51e4f89-c41b-4de3-af84-c25471720c5d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:51.617741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c51e4f89-c41b-4de3-af84-c25471720c5d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:51.618771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c51e4f89-c41b-4de3-af84-c25471720c5d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:51.619430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c51e4f89-c41b-4de3-af84-c25471720c5d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:51.792255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62b3e565-c5bd-4584-818a-7ba2eff3f004 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:51.793284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-62b3e565-c5bd-4584-818a-7ba2eff3f004 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:51.817121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62b3e565-c5bd-4584-818a-7ba2eff3f004 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:51.817579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62b3e565-c5bd-4584-818a-7ba2eff3f004 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:51.819320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62b3e565-c5bd-4584-818a-7ba2eff3f004 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:51.819811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62b3e565-c5bd-4584-818a-7ba2eff3f004 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:51.826257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:52.194949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c51e4f89-c41b-4de3-af84-c25471720c5d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:52.203274 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c51e4f89-c41b-4de3-af84-c25471720c5d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.622019 Jul 20 04:33:52.203902 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2509/5099] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:51 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:52.235053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cfe033bc-c944-480f-82f0-a27bb9528467 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:52.235886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cfe033bc-c944-480f-82f0-a27bb9528467 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:52.245827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfe033bc-c944-480f-82f0-a27bb9528467 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:52.246275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfe033bc-c944-480f-82f0-a27bb9528467 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:52.247080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfe033bc-c944-480f-82f0-a27bb9528467 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:52.251335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfe033bc-c944-480f-82f0-a27bb9528467 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:52.433519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-62b3e565-c5bd-4584-818a-7ba2eff3f004 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:52.446641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-62b3e565-c5bd-4584-818a-7ba2eff3f004 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:52.448514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-62b3e565-c5bd-4584-818a-7ba2eff3f004 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:52.449958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-62b3e565-c5bd-4584-818a-7ba2eff3f004 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.670483 Jul 20 04:33:52.456403 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2591/5100] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:51 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:33:52.461504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-805b0737-f836-4754-bc3d-b22f16a902b1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:52.463742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-805b0737-f836-4754-bc3d-b22f16a902b1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:52.472965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-805b0737-f836-4754-bc3d-b22f16a902b1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:52.473817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-805b0737-f836-4754-bc3d-b22f16a902b1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:52.474990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-805b0737-f836-4754-bc3d-b22f16a902b1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:52.476069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-805b0737-f836-4754-bc3d-b22f16a902b1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:52.821976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cfe033bc-c944-480f-82f0-a27bb9528467 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:52.837990 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cfe033bc-c944-480f-82f0-a27bb9528467 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.607139 Jul 20 04:33:52.844357 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2510/5101] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:52 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:52.906222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-805b0737-f836-4754-bc3d-b22f16a902b1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:52.915162 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-805b0737-f836-4754-bc3d-b22f16a902b1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.457252 Jul 20 04:33:52.915818 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2592/5102] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:52 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:53.221072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-697fd13b-f9e0-461f-b6b0-49f0928be067 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:53.221701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-697fd13b-f9e0-461f-b6b0-49f0928be067 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:53.253041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-697fd13b-f9e0-461f-b6b0-49f0928be067 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.253652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-697fd13b-f9e0-461f-b6b0-49f0928be067 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.255768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-697fd13b-f9e0-461f-b6b0-49f0928be067 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.256284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-697fd13b-f9e0-461f-b6b0-49f0928be067 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.475630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ee4eb88d-579e-44a1-b856-9b0398d31741 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:53.476212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ee4eb88d-579e-44a1-b856-9b0398d31741 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:53.489132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee4eb88d-579e-44a1-b856-9b0398d31741 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.490710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee4eb88d-579e-44a1-b856-9b0398d31741 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.491577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee4eb88d-579e-44a1-b856-9b0398d31741 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.492035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee4eb88d-579e-44a1-b856-9b0398d31741 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.180886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee4eb88d-579e-44a1-b856-9b0398d31741 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:54.206331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee4eb88d-579e-44a1-b856-9b0398d31741 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:54.208844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee4eb88d-579e-44a1-b856-9b0398d31741 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:54.213333 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ee4eb88d-579e-44a1-b856-9b0398d31741 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.742898 Jul 20 04:33:54.216600 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2593/5103] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:53 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:54.242078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-45d954b0-e81e-4d51-a5c8-14d3df31435e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:54.246932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-45d954b0-e81e-4d51-a5c8-14d3df31435e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:54.268455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-697fd13b-f9e0-461f-b6b0-49f0928be067 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:54.281548 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-697fd13b-f9e0-461f-b6b0-49f0928be067 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 1.064972 Jul 20 04:33:54.282505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45d954b0-e81e-4d51-a5c8-14d3df31435e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:54.283231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45d954b0-e81e-4d51-a5c8-14d3df31435e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.298277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45d954b0-e81e-4d51-a5c8-14d3df31435e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:54.299227 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2511/5104] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:53 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:54.301395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45d954b0-e81e-4d51-a5c8-14d3df31435e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.316331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2641af61-60e1-423a-8b5a-a313664acafb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:54.318751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2641af61-60e1-423a-8b5a-a313664acafb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:54.333862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2641af61-60e1-423a-8b5a-a313664acafb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:54.335047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2641af61-60e1-423a-8b5a-a313664acafb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.337069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2641af61-60e1-423a-8b5a-a313664acafb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:54.339144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2641af61-60e1-423a-8b5a-a313664acafb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.570682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-45d954b0-e81e-4d51-a5c8-14d3df31435e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:54.588332 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-45d954b0-e81e-4d51-a5c8-14d3df31435e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.360992 Jul 20 04:33:54.588332 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2594/5105] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:54 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:54.756304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2641af61-60e1-423a-8b5a-a313664acafb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:54.793195 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2641af61-60e1-423a-8b5a-a313664acafb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.491056 Jul 20 04:33:54.795956 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2512/5106] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:54 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:55.234902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6d18c4bd-feda-4db7-9d16-9b07e091374a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:55.236993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6d18c4bd-feda-4db7-9d16-9b07e091374a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:55.266017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d18c4bd-feda-4db7-9d16-9b07e091374a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.268067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d18c4bd-feda-4db7-9d16-9b07e091374a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.273203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d18c4bd-feda-4db7-9d16-9b07e091374a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.274633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d18c4bd-feda-4db7-9d16-9b07e091374a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.302402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-42ac4afd-4d85-42e9-8137-27bbe764d8d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:55.304039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-42ac4afd-4d85-42e9-8137-27bbe764d8d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:55.352819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-42ac4afd-4d85-42e9-8137-27bbe764d8d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.353552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-42ac4afd-4d85-42e9-8137-27bbe764d8d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.360154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-42ac4afd-4d85-42e9-8137-27bbe764d8d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.362843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-42ac4afd-4d85-42e9-8137-27bbe764d8d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.605638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6d18c4bd-feda-4db7-9d16-9b07e091374a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:55.618630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6d18c4bd-feda-4db7-9d16-9b07e091374a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:55.636245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6d18c4bd-feda-4db7-9d16-9b07e091374a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:55.638791 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6d18c4bd-feda-4db7-9d16-9b07e091374a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.408674 Jul 20 04:33:55.640245 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2595/5107] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:55 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:55.645900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5592adb7-07a5-40ff-ae6e-eedb54f55d0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:55.647134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5592adb7-07a5-40ff-ae6e-eedb54f55d0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:55.661552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5592adb7-07a5-40ff-ae6e-eedb54f55d0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.662384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5592adb7-07a5-40ff-ae6e-eedb54f55d0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.663426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5592adb7-07a5-40ff-ae6e-eedb54f55d0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.665136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5592adb7-07a5-40ff-ae6e-eedb54f55d0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.765206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-42ac4afd-4d85-42e9-8137-27bbe764d8d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:55.782730 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-42ac4afd-4d85-42e9-8137-27bbe764d8d1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.484892 Jul 20 04:33:55.784320 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2513/5108] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:55 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:55.817729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7bbb2ae1-bce1-4a1c-8f44-7f0b13d451ce tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:55.820175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7bbb2ae1-bce1-4a1c-8f44-7f0b13d451ce tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:55.861237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bbb2ae1-bce1-4a1c-8f44-7f0b13d451ce tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.867011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bbb2ae1-bce1-4a1c-8f44-7f0b13d451ce tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.868092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bbb2ae1-bce1-4a1c-8f44-7f0b13d451ce tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.874403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bbb2ae1-bce1-4a1c-8f44-7f0b13d451ce tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.990234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5592adb7-07a5-40ff-ae6e-eedb54f55d0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:56.004252 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5592adb7-07a5-40ff-ae6e-eedb54f55d0b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.362515 Jul 20 04:33:56.020192 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2596/5109] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:55 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:56.177110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7bbb2ae1-bce1-4a1c-8f44-7f0b13d451ce tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:56.188283 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7bbb2ae1-bce1-4a1c-8f44-7f0b13d451ce tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.379091 Jul 20 04:33:56.199496 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2514/5110] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:55 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:56.669155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4a8bda3f-bff2-4195-b10a-e27d0e9fe6f5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:56.670753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4a8bda3f-bff2-4195-b10a-e27d0e9fe6f5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:56.679694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a8bda3f-bff2-4195-b10a-e27d0e9fe6f5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:56.680436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a8bda3f-bff2-4195-b10a-e27d0e9fe6f5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:56.681402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a8bda3f-bff2-4195-b10a-e27d0e9fe6f5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:56.682810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a8bda3f-bff2-4195-b10a-e27d0e9fe6f5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:56.801890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0600ac3e-17a5-46a9-b7cf-ab105fb5faf1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:56.803173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0600ac3e-17a5-46a9-b7cf-ab105fb5faf1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:56.818900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0600ac3e-17a5-46a9-b7cf-ab105fb5faf1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:56.819708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0600ac3e-17a5-46a9-b7cf-ab105fb5faf1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:56.822557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0600ac3e-17a5-46a9-b7cf-ab105fb5faf1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:56.823176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0600ac3e-17a5-46a9-b7cf-ab105fb5faf1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:56.980750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4a8bda3f-bff2-4195-b10a-e27d0e9fe6f5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:56.993924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4a8bda3f-bff2-4195-b10a-e27d0e9fe6f5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:57.003548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4a8bda3f-bff2-4195-b10a-e27d0e9fe6f5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:57.005910 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4a8bda3f-bff2-4195-b10a-e27d0e9fe6f5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.348300 Jul 20 04:33:57.019566 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2597/5111] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:56 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:57.064841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-197b215a-e7bc-4fbb-bf99-466e4a170b30 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:57.070133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-197b215a-e7bc-4fbb-bf99-466e4a170b30 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:57.083752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-197b215a-e7bc-4fbb-bf99-466e4a170b30 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.084587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-197b215a-e7bc-4fbb-bf99-466e4a170b30 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.087430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-197b215a-e7bc-4fbb-bf99-466e4a170b30 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.088218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-197b215a-e7bc-4fbb-bf99-466e4a170b30 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.354993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0600ac3e-17a5-46a9-b7cf-ab105fb5faf1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:57.369936 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0600ac3e-17a5-46a9-b7cf-ab105fb5faf1 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.573093 Jul 20 04:33:57.383692 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2515/5112] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:56 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:57.396415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4d352e55-ee92-4ea1-b188-15bd93dadc7c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:57.397292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4d352e55-ee92-4ea1-b188-15bd93dadc7c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:57.416244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d352e55-ee92-4ea1-b188-15bd93dadc7c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.420053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d352e55-ee92-4ea1-b188-15bd93dadc7c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.421541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d352e55-ee92-4ea1-b188-15bd93dadc7c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.423548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d352e55-ee92-4ea1-b188-15bd93dadc7c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.535323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-197b215a-e7bc-4fbb-bf99-466e4a170b30 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:57.546250 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-197b215a-e7bc-4fbb-bf99-466e4a170b30 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.492018 Jul 20 04:33:57.549765 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2598/5113] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:57 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:57.821414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4d352e55-ee92-4ea1-b188-15bd93dadc7c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:57.833668 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4d352e55-ee92-4ea1-b188-15bd93dadc7c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.441878 Jul 20 04:33:57.834616 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2516/5114] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:57 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:58.031413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52d7001e-1043-4235-b4e6-32ed104622c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:58.034429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52d7001e-1043-4235-b4e6-32ed104622c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:58.057216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52d7001e-1043-4235-b4e6-32ed104622c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.058107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52d7001e-1043-4235-b4e6-32ed104622c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.059997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52d7001e-1043-4235-b4e6-32ed104622c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.062633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52d7001e-1043-4235-b4e6-32ed104622c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.291317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52d7001e-1043-4235-b4e6-32ed104622c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:58.304471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52d7001e-1043-4235-b4e6-32ed104622c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:58.306283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52d7001e-1043-4235-b4e6-32ed104622c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:58.307973 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52d7001e-1043-4235-b4e6-32ed104622c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.284711 Jul 20 04:33:58.309064 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2599/5115] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:58 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:58.387341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6ec5389d-7242-4257-9798-fec3469f9a71 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:58.388290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6ec5389d-7242-4257-9798-fec3469f9a71 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:58.397936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=78 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:58.400213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ec5389d-7242-4257-9798-fec3469f9a71 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.401130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ec5389d-7242-4257-9798-fec3469f9a71 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.404032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ec5389d-7242-4257-9798-fec3469f9a71 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.406589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ec5389d-7242-4257-9798-fec3469f9a71 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.566767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-03cdcdf2-0fb0-419a-996c-5d406e2291ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:58.567986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-03cdcdf2-0fb0-419a-996c-5d406e2291ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:58.580557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03cdcdf2-0fb0-419a-996c-5d406e2291ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.581844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03cdcdf2-0fb0-419a-996c-5d406e2291ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.584269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03cdcdf2-0fb0-419a-996c-5d406e2291ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.587337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03cdcdf2-0fb0-419a-996c-5d406e2291ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.631562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6ec5389d-7242-4257-9798-fec3469f9a71 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:58.641840 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6ec5389d-7242-4257-9798-fec3469f9a71 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.259094 Jul 20 04:33:58.643661 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2517/5116] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:58 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:58.853797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-40809b1d-d49f-4b03-8928-45fe058fe824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:58.855713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-40809b1d-d49f-4b03-8928-45fe058fe824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:58.873769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40809b1d-d49f-4b03-8928-45fe058fe824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.874736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40809b1d-d49f-4b03-8928-45fe058fe824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.875964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40809b1d-d49f-4b03-8928-45fe058fe824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.877328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-03cdcdf2-0fb0-419a-996c-5d406e2291ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:58.877903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40809b1d-d49f-4b03-8928-45fe058fe824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.887034 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-03cdcdf2-0fb0-419a-996c-5d406e2291ff tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.324337 Jul 20 04:33:58.888506 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2600/5117] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:58 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:59.181858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-40809b1d-d49f-4b03-8928-45fe058fe824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:59.186760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:59.201273 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-40809b1d-d49f-4b03-8928-45fe058fe824 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.352959 Jul 20 04:33:59.203008 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2518/5118] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:58 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:59.326401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-151e4012-be8f-48dc-a0bd-626a136292b0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:59.328846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-151e4012-be8f-48dc-a0bd-626a136292b0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:59.365760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-151e4012-be8f-48dc-a0bd-626a136292b0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.366680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-151e4012-be8f-48dc-a0bd-626a136292b0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.368875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-151e4012-be8f-48dc-a0bd-626a136292b0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.371119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-151e4012-be8f-48dc-a0bd-626a136292b0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.662204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d36d366d-3ff8-4c3d-bd95-3760927b4043 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:59.662883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d36d366d-3ff8-4c3d-bd95-3760927b4043 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:59.690318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d36d366d-3ff8-4c3d-bd95-3760927b4043 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.691276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d36d366d-3ff8-4c3d-bd95-3760927b4043 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.692475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d36d366d-3ff8-4c3d-bd95-3760927b4043 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.697134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d36d366d-3ff8-4c3d-bd95-3760927b4043 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.720200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-151e4012-be8f-48dc-a0bd-626a136292b0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:59.736058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-151e4012-be8f-48dc-a0bd-626a136292b0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:59.737678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-151e4012-be8f-48dc-a0bd-626a136292b0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:59.741099 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-151e4012-be8f-48dc-a0bd-626a136292b0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.418746 Jul 20 04:33:59.746595 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2601/5119] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:59 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:59.941145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1e632914-e9b0-4fcd-b47d-aab67e70adbf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:59.942285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1e632914-e9b0-4fcd-b47d-aab67e70adbf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:59.964781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e632914-e9b0-4fcd-b47d-aab67e70adbf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.969126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e632914-e9b0-4fcd-b47d-aab67e70adbf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.970340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e632914-e9b0-4fcd-b47d-aab67e70adbf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.977819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e632914-e9b0-4fcd-b47d-aab67e70adbf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:00.216900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d36d366d-3ff8-4c3d-bd95-3760927b4043 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:00.234612 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d36d366d-3ff8-4c3d-bd95-3760927b4043 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.577905 Jul 20 04:34:00.235862 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2519/5120] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:59 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:00.244341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-12a5d1af-8417-4c50-84c3-4d237ec2d28e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:00.259977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-12a5d1af-8417-4c50-84c3-4d237ec2d28e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:00.288328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12a5d1af-8417-4c50-84c3-4d237ec2d28e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:00.293137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12a5d1af-8417-4c50-84c3-4d237ec2d28e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:00.296312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12a5d1af-8417-4c50-84c3-4d237ec2d28e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:00.296840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12a5d1af-8417-4c50-84c3-4d237ec2d28e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:00.316427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1e632914-e9b0-4fcd-b47d-aab67e70adbf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:00.339832 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1e632914-e9b0-4fcd-b47d-aab67e70adbf tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.422135 Jul 20 04:34:00.345173 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2602/5121] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:59 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:00.537636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-12a5d1af-8417-4c50-84c3-4d237ec2d28e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:00.559637 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-12a5d1af-8417-4c50-84c3-4d237ec2d28e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1510 microversion: 2.1 time: 0.322236 Jul 20 04:34:00.560594 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2520/5122] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:00 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:00.766227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-78fdeb45-a152-4540-a2c5-3fa1aece41c4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:00.767225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-78fdeb45-a152-4540-a2c5-3fa1aece41c4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:00.778116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78fdeb45-a152-4540-a2c5-3fa1aece41c4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:00.778237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78fdeb45-a152-4540-a2c5-3fa1aece41c4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:00.779095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78fdeb45-a152-4540-a2c5-3fa1aece41c4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:00.781515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78fdeb45-a152-4540-a2c5-3fa1aece41c4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:00.962543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-78fdeb45-a152-4540-a2c5-3fa1aece41c4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:00.988982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-78fdeb45-a152-4540-a2c5-3fa1aece41c4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:00.990874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-78fdeb45-a152-4540-a2c5-3fa1aece41c4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:00.992145 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-78fdeb45-a152-4540-a2c5-3fa1aece41c4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.231795 Jul 20 04:34:01.006573 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2603/5123] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:00 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:34:01.253347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-46687ddf-4b1b-4c0a-913e-cb12abeda4c2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:01.254285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-46687ddf-4b1b-4c0a-913e-cb12abeda4c2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:01.281246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46687ddf-4b1b-4c0a-913e-cb12abeda4c2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:01.281718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46687ddf-4b1b-4c0a-913e-cb12abeda4c2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:01.287347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46687ddf-4b1b-4c0a-913e-cb12abeda4c2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:01.291652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46687ddf-4b1b-4c0a-913e-cb12abeda4c2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:01.358910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-90b058dc-9ef9-464f-ab06-a562bd383e29 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:01.360215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-90b058dc-9ef9-464f-ab06-a562bd383e29 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:01.370560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90b058dc-9ef9-464f-ab06-a562bd383e29 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:01.373543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90b058dc-9ef9-464f-ab06-a562bd383e29 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:01.377135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90b058dc-9ef9-464f-ab06-a562bd383e29 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:01.378047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90b058dc-9ef9-464f-ab06-a562bd383e29 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:01.728615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-46687ddf-4b1b-4c0a-913e-cb12abeda4c2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:01.740183 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-46687ddf-4b1b-4c0a-913e-cb12abeda4c2 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.492795 Jul 20 04:34:01.742502 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2521/5124] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:01 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:01.758484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-60d55fd8-9330-48af-8226-9373dc3da718 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:01.759394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-60d55fd8-9330-48af-8226-9373dc3da718 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:01.770544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60d55fd8-9330-48af-8226-9373dc3da718 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:01.771188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60d55fd8-9330-48af-8226-9373dc3da718 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:01.776471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60d55fd8-9330-48af-8226-9373dc3da718 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:01.780329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60d55fd8-9330-48af-8226-9373dc3da718 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:01.962745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-90b058dc-9ef9-464f-ab06-a562bd383e29 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:01.980502 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-90b058dc-9ef9-464f-ab06-a562bd383e29 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.626834 Jul 20 04:34:01.994457 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2604/5125] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:01 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:02.004542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b14b7dbb-14a9-4eb8-bed3-5ac457a96ccd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:02.008954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b14b7dbb-14a9-4eb8-bed3-5ac457a96ccd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:02.020602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b14b7dbb-14a9-4eb8-bed3-5ac457a96ccd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.021695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b14b7dbb-14a9-4eb8-bed3-5ac457a96ccd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.028298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b14b7dbb-14a9-4eb8-bed3-5ac457a96ccd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.030290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b14b7dbb-14a9-4eb8-bed3-5ac457a96ccd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.062851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-60d55fd8-9330-48af-8226-9373dc3da718 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.081510 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-60d55fd8-9330-48af-8226-9373dc3da718 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1487 microversion: 2.1 time: 0.334487 Jul 20 04:34:02.087528 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2522/5126] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:01 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1487 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:02.096570 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b14b7dbb-14a9-4eb8-bed3-5ac457a96ccd tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099003 Jul 20 04:34:02.100891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0dec4378-ec9b-49fa-a493-9e19cfa3330e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:02.103290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0dec4378-ec9b-49fa-a493-9e19cfa3330e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:02.107703 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2605/5127] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:34:01 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:34:02.120567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0dec4378-ec9b-49fa-a493-9e19cfa3330e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.121900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0dec4378-ec9b-49fa-a493-9e19cfa3330e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.122032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b69ac069-6279-4908-b952-3ffcba1ce82c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2067502054"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:02.124120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b69ac069-6279-4908-b952-3ffcba1ce82c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:02.127782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0dec4378-ec9b-49fa-a493-9e19cfa3330e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.129546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0dec4378-ec9b-49fa-a493-9e19cfa3330e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.145264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b69ac069-6279-4908-b952-3ffcba1ce82c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.145730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b69ac069-6279-4908-b952-3ffcba1ce82c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.146527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b69ac069-6279-4908-b952-3ffcba1ce82c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.146976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b69ac069-6279-4908-b952-3ffcba1ce82c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.291676 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b69ac069-6279-4908-b952-3ffcba1ce82c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "PUT /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1061 microversion: 2.1 time: 0.182103 Jul 20 04:34:02.304206 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2606/5128] 10.222.0.20 () {60 vars in 1255 bytes} [Wed Jul 20 04:34:02 2022] PUT /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1061 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:02.312590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aa6168cf-439b-4ef5-ac71-49ba4a055aac tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:02.313463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aa6168cf-439b-4ef5-ac71-49ba4a055aac tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:02.321123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa6168cf-439b-4ef5-ac71-49ba4a055aac tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.322148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa6168cf-439b-4ef5-ac71-49ba4a055aac tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.323908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa6168cf-439b-4ef5-ac71-49ba4a055aac tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.324682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa6168cf-439b-4ef5-ac71-49ba4a055aac tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.358920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:02.367576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aa6168cf-439b-4ef5-ac71-49ba4a055aac tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:34:02.415789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0dec4378-ec9b-49fa-a493-9e19cfa3330e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.428019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0dec4378-ec9b-49fa-a493-9e19cfa3330e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.429916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0dec4378-ec9b-49fa-a493-9e19cfa3330e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.432094 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0dec4378-ec9b-49fa-a493-9e19cfa3330e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.343458 Jul 20 04:34:02.433248 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2523/5129] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:02 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:02.439963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5b3e39c2-65ef-4726-89c9-fd45583955fb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:02.440989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5b3e39c2-65ef-4726-89c9-fd45583955fb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:02.448439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b3e39c2-65ef-4726-89c9-fd45583955fb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.449577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b3e39c2-65ef-4726-89c9-fd45583955fb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.450628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b3e39c2-65ef-4726-89c9-fd45583955fb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.452523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b3e39c2-65ef-4726-89c9-fd45583955fb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.505673 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aa6168cf-439b-4ef5-ac71-49ba4a055aac tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 204 len: 0 microversion: 2.1 time: 0.192460 Jul 20 04:34:02.509696 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2607/5130] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:02 2022] DELETE /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:34:02.522894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7194859-d139-4b5e-a798-f3baca7c5917 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:02.524022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a7194859-d139-4b5e-a798-f3baca7c5917 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:02.539300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7194859-d139-4b5e-a798-f3baca7c5917 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.539950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7194859-d139-4b5e-a798-f3baca7c5917 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.542041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7194859-d139-4b5e-a798-f3baca7c5917 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.542497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7194859-d139-4b5e-a798-f3baca7c5917 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.124359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a7194859-d139-4b5e-a798-f3baca7c5917 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:03.133895 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a7194859-d139-4b5e-a798-f3baca7c5917 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1670 microversion: 2.1 time: 0.622850 Jul 20 04:34:03.148552 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2608/5131] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:02 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1670 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:03.152736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fc0e5b91-482d-41f5-9418-d701cbd89a33 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:03.153369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fc0e5b91-482d-41f5-9418-d701cbd89a33 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:03.166758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc0e5b91-482d-41f5-9418-d701cbd89a33 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.167221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc0e5b91-482d-41f5-9418-d701cbd89a33 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.172894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc0e5b91-482d-41f5-9418-d701cbd89a33 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.174095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc0e5b91-482d-41f5-9418-d701cbd89a33 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.325878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5b3e39c2-65ef-4726-89c9-fd45583955fb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:03.347471 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5b3e39c2-65ef-4726-89c9-fd45583955fb tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1488 microversion: 2.1 time: 0.905382 Jul 20 04:34:03.376301 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2524/5132] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:02 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1488 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:03.395168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-52f65acd-f633-4813-84b4-3a73c15b9d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:03.397966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-52f65acd-f633-4813-84b4-3a73c15b9d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:03.421871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52f65acd-f633-4813-84b4-3a73c15b9d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.426832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52f65acd-f633-4813-84b4-3a73c15b9d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.431055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52f65acd-f633-4813-84b4-3a73c15b9d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.431770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52f65acd-f633-4813-84b4-3a73c15b9d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.728805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-52f65acd-f633-4813-84b4-3a73c15b9d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:03.738288 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-52f65acd-f633-4813-84b4-3a73c15b9d3f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1519 microversion: 2.1 time: 0.360299 Jul 20 04:34:03.743813 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2525/5133] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:03 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1519 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:03.749591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fc0e5b91-482d-41f5-9418-d701cbd89a33 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:03.765697 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fc0e5b91-482d-41f5-9418-d701cbd89a33 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.621206 Jul 20 04:34:03.771560 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-02a81ab4-f08d-4ce8-8ca5-139c0ab10bed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:03.773038 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2609/5134] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:03 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:03.779164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f253e564-9dc3-4e46-8c23-44e19edc3c53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:03.780123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-02a81ab4-f08d-4ce8-8ca5-139c0ab10bed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:03.787261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f253e564-9dc3-4e46-8c23-44e19edc3c53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:03.798755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02a81ab4-f08d-4ce8-8ca5-139c0ab10bed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.804007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02a81ab4-f08d-4ce8-8ca5-139c0ab10bed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.808006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02a81ab4-f08d-4ce8-8ca5-139c0ab10bed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.809132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02a81ab4-f08d-4ce8-8ca5-139c0ab10bed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.820944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f253e564-9dc3-4e46-8c23-44e19edc3c53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.824114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f253e564-9dc3-4e46-8c23-44e19edc3c53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.825053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f253e564-9dc3-4e46-8c23-44e19edc3c53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.825616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f253e564-9dc3-4e46-8c23-44e19edc3c53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:04.365158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-02a81ab4-f08d-4ce8-8ca5-139c0ab10bed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:04.374316 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-02a81ab4-f08d-4ce8-8ca5-139c0ab10bed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1488 microversion: 2.1 time: 0.629001 Jul 20 04:34:04.374917 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2526/5135] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:03 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1488 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:04.391910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3d264a57-199b-46c8-8352-6ed6997e5450 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:04.397752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3d264a57-199b-46c8-8352-6ed6997e5450 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:04.415266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d264a57-199b-46c8-8352-6ed6997e5450 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:04.416110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d264a57-199b-46c8-8352-6ed6997e5450 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:04.417621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d264a57-199b-46c8-8352-6ed6997e5450 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:04.418829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d264a57-199b-46c8-8352-6ed6997e5450 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:04.492300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f253e564-9dc3-4e46-8c23-44e19edc3c53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:04.517026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f253e564-9dc3-4e46-8c23-44e19edc3c53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:04.519480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f253e564-9dc3-4e46-8c23-44e19edc3c53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:04.536251 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f253e564-9dc3-4e46-8c23-44e19edc3c53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 0.761920 Jul 20 04:34:04.551921 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2610/5136] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:03 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:04.564907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e48458de-2e2e-41ac-b7a7-8f1f13ba3c2a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:04.565884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e48458de-2e2e-41ac-b7a7-8f1f13ba3c2a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:04.578359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e48458de-2e2e-41ac-b7a7-8f1f13ba3c2a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:04.578808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e48458de-2e2e-41ac-b7a7-8f1f13ba3c2a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:04.579901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e48458de-2e2e-41ac-b7a7-8f1f13ba3c2a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:04.580382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e48458de-2e2e-41ac-b7a7-8f1f13ba3c2a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:04.645484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e48458de-2e2e-41ac-b7a7-8f1f13ba3c2a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:34:04.804995 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e48458de-2e2e-41ac-b7a7-8f1f13ba3c2a tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 204 len: 0 microversion: 2.1 time: 0.251251 Jul 20 04:34:04.806081 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2611/5137] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:04 2022] DELETE /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:34:04.814972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-27ef7394-5fb8-4f32-a860-084ef03dfef3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:04.825332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3d264a57-199b-46c8-8352-6ed6997e5450 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:04.835500 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3d264a57-199b-46c8-8352-6ed6997e5450 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1670 microversion: 2.1 time: 0.450973 Jul 20 04:34:04.836246 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2527/5138] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:04 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1670 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:04.838212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-27ef7394-5fb8-4f32-a860-084ef03dfef3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:04.848308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27ef7394-5fb8-4f32-a860-084ef03dfef3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:04.849032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27ef7394-5fb8-4f32-a860-084ef03dfef3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:04.849811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27ef7394-5fb8-4f32-a860-084ef03dfef3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:04.850248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27ef7394-5fb8-4f32-a860-084ef03dfef3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:04.855770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5d14e47-aa4b-46dc-b1af-6d15451c521a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:04.855928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c5d14e47-aa4b-46dc-b1af-6d15451c521a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:04.894007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5d14e47-aa4b-46dc-b1af-6d15451c521a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:04.894448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5d14e47-aa4b-46dc-b1af-6d15451c521a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:04.895241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5d14e47-aa4b-46dc-b1af-6d15451c521a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:04.895754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5d14e47-aa4b-46dc-b1af-6d15451c521a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:05.557060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c5d14e47-aa4b-46dc-b1af-6d15451c521a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:05.571475 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5d14e47-aa4b-46dc-b1af-6d15451c521a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.730356 Jul 20 04:34:05.582627 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2528/5139] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:04 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:05.594415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bd4af855-8a1e-40bb-beec-7f62ed16d899 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:05.595030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bd4af855-8a1e-40bb-beec-7f62ed16d899 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:05.630613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd4af855-8a1e-40bb-beec-7f62ed16d899 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:05.630993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd4af855-8a1e-40bb-beec-7f62ed16d899 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:05.631820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd4af855-8a1e-40bb-beec-7f62ed16d899 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:05.632262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd4af855-8a1e-40bb-beec-7f62ed16d899 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:05.732913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-27ef7394-5fb8-4f32-a860-084ef03dfef3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:05.750294 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-27ef7394-5fb8-4f32-a860-084ef03dfef3 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.942863 Jul 20 04:34:05.750900 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2612/5140] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:04 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:05.768403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44be30aa-ae40-49af-9f4c-66e77fbc6d5c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:05.771854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44be30aa-ae40-49af-9f4c-66e77fbc6d5c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:05.800587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44be30aa-ae40-49af-9f4c-66e77fbc6d5c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:05.803658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44be30aa-ae40-49af-9f4c-66e77fbc6d5c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:05.804735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44be30aa-ae40-49af-9f4c-66e77fbc6d5c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:05.805349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44be30aa-ae40-49af-9f4c-66e77fbc6d5c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:06.180899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bd4af855-8a1e-40bb-beec-7f62ed16d899 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:06.189216 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bd4af855-8a1e-40bb-beec-7f62ed16d899 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1494 microversion: 2.1 time: 0.613827 Jul 20 04:34:06.195861 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2529/5141] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:05 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1494 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:06.205242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8864e59e-896f-43cd-8446-d3d42e0b07e0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:06.205875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8864e59e-896f-43cd-8446-d3d42e0b07e0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:06.215108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8864e59e-896f-43cd-8446-d3d42e0b07e0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.215483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8864e59e-896f-43cd-8446-d3d42e0b07e0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:06.221334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8864e59e-896f-43cd-8446-d3d42e0b07e0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.221808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8864e59e-896f-43cd-8446-d3d42e0b07e0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:06.855059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44be30aa-ae40-49af-9f4c-66e77fbc6d5c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:06.867142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44be30aa-ae40-49af-9f4c-66e77fbc6d5c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:06.868764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44be30aa-ae40-49af-9f4c-66e77fbc6d5c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:06.869903 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44be30aa-ae40-49af-9f4c-66e77fbc6d5c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 1.118035 Jul 20 04:34:06.870826 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2613/5142] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:05 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:06.898713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a8d82892-9216-40c1-80be-2837339690e1 req-f663779c-a5a2-45b4-aac3-383e5656c7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76d5764-986d-4d3f-806f-1f8b1c5a73c1", "name": "network-vif-plugged", "status": "completed", "tag": "f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:06.922314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a8d82892-9216-40c1-80be-2837339690e1 req-f663779c-a5a2-45b4-aac3-383e5656c7c4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.922759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a8d82892-9216-40c1-80be-2837339690e1 req-f663779c-a5a2-45b4-aac3-383e5656c7c4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:06.945080 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a8d82892-9216-40c1-80be-2837339690e1 req-f663779c-a5a2-45b4-aac3-383e5656c7c4 service nova] Creating event network-vif-plugged:f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981 for instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 on n-h2-764485-11 Jul 20 04:34:06.958107 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a8d82892-9216-40c1-80be-2837339690e1 req-f663779c-a5a2-45b4-aac3-383e5656c7c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063637 Jul 20 04:34:06.958737 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2614/5143] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:06.969208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bb00a06c-aecb-485c-99d2-bf115d8cfa8f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:06.976561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bb00a06c-aecb-485c-99d2-bf115d8cfa8f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:06.995493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb00a06c-aecb-485c-99d2-bf115d8cfa8f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:07.003801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb00a06c-aecb-485c-99d2-bf115d8cfa8f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:07.005026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb00a06c-aecb-485c-99d2-bf115d8cfa8f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:07.005696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb00a06c-aecb-485c-99d2-bf115d8cfa8f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:07.600258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8864e59e-896f-43cd-8446-d3d42e0b07e0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:07.613752 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8864e59e-896f-43cd-8446-d3d42e0b07e0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 1.416717 Jul 20 04:34:07.614368 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2530/5144] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:06 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:07.641806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4741d0c7-e26e-4997-a85f-7ef3f5b0ac9e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:07.642436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4741d0c7-e26e-4997-a85f-7ef3f5b0ac9e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:07.674222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4741d0c7-e26e-4997-a85f-7ef3f5b0ac9e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:07.674757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4741d0c7-e26e-4997-a85f-7ef3f5b0ac9e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:07.675605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4741d0c7-e26e-4997-a85f-7ef3f5b0ac9e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:07.676123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4741d0c7-e26e-4997-a85f-7ef3f5b0ac9e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.282264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4741d0c7-e26e-4997-a85f-7ef3f5b0ac9e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:08.289014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bb00a06c-aecb-485c-99d2-bf115d8cfa8f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:08.301887 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4741d0c7-e26e-4997-a85f-7ef3f5b0ac9e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.662563 Jul 20 04:34:08.309466 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bb00a06c-aecb-485c-99d2-bf115d8cfa8f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1670 microversion: 2.1 time: 1.344460 Jul 20 04:34:08.315374 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2531/5145] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:07 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:08.324206 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2615/5146] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:06 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1670 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:08.329569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f3bf9296-7214-4176-89a5-caf8f3511f40 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:08.336086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7bc2c04e-42c4-4603-a4cd-d184d8bbb33f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:08.336736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7bc2c04e-42c4-4603-a4cd-d184d8bbb33f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:08.337437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f3bf9296-7214-4176-89a5-caf8f3511f40 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:08.353638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3bf9296-7214-4176-89a5-caf8f3511f40 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.354369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3bf9296-7214-4176-89a5-caf8f3511f40 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.355920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3bf9296-7214-4176-89a5-caf8f3511f40 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.356368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3bf9296-7214-4176-89a5-caf8f3511f40 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.362580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bc2c04e-42c4-4603-a4cd-d184d8bbb33f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.364151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bc2c04e-42c4-4603-a4cd-d184d8bbb33f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.369462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bc2c04e-42c4-4603-a4cd-d184d8bbb33f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.369462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bc2c04e-42c4-4603-a4cd-d184d8bbb33f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.847308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f3bf9296-7214-4176-89a5-caf8f3511f40 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:08.858849 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f3bf9296-7214-4176-89a5-caf8f3511f40 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.533147 Jul 20 04:34:08.881127 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2616/5147] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:08 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:08.895665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-92f1c17a-c93b-4a17-824a-b4f1b65daa50 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:08.900326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-92f1c17a-c93b-4a17-824a-b4f1b65daa50 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:08.931716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92f1c17a-c93b-4a17-824a-b4f1b65daa50 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.932687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92f1c17a-c93b-4a17-824a-b4f1b65daa50 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.934803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92f1c17a-c93b-4a17-824a-b4f1b65daa50 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.937941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-92f1c17a-c93b-4a17-824a-b4f1b65daa50 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:09.033952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7bc2c04e-42c4-4603-a4cd-d184d8bbb33f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:09.066331 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7bc2c04e-42c4-4603-a4cd-d184d8bbb33f tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1494 microversion: 2.1 time: 0.746452 Jul 20 04:34:09.080158 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2532/5148] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:08 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1494 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:09.112263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cde55081-6780-4080-8c88-d1dbd864a339 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:09.138031 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-cde55081-6780-4080-8c88-d1dbd864a339 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance 4d57b97f-821c-4651-ad78-7c4f244d8022 has no mapping to a cell. Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cde55081-6780-4080-8c88-d1dbd864a339 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/4d57b97f-821c-4651-ad78-7c4f244d8022/action HTTP/1.1 Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 15 Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: {"os-stop": {}} Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 4d57b97f-821c-4651-ad78-7c4f244d8022 has no mapping to a cell. Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '4d57b97f-821c-4651-ad78-7c4f244d8022', 'body': {'os-stop': {}}} Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 4d57b97f-821c-4651-ad78-7c4f244d8022 has no mapping to a cell. Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:09.152228 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d57b97f-821c-4651-ad78-7c4f244d8022 has no mapping to a cell. Jul 20 04:34:09.157467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:09.157467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:09.157467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:09.157467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:09.157467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:09.157467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:09.157467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:09.157467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:09.157467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d57b97f-821c-4651-ad78-7c4f244d8022 has no mapping to a cell. Jul 20 04:34:09.157467 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:09.161922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cde55081-6780-4080-8c88-d1dbd864a339 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance 4d57b97f-821c-4651-ad78-7c4f244d8022 has no mapping to a cell. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:09.164865 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cde55081-6780-4080-8c88-d1dbd864a339 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/4d57b97f-821c-4651-ad78-7c4f244d8022/action" status: 404 len: 117 microversion: 2.1 time: 0.074227 Jul 20 04:34:09.165972 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2533/5149] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:09 2022] POST /compute/v2.1/servers/4d57b97f-821c-4651-ad78-7c4f244d8022/action => generated 117 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:09.199266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8672e2b3-a939-4ce8-bd1e-4ff1f16211c9 req-7d4b7753-817f-48cb-b25e-aeb22b792dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8d5de4-7985-4933-8867-3352bf84a16b", "name": "network-vif-unplugged", "status": "completed", "tag": "98d95473-ef58-4c7b-b571-36edf82efa0c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:09.228452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8672e2b3-a939-4ce8-bd1e-4ff1f16211c9 req-7d4b7753-817f-48cb-b25e-aeb22b792dd3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:09.240791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8672e2b3-a939-4ce8-bd1e-4ff1f16211c9 req-7d4b7753-817f-48cb-b25e-aeb22b792dd3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:09.266383 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8672e2b3-a939-4ce8-bd1e-4ff1f16211c9 req-7d4b7753-817f-48cb-b25e-aeb22b792dd3 service nova] Creating event network-vif-unplugged:98d95473-ef58-4c7b-b571-36edf82efa0c for instance bd8d5de4-7985-4933-8867-3352bf84a16b on n-h1-764485-11 Jul 20 04:34:09.279953 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8672e2b3-a939-4ce8-bd1e-4ff1f16211c9 req-7d4b7753-817f-48cb-b25e-aeb22b792dd3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110771 Jul 20 04:34:09.284747 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2534/5150] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:09.297390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-52aed87b-a6e8-4f50-bd16-8efc5819eb57 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:09.298140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-52aed87b-a6e8-4f50-bd16-8efc5819eb57 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:09.321124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52aed87b-a6e8-4f50-bd16-8efc5819eb57 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:09.323552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52aed87b-a6e8-4f50-bd16-8efc5819eb57 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:09.328380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52aed87b-a6e8-4f50-bd16-8efc5819eb57 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:09.331688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52aed87b-a6e8-4f50-bd16-8efc5819eb57 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:10.240375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-52aed87b-a6e8-4f50-bd16-8efc5819eb57 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:10.275068 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-52aed87b-a6e8-4f50-bd16-8efc5819eb57 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.987323 Jul 20 04:34:10.278427 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2535/5151] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:09 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:10.299735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5584a123-dbef-4e8c-bdb4-726f46ae9d6c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:10.327108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5584a123-dbef-4e8c-bdb4-726f46ae9d6c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:10.342177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5584a123-dbef-4e8c-bdb4-726f46ae9d6c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:10.344453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5584a123-dbef-4e8c-bdb4-726f46ae9d6c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:10.346543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5584a123-dbef-4e8c-bdb4-726f46ae9d6c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:10.347325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5584a123-dbef-4e8c-bdb4-726f46ae9d6c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:10.423009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-92f1c17a-c93b-4a17-824a-b4f1b65daa50 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:10.438105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-92f1c17a-c93b-4a17-824a-b4f1b65daa50 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:10.447018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-92f1c17a-c93b-4a17-824a-b4f1b65daa50 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:10.454493 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-92f1c17a-c93b-4a17-824a-b4f1b65daa50 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1806 microversion: 2.20 time: 1.569768 Jul 20 04:34:10.458157 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2617/5152] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:08 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1806 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:10.472348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b33c5e65-7071-4ec7-aedb-01af3fe77baf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:10.522580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b33c5e65-7071-4ec7-aedb-01af3fe77baf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:10.548355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b33c5e65-7071-4ec7-aedb-01af3fe77baf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:10.549163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b33c5e65-7071-4ec7-aedb-01af3fe77baf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:10.551398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b33c5e65-7071-4ec7-aedb-01af3fe77baf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:10.553188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b33c5e65-7071-4ec7-aedb-01af3fe77baf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:10.835748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b33c5e65-7071-4ec7-aedb-01af3fe77baf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:10.848871 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b33c5e65-7071-4ec7-aedb-01af3fe77baf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1602 microversion: 2.1 time: 0.389014 Jul 20 04:34:10.863476 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2618/5153] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:10 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1602 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:10.880153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-830a92f6-3580-40d2-8c66-8ba05c591ee0 req-1edc540a-2da8-4274-abca-de1147523a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bc8d51-b9c3-441b-8160-c27334808041", "name": "network-vif-deleted", "tag": "4254f267-2a36-4654-ad52-6ee068bcdee1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:10.901083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-830a92f6-3580-40d2-8c66-8ba05c591ee0 req-1edc540a-2da8-4274-abca-de1147523a00 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:10.902387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-830a92f6-3580-40d2-8c66-8ba05c591ee0 req-1edc540a-2da8-4274-abca-de1147523a00 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:10.918351 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-830a92f6-3580-40d2-8c66-8ba05c591ee0 req-1edc540a-2da8-4274-abca-de1147523a00 service nova] Creating event network-vif-deleted:4254f267-2a36-4654-ad52-6ee068bcdee1 for instance 54bc8d51-b9c3-441b-8160-c27334808041 on n-h2-764485-11 Jul 20 04:34:10.929312 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-830a92f6-3580-40d2-8c66-8ba05c591ee0 req-1edc540a-2da8-4274-abca-de1147523a00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062239 Jul 20 04:34:10.930633 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2619/5154] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:10.939828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88ba9293-9471-45e4-896b-c9acdc7c89e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:10.940891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88ba9293-9471-45e4-896b-c9acdc7c89e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:10.949386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88ba9293-9471-45e4-896b-c9acdc7c89e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:10.950182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88ba9293-9471-45e4-896b-c9acdc7c89e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:10.951441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88ba9293-9471-45e4-896b-c9acdc7c89e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:10.953136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88ba9293-9471-45e4-896b-c9acdc7c89e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:10.996569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88ba9293-9471-45e4-896b-c9acdc7c89e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:10.997389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88ba9293-9471-45e4-896b-c9acdc7c89e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:10.998748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-88ba9293-9471-45e4-896b-c9acdc7c89e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lazy-loading 'fault' on Instance uuid 54bc8d51-b9c3-441b-8160-c27334808041 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:34:11.095473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5584a123-dbef-4e8c-bdb4-726f46ae9d6c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:11.114111 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5584a123-dbef-4e8c-bdb4-726f46ae9d6c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.826714 Jul 20 04:34:11.120626 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2536/5155] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:10 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:11.133631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f294a81-c5ad-409b-81d0-7f35889c497f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:11.136742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2f294a81-c5ad-409b-81d0-7f35889c497f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:11.152688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f294a81-c5ad-409b-81d0-7f35889c497f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.154880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f294a81-c5ad-409b-81d0-7f35889c497f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.156781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f294a81-c5ad-409b-81d0-7f35889c497f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.159283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f294a81-c5ad-409b-81d0-7f35889c497f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.172347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:11.181640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88ba9293-9471-45e4-896b-c9acdc7c89e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:11.194070 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88ba9293-9471-45e4-896b-c9acdc7c89e5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 200 len: 1310 microversion: 2.1 time: 0.257024 Jul 20 04:34:11.198496 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2620/5156] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:10 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 1310 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:11.477361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ee31bb85-e9ab-4609-bfaf-1eae47424acf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:11.478146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ee31bb85-e9ab-4609-bfaf-1eae47424acf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:11.496130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee31bb85-e9ab-4609-bfaf-1eae47424acf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.499860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee31bb85-e9ab-4609-bfaf-1eae47424acf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.503378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2f294a81-c5ad-409b-81d0-7f35889c497f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:11.504830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee31bb85-e9ab-4609-bfaf-1eae47424acf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.508117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee31bb85-e9ab-4609-bfaf-1eae47424acf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.517624 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2f294a81-c5ad-409b-81d0-7f35889c497f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.392965 Jul 20 04:34:11.519256 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2537/5157] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:11 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:11.536174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6290430c-67a8-42ed-9b81-80ef665041e7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:11.537269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6290430c-67a8-42ed-9b81-80ef665041e7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: f34cfcb1-84f7-4ba0-8239-a9ac1191bb52] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:11.548910 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-6290430c-67a8-42ed-9b81-80ef665041e7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance f34cfcb1-84f7-4ba0-8239-a9ac1191bb52 could not be found. Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6290430c-67a8-42ed-9b81-80ef665041e7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/f34cfcb1-84f7-4ba0-8239-a9ac1191bb52/action HTTP/1.1 Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 15 Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: {"suspend": {}} Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance f34cfcb1-84f7-4ba0-8239-a9ac1191bb52 could not be found. Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'f34cfcb1-84f7-4ba0-8239-a9ac1191bb52', 'body': {'suspend': {}}} Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f34cfcb1-84f7-4ba0-8239-a9ac1191bb52 could not be found. Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f34cfcb1-84f7-4ba0-8239-a9ac1191bb52 could not be found. Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:11.550868 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:11.555214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:11.555214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:11.555214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f34cfcb1-84f7-4ba0-8239-a9ac1191bb52 could not be found. Jul 20 04:34:11.555214 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:11.561514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6290430c-67a8-42ed-9b81-80ef665041e7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance f34cfcb1-84f7-4ba0-8239-a9ac1191bb52 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:11.563333 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6290430c-67a8-42ed-9b81-80ef665041e7 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/f34cfcb1-84f7-4ba0-8239-a9ac1191bb52/action" status: 404 len: 111 microversion: 2.1 time: 0.032392 Jul 20 04:34:11.568754 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2538/5158] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:11 2022] POST /compute/v2.1/servers/f34cfcb1-84f7-4ba0-8239-a9ac1191bb52/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:34:11.581867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c501d3d1-d908-43ba-979a-93a245edab5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:11.585299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c501d3d1-d908-43ba-979a-93a245edab5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:11.605472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c501d3d1-d908-43ba-979a-93a245edab5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.606366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c501d3d1-d908-43ba-979a-93a245edab5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.610055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c501d3d1-d908-43ba-979a-93a245edab5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.612164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c501d3d1-d908-43ba-979a-93a245edab5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.642610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:12.190914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c501d3d1-d908-43ba-979a-93a245edab5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:12.204384 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c501d3d1-d908-43ba-979a-93a245edab5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.629746 Jul 20 04:34:12.206606 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2539/5159] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:11 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:12.206900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee31bb85-e9ab-4609-bfaf-1eae47424acf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:12.217059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee31bb85-e9ab-4609-bfaf-1eae47424acf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:12.224498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee31bb85-e9ab-4609-bfaf-1eae47424acf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:12.224696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1a0bb100-265a-4e5e-945c-fbd927868e49 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:12.225316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1a0bb100-265a-4e5e-945c-fbd927868e49 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:12.226730 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ee31bb85-e9ab-4609-bfaf-1eae47424acf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1793 microversion: 2.20 time: 0.754371 Jul 20 04:34:12.230740 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2621/5160] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:11 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1793 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:12.245487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-81d6ec69-45c8-4313-9358-c1d5fbcbb964 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:12.246361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-81d6ec69-45c8-4313-9358-c1d5fbcbb964 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:12.256810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a0bb100-265a-4e5e-945c-fbd927868e49 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.258887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-81d6ec69-45c8-4313-9358-c1d5fbcbb964 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.259033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a0bb100-265a-4e5e-945c-fbd927868e49 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.260677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a0bb100-265a-4e5e-945c-fbd927868e49 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.261139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a0bb100-265a-4e5e-945c-fbd927868e49 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.261611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-81d6ec69-45c8-4313-9358-c1d5fbcbb964 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.262633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-81d6ec69-45c8-4313-9358-c1d5fbcbb964 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.265469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-81d6ec69-45c8-4313-9358-c1d5fbcbb964 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.333701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a0bb100-265a-4e5e-945c-fbd927868e49 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.334163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a0bb100-265a-4e5e-945c-fbd927868e49 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.334690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-1a0bb100-265a-4e5e-945c-fbd927868e49 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lazy-loading 'fault' on Instance uuid bd8d5de4-7985-4933-8867-3352bf84a16b {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:34:12.434526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1a0bb100-265a-4e5e-945c-fbd927868e49 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:12.454439 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1a0bb100-265a-4e5e-945c-fbd927868e49 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 200 len: 1326 microversion: 2.1 time: 0.240109 Jul 20 04:34:12.456777 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2540/5161] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:12 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 1326 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:12.470219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3f30a14b-2800-42f9-8074-6d939f6d5377 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:12.471153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3f30a14b-2800-42f9-8074-6d939f6d5377 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:12.486938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f30a14b-2800-42f9-8074-6d939f6d5377 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.487737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f30a14b-2800-42f9-8074-6d939f6d5377 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.488773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f30a14b-2800-42f9-8074-6d939f6d5377 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.492194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f30a14b-2800-42f9-8074-6d939f6d5377 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.533910 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-3f30a14b-2800-42f9-8074-6d939f6d5377 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3f30a14b-2800-42f9-8074-6d939f6d5377 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 HTTP/1.1 Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '54bc8d51-b9c3-441b-8160-c27334808041'} Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:12.537294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:12.543169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:12.543169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:12.543169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:12.543169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:12.543169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:12.543169 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:12.546983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3f30a14b-2800-42f9-8074-6d939f6d5377 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:12.554198 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3f30a14b-2800-42f9-8074-6d939f6d5377 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 404 len: 111 microversion: 2.1 time: 0.095752 Jul 20 04:34:12.555543 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2541/5162] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:12 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:12.583135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5031ec80-71c2-4aba-9f5a-e5d353e8ee13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:12.586733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5031ec80-71c2-4aba-9f5a-e5d353e8ee13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:12.606691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5031ec80-71c2-4aba-9f5a-e5d353e8ee13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.607731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5031ec80-71c2-4aba-9f5a-e5d353e8ee13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.608979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5031ec80-71c2-4aba-9f5a-e5d353e8ee13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.611496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5031ec80-71c2-4aba-9f5a-e5d353e8ee13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.160564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-81d6ec69-45c8-4313-9358-c1d5fbcbb964 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:13.170789 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-81d6ec69-45c8-4313-9358-c1d5fbcbb964 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.938544 Jul 20 04:34:13.179352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5031ec80-71c2-4aba-9f5a-e5d353e8ee13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:13.182557 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2622/5163] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:12 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:13.199809 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5031ec80-71c2-4aba-9f5a-e5d353e8ee13 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.642694 Jul 20 04:34:13.201474 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2542/5164] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:12 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:13.214556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f3b4dd09-321c-4a52-8da8-524e9b5e57c4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:13.215073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f3b4dd09-321c-4a52-8da8-524e9b5e57c4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.225384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-be3b70ed-52e1-41cd-943d-5bb7b9b399b6 req-d8b05ed8-76bf-4412-a48a-5bf4440b2245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8d5de4-7985-4933-8867-3352bf84a16b", "name": "network-vif-deleted", "tag": "98d95473-ef58-4c7b-b571-36edf82efa0c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:13.236802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3b4dd09-321c-4a52-8da8-524e9b5e57c4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.243798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3b4dd09-321c-4a52-8da8-524e9b5e57c4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.256347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3b4dd09-321c-4a52-8da8-524e9b5e57c4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.257078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3b4dd09-321c-4a52-8da8-524e9b5e57c4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.260378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-be3b70ed-52e1-41cd-943d-5bb7b9b399b6 req-d8b05ed8-76bf-4412-a48a-5bf4440b2245 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.261103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-be3b70ed-52e1-41cd-943d-5bb7b9b399b6 req-d8b05ed8-76bf-4412-a48a-5bf4440b2245 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.307748 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-be3b70ed-52e1-41cd-943d-5bb7b9b399b6 req-d8b05ed8-76bf-4412-a48a-5bf4440b2245 service nova] Creating event network-vif-deleted:98d95473-ef58-4c7b-b571-36edf82efa0c for instance bd8d5de4-7985-4933-8867-3352bf84a16b on n-h1-764485-11 Jul 20 04:34:13.313342 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f3b4dd09-321c-4a52-8da8-524e9b5e57c4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f3b4dd09-321c-4a52-8da8-524e9b5e57c4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 HTTP/1.1 Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '54bc8d51-b9c3-441b-8160-c27334808041'} Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:13.315375 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:13.322014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.322014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.322014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.322014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.322014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.322014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.322014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:13.322014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:13.322014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:13.322014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.329809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f3b4dd09-321c-4a52-8da8-524e9b5e57c4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:13.333437 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f3b4dd09-321c-4a52-8da8-524e9b5e57c4 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 404 len: 111 microversion: 2.1 time: 0.149569 Jul 20 04:34:13.334266 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2623/5165] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:13 2022] DELETE /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:13.336223 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-be3b70ed-52e1-41cd-943d-5bb7b9b399b6 req-d8b05ed8-76bf-4412-a48a-5bf4440b2245 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116296 Jul 20 04:34:13.346086 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2543/5166] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:13.352505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6a04ad58-0ccb-402a-8f6e-71b440f0d311 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:13.353059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6a04ad58-0ccb-402a-8f6e-71b440f0d311 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.364291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a04ad58-0ccb-402a-8f6e-71b440f0d311 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.364638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a04ad58-0ccb-402a-8f6e-71b440f0d311 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.366117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a04ad58-0ccb-402a-8f6e-71b440f0d311 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.366567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6a04ad58-0ccb-402a-8f6e-71b440f0d311 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.369422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08837634-982b-4226-9549-c13b99057d40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:13.371500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-08837634-982b-4226-9549-c13b99057d40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 54bc8d51-b9c3-441b-8160-c27334808041] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.395803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08837634-982b-4226-9549-c13b99057d40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.396355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08837634-982b-4226-9549-c13b99057d40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.397211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08837634-982b-4226-9549-c13b99057d40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.397663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08837634-982b-4226-9549-c13b99057d40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.425606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-6a04ad58-0ccb-402a-8f6e-71b440f0d311 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lazy-loading 'flavor' on Instance uuid a2f3226f-82c7-4e50-9a7d-ca0721979912 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:34:13.429831 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-08837634-982b-4226-9549-c13b99057d40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08837634-982b-4226-9549-c13b99057d40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 HTTP/1.1 Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '54bc8d51-b9c3-441b-8160-c27334808041'} Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.441612 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.445975 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.445975 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.445975 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:13.445975 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:13.445975 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. Jul 20 04:34:13.445975 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.445975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08837634-982b-4226-9549-c13b99057d40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 54bc8d51-b9c3-441b-8160-c27334808041 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:13.445975 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-08837634-982b-4226-9549-c13b99057d40 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041" status: 404 len: 111 microversion: 2.1 time: 0.095641 Jul 20 04:34:13.452157 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2544/5167] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:13 2022] GET /compute/v2.1/servers/54bc8d51-b9c3-441b-8160-c27334808041 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:13.457400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f54f530e-6dca-4a2d-ae62-d848d616c0ed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:13.465918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f54f530e-6dca-4a2d-ae62-d848d616c0ed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.476347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f54f530e-6dca-4a2d-ae62-d848d616c0ed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.476992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f54f530e-6dca-4a2d-ae62-d848d616c0ed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.477953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f54f530e-6dca-4a2d-ae62-d848d616c0ed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.479728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f54f530e-6dca-4a2d-ae62-d848d616c0ed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.533184 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f54f530e-6dca-4a2d-ae62-d848d616c0ed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f54f530e-6dca-4a2d-ae62-d848d616c0ed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 HTTP/1.1 Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'f0b6a337-9b96-4c0a-8858-5c456313b327'} Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:13.535071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:34:13.540180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.540180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.540180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.540180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.540180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.540180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.540180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:13.540180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:13.540180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:34:13.540180 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.540180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f54f530e-6dca-4a2d-ae62-d848d616c0ed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:13.546259 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f54f530e-6dca-4a2d-ae62-d848d616c0ed tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 404 len: 111 microversion: 2.1 time: 0.082754 Jul 20 04:34:13.546935 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2545/5168] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:13 2022] DELETE /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:13.558241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d78897a2-fb07-4958-b8ad-976c3b2fdbaf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:13.559119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d78897a2-fb07-4958-b8ad-976c3b2fdbaf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.579474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d78897a2-fb07-4958-b8ad-976c3b2fdbaf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.580522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d78897a2-fb07-4958-b8ad-976c3b2fdbaf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.581592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d78897a2-fb07-4958-b8ad-976c3b2fdbaf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.582188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d78897a2-fb07-4958-b8ad-976c3b2fdbaf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.608048 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6a04ad58-0ccb-402a-8f6e-71b440f0d311 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 202 len: 0 microversion: 2.1 time: 0.269403 Jul 20 04:34:13.609084 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2624/5169] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:13 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:13.612955 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-d78897a2-fb07-4958-b8ad-976c3b2fdbaf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] HTTP exception thrown: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:34:13.616413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02e3c2df-10fd-40fc-95ca-e9b751f6e0cc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:13.617127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-02e3c2df-10fd-40fc-95ca-e9b751f6e0cc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: f0b6a337-9b96-4c0a-8858-5c456313b327] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d78897a2-fb07-4958-b8ad-976c3b2fdbaf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Request method failure captured: Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b HTTP/1.1 Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14R3puuTTj9BR9KHmkf0rGkPrttHRryRpT_aOmyRo5bE3o7ATD4JHUdBRTubOepRLN_YW7n2LdnKzJs79jXkPow5-CgW-I3h14ueSEk5yRIlalTSKWxFdOa0fXL1A3e94InH3R5mHg3suPCswxTYut9FysTiu35GHLnEDmpMpoOfbq4 Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: b57ef1075ca8492c829c3814ef2aa111 Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b57ef1075ca8492c829c3814ef2aa111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b57ef1075ca8492c829c3814ef2aa111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b57ef1075ca8492c829c3814ef2aa111", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b57ef1075ca8492c829c3814ef2aa111"}]}] Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: b57ef1075ca8492c829c3814ef2aa111 Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeTestJSON-129024044-project Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: d3153bab9eac4da0b257c291da3767ef Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeTestJSON-129024044-project Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'bd8d5de4-7985-4933-8867-3352bf84a16b'} Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.621910 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.627328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.627328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.627328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.627328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:13.627328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:13.627328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:34:13.627328 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.627328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d78897a2-fb07-4958-b8ad-976c3b2fdbaf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Returning 404 to user: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:13.627328 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d78897a2-fb07-4958-b8ad-976c3b2fdbaf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 404 len: 111 microversion: 2.1 time: 0.076424 Jul 20 04:34:13.627328 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2546/5170] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:13 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:13.633585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02e3c2df-10fd-40fc-95ca-e9b751f6e0cc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.634067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02e3c2df-10fd-40fc-95ca-e9b751f6e0cc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.634848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02e3c2df-10fd-40fc-95ca-e9b751f6e0cc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.635289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02e3c2df-10fd-40fc-95ca-e9b751f6e0cc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.637524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86c41ef3-d3f6-45cf-a7d5-15ee8d3f3418 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:13.638258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-86c41ef3-d3f6-45cf-a7d5-15ee8d3f3418 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.658558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86c41ef3-d3f6-45cf-a7d5-15ee8d3f3418 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.658932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86c41ef3-d3f6-45cf-a7d5-15ee8d3f3418 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.659764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86c41ef3-d3f6-45cf-a7d5-15ee8d3f3418 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.660212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86c41ef3-d3f6-45cf-a7d5-15ee8d3f3418 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.675804 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-02e3c2df-10fd-40fc-95ca-e9b751f6e0cc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02e3c2df-10fd-40fc-95ca-e9b751f6e0cc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 HTTP/1.1 Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'f0b6a337-9b96-4c0a-8858-5c456313b327'} Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.677578 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.681683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.681683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.681683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:13.681683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:13.681683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. Jul 20 04:34:13.681683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.681683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02e3c2df-10fd-40fc-95ca-e9b751f6e0cc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance f0b6a337-9b96-4c0a-8858-5c456313b327 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:13.681683 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-02e3c2df-10fd-40fc-95ca-e9b751f6e0cc tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327" status: 404 len: 111 microversion: 2.1 time: 0.068718 Jul 20 04:34:13.681683 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2625/5171] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:13 2022] GET /compute/v2.1/servers/f0b6a337-9b96-4c0a-8858-5c456313b327 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:13.687996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e27ce5cb-3540-44e7-bb99-af0c1c8b7516 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '.version_select at 0x7fbf9c85a790>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:13.754320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:13.772573 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e27ce5cb-3540-44e7-bb99-af0c1c8b7516 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-133672360" status: 202 len: 0 microversion: 2.1 time: 0.091841 Jul 20 04:34:13.780138 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2626/5172] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 20 04:34:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-133672360 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:13.787228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2f229c5-f461-42a9-b1c3-53208052edd5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:13.788599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c2f229c5-f461-42a9-b1c3-53208052edd5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.798307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2f229c5-f461-42a9-b1c3-53208052edd5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.799130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2f229c5-f461-42a9-b1c3-53208052edd5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.800914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2f229c5-f461-42a9-b1c3-53208052edd5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.825124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2f229c5-f461-42a9-b1c3-53208052edd5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.867296 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-c2f229c5-f461-42a9-b1c3-53208052edd5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2f229c5-f461-42a9-b1c3-53208052edd5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b HTTP/1.1 Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '8167df7a-d77a-4e1e-ab7b-c7d2668bd76b'} Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:13.871181 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:34:13.875770 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.875770 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.875770 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.875770 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.875770 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.875770 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.875770 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:13.875770 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:13.875770 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:34:13.875770 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.881596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2f229c5-f461-42a9-b1c3-53208052edd5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:13.885687 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c2f229c5-f461-42a9-b1c3-53208052edd5 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 404 len: 111 microversion: 2.1 time: 0.103030 Jul 20 04:34:13.886943 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2627/5173] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:13 2022] DELETE /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:13.901589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-039ce96f-3333-4df4-996b-4e911c2b9e4e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:13.902631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-039ce96f-3333-4df4-996b-4e911c2b9e4e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.911367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-039ce96f-3333-4df4-996b-4e911c2b9e4e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.912214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-039ce96f-3333-4df4-996b-4e911c2b9e4e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.913297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-039ce96f-3333-4df4-996b-4e911c2b9e4e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.914000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-039ce96f-3333-4df4-996b-4e911c2b9e4e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.947877 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-039ce96f-3333-4df4-996b-4e911c2b9e4e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-039ce96f-3333-4df4-996b-4e911c2b9e4e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b HTTP/1.1 Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '8167df7a-d77a-4e1e-ab7b-c7d2668bd76b'} Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.950030 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.954426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.954426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.954426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:13.954426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:13.954426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. Jul 20 04:34:13.954426 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.969287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-039ce96f-3333-4df4-996b-4e911c2b9e4e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 8167df7a-d77a-4e1e-ab7b-c7d2668bd76b could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:13.970582 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-039ce96f-3333-4df4-996b-4e911c2b9e4e tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b" status: 404 len: 111 microversion: 2.1 time: 0.079008 Jul 20 04:34:13.975042 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2628/5174] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:13 2022] GET /compute/v2.1/servers/8167df7a-d77a-4e1e-ab7b-c7d2668bd76b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:13.980746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5c1780f2-3633-47e2-aa35-d70771276906 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:13.981575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5c1780f2-3633-47e2-aa35-d70771276906 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.993131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c1780f2-3633-47e2-aa35-d70771276906 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.993903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c1780f2-3633-47e2-aa35-d70771276906 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.994920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c1780f2-3633-47e2-aa35-d70771276906 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.995687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5c1780f2-3633-47e2-aa35-d70771276906 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.016040 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-5c1780f2-3633-47e2-aa35-d70771276906 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:34:14.017456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-86c41ef3-d3f6-45cf-a7d5-15ee8d3f3418 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5c1780f2-3633-47e2-aa35-d70771276906 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e HTTP/1.1 Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'cb4805c1-47be-4944-b197-e890bf0e274e'} Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:14.018539 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:34:14.024207 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.024207 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.024207 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.024207 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.024207 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.024207 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.024207 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:14.024207 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:14.024207 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:34:14.024207 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.027020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5c1780f2-3633-47e2-aa35-d70771276906 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:14.028158 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-86c41ef3-d3f6-45cf-a7d5-15ee8d3f3418 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1514 microversion: 2.1 time: 0.400848 Jul 20 04:34:14.028811 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5c1780f2-3633-47e2-aa35-d70771276906 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 404 len: 111 microversion: 2.1 time: 0.052009 Jul 20 04:34:14.034468 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2629/5175] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:13 2022] DELETE /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:14.040716 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2547/5176] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:13 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1514 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:14.050024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e1fd279c-c008-4745-a483-ed5efe9a9af7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:14.051129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e1fd279c-c008-4745-a483-ed5efe9a9af7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: cb4805c1-47be-4944-b197-e890bf0e274e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.057950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1fd279c-c008-4745-a483-ed5efe9a9af7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.058498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1fd279c-c008-4745-a483-ed5efe9a9af7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.059380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1fd279c-c008-4745-a483-ed5efe9a9af7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.060473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1fd279c-c008-4745-a483-ed5efe9a9af7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.078639 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-e1fd279c-c008-4745-a483-ed5efe9a9af7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e1fd279c-c008-4745-a483-ed5efe9a9af7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e HTTP/1.1 Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'cb4805c1-47be-4944-b197-e890bf0e274e'} Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.080381 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.084556 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.084556 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.084556 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:14.084556 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:14.084556 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. Jul 20 04:34:14.084556 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.084556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e1fd279c-c008-4745-a483-ed5efe9a9af7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance cb4805c1-47be-4944-b197-e890bf0e274e could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:14.084556 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e1fd279c-c008-4745-a483-ed5efe9a9af7 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e" status: 404 len: 111 microversion: 2.1 time: 0.045907 Jul 20 04:34:14.086194 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2630/5177] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:14 2022] GET /compute/v2.1/servers/cb4805c1-47be-4944-b197-e890bf0e274e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:14.095231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-34a856cd-7676-4dac-9f72-3a3398025388 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:14.095970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-34a856cd-7676-4dac-9f72-3a3398025388 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.112744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34a856cd-7676-4dac-9f72-3a3398025388 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.113569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34a856cd-7676-4dac-9f72-3a3398025388 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.114645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34a856cd-7676-4dac-9f72-3a3398025388 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.115316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34a856cd-7676-4dac-9f72-3a3398025388 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.140432 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-34a856cd-7676-4dac-9f72-3a3398025388 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-34a856cd-7676-4dac-9f72-3a3398025388 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e HTTP/1.1 Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '6dcf7980-51fd-4f6c-9d31-833631d4419e'} Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:14.143823 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:34:14.149498 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.149498 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.149498 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.149498 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.149498 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.149498 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.149498 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:14.149498 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:14.149498 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:34:14.149498 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.152613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-34a856cd-7676-4dac-9f72-3a3398025388 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:14.154851 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-34a856cd-7676-4dac-9f72-3a3398025388 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 404 len: 111 microversion: 2.1 time: 0.063599 Jul 20 04:34:14.156033 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2548/5178] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:14 2022] DELETE /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:14.165447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b4db324b-01ff-4650-bff7-3af9237b3290 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:14.165988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b4db324b-01ff-4650-bff7-3af9237b3290 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 6dcf7980-51fd-4f6c-9d31-833631d4419e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.172284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4db324b-01ff-4650-bff7-3af9237b3290 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.172959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4db324b-01ff-4650-bff7-3af9237b3290 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.173900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4db324b-01ff-4650-bff7-3af9237b3290 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.174494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4db324b-01ff-4650-bff7-3af9237b3290 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.192246 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-b4db324b-01ff-4650-bff7-3af9237b3290 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b4db324b-01ff-4650-bff7-3af9237b3290 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e HTTP/1.1 Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '6dcf7980-51fd-4f6c-9d31-833631d4419e'} Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.194281 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.198708 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.198708 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.198708 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:14.198708 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:14.198708 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. Jul 20 04:34:14.198708 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.206010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ede6b9b-4816-4ef2-a644-967540977a6e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:14.206879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ede6b9b-4816-4ef2-a644-967540977a6e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.210624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b4db324b-01ff-4650-bff7-3af9237b3290 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 6dcf7980-51fd-4f6c-9d31-833631d4419e could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:14.211530 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b4db324b-01ff-4650-bff7-3af9237b3290 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e" status: 404 len: 111 microversion: 2.1 time: 0.050817 Jul 20 04:34:14.214177 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2631/5179] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:14 2022] GET /compute/v2.1/servers/6dcf7980-51fd-4f6c-9d31-833631d4419e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:14.218700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ede6b9b-4816-4ef2-a644-967540977a6e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.219148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ede6b9b-4816-4ef2-a644-967540977a6e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.224646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4ae0f278-d0a4-432f-9c5c-de45f4e09155 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:14.225155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4ae0f278-d0a4-432f-9c5c-de45f4e09155 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.227324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ede6b9b-4816-4ef2-a644-967540977a6e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.227847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ede6b9b-4816-4ef2-a644-967540977a6e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.249888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ae0f278-d0a4-432f-9c5c-de45f4e09155 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.250961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ae0f278-d0a4-432f-9c5c-de45f4e09155 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.252235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ae0f278-d0a4-432f-9c5c-de45f4e09155 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.253335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ae0f278-d0a4-432f-9c5c-de45f4e09155 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.285349 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-4ae0f278-d0a4-432f-9c5c-de45f4e09155 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4ae0f278-d0a4-432f-9c5c-de45f4e09155 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e HTTP/1.1 Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e'} Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:14.287348 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:34:14.294144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.294144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.294144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.294144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.294144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.294144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.294144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:14.294144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:14.294144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:34:14.294144 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.299992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4ae0f278-d0a4-432f-9c5c-de45f4e09155 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:14.299992 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4ae0f278-d0a4-432f-9c5c-de45f4e09155 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 404 len: 111 microversion: 2.1 time: 0.075947 Jul 20 04:34:14.301007 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2632/5180] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:14 2022] DELETE /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:14.305924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-578f12be-a229-4499-adbd-2fea8a967b0c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:14.306833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-578f12be-a229-4499-adbd-2fea8a967b0c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.314146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-578f12be-a229-4499-adbd-2fea8a967b0c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.314912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-578f12be-a229-4499-adbd-2fea8a967b0c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.315979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-578f12be-a229-4499-adbd-2fea8a967b0c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.316651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-578f12be-a229-4499-adbd-2fea8a967b0c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.333106 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-578f12be-a229-4499-adbd-2fea8a967b0c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-578f12be-a229-4499-adbd-2fea8a967b0c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e HTTP/1.1 Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e'} Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.340520 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:14.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:14.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. Jul 20 04:34:14.348860 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.348860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-578f12be-a229-4499-adbd-2fea8a967b0c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:14.350744 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-578f12be-a229-4499-adbd-2fea8a967b0c tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e" status: 404 len: 111 microversion: 2.1 time: 0.048483 Jul 20 04:34:14.358626 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2633/5181] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:14 2022] GET /compute/v2.1/servers/3d3f1cfb-8d75-4eb6-9cc6-d45d1af4b37e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:14.369101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bfefda57-e713-4cf5-a0bc-b74c149edf55 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:14.369657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bfefda57-e713-4cf5-a0bc-b74c149edf55 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 49ab8313-40ac-443f-b9e8-be2cec2b3469] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.392158 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-bfefda57-e713-4cf5-a0bc-b74c149edf55 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bfefda57-e713-4cf5-a0bc-b74c149edf55 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/49ab8313-40ac-443f-b9e8-be2cec2b3469 HTTP/1.1 Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '49ab8313-40ac-443f-b9e8-be2cec2b3469'} Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.395950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.403883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.403883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.403883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.403883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:14.403883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:14.403883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:34:14.403883 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.403883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bfefda57-e713-4cf5-a0bc-b74c149edf55 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:14.403883 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bfefda57-e713-4cf5-a0bc-b74c149edf55 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49ab8313-40ac-443f-b9e8-be2cec2b3469" status: 404 len: 111 microversion: 2.1 time: 0.034956 Jul 20 04:34:14.403883 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2634/5182] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:14 2022] DELETE /compute/v2.1/servers/49ab8313-40ac-443f-b9e8-be2cec2b3469 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:14.418680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5bfe8edc-10bd-4da0-a349-4b1af04d6930 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:14.422411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5bfe8edc-10bd-4da0-a349-4b1af04d6930 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 49ab8313-40ac-443f-b9e8-be2cec2b3469] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.448126 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-5bfe8edc-10bd-4da0-a349-4b1af04d6930 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5bfe8edc-10bd-4da0-a349-4b1af04d6930 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/49ab8313-40ac-443f-b9e8-be2cec2b3469 HTTP/1.1 Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '49ab8313-40ac-443f-b9e8-be2cec2b3469'} Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:14.453231 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:14.458312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:14.458312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:14.458312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. Jul 20 04:34:14.458312 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:14.458312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5bfe8edc-10bd-4da0-a349-4b1af04d6930 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 49ab8313-40ac-443f-b9e8-be2cec2b3469 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:14.460110 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5bfe8edc-10bd-4da0-a349-4b1af04d6930 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/49ab8313-40ac-443f-b9e8-be2cec2b3469" status: 404 len: 111 microversion: 2.1 time: 0.052757 Jul 20 04:34:14.463129 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2635/5183] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:14 2022] GET /compute/v2.1/servers/49ab8313-40ac-443f-b9e8-be2cec2b3469 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:14.486034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c1923ccf-c9cd-48af-a522-fd1fd852ddc9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:14.486034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c1923ccf-c9cd-48af-a522-fd1fd852ddc9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.521020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1923ccf-c9cd-48af-a522-fd1fd852ddc9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.521477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1923ccf-c9cd-48af-a522-fd1fd852ddc9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.522282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1923ccf-c9cd-48af-a522-fd1fd852ddc9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.522722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1923ccf-c9cd-48af-a522-fd1fd852ddc9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.589087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1ede6b9b-4816-4ef2-a644-967540977a6e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:14.601033 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ede6b9b-4816-4ef2-a644-967540977a6e tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.400085 Jul 20 04:34:14.601245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c1923ccf-c9cd-48af-a522-fd1fd852ddc9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:34:14.616724 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2549/5184] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:14 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:14.800160 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c1923ccf-c9cd-48af-a522-fd1fd852ddc9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 204 len: 0 microversion: 2.1 time: 0.331666 Jul 20 04:34:14.801231 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2636/5185] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:14 2022] DELETE /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:34:14.823399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0002aaca-a8f0-4606-8e27-e18f3ae581d1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:14.824226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0002aaca-a8f0-4606-8e27-e18f3ae581d1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.843165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0002aaca-a8f0-4606-8e27-e18f3ae581d1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.846018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0002aaca-a8f0-4606-8e27-e18f3ae581d1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.852297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0002aaca-a8f0-4606-8e27-e18f3ae581d1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.853162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0002aaca-a8f0-4606-8e27-e18f3ae581d1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:15.049176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-115eea78-b9bf-4ee9-b102-e4250015d79c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:15.050211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-115eea78-b9bf-4ee9-b102-e4250015d79c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:15.086974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-115eea78-b9bf-4ee9-b102-e4250015d79c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:15.087797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-115eea78-b9bf-4ee9-b102-e4250015d79c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:15.088774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-115eea78-b9bf-4ee9-b102-e4250015d79c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:15.103777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-115eea78-b9bf-4ee9-b102-e4250015d79c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:15.852683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0002aaca-a8f0-4606-8e27-e18f3ae581d1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:15.865230 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0002aaca-a8f0-4606-8e27-e18f3ae581d1 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1478 microversion: 2.1 time: 1.057504 Jul 20 04:34:15.875831 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2550/5186] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:14 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1478 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:15.939179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-115eea78-b9bf-4ee9-b102-e4250015d79c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:15.950662 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-115eea78-b9bf-4ee9-b102-e4250015d79c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1514 microversion: 2.1 time: 0.904269 Jul 20 04:34:15.960874 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2637/5187] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:15 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1514 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:16.463143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1f6a577d-1d62-4b50-acb8-95810aebb594 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:16.463816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1f6a577d-1d62-4b50-acb8-95810aebb594 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:16.478505 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f6a577d-1d62-4b50-acb8-95810aebb594 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:16.479194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f6a577d-1d62-4b50-acb8-95810aebb594 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:16.480942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f6a577d-1d62-4b50-acb8-95810aebb594 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:16.482502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f6a577d-1d62-4b50-acb8-95810aebb594 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:16.561409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88f143dd-653f-4842-b7b0-6e03287cc2fc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Action: 'create', calling method: .version_select at 0x7fbf9c7fe3a0>, body: {"keypair": {"name": "tempest-keypair-321486889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSUohoK8YP7N6VzF2X0C1DjuImABbj33mh5uYIcpc6wPbuW895GXNTFfq9O/RQ8II+GMV/WUZ7fJG1B+hO1AsK+bgShYLagJJ0NE6UOtatmC/d0gUEdm6j6NVX2hHT2/w=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:16.611265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-88f143dd-653f-4842-b7b0-6e03287cc2fc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Getting quotas for project b57ef1075ca8492c829c3814ef2aa111. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:16.625748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-88f143dd-653f-4842-b7b0-6e03287cc2fc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Getting quotas for user d3153bab9eac4da0b257c291da3767ef and project b57ef1075ca8492c829c3814ef2aa111. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:16.699448 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88f143dd-653f-4842-b7b0-6e03287cc2fc tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142311 Jul 20 04:34:16.711098 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2638/5188] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:34:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:34:16.884164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2a4b09e1-c99a-4405-a070-bdd46a943848 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:16.884791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2a4b09e1-c99a-4405-a070-bdd46a943848 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:16.922576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2a4b09e1-c99a-4405-a070-bdd46a943848 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:16.940881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2a4b09e1-c99a-4405-a070-bdd46a943848 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:16.952457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2a4b09e1-c99a-4405-a070-bdd46a943848 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:16.953109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2a4b09e1-c99a-4405-a070-bdd46a943848 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:17.465492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1f6a577d-1d62-4b50-acb8-95810aebb594 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:17.490852 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1f6a577d-1d62-4b50-acb8-95810aebb594 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 1.621578 Jul 20 04:34:17.491474 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2551/5189] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:15 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:17.499358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2a4b09e1-c99a-4405-a070-bdd46a943848 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:17.504349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5e2dcf03-8b5f-4470-91eb-9090234fa616 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:17.513600 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2a4b09e1-c99a-4405-a070-bdd46a943848 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1478 microversion: 2.1 time: 0.633214 Jul 20 04:34:17.525275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5e2dcf03-8b5f-4470-91eb-9090234fa616 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:17.528633 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2639/5190] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:16 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1478 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:17.531784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e2dcf03-8b5f-4470-91eb-9090234fa616 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:17.532255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e2dcf03-8b5f-4470-91eb-9090234fa616 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:17.533061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e2dcf03-8b5f-4470-91eb-9090234fa616 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:17.533509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e2dcf03-8b5f-4470-91eb-9090234fa616 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.321690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5e2dcf03-8b5f-4470-91eb-9090234fa616 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:18.348199 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5e2dcf03-8b5f-4470-91eb-9090234fa616 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1497 microversion: 2.1 time: 0.847103 Jul 20 04:34:18.374238 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2552/5191] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:17 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1497 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:18.390248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4f95e4d8-3fb6-4e47-8362-721829b10eec tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:18.390824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4f95e4d8-3fb6-4e47-8362-721829b10eec tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:18.406462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f95e4d8-3fb6-4e47-8362-721829b10eec tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.407151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f95e4d8-3fb6-4e47-8362-721829b10eec tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.408045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f95e4d8-3fb6-4e47-8362-721829b10eec tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.408499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f95e4d8-3fb6-4e47-8362-721829b10eec tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.465426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-4f95e4d8-3fb6-4e47-8362-721829b10eec tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lazy-loading 'flavor' on Instance uuid a2f3226f-82c7-4e50-9a7d-ca0721979912 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:34:18.495832 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-4f95e4d8-3fb6-4e47-8362-721829b10eec tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Cannot 'suspend' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state suspended Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4f95e4d8-3fb6-4e47-8362-721829b10eec tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action HTTP/1.1 Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 15 Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: {"suspend": {}} Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: exception: Cannot 'suspend' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state suspended Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a2f3226f-82c7-4e50-9a7d-ca0721979912', 'body': {'suspend': {}}} Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 20 04:34:18.498481 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state suspended Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state suspended Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4f95e4d8-3fb6-4e47-8362-721829b10eec tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 409 to user: Cannot 'suspend' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state suspended {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4f95e4d8-3fb6-4e47-8362-721829b10eec tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 409 len: 148 microversion: 2.1 time: 0.115480 Jul 20 04:34:18.502626 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2640/5192] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:18 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 148 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:34:18.509878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-371821aa-925d-41ad-941f-cbf4de9ceb28 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:18.510585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-371821aa-925d-41ad-941f-cbf4de9ceb28 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:18.519397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-371821aa-925d-41ad-941f-cbf4de9ceb28 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.523577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67e0b70b-cce0-4a09-acf7-9335a644bd79 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:18.524472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-371821aa-925d-41ad-941f-cbf4de9ceb28 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.525520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-371821aa-925d-41ad-941f-cbf4de9ceb28 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.527752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-371821aa-925d-41ad-941f-cbf4de9ceb28 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.534585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67e0b70b-cce0-4a09-acf7-9335a644bd79 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:18.543107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67e0b70b-cce0-4a09-acf7-9335a644bd79 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.548230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67e0b70b-cce0-4a09-acf7-9335a644bd79 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.549393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67e0b70b-cce0-4a09-acf7-9335a644bd79 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.550046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67e0b70b-cce0-4a09-acf7-9335a644bd79 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.657080 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67e0b70b-cce0-4a09-acf7-9335a644bd79 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 202 len: 0 microversion: 2.1 time: 0.138849 Jul 20 04:34:18.663081 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2641/5193] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:18 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:18.680004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e00c3067-d4a4-40d0-af67-3719d5ee5eb9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:18.681209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e00c3067-d4a4-40d0-af67-3719d5ee5eb9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:18.692113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e00c3067-d4a4-40d0-af67-3719d5ee5eb9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.692915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e00c3067-d4a4-40d0-af67-3719d5ee5eb9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.694103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e00c3067-d4a4-40d0-af67-3719d5ee5eb9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.695939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e00c3067-d4a4-40d0-af67-3719d5ee5eb9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.857867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e00c3067-d4a4-40d0-af67-3719d5ee5eb9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38b1e323c5490fbb4c0023034874c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abea957d3266410c8c9dab8b52a7c170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:18.865833 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e00c3067-d4a4-40d0-af67-3719d5ee5eb9 tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 200 len: 1436 microversion: 2.1 time: 0.200884 Jul 20 04:34:18.866430 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2642/5194] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:18 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 1436 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:18.877553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-af296305-6681-49ba-a754-9b011ab7c6a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:18.881019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-af296305-6681-49ba-a754-9b011ab7c6a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:18.894463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af296305-6681-49ba-a754-9b011ab7c6a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.894957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af296305-6681-49ba-a754-9b011ab7c6a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.898933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af296305-6681-49ba-a754-9b011ab7c6a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.899394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af296305-6681-49ba-a754-9b011ab7c6a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:19.064197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-371821aa-925d-41ad-941f-cbf4de9ceb28 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:19.075249 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-371821aa-925d-41ad-941f-cbf4de9ceb28 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 0.568892 Jul 20 04:34:19.111951 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2553/5195] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:18 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:19.134892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8140ac58-2ea1-441a-be25-d23c57b27f41 req-d7e7459f-c6cd-4a03-8af1-cd1ea56ac158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b20769a-b7f7-42e9-a508-0a69841e33c5", "name": "network-vif-deleted", "tag": "c279d121-fd2b-4719-a1ea-6cc519800111"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:19.168850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8140ac58-2ea1-441a-be25-d23c57b27f41 req-d7e7459f-c6cd-4a03-8af1-cd1ea56ac158 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:19.169903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8140ac58-2ea1-441a-be25-d23c57b27f41 req-d7e7459f-c6cd-4a03-8af1-cd1ea56ac158 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:19.193837 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8140ac58-2ea1-441a-be25-d23c57b27f41 req-d7e7459f-c6cd-4a03-8af1-cd1ea56ac158 service nova] Creating event network-vif-deleted:c279d121-fd2b-4719-a1ea-6cc519800111 for instance 8b20769a-b7f7-42e9-a508-0a69841e33c5 on n-h2-764485-11 Jul 20 04:34:19.204022 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8140ac58-2ea1-441a-be25-d23c57b27f41 req-d7e7459f-c6cd-4a03-8af1-cd1ea56ac158 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089766 Jul 20 04:34:19.205578 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2554/5196] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:19.356399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af296305-6681-49ba-a754-9b011ab7c6a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:19.361832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:19.380516 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-af296305-6681-49ba-a754-9b011ab7c6a2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1503 microversion: 2.1 time: 0.508754 Jul 20 04:34:19.391466 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2643/5197] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:18 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1503 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:19.889144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a0b63cf4-5835-49bc-945c-116c6ab502ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:19.891224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a0b63cf4-5835-49bc-945c-116c6ab502ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] [instance: 8b20769a-b7f7-42e9-a508-0a69841e33c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:19.904385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0b63cf4-5835-49bc-945c-116c6ab502ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:19.905404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0b63cf4-5835-49bc-945c-116c6ab502ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:19.907169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0b63cf4-5835-49bc-945c-116c6ab502ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:19.907651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0b63cf4-5835-49bc-945c-116c6ab502ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:19.926036 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a0b63cf4-5835-49bc-945c-116c6ab502ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] HTTP exception thrown: Instance 8b20769a-b7f7-42e9-a508-0a69841e33c5 could not be found. Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a0b63cf4-5835-49bc-945c-116c6ab502ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Request method failure captured: Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 HTTP/1.1 Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14S7X4Unm_jt2qfSTwAcQ6yWtgVIDznuFpYSajiv0uhLUofstgPbV2YXxJpFYF_y4GfOQa95R8ZOM_Meb59v6sUjW2OpVKNm0DpbDCpEgnlqLO5FZ7t1XqMfr4SasGuJf6Kpq7orVOhITpXPrEb6i7fvFNyGiZxbJUId3Akm8j5DXTI Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abea957d3266410c8c9dab8b52a7c170", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abea957d3266410c8c9dab8b52a7c170"}]}] Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersTestJSON-1719694346 Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: abea957d3266410c8c9dab8b52a7c170 Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersTestJSON-1719694346 Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 7d38b1e323c5490fbb4c0023034874c8 Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersTestJSON-1719694346-project Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 8b20769a-b7f7-42e9-a508-0a69841e33c5 could not be found. Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '8b20769a-b7f7-42e9-a508-0a69841e33c5'} Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b20769a-b7f7-42e9-a508-0a69841e33c5 could not be found. Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b20769a-b7f7-42e9-a508-0a69841e33c5 could not be found. Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:19.928465 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:19.933657 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:19.933657 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:19.933657 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:19.933657 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:19.933657 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b20769a-b7f7-42e9-a508-0a69841e33c5 could not be found. Jul 20 04:34:19.933657 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:19.935304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a0b63cf4-5835-49bc-945c-116c6ab502ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] Returning 404 to user: Instance 8b20769a-b7f7-42e9-a508-0a69841e33c5 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:19.936652 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a0b63cf4-5835-49bc-945c-116c6ab502ef tempest-ServersTestJSON-1719694346 tempest-ServersTestJSON-1719694346-project] 10.222.0.20 "GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5" status: 404 len: 111 microversion: 2.1 time: 0.056752 Jul 20 04:34:19.937443 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2555/5198] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:19 2022] GET /compute/v2.1/servers/8b20769a-b7f7-42e9-a508-0a69841e33c5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:20.105976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-665f8ef4-afa3-4d88-96a0-cb3cdf4f4811 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:20.107663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-665f8ef4-afa3-4d88-96a0-cb3cdf4f4811 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:20.126638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-665f8ef4-afa3-4d88-96a0-cb3cdf4f4811 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:20.137338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-665f8ef4-afa3-4d88-96a0-cb3cdf4f4811 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:20.139500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-665f8ef4-afa3-4d88-96a0-cb3cdf4f4811 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:20.140234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-665f8ef4-afa3-4d88-96a0-cb3cdf4f4811 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:20.398293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-881c963e-7bbf-45b8-85d7-6eca95c51271 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:20.399197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-881c963e-7bbf-45b8-85d7-6eca95c51271 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:20.415289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-881c963e-7bbf-45b8-85d7-6eca95c51271 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:20.415777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-881c963e-7bbf-45b8-85d7-6eca95c51271 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:20.416583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-881c963e-7bbf-45b8-85d7-6eca95c51271 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:20.417031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-881c963e-7bbf-45b8-85d7-6eca95c51271 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:20.618094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-665f8ef4-afa3-4d88-96a0-cb3cdf4f4811 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:20.648530 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-665f8ef4-afa3-4d88-96a0-cb3cdf4f4811 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1505 microversion: 2.1 time: 0.546235 Jul 20 04:34:20.649524 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2644/5199] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:20 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:21.002239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-881c963e-7bbf-45b8-85d7-6eca95c51271 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:21.013755 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-881c963e-7bbf-45b8-85d7-6eca95c51271 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1503 microversion: 2.1 time: 0.618542 Jul 20 04:34:21.017820 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2556/5200] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:20 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1503 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:21.437043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-476646769", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f20fd2cb-4f15-4aa3-b329-7ef6a1fa5321"}], "security_groups": [{"name": "tempest-securitygroup--1670605559"}], "key_name": "tempest-keypair-321486889", "user_data": "}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:21.669475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-31d8c28e-c0e2-4fd2-8082-73242102ecfd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:21.670304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-31d8c28e-c0e2-4fd2-8082-73242102ecfd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:21.681399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31d8c28e-c0e2-4fd2-8082-73242102ecfd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.681860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31d8c28e-c0e2-4fd2-8082-73242102ecfd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.682672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31d8c28e-c0e2-4fd2-8082-73242102ecfd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.683103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31d8c28e-c0e2-4fd2-8082-73242102ecfd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.760397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] validate_networks() for [('f20fd2cb-4f15-4aa3-b329-7ef6a1fa5321', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:22.210552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-31d8c28e-c0e2-4fd2-8082-73242102ecfd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:22.226527 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-31d8c28e-c0e2-4fd2-8082-73242102ecfd tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1505 microversion: 2.1 time: 0.563561 Jul 20 04:34:22.227663 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2557/5201] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:21 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:22.234615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2e77b37e-7465-4696-bc0e-0baf3f915953 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:22.235459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2e77b37e-7465-4696-bc0e-0baf3f915953 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:22.242446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e77b37e-7465-4696-bc0e-0baf3f915953 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:22.243659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e77b37e-7465-4696-bc0e-0baf3f915953 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:22.244624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e77b37e-7465-4696-bc0e-0baf3f915953 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:22.245236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e77b37e-7465-4696-bc0e-0baf3f915953 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:22.722749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2e77b37e-7465-4696-bc0e-0baf3f915953 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:22.733565 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2e77b37e-7465-4696-bc0e-0baf3f915953 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.504356 Jul 20 04:34:22.734488 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2558/5202] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:22 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:22.753129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b2b36191-2609-43f2-9855-9906676777c8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:22.753766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b2b36191-2609-43f2-9855-9906676777c8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:22.760020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2b36191-2609-43f2-9855-9906676777c8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:22.760702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2b36191-2609-43f2-9855-9906676777c8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:22.761658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2b36191-2609-43f2-9855-9906676777c8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:22.762285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2b36191-2609-43f2-9855-9906676777c8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.099678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:23.100696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:23.101337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:23.102547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:23.103394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:23.127194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.127940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.131466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.132248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.163374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Getting quotas for project b57ef1075ca8492c829c3814ef2aa111. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:23.176539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Getting quotas for user d3153bab9eac4da0b257c291da3767ef and project b57ef1075ca8492c829c3814ef2aa111. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:23.201585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:23.204797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:23.288224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b2b36191-2609-43f2-9855-9906676777c8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:23.291203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:23.310574 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b2b36191-2609-43f2-9855-9906676777c8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.550815 Jul 20 04:34:23.322373 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2559/5203] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:22 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:23.334820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a529a66d-46ef-49ad-a4ac-893ad80f4904 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:23.334820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a529a66d-46ef-49ad-a4ac-893ad80f4904 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:23.335060 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6dd872d4-8440-4ee7-b5ac-85603083be15 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.900105 Jul 20 04:34:23.339502 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2645/5204] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:34:23.348807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a529a66d-46ef-49ad-a4ac-893ad80f4904 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.349314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a529a66d-46ef-49ad-a4ac-893ad80f4904 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.352533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a529a66d-46ef-49ad-a4ac-893ad80f4904 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.353118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a529a66d-46ef-49ad-a4ac-893ad80f4904 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.354896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7e647556-7fce-4760-b592-e0508b8837b2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:23.356071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7e647556-7fce-4760-b592-e0508b8837b2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: e55e36e7-2238-4a2e-bda9-4b54a9fc5356] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:23.402994 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-7e647556-7fce-4760-b592-e0508b8837b2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance e55e36e7-2238-4a2e-bda9-4b54a9fc5356 could not be found. Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7e647556-7fce-4760-b592-e0508b8837b2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/e55e36e7-2238-4a2e-bda9-4b54a9fc5356/action HTTP/1.1 Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 15 Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: {"unpause": {}} Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance e55e36e7-2238-4a2e-bda9-4b54a9fc5356 could not be found. Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'e55e36e7-2238-4a2e-bda9-4b54a9fc5356', 'body': {'unpause': {}}} Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55e36e7-2238-4a2e-bda9-4b54a9fc5356 could not be found. Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55e36e7-2238-4a2e-bda9-4b54a9fc5356 could not be found. Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:23.407462 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:23.412037 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:23.412037 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:23.412037 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55e36e7-2238-4a2e-bda9-4b54a9fc5356 could not be found. Jul 20 04:34:23.412037 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:23.422761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7e647556-7fce-4760-b592-e0508b8837b2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance e55e36e7-2238-4a2e-bda9-4b54a9fc5356 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:23.424094 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7e647556-7fce-4760-b592-e0508b8837b2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/e55e36e7-2238-4a2e-bda9-4b54a9fc5356/action" status: 404 len: 111 microversion: 2.1 time: 0.083423 Jul 20 04:34:23.425093 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2646/5205] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:23 2022] POST /compute/v2.1/servers/e55e36e7-2238-4a2e-bda9-4b54a9fc5356/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:23.430061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3521a56e-ab79-44e8-a9f0-ce2c7a29d237 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:23.434106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3521a56e-ab79-44e8-a9f0-ce2c7a29d237 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:23.628549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3521a56e-ab79-44e8-a9f0-ce2c7a29d237 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:23.649778 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3521a56e-ab79-44e8-a9f0-ce2c7a29d237 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1236 microversion: 2.1 time: 0.223357 Jul 20 04:34:23.650352 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2647/5206] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:23 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1236 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:23.666416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-cbac9dc5-57a4-4b6e-905e-8d1c8e6a49f2 req-048f2aa8-00a1-42ac-b15f-0b9f7b0499c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce4bdd8-5b00-422f-9d57-bddb9ceac19f", "name": "network-vif-unplugged", "status": "completed", "tag": "ded1351f-4cec-44a9-9f29-b24a7ae27ae8"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:23.691737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cbac9dc5-57a4-4b6e-905e-8d1c8e6a49f2 req-048f2aa8-00a1-42ac-b15f-0b9f7b0499c1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.692184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cbac9dc5-57a4-4b6e-905e-8d1c8e6a49f2 req-048f2aa8-00a1-42ac-b15f-0b9f7b0499c1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.779531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.compute.server_external_events [req-cbac9dc5-57a4-4b6e-905e-8d1c8e6a49f2 req-048f2aa8-00a1-42ac-b15f-0b9f7b0499c1 service nova] Unable to find a host for instance fce4bdd8-5b00-422f-9d57-bddb9ceac19f. Dropping event network-vif-unplugged {{(pid=119808) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:34:23.780461 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-cbac9dc5-57a4-4b6e-905e-8d1c8e6a49f2 req-048f2aa8-00a1-42ac-b15f-0b9f7b0499c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.125571 Jul 20 04:34:23.781097 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2648/5207] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 130 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:34:23.796884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-952c17bb-3e1a-4087-bf5a-8867974af513 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:23.797755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-952c17bb-3e1a-4087-bf5a-8867974af513 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:23.813319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-952c17bb-3e1a-4087-bf5a-8867974af513 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.817280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-952c17bb-3e1a-4087-bf5a-8867974af513 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.824542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-952c17bb-3e1a-4087-bf5a-8867974af513 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.825086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-952c17bb-3e1a-4087-bf5a-8867974af513 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:24.524159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a529a66d-46ef-49ad-a4ac-893ad80f4904 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:24.540015 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a529a66d-46ef-49ad-a4ac-893ad80f4904 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 200 len: 1508 microversion: 2.1 time: 1.216355 Jul 20 04:34:24.540544 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2560/5208] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:23 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 1508 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:24.556983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-17fcb614-5d8d-4592-9edf-b6475c3a9a3d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:24.557880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-17fcb614-5d8d-4592-9edf-b6475c3a9a3d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:24.566922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-17fcb614-5d8d-4592-9edf-b6475c3a9a3d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:24.567668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-17fcb614-5d8d-4592-9edf-b6475c3a9a3d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:24.569062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-17fcb614-5d8d-4592-9edf-b6475c3a9a3d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:24.570351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-17fcb614-5d8d-4592-9edf-b6475c3a9a3d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:24.826068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-952c17bb-3e1a-4087-bf5a-8867974af513 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:24.837392 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-952c17bb-3e1a-4087-bf5a-8867974af513 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 1.053859 Jul 20 04:34:24.862984 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2649/5209] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:23 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:24.876075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-66d1bc2d-4e59-4cf7-a4bc-d5ed2e2f773b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:24.877383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-66d1bc2d-4e59-4cf7-a4bc-d5ed2e2f773b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:24.889421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66d1bc2d-4e59-4cf7-a4bc-d5ed2e2f773b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:24.895831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66d1bc2d-4e59-4cf7-a4bc-d5ed2e2f773b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:24.897021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66d1bc2d-4e59-4cf7-a4bc-d5ed2e2f773b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:24.899178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66d1bc2d-4e59-4cf7-a4bc-d5ed2e2f773b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.176892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-66d1bc2d-4e59-4cf7-a4bc-d5ed2e2f773b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:25.188369 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-66d1bc2d-4e59-4cf7-a4bc-d5ed2e2f773b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1296 microversion: 2.1 time: 0.322039 Jul 20 04:34:25.188983 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2650/5210] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:24 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1296 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:25.212565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c666d671-ae87-421f-b1e7-77ff61883fd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:25.213202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c666d671-ae87-421f-b1e7-77ff61883fd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:25.226560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c666d671-ae87-421f-b1e7-77ff61883fd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.227002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c666d671-ae87-421f-b1e7-77ff61883fd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.233663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c666d671-ae87-421f-b1e7-77ff61883fd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.234205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c666d671-ae87-421f-b1e7-77ff61883fd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.398807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-17fcb614-5d8d-4592-9edf-b6475c3a9a3d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:25.411334 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-17fcb614-5d8d-4592-9edf-b6475c3a9a3d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.858079 Jul 20 04:34:25.412518 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2561/5211] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:24 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:25.443926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a03e65e0-1c1c-43e1-b6d0-ff6ef5b15856 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:25.445565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a03e65e0-1c1c-43e1-b6d0-ff6ef5b15856 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:25.455579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a03e65e0-1c1c-43e1-b6d0-ff6ef5b15856 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.456522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a03e65e0-1c1c-43e1-b6d0-ff6ef5b15856 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.459216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a03e65e0-1c1c-43e1-b6d0-ff6ef5b15856 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.461208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a03e65e0-1c1c-43e1-b6d0-ff6ef5b15856 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.937203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c666d671-ae87-421f-b1e7-77ff61883fd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:25.957381 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c666d671-ae87-421f-b1e7-77ff61883fd8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.750268 Jul 20 04:34:25.958627 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2651/5212] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:25 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:25.978251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c64efa8-5cf1-429d-ad45-2cfab5cf4987 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:25.979316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0c64efa8-5cf1-429d-ad45-2cfab5cf4987 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:25.986216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c64efa8-5cf1-429d-ad45-2cfab5cf4987 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.987252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c64efa8-5cf1-429d-ad45-2cfab5cf4987 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.988284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c64efa8-5cf1-429d-ad45-2cfab5cf4987 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.989079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c64efa8-5cf1-429d-ad45-2cfab5cf4987 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.034310 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-0c64efa8-5cf1-429d-ad45-2cfab5cf4987 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Cannot 'unpause' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c64efa8-5cf1-429d-ad45-2cfab5cf4987 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action HTTP/1.1 Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 15 Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: {"unpause": {}} Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: exception: Cannot 'unpause' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a2f3226f-82c7-4e50-9a7d-ca0721979912', 'body': {'unpause': {}}} Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 in vm_state active. Cannot unpause while the instance is in this state. Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:26.036388 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:26.042367 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:26.042367 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:26.042367 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:26.042367 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:34:26.042367 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:26.042367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c64efa8-5cf1-429d-ad45-2cfab5cf4987 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 409 to user: Cannot 'unpause' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:26.042367 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0c64efa8-5cf1-429d-ad45-2cfab5cf4987 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 409 len: 145 microversion: 2.1 time: 0.067814 Jul 20 04:34:26.045139 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2652/5213] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:25 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 145 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:34:26.054882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2e6c2d71-e24e-4f4e-9017-e0acdad80d60 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:26.055544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2e6c2d71-e24e-4f4e-9017-e0acdad80d60 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:26.062706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e6c2d71-e24e-4f4e-9017-e0acdad80d60 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.063171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e6c2d71-e24e-4f4e-9017-e0acdad80d60 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.065602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e6c2d71-e24e-4f4e-9017-e0acdad80d60 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.066092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e6c2d71-e24e-4f4e-9017-e0acdad80d60 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.412229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a03e65e0-1c1c-43e1-b6d0-ff6ef5b15856 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:26.423455 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a03e65e0-1c1c-43e1-b6d0-ff6ef5b15856 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.983426 Jul 20 04:34:26.436012 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2562/5214] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:25 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:26.440885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6de409a7-75bf-447d-b457-76da2424cbe8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:26.441517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6de409a7-75bf-447d-b457-76da2424cbe8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:26.452464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6de409a7-75bf-447d-b457-76da2424cbe8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.452923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6de409a7-75bf-447d-b457-76da2424cbe8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.453723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6de409a7-75bf-447d-b457-76da2424cbe8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.454172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6de409a7-75bf-447d-b457-76da2424cbe8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.928694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6de409a7-75bf-447d-b457-76da2424cbe8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:26.948392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2e6c2d71-e24e-4f4e-9017-e0acdad80d60 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:26.949035 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6de409a7-75bf-447d-b457-76da2424cbe8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1294 microversion: 2.1 time: 0.511153 Jul 20 04:34:26.949638 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2563/5215] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:26 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1294 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:26.963215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7152293f-61b4-43a0-9fbe-778b1aca0417 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:26.964300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7152293f-61b4-43a0-9fbe-778b1aca0417 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:26.975223 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2e6c2d71-e24e-4f4e-9017-e0acdad80d60 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.928905 Jul 20 04:34:26.976141 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2653/5216] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:26 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:27.001227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-357787ca-6b45-4a15-b8f7-49d12e94be2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:27.002228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-357787ca-6b45-4a15-b8f7-49d12e94be2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:27.009940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7152293f-61b4-43a0-9fbe-778b1aca0417 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:27.011189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7152293f-61b4-43a0-9fbe-778b1aca0417 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:27.015129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7152293f-61b4-43a0-9fbe-778b1aca0417 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:27.016224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7152293f-61b4-43a0-9fbe-778b1aca0417 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:27.023922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-357787ca-6b45-4a15-b8f7-49d12e94be2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:27.035199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-357787ca-6b45-4a15-b8f7-49d12e94be2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:27.038718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-357787ca-6b45-4a15-b8f7-49d12e94be2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:27.040925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-357787ca-6b45-4a15-b8f7-49d12e94be2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:28.261213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7152293f-61b4-43a0-9fbe-778b1aca0417 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:28.274466 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7152293f-61b4-43a0-9fbe-778b1aca0417 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 1.323197 Jul 20 04:34:28.275436 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2564/5217] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:26 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:28.296601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-197cf235-f69e-49e0-b4b5-a80805b1a702 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:28.297506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-197cf235-f69e-49e0-b4b5-a80805b1a702 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:28.300662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-357787ca-6b45-4a15-b8f7-49d12e94be2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:28.305798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-197cf235-f69e-49e0-b4b5-a80805b1a702 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:28.307197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-197cf235-f69e-49e0-b4b5-a80805b1a702 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:28.309449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-197cf235-f69e-49e0-b4b5-a80805b1a702 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:28.310855 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-357787ca-6b45-4a15-b8f7-49d12e94be2c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 1.315664 Jul 20 04:34:28.311531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-197cf235-f69e-49e0-b4b5-a80805b1a702 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:28.334354 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2654/5218] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:26 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:28.339421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-93fcffd8-3521-4e6f-986c-50f28f46fa17 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:28.340090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-93fcffd8-3521-4e6f-986c-50f28f46fa17 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:28.356507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93fcffd8-3521-4e6f-986c-50f28f46fa17 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:28.356970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93fcffd8-3521-4e6f-986c-50f28f46fa17 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:28.357775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93fcffd8-3521-4e6f-986c-50f28f46fa17 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:28.358210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93fcffd8-3521-4e6f-986c-50f28f46fa17 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:28.481707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-197cf235-f69e-49e0-b4b5-a80805b1a702 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:28.494197 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-197cf235-f69e-49e0-b4b5-a80805b1a702 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1294 microversion: 2.1 time: 0.217250 Jul 20 04:34:28.510153 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2565/5219] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:28 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1294 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:28.531843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dc11ac5b-1006-48ca-89e6-b2419e664df2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:28.538527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dc11ac5b-1006-48ca-89e6-b2419e664df2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: 7e3b3c9e-3084-4f9d-bec5-f062d7e6e639] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:28.553160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:28.556849 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-dc11ac5b-1006-48ca-89e6-b2419e664df2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance 7e3b3c9e-3084-4f9d-bec5-f062d7e6e639 could not be found. Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dc11ac5b-1006-48ca-89e6-b2419e664df2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/7e3b3c9e-3084-4f9d-bec5-f062d7e6e639/action HTTP/1.1 Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 18 Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: {"unshelve": null} Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 7e3b3c9e-3084-4f9d-bec5-f062d7e6e639 could not be found. Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '7e3b3c9e-3084-4f9d-bec5-f062d7e6e639', 'body': {'unshelve': None}} Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3b3c9e-3084-4f9d-bec5-f062d7e6e639 could not be found. Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3b3c9e-3084-4f9d-bec5-f062d7e6e639 could not be found. Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:28.563626 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:28.568793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:28.568793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:28.568793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:28.568793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:28.568793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3b3c9e-3084-4f9d-bec5-f062d7e6e639 could not be found. Jul 20 04:34:28.568793 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:28.571965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dc11ac5b-1006-48ca-89e6-b2419e664df2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance 7e3b3c9e-3084-4f9d-bec5-f062d7e6e639 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:28.573776 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dc11ac5b-1006-48ca-89e6-b2419e664df2 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/7e3b3c9e-3084-4f9d-bec5-f062d7e6e639/action" status: 404 len: 111 microversion: 2.1 time: 0.061507 Jul 20 04:34:28.579941 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2566/5220] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:28 2022] POST /compute/v2.1/servers/7e3b3c9e-3084-4f9d-bec5-f062d7e6e639/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:28.590566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a15e503b-e465-43f6-b996-e85f38402a5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:28.594140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a15e503b-e465-43f6-b996-e85f38402a5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:28.610660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a15e503b-e465-43f6-b996-e85f38402a5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:28.612929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a15e503b-e465-43f6-b996-e85f38402a5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:28.618778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a15e503b-e465-43f6-b996-e85f38402a5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:28.619559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a15e503b-e465-43f6-b996-e85f38402a5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.486988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-93fcffd8-3521-4e6f-986c-50f28f46fa17 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:29.502539 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-93fcffd8-3521-4e6f-986c-50f28f46fa17 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 1.166852 Jul 20 04:34:29.530073 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2655/5221] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:28 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:29.532031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a15e503b-e465-43f6-b996-e85f38402a5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:29.547060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52e04315-1a01-470a-8517-0b5ebfbdda7c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:29.548356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52e04315-1a01-470a-8517-0b5ebfbdda7c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:29.549071 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a15e503b-e465-43f6-b996-e85f38402a5c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.967676 Jul 20 04:34:29.559765 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2567/5222] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:28 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:29.559765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2e21e33f-03bd-4463-b93f-7a9426130ea9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:29.572391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52e04315-1a01-470a-8517-0b5ebfbdda7c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.573295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52e04315-1a01-470a-8517-0b5ebfbdda7c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.574344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52e04315-1a01-470a-8517-0b5ebfbdda7c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.575003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52e04315-1a01-470a-8517-0b5ebfbdda7c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.583550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e21e33f-03bd-4463-b93f-7a9426130ea9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.584046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e21e33f-03bd-4463-b93f-7a9426130ea9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.647161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2e21e33f-03bd-4463-b93f-7a9426130ea9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Going to try to stop instance {{(pid=119807) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:34:29.742372 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2e21e33f-03bd-4463-b93f-7a9426130ea9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.188760 Jul 20 04:34:29.742951 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2568/5223] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:29 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:29.757590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cf74f255-5498-481d-861c-bc74bc7a41b0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:29.758281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cf74f255-5498-481d-861c-bc74bc7a41b0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:29.773759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf74f255-5498-481d-861c-bc74bc7a41b0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.775370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf74f255-5498-481d-861c-bc74bc7a41b0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.777531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf74f255-5498-481d-861c-bc74bc7a41b0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.779685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf74f255-5498-481d-861c-bc74bc7a41b0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:30.484326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52e04315-1a01-470a-8517-0b5ebfbdda7c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:30.495364 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52e04315-1a01-470a-8517-0b5ebfbdda7c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1362 microversion: 2.1 time: 0.963753 Jul 20 04:34:30.495997 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2656/5224] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:29 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1362 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:30.511034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-713a59e5-309f-4bca-9452-962b32aac953 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:30.511695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-713a59e5-309f-4bca-9452-962b32aac953 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:30.521176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-713a59e5-309f-4bca-9452-962b32aac953 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:30.522028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-713a59e5-309f-4bca-9452-962b32aac953 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:30.522879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-713a59e5-309f-4bca-9452-962b32aac953 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:30.523585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-713a59e5-309f-4bca-9452-962b32aac953 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:30.616465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf74f255-5498-481d-861c-bc74bc7a41b0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:30.635077 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cf74f255-5498-481d-861c-bc74bc7a41b0 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.887404 Jul 20 04:34:30.636242 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2569/5225] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:29 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:30.661878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-379ca9fa-5f12-49e9-8a4c-be73e31c112b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:30.662665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-379ca9fa-5f12-49e9-8a4c-be73e31c112b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:30.670625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-379ca9fa-5f12-49e9-8a4c-be73e31c112b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:30.671082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-379ca9fa-5f12-49e9-8a4c-be73e31c112b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:30.672727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-379ca9fa-5f12-49e9-8a4c-be73e31c112b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:30.673342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-379ca9fa-5f12-49e9-8a4c-be73e31c112b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:30.721508 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-379ca9fa-5f12-49e9-8a4c-be73e31c112b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Cannot 'unshelve' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-379ca9fa-5f12-49e9-8a4c-be73e31c112b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action HTTP/1.1 Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 18 Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: {"unshelve": null} Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: exception: Cannot 'unshelve' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a2f3226f-82c7-4e50-9a7d-ca0721979912', 'body': {'unshelve': None}} Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 in vm_state active. Cannot unshelve while the instance is in this state. Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:34:30.724157 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-379ca9fa-5f12-49e9-8a4c-be73e31c112b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 409 to user: Cannot 'unshelve' instance a2f3226f-82c7-4e50-9a7d-ca0721979912 while it is in vm_state active {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-379ca9fa-5f12-49e9-8a4c-be73e31c112b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action" status: 409 len: 146 microversion: 2.1 time: 0.072775 Jul 20 04:34:30.732213 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2570/5226] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:30 2022] POST /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912/action => generated 146 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:34:30.743295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-00898128-4079-43f9-a411-54a910431b5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:30.744394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-00898128-4079-43f9-a411-54a910431b5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:30.756746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00898128-4079-43f9-a411-54a910431b5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:30.757759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00898128-4079-43f9-a411-54a910431b5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:30.759918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00898128-4079-43f9-a411-54a910431b5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:30.760354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00898128-4079-43f9-a411-54a910431b5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:30.841555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-713a59e5-309f-4bca-9452-962b32aac953 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:30.851818 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-713a59e5-309f-4bca-9452-962b32aac953 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.344542 Jul 20 04:34:30.852683 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2657/5227] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:30 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:31.110527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-00898128-4079-43f9-a411-54a910431b5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:31.122583 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-00898128-4079-43f9-a411-54a910431b5b tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.387256 Jul 20 04:34:31.123198 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2571/5228] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:30 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:31.153089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8b380616-b9b2-4567-9491-c50c96b04428 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:31.154737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8b380616-b9b2-4567-9491-c50c96b04428 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:31.178720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b380616-b9b2-4567-9491-c50c96b04428 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.179538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b380616-b9b2-4567-9491-c50c96b04428 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.180578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b380616-b9b2-4567-9491-c50c96b04428 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.181300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b380616-b9b2-4567-9491-c50c96b04428 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.515462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-af3365e5-fbc0-4461-86b4-77704f4af1c5 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:31.516373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-af3365e5-fbc0-4461-86b4-77704f4af1c5 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:31.527000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af3365e5-fbc0-4461-86b4-77704f4af1c5 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.529736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af3365e5-fbc0-4461-86b4-77704f4af1c5 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.530847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af3365e5-fbc0-4461-86b4-77704f4af1c5 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.532027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af3365e5-fbc0-4461-86b4-77704f4af1c5 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.321047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8b380616-b9b2-4567-9491-c50c96b04428 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:32.334413 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8b380616-b9b2-4567-9491-c50c96b04428 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 1.185507 Jul 20 04:34:32.337246 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2658/5229] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:31 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:32.345197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6933091-c879-4915-92bd-84d141de4db9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:32.362790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c6933091-c879-4915-92bd-84d141de4db9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:32.364895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:32.394137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6933091-c879-4915-92bd-84d141de4db9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.394596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6933091-c879-4915-92bd-84d141de4db9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.395392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6933091-c879-4915-92bd-84d141de4db9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.395971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6933091-c879-4915-92bd-84d141de4db9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.630576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-af3365e5-fbc0-4461-86b4-77704f4af1c5 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:32.701129 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-af3365e5-fbc0-4461-86b4-77704f4af1c5 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1362 microversion: 2.1 time: 1.171705 Jul 20 04:34:32.717597 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2572/5230] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:31 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1362 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:32.732836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7114f515-9829-4385-9acc-1bfe5606fb4e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-433890800_updated"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:32.734851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7114f515-9829-4385-9acc-1bfe5606fb4e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: caf69874-27a8-47c4-8354-7444b70386db] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:32.741882 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-7114f515-9829-4385-9acc-1bfe5606fb4e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance caf69874-27a8-47c4-8354-7444b70386db could not be found. Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7114f515-9829-4385-9acc-1bfe5606fb4e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: request: PUT /compute/v2.1/servers/caf69874-27a8-47c4-8354-7444b70386db HTTP/1.1 Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 80 Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-433890800_updated"}} Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance caf69874-27a8-47c4-8354-7444b70386db could not be found. Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'caf69874-27a8-47c4-8354-7444b70386db', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-433890800_updated'}}} Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf69874-27a8-47c4-8354-7444b70386db could not be found. Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 20 04:34:32.745056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf69874-27a8-47c4-8354-7444b70386db could not be found. Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf69874-27a8-47c4-8354-7444b70386db could not be found. Jul 20 04:34:32.750071 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:32.752751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7114f515-9829-4385-9acc-1bfe5606fb4e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance caf69874-27a8-47c4-8354-7444b70386db could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:32.753856 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7114f515-9829-4385-9acc-1bfe5606fb4e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "PUT /compute/v2.1/servers/caf69874-27a8-47c4-8354-7444b70386db" status: 404 len: 111 microversion: 2.1 time: 0.034329 Jul 20 04:34:32.755007 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2573/5231] 10.222.0.20 () {60 vars in 1255 bytes} [Wed Jul 20 04:34:32 2022] PUT /compute/v2.1/servers/caf69874-27a8-47c4-8354-7444b70386db => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:32.775159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3208a448-a826-4592-842e-2a441e023081 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:32.775851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3208a448-a826-4592-842e-2a441e023081 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:32.799857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3208a448-a826-4592-842e-2a441e023081 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.801285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3208a448-a826-4592-842e-2a441e023081 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.802998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3208a448-a826-4592-842e-2a441e023081 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.807226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3208a448-a826-4592-842e-2a441e023081 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.874370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c6933091-c879-4915-92bd-84d141de4db9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:32.894216 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c6933091-c879-4915-92bd-84d141de4db9 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.554203 Jul 20 04:34:32.894216 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2659/5232] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:32 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:33.103785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-807d7f01-8e63-4e55-825f-f4d95c78a205 req-102f8cef-7998-4967-ba27-a9f19d8a8ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d78226-707b-4d41-96ab-987874bee7fc", "tag": "2adb9264-1b58-4969-a23a-628daabb41ab"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:33.140813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-807d7f01-8e63-4e55-825f-f4d95c78a205 req-102f8cef-7998-4967-ba27-a9f19d8a8ec1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.141421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-807d7f01-8e63-4e55-825f-f4d95c78a205 req-102f8cef-7998-4967-ba27-a9f19d8a8ec1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.166802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3208a448-a826-4592-842e-2a441e023081 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:33.187360 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3208a448-a826-4592-842e-2a441e023081 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.419582 Jul 20 04:34:33.188739 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2574/5233] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:32 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:33.193030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:33.195723 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-807d7f01-8e63-4e55-825f-f4d95c78a205 req-102f8cef-7998-4967-ba27-a9f19d8a8ec1 service nova] Creating event network-changed:2adb9264-1b58-4969-a23a-628daabb41ab for instance 62d78226-707b-4d41-96ab-987874bee7fc on n-h2-764485-11 Jul 20 04:34:33.210344 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-807d7f01-8e63-4e55-825f-f4d95c78a205 req-102f8cef-7998-4967-ba27-a9f19d8a8ec1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113852 Jul 20 04:34:33.212420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6166a938-7409-4810-957e-dfafd6e2f4ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:33.213287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6166a938-7409-4810-957e-dfafd6e2f4ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:33.214756 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2660/5234] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:33.236977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6166a938-7409-4810-957e-dfafd6e2f4ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.237733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6166a938-7409-4810-957e-dfafd6e2f4ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.241078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6166a938-7409-4810-957e-dfafd6e2f4ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.241902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6166a938-7409-4810-957e-dfafd6e2f4ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.631314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6166a938-7409-4810-957e-dfafd6e2f4ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:33.639488 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6166a938-7409-4810-957e-dfafd6e2f4ee tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.431962 Jul 20 04:34:33.645827 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2575/5235] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:33 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:33.663442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-800aa622-dd8e-450c-88fe-02aff7c0d49e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-800aa622-dd8e-450c-88fe-02aff7c0d49e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: request: PUT /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 HTTP/1.1 Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 280 Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a2f3226f-82c7-4e50-9a7d-ca0721979912', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:33.666889 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:34:33.671573 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:33.675639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-800aa622-dd8e-450c-88fe-02aff7c0d49e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:33.682707 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-800aa622-dd8e-450c-88fe-02aff7c0d49e tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "PUT /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 400 len: 619 microversion: 2.1 time: 0.022071 Jul 20 04:34:33.685311 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2661/5236] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Jul 20 04:34:33 2022] PUT /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:34:33.694160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-da419cd5-a82b-4118-8153-05b874e3ff5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:33.695035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-da419cd5-a82b-4118-8153-05b874e3ff5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:33.716642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da419cd5-a82b-4118-8153-05b874e3ff5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.718361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da419cd5-a82b-4118-8153-05b874e3ff5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.719422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da419cd5-a82b-4118-8153-05b874e3ff5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.720116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da419cd5-a82b-4118-8153-05b874e3ff5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.732520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=12 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:33.738439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c8c8ebe-93fe-4698-9414-2481fe54d96f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:33.741352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9c8c8ebe-93fe-4698-9414-2481fe54d96f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:33.796871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c8c8ebe-93fe-4698-9414-2481fe54d96f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.797321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c8c8ebe-93fe-4698-9414-2481fe54d96f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.800490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c8c8ebe-93fe-4698-9414-2481fe54d96f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.802589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c8c8ebe-93fe-4698-9414-2481fe54d96f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.197200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9c8c8ebe-93fe-4698-9414-2481fe54d96f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.209921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-da419cd5-a82b-4118-8153-05b874e3ff5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.220317 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-da419cd5-a82b-4118-8153-05b874e3ff5f tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.531012 Jul 20 04:34:34.221251 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2576/5237] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:33 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:34.234197 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c8c8ebe-93fe-4698-9414-2481fe54d96f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1362 microversion: 2.1 time: 0.497573 Jul 20 04:34:34.234197 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2662/5238] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:33 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:34.240807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b6e9022f-58a9-4314-96cb-1d40659d86ba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:34.241647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b6e9022f-58a9-4314-96cb-1d40659d86ba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:34.242793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ab8e4055-ba90-4c1f-b337-2d31d0f956fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:34.243898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ab8e4055-ba90-4c1f-b337-2d31d0f956fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:34.253743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6e9022f-58a9-4314-96cb-1d40659d86ba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.254400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6e9022f-58a9-4314-96cb-1d40659d86ba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.255683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6e9022f-58a9-4314-96cb-1d40659d86ba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.256928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6e9022f-58a9-4314-96cb-1d40659d86ba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.262003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab8e4055-ba90-4c1f-b337-2d31d0f956fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.264390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab8e4055-ba90-4c1f-b337-2d31d0f956fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.266517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab8e4055-ba90-4c1f-b337-2d31d0f956fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.268460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab8e4055-ba90-4c1f-b337-2d31d0f956fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.538413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b6e9022f-58a9-4314-96cb-1d40659d86ba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.540955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:34.541852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ab8e4055-ba90-4c1f-b337-2d31d0f956fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.550810 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b6e9022f-58a9-4314-96cb-1d40659d86ba tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.313767 Jul 20 04:34:34.552058 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2577/5239] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:34 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:34.554779 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ab8e4055-ba90-4c1f-b337-2d31d0f956fb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.317404 Jul 20 04:34:34.557810 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2663/5240] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:34 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:34.578442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b148285-7398-422a-b119-78416a90c8e6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b148285-7398-422a-b119-78416a90c8e6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: request: PUT /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 HTTP/1.1 Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 24 Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: {"server": {"name": ""}} Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a2f3226f-82c7-4e50-9a7d-ca0721979912', 'body': {'server': {'name': ''}}} Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi '' Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:34:34.583825 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b148285-7398-422a-b119-78416a90c8e6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7b148285-7398-422a-b119-78416a90c8e6 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "PUT /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 400 len: 108 microversion: 2.1 time: 0.020792 Jul 20 04:34:34.590395 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2578/5241] 10.222.0.20 () {60 vars in 1255 bytes} [Wed Jul 20 04:34:34 2022] PUT /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:34:34.595449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bfd321cb-e235-4da0-a64c-b7c787b1389c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:34.596273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bfd321cb-e235-4da0-a64c-b7c787b1389c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:34.606859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfd321cb-e235-4da0-a64c-b7c787b1389c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.607319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfd321cb-e235-4da0-a64c-b7c787b1389c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.608130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfd321cb-e235-4da0-a64c-b7c787b1389c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.611548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bfd321cb-e235-4da0-a64c-b7c787b1389c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.780503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bfd321cb-e235-4da0-a64c-b7c787b1389c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.789655 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bfd321cb-e235-4da0-a64c-b7c787b1389c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1506 microversion: 2.1 time: 0.199330 Jul 20 04:34:34.790925 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2664/5242] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:34 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:35.247105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ea8c17d1-22f2-4409-b083-46ba9cc90a55 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:35.247986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ea8c17d1-22f2-4409-b083-46ba9cc90a55 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:35.268818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea8c17d1-22f2-4409-b083-46ba9cc90a55 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.269278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea8c17d1-22f2-4409-b083-46ba9cc90a55 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.270078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea8c17d1-22f2-4409-b083-46ba9cc90a55 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.270528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea8c17d1-22f2-4409-b083-46ba9cc90a55 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.462419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ea8c17d1-22f2-4409-b083-46ba9cc90a55 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:35.481424 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ea8c17d1-22f2-4409-b083-46ba9cc90a55 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1362 microversion: 2.1 time: 0.237420 Jul 20 04:34:35.496578 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2579/5243] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:35 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:35.578046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b864485b-326a-4835-a7c8-209d36e9194c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:35.579138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b864485b-326a-4835-a7c8-209d36e9194c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:35.587490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b864485b-326a-4835-a7c8-209d36e9194c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.588198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b864485b-326a-4835-a7c8-209d36e9194c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.589159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b864485b-326a-4835-a7c8-209d36e9194c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.589771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b864485b-326a-4835-a7c8-209d36e9194c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.853649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b864485b-326a-4835-a7c8-209d36e9194c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:35.858017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:35.868069 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b864485b-326a-4835-a7c8-209d36e9194c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.295471 Jul 20 04:34:35.883655 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2665/5244] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:35 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:36.490020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1996736800", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": "none"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:36.500054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-653385c8-eed3-4bf8-a9b3-c7b480dedb2f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:36.500704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-653385c8-eed3-4bf8-a9b3-c7b480dedb2f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:36.511202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-653385c8-eed3-4bf8-a9b3-c7b480dedb2f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.513203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-653385c8-eed3-4bf8-a9b3-c7b480dedb2f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.515142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-653385c8-eed3-4bf8-a9b3-c7b480dedb2f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.518366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-653385c8-eed3-4bf8-a9b3-c7b480dedb2f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.581990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:36.582592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:36.583209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:36.583661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:36.584152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:36.604144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.607292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.609740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.610202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.635540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Getting quotas for project 7d644da9492149ee9a1d899dd1c096cb. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:36.642649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Getting quotas for user c72f925bb44a48e787d4fdde2bf84553 and project 7d644da9492149ee9a1d899dd1c096cb. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:36.658671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:36.669372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:36.761312 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-82915548-c235-4434-9f5f-a39132c2ca32 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.695835 Jul 20 04:34:36.767498 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2580/5245] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:34:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:34:36.773492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6f438bff-d9bb-49cd-89aa-5ca7cab03df6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:36.774596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6f438bff-d9bb-49cd-89aa-5ca7cab03df6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:37.114033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6f438bff-d9bb-49cd-89aa-5ca7cab03df6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:37.128621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6f438bff-d9bb-49cd-89aa-5ca7cab03df6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:37.133146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6f438bff-d9bb-49cd-89aa-5ca7cab03df6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:37.140618 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6f438bff-d9bb-49cd-89aa-5ca7cab03df6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1278 microversion: 2.57 time: 0.370771 Jul 20 04:34:37.141389 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2581/5246] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:36 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1278 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:37.152512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-183ef9d7-9439-452b-a92f-b9c8721599de tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:37.155586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-183ef9d7-9439-452b-a92f-b9c8721599de tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:37.172957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-183ef9d7-9439-452b-a92f-b9c8721599de tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.175747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-183ef9d7-9439-452b-a92f-b9c8721599de tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.179547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-183ef9d7-9439-452b-a92f-b9c8721599de tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.181977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-183ef9d7-9439-452b-a92f-b9c8721599de tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.261851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-653385c8-eed3-4bf8-a9b3-c7b480dedb2f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:37.273515 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-653385c8-eed3-4bf8-a9b3-c7b480dedb2f tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1362 microversion: 2.1 time: 0.778310 Jul 20 04:34:37.282673 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2666/5247] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:36 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1362 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:37.612938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-183ef9d7-9439-452b-a92f-b9c8721599de tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:37.627282 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-183ef9d7-9439-452b-a92f-b9c8721599de tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.484804 Jul 20 04:34:37.627933 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2582/5248] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:37 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:38.166060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-363cbc92-9091-4792-b7d2-fd11bc85f9ba tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:38.167150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-363cbc92-9091-4792-b7d2-fd11bc85f9ba tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:38.178162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-363cbc92-9091-4792-b7d2-fd11bc85f9ba tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.188735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-363cbc92-9091-4792-b7d2-fd11bc85f9ba tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.189993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-363cbc92-9091-4792-b7d2-fd11bc85f9ba tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.190602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-363cbc92-9091-4792-b7d2-fd11bc85f9ba tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.298683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6e39ff0d-3a8d-4921-b4e1-bf45cc27cc9c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:38.299306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6e39ff0d-3a8d-4921-b4e1-bf45cc27cc9c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:38.327695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6e39ff0d-3a8d-4921-b4e1-bf45cc27cc9c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.328156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6e39ff0d-3a8d-4921-b4e1-bf45cc27cc9c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.328957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6e39ff0d-3a8d-4921-b4e1-bf45cc27cc9c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.329396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6e39ff0d-3a8d-4921-b4e1-bf45cc27cc9c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.388588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-363cbc92-9091-4792-b7d2-fd11bc85f9ba tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:38.398310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-363cbc92-9091-4792-b7d2-fd11bc85f9ba tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:38.408746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-363cbc92-9091-4792-b7d2-fd11bc85f9ba tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:38.416038 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-363cbc92-9091-4792-b7d2-fd11bc85f9ba tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1330 microversion: 2.57 time: 0.255671 Jul 20 04:34:38.432264 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2667/5249] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:38 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1330 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:38.611525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6e39ff0d-3a8d-4921-b4e1-bf45cc27cc9c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:38.624299 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6e39ff0d-3a8d-4921-b4e1-bf45cc27cc9c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1362 microversion: 2.1 time: 0.327516 Jul 20 04:34:38.625980 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2583/5250] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:38 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:38.645133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91a467bb-d18a-4343-ac80-085204ab2f0a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:38.646070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91a467bb-d18a-4343-ac80-085204ab2f0a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:38.656148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91a467bb-d18a-4343-ac80-085204ab2f0a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.659341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91a467bb-d18a-4343-ac80-085204ab2f0a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.660200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91a467bb-d18a-4343-ac80-085204ab2f0a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.661960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91a467bb-d18a-4343-ac80-085204ab2f0a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.000561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91a467bb-d18a-4343-ac80-085204ab2f0a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:39.045201 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91a467bb-d18a-4343-ac80-085204ab2f0a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.391412 Jul 20 04:34:39.045867 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2668/5251] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:38 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:39.439385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-12090dcd-1bdb-4924-9672-900e592c962b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:39.439982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-12090dcd-1bdb-4924-9672-900e592c962b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:39.451079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12090dcd-1bdb-4924-9672-900e592c962b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.451571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12090dcd-1bdb-4924-9672-900e592c962b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.452386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12090dcd-1bdb-4924-9672-900e592c962b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.452833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12090dcd-1bdb-4924-9672-900e592c962b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.584612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-12090dcd-1bdb-4924-9672-900e592c962b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:39.598167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-12090dcd-1bdb-4924-9672-900e592c962b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:39.605366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-12090dcd-1bdb-4924-9672-900e592c962b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:39.608100 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-12090dcd-1bdb-4924-9672-900e592c962b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1336 microversion: 2.57 time: 0.173796 Jul 20 04:34:39.620262 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2584/5252] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:39 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1336 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:39.650054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21c99661-61ea-4605-8baa-f3d5edb565b2 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:39.651545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21c99661-61ea-4605-8baa-f3d5edb565b2 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:39.665423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21c99661-61ea-4605-8baa-f3d5edb565b2 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.665881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21c99661-61ea-4605-8baa-f3d5edb565b2 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.666678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21c99661-61ea-4605-8baa-f3d5edb565b2 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.668619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21c99661-61ea-4605-8baa-f3d5edb565b2 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.008537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-21c99661-61ea-4605-8baa-f3d5edb565b2 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.018888 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21c99661-61ea-4605-8baa-f3d5edb565b2 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1362 microversion: 2.1 time: 0.380127 Jul 20 04:34:40.024486 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2669/5253] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:39 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:40.062449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2a3da486-cd98-4f52-9740-0ade0e0612a3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:40.063083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2a3da486-cd98-4f52-9740-0ade0e0612a3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:40.085182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a3da486-cd98-4f52-9740-0ade0e0612a3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.086548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a3da486-cd98-4f52-9740-0ade0e0612a3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.094947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a3da486-cd98-4f52-9740-0ade0e0612a3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.098094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a3da486-cd98-4f52-9740-0ade0e0612a3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.628096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62028ddf-f372-49ff-b304-67da97226243 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:40.629305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-62028ddf-f372-49ff-b304-67da97226243 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:40.641097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62028ddf-f372-49ff-b304-67da97226243 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.642010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62028ddf-f372-49ff-b304-67da97226243 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.643187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62028ddf-f372-49ff-b304-67da97226243 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.644562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62028ddf-f372-49ff-b304-67da97226243 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.916977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-62028ddf-f372-49ff-b304-67da97226243 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.928687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-62028ddf-f372-49ff-b304-67da97226243 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.932404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-62028ddf-f372-49ff-b304-67da97226243 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.938389 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-62028ddf-f372-49ff-b304-67da97226243 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1336 microversion: 2.57 time: 0.315325 Jul 20 04:34:40.950755 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2670/5254] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:40 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1336 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:34:40.956564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2a3da486-cd98-4f52-9740-0ade0e0612a3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.968561 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2a3da486-cd98-4f52-9740-0ade0e0612a3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1679 microversion: 2.1 time: 0.910078 Jul 20 04:34:40.972167 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2585/5255] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:40 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1679 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:41.038657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a4876e57-3685-4609-a021-9d65ebc11317 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:41.039096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a4876e57-3685-4609-a021-9d65ebc11317 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:41.050269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4876e57-3685-4609-a021-9d65ebc11317 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.055056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4876e57-3685-4609-a021-9d65ebc11317 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.056212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4876e57-3685-4609-a021-9d65ebc11317 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.057883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4876e57-3685-4609-a021-9d65ebc11317 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.390703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-dcaa5265-4193-427c-8b5e-45e36bab0e0d req-20c04989-3399-471b-a753-f3625bd4abd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d78226-707b-4d41-96ab-987874bee7fc", "name": "network-vif-plugged", "status": "completed", "tag": "2adb9264-1b58-4969-a23a-628daabb41ab"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:41.410152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dcaa5265-4193-427c-8b5e-45e36bab0e0d req-20c04989-3399-471b-a753-f3625bd4abd6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.411026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dcaa5265-4193-427c-8b5e-45e36bab0e0d req-20c04989-3399-471b-a753-f3625bd4abd6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.440224 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-dcaa5265-4193-427c-8b5e-45e36bab0e0d req-20c04989-3399-471b-a753-f3625bd4abd6 service nova] Creating event network-vif-plugged:2adb9264-1b58-4969-a23a-628daabb41ab for instance 62d78226-707b-4d41-96ab-987874bee7fc on n-h2-764485-11 Jul 20 04:34:41.452833 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-dcaa5265-4193-427c-8b5e-45e36bab0e0d req-20c04989-3399-471b-a753-f3625bd4abd6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067369 Jul 20 04:34:41.459690 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2586/5256] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:34:41.687648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a4876e57-3685-4609-a021-9d65ebc11317 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:41.703491 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a4876e57-3685-4609-a021-9d65ebc11317 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1362 microversion: 2.1 time: 0.668405 Jul 20 04:34:41.714210 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2671/5257] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:41 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1362 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:41.968869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d801e520-b696-4c2b-a281-eac48e0af0e6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:41.969654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d801e520-b696-4c2b-a281-eac48e0af0e6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:41.981194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d801e520-b696-4c2b-a281-eac48e0af0e6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.981666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d801e520-b696-4c2b-a281-eac48e0af0e6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.983296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d801e520-b696-4c2b-a281-eac48e0af0e6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.983913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d801e520-b696-4c2b-a281-eac48e0af0e6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.989957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a3664647-5088-442f-85d1-b5a494d03b63 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:41.991134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a3664647-5088-442f-85d1-b5a494d03b63 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:42.007126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3664647-5088-442f-85d1-b5a494d03b63 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.007936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3664647-5088-442f-85d1-b5a494d03b63 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.009115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3664647-5088-442f-85d1-b5a494d03b63 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.011290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a3664647-5088-442f-85d1-b5a494d03b63 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.121467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d801e520-b696-4c2b-a281-eac48e0af0e6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:42.147157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d801e520-b696-4c2b-a281-eac48e0af0e6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:42.154667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d801e520-b696-4c2b-a281-eac48e0af0e6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:42.162512 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d801e520-b696-4c2b-a281-eac48e0af0e6 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1336 microversion: 2.57 time: 0.201354 Jul 20 04:34:42.165225 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2587/5258] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:41 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1336 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:42.334400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a3664647-5088-442f-85d1-b5a494d03b63 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:42.345876 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a3664647-5088-442f-85d1-b5a494d03b63 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1656 microversion: 2.1 time: 0.360239 Jul 20 04:34:42.347013 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2672/5259] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:41 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1656 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:42.365783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-976ade4d-6777-4f87-9557-f0b534e20ef0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:42.374292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-976ade4d-6777-4f87-9557-f0b534e20ef0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.374979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-976ade4d-6777-4f87-9557-f0b534e20ef0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.432722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-976ade4d-6777-4f87-9557-f0b534e20ef0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Going to try to start instance {{(pid=119807) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:34:42.514411 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-976ade4d-6777-4f87-9557-f0b534e20ef0 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.152824 Jul 20 04:34:42.521778 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2588/5260] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:42 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:42.533085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-251e05cd-42fe-4265-8b5c-559daa466c9f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:42.533697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-251e05cd-42fe-4265-8b5c-559daa466c9f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:42.555322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-251e05cd-42fe-4265-8b5c-559daa466c9f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.567359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-251e05cd-42fe-4265-8b5c-559daa466c9f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.573138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-251e05cd-42fe-4265-8b5c-559daa466c9f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.582796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-251e05cd-42fe-4265-8b5c-559daa466c9f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.721925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a04f31a-9768-4f78-b647-d1474a6e019a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:42.722672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a04f31a-9768-4f78-b647-d1474a6e019a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:42.740348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a04f31a-9768-4f78-b647-d1474a6e019a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.740810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a04f31a-9768-4f78-b647-d1474a6e019a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.742836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a04f31a-9768-4f78-b647-d1474a6e019a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.743500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a04f31a-9768-4f78-b647-d1474a6e019a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.092890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-251e05cd-42fe-4265-8b5c-559daa466c9f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:43.109158 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-251e05cd-42fe-4265-8b5c-559daa466c9f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1665 microversion: 2.1 time: 0.589558 Jul 20 04:34:43.109778 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2673/5261] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:42 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1665 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:43.115126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec3ad8b6-a81e-4b37-ab81-c64a4600df28 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:43.115664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ec3ad8b6-a81e-4b37-ab81-c64a4600df28 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:43.140954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec3ad8b6-a81e-4b37-ab81-c64a4600df28 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.141670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec3ad8b6-a81e-4b37-ab81-c64a4600df28 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.142732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec3ad8b6-a81e-4b37-ab81-c64a4600df28 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.154804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec3ad8b6-a81e-4b37-ab81-c64a4600df28 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.158267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a04f31a-9768-4f78-b647-d1474a6e019a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:43.166497 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a04f31a-9768-4f78-b647-d1474a6e019a tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1362 microversion: 2.1 time: 0.448698 Jul 20 04:34:43.171585 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2589/5262] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:42 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:43.195003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8d13c488-25c5-42d4-9dc7-54df5b437bfa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:43.195698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8d13c488-25c5-42d4-9dc7-54df5b437bfa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:43.203672 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-ec3ad8b6-a81e-4b37-ab81-c64a4600df28 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:34:43.207192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d13c488-25c5-42d4-9dc7-54df5b437bfa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.207688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d13c488-25c5-42d4-9dc7-54df5b437bfa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec3ad8b6-a81e-4b37-ab81-c64a4600df28 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac HTTP/1.1 Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'de2b9533-c850-4e02-afc0-68243a289fac'} Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:43.208307 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:43.213385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:34:43.213385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:43.213385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:43.213385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:43.213385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:43.213385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:43.213385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:43.213385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:43.213385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:43.213385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:34:43.213385 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:43.215003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec3ad8b6-a81e-4b37-ab81-c64a4600df28 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:43.217749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d13c488-25c5-42d4-9dc7-54df5b437bfa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.218210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d13c488-25c5-42d4-9dc7-54df5b437bfa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.218837 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ec3ad8b6-a81e-4b37-ab81-c64a4600df28 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 404 len: 111 microversion: 2.1 time: 0.106072 Jul 20 04:34:43.219439 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2674/5263] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:43 2022] DELETE /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:43.240645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a528bbce-9df3-44ff-90ca-5e15f026434c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:43.248399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a528bbce-9df3-44ff-90ca-5e15f026434c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: de2b9533-c850-4e02-afc0-68243a289fac] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:43.272622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a528bbce-9df3-44ff-90ca-5e15f026434c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.273637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a528bbce-9df3-44ff-90ca-5e15f026434c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.278524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a528bbce-9df3-44ff-90ca-5e15f026434c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.284874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a528bbce-9df3-44ff-90ca-5e15f026434c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.346636 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-a528bbce-9df3-44ff-90ca-5e15f026434c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a528bbce-9df3-44ff-90ca-5e15f026434c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac HTTP/1.1 Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'de2b9533-c850-4e02-afc0-68243a289fac'} Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:43.350227 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:43.354997 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:43.354997 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:43.354997 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:43.354997 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:43.354997 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:43.354997 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. Jul 20 04:34:43.354997 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:34:43.356586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a528bbce-9df3-44ff-90ca-5e15f026434c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance de2b9533-c850-4e02-afc0-68243a289fac could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:43.357652 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a528bbce-9df3-44ff-90ca-5e15f026434c tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac" status: 404 len: 111 microversion: 2.1 time: 0.129237 Jul 20 04:34:43.362098 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2675/5264] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:43 2022] GET /compute/v2.1/servers/de2b9533-c850-4e02-afc0-68243a289fac => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:43.367719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d00fbf44-3ff7-473e-930a-f2973e5e22b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:43.368448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d00fbf44-3ff7-473e-930a-f2973e5e22b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:43.380775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d00fbf44-3ff7-473e-930a-f2973e5e22b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.382861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d00fbf44-3ff7-473e-930a-f2973e5e22b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.386756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d00fbf44-3ff7-473e-930a-f2973e5e22b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.389337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d00fbf44-3ff7-473e-930a-f2973e5e22b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.505792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d00fbf44-3ff7-473e-930a-f2973e5e22b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:34:43.545384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8d13c488-25c5-42d4-9dc7-54df5b437bfa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:43.555337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8d13c488-25c5-42d4-9dc7-54df5b437bfa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:43.556896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8d13c488-25c5-42d4-9dc7-54df5b437bfa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:43.576419 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8d13c488-25c5-42d4-9dc7-54df5b437bfa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1357 microversion: 2.57 time: 0.385594 Jul 20 04:34:43.584771 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2590/5265] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:43 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1357 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:34:43.602990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:43.615664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:43.644983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.646661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.648599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.650468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.801097 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d00fbf44-3ff7-473e-930a-f2973e5e22b8 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 204 len: 0 microversion: 2.1 time: 0.437757 Jul 20 04:34:43.801939 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2676/5266] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:43 2022] DELETE /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:34:43.813002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1da6e506-7c31-45d8-a5e5-25a34d8d23cb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:43.814547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1da6e506-7c31-45d8-a5e5-25a34d8d23cb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:43.821201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:43.821701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:43.822257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:43.822920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:43.823559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:43.843820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1da6e506-7c31-45d8-a5e5-25a34d8d23cb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.844731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1da6e506-7c31-45d8-a5e5-25a34d8d23cb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.849188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1da6e506-7c31-45d8-a5e5-25a34d8d23cb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.849979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1da6e506-7c31-45d8-a5e5-25a34d8d23cb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.009282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.021203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.022026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.024176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.024840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.061865 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5b73c2f6-c507-41ab-90ea-bdbc26d95730 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "POST /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690/action" status: 202 len: 1138 microversion: 2.57 time: 0.463089 Jul 20 04:34:44.065312 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2591/5267] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Jul 20 04:34:43 2022] POST /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690/action => generated 1138 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:34:44.081834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-534f63f8-1ef6-4b4c-9aa7-67f44dcd51a9 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.082906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-534f63f8-1ef6-4b4c-9aa7-67f44dcd51a9 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.092746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-534f63f8-1ef6-4b4c-9aa7-67f44dcd51a9 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.093582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-534f63f8-1ef6-4b4c-9aa7-67f44dcd51a9 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.097335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-534f63f8-1ef6-4b4c-9aa7-67f44dcd51a9 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.100262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-534f63f8-1ef6-4b4c-9aa7-67f44dcd51a9 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.324252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-534f63f8-1ef6-4b4c-9aa7-67f44dcd51a9 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.335606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-534f63f8-1ef6-4b4c-9aa7-67f44dcd51a9 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.347908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-534f63f8-1ef6-4b4c-9aa7-67f44dcd51a9 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.349776 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-534f63f8-1ef6-4b4c-9aa7-67f44dcd51a9 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.274274 Jul 20 04:34:44.350865 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2592/5268] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:44.355883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0be71088-15ad-42e1-8167-7a4f7d2b5982 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.360391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0be71088-15ad-42e1-8167-7a4f7d2b5982 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.376909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0be71088-15ad-42e1-8167-7a4f7d2b5982 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.377630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0be71088-15ad-42e1-8167-7a4f7d2b5982 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.380889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0be71088-15ad-42e1-8167-7a4f7d2b5982 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.381690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0be71088-15ad-42e1-8167-7a4f7d2b5982 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.417953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1da6e506-7c31-45d8-a5e5-25a34d8d23cb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.430415 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1da6e506-7c31-45d8-a5e5-25a34d8d23cb tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1512 microversion: 2.1 time: 0.623520 Jul 20 04:34:44.431641 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2677/5269] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:43 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1512 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:44.438353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dc1c745e-1cd8-41f0-acb3-333a8841685c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.439329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dc1c745e-1cd8-41f0-acb3-333a8841685c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.446972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc1c745e-1cd8-41f0-acb3-333a8841685c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.447790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc1c745e-1cd8-41f0-acb3-333a8841685c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.448879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc1c745e-1cd8-41f0-acb3-333a8841685c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.449883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc1c745e-1cd8-41f0-acb3-333a8841685c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.808397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dc1c745e-1cd8-41f0-acb3-333a8841685c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.816685 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dc1c745e-1cd8-41f0-acb3-333a8841685c tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1546 microversion: 2.1 time: 0.383672 Jul 20 04:34:44.817283 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2678/5270] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1546 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:44.833431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-224e77ff-6212-4b0b-bd41-4a54e07a6dc0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.833939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-224e77ff-6212-4b0b-bd41-4a54e07a6dc0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.842361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-224e77ff-6212-4b0b-bd41-4a54e07a6dc0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.843080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-224e77ff-6212-4b0b-bd41-4a54e07a6dc0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.844108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-224e77ff-6212-4b0b-bd41-4a54e07a6dc0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.845526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-224e77ff-6212-4b0b-bd41-4a54e07a6dc0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.898195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0be71088-15ad-42e1-8167-7a4f7d2b5982 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.930594 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0be71088-15ad-42e1-8167-7a4f7d2b5982 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1665 microversion: 2.1 time: 0.578363 Jul 20 04:34:44.931220 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2593/5271] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1665 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:44.993606 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-224e77ff-6212-4b0b-bd41-4a54e07a6dc0 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163976 Jul 20 04:34:44.995675 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2679/5272] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:45.368916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1bebbf90-42af-44b5-9af0-247981b4d95c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.369797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1bebbf90-42af-44b5-9af0-247981b4d95c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.396100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bebbf90-42af-44b5-9af0-247981b4d95c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.396683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bebbf90-42af-44b5-9af0-247981b4d95c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.398683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bebbf90-42af-44b5-9af0-247981b4d95c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.401054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bebbf90-42af-44b5-9af0-247981b4d95c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.453310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d27ceb84-56ee-4693-8a8d-7e994b695e75 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.453934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d27ceb84-56ee-4693-8a8d-7e994b695e75 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.489255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d27ceb84-56ee-4693-8a8d-7e994b695e75 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.489775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d27ceb84-56ee-4693-8a8d-7e994b695e75 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.490574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d27ceb84-56ee-4693-8a8d-7e994b695e75 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.491026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d27ceb84-56ee-4693-8a8d-7e994b695e75 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.823690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1bebbf90-42af-44b5-9af0-247981b4d95c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:45.828294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:45.839438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1bebbf90-42af-44b5-9af0-247981b4d95c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:45.853933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1bebbf90-42af-44b5-9af0-247981b4d95c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:45.856003 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1bebbf90-42af-44b5-9af0-247981b4d95c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.490590 Jul 20 04:34:45.857111 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2594/5273] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:45 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:45.950365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5e451243-7e7b-4554-a9d7-008e8f21edc3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.952338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5e451243-7e7b-4554-a9d7-008e8f21edc3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.966941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e451243-7e7b-4554-a9d7-008e8f21edc3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.968566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e451243-7e7b-4554-a9d7-008e8f21edc3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.971870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e451243-7e7b-4554-a9d7-008e8f21edc3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.972472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e451243-7e7b-4554-a9d7-008e8f21edc3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:46.445449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d27ceb84-56ee-4693-8a8d-7e994b695e75 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:46.462004 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d27ceb84-56ee-4693-8a8d-7e994b695e75 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1512 microversion: 2.1 time: 1.011521 Jul 20 04:34:46.463382 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2680/5274] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:45 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1512 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:46.625647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:46.726632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5e451243-7e7b-4554-a9d7-008e8f21edc3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:46.740821 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5e451243-7e7b-4554-a9d7-008e8f21edc3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.796146 Jul 20 04:34:46.745538 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2595/5275] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:45 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:46.762130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f9a1617f-75be-4b2a-b4cc-5192d75a34db tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:46.762739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f9a1617f-75be-4b2a-b4cc-5192d75a34db tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:46.773598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9a1617f-75be-4b2a-b4cc-5192d75a34db tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:46.774577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9a1617f-75be-4b2a-b4cc-5192d75a34db tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:46.776498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9a1617f-75be-4b2a-b4cc-5192d75a34db tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:46.811015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9a1617f-75be-4b2a-b4cc-5192d75a34db tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:46.877451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-29650eee-1ce6-4745-9223-de9bcfbe62a4 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:46.877972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-29650eee-1ce6-4745-9223-de9bcfbe62a4 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:46.891058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29650eee-1ce6-4745-9223-de9bcfbe62a4 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:46.891830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29650eee-1ce6-4745-9223-de9bcfbe62a4 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:46.892825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29650eee-1ce6-4745-9223-de9bcfbe62a4 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:46.893439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29650eee-1ce6-4745-9223-de9bcfbe62a4 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.060497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-29650eee-1ce6-4745-9223-de9bcfbe62a4 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:47.070930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-29650eee-1ce6-4745-9223-de9bcfbe62a4 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:47.076566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-29650eee-1ce6-4745-9223-de9bcfbe62a4 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:47.083136 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-29650eee-1ce6-4745-9223-de9bcfbe62a4 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.210345 Jul 20 04:34:47.084390 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2596/5276] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:46 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:34:47.236122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f9a1617f-75be-4b2a-b4cc-5192d75a34db tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:47.252994 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f9a1617f-75be-4b2a-b4cc-5192d75a34db tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.494990 Jul 20 04:34:47.253684 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2681/5277] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:46 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:47.269796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:47.276809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-22a29641-a6d8-4c26-a9cf-4dbd90cbb99d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:47.278355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-22a29641-a6d8-4c26-a9cf-4dbd90cbb99d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:47.287022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22a29641-a6d8-4c26-a9cf-4dbd90cbb99d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.288532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22a29641-a6d8-4c26-a9cf-4dbd90cbb99d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.289928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22a29641-a6d8-4c26-a9cf-4dbd90cbb99d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.290692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22a29641-a6d8-4c26-a9cf-4dbd90cbb99d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.486621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-78b4e77e-66af-42cd-931f-8b42ba21c647 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:47.491139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-78b4e77e-66af-42cd-931f-8b42ba21c647 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:47.516641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78b4e77e-66af-42cd-931f-8b42ba21c647 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.517121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78b4e77e-66af-42cd-931f-8b42ba21c647 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.517937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78b4e77e-66af-42cd-931f-8b42ba21c647 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.518389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78b4e77e-66af-42cd-931f-8b42ba21c647 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.563957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:47.678353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-22a29641-a6d8-4c26-a9cf-4dbd90cbb99d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:47.694344 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-22a29641-a6d8-4c26-a9cf-4dbd90cbb99d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.425204 Jul 20 04:34:47.695815 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2597/5278] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:47 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:47.711200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-339fbd88-9851-4616-b6a2-a781b48313b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:47.711840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-339fbd88-9851-4616-b6a2-a781b48313b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:47.721450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-339fbd88-9851-4616-b6a2-a781b48313b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.721906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-339fbd88-9851-4616-b6a2-a781b48313b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.722687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-339fbd88-9851-4616-b6a2-a781b48313b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.723123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-339fbd88-9851-4616-b6a2-a781b48313b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.774956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-78b4e77e-66af-42cd-931f-8b42ba21c647 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac8188b69c4089858c1fdc6fbdbf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb95832b0b941c98c6d555d2066ff3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:47.791729 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-78b4e77e-66af-42cd-931f-8b42ba21c647 tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 200 len: 1470 microversion: 2.1 time: 0.313792 Jul 20 04:34:47.806026 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2682/5279] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:47 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 1470 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:47.818873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6763a22b-9051-4313-a30a-6b24b8144cb0 req-37ac0199-21c1-4289-ae61-e0d259f1dcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f3226f-82c7-4e50-9a7d-ca0721979912", "name": "network-vif-deleted", "tag": "e8a977e2-08d6-4a53-9757-e0d3ee9db0ff"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:47.849076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6763a22b-9051-4313-a30a-6b24b8144cb0 req-37ac0199-21c1-4289-ae61-e0d259f1dcf6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.853066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6763a22b-9051-4313-a30a-6b24b8144cb0 req-37ac0199-21c1-4289-ae61-e0d259f1dcf6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.893384 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6763a22b-9051-4313-a30a-6b24b8144cb0 req-37ac0199-21c1-4289-ae61-e0d259f1dcf6 service nova] Creating event network-vif-deleted:e8a977e2-08d6-4a53-9757-e0d3ee9db0ff for instance a2f3226f-82c7-4e50-9a7d-ca0721979912 on n-h1-764485-11 Jul 20 04:34:47.927786 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6763a22b-9051-4313-a30a-6b24b8144cb0 req-37ac0199-21c1-4289-ae61-e0d259f1dcf6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104171 Jul 20 04:34:47.929457 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2683/5280] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:48.103234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-339fbd88-9851-4616-b6a2-a781b48313b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:48.104739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-94fd4b8a-93db-43be-9b19-e20d22b565d7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:48.105465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-94fd4b8a-93db-43be-9b19-e20d22b565d7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:48.139764 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-339fbd88-9851-4616-b6a2-a781b48313b5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.428218 Jul 20 04:34:48.141559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94fd4b8a-93db-43be-9b19-e20d22b565d7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.142907 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2598/5281] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:47 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:48.143397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94fd4b8a-93db-43be-9b19-e20d22b565d7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.144556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94fd4b8a-93db-43be-9b19-e20d22b565d7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.145281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94fd4b8a-93db-43be-9b19-e20d22b565d7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.166436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1bdfa20a-fa66-421f-b8be-2fbdcd76d2ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:48.167116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1bdfa20a-fa66-421f-b8be-2fbdcd76d2ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:48.184883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bdfa20a-fa66-421f-b8be-2fbdcd76d2ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.190696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bdfa20a-fa66-421f-b8be-2fbdcd76d2ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.196147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bdfa20a-fa66-421f-b8be-2fbdcd76d2ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.196147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bdfa20a-fa66-421f-b8be-2fbdcd76d2ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.498686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94fd4b8a-93db-43be-9b19-e20d22b565d7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:48.509526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94fd4b8a-93db-43be-9b19-e20d22b565d7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:48.521574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94fd4b8a-93db-43be-9b19-e20d22b565d7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:48.523122 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-94fd4b8a-93db-43be-9b19-e20d22b565d7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.424282 Jul 20 04:34:48.524222 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2684/5282] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:48 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:48.599797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1bdfa20a-fa66-421f-b8be-2fbdcd76d2ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:48.613878 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1bdfa20a-fa66-421f-b8be-2fbdcd76d2ce tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.458590 Jul 20 04:34:48.617074 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2599/5283] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:48 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:48.647478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da6edd91-99b0-4ae3-a319-1f0c488fa66f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:48.649122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-da6edd91-99b0-4ae3-a319-1f0c488fa66f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:48.673094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da6edd91-99b0-4ae3-a319-1f0c488fa66f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.673094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da6edd91-99b0-4ae3-a319-1f0c488fa66f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.692963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da6edd91-99b0-4ae3-a319-1f0c488fa66f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.704326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da6edd91-99b0-4ae3-a319-1f0c488fa66f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.783838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-da6edd91-99b0-4ae3-a319-1f0c488fa66f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lazy-loading 'flavor' on Instance uuid c037b53b-2303-44d0-bb77-c8fa405473bb {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:34:48.834578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c64aa362-8301-4c88-9ad7-95b7f12322df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:48.835908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c64aa362-8301-4c88-9ad7-95b7f12322df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] [instance: a2f3226f-82c7-4e50-9a7d-ca0721979912] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:48.865689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c64aa362-8301-4c88-9ad7-95b7f12322df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.868727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c64aa362-8301-4c88-9ad7-95b7f12322df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.873258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c64aa362-8301-4c88-9ad7-95b7f12322df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.881859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c64aa362-8301-4c88-9ad7-95b7f12322df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.922306 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-c64aa362-8301-4c88-9ad7-95b7f12322df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] HTTP exception thrown: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 could not be found. Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c64aa362-8301-4c88-9ad7-95b7f12322df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Request method failure captured: Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 HTTP/1.1 Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14T-XTTlS6fUv8HMEtviWRLeEZHVmmR7XoLjdY_MSZ-saaIoScK3eSGUDuyxI1rUk36L1G1Y45DiVSOp8Zto_4I-YBWqTrs6zJZlVAlEFdVw4-8GYSJAgKyWEfyWLiKIJIhWNYUvvp1gv1OREaXOoltTS6mnayk2dA-pXFX1UVGA9Ss Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2bb95832b0b941c98c6d555d2066ff3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2bb95832b0b941c98c6d555d2066ff3b"}]}] Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 2bb95832b0b941c98c6d555d2066ff3b Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874518806 Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c6ac8188b69c4089858c1fdc6fbdbf66 Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-1874518806-project Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 could not be found. Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a2f3226f-82c7-4e50-9a7d-ca0721979912'} Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 could not be found. Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 could not be found. Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:48.930089 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:48.958339 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:48.958339 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:48.958339 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:48.958339 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:48.958339 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:48.958339 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 could not be found. Jul 20 04:34:48.958339 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:34:48.961731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c64aa362-8301-4c88-9ad7-95b7f12322df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] Returning 404 to user: Instance a2f3226f-82c7-4e50-9a7d-ca0721979912 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:48.962929 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c64aa362-8301-4c88-9ad7-95b7f12322df tempest-ServersNegativeTestJSON-1874518806 tempest-ServersNegativeTestJSON-1874518806-project] 10.222.0.20 "GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912" status: 404 len: 111 microversion: 2.1 time: 0.132355 Jul 20 04:34:48.964302 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2600/5284] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:48 2022] GET /compute/v2.1/servers/a2f3226f-82c7-4e50-9a7d-ca0721979912 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:34:49.008684 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da6edd91-99b0-4ae3-a319-1f0c488fa66f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.375053 Jul 20 04:34:49.016335 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2685/5285] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:48 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:49.036620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd633dbe-9a3f-4f33-8cc9-5de7e679ad78 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:49.039316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cd633dbe-9a3f-4f33-8cc9-5de7e679ad78 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:49.049557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd633dbe-9a3f-4f33-8cc9-5de7e679ad78 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.050367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd633dbe-9a3f-4f33-8cc9-5de7e679ad78 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.052624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd633dbe-9a3f-4f33-8cc9-5de7e679ad78 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.054836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd633dbe-9a3f-4f33-8cc9-5de7e679ad78 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.516841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cd633dbe-9a3f-4f33-8cc9-5de7e679ad78 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:49.528733 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd633dbe-9a3f-4f33-8cc9-5de7e679ad78 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1677 microversion: 2.1 time: 0.505622 Jul 20 04:34:49.529945 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2601/5286] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:49 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1677 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:49.549658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-647a8f02-7780-486b-be3e-56e27093a811 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:49.551663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-647a8f02-7780-486b-be3e-56e27093a811 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:49.568045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-647a8f02-7780-486b-be3e-56e27093a811 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.570343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-647a8f02-7780-486b-be3e-56e27093a811 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.571425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-647a8f02-7780-486b-be3e-56e27093a811 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.575210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-647a8f02-7780-486b-be3e-56e27093a811 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.784539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-647a8f02-7780-486b-be3e-56e27093a811 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:49.798934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-647a8f02-7780-486b-be3e-56e27093a811 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:49.800943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-647a8f02-7780-486b-be3e-56e27093a811 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:49.802553 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-647a8f02-7780-486b-be3e-56e27093a811 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.258957 Jul 20 04:34:49.803944 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2686/5287] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:49 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:50.198471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-5f10c7ee-0582-42a5-a8c2-5eeda6141e81 req-5767bf64-cae5-4f06-a510-f2555cf5c6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d78226-707b-4d41-96ab-987874bee7fc", "tag": "2adb9264-1b58-4969-a23a-628daabb41ab"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:50.226430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5f10c7ee-0582-42a5-a8c2-5eeda6141e81 req-5767bf64-cae5-4f06-a510-f2555cf5c6c1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.228666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5f10c7ee-0582-42a5-a8c2-5eeda6141e81 req-5767bf64-cae5-4f06-a510-f2555cf5c6c1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.261609 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-5f10c7ee-0582-42a5-a8c2-5eeda6141e81 req-5767bf64-cae5-4f06-a510-f2555cf5c6c1 service nova] Creating event network-changed:2adb9264-1b58-4969-a23a-628daabb41ab for instance 62d78226-707b-4d41-96ab-987874bee7fc on n-h2-764485-11 Jul 20 04:34:50.273032 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-5f10c7ee-0582-42a5-a8c2-5eeda6141e81 req-5767bf64-cae5-4f06-a510-f2555cf5c6c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076982 Jul 20 04:34:50.273669 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2602/5288] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:50.551955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eda5a574-bca7-47d6-ac63-2bfb67c98b03 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:50.553116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eda5a574-bca7-47d6-ac63-2bfb67c98b03 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:50.573010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eda5a574-bca7-47d6-ac63-2bfb67c98b03 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.573477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eda5a574-bca7-47d6-ac63-2bfb67c98b03 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.574491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eda5a574-bca7-47d6-ac63-2bfb67c98b03 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.574946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eda5a574-bca7-47d6-ac63-2bfb67c98b03 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.835283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a35cf171-c5f9-4677-9bb3-ce6480a26899 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:50.843887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a35cf171-c5f9-4677-9bb3-ce6480a26899 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:50.852841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a35cf171-c5f9-4677-9bb3-ce6480a26899 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.853680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a35cf171-c5f9-4677-9bb3-ce6480a26899 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.854716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a35cf171-c5f9-4677-9bb3-ce6480a26899 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.855679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a35cf171-c5f9-4677-9bb3-ce6480a26899 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.993756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-eda5a574-bca7-47d6-ac63-2bfb67c98b03 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:51.002748 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eda5a574-bca7-47d6-ac63-2bfb67c98b03 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1660 microversion: 2.1 time: 0.455023 Jul 20 04:34:51.008233 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2687/5289] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:50 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1660 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:51.011732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a35cf171-c5f9-4677-9bb3-ce6480a26899 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:51.032327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a35cf171-c5f9-4677-9bb3-ce6480a26899 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:51.034455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a35cf171-c5f9-4677-9bb3-ce6480a26899 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:51.035091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1fea1f81-e78d-4ee9-9d97-a12fdc09e818 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:51.036068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1fea1f81-e78d-4ee9-9d97-a12fdc09e818 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:51.039370 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a35cf171-c5f9-4677-9bb3-ce6480a26899 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.215689 Jul 20 04:34:51.040247 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2603/5290] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:50 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:51.057120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fea1f81-e78d-4ee9-9d97-a12fdc09e818 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:51.057949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fea1f81-e78d-4ee9-9d97-a12fdc09e818 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:51.059057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fea1f81-e78d-4ee9-9d97-a12fdc09e818 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:51.059798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fea1f81-e78d-4ee9-9d97-a12fdc09e818 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:51.168658 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1fea1f81-e78d-4ee9-9d97-a12fdc09e818 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action" status: 202 len: 0 microversion: 2.1 time: 0.144888 Jul 20 04:34:51.175206 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2688/5291] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:51 2022] POST /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:51.179866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fdc0b769-bd66-4197-8561-c2e0005188fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:51.180618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fdc0b769-bd66-4197-8561-c2e0005188fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:51.191844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fdc0b769-bd66-4197-8561-c2e0005188fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:51.192412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fdc0b769-bd66-4197-8561-c2e0005188fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:51.195136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fdc0b769-bd66-4197-8561-c2e0005188fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:51.195965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fdc0b769-bd66-4197-8561-c2e0005188fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:51.678082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fdc0b769-bd66-4197-8561-c2e0005188fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:51.695549 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fdc0b769-bd66-4197-8561-c2e0005188fa tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1666 microversion: 2.1 time: 0.518399 Jul 20 04:34:51.700058 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2604/5292] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:51 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1666 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:52.071173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-66c57813-9817-4c04-8a13-99013140d242 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:52.078364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-66c57813-9817-4c04-8a13-99013140d242 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:52.116773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66c57813-9817-4c04-8a13-99013140d242 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.117478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66c57813-9817-4c04-8a13-99013140d242 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.125523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66c57813-9817-4c04-8a13-99013140d242 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.126378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66c57813-9817-4c04-8a13-99013140d242 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.303547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-66c57813-9817-4c04-8a13-99013140d242 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:52.315745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-66c57813-9817-4c04-8a13-99013140d242 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:52.330859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-66c57813-9817-4c04-8a13-99013140d242 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:52.332468 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-66c57813-9817-4c04-8a13-99013140d242 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.275649 Jul 20 04:34:52.350049 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2689/5293] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:52 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:52.717612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5e20b80-7caa-486d-85e7-9a0297cf8385 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:52.718474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c5e20b80-7caa-486d-85e7-9a0297cf8385 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:52.732176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5e20b80-7caa-486d-85e7-9a0297cf8385 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.734980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5e20b80-7caa-486d-85e7-9a0297cf8385 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.736110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5e20b80-7caa-486d-85e7-9a0297cf8385 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.736792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5e20b80-7caa-486d-85e7-9a0297cf8385 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.133226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c5e20b80-7caa-486d-85e7-9a0297cf8385 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:53.143281 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5e20b80-7caa-486d-85e7-9a0297cf8385 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1666 microversion: 2.1 time: 0.430685 Jul 20 04:34:53.159910 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2605/5294] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:52 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1666 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:53.354421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1cd02adf-a03a-4ffb-a2c5-06b6edea8f7c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:53.355958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1cd02adf-a03a-4ffb-a2c5-06b6edea8f7c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:53.370859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cd02adf-a03a-4ffb-a2c5-06b6edea8f7c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.372071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cd02adf-a03a-4ffb-a2c5-06b6edea8f7c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.376325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cd02adf-a03a-4ffb-a2c5-06b6edea8f7c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.378202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cd02adf-a03a-4ffb-a2c5-06b6edea8f7c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.506642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1cd02adf-a03a-4ffb-a2c5-06b6edea8f7c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:53.525733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1cd02adf-a03a-4ffb-a2c5-06b6edea8f7c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:53.527596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1cd02adf-a03a-4ffb-a2c5-06b6edea8f7c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:53.533169 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1cd02adf-a03a-4ffb-a2c5-06b6edea8f7c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.183579 Jul 20 04:34:53.534237 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2690/5295] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:53 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:54.165088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac4873a9-9b28-4363-9a6d-24d89ced859f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:54.166480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac4873a9-9b28-4363-9a6d-24d89ced859f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:54.178042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac4873a9-9b28-4363-9a6d-24d89ced859f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.179271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac4873a9-9b28-4363-9a6d-24d89ced859f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.191812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac4873a9-9b28-4363-9a6d-24d89ced859f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.192685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac4873a9-9b28-4363-9a6d-24d89ced859f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.575040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bce20232-8713-42e3-9de9-655bc5f61847 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:54.576642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bce20232-8713-42e3-9de9-655bc5f61847 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:54.592855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bce20232-8713-42e3-9de9-655bc5f61847 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.594274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bce20232-8713-42e3-9de9-655bc5f61847 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.595190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bce20232-8713-42e3-9de9-655bc5f61847 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.595678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bce20232-8713-42e3-9de9-655bc5f61847 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.817528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bce20232-8713-42e3-9de9-655bc5f61847 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:54.832672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bce20232-8713-42e3-9de9-655bc5f61847 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:54.837046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bce20232-8713-42e3-9de9-655bc5f61847 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:54.843008 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bce20232-8713-42e3-9de9-655bc5f61847 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.273387 Jul 20 04:34:54.849492 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2691/5296] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:54 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:34:54.887636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ac4873a9-9b28-4363-9a6d-24d89ced859f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:54.898578 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ac4873a9-9b28-4363-9a6d-24d89ced859f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1666 microversion: 2.1 time: 0.737823 Jul 20 04:34:54.901302 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2606/5297] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:54 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1666 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:55.867079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bd054a3d-d6bf-424c-b7bf-d1373051c98c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:55.867794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bd054a3d-d6bf-424c-b7bf-d1373051c98c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:55.882829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd054a3d-d6bf-424c-b7bf-d1373051c98c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:55.883498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd054a3d-d6bf-424c-b7bf-d1373051c98c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:55.888914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd054a3d-d6bf-424c-b7bf-d1373051c98c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:55.889546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd054a3d-d6bf-424c-b7bf-d1373051c98c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:55.923969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8de3a08f-ce2a-4d5f-9b04-f51b54708a84 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:55.931283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8de3a08f-ce2a-4d5f-9b04-f51b54708a84 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:55.939020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:55.956229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8de3a08f-ce2a-4d5f-9b04-f51b54708a84 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:55.958135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8de3a08f-ce2a-4d5f-9b04-f51b54708a84 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:55.961589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8de3a08f-ce2a-4d5f-9b04-f51b54708a84 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:55.963021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8de3a08f-ce2a-4d5f-9b04-f51b54708a84 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.036541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bd054a3d-d6bf-424c-b7bf-d1373051c98c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:56.046503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bd054a3d-d6bf-424c-b7bf-d1373051c98c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:56.048986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bd054a3d-d6bf-424c-b7bf-d1373051c98c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:56.050660 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bd054a3d-d6bf-424c-b7bf-d1373051c98c tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.188022 Jul 20 04:34:56.052825 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2692/5298] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:55 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:56.634202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8de3a08f-ce2a-4d5f-9b04-f51b54708a84 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:56.642778 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8de3a08f-ce2a-4d5f-9b04-f51b54708a84 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.729411 Jul 20 04:34:56.649857 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2607/5299] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:55 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:56.659744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-997f8466-3316-4b47-8dad-03f22f49134c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:56.660608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-997f8466-3316-4b47-8dad-03f22f49134c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:56.670950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-997f8466-3316-4b47-8dad-03f22f49134c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.671650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-997f8466-3316-4b47-8dad-03f22f49134c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.672643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-997f8466-3316-4b47-8dad-03f22f49134c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.673276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-997f8466-3316-4b47-8dad-03f22f49134c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.861582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-997f8466-3316-4b47-8dad-03f22f49134c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:56.869572 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-997f8466-3316-4b47-8dad-03f22f49134c tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1669 microversion: 2.1 time: 0.213842 Jul 20 04:34:56.871128 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2693/5300] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:56 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1669 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:56.888091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:56.888845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:56.895792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.896582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.897815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.898645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.936270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:34:56.944477 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.compute.api [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Working on deleting snapshot d2f64123-6780-4181-893f-c26f900d98ad from shelved instance... Jul 20 04:34:57.070759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9073bde-005b-4511-b855-36c9c5fa094b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:57.071314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9073bde-005b-4511-b855-36c9c5fa094b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:57.085678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9073bde-005b-4511-b855-36c9c5fa094b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.088141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9073bde-005b-4511-b855-36c9c5fa094b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.088967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9073bde-005b-4511-b855-36c9c5fa094b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.089634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9073bde-005b-4511-b855-36c9c5fa094b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.300047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9073bde-005b-4511-b855-36c9c5fa094b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:57.318547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9073bde-005b-4511-b855-36c9c5fa094b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:57.320504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9073bde-005b-4511-b855-36c9c5fa094b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:57.322027 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9073bde-005b-4511-b855-36c9c5fa094b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.255391 Jul 20 04:34:57.334701 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2694/5301] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:57 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:58.279762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Doing local delete in cell de97e2bb-c8a2-4715-aa13-5b0025147107(cell1) {{(pid=119807) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 20 04:34:58.282481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.283681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.284311 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.compute.api [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 20 04:34:58.293745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] deallocate_for_instance() {{(pid=119807) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 20 04:34:58.341947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-56ad6bc6-19ff-4616-9576-dd5b0df64b31 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:58.343115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-56ad6bc6-19ff-4616-9576-dd5b0df64b31 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:58.354703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56ad6bc6-19ff-4616-9576-dd5b0df64b31 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.355466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56ad6bc6-19ff-4616-9576-dd5b0df64b31 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.357016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56ad6bc6-19ff-4616-9576-dd5b0df64b31 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.357632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56ad6bc6-19ff-4616-9576-dd5b0df64b31 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.593755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-56ad6bc6-19ff-4616-9576-dd5b0df64b31 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.611501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-56ad6bc6-19ff-4616-9576-dd5b0df64b31 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.615883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-56ad6bc6-19ff-4616-9576-dd5b0df64b31 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.620078 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-56ad6bc6-19ff-4616-9576-dd5b0df64b31 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.282643 Jul 20 04:34:58.623836 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2695/5302] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:58 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:59.151624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-fd5fd5ee-d503-47b9-bd14-95ff0289c689 req-dd418bb2-1f9f-41ac-8d18-03a9b7c9458b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce4bdd8-5b00-422f-9d57-bddb9ceac19f", "name": "network-vif-deleted", "tag": "ded1351f-4cec-44a9-9f29-b24a7ae27ae8"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:59.157925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Updating instance_info_cache with network_info: [] {{(pid=119807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:34:59.206414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-fd5fd5ee-d503-47b9-bd14-95ff0289c689 req-dd418bb2-1f9f-41ac-8d18-03a9b7c9458b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.214145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-fd5fd5ee-d503-47b9-bd14-95ff0289c689 req-dd418bb2-1f9f-41ac-8d18-03a9b7c9458b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.275959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.compute.server_external_events [req-fd5fd5ee-d503-47b9-bd14-95ff0289c689 req-dd418bb2-1f9f-41ac-8d18-03a9b7c9458b service nova] Unable to find a host for instance fce4bdd8-5b00-422f-9d57-bddb9ceac19f. Dropping event network-vif-deleted {{(pid=119808) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:34:59.279974 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-fd5fd5ee-d503-47b9-bd14-95ff0289c689 req-dd418bb2-1f9f-41ac-8d18-03a9b7c9458b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.132401 Jul 20 04:34:59.290301 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2696/5303] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 143 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 04:34:59.642945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2c8eb2e5-7f42-48ae-8557-01fdbba6c8a1 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:59.651704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2c8eb2e5-7f42-48ae-8557-01fdbba6c8a1 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:59.662448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c8eb2e5-7f42-48ae-8557-01fdbba6c8a1 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.662917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c8eb2e5-7f42-48ae-8557-01fdbba6c8a1 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.667208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c8eb2e5-7f42-48ae-8557-01fdbba6c8a1 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.667700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c8eb2e5-7f42-48ae-8557-01fdbba6c8a1 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.820221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c8eb2e5-7f42-48ae-8557-01fdbba6c8a1 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:59.823732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:59.830215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c8eb2e5-7f42-48ae-8557-01fdbba6c8a1 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:59.832025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c8eb2e5-7f42-48ae-8557-01fdbba6c8a1 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:59.833530 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2c8eb2e5-7f42-48ae-8557-01fdbba6c8a1 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.194682 Jul 20 04:34:59.835388 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2697/5304] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:59 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:59.925382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:00.102334 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-855c0d38-7872-4eb9-a48a-4ebb851c2d6f tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 204 len: 0 microversion: 2.1 time: 3.213824 Jul 20 04:35:00.103385 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2608/5305] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:56 2022] DELETE /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 0 bytes in 3220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:00.117343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aced168f-ad86-46cc-acf7-801deccc5836 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.119134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aced168f-ad86-46cc-acf7-801deccc5836 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: fce4bdd8-5b00-422f-9d57-bddb9ceac19f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.128943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aced168f-ad86-46cc-acf7-801deccc5836 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.131634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aced168f-ad86-46cc-acf7-801deccc5836 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.133866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aced168f-ad86-46cc-acf7-801deccc5836 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.135007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aced168f-ad86-46cc-acf7-801deccc5836 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.159958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-aced168f-ad86-46cc-acf7-801deccc5836 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] HTTP exception thrown: Instance fce4bdd8-5b00-422f-9d57-bddb9ceac19f could not be found. Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aced168f-ad86-46cc-acf7-801deccc5836 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Request method failure captured: Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f HTTP/1.1 Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14NwtqXY4gJOJdaQfNhy2FGHL1vHP3OiKcVH-Gr5N9oC3B6qjABKjSyLs8P6SaKylJs19ApYqqg5fwES-KSkLNqcl2qKzDVVeJngnxSlM4ze5o2Ef233SlZPhPTfozKQmRa8qo1Tc7EzdNN77K3K55Vks8oY9WaU6RPAKu1A_e5bvFE Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 1be9144d8b214ecb8e416318d92b92ea Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1be9144d8b214ecb8e416318d92b92ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1be9144d8b214ecb8e416318d92b92ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1be9144d8b214ecb8e416318d92b92ea", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1be9144d8b214ecb8e416318d92b92ea"}]}] Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 1be9144d8b214ecb8e416318d92b92ea Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerActionsTestJSON-1421550179-project Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b559a8f5a1724682831d18c3f7ddfdf2 Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerActionsTestJSON-1421550179-project Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance fce4bdd8-5b00-422f-9d57-bddb9ceac19f could not be found. Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'fce4bdd8-5b00-422f-9d57-bddb9ceac19f'} Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce4bdd8-5b00-422f-9d57-bddb9ceac19f could not be found. Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce4bdd8-5b00-422f-9d57-bddb9ceac19f could not be found. Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:00.162918 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:00.169271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:00.169271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:00.169271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:00.169271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:00.169271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:00.169271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce4bdd8-5b00-422f-9d57-bddb9ceac19f could not be found. Jul 20 04:35:00.169271 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:00.170723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aced168f-ad86-46cc-acf7-801deccc5836 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Returning 404 to user: Instance fce4bdd8-5b00-422f-9d57-bddb9ceac19f could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:00.172038 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aced168f-ad86-46cc-acf7-801deccc5836 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f" status: 404 len: 111 microversion: 2.1 time: 0.063347 Jul 20 04:35:00.172569 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2698/5306] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:00 2022] GET /compute/v2.1/servers/fce4bdd8-5b00-422f-9d57-bddb9ceac19f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:00.181545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f39f06be-0523-49b9-a41c-0eb34f7b491a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.182675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f39f06be-0523-49b9-a41c-0eb34f7b491a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.198578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f39f06be-0523-49b9-a41c-0eb34f7b491a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.199089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f39f06be-0523-49b9-a41c-0eb34f7b491a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.205192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f39f06be-0523-49b9-a41c-0eb34f7b491a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.205666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f39f06be-0523-49b9-a41c-0eb34f7b491a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.294036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f39f06be-0523-49b9-a41c-0eb34f7b491a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:00.446236 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f39f06be-0523-49b9-a41c-0eb34f7b491a tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "DELETE /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 204 len: 0 microversion: 2.1 time: 0.268629 Jul 20 04:35:00.447702 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2609/5307] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:00 2022] DELETE /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:00.460977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0a8d54fb-c1b4-4580-9f4e-9e71da4a8edf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.465745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0a8d54fb-c1b4-4580-9f4e-9e71da4a8edf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.497134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a8d54fb-c1b4-4580-9f4e-9e71da4a8edf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.498892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a8d54fb-c1b4-4580-9f4e-9e71da4a8edf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.500669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a8d54fb-c1b4-4580-9f4e-9e71da4a8edf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.501665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a8d54fb-c1b4-4580-9f4e-9e71da4a8edf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.712125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0a8d54fb-c1b4-4580-9f4e-9e71da4a8edf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:00.725871 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0a8d54fb-c1b4-4580-9f4e-9e71da4a8edf tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1466 microversion: 2.1 time: 0.273237 Jul 20 04:35:00.726482 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2699/5308] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:00 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1466 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:00.854755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a7c9c5af-2835-4fe4-b177-093ddbda9a7b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.857142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a7c9c5af-2835-4fe4-b177-093ddbda9a7b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.867454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7c9c5af-2835-4fe4-b177-093ddbda9a7b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.868565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7c9c5af-2835-4fe4-b177-093ddbda9a7b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.869918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7c9c5af-2835-4fe4-b177-093ddbda9a7b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.874556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7c9c5af-2835-4fe4-b177-093ddbda9a7b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.095303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a7c9c5af-2835-4fe4-b177-093ddbda9a7b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:01.111184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a7c9c5af-2835-4fe4-b177-093ddbda9a7b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:01.117359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a7c9c5af-2835-4fe4-b177-093ddbda9a7b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:01.120930 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a7c9c5af-2835-4fe4-b177-093ddbda9a7b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.272448 Jul 20 04:35:01.126815 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2610/5309] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:00 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:01.748209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c8849b47-449a-4b6f-8fe2-c0c7ccb5bff5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:01.749587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c8849b47-449a-4b6f-8fe2-c0c7ccb5bff5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:01.761982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8849b47-449a-4b6f-8fe2-c0c7ccb5bff5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.763208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8849b47-449a-4b6f-8fe2-c0c7ccb5bff5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.766604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8849b47-449a-4b6f-8fe2-c0c7ccb5bff5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.767358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8849b47-449a-4b6f-8fe2-c0c7ccb5bff5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.012542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c8849b47-449a-4b6f-8fe2-c0c7ccb5bff5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:02.026110 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c8849b47-449a-4b6f-8fe2-c0c7ccb5bff5 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1466 microversion: 2.1 time: 0.286463 Jul 20 04:35:02.031174 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2700/5310] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:01 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1466 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:02.144122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-13fe805c-75db-4ccb-bffb-a26e18774941 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:02.146597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-13fe805c-75db-4ccb-bffb-a26e18774941 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:02.167266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-13fe805c-75db-4ccb-bffb-a26e18774941 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.173646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-13fe805c-75db-4ccb-bffb-a26e18774941 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.174892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-13fe805c-75db-4ccb-bffb-a26e18774941 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.176354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-13fe805c-75db-4ccb-bffb-a26e18774941 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.429842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-13fe805c-75db-4ccb-bffb-a26e18774941 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:02.439720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-13fe805c-75db-4ccb-bffb-a26e18774941 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:02.441233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-13fe805c-75db-4ccb-bffb-a26e18774941 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:02.447085 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-13fe805c-75db-4ccb-bffb-a26e18774941 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.307826 Jul 20 04:35:02.458563 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2611/5311] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:02 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:03.047931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c7019952-3871-4058-9879-a17af5d2550d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:03.049254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c7019952-3871-4058-9879-a17af5d2550d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:03.061368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:03.076625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7019952-3871-4058-9879-a17af5d2550d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.078648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7019952-3871-4058-9879-a17af5d2550d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.079769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7019952-3871-4058-9879-a17af5d2550d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.084187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7019952-3871-4058-9879-a17af5d2550d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.467478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-10209d40-1545-49ff-b976-6be32d301728 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:03.468344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-10209d40-1545-49ff-b976-6be32d301728 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:03.487322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10209d40-1545-49ff-b976-6be32d301728 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.487953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10209d40-1545-49ff-b976-6be32d301728 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.488865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10209d40-1545-49ff-b976-6be32d301728 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.489403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-10209d40-1545-49ff-b976-6be32d301728 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.815817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-10209d40-1545-49ff-b976-6be32d301728 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:03.828763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-10209d40-1545-49ff-b976-6be32d301728 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:03.831823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-10209d40-1545-49ff-b976-6be32d301728 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:03.837039 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-10209d40-1545-49ff-b976-6be32d301728 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.374293 Jul 20 04:35:03.837759 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2612/5312] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:03 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:03.876321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c7019952-3871-4058-9879-a17af5d2550d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:03.895858 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c7019952-3871-4058-9879-a17af5d2550d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1466 microversion: 2.1 time: 0.852005 Jul 20 04:35:03.911432 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2701/5313] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:03 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1466 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:04.337331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-72632a06-b5a7-4136-9edd-9680fc038768 req-e9e9100b-b124-407c-9e38-b6e0ab8ee03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62976333-e59c-48d3-8222-e07e6b0c043a", "name": "network-vif-deleted", "tag": "04eefcfd-30b6-44aa-a955-5d97ac50f367"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:04.350446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-72632a06-b5a7-4136-9edd-9680fc038768 req-e9e9100b-b124-407c-9e38-b6e0ab8ee03e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.350889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-72632a06-b5a7-4136-9edd-9680fc038768 req-e9e9100b-b124-407c-9e38-b6e0ab8ee03e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.403789 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-72632a06-b5a7-4136-9edd-9680fc038768 req-e9e9100b-b124-407c-9e38-b6e0ab8ee03e service nova] Creating event network-vif-deleted:04eefcfd-30b6-44aa-a955-5d97ac50f367 for instance 62976333-e59c-48d3-8222-e07e6b0c043a on n-h1-764485-11 Jul 20 04:35:04.423624 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-72632a06-b5a7-4136-9edd-9680fc038768 req-e9e9100b-b124-407c-9e38-b6e0ab8ee03e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086458 Jul 20 04:35:04.429048 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2613/5314] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:04.856333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e463b95a-ab00-4fd7-aa64-aa99f776f683 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:04.857610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e463b95a-ab00-4fd7-aa64-aa99f776f683 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:04.866975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e463b95a-ab00-4fd7-aa64-aa99f776f683 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.867712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e463b95a-ab00-4fd7-aa64-aa99f776f683 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.868850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e463b95a-ab00-4fd7-aa64-aa99f776f683 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.869457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e463b95a-ab00-4fd7-aa64-aa99f776f683 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.921842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bfc3fd58-3089-47f4-9569-f5ce50ed5820 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:04.923277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bfc3fd58-3089-47f4-9569-f5ce50ed5820 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:04.937953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfc3fd58-3089-47f4-9569-f5ce50ed5820 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.942759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfc3fd58-3089-47f4-9569-f5ce50ed5820 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.943895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfc3fd58-3089-47f4-9569-f5ce50ed5820 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.944444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfc3fd58-3089-47f4-9569-f5ce50ed5820 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.064849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e463b95a-ab00-4fd7-aa64-aa99f776f683 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:05.066775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfc3fd58-3089-47f4-9569-f5ce50ed5820 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.067578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bfc3fd58-3089-47f4-9569-f5ce50ed5820 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.069007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-bfc3fd58-3089-47f4-9569-f5ce50ed5820 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lazy-loading 'fault' on Instance uuid 62976333-e59c-48d3-8222-e07e6b0c043a {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:05.076679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e463b95a-ab00-4fd7-aa64-aa99f776f683 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:05.078266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e463b95a-ab00-4fd7-aa64-aa99f776f683 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:05.090731 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e463b95a-ab00-4fd7-aa64-aa99f776f683 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.238214 Jul 20 04:35:05.095470 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2702/5315] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:04 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:05.194879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bfc3fd58-3089-47f4-9569-f5ce50ed5820 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:05.207872 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bfc3fd58-3089-47f4-9569-f5ce50ed5820 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 200 len: 1304 microversion: 2.1 time: 0.292398 Jul 20 04:35:05.219094 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2614/5316] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:04 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 1304 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:06.113981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-366e8c5b-21ce-40a7-9736-8956cb179215 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:06.114607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-366e8c5b-21ce-40a7-9736-8956cb179215 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:06.139986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-366e8c5b-21ce-40a7-9736-8956cb179215 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.140449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-366e8c5b-21ce-40a7-9736-8956cb179215 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.141254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-366e8c5b-21ce-40a7-9736-8956cb179215 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.141701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-366e8c5b-21ce-40a7-9736-8956cb179215 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.227231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0f7b1c2-cdee-4401-aee0-5af7857a64bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:06.228528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e0f7b1c2-cdee-4401-aee0-5af7857a64bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: 62976333-e59c-48d3-8222-e07e6b0c043a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:06.245529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0f7b1c2-cdee-4401-aee0-5af7857a64bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.247614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0f7b1c2-cdee-4401-aee0-5af7857a64bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.251192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0f7b1c2-cdee-4401-aee0-5af7857a64bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.251942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0f7b1c2-cdee-4401-aee0-5af7857a64bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.286867 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e0f7b1c2-cdee-4401-aee0-5af7857a64bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] HTTP exception thrown: Instance 62976333-e59c-48d3-8222-e07e6b0c043a could not be found. Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0f7b1c2-cdee-4401-aee0-5af7857a64bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Request method failure captured: Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a HTTP/1.1 Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14NwtqXY4gJOJdaQfNhy2FGHL1vHP3OiKcVH-Gr5N9oC3B6qjABKjSyLs8P6SaKylJs19ApYqqg5fwES-KSkLNqcl2qKzDVVeJngnxSlM4ze5o2Ef233SlZPhPTfozKQmRa8qo1Tc7EzdNN77K3K55Vks8oY9WaU6RPAKu1A_e5bvFE Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1be9144d8b214ecb8e416318d92b92ea Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1be9144d8b214ecb8e416318d92b92ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1be9144d8b214ecb8e416318d92b92ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1be9144d8b214ecb8e416318d92b92ea", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1be9144d8b214ecb8e416318d92b92ea"}]}] Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1be9144d8b214ecb8e416318d92b92ea Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerActionsTestJSON-1421550179-project Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: b559a8f5a1724682831d18c3f7ddfdf2 Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerActionsTestJSON-1421550179-project Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 62976333-e59c-48d3-8222-e07e6b0c043a could not be found. Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '62976333-e59c-48d3-8222-e07e6b0c043a'} Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62976333-e59c-48d3-8222-e07e6b0c043a could not be found. Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62976333-e59c-48d3-8222-e07e6b0c043a could not be found. Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:06.288591 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:06.297862 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:06.297862 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:06.297862 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:06.297862 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:06.297862 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:06.297862 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62976333-e59c-48d3-8222-e07e6b0c043a could not be found. Jul 20 04:35:06.297862 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:06.297862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0f7b1c2-cdee-4401-aee0-5af7857a64bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Returning 404 to user: Instance 62976333-e59c-48d3-8222-e07e6b0c043a could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:06.297862 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e0f7b1c2-cdee-4401-aee0-5af7857a64bb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a" status: 404 len: 111 microversion: 2.1 time: 0.068477 Jul 20 04:35:06.297862 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2615/5317] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:06 2022] GET /compute/v2.1/servers/62976333-e59c-48d3-8222-e07e6b0c043a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:06.308423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a838d038-5d21-4b91-b4c8-03bafcc60286 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:06.313514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a838d038-5d21-4b91-b4c8-03bafcc60286 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:06.333234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a838d038-5d21-4b91-b4c8-03bafcc60286 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.333809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a838d038-5d21-4b91-b4c8-03bafcc60286 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.335741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a838d038-5d21-4b91-b4c8-03bafcc60286 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.336222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a838d038-5d21-4b91-b4c8-03bafcc60286 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.408608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a838d038-5d21-4b91-b4c8-03bafcc60286 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:06.557180 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a838d038-5d21-4b91-b4c8-03bafcc60286 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 204 len: 0 microversion: 2.1 time: 0.259886 Jul 20 04:35:06.562562 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2616/5318] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:06 2022] DELETE /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:35:06.588415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e56488bf-66c2-42d4-ac1f-4c3016c73e01 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:06.589703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e56488bf-66c2-42d4-ac1f-4c3016c73e01 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:06.609418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e56488bf-66c2-42d4-ac1f-4c3016c73e01 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.610165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e56488bf-66c2-42d4-ac1f-4c3016c73e01 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.611254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e56488bf-66c2-42d4-ac1f-4c3016c73e01 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.611895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e56488bf-66c2-42d4-ac1f-4c3016c73e01 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.807305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-366e8c5b-21ce-40a7-9736-8956cb179215 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:06.819020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-366e8c5b-21ce-40a7-9736-8956cb179215 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:06.842202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-366e8c5b-21ce-40a7-9736-8956cb179215 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:06.843632 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-366e8c5b-21ce-40a7-9736-8956cb179215 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.733643 Jul 20 04:35:06.857488 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2703/5319] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:06 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:07.382485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e56488bf-66c2-42d4-ac1f-4c3016c73e01 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:07.395345 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e56488bf-66c2-42d4-ac1f-4c3016c73e01 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1508 microversion: 2.1 time: 0.827357 Jul 20 04:35:07.395983 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2617/5320] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:06 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1508 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:07.864373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e0366eb0-26bc-4008-ad31-0fc76ccdf5dd tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:07.866075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e0366eb0-26bc-4008-ad31-0fc76ccdf5dd tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:07.877707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0366eb0-26bc-4008-ad31-0fc76ccdf5dd tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:07.881997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0366eb0-26bc-4008-ad31-0fc76ccdf5dd tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:07.883092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0366eb0-26bc-4008-ad31-0fc76ccdf5dd tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:07.884611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0366eb0-26bc-4008-ad31-0fc76ccdf5dd tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.428703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b3ea2159-0a3d-42f1-b41f-5847cbd4f422 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:08.429342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b3ea2159-0a3d-42f1-b41f-5847cbd4f422 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:08.438613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e0366eb0-26bc-4008-ad31-0fc76ccdf5dd tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:08.450635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3ea2159-0a3d-42f1-b41f-5847cbd4f422 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:08.453370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3ea2159-0a3d-42f1-b41f-5847cbd4f422 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.454557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e0366eb0-26bc-4008-ad31-0fc76ccdf5dd tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:08.456597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3ea2159-0a3d-42f1-b41f-5847cbd4f422 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:08.457442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3ea2159-0a3d-42f1-b41f-5847cbd4f422 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.459625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e0366eb0-26bc-4008-ad31-0fc76ccdf5dd tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:08.473062 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e0366eb0-26bc-4008-ad31-0fc76ccdf5dd tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.603101 Jul 20 04:35:08.474020 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2704/5321] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:07 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:08.688323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b3ea2159-0a3d-42f1-b41f-5847cbd4f422 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:08.701982 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b3ea2159-0a3d-42f1-b41f-5847cbd4f422 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 200 len: 1466 microversion: 2.1 time: 0.291128 Jul 20 04:35:08.704480 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2618/5322] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:08 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 1466 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:08.881694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ab8650d1-fae6-4c69-9344-2a96844f6e24 req-40ab892c-6895-4d45-b54f-0995a3ae6d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff0a57fe-dc37-41d4-b516-8f3589bc54bd", "name": "network-vif-deleted", "tag": "bd187d04-ead6-4418-b4a8-75497697df42"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:08.917576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ab8650d1-fae6-4c69-9344-2a96844f6e24 req-40ab892c-6895-4d45-b54f-0995a3ae6d21 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:08.921535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ab8650d1-fae6-4c69-9344-2a96844f6e24 req-40ab892c-6895-4d45-b54f-0995a3ae6d21 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.965862 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ab8650d1-fae6-4c69-9344-2a96844f6e24 req-40ab892c-6895-4d45-b54f-0995a3ae6d21 service nova] Creating event network-vif-deleted:bd187d04-ead6-4418-b4a8-75497697df42 for instance ff0a57fe-dc37-41d4-b516-8f3589bc54bd on n-h1-764485-11 Jul 20 04:35:08.986672 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ab8650d1-fae6-4c69-9344-2a96844f6e24 req-40ab892c-6895-4d45-b54f-0995a3ae6d21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109129 Jul 20 04:35:08.993668 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2705/5323] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:09.494771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-102a3bd5-8b3e-48bb-979c-b6169a38b79b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:09.495447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-102a3bd5-8b3e-48bb-979c-b6169a38b79b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:09.513476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-102a3bd5-8b3e-48bb-979c-b6169a38b79b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.516437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-102a3bd5-8b3e-48bb-979c-b6169a38b79b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.518103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-102a3bd5-8b3e-48bb-979c-b6169a38b79b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.521338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-102a3bd5-8b3e-48bb-979c-b6169a38b79b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.723451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10497bc0-51fb-43d5-ae93-7eb633751d81 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:09.724470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-10497bc0-51fb-43d5-ae93-7eb633751d81 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: ff0a57fe-dc37-41d4-b516-8f3589bc54bd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:09.747320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10497bc0-51fb-43d5-ae93-7eb633751d81 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.754003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10497bc0-51fb-43d5-ae93-7eb633751d81 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.755318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10497bc0-51fb-43d5-ae93-7eb633751d81 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.757424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10497bc0-51fb-43d5-ae93-7eb633751d81 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.807077 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-10497bc0-51fb-43d5-ae93-7eb633751d81 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] HTTP exception thrown: Instance ff0a57fe-dc37-41d4-b516-8f3589bc54bd could not be found. Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10497bc0-51fb-43d5-ae93-7eb633751d81 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Request method failure captured: Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd HTTP/1.1 Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14NwtqXY4gJOJdaQfNhy2FGHL1vHP3OiKcVH-Gr5N9oC3B6qjABKjSyLs8P6SaKylJs19ApYqqg5fwES-KSkLNqcl2qKzDVVeJngnxSlM4ze5o2Ef233SlZPhPTfozKQmRa8qo1Tc7EzdNN77K3K55Vks8oY9WaU6RPAKu1A_e5bvFE Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 1be9144d8b214ecb8e416318d92b92ea Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1be9144d8b214ecb8e416318d92b92ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1be9144d8b214ecb8e416318d92b92ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1be9144d8b214ecb8e416318d92b92ea", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1be9144d8b214ecb8e416318d92b92ea"}]}] Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 1be9144d8b214ecb8e416318d92b92ea Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerActionsTestJSON-1421550179-project Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b559a8f5a1724682831d18c3f7ddfdf2 Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerActionsTestJSON-1421550179-project Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance ff0a57fe-dc37-41d4-b516-8f3589bc54bd could not be found. Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ff0a57fe-dc37-41d4-b516-8f3589bc54bd'} Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff0a57fe-dc37-41d4-b516-8f3589bc54bd could not be found. Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff0a57fe-dc37-41d4-b516-8f3589bc54bd could not be found. Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:09.811569 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:09.816476 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:09.816476 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:09.816476 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:09.816476 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:09.816476 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:09.816476 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff0a57fe-dc37-41d4-b516-8f3589bc54bd could not be found. Jul 20 04:35:09.816476 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:09.821752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10497bc0-51fb-43d5-ae93-7eb633751d81 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Returning 404 to user: Instance ff0a57fe-dc37-41d4-b516-8f3589bc54bd could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:09.822819 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-10497bc0-51fb-43d5-ae93-7eb633751d81 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd" status: 404 len: 111 microversion: 2.1 time: 0.105045 Jul 20 04:35:09.825553 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2706/5324] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:09 2022] GET /compute/v2.1/servers/ff0a57fe-dc37-41d4-b516-8f3589bc54bd => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:09.835425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c5ec5ff5-c9ef-4bab-9aae-7151649f6d2d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:09.837971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c5ec5ff5-c9ef-4bab-9aae-7151649f6d2d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:09.838699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-102a3bd5-8b3e-48bb-979c-b6169a38b79b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:09.854105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-102a3bd5-8b3e-48bb-979c-b6169a38b79b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:09.860714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5ec5ff5-c9ef-4bab-9aae-7151649f6d2d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.861416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5ec5ff5-c9ef-4bab-9aae-7151649f6d2d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.862425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5ec5ff5-c9ef-4bab-9aae-7151649f6d2d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.863750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5ec5ff5-c9ef-4bab-9aae-7151649f6d2d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.875417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-102a3bd5-8b3e-48bb-979c-b6169a38b79b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:09.884204 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-102a3bd5-8b3e-48bb-979c-b6169a38b79b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.393086 Jul 20 04:35:09.895668 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2619/5325] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:09 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:09.951151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c5ec5ff5-c9ef-4bab-9aae-7151649f6d2d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:10.091218 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c5ec5ff5-c9ef-4bab-9aae-7151649f6d2d tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 204 len: 0 microversion: 2.1 time: 0.262465 Jul 20 04:35:10.092589 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2707/5326] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:09 2022] DELETE /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:10.102742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7d5bfa8b-98ee-42f7-8022-dece0d49f212 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:10.103949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7d5bfa8b-98ee-42f7-8022-dece0d49f212 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:10.113172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d5bfa8b-98ee-42f7-8022-dece0d49f212 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.114091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d5bfa8b-98ee-42f7-8022-dece0d49f212 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.115222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d5bfa8b-98ee-42f7-8022-dece0d49f212 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.116035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d5bfa8b-98ee-42f7-8022-dece0d49f212 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.905744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4f75ae29-9821-46dd-a783-74dfb6e54851 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:10.906770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4f75ae29-9821-46dd-a783-74dfb6e54851 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:10.919849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f75ae29-9821-46dd-a783-74dfb6e54851 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.920771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f75ae29-9821-46dd-a783-74dfb6e54851 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.922949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f75ae29-9821-46dd-a783-74dfb6e54851 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.923611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f75ae29-9821-46dd-a783-74dfb6e54851 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:11.029200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7d5bfa8b-98ee-42f7-8022-dece0d49f212 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:11.037178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:11.041764 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7d5bfa8b-98ee-42f7-8022-dece0d49f212 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1495 microversion: 2.1 time: 0.944896 Jul 20 04:35:11.045684 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2620/5327] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:10 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1495 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:11.178429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4f75ae29-9821-46dd-a783-74dfb6e54851 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:11.196166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4f75ae29-9821-46dd-a783-74dfb6e54851 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:11.204252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4f75ae29-9821-46dd-a783-74dfb6e54851 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:11.211901 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4f75ae29-9821-46dd-a783-74dfb6e54851 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.310660 Jul 20 04:35:11.213138 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2708/5328] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:10 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:12.010765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-47f8a893-9ae4-4677-89ff-6a4de0722a9a req-9c59c7a6-3114-4af3-a3c1-0767de1dae5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48738f5-dd70-4d38-ae59-ddd1b3a03c36", "name": "network-vif-deleted", "tag": "833ba1d8-16e2-493c-ab15-8538117a4f3b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:12.063252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-55874c71-dae7-484d-a27e-63a18c71f362 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:12.064568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-55874c71-dae7-484d-a27e-63a18c71f362 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:12.064704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-47f8a893-9ae4-4677-89ff-6a4de0722a9a req-9c59c7a6-3114-4af3-a3c1-0767de1dae5e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.075647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-47f8a893-9ae4-4677-89ff-6a4de0722a9a req-9c59c7a6-3114-4af3-a3c1-0767de1dae5e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.088397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55874c71-dae7-484d-a27e-63a18c71f362 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.089166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55874c71-dae7-484d-a27e-63a18c71f362 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.104073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55874c71-dae7-484d-a27e-63a18c71f362 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.104984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55874c71-dae7-484d-a27e-63a18c71f362 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.172337 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-47f8a893-9ae4-4677-89ff-6a4de0722a9a req-9c59c7a6-3114-4af3-a3c1-0767de1dae5e service nova] Creating event network-vif-deleted:833ba1d8-16e2-493c-ab15-8538117a4f3b for instance a48738f5-dd70-4d38-ae59-ddd1b3a03c36 on n-h1-764485-11 Jul 20 04:35:12.210222 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-47f8a893-9ae4-4677-89ff-6a4de0722a9a req-9c59c7a6-3114-4af3-a3c1-0767de1dae5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208360 Jul 20 04:35:12.212293 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2621/5329] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:12.252011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-52eb5b69-9ac4-4f1c-b71e-e3a55a6551df tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:12.253012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-52eb5b69-9ac4-4f1c-b71e-e3a55a6551df tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:12.294289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52eb5b69-9ac4-4f1c-b71e-e3a55a6551df tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.294748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52eb5b69-9ac4-4f1c-b71e-e3a55a6551df tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.300456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52eb5b69-9ac4-4f1c-b71e-e3a55a6551df tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.301950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-52eb5b69-9ac4-4f1c-b71e-e3a55a6551df tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.318484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-55874c71-dae7-484d-a27e-63a18c71f362 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:12.332609 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-55874c71-dae7-484d-a27e-63a18c71f362 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 200 len: 1286 microversion: 2.1 time: 0.273770 Jul 20 04:35:12.347362 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2709/5330] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:12 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 1286 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:12.506643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-52eb5b69-9ac4-4f1c-b71e-e3a55a6551df tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:12.526540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-52eb5b69-9ac4-4f1c-b71e-e3a55a6551df tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:12.528859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-52eb5b69-9ac4-4f1c-b71e-e3a55a6551df tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:12.530114 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-52eb5b69-9ac4-4f1c-b71e-e3a55a6551df tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.292906 Jul 20 04:35:12.530852 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2622/5331] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:12 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:13.352735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4a4eea82-defb-4155-ac0f-f69988b951c6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:13.354582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4a4eea82-defb-4155-ac0f-f69988b951c6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: a48738f5-dd70-4d38-ae59-ddd1b3a03c36] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:13.379374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a4eea82-defb-4155-ac0f-f69988b951c6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.384120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a4eea82-defb-4155-ac0f-f69988b951c6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.385627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a4eea82-defb-4155-ac0f-f69988b951c6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.389212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a4eea82-defb-4155-ac0f-f69988b951c6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.442044 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-4a4eea82-defb-4155-ac0f-f69988b951c6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] HTTP exception thrown: Instance a48738f5-dd70-4d38-ae59-ddd1b3a03c36 could not be found. Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4a4eea82-defb-4155-ac0f-f69988b951c6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Request method failure captured: Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 HTTP/1.1 Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14NwtqXY4gJOJdaQfNhy2FGHL1vHP3OiKcVH-Gr5N9oC3B6qjABKjSyLs8P6SaKylJs19ApYqqg5fwES-KSkLNqcl2qKzDVVeJngnxSlM4ze5o2Ef233SlZPhPTfozKQmRa8qo1Tc7EzdNN77K3K55Vks8oY9WaU6RPAKu1A_e5bvFE Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 1be9144d8b214ecb8e416318d92b92ea Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1be9144d8b214ecb8e416318d92b92ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1be9144d8b214ecb8e416318d92b92ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1be9144d8b214ecb8e416318d92b92ea", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1be9144d8b214ecb8e416318d92b92ea"}]}] Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 1be9144d8b214ecb8e416318d92b92ea Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerActionsTestJSON-1421550179-project Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b559a8f5a1724682831d18c3f7ddfdf2 Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerActionsTestJSON-1421550179-project Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance a48738f5-dd70-4d38-ae59-ddd1b3a03c36 could not be found. Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a48738f5-dd70-4d38-ae59-ddd1b3a03c36'} Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48738f5-dd70-4d38-ae59-ddd1b3a03c36 could not be found. Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48738f5-dd70-4d38-ae59-ddd1b3a03c36 could not be found. Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:13.451862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:13.457071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:13.457071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:13.457071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:13.457071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:13.457071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:13.457071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48738f5-dd70-4d38-ae59-ddd1b3a03c36 could not be found. Jul 20 04:35:13.457071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:13.457071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4a4eea82-defb-4155-ac0f-f69988b951c6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Returning 404 to user: Instance a48738f5-dd70-4d38-ae59-ddd1b3a03c36 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:13.457071 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4a4eea82-defb-4155-ac0f-f69988b951c6 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36" status: 404 len: 111 microversion: 2.1 time: 0.105704 Jul 20 04:35:13.463835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9f652568-914b-4d3f-a8d0-6288e60edf08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:13.465020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9f652568-914b-4d3f-a8d0-6288e60edf08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:13.466320 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2710/5332] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:13 2022] GET /compute/v2.1/servers/a48738f5-dd70-4d38-ae59-ddd1b3a03c36 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:13.505685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f652568-914b-4d3f-a8d0-6288e60edf08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.512101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f652568-914b-4d3f-a8d0-6288e60edf08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.514434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f652568-914b-4d3f-a8d0-6288e60edf08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.520471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f652568-914b-4d3f-a8d0-6288e60edf08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.550342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88443e0c-7028-49a1-a404-612800f606b7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:13.551133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88443e0c-7028-49a1-a404-612800f606b7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:13.561166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88443e0c-7028-49a1-a404-612800f606b7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.561741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88443e0c-7028-49a1-a404-612800f606b7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.562652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88443e0c-7028-49a1-a404-612800f606b7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.563596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88443e0c-7028-49a1-a404-612800f606b7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.610283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9f652568-914b-4d3f-a8d0-6288e60edf08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:13.939359 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9f652568-914b-4d3f-a8d0-6288e60edf08 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 204 len: 0 microversion: 2.1 time: 0.480006 Jul 20 04:35:13.943029 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2623/5333] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:13 2022] DELETE /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:13.956857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bd9ac47a-38ed-4770-8d3d-610d9dc676fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:13.957511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bd9ac47a-38ed-4770-8d3d-610d9dc676fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:13.960590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88443e0c-7028-49a1-a404-612800f606b7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:13.973288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88443e0c-7028-49a1-a404-612800f606b7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:13.977022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88443e0c-7028-49a1-a404-612800f606b7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:13.979576 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88443e0c-7028-49a1-a404-612800f606b7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.433780 Jul 20 04:35:13.982910 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2711/5334] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:13 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:13.993746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd9ac47a-38ed-4770-8d3d-610d9dc676fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.999020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd9ac47a-38ed-4770-8d3d-610d9dc676fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:14.004228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd9ac47a-38ed-4770-8d3d-610d9dc676fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:14.005669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd9ac47a-38ed-4770-8d3d-610d9dc676fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:14.645039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bd9ac47a-38ed-4770-8d3d-610d9dc676fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:14.657882 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bd9ac47a-38ed-4770-8d3d-610d9dc676fe tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1675 microversion: 2.1 time: 0.707778 Jul 20 04:35:14.662808 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2624/5335] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:13 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1675 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:15.003831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0e927d25-003a-4534-98dd-0c08b2daa72a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:15.004459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0e927d25-003a-4534-98dd-0c08b2daa72a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:15.020028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e927d25-003a-4534-98dd-0c08b2daa72a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:15.020399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e927d25-003a-4534-98dd-0c08b2daa72a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:15.021193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e927d25-003a-4534-98dd-0c08b2daa72a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:15.021637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e927d25-003a-4534-98dd-0c08b2daa72a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:15.173172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0e927d25-003a-4534-98dd-0c08b2daa72a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:15.186447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0e927d25-003a-4534-98dd-0c08b2daa72a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:15.188028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0e927d25-003a-4534-98dd-0c08b2daa72a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:15.193577 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0e927d25-003a-4534-98dd-0c08b2daa72a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.194114 Jul 20 04:35:15.206824 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2712/5336] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:14 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:15.681198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd57e750-6cfd-497e-abe4-447f05df2ebb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:15.681973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cd57e750-6cfd-497e-abe4-447f05df2ebb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:15.709536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd57e750-6cfd-497e-abe4-447f05df2ebb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:15.710551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd57e750-6cfd-497e-abe4-447f05df2ebb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:15.714271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd57e750-6cfd-497e-abe4-447f05df2ebb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:15.719446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd57e750-6cfd-497e-abe4-447f05df2ebb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.128618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b66a52ad-d438-46fb-92a1-747340321dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:16.129233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b66a52ad-d438-46fb-92a1-747340321dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:16.137355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b66a52ad-d438-46fb-92a1-747340321dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:16.137823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b66a52ad-d438-46fb-92a1-747340321dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.138619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b66a52ad-d438-46fb-92a1-747340321dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:16.139069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b66a52ad-d438-46fb-92a1-747340321dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.269522 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b66a52ad-d438-46fb-92a1-747340321dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments/84d8b537-461f-4b36-8d33-ebacc1fb1c38" status: 200 len: 194 microversion: 2.20 time: 0.144608 Jul 20 04:35:16.269900 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2713/5337] 10.222.0.20 () {60 vars in 1453 bytes} [Wed Jul 20 04:35:16 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments/84d8b537-461f-4b36-8d33-ebacc1fb1c38 => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:35:16.293663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d29e5112-d7f2-4962-92c4-0cc3fde24d26 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:16.298245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d29e5112-d7f2-4962-92c4-0cc3fde24d26 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:16.322495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d29e5112-d7f2-4962-92c4-0cc3fde24d26 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:16.324610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d29e5112-d7f2-4962-92c4-0cc3fde24d26 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.334070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d29e5112-d7f2-4962-92c4-0cc3fde24d26 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:16.334784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d29e5112-d7f2-4962-92c4-0cc3fde24d26 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.521509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d29e5112-d7f2-4962-92c4-0cc3fde24d26 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:16.535955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d29e5112-d7f2-4962-92c4-0cc3fde24d26 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:16.540333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d29e5112-d7f2-4962-92c4-0cc3fde24d26 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:16.541814 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d29e5112-d7f2-4962-92c4-0cc3fde24d26 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1366 microversion: 2.57 time: 0.270957 Jul 20 04:35:16.545040 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2714/5338] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:16 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:16.563764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8562caad-375e-4134-976c-75e8bcb5ab53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:16.564948 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8562caad-375e-4134-976c-75e8bcb5ab53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:16.572784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8562caad-375e-4134-976c-75e8bcb5ab53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:16.575101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8562caad-375e-4134-976c-75e8bcb5ab53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.577488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8562caad-375e-4134-976c-75e8bcb5ab53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:16.578139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8562caad-375e-4134-976c-75e8bcb5ab53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.638243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:16.724668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cd57e750-6cfd-497e-abe4-447f05df2ebb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:16.744495 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd57e750-6cfd-497e-abe4-447f05df2ebb tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1675 microversion: 2.1 time: 1.068076 Jul 20 04:35:16.751146 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2625/5339] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:15 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1675 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:16.851410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-8562caad-375e-4134-976c-75e8bcb5ab53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lazy-loading 'services' on Instance uuid c76d5764-986d-4d3f-806f-1f8b1c5a73c1 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:17.030500 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8562caad-375e-4134-976c-75e8bcb5ab53 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments/84d8b537-461f-4b36-8d33-ebacc1fb1c38" status: 202 len: 0 microversion: 2.20 time: 0.483972 Jul 20 04:35:17.031124 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2715/5340] 10.222.0.20 () {60 vars in 1456 bytes} [Wed Jul 20 04:35:16 2022] DELETE /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments/84d8b537-461f-4b36-8d33-ebacc1fb1c38 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:17.050911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-246fb520-1132-4a3b-95d1-801fa2d75814 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:17.054073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-246fb520-1132-4a3b-95d1-801fa2d75814 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:17.074451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-246fb520-1132-4a3b-95d1-801fa2d75814 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.075283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-246fb520-1132-4a3b-95d1-801fa2d75814 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.076582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-246fb520-1132-4a3b-95d1-801fa2d75814 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.077205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-246fb520-1132-4a3b-95d1-801fa2d75814 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.166983 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-246fb520-1132-4a3b-95d1-801fa2d75814 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.127671 Jul 20 04:35:17.171809 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2626/5341] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:35:17 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:35:17.579743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ef292a2d-e87d-4837-a4a6-90e19dba154b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:17.582700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ef292a2d-e87d-4837-a4a6-90e19dba154b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:17.618748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef292a2d-e87d-4837-a4a6-90e19dba154b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.619261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef292a2d-e87d-4837-a4a6-90e19dba154b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.629568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef292a2d-e87d-4837-a4a6-90e19dba154b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.630203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef292a2d-e87d-4837-a4a6-90e19dba154b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.767316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5ab77b1c-0957-4ec9-957c-8eab2604525b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:17.768604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5ab77b1c-0957-4ec9-957c-8eab2604525b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:17.787432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ab77b1c-0957-4ec9-957c-8eab2604525b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.789533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ab77b1c-0957-4ec9-957c-8eab2604525b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.794847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ab77b1c-0957-4ec9-957c-8eab2604525b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.795327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ab77b1c-0957-4ec9-957c-8eab2604525b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.499297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5ab77b1c-0957-4ec9-957c-8eab2604525b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:19.512845 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5ab77b1c-0957-4ec9-957c-8eab2604525b tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1607 microversion: 2.1 time: 1.747774 Jul 20 04:35:19.514493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ef292a2d-e87d-4837-a4a6-90e19dba154b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:19.531634 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2627/5342] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:17 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1607 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:19.534616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ef292a2d-e87d-4837-a4a6-90e19dba154b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:19.537706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ef292a2d-e87d-4837-a4a6-90e19dba154b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:19.540275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e5286569-c7e6-40f4-a64a-fbe918741ab4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:19.541482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e5286569-c7e6-40f4-a64a-fbe918741ab4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:19.549278 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ef292a2d-e87d-4837-a4a6-90e19dba154b tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1372 microversion: 2.57 time: 1.987141 Jul 20 04:35:19.550289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5286569-c7e6-40f4-a64a-fbe918741ab4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.551067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5286569-c7e6-40f4-a64a-fbe918741ab4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.552153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5286569-c7e6-40f4-a64a-fbe918741ab4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.553251 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2716/5343] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:17 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1372 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:19.553954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5286569-c7e6-40f4-a64a-fbe918741ab4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.650586 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e5286569-c7e6-40f4-a64a-fbe918741ab4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116307 Jul 20 04:35:19.652664 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2628/5344] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:35:19 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:35:20.024371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-5f600c2b-0af1-48e0-88f0-641f9cf36bd4 req-69554c4a-bf37-41b3-9bd8-fdeebe81da29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c037b53b-2303-44d0-bb77-c8fa405473bb", "name": "network-vif-deleted", "tag": "86571be8-3cd1-44e0-856c-952546489890"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:20.050277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5f600c2b-0af1-48e0-88f0-641f9cf36bd4 req-69554c4a-bf37-41b3-9bd8-fdeebe81da29 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.050734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5f600c2b-0af1-48e0-88f0-641f9cf36bd4 req-69554c4a-bf37-41b3-9bd8-fdeebe81da29 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.093502 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-5f600c2b-0af1-48e0-88f0-641f9cf36bd4 req-69554c4a-bf37-41b3-9bd8-fdeebe81da29 service nova] Creating event network-vif-deleted:86571be8-3cd1-44e0-856c-952546489890 for instance c037b53b-2303-44d0-bb77-c8fa405473bb on n-h2-764485-11 Jul 20 04:35:20.110996 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-5f600c2b-0af1-48e0-88f0-641f9cf36bd4 req-69554c4a-bf37-41b3-9bd8-fdeebe81da29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091542 Jul 20 04:35:20.124483 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2717/5345] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:20.539421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6ab2823-740d-40a5-a9b5-d0463fd85b23 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:20.540070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a6ab2823-740d-40a5-a9b5-d0463fd85b23 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:20.561924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6ab2823-740d-40a5-a9b5-d0463fd85b23 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.563794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6ab2823-740d-40a5-a9b5-d0463fd85b23 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.563794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6ab2823-740d-40a5-a9b5-d0463fd85b23 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.570259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d82fda56-cfc8-4b21-9ff9-0d8d07e93ad2 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:20.570961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d82fda56-cfc8-4b21-9ff9-0d8d07e93ad2 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:20.573189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6ab2823-740d-40a5-a9b5-d0463fd85b23 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.583135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d82fda56-cfc8-4b21-9ff9-0d8d07e93ad2 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.585574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d82fda56-cfc8-4b21-9ff9-0d8d07e93ad2 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.588474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d82fda56-cfc8-4b21-9ff9-0d8d07e93ad2 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.590652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d82fda56-cfc8-4b21-9ff9-0d8d07e93ad2 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.697346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6ab2823-740d-40a5-a9b5-d0463fd85b23 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.697815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6ab2823-740d-40a5-a9b5-d0463fd85b23 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.698285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-a6ab2823-740d-40a5-a9b5-d0463fd85b23 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lazy-loading 'fault' on Instance uuid c037b53b-2303-44d0-bb77-c8fa405473bb {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:20.904250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a6ab2823-740d-40a5-a9b5-d0463fd85b23 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b559a8f5a1724682831d18c3f7ddfdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9144d8b214ecb8e416318d92b92ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:20.911185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d82fda56-cfc8-4b21-9ff9-0d8d07e93ad2 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:20.920200 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a6ab2823-740d-40a5-a9b5-d0463fd85b23 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 200 len: 1328 microversion: 2.1 time: 0.393258 Jul 20 04:35:20.921343 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2629/5346] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:20 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 1328 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:20.924717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d82fda56-cfc8-4b21-9ff9-0d8d07e93ad2 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:20.928147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d82fda56-cfc8-4b21-9ff9-0d8d07e93ad2 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:20.929375 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d82fda56-cfc8-4b21-9ff9-0d8d07e93ad2 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1372 microversion: 2.57 time: 0.364132 Jul 20 04:35:20.929959 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2718/5347] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:20 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1372 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:20.948264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2d49a476-2eeb-46ec-aa09-88ecbec44493 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:20.950855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2d49a476-2eeb-46ec-aa09-88ecbec44493 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:20.962377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d49a476-2eeb-46ec-aa09-88ecbec44493 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.964112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d49a476-2eeb-46ec-aa09-88ecbec44493 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.965435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d49a476-2eeb-46ec-aa09-88ecbec44493 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.967182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d49a476-2eeb-46ec-aa09-88ecbec44493 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.005135 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2d49a476-2eeb-46ec-aa09-88ecbec44493 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082346 Jul 20 04:35:21.006272 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2630/5348] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:35:20 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:35:21.939052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3695b619-f311-4605-baab-e52f0a85c4e3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:21.940490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3695b619-f311-4605-baab-e52f0a85c4e3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] [instance: c037b53b-2303-44d0-bb77-c8fa405473bb] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:21.953323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3695b619-f311-4605-baab-e52f0a85c4e3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.954093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3695b619-f311-4605-baab-e52f0a85c4e3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.955628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac686a52-0a60-4949-afac-abeb8f5656aa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:21.956263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac686a52-0a60-4949-afac-abeb8f5656aa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:21.957695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3695b619-f311-4605-baab-e52f0a85c4e3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.967650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3695b619-f311-4605-baab-e52f0a85c4e3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.969804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac686a52-0a60-4949-afac-abeb8f5656aa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.970967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac686a52-0a60-4949-afac-abeb8f5656aa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.972086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac686a52-0a60-4949-afac-abeb8f5656aa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.973618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac686a52-0a60-4949-afac-abeb8f5656aa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.046696 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-3695b619-f311-4605-baab-e52f0a85c4e3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] HTTP exception thrown: Instance c037b53b-2303-44d0-bb77-c8fa405473bb could not be found. Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3695b619-f311-4605-baab-e52f0a85c4e3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Request method failure captured: Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb HTTP/1.1 Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14NwtqXY4gJOJdaQfNhy2FGHL1vHP3OiKcVH-Gr5N9oC3B6qjABKjSyLs8P6SaKylJs19ApYqqg5fwES-KSkLNqcl2qKzDVVeJngnxSlM4ze5o2Ef233SlZPhPTfozKQmRa8qo1Tc7EzdNN77K3K55Vks8oY9WaU6RPAKu1A_e5bvFE Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 1be9144d8b214ecb8e416318d92b92ea Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1be9144d8b214ecb8e416318d92b92ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1be9144d8b214ecb8e416318d92b92ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1be9144d8b214ecb8e416318d92b92ea", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1be9144d8b214ecb8e416318d92b92ea"}]}] Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 1be9144d8b214ecb8e416318d92b92ea Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1421550179 Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerActionsTestJSON-1421550179-project Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b559a8f5a1724682831d18c3f7ddfdf2 Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerActionsTestJSON-1421550179-project Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance c037b53b-2303-44d0-bb77-c8fa405473bb could not be found. Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'c037b53b-2303-44d0-bb77-c8fa405473bb'} Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c037b53b-2303-44d0-bb77-c8fa405473bb could not be found. Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c037b53b-2303-44d0-bb77-c8fa405473bb could not be found. Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:22.049784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.054928 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:22.054928 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:22.054928 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:22.054928 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:22.054928 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:22.054928 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c037b53b-2303-44d0-bb77-c8fa405473bb could not be found. Jul 20 04:35:22.054928 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.059184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3695b619-f311-4605-baab-e52f0a85c4e3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Returning 404 to user: Instance c037b53b-2303-44d0-bb77-c8fa405473bb could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:22.062793 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3695b619-f311-4605-baab-e52f0a85c4e3 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb" status: 404 len: 111 microversion: 2.1 time: 0.128263 Jul 20 04:35:22.071098 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2719/5349] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:21 2022] GET /compute/v2.1/servers/c037b53b-2303-44d0-bb77-c8fa405473bb => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:22.084623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-50b8339a-8edf-4eeb-9283-bdfd05ab2413 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.093090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-50b8339a-8edf-4eeb-9283-bdfd05ab2413 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.119565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50b8339a-8edf-4eeb-9283-bdfd05ab2413 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.121956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50b8339a-8edf-4eeb-9283-bdfd05ab2413 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.132763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50b8339a-8edf-4eeb-9283-bdfd05ab2413 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.136747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50b8339a-8edf-4eeb-9283-bdfd05ab2413 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.262221 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-50b8339a-8edf-4eeb-9283-bdfd05ab2413 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.179101 Jul 20 04:35:22.262577 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2720/5350] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:35:22 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:35:22.275898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3898c07b-9ac1-4684-b07c-3dedd54cdf77 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] Calling method '.version_select at 0x7fbfa28a9ca0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.355907 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3898c07b-9ac1-4684-b07c-3dedd54cdf77 tempest-ServerActionsTestJSON-1421550179 tempest-ServerActionsTestJSON-1421550179-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-130480390" status: 202 len: 0 microversion: 2.1 time: 0.091888 Jul 20 04:35:22.357035 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2721/5351] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 20 04:35:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-130480390 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:35:22.384038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ac686a52-0a60-4949-afac-abeb8f5656aa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:22.417743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ac686a52-0a60-4949-afac-abeb8f5656aa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:22.438872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ac686a52-0a60-4949-afac-abeb8f5656aa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:22.440633 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ac686a52-0a60-4949-afac-abeb8f5656aa tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1357 microversion: 2.57 time: 0.489043 Jul 20 04:35:22.442561 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2631/5352] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:21 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1357 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:22.476528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-286b765e-d79b-4632-a8e9-dec73a90e0eb tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.476979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-286b765e-d79b-4632-a8e9-dec73a90e0eb tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.484859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-286b765e-d79b-4632-a8e9-dec73a90e0eb tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.500407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-286b765e-d79b-4632-a8e9-dec73a90e0eb tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.504672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-286b765e-d79b-4632-a8e9-dec73a90e0eb tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.505153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-286b765e-d79b-4632-a8e9-dec73a90e0eb tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.567258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-286b765e-d79b-4632-a8e9-dec73a90e0eb tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:22.713626 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-286b765e-d79b-4632-a8e9-dec73a90e0eb tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 204 len: 0 microversion: 2.57 time: 0.241154 Jul 20 04:35:22.719004 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2722/5353] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:35:22 2022] DELETE /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:35:22.725482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d1dbc17d-2230-4fc8-8725-2a79c2885c04 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.726898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d1dbc17d-2230-4fc8-8725-2a79c2885c04 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.759369 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d1dbc17d-2230-4fc8-8725-2a79c2885c04 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.764249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d1dbc17d-2230-4fc8-8725-2a79c2885c04 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.765374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d1dbc17d-2230-4fc8-8725-2a79c2885c04 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.766551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d1dbc17d-2230-4fc8-8725-2a79c2885c04 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.071102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d1dbc17d-2230-4fc8-8725-2a79c2885c04 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:23.085963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d1dbc17d-2230-4fc8-8725-2a79c2885c04 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:23.090567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d1dbc17d-2230-4fc8-8725-2a79c2885c04 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:23.094003 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d1dbc17d-2230-4fc8-8725-2a79c2885c04 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1363 microversion: 2.57 time: 0.373708 Jul 20 04:35:23.111612 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2632/5354] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:22 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1363 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:23.274185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-43edba51-e066-4531-8c37-b18eee8c8127 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:23.276077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-43edba51-e066-4531-8c37-b18eee8c8127 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:23.319247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43edba51-e066-4531-8c37-b18eee8c8127 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.323040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43edba51-e066-4531-8c37-b18eee8c8127 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.327636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43edba51-e066-4531-8c37-b18eee8c8127 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.331058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43edba51-e066-4531-8c37-b18eee8c8127 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.401143 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-43edba51-e066-4531-8c37-b18eee8c8127 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.130066 Jul 20 04:35:23.402671 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2723/5355] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:35:23 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:35:24.116055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bbbec568-94fc-48b9-a03b-7da12e9751b3 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:24.117705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bbbec568-94fc-48b9-a03b-7da12e9751b3 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:24.136742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bbbec568-94fc-48b9-a03b-7da12e9751b3 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.143439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bbbec568-94fc-48b9-a03b-7da12e9751b3 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.148219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bbbec568-94fc-48b9-a03b-7da12e9751b3 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.158359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bbbec568-94fc-48b9-a03b-7da12e9751b3 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.325894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bbbec568-94fc-48b9-a03b-7da12e9751b3 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:24.340279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bbbec568-94fc-48b9-a03b-7da12e9751b3 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:24.350753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bbbec568-94fc-48b9-a03b-7da12e9751b3 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:24.352022 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bbbec568-94fc-48b9-a03b-7da12e9751b3 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1363 microversion: 2.57 time: 0.240870 Jul 20 04:35:24.363785 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2633/5356] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:24 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:25.019303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d6226a71-3780-40db-beb4-4bb7ebbe8706 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:25.022333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d6226a71-3780-40db-beb4-4bb7ebbe8706 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:25.034179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6226a71-3780-40db-beb4-4bb7ebbe8706 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.035639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6226a71-3780-40db-beb4-4bb7ebbe8706 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.037777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6226a71-3780-40db-beb4-4bb7ebbe8706 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.039380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6226a71-3780-40db-beb4-4bb7ebbe8706 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.097509 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d6226a71-3780-40db-beb4-4bb7ebbe8706 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.687365 Jul 20 04:35:25.099182 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2724/5357] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:35:24 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments => generated 197 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:35:25.371948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:25.373156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:25.395698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.396542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.397360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.397803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.526281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.527814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.529383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lazy-loading 'fault' on Instance uuid 2c765cd5-6155-4390-bf06-8d8d1e046690 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:25.711450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:25.725434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:25.726995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c72f925bb44a48e787d4fdde2bf84553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d644da9492149ee9a1d899dd1c096cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:25.728282 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d5b711b7-4abd-45bb-b5fd-8eb5eed90b8a tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 200 len: 1368 microversion: 2.57 time: 0.361969 Jul 20 04:35:25.728872 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2634/5358] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:25 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:26.019246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-19901071", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "b770d69f-658a-4915-8df6-7ef90042961f"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:26.115469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-35522b9c-162f-4040-a8a7-b0fec4bed9d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:26.116502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-35522b9c-162f-4040-a8a7-b0fec4bed9d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:26.119201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:26.131471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35522b9c-162f-4040-a8a7-b0fec4bed9d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:26.131953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35522b9c-162f-4040-a8a7-b0fec4bed9d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:26.135561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35522b9c-162f-4040-a8a7-b0fec4bed9d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:26.136994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-35522b9c-162f-4040-a8a7-b0fec4bed9d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:26.141509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] validate_networks() for [('b770d69f-658a-4915-8df6-7ef90042961f', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:35:26.216278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:26.226007 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-35522b9c-162f-4040-a8a7-b0fec4bed9d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116607 Jul 20 04:35:26.227115 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2635/5359] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:35:26 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:35:26.750521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee8ae2bb-ed3b-48b2-bb1c-292099cbc7a7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:26.752522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ee8ae2bb-ed3b-48b2-bb1c-292099cbc7a7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] [instance: 2c765cd5-6155-4390-bf06-8d8d1e046690] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:26.768335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee8ae2bb-ed3b-48b2-bb1c-292099cbc7a7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:26.769071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee8ae2bb-ed3b-48b2-bb1c-292099cbc7a7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:26.770050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee8ae2bb-ed3b-48b2-bb1c-292099cbc7a7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:26.774226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee8ae2bb-ed3b-48b2-bb1c-292099cbc7a7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:26.829185 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-ee8ae2bb-ed3b-48b2-bb1c-292099cbc7a7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] HTTP exception thrown: Instance 2c765cd5-6155-4390-bf06-8d8d1e046690 could not be found. Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee8ae2bb-ed3b-48b2-bb1c-292099cbc7a7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Request method failure captured: Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 HTTP/1.1 Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14XbEmplGG1r5v5CmcjaW2LPzvYS_vonskIjfa6gkU2OSFVBTOjolbW8OtJ2RqgxgV4QOGwMHnqgTZQlkBesP_zI5gmKKBveM9BaPMU_U8rtRtLJqDTrP7K8Z7p_vFNeYLTVoPz3yta3i0lLpaGV39D5TGQOYyhZBBHVe5DqWIsoVnY Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.57 Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7d644da9492149ee9a1d899dd1c096cb Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerShowV257Test-1135332429 Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d644da9492149ee9a1d899dd1c096cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d644da9492149ee9a1d899dd1c096cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d644da9492149ee9a1d899dd1c096cb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d644da9492149ee9a1d899dd1c096cb"}]}] Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerShowV257Test-1135332429 Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7d644da9492149ee9a1d899dd1c096cb Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerShowV257Test-1135332429 Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerShowV257Test-1135332429-project Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: c72f925bb44a48e787d4fdde2bf84553 Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerShowV257Test-1135332429-project Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 2c765cd5-6155-4390-bf06-8d8d1e046690 could not be found. Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '2c765cd5-6155-4390-bf06-8d8d1e046690'} Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c765cd5-6155-4390-bf06-8d8d1e046690 could not be found. Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c765cd5-6155-4390-bf06-8d8d1e046690 could not be found. Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:26.833646 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:26.838887 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:26.838887 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:26.838887 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:26.838887 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:26.838887 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:26.838887 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c765cd5-6155-4390-bf06-8d8d1e046690 could not be found. Jul 20 04:35:26.838887 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:26.838887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee8ae2bb-ed3b-48b2-bb1c-292099cbc7a7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] Returning 404 to user: Instance 2c765cd5-6155-4390-bf06-8d8d1e046690 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:26.838887 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ee8ae2bb-ed3b-48b2-bb1c-292099cbc7a7 tempest-ServerShowV257Test-1135332429 tempest-ServerShowV257Test-1135332429-project] 10.222.0.20 "GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690" status: 404 len: 111 microversion: 2.57 time: 0.090645 Jul 20 04:35:26.851309 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2636/5360] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:26 2022] GET /compute/v2.1/servers/2c765cd5-6155-4390-bf06-8d8d1e046690 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:35:27.238761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-735cdfb2-930a-43fe-aa70-0718c98f1874 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:27.239953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-735cdfb2-930a-43fe-aa70-0718c98f1874 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:27.262945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-735cdfb2-930a-43fe-aa70-0718c98f1874 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.271446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-735cdfb2-930a-43fe-aa70-0718c98f1874 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.273641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-735cdfb2-930a-43fe-aa70-0718c98f1874 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.276702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-735cdfb2-930a-43fe-aa70-0718c98f1874 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.368881 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-735cdfb2-930a-43fe-aa70-0718c98f1874 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134150 Jul 20 04:35:27.383118 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2637/5361] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:35:27 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:35:27.720222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:35:27.720805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:35:27.721129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:35:27.722069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:35:27.722069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:35:27.738376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.738836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.742743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.743292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.796464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Getting quotas for project b3d0582144e64d308b6fa586d1b163fd. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:35:27.815896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Getting quotas for user 8c5759fe5f2c4f85979a40e3af72ca60 and project b3d0582144e64d308b6fa586d1b163fd. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:35:27.842856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:35:27.854864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:35:27.977799 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7a495b33-4ab1-4857-85fd-2071e1d5583c tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.375207 Jul 20 04:35:27.988418 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2725/5362] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:35:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:35:27.999491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8c5163b9-862c-45ac-ade3-c6fabbe12c6b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:28.000136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8c5163b9-862c-45ac-ade3-c6fabbe12c6b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:28.153302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8c5163b9-862c-45ac-ade3-c6fabbe12c6b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:28.165885 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8c5163b9-862c-45ac-ade3-c6fabbe12c6b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1226 microversion: 2.1 time: 0.170707 Jul 20 04:35:28.169448 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2638/5363] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:27 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1226 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:28.390270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f9edf612-1184-4474-b163-b24d30936482 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:28.391281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f9edf612-1184-4474-b163-b24d30936482 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:28.404622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9edf612-1184-4474-b163-b24d30936482 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.405083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9edf612-1184-4474-b163-b24d30936482 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.405884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9edf612-1184-4474-b163-b24d30936482 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.406336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9edf612-1184-4474-b163-b24d30936482 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.530305 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f9edf612-1184-4474-b163-b24d30936482 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.145008 Jul 20 04:35:28.538348 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2726/5364] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:35:28 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:28.683152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-45057966-1efb-41f9-98ab-a20b3034b649 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:28.684018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-45057966-1efb-41f9-98ab-a20b3034b649 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:28.715335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45057966-1efb-41f9-98ab-a20b3034b649 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.723229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45057966-1efb-41f9-98ab-a20b3034b649 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.730997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45057966-1efb-41f9-98ab-a20b3034b649 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.731921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45057966-1efb-41f9-98ab-a20b3034b649 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.823679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-45057966-1efb-41f9-98ab-a20b3034b649 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:29.095033 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-45057966-1efb-41f9-98ab-a20b3034b649 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 204 len: 0 microversion: 2.20 time: 0.415771 Jul 20 04:35:29.096239 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2639/5365] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:35:28 2022] DELETE /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:35:29.106704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-856f7b10-53de-4949-b4a3-2ce1ff87ea9d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:29.107551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-856f7b10-53de-4949-b4a3-2ce1ff87ea9d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:29.124780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-856f7b10-53de-4949-b4a3-2ce1ff87ea9d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.125698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-856f7b10-53de-4949-b4a3-2ce1ff87ea9d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.128078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-856f7b10-53de-4949-b4a3-2ce1ff87ea9d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.129251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-856f7b10-53de-4949-b4a3-2ce1ff87ea9d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.192192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cdc17ae9-9e5c-4a31-b6cb-63427307b55b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:29.192922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cdc17ae9-9e5c-4a31-b6cb-63427307b55b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:29.206996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdc17ae9-9e5c-4a31-b6cb-63427307b55b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.212192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdc17ae9-9e5c-4a31-b6cb-63427307b55b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.213304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdc17ae9-9e5c-4a31-b6cb-63427307b55b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.213972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cdc17ae9-9e5c-4a31-b6cb-63427307b55b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.690828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cdc17ae9-9e5c-4a31-b6cb-63427307b55b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:29.712741 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cdc17ae9-9e5c-4a31-b6cb-63427307b55b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1230 microversion: 2.1 time: 0.527646 Jul 20 04:35:29.713478 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2640/5366] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:29 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1230 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:30.354330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-856f7b10-53de-4949-b4a3-2ce1ff87ea9d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:30.364787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-856f7b10-53de-4949-b4a3-2ce1ff87ea9d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:30.371778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-856f7b10-53de-4949-b4a3-2ce1ff87ea9d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:30.373595 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-856f7b10-53de-4949-b4a3-2ce1ff87ea9d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1721 microversion: 2.20 time: 1.272870 Jul 20 04:35:30.374431 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2727/5367] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:29 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1721 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:30.747865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e5c8a01f-4b43-4eda-bd84-d9593c931bf9 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:30.750467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e5c8a01f-4b43-4eda-bd84-d9593c931bf9 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:30.764644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5c8a01f-4b43-4eda-bd84-d9593c931bf9 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:30.768136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5c8a01f-4b43-4eda-bd84-d9593c931bf9 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:30.771304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5c8a01f-4b43-4eda-bd84-d9593c931bf9 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:30.773188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5c8a01f-4b43-4eda-bd84-d9593c931bf9 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.398832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74a39965-b33e-420a-9e21-7cdd93696122 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:31.402431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74a39965-b33e-420a-9e21-7cdd93696122 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:31.436621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74a39965-b33e-420a-9e21-7cdd93696122 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.437995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74a39965-b33e-420a-9e21-7cdd93696122 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.440721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74a39965-b33e-420a-9e21-7cdd93696122 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.441556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74a39965-b33e-420a-9e21-7cdd93696122 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.968993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e5c8a01f-4b43-4eda-bd84-d9593c931bf9 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:31.981169 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e5c8a01f-4b43-4eda-bd84-d9593c931bf9 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1284 microversion: 2.1 time: 1.251820 Jul 20 04:35:31.995969 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2641/5368] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:30 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1284 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:32.602526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-74a39965-b33e-420a-9e21-7cdd93696122 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:32.630187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-74a39965-b33e-420a-9e21-7cdd93696122 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:32.633517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-74a39965-b33e-420a-9e21-7cdd93696122 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:32.636217 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74a39965-b33e-420a-9e21-7cdd93696122 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 200 len: 1721 microversion: 2.20 time: 1.245049 Jul 20 04:35:32.638386 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2728/5369] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:31 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 1721 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:32.769417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-773fc58c-bf1c-405b-ba8b-c5c2777e3589 req-e91b8305-9035-4125-bf17-660d5c88f981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76d5764-986d-4d3f-806f-1f8b1c5a73c1", "name": "network-vif-deleted", "tag": "f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:32.784654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-773fc58c-bf1c-405b-ba8b-c5c2777e3589 req-e91b8305-9035-4125-bf17-660d5c88f981 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:32.805724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-773fc58c-bf1c-405b-ba8b-c5c2777e3589 req-e91b8305-9035-4125-bf17-660d5c88f981 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:32.844800 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-773fc58c-bf1c-405b-ba8b-c5c2777e3589 req-e91b8305-9035-4125-bf17-660d5c88f981 service nova] Creating event network-vif-deleted:f6ab6bc5-e4a5-4ea2-898d-c5c1050ce981 for instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 on n-h2-764485-11 Jul 20 04:35:32.853063 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-773fc58c-bf1c-405b-ba8b-c5c2777e3589 req-e91b8305-9035-4125-bf17-660d5c88f981 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087236 Jul 20 04:35:32.858548 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2642/5370] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:33.005475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-241795b4-4022-4853-9c25-5c382d285834 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:33.006341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-241795b4-4022-4853-9c25-5c382d285834 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:33.024529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-241795b4-4022-4853-9c25-5c382d285834 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.025496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-241795b4-4022-4853-9c25-5c382d285834 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.026600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-241795b4-4022-4853-9c25-5c382d285834 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.028790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-241795b4-4022-4853-9c25-5c382d285834 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.253494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-241795b4-4022-4853-9c25-5c382d285834 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:33.266226 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-241795b4-4022-4853-9c25-5c382d285834 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1284 microversion: 2.1 time: 0.265671 Jul 20 04:35:33.285233 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2729/5371] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:32 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1284 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:33.657564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-25599820-103d-4f12-b38b-b39a557149ae tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:33.658243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-25599820-103d-4f12-b38b-b39a557149ae tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:33.681195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25599820-103d-4f12-b38b-b39a557149ae tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.681660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25599820-103d-4f12-b38b-b39a557149ae tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.682506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25599820-103d-4f12-b38b-b39a557149ae tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.683142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25599820-103d-4f12-b38b-b39a557149ae tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.705635 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-25599820-103d-4f12-b38b-b39a557149ae tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] HTTP exception thrown: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-25599820-103d-4f12-b38b-b39a557149ae tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Request method failure captured: Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 HTTP/1.1 Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Tf08Hz7E0qdsUUy-ltOAaCAoC-03Zqy01AoNSdalpIFw7vUNfDX9pIiSWG1Hfk5MI6hBvHSODI6ruSrQLFEUyEgT3J6ZKWTXia5T7msrqdb-T0lBeQJX53qci0XKlEQ6pJAeYKUpCe0h8GHlbEALnqoHpKZll8xXc56FqmfgycYk4 Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 991c8e8abd6b465bad948f659373c920 Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/991c8e8abd6b465bad948f659373c920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/991c8e8abd6b465bad948f659373c920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_991c8e8abd6b465bad948f659373c920", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/991c8e8abd6b465bad948f659373c920"}]}] Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 991c8e8abd6b465bad948f659373c920 Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeShelveTestJSON-1492017772-project Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 6e3f2f4e6d644b1d9c4743e9753aa9d2 Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1492017772-project Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'c76d5764-986d-4d3f-806f-1f8b1c5a73c1'} Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:33.727028 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:33.737244 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:33.737244 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:33.737244 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:33.737244 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:33.737244 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:33.737244 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:33.737244 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:35:33.737244 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:33.737244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-25599820-103d-4f12-b38b-b39a557149ae tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Returning 404 to user: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:33.737244 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-25599820-103d-4f12-b38b-b39a557149ae tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 404 len: 111 microversion: 2.20 time: 0.075513 Jul 20 04:35:33.737244 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2643/5372] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:33 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:35:33.743536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c1e4bafb-77ce-489c-83d9-094faaf5460f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '.version_select at 0x7fbf9c582160>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:33.748209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:33.787379 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c1e4bafb-77ce-489c-83d9-094faaf5460f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-470258869" status: 204 len: 0 microversion: 2.20 time: 0.049352 Jul 20 04:35:33.787927 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2730/5373] 10.222.0.20 () {60 vars in 1258 bytes} [Wed Jul 20 04:35:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-470258869 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:35:34.288186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9a5ec0e2-d7da-4471-916b-0547ed55f9be tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:34.289767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9a5ec0e2-d7da-4471-916b-0547ed55f9be tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:34.309762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a5ec0e2-d7da-4471-916b-0547ed55f9be tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.310220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a5ec0e2-d7da-4471-916b-0547ed55f9be tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.311008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a5ec0e2-d7da-4471-916b-0547ed55f9be tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.311444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a5ec0e2-d7da-4471-916b-0547ed55f9be tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.527326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9a5ec0e2-d7da-4471-916b-0547ed55f9be tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:34.539112 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9a5ec0e2-d7da-4471-916b-0547ed55f9be tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1284 microversion: 2.1 time: 0.257202 Jul 20 04:35:34.543817 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2644/5374] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:34 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:35.558652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-047ca777-43e7-4bb1-92d5-9fa0b8bab012 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:35.559903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-047ca777-43e7-4bb1-92d5-9fa0b8bab012 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:35.583876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-047ca777-43e7-4bb1-92d5-9fa0b8bab012 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:35.584543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-047ca777-43e7-4bb1-92d5-9fa0b8bab012 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:35.586160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-047ca777-43e7-4bb1-92d5-9fa0b8bab012 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:35.586791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-047ca777-43e7-4bb1-92d5-9fa0b8bab012 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.360467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-047ca777-43e7-4bb1-92d5-9fa0b8bab012 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:36.370969 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-047ca777-43e7-4bb1-92d5-9fa0b8bab012 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1326 microversion: 2.1 time: 0.813950 Jul 20 04:35:36.375236 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2731/5375] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:35 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1326 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:36.665755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-46677504-0800-4bbc-be50-1612034f0ac5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Action: 'create', calling method: .version_select at 0x7fbf9da049d0>, body: {"keypair": {"name": "tempest-keypair-113094986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTq1PiaxnHkGZYUut21blK5SP/olL3EauvcHExqNu6hlckw1UPMpwU5NnzsZ2/vhHGSOB5zKj4CEAkaE6euXKs1L0KZIY/RKmfkC109G46gV0CfLRed5Xd+1mxGpp4cg=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:36.693314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-46677504-0800-4bbc-be50-1612034f0ac5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Getting quotas for project 991c8e8abd6b465bad948f659373c920. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:35:36.700129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-46677504-0800-4bbc-be50-1612034f0ac5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Getting quotas for user 6e3f2f4e6d644b1d9c4743e9753aa9d2 and project 991c8e8abd6b465bad948f659373c920. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:35:36.741622 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-46677504-0800-4bbc-be50-1612034f0ac5 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.085289 Jul 20 04:35:36.742701 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2645/5376] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jul 20 04:35:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:35:37.391448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-79752f5a-f5d5-4e6a-a907-67e46e9c3a97 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:37.392170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-79752f5a-f5d5-4e6a-a907-67e46e9c3a97 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:37.411772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79752f5a-f5d5-4e6a-a907-67e46e9c3a97 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.412283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79752f5a-f5d5-4e6a-a907-67e46e9c3a97 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.413032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79752f5a-f5d5-4e6a-a907-67e46e9c3a97 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.413354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79752f5a-f5d5-4e6a-a907-67e46e9c3a97 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.772404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:37.833598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:37.975727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-79752f5a-f5d5-4e6a-a907-67e46e9c3a97 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:37.994488 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-79752f5a-f5d5-4e6a-a907-67e46e9c3a97 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1326 microversion: 2.1 time: 0.606952 Jul 20 04:35:37.999023 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2732/5377] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:37 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1326 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:38.210588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-10b5f18c-af07-42c6-8589-82f5610734ee req-1e780012-4f6b-42de-ad13-1ea324a4d409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7", "tag": "a3d449d0-a4f3-474d-9d77-f5322c4bf61a"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:38.252712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-10b5f18c-af07-42c6-8589-82f5610734ee req-1e780012-4f6b-42de-ad13-1ea324a4d409 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.256256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-10b5f18c-af07-42c6-8589-82f5610734ee req-1e780012-4f6b-42de-ad13-1ea324a4d409 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.293559 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-10b5f18c-af07-42c6-8589-82f5610734ee req-1e780012-4f6b-42de-ad13-1ea324a4d409 service nova] Creating event network-changed:a3d449d0-a4f3-474d-9d77-f5322c4bf61a for instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 on n-h1-764485-11 Jul 20 04:35:38.309515 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-10b5f18c-af07-42c6-8589-82f5610734ee req-1e780012-4f6b-42de-ad13-1ea324a4d409 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135320 Jul 20 04:35:38.310308 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2646/5378] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:39.017729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21516628-c489-4f2f-b454-80c92b93315b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:39.018894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21516628-c489-4f2f-b454-80c92b93315b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:39.028941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21516628-c489-4f2f-b454-80c92b93315b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:39.029745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21516628-c489-4f2f-b454-80c92b93315b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:39.030832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21516628-c489-4f2f-b454-80c92b93315b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:39.031441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21516628-c489-4f2f-b454-80c92b93315b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:39.585971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-21516628-c489-4f2f-b454-80c92b93315b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:39.608255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:39.611012 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21516628-c489-4f2f-b454-80c92b93315b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1326 microversion: 2.1 time: 0.600477 Jul 20 04:35:39.615609 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2733/5379] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:39 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1326 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:39.978135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1492420487", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd3052d7-ce52-4831-a899-60c23768265e"}], "security_groups": [{"name": "tempest-securitygroup--79866341"}], "key_name": "tempest-keypair-113094986", "user_data": "}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:40.286779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] validate_networks() for [('bd3052d7-ce52-4831-a899-60c23768265e', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:35:40.629076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-95500ea5-80ea-4538-9e94-a44f6e61e0a5 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:40.630115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-95500ea5-80ea-4538-9e94-a44f6e61e0a5 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:40.653934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95500ea5-80ea-4538-9e94-a44f6e61e0a5 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:40.661010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95500ea5-80ea-4538-9e94-a44f6e61e0a5 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:40.662323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95500ea5-80ea-4538-9e94-a44f6e61e0a5 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:40.664138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-95500ea5-80ea-4538-9e94-a44f6e61e0a5 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.566415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-95500ea5-80ea-4538-9e94-a44f6e61e0a5 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:41.576399 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-95500ea5-80ea-4538-9e94-a44f6e61e0a5 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1326 microversion: 2.1 time: 0.951285 Jul 20 04:35:41.583465 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2734/5380] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:40 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1326 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:42.084104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:35:42.084691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:35:42.085256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:35:42.085950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:35:42.086592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:35:42.111843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:42.115408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:42.121395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:42.121395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:42.231759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Getting quotas for project 991c8e8abd6b465bad948f659373c920. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:35:42.247114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Getting quotas for user 6e3f2f4e6d644b1d9c4743e9753aa9d2 and project 991c8e8abd6b465bad948f659373c920. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:35:42.311059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:35:42.344299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:35:42.509538 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cf23b564-b855-414f-b996-4948a9e59e0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.544764 Jul 20 04:35:42.514739 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2647/5381] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:35:39 2022] POST /compute/v2.1/servers => generated 400 bytes in 2551 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:35:42.524296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e4e7cd19-ca44-4b9a-b88d-9ac492f4a99e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:42.525008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e4e7cd19-ca44-4b9a-b88d-9ac492f4a99e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:42.593281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-120489ed-d0bf-4a5c-a705-5e9d8f26f685 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:42.594218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-120489ed-d0bf-4a5c-a705-5e9d8f26f685 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:42.602180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-120489ed-d0bf-4a5c-a705-5e9d8f26f685 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:42.604371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-120489ed-d0bf-4a5c-a705-5e9d8f26f685 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:42.608750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-120489ed-d0bf-4a5c-a705-5e9d8f26f685 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:42.609470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-120489ed-d0bf-4a5c-a705-5e9d8f26f685 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:43.117515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e4e7cd19-ca44-4b9a-b88d-9ac492f4a99e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:43.136842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e4e7cd19-ca44-4b9a-b88d-9ac492f4a99e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:43.148486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e4e7cd19-ca44-4b9a-b88d-9ac492f4a99e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:43.157650 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e4e7cd19-ca44-4b9a-b88d-9ac492f4a99e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1281 microversion: 2.20 time: 0.634271 Jul 20 04:35:43.161849 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2735/5382] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:42 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1281 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:43.830545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-120489ed-d0bf-4a5c-a705-5e9d8f26f685 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:43.840077 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-120489ed-d0bf-4a5c-a705-5e9d8f26f685 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1326 microversion: 2.1 time: 1.250527 Jul 20 04:35:43.853544 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2648/5383] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:42 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1326 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:44.183377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3aaf1479-1bf7-4673-9276-eaf03b9d9af4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:44.184081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3aaf1479-1bf7-4673-9276-eaf03b9d9af4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:44.202975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3aaf1479-1bf7-4673-9276-eaf03b9d9af4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.203435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3aaf1479-1bf7-4673-9276-eaf03b9d9af4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.206905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3aaf1479-1bf7-4673-9276-eaf03b9d9af4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.207378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3aaf1479-1bf7-4673-9276-eaf03b9d9af4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.841437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3aaf1479-1bf7-4673-9276-eaf03b9d9af4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:44.857288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3aaf1479-1bf7-4673-9276-eaf03b9d9af4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:44.859155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3aaf1479-1bf7-4673-9276-eaf03b9d9af4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:44.860573 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3aaf1479-1bf7-4673-9276-eaf03b9d9af4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1333 microversion: 2.20 time: 0.684440 Jul 20 04:35:44.861935 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2736/5384] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:44 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1333 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:44.869739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0045ab0f-19c9-4b68-a322-29af94e46c91 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:44.870782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0045ab0f-19c9-4b68-a322-29af94e46c91 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:44.881978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0045ab0f-19c9-4b68-a322-29af94e46c91 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.884661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0045ab0f-19c9-4b68-a322-29af94e46c91 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.887043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0045ab0f-19c9-4b68-a322-29af94e46c91 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.889425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0045ab0f-19c9-4b68-a322-29af94e46c91 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.983835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ef43e9e8-1d8f-4294-997c-77a344cb091b req-65eb4422-d881-4180-820b-cf6b547a3503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7", "name": "network-vif-plugged", "status": "completed", "tag": "a3d449d0-a4f3-474d-9d77-f5322c4bf61a"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:45.001980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ef43e9e8-1d8f-4294-997c-77a344cb091b req-65eb4422-d881-4180-820b-cf6b547a3503 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:45.002542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ef43e9e8-1d8f-4294-997c-77a344cb091b req-65eb4422-d881-4180-820b-cf6b547a3503 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:45.020109 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ef43e9e8-1d8f-4294-997c-77a344cb091b req-65eb4422-d881-4180-820b-cf6b547a3503 service nova] Creating event network-vif-plugged:a3d449d0-a4f3-474d-9d77-f5322c4bf61a for instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 on n-h1-764485-11 Jul 20 04:35:45.027705 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ef43e9e8-1d8f-4294-997c-77a344cb091b req-65eb4422-d881-4180-820b-cf6b547a3503 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048661 Jul 20 04:35:45.029009 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2737/5385] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:35:45.290749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0045ab0f-19c9-4b68-a322-29af94e46c91 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:45.303435 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0045ab0f-19c9-4b68-a322-29af94e46c91 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1326 microversion: 2.1 time: 0.437644 Jul 20 04:35:45.315002 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2649/5386] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:44 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1326 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:45.880855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-934e7b39-52e6-4faa-ad86-32c3ab1d5c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:45.881399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-934e7b39-52e6-4faa-ad86-32c3ab1d5c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:45.902978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-934e7b39-52e6-4faa-ad86-32c3ab1d5c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:45.907788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-934e7b39-52e6-4faa-ad86-32c3ab1d5c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:45.909972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-934e7b39-52e6-4faa-ad86-32c3ab1d5c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:45.912145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-934e7b39-52e6-4faa-ad86-32c3ab1d5c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.320336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0da97ca6-b958-4f25-a1df-445437b1afde tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:46.321396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0da97ca6-b958-4f25-a1df-445437b1afde tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:46.339351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0da97ca6-b958-4f25-a1df-445437b1afde tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.339836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0da97ca6-b958-4f25-a1df-445437b1afde tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.340645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0da97ca6-b958-4f25-a1df-445437b1afde tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.341608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0da97ca6-b958-4f25-a1df-445437b1afde tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.776940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0da97ca6-b958-4f25-a1df-445437b1afde tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:46.788144 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0da97ca6-b958-4f25-a1df-445437b1afde tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1326 microversion: 2.1 time: 0.471674 Jul 20 04:35:46.796486 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2650/5387] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:46 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1326 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:46.893355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-934e7b39-52e6-4faa-ad86-32c3ab1d5c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:46.907879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-934e7b39-52e6-4faa-ad86-32c3ab1d5c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:46.909700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-934e7b39-52e6-4faa-ad86-32c3ab1d5c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:46.911213 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-934e7b39-52e6-4faa-ad86-32c3ab1d5c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1405 microversion: 2.20 time: 1.036258 Jul 20 04:35:46.912370 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2738/5388] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:45 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1405 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:47.810584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bf8cce44-62de-49ae-9b8b-20f5b33c5ea6 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:47.811857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bf8cce44-62de-49ae-9b8b-20f5b33c5ea6 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:47.836566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf8cce44-62de-49ae-9b8b-20f5b33c5ea6 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.842976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf8cce44-62de-49ae-9b8b-20f5b33c5ea6 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:47.844109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf8cce44-62de-49ae-9b8b-20f5b33c5ea6 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.844698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf8cce44-62de-49ae-9b8b-20f5b33c5ea6 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:47.931163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2c002690-2bf3-4725-8259-70ffbb74c65c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:47.932063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2c002690-2bf3-4725-8259-70ffbb74c65c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:47.953587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c002690-2bf3-4725-8259-70ffbb74c65c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.956181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c002690-2bf3-4725-8259-70ffbb74c65c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:47.959258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c002690-2bf3-4725-8259-70ffbb74c65c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.969904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c002690-2bf3-4725-8259-70ffbb74c65c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:48.696761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c002690-2bf3-4725-8259-70ffbb74c65c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:48.715492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c002690-2bf3-4725-8259-70ffbb74c65c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:48.717053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c002690-2bf3-4725-8259-70ffbb74c65c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:48.718233 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2c002690-2bf3-4725-8259-70ffbb74c65c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1405 microversion: 2.20 time: 0.791237 Jul 20 04:35:48.721443 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2739/5389] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:47 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1405 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:48.745715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bf8cce44-62de-49ae-9b8b-20f5b33c5ea6 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:48.754868 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bf8cce44-62de-49ae-9b8b-20f5b33c5ea6 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1526 microversion: 2.1 time: 0.950412 Jul 20 04:35:48.756278 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2651/5390] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:47 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1526 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:48.775886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-632e63c8-0c19-41c1-9be9-7e834f08150e tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:48.776386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-632e63c8-0c19-41c1-9be9-7e834f08150e tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:48.786763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-632e63c8-0c19-41c1-9be9-7e834f08150e tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:48.787892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-632e63c8-0c19-41c1-9be9-7e834f08150e tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:48.789348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-632e63c8-0c19-41c1-9be9-7e834f08150e tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:48.790847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-632e63c8-0c19-41c1-9be9-7e834f08150e tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.117403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-632e63c8-0c19-41c1-9be9-7e834f08150e tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:49.141611 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-632e63c8-0c19-41c1-9be9-7e834f08150e tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1526 microversion: 2.1 time: 0.371153 Jul 20 04:35:49.157577 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2740/5391] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:48 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1526 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:49.686141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6709af2-9494-418e-aa51-9c810cecba1d tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:49.686711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a6709af2-9494-418e-aa51-9c810cecba1d tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:49.701367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6709af2-9494-418e-aa51-9c810cecba1d tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.704829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6709af2-9494-418e-aa51-9c810cecba1d tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.709699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6709af2-9494-418e-aa51-9c810cecba1d tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.709984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6709af2-9494-418e-aa51-9c810cecba1d tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.737196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc2b54f7-f30e-482c-b918-fdfe5dcfcc42 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:49.737889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc2b54f7-f30e-482c-b918-fdfe5dcfcc42 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:49.748566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc2b54f7-f30e-482c-b918-fdfe5dcfcc42 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.749010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc2b54f7-f30e-482c-b918-fdfe5dcfcc42 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.749821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc2b54f7-f30e-482c-b918-fdfe5dcfcc42 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.750265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc2b54f7-f30e-482c-b918-fdfe5dcfcc42 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.766022 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a6709af2-9494-418e-aa51-9c810cecba1d tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] HTTP exception thrown: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6709af2-9494-418e-aa51-9c810cecba1d tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Request method failure captured: Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 HTTP/1.1 Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14YNZKdtDpDED8Ro4FrlKBzUpEjd7cmg43HEMYqQCh3bRje_X5vtBvA2a3fc42CXqyOvXzJb1bs7dvFt_3LNaJrzPh_rwE88NkM6co_kfVPOQqaLRB69LGJQ4ZGDlfitPbu1CFp3-kRWFbXBWVsEXLRrxzDB05PosFGRSWH6m28-vSo Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: caaac7f913424bdda7af6cbad313bc03 Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-395168961 Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/caaac7f913424bdda7af6cbad313bc03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/caaac7f913424bdda7af6cbad313bc03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_caaac7f913424bdda7af6cbad313bc03", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/caaac7f913424bdda7af6cbad313bc03"}]}] Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-395168961 Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: caaac7f913424bdda7af6cbad313bc03 Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-395168961 Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestMultiTenantJSON-395168961-project Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: a9fd46e17ce749c78c455032f2434cc8 Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-395168961-project Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7'} Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:49.767814 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:49.773141 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:49.773141 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:49.773141 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:49.773141 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:49.773141 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:49.773141 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:49.773141 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:49.773141 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:49.773141 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:49.773141 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:49.773141 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:35:49.773141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6709af2-9494-418e-aa51-9c810cecba1d tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Returning 404 to user: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:49.777409 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a6709af2-9494-418e-aa51-9c810cecba1d tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 404 len: 111 microversion: 2.1 time: 0.617973 Jul 20 04:35:49.782050 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2652/5392] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:49 2022] DELETE /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 111 bytes in 623 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:49.812245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e4000411-6b8f-4383-b9d0-140353299ec1 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:49.816448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e4000411-6b8f-4383-b9d0-140353299ec1 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:49.834073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4000411-6b8f-4383-b9d0-140353299ec1 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.836568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4000411-6b8f-4383-b9d0-140353299ec1 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.841688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4000411-6b8f-4383-b9d0-140353299ec1 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.842181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4000411-6b8f-4383-b9d0-140353299ec1 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.423333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cc2b54f7-f30e-482c-b918-fdfe5dcfcc42 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:50.446694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cc2b54f7-f30e-482c-b918-fdfe5dcfcc42 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:50.451585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cc2b54f7-f30e-482c-b918-fdfe5dcfcc42 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:50.452972 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cc2b54f7-f30e-482c-b918-fdfe5dcfcc42 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1405 microversion: 2.20 time: 0.720552 Jul 20 04:35:50.457987 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2741/5393] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:49 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1405 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:50.469420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e4000411-6b8f-4383-b9d0-140353299ec1 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:50.482322 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e4000411-6b8f-4383-b9d0-140353299ec1 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1526 microversion: 2.1 time: 0.683697 Jul 20 04:35:50.483755 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2653/5394] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:49 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1526 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:50.501771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-31e4384d-78c8-486e-92cf-78d1f0fdf896 tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Action: 'update', calling method: >, body: {"server": {"name": "2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7_new"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:50.503843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-31e4384d-78c8-486e-92cf-78d1f0fdf896 tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:50.512993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31e4384d-78c8-486e-92cf-78d1f0fdf896 tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.514678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31e4384d-78c8-486e-92cf-78d1f0fdf896 tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.515895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31e4384d-78c8-486e-92cf-78d1f0fdf896 tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.516611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31e4384d-78c8-486e-92cf-78d1f0fdf896 tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.538689 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-31e4384d-78c8-486e-92cf-78d1f0fdf896 tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] HTTP exception thrown: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-31e4384d-78c8-486e-92cf-78d1f0fdf896 tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Request method failure captured: Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: request: PUT /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 HTTP/1.1 Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 64 Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14YNZKdtDpDED8Ro4FrlKBzUpEjd7cmg43HEMYqQCh3bRje_X5vtBvA2a3fc42CXqyOvXzJb1bs7dvFt_3LNaJrzPh_rwE88NkM6co_kfVPOQqaLRB69LGJQ4ZGDlfitPbu1CFp3-kRWFbXBWVsEXLRrxzDB05PosFGRSWH6m28-vSo Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: caaac7f913424bdda7af6cbad313bc03 Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-395168961 Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/caaac7f913424bdda7af6cbad313bc03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/caaac7f913424bdda7af6cbad313bc03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_caaac7f913424bdda7af6cbad313bc03", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/caaac7f913424bdda7af6cbad313bc03"}]}] Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-395168961 Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: caaac7f913424bdda7af6cbad313bc03 Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-395168961 Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestMultiTenantJSON-395168961-project Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: a9fd46e17ce749c78c455032f2434cc8 Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-395168961-project Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: {"server": {"name": "2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7_new"}} Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7', 'body': {'server': {'name': '2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7_new'}}} Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:35:50.541924 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:50.546465 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:50.548666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-31e4384d-78c8-486e-92cf-78d1f0fdf896 tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] Returning 404 to user: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:50.549709 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-31e4384d-78c8-486e-92cf-78d1f0fdf896 tempest-ServersNegativeTestMultiTenantJSON-395168961 tempest-ServersNegativeTestMultiTenantJSON-395168961-project] 10.222.0.20 "PUT /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 404 len: 111 microversion: 2.1 time: 0.053153 Jul 20 04:35:50.550985 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2742/5395] 10.222.0.20 () {60 vars in 1255 bytes} [Wed Jul 20 04:35:50 2022] PUT /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:35:50.561364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-de94f381-e070-42cb-8b6d-af0c488f2a3b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:50.561775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-de94f381-e070-42cb-8b6d-af0c488f2a3b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:50.569206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de94f381-e070-42cb-8b6d-af0c488f2a3b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.570850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de94f381-e070-42cb-8b6d-af0c488f2a3b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.571958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de94f381-e070-42cb-8b6d-af0c488f2a3b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.572787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de94f381-e070-42cb-8b6d-af0c488f2a3b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.608967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-de94f381-e070-42cb-8b6d-af0c488f2a3b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:50.715140 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-de94f381-e070-42cb-8b6d-af0c488f2a3b tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 204 len: 0 microversion: 2.1 time: 0.157377 Jul 20 04:35:50.719596 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2654/5396] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:50 2022] DELETE /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:35:50.730062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0df222df-8157-4d65-a6f6-5390926fc586 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:50.730686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0df222df-8157-4d65-a6f6-5390926fc586 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:50.738765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0df222df-8157-4d65-a6f6-5390926fc586 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.739224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0df222df-8157-4d65-a6f6-5390926fc586 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.740035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0df222df-8157-4d65-a6f6-5390926fc586 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.740493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0df222df-8157-4d65-a6f6-5390926fc586 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.918655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0df222df-8157-4d65-a6f6-5390926fc586 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:50.928179 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0df222df-8157-4d65-a6f6-5390926fc586 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1532 microversion: 2.1 time: 0.205735 Jul 20 04:35:50.929668 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2743/5397] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:50 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1532 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:50.997547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-abd6ef74-544a-4f2b-9720-1840fb9ef9be req-aa8ebe43-8f2c-41b2-8ed0-f030246b1215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fc74de-e748-4cab-838f-ea4b62c35ab5", "tag": "73105a65-3425-4751-af47-f418c2e5049c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:51.020071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-abd6ef74-544a-4f2b-9720-1840fb9ef9be req-aa8ebe43-8f2c-41b2-8ed0-f030246b1215 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.020775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-abd6ef74-544a-4f2b-9720-1840fb9ef9be req-aa8ebe43-8f2c-41b2-8ed0-f030246b1215 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.027435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:51.040674 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-abd6ef74-544a-4f2b-9720-1840fb9ef9be req-aa8ebe43-8f2c-41b2-8ed0-f030246b1215 service nova] Creating event network-changed:73105a65-3425-4751-af47-f418c2e5049c for instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 on n-h2-764485-11 Jul 20 04:35:51.053035 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-abd6ef74-544a-4f2b-9720-1840fb9ef9be req-aa8ebe43-8f2c-41b2-8ed0-f030246b1215 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063694 Jul 20 04:35:51.054299 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2655/5398] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:51.338892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a1f8eaf3-dfa4-4a4a-a9b0-9a976f4ffbce tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:51.345108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a1f8eaf3-dfa4-4a4a-a9b0-9a976f4ffbce tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:51.362545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1f8eaf3-dfa4-4a4a-a9b0-9a976f4ffbce tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.369554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1f8eaf3-dfa4-4a4a-a9b0-9a976f4ffbce tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.371013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1f8eaf3-dfa4-4a4a-a9b0-9a976f4ffbce tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.372219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1f8eaf3-dfa4-4a4a-a9b0-9a976f4ffbce tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.472710 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a1f8eaf3-dfa4-4a4a-a9b0-9a976f4ffbce tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/ips" status: 200 len: 144 microversion: 2.1 time: 0.151674 Jul 20 04:35:51.481400 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2744/5399] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:35:51 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/ips => generated 144 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:51.502486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7da1cebd-bc7a-4358-8041-c839e471f08f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:51.503205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7da1cebd-bc7a-4358-8041-c839e471f08f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:51.520437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7da1cebd-bc7a-4358-8041-c839e471f08f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.527949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7da1cebd-bc7a-4358-8041-c839e471f08f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.533021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7da1cebd-bc7a-4358-8041-c839e471f08f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.538842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7da1cebd-bc7a-4358-8041-c839e471f08f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.966713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8605f145-b316-4402-9c4f-41a4605f1a10 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:51.969123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8605f145-b316-4402-9c4f-41a4605f1a10 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:52.037943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8605f145-b316-4402-9c4f-41a4605f1a10 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.038524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8605f145-b316-4402-9c4f-41a4605f1a10 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:52.039383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8605f145-b316-4402-9c4f-41a4605f1a10 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.054491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8605f145-b316-4402-9c4f-41a4605f1a10 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:52.143245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:52.288819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=12 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:52.361620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7da1cebd-bc7a-4358-8041-c839e471f08f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:52.377257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7da1cebd-bc7a-4358-8041-c839e471f08f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:52.381928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7da1cebd-bc7a-4358-8041-c839e471f08f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:52.383616 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7da1cebd-bc7a-4358-8041-c839e471f08f tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1405 microversion: 2.20 time: 0.911063 Jul 20 04:35:52.397390 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2656/5400] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:51 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1405 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:52.829701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8605f145-b316-4402-9c4f-41a4605f1a10 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:52.846716 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8605f145-b316-4402-9c4f-41a4605f1a10 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1532 microversion: 2.1 time: 0.900671 Jul 20 04:35:52.850117 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2745/5401] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:51 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1532 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:53.407209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d48a1c15-f4da-44d4-a90b-c80298daff8d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:53.407996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d48a1c15-f4da-44d4-a90b-c80298daff8d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:53.422512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d48a1c15-f4da-44d4-a90b-c80298daff8d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:53.422977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d48a1c15-f4da-44d4-a90b-c80298daff8d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:53.423815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d48a1c15-f4da-44d4-a90b-c80298daff8d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:53.424257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d48a1c15-f4da-44d4-a90b-c80298daff8d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:53.866308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-79648c7e-dc34-4a5e-8995-0762cff30670 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:53.866934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-79648c7e-dc34-4a5e-8995-0762cff30670 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:53.870798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:53.883767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79648c7e-dc34-4a5e-8995-0762cff30670 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:53.884493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79648c7e-dc34-4a5e-8995-0762cff30670 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:53.887633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79648c7e-dc34-4a5e-8995-0762cff30670 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:53.889196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79648c7e-dc34-4a5e-8995-0762cff30670 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:54.071769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-79648c7e-dc34-4a5e-8995-0762cff30670 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5759fe5f2c4f85979a40e3af72ca60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d0582144e64d308b6fa586d1b163fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:54.087086 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-79648c7e-dc34-4a5e-8995-0762cff30670 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 200 len: 1490 microversion: 2.1 time: 0.224755 Jul 20 04:35:54.088422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d48a1c15-f4da-44d4-a90b-c80298daff8d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:54.089536 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2746/5402] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:53 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 1490 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:54.120301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d48a1c15-f4da-44d4-a90b-c80298daff8d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:54.128792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d48a1c15-f4da-44d4-a90b-c80298daff8d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:54.131112 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d48a1c15-f4da-44d4-a90b-c80298daff8d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1405 microversion: 2.20 time: 0.730510 Jul 20 04:35:54.132425 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2657/5403] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:53 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1405 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:54.329769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-82e8882b-a941-4f1e-98cd-61561eb083c8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e249f87b-6e77-4e3c-bba9-19ef7fae5498"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:54.331357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-82e8882b-a941-4f1e-98cd-61561eb083c8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:54.339181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82e8882b-a941-4f1e-98cd-61561eb083c8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:54.340039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82e8882b-a941-4f1e-98cd-61561eb083c8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:54.341141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82e8882b-a941-4f1e-98cd-61561eb083c8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:54.341761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82e8882b-a941-4f1e-98cd-61561eb083c8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:54.554451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-d7b21f69-876b-4f50-b574-2c41eeedf9eb req-eb2afe41-e532-4c3f-b663-ee04675cf587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7", "name": "network-vif-deleted", "tag": "a3d449d0-a4f3-474d-9d77-f5322c4bf61a"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:54.586161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d7b21f69-876b-4f50-b574-2c41eeedf9eb req-eb2afe41-e532-4c3f-b663-ee04675cf587 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:54.588997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d7b21f69-876b-4f50-b574-2c41eeedf9eb req-eb2afe41-e532-4c3f-b663-ee04675cf587 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:54.632776 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-d7b21f69-876b-4f50-b574-2c41eeedf9eb req-eb2afe41-e532-4c3f-b663-ee04675cf587 service nova] Creating event network-vif-deleted:a3d449d0-a4f3-474d-9d77-f5322c4bf61a for instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 on n-h1-764485-11 Jul 20 04:35:54.651406 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-d7b21f69-876b-4f50-b574-2c41eeedf9eb req-eb2afe41-e532-4c3f-b663-ee04675cf587 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.474937 Jul 20 04:35:54.654011 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2747/5404] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:55.107953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc65beac-2f26-494f-99d6-f83cd07ff7c0 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:55.109780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc65beac-2f26-494f-99d6-f83cd07ff7c0 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] [instance: 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:55.120055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc65beac-2f26-494f-99d6-f83cd07ff7c0 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.120758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc65beac-2f26-494f-99d6-f83cd07ff7c0 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.121761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc65beac-2f26-494f-99d6-f83cd07ff7c0 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.122374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc65beac-2f26-494f-99d6-f83cd07ff7c0 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.171400 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-cc65beac-2f26-494f-99d6-f83cd07ff7c0 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] HTTP exception thrown: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc65beac-2f26-494f-99d6-f83cd07ff7c0 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Request method failure captured: Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 HTTP/1.1 Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14X_PkVUM13mcYyzXK_oJobA6twe8hru1CR3--9iCgeCIZblGHKx6ZzPODm6sQwHQ-qZqXWjIOtITDKDHRfpatbuoZiQgPuYWzNfXN3I4xnj24-KeGTGDpPP6YcsCaZ_zf6JwBFVa0rUGnS4DN9fxWfNNhb57Qp6RraDrRmOEM0HEhE Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: b3d0582144e64d308b6fa586d1b163fd Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2126957094 Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3d0582144e64d308b6fa586d1b163fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3d0582144e64d308b6fa586d1b163fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3d0582144e64d308b6fa586d1b163fd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3d0582144e64d308b6fa586d1b163fd"}]}] Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2126957094 Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: b3d0582144e64d308b6fa586d1b163fd Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2126957094 Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2126957094-project Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8c5759fe5f2c4f85979a40e3af72ca60 Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2126957094-project Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7'} Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:55.173327 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:55.178171 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:55.178171 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:55.178171 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:55.178171 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:55.178171 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:55.178171 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:55.178171 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:55.178171 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. Jul 20 04:35:55.178171 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:35:55.193680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc65beac-2f26-494f-99d6-f83cd07ff7c0 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] Returning 404 to user: Instance 2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:55.196200 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cc65beac-2f26-494f-99d6-f83cd07ff7c0 tempest-ServersNegativeTestMultiTenantJSON-2126957094 tempest-ServersNegativeTestMultiTenantJSON-2126957094-project] 10.222.0.20 "GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7" status: 404 len: 111 microversion: 2.1 time: 0.094078 Jul 20 04:35:55.202288 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2748/5405] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:55 2022] GET /compute/v2.1/servers/2c7a15ab-c5c8-4c4f-9a58-13a015cb20c7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:55.210359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a911e53f-f52e-4286-8781-8985ee372df9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:55.211253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a911e53f-f52e-4286-8781-8985ee372df9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:55.240709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a911e53f-f52e-4286-8781-8985ee372df9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.241429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a911e53f-f52e-4286-8781-8985ee372df9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.242416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a911e53f-f52e-4286-8781-8985ee372df9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.243022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a911e53f-f52e-4286-8781-8985ee372df9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.605625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a911e53f-f52e-4286-8781-8985ee372df9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:55.621897 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-82e8882b-a941-4f1e-98cd-61561eb083c8 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "POST /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.296199 Jul 20 04:35:55.627441 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2658/5406] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:35:54 2022] POST /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments => generated 194 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:55.647328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a911e53f-f52e-4286-8781-8985ee372df9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:55.662824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a911e53f-f52e-4286-8781-8985ee372df9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:55.673977 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a911e53f-f52e-4286-8781-8985ee372df9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1405 microversion: 2.20 time: 0.464981 Jul 20 04:35:55.675255 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2749/5407] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:55 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:55.796403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1995428903", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "df976f65-3377-4f82-9769-9296ce9a0e91"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:55.908635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] validate_networks() for [('df976f65-3377-4f82-9769-9296ce9a0e91', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:35:56.696776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3f928c13-4eb0-4e05-94c9-39d828184c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:56.699069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3f928c13-4eb0-4e05-94c9-39d828184c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:56.711051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f928c13-4eb0-4e05-94c9-39d828184c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:56.716408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f928c13-4eb0-4e05-94c9-39d828184c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:56.723875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f928c13-4eb0-4e05-94c9-39d828184c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:56.726756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3f928c13-4eb0-4e05-94c9-39d828184c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:57.667845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:35:57.668920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:35:57.669745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:35:57.670403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:35:57.671061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:35:57.676365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:57.695846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:57.701947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:57.707163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:57.709246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:57.842145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Getting quotas for project af5c715f17d74241b139cbd856a05d18. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:35:57.859009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Getting quotas for user 7aab852ce6a046e0bbf780aea03cb66c and project af5c715f17d74241b139cbd856a05d18. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:35:57.893376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:35:57.904141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:35:58.050907 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e82feade-9ba0-4113-8532-436774761fbe tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.418234 Jul 20 04:35:58.051677 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2659/5408] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:35:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:35:58.068786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-77601391-7e1a-4a2b-8161-379c55c8ad08 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:58.069420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-77601391-7e1a-4a2b-8161-379c55c8ad08 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:58.188008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3f928c13-4eb0-4e05-94c9-39d828184c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:58.197995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3f928c13-4eb0-4e05-94c9-39d828184c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:58.212114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3f928c13-4eb0-4e05-94c9-39d828184c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:58.216549 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3f928c13-4eb0-4e05-94c9-39d828184c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1405 microversion: 2.20 time: 1.524344 Jul 20 04:35:58.228929 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2750/5409] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:56 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1405 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:35:58.341688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-77601391-7e1a-4a2b-8161-379c55c8ad08 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:58.349363 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-77601391-7e1a-4a2b-8161-379c55c8ad08 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1216 microversion: 2.1 time: 0.289808 Jul 20 04:35:58.357267 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2660/5410] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:58 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1216 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:59.243219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ab289e99-351f-47f5-a57b-94cf9c5f0c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:59.244057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ab289e99-351f-47f5-a57b-94cf9c5f0c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:59.276640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab289e99-351f-47f5-a57b-94cf9c5f0c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:59.277161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab289e99-351f-47f5-a57b-94cf9c5f0c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:59.293791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab289e99-351f-47f5-a57b-94cf9c5f0c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:59.294851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab289e99-351f-47f5-a57b-94cf9c5f0c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:59.381263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-24d304e3-ebd4-433e-945e-94d98e62715b tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:59.382496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-24d304e3-ebd4-433e-945e-94d98e62715b tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:59.987532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-24d304e3-ebd4-433e-945e-94d98e62715b tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:59.997338 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-24d304e3-ebd4-433e-945e-94d98e62715b tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1216 microversion: 2.1 time: 0.626804 Jul 20 04:36:00.000443 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2661/5411] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:59 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1216 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:00.318477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-80eeba25-4938-40c8-9ec2-72cb06d9fead req-7a58e87c-c03d-4c13-9c29-e105548584ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc74de-e748-4cab-838f-ea4b62c35ab5", "name": "network-vif-plugged", "status": "completed", "tag": "73105a65-3425-4751-af47-f418c2e5049c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:00.334913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-80eeba25-4938-40c8-9ec2-72cb06d9fead req-7a58e87c-c03d-4c13-9c29-e105548584ff service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.339217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-80eeba25-4938-40c8-9ec2-72cb06d9fead req-7a58e87c-c03d-4c13-9c29-e105548584ff service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.396808 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-80eeba25-4938-40c8-9ec2-72cb06d9fead req-7a58e87c-c03d-4c13-9c29-e105548584ff service nova] Creating event network-vif-plugged:73105a65-3425-4751-af47-f418c2e5049c for instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 on n-h2-764485-11 Jul 20 04:36:00.415012 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-80eeba25-4938-40c8-9ec2-72cb06d9fead req-7a58e87c-c03d-4c13-9c29-e105548584ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099946 Jul 20 04:36:00.425221 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2662/5412] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:00.463289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ab289e99-351f-47f5-a57b-94cf9c5f0c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:00.477323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ab289e99-351f-47f5-a57b-94cf9c5f0c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:00.488751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ab289e99-351f-47f5-a57b-94cf9c5f0c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:00.494656 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ab289e99-351f-47f5-a57b-94cf9c5f0c28 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1405 microversion: 2.20 time: 1.255485 Jul 20 04:36:00.503014 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2751/5413] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:59 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1405 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:01.019935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3d7a77c2-7a96-4bb4-9f2e-88a0887408bf tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:01.020654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3d7a77c2-7a96-4bb4-9f2e-88a0887408bf tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:01.034047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d7a77c2-7a96-4bb4-9f2e-88a0887408bf tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.041587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d7a77c2-7a96-4bb4-9f2e-88a0887408bf tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.042962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d7a77c2-7a96-4bb4-9f2e-88a0887408bf tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.046667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d7a77c2-7a96-4bb4-9f2e-88a0887408bf tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.522693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ae0c0a80-7c80-48d3-a719-ba03a411f3a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:01.523326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ae0c0a80-7c80-48d3-a719-ba03a411f3a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:01.538603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae0c0a80-7c80-48d3-a719-ba03a411f3a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.541462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae0c0a80-7c80-48d3-a719-ba03a411f3a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.544750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae0c0a80-7c80-48d3-a719-ba03a411f3a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.545315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae0c0a80-7c80-48d3-a719-ba03a411f3a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.621277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3d7a77c2-7a96-4bb4-9f2e-88a0887408bf tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.631583 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3d7a77c2-7a96-4bb4-9f2e-88a0887408bf tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1274 microversion: 2.1 time: 0.616462 Jul 20 04:36:01.641207 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2663/5414] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:01 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1274 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:01.997466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ae0c0a80-7c80-48d3-a719-ba03a411f3a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:02.013866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ae0c0a80-7c80-48d3-a719-ba03a411f3a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:02.015549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ae0c0a80-7c80-48d3-a719-ba03a411f3a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:02.024461 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ae0c0a80-7c80-48d3-a719-ba03a411f3a0 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1405 microversion: 2.20 time: 0.501868 Jul 20 04:36:02.027767 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2752/5415] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:01 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1405 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:02.657342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c08b87b3-d0cb-4210-9cee-5527e13fa81f tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:02.658706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c08b87b3-d0cb-4210-9cee-5527e13fa81f tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:02.678650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c08b87b3-d0cb-4210-9cee-5527e13fa81f tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.688032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c08b87b3-d0cb-4210-9cee-5527e13fa81f tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:02.688999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c08b87b3-d0cb-4210-9cee-5527e13fa81f tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.690218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c08b87b3-d0cb-4210-9cee-5527e13fa81f tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:03.046092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-320138f1-f9de-4bf7-8f9b-f4ee63c619b4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:03.046728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-320138f1-f9de-4bf7-8f9b-f4ee63c619b4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:03.058300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-320138f1-f9de-4bf7-8f9b-f4ee63c619b4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:03.058771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-320138f1-f9de-4bf7-8f9b-f4ee63c619b4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:03.059598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-320138f1-f9de-4bf7-8f9b-f4ee63c619b4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:03.060055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-320138f1-f9de-4bf7-8f9b-f4ee63c619b4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:03.473876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c08b87b3-d0cb-4210-9cee-5527e13fa81f tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:03.486379 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c08b87b3-d0cb-4210-9cee-5527e13fa81f tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1316 microversion: 2.1 time: 0.832776 Jul 20 04:36:03.487009 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2664/5416] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:02 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1316 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:03.616406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-320138f1-f9de-4bf7-8f9b-f4ee63c619b4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:03.625504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-320138f1-f9de-4bf7-8f9b-f4ee63c619b4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:03.627294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-320138f1-f9de-4bf7-8f9b-f4ee63c619b4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:03.633014 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-320138f1-f9de-4bf7-8f9b-f4ee63c619b4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1405 microversion: 2.20 time: 0.591884 Jul 20 04:36:03.633702 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2753/5417] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:03 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1405 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:04.504612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0ff4a803-7b0d-45cb-a191-533f3d861b97 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:04.505456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0ff4a803-7b0d-45cb-a191-533f3d861b97 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:04.529101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ff4a803-7b0d-45cb-a191-533f3d861b97 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.529101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ff4a803-7b0d-45cb-a191-533f3d861b97 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.535580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ff4a803-7b0d-45cb-a191-533f3d861b97 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.536586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ff4a803-7b0d-45cb-a191-533f3d861b97 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.653167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-32282f7f-474c-4668-9b49-d9e5a2961903 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:04.655051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-32282f7f-474c-4668-9b49-d9e5a2961903 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:04.658383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:04.676809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32282f7f-474c-4668-9b49-d9e5a2961903 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.678710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32282f7f-474c-4668-9b49-d9e5a2961903 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.679625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32282f7f-474c-4668-9b49-d9e5a2961903 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.694406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32282f7f-474c-4668-9b49-d9e5a2961903 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.814131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:07.147768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-32282f7f-474c-4668-9b49-d9e5a2961903 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:07.162554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-32282f7f-474c-4668-9b49-d9e5a2961903 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:07.164070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-32282f7f-474c-4668-9b49-d9e5a2961903 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:07.168138 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-32282f7f-474c-4668-9b49-d9e5a2961903 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1597 microversion: 2.20 time: 2.517421 Jul 20 04:36:07.170714 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2754/5418] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:04 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1597 bytes in 2524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:07.179338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-35d38837-d169-422f-8ffc-9b263e415fe1 req-64c8200d-19bb-4d2c-b63f-3360e5d5b246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f15d18-170f-48f8-a793-efe552f4c0b2", "tag": "6db761bf-90f5-4100-8b51-7e6c8cf5b0fb"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:07.201311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0ff4a803-7b0d-45cb-a191-533f3d861b97 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:07.205731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-35d38837-d169-422f-8ffc-9b263e415fe1 req-64c8200d-19bb-4d2c-b63f-3360e5d5b246 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.211675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-35d38837-d169-422f-8ffc-9b263e415fe1 req-64c8200d-19bb-4d2c-b63f-3360e5d5b246 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.215145 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0ff4a803-7b0d-45cb-a191-533f3d861b97 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1316 microversion: 2.1 time: 2.714823 Jul 20 04:36:07.219955 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2665/5419] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:04 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1316 bytes in 2720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:07.233874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-42f59a02-80a0-421b-a511-bd22bac47847 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.234480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-42f59a02-80a0-421b-a511-bd22bac47847 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.247543 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-35d38837-d169-422f-8ffc-9b263e415fe1 req-64c8200d-19bb-4d2c-b63f-3360e5d5b246 service nova] Creating event network-changed:6db761bf-90f5-4100-8b51-7e6c8cf5b0fb for instance 24f15d18-170f-48f8-a793-efe552f4c0b2 on n-h1-764485-11 Jul 20 04:36:07.248233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-42f59a02-80a0-421b-a511-bd22bac47847 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.251108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-42f59a02-80a0-421b-a511-bd22bac47847 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.253490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-42f59a02-80a0-421b-a511-bd22bac47847 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.257700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-42f59a02-80a0-421b-a511-bd22bac47847 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.261248 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-35d38837-d169-422f-8ffc-9b263e415fe1 req-64c8200d-19bb-4d2c-b63f-3360e5d5b246 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085140 Jul 20 04:36:07.261979 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2755/5420] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:07.518473 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-42f59a02-80a0-421b-a511-bd22bac47847 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.296820 Jul 20 04:36:07.520282 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2666/5421] 10.222.0.20 () {60 vars in 1315 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/os-interface => generated 285 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:36:08.241795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5774d5bd-306e-409e-b461-46b9055928c4 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:08.242674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5774d5bd-306e-409e-b461-46b9055928c4 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.257893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5774d5bd-306e-409e-b461-46b9055928c4 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.258367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5774d5bd-306e-409e-b461-46b9055928c4 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.262611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5774d5bd-306e-409e-b461-46b9055928c4 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.263144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5774d5bd-306e-409e-b461-46b9055928c4 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.130949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5774d5bd-306e-409e-b461-46b9055928c4 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.143143 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5774d5bd-306e-409e-b461-46b9055928c4 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1316 microversion: 2.1 time: 0.908692 Jul 20 04:36:09.144597 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2756/5422] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:08 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1316 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:09.612115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:09.625112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-81fea24e-64cc-4736-8821-aa6c1b2ecf6b req-feab2493-7f2e-4c87-be36-ee2611d64294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fc74de-e748-4cab-838f-ea4b62c35ab5", "tag": "73105a65-3425-4751-af47-f418c2e5049c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:09.636579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-81fea24e-64cc-4736-8821-aa6c1b2ecf6b req-feab2493-7f2e-4c87-be36-ee2611d64294 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.637365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-81fea24e-64cc-4736-8821-aa6c1b2ecf6b req-feab2493-7f2e-4c87-be36-ee2611d64294 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.659891 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-81fea24e-64cc-4736-8821-aa6c1b2ecf6b req-feab2493-7f2e-4c87-be36-ee2611d64294 service nova] Creating event network-changed:73105a65-3425-4751-af47-f418c2e5049c for instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 on n-h2-764485-11 Jul 20 04:36:09.669666 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-81fea24e-64cc-4736-8821-aa6c1b2ecf6b req-feab2493-7f2e-4c87-be36-ee2611d64294 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058081 Jul 20 04:36:09.674925 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2667/5423] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:10.163494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-039b81be-428d-40b9-a43a-e78fa3906372 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:10.164576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-039b81be-428d-40b9-a43a-e78fa3906372 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:10.180691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-039b81be-428d-40b9-a43a-e78fa3906372 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.181958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-039b81be-428d-40b9-a43a-e78fa3906372 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.184464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-039b81be-428d-40b9-a43a-e78fa3906372 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.185938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-039b81be-428d-40b9-a43a-e78fa3906372 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.724975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-039b81be-428d-40b9-a43a-e78fa3906372 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:10.733228 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-039b81be-428d-40b9-a43a-e78fa3906372 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1316 microversion: 2.1 time: 0.574868 Jul 20 04:36:10.737324 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2757/5424] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:10 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1316 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:11.753738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b8fe0a49-4b88-4e7b-a370-17bde45553bc tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:11.754462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b8fe0a49-4b88-4e7b-a370-17bde45553bc tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:11.767864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:11.770643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8fe0a49-4b88-4e7b-a370-17bde45553bc tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.771542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8fe0a49-4b88-4e7b-a370-17bde45553bc tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.777433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8fe0a49-4b88-4e7b-a370-17bde45553bc tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.778309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8fe0a49-4b88-4e7b-a370-17bde45553bc tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.378150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b8fe0a49-4b88-4e7b-a370-17bde45553bc tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:12.395741 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b8fe0a49-4b88-4e7b-a370-17bde45553bc tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1316 microversion: 2.1 time: 0.645853 Jul 20 04:36:12.397137 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2668/5425] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:11 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1316 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:12.999956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7533ce6a-9a08-45bc-9060-7dc4d4cf8ccf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:13.004108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7533ce6a-9a08-45bc-9060-7dc4d4cf8ccf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:13.017691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7533ce6a-9a08-45bc-9060-7dc4d4cf8ccf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.018151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7533ce6a-9a08-45bc-9060-7dc4d4cf8ccf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.020599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7533ce6a-9a08-45bc-9060-7dc4d4cf8ccf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.022075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7533ce6a-9a08-45bc-9060-7dc4d4cf8ccf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.086709 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7533ce6a-9a08-45bc-9060-7dc4d4cf8ccf tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093604 Jul 20 04:36:13.089492 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2758/5426] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:36:12 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:13.097708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9c4a327a-5dbf-4e4e-9ff2-73c827f2212d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:13.098901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9c4a327a-5dbf-4e4e-9ff2-73c827f2212d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:13.121963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c4a327a-5dbf-4e4e-9ff2-73c827f2212d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.122431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c4a327a-5dbf-4e4e-9ff2-73c827f2212d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.123229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c4a327a-5dbf-4e4e-9ff2-73c827f2212d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.127075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c4a327a-5dbf-4e4e-9ff2-73c827f2212d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.208882 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9c4a327a-5dbf-4e4e-9ff2-73c827f2212d tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments/e249f87b-6e77-4e3c-bba9-19ef7fae5498" status: 200 len: 194 microversion: 2.1 time: 0.115349 Jul 20 04:36:13.215820 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2669/5427] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Jul 20 04:36:13 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments/e249f87b-6e77-4e3c-bba9-19ef7fae5498 => generated 194 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:13.414285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-73c2ded1-1c5a-48d6-a037-88cb7220a4f8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:13.414984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-73c2ded1-1c5a-48d6-a037-88cb7220a4f8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:13.428218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-73c2ded1-1c5a-48d6-a037-88cb7220a4f8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.429987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-73c2ded1-1c5a-48d6-a037-88cb7220a4f8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.432922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-73c2ded1-1c5a-48d6-a037-88cb7220a4f8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.433386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-73c2ded1-1c5a-48d6-a037-88cb7220a4f8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.375306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-73c2ded1-1c5a-48d6-a037-88cb7220a4f8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:14.392845 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-73c2ded1-1c5a-48d6-a037-88cb7220a4f8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1316 microversion: 2.1 time: 0.982955 Jul 20 04:36:14.398023 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2759/5428] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:13 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1316 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:15.413590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-509c98f3-e0e2-48c8-b0de-72c69ad6284d tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:15.414256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-509c98f3-e0e2-48c8-b0de-72c69ad6284d tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:15.442375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-509c98f3-e0e2-48c8-b0de-72c69ad6284d tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.449653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-509c98f3-e0e2-48c8-b0de-72c69ad6284d tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:15.459864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-509c98f3-e0e2-48c8-b0de-72c69ad6284d tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.466463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-509c98f3-e0e2-48c8-b0de-72c69ad6284d tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:15.613916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-5d8d90c4-17d2-4817-bb7a-9ffb31e85304 req-dd26ec2d-b1a1-4304-bad5-261c212768da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f15d18-170f-48f8-a793-efe552f4c0b2", "name": "network-vif-plugged", "status": "completed", "tag": "6db761bf-90f5-4100-8b51-7e6c8cf5b0fb"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:15.629413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5d8d90c4-17d2-4817-bb7a-9ffb31e85304 req-dd26ec2d-b1a1-4304-bad5-261c212768da service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.629785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5d8d90c4-17d2-4817-bb7a-9ffb31e85304 req-dd26ec2d-b1a1-4304-bad5-261c212768da service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:15.654159 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-5d8d90c4-17d2-4817-bb7a-9ffb31e85304 req-dd26ec2d-b1a1-4304-bad5-261c212768da service nova] Creating event network-vif-plugged:6db761bf-90f5-4100-8b51-7e6c8cf5b0fb for instance 24f15d18-170f-48f8-a793-efe552f4c0b2 on n-h1-764485-11 Jul 20 04:36:15.669681 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-5d8d90c4-17d2-4817-bb7a-9ffb31e85304 req-dd26ec2d-b1a1-4304-bad5-261c212768da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.588284 Jul 20 04:36:15.672399 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2670/5429] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:16.265137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-509c98f3-e0e2-48c8-b0de-72c69ad6284d tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:16.277075 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-509c98f3-e0e2-48c8-b0de-72c69ad6284d tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1316 microversion: 2.1 time: 0.868217 Jul 20 04:36:16.277707 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2760/5430] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:15 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1316 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:16.363744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-273d9e97-87f1-4c99-9705-6ddc9cf5084b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87a7d230-eb7b-4ef9-ba6c-9645b0c9fb94"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:16.365262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-273d9e97-87f1-4c99-9705-6ddc9cf5084b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:16.378155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-273d9e97-87f1-4c99-9705-6ddc9cf5084b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.381643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-273d9e97-87f1-4c99-9705-6ddc9cf5084b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.384900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-273d9e97-87f1-4c99-9705-6ddc9cf5084b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.389795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-273d9e97-87f1-4c99-9705-6ddc9cf5084b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.992113 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-273d9e97-87f1-4c99-9705-6ddc9cf5084b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "POST /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.633120 Jul 20 04:36:17.000850 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2671/5431] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:36:16 2022] POST /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments => generated 194 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:17.294330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b3807169-8d74-41af-b703-5fc95e35151e tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:17.295573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b3807169-8d74-41af-b703-5fc95e35151e tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:17.310363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3807169-8d74-41af-b703-5fc95e35151e tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:17.313071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3807169-8d74-41af-b703-5fc95e35151e tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:17.316201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3807169-8d74-41af-b703-5fc95e35151e tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:17.316860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3807169-8d74-41af-b703-5fc95e35151e tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:17.568619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b3807169-8d74-41af-b703-5fc95e35151e tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:17.576822 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b3807169-8d74-41af-b703-5fc95e35151e tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1316 microversion: 2.1 time: 0.287309 Jul 20 04:36:17.589333 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2761/5432] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:17 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:18.596842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7d51742-bdcd-4ee3-b963-f6877fb37333 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:18.597564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c7d51742-bdcd-4ee3-b963-f6877fb37333 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:18.605510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7d51742-bdcd-4ee3-b963-f6877fb37333 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:18.620324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7d51742-bdcd-4ee3-b963-f6877fb37333 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:18.622160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7d51742-bdcd-4ee3-b963-f6877fb37333 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:18.623064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7d51742-bdcd-4ee3-b963-f6877fb37333 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.001226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c7d51742-bdcd-4ee3-b963-f6877fb37333 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:19.010702 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c7d51742-bdcd-4ee3-b963-f6877fb37333 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1503 microversion: 2.1 time: 0.417987 Jul 20 04:36:19.020852 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2672/5433] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:18 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1503 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:19.043855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-483d3bfc-b6de-46d0-83eb-c40005cd0290 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:19.044992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-483d3bfc-b6de-46d0-83eb-c40005cd0290 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:19.066366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-483d3bfc-b6de-46d0-83eb-c40005cd0290 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.072289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-483d3bfc-b6de-46d0-83eb-c40005cd0290 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.076068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-483d3bfc-b6de-46d0-83eb-c40005cd0290 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.076872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-483d3bfc-b6de-46d0-83eb-c40005cd0290 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.312254 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-483d3bfc-b6de-46d0-83eb-c40005cd0290 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "DELETE /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.273497 Jul 20 04:36:19.330133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b8d5563-ff79-42e6-aa5a-449ea000480c tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:19.330918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0b8d5563-ff79-42e6-aa5a-449ea000480c tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:19.336820 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2762/5434] 10.222.0.20 () {58 vars in 1295 bytes} [Wed Jul 20 04:36:19 2022] DELETE /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2/os-server-password => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:19.343300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b8d5563-ff79-42e6-aa5a-449ea000480c tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.344317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b8d5563-ff79-42e6-aa5a-449ea000480c tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.346826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b8d5563-ff79-42e6-aa5a-449ea000480c tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.347489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b8d5563-ff79-42e6-aa5a-449ea000480c tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.421992 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0b8d5563-ff79-42e6-aa5a-449ea000480c tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.096521 Jul 20 04:36:19.429610 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2673/5435] 10.222.0.20 () {58 vars in 1292 bytes} [Wed Jul 20 04:36:19 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2/os-server-password => generated 16 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:36:19.436375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-65ed0483-8483-4931-b1aa-c2ce92227130 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:19.437185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-65ed0483-8483-4931-b1aa-c2ce92227130 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:19.448417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65ed0483-8483-4931-b1aa-c2ce92227130 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.449300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65ed0483-8483-4931-b1aa-c2ce92227130 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.450281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65ed0483-8483-4931-b1aa-c2ce92227130 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.452665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-65ed0483-8483-4931-b1aa-c2ce92227130 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.517904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-65ed0483-8483-4931-b1aa-c2ce92227130 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:36:19.734883 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-65ed0483-8483-4931-b1aa-c2ce92227130 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "DELETE /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 204 len: 0 microversion: 2.1 time: 0.301896 Jul 20 04:36:19.747049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-932e3822-be52-405c-a760-700e2cde09b6 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:19.749359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-932e3822-be52-405c-a760-700e2cde09b6 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:19.753593 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2763/5436] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:19 2022] DELETE /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:19.766995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-932e3822-be52-405c-a760-700e2cde09b6 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.769069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-932e3822-be52-405c-a760-700e2cde09b6 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.773282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-932e3822-be52-405c-a760-700e2cde09b6 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.775531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-932e3822-be52-405c-a760-700e2cde09b6 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:20.089287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-932e3822-be52-405c-a760-700e2cde09b6 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:20.097745 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-932e3822-be52-405c-a760-700e2cde09b6 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1509 microversion: 2.1 time: 0.356241 Jul 20 04:36:20.098831 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2674/5437] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:19 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:21.123150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a2f920cb-9d4e-492c-b4d2-19fe34209df8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:21.124878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a2f920cb-9d4e-492c-b4d2-19fe34209df8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:21.153237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2f920cb-9d4e-492c-b4d2-19fe34209df8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:21.154135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2f920cb-9d4e-492c-b4d2-19fe34209df8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:21.155230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2f920cb-9d4e-492c-b4d2-19fe34209df8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:21.156400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2f920cb-9d4e-492c-b4d2-19fe34209df8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:21.788515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a2f920cb-9d4e-492c-b4d2-19fe34209df8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:21.797401 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a2f920cb-9d4e-492c-b4d2-19fe34209df8 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1509 microversion: 2.1 time: 0.679221 Jul 20 04:36:21.811868 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2764/5438] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:21 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1509 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:22.800590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-5396802b-d840-4baf-8996-d608e0e04596 req-0a623dfe-fb57-4126-9158-a7b2e17c619c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f15d18-170f-48f8-a793-efe552f4c0b2", "name": "network-vif-deleted", "tag": "6db761bf-90f5-4100-8b51-7e6c8cf5b0fb"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:22.827292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-41ea481f-743a-4e77-856e-1f9efad136ce tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:22.828082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-41ea481f-743a-4e77-856e-1f9efad136ce tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:22.841117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5396802b-d840-4baf-8996-d608e0e04596 req-0a623dfe-fb57-4126-9158-a7b2e17c619c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:22.841579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5396802b-d840-4baf-8996-d608e0e04596 req-0a623dfe-fb57-4126-9158-a7b2e17c619c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:22.848763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41ea481f-743a-4e77-856e-1f9efad136ce tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:22.849498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41ea481f-743a-4e77-856e-1f9efad136ce tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:22.854781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41ea481f-743a-4e77-856e-1f9efad136ce tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:22.855254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41ea481f-743a-4e77-856e-1f9efad136ce tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:22.890259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:22.895894 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-5396802b-d840-4baf-8996-d608e0e04596 req-0a623dfe-fb57-4126-9158-a7b2e17c619c service nova] Creating event network-vif-deleted:6db761bf-90f5-4100-8b51-7e6c8cf5b0fb for instance 24f15d18-170f-48f8-a793-efe552f4c0b2 on n-h1-764485-11 Jul 20 04:36:22.920657 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-5396802b-d840-4baf-8996-d608e0e04596 req-0a623dfe-fb57-4126-9158-a7b2e17c619c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124406 Jul 20 04:36:22.923356 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2675/5439] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:23.093083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-41ea481f-743a-4e77-856e-1f9efad136ce tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aab852ce6a046e0bbf780aea03cb66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5c715f17d74241b139cbd856a05d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:23.106258 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-41ea481f-743a-4e77-856e-1f9efad136ce tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 200 len: 1301 microversion: 2.1 time: 0.283499 Jul 20 04:36:23.106859 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2765/5440] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:22 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 1301 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:24.123350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b14aafdd-ccd4-4924-a2d0-0b1455751668 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:24.124904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b14aafdd-ccd4-4924-a2d0-0b1455751668 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] [instance: 24f15d18-170f-48f8-a793-efe552f4c0b2] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:24.150767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b14aafdd-ccd4-4924-a2d0-0b1455751668 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:24.151272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b14aafdd-ccd4-4924-a2d0-0b1455751668 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:24.152570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b14aafdd-ccd4-4924-a2d0-0b1455751668 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:24.154487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b14aafdd-ccd4-4924-a2d0-0b1455751668 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:24.192515 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b14aafdd-ccd4-4924-a2d0-0b1455751668 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] HTTP exception thrown: Instance 24f15d18-170f-48f8-a793-efe552f4c0b2 could not be found. Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b14aafdd-ccd4-4924-a2d0-0b1455751668 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Request method failure captured: Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 HTTP/1.1 Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14YrPht6KdBmYda7XIQw8Fwvhb-zX4g1tGP4pLVv-wlQrcGabk1nD36YiGWKfV-wDVIGuYdF-yklyKkB8I_aLBe5wvBl10jwDIjGrNiXH1Qb_WNhJSkhC8tl-ch-sLxg9ZzgGRdvBIM3ONl-8oeTTASSr06IqW7-x24HbyP37XEqjIQ Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: af5c715f17d74241b139cbd856a05d18 Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerPasswordTestJSON-512369935 Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/af5c715f17d74241b139cbd856a05d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af5c715f17d74241b139cbd856a05d18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_af5c715f17d74241b139cbd856a05d18", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af5c715f17d74241b139cbd856a05d18"}]}] Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerPasswordTestJSON-512369935 Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: af5c715f17d74241b139cbd856a05d18 Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerPasswordTestJSON-512369935 Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerPasswordTestJSON-512369935-project Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 7aab852ce6a046e0bbf780aea03cb66c Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerPasswordTestJSON-512369935-project Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 24f15d18-170f-48f8-a793-efe552f4c0b2 could not be found. Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '24f15d18-170f-48f8-a793-efe552f4c0b2'} Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f15d18-170f-48f8-a793-efe552f4c0b2 could not be found. Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f15d18-170f-48f8-a793-efe552f4c0b2 could not be found. Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:24.199750 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:36:24.204550 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:24.204550 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:24.204550 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:24.204550 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:24.204550 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:24.204550 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f15d18-170f-48f8-a793-efe552f4c0b2 could not be found. Jul 20 04:36:24.204550 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:36:24.206904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b14aafdd-ccd4-4924-a2d0-0b1455751668 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] Returning 404 to user: Instance 24f15d18-170f-48f8-a793-efe552f4c0b2 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:24.208345 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b14aafdd-ccd4-4924-a2d0-0b1455751668 tempest-ServerPasswordTestJSON-512369935 tempest-ServerPasswordTestJSON-512369935-project] 10.222.0.20 "GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2" status: 404 len: 111 microversion: 2.1 time: 0.089823 Jul 20 04:36:24.215542 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2676/5441] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:24 2022] GET /compute/v2.1/servers/24f15d18-170f-48f8-a793-efe552f4c0b2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:33.273658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1871956962", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:33.314946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:33.320092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:33.425755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:34.475933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:34.476552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:34.476991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:34.478429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:34.479261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:34.503025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.503490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.504354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.504800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.548699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Getting quotas for project 590dd193a11c4eb9ac1d977c6b0b4ebc. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:34.557932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Getting quotas for user 2d47dca5ecdf431c8f610b74abfa5c0f and project 590dd193a11c4eb9ac1d977c6b0b4ebc. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:34.574606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:34.577077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:34.701214 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-03ede689-e0c8-483b-a001-43d7da593108 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.433441 Jul 20 04:36:34.702387 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2766/5442] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:36:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:34.712815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-192fbdc8-b6dc-4100-b2ab-72be531c7815 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:34.713497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-192fbdc8-b6dc-4100-b2ab-72be531c7815 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:34.721494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:34.726439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:34.969159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-192fbdc8-b6dc-4100-b2ab-72be531c7815 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:34.995371 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-192fbdc8-b6dc-4100-b2ab-72be531c7815 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1215 microversion: 2.1 time: 0.275090 Jul 20 04:36:34.996096 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2677/5443] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:34 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1215 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:35.572781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2e31ab84-72f3-4d9e-b250-c0e96658ad2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:35.574402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2e31ab84-72f3-4d9e-b250-c0e96658ad2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:35.588602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e31ab84-72f3-4d9e-b250-c0e96658ad2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.589387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e31ab84-72f3-4d9e-b250-c0e96658ad2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.590390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e31ab84-72f3-4d9e-b250-c0e96658ad2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.594400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e31ab84-72f3-4d9e-b250-c0e96658ad2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.669601 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2e31ab84-72f3-4d9e-b250-c0e96658ad2b tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.101564 Jul 20 04:36:35.671171 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2767/5444] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:36:35 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:35.812603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-23b8ccda-7830-410b-875a-9ebebf5840aa tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:35.813210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-23b8ccda-7830-410b-875a-9ebebf5840aa tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:35.828958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23b8ccda-7830-410b-875a-9ebebf5840aa tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.829425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23b8ccda-7830-410b-875a-9ebebf5840aa tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.830231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23b8ccda-7830-410b-875a-9ebebf5840aa tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.830683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23b8ccda-7830-410b-875a-9ebebf5840aa tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.906635 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-23b8ccda-7830-410b-875a-9ebebf5840aa tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments/e249f87b-6e77-4e3c-bba9-19ef7fae5498" status: 200 len: 194 microversion: 2.1 time: 0.098619 Jul 20 04:36:35.925493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f3f7acf4-c587-46f8-b858-ecc989c3c8b1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:35.928141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f3f7acf4-c587-46f8-b858-ecc989c3c8b1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:35.937181 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2678/5445] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Jul 20 04:36:35 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments/e249f87b-6e77-4e3c-bba9-19ef7fae5498 => generated 194 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:35.943360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3f7acf4-c587-46f8-b858-ecc989c3c8b1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.944120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3f7acf4-c587-46f8-b858-ecc989c3c8b1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.947282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3f7acf4-c587-46f8-b858-ecc989c3c8b1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.948102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3f7acf4-c587-46f8-b858-ecc989c3c8b1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.021371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ec720b78-55ac-4843-b7b8-022e30d0b4d9 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:36.028354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ec720b78-55ac-4843-b7b8-022e30d0b4d9 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:36.047014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec720b78-55ac-4843-b7b8-022e30d0b4d9 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.047815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec720b78-55ac-4843-b7b8-022e30d0b4d9 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.052094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec720b78-55ac-4843-b7b8-022e30d0b4d9 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.052975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec720b78-55ac-4843-b7b8-022e30d0b4d9 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.127062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-f3f7acf4-c587-46f8-b858-ecc989c3c8b1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lazy-loading 'services' on Instance uuid 62d78226-707b-4d41-96ab-987874bee7fc {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:36:36.225300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ec720b78-55ac-4843-b7b8-022e30d0b4d9 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:36.243633 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ec720b78-55ac-4843-b7b8-022e30d0b4d9 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1267 microversion: 2.1 time: 0.231361 Jul 20 04:36:36.245392 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2679/5446] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:36 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:36.265416 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f3f7acf4-c587-46f8-b858-ecc989c3c8b1 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "DELETE /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments/e249f87b-6e77-4e3c-bba9-19ef7fae5498" status: 202 len: 0 microversion: 2.1 time: 0.351648 Jul 20 04:36:36.270858 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2768/5447] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:36:35 2022] DELETE /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments/e249f87b-6e77-4e3c-bba9-19ef7fae5498 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:37.267888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bc72d4e8-d8d2-4f2e-81a9-c53ba53125a3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:37.269648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bc72d4e8-d8d2-4f2e-81a9-c53ba53125a3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:37.292564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc72d4e8-d8d2-4f2e-81a9-c53ba53125a3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.293041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc72d4e8-d8d2-4f2e-81a9-c53ba53125a3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.296567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc72d4e8-d8d2-4f2e-81a9-c53ba53125a3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.297082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bc72d4e8-d8d2-4f2e-81a9-c53ba53125a3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.629280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bc72d4e8-d8d2-4f2e-81a9-c53ba53125a3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:37.644342 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bc72d4e8-d8d2-4f2e-81a9-c53ba53125a3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1273 microversion: 2.1 time: 0.383404 Jul 20 04:36:37.645281 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2680/5448] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:37 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1273 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:38.666570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8d78b954-0a77-45d2-82f1-b3d332bdbbca tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:38.667386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8d78b954-0a77-45d2-82f1-b3d332bdbbca tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:38.700772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d78b954-0a77-45d2-82f1-b3d332bdbbca tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.701233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d78b954-0a77-45d2-82f1-b3d332bdbbca tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.702029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d78b954-0a77-45d2-82f1-b3d332bdbbca tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.702461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d78b954-0a77-45d2-82f1-b3d332bdbbca tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.879744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8d78b954-0a77-45d2-82f1-b3d332bdbbca tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:38.887802 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8d78b954-0a77-45d2-82f1-b3d332bdbbca tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1273 microversion: 2.1 time: 0.229228 Jul 20 04:36:38.899573 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2769/5449] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:38 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:39.916965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a875b434-4f1e-4ce6-9e04-73344d7b8241 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:39.917621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a875b434-4f1e-4ce6-9e04-73344d7b8241 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:39.934829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a875b434-4f1e-4ce6-9e04-73344d7b8241 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.935030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a875b434-4f1e-4ce6-9e04-73344d7b8241 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.936489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a875b434-4f1e-4ce6-9e04-73344d7b8241 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.944348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a875b434-4f1e-4ce6-9e04-73344d7b8241 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.358496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a875b434-4f1e-4ce6-9e04-73344d7b8241 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:40.372122 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a875b434-4f1e-4ce6-9e04-73344d7b8241 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1315 microversion: 2.1 time: 0.458672 Jul 20 04:36:40.374669 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2681/5450] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:39 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:40.437103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-549371670", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": "none"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:40.550781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:40.551879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:40.552812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:40.553519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:40.554117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:40.578033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.579024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.580517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.583796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.628037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Getting quotas for project 692d3434aa1f460ca0f1f701820d821f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:40.655350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Getting quotas for user ad74018fd1214d98a2cf80273e87edd3 and project 692d3434aa1f460ca0f1f701820d821f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:40.703991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:40.712161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:40.824626 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57b7b43a-c61d-4621-901f-3c85bfd969c0 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.760984 Jul 20 04:36:40.828074 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2770/5451] 10.222.0.20 () {62 vars in 1187 bytes} [Wed Jul 20 04:36:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 20 04:36:40.836243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6e9726ea-7bdf-4457-b52a-4cc253e1cfd8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:40.837319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6e9726ea-7bdf-4457-b52a-4cc253e1cfd8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:41.146682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6e9726ea-7bdf-4457-b52a-4cc253e1cfd8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:41.174418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6e9726ea-7bdf-4457-b52a-4cc253e1cfd8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:41.193522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6e9726ea-7bdf-4457-b52a-4cc253e1cfd8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:41.203106 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6e9726ea-7bdf-4457-b52a-4cc253e1cfd8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1277 microversion: 2.54 time: 0.364267 Jul 20 04:36:41.205400 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2682/5452] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:40 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1277 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:41.394898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-697b0355-91cb-45bf-ab79-3c55eacbcad3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:41.396929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-697b0355-91cb-45bf-ab79-3c55eacbcad3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:41.423682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-697b0355-91cb-45bf-ab79-3c55eacbcad3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.425322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-697b0355-91cb-45bf-ab79-3c55eacbcad3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.426194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-697b0355-91cb-45bf-ab79-3c55eacbcad3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.434466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-697b0355-91cb-45bf-ab79-3c55eacbcad3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.736453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-93f03c4f-8548-4b95-993d-bd01667b9089 req-df25d42c-502f-429d-a2f2-68b5afab7527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330574e6-d69f-4f04-b3e4-42c68f637c95", "tag": "09b019f2-d5d6-4029-8ad1-b9c33142b991"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:41.782894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-93f03c4f-8548-4b95-993d-bd01667b9089 req-df25d42c-502f-429d-a2f2-68b5afab7527 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.788795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-93f03c4f-8548-4b95-993d-bd01667b9089 req-df25d42c-502f-429d-a2f2-68b5afab7527 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.824939 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-93f03c4f-8548-4b95-993d-bd01667b9089 req-df25d42c-502f-429d-a2f2-68b5afab7527 service nova] Creating event network-changed:09b019f2-d5d6-4029-8ad1-b9c33142b991 for instance 330574e6-d69f-4f04-b3e4-42c68f637c95 on n-h1-764485-11 Jul 20 04:36:41.843811 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-93f03c4f-8548-4b95-993d-bd01667b9089 req-df25d42c-502f-429d-a2f2-68b5afab7527 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107795 Jul 20 04:36:41.847443 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2683/5453] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:42.227744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5b513a21-d359-422e-865d-a4dee4f58026 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:42.228435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5b513a21-d359-422e-865d-a4dee4f58026 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:42.288695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b513a21-d359-422e-865d-a4dee4f58026 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:42.294612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b513a21-d359-422e-865d-a4dee4f58026 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:42.301146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b513a21-d359-422e-865d-a4dee4f58026 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:42.305289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b513a21-d359-422e-865d-a4dee4f58026 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:42.543159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5b513a21-d359-422e-865d-a4dee4f58026 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:42.562274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-697b0355-91cb-45bf-ab79-3c55eacbcad3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:42.565270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5b513a21-d359-422e-865d-a4dee4f58026 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:42.580703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5b513a21-d359-422e-865d-a4dee4f58026 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:42.580975 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-697b0355-91cb-45bf-ab79-3c55eacbcad3 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1315 microversion: 2.1 time: 1.181901 Jul 20 04:36:42.583419 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2771/5454] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:41 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1315 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:42.587927 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5b513a21-d359-422e-865d-a4dee4f58026 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1281 microversion: 2.54 time: 0.368790 Jul 20 04:36:42.599773 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2684/5455] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:42 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1281 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:43.607635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1b8b280d-e5eb-4fcb-8a82-18de9b89d8b8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:43.608326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1b8b280d-e5eb-4fcb-8a82-18de9b89d8b8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:43.610565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e888ac17-711e-42b2-8ccf-e5aae6525790 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:43.611464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e888ac17-711e-42b2-8ccf-e5aae6525790 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:43.639761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e888ac17-711e-42b2-8ccf-e5aae6525790 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.640216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e888ac17-711e-42b2-8ccf-e5aae6525790 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.640635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b8b280d-e5eb-4fcb-8a82-18de9b89d8b8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.641211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b8b280d-e5eb-4fcb-8a82-18de9b89d8b8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.647379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b8b280d-e5eb-4fcb-8a82-18de9b89d8b8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.649441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b8b280d-e5eb-4fcb-8a82-18de9b89d8b8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.653036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e888ac17-711e-42b2-8ccf-e5aae6525790 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.653771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e888ac17-711e-42b2-8ccf-e5aae6525790 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.985883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1b8b280d-e5eb-4fcb-8a82-18de9b89d8b8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.004178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1b8b280d-e5eb-4fcb-8a82-18de9b89d8b8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.013419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1b8b280d-e5eb-4fcb-8a82-18de9b89d8b8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.015633 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1b8b280d-e5eb-4fcb-8a82-18de9b89d8b8 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1335 microversion: 2.54 time: 0.413301 Jul 20 04:36:44.018837 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2685/5456] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:43 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1335 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:44.163678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e888ac17-711e-42b2-8ccf-e5aae6525790 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.176967 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e888ac17-711e-42b2-8ccf-e5aae6525790 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1315 microversion: 2.1 time: 0.580009 Jul 20 04:36:44.179815 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2772/5457] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:43 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:45.036297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-89b3854e-b66e-4427-af1f-68c687ce664d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:45.037584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-89b3854e-b66e-4427-af1f-68c687ce664d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:45.059343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89b3854e-b66e-4427-af1f-68c687ce664d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.060160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89b3854e-b66e-4427-af1f-68c687ce664d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.063303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89b3854e-b66e-4427-af1f-68c687ce664d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.063980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89b3854e-b66e-4427-af1f-68c687ce664d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.200762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ca181c68-7125-435f-9fc6-ab69e9ec335c tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:45.202701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca181c68-7125-435f-9fc6-ab69e9ec335c tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:45.225799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca181c68-7125-435f-9fc6-ab69e9ec335c tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.227792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca181c68-7125-435f-9fc6-ab69e9ec335c tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.230488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca181c68-7125-435f-9fc6-ab69e9ec335c tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.232921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca181c68-7125-435f-9fc6-ab69e9ec335c tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.468553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89b3854e-b66e-4427-af1f-68c687ce664d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:45.483186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89b3854e-b66e-4427-af1f-68c687ce664d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:45.494576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89b3854e-b66e-4427-af1f-68c687ce664d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:45.501009 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-89b3854e-b66e-4427-af1f-68c687ce664d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1335 microversion: 2.54 time: 0.468656 Jul 20 04:36:45.512977 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2686/5458] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:45 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1335 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:46.132534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ca181c68-7125-435f-9fc6-ab69e9ec335c tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:46.147055 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ca181c68-7125-435f-9fc6-ab69e9ec335c tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1315 microversion: 2.1 time: 0.953969 Jul 20 04:36:46.161724 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2773/5459] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:45 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1315 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:46.531522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5015512d-d64f-4498-aa74-9e3a17c4c52d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:46.532200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5015512d-d64f-4498-aa74-9e3a17c4c52d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:46.558384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5015512d-d64f-4498-aa74-9e3a17c4c52d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.558913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5015512d-d64f-4498-aa74-9e3a17c4c52d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.559790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5015512d-d64f-4498-aa74-9e3a17c4c52d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.560243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5015512d-d64f-4498-aa74-9e3a17c4c52d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.647020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7bb1d71b-f7fc-4b01-a06e-6c3ae7243790 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:46.648208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7bb1d71b-f7fc-4b01-a06e-6c3ae7243790 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:46.657350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7bb1d71b-f7fc-4b01-a06e-6c3ae7243790 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.658200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7bb1d71b-f7fc-4b01-a06e-6c3ae7243790 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.660031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7bb1d71b-f7fc-4b01-a06e-6c3ae7243790 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.660658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7bb1d71b-f7fc-4b01-a06e-6c3ae7243790 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.698938 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7bb1d71b-f7fc-4b01-a06e-6c3ae7243790 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments/87a7d230-eb7b-4ef9-ba6c-9645b0c9fb94" status: 200 len: 194 microversion: 2.1 time: 0.056212 Jul 20 04:36:46.705203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5015512d-d64f-4498-aa74-9e3a17c4c52d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:46.706013 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2774/5460] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Jul 20 04:36:46 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments/87a7d230-eb7b-4ef9-ba6c-9645b0c9fb94 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:36:46.711981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be949c5c-8776-4dc2-9a30-05d99dea1cd6 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:46.712911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-be949c5c-8776-4dc2-9a30-05d99dea1cd6 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:46.717915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5015512d-d64f-4498-aa74-9e3a17c4c52d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:46.720029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be949c5c-8776-4dc2-9a30-05d99dea1cd6 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.720764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be949c5c-8776-4dc2-9a30-05d99dea1cd6 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.721833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5015512d-d64f-4498-aa74-9e3a17c4c52d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:46.722048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be949c5c-8776-4dc2-9a30-05d99dea1cd6 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.722665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be949c5c-8776-4dc2-9a30-05d99dea1cd6 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.724635 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5015512d-d64f-4498-aa74-9e3a17c4c52d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1335 microversion: 2.54 time: 0.197196 Jul 20 04:36:46.726619 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2687/5461] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:46 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1335 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:46.857487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-be949c5c-8776-4dc2-9a30-05d99dea1cd6 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lazy-loading 'services' on Instance uuid 62d78226-707b-4d41-96ab-987874bee7fc {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:36:46.952627 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-be949c5c-8776-4dc2-9a30-05d99dea1cd6 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "DELETE /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments/87a7d230-eb7b-4ef9-ba6c-9645b0c9fb94" status: 202 len: 0 microversion: 2.1 time: 0.245100 Jul 20 04:36:46.954691 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2775/5462] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:36:46 2022] DELETE /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments/87a7d230-eb7b-4ef9-ba6c-9645b0c9fb94 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:47.170949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-22da118b-05fe-4a50-976f-d95613c10091 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:47.172108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-22da118b-05fe-4a50-976f-d95613c10091 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:47.183140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22da118b-05fe-4a50-976f-d95613c10091 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.184457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22da118b-05fe-4a50-976f-d95613c10091 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.185507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22da118b-05fe-4a50-976f-d95613c10091 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.186282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22da118b-05fe-4a50-976f-d95613c10091 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.489083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-22da118b-05fe-4a50-976f-d95613c10091 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.500392 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-22da118b-05fe-4a50-976f-d95613c10091 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1315 microversion: 2.1 time: 0.334270 Jul 20 04:36:47.519686 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2688/5463] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:47 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:47.753431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2a518c16-8226-421f-8b9d-5ab40427c65b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:47.757144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2a518c16-8226-421f-8b9d-5ab40427c65b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:47.782458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2a518c16-8226-421f-8b9d-5ab40427c65b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.782918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2a518c16-8226-421f-8b9d-5ab40427c65b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.787324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2a518c16-8226-421f-8b9d-5ab40427c65b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.787844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2a518c16-8226-421f-8b9d-5ab40427c65b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.023356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2a518c16-8226-421f-8b9d-5ab40427c65b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.032689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2a518c16-8226-421f-8b9d-5ab40427c65b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.034469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2a518c16-8226-421f-8b9d-5ab40427c65b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.036823 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2a518c16-8226-421f-8b9d-5ab40427c65b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1335 microversion: 2.54 time: 0.294387 Jul 20 04:36:48.049735 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2776/5464] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:47 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1335 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:48.520661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-daf3336c-2628-44b4-a354-06bec77ca0dc tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:48.521286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-daf3336c-2628-44b4-a354-06bec77ca0dc tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:48.530669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-daf3336c-2628-44b4-a354-06bec77ca0dc tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.533969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-daf3336c-2628-44b4-a354-06bec77ca0dc tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.536304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-daf3336c-2628-44b4-a354-06bec77ca0dc tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.537909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-daf3336c-2628-44b4-a354-06bec77ca0dc tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.060609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-695ca17a-f4ab-4a33-8e6a-0052a830ae91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:49.062610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-695ca17a-f4ab-4a33-8e6a-0052a830ae91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:49.071915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-695ca17a-f4ab-4a33-8e6a-0052a830ae91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.072996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-695ca17a-f4ab-4a33-8e6a-0052a830ae91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.074358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-695ca17a-f4ab-4a33-8e6a-0052a830ae91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.075013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-695ca17a-f4ab-4a33-8e6a-0052a830ae91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.241929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-695ca17a-f4ab-4a33-8e6a-0052a830ae91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.262294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-695ca17a-f4ab-4a33-8e6a-0052a830ae91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.275314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-695ca17a-f4ab-4a33-8e6a-0052a830ae91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.275314 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-695ca17a-f4ab-4a33-8e6a-0052a830ae91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1335 microversion: 2.54 time: 0.216998 Jul 20 04:36:49.275314 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2777/5465] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:49 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1335 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:49.320327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-daf3336c-2628-44b4-a354-06bec77ca0dc tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.365960 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-daf3336c-2628-44b4-a354-06bec77ca0dc tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1315 microversion: 2.1 time: 0.849809 Jul 20 04:36:49.369037 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2689/5466] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:48 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:50.295670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9bf180a-e5f1-42a1-8001-1c560920aa91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:50.297185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a9bf180a-e5f1-42a1-8001-1c560920aa91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:50.311843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9bf180a-e5f1-42a1-8001-1c560920aa91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.314343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9bf180a-e5f1-42a1-8001-1c560920aa91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.316133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9bf180a-e5f1-42a1-8001-1c560920aa91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.317184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9bf180a-e5f1-42a1-8001-1c560920aa91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.385541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-39833b9c-6024-42aa-b4a6-711c69adc909 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:50.386208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-39833b9c-6024-42aa-b4a6-711c69adc909 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:50.398313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39833b9c-6024-42aa-b4a6-711c69adc909 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.400961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39833b9c-6024-42aa-b4a6-711c69adc909 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.401904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39833b9c-6024-42aa-b4a6-711c69adc909 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.402424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-39833b9c-6024-42aa-b4a6-711c69adc909 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.459453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9bf180a-e5f1-42a1-8001-1c560920aa91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.475073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9bf180a-e5f1-42a1-8001-1c560920aa91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.483971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9bf180a-e5f1-42a1-8001-1c560920aa91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.488073 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a9bf180a-e5f1-42a1-8001-1c560920aa91 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1356 microversion: 2.54 time: 0.197847 Jul 20 04:36:50.490322 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2778/5467] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:50 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1356 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:50.518326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-66a09c00-4e31-4941-863f-21babfd844a5 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Action: 'create', calling method: .version_select at 0x7fbf9c49d040>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1683820281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKisz+31lU6WALZPBVlGPrntt3iwVaFBe/RWvrkAVOmV2c+cBb14hPuSUujDbCZwxWPc9tz9ULJ0MTIwmT9DgQlYhCiZrbBV7J545wqXvoFZfuiTaiMOGqWxP5PmmDyX1Q=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:50.552437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-66a09c00-4e31-4941-863f-21babfd844a5 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Getting quotas for project 692d3434aa1f460ca0f1f701820d821f. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:50.567617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-66a09c00-4e31-4941-863f-21babfd844a5 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Getting quotas for user ad74018fd1214d98a2cf80273e87edd3 and project 692d3434aa1f460ca0f1f701820d821f. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:50.615653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:50.630939 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-66a09c00-4e31-4941-863f-21babfd844a5 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.118814 Jul 20 04:36:50.637723 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2779/5468] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Jul 20 04:36:50 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 20 04:36:50.659962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1683820281", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:50.663844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:50.681664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.682611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.684099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.685433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.847352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-39833b9c-6024-42aa-b4a6-711c69adc909 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.860240 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-39833b9c-6024-42aa-b4a6-711c69adc909 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1315 microversion: 2.1 time: 0.478508 Jul 20 04:36:50.861780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:50.864935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:50.865592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:50.866320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:50.868211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:50.881080 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2690/5469] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:50 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:50.997511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:51.009390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.010162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.011143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.011521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.065892 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7d519717-d277-47aa-89dc-fef10491cd48 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "POST /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f/action" status: 202 len: 1139 microversion: 2.54 time: 0.420168 Jul 20 04:36:51.067755 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2780/5470] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Jul 20 04:36:50 2022] POST /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f/action => generated 1139 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:36:51.085089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ccf3fde1-7b00-48b5-a15a-6afde70e5cbb tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.087855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ccf3fde1-7b00-48b5-a15a-6afde70e5cbb tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:51.103301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ccf3fde1-7b00-48b5-a15a-6afde70e5cbb tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.107376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ccf3fde1-7b00-48b5-a15a-6afde70e5cbb tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.108832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ccf3fde1-7b00-48b5-a15a-6afde70e5cbb tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.109585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ccf3fde1-7b00-48b5-a15a-6afde70e5cbb tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.160431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:51.325113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ccf3fde1-7b00-48b5-a15a-6afde70e5cbb tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.339983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ccf3fde1-7b00-48b5-a15a-6afde70e5cbb tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.345654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ccf3fde1-7b00-48b5-a15a-6afde70e5cbb tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.346937 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ccf3fde1-7b00-48b5-a15a-6afde70e5cbb tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.267604 Jul 20 04:36:51.348674 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2691/5471] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:51 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:51.888700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-59cd894a-49b8-499e-91c5-7f713a815d86 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.889336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-59cd894a-49b8-499e-91c5-7f713a815d86 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:51.914957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59cd894a-49b8-499e-91c5-7f713a815d86 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.914957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59cd894a-49b8-499e-91c5-7f713a815d86 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.915233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59cd894a-49b8-499e-91c5-7f713a815d86 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.915442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59cd894a-49b8-499e-91c5-7f713a815d86 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.926220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:52.267983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-59cd894a-49b8-499e-91c5-7f713a815d86 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.283760 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-59cd894a-49b8-499e-91c5-7f713a815d86 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1315 microversion: 2.1 time: 0.399021 Jul 20 04:36:52.296426 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2781/5472] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:51 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:52.369365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-342eca5b-b9fd-4df5-823d-c2ecc913743d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:52.370771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-342eca5b-b9fd-4df5-823d-c2ecc913743d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:52.386307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-342eca5b-b9fd-4df5-823d-c2ecc913743d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.387404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-342eca5b-b9fd-4df5-823d-c2ecc913743d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.390378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-342eca5b-b9fd-4df5-823d-c2ecc913743d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.391100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-342eca5b-b9fd-4df5-823d-c2ecc913743d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.551256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-342eca5b-b9fd-4df5-823d-c2ecc913743d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.565343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-342eca5b-b9fd-4df5-823d-c2ecc913743d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.568237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-342eca5b-b9fd-4df5-823d-c2ecc913743d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.569899 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-342eca5b-b9fd-4df5-823d-c2ecc913743d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.205321 Jul 20 04:36:52.571246 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2692/5473] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:52 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:53.301873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c94c7e1b-260a-4ed1-9efa-848e5365f96e tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:53.302599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c94c7e1b-260a-4ed1-9efa-848e5365f96e tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:53.321993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c94c7e1b-260a-4ed1-9efa-848e5365f96e tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.324780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c94c7e1b-260a-4ed1-9efa-848e5365f96e tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.332451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c94c7e1b-260a-4ed1-9efa-848e5365f96e tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.333285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c94c7e1b-260a-4ed1-9efa-848e5365f96e tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.592189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c707496d-7756-469a-beb8-3c2e70669f83 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:53.592827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c707496d-7756-469a-beb8-3c2e70669f83 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:53.612357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c707496d-7756-469a-beb8-3c2e70669f83 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.614733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c707496d-7756-469a-beb8-3c2e70669f83 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.618646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c707496d-7756-469a-beb8-3c2e70669f83 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.619482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c707496d-7756-469a-beb8-3c2e70669f83 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.623328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c94c7e1b-260a-4ed1-9efa-848e5365f96e tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:53.633499 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c94c7e1b-260a-4ed1-9efa-848e5365f96e tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1315 microversion: 2.1 time: 0.336379 Jul 20 04:36:53.641115 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2782/5474] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:53 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:53.727311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-768d71d3-77c9-43cb-9228-8c36c0e6b8a8 req-7c4d5423-0ae7-4124-a6ec-ca78eeb7a029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330574e6-d69f-4f04-b3e4-42c68f637c95", "name": "network-vif-plugged", "status": "completed", "tag": "09b019f2-d5d6-4029-8ad1-b9c33142b991"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:53.741521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-768d71d3-77c9-43cb-9228-8c36c0e6b8a8 req-7c4d5423-0ae7-4124-a6ec-ca78eeb7a029 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.743129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-768d71d3-77c9-43cb-9228-8c36c0e6b8a8 req-7c4d5423-0ae7-4124-a6ec-ca78eeb7a029 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.769574 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-768d71d3-77c9-43cb-9228-8c36c0e6b8a8 req-7c4d5423-0ae7-4124-a6ec-ca78eeb7a029 service nova] Creating event network-vif-plugged:09b019f2-d5d6-4029-8ad1-b9c33142b991 for instance 330574e6-d69f-4f04-b3e4-42c68f637c95 on n-h1-764485-11 Jul 20 04:36:53.779952 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-768d71d3-77c9-43cb-9228-8c36c0e6b8a8 req-7c4d5423-0ae7-4124-a6ec-ca78eeb7a029 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057154 Jul 20 04:36:53.783833 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2783/5475] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:36:53.903304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c707496d-7756-469a-beb8-3c2e70669f83 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:53.915724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c707496d-7756-469a-beb8-3c2e70669f83 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:53.921070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c707496d-7756-469a-beb8-3c2e70669f83 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:53.924147 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c707496d-7756-469a-beb8-3c2e70669f83 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.338996 Jul 20 04:36:53.937606 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2693/5476] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:53 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:54.665092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec59509d-aaa6-498e-bd0a-c3c00f592ddf tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:54.666510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ec59509d-aaa6-498e-bd0a-c3c00f592ddf tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:54.685373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec59509d-aaa6-498e-bd0a-c3c00f592ddf tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.686259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec59509d-aaa6-498e-bd0a-c3c00f592ddf tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.687313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec59509d-aaa6-498e-bd0a-c3c00f592ddf tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.688011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec59509d-aaa6-498e-bd0a-c3c00f592ddf tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.945765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f6f8cf56-7ab0-4a12-807f-a9cd0201d500 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:54.946391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f6f8cf56-7ab0-4a12-807f-a9cd0201d500 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:54.957300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6f8cf56-7ab0-4a12-807f-a9cd0201d500 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.960113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6f8cf56-7ab0-4a12-807f-a9cd0201d500 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.961669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6f8cf56-7ab0-4a12-807f-a9cd0201d500 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.962361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6f8cf56-7ab0-4a12-807f-a9cd0201d500 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.138053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f6f8cf56-7ab0-4a12-807f-a9cd0201d500 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.140393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ec59509d-aaa6-498e-bd0a-c3c00f592ddf tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.152511 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ec59509d-aaa6-498e-bd0a-c3c00f592ddf tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1315 microversion: 2.1 time: 0.496622 Jul 20 04:36:55.155494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f6f8cf56-7ab0-4a12-807f-a9cd0201d500 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.158045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f6f8cf56-7ab0-4a12-807f-a9cd0201d500 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.162979 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2784/5477] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:54 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:55.164660 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f6f8cf56-7ab0-4a12-807f-a9cd0201d500 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.222580 Jul 20 04:36:55.168333 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2694/5478] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:54 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:55.177307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4cea3175-9916-4217-abe8-52f49c550559 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:55.178259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4cea3175-9916-4217-abe8-52f49c550559 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:55.204240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cea3175-9916-4217-abe8-52f49c550559 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.208349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cea3175-9916-4217-abe8-52f49c550559 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.210051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cea3175-9916-4217-abe8-52f49c550559 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.212303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cea3175-9916-4217-abe8-52f49c550559 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.308089 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4cea3175-9916-4217-abe8-52f49c550559 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.142994 Jul 20 04:36:55.315465 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2785/5479] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:36:55 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:36:55.496054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a3ac5810-64d6-482d-8b41-da3dcca493a7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:55.497004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a3ac5810-64d6-482d-8b41-da3dcca493a7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:55.511078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a3ac5810-64d6-482d-8b41-da3dcca493a7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.511795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a3ac5810-64d6-482d-8b41-da3dcca493a7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.512797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a3ac5810-64d6-482d-8b41-da3dcca493a7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.513413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a3ac5810-64d6-482d-8b41-da3dcca493a7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.567787 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a3ac5810-64d6-482d-8b41-da3dcca493a7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076873 Jul 20 04:36:55.573388 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2695/5480] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:36:55 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:36:55.665844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21f579eb-97a3-4daf-a5ae-eda99cb3d633 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:55.666478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21f579eb-97a3-4daf-a5ae-eda99cb3d633 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:55.675108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21f579eb-97a3-4daf-a5ae-eda99cb3d633 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.675837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21f579eb-97a3-4daf-a5ae-eda99cb3d633 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.676882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21f579eb-97a3-4daf-a5ae-eda99cb3d633 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.677786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21f579eb-97a3-4daf-a5ae-eda99cb3d633 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.725391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21f579eb-97a3-4daf-a5ae-eda99cb3d633 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:36:55.860413 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21f579eb-97a3-4daf-a5ae-eda99cb3d633 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "DELETE /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 204 len: 0 microversion: 2.1 time: 0.198365 Jul 20 04:36:55.861270 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2786/5481] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:55 2022] DELETE /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:55.871785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5137d82c-3996-4a7f-89bd-82ba0370fa57 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:55.873165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5137d82c-3996-4a7f-89bd-82ba0370fa57 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:55.882257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5137d82c-3996-4a7f-89bd-82ba0370fa57 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.883690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5137d82c-3996-4a7f-89bd-82ba0370fa57 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.884725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5137d82c-3996-4a7f-89bd-82ba0370fa57 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.885595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5137d82c-3996-4a7f-89bd-82ba0370fa57 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.919765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:56.171623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0869e97b-20af-4baa-bc51-912aee763ac2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:56.172337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0869e97b-20af-4baa-bc51-912aee763ac2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:56.202266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0869e97b-20af-4baa-bc51-912aee763ac2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.203255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0869e97b-20af-4baa-bc51-912aee763ac2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.204312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0869e97b-20af-4baa-bc51-912aee763ac2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.204927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0869e97b-20af-4baa-bc51-912aee763ac2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.442519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5137d82c-3996-4a7f-89bd-82ba0370fa57 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.470526 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5137d82c-3996-4a7f-89bd-82ba0370fa57 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1671 microversion: 2.1 time: 0.603836 Jul 20 04:36:56.482746 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2696/5482] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:55 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1671 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:56.489645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-73048640-e4ac-4687-af3b-a4605ff47f7e tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:56.490564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-73048640-e4ac-4687-af3b-a4605ff47f7e tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:56.505963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73048640-e4ac-4687-af3b-a4605ff47f7e tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.507946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73048640-e4ac-4687-af3b-a4605ff47f7e tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.510181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73048640-e4ac-4687-af3b-a4605ff47f7e tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.513521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73048640-e4ac-4687-af3b-a4605ff47f7e tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.770713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-73048640-e4ac-4687-af3b-a4605ff47f7e tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.784229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-73048640-e4ac-4687-af3b-a4605ff47f7e tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.788450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-73048640-e4ac-4687-af3b-a4605ff47f7e tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.792543 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-73048640-e4ac-4687-af3b-a4605ff47f7e tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.307350 Jul 20 04:36:56.793342 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2697/5483] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:56 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:56.925271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0869e97b-20af-4baa-bc51-912aee763ac2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.933478 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0869e97b-20af-4baa-bc51-912aee763ac2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1464 microversion: 2.1 time: 0.766107 Jul 20 04:36:56.934077 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2787/5484] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:56 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1464 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:56.990675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe0b14e4-80cc-4b66-8978-196a1eaaf53b tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:56.991704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe0b14e4-80cc-4b66-8978-196a1eaaf53b tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:56.999884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe0b14e4-80cc-4b66-8978-196a1eaaf53b tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.000457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe0b14e4-80cc-4b66-8978-196a1eaaf53b tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.001601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe0b14e4-80cc-4b66-8978-196a1eaaf53b tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.002879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe0b14e4-80cc-4b66-8978-196a1eaaf53b tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.033763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe0b14e4-80cc-4b66-8978-196a1eaaf53b tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:36:57.152360 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe0b14e4-80cc-4b66-8978-196a1eaaf53b tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "DELETE /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 204 len: 0 microversion: 2.1 time: 0.163898 Jul 20 04:36:57.157073 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2698/5485] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:56 2022] DELETE /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:57.162942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0a8c3f3-5743-4088-9669-ab0d6e9a4ce2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:57.164023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b0a8c3f3-5743-4088-9669-ab0d6e9a4ce2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:57.171826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0a8c3f3-5743-4088-9669-ab0d6e9a4ce2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.172768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0a8c3f3-5743-4088-9669-ab0d6e9a4ce2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.173722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0a8c3f3-5743-4088-9669-ab0d6e9a4ce2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.174392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0a8c3f3-5743-4088-9669-ab0d6e9a4ce2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.489544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f3154b21-0cd0-4329-935d-193ea18c6219 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:57.491063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f3154b21-0cd0-4329-935d-193ea18c6219 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:57.498960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3154b21-0cd0-4329-935d-193ea18c6219 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.504245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3154b21-0cd0-4329-935d-193ea18c6219 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.510407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3154b21-0cd0-4329-935d-193ea18c6219 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.510944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3154b21-0cd0-4329-935d-193ea18c6219 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.049736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f3154b21-0cd0-4329-935d-193ea18c6219 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.066079 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f3154b21-0cd0-4329-935d-193ea18c6219 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1671 microversion: 2.1 time: 0.580809 Jul 20 04:36:58.067128 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2699/5486] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:57 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1671 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:58.071975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a714b961-126b-4484-8c3f-8967ecafa495 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:58.072597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a714b961-126b-4484-8c3f-8967ecafa495 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:58.085098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a714b961-126b-4484-8c3f-8967ecafa495 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.085567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a714b961-126b-4484-8c3f-8967ecafa495 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.086717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a714b961-126b-4484-8c3f-8967ecafa495 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.087216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a714b961-126b-4484-8c3f-8967ecafa495 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.295749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a714b961-126b-4484-8c3f-8967ecafa495 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.311327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a714b961-126b-4484-8c3f-8967ecafa495 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.316459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a714b961-126b-4484-8c3f-8967ecafa495 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.324927 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a714b961-126b-4484-8c3f-8967ecafa495 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.253643 Jul 20 04:36:58.326090 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2700/5487] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:58 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:58.349480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b0a8c3f3-5743-4088-9669-ab0d6e9a4ce2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.358395 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b0a8c3f3-5743-4088-9669-ab0d6e9a4ce2 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1470 microversion: 2.1 time: 1.200246 Jul 20 04:36:58.359345 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2788/5488] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:57 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1470 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:59.083397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2848ab1-c9f4-4212-9452-84fd889de177 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:59.084122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a2848ab1-c9f4-4212-9452-84fd889de177 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:59.102170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2848ab1-c9f4-4212-9452-84fd889de177 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.103168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2848ab1-c9f4-4212-9452-84fd889de177 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.105233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2848ab1-c9f4-4212-9452-84fd889de177 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.107431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2848ab1-c9f4-4212-9452-84fd889de177 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.344875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c8290055-8034-49fd-b6b7-eef32ae0b73f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:59.347365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c8290055-8034-49fd-b6b7-eef32ae0b73f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:59.364593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8290055-8034-49fd-b6b7-eef32ae0b73f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.365151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8290055-8034-49fd-b6b7-eef32ae0b73f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.365828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8290055-8034-49fd-b6b7-eef32ae0b73f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.366339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8290055-8034-49fd-b6b7-eef32ae0b73f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.614428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c8290055-8034-49fd-b6b7-eef32ae0b73f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:59.626544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c8290055-8034-49fd-b6b7-eef32ae0b73f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:59.634561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c8290055-8034-49fd-b6b7-eef32ae0b73f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:59.639434 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c8290055-8034-49fd-b6b7-eef32ae0b73f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.298492 Jul 20 04:36:59.652455 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2789/5489] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:59 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:59.659354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d9430272-61d6-4896-bd72-bcf53e78cbda tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:59.665067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d9430272-61d6-4896-bd72-bcf53e78cbda tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:59.674669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:59.677267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9430272-61d6-4896-bd72-bcf53e78cbda tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.678312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9430272-61d6-4896-bd72-bcf53e78cbda tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.679388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9430272-61d6-4896-bd72-bcf53e78cbda tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.682293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9430272-61d6-4896-bd72-bcf53e78cbda tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.890436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a2848ab1-c9f4-4212-9452-84fd889de177 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:59.901535 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2848ab1-c9f4-4212-9452-84fd889de177 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1671 microversion: 2.1 time: 0.821212 Jul 20 04:36:59.912554 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2701/5490] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:59 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1671 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:00.257433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c7beb14d-62a4-4eee-b70f-821a187f549a req-e09c80d6-812d-4079-bfce-f17e61d2a56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d78226-707b-4d41-96ab-987874bee7fc", "name": "network-vif-deleted", "tag": "2adb9264-1b58-4969-a23a-628daabb41ab"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:00.298880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c7beb14d-62a4-4eee-b70f-821a187f549a req-e09c80d6-812d-4079-bfce-f17e61d2a56d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:00.300750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c7beb14d-62a4-4eee-b70f-821a187f549a req-e09c80d6-812d-4079-bfce-f17e61d2a56d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:00.330310 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c7beb14d-62a4-4eee-b70f-821a187f549a req-e09c80d6-812d-4079-bfce-f17e61d2a56d service nova] Creating event network-vif-deleted:2adb9264-1b58-4969-a23a-628daabb41ab for instance 62d78226-707b-4d41-96ab-987874bee7fc on n-h2-764485-11 Jul 20 04:37:00.341803 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c7beb14d-62a4-4eee-b70f-821a187f549a req-e09c80d6-812d-4079-bfce-f17e61d2a56d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094703 Jul 20 04:37:00.343058 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2702/5491] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:00.541903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d9430272-61d6-4896-bd72-bcf53e78cbda tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:00.561408 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d9430272-61d6-4896-bd72-bcf53e78cbda tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1470 microversion: 2.1 time: 0.905924 Jul 20 04:37:00.562041 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2790/5492] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:59 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1470 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:00.669646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-42a86cb4-12ef-410f-8cb8-0b22cc846258 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:00.670513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-42a86cb4-12ef-410f-8cb8-0b22cc846258 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:00.691479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-42a86cb4-12ef-410f-8cb8-0b22cc846258 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:00.692170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-42a86cb4-12ef-410f-8cb8-0b22cc846258 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:00.693149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-42a86cb4-12ef-410f-8cb8-0b22cc846258 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:00.693712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-42a86cb4-12ef-410f-8cb8-0b22cc846258 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:00.867843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-42a86cb4-12ef-410f-8cb8-0b22cc846258 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:00.889315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-42a86cb4-12ef-410f-8cb8-0b22cc846258 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:00.894073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-42a86cb4-12ef-410f-8cb8-0b22cc846258 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:00.898057 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-42a86cb4-12ef-410f-8cb8-0b22cc846258 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.235323 Jul 20 04:37:00.900920 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2703/5493] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:00 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:00.922423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-31fdd059-4ae5-4e86-9ff7-28d7e97dc414 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:00.923242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-31fdd059-4ae5-4e86-9ff7-28d7e97dc414 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:00.935125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=16 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:00.937150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31fdd059-4ae5-4e86-9ff7-28d7e97dc414 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:00.942040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31fdd059-4ae5-4e86-9ff7-28d7e97dc414 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:00.945075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31fdd059-4ae5-4e86-9ff7-28d7e97dc414 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:00.947405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31fdd059-4ae5-4e86-9ff7-28d7e97dc414 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.041423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31fdd059-4ae5-4e86-9ff7-28d7e97dc414 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.041889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31fdd059-4ae5-4e86-9ff7-28d7e97dc414 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.042959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-31fdd059-4ae5-4e86-9ff7-28d7e97dc414 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lazy-loading 'fault' on Instance uuid 62d78226-707b-4d41-96ab-987874bee7fc {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:37:01.139634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e7c52c88-3b85-407e-8209-c02023b77ea5 req-2e45d9f5-eba6-4893-8063-76600531f871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330574e6-d69f-4f04-b3e4-42c68f637c95", "name": "network-vif-deleted", "tag": "09b019f2-d5d6-4029-8ad1-b9c33142b991"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:01.152798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e7c52c88-3b85-407e-8209-c02023b77ea5 req-2e45d9f5-eba6-4893-8063-76600531f871 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.153530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e7c52c88-3b85-407e-8209-c02023b77ea5 req-2e45d9f5-eba6-4893-8063-76600531f871 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.193514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-31fdd059-4ae5-4e86-9ff7-28d7e97dc414 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3153bab9eac4da0b257c291da3767ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ef1075ca8492c829c3814ef2aa111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.198651 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e7c52c88-3b85-407e-8209-c02023b77ea5 req-2e45d9f5-eba6-4893-8063-76600531f871 service nova] Creating event network-vif-deleted:09b019f2-d5d6-4029-8ad1-b9c33142b991 for instance 330574e6-d69f-4f04-b3e4-42c68f637c95 on n-h1-764485-11 Jul 20 04:37:01.205403 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e7c52c88-3b85-407e-8209-c02023b77ea5 req-2e45d9f5-eba6-4893-8063-76600531f871 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073103 Jul 20 04:37:01.206282 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2704/5494] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:37:01.208591 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-31fdd059-4ae5-4e86-9ff7-28d7e97dc414 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 200 len: 1326 microversion: 2.1 time: 0.291681 Jul 20 04:37:01.210794 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2791/5495] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:00 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 1326 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:01.580874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-272232e5-2a9d-40df-8fc2-7ba4f8987c13 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:01.581502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-272232e5-2a9d-40df-8fc2-7ba4f8987c13 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:01.597382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-272232e5-2a9d-40df-8fc2-7ba4f8987c13 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.601318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-272232e5-2a9d-40df-8fc2-7ba4f8987c13 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.602496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-272232e5-2a9d-40df-8fc2-7ba4f8987c13 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.605582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-272232e5-2a9d-40df-8fc2-7ba4f8987c13 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.729161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-272232e5-2a9d-40df-8fc2-7ba4f8987c13 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.729775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-272232e5-2a9d-40df-8fc2-7ba4f8987c13 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.730263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-272232e5-2a9d-40df-8fc2-7ba4f8987c13 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lazy-loading 'fault' on Instance uuid 330574e6-d69f-4f04-b3e4-42c68f637c95 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:37:01.920794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3d62953b-01ab-4a18-8cdb-b21e83a3e463 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:01.922148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3d62953b-01ab-4a18-8cdb-b21e83a3e463 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:01.934394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d62953b-01ab-4a18-8cdb-b21e83a3e463 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.945892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d62953b-01ab-4a18-8cdb-b21e83a3e463 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.947249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d62953b-01ab-4a18-8cdb-b21e83a3e463 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.949302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d62953b-01ab-4a18-8cdb-b21e83a3e463 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.954620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-272232e5-2a9d-40df-8fc2-7ba4f8987c13 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d47dca5ecdf431c8f610b74abfa5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '590dd193a11c4eb9ac1d977c6b0b4ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.964362 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-272232e5-2a9d-40df-8fc2-7ba4f8987c13 tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 200 len: 1305 microversion: 2.1 time: 0.388881 Jul 20 04:37:01.971545 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2705/5496] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:01 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 1305 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:02.113954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3d62953b-01ab-4a18-8cdb-b21e83a3e463 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:02.131348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3d62953b-01ab-4a18-8cdb-b21e83a3e463 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:02.134513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3d62953b-01ab-4a18-8cdb-b21e83a3e463 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:02.136094 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3d62953b-01ab-4a18-8cdb-b21e83a3e463 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.221671 Jul 20 04:37:02.137230 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2792/5497] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:01 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:02.230552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a1d0a4c5-b82b-404f-b4b0-29ea356a0ace tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:02.231452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a1d0a4c5-b82b-404f-b4b0-29ea356a0ace tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:02.238163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1d0a4c5-b82b-404f-b4b0-29ea356a0ace tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.238883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1d0a4c5-b82b-404f-b4b0-29ea356a0ace tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:02.239890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1d0a4c5-b82b-404f-b4b0-29ea356a0ace tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.240514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a1d0a4c5-b82b-404f-b4b0-29ea356a0ace tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:02.270994 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a1d0a4c5-b82b-404f-b4b0-29ea356a0ace tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] HTTP exception thrown: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a1d0a4c5-b82b-404f-b4b0-29ea356a0ace tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Request method failure captured: Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc HTTP/1.1 Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14R3puuTTj9BR9KHmkf0rGkPrttHRryRpT_aOmyRo5bE3o7ATD4JHUdBRTubOepRLN_YW7n2LdnKzJs79jXkPow5-CgW-I3h14ueSEk5yRIlalTSKWxFdOa0fXL1A3e94InH3R5mHg3suPCswxTYut9FysTiu35GHLnEDmpMpoOfbq4 Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: b57ef1075ca8492c829c3814ef2aa111 Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b57ef1075ca8492c829c3814ef2aa111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b57ef1075ca8492c829c3814ef2aa111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b57ef1075ca8492c829c3814ef2aa111", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b57ef1075ca8492c829c3814ef2aa111"}]}] Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: b57ef1075ca8492c829c3814ef2aa111 Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeTestJSON-129024044-project Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: d3153bab9eac4da0b257c291da3767ef Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeTestJSON-129024044-project Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '62d78226-707b-4d41-96ab-987874bee7fc'} Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:02.280895 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:02.286676 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:02.286676 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:02.286676 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:02.286676 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:02.286676 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:02.286676 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:02.286676 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:02.299830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a1d0a4c5-b82b-404f-b4b0-29ea356a0ace tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Returning 404 to user: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:02.300754 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a1d0a4c5-b82b-404f-b4b0-29ea356a0ace tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 404 len: 111 microversion: 2.1 time: 0.075515 Jul 20 04:37:02.301348 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2706/5498] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:02 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:37:02.310423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62fbc77d-b40e-4e31-b231-7b51cc1bc5a6 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '.version_select at 0x7fbf9c4e0670>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:02.345930 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-62fbc77d-b40e-4e31-b231-7b51cc1bc5a6 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-321486889" status: 202 len: 0 microversion: 2.1 time: 0.039290 Jul 20 04:37:02.354323 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2793/5499] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 20 04:37:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-321486889 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:02.984338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-00ce13c5-5375-49aa-a11f-bdb688832a3a tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:02.985031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-00ce13c5-5375-49aa-a11f-bdb688832a3a tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] [instance: 330574e6-d69f-4f04-b3e4-42c68f637c95] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:02.998852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00ce13c5-5375-49aa-a11f-bdb688832a3a tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.002118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00ce13c5-5375-49aa-a11f-bdb688832a3a tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.004107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00ce13c5-5375-49aa-a11f-bdb688832a3a tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.004575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00ce13c5-5375-49aa-a11f-bdb688832a3a tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.044626 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-00ce13c5-5375-49aa-a11f-bdb688832a3a tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] HTTP exception thrown: Instance 330574e6-d69f-4f04-b3e4-42c68f637c95 could not be found. Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-00ce13c5-5375-49aa-a11f-bdb688832a3a tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Request method failure captured: Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 HTTP/1.1 Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14ZNYU5g9oRy5cqeSmkTolnrMbKMeLXXiWc2ZI-TxwTEFx3PqhMh_yZ80To1Rk-rFGpYPo1ITO8HamBCNIdjQgVJ4qhmHeYIY5bwDFAUEEvTOj3Tmh2GON0WQ1eM5FLKg_vJRdV0hA_O4mh6EUqKqyINZLj73jx6qvb1MNX1AVJPmIo Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 590dd193a11c4eb9ac1d977c6b0b4ebc Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-VolumesNegativeTest-385739819 Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/590dd193a11c4eb9ac1d977c6b0b4ebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/590dd193a11c4eb9ac1d977c6b0b4ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_590dd193a11c4eb9ac1d977c6b0b4ebc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/590dd193a11c4eb9ac1d977c6b0b4ebc"}]}] Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-VolumesNegativeTest-385739819 Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 590dd193a11c4eb9ac1d977c6b0b4ebc Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-VolumesNegativeTest-385739819 Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-VolumesNegativeTest-385739819-project Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 2d47dca5ecdf431c8f610b74abfa5c0f Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-VolumesNegativeTest-385739819-project Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 330574e6-d69f-4f04-b3e4-42c68f637c95 could not be found. Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '330574e6-d69f-4f04-b3e4-42c68f637c95'} Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330574e6-d69f-4f04-b3e4-42c68f637c95 could not be found. Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330574e6-d69f-4f04-b3e4-42c68f637c95 could not be found. Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:03.046601 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:03.052063 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:03.052063 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:03.052063 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:03.052063 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:03.052063 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:03.052063 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330574e6-d69f-4f04-b3e4-42c68f637c95 could not be found. Jul 20 04:37:03.052063 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:03.052063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-00ce13c5-5375-49aa-a11f-bdb688832a3a tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] Returning 404 to user: Instance 330574e6-d69f-4f04-b3e4-42c68f637c95 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:03.052063 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-00ce13c5-5375-49aa-a11f-bdb688832a3a tempest-VolumesNegativeTest-385739819 tempest-VolumesNegativeTest-385739819-project] 10.222.0.20 "GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95" status: 404 len: 111 microversion: 2.1 time: 0.068386 Jul 20 04:37:03.052063 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2707/5500] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:02 2022] GET /compute/v2.1/servers/330574e6-d69f-4f04-b3e4-42c68f637c95 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:37:03.155084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-84c1dbb8-19a4-48eb-b3f4-b8445a96da31 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:03.155796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-84c1dbb8-19a4-48eb-b3f4-b8445a96da31 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:03.171817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-84c1dbb8-19a4-48eb-b3f4-b8445a96da31 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.172123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-84c1dbb8-19a4-48eb-b3f4-b8445a96da31 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.172958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-84c1dbb8-19a4-48eb-b3f4-b8445a96da31 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.173416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-84c1dbb8-19a4-48eb-b3f4-b8445a96da31 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.634491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-84c1dbb8-19a4-48eb-b3f4-b8445a96da31 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.645463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-84c1dbb8-19a4-48eb-b3f4-b8445a96da31 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.652366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-84c1dbb8-19a4-48eb-b3f4-b8445a96da31 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.654281 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-84c1dbb8-19a4-48eb-b3f4-b8445a96da31 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.503349 Jul 20 04:37:03.658474 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2794/5501] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:03 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:04.682142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6417ccca-b02c-4392-8613-b78943f7c8e3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:04.689010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6417ccca-b02c-4392-8613-b78943f7c8e3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:04.712253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6417ccca-b02c-4392-8613-b78943f7c8e3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.713616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6417ccca-b02c-4392-8613-b78943f7c8e3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.715384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6417ccca-b02c-4392-8613-b78943f7c8e3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.721186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6417ccca-b02c-4392-8613-b78943f7c8e3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.836356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6417ccca-b02c-4392-8613-b78943f7c8e3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.850388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6417ccca-b02c-4392-8613-b78943f7c8e3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.863372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6417ccca-b02c-4392-8613-b78943f7c8e3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.882216 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6417ccca-b02c-4392-8613-b78943f7c8e3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.205952 Jul 20 04:37:04.888094 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2708/5502] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:04 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:05.906978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9e16d0c3-0c43-4587-95da-b53054ad3158 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:05.907721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9e16d0c3-0c43-4587-95da-b53054ad3158 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:05.930946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e16d0c3-0c43-4587-95da-b53054ad3158 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:05.931411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e16d0c3-0c43-4587-95da-b53054ad3158 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:05.932269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e16d0c3-0c43-4587-95da-b53054ad3158 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:05.932722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e16d0c3-0c43-4587-95da-b53054ad3158 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.264449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e16d0c3-0c43-4587-95da-b53054ad3158 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:06.294771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e16d0c3-0c43-4587-95da-b53054ad3158 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:06.298693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9e16d0c3-0c43-4587-95da-b53054ad3158 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:06.309369 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9e16d0c3-0c43-4587-95da-b53054ad3158 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.403164 Jul 20 04:37:06.313948 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2795/5503] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:05 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:07.333780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8129dabb-7041-4235-88ad-499ea869b6b3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:07.334717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8129dabb-7041-4235-88ad-499ea869b6b3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:07.339702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:07.359438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8129dabb-7041-4235-88ad-499ea869b6b3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.361671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8129dabb-7041-4235-88ad-499ea869b6b3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.362821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8129dabb-7041-4235-88ad-499ea869b6b3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.364800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8129dabb-7041-4235-88ad-499ea869b6b3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.524275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8129dabb-7041-4235-88ad-499ea869b6b3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:07.542600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8129dabb-7041-4235-88ad-499ea869b6b3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:07.547662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8129dabb-7041-4235-88ad-499ea869b6b3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:07.549304 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8129dabb-7041-4235-88ad-499ea869b6b3 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.219843 Jul 20 04:37:07.567216 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2709/5504] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:07 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:08.577028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-124f27fa-8b20-43b2-a433-a9470158d427 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:08.578104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-124f27fa-8b20-43b2-a433-a9470158d427 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:08.592003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-124f27fa-8b20-43b2-a433-a9470158d427 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.592455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-124f27fa-8b20-43b2-a433-a9470158d427 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.593235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-124f27fa-8b20-43b2-a433-a9470158d427 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.593676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-124f27fa-8b20-43b2-a433-a9470158d427 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.802613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-124f27fa-8b20-43b2-a433-a9470158d427 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:08.815953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-124f27fa-8b20-43b2-a433-a9470158d427 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:08.817386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-124f27fa-8b20-43b2-a433-a9470158d427 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:08.818602 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-124f27fa-8b20-43b2-a433-a9470158d427 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.247199 Jul 20 04:37:08.819184 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2796/5505] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:08 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:09.837756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d878e06c-a29c-40e1-88a9-f833e7677cd4 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:09.838742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d878e06c-a29c-40e1-88a9-f833e7677cd4 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:09.855988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d878e06c-a29c-40e1-88a9-f833e7677cd4 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.856614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d878e06c-a29c-40e1-88a9-f833e7677cd4 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.861977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d878e06c-a29c-40e1-88a9-f833e7677cd4 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.862712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d878e06c-a29c-40e1-88a9-f833e7677cd4 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.093343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d878e06c-a29c-40e1-88a9-f833e7677cd4 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:10.106015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d878e06c-a29c-40e1-88a9-f833e7677cd4 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:10.107608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d878e06c-a29c-40e1-88a9-f833e7677cd4 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:10.109262 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d878e06c-a29c-40e1-88a9-f833e7677cd4 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.275729 Jul 20 04:37:10.110055 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2710/5506] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:09 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:11.128076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e1b29d14-44e7-4c31-a909-80a5d0963a5d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:11.128690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e1b29d14-44e7-4c31-a909-80a5d0963a5d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:11.143175 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1b29d14-44e7-4c31-a909-80a5d0963a5d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.143696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1b29d14-44e7-4c31-a909-80a5d0963a5d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.144545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1b29d14-44e7-4c31-a909-80a5d0963a5d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.144990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1b29d14-44e7-4c31-a909-80a5d0963a5d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.231346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:11.449368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e1b29d14-44e7-4c31-a909-80a5d0963a5d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:11.464910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e1b29d14-44e7-4c31-a909-80a5d0963a5d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:11.470758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e1b29d14-44e7-4c31-a909-80a5d0963a5d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:11.480039 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e1b29d14-44e7-4c31-a909-80a5d0963a5d tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.356056 Jul 20 04:37:11.483763 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2797/5507] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:11 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:11.994407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e34312f-5141-4399-82b1-cc524d6630fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:11.995009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7e34312f-5141-4399-82b1-cc524d6630fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:12.009363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e34312f-5141-4399-82b1-cc524d6630fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.009873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e34312f-5141-4399-82b1-cc524d6630fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.010671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e34312f-5141-4399-82b1-cc524d6630fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.011115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e34312f-5141-4399-82b1-cc524d6630fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.130047 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7e34312f-5141-4399-82b1-cc524d6630fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/ips" status: 200 len: 152 microversion: 2.20 time: 0.140112 Jul 20 04:37:12.130664 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2711/5508] 10.222.0.20 () {60 vars in 1288 bytes} [Wed Jul 20 04:37:11 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/ips => generated 152 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:37:12.516394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2fa4a8ad-4069-4b58-bac3-8ee8aba31ddc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:12.517042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2fa4a8ad-4069-4b58-bac3-8ee8aba31ddc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:12.545178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fa4a8ad-4069-4b58-bac3-8ee8aba31ddc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.545636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fa4a8ad-4069-4b58-bac3-8ee8aba31ddc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.546424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fa4a8ad-4069-4b58-bac3-8ee8aba31ddc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.546873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fa4a8ad-4069-4b58-bac3-8ee8aba31ddc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.798323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2fa4a8ad-4069-4b58-bac3-8ee8aba31ddc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:12.819568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2fa4a8ad-4069-4b58-bac3-8ee8aba31ddc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:12.829675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2fa4a8ad-4069-4b58-bac3-8ee8aba31ddc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:12.834785 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2fa4a8ad-4069-4b58-bac3-8ee8aba31ddc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.327888 Jul 20 04:37:12.839564 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2798/5509] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:12 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:13.857200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d17361de-1a0d-4fb7-a1e2-e775db650b5f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:13.858828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d17361de-1a0d-4fb7-a1e2-e775db650b5f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:13.881706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d17361de-1a0d-4fb7-a1e2-e775db650b5f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.884677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d17361de-1a0d-4fb7-a1e2-e775db650b5f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.891342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d17361de-1a0d-4fb7-a1e2-e775db650b5f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.893447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d17361de-1a0d-4fb7-a1e2-e775db650b5f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.062400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d17361de-1a0d-4fb7-a1e2-e775db650b5f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:14.074165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d17361de-1a0d-4fb7-a1e2-e775db650b5f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:14.076932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d17361de-1a0d-4fb7-a1e2-e775db650b5f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:14.078183 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d17361de-1a0d-4fb7-a1e2-e775db650b5f tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.225636 Jul 20 04:37:14.087329 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2712/5510] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:13 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:15.106558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-279de3d7-1e91-4464-84ac-126df14329c7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:15.107183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-279de3d7-1e91-4464-84ac-126df14329c7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:15.134235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-279de3d7-1e91-4464-84ac-126df14329c7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:15.139148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-279de3d7-1e91-4464-84ac-126df14329c7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:15.143598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-279de3d7-1e91-4464-84ac-126df14329c7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:15.151158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-279de3d7-1e91-4464-84ac-126df14329c7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:15.376185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-279de3d7-1e91-4464-84ac-126df14329c7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:15.386394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-279de3d7-1e91-4464-84ac-126df14329c7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:15.388560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-279de3d7-1e91-4464-84ac-126df14329c7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:15.390002 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-279de3d7-1e91-4464-84ac-126df14329c7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.287684 Jul 20 04:37:15.391691 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2799/5511] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:15 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:16.410502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e4d845db-d256-4f82-a069-793bf4d2d9bf tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:16.411418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e4d845db-d256-4f82-a069-793bf4d2d9bf tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:16.438226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4d845db-d256-4f82-a069-793bf4d2d9bf tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.443299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4d845db-d256-4f82-a069-793bf4d2d9bf tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.444858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4d845db-d256-4f82-a069-793bf4d2d9bf tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.447849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e4d845db-d256-4f82-a069-793bf4d2d9bf tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.718411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e4d845db-d256-4f82-a069-793bf4d2d9bf tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:16.730883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:16.737896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f4c7213d-d994-4f95-803c-0c43d0c94a10 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:16.738436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f4c7213d-d994-4f95-803c-0c43d0c94a10 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:16.750428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e4d845db-d256-4f82-a069-793bf4d2d9bf tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:16.752682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e4d845db-d256-4f82-a069-793bf4d2d9bf tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:16.756534 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e4d845db-d256-4f82-a069-793bf4d2d9bf tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.350846 Jul 20 04:37:16.758264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4c7213d-d994-4f95-803c-0c43d0c94a10 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.760114 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2713/5512] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:16 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:16.763991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4c7213d-d994-4f95-803c-0c43d0c94a10 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.765533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4c7213d-d994-4f95-803c-0c43d0c94a10 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.766187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4c7213d-d994-4f95-803c-0c43d0c94a10 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.848410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-f4c7213d-d994-4f95-803c-0c43d0c94a10 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lazy-loading 'flavor' on Instance uuid 65fc74de-e748-4cab-838f-ea4b62c35ab5 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:37:17.411228 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f4c7213d-d994-4f95-803c-0c43d0c94a10 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "POST /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/action" status: 202 len: 0 microversion: 2.20 time: 0.677941 Jul 20 04:37:17.411935 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2800/5513] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:37:16 2022] POST /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:37:17.429925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-322b45ee-d507-4b3c-a1f7-4da34e787ecd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:17.431673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-322b45ee-d507-4b3c-a1f7-4da34e787ecd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:17.459416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-322b45ee-d507-4b3c-a1f7-4da34e787ecd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.460418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-322b45ee-d507-4b3c-a1f7-4da34e787ecd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.464827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-322b45ee-d507-4b3c-a1f7-4da34e787ecd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.466736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-322b45ee-d507-4b3c-a1f7-4da34e787ecd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.703779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-322b45ee-d507-4b3c-a1f7-4da34e787ecd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.722485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-322b45ee-d507-4b3c-a1f7-4da34e787ecd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.732611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-322b45ee-d507-4b3c-a1f7-4da34e787ecd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.736453 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-322b45ee-d507-4b3c-a1f7-4da34e787ecd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1722 microversion: 2.20 time: 0.317166 Jul 20 04:37:17.739413 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2714/5514] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:17 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:17.779916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4182014a-cfaf-4276-b421-12d09340fb80 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:17.780638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4182014a-cfaf-4276-b421-12d09340fb80 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:17.796220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4182014a-cfaf-4276-b421-12d09340fb80 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.796956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4182014a-cfaf-4276-b421-12d09340fb80 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.799827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4182014a-cfaf-4276-b421-12d09340fb80 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.801048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4182014a-cfaf-4276-b421-12d09340fb80 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.915321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4182014a-cfaf-4276-b421-12d09340fb80 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.929245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4182014a-cfaf-4276-b421-12d09340fb80 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.935801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4182014a-cfaf-4276-b421-12d09340fb80 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.937830 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4182014a-cfaf-4276-b421-12d09340fb80 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.162378 Jul 20 04:37:17.938899 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2801/5515] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:17 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:17.994948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ba6ead2f-2978-4d13-afe2-b1dc116b6334 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:17.995982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ba6ead2f-2978-4d13-afe2-b1dc116b6334 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:18.003784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba6ead2f-2978-4d13-afe2-b1dc116b6334 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:18.004247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba6ead2f-2978-4d13-afe2-b1dc116b6334 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:18.005112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba6ead2f-2978-4d13-afe2-b1dc116b6334 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:18.005565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ba6ead2f-2978-4d13-afe2-b1dc116b6334 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:18.050427 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-ba6ead2f-2978-4d13-afe2-b1dc116b6334 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] HTTP exception thrown: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ba6ead2f-2978-4d13-afe2-b1dc116b6334 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Request method failure captured: Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc HTTP/1.1 Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14R3puuTTj9BR9KHmkf0rGkPrttHRryRpT_aOmyRo5bE3o7ATD4JHUdBRTubOepRLN_YW7n2LdnKzJs79jXkPow5-CgW-I3h14ueSEk5yRIlalTSKWxFdOa0fXL1A3e94InH3R5mHg3suPCswxTYut9FysTiu35GHLnEDmpMpoOfbq4 Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: b57ef1075ca8492c829c3814ef2aa111 Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b57ef1075ca8492c829c3814ef2aa111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b57ef1075ca8492c829c3814ef2aa111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b57ef1075ca8492c829c3814ef2aa111", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b57ef1075ca8492c829c3814ef2aa111"}]}] Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: b57ef1075ca8492c829c3814ef2aa111 Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeTestJSON-129024044-project Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: d3153bab9eac4da0b257c291da3767ef Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeTestJSON-129024044-project Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '62d78226-707b-4d41-96ab-987874bee7fc'} Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:18.052101 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ba6ead2f-2978-4d13-afe2-b1dc116b6334 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Returning 404 to user: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:18.058109 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ba6ead2f-2978-4d13-afe2-b1dc116b6334 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "DELETE /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 404 len: 111 microversion: 2.1 time: 0.067206 Jul 20 04:37:18.063450 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2715/5516] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:37:17 2022] DELETE /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:37:18.068220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-56e61947-f1ac-4483-b8a9-0a86c322a4b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:18.069287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-56e61947-f1ac-4483-b8a9-0a86c322a4b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: 62d78226-707b-4d41-96ab-987874bee7fc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:18.078018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56e61947-f1ac-4483-b8a9-0a86c322a4b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:18.078482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56e61947-f1ac-4483-b8a9-0a86c322a4b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:18.079269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56e61947-f1ac-4483-b8a9-0a86c322a4b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:18.079759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56e61947-f1ac-4483-b8a9-0a86c322a4b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:18.139414 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-56e61947-f1ac-4483-b8a9-0a86c322a4b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] HTTP exception thrown: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-56e61947-f1ac-4483-b8a9-0a86c322a4b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Request method failure captured: Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc HTTP/1.1 Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14R3puuTTj9BR9KHmkf0rGkPrttHRryRpT_aOmyRo5bE3o7ATD4JHUdBRTubOepRLN_YW7n2LdnKzJs79jXkPow5-CgW-I3h14ueSEk5yRIlalTSKWxFdOa0fXL1A3e94InH3R5mHg3suPCswxTYut9FysTiu35GHLnEDmpMpoOfbq4 Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: b57ef1075ca8492c829c3814ef2aa111 Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b57ef1075ca8492c829c3814ef2aa111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b57ef1075ca8492c829c3814ef2aa111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b57ef1075ca8492c829c3814ef2aa111", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b57ef1075ca8492c829c3814ef2aa111"}]}] Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: b57ef1075ca8492c829c3814ef2aa111 Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AttachVolumeTestJSON-129024044-project Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: d3153bab9eac4da0b257c291da3767ef Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AttachVolumeTestJSON-129024044-project Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '62d78226-707b-4d41-96ab-987874bee7fc'} Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:18.142946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:18.151064 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:18.151064 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:18.151064 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:18.151064 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:18.151064 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:18.151064 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. Jul 20 04:37:18.151064 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:18.153415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-56e61947-f1ac-4483-b8a9-0a86c322a4b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Returning 404 to user: Instance 62d78226-707b-4d41-96ab-987874bee7fc could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:18.154915 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-56e61947-f1ac-4483-b8a9-0a86c322a4b7 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc" status: 404 len: 111 microversion: 2.1 time: 0.090861 Jul 20 04:37:18.156253 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2802/5517] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:18 2022] GET /compute/v2.1/servers/62d78226-707b-4d41-96ab-987874bee7fc => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:37:18.759148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2dc3c1ef-6b6d-45e2-88fa-760fdf69ac36 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:18.759834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2dc3c1ef-6b6d-45e2-88fa-760fdf69ac36 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:18.780142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2dc3c1ef-6b6d-45e2-88fa-760fdf69ac36 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:18.782051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2dc3c1ef-6b6d-45e2-88fa-760fdf69ac36 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:18.788370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2dc3c1ef-6b6d-45e2-88fa-760fdf69ac36 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:18.789716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2dc3c1ef-6b6d-45e2-88fa-760fdf69ac36 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:18.968611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-23d6ed0b-6a59-4159-ae00-985926f1883c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:18.972164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-23d6ed0b-6a59-4159-ae00-985926f1883c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:19.000261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23d6ed0b-6a59-4159-ae00-985926f1883c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.001632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23d6ed0b-6a59-4159-ae00-985926f1883c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.005726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23d6ed0b-6a59-4159-ae00-985926f1883c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.006234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23d6ed0b-6a59-4159-ae00-985926f1883c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.220112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-23d6ed0b-6a59-4159-ae00-985926f1883c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.232577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-23d6ed0b-6a59-4159-ae00-985926f1883c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.236280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-23d6ed0b-6a59-4159-ae00-985926f1883c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.239216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2dc3c1ef-6b6d-45e2-88fa-760fdf69ac36 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.248495 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-23d6ed0b-6a59-4159-ae00-985926f1883c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.291687 Jul 20 04:37:19.254270 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2803/5518] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:18 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:19.257999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2dc3c1ef-6b6d-45e2-88fa-760fdf69ac36 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.260183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2dc3c1ef-6b6d-45e2-88fa-760fdf69ac36 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.267936 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2dc3c1ef-6b6d-45e2-88fa-760fdf69ac36 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1722 microversion: 2.20 time: 0.511297 Jul 20 04:37:19.282395 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2716/5519] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:18 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1722 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:20.279000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c5f238cf-f259-44da-886b-37437c710cae tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:20.280424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c5f238cf-f259-44da-886b-37437c710cae tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:20.291478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5d18c26-fb8f-458a-aa84-b34cceb156a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:20.292296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c5d18c26-fb8f-458a-aa84-b34cceb156a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:20.294744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5f238cf-f259-44da-886b-37437c710cae tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.307834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5f238cf-f259-44da-886b-37437c710cae tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.308898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5f238cf-f259-44da-886b-37437c710cae tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.309356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5f238cf-f259-44da-886b-37437c710cae tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.310177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5d18c26-fb8f-458a-aa84-b34cceb156a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.311176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5d18c26-fb8f-458a-aa84-b34cceb156a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.314514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5d18c26-fb8f-458a-aa84-b34cceb156a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.315109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5d18c26-fb8f-458a-aa84-b34cceb156a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:21.103631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c5f238cf-f259-44da-886b-37437c710cae tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:21.125654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c5f238cf-f259-44da-886b-37437c710cae tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:21.127191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c5f238cf-f259-44da-886b-37437c710cae tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:21.128607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c5f238cf-f259-44da-886b-37437c710cae tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.858279 Jul 20 04:37:21.140439 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2804/5520] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:20 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:21.518533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c5d18c26-fb8f-458a-aa84-b34cceb156a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:21.533686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c5d18c26-fb8f-458a-aa84-b34cceb156a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:21.541197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c5d18c26-fb8f-458a-aa84-b34cceb156a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:21.544052 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5d18c26-fb8f-458a-aa84-b34cceb156a1 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1722 microversion: 2.20 time: 1.259199 Jul 20 04:37:21.545822 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2717/5521] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:20 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1722 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:22.149961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-839c3c48-b824-45ab-b8a8-1921c8ddb672 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:22.151229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-839c3c48-b824-45ab-b8a8-1921c8ddb672 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:22.190641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-839c3c48-b824-45ab-b8a8-1921c8ddb672 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.191641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-839c3c48-b824-45ab-b8a8-1921c8ddb672 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.192715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-839c3c48-b824-45ab-b8a8-1921c8ddb672 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.193361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-839c3c48-b824-45ab-b8a8-1921c8ddb672 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.590551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-839c3c48-b824-45ab-b8a8-1921c8ddb672 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.610775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-839c3c48-b824-45ab-b8a8-1921c8ddb672 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.612354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-839c3c48-b824-45ab-b8a8-1921c8ddb672 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.613560 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-839c3c48-b824-45ab-b8a8-1921c8ddb672 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1408 microversion: 2.54 time: 0.468592 Jul 20 04:37:22.614148 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2805/5522] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:22 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:22.619292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dcc91e15-f0a7-4b82-be4d-2316dbdff202 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:22.626316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dcc91e15-f0a7-4b82-be4d-2316dbdff202 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:22.739308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcc91e15-f0a7-4b82-be4d-2316dbdff202 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.759527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcc91e15-f0a7-4b82-be4d-2316dbdff202 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.783054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcc91e15-f0a7-4b82-be4d-2316dbdff202 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.788319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dcc91e15-f0a7-4b82-be4d-2316dbdff202 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.332078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dcc91e15-f0a7-4b82-be4d-2316dbdff202 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:23.343350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dcc91e15-f0a7-4b82-be4d-2316dbdff202 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:23.350057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dcc91e15-f0a7-4b82-be4d-2316dbdff202 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:23.352327 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dcc91e15-f0a7-4b82-be4d-2316dbdff202 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1722 microversion: 2.20 time: 0.787330 Jul 20 04:37:23.357886 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2718/5523] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:22 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1722 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:23.633539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-58c81749-2d5d-4dd0-b1c1-e0e8e3723adc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:23.634150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-58c81749-2d5d-4dd0-b1c1-e0e8e3723adc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:23.650886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58c81749-2d5d-4dd0-b1c1-e0e8e3723adc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:23.651821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58c81749-2d5d-4dd0-b1c1-e0e8e3723adc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.652913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58c81749-2d5d-4dd0-b1c1-e0e8e3723adc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:23.653597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58c81749-2d5d-4dd0-b1c1-e0e8e3723adc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.802535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-58c81749-2d5d-4dd0-b1c1-e0e8e3723adc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:23.816151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-58c81749-2d5d-4dd0-b1c1-e0e8e3723adc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:23.822195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-58c81749-2d5d-4dd0-b1c1-e0e8e3723adc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:23.825758 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-58c81749-2d5d-4dd0-b1c1-e0e8e3723adc tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1414 microversion: 2.54 time: 0.197117 Jul 20 04:37:23.826363 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2806/5524] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:23 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1414 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:24.377871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c3920fc8-bb9d-4ac5-8f03-4893bc4693f6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:24.378498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c3920fc8-bb9d-4ac5-8f03-4893bc4693f6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:24.389551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3920fc8-bb9d-4ac5-8f03-4893bc4693f6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.390019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3920fc8-bb9d-4ac5-8f03-4893bc4693f6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.390810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3920fc8-bb9d-4ac5-8f03-4893bc4693f6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.396242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3920fc8-bb9d-4ac5-8f03-4893bc4693f6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.729762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c3920fc8-bb9d-4ac5-8f03-4893bc4693f6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:24.753594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c3920fc8-bb9d-4ac5-8f03-4893bc4693f6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:24.762210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c3920fc8-bb9d-4ac5-8f03-4893bc4693f6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:24.768579 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c3920fc8-bb9d-4ac5-8f03-4893bc4693f6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1722 microversion: 2.20 time: 0.393171 Jul 20 04:37:24.773087 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2719/5525] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:24 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1722 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:24.846597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aed22bbc-90e5-49b9-9aff-c74a32c15b9c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:24.847393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aed22bbc-90e5-49b9-9aff-c74a32c15b9c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:24.874412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aed22bbc-90e5-49b9-9aff-c74a32c15b9c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.874835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aed22bbc-90e5-49b9-9aff-c74a32c15b9c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.878482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aed22bbc-90e5-49b9-9aff-c74a32c15b9c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.878950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aed22bbc-90e5-49b9-9aff-c74a32c15b9c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.062683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aed22bbc-90e5-49b9-9aff-c74a32c15b9c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.084215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7d3e10c4-544b-4620-8cbf-9ed110ad26b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:25.084787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7d3e10c4-544b-4620-8cbf-9ed110ad26b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:25.106768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d3e10c4-544b-4620-8cbf-9ed110ad26b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.107240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d3e10c4-544b-4620-8cbf-9ed110ad26b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.114144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d3e10c4-544b-4620-8cbf-9ed110ad26b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.114675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d3e10c4-544b-4620-8cbf-9ed110ad26b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.117522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aed22bbc-90e5-49b9-9aff-c74a32c15b9c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.119388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aed22bbc-90e5-49b9-9aff-c74a32c15b9c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.120653 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aed22bbc-90e5-49b9-9aff-c74a32c15b9c tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1414 microversion: 2.54 time: 0.278938 Jul 20 04:37:25.128627 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2807/5526] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:24 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1414 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:25.161685 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-7d3e10c4-544b-4620-8cbf-9ed110ad26b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] HTTP exception thrown: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7d3e10c4-544b-4620-8cbf-9ed110ad26b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Request method failure captured: Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b HTTP/1.1 Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14R3puuTTj9BR9KHmkf0rGkPrttHRryRpT_aOmyRo5bE3o7ATD4JHUdBRTubOepRLN_YW7n2LdnKzJs79jXkPow5-CgW-I3h14ueSEk5yRIlalTSKWxFdOa0fXL1A3e94InH3R5mHg3suPCswxTYut9FysTiu35GHLnEDmpMpoOfbq4 Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: b57ef1075ca8492c829c3814ef2aa111 Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b57ef1075ca8492c829c3814ef2aa111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b57ef1075ca8492c829c3814ef2aa111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b57ef1075ca8492c829c3814ef2aa111", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b57ef1075ca8492c829c3814ef2aa111"}]}] Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: b57ef1075ca8492c829c3814ef2aa111 Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeTestJSON-129024044-project Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: d3153bab9eac4da0b257c291da3767ef Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeTestJSON-129024044-project Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'bd8d5de4-7985-4933-8867-3352bf84a16b'} Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:25.176404 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:25.182211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:37:25.182211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:25.182211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:25.182211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:25.182211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:25.182211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:25.182211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:25.182211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:25.182211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:25.182211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:37:25.182211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:37:25.185838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7d3e10c4-544b-4620-8cbf-9ed110ad26b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Returning 404 to user: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:25.189546 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7d3e10c4-544b-4620-8cbf-9ed110ad26b3 tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 404 len: 111 microversion: 2.1 time: 0.111217 Jul 20 04:37:25.197095 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2720/5527] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:37:25 2022] DELETE /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:37:25.205210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-044fd03b-bdc1-439c-8af3-59aed52783fe tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:25.205839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-044fd03b-bdc1-439c-8af3-59aed52783fe tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] [instance: bd8d5de4-7985-4933-8867-3352bf84a16b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:25.217623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-044fd03b-bdc1-439c-8af3-59aed52783fe tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.218106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-044fd03b-bdc1-439c-8af3-59aed52783fe tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.220859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-044fd03b-bdc1-439c-8af3-59aed52783fe tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.224541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-044fd03b-bdc1-439c-8af3-59aed52783fe tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.273077 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-044fd03b-bdc1-439c-8af3-59aed52783fe tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] HTTP exception thrown: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-044fd03b-bdc1-439c-8af3-59aed52783fe tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Request method failure captured: Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b HTTP/1.1 Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14R3puuTTj9BR9KHmkf0rGkPrttHRryRpT_aOmyRo5bE3o7ATD4JHUdBRTubOepRLN_YW7n2LdnKzJs79jXkPow5-CgW-I3h14ueSEk5yRIlalTSKWxFdOa0fXL1A3e94InH3R5mHg3suPCswxTYut9FysTiu35GHLnEDmpMpoOfbq4 Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: b57ef1075ca8492c829c3814ef2aa111 Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b57ef1075ca8492c829c3814ef2aa111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b57ef1075ca8492c829c3814ef2aa111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b57ef1075ca8492c829c3814ef2aa111", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b57ef1075ca8492c829c3814ef2aa111"}]}] Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: b57ef1075ca8492c829c3814ef2aa111 Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AttachVolumeTestJSON-129024044 Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AttachVolumeTestJSON-129024044-project Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: d3153bab9eac4da0b257c291da3767ef Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AttachVolumeTestJSON-129024044-project Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'bd8d5de4-7985-4933-8867-3352bf84a16b'} Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:25.275059 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:25.280793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:25.280793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:25.280793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:25.280793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:25.280793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:25.280793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. Jul 20 04:37:25.280793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:25.282845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-044fd03b-bdc1-439c-8af3-59aed52783fe tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] Returning 404 to user: Instance bd8d5de4-7985-4933-8867-3352bf84a16b could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:25.284226 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-044fd03b-bdc1-439c-8af3-59aed52783fe tempest-AttachVolumeTestJSON-129024044 tempest-AttachVolumeTestJSON-129024044-project] 10.222.0.20 "GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b" status: 404 len: 111 microversion: 2.1 time: 0.083041 Jul 20 04:37:25.289299 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2808/5528] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:25 2022] GET /compute/v2.1/servers/bd8d5de4-7985-4933-8867-3352bf84a16b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:37:25.790850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-607e6ce6-8e8c-4d63-9f85-090d78759fbe tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:25.791771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-607e6ce6-8e8c-4d63-9f85-090d78759fbe tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:25.804747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-607e6ce6-8e8c-4d63-9f85-090d78759fbe tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.805523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-607e6ce6-8e8c-4d63-9f85-090d78759fbe tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.805989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-607e6ce6-8e8c-4d63-9f85-090d78759fbe tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.806497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-607e6ce6-8e8c-4d63-9f85-090d78759fbe tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.142353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-46a7c9e2-966c-4463-8e9b-809773276d8b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:26.142987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-46a7c9e2-966c-4463-8e9b-809773276d8b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:26.158282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46a7c9e2-966c-4463-8e9b-809773276d8b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:26.168141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46a7c9e2-966c-4463-8e9b-809773276d8b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.168995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46a7c9e2-966c-4463-8e9b-809773276d8b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:26.169449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46a7c9e2-966c-4463-8e9b-809773276d8b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.604423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-46a7c9e2-966c-4463-8e9b-809773276d8b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.619803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-46a7c9e2-966c-4463-8e9b-809773276d8b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.626542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-46a7c9e2-966c-4463-8e9b-809773276d8b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.631408 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-46a7c9e2-966c-4463-8e9b-809773276d8b tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1414 microversion: 2.54 time: 0.492270 Jul 20 04:37:26.645562 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2809/5529] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:26 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1414 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:27.057771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-607e6ce6-8e8c-4d63-9f85-090d78759fbe tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.072178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-607e6ce6-8e8c-4d63-9f85-090d78759fbe tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.074168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-607e6ce6-8e8c-4d63-9f85-090d78759fbe tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.087073 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-607e6ce6-8e8c-4d63-9f85-090d78759fbe tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1722 microversion: 2.20 time: 1.300890 Jul 20 04:37:27.098951 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2721/5530] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:25 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1722 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:27.655204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-35725e84-35b7-4fe9-ae80-0cb3752e92d2 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:27.655862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-35725e84-35b7-4fe9-ae80-0cb3752e92d2 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:27.668643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35725e84-35b7-4fe9-ae80-0cb3752e92d2 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.673178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35725e84-35b7-4fe9-ae80-0cb3752e92d2 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.676994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35725e84-35b7-4fe9-ae80-0cb3752e92d2 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.679315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35725e84-35b7-4fe9-ae80-0cb3752e92d2 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.831455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-35725e84-35b7-4fe9-ae80-0cb3752e92d2 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.848392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-35725e84-35b7-4fe9-ae80-0cb3752e92d2 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.855735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-35725e84-35b7-4fe9-ae80-0cb3752e92d2 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.864594 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-35725e84-35b7-4fe9-ae80-0cb3752e92d2 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1414 microversion: 2.54 time: 0.211561 Jul 20 04:37:27.866754 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2810/5531] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:27 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1414 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:28.108189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5be38f92-fff6-45ab-a473-837cc98058d6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:28.109537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5be38f92-fff6-45ab-a473-837cc98058d6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:28.122576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5be38f92-fff6-45ab-a473-837cc98058d6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.125752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5be38f92-fff6-45ab-a473-837cc98058d6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.129222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5be38f92-fff6-45ab-a473-837cc98058d6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.129868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5be38f92-fff6-45ab-a473-837cc98058d6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.803150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5be38f92-fff6-45ab-a473-837cc98058d6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:28.820933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5be38f92-fff6-45ab-a473-837cc98058d6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:28.822814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5be38f92-fff6-45ab-a473-837cc98058d6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:28.824269 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5be38f92-fff6-45ab-a473-837cc98058d6 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1722 microversion: 2.20 time: 0.721632 Jul 20 04:37:28.836290 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2722/5532] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:28 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1722 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:28.885892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fbc1b7d9-561f-4984-a0dd-e01f69bbfffe tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:28.887131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fbc1b7d9-561f-4984-a0dd-e01f69bbfffe tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:28.897730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbc1b7d9-561f-4984-a0dd-e01f69bbfffe tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.902726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbc1b7d9-561f-4984-a0dd-e01f69bbfffe tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.904181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbc1b7d9-561f-4984-a0dd-e01f69bbfffe tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.904812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbc1b7d9-561f-4984-a0dd-e01f69bbfffe tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.632341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fbc1b7d9-561f-4984-a0dd-e01f69bbfffe tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:29.652797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fbc1b7d9-561f-4984-a0dd-e01f69bbfffe tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:29.654315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fbc1b7d9-561f-4984-a0dd-e01f69bbfffe tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:29.655640 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fbc1b7d9-561f-4984-a0dd-e01f69bbfffe tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1399 microversion: 2.54 time: 0.773598 Jul 20 04:37:29.669563 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2811/5533] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:28 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1399 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:29.678090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-79b80640-d585-47d6-8ea9-0b18c0537f69 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '.version_select at 0x7fbf9c343b80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:29.733336 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-79b80640-d585-47d6-8ea9-0b18c0537f69 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1683820281" status: 204 len: 0 microversion: 2.54 time: 0.060015 Jul 20 04:37:29.737676 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2723/5534] 10.222.0.20 () {60 vars in 1318 bytes} [Wed Jul 20 04:37:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1683820281 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:37:29.760053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-79ec777b-2cd9-4479-a92c-3004b961fc47 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:29.761191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-79ec777b-2cd9-4479-a92c-3004b961fc47 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:29.771062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:29.778614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79ec777b-2cd9-4479-a92c-3004b961fc47 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:29.780023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79ec777b-2cd9-4479-a92c-3004b961fc47 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.781849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79ec777b-2cd9-4479-a92c-3004b961fc47 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:29.784938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79ec777b-2cd9-4479-a92c-3004b961fc47 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.846968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ec602e0-efaf-4326-80a7-91fb4d86451d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:29.848402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ec602e0-efaf-4326-80a7-91fb4d86451d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:29.858206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ec602e0-efaf-4326-80a7-91fb4d86451d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:29.859345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ec602e0-efaf-4326-80a7-91fb4d86451d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.859879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-79ec777b-2cd9-4479-a92c-3004b961fc47 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:37:29.860962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ec602e0-efaf-4326-80a7-91fb4d86451d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:29.861656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ec602e0-efaf-4326-80a7-91fb4d86451d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.939720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:30.022245 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-79ec777b-2cd9-4479-a92c-3004b961fc47 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 204 len: 0 microversion: 2.54 time: 0.268163 Jul 20 04:37:30.024352 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2812/5535] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:37:29 2022] DELETE /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:37:30.032968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a35ac185-0633-4682-8ba9-a862fd258851 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:30.033732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a35ac185-0633-4682-8ba9-a862fd258851 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:30.082573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a35ac185-0633-4682-8ba9-a862fd258851 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.083659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a35ac185-0633-4682-8ba9-a862fd258851 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.084664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a35ac185-0633-4682-8ba9-a862fd258851 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.085692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a35ac185-0633-4682-8ba9-a862fd258851 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.415648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a35ac185-0633-4682-8ba9-a862fd258851 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:30.429322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a35ac185-0633-4682-8ba9-a862fd258851 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:30.432247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a35ac185-0633-4682-8ba9-a862fd258851 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:30.433829 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a35ac185-0633-4682-8ba9-a862fd258851 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1405 microversion: 2.54 time: 0.405398 Jul 20 04:37:30.435210 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2813/5536] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:30 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:30.505811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ec602e0-efaf-4326-80a7-91fb4d86451d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:30.534740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ec602e0-efaf-4326-80a7-91fb4d86451d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:30.536848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ec602e0-efaf-4326-80a7-91fb4d86451d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:30.546578 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ec602e0-efaf-4326-80a7-91fb4d86451d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1743 microversion: 2.20 time: 0.697009 Jul 20 04:37:30.556463 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2724/5537] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:29 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1743 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:31.455630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8b149ea1-c58f-46e7-9acc-c6edcadc7608 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:31.458894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8b149ea1-c58f-46e7-9acc-c6edcadc7608 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:31.474796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b149ea1-c58f-46e7-9acc-c6edcadc7608 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.476010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b149ea1-c58f-46e7-9acc-c6edcadc7608 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.476931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b149ea1-c58f-46e7-9acc-c6edcadc7608 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.477629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b149ea1-c58f-46e7-9acc-c6edcadc7608 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.579445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-25e202ce-1a43-4922-93af-da57446cc181 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:31.582463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-25e202ce-1a43-4922-93af-da57446cc181 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:31.592627 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25e202ce-1a43-4922-93af-da57446cc181 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.593562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25e202ce-1a43-4922-93af-da57446cc181 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.594589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25e202ce-1a43-4922-93af-da57446cc181 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.595444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25e202ce-1a43-4922-93af-da57446cc181 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.699072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8b149ea1-c58f-46e7-9acc-c6edcadc7608 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:31.710447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8b149ea1-c58f-46e7-9acc-c6edcadc7608 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:31.727915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8b149ea1-c58f-46e7-9acc-c6edcadc7608 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:31.733285 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8b149ea1-c58f-46e7-9acc-c6edcadc7608 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1405 microversion: 2.54 time: 0.282591 Jul 20 04:37:31.739005 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2814/5538] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:31 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:32.307670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-25e202ce-1a43-4922-93af-da57446cc181 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:32.332770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-25e202ce-1a43-4922-93af-da57446cc181 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:32.342657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-25e202ce-1a43-4922-93af-da57446cc181 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:32.344550 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-25e202ce-1a43-4922-93af-da57446cc181 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1743 microversion: 2.20 time: 0.769488 Jul 20 04:37:32.351297 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2725/5539] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:31 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1743 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:32.780600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:32.781963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:32.817712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.820112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.821739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.824670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.917671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.918767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.919490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lazy-loading 'fault' on Instance uuid 6480345e-4d22-4a97-9f33-476b1c2d158f {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:37:33.148221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:33.243643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:33.245444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad74018fd1214d98a2cf80273e87edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692d3434aa1f460ca0f1f701820d821f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:33.246692 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-68359f54-0fdb-4232-9666-3739c69c71cd tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 200 len: 1410 microversion: 2.54 time: 0.470547 Jul 20 04:37:33.263483 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2815/5540] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:32 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 1410 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:33.370972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8eac506a-850a-4879-843e-bb34bca99819 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:33.372310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8eac506a-850a-4879-843e-bb34bca99819 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:33.390961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8eac506a-850a-4879-843e-bb34bca99819 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.391849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8eac506a-850a-4879-843e-bb34bca99819 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.393975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8eac506a-850a-4879-843e-bb34bca99819 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.396213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8eac506a-850a-4879-843e-bb34bca99819 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.652052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-16f6307d-41ba-4004-8cab-4c96204550b7 req-b7e7f54a-408e-4c37-a867-c5eea5642f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc74de-e748-4cab-838f-ea4b62c35ab5", "name": "network-vif-plugged", "status": "completed", "tag": "73105a65-3425-4751-af47-f418c2e5049c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:33.688919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-16f6307d-41ba-4004-8cab-4c96204550b7 req-b7e7f54a-408e-4c37-a867-c5eea5642f94 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.690854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-16f6307d-41ba-4004-8cab-4c96204550b7 req-b7e7f54a-408e-4c37-a867-c5eea5642f94 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.743017 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-16f6307d-41ba-4004-8cab-4c96204550b7 req-b7e7f54a-408e-4c37-a867-c5eea5642f94 service nova] Creating event network-vif-plugged:73105a65-3425-4751-af47-f418c2e5049c for instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 on n-h2-764485-11 Jul 20 04:37:33.752613 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-16f6307d-41ba-4004-8cab-4c96204550b7 req-b7e7f54a-408e-4c37-a867-c5eea5642f94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106593 Jul 20 04:37:33.759958 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2816/5541] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:37:34.267392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2ed0c0e-556a-47b8-89c5-81612babffa7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:34.268861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c2ed0c0e-556a-47b8-89c5-81612babffa7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] [instance: 6480345e-4d22-4a97-9f33-476b1c2d158f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:34.288357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2ed0c0e-556a-47b8-89c5-81612babffa7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.288753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2ed0c0e-556a-47b8-89c5-81612babffa7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.289758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2ed0c0e-556a-47b8-89c5-81612babffa7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.290434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2ed0c0e-556a-47b8-89c5-81612babffa7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.326168 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-c2ed0c0e-556a-47b8-89c5-81612babffa7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] HTTP exception thrown: Instance 6480345e-4d22-4a97-9f33-476b1c2d158f could not be found. Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2ed0c0e-556a-47b8-89c5-81612babffa7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Request method failure captured: Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f HTTP/1.1 Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14ZXcpGTgIF_0LrH-itfrcKQ0vNiCGaRNd_Twgs_cpArVXUFbxaDtI9ydrDo9IFv8IaD5qbF-NYE6lGV4O7e5uy8-rHDjQkIW_zclkRE6MCuH2zOGxhPYeDtsKdQ6WtsPLY0R3AG_FsxdJIV46qYRCqCnqg9ORG-9EjbP1nmJNXwPzw Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.54 Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 692d3434aa1f460ca0f1f701820d821f Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerShowV254Test-458656850 Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/692d3434aa1f460ca0f1f701820d821f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/692d3434aa1f460ca0f1f701820d821f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_692d3434aa1f460ca0f1f701820d821f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/692d3434aa1f460ca0f1f701820d821f"}]}] Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerShowV254Test-458656850 Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 692d3434aa1f460ca0f1f701820d821f Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerShowV254Test-458656850 Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerShowV254Test-458656850-project Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: ad74018fd1214d98a2cf80273e87edd3 Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerShowV254Test-458656850-project Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 6480345e-4d22-4a97-9f33-476b1c2d158f could not be found. Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '6480345e-4d22-4a97-9f33-476b1c2d158f'} Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6480345e-4d22-4a97-9f33-476b1c2d158f could not be found. Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6480345e-4d22-4a97-9f33-476b1c2d158f could not be found. Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:34.344687 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:34.350852 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:34.350852 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:34.350852 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:34.350852 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:34.350852 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:34.350852 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6480345e-4d22-4a97-9f33-476b1c2d158f could not be found. Jul 20 04:37:34.350852 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:37:34.350852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2ed0c0e-556a-47b8-89c5-81612babffa7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] Returning 404 to user: Instance 6480345e-4d22-4a97-9f33-476b1c2d158f could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:34.350852 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c2ed0c0e-556a-47b8-89c5-81612babffa7 tempest-ServerShowV254Test-458656850 tempest-ServerShowV254Test-458656850-project] 10.222.0.20 "GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f" status: 404 len: 111 microversion: 2.54 time: 0.084223 Jul 20 04:37:34.350852 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2817/5542] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:34 2022] GET /compute/v2.1/servers/6480345e-4d22-4a97-9f33-476b1c2d158f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:37:34.956642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8eac506a-850a-4879-843e-bb34bca99819 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:34.987068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8eac506a-850a-4879-843e-bb34bca99819 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:34.999688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8eac506a-850a-4879-843e-bb34bca99819 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:35.005855 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8eac506a-850a-4879-843e-bb34bca99819 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1743 microversion: 2.20 time: 1.635242 Jul 20 04:37:35.008020 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2726/5543] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:33 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1743 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:36.026039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2f635dc0-5147-48e2-97fe-d78aa0d14ec2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:36.027291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2f635dc0-5147-48e2-97fe-d78aa0d14ec2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:36.048618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f635dc0-5147-48e2-97fe-d78aa0d14ec2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:36.054347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f635dc0-5147-48e2-97fe-d78aa0d14ec2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:36.055562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f635dc0-5147-48e2-97fe-d78aa0d14ec2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:36.059270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f635dc0-5147-48e2-97fe-d78aa0d14ec2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.796189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f635dc0-5147-48e2-97fe-d78aa0d14ec2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:37.806962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f635dc0-5147-48e2-97fe-d78aa0d14ec2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:37.815436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f635dc0-5147-48e2-97fe-d78aa0d14ec2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:37.819776 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2f635dc0-5147-48e2-97fe-d78aa0d14ec2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 1.798053 Jul 20 04:37:37.824478 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2818/5544] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:36 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:38.844974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eea93cb2-84e3-4a5d-8939-722b32585771 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:38.846202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eea93cb2-84e3-4a5d-8939-722b32585771 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:38.848305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:38.869197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eea93cb2-84e3-4a5d-8939-722b32585771 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.869933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eea93cb2-84e3-4a5d-8939-722b32585771 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.875693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eea93cb2-84e3-4a5d-8939-722b32585771 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.876446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eea93cb2-84e3-4a5d-8939-722b32585771 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.723275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eea93cb2-84e3-4a5d-8939-722b32585771 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:39.741829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eea93cb2-84e3-4a5d-8939-722b32585771 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:39.746272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eea93cb2-84e3-4a5d-8939-722b32585771 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:39.759254 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eea93cb2-84e3-4a5d-8939-722b32585771 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 0.918422 Jul 20 04:37:39.762393 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2727/5545] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:38 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:40.778142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-31139604-c332-4e7e-99fe-58120fe26c84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:40.778928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-31139604-c332-4e7e-99fe-58120fe26c84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:40.798339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31139604-c332-4e7e-99fe-58120fe26c84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:40.798705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31139604-c332-4e7e-99fe-58120fe26c84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:40.799533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31139604-c332-4e7e-99fe-58120fe26c84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:40.809096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31139604-c332-4e7e-99fe-58120fe26c84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.752437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-31139604-c332-4e7e-99fe-58120fe26c84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:41.777018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-31139604-c332-4e7e-99fe-58120fe26c84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:41.785158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-31139604-c332-4e7e-99fe-58120fe26c84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:41.791775 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-31139604-c332-4e7e-99fe-58120fe26c84 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 1.014517 Jul 20 04:37:41.794703 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2819/5546] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:40 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:42.811726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7178bbce-47e3-4051-8db3-5d74203e72f3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:42.812982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7178bbce-47e3-4051-8db3-5d74203e72f3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:42.835908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7178bbce-47e3-4051-8db3-5d74203e72f3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.836767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7178bbce-47e3-4051-8db3-5d74203e72f3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.839393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7178bbce-47e3-4051-8db3-5d74203e72f3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.841587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7178bbce-47e3-4051-8db3-5d74203e72f3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:43.389839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7178bbce-47e3-4051-8db3-5d74203e72f3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:43.401615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7178bbce-47e3-4051-8db3-5d74203e72f3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:43.403133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7178bbce-47e3-4051-8db3-5d74203e72f3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:43.413489 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7178bbce-47e3-4051-8db3-5d74203e72f3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 0.597728 Jul 20 04:37:43.427877 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2728/5547] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:42 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:44.433145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2e72786-4cc1-4fdb-b8a5-346e47740e41 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:44.434451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c2e72786-4cc1-4fdb-b8a5-346e47740e41 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:44.457600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2e72786-4cc1-4fdb-b8a5-346e47740e41 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.458056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2e72786-4cc1-4fdb-b8a5-346e47740e41 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:44.476877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2e72786-4cc1-4fdb-b8a5-346e47740e41 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.477448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2e72786-4cc1-4fdb-b8a5-346e47740e41 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:45.963727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c2e72786-4cc1-4fdb-b8a5-346e47740e41 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:45.984133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c2e72786-4cc1-4fdb-b8a5-346e47740e41 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:45.986179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c2e72786-4cc1-4fdb-b8a5-346e47740e41 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:46.002907 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c2e72786-4cc1-4fdb-b8a5-346e47740e41 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 1.565899 Jul 20 04:37:46.018148 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2820/5548] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:44 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:47.023386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-29e68498-9ad0-47d2-a4b5-2767d5766c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:47.025401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-29e68498-9ad0-47d2-a4b5-2767d5766c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:47.051472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29e68498-9ad0-47d2-a4b5-2767d5766c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.066077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29e68498-9ad0-47d2-a4b5-2767d5766c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.069724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29e68498-9ad0-47d2-a4b5-2767d5766c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.070969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29e68498-9ad0-47d2-a4b5-2767d5766c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.801943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-29e68498-9ad0-47d2-a4b5-2767d5766c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:48.808470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=81 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:48.820456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-29e68498-9ad0-47d2-a4b5-2767d5766c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:48.821965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-29e68498-9ad0-47d2-a4b5-2767d5766c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:48.863833 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-29e68498-9ad0-47d2-a4b5-2767d5766c89 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 1.824413 Jul 20 04:37:48.864873 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2729/5549] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:47 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:49.883120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6192bdbd-5791-4876-938e-2c8bef0e4aab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:49.884049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6192bdbd-5791-4876-938e-2c8bef0e4aab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:49.903067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6192bdbd-5791-4876-938e-2c8bef0e4aab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:49.915582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6192bdbd-5791-4876-938e-2c8bef0e4aab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:49.918121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6192bdbd-5791-4876-938e-2c8bef0e4aab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:49.921723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6192bdbd-5791-4876-938e-2c8bef0e4aab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:51.346514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6192bdbd-5791-4876-938e-2c8bef0e4aab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:51.370707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6192bdbd-5791-4876-938e-2c8bef0e4aab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:51.372268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6192bdbd-5791-4876-938e-2c8bef0e4aab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:51.373467 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6192bdbd-5791-4876-938e-2c8bef0e4aab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 1.494523 Jul 20 04:37:51.395259 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2821/5550] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:49 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:52.398000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-396e68f5-15bd-4b9d-baa5-278f47b12531 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:52.399272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-396e68f5-15bd-4b9d-baa5-278f47b12531 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:52.429094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-396e68f5-15bd-4b9d-baa5-278f47b12531 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:52.442060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-396e68f5-15bd-4b9d-baa5-278f47b12531 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:52.448538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-396e68f5-15bd-4b9d-baa5-278f47b12531 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:52.449244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-396e68f5-15bd-4b9d-baa5-278f47b12531 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:52.843549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-396e68f5-15bd-4b9d-baa5-278f47b12531 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:52.854703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-396e68f5-15bd-4b9d-baa5-278f47b12531 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:52.856277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-396e68f5-15bd-4b9d-baa5-278f47b12531 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:52.857479 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-396e68f5-15bd-4b9d-baa5-278f47b12531 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 0.465882 Jul 20 04:37:52.858060 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2730/5551] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:52 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:53.879587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8ad1fffb-af3d-42b3-a324-c40eadcc26c3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:53.880225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8ad1fffb-af3d-42b3-a324-c40eadcc26c3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:53.895048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ad1fffb-af3d-42b3-a324-c40eadcc26c3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.895883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ad1fffb-af3d-42b3-a324-c40eadcc26c3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:53.896882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ad1fffb-af3d-42b3-a324-c40eadcc26c3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.910187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8ad1fffb-af3d-42b3-a324-c40eadcc26c3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:55.014380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8ad1fffb-af3d-42b3-a324-c40eadcc26c3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:55.025261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8ad1fffb-af3d-42b3-a324-c40eadcc26c3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:55.030682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8ad1fffb-af3d-42b3-a324-c40eadcc26c3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:55.039416 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8ad1fffb-af3d-42b3-a324-c40eadcc26c3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 1.160089 Jul 20 04:37:55.040367 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2822/5552] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:53 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:56.059383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1a562f81-7b9d-4fcb-bcc4-42bded62ad48 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:56.059383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1a562f81-7b9d-4fcb-bcc4-42bded62ad48 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:56.066424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a562f81-7b9d-4fcb-bcc4-42bded62ad48 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.084730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a562f81-7b9d-4fcb-bcc4-42bded62ad48 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.088392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a562f81-7b9d-4fcb-bcc4-42bded62ad48 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.091127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a562f81-7b9d-4fcb-bcc4-42bded62ad48 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.645330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1a562f81-7b9d-4fcb-bcc4-42bded62ad48 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:56.683374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1a562f81-7b9d-4fcb-bcc4-42bded62ad48 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:56.701107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1a562f81-7b9d-4fcb-bcc4-42bded62ad48 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:56.702369 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1a562f81-7b9d-4fcb-bcc4-42bded62ad48 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 0.647428 Jul 20 04:37:56.709765 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2731/5553] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:56 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:57.483634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-839f1eb8-1a5c-403c-bf79-a483a3ba0465 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: .version_select at 0x7fbf9c4f50d0>, body: {"keypair": {"name": "tempest-keypair-251516566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYGqrZHad4K+z7ddwlm6uSlFfGCkjtIDja+y/tMwRTfNH2WBTocPP85NLK5nvhF2JvE3hCkBd9ukWVew03TZaQp04oCvw3CjWdlCtvPKRQ5o8C55PIbWY5QMkBM1mML4A=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:57.529599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-839f1eb8-1a5c-403c-bf79-a483a3ba0465 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:37:57.536614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-839f1eb8-1a5c-403c-bf79-a483a3ba0465 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for user 8759015052b64df2b36efb694b837999 and project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:37:57.593462 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-839f1eb8-1a5c-403c-bf79-a483a3ba0465 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.550832 Jul 20 04:37:57.594765 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2823/5554] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:37:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:57.726349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-89c469e9-8b1f-451b-8628-100624923039 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:57.727798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-89c469e9-8b1f-451b-8628-100624923039 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:57.741774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89c469e9-8b1f-451b-8628-100624923039 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:57.745992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89c469e9-8b1f-451b-8628-100624923039 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:57.747138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89c469e9-8b1f-451b-8628-100624923039 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:57.747949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89c469e9-8b1f-451b-8628-100624923039 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:58.135363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89c469e9-8b1f-451b-8628-100624923039 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:58.148012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89c469e9-8b1f-451b-8628-100624923039 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:58.150234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89c469e9-8b1f-451b-8628-100624923039 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:58.153841 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-89c469e9-8b1f-451b-8628-100624923039 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 0.433635 Jul 20 04:37:58.166743 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2732/5555] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:57 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:37:59.173860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0d8d5e21-64c8-4576-a1c6-a62610af2d51 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:59.175290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0d8d5e21-64c8-4576-a1c6-a62610af2d51 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:59.199674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d8d5e21-64c8-4576-a1c6-a62610af2d51 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.199674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d8d5e21-64c8-4576-a1c6-a62610af2d51 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.201318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d8d5e21-64c8-4576-a1c6-a62610af2d51 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.201318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d8d5e21-64c8-4576-a1c6-a62610af2d51 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.986429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d8d5e21-64c8-4576-a1c6-a62610af2d51 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:59.995162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:00.002820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d8d5e21-64c8-4576-a1c6-a62610af2d51 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:00.013568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d8d5e21-64c8-4576-a1c6-a62610af2d51 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:00.023174 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0d8d5e21-64c8-4576-a1c6-a62610af2d51 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 0.853419 Jul 20 04:38:00.032032 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2824/5556] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:59 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:01.050580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dbca2b26-018e-4f0f-a2a0-13e813f9d349 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:01.051196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dbca2b26-018e-4f0f-a2a0-13e813f9d349 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:01.065990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbca2b26-018e-4f0f-a2a0-13e813f9d349 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.066774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbca2b26-018e-4f0f-a2a0-13e813f9d349 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.068806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbca2b26-018e-4f0f-a2a0-13e813f9d349 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.075408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbca2b26-018e-4f0f-a2a0-13e813f9d349 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.465248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-405066068", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ee66832-4e3e-4ea5-b8c6-0e6625557ba2"}], "security_groups": [{"name": "tempest-securitygroup--1607395355"}], "key_name": "tempest-keypair-251516566", "user_data": "}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:01.489024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:02.221135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dbca2b26-018e-4f0f-a2a0-13e813f9d349 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:02.236795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dbca2b26-018e-4f0f-a2a0-13e813f9d349 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:02.241107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] validate_networks() for [('5ee66832-4e3e-4ea5-b8c6-0e6625557ba2', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:38:02.242722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dbca2b26-018e-4f0f-a2a0-13e813f9d349 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:02.247458 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dbca2b26-018e-4f0f-a2a0-13e813f9d349 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 1.199102 Jul 20 04:38:02.248850 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2733/5557] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:01 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:03.275125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cf5f4df4-e5c8-4a56-90b7-00f89cd381fc tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:03.275886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cf5f4df4-e5c8-4a56-90b7-00f89cd381fc tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:03.313836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf5f4df4-e5c8-4a56-90b7-00f89cd381fc tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.314306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf5f4df4-e5c8-4a56-90b7-00f89cd381fc tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.329318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf5f4df4-e5c8-4a56-90b7-00f89cd381fc tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.329318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf5f4df4-e5c8-4a56-90b7-00f89cd381fc tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.836800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf5f4df4-e5c8-4a56-90b7-00f89cd381fc tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:03.849916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf5f4df4-e5c8-4a56-90b7-00f89cd381fc tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:03.855069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf5f4df4-e5c8-4a56-90b7-00f89cd381fc tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:03.859495 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cf5f4df4-e5c8-4a56-90b7-00f89cd381fc tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 0.589182 Jul 20 04:38:03.871998 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2734/5558] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:03 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:03.911309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:38:03.913423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:38:03.914116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:38:03.919195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:38:03.919924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:38:03.966620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.968370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.970205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.971784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.999455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:04.011674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for user 8759015052b64df2b36efb694b837999 and project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:04.052366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:38:04.056553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:38:04.183923 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a7d70d00-2ff7-4b08-a057-1facb90db9ad tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.728581 Jul 20 04:38:04.192536 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2825/5559] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 2737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:38:04.197149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-48172411-5058-467a-8a2d-a8e533086fdb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:04.197860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-48172411-5058-467a-8a2d-a8e533086fdb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:04.466257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-48172411-5058-467a-8a2d-a8e533086fdb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:04.503676 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-48172411-5058-467a-8a2d-a8e533086fdb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1240 microversion: 2.1 time: 0.287053 Jul 20 04:38:04.520104 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2735/5560] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:04 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1240 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:04.880027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f4832b8d-f9ab-4c2c-b026-924b536f4462 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:04.881474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f4832b8d-f9ab-4c2c-b026-924b536f4462 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:04.892093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4832b8d-f9ab-4c2c-b026-924b536f4462 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:04.901478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4832b8d-f9ab-4c2c-b026-924b536f4462 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:04.902624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4832b8d-f9ab-4c2c-b026-924b536f4462 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:04.903236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4832b8d-f9ab-4c2c-b026-924b536f4462 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.255786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f4832b8d-f9ab-4c2c-b026-924b536f4462 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:05.273197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f4832b8d-f9ab-4c2c-b026-924b536f4462 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:05.286216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f4832b8d-f9ab-4c2c-b026-924b536f4462 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:05.295694 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f4832b8d-f9ab-4c2c-b026-924b536f4462 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1738 microversion: 2.20 time: 0.418596 Jul 20 04:38:05.298536 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2826/5561] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:04 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1738 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:05.523736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-21f2db30-92e9-4ca3-a53a-8baca8e82dcc tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:05.524483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-21f2db30-92e9-4ca3-a53a-8baca8e82dcc tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:05.533154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21f2db30-92e9-4ca3-a53a-8baca8e82dcc tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.533889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21f2db30-92e9-4ca3-a53a-8baca8e82dcc tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.534962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21f2db30-92e9-4ca3-a53a-8baca8e82dcc tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.535927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21f2db30-92e9-4ca3-a53a-8baca8e82dcc tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.727583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-21f2db30-92e9-4ca3-a53a-8baca8e82dcc tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:05.735650 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-21f2db30-92e9-4ca3-a53a-8baca8e82dcc tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1292 microversion: 2.1 time: 0.218875 Jul 20 04:38:05.749626 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2736/5562] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:05 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1292 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:06.314392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2db6c0cd-78da-4e13-bd1d-18cf2f255277 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:06.315358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2db6c0cd-78da-4e13-bd1d-18cf2f255277 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:06.331667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2db6c0cd-78da-4e13-bd1d-18cf2f255277 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.332686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2db6c0cd-78da-4e13-bd1d-18cf2f255277 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.334302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2db6c0cd-78da-4e13-bd1d-18cf2f255277 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.336467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2db6c0cd-78da-4e13-bd1d-18cf2f255277 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.721953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2db6c0cd-78da-4e13-bd1d-18cf2f255277 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:06.731024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2db6c0cd-78da-4e13-bd1d-18cf2f255277 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:06.732866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2db6c0cd-78da-4e13-bd1d-18cf2f255277 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:06.734276 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2db6c0cd-78da-4e13-bd1d-18cf2f255277 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1720 microversion: 2.20 time: 0.423924 Jul 20 04:38:06.746379 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2827/5563] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:06 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1720 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:06.767144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0968895-6271-4508-be15-27ca6c19ba96 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:06.768223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e0968895-6271-4508-be15-27ca6c19ba96 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:06.784228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0968895-6271-4508-be15-27ca6c19ba96 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.785490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0968895-6271-4508-be15-27ca6c19ba96 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.786399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0968895-6271-4508-be15-27ca6c19ba96 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.786974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0968895-6271-4508-be15-27ca6c19ba96 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.030626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e0968895-6271-4508-be15-27ca6c19ba96 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:07.045167 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e0968895-6271-4508-be15-27ca6c19ba96 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1298 microversion: 2.1 time: 0.291297 Jul 20 04:38:07.045792 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2737/5564] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:06 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1298 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:07.759587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a963af83-696a-454a-9f9a-1428d1468226 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:07.760623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a963af83-696a-454a-9f9a-1428d1468226 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:07.799222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a963af83-696a-454a-9f9a-1428d1468226 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.801483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a963af83-696a-454a-9f9a-1428d1468226 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.804558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a963af83-696a-454a-9f9a-1428d1468226 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.811146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a963af83-696a-454a-9f9a-1428d1468226 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.065386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-66e6679d-af62-4b6d-bb76-ec100e482c4f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:08.065848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-66e6679d-af62-4b6d-bb76-ec100e482c4f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:08.082351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66e6679d-af62-4b6d-bb76-ec100e482c4f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.085175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66e6679d-af62-4b6d-bb76-ec100e482c4f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.086413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66e6679d-af62-4b6d-bb76-ec100e482c4f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.087820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-66e6679d-af62-4b6d-bb76-ec100e482c4f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.681580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-66e6679d-af62-4b6d-bb76-ec100e482c4f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:08.708301 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-66e6679d-af62-4b6d-bb76-ec100e482c4f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1298 microversion: 2.1 time: 0.647518 Jul 20 04:38:08.710737 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2738/5565] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:08 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1298 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:09.498338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a963af83-696a-454a-9f9a-1428d1468226 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:09.516003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a963af83-696a-454a-9f9a-1428d1468226 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:09.527605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a963af83-696a-454a-9f9a-1428d1468226 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:09.529058 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a963af83-696a-454a-9f9a-1428d1468226 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1720 microversion: 2.20 time: 1.777169 Jul 20 04:38:09.530390 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2828/5566] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:07 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1720 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:09.727206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-652ddf8f-9307-4f03-b735-64202c413c38 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:09.727947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-652ddf8f-9307-4f03-b735-64202c413c38 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:09.766473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=26 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:09.773487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-652ddf8f-9307-4f03-b735-64202c413c38 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.775603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-652ddf8f-9307-4f03-b735-64202c413c38 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.778116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-652ddf8f-9307-4f03-b735-64202c413c38 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.778723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-652ddf8f-9307-4f03-b735-64202c413c38 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.549284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c05d85c2-af8f-4e89-93b0-a46137162f13 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:10.550033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c05d85c2-af8f-4e89-93b0-a46137162f13 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:10.567798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c05d85c2-af8f-4e89-93b0-a46137162f13 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.569014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c05d85c2-af8f-4e89-93b0-a46137162f13 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.570191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c05d85c2-af8f-4e89-93b0-a46137162f13 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.570790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c05d85c2-af8f-4e89-93b0-a46137162f13 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.841558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-652ddf8f-9307-4f03-b735-64202c413c38 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:10.865967 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-652ddf8f-9307-4f03-b735-64202c413c38 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1366 microversion: 2.1 time: 1.143677 Jul 20 04:38:10.867579 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2739/5567] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:09 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1366 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:11.159534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1a89f4e4-8c23-4297-8222-f473c1d8458f req-3989c452-9ee1-44e9-933f-6ffecf3c55a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc74de-e748-4cab-838f-ea4b62c35ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "73105a65-3425-4751-af47-f418c2e5049c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:11.177932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1a89f4e4-8c23-4297-8222-f473c1d8458f req-3989c452-9ee1-44e9-933f-6ffecf3c55a7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.178469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1a89f4e4-8c23-4297-8222-f473c1d8458f req-3989c452-9ee1-44e9-933f-6ffecf3c55a7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.203195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.compute.server_external_events [req-1a89f4e4-8c23-4297-8222-f473c1d8458f req-3989c452-9ee1-44e9-933f-6ffecf3c55a7 service nova] Unable to find a host for instance 65fc74de-e748-4cab-838f-ea4b62c35ab5. Dropping event network-vif-unplugged {{(pid=119807) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:38:11.207296 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1a89f4e4-8c23-4297-8222-f473c1d8458f req-3989c452-9ee1-44e9-933f-6ffecf3c55a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051903 Jul 20 04:38:11.208537 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2740/5568] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 04:38:11.292282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c05d85c2-af8f-4e89-93b0-a46137162f13 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:11.304428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c05d85c2-af8f-4e89-93b0-a46137162f13 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:11.308385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c05d85c2-af8f-4e89-93b0-a46137162f13 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:11.310868 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c05d85c2-af8f-4e89-93b0-a46137162f13 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1663 microversion: 2.20 time: 0.766435 Jul 20 04:38:11.314011 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2829/5569] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:10 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1663 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:11.335748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fb7db8ee-ef52-42fe-8548-d6981c96bb49 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "643b63eb-9816-4eb9-aadd-5e1aac157d07"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:11.336826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fb7db8ee-ef52-42fe-8548-d6981c96bb49 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:11.345622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb7db8ee-ef52-42fe-8548-d6981c96bb49 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.346088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb7db8ee-ef52-42fe-8548-d6981c96bb49 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.346907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb7db8ee-ef52-42fe-8548-d6981c96bb49 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.347396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb7db8ee-ef52-42fe-8548-d6981c96bb49 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.885419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ea3f4c75-2ba5-4ea7-922b-ea7d5f76940a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:11.886098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ea3f4c75-2ba5-4ea7-922b-ea7d5f76940a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:11.914786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea3f4c75-2ba5-4ea7-922b-ea7d5f76940a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.915573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea3f4c75-2ba5-4ea7-922b-ea7d5f76940a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.916677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea3f4c75-2ba5-4ea7-922b-ea7d5f76940a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.920184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea3f4c75-2ba5-4ea7-922b-ea7d5f76940a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.019939 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fb7db8ee-ef52-42fe-8548-d6981c96bb49 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "POST /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.688715 Jul 20 04:38:12.021735 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2741/5570] 10.222.0.20 () {62 vars in 1363 bytes} [Wed Jul 20 04:38:11 2022] POST /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/os-volume_attachments => generated 188 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:38:12.341261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9aa052de-bbed-4db0-a18d-f7dc948a2c0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:12.342125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9aa052de-bbed-4db0-a18d-f7dc948a2c0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:12.372358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9aa052de-bbed-4db0-a18d-f7dc948a2c0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.374663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9aa052de-bbed-4db0-a18d-f7dc948a2c0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.375773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9aa052de-bbed-4db0-a18d-f7dc948a2c0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.380790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9aa052de-bbed-4db0-a18d-f7dc948a2c0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.726742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ea3f4c75-2ba5-4ea7-922b-ea7d5f76940a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:12.741066 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ea3f4c75-2ba5-4ea7-922b-ea7d5f76940a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1366 microversion: 2.1 time: 0.861483 Jul 20 04:38:12.750266 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2830/5571] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:11 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1366 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:12.969176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-51ba9199-7b29-4a0f-b6fb-d9c1ec85ceea req-c53206ad-a98d-472c-86cb-1510c5e65361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60434b5-42e4-4695-bfdb-66aaaa6d394a", "tag": "58e6d4c6-d1bb-452d-8bc3-df51748f77ae"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:13.013094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-51ba9199-7b29-4a0f-b6fb-d9c1ec85ceea req-c53206ad-a98d-472c-86cb-1510c5e65361 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.015467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-51ba9199-7b29-4a0f-b6fb-d9c1ec85ceea req-c53206ad-a98d-472c-86cb-1510c5e65361 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.056037 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-51ba9199-7b29-4a0f-b6fb-d9c1ec85ceea req-c53206ad-a98d-472c-86cb-1510c5e65361 service nova] Creating event network-changed:58e6d4c6-d1bb-452d-8bc3-df51748f77ae for instance f60434b5-42e4-4695-bfdb-66aaaa6d394a on n-h1-764485-11 Jul 20 04:38:13.069508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:13.074382 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9aa052de-bbed-4db0-a18d-f7dc948a2c0e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/os-volume_attachments/643b63eb-9816-4eb9-aadd-5e1aac157d07" status: 202 len: 0 microversion: 2.20 time: 0.736876 Jul 20 04:38:13.075343 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-51ba9199-7b29-4a0f-b6fb-d9c1ec85ceea req-c53206ad-a98d-472c-86cb-1510c5e65361 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111488 Jul 20 04:38:13.076187 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2831/5572] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:13.078637 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2742/5573] 10.222.0.20 () {60 vars in 1456 bytes} [Wed Jul 20 04:38:12 2022] DELETE /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/os-volume_attachments/643b63eb-9816-4eb9-aadd-5e1aac157d07 => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:13.244587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8d775f71-4478-4b97-99b4-55808ca8215a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:13.245254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8d775f71-4478-4b97-99b4-55808ca8215a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:13.274781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d775f71-4478-4b97-99b4-55808ca8215a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.275238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d775f71-4478-4b97-99b4-55808ca8215a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.276063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d775f71-4478-4b97-99b4-55808ca8215a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.276514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8d775f71-4478-4b97-99b4-55808ca8215a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.560732 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8d775f71-4478-4b97-99b4-55808ca8215a tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "POST /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/action" status: 202 len: 0 microversion: 2.20 time: 0.331207 Jul 20 04:38:13.561908 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2832/5574] 10.222.0.20 () {62 vars in 1318 bytes} [Wed Jul 20 04:38:13 2022] POST /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:13.574656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dd2ac600-324a-4349-9136-33805302ea80 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:13.575282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dd2ac600-324a-4349-9136-33805302ea80 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:13.607639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd2ac600-324a-4349-9136-33805302ea80 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.611405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd2ac600-324a-4349-9136-33805302ea80 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.612558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd2ac600-324a-4349-9136-33805302ea80 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.622316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dd2ac600-324a-4349-9136-33805302ea80 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.766298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e91b3144-50dd-4e17-b0fb-a3e7f62210bd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:13.767161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e91b3144-50dd-4e17-b0fb-a3e7f62210bd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:13.776458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e91b3144-50dd-4e17-b0fb-a3e7f62210bd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.776914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e91b3144-50dd-4e17-b0fb-a3e7f62210bd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.777701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e91b3144-50dd-4e17-b0fb-a3e7f62210bd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.778145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e91b3144-50dd-4e17-b0fb-a3e7f62210bd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.984942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:14.031816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=10 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:14.477619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:15.377248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dd2ac600-324a-4349-9136-33805302ea80 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.391939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dd2ac600-324a-4349-9136-33805302ea80 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.398232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dd2ac600-324a-4349-9136-33805302ea80 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.402148 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dd2ac600-324a-4349-9136-33805302ea80 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1671 microversion: 2.20 time: 1.835735 Jul 20 04:38:15.407230 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2743/5575] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:13 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1671 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:15.444783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e91b3144-50dd-4e17-b0fb-a3e7f62210bd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.457144 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e91b3144-50dd-4e17-b0fb-a3e7f62210bd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1366 microversion: 2.1 time: 1.694628 Jul 20 04:38:15.457744 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2833/5576] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:13 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1366 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:16.425312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f06ab25-f610-419f-a7f2-f6825b169ce3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:16.426799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0f06ab25-f610-419f-a7f2-f6825b169ce3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:16.446173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f06ab25-f610-419f-a7f2-f6825b169ce3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.463320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f06ab25-f610-419f-a7f2-f6825b169ce3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.484646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0627e6af-0a43-4f86-8712-c907615c9bb1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:16.485476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0627e6af-0a43-4f86-8712-c907615c9bb1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:16.491308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f06ab25-f610-419f-a7f2-f6825b169ce3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.494866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f06ab25-f610-419f-a7f2-f6825b169ce3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.500854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0627e6af-0a43-4f86-8712-c907615c9bb1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.515450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0627e6af-0a43-4f86-8712-c907615c9bb1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.516670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0627e6af-0a43-4f86-8712-c907615c9bb1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.517761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0627e6af-0a43-4f86-8712-c907615c9bb1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.030582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0627e6af-0a43-4f86-8712-c907615c9bb1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:17.044665 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0627e6af-0a43-4f86-8712-c907615c9bb1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1366 microversion: 2.1 time: 0.572494 Jul 20 04:38:17.047494 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2834/5577] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:16 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1366 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:17.090391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0f06ab25-f610-419f-a7f2-f6825b169ce3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:17.098747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0f06ab25-f610-419f-a7f2-f6825b169ce3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:17.105131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0f06ab25-f610-419f-a7f2-f6825b169ce3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:17.106696 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f06ab25-f610-419f-a7f2-f6825b169ce3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1671 microversion: 2.20 time: 0.685456 Jul 20 04:38:17.111850 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2744/5578] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:16 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1671 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:18.069048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9eb8710c-7a7b-4bcc-aade-305364a8504c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:18.070791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9eb8710c-7a7b-4bcc-aade-305364a8504c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:18.086924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9eb8710c-7a7b-4bcc-aade-305364a8504c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.088322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9eb8710c-7a7b-4bcc-aade-305364a8504c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.089473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9eb8710c-7a7b-4bcc-aade-305364a8504c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.090149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9eb8710c-7a7b-4bcc-aade-305364a8504c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.137912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5d8b8ca9-8245-4fe0-a1c2-3159bd7f9731 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:18.139224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5d8b8ca9-8245-4fe0-a1c2-3159bd7f9731 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:18.149504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d8b8ca9-8245-4fe0-a1c2-3159bd7f9731 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.150316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d8b8ca9-8245-4fe0-a1c2-3159bd7f9731 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.151319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d8b8ca9-8245-4fe0-a1c2-3159bd7f9731 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.152014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d8b8ca9-8245-4fe0-a1c2-3159bd7f9731 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.640080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9eb8710c-7a7b-4bcc-aade-305364a8504c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:18.657252 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9eb8710c-7a7b-4bcc-aade-305364a8504c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1366 microversion: 2.1 time: 0.593879 Jul 20 04:38:18.659096 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2835/5579] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:18 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1366 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:18.733406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5d8b8ca9-8245-4fe0-a1c2-3159bd7f9731 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:18.754882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5d8b8ca9-8245-4fe0-a1c2-3159bd7f9731 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:18.765289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5d8b8ca9-8245-4fe0-a1c2-3159bd7f9731 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:18.770063 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5d8b8ca9-8245-4fe0-a1c2-3159bd7f9731 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 0.642895 Jul 20 04:38:18.782390 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2745/5580] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:18 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:38:19.676549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0a46812-7c94-4d69-bcc2-da34761b6fe1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:19.677865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b0a46812-7c94-4d69-bcc2-da34761b6fe1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:19.695302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0a46812-7c94-4d69-bcc2-da34761b6fe1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:19.699026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0a46812-7c94-4d69-bcc2-da34761b6fe1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:19.701755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0a46812-7c94-4d69-bcc2-da34761b6fe1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:19.702383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0a46812-7c94-4d69-bcc2-da34761b6fe1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:19.802619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1e03794f-b444-4da1-ba09-47423f15a7fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:19.803363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1e03794f-b444-4da1-ba09-47423f15a7fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:19.825653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e03794f-b444-4da1-ba09-47423f15a7fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:19.826115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e03794f-b444-4da1-ba09-47423f15a7fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:19.836529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e03794f-b444-4da1-ba09-47423f15a7fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:19.841700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1e03794f-b444-4da1-ba09-47423f15a7fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:21.534959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b0a46812-7c94-4d69-bcc2-da34761b6fe1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:21.544156 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b0a46812-7c94-4d69-bcc2-da34761b6fe1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1366 microversion: 2.1 time: 1.871779 Jul 20 04:38:21.547963 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2836/5581] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:19 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1366 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:21.644820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1e03794f-b444-4da1-ba09-47423f15a7fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:21.664068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1e03794f-b444-4da1-ba09-47423f15a7fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:21.670366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1e03794f-b444-4da1-ba09-47423f15a7fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:21.675930 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1e03794f-b444-4da1-ba09-47423f15a7fa tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 1.878083 Jul 20 04:38:21.688166 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2746/5582] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:19 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:21.970162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-dd66db5f-56f7-4aac-8d39-d3a649ab7e2f req-25fee4b8-f51b-484a-9f73-bad83b11f389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60434b5-42e4-4695-bfdb-66aaaa6d394a", "name": "network-vif-plugged", "status": "completed", "tag": "58e6d4c6-d1bb-452d-8bc3-df51748f77ae"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:21.999608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dd66db5f-56f7-4aac-8d39-d3a649ab7e2f req-25fee4b8-f51b-484a-9f73-bad83b11f389 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.000066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dd66db5f-56f7-4aac-8d39-d3a649ab7e2f req-25fee4b8-f51b-484a-9f73-bad83b11f389 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.052718 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-dd66db5f-56f7-4aac-8d39-d3a649ab7e2f req-25fee4b8-f51b-484a-9f73-bad83b11f389 service nova] Creating event network-vif-plugged:58e6d4c6-d1bb-452d-8bc3-df51748f77ae for instance f60434b5-42e4-4695-bfdb-66aaaa6d394a on n-h1-764485-11 Jul 20 04:38:22.062630 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-dd66db5f-56f7-4aac-8d39-d3a649ab7e2f req-25fee4b8-f51b-484a-9f73-bad83b11f389 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096135 Jul 20 04:38:22.088990 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2837/5583] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:38:22.572774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f011bbc4-db0e-4a9e-8aff-cc69d2dbe6e7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:22.573815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f011bbc4-db0e-4a9e-8aff-cc69d2dbe6e7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:22.615901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f011bbc4-db0e-4a9e-8aff-cc69d2dbe6e7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.616747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f011bbc4-db0e-4a9e-8aff-cc69d2dbe6e7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.619977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f011bbc4-db0e-4a9e-8aff-cc69d2dbe6e7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.622065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f011bbc4-db0e-4a9e-8aff-cc69d2dbe6e7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.696543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-64851da4-3d24-4b0c-bbb2-a9bb7a819619 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:22.697416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-64851da4-3d24-4b0c-bbb2-a9bb7a819619 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:22.720724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64851da4-3d24-4b0c-bbb2-a9bb7a819619 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.721436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64851da4-3d24-4b0c-bbb2-a9bb7a819619 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.722381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64851da4-3d24-4b0c-bbb2-a9bb7a819619 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.723030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64851da4-3d24-4b0c-bbb2-a9bb7a819619 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:23.518226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f011bbc4-db0e-4a9e-8aff-cc69d2dbe6e7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:23.529747 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f011bbc4-db0e-4a9e-8aff-cc69d2dbe6e7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1366 microversion: 2.1 time: 0.967976 Jul 20 04:38:23.539537 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2747/5584] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:22 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1366 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:24.355292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-64851da4-3d24-4b0c-bbb2-a9bb7a819619 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:24.385341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-64851da4-3d24-4b0c-bbb2-a9bb7a819619 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:24.401877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-64851da4-3d24-4b0c-bbb2-a9bb7a819619 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:24.403231 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-64851da4-3d24-4b0c-bbb2-a9bb7a819619 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 1.712409 Jul 20 04:38:24.406580 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2838/5585] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:22 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:24.556993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e291151e-d9fd-449b-8439-6ff900db175b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:24.557607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e291151e-d9fd-449b-8439-6ff900db175b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:24.570817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e291151e-d9fd-449b-8439-6ff900db175b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:24.571275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e291151e-d9fd-449b-8439-6ff900db175b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:24.581434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e291151e-d9fd-449b-8439-6ff900db175b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:24.583461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e291151e-d9fd-449b-8439-6ff900db175b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:25.320056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e291151e-d9fd-449b-8439-6ff900db175b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:25.329782 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e291151e-d9fd-449b-8439-6ff900db175b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1556 microversion: 2.1 time: 0.776764 Jul 20 04:38:25.346103 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2748/5586] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:24 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1556 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:25.352385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-27cb3623-cd0a-411d-b8fc-7b86ba3d1118 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:25.357127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-27cb3623-cd0a-411d-b8fc-7b86ba3d1118 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:25.389038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27cb3623-cd0a-411d-b8fc-7b86ba3d1118 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:25.391807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27cb3623-cd0a-411d-b8fc-7b86ba3d1118 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:25.394714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27cb3623-cd0a-411d-b8fc-7b86ba3d1118 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:25.395200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-27cb3623-cd0a-411d-b8fc-7b86ba3d1118 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:25.428041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8a1bdade-9cde-43e7-afdc-3c02c66c7057 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:25.430120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8a1bdade-9cde-43e7-afdc-3c02c66c7057 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:25.449501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a1bdade-9cde-43e7-afdc-3c02c66c7057 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:25.450205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a1bdade-9cde-43e7-afdc-3c02c66c7057 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:25.451172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a1bdade-9cde-43e7-afdc-3c02c66c7057 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:25.453833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a1bdade-9cde-43e7-afdc-3c02c66c7057 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:25.758249 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-27cb3623-cd0a-411d-b8fc-7b86ba3d1118 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.410655 Jul 20 04:38:25.759501 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2839/5587] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:38:25 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-interface => generated 285 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:26.585383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8a1bdade-9cde-43e7-afdc-3c02c66c7057 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:26.597622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8a1bdade-9cde-43e7-afdc-3c02c66c7057 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:26.611468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8a1bdade-9cde-43e7-afdc-3c02c66c7057 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:26.616579 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8a1bdade-9cde-43e7-afdc-3c02c66c7057 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 1.190242 Jul 20 04:38:26.618161 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2749/5588] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:25 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:38:27.644446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b6177bc-6319-4f37-bd9d-814a892f58f9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:27.645078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5b6177bc-6319-4f37-bd9d-814a892f58f9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:27.668481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b6177bc-6319-4f37-bd9d-814a892f58f9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:27.671434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b6177bc-6319-4f37-bd9d-814a892f58f9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:27.682062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b6177bc-6319-4f37-bd9d-814a892f58f9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:27.682762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b6177bc-6319-4f37-bd9d-814a892f58f9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:30.452183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b6177bc-6319-4f37-bd9d-814a892f58f9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:30.481036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b6177bc-6319-4f37-bd9d-814a892f58f9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:30.482588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b6177bc-6319-4f37-bd9d-814a892f58f9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:30.500211 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5b6177bc-6319-4f37-bd9d-814a892f58f9 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 2.845440 Jul 20 04:38:30.511881 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2840/5589] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:27 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 2874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:31.518426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-64d3b049-4a2d-49ea-9da4-b9daaa07750c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:31.519952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-64d3b049-4a2d-49ea-9da4-b9daaa07750c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:31.535004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64d3b049-4a2d-49ea-9da4-b9daaa07750c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:31.541164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64d3b049-4a2d-49ea-9da4-b9daaa07750c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:31.544852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64d3b049-4a2d-49ea-9da4-b9daaa07750c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:31.545509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64d3b049-4a2d-49ea-9da4-b9daaa07750c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:32.772225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-64d3b049-4a2d-49ea-9da4-b9daaa07750c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:32.791998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-64d3b049-4a2d-49ea-9da4-b9daaa07750c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:32.794648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-64d3b049-4a2d-49ea-9da4-b9daaa07750c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:32.796628 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-64d3b049-4a2d-49ea-9da4-b9daaa07750c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 1.282480 Jul 20 04:38:32.797878 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2750/5590] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:31 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:33.815626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4b351bb8-a95b-4995-8daa-a5ac3a059dab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:33.816834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4b351bb8-a95b-4995-8daa-a5ac3a059dab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:33.826822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:33.830343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b351bb8-a95b-4995-8daa-a5ac3a059dab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:33.830998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b351bb8-a95b-4995-8daa-a5ac3a059dab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:33.832312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b351bb8-a95b-4995-8daa-a5ac3a059dab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:33.833871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b351bb8-a95b-4995-8daa-a5ac3a059dab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:33.923736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:35.556183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-24c2d890-90be-4016-bafa-ac75bff52080 req-b6071913-2eb8-464b-9085-e91e2d5c99df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60434b5-42e4-4695-bfdb-66aaaa6d394a", "tag": "58e6d4c6-d1bb-452d-8bc3-df51748f77ae"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:35.565011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4b351bb8-a95b-4995-8daa-a5ac3a059dab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:35.570659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-24c2d890-90be-4016-bafa-ac75bff52080 req-b6071913-2eb8-464b-9085-e91e2d5c99df service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:35.574595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-24c2d890-90be-4016-bafa-ac75bff52080 req-b6071913-2eb8-464b-9085-e91e2d5c99df service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:35.580791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4b351bb8-a95b-4995-8daa-a5ac3a059dab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:35.582821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4b351bb8-a95b-4995-8daa-a5ac3a059dab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:35.584464 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4b351bb8-a95b-4995-8daa-a5ac3a059dab tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 1.773340 Jul 20 04:38:35.596043 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2841/5591] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:33 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:35.599901 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-24c2d890-90be-4016-bafa-ac75bff52080 req-b6071913-2eb8-464b-9085-e91e2d5c99df service nova] Creating event network-changed:58e6d4c6-d1bb-452d-8bc3-df51748f77ae for instance f60434b5-42e4-4695-bfdb-66aaaa6d394a on n-h1-764485-11 Jul 20 04:38:35.617159 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-24c2d890-90be-4016-bafa-ac75bff52080 req-b6071913-2eb8-464b-9085-e91e2d5c99df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065172 Jul 20 04:38:35.619760 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2751/5592] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:38:36.605597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-11f857b9-0ff9-4896-b8c9-5ff7accc5dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:36.607183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-11f857b9-0ff9-4896-b8c9-5ff7accc5dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:36.627500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11f857b9-0ff9-4896-b8c9-5ff7accc5dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:36.631660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11f857b9-0ff9-4896-b8c9-5ff7accc5dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:36.632983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11f857b9-0ff9-4896-b8c9-5ff7accc5dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:36.633568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11f857b9-0ff9-4896-b8c9-5ff7accc5dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:36.776794 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:38:36.777384 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 04:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:38:37.367220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-11f857b9-0ff9-4896-b8c9-5ff7accc5dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:37.414974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-11f857b9-0ff9-4896-b8c9-5ff7accc5dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:37.418409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-11f857b9-0ff9-4896-b8c9-5ff7accc5dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:37.438740 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-11f857b9-0ff9-4896-b8c9-5ff7accc5dbf tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 0.837826 Jul 20 04:38:37.441157 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2842/5593] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:36 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:38.460595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8770d59d-77b5-4ca5-95ee-b1907dd961e4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:38.461995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8770d59d-77b5-4ca5-95ee-b1907dd961e4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:38.482636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8770d59d-77b5-4ca5-95ee-b1907dd961e4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:38.483139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8770d59d-77b5-4ca5-95ee-b1907dd961e4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:38.484031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8770d59d-77b5-4ca5-95ee-b1907dd961e4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:38.484742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8770d59d-77b5-4ca5-95ee-b1907dd961e4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:39.220331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8770d59d-77b5-4ca5-95ee-b1907dd961e4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:39.234191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8770d59d-77b5-4ca5-95ee-b1907dd961e4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:39.245167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8770d59d-77b5-4ca5-95ee-b1907dd961e4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:39.249944 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8770d59d-77b5-4ca5-95ee-b1907dd961e4 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 0.795923 Jul 20 04:38:39.262809 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2752/5594] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:38 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:40.272504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9a896336-e032-4129-bbf0-24170c00dc7c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:40.273323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9a896336-e032-4129-bbf0-24170c00dc7c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:40.295590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a896336-e032-4129-bbf0-24170c00dc7c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:40.298683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a896336-e032-4129-bbf0-24170c00dc7c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:40.302690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a896336-e032-4129-bbf0-24170c00dc7c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:40.306711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a896336-e032-4129-bbf0-24170c00dc7c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:41.200959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9a896336-e032-4129-bbf0-24170c00dc7c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:41.213996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9a896336-e032-4129-bbf0-24170c00dc7c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:41.217986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9a896336-e032-4129-bbf0-24170c00dc7c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:41.219240 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9a896336-e032-4129-bbf0-24170c00dc7c tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 0.953135 Jul 20 04:38:41.219874 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2843/5595] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:40 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:42.240655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-88002408-42d0-4d1a-a206-9483db7e61c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:42.241843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-88002408-42d0-4d1a-a206-9483db7e61c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:42.253611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=28 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:42.256537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88002408-42d0-4d1a-a206-9483db7e61c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:42.258997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88002408-42d0-4d1a-a206-9483db7e61c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:42.260430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88002408-42d0-4d1a-a206-9483db7e61c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:42.260890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88002408-42d0-4d1a-a206-9483db7e61c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:43.053057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-88002408-42d0-4d1a-a206-9483db7e61c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:43.062553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-88002408-42d0-4d1a-a206-9483db7e61c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:43.068613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-88002408-42d0-4d1a-a206-9483db7e61c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:43.069850 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-88002408-42d0-4d1a-a206-9483db7e61c2 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 0.836012 Jul 20 04:38:43.070437 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2753/5596] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:42 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:44.092182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e2cd284e-dba5-4203-9a44-75b5f6a3968e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:44.092808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e2cd284e-dba5-4203-9a44-75b5f6a3968e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:44.105980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2cd284e-dba5-4203-9a44-75b5f6a3968e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:44.106711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2cd284e-dba5-4203-9a44-75b5f6a3968e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:44.108591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2cd284e-dba5-4203-9a44-75b5f6a3968e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:44.120323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2cd284e-dba5-4203-9a44-75b5f6a3968e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:44.797079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e2cd284e-dba5-4203-9a44-75b5f6a3968e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:44.816463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e2cd284e-dba5-4203-9a44-75b5f6a3968e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:44.825712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e2cd284e-dba5-4203-9a44-75b5f6a3968e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:44.832355 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e2cd284e-dba5-4203-9a44-75b5f6a3968e tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 0.739205 Jul 20 04:38:44.844638 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2844/5597] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:44 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:45.853992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-54fb1685-c846-451f-a189-eca11fd345d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:45.854605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-54fb1685-c846-451f-a189-eca11fd345d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:45.867459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54fb1685-c846-451f-a189-eca11fd345d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:45.868167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54fb1685-c846-451f-a189-eca11fd345d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:45.872222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54fb1685-c846-451f-a189-eca11fd345d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:45.873213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54fb1685-c846-451f-a189-eca11fd345d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:45.934382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=63 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:46.592988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9c03b5f4-e1a2-45e8-be55-6f9fb29ec0f6 req-a03f00b7-7c39-4719-af41-83dc9baa5805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc74de-e748-4cab-838f-ea4b62c35ab5", "name": "network-vif-plugged", "status": "completed", "tag": "73105a65-3425-4751-af47-f418c2e5049c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:46.627495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9c03b5f4-e1a2-45e8-be55-6f9fb29ec0f6 req-a03f00b7-7c39-4719-af41-83dc9baa5805 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:46.633834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9c03b5f4-e1a2-45e8-be55-6f9fb29ec0f6 req-a03f00b7-7c39-4719-af41-83dc9baa5805 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.679306 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9c03b5f4-e1a2-45e8-be55-6f9fb29ec0f6 req-a03f00b7-7c39-4719-af41-83dc9baa5805 service nova] Creating event network-vif-plugged:73105a65-3425-4751-af47-f418c2e5049c for instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 on n-h2-764485-11 Jul 20 04:38:46.695460 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9c03b5f4-e1a2-45e8-be55-6f9fb29ec0f6 req-a03f00b7-7c39-4719-af41-83dc9baa5805 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108930 Jul 20 04:38:46.696685 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2845/5598] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:46.924742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-54fb1685-c846-451f-a189-eca11fd345d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:46.930613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-54fb1685-c846-451f-a189-eca11fd345d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:46.945162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-54fb1685-c846-451f-a189-eca11fd345d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:46.946574 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-54fb1685-c846-451f-a189-eca11fd345d7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 1.099051 Jul 20 04:38:46.947286 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2754/5599] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:45 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:38:47.966030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-706e5d2f-d34d-428c-a7f2-ff9958f5096d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:47.966666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-706e5d2f-d34d-428c-a7f2-ff9958f5096d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:47.991365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-706e5d2f-d34d-428c-a7f2-ff9958f5096d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:47.991957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-706e5d2f-d34d-428c-a7f2-ff9958f5096d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:47.992810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-706e5d2f-d34d-428c-a7f2-ff9958f5096d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:47.993270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-706e5d2f-d34d-428c-a7f2-ff9958f5096d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.581032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-706e5d2f-d34d-428c-a7f2-ff9958f5096d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.586735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-706e5d2f-d34d-428c-a7f2-ff9958f5096d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.588294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-706e5d2f-d34d-428c-a7f2-ff9958f5096d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.589481 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-706e5d2f-d34d-428c-a7f2-ff9958f5096d tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 0.628469 Jul 20 04:38:48.598251 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2846/5600] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:47 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:49.619887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eb85f2ca-896d-4e90-959f-59046cc884d3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:49.620519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eb85f2ca-896d-4e90-959f-59046cc884d3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:49.637290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb85f2ca-896d-4e90-959f-59046cc884d3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.637889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb85f2ca-896d-4e90-959f-59046cc884d3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.638737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb85f2ca-896d-4e90-959f-59046cc884d3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.641338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb85f2ca-896d-4e90-959f-59046cc884d3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.333293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eb85f2ca-896d-4e90-959f-59046cc884d3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:50.354119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eb85f2ca-896d-4e90-959f-59046cc884d3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:50.356800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eb85f2ca-896d-4e90-959f-59046cc884d3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:50.358042 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eb85f2ca-896d-4e90-959f-59046cc884d3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1729 microversion: 2.20 time: 0.745574 Jul 20 04:38:50.362702 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2755/5601] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:49 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1729 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:51.380372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b59f06f4-ca42-4131-8b3f-2fbd524fe4a3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:51.381630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b59f06f4-ca42-4131-8b3f-2fbd524fe4a3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:51.395752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b59f06f4-ca42-4131-8b3f-2fbd524fe4a3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.396458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b59f06f4-ca42-4131-8b3f-2fbd524fe4a3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:51.397448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b59f06f4-ca42-4131-8b3f-2fbd524fe4a3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.398037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b59f06f4-ca42-4131-8b3f-2fbd524fe4a3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:52.139479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b59f06f4-ca42-4131-8b3f-2fbd524fe4a3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:52.153664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b59f06f4-ca42-4131-8b3f-2fbd524fe4a3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:52.158103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b59f06f4-ca42-4131-8b3f-2fbd524fe4a3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:52.162498 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b59f06f4-ca42-4131-8b3f-2fbd524fe4a3 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1716 microversion: 2.20 time: 0.786836 Jul 20 04:38:52.165057 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2847/5602] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:51 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1716 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:47.565847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-05e43fc0-cdc4-4072-8582-3f5b2ff12282 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:47.567691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-05e43fc0-cdc4-4072-8582-3f5b2ff12282 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:47.578491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=5 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:47.579608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=11 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:47.586291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05e43fc0-cdc4-4072-8582-3f5b2ff12282 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.586766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05e43fc0-cdc4-4072-8582-3f5b2ff12282 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.587638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05e43fc0-cdc4-4072-8582-3f5b2ff12282 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.594992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05e43fc0-cdc4-4072-8582-3f5b2ff12282 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.682146 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-05e43fc0-cdc4-4072-8582-3f5b2ff12282 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.121151 Jul 20 04:39:47.686032 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2756/5603] 10.222.0.20 () {60 vars in 1342 bytes} [Wed Jul 20 04:39:47 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:47.808765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-96f10469-9fcd-4555-93e0-0ae62b4ac437 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:47.809392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-96f10469-9fcd-4555-93e0-0ae62b4ac437 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:47.820515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=13 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:47.823393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=37 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:47.831027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96f10469-9fcd-4555-93e0-0ae62b4ac437 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.831760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96f10469-9fcd-4555-93e0-0ae62b4ac437 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.832583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96f10469-9fcd-4555-93e0-0ae62b4ac437 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.833654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96f10469-9fcd-4555-93e0-0ae62b4ac437 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.956490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-96f10469-9fcd-4555-93e0-0ae62b4ac437 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:39:48.042945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc2ae634-66cf-4364-bc53-895268f5f880 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:48.044492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc2ae634-66cf-4364-bc53-895268f5f880 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:48.062239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc2ae634-66cf-4364-bc53-895268f5f880 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.067375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc2ae634-66cf-4364-bc53-895268f5f880 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.069553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc2ae634-66cf-4364-bc53-895268f5f880 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.070760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc2ae634-66cf-4364-bc53-895268f5f880 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.180246 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc2ae634-66cf-4364-bc53-895268f5f880 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/ips" status: 200 len: 149 microversion: 2.1 time: 0.142856 Jul 20 04:39:48.183709 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2757/5604] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:39:48 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/ips => generated 149 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:39:48.298825 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-96f10469-9fcd-4555-93e0-0ae62b4ac437 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 204 len: 0 microversion: 2.20 time: 0.495280 Jul 20 04:39:48.300992 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2848/5605] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:39:47 2022] DELETE /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:39:48.309556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-04e00504-09cc-4ca7-884b-f5c69c1c73a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:48.311247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-04e00504-09cc-4ca7-884b-f5c69c1c73a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:48.329163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-04e00504-09cc-4ca7-884b-f5c69c1c73a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.332191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-04e00504-09cc-4ca7-884b-f5c69c1c73a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.354970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-04e00504-09cc-4ca7-884b-f5c69c1c73a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.359568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-04e00504-09cc-4ca7-884b-f5c69c1c73a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.214037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-04e00504-09cc-4ca7-884b-f5c69c1c73a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:49.237175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-04e00504-09cc-4ca7-884b-f5c69c1c73a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:49.237175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-04e00504-09cc-4ca7-884b-f5c69c1c73a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:49.237175 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-04e00504-09cc-4ca7-884b-f5c69c1c73a7 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1722 microversion: 2.20 time: 0.932038 Jul 20 04:39:49.259715 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2758/5606] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:48 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1722 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:50.261547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10a5c751-4e7b-4099-865d-6e918528b663 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:50.263256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-10a5c751-4e7b-4099-865d-6e918528b663 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:50.278734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10a5c751-4e7b-4099-865d-6e918528b663 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.279366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10a5c751-4e7b-4099-865d-6e918528b663 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:50.284599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10a5c751-4e7b-4099-865d-6e918528b663 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.285069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10a5c751-4e7b-4099-865d-6e918528b663 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:50.800395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10a5c751-4e7b-4099-865d-6e918528b663 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:50.812833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10a5c751-4e7b-4099-865d-6e918528b663 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:50.814456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10a5c751-4e7b-4099-865d-6e918528b663 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:50.815846 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-10a5c751-4e7b-4099-865d-6e918528b663 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1722 microversion: 2.20 time: 0.558796 Jul 20 04:39:50.827362 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2849/5607] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:50 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1722 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:51.711960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5750704-7ac0-4563-b7e8-a352ee46f802 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86983adb-4cd2-4c21-9265-9eff6833ac34"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:51.713537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c5750704-7ac0-4563-b7e8-a352ee46f802 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:51.726067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5750704-7ac0-4563-b7e8-a352ee46f802 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.729623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5750704-7ac0-4563-b7e8-a352ee46f802 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.730805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5750704-7ac0-4563-b7e8-a352ee46f802 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.735120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5750704-7ac0-4563-b7e8-a352ee46f802 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.833646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be15d356-8e37-4906-b984-83b645263718 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:51.834266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-be15d356-8e37-4906-b984-83b645263718 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:51.850816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be15d356-8e37-4906-b984-83b645263718 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.851276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be15d356-8e37-4906-b984-83b645263718 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.856691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be15d356-8e37-4906-b984-83b645263718 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.857324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be15d356-8e37-4906-b984-83b645263718 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:52.141330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-be15d356-8e37-4906-b984-83b645263718 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.164583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-be15d356-8e37-4906-b984-83b645263718 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.177267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-be15d356-8e37-4906-b984-83b645263718 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.178879 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-be15d356-8e37-4906-b984-83b645263718 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1656 microversion: 2.20 time: 0.349382 Jul 20 04:39:52.180129 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2850/5608] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:51 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1656 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:39:52.386676 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5750704-7ac0-4563-b7e8-a352ee46f802 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.662341 Jul 20 04:39:52.390756 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2759/5609] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:39:51 2022] POST /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments => generated 194 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:53.197961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6fad6071-cf11-430a-bb32-e5e5e8ff98bd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:53.199117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6fad6071-cf11-430a-bb32-e5e5e8ff98bd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:53.219098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fad6071-cf11-430a-bb32-e5e5e8ff98bd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:53.220017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fad6071-cf11-430a-bb32-e5e5e8ff98bd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:53.224558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fad6071-cf11-430a-bb32-e5e5e8ff98bd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:53.225507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6fad6071-cf11-430a-bb32-e5e5e8ff98bd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.296540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6fad6071-cf11-430a-bb32-e5e5e8ff98bd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.327836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6fad6071-cf11-430a-bb32-e5e5e8ff98bd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.329677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6fad6071-cf11-430a-bb32-e5e5e8ff98bd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.331648 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6fad6071-cf11-430a-bb32-e5e5e8ff98bd tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1656 microversion: 2.20 time: 1.137756 Jul 20 04:39:54.332242 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2851/5610] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:53 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1656 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:54.664381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0c8e46ef-b9db-4a6d-99ef-4f53636950d3 req-d5763a9c-53ef-431e-bef1-d7156134547a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc74de-e748-4cab-838f-ea4b62c35ab5", "name": "network-vif-deleted", "tag": "73105a65-3425-4751-af47-f418c2e5049c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:54.691173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0c8e46ef-b9db-4a6d-99ef-4f53636950d3 req-d5763a9c-53ef-431e-bef1-d7156134547a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:54.691694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0c8e46ef-b9db-4a6d-99ef-4f53636950d3 req-d5763a9c-53ef-431e-bef1-d7156134547a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.715449 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0c8e46ef-b9db-4a6d-99ef-4f53636950d3 req-d5763a9c-53ef-431e-bef1-d7156134547a service nova] Creating event network-vif-deleted:73105a65-3425-4751-af47-f418c2e5049c for instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 on n-h2-764485-11 Jul 20 04:39:54.737686 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0c8e46ef-b9db-4a6d-99ef-4f53636950d3 req-d5763a9c-53ef-431e-bef1-d7156134547a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076987 Jul 20 04:39:54.743860 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2760/5611] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:55.349480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:55.351179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:55.372282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.373050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.374027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.376065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.498129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.507321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.508149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lazy-loading 'fault' on Instance uuid 65fc74de-e748-4cab-838f-ea4b62c35ab5 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:39:55.638025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:55.657954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:55.665083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6e3f2f4e6d644b1d9c4743e9753aa9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c8e8abd6b465bad948f659373c920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:55.666687 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-61a52f25-eb4e-457f-a708-0b2db4f7d802 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 200 len: 1371 microversion: 2.20 time: 0.321643 Jul 20 04:39:55.675525 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2852/5612] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:55 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:56.695461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3aa6c778-3dbf-463e-ab73-d168aea29031 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:56.697050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3aa6c778-3dbf-463e-ab73-d168aea29031 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:56.725735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3aa6c778-3dbf-463e-ab73-d168aea29031 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.726564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3aa6c778-3dbf-463e-ab73-d168aea29031 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.727842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3aa6c778-3dbf-463e-ab73-d168aea29031 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.728519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3aa6c778-3dbf-463e-ab73-d168aea29031 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.772837 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-3aa6c778-3dbf-463e-ab73-d168aea29031 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] HTTP exception thrown: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3aa6c778-3dbf-463e-ab73-d168aea29031 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Request method failure captured: Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 HTTP/1.1 Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Tf08Hz7E0qdsUUy-ltOAaCAoC-03Zqy01AoNSdalpIFw7vUNfDX9pIiSWG1Hfk5MI6hBvHSODI6ruSrQLFEUyEgT3J6ZKWTXia5T7msrqdb-T0lBeQJX53qci0XKlEQ6pJAeYKUpCe0h8GHlbEALnqoHpKZll8xXc56FqmfgycYk4 Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 991c8e8abd6b465bad948f659373c920 Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/991c8e8abd6b465bad948f659373c920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/991c8e8abd6b465bad948f659373c920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_991c8e8abd6b465bad948f659373c920", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/991c8e8abd6b465bad948f659373c920"}]}] Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 991c8e8abd6b465bad948f659373c920 Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeShelveTestJSON-1492017772-project Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 6e3f2f4e6d644b1d9c4743e9753aa9d2 Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1492017772-project Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '65fc74de-e748-4cab-838f-ea4b62c35ab5'} Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:39:56.781416 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:56.786042 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:39:56.786042 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:56.786042 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:56.786042 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:56.786042 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:56.786042 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:56.786042 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:39:56.786042 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:39:56.790000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3aa6c778-3dbf-463e-ab73-d168aea29031 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Returning 404 to user: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:56.791134 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3aa6c778-3dbf-463e-ab73-d168aea29031 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 404 len: 111 microversion: 2.20 time: 0.101671 Jul 20 04:39:56.791972 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2761/5613] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:56 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:39:56.801740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9258f23a-4513-454a-8a60-f9985c8caf8b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '.version_select at 0x7fbf9c389550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:56.841833 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9258f23a-4513-454a-8a60-f9985c8caf8b tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-113094986" status: 204 len: 0 microversion: 2.20 time: 0.045184 Jul 20 04:39:56.848662 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2853/5614] 10.222.0.20 () {60 vars in 1258 bytes} [Wed Jul 20 04:39:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-113094986 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:40:03.288683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b86113bb-216a-413b-b631-d811b9e74426 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:03.289874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b86113bb-216a-413b-b631-d811b9e74426 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:03.311356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b86113bb-216a-413b-b631-d811b9e74426 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.312150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b86113bb-216a-413b-b631-d811b9e74426 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.313086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b86113bb-216a-413b-b631-d811b9e74426 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.313544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b86113bb-216a-413b-b631-d811b9e74426 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.398684 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b86113bb-216a-413b-b631-d811b9e74426 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] HTTP exception thrown: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b86113bb-216a-413b-b631-d811b9e74426 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Request method failure captured: Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 HTTP/1.1 Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Tf08Hz7E0qdsUUy-ltOAaCAoC-03Zqy01AoNSdalpIFw7vUNfDX9pIiSWG1Hfk5MI6hBvHSODI6ruSrQLFEUyEgT3J6ZKWTXia5T7msrqdb-T0lBeQJX53qci0XKlEQ6pJAeYKUpCe0h8GHlbEALnqoHpKZll8xXc56FqmfgycYk4 Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 991c8e8abd6b465bad948f659373c920 Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/991c8e8abd6b465bad948f659373c920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/991c8e8abd6b465bad948f659373c920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_991c8e8abd6b465bad948f659373c920", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/991c8e8abd6b465bad948f659373c920"}]}] Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 991c8e8abd6b465bad948f659373c920 Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeShelveTestJSON-1492017772-project Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 6e3f2f4e6d644b1d9c4743e9753aa9d2 Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1492017772-project Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '65fc74de-e748-4cab-838f-ea4b62c35ab5'} Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:03.406406 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:03.412318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:40:03.412318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:03.412318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:03.412318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:03.412318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:03.412318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:03.412318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:03.412318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:03.412318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:03.412318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:40:03.412318 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:03.419567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b86113bb-216a-413b-b631-d811b9e74426 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Returning 404 to user: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:03.420741 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b86113bb-216a-413b-b631-d811b9e74426 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 404 len: 111 microversion: 2.20 time: 0.137912 Jul 20 04:40:03.421862 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2762/5615] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:40:03 2022] DELETE /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:40:03.430449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f046b107-4c8e-4661-81f4-42fb7fba8298 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:03.431979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f046b107-4c8e-4661-81f4-42fb7fba8298 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: 65fc74de-e748-4cab-838f-ea4b62c35ab5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:03.470163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f046b107-4c8e-4661-81f4-42fb7fba8298 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.471636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f046b107-4c8e-4661-81f4-42fb7fba8298 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.474398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f046b107-4c8e-4661-81f4-42fb7fba8298 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.475445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f046b107-4c8e-4661-81f4-42fb7fba8298 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.499584 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f046b107-4c8e-4661-81f4-42fb7fba8298 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] HTTP exception thrown: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f046b107-4c8e-4661-81f4-42fb7fba8298 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Request method failure captured: Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 HTTP/1.1 Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Tf08Hz7E0qdsUUy-ltOAaCAoC-03Zqy01AoNSdalpIFw7vUNfDX9pIiSWG1Hfk5MI6hBvHSODI6ruSrQLFEUyEgT3J6ZKWTXia5T7msrqdb-T0lBeQJX53qci0XKlEQ6pJAeYKUpCe0h8GHlbEALnqoHpKZll8xXc56FqmfgycYk4 Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 991c8e8abd6b465bad948f659373c920 Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/991c8e8abd6b465bad948f659373c920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/991c8e8abd6b465bad948f659373c920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_991c8e8abd6b465bad948f659373c920", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/991c8e8abd6b465bad948f659373c920"}]}] Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 991c8e8abd6b465bad948f659373c920 Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AttachVolumeShelveTestJSON-1492017772-project Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 6e3f2f4e6d644b1d9c4743e9753aa9d2 Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1492017772-project Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '65fc74de-e748-4cab-838f-ea4b62c35ab5'} Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:40:03.503008 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:03.506576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:40:03.506576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:03.506576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:03.506576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:03.506576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:03.506576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:03.506576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. Jul 20 04:40:03.506576 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:40:03.509283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f046b107-4c8e-4661-81f4-42fb7fba8298 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Returning 404 to user: Instance 65fc74de-e748-4cab-838f-ea4b62c35ab5 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:03.510826 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f046b107-4c8e-4661-81f4-42fb7fba8298 tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5" status: 404 len: 111 microversion: 2.20 time: 0.084337 Jul 20 04:40:03.512106 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2854/5616] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:03 2022] GET /compute/v2.1/servers/65fc74de-e748-4cab-838f-ea4b62c35ab5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:40:07.210785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1063802286", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "b166a73b-b76d-4105-85ac-a3c19a1dbf41"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:07.333341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] validate_networks() for [('b166a73b-b76d-4105-85ac-a3c19a1dbf41', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:40:08.463916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:40:08.465166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:40:08.465858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:40:08.466464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:40:08.467286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:40:08.505242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.509172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.515811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.516713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.608665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Getting quotas for project 58587ea50c7440efad506682a9104ffb. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:40:08.615850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Getting quotas for user 684d9d49d9664fc5aaebb566653da6ae and project 58587ea50c7440efad506682a9104ffb. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:40:08.647611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:40:08.650263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:40:08.759555 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b25465c5-7437-461c-a264-d08e15858787 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.903343 Jul 20 04:40:08.764714 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2763/5617] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:40:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:40:08.777430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a62a09a6-201a-4bb5-b711-43a3b19d372c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:08.778232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a62a09a6-201a-4bb5-b711-43a3b19d372c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:09.758629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a62a09a6-201a-4bb5-b711-43a3b19d372c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.771021 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a62a09a6-201a-4bb5-b711-43a3b19d372c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1214 microversion: 2.1 time: 0.999618 Jul 20 04:40:09.776968 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2855/5618] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:08 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1214 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:10.797154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1c0c7e5d-d18a-470f-bb8e-07db31c24791 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:10.798668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1c0c7e5d-d18a-470f-bb8e-07db31c24791 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:10.819579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c0c7e5d-d18a-470f-bb8e-07db31c24791 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.820333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c0c7e5d-d18a-470f-bb8e-07db31c24791 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.821725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c0c7e5d-d18a-470f-bb8e-07db31c24791 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.822613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c0c7e5d-d18a-470f-bb8e-07db31c24791 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.159583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1c0c7e5d-d18a-470f-bb8e-07db31c24791 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:11.179631 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1c0c7e5d-d18a-470f-bb8e-07db31c24791 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1272 microversion: 2.1 time: 0.391646 Jul 20 04:40:11.186174 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2764/5619] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:10 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1272 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:12.024144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b8f4e538-7606-4994-88b6-0642771f7895 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: .version_select at 0x7fbf9c09f040>, body: {"keypair": {"name": "tempest-keypair-964500984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx4H3QruAwKQ94QpJpDbBJINWE4Cp2V6wNU26YE529+IR+KscM2tLbNNur6LcfZVPCorcR3gPYpnhQn7tYAy7JUzOr1oIHNY333Nn0eBK6P8hFqtVk/nB8YW5laE1NbdQ=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:12.078512 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b8f4e538-7606-4994-88b6-0642771f7895 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:40:12.098753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b8f4e538-7606-4994-88b6-0642771f7895 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for user 8759015052b64df2b36efb694b837999 and project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:40:12.160098 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b8f4e538-7606-4994-88b6-0642771f7895 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.140647 Jul 20 04:40:12.161325 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2856/5620] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:40:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:12.206125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d0b78ad3-6b7b-4cb3-acc5-bc43f91d4cd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:12.206801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d0b78ad3-6b7b-4cb3-acc5-bc43f91d4cd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:12.223963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d0b78ad3-6b7b-4cb3-acc5-bc43f91d4cd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.224404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d0b78ad3-6b7b-4cb3-acc5-bc43f91d4cd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.230052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d0b78ad3-6b7b-4cb3-acc5-bc43f91d4cd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.230525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d0b78ad3-6b7b-4cb3-acc5-bc43f91d4cd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.525816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d0b78ad3-6b7b-4cb3-acc5-bc43f91d4cd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:12.543113 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d0b78ad3-6b7b-4cb3-acc5-bc43f91d4cd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1272 microversion: 2.1 time: 0.338728 Jul 20 04:40:12.545673 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2765/5621] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:12 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:13.563084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a608df31-880b-4de1-8d59-da769a95e5eb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:13.567070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a608df31-880b-4de1-8d59-da769a95e5eb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:13.572741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:13.594187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a608df31-880b-4de1-8d59-da769a95e5eb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.596543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a608df31-880b-4de1-8d59-da769a95e5eb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:13.599829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a608df31-880b-4de1-8d59-da769a95e5eb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.600830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a608df31-880b-4de1-8d59-da769a95e5eb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:14.972318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a608df31-880b-4de1-8d59-da769a95e5eb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:14.985452 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a608df31-880b-4de1-8d59-da769a95e5eb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1314 microversion: 2.1 time: 1.426552 Jul 20 04:40:14.988287 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2857/5622] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:13 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1314 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:15.631272 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:40:15.632218 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 04:40:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:40:16.005062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2c1a329-4520-4441-9067-234c766153ce tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:16.006304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2c1a329-4520-4441-9067-234c766153ce tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:16.020218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2c1a329-4520-4441-9067-234c766153ce tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.020937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2c1a329-4520-4441-9067-234c766153ce tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.021898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2c1a329-4520-4441-9067-234c766153ce tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.022492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2c1a329-4520-4441-9067-234c766153ce tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.815636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c2c1a329-4520-4441-9067-234c766153ce tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:16.833838 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2c1a329-4520-4441-9067-234c766153ce tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1314 microversion: 2.1 time: 0.832540 Jul 20 04:40:16.842061 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2766/5623] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:16 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1314 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:17.088151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec09c924-586e-45be-80c2-f65e6ea846ef tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:17.089637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ec09c924-586e-45be-80c2-f65e6ea846ef tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:17.119586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec09c924-586e-45be-80c2-f65e6ea846ef tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.127835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec09c924-586e-45be-80c2-f65e6ea846ef tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.129199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec09c924-586e-45be-80c2-f65e6ea846ef tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.132278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec09c924-586e-45be-80c2-f65e6ea846ef tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.180442 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-ec09c924-586e-45be-80c2-f65e6ea846ef tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] HTTP exception thrown: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec09c924-586e-45be-80c2-f65e6ea846ef tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Request method failure captured: Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 HTTP/1.1 Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14Tf08Hz7E0qdsUUy-ltOAaCAoC-03Zqy01AoNSdalpIFw7vUNfDX9pIiSWG1Hfk5MI6hBvHSODI6ruSrQLFEUyEgT3J6ZKWTXia5T7msrqdb-T0lBeQJX53qci0XKlEQ6pJAeYKUpCe0h8GHlbEALnqoHpKZll8xXc56FqmfgycYk4 Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 991c8e8abd6b465bad948f659373c920 Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/991c8e8abd6b465bad948f659373c920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/991c8e8abd6b465bad948f659373c920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_991c8e8abd6b465bad948f659373c920", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/991c8e8abd6b465bad948f659373c920"}]}] Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 991c8e8abd6b465bad948f659373c920 Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AttachVolumeShelveTestJSON-1492017772-project Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 6e3f2f4e6d644b1d9c4743e9753aa9d2 Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1492017772-project Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'c76d5764-986d-4d3f-806f-1f8b1c5a73c1'} Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:17.197940 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:17.201470 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:40:17.201470 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:40:17.201470 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:17.201470 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:40:17.201470 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:17.201470 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:17.201470 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:17.201470 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:17.201470 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:17.201470 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:40:17.201470 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:40:17.209082 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:40:17.209082 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 04:40:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:40:17.210663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec09c924-586e-45be-80c2-f65e6ea846ef tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Returning 404 to user: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:17.212062 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ec09c924-586e-45be-80c2-f65e6ea846ef tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 404 len: 111 microversion: 2.20 time: 0.129537 Jul 20 04:40:17.216390 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2858/5624] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Jul 20 04:40:17 2022] DELETE /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:40:17.221663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-99fbcb53-7c44-4f60-a525-47286935b1cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:17.222285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-99fbcb53-7c44-4f60-a525-47286935b1cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] [instance: c76d5764-986d-4d3f-806f-1f8b1c5a73c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:17.241543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99fbcb53-7c44-4f60-a525-47286935b1cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.242004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99fbcb53-7c44-4f60-a525-47286935b1cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.242805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99fbcb53-7c44-4f60-a525-47286935b1cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.243836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99fbcb53-7c44-4f60-a525-47286935b1cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.271344 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-99fbcb53-7c44-4f60-a525-47286935b1cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] HTTP exception thrown: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-99fbcb53-7c44-4f60-a525-47286935b1cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Request method failure captured: Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 HTTP/1.1 Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14Tf08Hz7E0qdsUUy-ltOAaCAoC-03Zqy01AoNSdalpIFw7vUNfDX9pIiSWG1Hfk5MI6hBvHSODI6ruSrQLFEUyEgT3J6ZKWTXia5T7msrqdb-T0lBeQJX53qci0XKlEQ6pJAeYKUpCe0h8GHlbEALnqoHpKZll8xXc56FqmfgycYk4 Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 991c8e8abd6b465bad948f659373c920 Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/991c8e8abd6b465bad948f659373c920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/991c8e8abd6b465bad948f659373c920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_991c8e8abd6b465bad948f659373c920", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/991c8e8abd6b465bad948f659373c920"}]}] Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 991c8e8abd6b465bad948f659373c920 Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1492017772 Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeShelveTestJSON-1492017772-project Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 6e3f2f4e6d644b1d9c4743e9753aa9d2 Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1492017772-project Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'c76d5764-986d-4d3f-806f-1f8b1c5a73c1'} Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:17.294867 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:17.299460 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:17.299460 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:17.299460 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:17.299460 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:17.299460 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:17.299460 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:17.299460 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. Jul 20 04:40:17.299460 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:17.301403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-99fbcb53-7c44-4f60-a525-47286935b1cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] Returning 404 to user: Instance c76d5764-986d-4d3f-806f-1f8b1c5a73c1 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:17.302756 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-99fbcb53-7c44-4f60-a525-47286935b1cb tempest-AttachVolumeShelveTestJSON-1492017772 tempest-AttachVolumeShelveTestJSON-1492017772-project] 10.222.0.20 "GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1" status: 404 len: 111 microversion: 2.20 time: 0.085351 Jul 20 04:40:17.305171 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2767/5625] 10.222.0.20 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:17 2022] GET /compute/v2.1/servers/c76d5764-986d-4d3f-806f-1f8b1c5a73c1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:40:17.517973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-66aace50-8227-4c5c-b828-a4838d1b9b2e req-5c3480e8-131e-4d31-bf63-1244d130fad3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab65189-b377-470a-ad31-fe77609157c9", "tag": "2314c637-9bde-47be-ac0c-ff03de353eb6"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:17.541016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-66aace50-8227-4c5c-b828-a4838d1b9b2e req-5c3480e8-131e-4d31-bf63-1244d130fad3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.541829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-66aace50-8227-4c5c-b828-a4838d1b9b2e req-5c3480e8-131e-4d31-bf63-1244d130fad3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.568576 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-66aace50-8227-4c5c-b828-a4838d1b9b2e req-5c3480e8-131e-4d31-bf63-1244d130fad3 service nova] Creating event network-changed:2314c637-9bde-47be-ac0c-ff03de353eb6 for instance 0ab65189-b377-470a-ad31-fe77609157c9 on n-h2-764485-11 Jul 20 04:40:17.582033 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-66aace50-8227-4c5c-b828-a4838d1b9b2e req-5c3480e8-131e-4d31-bf63-1244d130fad3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073141 Jul 20 04:40:17.582827 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2859/5626] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:17.850777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-73d1fa4a-8137-42af-97ae-e36dc849193c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:17.854857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-73d1fa4a-8137-42af-97ae-e36dc849193c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:17.863727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:17.865448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73d1fa4a-8137-42af-97ae-e36dc849193c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.865946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73d1fa4a-8137-42af-97ae-e36dc849193c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.866741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73d1fa4a-8137-42af-97ae-e36dc849193c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.867187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73d1fa4a-8137-42af-97ae-e36dc849193c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.870756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:18.550673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-73d1fa4a-8137-42af-97ae-e36dc849193c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:18.553583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:18.569871 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-73d1fa4a-8137-42af-97ae-e36dc849193c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1314 microversion: 2.1 time: 0.723089 Jul 20 04:40:18.580676 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2768/5627] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:17 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:19.600234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-caa2002d-111a-4efe-b8e7-ddfd377f506d tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:19.600845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-caa2002d-111a-4efe-b8e7-ddfd377f506d tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:19.607642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:19.633089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caa2002d-111a-4efe-b8e7-ddfd377f506d tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:19.634187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caa2002d-111a-4efe-b8e7-ddfd377f506d tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:19.635036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caa2002d-111a-4efe-b8e7-ddfd377f506d tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:19.637117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-caa2002d-111a-4efe-b8e7-ddfd377f506d tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:21.712485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-743793094", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ee66832-4e3e-4ea5-b8c6-0e6625557ba2"}], "security_groups": [{"name": "tempest-securitygroup--1387109004"}], "key_name": "tempest-keypair-964500984", "user_data": "}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:21.738983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-caa2002d-111a-4efe-b8e7-ddfd377f506d tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:21.756805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:21.777003 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-caa2002d-111a-4efe-b8e7-ddfd377f506d tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1314 microversion: 2.1 time: 2.183769 Jul 20 04:40:21.778503 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2860/5628] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:19 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1314 bytes in 2186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:22.719330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] validate_networks() for [('5ee66832-4e3e-4ea5-b8c6-0e6625557ba2', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:40:22.795201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-54a9282c-0bcd-421b-82f2-9c025073b6b8 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:22.795672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-54a9282c-0bcd-421b-82f2-9c025073b6b8 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:22.799190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:22.807288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-54a9282c-0bcd-421b-82f2-9c025073b6b8 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.808119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-54a9282c-0bcd-421b-82f2-9c025073b6b8 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.809106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-54a9282c-0bcd-421b-82f2-9c025073b6b8 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.809753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-54a9282c-0bcd-421b-82f2-9c025073b6b8 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.820338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-54a9282c-0bcd-421b-82f2-9c025073b6b8 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:23.848280 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-54a9282c-0bcd-421b-82f2-9c025073b6b8 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1314 microversion: 2.1 time: 1.057824 Jul 20 04:40:23.852556 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2861/5629] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:22 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1314 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:24.869709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-450c28b4-0f24-44d1-9c3f-07fd17360733 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:24.870984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-450c28b4-0f24-44d1-9c3f-07fd17360733 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:24.887348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-450c28b4-0f24-44d1-9c3f-07fd17360733 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.894150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-450c28b4-0f24-44d1-9c3f-07fd17360733 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.898238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-450c28b4-0f24-44d1-9c3f-07fd17360733 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.899828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-450c28b4-0f24-44d1-9c3f-07fd17360733 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.530559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:40:25.531874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:40:25.533324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:40:25.534013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:40:25.534666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:40:25.572281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.573211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.575279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.576619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.624982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:40:25.645206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for user 8759015052b64df2b36efb694b837999 and project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:40:25.666220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:40:25.671987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:40:25.788079 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-44bcb506-e79b-424a-96e1-ae1f97a81887 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.071645 Jul 20 04:40:25.788886 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2769/5630] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:40:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 4087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:40:25.799376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-893b7486-d91a-481e-8d23-24a1ff24e14d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:25.800035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-893b7486-d91a-481e-8d23-24a1ff24e14d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:25.906392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-450c28b4-0f24-44d1-9c3f-07fd17360733 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:25.942565 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-450c28b4-0f24-44d1-9c3f-07fd17360733 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1314 microversion: 2.1 time: 1.077240 Jul 20 04:40:25.956004 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2862/5631] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:24 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1314 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:26.066679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-893b7486-d91a-481e-8d23-24a1ff24e14d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:26.076332 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-893b7486-d91a-481e-8d23-24a1ff24e14d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1240 microversion: 2.1 time: 0.281006 Jul 20 04:40:26.086616 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2770/5632] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:25 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1240 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:26.963373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da79739d-56a6-45f3-85ce-459f82565ab1 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:26.964703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-da79739d-56a6-45f3-85ce-459f82565ab1 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:26.988540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da79739d-56a6-45f3-85ce-459f82565ab1 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:26.989622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da79739d-56a6-45f3-85ce-459f82565ab1 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.990591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da79739d-56a6-45f3-85ce-459f82565ab1 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:26.992084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da79739d-56a6-45f3-85ce-459f82565ab1 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.094100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa10242b-89ae-4e58-861e-c538131b64a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:27.094751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa10242b-89ae-4e58-861e-c538131b64a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:27.105689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa10242b-89ae-4e58-861e-c538131b64a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.108316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa10242b-89ae-4e58-861e-c538131b64a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.109762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa10242b-89ae-4e58-861e-c538131b64a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.114785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa10242b-89ae-4e58-861e-c538131b64a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.555910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fa10242b-89ae-4e58-861e-c538131b64a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:27.570296 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fa10242b-89ae-4e58-861e-c538131b64a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1292 microversion: 2.1 time: 0.479903 Jul 20 04:40:27.573912 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2771/5633] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:27 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1292 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:27.582746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-7564f17a-76fd-4e25-a87d-0f37173627d1 req-d449890b-9b3c-4a4d-a467-50599b683b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab65189-b377-470a-ad31-fe77609157c9", "name": "network-vif-plugged", "status": "completed", "tag": "2314c637-9bde-47be-ac0c-ff03de353eb6"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:27.605809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7564f17a-76fd-4e25-a87d-0f37173627d1 req-d449890b-9b3c-4a4d-a467-50599b683b16 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.606714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7564f17a-76fd-4e25-a87d-0f37173627d1 req-d449890b-9b3c-4a4d-a467-50599b683b16 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.641972 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-7564f17a-76fd-4e25-a87d-0f37173627d1 req-d449890b-9b3c-4a4d-a467-50599b683b16 service nova] Creating event network-vif-plugged:2314c637-9bde-47be-ac0c-ff03de353eb6 for instance 0ab65189-b377-470a-ad31-fe77609157c9 on n-h2-764485-11 Jul 20 04:40:27.657022 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-7564f17a-76fd-4e25-a87d-0f37173627d1 req-d449890b-9b3c-4a4d-a467-50599b683b16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080996 Jul 20 04:40:27.659863 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2772/5634] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:27.901227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-da79739d-56a6-45f3-85ce-459f82565ab1 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:27.913751 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da79739d-56a6-45f3-85ce-459f82565ab1 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1314 microversion: 2.1 time: 0.954189 Jul 20 04:40:27.914366 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2863/5635] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:26 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1314 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:28.589417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-258724c1-bdc7-4eae-a48f-e780464aa680 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:28.590131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-258724c1-bdc7-4eae-a48f-e780464aa680 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:28.614178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-258724c1-bdc7-4eae-a48f-e780464aa680 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.614635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-258724c1-bdc7-4eae-a48f-e780464aa680 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.615424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-258724c1-bdc7-4eae-a48f-e780464aa680 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.615894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-258724c1-bdc7-4eae-a48f-e780464aa680 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.930597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-99cea7be-1d18-4d57-b62c-231981c1a97c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:28.936184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-99cea7be-1d18-4d57-b62c-231981c1a97c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:28.955878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99cea7be-1d18-4d57-b62c-231981c1a97c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.960637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99cea7be-1d18-4d57-b62c-231981c1a97c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.961761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99cea7be-1d18-4d57-b62c-231981c1a97c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.962795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99cea7be-1d18-4d57-b62c-231981c1a97c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.515061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-258724c1-bdc7-4eae-a48f-e780464aa680 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.524868 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-258724c1-bdc7-4eae-a48f-e780464aa680 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1298 microversion: 2.1 time: 0.939525 Jul 20 04:40:29.544796 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2773/5636] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:28 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1298 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:29.906773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-99cea7be-1d18-4d57-b62c-231981c1a97c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.920241 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-99cea7be-1d18-4d57-b62c-231981c1a97c tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1314 microversion: 2.1 time: 0.990345 Jul 20 04:40:29.921220 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2864/5637] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:28 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:30.556228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b2316e3d-acd8-4a20-80df-58e2c3f694c1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:30.562001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b2316e3d-acd8-4a20-80df-58e2c3f694c1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:30.574256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2316e3d-acd8-4a20-80df-58e2c3f694c1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.574977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2316e3d-acd8-4a20-80df-58e2c3f694c1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.579462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2316e3d-acd8-4a20-80df-58e2c3f694c1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.580134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2316e3d-acd8-4a20-80df-58e2c3f694c1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.938125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e4f8bc08-a4c2-402b-80d4-c674b585383b tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:30.938810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e4f8bc08-a4c2-402b-80d4-c674b585383b tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:30.963685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e4f8bc08-a4c2-402b-80d4-c674b585383b tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.964161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e4f8bc08-a4c2-402b-80d4-c674b585383b tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.965102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e4f8bc08-a4c2-402b-80d4-c674b585383b tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.965548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e4f8bc08-a4c2-402b-80d4-c674b585383b tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.319081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b2316e3d-acd8-4a20-80df-58e2c3f694c1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:31.339470 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b2316e3d-acd8-4a20-80df-58e2c3f694c1 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1298 microversion: 2.1 time: 0.787156 Jul 20 04:40:31.342693 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2774/5638] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:30 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1298 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:32.222039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e4f8bc08-a4c2-402b-80d4-c674b585383b tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.242620 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e4f8bc08-a4c2-402b-80d4-c674b585383b tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1314 microversion: 2.1 time: 1.308349 Jul 20 04:40:32.257843 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2865/5639] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:30 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1314 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:32.361432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-26d670ec-0c73-4c2b-991e-f0adfd52580f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:32.362748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-26d670ec-0c73-4c2b-991e-f0adfd52580f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:32.380830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26d670ec-0c73-4c2b-991e-f0adfd52580f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.381558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26d670ec-0c73-4c2b-991e-f0adfd52580f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.382575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26d670ec-0c73-4c2b-991e-f0adfd52580f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.383265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26d670ec-0c73-4c2b-991e-f0adfd52580f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.942604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-26d670ec-0c73-4c2b-991e-f0adfd52580f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.962414 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-26d670ec-0c73-4c2b-991e-f0adfd52580f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1298 microversion: 2.1 time: 0.606253 Jul 20 04:40:32.963372 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2775/5640] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:32 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1298 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:33.264586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e5ce5664-fc72-4560-905f-136d933207cb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:33.265153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e5ce5664-fc72-4560-905f-136d933207cb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:33.283310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5ce5664-fc72-4560-905f-136d933207cb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.284131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5ce5664-fc72-4560-905f-136d933207cb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.285375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5ce5664-fc72-4560-905f-136d933207cb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.285819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5ce5664-fc72-4560-905f-136d933207cb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.980607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3005018b-a538-4133-aa00-020b59576363 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:33.981873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3005018b-a538-4133-aa00-020b59576363 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:33.994314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3005018b-a538-4133-aa00-020b59576363 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.994939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3005018b-a538-4133-aa00-020b59576363 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.998534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3005018b-a538-4133-aa00-020b59576363 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.999151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3005018b-a538-4133-aa00-020b59576363 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.273140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e5ce5664-fc72-4560-905f-136d933207cb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:34.303311 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e5ce5664-fc72-4560-905f-136d933207cb tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1498 microversion: 2.1 time: 1.044193 Jul 20 04:40:34.314780 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2866/5641] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:33 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1498 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:34.549715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3005018b-a538-4133-aa00-020b59576363 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:34.558667 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3005018b-a538-4133-aa00-020b59576363 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1366 microversion: 2.1 time: 0.581767 Jul 20 04:40:34.565063 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2776/5642] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:33 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1366 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:35.584578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c307900d-f4a1-48a3-824e-b49bb669daf3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:35.586423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c307900d-f4a1-48a3-824e-b49bb669daf3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:35.613103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c307900d-f4a1-48a3-824e-b49bb669daf3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:35.614281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c307900d-f4a1-48a3-824e-b49bb669daf3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:35.615263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c307900d-f4a1-48a3-824e-b49bb669daf3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:35.623055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c307900d-f4a1-48a3-824e-b49bb669daf3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.692060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c307900d-f4a1-48a3-824e-b49bb669daf3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:36.709001 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c307900d-f4a1-48a3-824e-b49bb669daf3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1366 microversion: 2.1 time: 1.130585 Jul 20 04:40:36.712581 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2867/5643] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:35 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1366 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:37.731829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f07fab02-87aa-4699-8ed0-451c51abb292 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:37.732524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f07fab02-87aa-4699-8ed0-451c51abb292 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:37.744913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:37.755840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:37.779335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f07fab02-87aa-4699-8ed0-451c51abb292 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.782756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f07fab02-87aa-4699-8ed0-451c51abb292 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.784528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f07fab02-87aa-4699-8ed0-451c51abb292 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.785981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f07fab02-87aa-4699-8ed0-451c51abb292 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.036534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f07fab02-87aa-4699-8ed0-451c51abb292 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.048812 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f07fab02-87aa-4699-8ed0-451c51abb292 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1366 microversion: 2.1 time: 1.321164 Jul 20 04:40:39.049752 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2777/5644] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:37 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1366 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:39.135064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-dbba2720-e6be-4631-b575-2ecb699977e4 req-a97559b1-4a61-46df-8575-7d44a2a45361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4720cce2-ac73-4a0d-b54e-996065a5f45d", "tag": "c929cf81-71ab-4d72-aaa1-825202468cd6"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:39.154145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dbba2720-e6be-4631-b575-2ecb699977e4 req-a97559b1-4a61-46df-8575-7d44a2a45361 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.154998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dbba2720-e6be-4631-b575-2ecb699977e4 req-a97559b1-4a61-46df-8575-7d44a2a45361 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.202705 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-dbba2720-e6be-4631-b575-2ecb699977e4 req-a97559b1-4a61-46df-8575-7d44a2a45361 service nova] Creating event network-changed:c929cf81-71ab-4d72-aaa1-825202468cd6 for instance 4720cce2-ac73-4a0d-b54e-996065a5f45d on n-h1-764485-11 Jul 20 04:40:39.220958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-dbba2720-e6be-4631-b575-2ecb699977e4 req-a97559b1-4a61-46df-8575-7d44a2a45361 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089471 Jul 20 04:40:39.229224 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2868/5645] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:39.529927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9dc81243-c50b-497a-8620-3050be4a8636 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:39.530443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9dc81243-c50b-497a-8620-3050be4a8636 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:39.541587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dc81243-c50b-497a-8620-3050be4a8636 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.542258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dc81243-c50b-497a-8620-3050be4a8636 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.542833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dc81243-c50b-497a-8620-3050be4a8636 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.543444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dc81243-c50b-497a-8620-3050be4a8636 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.615770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9dc81243-c50b-497a-8620-3050be4a8636 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:40:39.784054 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9dc81243-c50b-497a-8620-3050be4a8636 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 204 len: 0 microversion: 2.1 time: 0.258027 Jul 20 04:40:39.784619 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2778/5646] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:40:39 2022] DELETE /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:40:39.795279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-037191f7-ac03-4e57-a79f-cfe2c3144bd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:39.796277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-037191f7-ac03-4e57-a79f-cfe2c3144bd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:39.804384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-037191f7-ac03-4e57-a79f-cfe2c3144bd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.805117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-037191f7-ac03-4e57-a79f-cfe2c3144bd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.806086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-037191f7-ac03-4e57-a79f-cfe2c3144bd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.806695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-037191f7-ac03-4e57-a79f-cfe2c3144bd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.067342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4275472a-3e51-4566-a96f-47bdff08f7f7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:40.068758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4275472a-3e51-4566-a96f-47bdff08f7f7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:40.078093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4275472a-3e51-4566-a96f-47bdff08f7f7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.090866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4275472a-3e51-4566-a96f-47bdff08f7f7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.094815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4275472a-3e51-4566-a96f-47bdff08f7f7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.095599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4275472a-3e51-4566-a96f-47bdff08f7f7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.634110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-037191f7-ac03-4e57-a79f-cfe2c3144bd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:40.648944 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-037191f7-ac03-4e57-a79f-cfe2c3144bd2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1504 microversion: 2.1 time: 0.857822 Jul 20 04:40:40.649721 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2869/5647] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:39 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1504 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:40.674523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4275472a-3e51-4566-a96f-47bdff08f7f7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:40.682761 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4275472a-3e51-4566-a96f-47bdff08f7f7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1366 microversion: 2.1 time: 0.620113 Jul 20 04:40:40.694397 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2779/5648] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:40 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1366 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:41.476504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2cd85a49-be6d-4461-8c2c-9914c35f5026 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] Action: 'create', calling method: .version_select at 0x7fbf9c0c8310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-27820943", "metadata": {"Type": "work"}}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:41.666800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4662fe1e-e365-4de6-8940-0e294ebbf9d0 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:41.667632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4662fe1e-e365-4de6-8940-0e294ebbf9d0 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:41.680647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4662fe1e-e365-4de6-8940-0e294ebbf9d0 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.685101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4662fe1e-e365-4de6-8940-0e294ebbf9d0 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.686190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4662fe1e-e365-4de6-8940-0e294ebbf9d0 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.687437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4662fe1e-e365-4de6-8940-0e294ebbf9d0 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:42.145755 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2cd85a49-be6d-4461-8c2c-9914c35f5026 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.975328 Jul 20 04:40:42.147363 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2870/5649] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Jul 20 04:40:41 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 977 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 04:40:42.153565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-41455c0b-c256-4ec3-bc4c-d499778e4ca9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:42.154198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-41455c0b-c256-4ec3-bc4c-d499778e4ca9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:42.170697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41455c0b-c256-4ec3-bc4c-d499778e4ca9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:42.171167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41455c0b-c256-4ec3-bc4c-d499778e4ca9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:42.174605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41455c0b-c256-4ec3-bc4c-d499778e4ca9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:42.175070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41455c0b-c256-4ec3-bc4c-d499778e4ca9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.279187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4662fe1e-e365-4de6-8940-0e294ebbf9d0 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:43.290959 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4662fe1e-e365-4de6-8940-0e294ebbf9d0 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1504 microversion: 2.1 time: 1.628596 Jul 20 04:40:43.302193 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2780/5650] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:41 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1504 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:43.307190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-42070928-fa75-4be0-be71-e89669a24ea3 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] Calling method '.version_select at 0x7fbf9c0d5430>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:43.418104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-41455c0b-c256-4ec3-bc4c-d499778e4ca9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:43.433220 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-41455c0b-c256-4ec3-bc4c-d499778e4ca9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1366 microversion: 2.1 time: 1.280469 Jul 20 04:40:43.435924 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2871/5651] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:42 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1366 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:43.438522 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-42070928-fa75-4be0-be71-e89669a24ea3 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762" status: 200 len: 351 microversion: 2.1 time: 0.134874 Jul 20 04:40:43.439163 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2781/5652] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:40:43 2022] GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762 => generated 351 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:44.309882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fe62dc46-49cf-4351-8637-bc2246f42467 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:44.313396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fe62dc46-49cf-4351-8637-bc2246f42467 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:44.332289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe62dc46-49cf-4351-8637-bc2246f42467 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.333742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe62dc46-49cf-4351-8637-bc2246f42467 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.335183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe62dc46-49cf-4351-8637-bc2246f42467 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.336223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe62dc46-49cf-4351-8637-bc2246f42467 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.384629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=73 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:44.459732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-72fbb7ad-4073-496d-922a-75a25a40dbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:44.467164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-72fbb7ad-4073-496d-922a-75a25a40dbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:44.487439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72fbb7ad-4073-496d-922a-75a25a40dbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.488288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72fbb7ad-4073-496d-922a-75a25a40dbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.489321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72fbb7ad-4073-496d-922a-75a25a40dbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.497298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72fbb7ad-4073-496d-922a-75a25a40dbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.580625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fe62dc46-49cf-4351-8637-bc2246f42467 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:44.602725 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fe62dc46-49cf-4351-8637-bc2246f42467 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1462 microversion: 2.1 time: 0.297498 Jul 20 04:40:44.603940 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2872/5653] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:44 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1462 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:44.618046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1a038de6-53d4-47ea-a335-42583032d64d tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] Calling method '.version_select at 0x7fbf9c0c84c0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:44.746232 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1a038de6-53d4-47ea-a335-42583032d64d tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762" status: 200 len: 352 microversion: 2.1 time: 0.141053 Jul 20 04:40:44.752202 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2873/5654] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:40:44 2022] GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762 => generated 352 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:44.763713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c23a20db-4a47-4961-86a5-2f55a41ba721 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] Calling method '.version_select at 0x7fbf9c0894c0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:44.882073 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c23a20db-4a47-4961-86a5-2f55a41ba721 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762" status: 200 len: 352 microversion: 2.1 time: 0.122647 Jul 20 04:40:44.882984 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2874/5655] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:40:44 2022] GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762 => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:44.894870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9887929-e154-4364-a80d-ecbc43893b4e tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] Calling method '.version_select at 0x7fbf9c40cb80>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:44.991355 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9887929-e154-4364-a80d-ecbc43893b4e tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762" status: 202 len: 0 microversion: 2.1 time: 0.099775 Jul 20 04:40:44.995100 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2875/5656] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:40:44 2022] DELETE /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:40:45.004750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-796926c2-8e97-4b7e-b7f1-beee9ae415c9 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] Calling method '.version_select at 0x7fbf9c089940>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:45.174898 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-796926c2-8e97-4b7e-b7f1-beee9ae415c9 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762" status: 200 len: 351 microversion: 2.1 time: 0.178613 Jul 20 04:40:45.176352 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2876/5657] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:40:44 2022] GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762 => generated 351 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:40:45.198049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-fff6abd6-03c5-4629-91c0-9bc7d7aeeb2b req-7a39d089-0bfc-48b2-93af-ead8a5d905d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab65189-b377-470a-ad31-fe77609157c9", "name": "network-vif-deleted", "tag": "2314c637-9bde-47be-ac0c-ff03de353eb6"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:45.244824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-fff6abd6-03c5-4629-91c0-9bc7d7aeeb2b req-7a39d089-0bfc-48b2-93af-ead8a5d905d3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.245280 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-fff6abd6-03c5-4629-91c0-9bc7d7aeeb2b req-7a39d089-0bfc-48b2-93af-ead8a5d905d3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.279745 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-fff6abd6-03c5-4629-91c0-9bc7d7aeeb2b req-7a39d089-0bfc-48b2-93af-ead8a5d905d3 service nova] Creating event network-vif-deleted:2314c637-9bde-47be-ac0c-ff03de353eb6 for instance 0ab65189-b377-470a-ad31-fe77609157c9 on n-h2-764485-11 Jul 20 04:40:45.293013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-72fbb7ad-4073-496d-922a-75a25a40dbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:45.306585 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-fff6abd6-03c5-4629-91c0-9bc7d7aeeb2b req-7a39d089-0bfc-48b2-93af-ead8a5d905d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114619 Jul 20 04:40:45.310531 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-72fbb7ad-4073-496d-922a-75a25a40dbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1366 microversion: 2.1 time: 0.855299 Jul 20 04:40:45.311592 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2877/5658] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:45.312425 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2782/5659] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:44 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1366 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:45.624956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49b22cd9-8ac4-4079-adc2-f9619bc585f2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:45.628126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-49b22cd9-8ac4-4079-adc2-f9619bc585f2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:45.649670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49b22cd9-8ac4-4079-adc2-f9619bc585f2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.650086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49b22cd9-8ac4-4079-adc2-f9619bc585f2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.650907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49b22cd9-8ac4-4079-adc2-f9619bc585f2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.651353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49b22cd9-8ac4-4079-adc2-f9619bc585f2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.754576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49b22cd9-8ac4-4079-adc2-f9619bc585f2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.755302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49b22cd9-8ac4-4079-adc2-f9619bc585f2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.756171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-49b22cd9-8ac4-4079-adc2-f9619bc585f2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lazy-loading 'fault' on Instance uuid 0ab65189-b377-470a-ad31-fe77609157c9 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:46.088287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-49b22cd9-8ac4-4079-adc2-f9619bc585f2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d9d49d9664fc5aaebb566653da6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58587ea50c7440efad506682a9104ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:46.102396 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-49b22cd9-8ac4-4079-adc2-f9619bc585f2 tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 200 len: 1304 microversion: 2.1 time: 0.482448 Jul 20 04:40:46.103415 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2878/5660] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:45 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 1304 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:46.189938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-035dc771-e0c9-4b8f-82f3-09ffdfbfbafe tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] Calling method '.version_select at 0x7fbf9c118040>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:46.303231 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-035dc771-e0c9-4b8f-82f3-09ffdfbfbafe tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762" status: 200 len: 351 microversion: 2.1 time: 0.119002 Jul 20 04:40:46.311140 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2783/5661] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:40:46 2022] GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762 => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:46.331355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f0e24e92-4267-40c7-977a-f24029eab34a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:46.332160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f0e24e92-4267-40c7-977a-f24029eab34a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:46.354971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f0e24e92-4267-40c7-977a-f24029eab34a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.356804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f0e24e92-4267-40c7-977a-f24029eab34a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.358377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f0e24e92-4267-40c7-977a-f24029eab34a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.364687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f0e24e92-4267-40c7-977a-f24029eab34a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.108978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f0e24e92-4267-40c7-977a-f24029eab34a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:47.121898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e23b728-5a18-426e-9a70-b755988816ef tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:47.122837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7e23b728-5a18-426e-9a70-b755988816ef tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] [instance: 0ab65189-b377-470a-ad31-fe77609157c9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:47.135503 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f0e24e92-4267-40c7-977a-f24029eab34a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1366 microversion: 2.1 time: 0.809951 Jul 20 04:40:47.143141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e23b728-5a18-426e-9a70-b755988816ef tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:47.143955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e23b728-5a18-426e-9a70-b755988816ef tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.144394 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2879/5662] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:46 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1366 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:47.145501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e23b728-5a18-426e-9a70-b755988816ef tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:47.146122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e23b728-5a18-426e-9a70-b755988816ef tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.208135 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-7e23b728-5a18-426e-9a70-b755988816ef tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] HTTP exception thrown: Instance 0ab65189-b377-470a-ad31-fe77609157c9 could not be found. Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e23b728-5a18-426e-9a70-b755988816ef tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Request method failure captured: Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 HTTP/1.1 Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14cjFpC9JqFQv6d8W8x_m_n1KtlvIUS2LRIwxOini11D0XlYrUINRgSocNx0rAjBkA-ftroU7oactlrslBUS6PvS27zzESbtQ8BBEtgFS17vgEijcvlBDzxgKCm63kd_aNKT_HM5NjCND1GGYmCiZ78z8HSGAUkfn2E0GnSttW1mgQM Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 58587ea50c7440efad506682a9104ffb Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-VolumesActionsTest-351489118 Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/58587ea50c7440efad506682a9104ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/58587ea50c7440efad506682a9104ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_58587ea50c7440efad506682a9104ffb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/58587ea50c7440efad506682a9104ffb"}]}] Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-VolumesActionsTest-351489118 Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 58587ea50c7440efad506682a9104ffb Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-VolumesActionsTest-351489118 Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-VolumesActionsTest-351489118-project Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 684d9d49d9664fc5aaebb566653da6ae Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-VolumesActionsTest-351489118-project Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 0ab65189-b377-470a-ad31-fe77609157c9 could not be found. Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '0ab65189-b377-470a-ad31-fe77609157c9'} Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab65189-b377-470a-ad31-fe77609157c9 could not be found. Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab65189-b377-470a-ad31-fe77609157c9 could not be found. Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:47.215439 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:47.220204 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:47.220204 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:47.220204 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:47.220204 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:47.220204 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:47.220204 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab65189-b377-470a-ad31-fe77609157c9 could not be found. Jul 20 04:40:47.220204 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:47.220204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e23b728-5a18-426e-9a70-b755988816ef tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] Returning 404 to user: Instance 0ab65189-b377-470a-ad31-fe77609157c9 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:47.223020 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7e23b728-5a18-426e-9a70-b755988816ef tempest-VolumesActionsTest-351489118 tempest-VolumesActionsTest-351489118-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9" status: 404 len: 111 microversion: 2.1 time: 0.106008 Jul 20 04:40:47.224191 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2784/5663] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:47 2022] GET /compute/v2.1/servers/0ab65189-b377-470a-ad31-fe77609157c9 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:40:47.318773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8012d4a7-dd8a-4812-89d1-aa8e63e85eb1 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] Calling method '.version_select at 0x7fbf9c49d0d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:47.405480 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8012d4a7-dd8a-4812-89d1-aa8e63e85eb1 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762" status: 200 len: 351 microversion: 2.1 time: 0.091214 Jul 20 04:40:47.406070 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2880/5664] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:40:47 2022] GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762 => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:40:48.176082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eed510fe-dc7a-4819-8c94-2abc83883551 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:48.176880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eed510fe-dc7a-4819-8c94-2abc83883551 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:48.201356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:48.204660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eed510fe-dc7a-4819-8c94-2abc83883551 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.208943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eed510fe-dc7a-4819-8c94-2abc83883551 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.209961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eed510fe-dc7a-4819-8c94-2abc83883551 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.210477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eed510fe-dc7a-4819-8c94-2abc83883551 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.275111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:48.419799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dddea572-051c-4633-80d6-2b61c22a366e tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] Calling method '.version_select at 0x7fbf9c3894c0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:48.559607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eed510fe-dc7a-4819-8c94-2abc83883551 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:48.569139 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eed510fe-dc7a-4819-8c94-2abc83883551 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1366 microversion: 2.1 time: 0.413412 Jul 20 04:40:48.574904 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dddea572-051c-4633-80d6-2b61c22a366e tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762" status: 200 len: 351 microversion: 2.1 time: 0.159976 Jul 20 04:40:48.575780 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2881/5665] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:40:48 2022] GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762 => generated 351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:48.581099 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2785/5666] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:48 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:49.589185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62a34912-6a27-42e6-8ea6-0ae084ebdbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:49.591007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-62a34912-6a27-42e6-8ea6-0ae084ebdbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:49.592621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5de294d0-2c5e-4986-9524-4be20b38b845 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] Calling method '.version_select at 0x7fbf9c0d5f70>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:49.611154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62a34912-6a27-42e6-8ea6-0ae084ebdbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.615766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62a34912-6a27-42e6-8ea6-0ae084ebdbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.630208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62a34912-6a27-42e6-8ea6-0ae084ebdbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.630834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62a34912-6a27-42e6-8ea6-0ae084ebdbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.664785 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-5de294d0-2c5e-4986-9524-4be20b38b845 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] HTTP exception thrown: Volume 2d9c8bc3-11ac-4991-84cf-a27ff037e762 could not be found. Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5de294d0-2c5e-4986-9524-4be20b38b845 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] Request method failure captured: Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762 HTTP/1.1 Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14dJHqFNv4x0ZztNKF3IGGjdFBNI6SqbY9xPRUPxSw8P1IgH2b4Q7ksFSeXJBZJ51_Vn7V36SH7SL_5Z16CN3-nZqDgYdwuy4sf5PHUzjsPeht9ougKWqvz-JRn1xn4S7CdEu7Rj7luOlyDF174lGdCTJZ4RXS55XevL94fCI9SI9MQ Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: adbf219a808c4ed097115e567f27d07f Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-VolumesGetTestJSON-790297468 Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adbf219a808c4ed097115e567f27d07f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adbf219a808c4ed097115e567f27d07f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adbf219a808c4ed097115e567f27d07f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adbf219a808c4ed097115e567f27d07f"}]}] Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-VolumesGetTestJSON-790297468 Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: adbf219a808c4ed097115e567f27d07f Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-VolumesGetTestJSON-790297468 Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-VolumesGetTestJSON-790297468-project Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: aa67bbf3980f43ec86e65d11296780f1 Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-VolumesGetTestJSON-790297468-project Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: method: Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: exception: Volume 2d9c8bc3-11ac-4991-84cf-a27ff037e762 could not be found. Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '2d9c8bc3-11ac-4991-84cf-a27ff037e762'} Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d9c8bc3-11ac-4991-84cf-a27ff037e762 could not be found. (HTTP 404) (Request-ID: req-19cd510f-f303-45a6-be9f-98baf0acebb2) Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:40:49.666811 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d9c8bc3-11ac-4991-84cf-a27ff037e762 could not be found. Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d9c8bc3-11ac-4991-84cf-a27ff037e762 could not be found. Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d9c8bc3-11ac-4991-84cf-a27ff037e762 could not be found. Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5de294d0-2c5e-4986-9524-4be20b38b845 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] Returning 404 to user: Volume 2d9c8bc3-11ac-4991-84cf-a27ff037e762 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5de294d0-2c5e-4986-9524-4be20b38b845 tempest-VolumesGetTestJSON-790297468 tempest-VolumesGetTestJSON-790297468-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762" status: 404 len: 109 microversion: 2.1 time: 0.084220 Jul 20 04:40:49.671127 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2786/5667] 10.222.0.20 () {58 vars in 1244 bytes} [Wed Jul 20 04:40:49 2022] GET /compute/v2.1/os-volumes/2d9c8bc3-11ac-4991-84cf-a27ff037e762 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:40:49.763961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1b92ca3f-b6e3-432e-afc3-08636e08c1eb req-92ad7b4c-93bc-42c8-98e0-19fcf277313d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4720cce2-ac73-4a0d-b54e-996065a5f45d", "name": "network-vif-plugged", "status": "completed", "tag": "c929cf81-71ab-4d72-aaa1-825202468cd6"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:49.785551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1b92ca3f-b6e3-432e-afc3-08636e08c1eb req-92ad7b4c-93bc-42c8-98e0-19fcf277313d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.789626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1b92ca3f-b6e3-432e-afc3-08636e08c1eb req-92ad7b4c-93bc-42c8-98e0-19fcf277313d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.822846 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1b92ca3f-b6e3-432e-afc3-08636e08c1eb req-92ad7b4c-93bc-42c8-98e0-19fcf277313d service nova] Creating event network-vif-plugged:c929cf81-71ab-4d72-aaa1-825202468cd6 for instance 4720cce2-ac73-4a0d-b54e-996065a5f45d on n-h1-764485-11 Jul 20 04:40:49.833902 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1b92ca3f-b6e3-432e-afc3-08636e08c1eb req-92ad7b4c-93bc-42c8-98e0-19fcf277313d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073443 Jul 20 04:40:49.834803 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2787/5668] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:40:50.530616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-62a34912-6a27-42e6-8ea6-0ae084ebdbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:50.545654 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-62a34912-6a27-42e6-8ea6-0ae084ebdbc3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1366 microversion: 2.1 time: 0.962458 Jul 20 04:40:50.558186 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2882/5669] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:49 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1366 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:51.567108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9d52056b-6aee-4662-87f8-7244f40bdb36 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:51.567746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9d52056b-6aee-4662-87f8-7244f40bdb36 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:51.599596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d52056b-6aee-4662-87f8-7244f40bdb36 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.601349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d52056b-6aee-4662-87f8-7244f40bdb36 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.603882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d52056b-6aee-4662-87f8-7244f40bdb36 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.606621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d52056b-6aee-4662-87f8-7244f40bdb36 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.046330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9d52056b-6aee-4662-87f8-7244f40bdb36 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.069730 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9d52056b-6aee-4662-87f8-7244f40bdb36 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1366 microversion: 2.1 time: 2.507652 Jul 20 04:40:54.071654 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2788/5670] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:51 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1366 bytes in 2511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:55.095075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-47aa1d83-7c26-40a8-87d8-304d00096f71 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:55.102013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-47aa1d83-7c26-40a8-87d8-304d00096f71 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:55.127035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=34 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:55.133003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47aa1d83-7c26-40a8-87d8-304d00096f71 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.133543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47aa1d83-7c26-40a8-87d8-304d00096f71 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.137885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47aa1d83-7c26-40a8-87d8-304d00096f71 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.138429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47aa1d83-7c26-40a8-87d8-304d00096f71 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.194523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-47aa1d83-7c26-40a8-87d8-304d00096f71 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:56.213012 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-47aa1d83-7c26-40a8-87d8-304d00096f71 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1555 microversion: 2.1 time: 1.123029 Jul 20 04:40:56.213637 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2883/5671] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:55 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1555 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:56.248072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5800b4d2-bea3-4460-855e-cde8e2078844 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:56.248582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5800b4d2-bea3-4460-855e-cde8e2078844 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:56.284080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5800b4d2-bea3-4460-855e-cde8e2078844 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.284080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5800b4d2-bea3-4460-855e-cde8e2078844 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.284876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5800b4d2-bea3-4460-855e-cde8e2078844 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.295080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5800b4d2-bea3-4460-855e-cde8e2078844 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.579325 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5800b4d2-bea3-4460-855e-cde8e2078844 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.349439 Jul 20 04:40:56.580244 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2789/5672] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:40:56 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d/os-interface => generated 284 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:01.888398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-50062815-0cbb-4a43-9540-3bc14d923ce8 req-38143c27-b44f-41fa-9335-d70bdd90bfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4720cce2-ac73-4a0d-b54e-996065a5f45d", "tag": "c929cf81-71ab-4d72-aaa1-825202468cd6"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:01.912176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-50062815-0cbb-4a43-9540-3bc14d923ce8 req-38143c27-b44f-41fa-9335-d70bdd90bfee service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:01.912924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-50062815-0cbb-4a43-9540-3bc14d923ce8 req-38143c27-b44f-41fa-9335-d70bdd90bfee service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:01.963201 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-50062815-0cbb-4a43-9540-3bc14d923ce8 req-38143c27-b44f-41fa-9335-d70bdd90bfee service nova] Creating event network-changed:c929cf81-71ab-4d72-aaa1-825202468cd6 for instance 4720cce2-ac73-4a0d-b54e-996065a5f45d on n-h1-764485-11 Jul 20 04:41:01.989966 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-50062815-0cbb-4a43-9540-3bc14d923ce8 req-38143c27-b44f-41fa-9335-d70bdd90bfee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.846983 Jul 20 04:41:01.991100 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2884/5673] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:26.957280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-148286088", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "a8419ed0-ae67-4ce7-8412-01a277b3759d"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:26.971816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=7 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:26.973159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=17 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:27.025546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] validate_networks() for [('a8419ed0-ae67-4ce7-8412-01a277b3759d', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:41:28.778720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:41:28.779356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:41:28.779792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:41:28.780975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:41:28.781649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:41:28.791864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.792655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.793603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.794376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.816984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Getting quotas for project 65f2eb23c3c149d2b364f1a531b3573c. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:28.826232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Getting quotas for user 6a205f9889d546ff8adaf05c6cf8ff0e and project 65f2eb23c3c149d2b364f1a531b3573c. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:28.854419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:41:28.860420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:41:28.978015 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-94ba3487-d6e4-4bde-924f-a837504e10f0 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.020074 Jul 20 04:41:28.984557 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2790/5674] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:41:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:41:28.991156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-322f8696-7089-4f93-9112-c1f675d7612e tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:28.991897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-322f8696-7089-4f93-9112-c1f675d7612e tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:28.994909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:28.995595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=35 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:29.132713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-322f8696-7089-4f93-9112-c1f675d7612e tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:29.140454 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-322f8696-7089-4f93-9112-c1f675d7612e tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1218 microversion: 2.1 time: 0.154150 Jul 20 04:41:29.143575 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2885/5675] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:28 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:30.167125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-25939cb1-d73c-46df-9e80-b04ff99e99dd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:30.168422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-25939cb1-d73c-46df-9e80-b04ff99e99dd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:30.191626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25939cb1-d73c-46df-9e80-b04ff99e99dd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:30.192356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25939cb1-d73c-46df-9e80-b04ff99e99dd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:30.196797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25939cb1-d73c-46df-9e80-b04ff99e99dd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:30.198917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-25939cb1-d73c-46df-9e80-b04ff99e99dd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:30.402411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-25939cb1-d73c-46df-9e80-b04ff99e99dd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:30.414444 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-25939cb1-d73c-46df-9e80-b04ff99e99dd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1214 microversion: 2.1 time: 0.260660 Jul 20 04:41:30.415766 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2791/5676] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:30 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1214 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:31.434409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d8b06f62-da7c-4ffd-8437-6aff0b4adf48 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:31.435019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d8b06f62-da7c-4ffd-8437-6aff0b4adf48 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:31.451553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d8b06f62-da7c-4ffd-8437-6aff0b4adf48 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:31.452831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d8b06f62-da7c-4ffd-8437-6aff0b4adf48 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:31.453787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d8b06f62-da7c-4ffd-8437-6aff0b4adf48 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:31.454227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d8b06f62-da7c-4ffd-8437-6aff0b4adf48 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:31.970603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d8b06f62-da7c-4ffd-8437-6aff0b4adf48 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:31.979450 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d8b06f62-da7c-4ffd-8437-6aff0b4adf48 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1276 microversion: 2.1 time: 0.549250 Jul 20 04:41:31.985628 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2886/5677] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:31 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1276 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:33.001234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fdb63ac1-37ca-45eb-ba9e-295814e40144 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:33.002508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fdb63ac1-37ca-45eb-ba9e-295814e40144 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:33.016776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fdb63ac1-37ca-45eb-ba9e-295814e40144 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.017530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fdb63ac1-37ca-45eb-ba9e-295814e40144 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.019115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fdb63ac1-37ca-45eb-ba9e-295814e40144 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.020807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fdb63ac1-37ca-45eb-ba9e-295814e40144 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.185843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fdb63ac1-37ca-45eb-ba9e-295814e40144 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:34.210469 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fdb63ac1-37ca-45eb-ba9e-295814e40144 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1318 microversion: 2.1 time: 1.214128 Jul 20 04:41:34.211141 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2792/5678] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:32 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1318 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:34.823009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-56648f20-dbf0-4b3b-9a5b-80b5d8c829d4 req-120f631d-4b69-42dc-afaf-15fbedc05404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2306ea05-0e30-4750-883f-aee66bcd03ef", "tag": "ce3c1e3c-4e71-4c76-b40f-c2111256776e"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:34.840143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-56648f20-dbf0-4b3b-9a5b-80b5d8c829d4 req-120f631d-4b69-42dc-afaf-15fbedc05404 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.841024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-56648f20-dbf0-4b3b-9a5b-80b5d8c829d4 req-120f631d-4b69-42dc-afaf-15fbedc05404 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.861925 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-56648f20-dbf0-4b3b-9a5b-80b5d8c829d4 req-120f631d-4b69-42dc-afaf-15fbedc05404 service nova] Creating event network-changed:ce3c1e3c-4e71-4c76-b40f-c2111256776e for instance 2306ea05-0e30-4750-883f-aee66bcd03ef on n-h2-764485-11 Jul 20 04:41:34.868462 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-56648f20-dbf0-4b3b-9a5b-80b5d8c829d4 req-120f631d-4b69-42dc-afaf-15fbedc05404 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319914 Jul 20 04:41:34.869694 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2887/5679] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:35.230454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b3e71e38-4048-4dcc-b16e-26b5d8ee067a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:35.232240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b3e71e38-4048-4dcc-b16e-26b5d8ee067a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:35.258749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3e71e38-4048-4dcc-b16e-26b5d8ee067a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.259579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3e71e38-4048-4dcc-b16e-26b5d8ee067a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.260608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3e71e38-4048-4dcc-b16e-26b5d8ee067a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.261380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3e71e38-4048-4dcc-b16e-26b5d8ee067a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.597866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b3e71e38-4048-4dcc-b16e-26b5d8ee067a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:35.618257 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b3e71e38-4048-4dcc-b16e-26b5d8ee067a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1318 microversion: 2.1 time: 0.393066 Jul 20 04:41:35.618894 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2793/5680] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:35 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:36.637199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b858b4e8-219b-407b-9566-1607544dc821 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:36.638837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b858b4e8-219b-407b-9566-1607544dc821 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:36.657123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b858b4e8-219b-407b-9566-1607544dc821 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:36.657805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b858b4e8-219b-407b-9566-1607544dc821 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:36.658991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b858b4e8-219b-407b-9566-1607544dc821 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:36.660871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b858b4e8-219b-407b-9566-1607544dc821 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:37.268326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b858b4e8-219b-407b-9566-1607544dc821 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:37.290190 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b858b4e8-219b-407b-9566-1607544dc821 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1318 microversion: 2.1 time: 0.657303 Jul 20 04:41:37.290190 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2888/5681] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:36 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1318 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:38.307345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a292f386-e458-404e-911b-157781261d11 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:38.308122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a292f386-e458-404e-911b-157781261d11 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:38.337380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a292f386-e458-404e-911b-157781261d11 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:38.337867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a292f386-e458-404e-911b-157781261d11 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:38.341051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a292f386-e458-404e-911b-157781261d11 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:38.342128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a292f386-e458-404e-911b-157781261d11 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:38.808328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:38.839978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:39.283054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a292f386-e458-404e-911b-157781261d11 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:39.363318 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a292f386-e458-404e-911b-157781261d11 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1318 microversion: 2.1 time: 1.059772 Jul 20 04:41:39.367291 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2794/5682] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:38 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1318 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:40.387152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-633f0f01-63d1-4e4f-bc7b-225f740f9bd6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:40.387800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-633f0f01-63d1-4e4f-bc7b-225f740f9bd6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:40.392108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:40.413888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-633f0f01-63d1-4e4f-bc7b-225f740f9bd6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:40.414546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-633f0f01-63d1-4e4f-bc7b-225f740f9bd6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:40.415589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-633f0f01-63d1-4e4f-bc7b-225f740f9bd6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:40.416200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-633f0f01-63d1-4e4f-bc7b-225f740f9bd6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:41.101879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-633f0f01-63d1-4e4f-bc7b-225f740f9bd6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:41.118080 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-633f0f01-63d1-4e4f-bc7b-225f740f9bd6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1318 microversion: 2.1 time: 0.737255 Jul 20 04:41:41.118692 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2889/5683] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:40 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1318 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:42.136538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-70ffaa33-1870-49e3-a764-716479c48846 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:42.137213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-70ffaa33-1870-49e3-a764-716479c48846 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:42.155434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-70ffaa33-1870-49e3-a764-716479c48846 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:42.159626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-70ffaa33-1870-49e3-a764-716479c48846 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:42.160710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-70ffaa33-1870-49e3-a764-716479c48846 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:42.162782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-70ffaa33-1870-49e3-a764-716479c48846 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:42.656314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-70ffaa33-1870-49e3-a764-716479c48846 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:42.665269 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-70ffaa33-1870-49e3-a764-716479c48846 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1318 microversion: 2.1 time: 0.532272 Jul 20 04:41:42.675625 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2795/5684] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:42 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:43.692642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d6b3fd82-2777-4e74-ba8e-d065dbf8ae5b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:43.696392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d6b3fd82-2777-4e74-ba8e-d065dbf8ae5b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:43.720169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6b3fd82-2777-4e74-ba8e-d065dbf8ae5b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:43.727008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6b3fd82-2777-4e74-ba8e-d065dbf8ae5b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:43.728719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6b3fd82-2777-4e74-ba8e-d065dbf8ae5b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:43.735309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6b3fd82-2777-4e74-ba8e-d065dbf8ae5b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.148073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d6b3fd82-2777-4e74-ba8e-d065dbf8ae5b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:44.160800 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d6b3fd82-2777-4e74-ba8e-d065dbf8ae5b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1318 microversion: 2.1 time: 0.477659 Jul 20 04:41:44.161665 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2890/5685] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:43 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:45.188774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ce1b9cb-d6b7-4658-8467-74ba688f5057 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:45.192982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ce1b9cb-d6b7-4658-8467-74ba688f5057 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:45.236178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ce1b9cb-d6b7-4658-8467-74ba688f5057 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.248542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ce1b9cb-d6b7-4658-8467-74ba688f5057 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.249506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ce1b9cb-d6b7-4658-8467-74ba688f5057 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.249986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ce1b9cb-d6b7-4658-8467-74ba688f5057 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.447421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ce1b9cb-d6b7-4658-8467-74ba688f5057 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:46.461658 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ce1b9cb-d6b7-4658-8467-74ba688f5057 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1318 microversion: 2.1 time: 1.287273 Jul 20 04:41:46.470736 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2796/5686] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:45 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1318 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:47.227044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-704883cc-acec-4007-a889-09e6bcb52566 req-f402db01-30ca-45a9-a6c0-33797fc11918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2306ea05-0e30-4750-883f-aee66bcd03ef", "name": "network-vif-plugged", "status": "completed", "tag": "ce3c1e3c-4e71-4c76-b40f-c2111256776e"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:47.254785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-704883cc-acec-4007-a889-09e6bcb52566 req-f402db01-30ca-45a9-a6c0-33797fc11918 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.255572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-704883cc-acec-4007-a889-09e6bcb52566 req-f402db01-30ca-45a9-a6c0-33797fc11918 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:47.289148 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-704883cc-acec-4007-a889-09e6bcb52566 req-f402db01-30ca-45a9-a6c0-33797fc11918 service nova] Creating event network-vif-plugged:ce3c1e3c-4e71-4c76-b40f-c2111256776e for instance 2306ea05-0e30-4750-883f-aee66bcd03ef on n-h2-764485-11 Jul 20 04:41:47.297925 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-704883cc-acec-4007-a889-09e6bcb52566 req-f402db01-30ca-45a9-a6c0-33797fc11918 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.460862 Jul 20 04:41:47.298561 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2891/5687] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:47.485205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8e388b3b-e6e6-463d-898b-63e4c8ba32d1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:47.488827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8e388b3b-e6e6-463d-898b-63e4c8ba32d1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:47.524633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e388b3b-e6e6-463d-898b-63e4c8ba32d1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.524633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e388b3b-e6e6-463d-898b-63e4c8ba32d1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:47.524633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e388b3b-e6e6-463d-898b-63e4c8ba32d1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.524633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e388b3b-e6e6-463d-898b-63e4c8ba32d1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:48.344597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8e388b3b-e6e6-463d-898b-63e4c8ba32d1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:48.368306 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8e388b3b-e6e6-463d-898b-63e4c8ba32d1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1318 microversion: 2.1 time: 0.888125 Jul 20 04:41:48.369473 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2797/5688] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:47 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1318 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:49.386134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9bd741d6-49bd-46a5-91d8-baa5aeedd6f3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:49.386864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9bd741d6-49bd-46a5-91d8-baa5aeedd6f3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:49.409616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bd741d6-49bd-46a5-91d8-baa5aeedd6f3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.411501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bd741d6-49bd-46a5-91d8-baa5aeedd6f3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.412345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bd741d6-49bd-46a5-91d8-baa5aeedd6f3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.412812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bd741d6-49bd-46a5-91d8-baa5aeedd6f3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.111097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9bd741d6-49bd-46a5-91d8-baa5aeedd6f3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:50.123174 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9bd741d6-49bd-46a5-91d8-baa5aeedd6f3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1318 microversion: 2.1 time: 0.741315 Jul 20 04:41:50.127817 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2892/5689] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:49 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1318 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:51.145821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4e316d14-62d4-46b3-9963-f7aa75289ce6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:51.146451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4e316d14-62d4-46b3-9963-f7aa75289ce6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:51.159718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e316d14-62d4-46b3-9963-f7aa75289ce6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:51.167866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e316d14-62d4-46b3-9963-f7aa75289ce6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:51.169285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e316d14-62d4-46b3-9963-f7aa75289ce6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:51.170017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e316d14-62d4-46b3-9963-f7aa75289ce6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:51.845837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4e316d14-62d4-46b3-9963-f7aa75289ce6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:51.863366 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4e316d14-62d4-46b3-9963-f7aa75289ce6 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1508 microversion: 2.1 time: 0.722702 Jul 20 04:41:51.867833 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2798/5690] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:51 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1508 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:09.234286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e6125ad7-70f0-4572-8889-c8a37e54bc0e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:09.234914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e6125ad7-70f0-4572-8889-c8a37e54bc0e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:09.245872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=18 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:09.253588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=34 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:09.260607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6125ad7-70f0-4572-8889-c8a37e54bc0e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:09.261063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6125ad7-70f0-4572-8889-c8a37e54bc0e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:09.266888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6125ad7-70f0-4572-8889-c8a37e54bc0e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:09.267420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6125ad7-70f0-4572-8889-c8a37e54bc0e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:09.370653 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e6125ad7-70f0-4572-8889-c8a37e54bc0e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d/ips" status: 200 len: 149 microversion: 2.1 time: 0.140659 Jul 20 04:42:09.373443 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2893/5691] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:42:09 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d/ips => generated 149 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:42:09.382862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c42dfa1-e41d-41c3-abca-69e8ba214acf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86983adb-4cd2-4c21-9265-9eff6833ac34"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:09.384843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4c42dfa1-e41d-41c3-abca-69e8ba214acf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:09.396216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:09.406253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=50 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:09.408666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c42dfa1-e41d-41c3-abca-69e8ba214acf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:09.411592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c42dfa1-e41d-41c3-abca-69e8ba214acf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:09.412681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c42dfa1-e41d-41c3-abca-69e8ba214acf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:09.413283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c42dfa1-e41d-41c3-abca-69e8ba214acf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:09.639635 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-4c42dfa1-e41d-41c3-abca-69e8ba214acf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Invalid volume: volume 86983adb-4cd2-4c21-9265-9eff6833ac34 is already attached to instances: f60434b5-42e4-4695-bfdb-66aaaa6d394a Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c42dfa1-e41d-41c3-abca-69e8ba214acf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d/os-volume_attachments HTTP/1.1 Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 74 Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: {"volumeAttachment": {"volumeId": "86983adb-4cd2-4c21-9265-9eff6833ac34"}} Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: exception: Invalid volume: volume 86983adb-4cd2-4c21-9265-9eff6833ac34 is already attached to instances: f60434b5-42e4-4695-bfdb-66aaaa6d394a Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'server_id': '4720cce2-ac73-4a0d-b54e-996065a5f45d', 'body': {'volumeAttachment': {'volumeId': '86983adb-4cd2-4c21-9265-9eff6833ac34'}}} Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 86983adb-4cd2-4c21-9265-9eff6833ac34 is already attached to instances: f60434b5-42e4-4695-bfdb-66aaaa6d394a Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:42:09.641737 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 86983adb-4cd2-4c21-9265-9eff6833ac34 is already attached to instances: f60434b5-42e4-4695-bfdb-66aaaa6d394a Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 86983adb-4cd2-4c21-9265-9eff6833ac34 is already attached to instances: f60434b5-42e4-4695-bfdb-66aaaa6d394a Jul 20 04:42:09.646577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:42:09.657476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c42dfa1-e41d-41c3-abca-69e8ba214acf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 400 to user: Invalid volume: volume 86983adb-4cd2-4c21-9265-9eff6833ac34 is already attached to instances: f60434b5-42e4-4695-bfdb-66aaaa6d394a {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:09.659301 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4c42dfa1-e41d-41c3-abca-69e8ba214acf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.280588 Jul 20 04:42:09.660764 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2799/5692] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:42:09 2022] POST /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d/os-volume_attachments => generated 174 bytes in 283 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:42:09.671337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-744e1be2-debf-4d52-9946-aaa543d1f6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:09.671984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-744e1be2-debf-4d52-9946-aaa543d1f6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:09.683731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-744e1be2-debf-4d52-9946-aaa543d1f6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:09.684186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-744e1be2-debf-4d52-9946-aaa543d1f6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:09.691248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-744e1be2-debf-4d52-9946-aaa543d1f6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:09.691843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-744e1be2-debf-4d52-9946-aaa543d1f6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:09.792960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-744e1be2-debf-4d52-9946-aaa543d1f6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:42:10.003552 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-744e1be2-debf-4d52-9946-aaa543d1f6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 204 len: 0 microversion: 2.1 time: 0.320942 Jul 20 04:42:10.003552 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2894/5693] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:09 2022] DELETE /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:42:10.011063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2e81c4f9-8722-4a06-bc54-901858d852d4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:10.012003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2e81c4f9-8722-4a06-bc54-901858d852d4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:10.026328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e81c4f9-8722-4a06-bc54-901858d852d4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:10.033307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e81c4f9-8722-4a06-bc54-901858d852d4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:10.035153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e81c4f9-8722-4a06-bc54-901858d852d4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:10.036962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e81c4f9-8722-4a06-bc54-901858d852d4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:10.797921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2e81c4f9-8722-4a06-bc54-901858d852d4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:10.809039 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2e81c4f9-8722-4a06-bc54-901858d852d4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1680 microversion: 2.1 time: 0.802760 Jul 20 04:42:10.816059 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2800/5694] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:10 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1680 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:11.834067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a10bf5a-d732-4674-8c15-aa4d082eb394 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:11.835042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7a10bf5a-d732-4674-8c15-aa4d082eb394 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:11.844762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a10bf5a-d732-4674-8c15-aa4d082eb394 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:11.874585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a10bf5a-d732-4674-8c15-aa4d082eb394 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:11.875436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a10bf5a-d732-4674-8c15-aa4d082eb394 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:11.875903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a10bf5a-d732-4674-8c15-aa4d082eb394 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:12.263031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7a10bf5a-d732-4674-8c15-aa4d082eb394 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:12.276929 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7a10bf5a-d732-4674-8c15-aa4d082eb394 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1680 microversion: 2.1 time: 0.447421 Jul 20 04:42:12.290837 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2895/5695] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:11 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1680 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:13.298998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6f402aed-19d1-46cb-bee0-b05b849d9f3d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:13.299983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6f402aed-19d1-46cb-bee0-b05b849d9f3d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:13.324398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f402aed-19d1-46cb-bee0-b05b849d9f3d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:13.325147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f402aed-19d1-46cb-bee0-b05b849d9f3d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:13.331649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f402aed-19d1-46cb-bee0-b05b849d9f3d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:13.334653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f402aed-19d1-46cb-bee0-b05b849d9f3d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:14.146581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6f402aed-19d1-46cb-bee0-b05b849d9f3d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:14.160201 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6f402aed-19d1-46cb-bee0-b05b849d9f3d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1680 microversion: 2.1 time: 0.866498 Jul 20 04:42:14.161014 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2801/5696] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:13 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1680 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:15.181531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-20caf09b-37be-40a3-a41e-89a0608767ca tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:15.182689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-20caf09b-37be-40a3-a41e-89a0608767ca tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:15.201871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20caf09b-37be-40a3-a41e-89a0608767ca tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:15.202242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20caf09b-37be-40a3-a41e-89a0608767ca tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:15.208637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20caf09b-37be-40a3-a41e-89a0608767ca tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:15.209091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20caf09b-37be-40a3-a41e-89a0608767ca tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:15.427860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-20caf09b-37be-40a3-a41e-89a0608767ca tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:15.437149 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-20caf09b-37be-40a3-a41e-89a0608767ca tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1612 microversion: 2.1 time: 0.260142 Jul 20 04:42:15.443359 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2896/5697] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:15 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1612 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:16.315459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a7b201ed-fa5f-486b-8373-cef4bada7396 req-69d03b0c-552b-44f1-8504-fed07500da6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4720cce2-ac73-4a0d-b54e-996065a5f45d", "name": "network-vif-deleted", "tag": "c929cf81-71ab-4d72-aaa1-825202468cd6"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:16.333322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a7b201ed-fa5f-486b-8373-cef4bada7396 req-69d03b0c-552b-44f1-8504-fed07500da6c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:16.334077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a7b201ed-fa5f-486b-8373-cef4bada7396 req-69d03b0c-552b-44f1-8504-fed07500da6c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:16.373595 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a7b201ed-fa5f-486b-8373-cef4bada7396 req-69d03b0c-552b-44f1-8504-fed07500da6c service nova] Creating event network-vif-deleted:c929cf81-71ab-4d72-aaa1-825202468cd6 for instance 4720cce2-ac73-4a0d-b54e-996065a5f45d on n-h1-764485-11 Jul 20 04:42:16.385417 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a7b201ed-fa5f-486b-8373-cef4bada7396 req-69d03b0c-552b-44f1-8504-fed07500da6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073425 Jul 20 04:42:16.391404 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2802/5698] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:16.456455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-35bddd4c-3ffd-4957-86d1-1400b275e073 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:16.457660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-35bddd4c-3ffd-4957-86d1-1400b275e073 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:16.471190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35bddd4c-3ffd-4957-86d1-1400b275e073 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:16.475057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35bddd4c-3ffd-4957-86d1-1400b275e073 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:16.476407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35bddd4c-3ffd-4957-86d1-1400b275e073 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:16.477009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35bddd4c-3ffd-4957-86d1-1400b275e073 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:16.666598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-35bddd4c-3ffd-4957-86d1-1400b275e073 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:16.681871 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-35bddd4c-3ffd-4957-86d1-1400b275e073 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 200 len: 1325 microversion: 2.1 time: 0.229588 Jul 20 04:42:16.682717 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2897/5699] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:16 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 1325 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:17.700286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3901d17c-bc9e-4a77-a3a2-e97ea42b9c2e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:17.701162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3901d17c-bc9e-4a77-a3a2-e97ea42b9c2e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:17.710384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3901d17c-bc9e-4a77-a3a2-e97ea42b9c2e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:17.728178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3901d17c-bc9e-4a77-a3a2-e97ea42b9c2e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:17.729295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3901d17c-bc9e-4a77-a3a2-e97ea42b9c2e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:17.729859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3901d17c-bc9e-4a77-a3a2-e97ea42b9c2e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:17.773924 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-3901d17c-bc9e-4a77-a3a2-e97ea42b9c2e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3901d17c-bc9e-4a77-a3a2-e97ea42b9c2e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d HTTP/1.1 Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '4720cce2-ac73-4a0d-b54e-996065a5f45d'} Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:17.785578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:42:17.789731 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:17.789731 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:17.789731 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:17.789731 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:17.789731 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:17.789731 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:42:17.789731 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:42:17.791948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3901d17c-bc9e-4a77-a3a2-e97ea42b9c2e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 404 to user: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:17.792963 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3901d17c-bc9e-4a77-a3a2-e97ea42b9c2e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 404 len: 111 microversion: 2.1 time: 0.097065 Jul 20 04:42:17.793671 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2803/5700] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:17 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:17.802618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57994929-e08b-4785-8440-6f5e6d76a44d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '.version_select at 0x7fbf9c24a550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:17.856995 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57994929-e08b-4785-8440-6f5e6d76a44d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964500984" status: 202 len: 0 microversion: 2.1 time: 0.058168 Jul 20 04:42:17.862156 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2898/5701] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 20 04:42:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964500984 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:42:21.222534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-49352c54-f328-426b-bb2b-9584bea1cbe4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:21.223213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-49352c54-f328-426b-bb2b-9584bea1cbe4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:21.243631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49352c54-f328-426b-bb2b-9584bea1cbe4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:21.245610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49352c54-f328-426b-bb2b-9584bea1cbe4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:21.246479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49352c54-f328-426b-bb2b-9584bea1cbe4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:21.247826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49352c54-f328-426b-bb2b-9584bea1cbe4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:21.555489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-49352c54-f328-426b-bb2b-9584bea1cbe4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lazy-loading 'services' on Instance uuid f60434b5-42e4-4695-bfdb-66aaaa6d394a {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:42:21.717290 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-49352c54-f328-426b-bb2b-9584bea1cbe4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments/86983adb-4cd2-4c21-9265-9eff6833ac34" status: 202 len: 0 microversion: 2.1 time: 0.500196 Jul 20 04:42:21.721385 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2804/5702] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:42:21 2022] DELETE /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments/86983adb-4cd2-4c21-9265-9eff6833ac34 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:42:21.727614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88e37272-1b6f-4528-8d56-203cef571a27 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:21.728864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88e37272-1b6f-4528-8d56-203cef571a27 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:21.766516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88e37272-1b6f-4528-8d56-203cef571a27 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:21.769561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88e37272-1b6f-4528-8d56-203cef571a27 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:21.775740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88e37272-1b6f-4528-8d56-203cef571a27 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:21.778132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88e37272-1b6f-4528-8d56-203cef571a27 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:21.997725 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88e37272-1b6f-4528-8d56-203cef571a27 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.274811 Jul 20 04:42:22.005679 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2899/5703] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:42:21 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments => generated 197 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:23.033798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-461db5a1-e573-4496-8aa0-5f8b04948d76 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:23.035616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-461db5a1-e573-4496-8aa0-5f8b04948d76 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:23.051972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-461db5a1-e573-4496-8aa0-5f8b04948d76 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:23.052697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-461db5a1-e573-4496-8aa0-5f8b04948d76 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:23.053736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-461db5a1-e573-4496-8aa0-5f8b04948d76 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:23.063219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-461db5a1-e573-4496-8aa0-5f8b04948d76 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:23.130645 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-461db5a1-e573-4496-8aa0-5f8b04948d76 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118296 Jul 20 04:42:23.140119 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2805/5704] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:42:23 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:24.147455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-095f3392-8695-4830-a75e-344f46349bd3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:24.149051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-095f3392-8695-4830-a75e-344f46349bd3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:24.170170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-095f3392-8695-4830-a75e-344f46349bd3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:24.173808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-095f3392-8695-4830-a75e-344f46349bd3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:24.174800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-095f3392-8695-4830-a75e-344f46349bd3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:24.177724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-095f3392-8695-4830-a75e-344f46349bd3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:24.282918 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-095f3392-8695-4830-a75e-344f46349bd3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139362 Jul 20 04:42:24.283557 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2900/5705] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:42:24 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:25.295566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cfddfcad-86f0-4485-98fb-9b7748b0b621 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:25.296773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cfddfcad-86f0-4485-98fb-9b7748b0b621 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:25.329579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfddfcad-86f0-4485-98fb-9b7748b0b621 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:25.330204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfddfcad-86f0-4485-98fb-9b7748b0b621 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:25.331198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfddfcad-86f0-4485-98fb-9b7748b0b621 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:25.331843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfddfcad-86f0-4485-98fb-9b7748b0b621 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:25.408002 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cfddfcad-86f0-4485-98fb-9b7748b0b621 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117409 Jul 20 04:42:25.409018 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2806/5706] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:42:25 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:26.426141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b778ae0-9252-439b-b252-d40e062df719 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:26.426141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5b778ae0-9252-439b-b252-d40e062df719 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:26.438267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b778ae0-9252-439b-b252-d40e062df719 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:26.442239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b778ae0-9252-439b-b252-d40e062df719 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:26.442239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b778ae0-9252-439b-b252-d40e062df719 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:26.443933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b778ae0-9252-439b-b252-d40e062df719 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:26.522398 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5b778ae0-9252-439b-b252-d40e062df719 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101155 Jul 20 04:42:26.523566 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2901/5707] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:42:26 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:42:27.535600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-482c3956-41ff-4a78-a1e7-5166e3105025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:27.544328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-482c3956-41ff-4a78-a1e7-5166e3105025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:27.557567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-482c3956-41ff-4a78-a1e7-5166e3105025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:27.559646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-482c3956-41ff-4a78-a1e7-5166e3105025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:27.561038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-482c3956-41ff-4a78-a1e7-5166e3105025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:27.562316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-482c3956-41ff-4a78-a1e7-5166e3105025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:27.679677 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-482c3956-41ff-4a78-a1e7-5166e3105025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143993 Jul 20 04:42:27.684022 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2807/5708] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:42:27 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:28.694487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8770e182-8f97-4e1e-bbfb-55b9321d3577 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:28.695431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8770e182-8f97-4e1e-bbfb-55b9321d3577 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:28.714168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8770e182-8f97-4e1e-bbfb-55b9321d3577 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.714664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8770e182-8f97-4e1e-bbfb-55b9321d3577 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.716084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8770e182-8f97-4e1e-bbfb-55b9321d3577 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.716679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8770e182-8f97-4e1e-bbfb-55b9321d3577 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.777057 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8770e182-8f97-4e1e-bbfb-55b9321d3577 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086537 Jul 20 04:42:28.783485 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2902/5709] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:42:28 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:29.208213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-11e97180-e052-4995-8358-259e067f9c01 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bec1cbfe-3e02-466e-b1a1-74c29044e30c", "device": "/dev/sdb"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:29.209266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-11e97180-e052-4995-8358-259e067f9c01 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:29.231603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11e97180-e052-4995-8358-259e067f9c01 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.232806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11e97180-e052-4995-8358-259e067f9c01 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.234058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11e97180-e052-4995-8358-259e067f9c01 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.234676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11e97180-e052-4995-8358-259e067f9c01 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.728719 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-11e97180-e052-4995-8358-259e067f9c01 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "POST /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.524739 Jul 20 04:42:29.734602 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2808/5710] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:42:29 2022] POST /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:29.794136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b76acd01-38df-4391-862e-5ed14d11dae9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:29.796410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b76acd01-38df-4391-862e-5ed14d11dae9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:29.819350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b76acd01-38df-4391-862e-5ed14d11dae9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.820110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b76acd01-38df-4391-862e-5ed14d11dae9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.823621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b76acd01-38df-4391-862e-5ed14d11dae9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.827840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b76acd01-38df-4391-862e-5ed14d11dae9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.933312 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b76acd01-38df-4391-862e-5ed14d11dae9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147294 Jul 20 04:42:29.935100 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2903/5711] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:42:29 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:30.946277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e02f9d3-0548-41cb-8c13-ff0477d03956 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:30.947388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7e02f9d3-0548-41cb-8c13-ff0477d03956 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:30.977912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e02f9d3-0548-41cb-8c13-ff0477d03956 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.985024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e02f9d3-0548-41cb-8c13-ff0477d03956 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.991469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e02f9d3-0548-41cb-8c13-ff0477d03956 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.992006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e02f9d3-0548-41cb-8c13-ff0477d03956 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:31.149154 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7e02f9d3-0548-41cb-8c13-ff0477d03956 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203857 Jul 20 04:42:31.167910 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2809/5712] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:42:30 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:32.172553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-43e58b9c-2251-4c73-807f-3cdc8394394a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:32.174208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-43e58b9c-2251-4c73-807f-3cdc8394394a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:32.189430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43e58b9c-2251-4c73-807f-3cdc8394394a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:32.189901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43e58b9c-2251-4c73-807f-3cdc8394394a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:32.194048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43e58b9c-2251-4c73-807f-3cdc8394394a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:32.194528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43e58b9c-2251-4c73-807f-3cdc8394394a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:32.270785 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-43e58b9c-2251-4c73-807f-3cdc8394394a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102240 Jul 20 04:42:32.277041 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2904/5713] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:42:32 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:33.295163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-03df012e-7953-49fd-8ea3-1e99913df8ae tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:33.296173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-03df012e-7953-49fd-8ea3-1e99913df8ae tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:33.341979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03df012e-7953-49fd-8ea3-1e99913df8ae tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:33.342895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03df012e-7953-49fd-8ea3-1e99913df8ae tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:33.345608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03df012e-7953-49fd-8ea3-1e99913df8ae tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:33.347542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03df012e-7953-49fd-8ea3-1e99913df8ae tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:33.487318 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-03df012e-7953-49fd-8ea3-1e99913df8ae tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.204884 Jul 20 04:42:33.487318 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2810/5714] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:42:33 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a/os-volume_attachments => generated 25 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:42:33.662303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4aadbc97-874d-4ffa-a09d-592aae198e06 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:33.662840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4aadbc97-874d-4ffa-a09d-592aae198e06 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:33.686262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aadbc97-874d-4ffa-a09d-592aae198e06 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:33.690205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aadbc97-874d-4ffa-a09d-592aae198e06 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:33.691244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aadbc97-874d-4ffa-a09d-592aae198e06 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:33.691904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aadbc97-874d-4ffa-a09d-592aae198e06 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:33.755279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4aadbc97-874d-4ffa-a09d-592aae198e06 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:42:33.947690 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4aadbc97-874d-4ffa-a09d-592aae198e06 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 204 len: 0 microversion: 2.1 time: 0.286911 Jul 20 04:42:33.954413 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2905/5715] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:33 2022] DELETE /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:42:33.959690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-625e5adc-29aa-4fbd-82b3-ebd4af8ae709 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:33.960600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-625e5adc-29aa-4fbd-82b3-ebd4af8ae709 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:33.972240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-625e5adc-29aa-4fbd-82b3-ebd4af8ae709 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:33.976356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-625e5adc-29aa-4fbd-82b3-ebd4af8ae709 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:33.977440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-625e5adc-29aa-4fbd-82b3-ebd4af8ae709 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:33.978042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-625e5adc-29aa-4fbd-82b3-ebd4af8ae709 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:34.720819 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-625e5adc-29aa-4fbd-82b3-ebd4af8ae709 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:34.740244 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-625e5adc-29aa-4fbd-82b3-ebd4af8ae709 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1680 microversion: 2.1 time: 0.782128 Jul 20 04:42:34.740244 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2811/5716] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:33 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1680 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:35.759833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67479baf-f10a-4529-9e47-959a48036255 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.761213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67479baf-f10a-4529-9e47-959a48036255 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:35.787964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67479baf-f10a-4529-9e47-959a48036255 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.788706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67479baf-f10a-4529-9e47-959a48036255 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.797237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67479baf-f10a-4529-9e47-959a48036255 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.798670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67479baf-f10a-4529-9e47-959a48036255 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.931560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67479baf-f10a-4529-9e47-959a48036255 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:36.946127 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67479baf-f10a-4529-9e47-959a48036255 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1680 microversion: 2.1 time: 1.190815 Jul 20 04:42:36.954781 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2906/5717] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1680 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:37.967154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8381b273-b6fe-4727-a72b-1c0e23beaf74 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:37.969017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8381b273-b6fe-4727-a72b-1c0e23beaf74 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:37.990687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8381b273-b6fe-4727-a72b-1c0e23beaf74 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.995401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8381b273-b6fe-4727-a72b-1c0e23beaf74 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:38.001044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8381b273-b6fe-4727-a72b-1c0e23beaf74 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:38.003093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8381b273-b6fe-4727-a72b-1c0e23beaf74 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:38.414669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8381b273-b6fe-4727-a72b-1c0e23beaf74 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:38.433616 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8381b273-b6fe-4727-a72b-1c0e23beaf74 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1612 microversion: 2.1 time: 0.467548 Jul 20 04:42:38.445564 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2812/5718] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:37 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1612 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:39.271558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6dfc11a7-f59c-4f83-a5bc-65c4d718f579 req-9727754b-6a1f-4bd7-b67d-c2e3f2cc38ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60434b5-42e4-4695-bfdb-66aaaa6d394a", "name": "network-vif-deleted", "tag": "58e6d4c6-d1bb-452d-8bc3-df51748f77ae"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:39.278107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:39.325903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6dfc11a7-f59c-4f83-a5bc-65c4d718f579 req-9727754b-6a1f-4bd7-b67d-c2e3f2cc38ed service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:39.326355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6dfc11a7-f59c-4f83-a5bc-65c4d718f579 req-9727754b-6a1f-4bd7-b67d-c2e3f2cc38ed service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.349843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:39.374496 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6dfc11a7-f59c-4f83-a5bc-65c4d718f579 req-9727754b-6a1f-4bd7-b67d-c2e3f2cc38ed service nova] Creating event network-vif-deleted:58e6d4c6-d1bb-452d-8bc3-df51748f77ae for instance f60434b5-42e4-4695-bfdb-66aaaa6d394a on n-h1-764485-11 Jul 20 04:42:39.406104 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6dfc11a7-f59c-4f83-a5bc-65c4d718f579 req-9727754b-6a1f-4bd7-b67d-c2e3f2cc38ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136319 Jul 20 04:42:39.406746 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2907/5719] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:39.452811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-edfdf7f6-b556-4b62-829c-0068f3bf4c04 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:39.454041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-edfdf7f6-b556-4b62-829c-0068f3bf4c04 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:39.464090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edfdf7f6-b556-4b62-829c-0068f3bf4c04 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:39.475376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edfdf7f6-b556-4b62-829c-0068f3bf4c04 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.476738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edfdf7f6-b556-4b62-829c-0068f3bf4c04 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:39.477363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edfdf7f6-b556-4b62-829c-0068f3bf4c04 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.480756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:39.690815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-edfdf7f6-b556-4b62-829c-0068f3bf4c04 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:39.700133 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-edfdf7f6-b556-4b62-829c-0068f3bf4c04 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 200 len: 1325 microversion: 2.1 time: 0.251931 Jul 20 04:42:39.716433 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2813/5720] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:39 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:40.786456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9f4cf458-f1a2-4e38-8dd9-38acd6edcf6c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:40.787815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9f4cf458-f1a2-4e38-8dd9-38acd6edcf6c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:40.829684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f4cf458-f1a2-4e38-8dd9-38acd6edcf6c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.830158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f4cf458-f1a2-4e38-8dd9-38acd6edcf6c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.836143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f4cf458-f1a2-4e38-8dd9-38acd6edcf6c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.838065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f4cf458-f1a2-4e38-8dd9-38acd6edcf6c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.861311 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-9f4cf458-f1a2-4e38-8dd9-38acd6edcf6c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9f4cf458-f1a2-4e38-8dd9-38acd6edcf6c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a HTTP/1.1 Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'f60434b5-42e4-4695-bfdb-66aaaa6d394a'} Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:40.864128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:42:40.868153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:40.868153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:40.868153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:40.868153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:40.868153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:40.868153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:42:40.868153 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:42:40.868153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9f4cf458-f1a2-4e38-8dd9-38acd6edcf6c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 404 to user: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:40.868153 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9f4cf458-f1a2-4e38-8dd9-38acd6edcf6c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 404 len: 111 microversion: 2.1 time: 0.141073 Jul 20 04:42:40.868153 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2908/5721] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:40 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:40.892219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6fe0fdcd-df4d-4e7b-bb28-ae32588d13a2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '.version_select at 0x7fbf9c07cb80>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:40.920178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=31 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:40.964176 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6fe0fdcd-df4d-4e7b-bb28-ae32588d13a2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-251516566" status: 202 len: 0 microversion: 2.1 time: 0.077896 Jul 20 04:42:40.966201 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2814/5722] 10.222.0.20 () {58 vars in 1217 bytes} [Wed Jul 20 04:42:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-251516566 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:42:43.174071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7d07286b-8592-4dfc-833e-93fbf1cae9c8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: .version_select at 0x7fbf9c04aca0>, body: {"keypair": {"name": "tempest-keypair-1910856026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVGifIn4t6Pkz+c6ChKu/R/VHjEhZs3KOSoEnyYdmVW/7kFuvRrmHCD+gicFlGc6T2aWGU6ED5F6CJJDJHeDy47j85dtkhaNDk/27ltBXpu2twg+pPTn1wnNo3umIxaiQ=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:43.348875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-7d07286b-8592-4dfc-833e-93fbf1cae9c8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:42:43.389940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-7d07286b-8592-4dfc-833e-93fbf1cae9c8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for user 8759015052b64df2b36efb694b837999 and project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:42:43.524304 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7d07286b-8592-4dfc-833e-93fbf1cae9c8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.354532 Jul 20 04:42:43.529261 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2909/5723] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:42:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:46.596523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1456630315", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ee66832-4e3e-4ea5-b8c6-0e6625557ba2"}], "security_groups": [{"name": "tempest-securitygroup--682814390"}], "key_name": "tempest-keypair-1910856026", "user_data": "}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:46.871674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] validate_networks() for [('5ee66832-4e3e-4ea5-b8c6-0e6625557ba2', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:42:48.050484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:42:48.051136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:42:48.051377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:42:48.061639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:42:48.062389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:42:48.084559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.085010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.088795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.091297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.176346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:42:48.213019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for user 8759015052b64df2b36efb694b837999 and project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:42:48.252660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:42:48.256052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:42:48.347116 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7e39c29d-2f53-4fee-bbf9-bc16b5261fcb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.755695 Jul 20 04:42:48.354259 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2815/5724] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:42:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:42:48.360770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1d8c4707-a76e-4b76-89d3-e1fce776f159 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:48.362379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1d8c4707-a76e-4b76-89d3-e1fce776f159 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:48.661120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1d8c4707-a76e-4b76-89d3-e1fce776f159 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:48.675589 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1d8c4707-a76e-4b76-89d3-e1fce776f159 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1242 microversion: 2.1 time: 0.320917 Jul 20 04:42:48.690377 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2910/5725] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:48 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1242 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:49.697895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0e2885f0-0207-4e30-be7f-c81df85a766b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:49.698512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0e2885f0-0207-4e30-be7f-c81df85a766b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:49.719027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e2885f0-0207-4e30-be7f-c81df85a766b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.721140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e2885f0-0207-4e30-be7f-c81df85a766b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:49.723326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e2885f0-0207-4e30-be7f-c81df85a766b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.724264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0e2885f0-0207-4e30-be7f-c81df85a766b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:50.094682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0e2885f0-0207-4e30-be7f-c81df85a766b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:50.104579 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0e2885f0-0207-4e30-be7f-c81df85a766b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1238 microversion: 2.1 time: 0.412151 Jul 20 04:42:50.115412 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2816/5726] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:49 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1238 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:51.122742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-778c9397-94cc-4a8a-87da-049a80436b1f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:51.124585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-778c9397-94cc-4a8a-87da-049a80436b1f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:51.137800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:51.151718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-778c9397-94cc-4a8a-87da-049a80436b1f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.152925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-778c9397-94cc-4a8a-87da-049a80436b1f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.154115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-778c9397-94cc-4a8a-87da-049a80436b1f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:51.154725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-778c9397-94cc-4a8a-87da-049a80436b1f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.393707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-778c9397-94cc-4a8a-87da-049a80436b1f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:51.403406 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-778c9397-94cc-4a8a-87da-049a80436b1f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1300 microversion: 2.1 time: 0.284282 Jul 20 04:42:51.416652 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2911/5727] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:51 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1300 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:52.425764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b03f71d-060b-42d9-a2d8-23b5f18b78e6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:52.426459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0b03f71d-060b-42d9-a2d8-23b5f18b78e6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:52.438201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b03f71d-060b-42d9-a2d8-23b5f18b78e6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:52.441472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b03f71d-060b-42d9-a2d8-23b5f18b78e6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:52.443433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b03f71d-060b-42d9-a2d8-23b5f18b78e6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:52.451941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b03f71d-060b-42d9-a2d8-23b5f18b78e6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:53.544298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0b03f71d-060b-42d9-a2d8-23b5f18b78e6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:53.579757 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0b03f71d-060b-42d9-a2d8-23b5f18b78e6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1300 microversion: 2.1 time: 1.158851 Jul 20 04:42:53.592345 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2817/5728] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:52 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1300 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:54.610759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3d8d7c82-f74e-4224-a7d1-2ae9127d5ab5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:54.611209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3d8d7c82-f74e-4224-a7d1-2ae9127d5ab5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:54.643440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d8d7c82-f74e-4224-a7d1-2ae9127d5ab5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:54.644218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d8d7c82-f74e-4224-a7d1-2ae9127d5ab5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:54.645248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d8d7c82-f74e-4224-a7d1-2ae9127d5ab5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:54.645915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3d8d7c82-f74e-4224-a7d1-2ae9127d5ab5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:55.591467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3d8d7c82-f74e-4224-a7d1-2ae9127d5ab5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:55.605409 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3d8d7c82-f74e-4224-a7d1-2ae9127d5ab5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1367 microversion: 2.1 time: 1.009113 Jul 20 04:42:55.606695 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2912/5729] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:54 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1367 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:56.640102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a3ddf2a-d1e2-4491-acc3-1706bc5e2c60 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:56.645829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a3ddf2a-d1e2-4491-acc3-1706bc5e2c60 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:56.670376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a3ddf2a-d1e2-4491-acc3-1706bc5e2c60 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:56.672290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a3ddf2a-d1e2-4491-acc3-1706bc5e2c60 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:56.673630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a3ddf2a-d1e2-4491-acc3-1706bc5e2c60 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:56.674847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a3ddf2a-d1e2-4491-acc3-1706bc5e2c60 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:57.914524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4a64ea3c-039b-4527-b67a-bcfbb0f06bf7 req-57d34f56-c66c-4764-8f29-1b982b425da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01009a01-6369-4508-97a4-1ed09bbd90a6", "tag": "63f5a59a-d9c7-4902-a67e-840697a666cc"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:57.934654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4a64ea3c-039b-4527-b67a-bcfbb0f06bf7 req-57d34f56-c66c-4764-8f29-1b982b425da2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:57.935110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4a64ea3c-039b-4527-b67a-bcfbb0f06bf7 req-57d34f56-c66c-4764-8f29-1b982b425da2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:57.975183 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4a64ea3c-039b-4527-b67a-bcfbb0f06bf7 req-57d34f56-c66c-4764-8f29-1b982b425da2 service nova] Creating event network-changed:63f5a59a-d9c7-4902-a67e-840697a666cc for instance 01009a01-6369-4508-97a4-1ed09bbd90a6 on n-h1-764485-11 Jul 20 04:42:57.997507 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4a64ea3c-039b-4527-b67a-bcfbb0f06bf7 req-57d34f56-c66c-4764-8f29-1b982b425da2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086794 Jul 20 04:42:57.998511 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2913/5730] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:58.056977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a3ddf2a-d1e2-4491-acc3-1706bc5e2c60 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:58.070147 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a3ddf2a-d1e2-4491-acc3-1706bc5e2c60 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1367 microversion: 2.1 time: 1.450688 Jul 20 04:42:58.074273 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2818/5731] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:56 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1367 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:59.091891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-afd38b94-ea75-444e-92ab-e85b63d23da8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:59.092618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-afd38b94-ea75-444e-92ab-e85b63d23da8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:59.094645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:59.127435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-afd38b94-ea75-444e-92ab-e85b63d23da8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.135354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-afd38b94-ea75-444e-92ab-e85b63d23da8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.136247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-afd38b94-ea75-444e-92ab-e85b63d23da8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.137457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-afd38b94-ea75-444e-92ab-e85b63d23da8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.452661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-afd38b94-ea75-444e-92ab-e85b63d23da8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:59.465992 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-afd38b94-ea75-444e-92ab-e85b63d23da8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1367 microversion: 2.1 time: 0.378742 Jul 20 04:42:59.468647 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2914/5732] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:59 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:00.486645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-94ac8f53-998b-46a2-ac4f-b49d57f37cc4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:00.487940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-94ac8f53-998b-46a2-ac4f-b49d57f37cc4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:00.491036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:00.491965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:00.501271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94ac8f53-998b-46a2-ac4f-b49d57f37cc4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:00.502567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94ac8f53-998b-46a2-ac4f-b49d57f37cc4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:00.503599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94ac8f53-998b-46a2-ac4f-b49d57f37cc4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:00.504214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94ac8f53-998b-46a2-ac4f-b49d57f37cc4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:02.689163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-94ac8f53-998b-46a2-ac4f-b49d57f37cc4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:02.700594 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-94ac8f53-998b-46a2-ac4f-b49d57f37cc4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1367 microversion: 2.1 time: 2.217702 Jul 20 04:43:02.721357 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2819/5733] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:00 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1367 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:03.721025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-784f0bd1-61aa-439e-950f-39b31fde7e52 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:03.722406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-784f0bd1-61aa-439e-950f-39b31fde7e52 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:03.768078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-784f0bd1-61aa-439e-950f-39b31fde7e52 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:03.768461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-784f0bd1-61aa-439e-950f-39b31fde7e52 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:03.769363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-784f0bd1-61aa-439e-950f-39b31fde7e52 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:03.769695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-784f0bd1-61aa-439e-950f-39b31fde7e52 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:04.502131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-784f0bd1-61aa-439e-950f-39b31fde7e52 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:04.513703 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-784f0bd1-61aa-439e-950f-39b31fde7e52 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1367 microversion: 2.1 time: 0.799817 Jul 20 04:43:04.529608 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2915/5734] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:03 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1367 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:05.230486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b256986c-f1ac-4288-8fd7-3465d0a8df04 req-6b2ecd2e-b2a3-43a9-8432-62b062dca45e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01009a01-6369-4508-97a4-1ed09bbd90a6", "name": "network-vif-plugged", "status": "completed", "tag": "63f5a59a-d9c7-4902-a67e-840697a666cc"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:05.278396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b256986c-f1ac-4288-8fd7-3465d0a8df04 req-6b2ecd2e-b2a3-43a9-8432-62b062dca45e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:05.282833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b256986c-f1ac-4288-8fd7-3465d0a8df04 req-6b2ecd2e-b2a3-43a9-8432-62b062dca45e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:05.324066 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b256986c-f1ac-4288-8fd7-3465d0a8df04 req-6b2ecd2e-b2a3-43a9-8432-62b062dca45e service nova] Creating event network-vif-plugged:63f5a59a-d9c7-4902-a67e-840697a666cc for instance 01009a01-6369-4508-97a4-1ed09bbd90a6 on n-h1-764485-11 Jul 20 04:43:05.337797 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b256986c-f1ac-4288-8fd7-3465d0a8df04 req-6b2ecd2e-b2a3-43a9-8432-62b062dca45e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115562 Jul 20 04:43:05.344228 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2820/5735] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:05.535235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-38bcf43b-80c9-4bba-bb7f-f03ff39c14ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:05.535877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-38bcf43b-80c9-4bba-bb7f-f03ff39c14ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:05.558488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38bcf43b-80c9-4bba-bb7f-f03ff39c14ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:05.559067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38bcf43b-80c9-4bba-bb7f-f03ff39c14ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:05.561213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38bcf43b-80c9-4bba-bb7f-f03ff39c14ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:05.561668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38bcf43b-80c9-4bba-bb7f-f03ff39c14ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:06.159684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-38bcf43b-80c9-4bba-bb7f-f03ff39c14ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:06.168239 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-38bcf43b-80c9-4bba-bb7f-f03ff39c14ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1367 microversion: 2.1 time: 0.636797 Jul 20 04:43:06.199802 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2916/5736] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:05 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1367 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:07.206096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4d058fa0-d975-4d00-8aaa-bef606cf374a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:07.207114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4d058fa0-d975-4d00-8aaa-bef606cf374a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:07.222726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d058fa0-d975-4d00-8aaa-bef606cf374a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:07.226402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d058fa0-d975-4d00-8aaa-bef606cf374a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:07.227378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d058fa0-d975-4d00-8aaa-bef606cf374a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:07.227941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4d058fa0-d975-4d00-8aaa-bef606cf374a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:07.743099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4d058fa0-d975-4d00-8aaa-bef606cf374a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:07.769878 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4d058fa0-d975-4d00-8aaa-bef606cf374a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1367 microversion: 2.1 time: 0.568566 Jul 20 04:43:07.787780 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2821/5737] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:07 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1367 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:08.787655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9edeff4-226b-4015-a6e3-92628d5c3c51 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:08.788990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a9edeff4-226b-4015-a6e3-92628d5c3c51 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:08.807149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9edeff4-226b-4015-a6e3-92628d5c3c51 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.810981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9edeff4-226b-4015-a6e3-92628d5c3c51 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.813868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9edeff4-226b-4015-a6e3-92628d5c3c51 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.821414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9edeff4-226b-4015-a6e3-92628d5c3c51 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:09.324805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9edeff4-226b-4015-a6e3-92628d5c3c51 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:09.337466 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a9edeff4-226b-4015-a6e3-92628d5c3c51 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1557 microversion: 2.1 time: 0.552516 Jul 20 04:43:09.338654 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2917/5738] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:08 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1557 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:09.357644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-17228825-e863-41be-af91-563f353cc09f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:09.362268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-17228825-e863-41be-af91-563f353cc09f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:09.376883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-17228825-e863-41be-af91-563f353cc09f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:09.380532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-17228825-e863-41be-af91-563f353cc09f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:09.385021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-17228825-e863-41be-af91-563f353cc09f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:09.387570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-17228825-e863-41be-af91-563f353cc09f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:09.547957 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-17228825-e863-41be-af91-563f353cc09f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.195351 Jul 20 04:43:09.549285 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2822/5739] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:43:09 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:11.661245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-016d10e4-6615-469c-9248-c69aec2d244a req-435d5ae7-1b63-4c18-a858-ac1d0185462f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01009a01-6369-4508-97a4-1ed09bbd90a6", "tag": "63f5a59a-d9c7-4902-a67e-840697a666cc"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:11.675012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:11.677233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-016d10e4-6615-469c-9248-c69aec2d244a req-435d5ae7-1b63-4c18-a858-ac1d0185462f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:11.677672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-016d10e4-6615-469c-9248-c69aec2d244a req-435d5ae7-1b63-4c18-a858-ac1d0185462f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:11.700838 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-016d10e4-6615-469c-9248-c69aec2d244a req-435d5ae7-1b63-4c18-a858-ac1d0185462f service nova] Creating event network-changed:63f5a59a-d9c7-4902-a67e-840697a666cc for instance 01009a01-6369-4508-97a4-1ed09bbd90a6 on n-h1-764485-11 Jul 20 04:43:11.715427 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-016d10e4-6615-469c-9248-c69aec2d244a req-435d5ae7-1b63-4c18-a858-ac1d0185462f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055092 Jul 20 04:43:11.720206 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2918/5740] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:14.835471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a7548bb7-0dc6-4eec-aad8-a9a495c8d2ea tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:14.836850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a7548bb7-0dc6-4eec-aad8-a9a495c8d2ea tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:14.850246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:14.855909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7548bb7-0dc6-4eec-aad8-a9a495c8d2ea tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:14.860938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7548bb7-0dc6-4eec-aad8-a9a495c8d2ea tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:14.862177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7548bb7-0dc6-4eec-aad8-a9a495c8d2ea tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:14.863038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7548bb7-0dc6-4eec-aad8-a9a495c8d2ea tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:14.934249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=44 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:15.068294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-a7548bb7-0dc6-4eec-aad8-a9a495c8d2ea tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lazy-loading 'services' on Instance uuid 2306ea05-0e30-4750-883f-aee66bcd03ef {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:43:15.183239 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a7548bb7-0dc6-4eec-aad8-a9a495c8d2ea tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef/os-volume_attachments/bec1cbfe-3e02-466e-b1a1-74c29044e30c" status: 202 len: 0 microversion: 2.1 time: 0.350879 Jul 20 04:43:15.186173 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2823/5741] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:43:14 2022] DELETE /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef/os-volume_attachments/bec1cbfe-3e02-466e-b1a1-74c29044e30c => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:43:22.108101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d63cda55-fd97-4b8f-9594-82aa4a2f7e10 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:22.109435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d63cda55-fd97-4b8f-9594-82aa4a2f7e10 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:22.117788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=40 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:22.121363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d63cda55-fd97-4b8f-9594-82aa4a2f7e10 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.122017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d63cda55-fd97-4b8f-9594-82aa4a2f7e10 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.122980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d63cda55-fd97-4b8f-9594-82aa4a2f7e10 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.123682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d63cda55-fd97-4b8f-9594-82aa4a2f7e10 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.186272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d63cda55-fd97-4b8f-9594-82aa4a2f7e10 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:43:22.382636 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d63cda55-fd97-4b8f-9594-82aa4a2f7e10 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 204 len: 0 microversion: 2.1 time: 0.279949 Jul 20 04:43:22.384341 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2919/5742] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:43:22 2022] DELETE /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:43:22.395784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8df2227c-976e-4522-8ea0-707ad2fd4ecd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:22.397285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8df2227c-976e-4522-8ea0-707ad2fd4ecd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:22.419391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8df2227c-976e-4522-8ea0-707ad2fd4ecd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.421662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8df2227c-976e-4522-8ea0-707ad2fd4ecd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.423771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8df2227c-976e-4522-8ea0-707ad2fd4ecd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.424974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8df2227c-976e-4522-8ea0-707ad2fd4ecd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.749683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8df2227c-976e-4522-8ea0-707ad2fd4ecd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:22.757862 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8df2227c-976e-4522-8ea0-707ad2fd4ecd tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1514 microversion: 2.1 time: 0.368272 Jul 20 04:43:22.763191 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2824/5743] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:22 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:23.783521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a42f9272-43c2-4512-a61f-80f97c9d1d8f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:23.784342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a42f9272-43c2-4512-a61f-80f97c9d1d8f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:23.798171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a42f9272-43c2-4512-a61f-80f97c9d1d8f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.798711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a42f9272-43c2-4512-a61f-80f97c9d1d8f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.799605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a42f9272-43c2-4512-a61f-80f97c9d1d8f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.800112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a42f9272-43c2-4512-a61f-80f97c9d1d8f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:24.211393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a42f9272-43c2-4512-a61f-80f97c9d1d8f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:24.227154 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a42f9272-43c2-4512-a61f-80f97c9d1d8f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1514 microversion: 2.1 time: 0.451187 Jul 20 04:43:24.227801 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2920/5744] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:23 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1514 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:25.217162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f26622ce-6d0b-4ec3-9f61-97721d5dcb51 req-71c027ca-f7c7-4454-8220-fda646eb84a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2306ea05-0e30-4750-883f-aee66bcd03ef", "name": "network-vif-deleted", "tag": "ce3c1e3c-4e71-4c76-b40f-c2111256776e"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:25.253338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dc721559-a678-4568-8f59-233c075b6725 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:25.256577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dc721559-a678-4568-8f59-233c075b6725 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:25.294418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc721559-a678-4568-8f59-233c075b6725 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.295079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f26622ce-6d0b-4ec3-9f61-97721d5dcb51 req-71c027ca-f7c7-4454-8220-fda646eb84a0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.295658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f26622ce-6d0b-4ec3-9f61-97721d5dcb51 req-71c027ca-f7c7-4454-8220-fda646eb84a0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.300987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc721559-a678-4568-8f59-233c075b6725 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.301865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc721559-a678-4568-8f59-233c075b6725 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.302320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc721559-a678-4568-8f59-233c075b6725 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.321647 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f26622ce-6d0b-4ec3-9f61-97721d5dcb51 req-71c027ca-f7c7-4454-8220-fda646eb84a0 service nova] Creating event network-vif-deleted:ce3c1e3c-4e71-4c76-b40f-c2111256776e for instance 2306ea05-0e30-4750-883f-aee66bcd03ef on n-h2-764485-11 Jul 20 04:43:25.356479 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f26622ce-6d0b-4ec3-9f61-97721d5dcb51 req-71c027ca-f7c7-4454-8220-fda646eb84a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145576 Jul 20 04:43:25.361757 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2825/5745] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:25.460457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dc721559-a678-4568-8f59-233c075b6725 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:25.472210 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dc721559-a678-4568-8f59-233c075b6725 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 200 len: 1303 microversion: 2.1 time: 0.229725 Jul 20 04:43:25.478784 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2921/5746] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:25 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 1303 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:26.495094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f73b9ba8-0d95-4416-baf2-f6a7dd1c6277 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:26.496345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f73b9ba8-0d95-4416-baf2-f6a7dd1c6277 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 2306ea05-0e30-4750-883f-aee66bcd03ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:26.507552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f73b9ba8-0d95-4416-baf2-f6a7dd1c6277 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:26.516982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f73b9ba8-0d95-4416-baf2-f6a7dd1c6277 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.518115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f73b9ba8-0d95-4416-baf2-f6a7dd1c6277 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:26.518733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f73b9ba8-0d95-4416-baf2-f6a7dd1c6277 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.544322 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f73b9ba8-0d95-4416-baf2-f6a7dd1c6277 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] HTTP exception thrown: Instance 2306ea05-0e30-4750-883f-aee66bcd03ef could not be found. Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f73b9ba8-0d95-4416-baf2-f6a7dd1c6277 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Request method failure captured: Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef HTTP/1.1 Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14cGQc1zOJedrp9D1ZaJhqWIqOPSv5lgSmCO5v7jcIt9c0XU7P9QtXZNzgtZMSgnMNtLiIN3tqHVTmGoYuTI1gL4RcTblwbqznzViObUlPx_ofFugaHYtJumRp8UoDlAjrOuzotRJ4ox1H0LlZmUNYHiSHl1V_g7Sd5Ea5WkCKJ1wyM Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 65f2eb23c3c149d2b364f1a531b3573c Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1817315360 Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65f2eb23c3c149d2b364f1a531b3573c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65f2eb23c3c149d2b364f1a531b3573c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65f2eb23c3c149d2b364f1a531b3573c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65f2eb23c3c149d2b364f1a531b3573c"}]}] Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-VolumesSnapshotTestJSON-1817315360 Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 65f2eb23c3c149d2b364f1a531b3573c Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1817315360 Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-VolumesSnapshotTestJSON-1817315360-project Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 6a205f9889d546ff8adaf05c6cf8ff0e Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-VolumesSnapshotTestJSON-1817315360-project Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 2306ea05-0e30-4750-883f-aee66bcd03ef could not be found. Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '2306ea05-0e30-4750-883f-aee66bcd03ef'} Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2306ea05-0e30-4750-883f-aee66bcd03ef could not be found. Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2306ea05-0e30-4750-883f-aee66bcd03ef could not be found. Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:26.546066 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:43:26.551260 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:26.551260 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:26.551260 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:26.551260 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:43:26.551260 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:43:26.551260 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2306ea05-0e30-4750-883f-aee66bcd03ef could not be found. Jul 20 04:43:26.551260 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:43:26.551260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f73b9ba8-0d95-4416-baf2-f6a7dd1c6277 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Returning 404 to user: Instance 2306ea05-0e30-4750-883f-aee66bcd03ef could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:43:26.551260 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f73b9ba8-0d95-4416-baf2-f6a7dd1c6277 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef" status: 404 len: 111 microversion: 2.1 time: 0.057804 Jul 20 04:43:26.551260 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2826/5747] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:26 2022] GET /compute/v2.1/servers/2306ea05-0e30-4750-883f-aee66bcd03ef => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:43:35.642004 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:43:35.642493 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 04:43:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:43:38.541121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2123252085", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "a8419ed0-ae67-4ce7-8412-01a277b3759d"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:38.580184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:38.580973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:38.706252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] validate_networks() for [('a8419ed0-ae67-4ce7-8412-01a277b3759d', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:43:40.134095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:43:40.135766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:43:40.136822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:43:40.139883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:43:40.140706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:43:40.158238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.159877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.161138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.162370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.189744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Getting quotas for project 65f2eb23c3c149d2b364f1a531b3573c. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:43:40.201480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Getting quotas for user 6a205f9889d546ff8adaf05c6cf8ff0e and project 65f2eb23c3c149d2b364f1a531b3573c. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:43:40.222419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:43:40.226488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:43:40.305548 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-adfbdbf7-aacf-4b89-984a-465729844585 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774956 Jul 20 04:43:40.307052 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2922/5748] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:43:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:43:40.319381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-09001ac5-1356-4086-a5ed-608ceb11d55b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:40.320836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-09001ac5-1356-4086-a5ed-608ceb11d55b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:40.325536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=7 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:40.336633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:40.581037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-09001ac5-1356-4086-a5ed-608ceb11d55b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:40.584948 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-09001ac5-1356-4086-a5ed-608ceb11d55b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1219 microversion: 2.1 time: 0.270144 Jul 20 04:43:40.585960 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2827/5749] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:40 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1219 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:41.609117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1cb9d511-b5d1-4c58-95b5-e080401d203b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:41.610619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1cb9d511-b5d1-4c58-95b5-e080401d203b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:41.643231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cb9d511-b5d1-4c58-95b5-e080401d203b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.647181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cb9d511-b5d1-4c58-95b5-e080401d203b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.649285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cb9d511-b5d1-4c58-95b5-e080401d203b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.652668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1cb9d511-b5d1-4c58-95b5-e080401d203b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.957918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1cb9d511-b5d1-4c58-95b5-e080401d203b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:41.972096 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1cb9d511-b5d1-4c58-95b5-e080401d203b tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1215 microversion: 2.1 time: 0.370490 Jul 20 04:43:41.975360 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2923/5750] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:41 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1215 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:42.994989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3c3f7acf-eb6e-4215-b36d-e23cc3fdf7bf tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:42.996661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3c3f7acf-eb6e-4215-b36d-e23cc3fdf7bf tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:43.015015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c3f7acf-eb6e-4215-b36d-e23cc3fdf7bf tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:43.016521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c3f7acf-eb6e-4215-b36d-e23cc3fdf7bf tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.019003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c3f7acf-eb6e-4215-b36d-e23cc3fdf7bf tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:43.022448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c3f7acf-eb6e-4215-b36d-e23cc3fdf7bf tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.331402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3c3f7acf-eb6e-4215-b36d-e23cc3fdf7bf tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:43.343444 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3c3f7acf-eb6e-4215-b36d-e23cc3fdf7bf tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1277 microversion: 2.1 time: 0.354527 Jul 20 04:43:43.346200 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2828/5751] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:42 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1277 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:44.362574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-13cbfce7-05c6-47dd-8f82-ff34a3bd2fbe tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:44.363400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-13cbfce7-05c6-47dd-8f82-ff34a3bd2fbe tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:44.399318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13cbfce7-05c6-47dd-8f82-ff34a3bd2fbe tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.409551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13cbfce7-05c6-47dd-8f82-ff34a3bd2fbe tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.410829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13cbfce7-05c6-47dd-8f82-ff34a3bd2fbe tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.412154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13cbfce7-05c6-47dd-8f82-ff34a3bd2fbe tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.212215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-13cbfce7-05c6-47dd-8f82-ff34a3bd2fbe tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:45.224657 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-13cbfce7-05c6-47dd-8f82-ff34a3bd2fbe tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1277 microversion: 2.1 time: 0.864942 Jul 20 04:43:45.227904 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2924/5752] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:44 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1277 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:46.247464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2b1d7c00-bfdb-4257-b059-cb9d383947ae tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:46.248846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2b1d7c00-bfdb-4257-b059-cb9d383947ae tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:46.263430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b1d7c00-bfdb-4257-b059-cb9d383947ae tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.264270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b1d7c00-bfdb-4257-b059-cb9d383947ae tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.265294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b1d7c00-bfdb-4257-b059-cb9d383947ae tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.268094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b1d7c00-bfdb-4257-b059-cb9d383947ae tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.023756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2b1d7c00-bfdb-4257-b059-cb9d383947ae tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:47.036379 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2b1d7c00-bfdb-4257-b059-cb9d383947ae tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1319 microversion: 2.1 time: 0.793472 Jul 20 04:43:47.037750 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2829/5753] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:46 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1319 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:48.054960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4b5bfc05-45e7-4b09-849f-4fb4021bff99 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:48.055588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4b5bfc05-45e7-4b09-849f-4fb4021bff99 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:48.080129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b5bfc05-45e7-4b09-849f-4fb4021bff99 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.080879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b5bfc05-45e7-4b09-849f-4fb4021bff99 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.093322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b5bfc05-45e7-4b09-849f-4fb4021bff99 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.093844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b5bfc05-45e7-4b09-849f-4fb4021bff99 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.606388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4b5bfc05-45e7-4b09-849f-4fb4021bff99 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:48.620416 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4b5bfc05-45e7-4b09-849f-4fb4021bff99 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1319 microversion: 2.1 time: 0.569323 Jul 20 04:43:48.621394 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2925/5754] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:48 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:49.638164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3ba684a7-809d-468e-a24b-c38e87503cab tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:49.638795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3ba684a7-809d-468e-a24b-c38e87503cab tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:49.665128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ba684a7-809d-468e-a24b-c38e87503cab tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.665602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ba684a7-809d-468e-a24b-c38e87503cab tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.666692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ba684a7-809d-468e-a24b-c38e87503cab tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.667257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ba684a7-809d-468e-a24b-c38e87503cab tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.581074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:50.714315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-7244e9b7-2594-445c-908b-6843648182a2 req-90b51dee-97e5-44fa-9f09-4138032647fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b77b89-d965-4fac-93ea-fc3793c1e4ef", "tag": "4b9464e8-682e-42ec-a378-1324eb55f481"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:50.719274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:50.722025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:50.742071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7244e9b7-2594-445c-908b-6843648182a2 req-90b51dee-97e5-44fa-9f09-4138032647fd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.742798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7244e9b7-2594-445c-908b-6843648182a2 req-90b51dee-97e5-44fa-9f09-4138032647fd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.757455 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7244e9b7-2594-445c-908b-6843648182a2 req-90b51dee-97e5-44fa-9f09-4138032647fd service nova] Creating event network-changed:4b9464e8-682e-42ec-a378-1324eb55f481 for instance 30b77b89-d965-4fac-93ea-fc3793c1e4ef on n-h2-764485-11 Jul 20 04:43:50.764734 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-7244e9b7-2594-445c-908b-6843648182a2 req-90b51dee-97e5-44fa-9f09-4138032647fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054573 Jul 20 04:43:50.765962 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2926/5755] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:43:50.997699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3ba684a7-809d-468e-a24b-c38e87503cab tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:51.007212 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3ba684a7-809d-468e-a24b-c38e87503cab tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1319 microversion: 2.1 time: 1.373210 Jul 20 04:43:51.011112 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2830/5756] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:49 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1319 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:52.037954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-89b26c42-0627-4bd3-9d7d-77f308413379 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:52.040088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-89b26c42-0627-4bd3-9d7d-77f308413379 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:52.050576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89b26c42-0627-4bd3-9d7d-77f308413379 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.051406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89b26c42-0627-4bd3-9d7d-77f308413379 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.052520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89b26c42-0627-4bd3-9d7d-77f308413379 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.053341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89b26c42-0627-4bd3-9d7d-77f308413379 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.397706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-89b26c42-0627-4bd3-9d7d-77f308413379 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.414207 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-89b26c42-0627-4bd3-9d7d-77f308413379 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1319 microversion: 2.1 time: 0.385748 Jul 20 04:43:52.415261 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2927/5757] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:52 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:53.437175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7f31bc40-52fb-4518-a80c-c74b1ea9bd3d tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:53.437879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7f31bc40-52fb-4518-a80c-c74b1ea9bd3d tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:53.447680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f31bc40-52fb-4518-a80c-c74b1ea9bd3d tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.448120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f31bc40-52fb-4518-a80c-c74b1ea9bd3d tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.449019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f31bc40-52fb-4518-a80c-c74b1ea9bd3d tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.449474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f31bc40-52fb-4518-a80c-c74b1ea9bd3d tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.719434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7f31bc40-52fb-4518-a80c-c74b1ea9bd3d tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:53.732565 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7f31bc40-52fb-4518-a80c-c74b1ea9bd3d tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1319 microversion: 2.1 time: 0.299597 Jul 20 04:43:53.741404 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2831/5758] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:53 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:54.758830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-01ffe887-3426-4bae-9164-bf7dc6a1038f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:54.760952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-01ffe887-3426-4bae-9164-bf7dc6a1038f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:54.776383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01ffe887-3426-4bae-9164-bf7dc6a1038f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.777182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01ffe887-3426-4bae-9164-bf7dc6a1038f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.780424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01ffe887-3426-4bae-9164-bf7dc6a1038f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.781061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01ffe887-3426-4bae-9164-bf7dc6a1038f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.165767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-01ffe887-3426-4bae-9164-bf7dc6a1038f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:55.180476 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-01ffe887-3426-4bae-9164-bf7dc6a1038f tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1319 microversion: 2.1 time: 0.425366 Jul 20 04:43:55.182713 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2928/5759] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:54 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:56.215989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7dad1b7c-d0fa-4071-9a09-3a740ff68495 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:56.218381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7dad1b7c-d0fa-4071-9a09-3a740ff68495 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:56.239989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dad1b7c-d0fa-4071-9a09-3a740ff68495 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.240621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dad1b7c-d0fa-4071-9a09-3a740ff68495 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.241587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dad1b7c-d0fa-4071-9a09-3a740ff68495 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.242142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dad1b7c-d0fa-4071-9a09-3a740ff68495 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.388477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7dad1b7c-d0fa-4071-9a09-3a740ff68495 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:57.401329 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7dad1b7c-d0fa-4071-9a09-3a740ff68495 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1319 microversion: 2.1 time: 1.206109 Jul 20 04:43:57.419124 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2832/5760] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:56 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1319 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:58.136293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-d85eac9e-71d1-45b7-85e5-7715e21df03f req-68dcc704-85c1-4f3c-a724-9ba7ee80160d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b77b89-d965-4fac-93ea-fc3793c1e4ef", "name": "network-vif-plugged", "status": "completed", "tag": "4b9464e8-682e-42ec-a378-1324eb55f481"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:58.156134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d85eac9e-71d1-45b7-85e5-7715e21df03f req-68dcc704-85c1-4f3c-a724-9ba7ee80160d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:58.156817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d85eac9e-71d1-45b7-85e5-7715e21df03f req-68dcc704-85c1-4f3c-a724-9ba7ee80160d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:58.191191 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-d85eac9e-71d1-45b7-85e5-7715e21df03f req-68dcc704-85c1-4f3c-a724-9ba7ee80160d service nova] Creating event network-vif-plugged:4b9464e8-682e-42ec-a378-1324eb55f481 for instance 30b77b89-d965-4fac-93ea-fc3793c1e4ef on n-h2-764485-11 Jul 20 04:43:58.208243 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-d85eac9e-71d1-45b7-85e5-7715e21df03f req-68dcc704-85c1-4f3c-a724-9ba7ee80160d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076574 Jul 20 04:43:58.209093 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2929/5761] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:58.431905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-783e763b-fa37-4e28-bba4-8a86b09121fa tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:58.433946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-783e763b-fa37-4e28-bba4-8a86b09121fa tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:58.472066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-783e763b-fa37-4e28-bba4-8a86b09121fa tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:58.472454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-783e763b-fa37-4e28-bba4-8a86b09121fa tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:58.481365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-783e763b-fa37-4e28-bba4-8a86b09121fa tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:58.485034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-783e763b-fa37-4e28-bba4-8a86b09121fa tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:58.874351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-783e763b-fa37-4e28-bba4-8a86b09121fa tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:58.882186 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-783e763b-fa37-4e28-bba4-8a86b09121fa tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1319 microversion: 2.1 time: 0.466189 Jul 20 04:43:58.892467 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2833/5762] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:58 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:59.908341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ca09b43b-6417-428c-a548-dc32d720afe1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:59.910797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca09b43b-6417-428c-a548-dc32d720afe1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:59.937274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca09b43b-6417-428c-a548-dc32d720afe1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:59.942720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca09b43b-6417-428c-a548-dc32d720afe1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:59.943861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca09b43b-6417-428c-a548-dc32d720afe1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:59.949435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca09b43b-6417-428c-a548-dc32d720afe1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.396629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ca09b43b-6417-428c-a548-dc32d720afe1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:00.410685 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ca09b43b-6417-428c-a548-dc32d720afe1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1319 microversion: 2.1 time: 0.514893 Jul 20 04:44:00.412069 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2930/5763] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:59 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:01.438782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7eca1859-d706-4166-872b-65af7450f082 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:01.440049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7eca1859-d706-4166-872b-65af7450f082 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:01.466393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7eca1859-d706-4166-872b-65af7450f082 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.489208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7eca1859-d706-4166-872b-65af7450f082 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:01.491660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7eca1859-d706-4166-872b-65af7450f082 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.495755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7eca1859-d706-4166-872b-65af7450f082 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.229903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7eca1859-d706-4166-872b-65af7450f082 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:02.240846 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7eca1859-d706-4166-872b-65af7450f082 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1508 microversion: 2.1 time: 0.816134 Jul 20 04:44:02.252201 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2834/5764] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:01 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1508 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:02.257517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5400b255-b56d-4c2f-8948-4af23cc62d1a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23a2cc85-32b1-4edd-8fef-d45cfa594f6a", "device": "/dev/sdb"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:02.259716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5400b255-b56d-4c2f-8948-4af23cc62d1a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:02.289239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5400b255-b56d-4c2f-8948-4af23cc62d1a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.289705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5400b255-b56d-4c2f-8948-4af23cc62d1a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.290710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5400b255-b56d-4c2f-8948-4af23cc62d1a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.299576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5400b255-b56d-4c2f-8948-4af23cc62d1a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.978930 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5400b255-b56d-4c2f-8948-4af23cc62d1a tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "POST /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724199 Jul 20 04:44:02.981874 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2931/5765] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:44:02 2022] POST /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef/os-volume_attachments => generated 194 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:25.540601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bb073dcd-e9ab-4b33-85a8-b49657243d75 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:25.541323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bb073dcd-e9ab-4b33-85a8-b49657243d75 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:25.543414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=18 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:25.545379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=42 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:25.560237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb073dcd-e9ab-4b33-85a8-b49657243d75 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.560675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb073dcd-e9ab-4b33-85a8-b49657243d75 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.563031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb073dcd-e9ab-4b33-85a8-b49657243d75 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.566284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb073dcd-e9ab-4b33-85a8-b49657243d75 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.648197 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bb073dcd-e9ab-4b33-85a8-b49657243d75 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/ips" status: 200 len: 150 microversion: 2.1 time: 0.112891 Jul 20 04:44:25.651840 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2835/5766] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:44:25 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/ips => generated 150 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:29.515844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:29.516610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:29.521936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6d135171-90f6-4bbc-b4ce-f31bcf4a7282 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f9ce6a7-bc1f-4a9b-89b4-8f11953f30f0"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:29.523350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6d135171-90f6-4bbc-b4ce-f31bcf4a7282 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:29.576229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d135171-90f6-4bbc-b4ce-f31bcf4a7282 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.576930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d135171-90f6-4bbc-b4ce-f31bcf4a7282 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.577943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d135171-90f6-4bbc-b4ce-f31bcf4a7282 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.578593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d135171-90f6-4bbc-b4ce-f31bcf4a7282 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.161220 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6d135171-90f6-4bbc-b4ce-f31bcf4a7282 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.646958 Jul 20 04:44:30.169153 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2932/5767] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:44:29 2022] POST /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 194 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:45.121794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fcf3006c-43a5-45c1-883b-f4d091fa8df1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:45.122333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fcf3006c-43a5-45c1-883b-f4d091fa8df1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:45.136069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:45.136807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:45.150014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fcf3006c-43a5-45c1-883b-f4d091fa8df1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:45.151780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fcf3006c-43a5-45c1-883b-f4d091fa8df1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:45.168232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fcf3006c-43a5-45c1-883b-f4d091fa8df1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:45.169022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fcf3006c-43a5-45c1-883b-f4d091fa8df1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:45.333948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-fcf3006c-43a5-45c1-883b-f4d091fa8df1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lazy-loading 'services' on Instance uuid 30b77b89-d965-4fac-93ea-fc3793c1e4ef {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:44:45.463003 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fcf3006c-43a5-45c1-883b-f4d091fa8df1 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "DELETE /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef/os-volume_attachments/23a2cc85-32b1-4edd-8fef-d45cfa594f6a" status: 202 len: 0 microversion: 2.1 time: 0.343455 Jul 20 04:44:45.467647 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2836/5768] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:44:45 2022] DELETE /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef/os-volume_attachments/23a2cc85-32b1-4edd-8fef-d45cfa594f6a => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:44:51.870714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:51.872434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:51.880190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16cd30d7-c9db-49dc-92e1-31a8b7bceea2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f9ce6a7-bc1f-4a9b-89b4-8f11953f30f0"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:51.884528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-16cd30d7-c9db-49dc-92e1-31a8b7bceea2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:51.903259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16cd30d7-c9db-49dc-92e1-31a8b7bceea2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:51.904135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16cd30d7-c9db-49dc-92e1-31a8b7bceea2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:51.905156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16cd30d7-c9db-49dc-92e1-31a8b7bceea2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:51.907704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16cd30d7-c9db-49dc-92e1-31a8b7bceea2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.215125 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-16cd30d7-c9db-49dc-92e1-31a8b7bceea2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Invalid volume: volume 0f9ce6a7-bc1f-4a9b-89b4-8f11953f30f0 is already attached to instances: 01009a01-6369-4508-97a4-1ed09bbd90a6 Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16cd30d7-c9db-49dc-92e1-31a8b7bceea2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments HTTP/1.1 Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 74 Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: {"volumeAttachment": {"volumeId": "0f9ce6a7-bc1f-4a9b-89b4-8f11953f30f0"}} Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid volume: volume 0f9ce6a7-bc1f-4a9b-89b4-8f11953f30f0 is already attached to instances: 01009a01-6369-4508-97a4-1ed09bbd90a6 Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'server_id': '01009a01-6369-4508-97a4-1ed09bbd90a6', 'body': {'volumeAttachment': {'volumeId': '0f9ce6a7-bc1f-4a9b-89b4-8f11953f30f0'}}} Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0f9ce6a7-bc1f-4a9b-89b4-8f11953f30f0 is already attached to instances: 01009a01-6369-4508-97a4-1ed09bbd90a6 Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:52.218012 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0f9ce6a7-bc1f-4a9b-89b4-8f11953f30f0 is already attached to instances: 01009a01-6369-4508-97a4-1ed09bbd90a6 Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0f9ce6a7-bc1f-4a9b-89b4-8f11953f30f0 is already attached to instances: 01009a01-6369-4508-97a4-1ed09bbd90a6 Jul 20 04:44:52.223838 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.236030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16cd30d7-c9db-49dc-92e1-31a8b7bceea2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 400 to user: Invalid volume: volume 0f9ce6a7-bc1f-4a9b-89b4-8f11953f30f0 is already attached to instances: 01009a01-6369-4508-97a4-1ed09bbd90a6 {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:52.237500 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-16cd30d7-c9db-49dc-92e1-31a8b7bceea2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.368779 Jul 20 04:44:52.253754 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2933/5769] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:44:51 2022] POST /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 174 bytes in 387 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:52.417886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dc781603-fb0b-4e2d-87e5-bc79ccd0eae3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:52.419070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dc781603-fb0b-4e2d-87e5-bc79ccd0eae3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:52.446266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc781603-fb0b-4e2d-87e5-bc79ccd0eae3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.449858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc781603-fb0b-4e2d-87e5-bc79ccd0eae3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.450731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc781603-fb0b-4e2d-87e5-bc79ccd0eae3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.451174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc781603-fb0b-4e2d-87e5-bc79ccd0eae3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.764072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-dc781603-fb0b-4e2d-87e5-bc79ccd0eae3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lazy-loading 'services' on Instance uuid 01009a01-6369-4508-97a4-1ed09bbd90a6 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:44:52.928698 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dc781603-fb0b-4e2d-87e5-bc79ccd0eae3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments/0f9ce6a7-bc1f-4a9b-89b4-8f11953f30f0" status: 202 len: 0 microversion: 2.1 time: 0.516852 Jul 20 04:44:52.929873 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2837/5770] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:44:52 2022] DELETE /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments/0f9ce6a7-bc1f-4a9b-89b4-8f11953f30f0 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:44:52.944262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-987f0465-d9de-4948-a9e2-a23a6b2a71ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:52.945358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-987f0465-d9de-4948-a9e2-a23a6b2a71ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:52.985756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-987f0465-d9de-4948-a9e2-a23a6b2a71ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.986705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-987f0465-d9de-4948-a9e2-a23a6b2a71ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.987749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-987f0465-d9de-4948-a9e2-a23a6b2a71ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.988390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-987f0465-d9de-4948-a9e2-a23a6b2a71ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:53.088811 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-987f0465-d9de-4948-a9e2-a23a6b2a71ba tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150340 Jul 20 04:44:53.089802 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2934/5771] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:52 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:54.103613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d219c604-fa26-4923-9455-917d3075ff82 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:54.105646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d219c604-fa26-4923-9455-917d3075ff82 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:54.143055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d219c604-fa26-4923-9455-917d3075ff82 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:54.143055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d219c604-fa26-4923-9455-917d3075ff82 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:54.145688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d219c604-fa26-4923-9455-917d3075ff82 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:54.147415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d219c604-fa26-4923-9455-917d3075ff82 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:54.232946 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d219c604-fa26-4923-9455-917d3075ff82 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135393 Jul 20 04:44:54.234476 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2838/5772] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:54 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:55.245185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1bb60714-e977-4125-a20c-faa31496e948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:55.246712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1bb60714-e977-4125-a20c-faa31496e948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:55.266488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1bb60714-e977-4125-a20c-faa31496e948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:55.266939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1bb60714-e977-4125-a20c-faa31496e948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:55.267759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1bb60714-e977-4125-a20c-faa31496e948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:55.268198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1bb60714-e977-4125-a20c-faa31496e948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:55.348389 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1bb60714-e977-4125-a20c-faa31496e948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107466 Jul 20 04:44:55.349347 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2935/5773] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:55 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:56.362160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-26faa4cc-0631-48cc-821d-71017b1203d2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:56.364304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-26faa4cc-0631-48cc-821d-71017b1203d2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:56.393741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26faa4cc-0631-48cc-821d-71017b1203d2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:56.403176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26faa4cc-0631-48cc-821d-71017b1203d2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.407003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26faa4cc-0631-48cc-821d-71017b1203d2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:56.407744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26faa4cc-0631-48cc-821d-71017b1203d2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.505647 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-26faa4cc-0631-48cc-821d-71017b1203d2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148976 Jul 20 04:44:56.506257 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2839/5774] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:56 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:56.844947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fce0497c-6039-4f0a-9c57-6e6ebb7e50b3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:56.845451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fce0497c-6039-4f0a-9c57-6e6ebb7e50b3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:56.858100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fce0497c-6039-4f0a-9c57-6e6ebb7e50b3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:56.868455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fce0497c-6039-4f0a-9c57-6e6ebb7e50b3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.869671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fce0497c-6039-4f0a-9c57-6e6ebb7e50b3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:56.870128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fce0497c-6039-4f0a-9c57-6e6ebb7e50b3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.913003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fce0497c-6039-4f0a-9c57-6e6ebb7e50b3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:57.138540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fce0497c-6039-4f0a-9c57-6e6ebb7e50b3 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "DELETE /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 204 len: 0 microversion: 2.1 time: 0.295486 Jul 20 04:44:57.149379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6d1b61cb-c4eb-45fd-80a8-ddce9c87d074 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:57.150378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6d1b61cb-c4eb-45fd-80a8-ddce9c87d074 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:57.155247 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2936/5775] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:56 2022] DELETE /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:57.160584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d1b61cb-c4eb-45fd-80a8-ddce9c87d074 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.164913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d1b61cb-c4eb-45fd-80a8-ddce9c87d074 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.166660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d1b61cb-c4eb-45fd-80a8-ddce9c87d074 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.167853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d1b61cb-c4eb-45fd-80a8-ddce9c87d074 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.519380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-219a9323-2a0f-412c-8645-543617005562 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:57.520645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-219a9323-2a0f-412c-8645-543617005562 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:57.547173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-219a9323-2a0f-412c-8645-543617005562 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.549733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-219a9323-2a0f-412c-8645-543617005562 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.559247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-219a9323-2a0f-412c-8645-543617005562 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.560651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-219a9323-2a0f-412c-8645-543617005562 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.570567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6d1b61cb-c4eb-45fd-80a8-ddce9c87d074 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:57.583922 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6d1b61cb-c4eb-45fd-80a8-ddce9c87d074 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1514 microversion: 2.1 time: 0.435462 Jul 20 04:44:57.597156 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2840/5776] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:57 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1514 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:57.699796 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-219a9323-2a0f-412c-8645-543617005562 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185609 Jul 20 04:44:57.706502 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2937/5777] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:57 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:58.611377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f8d2a8f-1a09-4606-b7d9-6cd6fb10161e tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:58.612133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0f8d2a8f-1a09-4606-b7d9-6cd6fb10161e tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:58.639480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f8d2a8f-1a09-4606-b7d9-6cd6fb10161e tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.639993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f8d2a8f-1a09-4606-b7d9-6cd6fb10161e tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.640805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f8d2a8f-1a09-4606-b7d9-6cd6fb10161e tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.641263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f8d2a8f-1a09-4606-b7d9-6cd6fb10161e tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.715588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a931b942-e686-40b2-8e43-9ec79c68f9b9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:58.724703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a931b942-e686-40b2-8e43-9ec79c68f9b9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:58.745962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a931b942-e686-40b2-8e43-9ec79c68f9b9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.747981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a931b942-e686-40b2-8e43-9ec79c68f9b9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.753412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a931b942-e686-40b2-8e43-9ec79c68f9b9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.755057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a931b942-e686-40b2-8e43-9ec79c68f9b9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.900925 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a931b942-e686-40b2-8e43-9ec79c68f9b9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190925 Jul 20 04:44:58.904923 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2938/5778] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:58 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:44:58.983902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0f8d2a8f-1a09-4606-b7d9-6cd6fb10161e tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:59.015081 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f8d2a8f-1a09-4606-b7d9-6cd6fb10161e tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1514 microversion: 2.1 time: 0.405663 Jul 20 04:44:59.016170 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2841/5779] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:58 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1514 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:59.912478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9435642-3240-41ba-8e42-49a6272ecad6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:59.914227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9435642-3240-41ba-8e42-49a6272ecad6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:59.941336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9435642-3240-41ba-8e42-49a6272ecad6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.942846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9435642-3240-41ba-8e42-49a6272ecad6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:59.947671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9435642-3240-41ba-8e42-49a6272ecad6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.948147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9435642-3240-41ba-8e42-49a6272ecad6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:00.042240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ec8e0e1a-03f0-4e3b-85a3-ffa500aceb09 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:00.043490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ec8e0e1a-03f0-4e3b-85a3-ffa500aceb09 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:00.077175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec8e0e1a-03f0-4e3b-85a3-ffa500aceb09 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:00.080967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec8e0e1a-03f0-4e3b-85a3-ffa500aceb09 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:00.093985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec8e0e1a-03f0-4e3b-85a3-ffa500aceb09 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:00.097291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ec8e0e1a-03f0-4e3b-85a3-ffa500aceb09 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:00.170294 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9435642-3240-41ba-8e42-49a6272ecad6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.261379 Jul 20 04:45:00.184837 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2939/5780] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:59 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:00.385524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ec8e0e1a-03f0-4e3b-85a3-ffa500aceb09 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a205f9889d546ff8adaf05c6cf8ff0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2eb23c3c149d2b364f1a531b3573c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:00.402555 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ec8e0e1a-03f0-4e3b-85a3-ffa500aceb09 tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 200 len: 1472 microversion: 2.1 time: 0.372553 Jul 20 04:45:00.408086 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2842/5781] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:00 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 1472 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:00.657034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9c60fd83-08de-4b99-8e2e-00ffbb60bdb6 req-5cdb8230-5e12-4e74-bd08-af449cb6b137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b77b89-d965-4fac-93ea-fc3793c1e4ef", "name": "network-vif-deleted", "tag": "4b9464e8-682e-42ec-a378-1324eb55f481"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:00.681848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9c60fd83-08de-4b99-8e2e-00ffbb60bdb6 req-5cdb8230-5e12-4e74-bd08-af449cb6b137 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:00.682304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9c60fd83-08de-4b99-8e2e-00ffbb60bdb6 req-5cdb8230-5e12-4e74-bd08-af449cb6b137 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:00.728367 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9c60fd83-08de-4b99-8e2e-00ffbb60bdb6 req-5cdb8230-5e12-4e74-bd08-af449cb6b137 service nova] Creating event network-vif-deleted:4b9464e8-682e-42ec-a378-1324eb55f481 for instance 30b77b89-d965-4fac-93ea-fc3793c1e4ef on n-h2-764485-11 Jul 20 04:45:00.736096 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9c60fd83-08de-4b99-8e2e-00ffbb60bdb6 req-5cdb8230-5e12-4e74-bd08-af449cb6b137 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082276 Jul 20 04:45:00.737103 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2940/5782] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:01.218551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c878d51-948c-4be3-a3ca-8c7e569edbe5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:01.219593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4c878d51-948c-4be3-a3ca-8c7e569edbe5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:01.234882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c878d51-948c-4be3-a3ca-8c7e569edbe5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:01.235349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c878d51-948c-4be3-a3ca-8c7e569edbe5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:01.236497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c878d51-948c-4be3-a3ca-8c7e569edbe5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:01.236931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c878d51-948c-4be3-a3ca-8c7e569edbe5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:01.346400 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4c878d51-948c-4be3-a3ca-8c7e569edbe5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152956 Jul 20 04:45:01.355911 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2843/5783] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:45:01 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:01.427763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d4d43ae0-39e5-4d14-bb56-f83a935777ad tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:01.430427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d4d43ae0-39e5-4d14-bb56-f83a935777ad tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] [instance: 30b77b89-d965-4fac-93ea-fc3793c1e4ef] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:01.445288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4d43ae0-39e5-4d14-bb56-f83a935777ad tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:01.447425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4d43ae0-39e5-4d14-bb56-f83a935777ad tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:01.455199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4d43ae0-39e5-4d14-bb56-f83a935777ad tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:01.456392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4d43ae0-39e5-4d14-bb56-f83a935777ad tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:01.504056 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-d4d43ae0-39e5-4d14-bb56-f83a935777ad tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] HTTP exception thrown: Instance 30b77b89-d965-4fac-93ea-fc3793c1e4ef could not be found. Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d4d43ae0-39e5-4d14-bb56-f83a935777ad tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Request method failure captured: Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef HTTP/1.1 Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14cGQc1zOJedrp9D1ZaJhqWIqOPSv5lgSmCO5v7jcIt9c0XU7P9QtXZNzgtZMSgnMNtLiIN3tqHVTmGoYuTI1gL4RcTblwbqznzViObUlPx_ofFugaHYtJumRp8UoDlAjrOuzotRJ4ox1H0LlZmUNYHiSHl1V_g7Sd5Ea5WkCKJ1wyM Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 65f2eb23c3c149d2b364f1a531b3573c Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1817315360 Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65f2eb23c3c149d2b364f1a531b3573c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65f2eb23c3c149d2b364f1a531b3573c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65f2eb23c3c149d2b364f1a531b3573c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65f2eb23c3c149d2b364f1a531b3573c"}]}] Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-VolumesSnapshotTestJSON-1817315360 Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 65f2eb23c3c149d2b364f1a531b3573c Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1817315360 Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-VolumesSnapshotTestJSON-1817315360-project Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 6a205f9889d546ff8adaf05c6cf8ff0e Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-VolumesSnapshotTestJSON-1817315360-project Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 30b77b89-d965-4fac-93ea-fc3793c1e4ef could not be found. Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '30b77b89-d965-4fac-93ea-fc3793c1e4ef'} Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b77b89-d965-4fac-93ea-fc3793c1e4ef could not be found. Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b77b89-d965-4fac-93ea-fc3793c1e4ef could not be found. Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:01.511649 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:45:01.516784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:01.516784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:01.516784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:01.516784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:45:01.516784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:45:01.516784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b77b89-d965-4fac-93ea-fc3793c1e4ef could not be found. Jul 20 04:45:01.516784 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:45:01.516784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d4d43ae0-39e5-4d14-bb56-f83a935777ad tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] Returning 404 to user: Instance 30b77b89-d965-4fac-93ea-fc3793c1e4ef could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:45:01.516784 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d4d43ae0-39e5-4d14-bb56-f83a935777ad tempest-VolumesSnapshotTestJSON-1817315360 tempest-VolumesSnapshotTestJSON-1817315360-project] 10.222.0.20 "GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef" status: 404 len: 111 microversion: 2.1 time: 0.093326 Jul 20 04:45:01.516784 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2941/5784] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:01 2022] GET /compute/v2.1/servers/30b77b89-d965-4fac-93ea-fc3793c1e4ef => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:45:02.362033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7bc37197-6971-41ca-80b5-26c6ee707ec9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:02.363418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7bc37197-6971-41ca-80b5-26c6ee707ec9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:02.391699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bc37197-6971-41ca-80b5-26c6ee707ec9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:02.392179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bc37197-6971-41ca-80b5-26c6ee707ec9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:02.393009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bc37197-6971-41ca-80b5-26c6ee707ec9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:02.402922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bc37197-6971-41ca-80b5-26c6ee707ec9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:02.529640 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7bc37197-6971-41ca-80b5-26c6ee707ec9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171652 Jul 20 04:45:02.535431 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2844/5785] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:45:02 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:03.542147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b06c2922-9519-42dc-a9ff-9fae3fb9e50b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:03.543093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b06c2922-9519-42dc-a9ff-9fae3fb9e50b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:03.568618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b06c2922-9519-42dc-a9ff-9fae3fb9e50b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:03.569258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b06c2922-9519-42dc-a9ff-9fae3fb9e50b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:03.582970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b06c2922-9519-42dc-a9ff-9fae3fb9e50b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:03.587766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b06c2922-9519-42dc-a9ff-9fae3fb9e50b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:03.781209 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b06c2922-9519-42dc-a9ff-9fae3fb9e50b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.239483 Jul 20 04:45:03.793889 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2942/5786] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:45:03 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:04.797547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-92bdcff5-6664-4e36-98b7-1889e10b4a4c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:04.798480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92bdcff5-6664-4e36-98b7-1889e10b4a4c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:04.817128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92bdcff5-6664-4e36-98b7-1889e10b4a4c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.817598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92bdcff5-6664-4e36-98b7-1889e10b4a4c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.818395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92bdcff5-6664-4e36-98b7-1889e10b4a4c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.818838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92bdcff5-6664-4e36-98b7-1889e10b4a4c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.980191 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-92bdcff5-6664-4e36-98b7-1889e10b4a4c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186477 Jul 20 04:45:04.991198 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2845/5787] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:45:04 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:06.002555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e052a579-90ef-41db-bfdb-ab9d17dee817 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:06.008415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e052a579-90ef-41db-bfdb-ab9d17dee817 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:06.023184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e052a579-90ef-41db-bfdb-ab9d17dee817 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:06.024471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e052a579-90ef-41db-bfdb-ab9d17dee817 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:06.026373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e052a579-90ef-41db-bfdb-ab9d17dee817 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:06.028027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e052a579-90ef-41db-bfdb-ab9d17dee817 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:06.104553 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e052a579-90ef-41db-bfdb-ab9d17dee817 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104216 Jul 20 04:45:06.111588 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2943/5788] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:45:05 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:07.120397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5ebafaee-9df8-49b4-8b90-7616bf507cbe tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:07.121953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5ebafaee-9df8-49b4-8b90-7616bf507cbe tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:07.148558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ebafaee-9df8-49b4-8b90-7616bf507cbe tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:07.154973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ebafaee-9df8-49b4-8b90-7616bf507cbe tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:07.156115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ebafaee-9df8-49b4-8b90-7616bf507cbe tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:07.156574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ebafaee-9df8-49b4-8b90-7616bf507cbe tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:07.309219 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5ebafaee-9df8-49b4-8b90-7616bf507cbe tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188395 Jul 20 04:45:07.316117 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2846/5789] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:45:07 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:08.321607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-63ed4fa6-edf5-4945-ad54-2793d4591ddf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:08.323464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-63ed4fa6-edf5-4945-ad54-2793d4591ddf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:08.337517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63ed4fa6-edf5-4945-ad54-2793d4591ddf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:08.338232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63ed4fa6-edf5-4945-ad54-2793d4591ddf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:08.341649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63ed4fa6-edf5-4945-ad54-2793d4591ddf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:08.342308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63ed4fa6-edf5-4945-ad54-2793d4591ddf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:09.078521 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-63ed4fa6-edf5-4945-ad54-2793d4591ddf tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.761992 Jul 20 04:45:09.079796 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2944/5790] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:45:08 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6/os-volume_attachments => generated 25 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:45:09.190396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc095698-4097-48d6-838f-a7dfdd8e25f4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:09.197059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc095698-4097-48d6-838f-a7dfdd8e25f4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:09.233062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc095698-4097-48d6-838f-a7dfdd8e25f4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:09.233957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc095698-4097-48d6-838f-a7dfdd8e25f4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:09.235759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc095698-4097-48d6-838f-a7dfdd8e25f4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:09.239081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc095698-4097-48d6-838f-a7dfdd8e25f4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:09.308990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc095698-4097-48d6-838f-a7dfdd8e25f4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:45:09.584481 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc095698-4097-48d6-838f-a7dfdd8e25f4 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 204 len: 0 microversion: 2.1 time: 0.395714 Jul 20 04:45:09.590910 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2847/5791] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:45:09 2022] DELETE /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:45:09.600086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67a96af9-0954-4942-893c-3c15f885f025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:09.603743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67a96af9-0954-4942-893c-3c15f885f025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:09.618167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67a96af9-0954-4942-893c-3c15f885f025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:09.621403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67a96af9-0954-4942-893c-3c15f885f025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:09.624562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67a96af9-0954-4942-893c-3c15f885f025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:09.625541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67a96af9-0954-4942-893c-3c15f885f025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:10.113715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67a96af9-0954-4942-893c-3c15f885f025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:10.132882 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67a96af9-0954-4942-893c-3c15f885f025 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1682 microversion: 2.1 time: 0.535309 Jul 20 04:45:10.134535 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2945/5792] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:09 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1682 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:11.155007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3ab076aa-cb84-41e7-9d2b-e2fde78b11fb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:11.156754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3ab076aa-cb84-41e7-9d2b-e2fde78b11fb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:11.197808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ab076aa-cb84-41e7-9d2b-e2fde78b11fb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:11.201688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ab076aa-cb84-41e7-9d2b-e2fde78b11fb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:11.203874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ab076aa-cb84-41e7-9d2b-e2fde78b11fb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:11.207624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ab076aa-cb84-41e7-9d2b-e2fde78b11fb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:12.193861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3ab076aa-cb84-41e7-9d2b-e2fde78b11fb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:12.209950 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3ab076aa-cb84-41e7-9d2b-e2fde78b11fb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1682 microversion: 2.1 time: 1.063051 Jul 20 04:45:12.229015 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2848/5793] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:11 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1682 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:13.250877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f97ec97f-b010-43be-a967-2966c03850d3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:13.251592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f97ec97f-b010-43be-a967-2966c03850d3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:13.275170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f97ec97f-b010-43be-a967-2966c03850d3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:13.278236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f97ec97f-b010-43be-a967-2966c03850d3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:13.279302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f97ec97f-b010-43be-a967-2966c03850d3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:13.281406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f97ec97f-b010-43be-a967-2966c03850d3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:14.855024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f97ec97f-b010-43be-a967-2966c03850d3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:14.883731 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f97ec97f-b010-43be-a967-2966c03850d3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1682 microversion: 2.1 time: 1.637929 Jul 20 04:45:14.886892 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2946/5794] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:13 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1682 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:15.834916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a95a6caf-02e6-473d-8187-f66845b09cf5 req-251bc4fa-b3d5-4f16-8732-88c19b2a99d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01009a01-6369-4508-97a4-1ed09bbd90a6", "name": "network-vif-deleted", "tag": "63f5a59a-d9c7-4902-a67e-840697a666cc"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:15.877646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:15.903598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-326dea9d-2c7b-4b9f-8c82-9dbe40309bc7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:15.904242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-326dea9d-2c7b-4b9f-8c82-9dbe40309bc7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:15.920763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-326dea9d-2c7b-4b9f-8c82-9dbe40309bc7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:15.921268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-326dea9d-2c7b-4b9f-8c82-9dbe40309bc7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:15.921440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a95a6caf-02e6-473d-8187-f66845b09cf5 req-251bc4fa-b3d5-4f16-8732-88c19b2a99d4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:15.922068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-326dea9d-2c7b-4b9f-8c82-9dbe40309bc7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:15.922416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a95a6caf-02e6-473d-8187-f66845b09cf5 req-251bc4fa-b3d5-4f16-8732-88c19b2a99d4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:15.922703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-326dea9d-2c7b-4b9f-8c82-9dbe40309bc7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:15.939565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:15.966987 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a95a6caf-02e6-473d-8187-f66845b09cf5 req-251bc4fa-b3d5-4f16-8732-88c19b2a99d4 service nova] Creating event network-vif-deleted:63f5a59a-d9c7-4902-a67e-840697a666cc for instance 01009a01-6369-4508-97a4-1ed09bbd90a6 on n-h1-764485-11 Jul 20 04:45:15.977134 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a95a6caf-02e6-473d-8187-f66845b09cf5 req-251bc4fa-b3d5-4f16-8732-88c19b2a99d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145694 Jul 20 04:45:15.979011 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2849/5795] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:16.220255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-326dea9d-2c7b-4b9f-8c82-9dbe40309bc7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:16.230892 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-326dea9d-2c7b-4b9f-8c82-9dbe40309bc7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 200 len: 1327 microversion: 2.1 time: 0.331451 Jul 20 04:45:16.256352 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2947/5796] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:15 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 1327 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:17.219134 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:45:17.219631 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 04:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:45:17.252013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0539f15-eb8d-4686-91d7-7aaecc0a17a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:17.253051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b0539f15-eb8d-4686-91d7-7aaecc0a17a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:17.267400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0539f15-eb8d-4686-91d7-7aaecc0a17a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:17.269303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0539f15-eb8d-4686-91d7-7aaecc0a17a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:17.274046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0539f15-eb8d-4686-91d7-7aaecc0a17a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:17.274813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0539f15-eb8d-4686-91d7-7aaecc0a17a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:17.293270 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b0539f15-eb8d-4686-91d7-7aaecc0a17a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0539f15-eb8d-4686-91d7-7aaecc0a17a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 HTTP/1.1 Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '01009a01-6369-4508-97a4-1ed09bbd90a6'} Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:17.295396 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:45:17.311624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:17.311624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:17.311624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:17.311624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:45:17.311624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:45:17.311624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:45:17.311624 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:45:17.315053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0539f15-eb8d-4686-91d7-7aaecc0a17a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 404 to user: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:45:17.316229 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0539f15-eb8d-4686-91d7-7aaecc0a17a9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 404 len: 111 microversion: 2.1 time: 0.072263 Jul 20 04:45:17.317369 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2850/5797] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:17 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:45:17.327063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0cafee5a-e8d5-4db0-9ce2-13b20c677e50 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '.version_select at 0x7fbf9c062dc0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:17.371588 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0cafee5a-e8d5-4db0-9ce2-13b20c677e50 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1910856026" status: 202 len: 0 microversion: 2.1 time: 0.045225 Jul 20 04:45:17.375245 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2948/5798] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 04:45:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1910856026 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:45:19.423555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c9c0f019-4254-4b72-9233-d2ce9bd6f7c6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: .version_select at 0x7fbf9c4cc1f0>, body: {"keypair": {"name": "tempest-keypair-1794934589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHEzbw9ek95676DOXNi0HVaM5O5402b+9gXMcFCqtENa1oUf6C0/lZYAgHcOkMXSOQoOPjGOCpOQy2pqmfQDgZaUnKVAcGZGmObDpqOh85YBuKZDLfousTpG78m1E40EA=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:19.452856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c9c0f019-4254-4b72-9233-d2ce9bd6f7c6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:19.458890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c9c0f019-4254-4b72-9233-d2ce9bd6f7c6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for user 8759015052b64df2b36efb694b837999 and project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:19.509462 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c9c0f019-4254-4b72-9233-d2ce9bd6f7c6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.089467 Jul 20 04:45:19.512190 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2851/5799] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:45:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:25.894724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1404300842", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ee66832-4e3e-4ea5-b8c6-0e6625557ba2"}], "security_groups": [{"name": "tempest-securitygroup--552514550"}], "key_name": "tempest-keypair-1794934589", "user_data": "}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:25.922483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:26.230629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:26.662288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] validate_networks() for [('5ee66832-4e3e-4ea5-b8c6-0e6625557ba2', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:45:28.032865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:45:28.034298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:45:28.034795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:45:28.035227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:45:28.035735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:45:28.065083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:28.068342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:28.069577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:28.072307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:28.118834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:28.134834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Getting quotas for user 8759015052b64df2b36efb694b837999 and project 1a4fadbcc3e34a44a47acbd4428d7eef. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:28.164117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:45:28.169740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:45:28.283752 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6bb2392c-57c3-47a4-a7d6-12c3ab6ba31b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.424425 Jul 20 04:45:28.285722 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2949/5800] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:45:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:45:28.295442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ee1bd23-00df-43ac-8946-8f2e6c57c7dc tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:28.296176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ee1bd23-00df-43ac-8946-8f2e6c57c7dc tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:28.299298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:28.770523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ee1bd23-00df-43ac-8946-8f2e6c57c7dc tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:28.778533 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ee1bd23-00df-43ac-8946-8f2e6c57c7dc tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1242 microversion: 2.1 time: 0.486885 Jul 20 04:45:28.785083 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2852/5801] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:28 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1242 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:29.800091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1d259d1f-200f-4388-b2e8-859b294580ee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:29.802085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1d259d1f-200f-4388-b2e8-859b294580ee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:29.816174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d259d1f-200f-4388-b2e8-859b294580ee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:29.816938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d259d1f-200f-4388-b2e8-859b294580ee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:29.818458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d259d1f-200f-4388-b2e8-859b294580ee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:29.820197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d259d1f-200f-4388-b2e8-859b294580ee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:29.958114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1d259d1f-200f-4388-b2e8-859b294580ee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:29.970240 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1d259d1f-200f-4388-b2e8-859b294580ee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1294 microversion: 2.1 time: 0.174392 Jul 20 04:45:30.023603 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2950/5802] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:29 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1294 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:31.035009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5074d818-6bf8-4875-aba9-b55ba22d2b1e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:31.035553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5074d818-6bf8-4875-aba9-b55ba22d2b1e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:31.096378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5074d818-6bf8-4875-aba9-b55ba22d2b1e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:31.098167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5074d818-6bf8-4875-aba9-b55ba22d2b1e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:31.102236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5074d818-6bf8-4875-aba9-b55ba22d2b1e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:31.106562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5074d818-6bf8-4875-aba9-b55ba22d2b1e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:32.292628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5074d818-6bf8-4875-aba9-b55ba22d2b1e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:32.308148 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5074d818-6bf8-4875-aba9-b55ba22d2b1e tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1367 microversion: 2.1 time: 1.300878 Jul 20 04:45:32.311623 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2853/5803] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:31 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1367 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:33.329560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-90362aab-34ac-4041-a2e2-8d1b22fad674 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:33.330779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-90362aab-34ac-4041-a2e2-8d1b22fad674 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:33.354363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90362aab-34ac-4041-a2e2-8d1b22fad674 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:33.354823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90362aab-34ac-4041-a2e2-8d1b22fad674 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:33.358604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90362aab-34ac-4041-a2e2-8d1b22fad674 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:33.359151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90362aab-34ac-4041-a2e2-8d1b22fad674 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:34.145687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-90362aab-34ac-4041-a2e2-8d1b22fad674 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:34.172266 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-90362aab-34ac-4041-a2e2-8d1b22fad674 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1367 microversion: 2.1 time: 0.844033 Jul 20 04:45:34.177223 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2951/5804] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:33 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1367 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:34.560274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-351f1d10-f37c-40e9-ba49-497e0cacff72 req-1600425b-090d-4948-81dc-b54a3a40321d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f7d604-7504-4bff-9f32-5fc8fb2518a4", "tag": "b1cb634c-78e4-4386-a68b-c0d08e5e8ed0"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:34.584149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-351f1d10-f37c-40e9-ba49-497e0cacff72 req-1600425b-090d-4948-81dc-b54a3a40321d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:34.585348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-351f1d10-f37c-40e9-ba49-497e0cacff72 req-1600425b-090d-4948-81dc-b54a3a40321d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:34.674116 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-351f1d10-f37c-40e9-ba49-497e0cacff72 req-1600425b-090d-4948-81dc-b54a3a40321d service nova] Creating event network-changed:b1cb634c-78e4-4386-a68b-c0d08e5e8ed0 for instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 on n-h1-764485-11 Jul 20 04:45:34.713654 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-351f1d10-f37c-40e9-ba49-497e0cacff72 req-1600425b-090d-4948-81dc-b54a3a40321d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157710 Jul 20 04:45:34.721225 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2854/5805] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:35.193292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5639f148-ed22-405a-bd56-5d98938e5496 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:35.194069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5639f148-ed22-405a-bd56-5d98938e5496 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:35.206905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5639f148-ed22-405a-bd56-5d98938e5496 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:35.207370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5639f148-ed22-405a-bd56-5d98938e5496 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:35.228059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5639f148-ed22-405a-bd56-5d98938e5496 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:35.228536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5639f148-ed22-405a-bd56-5d98938e5496 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:35.834034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5639f148-ed22-405a-bd56-5d98938e5496 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:35.843031 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5639f148-ed22-405a-bd56-5d98938e5496 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1367 microversion: 2.1 time: 0.653785 Jul 20 04:45:35.860250 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2952/5806] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:35 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1367 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:36.871721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c350f395-7904-4018-9e44-6480374c3cac tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:36.872390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c350f395-7904-4018-9e44-6480374c3cac tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:36.895837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c350f395-7904-4018-9e44-6480374c3cac tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:36.900042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c350f395-7904-4018-9e44-6480374c3cac tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:36.901029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c350f395-7904-4018-9e44-6480374c3cac tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:36.901499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c350f395-7904-4018-9e44-6480374c3cac tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:37.404482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c350f395-7904-4018-9e44-6480374c3cac tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:37.462921 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c350f395-7904-4018-9e44-6480374c3cac tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1367 microversion: 2.1 time: 0.595690 Jul 20 04:45:37.468231 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2855/5807] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:36 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1367 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:38.485700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-341ff2a1-e39f-4bf5-a383-ef1ee45ba92c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:38.487180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-341ff2a1-e39f-4bf5-a383-ef1ee45ba92c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:38.494273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:38.495402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:38.506835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-341ff2a1-e39f-4bf5-a383-ef1ee45ba92c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:38.508087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-341ff2a1-e39f-4bf5-a383-ef1ee45ba92c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:38.511677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-341ff2a1-e39f-4bf5-a383-ef1ee45ba92c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:38.512850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-341ff2a1-e39f-4bf5-a383-ef1ee45ba92c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:39.895164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-341ff2a1-e39f-4bf5-a383-ef1ee45ba92c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:39.905935 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-341ff2a1-e39f-4bf5-a383-ef1ee45ba92c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1367 microversion: 2.1 time: 1.424043 Jul 20 04:45:39.908330 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2953/5808] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:38 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1367 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:40.925687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-268cd8de-7e2b-4932-831d-6bb5a90013b7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:40.926899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-268cd8de-7e2b-4932-831d-6bb5a90013b7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:40.931497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:40.939035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-268cd8de-7e2b-4932-831d-6bb5a90013b7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.949502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-268cd8de-7e2b-4932-831d-6bb5a90013b7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:40.960349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-268cd8de-7e2b-4932-831d-6bb5a90013b7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.962339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-268cd8de-7e2b-4932-831d-6bb5a90013b7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:41.218884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-268cd8de-7e2b-4932-831d-6bb5a90013b7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:41.238519 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-268cd8de-7e2b-4932-831d-6bb5a90013b7 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1367 microversion: 2.1 time: 0.316928 Jul 20 04:45:41.239834 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2856/5809] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:40 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:42.258349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-45c7e57f-6a5b-4255-aa3d-d8e7f19c4af3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:42.259168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-45c7e57f-6a5b-4255-aa3d-d8e7f19c4af3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:42.279338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45c7e57f-6a5b-4255-aa3d-d8e7f19c4af3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:42.282699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45c7e57f-6a5b-4255-aa3d-d8e7f19c4af3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:42.291295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45c7e57f-6a5b-4255-aa3d-d8e7f19c4af3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:42.302340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45c7e57f-6a5b-4255-aa3d-d8e7f19c4af3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:42.759015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-45c7e57f-6a5b-4255-aa3d-d8e7f19c4af3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:42.777091 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-45c7e57f-6a5b-4255-aa3d-d8e7f19c4af3 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1367 microversion: 2.1 time: 0.524327 Jul 20 04:45:42.778116 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2954/5810] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:42 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1367 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:43.798050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bd281bda-23b1-4d0b-9245-98dfa64ae3bb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:43.801444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bd281bda-23b1-4d0b-9245-98dfa64ae3bb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:43.828085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd281bda-23b1-4d0b-9245-98dfa64ae3bb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:43.832125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd281bda-23b1-4d0b-9245-98dfa64ae3bb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:43.836740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd281bda-23b1-4d0b-9245-98dfa64ae3bb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:43.863430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bd281bda-23b1-4d0b-9245-98dfa64ae3bb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.819761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bd281bda-23b1-4d0b-9245-98dfa64ae3bb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:44.841110 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bd281bda-23b1-4d0b-9245-98dfa64ae3bb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1367 microversion: 2.1 time: 1.048538 Jul 20 04:45:44.844515 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2857/5811] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:43 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1367 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:45.863249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2f929b16-3ea9-4b2c-9e02-7901cf7e7bc2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:45.866268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2f929b16-3ea9-4b2c-9e02-7901cf7e7bc2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:45.875341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f929b16-3ea9-4b2c-9e02-7901cf7e7bc2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.876333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f929b16-3ea9-4b2c-9e02-7901cf7e7bc2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.877391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f929b16-3ea9-4b2c-9e02-7901cf7e7bc2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.878210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2f929b16-3ea9-4b2c-9e02-7901cf7e7bc2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:46.164957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d7967485-8c65-4532-b7b7-24eced6a924f req-65ed8a9f-b68a-4cb3-976b-4e2f6fa296f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f7d604-7504-4bff-9f32-5fc8fb2518a4", "name": "network-vif-plugged", "status": "completed", "tag": "b1cb634c-78e4-4386-a68b-c0d08e5e8ed0"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:46.176709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:46.196757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d7967485-8c65-4532-b7b7-24eced6a924f req-65ed8a9f-b68a-4cb3-976b-4e2f6fa296f0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:46.199016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d7967485-8c65-4532-b7b7-24eced6a924f req-65ed8a9f-b68a-4cb3-976b-4e2f6fa296f0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:46.236386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2f929b16-3ea9-4b2c-9e02-7901cf7e7bc2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:46.243809 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d7967485-8c65-4532-b7b7-24eced6a924f req-65ed8a9f-b68a-4cb3-976b-4e2f6fa296f0 service nova] Creating event network-vif-plugged:b1cb634c-78e4-4386-a68b-c0d08e5e8ed0 for instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 on n-h1-764485-11 Jul 20 04:45:46.256595 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d7967485-8c65-4532-b7b7-24eced6a924f req-65ed8a9f-b68a-4cb3-976b-4e2f6fa296f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095906 Jul 20 04:45:46.257422 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2f929b16-3ea9-4b2c-9e02-7901cf7e7bc2 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1367 microversion: 2.1 time: 0.396957 Jul 20 04:45:46.259104 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2858/5812] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:46.259553 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2955/5813] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:45 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:47.275429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7588cd0c-c55f-42f2-a1e2-63b4f8476cee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:47.286054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7588cd0c-c55f-42f2-a1e2-63b4f8476cee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:47.323870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7588cd0c-c55f-42f2-a1e2-63b4f8476cee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:47.325283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7588cd0c-c55f-42f2-a1e2-63b4f8476cee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:47.326814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7588cd0c-c55f-42f2-a1e2-63b4f8476cee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:47.327348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7588cd0c-c55f-42f2-a1e2-63b4f8476cee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:47.655559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7588cd0c-c55f-42f2-a1e2-63b4f8476cee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:47.667884 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7588cd0c-c55f-42f2-a1e2-63b4f8476cee tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1367 microversion: 2.1 time: 0.395048 Jul 20 04:45:47.670327 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2956/5814] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:47 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:48.688696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-54d81f63-7ced-4a82-9b75-a44afc61c655 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:48.692109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-54d81f63-7ced-4a82-9b75-a44afc61c655 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:48.705641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54d81f63-7ced-4a82-9b75-a44afc61c655 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:48.706563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54d81f63-7ced-4a82-9b75-a44afc61c655 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:48.707890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54d81f63-7ced-4a82-9b75-a44afc61c655 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:48.709015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54d81f63-7ced-4a82-9b75-a44afc61c655 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:49.851639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-54d81f63-7ced-4a82-9b75-a44afc61c655 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:49.912219 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-54d81f63-7ced-4a82-9b75-a44afc61c655 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1557 microversion: 2.1 time: 1.228737 Jul 20 04:45:49.913200 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2859/5815] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:48 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1557 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:49.934993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-503f1604-0ca8-4a58-814c-fbc75ac4e6b8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:49.937663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-503f1604-0ca8-4a58-814c-fbc75ac4e6b8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:49.996308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-503f1604-0ca8-4a58-814c-fbc75ac4e6b8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:49.997184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-503f1604-0ca8-4a58-814c-fbc75ac4e6b8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:49.998770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-503f1604-0ca8-4a58-814c-fbc75ac4e6b8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:50.014086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-503f1604-0ca8-4a58-814c-fbc75ac4e6b8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:50.602118 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-503f1604-0ca8-4a58-814c-fbc75ac4e6b8 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.671972 Jul 20 04:45:50.602909 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2957/5816] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 04:45:49 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-interface => generated 285 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:56.070621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c40e7540-87cc-4a12-892f-f3f3c2bde366 req-0f571a3b-3991-4b27-a75f-659b1b1ffb01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f7d604-7504-4bff-9f32-5fc8fb2518a4", "tag": "b1cb634c-78e4-4386-a68b-c0d08e5e8ed0"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:56.109082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c40e7540-87cc-4a12-892f-f3f3c2bde366 req-0f571a3b-3991-4b27-a75f-659b1b1ffb01 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:56.109936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c40e7540-87cc-4a12-892f-f3f3c2bde366 req-0f571a3b-3991-4b27-a75f-659b1b1ffb01 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:56.159571 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c40e7540-87cc-4a12-892f-f3f3c2bde366 req-0f571a3b-3991-4b27-a75f-659b1b1ffb01 service nova] Creating event network-changed:b1cb634c-78e4-4386-a68b-c0d08e5e8ed0 for instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 on n-h1-764485-11 Jul 20 04:45:56.178884 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c40e7540-87cc-4a12-892f-f3f3c2bde366 req-0f571a3b-3991-4b27-a75f-659b1b1ffb01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128254 Jul 20 04:45:56.183658 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2860/5817] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:14.565630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:14.566743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=48 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:15.032764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2016ecc5-805b-4323-8ac0-7e47f7c3bc39 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Action: 'create', calling method: .version_select at 0x7fbf9c0a8790>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1895092889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0vVQonkr9T+VKPun0KoPzOFvLPv4/edn4nm1qeqE9RnyhBh0nShPM+AtaWyGuWdG+kk46szKpgI0i1NciF+Fl3YXlJRBv7lS6GyDYo6OpYGgD5/q+XNFEl0wWAimmanQ=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:15.072633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-2016ecc5-805b-4323-8ac0-7e47f7c3bc39 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Getting quotas for project d4bb4b22a5a24cbd801b18ce4381012d. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:15.093349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-2016ecc5-805b-4323-8ac0-7e47f7c3bc39 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Getting quotas for user 60e9fc1c48194d28a58ab64c7b9eec9d and project d4bb4b22a5a24cbd801b18ce4381012d. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:15.168852 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2016ecc5-805b-4323-8ac0-7e47f7c3bc39 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.605199 Jul 20 04:46:15.175474 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2958/5818] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:46:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:17.839330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=5 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:17.841299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=36 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:17.846138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2029964679", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1895092889", "security_groups": [{"name": "tempest-secgroup-smoke-1782134766"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "b8a5d0d4-ca0d-4dbc-8994-5f8cad9560c7"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:18.078113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] validate_networks() for [('b8a5d0d4-ca0d-4dbc-8994-5f8cad9560c7', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:46:19.566852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Getting quotas for project d4bb4b22a5a24cbd801b18ce4381012d. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:19.590058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Getting quotas for user 60e9fc1c48194d28a58ab64c7b9eec9d and project d4bb4b22a5a24cbd801b18ce4381012d. Resources: dict_keys(['metadata_items']) {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:19.645134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:46:19.647862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:46:19.653457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:46:19.654336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:46:19.655039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:46:19.691675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.693342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.697496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.698105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.779419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Getting quotas for project d4bb4b22a5a24cbd801b18ce4381012d. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:19.813006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Getting quotas for user 60e9fc1c48194d28a58ab64c7b9eec9d and project d4bb4b22a5a24cbd801b18ce4381012d. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:19.878677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:46:19.886614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:46:20.115878 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ce0f40e8-db9c-449f-807b-9e3ab9edef6c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.273803 Jul 20 04:46:20.122384 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2861/5819] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 2286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:46:20.132815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5f259fa4-754b-4f05-837f-0eeac9b2b76b tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:20.133572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5f259fa4-754b-4f05-837f-0eeac9b2b76b tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:20.356479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5f259fa4-754b-4f05-837f-0eeac9b2b76b tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:20.368728 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5f259fa4-754b-4f05-837f-0eeac9b2b76b tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1303 microversion: 2.1 time: 0.237881 Jul 20 04:46:20.369366 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2959/5820] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:20 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1303 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:21.389595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4148fb95-c7bf-4fb2-ae22-ae331cd148e0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:21.390115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4148fb95-c7bf-4fb2-ae22-ae331cd148e0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:21.674610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4148fb95-c7bf-4fb2-ae22-ae331cd148e0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:21.683409 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4148fb95-c7bf-4fb2-ae22-ae331cd148e0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1303 microversion: 2.1 time: 0.300487 Jul 20 04:46:21.687156 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2862/5821] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:21 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1303 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:22.702387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bdfd5bbc-abba-4fc1-84f6-ef258bf6c66a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:22.703697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bdfd5bbc-abba-4fc1-84f6-ef258bf6c66a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:22.719379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bdfd5bbc-abba-4fc1-84f6-ef258bf6c66a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:22.720058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bdfd5bbc-abba-4fc1-84f6-ef258bf6c66a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:22.721013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bdfd5bbc-abba-4fc1-84f6-ef258bf6c66a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:22.721769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bdfd5bbc-abba-4fc1-84f6-ef258bf6c66a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:23.011041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bdfd5bbc-abba-4fc1-84f6-ef258bf6c66a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:23.022347 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bdfd5bbc-abba-4fc1-84f6-ef258bf6c66a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1307 microversion: 2.1 time: 0.324142 Jul 20 04:46:23.034637 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2960/5822] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:22 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1307 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:24.043282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0ea13538-285a-4ce6-a3fc-ad295f1fc9cd tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:24.061140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0ea13538-285a-4ce6-a3fc-ad295f1fc9cd tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:24.077835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ea13538-285a-4ce6-a3fc-ad295f1fc9cd tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.078293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ea13538-285a-4ce6-a3fc-ad295f1fc9cd tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.079087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ea13538-285a-4ce6-a3fc-ad295f1fc9cd tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.079583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ea13538-285a-4ce6-a3fc-ad295f1fc9cd tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.351945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0ea13538-285a-4ce6-a3fc-ad295f1fc9cd tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:24.361612 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0ea13538-285a-4ce6-a3fc-ad295f1fc9cd tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1363 microversion: 2.1 time: 0.322684 Jul 20 04:46:24.363594 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2863/5823] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:24 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:25.384412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fc716f01-ac42-42b1-b1c0-71f98b096242 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:25.385673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fc716f01-ac42-42b1-b1c0-71f98b096242 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:25.399054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc716f01-ac42-42b1-b1c0-71f98b096242 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.400815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc716f01-ac42-42b1-b1c0-71f98b096242 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.404063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc716f01-ac42-42b1-b1c0-71f98b096242 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.404888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc716f01-ac42-42b1-b1c0-71f98b096242 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.566362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fc716f01-ac42-42b1-b1c0-71f98b096242 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:25.576554 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fc716f01-ac42-42b1-b1c0-71f98b096242 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1361 microversion: 2.1 time: 0.196682 Jul 20 04:46:25.580340 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2961/5824] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:25 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:26.601301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4257235f-ab80-4feb-a957-3a669af0b490 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:26.602852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4257235f-ab80-4feb-a957-3a669af0b490 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:26.638993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4257235f-ab80-4feb-a957-3a669af0b490 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:26.639642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4257235f-ab80-4feb-a957-3a669af0b490 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:26.641152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4257235f-ab80-4feb-a957-3a669af0b490 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:26.641724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4257235f-ab80-4feb-a957-3a669af0b490 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:27.298594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4257235f-ab80-4feb-a957-3a669af0b490 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:27.312017 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4257235f-ab80-4feb-a957-3a669af0b490 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1429 microversion: 2.1 time: 0.718477 Jul 20 04:46:27.328595 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2864/5825] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:26 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1429 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:28.199376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-049514e1-42b5-40e7-b436-bd40f85077cc req-7399e3ce-3cd6-4d66-9a1e-2a6076528fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a35e7a-e82c-4759-9737-7d99fa1310a0", "tag": "07156b72-7558-4377-aa1e-1c96adad14e1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:28.215839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-049514e1-42b5-40e7-b436-bd40f85077cc req-7399e3ce-3cd6-4d66-9a1e-2a6076528fd0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.219658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-049514e1-42b5-40e7-b436-bd40f85077cc req-7399e3ce-3cd6-4d66-9a1e-2a6076528fd0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.256966 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-049514e1-42b5-40e7-b436-bd40f85077cc req-7399e3ce-3cd6-4d66-9a1e-2a6076528fd0 service nova] Creating event network-changed:07156b72-7558-4377-aa1e-1c96adad14e1 for instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 on n-h2-764485-11 Jul 20 04:46:28.272187 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-049514e1-42b5-40e7-b436-bd40f85077cc req-7399e3ce-3cd6-4d66-9a1e-2a6076528fd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070816 Jul 20 04:46:28.273271 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2962/5826] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:28.345210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3665fee2-b41d-4a0e-a7fd-4a4f7e077d42 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:28.345791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3665fee2-b41d-4a0e-a7fd-4a4f7e077d42 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:28.366717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3665fee2-b41d-4a0e-a7fd-4a4f7e077d42 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.383237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3665fee2-b41d-4a0e-a7fd-4a4f7e077d42 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.387615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3665fee2-b41d-4a0e-a7fd-4a4f7e077d42 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.395120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3665fee2-b41d-4a0e-a7fd-4a4f7e077d42 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.323884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3665fee2-b41d-4a0e-a7fd-4a4f7e077d42 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:29.335976 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3665fee2-b41d-4a0e-a7fd-4a4f7e077d42 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1429 microversion: 2.1 time: 0.994885 Jul 20 04:46:29.344095 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2865/5827] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:28 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1429 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:30.356653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-58f003d1-58f9-4a0a-8e24-aeb1b8de157a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:30.357970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-58f003d1-58f9-4a0a-8e24-aeb1b8de157a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:30.372910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:30.377551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58f003d1-58f9-4a0a-8e24-aeb1b8de157a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.378017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58f003d1-58f9-4a0a-8e24-aeb1b8de157a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.378786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58f003d1-58f9-4a0a-8e24-aeb1b8de157a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.379228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58f003d1-58f9-4a0a-8e24-aeb1b8de157a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.665910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-58f003d1-58f9-4a0a-8e24-aeb1b8de157a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:30.674195 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-58f003d1-58f9-4a0a-8e24-aeb1b8de157a tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1429 microversion: 2.1 time: 0.322728 Jul 20 04:46:30.682423 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2963/5828] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:30 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1429 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:31.694530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c29863b4-c27f-46cb-b514-a2d348c00b8b tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:31.695156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c29863b4-c27f-46cb-b514-a2d348c00b8b tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:31.714080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:31.715691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=12 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:31.728655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c29863b4-c27f-46cb-b514-a2d348c00b8b tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.729795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c29863b4-c27f-46cb-b514-a2d348c00b8b tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.730735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c29863b4-c27f-46cb-b514-a2d348c00b8b tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.731459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c29863b4-c27f-46cb-b514-a2d348c00b8b tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:32.019183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c29863b4-c27f-46cb-b514-a2d348c00b8b tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:32.032989 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c29863b4-c27f-46cb-b514-a2d348c00b8b tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1429 microversion: 2.1 time: 0.338370 Jul 20 04:46:32.034123 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2866/5829] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:31 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1429 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:33.050826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d7775f68-072c-4d73-8d8b-cabad2f7a3e8 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:33.052149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d7775f68-072c-4d73-8d8b-cabad2f7a3e8 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:33.067357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d7775f68-072c-4d73-8d8b-cabad2f7a3e8 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.067904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d7775f68-072c-4d73-8d8b-cabad2f7a3e8 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.068693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d7775f68-072c-4d73-8d8b-cabad2f7a3e8 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.069132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d7775f68-072c-4d73-8d8b-cabad2f7a3e8 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.465570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d7775f68-072c-4d73-8d8b-cabad2f7a3e8 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:33.497729 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d7775f68-072c-4d73-8d8b-cabad2f7a3e8 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1429 microversion: 2.1 time: 0.447674 Jul 20 04:46:33.498491 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2964/5830] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:33 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1429 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:34.515044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3fb81317-5336-42ec-87eb-0b00a3ed15df tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:34.516334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3fb81317-5336-42ec-87eb-0b00a3ed15df tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:34.534312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fb81317-5336-42ec-87eb-0b00a3ed15df tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.535038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fb81317-5336-42ec-87eb-0b00a3ed15df tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.536642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fb81317-5336-42ec-87eb-0b00a3ed15df tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.537328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fb81317-5336-42ec-87eb-0b00a3ed15df tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.732023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a454068e-0414-4c6c-b9db-e93cc08018ce req-8432bf2e-796e-4ac1-b974-b28f62368ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a35e7a-e82c-4759-9737-7d99fa1310a0", "name": "network-vif-plugged", "status": "completed", "tag": "07156b72-7558-4377-aa1e-1c96adad14e1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:34.756123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a454068e-0414-4c6c-b9db-e93cc08018ce req-8432bf2e-796e-4ac1-b974-b28f62368ff1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.756573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a454068e-0414-4c6c-b9db-e93cc08018ce req-8432bf2e-796e-4ac1-b974-b28f62368ff1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.798415 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a454068e-0414-4c6c-b9db-e93cc08018ce req-8432bf2e-796e-4ac1-b974-b28f62368ff1 service nova] Creating event network-vif-plugged:07156b72-7558-4377-aa1e-1c96adad14e1 for instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 on n-h2-764485-11 Jul 20 04:46:34.812719 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a454068e-0414-4c6c-b9db-e93cc08018ce req-8432bf2e-796e-4ac1-b974-b28f62368ff1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082351 Jul 20 04:46:34.820302 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2965/5831] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:35.128031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3fb81317-5336-42ec-87eb-0b00a3ed15df tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:35.149109 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3fb81317-5336-42ec-87eb-0b00a3ed15df tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1429 microversion: 2.1 time: 0.637774 Jul 20 04:46:35.150033 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2867/5832] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:34 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1429 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:36.168549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cacef25f-c422-4114-9d03-5cb6ebd24e8e tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:36.169264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cacef25f-c422-4114-9d03-5cb6ebd24e8e tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:36.183337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cacef25f-c422-4114-9d03-5cb6ebd24e8e tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:36.183839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cacef25f-c422-4114-9d03-5cb6ebd24e8e tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:36.184631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cacef25f-c422-4114-9d03-5cb6ebd24e8e tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:36.190086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cacef25f-c422-4114-9d03-5cb6ebd24e8e tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:36.554619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cacef25f-c422-4114-9d03-5cb6ebd24e8e tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:36.562833 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cacef25f-c422-4114-9d03-5cb6ebd24e8e tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1429 microversion: 2.1 time: 0.399415 Jul 20 04:46:36.574380 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2966/5833] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:36 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1429 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:37.591208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d5f03407-075f-4c39-bb21-5ac21c8289a1 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:37.593296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d5f03407-075f-4c39-bb21-5ac21c8289a1 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:37.615390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5f03407-075f-4c39-bb21-5ac21c8289a1 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.616159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5f03407-075f-4c39-bb21-5ac21c8289a1 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.617153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5f03407-075f-4c39-bb21-5ac21c8289a1 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.617802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d5f03407-075f-4c39-bb21-5ac21c8289a1 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.911572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d5f03407-075f-4c39-bb21-5ac21c8289a1 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:37.923589 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d5f03407-075f-4c39-bb21-5ac21c8289a1 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1609 microversion: 2.1 time: 0.336035 Jul 20 04:46:37.935192 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2868/5834] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:37 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1609 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:37.940235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7f157073-3ce5-43aa-81b8-f8c1e8678163 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:37.941467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7f157073-3ce5-43aa-81b8-f8c1e8678163 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:37.960691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f157073-3ce5-43aa-81b8-f8c1e8678163 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.961460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f157073-3ce5-43aa-81b8-f8c1e8678163 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.962454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f157073-3ce5-43aa-81b8-f8c1e8678163 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.963079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f157073-3ce5-43aa-81b8-f8c1e8678163 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.341409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7f157073-3ce5-43aa-81b8-f8c1e8678163 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:38.356978 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7f157073-3ce5-43aa-81b8-f8c1e8678163 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1609 microversion: 2.1 time: 0.413524 Jul 20 04:46:38.358539 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2967/5835] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:37 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1609 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:38.377549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-60e97de7-a046-4fd3-a0fb-c2aa04b9ea9f tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:38.378181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-60e97de7-a046-4fd3-a0fb-c2aa04b9ea9f tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:38.427253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60e97de7-a046-4fd3-a0fb-c2aa04b9ea9f tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.427738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60e97de7-a046-4fd3-a0fb-c2aa04b9ea9f tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.428524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60e97de7-a046-4fd3-a0fb-c2aa04b9ea9f tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.433509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60e97de7-a046-4fd3-a0fb-c2aa04b9ea9f tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.850393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-60e97de7-a046-4fd3-a0fb-c2aa04b9ea9f tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:38.862658 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-60e97de7-a046-4fd3-a0fb-c2aa04b9ea9f tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1609 microversion: 2.1 time: 0.490282 Jul 20 04:46:38.871906 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2869/5836] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:38 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1609 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:43.369367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-279f0b8d-7395-4d21-85ec-bd96a081bbdb req-e8f68ec3-c11b-4399-af7e-fa8770874dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a35e7a-e82c-4759-9737-7d99fa1310a0", "tag": "07156b72-7558-4377-aa1e-1c96adad14e1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:43.384139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-279f0b8d-7395-4d21-85ec-bd96a081bbdb req-e8f68ec3-c11b-4399-af7e-fa8770874dda service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.384659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-279f0b8d-7395-4d21-85ec-bd96a081bbdb req-e8f68ec3-c11b-4399-af7e-fa8770874dda service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.412884 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-279f0b8d-7395-4d21-85ec-bd96a081bbdb req-e8f68ec3-c11b-4399-af7e-fa8770874dda service nova] Creating event network-changed:07156b72-7558-4377-aa1e-1c96adad14e1 for instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 on n-h2-764485-11 Jul 20 04:46:43.425749 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-279f0b8d-7395-4d21-85ec-bd96a081bbdb req-e8f68ec3-c11b-4399-af7e-fa8770874dda service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.273000 Jul 20 04:46:43.426979 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2968/5837] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:06.953315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-573729871", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "fba1ba96-599b-49a9-83ba-4c01a3f32292"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:06.993464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:06.996588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=44 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:07.083762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] validate_networks() for [('fba1ba96-599b-49a9-83ba-4c01a3f32292', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:47:07.431181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21cdc7eb-83f0-46a8-9080-7a2ccfefa489 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:07.432018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21cdc7eb-83f0-46a8-9080-7a2ccfefa489 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:07.456807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:07.459664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=42 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:07.465780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21cdc7eb-83f0-46a8-9080-7a2ccfefa489 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:07.466442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21cdc7eb-83f0-46a8-9080-7a2ccfefa489 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:07.469756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21cdc7eb-83f0-46a8-9080-7a2ccfefa489 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:07.470340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21cdc7eb-83f0-46a8-9080-7a2ccfefa489 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:07.524562 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21cdc7eb-83f0-46a8-9080-7a2ccfefa489 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/ips" status: 200 len: 149 microversion: 2.1 time: 0.103562 Jul 20 04:47:07.527832 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2969/5838] 10.222.0.20 () {58 vars in 1247 bytes} [Wed Jul 20 04:47:07 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/ips => generated 149 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:07.834727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:47:07.835640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:47:07.836397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:47:07.837387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:47:07.838163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:47:07.870208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:07.870680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:07.871921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:07.873371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:07.912615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Getting quotas for project 50d59d062e95402b9ddf3699e09a1ac0. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:47:07.925967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Getting quotas for user f3e3329f9f764805ace7e1561ff909b8 and project 50d59d062e95402b9ddf3699e09a1ac0. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:47:07.991712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:47:07.995861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:47:08.121517 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-96dc325c-dbd7-46c3-b8fe-78d0831b45bd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.178472 Jul 20 04:47:08.122922 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2870/5839] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:47:08.135460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ac84a5db-6205-4686-9991-f2b5402096a6 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:08.136619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ac84a5db-6205-4686-9991-f2b5402096a6 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:08.222887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ac84a5db-6205-4686-9991-f2b5402096a6 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:08.235063 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ac84a5db-6205-4686-9991-f2b5402096a6 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1213 microversion: 2.1 time: 0.105493 Jul 20 04:47:08.246760 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2970/5840] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:08 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1213 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:09.254287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6cf29d64-7467-4ed5-b43b-4625d32d7c08 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:09.254906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6cf29d64-7467-4ed5-b43b-4625d32d7c08 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:09.403782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6cf29d64-7467-4ed5-b43b-4625d32d7c08 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:09.419367 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6cf29d64-7467-4ed5-b43b-4625d32d7c08 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1213 microversion: 2.1 time: 0.169409 Jul 20 04:47:09.420317 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2871/5841] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:09 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1213 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:10.297252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a91735c-69d5-41b2-8ed5-f446cf1fc993 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f8f694e-c91a-4e8c-9de0-043b9d8530dd"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:10.301373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7a91735c-69d5-41b2-8ed5-f446cf1fc993 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:10.324216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a91735c-69d5-41b2-8ed5-f446cf1fc993 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.325942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a91735c-69d5-41b2-8ed5-f446cf1fc993 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.327157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a91735c-69d5-41b2-8ed5-f446cf1fc993 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.336381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a91735c-69d5-41b2-8ed5-f446cf1fc993 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.443967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3d43d3c9-32d0-4ece-9c70-a483b5811728 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:10.445842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3d43d3c9-32d0-4ece-9c70-a483b5811728 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:10.488465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d43d3c9-32d0-4ece-9c70-a483b5811728 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.489620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d43d3c9-32d0-4ece-9c70-a483b5811728 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.492575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d43d3c9-32d0-4ece-9c70-a483b5811728 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.493032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d43d3c9-32d0-4ece-9c70-a483b5811728 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.820433 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7a91735c-69d5-41b2-8ed5-f446cf1fc993 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "POST /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532795 Jul 20 04:47:10.823261 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2971/5842] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:47:10 2022] POST /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:10.941890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3d43d3c9-32d0-4ece-9c70-a483b5811728 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:10.957582 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3d43d3c9-32d0-4ece-9c70-a483b5811728 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1283 microversion: 2.1 time: 0.523761 Jul 20 04:47:10.958893 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2872/5843] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:10 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1283 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:11.987278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-470a8add-d352-44fa-97e3-6aeca1ab1bcd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:11.989091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-470a8add-d352-44fa-97e3-6aeca1ab1bcd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:12.006419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-470a8add-d352-44fa-97e3-6aeca1ab1bcd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.007128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-470a8add-d352-44fa-97e3-6aeca1ab1bcd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.008195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-470a8add-d352-44fa-97e3-6aeca1ab1bcd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.009129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-470a8add-d352-44fa-97e3-6aeca1ab1bcd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.400153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-470a8add-d352-44fa-97e3-6aeca1ab1bcd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:12.434345 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-470a8add-d352-44fa-97e3-6aeca1ab1bcd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1271 microversion: 2.1 time: 0.455186 Jul 20 04:47:12.446412 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2972/5844] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:11 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1271 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:13.452246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b64f433c-8a1f-493e-bdee-a0ac01a68c29 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:13.452978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b64f433c-8a1f-493e-bdee-a0ac01a68c29 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:13.464090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b64f433c-8a1f-493e-bdee-a0ac01a68c29 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:13.474595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b64f433c-8a1f-493e-bdee-a0ac01a68c29 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:13.475640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b64f433c-8a1f-493e-bdee-a0ac01a68c29 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:13.476325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b64f433c-8a1f-493e-bdee-a0ac01a68c29 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:14.653094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b64f433c-8a1f-493e-bdee-a0ac01a68c29 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:14.662513 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b64f433c-8a1f-493e-bdee-a0ac01a68c29 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1313 microversion: 2.1 time: 1.214367 Jul 20 04:47:14.669453 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2873/5845] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:13 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1313 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:15.366242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-d5ecfb9a-7e39-4579-b16f-d1def7bed671 req-106321d5-900e-440f-a6ca-326ac266e7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70dfe7e8-de9d-49d7-aa84-a96608e0de70", "tag": "8eef5c1e-2d41-4b96-b00c-2fdf0ad9b840"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:15.399698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d5ecfb9a-7e39-4579-b16f-d1def7bed671 req-106321d5-900e-440f-a6ca-326ac266e7f7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.400927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d5ecfb9a-7e39-4579-b16f-d1def7bed671 req-106321d5-900e-440f-a6ca-326ac266e7f7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:15.445922 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-d5ecfb9a-7e39-4579-b16f-d1def7bed671 req-106321d5-900e-440f-a6ca-326ac266e7f7 service nova] Creating event network-changed:8eef5c1e-2d41-4b96-b00c-2fdf0ad9b840 for instance 70dfe7e8-de9d-49d7-aa84-a96608e0de70 on n-h1-764485-11 Jul 20 04:47:15.455129 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-d5ecfb9a-7e39-4579-b16f-d1def7bed671 req-106321d5-900e-440f-a6ca-326ac266e7f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093267 Jul 20 04:47:15.458218 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2973/5846] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:15.686109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1038d38e-92d8-4fbe-9b7a-5bd6459c094e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:15.687595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1038d38e-92d8-4fbe-9b7a-5bd6459c094e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:15.700419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1038d38e-92d8-4fbe-9b7a-5bd6459c094e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.703672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1038d38e-92d8-4fbe-9b7a-5bd6459c094e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:15.706931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1038d38e-92d8-4fbe-9b7a-5bd6459c094e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.707774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1038d38e-92d8-4fbe-9b7a-5bd6459c094e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:16.126440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1038d38e-92d8-4fbe-9b7a-5bd6459c094e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:16.174459 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1038d38e-92d8-4fbe-9b7a-5bd6459c094e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1313 microversion: 2.1 time: 0.492712 Jul 20 04:47:16.185834 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2874/5847] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:15 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:17.201014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-86bc0ebf-9b7d-435f-9d39-a0c8f0547b5e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:17.201737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-86bc0ebf-9b7d-435f-9d39-a0c8f0547b5e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:17.245513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86bc0ebf-9b7d-435f-9d39-a0c8f0547b5e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.246089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86bc0ebf-9b7d-435f-9d39-a0c8f0547b5e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.246900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86bc0ebf-9b7d-435f-9d39-a0c8f0547b5e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.247345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86bc0ebf-9b7d-435f-9d39-a0c8f0547b5e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.710766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-86bc0ebf-9b7d-435f-9d39-a0c8f0547b5e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:17.726570 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-86bc0ebf-9b7d-435f-9d39-a0c8f0547b5e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1313 microversion: 2.1 time: 0.526027 Jul 20 04:47:17.736688 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2974/5848] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:17 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:18.744363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5025ffee-5761-4f61-a7d5-b2cf01167f77 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:18.744998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5025ffee-5761-4f61-a7d5-b2cf01167f77 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:18.756252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:18.760333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5025ffee-5761-4f61-a7d5-b2cf01167f77 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:18.781593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5025ffee-5761-4f61-a7d5-b2cf01167f77 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:18.782595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5025ffee-5761-4f61-a7d5-b2cf01167f77 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:18.783057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5025ffee-5761-4f61-a7d5-b2cf01167f77 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.408612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:19.483474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5025ffee-5761-4f61-a7d5-b2cf01167f77 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:19.507661 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5025ffee-5761-4f61-a7d5-b2cf01167f77 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1313 microversion: 2.1 time: 0.759627 Jul 20 04:47:19.509631 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2875/5849] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:18 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1313 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:20.527339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-28e0d3ee-e40b-4204-b94e-395147fbead9 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:20.528296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-28e0d3ee-e40b-4204-b94e-395147fbead9 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:20.538707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:20.576527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28e0d3ee-e40b-4204-b94e-395147fbead9 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.585791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28e0d3ee-e40b-4204-b94e-395147fbead9 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.589523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28e0d3ee-e40b-4204-b94e-395147fbead9 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.598034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28e0d3ee-e40b-4204-b94e-395147fbead9 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.420418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-28e0d3ee-e40b-4204-b94e-395147fbead9 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:21.432443 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-28e0d3ee-e40b-4204-b94e-395147fbead9 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1313 microversion: 2.1 time: 0.910246 Jul 20 04:47:21.436146 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2975/5850] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:20 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1313 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:22.452199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-88ae3ef2-763c-4107-ab38-d306686a9cd2 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:22.452994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-88ae3ef2-763c-4107-ab38-d306686a9cd2 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:22.462273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88ae3ef2-763c-4107-ab38-d306686a9cd2 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.466820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88ae3ef2-763c-4107-ab38-d306686a9cd2 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.467803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88ae3ef2-763c-4107-ab38-d306686a9cd2 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.479697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88ae3ef2-763c-4107-ab38-d306686a9cd2 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.804325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-88ae3ef2-763c-4107-ab38-d306686a9cd2 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:22.816795 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-88ae3ef2-763c-4107-ab38-d306686a9cd2 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1313 microversion: 2.1 time: 0.368311 Jul 20 04:47:22.818723 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2876/5851] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:22 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:23.845952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b008ffef-4283-4b27-a19d-5fdf3a2a5627 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:23.846699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b008ffef-4283-4b27-a19d-5fdf3a2a5627 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:23.856936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b008ffef-4283-4b27-a19d-5fdf3a2a5627 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.857401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b008ffef-4283-4b27-a19d-5fdf3a2a5627 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.858200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b008ffef-4283-4b27-a19d-5fdf3a2a5627 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.858653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b008ffef-4283-4b27-a19d-5fdf3a2a5627 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:24.161114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b008ffef-4283-4b27-a19d-5fdf3a2a5627 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:24.182161 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b008ffef-4283-4b27-a19d-5fdf3a2a5627 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1313 microversion: 2.1 time: 0.350927 Jul 20 04:47:24.183422 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2976/5852] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:23 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:25.201165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9b9486a-584d-450c-8794-f46f20a74c05 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:25.201815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e9b9486a-584d-450c-8794-f46f20a74c05 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:25.224830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9b9486a-584d-450c-8794-f46f20a74c05 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.225458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9b9486a-584d-450c-8794-f46f20a74c05 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.226429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9b9486a-584d-450c-8794-f46f20a74c05 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.227273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9b9486a-584d-450c-8794-f46f20a74c05 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.815606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e9b9486a-584d-450c-8794-f46f20a74c05 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:25.826878 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e9b9486a-584d-450c-8794-f46f20a74c05 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1313 microversion: 2.1 time: 0.630722 Jul 20 04:47:25.840724 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2877/5853] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:25 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1313 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:26.851114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-419e39ef-09b2-4ccf-9098-f3d4e3d35e7c tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:26.852100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-419e39ef-09b2-4ccf-9098-f3d4e3d35e7c tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:26.870552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-419e39ef-09b2-4ccf-9098-f3d4e3d35e7c tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.871838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-419e39ef-09b2-4ccf-9098-f3d4e3d35e7c tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.875066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-419e39ef-09b2-4ccf-9098-f3d4e3d35e7c tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.875570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-419e39ef-09b2-4ccf-9098-f3d4e3d35e7c tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:27.511451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-17ed324c-fa2c-4617-aaea-7d434ba15f4f req-04ff6a66-d001-4ac1-ad26-791afcd90f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70dfe7e8-de9d-49d7-aa84-a96608e0de70", "name": "network-vif-plugged", "status": "completed", "tag": "8eef5c1e-2d41-4b96-b00c-2fdf0ad9b840"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:27.528383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-17ed324c-fa2c-4617-aaea-7d434ba15f4f req-04ff6a66-d001-4ac1-ad26-791afcd90f97 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:27.528838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-17ed324c-fa2c-4617-aaea-7d434ba15f4f req-04ff6a66-d001-4ac1-ad26-791afcd90f97 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:27.586416 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-17ed324c-fa2c-4617-aaea-7d434ba15f4f req-04ff6a66-d001-4ac1-ad26-791afcd90f97 service nova] Creating event network-vif-plugged:8eef5c1e-2d41-4b96-b00c-2fdf0ad9b840 for instance 70dfe7e8-de9d-49d7-aa84-a96608e0de70 on n-h1-764485-11 Jul 20 04:47:27.605071 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-17ed324c-fa2c-4617-aaea-7d434ba15f4f req-04ff6a66-d001-4ac1-ad26-791afcd90f97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.638397 Jul 20 04:47:27.605723 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2878/5854] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:27.792474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-419e39ef-09b2-4ccf-9098-f3d4e3d35e7c tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:27.805459 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-419e39ef-09b2-4ccf-9098-f3d4e3d35e7c tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1313 microversion: 2.1 time: 0.964133 Jul 20 04:47:27.816487 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2977/5855] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:26 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1313 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:28.834541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-358663a4-093a-4fe2-b77d-7e2bace7698e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:28.835590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-358663a4-093a-4fe2-b77d-7e2bace7698e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:28.854733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-358663a4-093a-4fe2-b77d-7e2bace7698e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.855696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-358663a4-093a-4fe2-b77d-7e2bace7698e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.856761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-358663a4-093a-4fe2-b77d-7e2bace7698e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.858473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-358663a4-093a-4fe2-b77d-7e2bace7698e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.446133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-358663a4-093a-4fe2-b77d-7e2bace7698e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:29.454355 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-358663a4-093a-4fe2-b77d-7e2bace7698e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1313 microversion: 2.1 time: 0.624916 Jul 20 04:47:29.461156 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2879/5856] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:28 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:30.039269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f45beb03-1081-40b0-bb4f-6848a90d2e69 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-22183739", "availability_zone": "foo_zone"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:30.085456 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:47:30.085456 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:47:30.105743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.aggregate [None req-f45beb03-1081-40b0-bb4f-6848a90d2e69 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Generated uuid 37e95c15-6a99-47cf-a017-ed7e1be8c5ca for aggregate {{(pid=119808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:47:30.193374 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f45beb03-1081-40b0-bb4f-6848a90d2e69 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 207 microversion: 2.1 time: 0.285626 Jul 20 04:47:30.203930 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2978/5857] 10.222.0.20 () {60 vars in 1163 bytes} [Wed Jul 20 04:47:29 2022] POST /compute/v2.1/os-aggregates => generated 207 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:30.214057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cb2508b3-67bb-409a-b2f3-3229c4887bb1 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:30.215424 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:47:30.215424 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:47:30.280381 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cb2508b3-67bb-409a-b2f3-3229c4887bb1 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 317 microversion: 2.1 time: 0.070514 Jul 20 04:47:30.289706 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2880/5858] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:47:30 2022] POST /compute/v2.1/os-aggregates/19/action => generated 317 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:30.293382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e6d5c40d-d55c-4079-9cc4-5eb6a87fba69 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:30.300324 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:47:30.300324 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:47:30.302029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6d5c40d-d55c-4079-9cc4-5eb6a87fba69 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.306255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6d5c40d-d55c-4079-9cc4-5eb6a87fba69 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.313381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6d5c40d-d55c-4079-9cc4-5eb6a87fba69 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.315426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e6d5c40d-d55c-4079-9cc4-5eb6a87fba69 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.382705 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e6d5c40d-d55c-4079-9cc4-5eb6a87fba69 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.087985 Jul 20 04:47:30.385788 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2979/5859] 10.222.0.20 () {58 vars in 1175 bytes} [Wed Jul 20 04:47:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:30.397518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8d35981a-224c-498a-9eae-93eeab37093b tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:30.398488 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:47:30.398488 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:47:30.418077 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8d35981a-224c-498a-9eae-93eeab37093b tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.025207 Jul 20 04:47:30.425849 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2881/5860] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Jul 20 04:47:30 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:30.432615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c0435982-c94b-46df-8dc9-7f8456d9c941 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:30.434052 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:47:30.434052 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:47:30.451590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0435982-c94b-46df-8dc9-7f8456d9c941 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.452065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0435982-c94b-46df-8dc9-7f8456d9c941 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.481255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08047257-f75f-453c-aa29-1d7e5ac13384 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:30.482288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-08047257-f75f-453c-aa29-1d7e5ac13384 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:30.493835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08047257-f75f-453c-aa29-1d7e5ac13384 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.495929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08047257-f75f-453c-aa29-1d7e5ac13384 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.498995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08047257-f75f-453c-aa29-1d7e5ac13384 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.500902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08047257-f75f-453c-aa29-1d7e5ac13384 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.979159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-08047257-f75f-453c-aa29-1d7e5ac13384 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:30.990375 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-08047257-f75f-453c-aa29-1d7e5ac13384 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1497 microversion: 2.1 time: 0.515085 Jul 20 04:47:31.046389 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2882/5861] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:30 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1497 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:31.090569 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c0435982-c94b-46df-8dc9-7f8456d9c941 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.663711 Jul 20 04:47:31.092807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-920c5f9c-b7c6-478e-b317-cdb89c825aed tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:31.100475 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2980/5862] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:47:30 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:31.105712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-920c5f9c-b7c6-478e-b317-cdb89c825aed tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:31.110545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5e13e7ec-c344-48ce-84ed-6a386cca5c15 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:31.125954 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:47:31.125954 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:47:31.132707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-920c5f9c-b7c6-478e-b317-cdb89c825aed tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:31.134541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-920c5f9c-b7c6-478e-b317-cdb89c825aed tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.137615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-920c5f9c-b7c6-478e-b317-cdb89c825aed tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:31.138323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-920c5f9c-b7c6-478e-b317-cdb89c825aed tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.148063 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5e13e7ec-c344-48ce-84ed-6a386cca5c15 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.041201 Jul 20 04:47:31.151075 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2981/5863] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:47:31 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:31.182878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-748cfe7e-3f3b-4af2-b114-3ba858733863 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1826989920", "availability_zone": "foo_zone"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:31.388335 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:47:31.388335 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:47:31.452915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-920c5f9c-b7c6-478e-b317-cdb89c825aed tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lazy-loading 'services' on Instance uuid 89f7d604-7504-4bff-9f32-5fc8fb2518a4 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:47:31.512561 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-748cfe7e-3f3b-4af2-b114-3ba858733863 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.355286 Jul 20 04:47:31.514459 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2982/5864] 10.222.0.20 () {60 vars in 1172 bytes} [Wed Jul 20 04:47:31 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:31.527772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-635df5b7-d8c1-43bd-bde8-59cb91702141 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:31.531176 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:47:31.531176 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:47:31.588864 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-635df5b7-d8c1-43bd-bde8-59cb91702141 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.068742 Jul 20 04:47:31.590193 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2983/5865] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:47:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:31.602688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3fdb99a4-b551-4ca1-8ff2-fa0975ef06d8 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:31.605296 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:47:31.605296 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:47:31.625115 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3fdb99a4-b551-4ca1-8ff2-fa0975ef06d8 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.024793 Jul 20 04:47:31.626365 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2984/5866] 10.222.0.20 () {58 vars in 1151 bytes} [Wed Jul 20 04:47:31 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:31.644237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-80b0124c-778b-4dad-a29c-cf260b5f0754 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-764485-11"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:31.648864 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:47:31.648864 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:47:31.661353 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-920c5f9c-b7c6-478e-b317-cdb89c825aed tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments/5f8f694e-c91a-4e8c-9de0-043b9d8530dd" status: 202 len: 0 microversion: 2.1 time: 0.584432 Jul 20 04:47:31.661979 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2883/5867] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:47:31 2022] DELETE /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments/5f8f694e-c91a-4e8c-9de0-043b9d8530dd => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:31.680132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80b0124c-778b-4dad-a29c-cf260b5f0754 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:31.686420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80b0124c-778b-4dad-a29c-cf260b5f0754 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.697038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-db0bae31-1022-4cd9-b34b-0f07196cdfb9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:31.700155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-db0bae31-1022-4cd9-b34b-0f07196cdfb9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:31.717378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db0bae31-1022-4cd9-b34b-0f07196cdfb9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:31.718094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db0bae31-1022-4cd9-b34b-0f07196cdfb9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.723316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db0bae31-1022-4cd9-b34b-0f07196cdfb9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:31.724226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-db0bae31-1022-4cd9-b34b-0f07196cdfb9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.770108 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-db0bae31-1022-4cd9-b34b-0f07196cdfb9 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101521 Jul 20 04:47:31.770979 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2884/5868] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:47:31 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:31.962466 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-80b0124c-778b-4dad-a29c-cf260b5f0754 tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.329343 Jul 20 04:47:31.965742 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2985/5869] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Jul 20 04:47:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:31.989281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-43957f4b-fe8e-457e-aed1-268ab4933b8c tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:31.990389 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:47:31.990389 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:47:32.042584 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-43957f4b-fe8e-457e-aed1-268ab4933b8c tempest-TestAggregatesBasicOps-1924251404 tempest-TestAggregatesBasicOps-1924251404-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.069923 Jul 20 04:47:32.043754 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2885/5870] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Jul 20 04:47:31 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:47:32.077858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d02be40a-82d8-4a24-9c82-cc23484e556b tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:32.078562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d02be40a-82d8-4a24-9c82-cc23484e556b tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:32.087114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d02be40a-82d8-4a24-9c82-cc23484e556b tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.087543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d02be40a-82d8-4a24-9c82-cc23484e556b tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.088316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d02be40a-82d8-4a24-9c82-cc23484e556b tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.107455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d02be40a-82d8-4a24-9c82-cc23484e556b tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.195975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d02be40a-82d8-4a24-9c82-cc23484e556b tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:47:32.359537 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d02be40a-82d8-4a24-9c82-cc23484e556b tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 204 len: 0 microversion: 2.1 time: 0.285498 Jul 20 04:47:32.365700 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2986/5871] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:47:32 2022] DELETE /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:47:32.387020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0c39569a-ff74-4e60-85e0-0601ad6c5734 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:32.388180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0c39569a-ff74-4e60-85e0-0601ad6c5734 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:32.397800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c39569a-ff74-4e60-85e0-0601ad6c5734 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.399356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c39569a-ff74-4e60-85e0-0601ad6c5734 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.404246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c39569a-ff74-4e60-85e0-0601ad6c5734 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.404828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c39569a-ff74-4e60-85e0-0601ad6c5734 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.793438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b2691c3-8e48-4763-8363-91d577a531a6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:32.794965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b2691c3-8e48-4763-8363-91d577a531a6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:32.805393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b2691c3-8e48-4763-8363-91d577a531a6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.805935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b2691c3-8e48-4763-8363-91d577a531a6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.806664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b2691c3-8e48-4763-8363-91d577a531a6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.807125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b2691c3-8e48-4763-8363-91d577a531a6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.878701 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b2691c3-8e48-4763-8363-91d577a531a6 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100989 Jul 20 04:47:32.879218 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2987/5872] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:47:32 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:32.892463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0c39569a-ff74-4e60-85e0-0601ad6c5734 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:32.906521 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0c39569a-ff74-4e60-85e0-0601ad6c5734 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1503 microversion: 2.1 time: 0.533143 Jul 20 04:47:32.907779 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2886/5873] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:32 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1503 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:33.890345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f0097e3b-6e0f-4919-9148-f39369cb50b0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:33.891398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f0097e3b-6e0f-4919-9148-f39369cb50b0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:33.905006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f0097e3b-6e0f-4919-9148-f39369cb50b0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:33.905560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f0097e3b-6e0f-4919-9148-f39369cb50b0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:33.906358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f0097e3b-6e0f-4919-9148-f39369cb50b0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:33.906812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f0097e3b-6e0f-4919-9148-f39369cb50b0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:33.925031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b65a5b75-3b20-4ea5-8156-eed809b39105 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:33.925688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b65a5b75-3b20-4ea5-8156-eed809b39105 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:33.934499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b65a5b75-3b20-4ea5-8156-eed809b39105 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:33.951245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b65a5b75-3b20-4ea5-8156-eed809b39105 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:33.952394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b65a5b75-3b20-4ea5-8156-eed809b39105 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:33.953045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b65a5b75-3b20-4ea5-8156-eed809b39105 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:33.991708 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f0097e3b-6e0f-4919-9148-f39369cb50b0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105174 Jul 20 04:47:33.998995 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2988/5874] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:47:33 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:34.339173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b65a5b75-3b20-4ea5-8156-eed809b39105 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:34.348102 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b65a5b75-3b20-4ea5-8156-eed809b39105 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1503 microversion: 2.1 time: 0.427536 Jul 20 04:47:34.355336 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2887/5875] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:33 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1503 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:35.007288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-26afbe27-d2f4-4b53-8519-911834ab59fd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:35.008881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-26afbe27-d2f4-4b53-8519-911834ab59fd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:35.022378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26afbe27-d2f4-4b53-8519-911834ab59fd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:35.029945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26afbe27-d2f4-4b53-8519-911834ab59fd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:35.032306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26afbe27-d2f4-4b53-8519-911834ab59fd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:35.037778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26afbe27-d2f4-4b53-8519-911834ab59fd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:35.113011 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-26afbe27-d2f4-4b53-8519-911834ab59fd tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110410 Jul 20 04:47:35.117834 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2989/5876] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:47:35 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:35.379352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4e51f791-4f44-4793-8f1b-d94cb3a3dd50 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:35.380816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4e51f791-4f44-4793-8f1b-d94cb3a3dd50 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:35.399688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e51f791-4f44-4793-8f1b-d94cb3a3dd50 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:35.400148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e51f791-4f44-4793-8f1b-d94cb3a3dd50 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:35.400936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e51f791-4f44-4793-8f1b-d94cb3a3dd50 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:35.401378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e51f791-4f44-4793-8f1b-d94cb3a3dd50 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.130687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d260e842-8261-437d-9de1-74ef5cd3087d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:36.132306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d260e842-8261-437d-9de1-74ef5cd3087d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:36.153978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d260e842-8261-437d-9de1-74ef5cd3087d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.154441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d260e842-8261-437d-9de1-74ef5cd3087d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.161467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d260e842-8261-437d-9de1-74ef5cd3087d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.161906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d260e842-8261-437d-9de1-74ef5cd3087d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.264969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:36.277722 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d260e842-8261-437d-9de1-74ef5cd3087d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150949 Jul 20 04:47:36.287773 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2990/5877] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:47:36 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:36.954612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4e51f791-4f44-4793-8f1b-d94cb3a3dd50 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:36.965057 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4e51f791-4f44-4793-8f1b-d94cb3a3dd50 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1503 microversion: 2.1 time: 1.596211 Jul 20 04:47:36.985852 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2888/5878] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:35 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1503 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:37.300358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c02b618-898a-4baa-a82e-392e15c41e69 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:37.302743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9c02b618-898a-4baa-a82e-392e15c41e69 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:37.338919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c02b618-898a-4baa-a82e-392e15c41e69 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:37.341031 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c02b618-898a-4baa-a82e-392e15c41e69 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:37.342184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c02b618-898a-4baa-a82e-392e15c41e69 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:37.348522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c02b618-898a-4baa-a82e-392e15c41e69 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:37.464905 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c02b618-898a-4baa-a82e-392e15c41e69 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177737 Jul 20 04:47:37.466010 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2991/5879] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:47:37 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:37.467380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-80dea3c6-512b-49d7-bf71-aa79de890fc1 req-061f0ff8-9a72-4974-b305-b0289f04461a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70dfe7e8-de9d-49d7-aa84-a96608e0de70", "name": "network-vif-deleted", "tag": "8eef5c1e-2d41-4b96-b00c-2fdf0ad9b840"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:37.472795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:37.489885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-80dea3c6-512b-49d7-bf71-aa79de890fc1 req-061f0ff8-9a72-4974-b305-b0289f04461a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:37.490412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-80dea3c6-512b-49d7-bf71-aa79de890fc1 req-061f0ff8-9a72-4974-b305-b0289f04461a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:37.543010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:37.570235 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-80dea3c6-512b-49d7-bf71-aa79de890fc1 req-061f0ff8-9a72-4974-b305-b0289f04461a service nova] Creating event network-vif-deleted:8eef5c1e-2d41-4b96-b00c-2fdf0ad9b840 for instance 70dfe7e8-de9d-49d7-aa84-a96608e0de70 on n-h1-764485-11 Jul 20 04:47:37.581364 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-80dea3c6-512b-49d7-bf71-aa79de890fc1 req-061f0ff8-9a72-4974-b305-b0289f04461a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117441 Jul 20 04:47:37.587064 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2889/5880] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:37.994743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fe92f02e-3ba0-4786-91df-700a71f6aaac tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:37.995643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fe92f02e-3ba0-4786-91df-700a71f6aaac tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:37.997752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:38.021516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe92f02e-3ba0-4786-91df-700a71f6aaac tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.021981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe92f02e-3ba0-4786-91df-700a71f6aaac tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.031761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe92f02e-3ba0-4786-91df-700a71f6aaac tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.035277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe92f02e-3ba0-4786-91df-700a71f6aaac tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.137267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe92f02e-3ba0-4786-91df-700a71f6aaac tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.137726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe92f02e-3ba0-4786-91df-700a71f6aaac tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.138351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-fe92f02e-3ba0-4786-91df-700a71f6aaac tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lazy-loading 'fault' on Instance uuid 70dfe7e8-de9d-49d7-aa84-a96608e0de70 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:47:38.352612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fe92f02e-3ba0-4786-91df-700a71f6aaac tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:38.366824 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fe92f02e-3ba0-4786-91df-700a71f6aaac tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 200 len: 1303 microversion: 2.1 time: 0.376066 Jul 20 04:47:38.368185 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2992/5881] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:37 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 1303 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:38.480150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1873bce9-88a5-43ea-ba12-aba2ae3193db tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:38.482343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1873bce9-88a5-43ea-ba12-aba2ae3193db tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:38.521906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1873bce9-88a5-43ea-ba12-aba2ae3193db tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.524226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1873bce9-88a5-43ea-ba12-aba2ae3193db tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.527293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1873bce9-88a5-43ea-ba12-aba2ae3193db tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.528351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1873bce9-88a5-43ea-ba12-aba2ae3193db tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.698326 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1873bce9-88a5-43ea-ba12-aba2ae3193db tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.223745 Jul 20 04:47:38.704239 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2890/5882] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:47:38 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:39.386956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6ed8aef-cc2e-4a07-b879-ac57e59bbf88 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:39.388117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f6ed8aef-cc2e-4a07-b879-ac57e59bbf88 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 70dfe7e8-de9d-49d7-aa84-a96608e0de70] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:39.397164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6ed8aef-cc2e-4a07-b879-ac57e59bbf88 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.397810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6ed8aef-cc2e-4a07-b879-ac57e59bbf88 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.398798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6ed8aef-cc2e-4a07-b879-ac57e59bbf88 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.399395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6ed8aef-cc2e-4a07-b879-ac57e59bbf88 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.419183 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f6ed8aef-cc2e-4a07-b879-ac57e59bbf88 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] HTTP exception thrown: Instance 70dfe7e8-de9d-49d7-aa84-a96608e0de70 could not be found. Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6ed8aef-cc2e-4a07-b879-ac57e59bbf88 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Request method failure captured: Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 HTTP/1.1 Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14jHqr4utfJCCPEFA92XP7Ylnv552yAuUiXeRyJOl9ix8lqIBLsUwi1dCgfj8WbEX0nyLuF6fAobrwJkpf_-MN325EoU6Gt5ytOKkWAkQ1oyQiit8qXc2MURDML6pqf49SAevSFSnuayN26H4T7U41SxT1bBQS3qNqeG_e_jKFnppTs Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 50d59d062e95402b9ddf3699e09a1ac0 Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-VolumesActionsTest-600966433 Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/50d59d062e95402b9ddf3699e09a1ac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/50d59d062e95402b9ddf3699e09a1ac0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_50d59d062e95402b9ddf3699e09a1ac0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/50d59d062e95402b9ddf3699e09a1ac0"}]}] Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-VolumesActionsTest-600966433 Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 50d59d062e95402b9ddf3699e09a1ac0 Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-VolumesActionsTest-600966433 Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-VolumesActionsTest-600966433-project Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: f3e3329f9f764805ace7e1561ff909b8 Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-VolumesActionsTest-600966433-project Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 70dfe7e8-de9d-49d7-aa84-a96608e0de70 could not be found. Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '70dfe7e8-de9d-49d7-aa84-a96608e0de70'} Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70dfe7e8-de9d-49d7-aa84-a96608e0de70 could not be found. Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70dfe7e8-de9d-49d7-aa84-a96608e0de70 could not be found. Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:39.421104 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:47:39.425236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:39.425236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:39.425236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:39.425236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:39.425236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:39.425236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70dfe7e8-de9d-49d7-aa84-a96608e0de70 could not be found. Jul 20 04:47:39.425236 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:47:39.426844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6ed8aef-cc2e-4a07-b879-ac57e59bbf88 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Returning 404 to user: Instance 70dfe7e8-de9d-49d7-aa84-a96608e0de70 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:39.428316 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f6ed8aef-cc2e-4a07-b879-ac57e59bbf88 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70" status: 404 len: 111 microversion: 2.1 time: 0.046500 Jul 20 04:47:39.429042 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2993/5883] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:39 2022] GET /compute/v2.1/servers/70dfe7e8-de9d-49d7-aa84-a96608e0de70 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:47:39.583675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1739307846", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "fba1ba96-599b-49a9-83ba-4c01a3f32292"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:39.711423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7220df14-439c-4f60-ab5c-c937e55d9fef tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:39.713689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7220df14-439c-4f60-ab5c-c937e55d9fef tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:39.723192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7220df14-439c-4f60-ab5c-c937e55d9fef tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.724397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7220df14-439c-4f60-ab5c-c937e55d9fef tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.725487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7220df14-439c-4f60-ab5c-c937e55d9fef tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.726345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7220df14-439c-4f60-ab5c-c937e55d9fef tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.742915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] validate_networks() for [('fba1ba96-599b-49a9-83ba-4c01a3f32292', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:47:39.784621 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7220df14-439c-4f60-ab5c-c937e55d9fef tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073331 Jul 20 04:47:39.789639 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2994/5884] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:47:39 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:40.579799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:47:40.579799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:47:40.579799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:47:40.579799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:47:40.579799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:47:40.612332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.613167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.614516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.625285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.648274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Getting quotas for project 50d59d062e95402b9ddf3699e09a1ac0. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:47:40.654974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Getting quotas for user f3e3329f9f764805ace7e1561ff909b8 and project 50d59d062e95402b9ddf3699e09a1ac0. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:47:40.669795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:47:40.672308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:47:40.730887 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ca93a13-a0da-4e6f-b560-5d049ac84286 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152005 Jul 20 04:47:40.731854 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2891/5885] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:47:40.744204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9403bca0-b925-4881-ac6f-2ff8c5d7435f tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:40.744886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9403bca0-b925-4881-ac6f-2ff8c5d7435f tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:40.746768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:40.797352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f2c03318-7fda-4680-8423-afb99a23a42c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:40.800915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f2c03318-7fda-4680-8423-afb99a23a42c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:40.813769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f2c03318-7fda-4680-8423-afb99a23a42c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.814225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f2c03318-7fda-4680-8423-afb99a23a42c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.815308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f2c03318-7fda-4680-8423-afb99a23a42c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.820009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f2c03318-7fda-4680-8423-afb99a23a42c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.880995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9403bca0-b925-4881-ac6f-2ff8c5d7435f tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:40.890398 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9403bca0-b925-4881-ac6f-2ff8c5d7435f tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1214 microversion: 2.1 time: 0.152112 Jul 20 04:47:40.892358 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2995/5886] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:40 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:40.931824 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f2c03318-7fda-4680-8423-afb99a23a42c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138673 Jul 20 04:47:40.937197 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2892/5887] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:47:40 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:41.914011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6296314-5934-4f3c-bb99-99cf2d55e20d tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:41.916416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f6296314-5934-4f3c-bb99-99cf2d55e20d tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:41.946234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6a11c175-2c70-4509-a6a7-47fb37b6303c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:41.947654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6a11c175-2c70-4509-a6a7-47fb37b6303c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:41.958293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a11c175-2c70-4509-a6a7-47fb37b6303c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.972209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6296314-5934-4f3c-bb99-99cf2d55e20d tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.977255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a11c175-2c70-4509-a6a7-47fb37b6303c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.981105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a11c175-2c70-4509-a6a7-47fb37b6303c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.982136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6296314-5934-4f3c-bb99-99cf2d55e20d tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.984745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a11c175-2c70-4509-a6a7-47fb37b6303c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.988463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6296314-5934-4f3c-bb99-99cf2d55e20d tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.990633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6296314-5934-4f3c-bb99-99cf2d55e20d tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.071333 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6a11c175-2c70-4509-a6a7-47fb37b6303c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129959 Jul 20 04:47:42.072727 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2893/5888] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:47:41 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:42.179578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f6296314-5934-4f3c-bb99-99cf2d55e20d tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:42.189564 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f6296314-5934-4f3c-bb99-99cf2d55e20d tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1266 microversion: 2.1 time: 0.283200 Jul 20 04:47:42.195057 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2996/5889] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:41 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:43.085052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-02fe7316-b4a7-43ad-98f9-cb561415ba7c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:43.086123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-02fe7316-b4a7-43ad-98f9-cb561415ba7c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:43.105406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02fe7316-b4a7-43ad-98f9-cb561415ba7c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.106192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02fe7316-b4a7-43ad-98f9-cb561415ba7c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.107228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02fe7316-b4a7-43ad-98f9-cb561415ba7c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.108227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02fe7316-b4a7-43ad-98f9-cb561415ba7c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.180603 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-02fe7316-b4a7-43ad-98f9-cb561415ba7c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100720 Jul 20 04:47:43.182169 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2894/5890] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:47:43 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:43.210772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-364d3a18-f4f8-45b2-ae19-b892c622591e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:43.210772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-364d3a18-f4f8-45b2-ae19-b892c622591e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:43.225045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-364d3a18-f4f8-45b2-ae19-b892c622591e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.225511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-364d3a18-f4f8-45b2-ae19-b892c622591e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.226316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-364d3a18-f4f8-45b2-ae19-b892c622591e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.227025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-364d3a18-f4f8-45b2-ae19-b892c622591e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.372722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-364d3a18-f4f8-45b2-ae19-b892c622591e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:43.387880 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-364d3a18-f4f8-45b2-ae19-b892c622591e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1272 microversion: 2.1 time: 0.177029 Jul 20 04:47:43.388565 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2997/5891] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:43 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:44.201057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f5be2520-5238-466b-8769-2976cb02ff95 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:44.204834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f5be2520-5238-466b-8769-2976cb02ff95 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:44.243892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5be2520-5238-466b-8769-2976cb02ff95 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.253339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5be2520-5238-466b-8769-2976cb02ff95 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.254221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5be2520-5238-466b-8769-2976cb02ff95 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.254673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5be2520-5238-466b-8769-2976cb02ff95 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.323802 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f5be2520-5238-466b-8769-2976cb02ff95 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133111 Jul 20 04:47:44.325102 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2895/5892] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 04:47:44 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:47:44.407110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7606b9a0-6455-4f8f-983a-f14dc107979a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:44.415122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5d3b76d6-f12d-4bae-a49e-444c118b80cb tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:44.416315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5d3b76d6-f12d-4bae-a49e-444c118b80cb tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:44.418464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7606b9a0-6455-4f8f-983a-f14dc107979a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:44.429918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d3b76d6-f12d-4bae-a49e-444c118b80cb tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.435502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d3b76d6-f12d-4bae-a49e-444c118b80cb tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.437411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d3b76d6-f12d-4bae-a49e-444c118b80cb tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.439041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d3b76d6-f12d-4bae-a49e-444c118b80cb tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.440643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7606b9a0-6455-4f8f-983a-f14dc107979a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.446227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7606b9a0-6455-4f8f-983a-f14dc107979a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.447407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7606b9a0-6455-4f8f-983a-f14dc107979a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.448110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7606b9a0-6455-4f8f-983a-f14dc107979a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.514569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7606b9a0-6455-4f8f-983a-f14dc107979a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:47:44.856451 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7606b9a0-6455-4f8f-983a-f14dc107979a tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 204 len: 0 microversion: 2.1 time: 0.455546 Jul 20 04:47:44.859782 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2998/5893] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:47:44 2022] DELETE /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:47:44.873713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-205f3fd9-0957-4cfc-ab58-512377f51f87 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:44.879738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-205f3fd9-0957-4cfc-ab58-512377f51f87 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:44.898157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-205f3fd9-0957-4cfc-ab58-512377f51f87 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.898975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-205f3fd9-0957-4cfc-ab58-512377f51f87 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.900168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-205f3fd9-0957-4cfc-ab58-512377f51f87 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.900874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-205f3fd9-0957-4cfc-ab58-512377f51f87 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.436283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5d3b76d6-f12d-4bae-a49e-444c118b80cb tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:45.445290 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5d3b76d6-f12d-4bae-a49e-444c118b80cb tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1314 microversion: 2.1 time: 1.034616 Jul 20 04:47:45.453726 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2896/5894] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:44 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1314 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:45.650135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-205f3fd9-0957-4cfc-ab58-512377f51f87 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:45.668753 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-205f3fd9-0957-4cfc-ab58-512377f51f87 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1681 microversion: 2.1 time: 0.803722 Jul 20 04:47:45.680291 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 2999/5895] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:44 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1681 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:46.268382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1fdee707-e78e-4a37-a125-cb65c736935d req-b43d54b8-7c3f-4113-9e47-f91396ae6ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12ccc5c9-90ba-4fa6-b81c-6793babfaa64", "tag": "9a8ef827-acd8-4d7e-a976-fb75147e44e6"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:46.286103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1fdee707-e78e-4a37-a125-cb65c736935d req-b43d54b8-7c3f-4113-9e47-f91396ae6ef5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.286677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1fdee707-e78e-4a37-a125-cb65c736935d req-b43d54b8-7c3f-4113-9e47-f91396ae6ef5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.310877 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1fdee707-e78e-4a37-a125-cb65c736935d req-b43d54b8-7c3f-4113-9e47-f91396ae6ef5 service nova] Creating event network-changed:9a8ef827-acd8-4d7e-a976-fb75147e44e6 for instance 12ccc5c9-90ba-4fa6-b81c-6793babfaa64 on n-h1-764485-11 Jul 20 04:47:46.320994 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1fdee707-e78e-4a37-a125-cb65c736935d req-b43d54b8-7c3f-4113-9e47-f91396ae6ef5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056496 Jul 20 04:47:46.324440 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2897/5896] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:46.469943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2ad370b4-088e-4981-b2a8-b757cc23ad7e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:46.471042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2ad370b4-088e-4981-b2a8-b757cc23ad7e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:46.487989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ad370b4-088e-4981-b2a8-b757cc23ad7e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.490115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ad370b4-088e-4981-b2a8-b757cc23ad7e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.491534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ad370b4-088e-4981-b2a8-b757cc23ad7e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.492605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ad370b4-088e-4981-b2a8-b757cc23ad7e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.664464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-969625a4-c518-43ab-ba0c-95a37be8013c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:46.665766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-969625a4-c518-43ab-ba0c-95a37be8013c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:46.676967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-969625a4-c518-43ab-ba0c-95a37be8013c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.682895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-969625a4-c518-43ab-ba0c-95a37be8013c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.684032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-969625a4-c518-43ab-ba0c-95a37be8013c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.686097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-969625a4-c518-43ab-ba0c-95a37be8013c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.741568 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-969625a4-c518-43ab-ba0c-95a37be8013c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.081860 Jul 20 04:47:46.747085 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2898/5897] 10.222.0.20 () {58 vars in 1292 bytes} [Wed Jul 20 04:47:46 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0/os-server-password => generated 116 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:46.776133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-88fcb808-3f12-4492-8eb5-d4eeea0aa6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:46.778563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-88fcb808-3f12-4492-8eb5-d4eeea0aa6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:46.792634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88fcb808-3f12-4492-8eb5-d4eeea0aa6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.793102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88fcb808-3f12-4492-8eb5-d4eeea0aa6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.793882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88fcb808-3f12-4492-8eb5-d4eeea0aa6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.794328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88fcb808-3f12-4492-8eb5-d4eeea0aa6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:47.531344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-88fcb808-3f12-4492-8eb5-d4eeea0aa6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:47.536140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2ad370b4-088e-4981-b2a8-b757cc23ad7e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:47.546868 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-88fcb808-3f12-4492-8eb5-d4eeea0aa6c0 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1681 microversion: 2.1 time: 0.797740 Jul 20 04:47:47.547487 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2899/5898] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:46 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1681 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:47.556903 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2ad370b4-088e-4981-b2a8-b757cc23ad7e tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1314 microversion: 2.1 time: 1.082431 Jul 20 04:47:47.556903 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3000/5899] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:46 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1314 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:48.570518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4d06c9da-4e61-48b4-993c-3456667ea0c1 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:48.573065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-15bb926b-ccf5-4c45-8f6e-2457d6b9eec5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:48.574587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4d06c9da-4e61-48b4-993c-3456667ea0c1 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:48.575530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-15bb926b-ccf5-4c45-8f6e-2457d6b9eec5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:48.593318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d06c9da-4e61-48b4-993c-3456667ea0c1 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.594238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15bb926b-ccf5-4c45-8f6e-2457d6b9eec5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.594955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15bb926b-ccf5-4c45-8f6e-2457d6b9eec5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.596539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d06c9da-4e61-48b4-993c-3456667ea0c1 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.597704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d06c9da-4e61-48b4-993c-3456667ea0c1 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.597941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15bb926b-ccf5-4c45-8f6e-2457d6b9eec5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.598655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15bb926b-ccf5-4c45-8f6e-2457d6b9eec5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.599310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d06c9da-4e61-48b4-993c-3456667ea0c1 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:49.448294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-15bb926b-ccf5-4c45-8f6e-2457d6b9eec5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:49.465533 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-15bb926b-ccf5-4c45-8f6e-2457d6b9eec5 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1681 microversion: 2.1 time: 0.904194 Jul 20 04:47:49.466273 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2900/5900] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:48 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1681 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:49.602501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4d06c9da-4e61-48b4-993c-3456667ea0c1 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:49.612997 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4d06c9da-4e61-48b4-993c-3456667ea0c1 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1314 microversion: 2.1 time: 1.046328 Jul 20 04:47:49.630715 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3001/5901] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:48 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1314 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:50.484529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-575d957b-558f-4c37-8056-383af3c7a948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:50.485162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-575d957b-558f-4c37-8056-383af3c7a948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:50.504556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-575d957b-558f-4c37-8056-383af3c7a948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.505317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-575d957b-558f-4c37-8056-383af3c7a948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.506343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-575d957b-558f-4c37-8056-383af3c7a948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.507007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-575d957b-558f-4c37-8056-383af3c7a948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.636427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:50.638737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b1ff7f5-c083-4b33-b830-b1024cd15923 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:50.641114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5b1ff7f5-c083-4b33-b830-b1024cd15923 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:50.656955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b1ff7f5-c083-4b33-b830-b1024cd15923 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.660513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b1ff7f5-c083-4b33-b830-b1024cd15923 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.662504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b1ff7f5-c083-4b33-b830-b1024cd15923 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.663628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b1ff7f5-c083-4b33-b830-b1024cd15923 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.664284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:50.890799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:51.055677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-575d957b-558f-4c37-8056-383af3c7a948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:51.075444 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-575d957b-558f-4c37-8056-383af3c7a948 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1614 microversion: 2.1 time: 0.596112 Jul 20 04:47:51.083160 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2901/5902] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:50 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1614 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:51.457557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b6d8c297-f51f-4a7e-abf4-310e5a3746ce req-45353f59-048b-4ce2-83b1-c533cf37183f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f7d604-7504-4bff-9f32-5fc8fb2518a4", "name": "network-vif-deleted", "tag": "b1cb634c-78e4-4386-a68b-c0d08e5e8ed0"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:51.474880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b6d8c297-f51f-4a7e-abf4-310e5a3746ce req-45353f59-048b-4ce2-83b1-c533cf37183f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:51.477008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b6d8c297-f51f-4a7e-abf4-310e5a3746ce req-45353f59-048b-4ce2-83b1-c533cf37183f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:51.490441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b1ff7f5-c083-4b33-b830-b1024cd15923 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:51.501132 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5b1ff7f5-c083-4b33-b830-b1024cd15923 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1314 microversion: 2.1 time: 0.868793 Jul 20 04:47:51.512717 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b6d8c297-f51f-4a7e-abf4-310e5a3746ce req-45353f59-048b-4ce2-83b1-c533cf37183f service nova] Creating event network-vif-deleted:b1cb634c-78e4-4386-a68b-c0d08e5e8ed0 for instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 on n-h1-764485-11 Jul 20 04:47:51.515697 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3002/5903] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:50 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:51.519769 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b6d8c297-f51f-4a7e-abf4-310e5a3746ce req-45353f59-048b-4ce2-83b1-c533cf37183f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066820 Jul 20 04:47:51.522290 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2902/5904] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:52.100807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4d964a70-42f8-41f5-a096-3256dfd1043c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:52.102503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4d964a70-42f8-41f5-a096-3256dfd1043c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:52.115081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d964a70-42f8-41f5-a096-3256dfd1043c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.118231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d964a70-42f8-41f5-a096-3256dfd1043c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.119184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d964a70-42f8-41f5-a096-3256dfd1043c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.120786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d964a70-42f8-41f5-a096-3256dfd1043c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.223605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d964a70-42f8-41f5-a096-3256dfd1043c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.226011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4d964a70-42f8-41f5-a096-3256dfd1043c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.227007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-4d964a70-42f8-41f5-a096-3256dfd1043c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lazy-loading 'fault' on Instance uuid 89f7d604-7504-4bff-9f32-5fc8fb2518a4 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:47:52.405971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4d964a70-42f8-41f5-a096-3256dfd1043c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8759015052b64df2b36efb694b837999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4fadbcc3e34a44a47acbd4428d7eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:52.420433 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4d964a70-42f8-41f5-a096-3256dfd1043c tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 200 len: 1332 microversion: 2.1 time: 0.319928 Jul 20 04:47:52.429287 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3003/5905] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:52 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 1332 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:52.522551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-15b3dd76-e013-4956-b0f5-670c6e8bcd13 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:52.523998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-15b3dd76-e013-4956-b0f5-670c6e8bcd13 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:52.540640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15b3dd76-e013-4956-b0f5-670c6e8bcd13 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.541690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15b3dd76-e013-4956-b0f5-670c6e8bcd13 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.543739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15b3dd76-e013-4956-b0f5-670c6e8bcd13 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.545170 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-15b3dd76-e013-4956-b0f5-670c6e8bcd13 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.825402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-15b3dd76-e013-4956-b0f5-670c6e8bcd13 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:52.839432 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-15b3dd76-e013-4956-b0f5-670c6e8bcd13 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1314 microversion: 2.1 time: 0.322477 Jul 20 04:47:52.853301 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2903/5906] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:52 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:53.441275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8cd1707b-504c-47c6-9fac-21c42192db58 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:53.442497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8cd1707b-504c-47c6-9fac-21c42192db58 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:53.460738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8cd1707b-504c-47c6-9fac-21c42192db58 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.461453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8cd1707b-504c-47c6-9fac-21c42192db58 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.462961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8cd1707b-504c-47c6-9fac-21c42192db58 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.463643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8cd1707b-504c-47c6-9fac-21c42192db58 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.488877 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-8cd1707b-504c-47c6-9fac-21c42192db58 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8cd1707b-504c-47c6-9fac-21c42192db58 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 HTTP/1.1 Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '89f7d604-7504-4bff-9f32-5fc8fb2518a4'} Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:53.493279 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.497373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.497373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:53.497373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:53.497373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:53.497373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:53.497373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:47:53.497373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.503196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8cd1707b-504c-47c6-9fac-21c42192db58 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 404 to user: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:53.505228 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8cd1707b-504c-47c6-9fac-21c42192db58 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 404 len: 111 microversion: 2.1 time: 0.070081 Jul 20 04:47:53.510991 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3004/5907] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:53 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:53.522238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c77f381d-deba-4743-8ed6-568ef5b08a11 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '.version_select at 0x7fbf9c480550>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:53.574720 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c77f381d-deba-4743-8ed6-568ef5b08a11 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794934589" status: 202 len: 0 microversion: 2.1 time: 0.056280 Jul 20 04:47:53.577282 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2904/5908] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 04:47:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794934589 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:53.859824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-58f71cc7-0c91-4f11-90a7-cabca2b5d1fd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:53.860444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-58f71cc7-0c91-4f11-90a7-cabca2b5d1fd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:53.870671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58f71cc7-0c91-4f11-90a7-cabca2b5d1fd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.871003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58f71cc7-0c91-4f11-90a7-cabca2b5d1fd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.871918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58f71cc7-0c91-4f11-90a7-cabca2b5d1fd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.874444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58f71cc7-0c91-4f11-90a7-cabca2b5d1fd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:54.508499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-58f71cc7-0c91-4f11-90a7-cabca2b5d1fd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:54.521598 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-58f71cc7-0c91-4f11-90a7-cabca2b5d1fd tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1314 microversion: 2.1 time: 0.666766 Jul 20 04:47:54.536709 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3005/5909] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:53 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:54.847928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-36b7d8dc-5589-4b3f-84a2-bf015e79c457 req-3a2c0f54-68a1-49cd-adf2-b20822de4226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ccc5c9-90ba-4fa6-b81c-6793babfaa64", "name": "network-vif-plugged", "status": "completed", "tag": "9a8ef827-acd8-4d7e-a976-fb75147e44e6"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:54.876853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-36b7d8dc-5589-4b3f-84a2-bf015e79c457 req-3a2c0f54-68a1-49cd-adf2-b20822de4226 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:54.879296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-36b7d8dc-5589-4b3f-84a2-bf015e79c457 req-3a2c0f54-68a1-49cd-adf2-b20822de4226 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:54.912828 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-36b7d8dc-5589-4b3f-84a2-bf015e79c457 req-3a2c0f54-68a1-49cd-adf2-b20822de4226 service nova] Creating event network-vif-plugged:9a8ef827-acd8-4d7e-a976-fb75147e44e6 for instance 12ccc5c9-90ba-4fa6-b81c-6793babfaa64 on n-h1-764485-11 Jul 20 04:47:54.928346 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-36b7d8dc-5589-4b3f-84a2-bf015e79c457 req-3a2c0f54-68a1-49cd-adf2-b20822de4226 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087148 Jul 20 04:47:54.930523 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2905/5910] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:55.544552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52d7f5ad-4e85-408a-bbd9-0b90113aa700 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:55.544552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52d7f5ad-4e85-408a-bbd9-0b90113aa700 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:55.551312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52d7f5ad-4e85-408a-bbd9-0b90113aa700 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:55.551799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52d7f5ad-4e85-408a-bbd9-0b90113aa700 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:55.552583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52d7f5ad-4e85-408a-bbd9-0b90113aa700 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:55.553028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52d7f5ad-4e85-408a-bbd9-0b90113aa700 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:55.888265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52d7f5ad-4e85-408a-bbd9-0b90113aa700 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:55.896938 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52d7f5ad-4e85-408a-bbd9-0b90113aa700 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1314 microversion: 2.1 time: 0.360161 Jul 20 04:47:55.902639 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3006/5911] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:55 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:56.901398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1380943097", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "006ca317-30bd-4662-a9d5-21fb7703e7f4"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:56.928646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-307c9b39-e842-4405-b342-d45dafb3ddb8 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:56.929455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-307c9b39-e842-4405-b342-d45dafb3ddb8 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:56.972199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-307c9b39-e842-4405-b342-d45dafb3ddb8 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:56.974173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-307c9b39-e842-4405-b342-d45dafb3ddb8 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:56.975999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-307c9b39-e842-4405-b342-d45dafb3ddb8 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:56.983707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-307c9b39-e842-4405-b342-d45dafb3ddb8 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:57.010399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] validate_networks() for [('006ca317-30bd-4662-a9d5-21fb7703e7f4', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:47:57.023878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:57.399138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-307c9b39-e842-4405-b342-d45dafb3ddb8 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:57.416912 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-307c9b39-e842-4405-b342-d45dafb3ddb8 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1499 microversion: 2.1 time: 0.500290 Jul 20 04:47:57.418256 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3007/5912] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:56 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1499 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:58.246112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-de4c0104-fae7-467b-86fd-be193058c7da tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:58.246838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-de4c0104-fae7-467b-86fd-be193058c7da tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:58.262522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de4c0104-fae7-467b-86fd-be193058c7da tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:58.262989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de4c0104-fae7-467b-86fd-be193058c7da tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:58.263844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de4c0104-fae7-467b-86fd-be193058c7da tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:58.264286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de4c0104-fae7-467b-86fd-be193058c7da tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:58.328309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-de4c0104-fae7-467b-86fd-be193058c7da tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:47:58.483448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:47:58.483973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:47:58.484514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:47:58.484936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:47:58.485355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:47:58.521756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:58.525215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:58.527953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:58.531163 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-de4c0104-fae7-467b-86fd-be193058c7da tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 204 len: 0 microversion: 2.1 time: 0.288325 Jul 20 04:47:58.531409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:58.534553 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3008/5913] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:47:58 2022] DELETE /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:47:58.565844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8bcc0c93-775e-49fc-b8f0-c614999a1834 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:58.568555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8bcc0c93-775e-49fc-b8f0-c614999a1834 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:58.583358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bcc0c93-775e-49fc-b8f0-c614999a1834 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:58.584019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bcc0c93-775e-49fc-b8f0-c614999a1834 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:58.585514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bcc0c93-775e-49fc-b8f0-c614999a1834 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:58.587816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8bcc0c93-775e-49fc-b8f0-c614999a1834 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:58.593962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Getting quotas for project 25cb4471bbb94aa6bd92210bdee531a6. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:47:58.608364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Getting quotas for user 6bda7588a6f9417f9caf7ad1eb43c312 and project 25cb4471bbb94aa6bd92210bdee531a6. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:47:58.643992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:47:58.647646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:47:58.775236 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bdebb48f-d9e2-44b6-a76f-ccb305f78953 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.088924 Jul 20 04:47:58.776132 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2906/5914] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:47:58.795898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e7c9587f-4d0e-4267-93af-afa93d6a64f3 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:58.796655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e7c9587f-4d0e-4267-93af-afa93d6a64f3 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:58.916592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e7c9587f-4d0e-4267-93af-afa93d6a64f3 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:58.929637 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e7c9587f-4d0e-4267-93af-afa93d6a64f3 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1215 microversion: 2.1 time: 0.139779 Jul 20 04:47:58.931744 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2907/5915] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:58 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:59.009033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8bcc0c93-775e-49fc-b8f0-c614999a1834 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:59.027643 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8bcc0c93-775e-49fc-b8f0-c614999a1834 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1505 microversion: 2.1 time: 0.483858 Jul 20 04:47:59.028248 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3009/5916] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:58 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:59.899531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b34b6bbd-9e3a-44bc-ad37-0608113fc224 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:59.900434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b34b6bbd-9e3a-44bc-ad37-0608113fc224 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:59.914375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b34b6bbd-9e3a-44bc-ad37-0608113fc224 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.915000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b34b6bbd-9e3a-44bc-ad37-0608113fc224 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.920302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b34b6bbd-9e3a-44bc-ad37-0608113fc224 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.920845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b34b6bbd-9e3a-44bc-ad37-0608113fc224 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.946905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-98cf280b-2363-4273-80e2-e295dd5e9b17 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:59.947538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-98cf280b-2363-4273-80e2-e295dd5e9b17 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:59.961638 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b34b6bbd-9e3a-44bc-ad37-0608113fc224 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:47:59.970982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98cf280b-2363-4273-80e2-e295dd5e9b17 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.971377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98cf280b-2363-4273-80e2-e295dd5e9b17 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b34b6bbd-9e3a-44bc-ad37-0608113fc224 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 HTTP/1.1 Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '89f7d604-7504-4bff-9f32-5fc8fb2518a4'} Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:59.976664 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:59.980403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:47:59.980403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:47:59.980403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:59.980403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:47:59.980403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:59.980403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:59.980403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:59.980403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:59.980403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:59.980403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:47:59.980403 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:47:59.980985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98cf280b-2363-4273-80e2-e295dd5e9b17 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.981060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b34b6bbd-9e3a-44bc-ad37-0608113fc224 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 404 to user: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:59.981060 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b34b6bbd-9e3a-44bc-ad37-0608113fc224 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 404 len: 111 microversion: 2.1 time: 0.085463 Jul 20 04:47:59.982002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98cf280b-2363-4273-80e2-e295dd5e9b17 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.988216 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2908/5917] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:47:59 2022] DELETE /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:00.005542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-300c5359-fecd-4f1a-b1c7-7b5ffd6f256d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:00.006182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-300c5359-fecd-4f1a-b1c7-7b5ffd6f256d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 89f7d604-7504-4bff-9f32-5fc8fb2518a4] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:00.026068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-300c5359-fecd-4f1a-b1c7-7b5ffd6f256d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:00.026529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-300c5359-fecd-4f1a-b1c7-7b5ffd6f256d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:00.035390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-300c5359-fecd-4f1a-b1c7-7b5ffd6f256d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:00.035888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-300c5359-fecd-4f1a-b1c7-7b5ffd6f256d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:00.089577 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-300c5359-fecd-4f1a-b1c7-7b5ffd6f256d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-300c5359-fecd-4f1a-b1c7-7b5ffd6f256d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 HTTP/1.1 Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '89f7d604-7504-4bff-9f32-5fc8fb2518a4'} Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:00.093074 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:00.097510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:00.097510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:00.097510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:00.097510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:00.097510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:00.097510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. Jul 20 04:48:00.097510 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:00.111825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-300c5359-fecd-4f1a-b1c7-7b5ffd6f256d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 404 to user: Instance 89f7d604-7504-4bff-9f32-5fc8fb2518a4 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:00.113008 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-300c5359-fecd-4f1a-b1c7-7b5ffd6f256d tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4" status: 404 len: 111 microversion: 2.1 time: 0.122730 Jul 20 04:48:00.113844 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2909/5918] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:59 2022] GET /compute/v2.1/servers/89f7d604-7504-4bff-9f32-5fc8fb2518a4 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:00.132074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9386b197-0c9d-4e09-aab1-a2371d407393 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:00.132733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9386b197-0c9d-4e09-aab1-a2371d407393 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:00.154893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9386b197-0c9d-4e09-aab1-a2371d407393 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:00.155868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9386b197-0c9d-4e09-aab1-a2371d407393 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:00.156846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9386b197-0c9d-4e09-aab1-a2371d407393 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:00.158148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9386b197-0c9d-4e09-aab1-a2371d407393 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:00.181051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-98cf280b-2363-4273-80e2-e295dd5e9b17 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:00.209089 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-98cf280b-2363-4273-80e2-e295dd5e9b17 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1267 microversion: 2.1 time: 0.257355 Jul 20 04:48:00.215297 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3010/5919] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:59 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1267 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:00.857626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9386b197-0c9d-4e09-aab1-a2371d407393 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:00.867333 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9386b197-0c9d-4e09-aab1-a2371d407393 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1505 microversion: 2.1 time: 0.749885 Jul 20 04:48:00.877130 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2910/5920] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:00 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1505 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:01.245611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4415b42e-bb64-411d-a5c5-158120f3a473 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:01.246886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4415b42e-bb64-411d-a5c5-158120f3a473 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:01.267767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4415b42e-bb64-411d-a5c5-158120f3a473 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.278204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4415b42e-bb64-411d-a5c5-158120f3a473 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.280043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4415b42e-bb64-411d-a5c5-158120f3a473 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.280924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4415b42e-bb64-411d-a5c5-158120f3a473 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.593143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4415b42e-bb64-411d-a5c5-158120f3a473 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:01.594188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-60eef679-c13b-43d2-af7e-9ac351694920 req-76b807ea-c2c5-43f0-82ed-0f1ea175550e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ccc5c9-90ba-4fa6-b81c-6793babfaa64", "name": "network-vif-deleted", "tag": "9a8ef827-acd8-4d7e-a976-fb75147e44e6"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:01.609940 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4415b42e-bb64-411d-a5c5-158120f3a473 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1273 microversion: 2.1 time: 0.380174 Jul 20 04:48:01.614602 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3011/5921] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:01 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1273 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:01.627383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-60eef679-c13b-43d2-af7e-9ac351694920 req-76b807ea-c2c5-43f0-82ed-0f1ea175550e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.635775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-60eef679-c13b-43d2-af7e-9ac351694920 req-76b807ea-c2c5-43f0-82ed-0f1ea175550e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.655716 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-60eef679-c13b-43d2-af7e-9ac351694920 req-76b807ea-c2c5-43f0-82ed-0f1ea175550e service nova] Creating event network-vif-deleted:9a8ef827-acd8-4d7e-a976-fb75147e44e6 for instance 12ccc5c9-90ba-4fa6-b81c-6793babfaa64 on n-h1-764485-11 Jul 20 04:48:01.661663 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-60eef679-c13b-43d2-af7e-9ac351694920 req-76b807ea-c2c5-43f0-82ed-0f1ea175550e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072371 Jul 20 04:48:01.663041 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2911/5922] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:01.884764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e3c9a4f-da5f-465f-b327-3e45ba5dc081 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:01.885782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6e3c9a4f-da5f-465f-b327-3e45ba5dc081 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:01.901304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e3c9a4f-da5f-465f-b327-3e45ba5dc081 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.902049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e3c9a4f-da5f-465f-b327-3e45ba5dc081 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.904806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e3c9a4f-da5f-465f-b327-3e45ba5dc081 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.905435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e3c9a4f-da5f-465f-b327-3e45ba5dc081 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:02.000074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e3c9a4f-da5f-465f-b327-3e45ba5dc081 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:02.000534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e3c9a4f-da5f-465f-b327-3e45ba5dc081 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:02.001205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-6e3c9a4f-da5f-465f-b327-3e45ba5dc081 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lazy-loading 'fault' on Instance uuid 12ccc5c9-90ba-4fa6-b81c-6793babfaa64 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:48:02.098107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6e3c9a4f-da5f-465f-b327-3e45ba5dc081 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e3329f9f764805ace7e1561ff909b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d59d062e95402b9ddf3699e09a1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:02.106988 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6e3c9a4f-da5f-465f-b327-3e45ba5dc081 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 200 len: 1304 microversion: 2.1 time: 0.226345 Jul 20 04:48:02.112494 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3012/5923] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:01 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 1304 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:02.630906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4e99e769-2075-411b-8082-60a156144d9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:02.632326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4e99e769-2075-411b-8082-60a156144d9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:02.658986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e99e769-2075-411b-8082-60a156144d9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:02.659632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e99e769-2075-411b-8082-60a156144d9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:02.660520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e99e769-2075-411b-8082-60a156144d9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:02.661215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e99e769-2075-411b-8082-60a156144d9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.063438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4e99e769-2075-411b-8082-60a156144d9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:03.076214 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4e99e769-2075-411b-8082-60a156144d9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1315 microversion: 2.1 time: 0.447743 Jul 20 04:48:03.087859 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2912/5924] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:02 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:03.131167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-147749a4-cc4c-4537-95a6-acdb29084b27 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:03.132581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-147749a4-cc4c-4537-95a6-acdb29084b27 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] [instance: 12ccc5c9-90ba-4fa6-b81c-6793babfaa64] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:03.146943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-147749a4-cc4c-4537-95a6-acdb29084b27 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.147657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-147749a4-cc4c-4537-95a6-acdb29084b27 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.148593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-147749a4-cc4c-4537-95a6-acdb29084b27 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.149227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-147749a4-cc4c-4537-95a6-acdb29084b27 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.185044 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-147749a4-cc4c-4537-95a6-acdb29084b27 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] HTTP exception thrown: Instance 12ccc5c9-90ba-4fa6-b81c-6793babfaa64 could not be found. Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-147749a4-cc4c-4537-95a6-acdb29084b27 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Request method failure captured: Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 HTTP/1.1 Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14jHqr4utfJCCPEFA92XP7Ylnv552yAuUiXeRyJOl9ix8lqIBLsUwi1dCgfj8WbEX0nyLuF6fAobrwJkpf_-MN325EoU6Gt5ytOKkWAkQ1oyQiit8qXc2MURDML6pqf49SAevSFSnuayN26H4T7U41SxT1bBQS3qNqeG_e_jKFnppTs Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 50d59d062e95402b9ddf3699e09a1ac0 Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-VolumesActionsTest-600966433 Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/50d59d062e95402b9ddf3699e09a1ac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/50d59d062e95402b9ddf3699e09a1ac0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_50d59d062e95402b9ddf3699e09a1ac0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/50d59d062e95402b9ddf3699e09a1ac0"}]}] Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-VolumesActionsTest-600966433 Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 50d59d062e95402b9ddf3699e09a1ac0 Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-VolumesActionsTest-600966433 Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-VolumesActionsTest-600966433-project Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: f3e3329f9f764805ace7e1561ff909b8 Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-VolumesActionsTest-600966433-project Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 12ccc5c9-90ba-4fa6-b81c-6793babfaa64 could not be found. Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '12ccc5c9-90ba-4fa6-b81c-6793babfaa64'} Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12ccc5c9-90ba-4fa6-b81c-6793babfaa64 could not be found. Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12ccc5c9-90ba-4fa6-b81c-6793babfaa64 could not be found. Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:03.192195 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:03.195679 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:03.195679 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:03.195679 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:03.195679 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:03.195679 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:03.195679 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12ccc5c9-90ba-4fa6-b81c-6793babfaa64 could not be found. Jul 20 04:48:03.195679 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:03.200657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-147749a4-cc4c-4537-95a6-acdb29084b27 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] Returning 404 to user: Instance 12ccc5c9-90ba-4fa6-b81c-6793babfaa64 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:03.201854 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-147749a4-cc4c-4537-95a6-acdb29084b27 tempest-VolumesActionsTest-600966433 tempest-VolumesActionsTest-600966433-project] 10.222.0.20 "GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64" status: 404 len: 111 microversion: 2.1 time: 0.076829 Jul 20 04:48:03.203911 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3013/5925] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:03 2022] GET /compute/v2.1/servers/12ccc5c9-90ba-4fa6-b81c-6793babfaa64 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:48:03.706091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b1213333-28e0-49b4-8842-8277e8898075 req-97bd0eb2-eda6-4070-848f-40d8f1892211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a11374b-2d58-4f28-9650-3f5f2d3b75c5", "tag": "cbecd811-618c-41f9-904f-b7d56e050ec9"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:03.728491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b1213333-28e0-49b4-8842-8277e8898075 req-97bd0eb2-eda6-4070-848f-40d8f1892211 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.729395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b1213333-28e0-49b4-8842-8277e8898075 req-97bd0eb2-eda6-4070-848f-40d8f1892211 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.765988 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b1213333-28e0-49b4-8842-8277e8898075 req-97bd0eb2-eda6-4070-848f-40d8f1892211 service nova] Creating event network-changed:cbecd811-618c-41f9-904f-b7d56e050ec9 for instance 5a11374b-2d58-4f28-9650-3f5f2d3b75c5 on n-h2-764485-11 Jul 20 04:48:03.798733 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b1213333-28e0-49b4-8842-8277e8898075 req-97bd0eb2-eda6-4070-848f-40d8f1892211 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098033 Jul 20 04:48:03.808677 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2913/5926] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:04.098436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-290ad62c-bb03-414a-8e97-0559fb97b1e4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:04.101028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-290ad62c-bb03-414a-8e97-0559fb97b1e4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:04.130415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-290ad62c-bb03-414a-8e97-0559fb97b1e4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:04.132249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-290ad62c-bb03-414a-8e97-0559fb97b1e4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:04.134982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-290ad62c-bb03-414a-8e97-0559fb97b1e4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:04.136140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-290ad62c-bb03-414a-8e97-0559fb97b1e4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:04.610595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-290ad62c-bb03-414a-8e97-0559fb97b1e4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:04.622268 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-290ad62c-bb03-414a-8e97-0559fb97b1e4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1315 microversion: 2.1 time: 0.531471 Jul 20 04:48:04.630645 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3014/5927] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:04 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:05.649655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cb7c2a2e-02c9-4c3f-ae19-71fb0380eaf0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:05.650528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cb7c2a2e-02c9-4c3f-ae19-71fb0380eaf0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:05.667088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb7c2a2e-02c9-4c3f-ae19-71fb0380eaf0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:05.672973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb7c2a2e-02c9-4c3f-ae19-71fb0380eaf0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:05.674920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb7c2a2e-02c9-4c3f-ae19-71fb0380eaf0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:05.678211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb7c2a2e-02c9-4c3f-ae19-71fb0380eaf0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:06.020281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cb7c2a2e-02c9-4c3f-ae19-71fb0380eaf0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:06.029004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:06.034935 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cb7c2a2e-02c9-4c3f-ae19-71fb0380eaf0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1315 microversion: 2.1 time: 0.389274 Jul 20 04:48:06.036781 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2914/5928] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:05 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:07.054199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc4b1715-7d1e-454f-bfd2-cf5cd4803381 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:07.054820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc4b1715-7d1e-454f-bfd2-cf5cd4803381 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:07.077393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc4b1715-7d1e-454f-bfd2-cf5cd4803381 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:07.084246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc4b1715-7d1e-454f-bfd2-cf5cd4803381 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:07.085138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc4b1715-7d1e-454f-bfd2-cf5cd4803381 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:07.085600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc4b1715-7d1e-454f-bfd2-cf5cd4803381 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:07.442861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cc4b1715-7d1e-454f-bfd2-cf5cd4803381 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:07.451233 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cc4b1715-7d1e-454f-bfd2-cf5cd4803381 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1315 microversion: 2.1 time: 0.400846 Jul 20 04:48:07.461718 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3015/5929] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:07 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:08.482755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6f61162f-8cdd-4a70-9e58-098e0baaa1c0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:08.483376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6f61162f-8cdd-4a70-9e58-098e0baaa1c0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:08.524267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f61162f-8cdd-4a70-9e58-098e0baaa1c0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.524871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f61162f-8cdd-4a70-9e58-098e0baaa1c0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.525722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f61162f-8cdd-4a70-9e58-098e0baaa1c0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.526165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f61162f-8cdd-4a70-9e58-098e0baaa1c0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.611845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:08.921615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:08.942045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6f61162f-8cdd-4a70-9e58-098e0baaa1c0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:08.959192 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6f61162f-8cdd-4a70-9e58-098e0baaa1c0 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1315 microversion: 2.1 time: 0.479125 Jul 20 04:48:08.960008 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2915/5930] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:08 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:09.859656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a775698-b81e-4b91-bd53-747ac5ce6c72 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Action: 'create', calling method: .version_select at 0x7fbf9c5394c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1301290952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZQxH5Ag+VSQ89xCNrGMgbgrm10InF2U1lBK0oV6whh8oPznj3ch2lp5eaWtRReSClpGdGiJ/Vfyd8njcFFg5vs9X/IKmFCv+1/qJMwBTh2nMTIlxk9Q6RagJAOp7aiQ=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:09.873438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:09.904203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3a775698-b81e-4b91-bd53-747ac5ce6c72 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Getting quotas for project 141470bf62e0454bab8289b6bab0b01a. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:48:09.918853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-3a775698-b81e-4b91-bd53-747ac5ce6c72 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Getting quotas for user 97323cd98ca448c097f6a1cfa4ab691a and project 141470bf62e0454bab8289b6bab0b01a. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:48:09.977615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c0fd0853-ef12-4dc8-a021-2bca357bf587 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:09.978897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c0fd0853-ef12-4dc8-a021-2bca357bf587 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:09.982137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:09.989945 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a775698-b81e-4b91-bd53-747ac5ce6c72 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.134143 Jul 20 04:48:10.001024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0fd0853-ef12-4dc8-a021-2bca357bf587 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.003927 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3016/5931] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:48:09 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:10.017760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0fd0853-ef12-4dc8-a021-2bca357bf587 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.018949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0fd0853-ef12-4dc8-a021-2bca357bf587 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.019658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0fd0853-ef12-4dc8-a021-2bca357bf587 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.480647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c0fd0853-ef12-4dc8-a021-2bca357bf587 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:10.490238 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c0fd0853-ef12-4dc8-a021-2bca357bf587 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1315 microversion: 2.1 time: 0.516915 Jul 20 04:48:10.499070 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2916/5932] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:09 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:11.517501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c5c601f5-013f-44c7-a36c-57caeddfa097 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:11.518835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c5c601f5-013f-44c7-a36c-57caeddfa097 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:11.541625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5c601f5-013f-44c7-a36c-57caeddfa097 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:11.545582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5c601f5-013f-44c7-a36c-57caeddfa097 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:11.549571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5c601f5-013f-44c7-a36c-57caeddfa097 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:11.551747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c5c601f5-013f-44c7-a36c-57caeddfa097 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.032999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-beab2a54-f3e2-4864-891b-94a101cfe2cb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:12.034220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-beab2a54-f3e2-4864-891b-94a101cfe2cb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:12.059356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-beab2a54-f3e2-4864-891b-94a101cfe2cb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.076118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-beab2a54-f3e2-4864-891b-94a101cfe2cb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.077363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-beab2a54-f3e2-4864-891b-94a101cfe2cb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.078042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-beab2a54-f3e2-4864-891b-94a101cfe2cb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.132689 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-beab2a54-f3e2-4864-891b-94a101cfe2cb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-beab2a54-f3e2-4864-891b-94a101cfe2cb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 HTTP/1.1 Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '01009a01-6369-4508-97a4-1ed09bbd90a6'} Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:12.134400 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-beab2a54-f3e2-4864-891b-94a101cfe2cb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 404 to user: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:12.137709 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-beab2a54-f3e2-4864-891b-94a101cfe2cb tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 404 len: 111 microversion: 2.1 time: 0.107789 Jul 20 04:48:12.147908 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2917/5933] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:48:12 2022] DELETE /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:12.153037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8cf1cce7-c803-4040-b513-43cbcd5a15fa tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:12.153664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8cf1cce7-c803-4040-b513-43cbcd5a15fa tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 01009a01-6369-4508-97a4-1ed09bbd90a6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:12.173421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cf1cce7-c803-4040-b513-43cbcd5a15fa tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.174201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cf1cce7-c803-4040-b513-43cbcd5a15fa tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.175159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cf1cce7-c803-4040-b513-43cbcd5a15fa tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.175642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cf1cce7-c803-4040-b513-43cbcd5a15fa tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.181601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c5c601f5-013f-44c7-a36c-57caeddfa097 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:12.190751 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c5c601f5-013f-44c7-a36c-57caeddfa097 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1315 microversion: 2.1 time: 0.678106 Jul 20 04:48:12.204787 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3017/5934] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:11 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1315 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:12.232520 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-8cf1cce7-c803-4040-b513-43cbcd5a15fa tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8cf1cce7-c803-4040-b513-43cbcd5a15fa tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 HTTP/1.1 Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '01009a01-6369-4508-97a4-1ed09bbd90a6'} Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:12.234384 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.238540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:12.238540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:12.238540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:12.238540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:12.238540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:12.238540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. Jul 20 04:48:12.238540 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.239687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8cf1cce7-c803-4040-b513-43cbcd5a15fa tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 404 to user: Instance 01009a01-6369-4508-97a4-1ed09bbd90a6 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:12.240720 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8cf1cce7-c803-4040-b513-43cbcd5a15fa tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6" status: 404 len: 111 microversion: 2.1 time: 0.091742 Jul 20 04:48:12.256568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a583a4c-0312-468b-9679-c5ad648009be tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:12.257359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7a583a4c-0312-468b-9679-c5ad648009be tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:12.262460 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2918/5935] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:12 2022] GET /compute/v2.1/servers/01009a01-6369-4508-97a4-1ed09bbd90a6 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:12.264270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a583a4c-0312-468b-9679-c5ad648009be tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.264730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a583a4c-0312-468b-9679-c5ad648009be tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.265519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a583a4c-0312-468b-9679-c5ad648009be tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.265961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a583a4c-0312-468b-9679-c5ad648009be tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.333918 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-7a583a4c-0312-468b-9679-c5ad648009be tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a583a4c-0312-468b-9679-c5ad648009be tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d HTTP/1.1 Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '4720cce2-ac73-4a0d-b54e-996065a5f45d'} Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:12.334887 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a583a4c-0312-468b-9679-c5ad648009be tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 404 to user: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:12.339232 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7a583a4c-0312-468b-9679-c5ad648009be tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 404 len: 111 microversion: 2.1 time: 0.084486 Jul 20 04:48:12.346625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c0b0299f-237e-4ff1-adfe-c2b3d63bfd43 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:12.347252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c0b0299f-237e-4ff1-adfe-c2b3d63bfd43 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: 4720cce2-ac73-4a0d-b54e-996065a5f45d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:12.356169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0b0299f-237e-4ff1-adfe-c2b3d63bfd43 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.357461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0b0299f-237e-4ff1-adfe-c2b3d63bfd43 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.359882 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3018/5936] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:48:12 2022] DELETE /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:12.362054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0b0299f-237e-4ff1-adfe-c2b3d63bfd43 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.364209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0b0299f-237e-4ff1-adfe-c2b3d63bfd43 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.471958 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-c0b0299f-237e-4ff1-adfe-c2b3d63bfd43 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c0b0299f-237e-4ff1-adfe-c2b3d63bfd43 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d HTTP/1.1 Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '4720cce2-ac73-4a0d-b54e-996065a5f45d'} Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:12.479212 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.484032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:12.484032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:12.484032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:12.484032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:12.484032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:12.484032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. Jul 20 04:48:12.484032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:12.497176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c0b0299f-237e-4ff1-adfe-c2b3d63bfd43 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 404 to user: Instance 4720cce2-ac73-4a0d-b54e-996065a5f45d could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:12.503788 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c0b0299f-237e-4ff1-adfe-c2b3d63bfd43 tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d" status: 404 len: 111 microversion: 2.1 time: 0.161852 Jul 20 04:48:12.504651 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2919/5937] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:12 2022] GET /compute/v2.1/servers/4720cce2-ac73-4a0d-b54e-996065a5f45d => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:13.222169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ed615c36-b5cb-41eb-a51c-7af2b5f7a2c5 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:13.222796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ed615c36-b5cb-41eb-a51c-7af2b5f7a2c5 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:13.242121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed615c36-b5cb-41eb-a51c-7af2b5f7a2c5 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.242664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed615c36-b5cb-41eb-a51c-7af2b5f7a2c5 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.243490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed615c36-b5cb-41eb-a51c-7af2b5f7a2c5 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.250218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed615c36-b5cb-41eb-a51c-7af2b5f7a2c5 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.506093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-09c79edf-95e6-4a16-9df0-94ba3333ae74 req-b5e83280-ef93-46d1-b77b-6035bc6bc2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a11374b-2d58-4f28-9650-3f5f2d3b75c5", "name": "network-vif-plugged", "status": "completed", "tag": "cbecd811-618c-41f9-904f-b7d56e050ec9"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:13.534153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-09c79edf-95e6-4a16-9df0-94ba3333ae74 req-b5e83280-ef93-46d1-b77b-6035bc6bc2f7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.540058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-09c79edf-95e6-4a16-9df0-94ba3333ae74 req-b5e83280-ef93-46d1-b77b-6035bc6bc2f7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.588907 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-09c79edf-95e6-4a16-9df0-94ba3333ae74 req-b5e83280-ef93-46d1-b77b-6035bc6bc2f7 service nova] Creating event network-vif-plugged:cbecd811-618c-41f9-904f-b7d56e050ec9 for instance 5a11374b-2d58-4f28-9650-3f5f2d3b75c5 on n-h2-764485-11 Jul 20 04:48:13.615376 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-09c79edf-95e6-4a16-9df0-94ba3333ae74 req-b5e83280-ef93-46d1-b77b-6035bc6bc2f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113839 Jul 20 04:48:13.616083 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2920/5938] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:13.626590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1977203628", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "c475f8b5-57ca-4cbb-9fef-6be85b36e2a5"}], "key_name": "tempest-TestNetworkBasicOps-1301290952", "security_groups": [{"name": "tempest-secgroup-smoke-1022730601"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:13.642803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ed615c36-b5cb-41eb-a51c-7af2b5f7a2c5 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:13.651377 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ed615c36-b5cb-41eb-a51c-7af2b5f7a2c5 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1315 microversion: 2.1 time: 0.433712 Jul 20 04:48:13.653273 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3019/5939] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:13 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:14.084448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] validate_networks() for [('c475f8b5-57ca-4cbb-9fef-6be85b36e2a5', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:48:14.670401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ac5ecf0c-fbe1-4afe-963f-c1a0eed98ddf tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:14.671877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ac5ecf0c-fbe1-4afe-963f-c1a0eed98ddf tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:14.690115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ac5ecf0c-fbe1-4afe-963f-c1a0eed98ddf tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.690985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ac5ecf0c-fbe1-4afe-963f-c1a0eed98ddf tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:14.696751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ac5ecf0c-fbe1-4afe-963f-c1a0eed98ddf tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.697539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ac5ecf0c-fbe1-4afe-963f-c1a0eed98ddf tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:15.004477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:48:15.004948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:48:15.005384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:48:15.005802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:48:15.006225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:48:15.010562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ac5ecf0c-fbe1-4afe-963f-c1a0eed98ddf tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:15.020753 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ac5ecf0c-fbe1-4afe-963f-c1a0eed98ddf tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1315 microversion: 2.1 time: 0.354130 Jul 20 04:48:15.022737 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3020/5940] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:14 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:15.034166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:15.034704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:15.035581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:15.036248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:15.077324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Getting quotas for project 141470bf62e0454bab8289b6bab0b01a. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:48:15.092183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Getting quotas for user 97323cd98ca448c097f6a1cfa4ab691a and project 141470bf62e0454bab8289b6bab0b01a. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:48:15.116372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:48:15.120240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:48:15.202750 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f461c2ab-511e-408c-93e3-f0ed3d21fa3a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.580372 Jul 20 04:48:15.206364 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2921/5941] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:48:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:48:15.218241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-95f5c035-bd04-4419-b957-fcdb37193670 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:15.218996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-95f5c035-bd04-4419-b957-fcdb37193670 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:15.370143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-95f5c035-bd04-4419-b957-fcdb37193670 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:15.381210 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-95f5c035-bd04-4419-b957-fcdb37193670 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1249 microversion: 2.1 time: 0.166549 Jul 20 04:48:15.382428 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3021/5942] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:15 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1249 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:16.040720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-57e06e50-3054-43d1-a7eb-dedcc24a76ce tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:16.041413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-57e06e50-3054-43d1-a7eb-dedcc24a76ce tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:16.058566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57e06e50-3054-43d1-a7eb-dedcc24a76ce tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.059052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57e06e50-3054-43d1-a7eb-dedcc24a76ce tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.059889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57e06e50-3054-43d1-a7eb-dedcc24a76ce tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.060342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57e06e50-3054-43d1-a7eb-dedcc24a76ce tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.385109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-57e06e50-3054-43d1-a7eb-dedcc24a76ce tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:16.400437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8996f6b5-45dd-40af-b455-4e7ce6b41c45 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:16.401001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8996f6b5-45dd-40af-b455-4e7ce6b41c45 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:16.408470 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-57e06e50-3054-43d1-a7eb-dedcc24a76ce tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1503 microversion: 2.1 time: 0.372679 Jul 20 04:48:16.421308 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2922/5943] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:16 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1503 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:16.430248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-faf1419f-268c-4ae1-9a06-d28794d77eee tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:16.431104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8996f6b5-45dd-40af-b455-4e7ce6b41c45 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.433426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8996f6b5-45dd-40af-b455-4e7ce6b41c45 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.434762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8996f6b5-45dd-40af-b455-4e7ce6b41c45 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.435429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8996f6b5-45dd-40af-b455-4e7ce6b41c45 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.436497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-faf1419f-268c-4ae1-9a06-d28794d77eee tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:16.457036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-faf1419f-268c-4ae1-9a06-d28794d77eee tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.457589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-faf1419f-268c-4ae1-9a06-d28794d77eee tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.458400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-faf1419f-268c-4ae1-9a06-d28794d77eee tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.458852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-faf1419f-268c-4ae1-9a06-d28794d77eee tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.578345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8996f6b5-45dd-40af-b455-4e7ce6b41c45 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:16.591944 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8996f6b5-45dd-40af-b455-4e7ce6b41c45 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1245 microversion: 2.1 time: 0.196289 Jul 20 04:48:16.595827 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3022/5944] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:16 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1245 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:16.769556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-faf1419f-268c-4ae1-9a06-d28794d77eee tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:16.785939 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-faf1419f-268c-4ae1-9a06-d28794d77eee tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1503 microversion: 2.1 time: 0.363163 Jul 20 04:48:16.787452 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2923/5945] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:16 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1503 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:16.805547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1e1f3e77-b9f1-466f-a495-2ace1301af2a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:16.806107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1e1f3e77-b9f1-466f-a495-2ace1301af2a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:16.818610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e1f3e77-b9f1-466f-a495-2ace1301af2a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.818990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e1f3e77-b9f1-466f-a495-2ace1301af2a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.819839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e1f3e77-b9f1-466f-a495-2ace1301af2a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.827378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e1f3e77-b9f1-466f-a495-2ace1301af2a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.868464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-1e1f3e77-b9f1-466f-a495-2ace1301af2a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lazy-loading 'flavor' on Instance uuid 5a11374b-2d58-4f28-9650-3f5f2d3b75c5 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:48:17.036269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:17.072134 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1e1f3e77-b9f1-466f-a495-2ace1301af2a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "POST /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5/action" status: 202 len: 0 microversion: 2.1 time: 0.270493 Jul 20 04:48:17.072922 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3023/5946] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:16 2022] POST /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:17.084680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a72aec1c-8bff-4d04-851b-476246ac3530 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:17.085317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a72aec1c-8bff-4d04-851b-476246ac3530 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:17.116103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a72aec1c-8bff-4d04-851b-476246ac3530 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.116721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a72aec1c-8bff-4d04-851b-476246ac3530 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.129730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a72aec1c-8bff-4d04-851b-476246ac3530 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.130281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a72aec1c-8bff-4d04-851b-476246ac3530 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.568833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a72aec1c-8bff-4d04-851b-476246ac3530 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:17.615707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2ced0ea6-ed6e-493c-b7bd-d7cfbc0092df tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:17.616599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2ced0ea6-ed6e-493c-b7bd-d7cfbc0092df tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:17.622625 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a72aec1c-8bff-4d04-851b-476246ac3530 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1511 microversion: 2.1 time: 0.540415 Jul 20 04:48:17.632516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ced0ea6-ed6e-493c-b7bd-d7cfbc0092df tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.636699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ced0ea6-ed6e-493c-b7bd-d7cfbc0092df tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.637809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ced0ea6-ed6e-493c-b7bd-d7cfbc0092df tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.640878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ced0ea6-ed6e-493c-b7bd-d7cfbc0092df tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.644997 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2924/5947] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:17 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1511 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:17.863950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2ced0ea6-ed6e-493c-b7bd-d7cfbc0092df tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:17.898373 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2ced0ea6-ed6e-493c-b7bd-d7cfbc0092df tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1307 microversion: 2.1 time: 0.289517 Jul 20 04:48:17.918130 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3024/5948] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:17 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1307 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:18.647736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e7f1ecdd-b737-4564-b660-47cc56a0e711 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:18.648373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e7f1ecdd-b737-4564-b660-47cc56a0e711 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:18.663086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7f1ecdd-b737-4564-b660-47cc56a0e711 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:18.663577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7f1ecdd-b737-4564-b660-47cc56a0e711 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:18.673676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7f1ecdd-b737-4564-b660-47cc56a0e711 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:18.674741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7f1ecdd-b737-4564-b660-47cc56a0e711 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:18.924385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-58ce3604-0041-4846-96a0-3720660697b2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:18.925006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-58ce3604-0041-4846-96a0-3720660697b2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:18.939141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58ce3604-0041-4846-96a0-3720660697b2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:18.939978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58ce3604-0041-4846-96a0-3720660697b2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:18.946148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58ce3604-0041-4846-96a0-3720660697b2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:18.946848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58ce3604-0041-4846-96a0-3720660697b2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:19.124213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-58ce3604-0041-4846-96a0-3720660697b2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:19.138114 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-58ce3604-0041-4846-96a0-3720660697b2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1307 microversion: 2.1 time: 0.218650 Jul 20 04:48:19.138954 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3025/5949] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:18 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1307 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:19.449151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e7f1ecdd-b737-4564-b660-47cc56a0e711 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:19.467819 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e7f1ecdd-b737-4564-b660-47cc56a0e711 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1494 microversion: 2.1 time: 0.825115 Jul 20 04:48:19.468913 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2925/5950] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:18 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1494 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:19.490116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c7776270-f28b-4774-b161-2bc1547f6fe4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:19.490776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c7776270-f28b-4774-b161-2bc1547f6fe4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:19.502043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7776270-f28b-4774-b161-2bc1547f6fe4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:19.504615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7776270-f28b-4774-b161-2bc1547f6fe4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:19.508430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7776270-f28b-4774-b161-2bc1547f6fe4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:19.508997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7776270-f28b-4774-b161-2bc1547f6fe4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:19.667008 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c7776270-f28b-4774-b161-2bc1547f6fe4 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "POST /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5/action" status: 202 len: 0 microversion: 2.1 time: 0.178970 Jul 20 04:48:19.672415 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3026/5951] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:19 2022] POST /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:19.679793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0745246-e416-43b4-b135-387e4b4cf1c7 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:19.681992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b0745246-e416-43b4-b135-387e4b4cf1c7 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:19.697280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0745246-e416-43b4-b135-387e4b4cf1c7 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:19.702685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0745246-e416-43b4-b135-387e4b4cf1c7 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:19.703919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0745246-e416-43b4-b135-387e4b4cf1c7 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:19.704581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0745246-e416-43b4-b135-387e4b4cf1c7 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:20.159402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-82ef1f5d-a5e4-468c-bf4e-971f9673585a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:20.161003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-82ef1f5d-a5e4-468c-bf4e-971f9673585a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:20.178777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82ef1f5d-a5e4-468c-bf4e-971f9673585a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:20.180377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82ef1f5d-a5e4-468c-bf4e-971f9673585a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:20.181420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82ef1f5d-a5e4-468c-bf4e-971f9673585a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:20.183884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82ef1f5d-a5e4-468c-bf4e-971f9673585a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:20.426098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-82ef1f5d-a5e4-468c-bf4e-971f9673585a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:20.441047 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-82ef1f5d-a5e4-468c-bf4e-971f9673585a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1375 microversion: 2.1 time: 0.288370 Jul 20 04:48:20.441859 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3027/5952] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:20 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1375 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:20.598898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b0745246-e416-43b4-b135-387e4b4cf1c7 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:20.614246 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0745246-e416-43b4-b135-387e4b4cf1c7 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1500 microversion: 2.1 time: 0.938932 Jul 20 04:48:20.616169 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2926/5953] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:19 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1500 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:21.461911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02790428-a634-4b56-9de0-af12eca90cba tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:21.462543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-02790428-a634-4b56-9de0-af12eca90cba tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:21.501945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02790428-a634-4b56-9de0-af12eca90cba tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:21.502563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02790428-a634-4b56-9de0-af12eca90cba tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:21.504074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02790428-a634-4b56-9de0-af12eca90cba tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:21.504543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02790428-a634-4b56-9de0-af12eca90cba tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:21.635044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-20b09638-a33e-4654-aec5-b25b4b81dafa tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:21.636611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-20b09638-a33e-4654-aec5-b25b4b81dafa tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:21.661751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20b09638-a33e-4654-aec5-b25b4b81dafa tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:21.666428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20b09638-a33e-4654-aec5-b25b4b81dafa tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:21.667370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20b09638-a33e-4654-aec5-b25b4b81dafa tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:21.667861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20b09638-a33e-4654-aec5-b25b4b81dafa tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.139419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-02790428-a634-4b56-9de0-af12eca90cba tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:22.159267 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-02790428-a634-4b56-9de0-af12eca90cba tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1375 microversion: 2.1 time: 0.703527 Jul 20 04:48:22.159902 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3028/5954] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:21 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1375 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:22.240833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-20b09638-a33e-4654-aec5-b25b4b81dafa tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:22.273449 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-20b09638-a33e-4654-aec5-b25b4b81dafa tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1500 microversion: 2.1 time: 0.645111 Jul 20 04:48:22.290175 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2927/5955] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:21 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1500 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:22.370828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a537a759-e646-4d57-8b70-d2cec3118998 req-e4d95cf7-82e8-4dc0-b8dc-a8a960913fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd560666-40fb-4f9a-b8c3-aab8e12c0b3b", "tag": "9e70c6c8-f45d-46ba-9492-6ce54a59025d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:22.390249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a537a759-e646-4d57-8b70-d2cec3118998 req-e4d95cf7-82e8-4dc0-b8dc-a8a960913fc8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.390708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a537a759-e646-4d57-8b70-d2cec3118998 req-e4d95cf7-82e8-4dc0-b8dc-a8a960913fc8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.439792 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a537a759-e646-4d57-8b70-d2cec3118998 req-e4d95cf7-82e8-4dc0-b8dc-a8a960913fc8 service nova] Creating event network-changed:9e70c6c8-f45d-46ba-9492-6ce54a59025d for instance cd560666-40fb-4f9a-b8c3-aab8e12c0b3b on n-h1-764485-11 Jul 20 04:48:22.461926 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a537a759-e646-4d57-8b70-d2cec3118998 req-e4d95cf7-82e8-4dc0-b8dc-a8a960913fc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090979 Jul 20 04:48:22.462638 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3029/5956] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:22.775617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f827b401-4100-496e-84b1-5d17a8cfce0b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:22.776428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f827b401-4100-496e-84b1-5d17a8cfce0b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:22.796939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f827b401-4100-496e-84b1-5d17a8cfce0b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.798612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f827b401-4100-496e-84b1-5d17a8cfce0b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.799642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f827b401-4100-496e-84b1-5d17a8cfce0b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.802042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f827b401-4100-496e-84b1-5d17a8cfce0b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.841695 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-f827b401-4100-496e-84b1-5d17a8cfce0b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f827b401-4100-496e-84b1-5d17a8cfce0b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a HTTP/1.1 Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'f60434b5-42e4-4695-bfdb-66aaaa6d394a'} Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:22.843424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f827b401-4100-496e-84b1-5d17a8cfce0b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 404 to user: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:22.847958 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f827b401-4100-496e-84b1-5d17a8cfce0b tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 404 len: 111 microversion: 2.1 time: 0.075213 Jul 20 04:48:22.859255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a941a9ff-7f46-46a0-a6ad-e0fda2fb520f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:22.862300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a941a9ff-7f46-46a0-a6ad-e0fda2fb520f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] [instance: f60434b5-42e4-4695-bfdb-66aaaa6d394a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:22.867211 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2928/5957] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:48:22 2022] DELETE /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:22.886784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a941a9ff-7f46-46a0-a6ad-e0fda2fb520f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.889578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a941a9ff-7f46-46a0-a6ad-e0fda2fb520f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.893083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a941a9ff-7f46-46a0-a6ad-e0fda2fb520f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.893782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a941a9ff-7f46-46a0-a6ad-e0fda2fb520f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.934490 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-a941a9ff-7f46-46a0-a6ad-e0fda2fb520f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] HTTP exception thrown: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a941a9ff-7f46-46a0-a6ad-e0fda2fb520f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Request method failure captured: Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a HTTP/1.1 Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14akOkwLl22ZA4Ta7MiNHEdLGWNJgygP8j0jAzVu3LTqBNe8VhDG0DH3emGqI1tnQZT_724G-BUHQZ82OBFr7h2oT5iGt1EzWcIt1b-rotNUWcTQHujVPILp0B-2mMzunXy0xGP1NghCYQnZHBoOqprWrYsmSRvZTtXN8BGNHs7NSk8 Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4fadbcc3e34a44a47acbd4428d7eef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4fadbcc3e34a44a47acbd4428d7eef"}]}] Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 1a4fadbcc3e34a44a47acbd4428d7eef Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-427079009 Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 8759015052b64df2b36efb694b837999 Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-AttachVolumeNegativeTest-427079009-project Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'f60434b5-42e4-4695-bfdb-66aaaa6d394a'} Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:22.939945 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:22.943743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:22.943743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:22.943743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:22.943743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:22.943743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:22.943743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. Jul 20 04:48:22.943743 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:48:22.943743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a941a9ff-7f46-46a0-a6ad-e0fda2fb520f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] Returning 404 to user: Instance f60434b5-42e4-4695-bfdb-66aaaa6d394a could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:22.943743 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a941a9ff-7f46-46a0-a6ad-e0fda2fb520f tempest-AttachVolumeNegativeTest-427079009 tempest-AttachVolumeNegativeTest-427079009-project] 10.222.0.20 "GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a" status: 404 len: 111 microversion: 2.1 time: 0.089924 Jul 20 04:48:22.946009 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3030/5958] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:22 2022] GET /compute/v2.1/servers/f60434b5-42e4-4695-bfdb-66aaaa6d394a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:23.176754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bb07d1fd-9472-4889-9104-e0af9cd5388d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:23.177468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bb07d1fd-9472-4889-9104-e0af9cd5388d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:23.195392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb07d1fd-9472-4889-9104-e0af9cd5388d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:23.195913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb07d1fd-9472-4889-9104-e0af9cd5388d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:23.196718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb07d1fd-9472-4889-9104-e0af9cd5388d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:23.197175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bb07d1fd-9472-4889-9104-e0af9cd5388d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:23.294011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5364eb01-5a15-47df-b7d6-d564d01eff23 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:23.295274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5364eb01-5a15-47df-b7d6-d564d01eff23 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:23.311177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5364eb01-5a15-47df-b7d6-d564d01eff23 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:23.332652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5364eb01-5a15-47df-b7d6-d564d01eff23 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:23.334036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5364eb01-5a15-47df-b7d6-d564d01eff23 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:23.334668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5364eb01-5a15-47df-b7d6-d564d01eff23 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:23.579255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bb07d1fd-9472-4889-9104-e0af9cd5388d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:23.616562 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bb07d1fd-9472-4889-9104-e0af9cd5388d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1375 microversion: 2.1 time: 0.418397 Jul 20 04:48:23.630042 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2929/5959] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:23 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1375 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:23.737081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5364eb01-5a15-47df-b7d6-d564d01eff23 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:23.747485 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5364eb01-5a15-47df-b7d6-d564d01eff23 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1503 microversion: 2.1 time: 0.457600 Jul 20 04:48:23.762799 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3031/5960] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:23 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1503 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:23.773222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-edf2e5af-99d8-4c3d-bfbe-de3bf9aceb9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:23.774820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-edf2e5af-99d8-4c3d-bfbe-de3bf9aceb9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:23.785378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edf2e5af-99d8-4c3d-bfbe-de3bf9aceb9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:23.786045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edf2e5af-99d8-4c3d-bfbe-de3bf9aceb9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:23.786606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edf2e5af-99d8-4c3d-bfbe-de3bf9aceb9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:23.787049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edf2e5af-99d8-4c3d-bfbe-de3bf9aceb9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:23.870352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-edf2e5af-99d8-4c3d-bfbe-de3bf9aceb9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lazy-loading 'flavor' on Instance uuid 5a11374b-2d58-4f28-9650-3f5f2d3b75c5 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:48:24.080238 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-edf2e5af-99d8-4c3d-bfbe-de3bf9aceb9a tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "POST /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5/action" status: 202 len: 0 microversion: 2.1 time: 0.307831 Jul 20 04:48:24.084688 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2930/5961] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:23 2022] POST /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:24.089650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0eeb16b8-75a4-44e3-b414-5312caf4545c tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:24.092902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0eeb16b8-75a4-44e3-b414-5312caf4545c tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:24.124144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0eeb16b8-75a4-44e3-b414-5312caf4545c tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:24.130261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0eeb16b8-75a4-44e3-b414-5312caf4545c tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:24.138755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0eeb16b8-75a4-44e3-b414-5312caf4545c tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:24.139231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0eeb16b8-75a4-44e3-b414-5312caf4545c tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:24.644437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0eeb16b8-75a4-44e3-b414-5312caf4545c tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:24.644437 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0eeb16b8-75a4-44e3-b414-5312caf4545c tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1511 microversion: 2.1 time: 0.531071 Jul 20 04:48:24.644437 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3032/5962] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:24 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1511 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:24.644863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d14676db-4414-4944-b5d8-c7716aeb1205 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:24.644863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d14676db-4414-4944-b5d8-c7716aeb1205 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:24.644863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d14676db-4414-4944-b5d8-c7716aeb1205 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:24.644863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d14676db-4414-4944-b5d8-c7716aeb1205 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:24.644863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d14676db-4414-4944-b5d8-c7716aeb1205 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:24.644863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d14676db-4414-4944-b5d8-c7716aeb1205 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:24.962382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d14676db-4414-4944-b5d8-c7716aeb1205 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:24.971813 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d14676db-4414-4944-b5d8-c7716aeb1205 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1375 microversion: 2.1 time: 0.341017 Jul 20 04:48:24.979643 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2931/5963] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:24 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1375 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:25.646067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bee5aab7-98f5-40e2-a9d6-52ff972d3ec9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:25.649096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bee5aab7-98f5-40e2-a9d6-52ff972d3ec9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:25.679787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:25.690949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bee5aab7-98f5-40e2-a9d6-52ff972d3ec9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:25.693557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bee5aab7-98f5-40e2-a9d6-52ff972d3ec9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:25.694472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bee5aab7-98f5-40e2-a9d6-52ff972d3ec9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:25.695888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bee5aab7-98f5-40e2-a9d6-52ff972d3ec9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:25.989315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3924bf6a-d78d-4504-84b9-61d00f452fa0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:25.989865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3924bf6a-d78d-4504-84b9-61d00f452fa0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:25.997133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:26.001231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:26.010064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3924bf6a-d78d-4504-84b9-61d00f452fa0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.011438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3924bf6a-d78d-4504-84b9-61d00f452fa0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.012567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3924bf6a-d78d-4504-84b9-61d00f452fa0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.013067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3924bf6a-d78d-4504-84b9-61d00f452fa0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.764254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3924bf6a-d78d-4504-84b9-61d00f452fa0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:26.780466 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3924bf6a-d78d-4504-84b9-61d00f452fa0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1375 microversion: 2.1 time: 0.788707 Jul 20 04:48:26.783666 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2932/5964] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:25 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1375 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:26.825645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bee5aab7-98f5-40e2-a9d6-52ff972d3ec9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:26.836028 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bee5aab7-98f5-40e2-a9d6-52ff972d3ec9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1494 microversion: 2.1 time: 1.205296 Jul 20 04:48:26.837309 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3033/5965] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:25 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1494 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:26.860486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-686a45d3-9c61-4ebe-bcc7-741bb7932d30 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:26.861688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-686a45d3-9c61-4ebe-bcc7-741bb7932d30 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:26.880054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-686a45d3-9c61-4ebe-bcc7-741bb7932d30 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.882737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-686a45d3-9c61-4ebe-bcc7-741bb7932d30 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.884094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-686a45d3-9c61-4ebe-bcc7-741bb7932d30 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.884669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-686a45d3-9c61-4ebe-bcc7-741bb7932d30 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.964900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:27.074506 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-686a45d3-9c61-4ebe-bcc7-741bb7932d30 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "POST /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5/action" status: 202 len: 0 microversion: 2.1 time: 0.218728 Jul 20 04:48:27.077982 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2933/5966] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:26 2022] POST /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:27.084619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d03d8087-bc24-4993-b6f4-c803ab131230 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:27.085742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d03d8087-bc24-4993-b6f4-c803ab131230 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:27.093484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d03d8087-bc24-4993-b6f4-c803ab131230 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:27.095001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d03d8087-bc24-4993-b6f4-c803ab131230 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:27.096317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d03d8087-bc24-4993-b6f4-c803ab131230 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:27.097152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d03d8087-bc24-4993-b6f4-c803ab131230 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:27.780154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d03d8087-bc24-4993-b6f4-c803ab131230 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:27.800532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9bcbf0e-fda0-4a76-8833-3a7e9cfb6fea tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:27.801621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b9bcbf0e-fda0-4a76-8833-3a7e9cfb6fea tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:27.838297 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d03d8087-bc24-4993-b6f4-c803ab131230 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1500 microversion: 2.1 time: 0.752958 Jul 20 04:48:27.847617 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3034/5967] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:27 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1500 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:27.849706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9bcbf0e-fda0-4a76-8833-3a7e9cfb6fea tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:27.850184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9bcbf0e-fda0-4a76-8833-3a7e9cfb6fea tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:27.851000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9bcbf0e-fda0-4a76-8833-3a7e9cfb6fea tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:27.851446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9bcbf0e-fda0-4a76-8833-3a7e9cfb6fea tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:28.809291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9bcbf0e-fda0-4a76-8833-3a7e9cfb6fea tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:28.822710 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b9bcbf0e-fda0-4a76-8833-3a7e9cfb6fea tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1375 microversion: 2.1 time: 1.026722 Jul 20 04:48:28.825993 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2934/5968] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:27 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1375 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:28.861357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9a8b038-8fba-4438-9e35-9d40f9ee4bca tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:28.863009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a9a8b038-8fba-4438-9e35-9d40f9ee4bca tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:28.884730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9a8b038-8fba-4438-9e35-9d40f9ee4bca tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:28.885533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9a8b038-8fba-4438-9e35-9d40f9ee4bca tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:28.886563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9a8b038-8fba-4438-9e35-9d40f9ee4bca tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:28.887161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9a8b038-8fba-4438-9e35-9d40f9ee4bca tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:29.757457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9a8b038-8fba-4438-9e35-9d40f9ee4bca tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:29.765980 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a9a8b038-8fba-4438-9e35-9d40f9ee4bca tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1500 microversion: 2.1 time: 0.909608 Jul 20 04:48:29.772991 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3035/5969] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:28 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1500 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:29.844628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-571340a8-edc7-49f9-86fb-d8e32ad192bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:29.847418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-571340a8-edc7-49f9-86fb-d8e32ad192bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:29.873659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-571340a8-edc7-49f9-86fb-d8e32ad192bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:29.874460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-571340a8-edc7-49f9-86fb-d8e32ad192bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:29.878100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-571340a8-edc7-49f9-86fb-d8e32ad192bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:29.883529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-571340a8-edc7-49f9-86fb-d8e32ad192bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:30.671596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-571340a8-edc7-49f9-86fb-d8e32ad192bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:30.685545 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-571340a8-edc7-49f9-86fb-d8e32ad192bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1375 microversion: 2.1 time: 0.846884 Jul 20 04:48:30.702007 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2935/5970] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:29 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1375 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:30.790500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-43d43108-b868-4994-a048-cb939f3da875 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:30.791760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-43d43108-b868-4994-a048-cb939f3da875 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:30.807023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43d43108-b868-4994-a048-cb939f3da875 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:30.807475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43d43108-b868-4994-a048-cb939f3da875 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:30.808489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43d43108-b868-4994-a048-cb939f3da875 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:30.809090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43d43108-b868-4994-a048-cb939f3da875 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.317587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-4f24950c-64da-4559-8c77-31b81c02f4b0 req-106a2f49-74f4-4970-aba6-610ba21290cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd560666-40fb-4f9a-b8c3-aab8e12c0b3b", "name": "network-vif-plugged", "status": "completed", "tag": "9e70c6c8-f45d-46ba-9492-6ce54a59025d"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:31.353998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4f24950c-64da-4559-8c77-31b81c02f4b0 req-106a2f49-74f4-4970-aba6-610ba21290cb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.354713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4f24950c-64da-4559-8c77-31b81c02f4b0 req-106a2f49-74f4-4970-aba6-610ba21290cb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.374502 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-4f24950c-64da-4559-8c77-31b81c02f4b0 req-106a2f49-74f4-4970-aba6-610ba21290cb service nova] Creating event network-vif-plugged:9e70c6c8-f45d-46ba-9492-6ce54a59025d for instance cd560666-40fb-4f9a-b8c3-aab8e12c0b3b on n-h1-764485-11 Jul 20 04:48:31.383562 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-4f24950c-64da-4559-8c77-31b81c02f4b0 req-106a2f49-74f4-4970-aba6-610ba21290cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074116 Jul 20 04:48:31.389475 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2936/5971] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:31.453001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-43d43108-b868-4994-a048-cb939f3da875 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:31.464677 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-43d43108-b868-4994-a048-cb939f3da875 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1500 microversion: 2.1 time: 0.677840 Jul 20 04:48:31.466402 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3036/5972] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:30 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1500 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:31.705623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4404d6c0-2e31-4df9-9f22-5a08a4d05458 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:31.706350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4404d6c0-2e31-4df9-9f22-5a08a4d05458 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:31.722330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4404d6c0-2e31-4df9-9f22-5a08a4d05458 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.732336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4404d6c0-2e31-4df9-9f22-5a08a4d05458 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:31.735271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4404d6c0-2e31-4df9-9f22-5a08a4d05458 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:31.736443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4404d6c0-2e31-4df9-9f22-5a08a4d05458 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:32.473447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4404d6c0-2e31-4df9-9f22-5a08a4d05458 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:32.488604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2be75247-87a2-49d4-bf6e-0ffc457129df tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:32.490168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2be75247-87a2-49d4-bf6e-0ffc457129df tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:32.510238 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4404d6c0-2e31-4df9-9f22-5a08a4d05458 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1375 microversion: 2.1 time: 0.809771 Jul 20 04:48:32.519383 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2937/5973] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:31 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1375 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:32.521788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2be75247-87a2-49d4-bf6e-0ffc457129df tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:32.522363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2be75247-87a2-49d4-bf6e-0ffc457129df tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:32.525807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2be75247-87a2-49d4-bf6e-0ffc457129df tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:32.526386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2be75247-87a2-49d4-bf6e-0ffc457129df tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:33.021531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2be75247-87a2-49d4-bf6e-0ffc457129df tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:33.030285 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2be75247-87a2-49d4-bf6e-0ffc457129df tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1503 microversion: 2.1 time: 0.548379 Jul 20 04:48:33.032946 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3037/5974] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:32 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1503 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:33.048823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7716027d-efea-4007-b2fb-ecf9619aaebb tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:33.050156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7716027d-efea-4007-b2fb-ecf9619aaebb tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:33.057729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7716027d-efea-4007-b2fb-ecf9619aaebb tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:33.058459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7716027d-efea-4007-b2fb-ecf9619aaebb tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:33.059441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7716027d-efea-4007-b2fb-ecf9619aaebb tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:33.060224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7716027d-efea-4007-b2fb-ecf9619aaebb tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:33.094451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7716027d-efea-4007-b2fb-ecf9619aaebb tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:48:33.248262 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7716027d-efea-4007-b2fb-ecf9619aaebb tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 204 len: 0 microversion: 2.1 time: 0.197831 Jul 20 04:48:33.249218 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2938/5975] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:48:33 2022] DELETE /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:48:33.263116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b71e4620-2f2e-42b6-ad2b-4e273994c9c2 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:33.263802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b71e4620-2f2e-42b6-ad2b-4e273994c9c2 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:33.299540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b71e4620-2f2e-42b6-ad2b-4e273994c9c2 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:33.301057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b71e4620-2f2e-42b6-ad2b-4e273994c9c2 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:33.302951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b71e4620-2f2e-42b6-ad2b-4e273994c9c2 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:33.308252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b71e4620-2f2e-42b6-ad2b-4e273994c9c2 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:33.537967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-150c2d7d-e2aa-4751-a096-0a1d3af353a0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:33.541875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-150c2d7d-e2aa-4751-a096-0a1d3af353a0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:33.566683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-150c2d7d-e2aa-4751-a096-0a1d3af353a0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:33.567543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-150c2d7d-e2aa-4751-a096-0a1d3af353a0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:33.570853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-150c2d7d-e2aa-4751-a096-0a1d3af353a0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:33.571578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-150c2d7d-e2aa-4751-a096-0a1d3af353a0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:33.853444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b71e4620-2f2e-42b6-ad2b-4e273994c9c2 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:33.869843 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b71e4620-2f2e-42b6-ad2b-4e273994c9c2 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1509 microversion: 2.1 time: 0.615424 Jul 20 04:48:33.871212 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3038/5976] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:33 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1509 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:34.056950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-150c2d7d-e2aa-4751-a096-0a1d3af353a0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:34.069500 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-150c2d7d-e2aa-4751-a096-0a1d3af353a0 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1375 microversion: 2.1 time: 0.535680 Jul 20 04:48:34.071219 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2939/5977] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:33 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1375 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:34.888589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d4417017-da45-4b34-85ee-c1009e98e0a6 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:34.889360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d4417017-da45-4b34-85ee-c1009e98e0a6 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:34.917192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4417017-da45-4b34-85ee-c1009e98e0a6 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:34.917660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4417017-da45-4b34-85ee-c1009e98e0a6 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:34.918459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4417017-da45-4b34-85ee-c1009e98e0a6 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:34.925959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4417017-da45-4b34-85ee-c1009e98e0a6 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:35.100246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3e786c09-77f1-4189-b9b8-a4f0e63245e3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:35.101740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3e786c09-77f1-4189-b9b8-a4f0e63245e3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:35.142612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e786c09-77f1-4189-b9b8-a4f0e63245e3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.144429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e786c09-77f1-4189-b9b8-a4f0e63245e3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:35.152614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e786c09-77f1-4189-b9b8-a4f0e63245e3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.160042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3e786c09-77f1-4189-b9b8-a4f0e63245e3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:35.454792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d4417017-da45-4b34-85ee-c1009e98e0a6 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:35.467614 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d4417017-da45-4b34-85ee-c1009e98e0a6 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1509 microversion: 2.1 time: 0.583214 Jul 20 04:48:35.468875 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3039/5978] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:34 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1509 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:35.615943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3e786c09-77f1-4189-b9b8-a4f0e63245e3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:35.635189 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3e786c09-77f1-4189-b9b8-a4f0e63245e3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1548 microversion: 2.1 time: 0.545832 Jul 20 04:48:35.636931 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2940/5979] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:35 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1548 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:35.659111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7342067-a358-49a5-bd9a-3827932bd70d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:35.661027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a7342067-a358-49a5-bd9a-3827932bd70d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:35.673931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7342067-a358-49a5-bd9a-3827932bd70d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.681745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7342067-a358-49a5-bd9a-3827932bd70d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:35.683204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7342067-a358-49a5-bd9a-3827932bd70d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.684207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7342067-a358-49a5-bd9a-3827932bd70d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:36.229238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a7342067-a358-49a5-bd9a-3827932bd70d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:36.236803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:36.249196 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a7342067-a358-49a5-bd9a-3827932bd70d tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1548 microversion: 2.1 time: 0.600479 Jul 20 04:48:36.252593 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3040/5980] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:35 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1548 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:36.487719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1f8a26a7-c5ce-4663-88f4-4c39ec7872c9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:36.488560 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1f8a26a7-c5ce-4663-88f4-4c39ec7872c9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:36.502384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f8a26a7-c5ce-4663-88f4-4c39ec7872c9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:36.513503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f8a26a7-c5ce-4663-88f4-4c39ec7872c9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:36.517567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f8a26a7-c5ce-4663-88f4-4c39ec7872c9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:36.518451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f8a26a7-c5ce-4663-88f4-4c39ec7872c9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:37.533483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1f8a26a7-c5ce-4663-88f4-4c39ec7872c9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bda7588a6f9417f9caf7ad1eb43c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb4471bbb94aa6bd92210bdee531a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:37.553135 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1f8a26a7-c5ce-4663-88f4-4c39ec7872c9 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 200 len: 1509 microversion: 2.1 time: 1.069243 Jul 20 04:48:37.562419 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2941/5981] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:36 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 1509 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:37.754658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-bc509ca1-f5a0-4b44-9602-a9ea38850690 req-dbfa7b29-05f0-4f10-87ed-9f86287e8d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a11374b-2d58-4f28-9650-3f5f2d3b75c5", "name": "network-vif-deleted", "tag": "cbecd811-618c-41f9-904f-b7d56e050ec9"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:37.802862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-bc509ca1-f5a0-4b44-9602-a9ea38850690 req-dbfa7b29-05f0-4f10-87ed-9f86287e8d16 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:37.804080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-bc509ca1-f5a0-4b44-9602-a9ea38850690 req-dbfa7b29-05f0-4f10-87ed-9f86287e8d16 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:37.851033 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-bc509ca1-f5a0-4b44-9602-a9ea38850690 req-dbfa7b29-05f0-4f10-87ed-9f86287e8d16 service nova] Creating event network-vif-deleted:cbecd811-618c-41f9-904f-b7d56e050ec9 for instance 5a11374b-2d58-4f28-9650-3f5f2d3b75c5 on n-h2-764485-11 Jul 20 04:48:37.868379 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-bc509ca1-f5a0-4b44-9602-a9ea38850690 req-dbfa7b29-05f0-4f10-87ed-9f86287e8d16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115334 Jul 20 04:48:37.869488 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3041/5982] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:38.608012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9e231df-e8bd-4812-954e-aef797026621 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:38.608012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a9e231df-e8bd-4812-954e-aef797026621 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] [instance: 5a11374b-2d58-4f28-9650-3f5f2d3b75c5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:38.664115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e231df-e8bd-4812-954e-aef797026621 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:38.671246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e231df-e8bd-4812-954e-aef797026621 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:38.677035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e231df-e8bd-4812-954e-aef797026621 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:38.677506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e231df-e8bd-4812-954e-aef797026621 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:38.774825 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a9e231df-e8bd-4812-954e-aef797026621 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] HTTP exception thrown: Instance 5a11374b-2d58-4f28-9650-3f5f2d3b75c5 could not be found. Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9e231df-e8bd-4812-954e-aef797026621 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Request method failure captured: Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 HTTP/1.1 Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14j6fTK24KI3-wgJk-VRGt2b6Oy6rbGTCN5uJyt7tRDc8bcmnrLq2w07xjzv1XZ8vupzj8jLeRwi9IndfX2zBhaiQ7IEv5ri4exzzMo_kdDvOPDBzazp-jzqyFQUZGWTd7xZeIfYPlpSXRnlqRS31nE1-VUYakiFg7indRP7jngxzYo Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 25cb4471bbb94aa6bd92210bdee531a6 Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestServerAdvancedOps-1817505282 Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25cb4471bbb94aa6bd92210bdee531a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25cb4471bbb94aa6bd92210bdee531a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25cb4471bbb94aa6bd92210bdee531a6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25cb4471bbb94aa6bd92210bdee531a6"}]}] Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestServerAdvancedOps-1817505282 Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 25cb4471bbb94aa6bd92210bdee531a6 Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestServerAdvancedOps-1817505282 Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestServerAdvancedOps-1817505282-project Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 6bda7588a6f9417f9caf7ad1eb43c312 Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestServerAdvancedOps-1817505282-project Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 5a11374b-2d58-4f28-9650-3f5f2d3b75c5 could not be found. Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '5a11374b-2d58-4f28-9650-3f5f2d3b75c5'} Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a11374b-2d58-4f28-9650-3f5f2d3b75c5 could not be found. Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a11374b-2d58-4f28-9650-3f5f2d3b75c5 could not be found. Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:38.779013 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:38.785294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:38.785294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:38.785294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:38.785294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:38.785294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:38.785294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a11374b-2d58-4f28-9650-3f5f2d3b75c5 could not be found. Jul 20 04:48:38.785294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:48:38.788650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9e231df-e8bd-4812-954e-aef797026621 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] Returning 404 to user: Instance 5a11374b-2d58-4f28-9650-3f5f2d3b75c5 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:38.789758 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a9e231df-e8bd-4812-954e-aef797026621 tempest-TestServerAdvancedOps-1817505282 tempest-TestServerAdvancedOps-1817505282-project] 10.222.0.20 "GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5" status: 404 len: 111 microversion: 2.1 time: 0.223080 Jul 20 04:48:38.792648 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2942/5983] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:38 2022] GET /compute/v2.1/servers/5a11374b-2d58-4f28-9650-3f5f2d3b75c5 => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:41.230076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-302451d6-d269-40d8-a822-25ebbf4e2ed7 req-dcc969eb-20e9-4eb9-9404-bf528480d24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd560666-40fb-4f9a-b8c3-aab8e12c0b3b", "tag": "9e70c6c8-f45d-46ba-9492-6ce54a59025d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:41.241342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:41.244062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-302451d6-d269-40d8-a822-25ebbf4e2ed7 req-dcc969eb-20e9-4eb9-9404-bf528480d24f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:41.244775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-302451d6-d269-40d8-a822-25ebbf4e2ed7 req-dcc969eb-20e9-4eb9-9404-bf528480d24f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:41.261312 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-302451d6-d269-40d8-a822-25ebbf4e2ed7 req-dcc969eb-20e9-4eb9-9404-bf528480d24f service nova] Creating event network-changed:9e70c6c8-f45d-46ba-9492-6ce54a59025d for instance cd560666-40fb-4f9a-b8c3-aab8e12c0b3b on n-h1-764485-11 Jul 20 04:48:41.299101 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-302451d6-d269-40d8-a822-25ebbf4e2ed7 req-dcc969eb-20e9-4eb9-9404-bf528480d24f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.435149 Jul 20 04:48:41.300178 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3042/5984] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:58.326158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e997a71d-4123-4b51-88e3-3dcf4a208970 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Action: 'create', calling method: .version_select at 0x7fbf9d5a5670>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-636586879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByutyZgOgNouUgd1iztqyIbSBIfQIoNxFCwT1LXS2oWGQkborG4b1UgKSAhM1zK6enpv5YvU5wvYj+2T8e3bRj9GCeTENuvAaV727qXdH825nmeXz3uUe3jrVLjQhwkdA=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:58.334084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:58.335041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:58.347906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e997a71d-4123-4b51-88e3-3dcf4a208970 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Getting quotas for project 1fbeaab7c915413ba676038a5470dfac. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:48:58.357246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e997a71d-4123-4b51-88e3-3dcf4a208970 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Getting quotas for user e65a2471b9ea4860a57b8003b19295c4 and project 1fbeaab7c915413ba676038a5470dfac. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:48:58.388407 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e997a71d-4123-4b51-88e3-3dcf4a208970 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.066342 Jul 20 04:48:58.389657 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2943/5985] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:48:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:59.865328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:59.867037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:59.872076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1271559912", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2d7a48ca-245a-4a60-ae55-ec734ce84461", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-636586879", "security_groups": [{"name": "tempest-secgroup-smoke-615312121"}], "networks": [{"uuid": "4c034c77-cc71-4c54-a5de-5f6a008314e9"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:00.020730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] validate_networks() for [('4c034c77-cc71-4c54-a5de-5f6a008314e9', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:49:00.889494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:49:00.891656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:49:00.893608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:49:00.894616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:49:00.895339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:49:00.940078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.943349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.944496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.946158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.980351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Getting quotas for project 1fbeaab7c915413ba676038a5470dfac. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:49:01.004596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Getting quotas for user e65a2471b9ea4860a57b8003b19295c4 and project 1fbeaab7c915413ba676038a5470dfac. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:49:01.131247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:49:01.133919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d7a48ca-245a-4a60-ae55-ec734ce84461',volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:49:01.418245 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4c0f9ef7-d81c-4cc8-bf64-b2832022f9b6 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.554717 Jul 20 04:49:01.419807 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3043/5986] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:48:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:49:01.433638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1deb50a0-ada7-4a5f-8da6-de65149869b7 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:01.435338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1deb50a0-ada7-4a5f-8da6-de65149869b7 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:01.539321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1deb50a0-ada7-4a5f-8da6-de65149869b7 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:01.551755 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1deb50a0-ada7-4a5f-8da6-de65149869b7 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1098 microversion: 2.1 time: 0.122015 Jul 20 04:49:01.552457 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2944/5987] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:01 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1098 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:02.568792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-806066d8-8193-4bd4-96e6-6be2f7a6a36d tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:02.569425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-806066d8-8193-4bd4-96e6-6be2f7a6a36d tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:02.579725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-806066d8-8193-4bd4-96e6-6be2f7a6a36d tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:02.580877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-806066d8-8193-4bd4-96e6-6be2f7a6a36d tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:02.582692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-806066d8-8193-4bd4-96e6-6be2f7a6a36d tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:02.583158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-806066d8-8193-4bd4-96e6-6be2f7a6a36d tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:02.700496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-806066d8-8193-4bd4-96e6-6be2f7a6a36d tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:02.710128 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-806066d8-8193-4bd4-96e6-6be2f7a6a36d tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1196 microversion: 2.1 time: 0.145304 Jul 20 04:49:02.710717 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3044/5988] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:02 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1196 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:03.729991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6406868-5fa4-45cf-bb0e-cfd73092ffb5 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:03.730693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e6406868-5fa4-45cf-bb0e-cfd73092ffb5 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:03.751033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6406868-5fa4-45cf-bb0e-cfd73092ffb5 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:03.752102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6406868-5fa4-45cf-bb0e-cfd73092ffb5 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:03.754543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6406868-5fa4-45cf-bb0e-cfd73092ffb5 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:03.756166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6406868-5fa4-45cf-bb0e-cfd73092ffb5 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:03.930586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e6406868-5fa4-45cf-bb0e-cfd73092ffb5 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:03.945812 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e6406868-5fa4-45cf-bb0e-cfd73092ffb5 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1214 microversion: 2.1 time: 0.218132 Jul 20 04:49:03.949218 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2945/5989] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:03 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:04.380739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-93864b6a-5f57-4ae1-a1e6-4f1d5d2d3f74 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Action: 'create', calling method: .version_select at 0x7fbfa27d7670>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2100312551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJGwmbQ1iqrbwXiOSPWWC5SEGeeeN+XP3Xe5saoL/579as1yiYX+FO0NCEhOeqzbJfP7dvTF3cDaKsS5SpPkkB2vhMsPgWyCv3z0T97/aqszNOcpnx687T8hjoiv0SGcw=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:04.409023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-93864b6a-5f57-4ae1-a1e6-4f1d5d2d3f74 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Getting quotas for project 82bef8770b5e43e2b9f360f6a186227f. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:49:04.429561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-93864b6a-5f57-4ae1-a1e6-4f1d5d2d3f74 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Getting quotas for user f2d7aa07fd4545d68d9e54fa4fdba267 and project 82bef8770b5e43e2b9f360f6a186227f. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:49:04.479764 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-93864b6a-5f57-4ae1-a1e6-4f1d5d2d3f74 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.503341 Jul 20 04:49:04.481610 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3045/5990] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:49:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:04.966617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9c7012ac-1fce-4ecb-897d-5827fe103405 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:04.968637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9c7012ac-1fce-4ecb-897d-5827fe103405 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:04.985761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c7012ac-1fce-4ecb-897d-5827fe103405 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.986454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c7012ac-1fce-4ecb-897d-5827fe103405 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:04.988435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c7012ac-1fce-4ecb-897d-5827fe103405 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:04.989730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9c7012ac-1fce-4ecb-897d-5827fe103405 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:05.435466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9c7012ac-1fce-4ecb-897d-5827fe103405 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:05.466930 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9c7012ac-1fce-4ecb-897d-5827fe103405 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1281 microversion: 2.1 time: 0.502437 Jul 20 04:49:05.481907 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2946/5991] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:04 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1281 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:06.299299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-1ee73ffa-5d38-4c8a-bd48-f5299ddd2d37 req-b7710119-a5ea-4dc2-badc-b0d41903c7ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c4c3d3-215d-403c-bd3e-012321105dc7", "tag": "88ba16f8-1f9f-4886-adea-eda6035f439a"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:06.324120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1ee73ffa-5d38-4c8a-bd48-f5299ddd2d37 req-b7710119-a5ea-4dc2-badc-b0d41903c7ca service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:06.324570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1ee73ffa-5d38-4c8a-bd48-f5299ddd2d37 req-b7710119-a5ea-4dc2-badc-b0d41903c7ca service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:06.355075 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-1ee73ffa-5d38-4c8a-bd48-f5299ddd2d37 req-b7710119-a5ea-4dc2-badc-b0d41903c7ca service nova] Creating event network-changed:88ba16f8-1f9f-4886-adea-eda6035f439a for instance c0c4c3d3-215d-403c-bd3e-012321105dc7 on n-h2-764485-11 Jul 20 04:49:06.366978 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-1ee73ffa-5d38-4c8a-bd48-f5299ddd2d37 req-b7710119-a5ea-4dc2-badc-b0d41903c7ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074082 Jul 20 04:49:06.368086 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3046/5992] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:06.484777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5f15bb20-2c3d-42ef-9baa-99916804ba08 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:06.485407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5f15bb20-2c3d-42ef-9baa-99916804ba08 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:06.505633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f15bb20-2c3d-42ef-9baa-99916804ba08 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:06.506152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f15bb20-2c3d-42ef-9baa-99916804ba08 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:06.512548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f15bb20-2c3d-42ef-9baa-99916804ba08 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:06.516951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f15bb20-2c3d-42ef-9baa-99916804ba08 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:06.952474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5f15bb20-2c3d-42ef-9baa-99916804ba08 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:06.975785 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5f15bb20-2c3d-42ef-9baa-99916804ba08 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1281 microversion: 2.1 time: 0.494426 Jul 20 04:49:06.977899 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2947/5993] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:06 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1281 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:07.995555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9d0dcb0e-bac0-4590-8718-aad4eca0fcea tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:07.996849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9d0dcb0e-bac0-4590-8718-aad4eca0fcea tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:08.010540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d0dcb0e-bac0-4590-8718-aad4eca0fcea tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:08.012722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d0dcb0e-bac0-4590-8718-aad4eca0fcea tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:08.020794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d0dcb0e-bac0-4590-8718-aad4eca0fcea tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:08.021531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d0dcb0e-bac0-4590-8718-aad4eca0fcea tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:08.963066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9d0dcb0e-bac0-4590-8718-aad4eca0fcea tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:08.986779 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9d0dcb0e-bac0-4590-8718-aad4eca0fcea tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1281 microversion: 2.1 time: 0.996257 Jul 20 04:49:08.996049 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3047/5994] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:07 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1281 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:10.008155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dfe033ab-ad24-4745-9581-daa789cc5e4b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:10.009189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dfe033ab-ad24-4745-9581-daa789cc5e4b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:10.042064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dfe033ab-ad24-4745-9581-daa789cc5e4b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:10.042536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dfe033ab-ad24-4745-9581-daa789cc5e4b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:10.043351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dfe033ab-ad24-4745-9581-daa789cc5e4b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:10.043824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dfe033ab-ad24-4745-9581-daa789cc5e4b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:10.448232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dfe033ab-ad24-4745-9581-daa789cc5e4b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:10.461614 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dfe033ab-ad24-4745-9581-daa789cc5e4b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1281 microversion: 2.1 time: 0.459504 Jul 20 04:49:10.462331 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2948/5995] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:09 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1281 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:11.484516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-79b9b6a6-2b61-4233-b1fd-5cf0d0038255 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:11.485417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-79b9b6a6-2b61-4233-b1fd-5cf0d0038255 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:11.489321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:11.522485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79b9b6a6-2b61-4233-b1fd-5cf0d0038255 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:11.523218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79b9b6a6-2b61-4233-b1fd-5cf0d0038255 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:11.524289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79b9b6a6-2b61-4233-b1fd-5cf0d0038255 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:11.528175 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79b9b6a6-2b61-4233-b1fd-5cf0d0038255 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:11.864809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-79b9b6a6-2b61-4233-b1fd-5cf0d0038255 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:11.902222 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-79b9b6a6-2b61-4233-b1fd-5cf0d0038255 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1269 microversion: 2.1 time: 0.422858 Jul 20 04:49:11.917170 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3048/5996] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:11 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1269 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:12.539435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:12.587870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9b0d2642-f1e4-47dc-b08a-7ad0b8fbfef9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:12.589654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9b0d2642-f1e4-47dc-b08a-7ad0b8fbfef9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:12.621666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9b0d2642-f1e4-47dc-b08a-7ad0b8fbfef9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:12.622721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9b0d2642-f1e4-47dc-b08a-7ad0b8fbfef9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:12.624211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9b0d2642-f1e4-47dc-b08a-7ad0b8fbfef9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:12.631271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9b0d2642-f1e4-47dc-b08a-7ad0b8fbfef9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:12.740351 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9b0d2642-f1e4-47dc-b08a-7ad0b8fbfef9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "POST /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b/action" status: 200 len: 24569 microversion: 2.1 time: 0.156658 Jul 20 04:49:12.741531 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3049/5997] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:49:12 2022] POST /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b/action => generated 24569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:49:12.924169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-55ae7580-3c5a-45e2-bad8-2bd8e819135c tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:12.926027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-55ae7580-3c5a-45e2-bad8-2bd8e819135c tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:12.936989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55ae7580-3c5a-45e2-bad8-2bd8e819135c tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:12.937769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55ae7580-3c5a-45e2-bad8-2bd8e819135c tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:12.940750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55ae7580-3c5a-45e2-bad8-2bd8e819135c tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:12.941574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-55ae7580-3c5a-45e2-bad8-2bd8e819135c tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:13.161183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1400cc35-6311-464b-826e-4408a068a375 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062-project-admin] Calling method '.version_select at 0x7fbfa28ed670>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:13.162271 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:49:13.162271 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 04:49:13.163806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1400cc35-6311-464b-826e-4408a068a375 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:13.164521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1400cc35-6311-464b-826e-4408a068a375 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:13.199067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1400cc35-6311-464b-826e-4408a068a375 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:13.199776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1400cc35-6311-464b-826e-4408a068a375 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:13.213572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1400cc35-6311-464b-826e-4408a068a375 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:13.214390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1400cc35-6311-464b-826e-4408a068a375 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:13.223169 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1400cc35-6311-464b-826e-4408a068a375 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247388062-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.690025 Jul 20 04:49:13.232713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-55ae7580-3c5a-45e2-bad8-2bd8e819135c tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:13.241337 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2949/5998] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 04:49:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:13.252475 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-55ae7580-3c5a-45e2-bad8-2bd8e819135c tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1269 microversion: 2.1 time: 0.335367 Jul 20 04:49:13.264151 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3050/5999] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:12 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1269 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:14.274841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f840af9-f3a3-4ba6-8283-7d076a4224a4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:14.275351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2f840af9-f3a3-4ba6-8283-7d076a4224a4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:14.300044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f840af9-f3a3-4ba6-8283-7d076a4224a4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:14.300808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f840af9-f3a3-4ba6-8283-7d076a4224a4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:14.301818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f840af9-f3a3-4ba6-8283-7d076a4224a4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:14.302495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f840af9-f3a3-4ba6-8283-7d076a4224a4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:14.666653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2f840af9-f3a3-4ba6-8283-7d076a4224a4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:14.690908 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2f840af9-f3a3-4ba6-8283-7d076a4224a4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1269 microversion: 2.1 time: 0.420403 Jul 20 04:49:14.701162 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2950/6000] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:14 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1269 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:15.309135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1496551843-access_point-1692735017", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "bf7af888-4574-4979-9f97-5628b27b013b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2100312551", "security_groups": [{"name": "tempest-secgroup_access--952779810"}, {"name": "tempest-secgroup_general--1077115834"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:15.324221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=10 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:15.499681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] validate_networks() for [('bf7af888-4574-4979-9f97-5628b27b013b', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:49:15.708150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e830573e-8013-49ce-bddc-adcd454ed856 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:15.709963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e830573e-8013-49ce-bddc-adcd454ed856 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:15.719246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e830573e-8013-49ce-bddc-adcd454ed856 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:15.719996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e830573e-8013-49ce-bddc-adcd454ed856 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:15.720973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e830573e-8013-49ce-bddc-adcd454ed856 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:15.721571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e830573e-8013-49ce-bddc-adcd454ed856 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:16.102038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e830573e-8013-49ce-bddc-adcd454ed856 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:16.111870 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e830573e-8013-49ce-bddc-adcd454ed856 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1269 microversion: 2.1 time: 0.407821 Jul 20 04:49:16.113318 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2951/6001] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:15 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1269 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:16.118579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1621828294", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:16.193114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] validate_networks() for None {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:49:16.408936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:49:16.409806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:49:16.410370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:49:16.410868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:49:16.411363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:49:16.423968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:16.424519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:16.425434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:16.425955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:16.446452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Getting quotas for project 82bef8770b5e43e2b9f360f6a186227f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:49:16.454426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Getting quotas for user f2d7aa07fd4545d68d9e54fa4fdba267 and project 82bef8770b5e43e2b9f360f6a186227f. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:49:16.471300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:49:16.473409 n-d-764485-11 devstack@n-api.service[119808]: WARNING nova.utils [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1496551843-access_point-1692735017 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1496551843-ac Jul 20 04:49:16.474144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:49:16.530527 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0a7094c7-d032-446e-b5bf-d991241ad5ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.224485 Jul 20 04:49:16.537278 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3051/6002] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:49:15 2022] POST /compute/v2.1/servers => generated 457 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:49:16.542390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7e172a9d-871c-41a0-bc26-c2949408cf00 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:16.543850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7e172a9d-871c-41a0-bc26-c2949408cf00 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:16.972706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7e172a9d-871c-41a0-bc26-c2949408cf00 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:16.980818 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7e172a9d-871c-41a0-bc26-c2949408cf00 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1295 microversion: 2.1 time: 0.442384 Jul 20 04:49:16.981389 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3052/6003] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:16 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1295 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:17.132554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:49:17.133041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3acb6ec4-5d35-424b-b083-c7fe6d314247 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:17.133508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3acb6ec4-5d35-424b-b083-c7fe6d314247 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:17.134322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:49:17.136213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:49:17.137261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:49:17.137704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:49:17.141108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3acb6ec4-5d35-424b-b083-c7fe6d314247 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:17.141819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3acb6ec4-5d35-424b-b083-c7fe6d314247 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:17.142977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3acb6ec4-5d35-424b-b083-c7fe6d314247 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:17.143648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3acb6ec4-5d35-424b-b083-c7fe6d314247 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:17.153433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:17.154319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:17.155650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:17.156257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:17.182147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Getting quotas for project a349d40104774627a42520916ce41883. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:49:17.201029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Getting quotas for user b2774bb16e69433caab57c51ed6df23a and project a349d40104774627a42520916ce41883. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:49:17.217866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:49:17.220416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:49:17.275395 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-27442b2a-05f7-4b5c-acd6-e05590bc3084 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160439 Jul 20 04:49:17.282086 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2952/6004] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:49:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:49:17.288935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-84cb0fdc-ae8d-4ecd-99b7-ed4ea804d122 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:17.289572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-84cb0fdc-ae8d-4ecd-99b7-ed4ea804d122 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:17.447176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-84cb0fdc-ae8d-4ecd-99b7-ed4ea804d122 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:17.457030 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-84cb0fdc-ae8d-4ecd-99b7-ed4ea804d122 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1214 microversion: 2.1 time: 0.173871 Jul 20 04:49:17.457628 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2953/6005] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:17 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:17.471784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3acb6ec4-5d35-424b-b083-c7fe6d314247 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:17.486621 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3acb6ec4-5d35-424b-b083-c7fe6d314247 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1269 microversion: 2.1 time: 0.359807 Jul 20 04:49:17.498000 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3053/6006] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:17 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1269 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:17.998502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-57409e8f-007e-420e-a1c3-d10e839ef4a3 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:17.999900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-57409e8f-007e-420e-a1c3-d10e839ef4a3 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:18.008210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57409e8f-007e-420e-a1c3-d10e839ef4a3 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:18.008744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57409e8f-007e-420e-a1c3-d10e839ef4a3 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:18.009697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57409e8f-007e-420e-a1c3-d10e839ef4a3 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:18.010149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57409e8f-007e-420e-a1c3-d10e839ef4a3 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:18.098268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-57409e8f-007e-420e-a1c3-d10e839ef4a3 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:18.107454 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-57409e8f-007e-420e-a1c3-d10e839ef4a3 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1353 microversion: 2.1 time: 0.112942 Jul 20 04:49:18.109057 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2954/6007] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:17 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1353 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:18.474854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d89e20dc-87d0-4645-a129-1a8cb6fd6691 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:18.476148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d89e20dc-87d0-4645-a129-1a8cb6fd6691 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:18.496861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d89e20dc-87d0-4645-a129-1a8cb6fd6691 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:18.497612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d89e20dc-87d0-4645-a129-1a8cb6fd6691 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:18.506043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-82347084-0166-4aa2-a4e7-564cce195518 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:18.506742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-82347084-0166-4aa2-a4e7-564cce195518 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:18.518717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d89e20dc-87d0-4645-a129-1a8cb6fd6691 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:18.522760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d89e20dc-87d0-4645-a129-1a8cb6fd6691 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:18.529268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82347084-0166-4aa2-a4e7-564cce195518 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:18.529731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82347084-0166-4aa2-a4e7-564cce195518 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:18.537708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82347084-0166-4aa2-a4e7-564cce195518 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:18.540701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82347084-0166-4aa2-a4e7-564cce195518 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:18.857811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d89e20dc-87d0-4645-a129-1a8cb6fd6691 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:18.866615 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d89e20dc-87d0-4645-a129-1a8cb6fd6691 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1274 microversion: 2.1 time: 0.396254 Jul 20 04:49:18.877818 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3054/6008] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:18 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1274 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:19.022272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-82347084-0166-4aa2-a4e7-564cce195518 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:19.032106 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-82347084-0166-4aa2-a4e7-564cce195518 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1269 microversion: 2.1 time: 0.529792 Jul 20 04:49:19.032921 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2955/6009] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:18 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1269 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:19.127149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6203782b-8f79-49af-9784-66c39a2ed074 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:19.127807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6203782b-8f79-49af-9784-66c39a2ed074 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:19.134867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6203782b-8f79-49af-9784-66c39a2ed074 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:19.135325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6203782b-8f79-49af-9784-66c39a2ed074 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:19.136141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6203782b-8f79-49af-9784-66c39a2ed074 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:19.136593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6203782b-8f79-49af-9784-66c39a2ed074 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:19.576141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6203782b-8f79-49af-9784-66c39a2ed074 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:19.584055 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6203782b-8f79-49af-9784-66c39a2ed074 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1472 microversion: 2.1 time: 0.461577 Jul 20 04:49:19.584682 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3055/6010] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:19 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1472 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:19.884912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-260555e6-d549-4573-9d5f-32d777c91e5f tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:19.885639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-260555e6-d549-4573-9d5f-32d777c91e5f tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:19.892779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-260555e6-d549-4573-9d5f-32d777c91e5f tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:19.893239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-260555e6-d549-4573-9d5f-32d777c91e5f tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:19.894023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-260555e6-d549-4573-9d5f-32d777c91e5f tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:19.894474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-260555e6-d549-4573-9d5f-32d777c91e5f tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:20.027067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-260555e6-d549-4573-9d5f-32d777c91e5f tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:20.034706 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-260555e6-d549-4573-9d5f-32d777c91e5f tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1272 microversion: 2.1 time: 0.153734 Jul 20 04:49:20.035296 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2956/6011] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:19 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:20.051213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-63e59492-6762-489d-8cd7-ef21c61f77eb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:20.051828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-63e59492-6762-489d-8cd7-ef21c61f77eb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:20.057981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63e59492-6762-489d-8cd7-ef21c61f77eb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:20.058440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63e59492-6762-489d-8cd7-ef21c61f77eb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:20.059250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63e59492-6762-489d-8cd7-ef21c61f77eb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:20.059722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63e59492-6762-489d-8cd7-ef21c61f77eb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:20.478300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-63e59492-6762-489d-8cd7-ef21c61f77eb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:20.490523 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-63e59492-6762-489d-8cd7-ef21c61f77eb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1269 microversion: 2.1 time: 0.443148 Jul 20 04:49:20.491916 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3056/6012] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:20 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1269 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:20.601102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-20988d8a-9497-4b8d-bc9b-1154de473efe tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:20.601820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-20988d8a-9497-4b8d-bc9b-1154de473efe tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:20.612657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20988d8a-9497-4b8d-bc9b-1154de473efe tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:20.613121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20988d8a-9497-4b8d-bc9b-1154de473efe tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:20.613881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20988d8a-9497-4b8d-bc9b-1154de473efe tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:20.614322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20988d8a-9497-4b8d-bc9b-1154de473efe tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:20.977862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-20988d8a-9497-4b8d-bc9b-1154de473efe tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:20.986596 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-20988d8a-9497-4b8d-bc9b-1154de473efe tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1472 microversion: 2.1 time: 0.389287 Jul 20 04:49:20.987243 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2957/6013] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:20 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:21.053615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-412c70e5-3208-4ed3-877d-b3151a850087 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:21.054251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-412c70e5-3208-4ed3-877d-b3151a850087 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:21.062110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-412c70e5-3208-4ed3-877d-b3151a850087 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:21.062574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-412c70e5-3208-4ed3-877d-b3151a850087 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:21.063377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-412c70e5-3208-4ed3-877d-b3151a850087 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:21.063857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-412c70e5-3208-4ed3-877d-b3151a850087 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:21.209188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3c68c8c4-9275-4762-9c6e-a60f766ba80a req-878244ad-cba6-4eb6-b5a0-530ee9b80b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ca5c80-1961-48c5-b47a-0e1786b819b5", "tag": "84204b04-8b93-408b-9a88-64de57206a1c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:21.233940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3c68c8c4-9275-4762-9c6e-a60f766ba80a req-878244ad-cba6-4eb6-b5a0-530ee9b80b89 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:21.233940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3c68c8c4-9275-4762-9c6e-a60f766ba80a req-878244ad-cba6-4eb6-b5a0-530ee9b80b89 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:21.255329 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3c68c8c4-9275-4762-9c6e-a60f766ba80a req-878244ad-cba6-4eb6-b5a0-530ee9b80b89 service nova] Creating event network-changed:84204b04-8b93-408b-9a88-64de57206a1c for instance 87ca5c80-1961-48c5-b47a-0e1786b819b5 on n-h1-764485-11 Jul 20 04:49:21.261897 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3c68c8c4-9275-4762-9c6e-a60f766ba80a req-878244ad-cba6-4eb6-b5a0-530ee9b80b89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057636 Jul 20 04:49:21.263256 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2958/6014] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:49:21.511847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-85e86929-17a5-46f1-aa1e-162899504b5f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:21.513010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-85e86929-17a5-46f1-aa1e-162899504b5f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:21.521081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85e86929-17a5-46f1-aa1e-162899504b5f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:21.521782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85e86929-17a5-46f1-aa1e-162899504b5f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:21.522887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85e86929-17a5-46f1-aa1e-162899504b5f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:21.523497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85e86929-17a5-46f1-aa1e-162899504b5f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:21.643615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-412c70e5-3208-4ed3-877d-b3151a850087 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:21.657461 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-412c70e5-3208-4ed3-877d-b3151a850087 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1314 microversion: 2.1 time: 0.608584 Jul 20 04:49:21.659263 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3057/6015] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:21 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:22.004619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9cade294-fb5a-48f7-86e2-9288b9d9d535 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:22.005404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9cade294-fb5a-48f7-86e2-9288b9d9d535 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:22.012525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9cade294-fb5a-48f7-86e2-9288b9d9d535 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:22.013339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9cade294-fb5a-48f7-86e2-9288b9d9d535 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:22.014404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9cade294-fb5a-48f7-86e2-9288b9d9d535 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:22.015708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9cade294-fb5a-48f7-86e2-9288b9d9d535 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:22.341223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-85e86929-17a5-46f1-aa1e-162899504b5f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:22.350078 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-85e86929-17a5-46f1-aa1e-162899504b5f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1269 microversion: 2.1 time: 0.844544 Jul 20 04:49:22.350676 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2959/6016] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:21 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1269 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:22.508084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9cade294-fb5a-48f7-86e2-9288b9d9d535 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:22.515747 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9cade294-fb5a-48f7-86e2-9288b9d9d535 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1472 microversion: 2.1 time: 0.515435 Jul 20 04:49:22.516345 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3058/6017] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:21 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1472 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:22.674969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-81fff5c5-d314-484e-8c02-a51bf58226e8 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:22.675969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-81fff5c5-d314-484e-8c02-a51bf58226e8 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:22.682630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81fff5c5-d314-484e-8c02-a51bf58226e8 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:22.683180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81fff5c5-d314-484e-8c02-a51bf58226e8 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:22.684089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81fff5c5-d314-484e-8c02-a51bf58226e8 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:22.684564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81fff5c5-d314-484e-8c02-a51bf58226e8 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:22.947229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-81fff5c5-d314-484e-8c02-a51bf58226e8 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:22.959076 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-81fff5c5-d314-484e-8c02-a51bf58226e8 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1314 microversion: 2.1 time: 0.288344 Jul 20 04:49:22.971096 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2960/6018] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:22 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:23.285310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-5173ec4b-385e-440d-b1e8-2a0880b26eec req-ab97264f-645d-4f39-bf36-1a5f51bbbd48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb259890-cee8-4078-b46c-970c35705527", "tag": "66e9e3b5-bebb-4ef1-b2c9-90cd38b2c84c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:23.300592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5173ec4b-385e-440d-b1e8-2a0880b26eec req-ab97264f-645d-4f39-bf36-1a5f51bbbd48 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.301487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5173ec4b-385e-440d-b1e8-2a0880b26eec req-ab97264f-645d-4f39-bf36-1a5f51bbbd48 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:23.317029 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-5173ec4b-385e-440d-b1e8-2a0880b26eec req-ab97264f-645d-4f39-bf36-1a5f51bbbd48 service nova] Creating event network-changed:66e9e3b5-bebb-4ef1-b2c9-90cd38b2c84c for instance fb259890-cee8-4078-b46c-970c35705527 on n-h2-764485-11 Jul 20 04:49:23.324446 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-5173ec4b-385e-440d-b1e8-2a0880b26eec req-ab97264f-645d-4f39-bf36-1a5f51bbbd48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043869 Jul 20 04:49:23.325566 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3059/6019] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:49:23.356312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8baf685b-5ae1-493d-9c3c-2be2d9534490 req-322ab94e-9444-43d8-b090-fcf3de437718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c4c3d3-215d-403c-bd3e-012321105dc7", "name": "network-vif-plugged", "status": "completed", "tag": "88ba16f8-1f9f-4886-adea-eda6035f439a"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:23.369789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2efe4d2e-f783-4eaa-9bac-3a466268bdf4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:23.374178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2efe4d2e-f783-4eaa-9bac-3a466268bdf4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:23.374338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8baf685b-5ae1-493d-9c3c-2be2d9534490 req-322ab94e-9444-43d8-b090-fcf3de437718 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.374338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8baf685b-5ae1-493d-9c3c-2be2d9534490 req-322ab94e-9444-43d8-b090-fcf3de437718 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:23.387004 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8baf685b-5ae1-493d-9c3c-2be2d9534490 req-322ab94e-9444-43d8-b090-fcf3de437718 service nova] Creating event network-vif-plugged:88ba16f8-1f9f-4886-adea-eda6035f439a for instance c0c4c3d3-215d-403c-bd3e-012321105dc7 on n-h2-764485-11 Jul 20 04:49:23.387223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2efe4d2e-f783-4eaa-9bac-3a466268bdf4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.387711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2efe4d2e-f783-4eaa-9bac-3a466268bdf4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:23.388509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2efe4d2e-f783-4eaa-9bac-3a466268bdf4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.388956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2efe4d2e-f783-4eaa-9bac-3a466268bdf4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:23.393949 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8baf685b-5ae1-493d-9c3c-2be2d9534490 req-322ab94e-9444-43d8-b090-fcf3de437718 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043990 Jul 20 04:49:23.395105 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2961/6020] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:23.534372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-346cbb82-6c1f-4390-9456-f4a4817d06ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:23.535891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-346cbb82-6c1f-4390-9456-f4a4817d06ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:23.543566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-346cbb82-6c1f-4390-9456-f4a4817d06ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.544395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-346cbb82-6c1f-4390-9456-f4a4817d06ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:23.546433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-346cbb82-6c1f-4390-9456-f4a4817d06ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.547321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-346cbb82-6c1f-4390-9456-f4a4817d06ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:23.690410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2efe4d2e-f783-4eaa-9bac-3a466268bdf4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:23.699405 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2efe4d2e-f783-4eaa-9bac-3a466268bdf4 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1269 microversion: 2.1 time: 0.335156 Jul 20 04:49:23.700293 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3060/6021] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:23 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1269 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:23.744125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-346cbb82-6c1f-4390-9456-f4a4817d06ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:23.752270 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-346cbb82-6c1f-4390-9456-f4a4817d06ae tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1472 microversion: 2.1 time: 0.223181 Jul 20 04:49:23.752857 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2962/6022] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:23 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:23.976761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e17311b2-9e2b-4412-b209-bf0759cae745 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:23.978008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e17311b2-9e2b-4412-b209-bf0759cae745 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:23.986206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e17311b2-9e2b-4412-b209-bf0759cae745 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.986602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e17311b2-9e2b-4412-b209-bf0759cae745 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:23.987392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e17311b2-9e2b-4412-b209-bf0759cae745 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.987876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e17311b2-9e2b-4412-b209-bf0759cae745 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:24.158524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e17311b2-9e2b-4412-b209-bf0759cae745 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:24.166551 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e17311b2-9e2b-4412-b209-bf0759cae745 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1314 microversion: 2.1 time: 0.194030 Jul 20 04:49:24.167134 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3061/6023] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:23 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:24.716366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bbbd96cc-98a2-461e-9a0a-59d84de08587 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:24.716994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bbbd96cc-98a2-461e-9a0a-59d84de08587 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:24.724353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bbbd96cc-98a2-461e-9a0a-59d84de08587 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:24.724843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bbbd96cc-98a2-461e-9a0a-59d84de08587 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:24.725567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bbbd96cc-98a2-461e-9a0a-59d84de08587 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:24.726013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bbbd96cc-98a2-461e-9a0a-59d84de08587 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:24.770046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-183c2d65-8c61-4d02-b5d6-cb8e6be58527 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:24.770677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-183c2d65-8c61-4d02-b5d6-cb8e6be58527 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:24.778130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-183c2d65-8c61-4d02-b5d6-cb8e6be58527 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:24.778594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-183c2d65-8c61-4d02-b5d6-cb8e6be58527 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:24.780421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-183c2d65-8c61-4d02-b5d6-cb8e6be58527 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:24.780421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-183c2d65-8c61-4d02-b5d6-cb8e6be58527 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:24.940843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bbbd96cc-98a2-461e-9a0a-59d84de08587 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:24.948723 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bbbd96cc-98a2-461e-9a0a-59d84de08587 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1269 microversion: 2.1 time: 0.236236 Jul 20 04:49:24.949570 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2963/6024] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:24 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:24.987290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-183c2d65-8c61-4d02-b5d6-cb8e6be58527 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:24.998157 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-183c2d65-8c61-4d02-b5d6-cb8e6be58527 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1472 microversion: 2.1 time: 0.231938 Jul 20 04:49:24.999605 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3062/6025] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:24 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1472 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:25.193704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b6b37f6f-6af3-4487-b2ae-72da708e27c0 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:25.194536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b6b37f6f-6af3-4487-b2ae-72da708e27c0 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:25.201398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6b37f6f-6af3-4487-b2ae-72da708e27c0 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.203124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6b37f6f-6af3-4487-b2ae-72da708e27c0 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:25.204050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6b37f6f-6af3-4487-b2ae-72da708e27c0 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.204730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6b37f6f-6af3-4487-b2ae-72da708e27c0 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:25.241325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:25.462680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b6b37f6f-6af3-4487-b2ae-72da708e27c0 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:25.470942 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b6b37f6f-6af3-4487-b2ae-72da708e27c0 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1314 microversion: 2.1 time: 0.290849 Jul 20 04:49:25.481546 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2964/6026] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:25 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:25.967757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-32731192-3b86-4265-8e01-73aa4b4b2814 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:25.968533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-32731192-3b86-4265-8e01-73aa4b4b2814 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:25.975689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32731192-3b86-4265-8e01-73aa4b4b2814 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.976143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32731192-3b86-4265-8e01-73aa4b4b2814 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:25.977020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32731192-3b86-4265-8e01-73aa4b4b2814 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.977727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-32731192-3b86-4265-8e01-73aa4b4b2814 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:26.015952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ad34353-94a5-4283-9550-b9ceb25e436c tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:26.017414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ad34353-94a5-4283-9550-b9ceb25e436c tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:26.024662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ad34353-94a5-4283-9550-b9ceb25e436c tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:26.025127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ad34353-94a5-4283-9550-b9ceb25e436c tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:26.025945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ad34353-94a5-4283-9550-b9ceb25e436c tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:26.026394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ad34353-94a5-4283-9550-b9ceb25e436c tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:26.244144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-32731192-3b86-4265-8e01-73aa4b4b2814 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:26.252644 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-32731192-3b86-4265-8e01-73aa4b4b2814 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1269 microversion: 2.1 time: 0.289432 Jul 20 04:49:26.253376 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3063/6027] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:25 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1269 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:26.282542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4ad34353-94a5-4283-9550-b9ceb25e436c tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:26.290624 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ad34353-94a5-4283-9550-b9ceb25e436c tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1472 microversion: 2.1 time: 0.278869 Jul 20 04:49:26.291226 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2965/6028] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:26 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1472 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:26.489088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-431c6412-e372-4c45-9851-1860e8e2e213 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:26.489853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-431c6412-e372-4c45-9851-1860e8e2e213 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:26.491993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:26.506940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-431c6412-e372-4c45-9851-1860e8e2e213 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:26.508165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-431c6412-e372-4c45-9851-1860e8e2e213 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:26.509494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-431c6412-e372-4c45-9851-1860e8e2e213 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:26.510151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-431c6412-e372-4c45-9851-1860e8e2e213 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:26.532756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:26.661724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-431c6412-e372-4c45-9851-1860e8e2e213 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:26.669214 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-431c6412-e372-4c45-9851-1860e8e2e213 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1314 microversion: 2.1 time: 0.184505 Jul 20 04:49:26.669809 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3064/6029] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:26 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:27.057067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6c79ded9-0d0c-4374-8935-e9661419458a req-818de735-f297-4772-acfb-97c07c5b049d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ca5c80-1961-48c5-b47a-0e1786b819b5", "name": "network-vif-plugged", "status": "completed", "tag": "84204b04-8b93-408b-9a88-64de57206a1c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:27.075135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6c79ded9-0d0c-4374-8935-e9661419458a req-818de735-f297-4772-acfb-97c07c5b049d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.076322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6c79ded9-0d0c-4374-8935-e9661419458a req-818de735-f297-4772-acfb-97c07c5b049d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.096670 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-6c79ded9-0d0c-4374-8935-e9661419458a req-818de735-f297-4772-acfb-97c07c5b049d service nova] Creating event network-vif-plugged:84204b04-8b93-408b-9a88-64de57206a1c for instance 87ca5c80-1961-48c5-b47a-0e1786b819b5 on n-h1-764485-11 Jul 20 04:49:27.103668 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6c79ded9-0d0c-4374-8935-e9661419458a req-818de735-f297-4772-acfb-97c07c5b049d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055465 Jul 20 04:49:27.104853 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2966/6030] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:27.270232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74a21fc9-dc37-40bd-b36b-b328697c0ed9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:27.271039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74a21fc9-dc37-40bd-b36b-b328697c0ed9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:27.274069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:27.280900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74a21fc9-dc37-40bd-b36b-b328697c0ed9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.281685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74a21fc9-dc37-40bd-b36b-b328697c0ed9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.282668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74a21fc9-dc37-40bd-b36b-b328697c0ed9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.283311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74a21fc9-dc37-40bd-b36b-b328697c0ed9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.305843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:27.310714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4f0f385e-607b-402b-a701-5c978f295d6f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:27.311659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4f0f385e-607b-402b-a701-5c978f295d6f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:27.321773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f0f385e-607b-402b-a701-5c978f295d6f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.322992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f0f385e-607b-402b-a701-5c978f295d6f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.324135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f0f385e-607b-402b-a701-5c978f295d6f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.324824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f0f385e-607b-402b-a701-5c978f295d6f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.457016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:27.698281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-74a21fc9-dc37-40bd-b36b-b328697c0ed9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:27.709922 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74a21fc9-dc37-40bd-b36b-b328697c0ed9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1459 microversion: 2.1 time: 0.444138 Jul 20 04:49:27.723886 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3065/6031] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:27 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1459 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:27.729384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ad4eec23-4135-4024-8d73-6ee3fa85acf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:27.730323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ad4eec23-4135-4024-8d73-6ee3fa85acf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:27.740959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad4eec23-4135-4024-8d73-6ee3fa85acf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.741858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad4eec23-4135-4024-8d73-6ee3fa85acf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.743983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad4eec23-4135-4024-8d73-6ee3fa85acf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.744609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad4eec23-4135-4024-8d73-6ee3fa85acf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:28.062966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4f0f385e-607b-402b-a701-5c978f295d6f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:28.077004 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4f0f385e-607b-402b-a701-5c978f295d6f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1472 microversion: 2.1 time: 0.771863 Jul 20 04:49:28.078670 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2967/6032] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:27 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1472 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:28.084366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9a13a30-f0e2-4a1d-9c17-81d22a58b63b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:28.085219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e9a13a30-f0e2-4a1d-9c17-81d22a58b63b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:28.092233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9a13a30-f0e2-4a1d-9c17-81d22a58b63b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:28.092922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9a13a30-f0e2-4a1d-9c17-81d22a58b63b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:28.093720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9a13a30-f0e2-4a1d-9c17-81d22a58b63b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:28.094449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9a13a30-f0e2-4a1d-9c17-81d22a58b63b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:28.188445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ad4eec23-4135-4024-8d73-6ee3fa85acf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:28.196714 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ad4eec23-4135-4024-8d73-6ee3fa85acf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1314 microversion: 2.1 time: 0.471382 Jul 20 04:49:28.197526 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3066/6033] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:27 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:28.270654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e9a13a30-f0e2-4a1d-9c17-81d22a58b63b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:28.279148 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e9a13a30-f0e2-4a1d-9c17-81d22a58b63b tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1459 microversion: 2.1 time: 0.199034 Jul 20 04:49:28.291142 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2968/6034] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:28 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1459 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:29.095243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b617da36-a875-4a7f-b004-1cfe92c95a83 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:29.095906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b617da36-a875-4a7f-b004-1cfe92c95a83 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:29.103242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b617da36-a875-4a7f-b004-1cfe92c95a83 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.104107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b617da36-a875-4a7f-b004-1cfe92c95a83 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.105127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b617da36-a875-4a7f-b004-1cfe92c95a83 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.105564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b617da36-a875-4a7f-b004-1cfe92c95a83 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.214620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2325d202-1089-48d7-a0ae-129df98ecbf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:29.215259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2325d202-1089-48d7-a0ae-129df98ecbf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:29.219742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:29.240452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2325d202-1089-48d7-a0ae-129df98ecbf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.242636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2325d202-1089-48d7-a0ae-129df98ecbf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.244505 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2325d202-1089-48d7-a0ae-129df98ecbf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.247935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2325d202-1089-48d7-a0ae-129df98ecbf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.318141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b617da36-a875-4a7f-b004-1cfe92c95a83 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:29.330146 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b617da36-a875-4a7f-b004-1cfe92c95a83 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1644 microversion: 2.1 time: 0.239097 Jul 20 04:49:29.331793 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3067/6035] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:29 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1644 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:29.352496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1fa4e108-42d7-47b1-9018-bfb3e4cbb5cb tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:29.357416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1fa4e108-42d7-47b1-9018-bfb3e4cbb5cb tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:29.365708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fa4e108-42d7-47b1-9018-bfb3e4cbb5cb tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.366658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fa4e108-42d7-47b1-9018-bfb3e4cbb5cb tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.367670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fa4e108-42d7-47b1-9018-bfb3e4cbb5cb tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.368265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fa4e108-42d7-47b1-9018-bfb3e4cbb5cb tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.524630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2325d202-1089-48d7-a0ae-129df98ecbf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:29.534341 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2325d202-1089-48d7-a0ae-129df98ecbf1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1314 microversion: 2.1 time: 0.324124 Jul 20 04:49:29.535426 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2969/6036] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:29 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:29.629259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1fa4e108-42d7-47b1-9018-bfb3e4cbb5cb tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:29.637283 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1fa4e108-42d7-47b1-9018-bfb3e4cbb5cb tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1644 microversion: 2.1 time: 0.292884 Jul 20 04:49:29.638043 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3068/6037] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:29 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1644 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:29.657082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8b981cfd-7e40-4c2b-a7da-0e256f312abd tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:29.658887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8b981cfd-7e40-4c2b-a7da-0e256f312abd tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:29.669663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b981cfd-7e40-4c2b-a7da-0e256f312abd tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.670946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b981cfd-7e40-4c2b-a7da-0e256f312abd tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.672171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b981cfd-7e40-4c2b-a7da-0e256f312abd tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.672932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b981cfd-7e40-4c2b-a7da-0e256f312abd tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:30.248210 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8b981cfd-7e40-4c2b-a7da-0e256f312abd tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1797 microversion: 2.1 time: 0.597306 Jul 20 04:49:30.259779 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2970/6038] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:29 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1797 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:30.515380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-c9fc4726-1b5d-43e3-9421-1e478a40bd6d req-ab69eb33-589b-47e1-939c-c17c6469e11f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c4c3d3-215d-403c-bd3e-012321105dc7", "tag": "88ba16f8-1f9f-4886-adea-eda6035f439a"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:30.529285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:30.532056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c9fc4726-1b5d-43e3-9421-1e478a40bd6d req-ab69eb33-589b-47e1-939c-c17c6469e11f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:30.532511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c9fc4726-1b5d-43e3-9421-1e478a40bd6d req-ab69eb33-589b-47e1-939c-c17c6469e11f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:30.554205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1efd5e0e-8b32-4055-9663-6d95061994c3 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:30.556906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1efd5e0e-8b32-4055-9663-6d95061994c3 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:30.557474 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c9fc4726-1b5d-43e3-9421-1e478a40bd6d req-ab69eb33-589b-47e1-939c-c17c6469e11f service nova] Creating event network-changed:88ba16f8-1f9f-4886-adea-eda6035f439a for instance c0c4c3d3-215d-403c-bd3e-012321105dc7 on n-h2-764485-11 Jul 20 04:49:30.569695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1efd5e0e-8b32-4055-9663-6d95061994c3 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:30.570754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1efd5e0e-8b32-4055-9663-6d95061994c3 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:30.572048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1efd5e0e-8b32-4055-9663-6d95061994c3 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:30.572992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1efd5e0e-8b32-4055-9663-6d95061994c3 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:30.577153 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-c9fc4726-1b5d-43e3-9421-1e478a40bd6d req-ab69eb33-589b-47e1-939c-c17c6469e11f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065362 Jul 20 04:49:30.583277 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3069/6039] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:30.908073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1efd5e0e-8b32-4055-9663-6d95061994c3 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:30.932419 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1efd5e0e-8b32-4055-9663-6d95061994c3 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1314 microversion: 2.1 time: 0.380647 Jul 20 04:49:30.937354 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2971/6040] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:30 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:31.409606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a36c6e0f-f09f-4855-8620-0b528c4d7ea0 req-6826b18b-23ce-4c03-9e04-61ab4125c8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb259890-cee8-4078-b46c-970c35705527", "name": "network-vif-plugged", "status": "completed", "tag": "66e9e3b5-bebb-4ef1-b2c9-90cd38b2c84c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:31.418173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a36c6e0f-f09f-4855-8620-0b528c4d7ea0 req-6826b18b-23ce-4c03-9e04-61ab4125c8b7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:31.418624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a36c6e0f-f09f-4855-8620-0b528c4d7ea0 req-6826b18b-23ce-4c03-9e04-61ab4125c8b7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:31.431212 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a36c6e0f-f09f-4855-8620-0b528c4d7ea0 req-6826b18b-23ce-4c03-9e04-61ab4125c8b7 service nova] Creating event network-vif-plugged:66e9e3b5-bebb-4ef1-b2c9-90cd38b2c84c for instance fb259890-cee8-4078-b46c-970c35705527 on n-h2-764485-11 Jul 20 04:49:31.436838 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a36c6e0f-f09f-4855-8620-0b528c4d7ea0 req-6826b18b-23ce-4c03-9e04-61ab4125c8b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032173 Jul 20 04:49:31.438112 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3070/6041] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:31.950472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2b0331b6-986f-46a7-9443-0fba62a35698 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:31.951101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2b0331b6-986f-46a7-9443-0fba62a35698 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:31.958770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b0331b6-986f-46a7-9443-0fba62a35698 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:31.959228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b0331b6-986f-46a7-9443-0fba62a35698 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:31.960055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b0331b6-986f-46a7-9443-0fba62a35698 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:31.960501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b0331b6-986f-46a7-9443-0fba62a35698 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:32.101813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2b0331b6-986f-46a7-9443-0fba62a35698 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:32.110852 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2b0331b6-986f-46a7-9443-0fba62a35698 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1314 microversion: 2.1 time: 0.164520 Jul 20 04:49:32.111439 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2972/6042] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:31 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:33.146254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-20e0596c-1c3e-4630-97aa-00703eb5fb29 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:33.148041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-20e0596c-1c3e-4630-97aa-00703eb5fb29 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:33.171484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20e0596c-1c3e-4630-97aa-00703eb5fb29 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:33.172251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20e0596c-1c3e-4630-97aa-00703eb5fb29 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:33.173729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20e0596c-1c3e-4630-97aa-00703eb5fb29 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:33.177333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20e0596c-1c3e-4630-97aa-00703eb5fb29 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:33.270756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3cdcaed8-a2b6-4780-8ea3-2306354b2260 req-ba49623f-6b1a-4839-925d-7d7ef679f985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c4c3d3-215d-403c-bd3e-012321105dc7", "tag": "88ba16f8-1f9f-4886-adea-eda6035f439a"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:33.284299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3cdcaed8-a2b6-4780-8ea3-2306354b2260 req-ba49623f-6b1a-4839-925d-7d7ef679f985 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:33.285376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3cdcaed8-a2b6-4780-8ea3-2306354b2260 req-ba49623f-6b1a-4839-925d-7d7ef679f985 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:33.305268 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3cdcaed8-a2b6-4780-8ea3-2306354b2260 req-ba49623f-6b1a-4839-925d-7d7ef679f985 service nova] Creating event network-changed:88ba16f8-1f9f-4886-adea-eda6035f439a for instance c0c4c3d3-215d-403c-bd3e-012321105dc7 on n-h2-764485-11 Jul 20 04:49:33.318512 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3cdcaed8-a2b6-4780-8ea3-2306354b2260 req-ba49623f-6b1a-4839-925d-7d7ef679f985 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053159 Jul 20 04:49:33.319466 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2973/6043] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:33.492764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-20e0596c-1c3e-4630-97aa-00703eb5fb29 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:33.503278 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-20e0596c-1c3e-4630-97aa-00703eb5fb29 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1463 microversion: 2.1 time: 0.374379 Jul 20 04:49:33.516315 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3071/6044] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:33 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1463 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:33.523810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6998c807-da3e-49f1-af3d-c99fd8a0ecd1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c83d58c7-222c-4a30-96dc-72fc17f6c6b3", "device": "/dev/sdb"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:33.525457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6998c807-da3e-49f1-af3d-c99fd8a0ecd1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:33.535206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6998c807-da3e-49f1-af3d-c99fd8a0ecd1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:33.535874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6998c807-da3e-49f1-af3d-c99fd8a0ecd1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:33.537249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6998c807-da3e-49f1-af3d-c99fd8a0ecd1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:33.537911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6998c807-da3e-49f1-af3d-c99fd8a0ecd1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:33.897989 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6998c807-da3e-49f1-af3d-c99fd8a0ecd1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "POST /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378496 Jul 20 04:49:33.898882 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2974/6045] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 04:49:33 2022] POST /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:35.343030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-feff1b6d-6b3c-40c8-b04d-244e9f8a23b2 req-da6d3775-e1b3-4702-9cbb-d34064ff7257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c4c3d3-215d-403c-bd3e-012321105dc7", "tag": "88ba16f8-1f9f-4886-adea-eda6035f439a"}, {"name": "network-changed", "server_uuid": "87ca5c80-1961-48c5-b47a-0e1786b819b5", "tag": "84204b04-8b93-408b-9a88-64de57206a1c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:35.359423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-feff1b6d-6b3c-40c8-b04d-244e9f8a23b2 req-da6d3775-e1b3-4702-9cbb-d34064ff7257 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:35.360125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-feff1b6d-6b3c-40c8-b04d-244e9f8a23b2 req-da6d3775-e1b3-4702-9cbb-d34064ff7257 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:35.377799 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-feff1b6d-6b3c-40c8-b04d-244e9f8a23b2 req-da6d3775-e1b3-4702-9cbb-d34064ff7257 service nova] Creating event network-changed:88ba16f8-1f9f-4886-adea-eda6035f439a for instance c0c4c3d3-215d-403c-bd3e-012321105dc7 on n-h2-764485-11 Jul 20 04:49:35.378617 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-feff1b6d-6b3c-40c8-b04d-244e9f8a23b2 req-da6d3775-e1b3-4702-9cbb-d34064ff7257 service nova] Creating event network-changed:84204b04-8b93-408b-9a88-64de57206a1c for instance 87ca5c80-1961-48c5-b47a-0e1786b819b5 on n-h1-764485-11 Jul 20 04:49:35.387590 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-feff1b6d-6b3c-40c8-b04d-244e9f8a23b2 req-da6d3775-e1b3-4702-9cbb-d34064ff7257 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048765 Jul 20 04:49:35.389820 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3072/6046] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:55.874454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-220240f9-912d-4e62-8f03-797230c61b2e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Action: 'create', calling method: .version_select at 0x7fbf9d153ca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-333317329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlXRChw4lExUoCT7D6w5VehL9kYRzYY09yUlqHPBx9zIsfSn7E3MeOSyFeCdg3PdCyoSrCmnheCpTWv3VGN/wH0SZuUkVTNMTzsj6zz0LCVV11noSBi9WH9oIITQ1Wxtw=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:55.883421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=11 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:55.884416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:55.894945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-220240f9-912d-4e62-8f03-797230c61b2e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Getting quotas for project 141470bf62e0454bab8289b6bab0b01a. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:49:55.902749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-220240f9-912d-4e62-8f03-797230c61b2e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Getting quotas for user 97323cd98ca448c097f6a1cfa4ab691a and project 141470bf62e0454bab8289b6bab0b01a. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:49:55.942872 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-220240f9-912d-4e62-8f03-797230c61b2e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.074580 Jul 20 04:49:55.949330 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2975/6047] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:49:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:57.585061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=7 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:57.587075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=38 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:57.593204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-592932399", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "59a3c66b-58a0-4f89-9f64-938d3037fd1b"}], "key_name": "tempest-TestNetworkBasicOps-333317329", "security_groups": [{"name": "tempest-secgroup-smoke-1367975372"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:57.972021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] validate_networks() for [('59a3c66b-58a0-4f89-9f64-938d3037fd1b', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:49:58.655831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:49:58.658475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:49:58.659700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:49:58.660842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:49:58.661528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:49:58.676723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:58.677884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:58.678866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:58.679642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:58.705562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Getting quotas for project 141470bf62e0454bab8289b6bab0b01a. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:49:58.713628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Getting quotas for user 97323cd98ca448c097f6a1cfa4ab691a and project 141470bf62e0454bab8289b6bab0b01a. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:49:58.734426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:49:58.737990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:49:58.805393 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1c5ea480-701e-4b8e-95b7-92177ac9ceca tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.222325 Jul 20 04:49:58.806062 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3073/6048] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:49:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:49:58.817323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3f536624-d8b4-4c01-bf15-902a1a1f5544 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:58.818779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3f536624-d8b4-4c01-bf15-902a1a1f5544 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:58.936978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3f536624-d8b4-4c01-bf15-902a1a1f5544 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:58.944358 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3f536624-d8b4-4c01-bf15-902a1a1f5544 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1247 microversion: 2.1 time: 0.131934 Jul 20 04:49:58.945557 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2976/6049] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:58 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1247 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:59.963927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2e7092fe-6b47-40ac-ab44-8b55e527340b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:59.964895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2e7092fe-6b47-40ac-ab44-8b55e527340b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:59.975074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e7092fe-6b47-40ac-ab44-8b55e527340b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.975946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e7092fe-6b47-40ac-ab44-8b55e527340b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.977001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e7092fe-6b47-40ac-ab44-8b55e527340b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.978048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e7092fe-6b47-40ac-ab44-8b55e527340b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:00.146966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2e7092fe-6b47-40ac-ab44-8b55e527340b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:00.155134 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2e7092fe-6b47-40ac-ab44-8b55e527340b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1307 microversion: 2.1 time: 0.196655 Jul 20 04:50:00.164914 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3074/6050] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:59 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1307 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:01.177719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c3864589-2fb0-4bbb-8b90-90c4245d49ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:01.178380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c3864589-2fb0-4bbb-8b90-90c4245d49ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:01.188638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3864589-2fb0-4bbb-8b90-90c4245d49ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:01.189473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3864589-2fb0-4bbb-8b90-90c4245d49ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:01.190453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3864589-2fb0-4bbb-8b90-90c4245d49ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:01.191053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3864589-2fb0-4bbb-8b90-90c4245d49ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:01.330925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c3864589-2fb0-4bbb-8b90-90c4245d49ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:01.339260 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c3864589-2fb0-4bbb-8b90-90c4245d49ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1305 microversion: 2.1 time: 0.170396 Jul 20 04:50:01.339856 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2977/6051] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:01 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1305 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:02.358918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-26f60677-9527-478f-8024-9c47b5100dde tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:02.360079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-26f60677-9527-478f-8024-9c47b5100dde tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:02.367338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26f60677-9527-478f-8024-9c47b5100dde tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:02.367819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26f60677-9527-478f-8024-9c47b5100dde tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:02.368620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26f60677-9527-478f-8024-9c47b5100dde tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:02.369808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-26f60677-9527-478f-8024-9c47b5100dde tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:02.657522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-26f60677-9527-478f-8024-9c47b5100dde tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:02.665210 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-26f60677-9527-478f-8024-9c47b5100dde tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1373 microversion: 2.1 time: 0.311707 Jul 20 04:50:02.665951 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3075/6052] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:02 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1373 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:03.086126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8398a1e2-d53c-44d6-9f81-13fcad66385f req-05234932-ecb5-406b-b20f-3f2e7072abff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dead210-d0bc-485a-bdd8-610bbf4c19f3", "tag": "00f11344-05f1-4d3f-9ed2-f58c3851666d"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:03.103028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8398a1e2-d53c-44d6-9f81-13fcad66385f req-05234932-ecb5-406b-b20f-3f2e7072abff service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:03.103028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8398a1e2-d53c-44d6-9f81-13fcad66385f req-05234932-ecb5-406b-b20f-3f2e7072abff service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:03.128342 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8398a1e2-d53c-44d6-9f81-13fcad66385f req-05234932-ecb5-406b-b20f-3f2e7072abff service nova] Creating event network-changed:00f11344-05f1-4d3f-9ed2-f58c3851666d for instance 8dead210-d0bc-485a-bdd8-610bbf4c19f3 on n-h1-764485-11 Jul 20 04:50:03.136686 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8398a1e2-d53c-44d6-9f81-13fcad66385f req-05234932-ecb5-406b-b20f-3f2e7072abff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054158 Jul 20 04:50:03.137302 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2978/6053] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:03.682495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b6a3e4a-dcae-4086-9f42-8ae6ea9453ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:03.683119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b6a3e4a-dcae-4086-9f42-8ae6ea9453ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:03.691820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b6a3e4a-dcae-4086-9f42-8ae6ea9453ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:03.692805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b6a3e4a-dcae-4086-9f42-8ae6ea9453ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:03.693600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b6a3e4a-dcae-4086-9f42-8ae6ea9453ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:03.694231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b6a3e4a-dcae-4086-9f42-8ae6ea9453ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:03.849207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0b6a3e4a-dcae-4086-9f42-8ae6ea9453ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:03.859114 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b6a3e4a-dcae-4086-9f42-8ae6ea9453ee tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1373 microversion: 2.1 time: 0.180550 Jul 20 04:50:03.859745 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3076/6054] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:03 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:04.878655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6fa0419b-7c94-4048-8358-a4005c97bfae tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:04.880117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6fa0419b-7c94-4048-8358-a4005c97bfae tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:04.888574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6fa0419b-7c94-4048-8358-a4005c97bfae tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:04.888984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6fa0419b-7c94-4048-8358-a4005c97bfae tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:04.890336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6fa0419b-7c94-4048-8358-a4005c97bfae tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:04.890939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6fa0419b-7c94-4048-8358-a4005c97bfae tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:05.109839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6fa0419b-7c94-4048-8358-a4005c97bfae tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:05.118697 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6fa0419b-7c94-4048-8358-a4005c97bfae tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1373 microversion: 2.1 time: 0.245480 Jul 20 04:50:05.119472 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2979/6055] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:04 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1373 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:05.889677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d3ba7b52-ff1a-4334-b98b-dc7e10c4be60 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:05.890283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d3ba7b52-ff1a-4334-b98b-dc7e10c4be60 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:05.913590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-7941bb3e-2179-41bf-9bfd-15b72b2643ae req-714332f7-c746-42fd-8f16-0d6548abfec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c4c3d3-215d-403c-bd3e-012321105dc7", "tag": "88ba16f8-1f9f-4886-adea-eda6035f439a"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:05.929099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d3ba7b52-ff1a-4334-b98b-dc7e10c4be60 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:05.929980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d3ba7b52-ff1a-4334-b98b-dc7e10c4be60 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:05.931200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d3ba7b52-ff1a-4334-b98b-dc7e10c4be60 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:05.932598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d3ba7b52-ff1a-4334-b98b-dc7e10c4be60 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:05.937975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7941bb3e-2179-41bf-9bfd-15b72b2643ae req-714332f7-c746-42fd-8f16-0d6548abfec3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:05.938439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7941bb3e-2179-41bf-9bfd-15b72b2643ae req-714332f7-c746-42fd-8f16-0d6548abfec3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:05.969277 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-7941bb3e-2179-41bf-9bfd-15b72b2643ae req-714332f7-c746-42fd-8f16-0d6548abfec3 service nova] Creating event network-changed:88ba16f8-1f9f-4886-adea-eda6035f439a for instance c0c4c3d3-215d-403c-bd3e-012321105dc7 on n-h2-764485-11 Jul 20 04:50:05.969691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d3ba7b52-ff1a-4334-b98b-dc7e10c4be60 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:50:05.983381 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-7941bb3e-2179-41bf-9bfd-15b72b2643ae req-714332f7-c746-42fd-8f16-0d6548abfec3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081183 Jul 20 04:50:05.984435 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2980/6056] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:06.086147 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d3ba7b52-ff1a-4334-b98b-dc7e10c4be60 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 204 len: 0 microversion: 2.1 time: 0.200471 Jul 20 04:50:06.094772 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3077/6057] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:50:05 2022] DELETE /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:50:06.098665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-123e8260-8367-4643-826e-4b4b5bcb990f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:06.099699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-123e8260-8367-4643-826e-4b4b5bcb990f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:06.107918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-123e8260-8367-4643-826e-4b4b5bcb990f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:06.108683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-123e8260-8367-4643-826e-4b4b5bcb990f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:06.109684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-123e8260-8367-4643-826e-4b4b5bcb990f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:06.110294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-123e8260-8367-4643-826e-4b4b5bcb990f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:06.139092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cb9154d9-7d8a-49f3-bf7e-5176aa676869 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:06.139845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cb9154d9-7d8a-49f3-bf7e-5176aa676869 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:06.149149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb9154d9-7d8a-49f3-bf7e-5176aa676869 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:06.149605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb9154d9-7d8a-49f3-bf7e-5176aa676869 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:06.150451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb9154d9-7d8a-49f3-bf7e-5176aa676869 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:06.150893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cb9154d9-7d8a-49f3-bf7e-5176aa676869 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:06.567873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-123e8260-8367-4643-826e-4b4b5bcb990f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:06.580290 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-123e8260-8367-4643-826e-4b4b5bcb990f tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1583 microversion: 2.1 time: 0.486972 Jul 20 04:50:06.593261 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2981/6058] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:06 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1583 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:06.623747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cb9154d9-7d8a-49f3-bf7e-5176aa676869 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:06.631803 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cb9154d9-7d8a-49f3-bf7e-5176aa676869 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1373 microversion: 2.1 time: 0.498232 Jul 20 04:50:06.632630 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3078/6059] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:06 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1373 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:07.601639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e693a3cc-a451-4408-9b96-46345b322ea9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:07.602803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e693a3cc-a451-4408-9b96-46345b322ea9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:07.611110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e693a3cc-a451-4408-9b96-46345b322ea9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:07.611734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e693a3cc-a451-4408-9b96-46345b322ea9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:07.612643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e693a3cc-a451-4408-9b96-46345b322ea9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:07.613201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e693a3cc-a451-4408-9b96-46345b322ea9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:07.649562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2698a94-efd9-4191-9f61-06792604da17 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:07.650182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c2698a94-efd9-4191-9f61-06792604da17 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:07.659015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2698a94-efd9-4191-9f61-06792604da17 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:07.660327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2698a94-efd9-4191-9f61-06792604da17 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:07.662074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2698a94-efd9-4191-9f61-06792604da17 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:07.664415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2698a94-efd9-4191-9f61-06792604da17 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:07.941620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e693a3cc-a451-4408-9b96-46345b322ea9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:07.949386 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e693a3cc-a451-4408-9b96-46345b322ea9 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1583 microversion: 2.1 time: 0.352079 Jul 20 04:50:07.951668 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2982/6060] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:07 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1583 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:07.998834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c2698a94-efd9-4191-9f61-06792604da17 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:08.014588 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c2698a94-efd9-4191-9f61-06792604da17 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1373 microversion: 2.1 time: 0.368126 Jul 20 04:50:08.015409 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3079/6061] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:07 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1373 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:08.777824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e23a60c2-4760-413d-bbdf-5d0b52e93870 req-732917d7-f3bb-4197-9a57-7a2c966e3f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c4c3d3-215d-403c-bd3e-012321105dc7", "name": "network-vif-deleted", "tag": "88ba16f8-1f9f-4886-adea-eda6035f439a"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:08.789075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e23a60c2-4760-413d-bbdf-5d0b52e93870 req-732917d7-f3bb-4197-9a57-7a2c966e3f2c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:08.789528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e23a60c2-4760-413d-bbdf-5d0b52e93870 req-732917d7-f3bb-4197-9a57-7a2c966e3f2c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:08.805040 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e23a60c2-4760-413d-bbdf-5d0b52e93870 req-732917d7-f3bb-4197-9a57-7a2c966e3f2c service nova] Creating event network-vif-deleted:88ba16f8-1f9f-4886-adea-eda6035f439a for instance c0c4c3d3-215d-403c-bd3e-012321105dc7 on n-h2-764485-11 Jul 20 04:50:08.813429 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e23a60c2-4760-413d-bbdf-5d0b52e93870 req-732917d7-f3bb-4197-9a57-7a2c966e3f2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036585 Jul 20 04:50:08.818137 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2983/6062] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:50:08.968517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0defccfd-7019-4b9e-a330-b70dcbe6bb3e tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:08.969764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0defccfd-7019-4b9e-a330-b70dcbe6bb3e tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:08.973808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:08.975188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:08.982754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0defccfd-7019-4b9e-a330-b70dcbe6bb3e tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:08.983431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0defccfd-7019-4b9e-a330-b70dcbe6bb3e tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:08.984399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0defccfd-7019-4b9e-a330-b70dcbe6bb3e tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:08.985005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0defccfd-7019-4b9e-a330-b70dcbe6bb3e tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:09.034295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aadb5f98-ec2a-4583-b3a1-3b449e5b0427 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:09.056166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aadb5f98-ec2a-4583-b3a1-3b449e5b0427 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:09.058738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:09.070776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aadb5f98-ec2a-4583-b3a1-3b449e5b0427 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:09.079586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aadb5f98-ec2a-4583-b3a1-3b449e5b0427 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:09.082864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aadb5f98-ec2a-4583-b3a1-3b449e5b0427 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:09.084390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aadb5f98-ec2a-4583-b3a1-3b449e5b0427 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:09.098839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0defccfd-7019-4b9e-a330-b70dcbe6bb3e tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:09.114087 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0defccfd-7019-4b9e-a330-b70dcbe6bb3e tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1229 microversion: 2.1 time: 0.149521 Jul 20 04:50:09.116949 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3080/6063] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:08 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1229 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:09.421987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-11ed67a3-cd7c-4a08-9d03-1bcb2ee76ffd req-fce82dc3-fedc-43df-b302-01ac6541beae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dead210-d0bc-485a-bdd8-610bbf4c19f3", "name": "network-vif-plugged", "status": "completed", "tag": "00f11344-05f1-4d3f-9ed2-f58c3851666d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:09.436985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-11ed67a3-cd7c-4a08-9d03-1bcb2ee76ffd req-fce82dc3-fedc-43df-b302-01ac6541beae service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:09.437464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-11ed67a3-cd7c-4a08-9d03-1bcb2ee76ffd req-fce82dc3-fedc-43df-b302-01ac6541beae service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:09.442196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aadb5f98-ec2a-4583-b3a1-3b449e5b0427 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:09.462421 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aadb5f98-ec2a-4583-b3a1-3b449e5b0427 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1373 microversion: 2.1 time: 0.431222 Jul 20 04:50:09.463723 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2984/6064] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:09 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1373 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:09.489305 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-11ed67a3-cd7c-4a08-9d03-1bcb2ee76ffd req-fce82dc3-fedc-43df-b302-01ac6541beae service nova] Creating event network-vif-plugged:00f11344-05f1-4d3f-9ed2-f58c3851666d for instance 8dead210-d0bc-485a-bdd8-610bbf4c19f3 on n-h1-764485-11 Jul 20 04:50:09.497930 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-11ed67a3-cd7c-4a08-9d03-1bcb2ee76ffd req-fce82dc3-fedc-43df-b302-01ac6541beae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081004 Jul 20 04:50:09.499655 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3081/6065] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:10.132576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-81ceddd4-a633-4e31-81b1-0b67f146cfca tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:10.133914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-81ceddd4-a633-4e31-81b1-0b67f146cfca tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:10.141728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81ceddd4-a633-4e31-81b1-0b67f146cfca tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:10.142371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81ceddd4-a633-4e31-81b1-0b67f146cfca tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:10.143310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81ceddd4-a633-4e31-81b1-0b67f146cfca tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:10.143772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81ceddd4-a633-4e31-81b1-0b67f146cfca tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:10.227080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-81ceddd4-a633-4e31-81b1-0b67f146cfca tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:10.249562 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-81ceddd4-a633-4e31-81b1-0b67f146cfca tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1229 microversion: 2.1 time: 0.120356 Jul 20 04:50:10.251940 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2985/6066] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:10 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1229 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:10.485217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f73967ab-0500-472c-a4a4-51e5b71f18e7 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:10.488397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f73967ab-0500-472c-a4a4-51e5b71f18e7 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:10.495985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f73967ab-0500-472c-a4a4-51e5b71f18e7 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:10.496437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f73967ab-0500-472c-a4a4-51e5b71f18e7 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:10.497284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f73967ab-0500-472c-a4a4-51e5b71f18e7 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:10.497828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f73967ab-0500-472c-a4a4-51e5b71f18e7 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:10.673116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f73967ab-0500-472c-a4a4-51e5b71f18e7 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:10.684417 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f73967ab-0500-472c-a4a4-51e5b71f18e7 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1373 microversion: 2.1 time: 0.206489 Jul 20 04:50:10.686064 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3082/6067] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:10 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:11.268979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f39751a7-4ca7-4b9c-9486-fb6ddd4b88bb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:11.270033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f39751a7-4ca7-4b9c-9486-fb6ddd4b88bb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:11.281441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f39751a7-4ca7-4b9c-9486-fb6ddd4b88bb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:11.282160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f39751a7-4ca7-4b9c-9486-fb6ddd4b88bb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:11.283163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f39751a7-4ca7-4b9c-9486-fb6ddd4b88bb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:11.283800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f39751a7-4ca7-4b9c-9486-fb6ddd4b88bb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:11.360104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f39751a7-4ca7-4b9c-9486-fb6ddd4b88bb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:11.373458 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f39751a7-4ca7-4b9c-9486-fb6ddd4b88bb tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1229 microversion: 2.1 time: 0.110668 Jul 20 04:50:11.384986 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2986/6068] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:11 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1229 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:11.703721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1e7e3196-e89b-4971-8ade-6ed26eb01064 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:11.707367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1e7e3196-e89b-4971-8ade-6ed26eb01064 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:11.720210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e7e3196-e89b-4971-8ade-6ed26eb01064 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:11.720801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e7e3196-e89b-4971-8ade-6ed26eb01064 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:11.722655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e7e3196-e89b-4971-8ade-6ed26eb01064 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:11.723493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e7e3196-e89b-4971-8ade-6ed26eb01064 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:11.901956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1e7e3196-e89b-4971-8ade-6ed26eb01064 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:11.911535 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1e7e3196-e89b-4971-8ade-6ed26eb01064 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1546 microversion: 2.1 time: 0.213405 Jul 20 04:50:11.912760 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3083/6069] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:11 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:11.929074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a685f973-d228-42c7-b936-45bf23cc7c42 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:11.930084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a685f973-d228-42c7-b936-45bf23cc7c42 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:11.937224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a685f973-d228-42c7-b936-45bf23cc7c42 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:11.938036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a685f973-d228-42c7-b936-45bf23cc7c42 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:11.939285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a685f973-d228-42c7-b936-45bf23cc7c42 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:11.939964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a685f973-d228-42c7-b936-45bf23cc7c42 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.105760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a685f973-d228-42c7-b936-45bf23cc7c42 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:12.117260 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a685f973-d228-42c7-b936-45bf23cc7c42 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1546 microversion: 2.1 time: 0.192030 Jul 20 04:50:12.127217 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2987/6070] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:11 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:12.392478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1f069db1-8d86-41e3-a261-182fd7a50949 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:12.392784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1f069db1-8d86-41e3-a261-182fd7a50949 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:12.404761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f069db1-8d86-41e3-a261-182fd7a50949 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:12.405584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f069db1-8d86-41e3-a261-182fd7a50949 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.406562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f069db1-8d86-41e3-a261-182fd7a50949 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:12.407100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1f069db1-8d86-41e3-a261-182fd7a50949 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.503603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1f069db1-8d86-41e3-a261-182fd7a50949 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:12.520634 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1f069db1-8d86-41e3-a261-182fd7a50949 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1229 microversion: 2.1 time: 0.133126 Jul 20 04:50:12.521864 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3084/6071] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:12 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1229 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:13.538217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-36bc9de7-a572-44f7-acb2-3608d5bee8f1 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:13.538865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-36bc9de7-a572-44f7-acb2-3608d5bee8f1 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:13.548349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-36bc9de7-a572-44f7-acb2-3608d5bee8f1 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:13.549132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-36bc9de7-a572-44f7-acb2-3608d5bee8f1 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:13.550085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-36bc9de7-a572-44f7-acb2-3608d5bee8f1 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:13.550706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-36bc9de7-a572-44f7-acb2-3608d5bee8f1 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:13.707070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-36bc9de7-a572-44f7-acb2-3608d5bee8f1 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65a2471b9ea4860a57b8003b19295c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbeaab7c915413ba676038a5470dfac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:13.720827 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-36bc9de7-a572-44f7-acb2-3608d5bee8f1 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 200 len: 1229 microversion: 2.1 time: 0.186967 Jul 20 04:50:13.723941 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2988/6072] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:13 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 1229 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:14.738950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a7173f6-ea14-4dff-8a1f-5017d8d0ec87 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:14.740355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3a7173f6-ea14-4dff-8a1f-5017d8d0ec87 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] [instance: c0c4c3d3-215d-403c-bd3e-012321105dc7] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:14.762170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a7173f6-ea14-4dff-8a1f-5017d8d0ec87 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:14.763222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a7173f6-ea14-4dff-8a1f-5017d8d0ec87 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:14.764387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a7173f6-ea14-4dff-8a1f-5017d8d0ec87 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:14.764987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a7173f6-ea14-4dff-8a1f-5017d8d0ec87 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:14.797379 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-3a7173f6-ea14-4dff-8a1f-5017d8d0ec87 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] HTTP exception thrown: Instance c0c4c3d3-215d-403c-bd3e-012321105dc7 could not be found. Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a7173f6-ea14-4dff-8a1f-5017d8d0ec87 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Request method failure captured: Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 HTTP/1.1 Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14g2TSGoJdsLvFC5LBI6wkxdV_1U0otgG7JlfReBCO44xHXMOCXYsFgRbUOib-8ioe1GYiDdlZE_eKBWhkLwKQaroMHR374pclEFpTqq02cbYPUE2bvrrU2ZC0bS0DQ8HYW-r7eXika7er1nBE97Ercd-VzbhkTWU11Su7cKCHDHxx4 Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 1fbeaab7c915413ba676038a5470dfac Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestVolumeBackupRestore-231262543 Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1fbeaab7c915413ba676038a5470dfac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fbeaab7c915413ba676038a5470dfac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1fbeaab7c915413ba676038a5470dfac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fbeaab7c915413ba676038a5470dfac"}]}] Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestVolumeBackupRestore-231262543 Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 1fbeaab7c915413ba676038a5470dfac Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestVolumeBackupRestore-231262543 Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestVolumeBackupRestore-231262543-project Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: e65a2471b9ea4860a57b8003b19295c4 Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestVolumeBackupRestore-231262543-project Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance c0c4c3d3-215d-403c-bd3e-012321105dc7 could not be found. Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'c0c4c3d3-215d-403c-bd3e-012321105dc7'} Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c4c3d3-215d-403c-bd3e-012321105dc7 could not be found. Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c4c3d3-215d-403c-bd3e-012321105dc7 could not be found. Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:14.799292 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:50:14.803557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:14.803557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:14.803557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:14.803557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:50:14.803557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:50:14.803557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c4c3d3-215d-403c-bd3e-012321105dc7 could not be found. Jul 20 04:50:14.803557 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:50:14.803557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a7173f6-ea14-4dff-8a1f-5017d8d0ec87 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Returning 404 to user: Instance c0c4c3d3-215d-403c-bd3e-012321105dc7 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:50:14.803557 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a7173f6-ea14-4dff-8a1f-5017d8d0ec87 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7" status: 404 len: 111 microversion: 2.1 time: 0.065973 Jul 20 04:50:14.803557 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3085/6073] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:14 2022] GET /compute/v2.1/servers/c0c4c3d3-215d-403c-bd3e-012321105dc7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:50:15.227741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a7495131-be7f-4517-be7d-0bad7d1bf317 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] Calling method '.version_select at 0x7fbf9da985e0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:15.276836 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a7495131-be7f-4517-be7d-0bad7d1bf317 tempest-TestVolumeBackupRestore-231262543 tempest-TestVolumeBackupRestore-231262543-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-636586879" status: 202 len: 0 microversion: 2.1 time: 0.054054 Jul 20 04:50:15.279358 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2989/6074] 10.222.0.20 () {58 vars in 1265 bytes} [Wed Jul 20 04:50:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-636586879 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:50:50.430323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ee522057-a689-4089-b020-157cda9ea9b1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:50.430912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ee522057-a689-4089-b020-157cda9ea9b1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:50.434631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:50.435701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:50.442250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee522057-a689-4089-b020-157cda9ea9b1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:50.442704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee522057-a689-4089-b020-157cda9ea9b1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:50.443488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee522057-a689-4089-b020-157cda9ea9b1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:50.443960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee522057-a689-4089-b020-157cda9ea9b1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:50.721623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-ee522057-a689-4089-b020-157cda9ea9b1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lazy-loading 'services' on Instance uuid fb259890-cee8-4078-b46c-970c35705527 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:50:50.809884 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ee522057-a689-4089-b020-157cda9ea9b1 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527/os-volume_attachments/c83d58c7-222c-4a30-96dc-72fc17f6c6b3" status: 202 len: 0 microversion: 2.1 time: 0.383835 Jul 20 04:50:50.815052 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3086/6075] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 04:50:50 2022] DELETE /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527/os-volume_attachments/c83d58c7-222c-4a30-96dc-72fc17f6c6b3 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:50:55.664451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-65b50c9c-216d-46ac-b121-68f5de8fa6a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:55.668633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-65b50c9c-216d-46ac-b121-68f5de8fa6a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:55.685180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=60 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:55.686858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:55.704411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65b50c9c-216d-46ac-b121-68f5de8fa6a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:55.724398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65b50c9c-216d-46ac-b121-68f5de8fa6a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:55.725626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65b50c9c-216d-46ac-b121-68f5de8fa6a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:55.727006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-65b50c9c-216d-46ac-b121-68f5de8fa6a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:55.806412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-65b50c9c-216d-46ac-b121-68f5de8fa6a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:50:55.986899 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-65b50c9c-216d-46ac-b121-68f5de8fa6a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 204 len: 0 microversion: 2.1 time: 0.337343 Jul 20 04:50:55.987904 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2990/6076] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:50:55 2022] DELETE /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:50:55.998915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4ddc8014-ad26-4e09-90f2-e8d8ed4ff573 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:56.000204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4ddc8014-ad26-4e09-90f2-e8d8ed4ff573 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:56.010203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ddc8014-ad26-4e09-90f2-e8d8ed4ff573 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:56.011926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ddc8014-ad26-4e09-90f2-e8d8ed4ff573 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:56.012966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ddc8014-ad26-4e09-90f2-e8d8ed4ff573 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:56.013800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ddc8014-ad26-4e09-90f2-e8d8ed4ff573 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:56.267761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4ddc8014-ad26-4e09-90f2-e8d8ed4ff573 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:56.284360 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4ddc8014-ad26-4e09-90f2-e8d8ed4ff573 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1552 microversion: 2.1 time: 0.291926 Jul 20 04:50:56.285133 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3087/6077] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:55 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1552 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:57.306095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7acbcdb6-b45c-4e1c-a880-8887cb8c09d2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:57.307374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7acbcdb6-b45c-4e1c-a880-8887cb8c09d2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:57.318619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7acbcdb6-b45c-4e1c-a880-8887cb8c09d2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:57.319239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7acbcdb6-b45c-4e1c-a880-8887cb8c09d2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:57.320586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7acbcdb6-b45c-4e1c-a880-8887cb8c09d2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:57.321236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7acbcdb6-b45c-4e1c-a880-8887cb8c09d2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:57.592515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-404b9a5b-3a57-4886-8dde-1bc41bcea769 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:57.599650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-404b9a5b-3a57-4886-8dde-1bc41bcea769 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:57.614764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-404b9a5b-3a57-4886-8dde-1bc41bcea769 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:57.615645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-404b9a5b-3a57-4886-8dde-1bc41bcea769 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:57.617039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-404b9a5b-3a57-4886-8dde-1bc41bcea769 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:57.618177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-404b9a5b-3a57-4886-8dde-1bc41bcea769 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:57.657612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-404b9a5b-3a57-4886-8dde-1bc41bcea769 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:50:57.781634 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-404b9a5b-3a57-4886-8dde-1bc41bcea769 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 204 len: 0 microversion: 2.1 time: 0.194525 Jul 20 04:50:57.786878 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3088/6078] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:50:57 2022] DELETE /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:50:57.796988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-514a01cd-434a-4daa-9ed6-5a7df248d110 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:57.798469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-514a01cd-434a-4daa-9ed6-5a7df248d110 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:57.813068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-514a01cd-434a-4daa-9ed6-5a7df248d110 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:57.813827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-514a01cd-434a-4daa-9ed6-5a7df248d110 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:57.814931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-514a01cd-434a-4daa-9ed6-5a7df248d110 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:57.815890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-514a01cd-434a-4daa-9ed6-5a7df248d110 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:57.930288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7acbcdb6-b45c-4e1c-a880-8887cb8c09d2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:57.955878 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7acbcdb6-b45c-4e1c-a880-8887cb8c09d2 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1552 microversion: 2.1 time: 0.656210 Jul 20 04:50:57.956869 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2991/6079] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:57 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1552 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:58.221381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-514a01cd-434a-4daa-9ed6-5a7df248d110 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:58.238090 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-514a01cd-434a-4daa-9ed6-5a7df248d110 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1469 microversion: 2.1 time: 0.449622 Jul 20 04:50:58.238644 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3089/6080] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:57 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1469 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:58.975083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fbf25217-8431-4a9c-9301-3d7e58e9676e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:58.976362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fbf25217-8431-4a9c-9301-3d7e58e9676e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:58.999433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbf25217-8431-4a9c-9301-3d7e58e9676e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:59.000199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbf25217-8431-4a9c-9301-3d7e58e9676e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:59.001986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbf25217-8431-4a9c-9301-3d7e58e9676e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:59.005007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbf25217-8431-4a9c-9301-3d7e58e9676e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:59.061675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-c1746cf6-4032-4462-9114-6cf97b035225 req-5dd1c5e2-102d-4643-8d2f-9f4ae7da0b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dead210-d0bc-485a-bdd8-610bbf4c19f3", "name": "network-vif-deleted", "tag": "00f11344-05f1-4d3f-9ed2-f58c3851666d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:59.092816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c1746cf6-4032-4462-9114-6cf97b035225 req-5dd1c5e2-102d-4643-8d2f-9f4ae7da0b6a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:59.093543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c1746cf6-4032-4462-9114-6cf97b035225 req-5dd1c5e2-102d-4643-8d2f-9f4ae7da0b6a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:59.119733 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c1746cf6-4032-4462-9114-6cf97b035225 req-5dd1c5e2-102d-4643-8d2f-9f4ae7da0b6a service nova] Creating event network-vif-deleted:00f11344-05f1-4d3f-9ed2-f58c3851666d for instance 8dead210-d0bc-485a-bdd8-610bbf4c19f3 on n-h1-764485-11 Jul 20 04:50:59.137888 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-c1746cf6-4032-4462-9114-6cf97b035225 req-5dd1c5e2-102d-4643-8d2f-9f4ae7da0b6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080997 Jul 20 04:50:59.138427 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3090/6081] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:50:59.151959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fbf25217-8431-4a9c-9301-3d7e58e9676e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:59.166819 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fbf25217-8431-4a9c-9301-3d7e58e9676e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 200 len: 1484 microversion: 2.1 time: 0.196305 Jul 20 04:50:59.170457 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2992/6082] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:58 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 1484 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:59.257155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1c3c1c2e-8c5b-49a2-adbf-e1d3f10efca5 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:59.257763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1c3c1c2e-8c5b-49a2-adbf-e1d3f10efca5 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:59.273102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c3c1c2e-8c5b-49a2-adbf-e1d3f10efca5 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:59.273822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c3c1c2e-8c5b-49a2-adbf-e1d3f10efca5 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:59.275146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c3c1c2e-8c5b-49a2-adbf-e1d3f10efca5 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:59.276036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c3c1c2e-8c5b-49a2-adbf-e1d3f10efca5 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:59.527298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1c3c1c2e-8c5b-49a2-adbf-e1d3f10efca5 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:59.538608 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1c3c1c2e-8c5b-49a2-adbf-e1d3f10efca5 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1469 microversion: 2.1 time: 0.283906 Jul 20 04:50:59.550864 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3091/6083] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:59 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1469 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:59.769409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1449556105", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "c1cdf1d6-28a5-47da-9e0b-ceed366972f7"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2100312551", "security_groups": []}, "os:scheduler_hints": {"different_host": ["87ca5c80-1961-48c5-b47a-0e1786b819b5"]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:59.842148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] validate_networks() for [('c1cdf1d6-28a5-47da-9e0b-ceed366972f7', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:51:00.197630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ae87ad90-f1f8-4f11-a14b-b2b7e92aed46 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:00.198325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ae87ad90-f1f8-4f11-a14b-b2b7e92aed46 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 8dead210-d0bc-485a-bdd8-610bbf4c19f3] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:00.207815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae87ad90-f1f8-4f11-a14b-b2b7e92aed46 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:00.208281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae87ad90-f1f8-4f11-a14b-b2b7e92aed46 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:00.209195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae87ad90-f1f8-4f11-a14b-b2b7e92aed46 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:00.210236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae87ad90-f1f8-4f11-a14b-b2b7e92aed46 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:00.250976 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-ae87ad90-f1f8-4f11-a14b-b2b7e92aed46 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] HTTP exception thrown: Instance 8dead210-d0bc-485a-bdd8-610bbf4c19f3 could not be found. Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ae87ad90-f1f8-4f11-a14b-b2b7e92aed46 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Request method failure captured: Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 HTTP/1.1 Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14j7g2DG9R8c47poZBwDWSz0WARq5VdRh1LFfATtyfTWE_0P4APzetD_rDciLIFAEU-qtRbmXPLhqNSWO_iBxSSP0iA3R57Z-JB5TtjkjSm66Fg-q-FuqBs4F_mZJDUQUxKgS5kb6jt83AzEV5IcLcLRmDiaRgwvr_vdlJ1Z8UKm4vA Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 141470bf62e0454bab8289b6bab0b01a Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestNetworkBasicOps-1642029803 Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/141470bf62e0454bab8289b6bab0b01a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/141470bf62e0454bab8289b6bab0b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_141470bf62e0454bab8289b6bab0b01a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/141470bf62e0454bab8289b6bab0b01a"}]}] Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestNetworkBasicOps-1642029803 Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 141470bf62e0454bab8289b6bab0b01a Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestNetworkBasicOps-1642029803 Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestNetworkBasicOps-1642029803-project Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 97323cd98ca448c097f6a1cfa4ab691a Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestNetworkBasicOps-1642029803-project Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 8dead210-d0bc-485a-bdd8-610bbf4c19f3 could not be found. Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '8dead210-d0bc-485a-bdd8-610bbf4c19f3'} Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dead210-d0bc-485a-bdd8-610bbf4c19f3 could not be found. Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dead210-d0bc-485a-bdd8-610bbf4c19f3 could not be found. Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:00.252925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:00.259611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:00.259611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:00.259611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:00.259611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:00.259611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:00.259611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dead210-d0bc-485a-bdd8-610bbf4c19f3 could not be found. Jul 20 04:51:00.259611 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:00.262417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ae87ad90-f1f8-4f11-a14b-b2b7e92aed46 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Returning 404 to user: Instance 8dead210-d0bc-485a-bdd8-610bbf4c19f3 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:00.263540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ae87ad90-f1f8-4f11-a14b-b2b7e92aed46 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3" status: 404 len: 111 microversion: 2.1 time: 0.072918 Jul 20 04:51:00.264676 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3092/6084] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:00 2022] GET /compute/v2.1/servers/8dead210-d0bc-485a-bdd8-610bbf4c19f3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:51:00.348216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4c321c9a-2224-4566-a97c-0bb06c97dfac req-47d75630-c80d-47e1-bcef-839a43277524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb259890-cee8-4078-b46c-970c35705527", "name": "network-vif-deleted", "tag": "66e9e3b5-bebb-4ef1-b2c9-90cd38b2c84c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:00.366592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4c321c9a-2224-4566-a97c-0bb06c97dfac req-47d75630-c80d-47e1-bcef-839a43277524 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:00.367058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4c321c9a-2224-4566-a97c-0bb06c97dfac req-47d75630-c80d-47e1-bcef-839a43277524 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:00.389296 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4c321c9a-2224-4566-a97c-0bb06c97dfac req-47d75630-c80d-47e1-bcef-839a43277524 service nova] Creating event network-vif-deleted:66e9e3b5-bebb-4ef1-b2c9-90cd38b2c84c for instance fb259890-cee8-4078-b46c-970c35705527 on n-h2-764485-11 Jul 20 04:51:00.406426 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4c321c9a-2224-4566-a97c-0bb06c97dfac req-47d75630-c80d-47e1-bcef-839a43277524 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063356 Jul 20 04:51:00.408409 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3093/6085] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:00.479709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:51:00.480228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:51:00.480741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:51:00.481230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:51:00.481878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:51:00.494473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:00.496180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:00.498141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:00.498652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:00.548308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Getting quotas for project 82bef8770b5e43e2b9f360f6a186227f. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:00.556569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Getting quotas for user f2d7aa07fd4545d68d9e54fa4fdba267 and project 82bef8770b5e43e2b9f360f6a186227f. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:00.564498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3fd4f6c6-ac81-4c24-91c8-97f9400e4987 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:00.566811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3fd4f6c6-ac81-4c24-91c8-97f9400e4987 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:00.575601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:51:00.580496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fd4f6c6-ac81-4c24-91c8-97f9400e4987 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:00.580496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fd4f6c6-ac81-4c24-91c8-97f9400e4987 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:00.582686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:51:00.582943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fd4f6c6-ac81-4c24-91c8-97f9400e4987 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:00.583808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fd4f6c6-ac81-4c24-91c8-97f9400e4987 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:00.670920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fd4f6c6-ac81-4c24-91c8-97f9400e4987 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:00.671776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3fd4f6c6-ac81-4c24-91c8-97f9400e4987 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:00.672546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-3fd4f6c6-ac81-4c24-91c8-97f9400e4987 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lazy-loading 'fault' on Instance uuid fb259890-cee8-4078-b46c-970c35705527 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:51:00.695243 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-acdb0bdd-bc7d-41ea-b4b5-0818bc8eb9cd tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.939991 Jul 20 04:51:00.699229 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2993/6086] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:50:59 2022] POST /compute/v2.1/servers => generated 361 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:51:00.710307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cbe74cb2-1128-4bb3-94b0-8365b2a1f109 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '.version_select at 0x7fbf9d0b7dc0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:00.760629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3fd4f6c6-ac81-4c24-91c8-97f9400e4987 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2774bb16e69433caab57c51ed6df23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349d40104774627a42520916ce41883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:00.771072 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cbe74cb2-1128-4bb3-94b0-8365b2a1f109 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-333317329" status: 202 len: 0 microversion: 2.1 time: 0.067889 Jul 20 04:51:00.771072 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2994/6087] 10.222.0.20 () {58 vars in 1253 bytes} [Wed Jul 20 04:51:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-333317329 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:51:00.778737 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3fd4f6c6-ac81-4c24-91c8-97f9400e4987 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 200 len: 1304 microversion: 2.1 time: 0.219196 Jul 20 04:51:00.780074 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3094/6088] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:00 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 1304 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:00.786722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a19c6612-5eed-4800-ae32-5e1b58c8e373 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:00.787644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a19c6612-5eed-4800-ae32-5e1b58c8e373 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:00.891932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a19c6612-5eed-4800-ae32-5e1b58c8e373 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:00.900945 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a19c6612-5eed-4800-ae32-5e1b58c8e373 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1242 microversion: 2.1 time: 0.130079 Jul 20 04:51:00.905893 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2995/6089] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:00 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1242 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:01.797202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e047cc2-83f5-4edb-a964-82f96e698472 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:01.797825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6e047cc2-83f5-4edb-a964-82f96e698472 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] [instance: fb259890-cee8-4078-b46c-970c35705527] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:01.813966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e047cc2-83f5-4edb-a964-82f96e698472 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:01.817116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e047cc2-83f5-4edb-a964-82f96e698472 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:01.818097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e047cc2-83f5-4edb-a964-82f96e698472 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:01.822263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e047cc2-83f5-4edb-a964-82f96e698472 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:01.858560 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-6e047cc2-83f5-4edb-a964-82f96e698472 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] HTTP exception thrown: Instance fb259890-cee8-4078-b46c-970c35705527 could not be found. Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e047cc2-83f5-4edb-a964-82f96e698472 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Request method failure captured: Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 HTTP/1.1 Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14lIgAXSSpxUsTifVjTSM6Wq_Hg_eBncVbaClFHiB1PuNV8DXRNIt4Wkquybp-4H9X8VEA3Mrr0qhfdRmSdYYItpouURLCNwnnSHHmZ-kRC-p7Bqcc7jBHRv2ROZKmLZBmjADov5k2orvqtkYddr-B5M6Goc5TmvRlhCM0u3hN6D8Zs Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a349d40104774627a42520916ce41883 Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-VolumesBackupsTest-1044944427 Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a349d40104774627a42520916ce41883"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a349d40104774627a42520916ce41883"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a349d40104774627a42520916ce41883", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a349d40104774627a42520916ce41883"}]}] Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-VolumesBackupsTest-1044944427 Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a349d40104774627a42520916ce41883 Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-VolumesBackupsTest-1044944427 Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-VolumesBackupsTest-1044944427-project Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: b2774bb16e69433caab57c51ed6df23a Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-VolumesBackupsTest-1044944427-project Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance fb259890-cee8-4078-b46c-970c35705527 could not be found. Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'fb259890-cee8-4078-b46c-970c35705527'} Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb259890-cee8-4078-b46c-970c35705527 could not be found. Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb259890-cee8-4078-b46c-970c35705527 could not be found. Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:01.861073 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:01.865405 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:01.865405 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:01.865405 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:01.865405 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:01.865405 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:01.865405 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb259890-cee8-4078-b46c-970c35705527 could not be found. Jul 20 04:51:01.865405 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:01.869357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e047cc2-83f5-4edb-a964-82f96e698472 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] Returning 404 to user: Instance fb259890-cee8-4078-b46c-970c35705527 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:01.871262 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6e047cc2-83f5-4edb-a964-82f96e698472 tempest-VolumesBackupsTest-1044944427 tempest-VolumesBackupsTest-1044944427-project] 10.222.0.20 "GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527" status: 404 len: 111 microversion: 2.1 time: 0.078115 Jul 20 04:51:01.872600 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3095/6090] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:01 2022] GET /compute/v2.1/servers/fb259890-cee8-4078-b46c-970c35705527 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:51:01.921130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4518b51c-580d-4b1b-974f-f855aad92a17 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:01.921983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4518b51c-580d-4b1b-974f-f855aad92a17 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:01.938205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4518b51c-580d-4b1b-974f-f855aad92a17 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:01.939015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4518b51c-580d-4b1b-974f-f855aad92a17 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:01.940420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4518b51c-580d-4b1b-974f-f855aad92a17 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:01.941686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4518b51c-580d-4b1b-974f-f855aad92a17 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:02.095536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4518b51c-580d-4b1b-974f-f855aad92a17 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:02.111022 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4518b51c-580d-4b1b-974f-f855aad92a17 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1294 microversion: 2.1 time: 0.196283 Jul 20 04:51:02.112454 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2996/6091] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:01 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1294 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:03.138858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e09fc4d0-9b00-47b9-884b-1701f9e52442 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:03.139496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e09fc4d0-9b00-47b9-884b-1701f9e52442 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:03.150196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e09fc4d0-9b00-47b9-884b-1701f9e52442 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:03.151699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e09fc4d0-9b00-47b9-884b-1701f9e52442 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:03.154340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e09fc4d0-9b00-47b9-884b-1701f9e52442 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:03.155024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e09fc4d0-9b00-47b9-884b-1701f9e52442 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:03.252400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e09fc4d0-9b00-47b9-884b-1701f9e52442 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:03.264722 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e09fc4d0-9b00-47b9-884b-1701f9e52442 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1300 microversion: 2.1 time: 0.139194 Jul 20 04:51:03.265525 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3096/6092] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:03 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:04.207027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b4ea7fcc-9a89-4d1c-8650-b752ec78fe21 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:04.208104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b4ea7fcc-9a89-4d1c-8650-b752ec78fe21 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:04.221710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9c260bc0-59e8-4b9b-a9a4-454593f24d1c req-b3ff0639-822c-4010-9ac9-607d08b04697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd560666-40fb-4f9a-b8c3-aab8e12c0b3b", "tag": "9e70c6c8-f45d-46ba-9492-6ce54a59025d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:04.250322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4ea7fcc-9a89-4d1c-8650-b752ec78fe21 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:04.252339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4ea7fcc-9a89-4d1c-8650-b752ec78fe21 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:04.255415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4ea7fcc-9a89-4d1c-8650-b752ec78fe21 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:04.257955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4ea7fcc-9a89-4d1c-8650-b752ec78fe21 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:04.287263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9c260bc0-59e8-4b9b-a9a4-454593f24d1c req-b3ff0639-822c-4010-9ac9-607d08b04697 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:04.288047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9c260bc0-59e8-4b9b-a9a4-454593f24d1c req-b3ff0639-822c-4010-9ac9-607d08b04697 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:04.318838 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9c260bc0-59e8-4b9b-a9a4-454593f24d1c req-b3ff0639-822c-4010-9ac9-607d08b04697 service nova] Creating event network-changed:9e70c6c8-f45d-46ba-9492-6ce54a59025d for instance cd560666-40fb-4f9a-b8c3-aab8e12c0b3b on n-h1-764485-11 Jul 20 04:51:04.329967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b4ea7fcc-9a89-4d1c-8650-b752ec78fe21 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:51:04.343862 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9c260bc0-59e8-4b9b-a9a4-454593f24d1c req-b3ff0639-822c-4010-9ac9-607d08b04697 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127864 Jul 20 04:51:04.345423 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3097/6093] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:04.354779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aace3701-bb1d-4225-bb0f-4b61f27dc653 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:04.355946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aace3701-bb1d-4225-bb0f-4b61f27dc653 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:04.363808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aace3701-bb1d-4225-bb0f-4b61f27dc653 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:04.364529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aace3701-bb1d-4225-bb0f-4b61f27dc653 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:04.365481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aace3701-bb1d-4225-bb0f-4b61f27dc653 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:04.366082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aace3701-bb1d-4225-bb0f-4b61f27dc653 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:04.517945 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b4ea7fcc-9a89-4d1c-8650-b752ec78fe21 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 204 len: 0 microversion: 2.1 time: 0.314230 Jul 20 04:51:04.519355 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2997/6094] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:51:04 2022] DELETE /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:51:04.531437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0375a00-7419-4540-845f-e7a1e6d77180 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:04.549683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e0375a00-7419-4540-845f-e7a1e6d77180 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:04.569294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0375a00-7419-4540-845f-e7a1e6d77180 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:04.569761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0375a00-7419-4540-845f-e7a1e6d77180 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:04.570561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0375a00-7419-4540-845f-e7a1e6d77180 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:04.572456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0375a00-7419-4540-845f-e7a1e6d77180 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:04.602297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aace3701-bb1d-4225-bb0f-4b61f27dc653 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:04.636961 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aace3701-bb1d-4225-bb0f-4b61f27dc653 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1300 microversion: 2.1 time: 0.289932 Jul 20 04:51:04.637479 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3098/6095] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:04 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1300 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:05.001066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e0375a00-7419-4540-845f-e7a1e6d77180 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:05.013646 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e0375a00-7419-4540-845f-e7a1e6d77180 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1673 microversion: 2.1 time: 0.489064 Jul 20 04:51:05.027675 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2998/6096] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:04 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1673 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:05.390103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-e7fd32d8-123b-4331-b40e-164182b57ae2 req-f0ce0245-f0a6-436c-9c8e-30b959912e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7058f9-3320-413b-b090-bdcc308364f9", "tag": "c0a9a2a0-aa98-45d4-af78-7fcf8c4b36e0"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:05.406190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e7fd32d8-123b-4331-b40e-164182b57ae2 req-f0ce0245-f0a6-436c-9c8e-30b959912e96 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:05.406898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e7fd32d8-123b-4331-b40e-164182b57ae2 req-f0ce0245-f0a6-436c-9c8e-30b959912e96 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:05.454583 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e7fd32d8-123b-4331-b40e-164182b57ae2 req-f0ce0245-f0a6-436c-9c8e-30b959912e96 service nova] Creating event network-changed:c0a9a2a0-aa98-45d4-af78-7fcf8c4b36e0 for instance 1c7058f9-3320-413b-b090-bdcc308364f9 on n-h2-764485-11 Jul 20 04:51:05.466416 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-e7fd32d8-123b-4331-b40e-164182b57ae2 req-f0ce0245-f0a6-436c-9c8e-30b959912e96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081275 Jul 20 04:51:05.469426 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3099/6097] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:05.655453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0dfc1cdb-077e-4bdd-9327-160567a7e76d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:05.656183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0dfc1cdb-077e-4bdd-9327-160567a7e76d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:05.672406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0dfc1cdb-077e-4bdd-9327-160567a7e76d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:05.672782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0dfc1cdb-077e-4bdd-9327-160567a7e76d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:05.673583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0dfc1cdb-077e-4bdd-9327-160567a7e76d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:05.677454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0dfc1cdb-077e-4bdd-9327-160567a7e76d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:05.904833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0dfc1cdb-077e-4bdd-9327-160567a7e76d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:05.914786 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0dfc1cdb-077e-4bdd-9327-160567a7e76d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1300 microversion: 2.1 time: 0.264222 Jul 20 04:51:05.920319 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 2999/6098] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:05 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1300 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:06.034261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0984a3b2-379e-4ae6-8dde-57f4149f763f tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:06.035156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0984a3b2-379e-4ae6-8dde-57f4149f763f tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:06.055195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0984a3b2-379e-4ae6-8dde-57f4149f763f tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:06.055671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0984a3b2-379e-4ae6-8dde-57f4149f763f tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:06.063082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0984a3b2-379e-4ae6-8dde-57f4149f763f tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:06.067733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0984a3b2-379e-4ae6-8dde-57f4149f763f tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:06.663501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0984a3b2-379e-4ae6-8dde-57f4149f763f tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:06.676709 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0984a3b2-379e-4ae6-8dde-57f4149f763f tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1673 microversion: 2.1 time: 0.648200 Jul 20 04:51:06.677776 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3100/6099] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:06 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1673 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:06.937629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1d8c6259-ba01-4f5b-b095-9fb2646215c2 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:06.939415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1d8c6259-ba01-4f5b-b095-9fb2646215c2 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:06.947747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d8c6259-ba01-4f5b-b095-9fb2646215c2 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:06.949120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d8c6259-ba01-4f5b-b095-9fb2646215c2 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:06.950441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d8c6259-ba01-4f5b-b095-9fb2646215c2 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:06.951054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1d8c6259-ba01-4f5b-b095-9fb2646215c2 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:07.123866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1d8c6259-ba01-4f5b-b095-9fb2646215c2 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:07.137071 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1d8c6259-ba01-4f5b-b095-9fb2646215c2 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1300 microversion: 2.1 time: 0.204213 Jul 20 04:51:07.144779 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3000/6100] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:06 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1300 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:07.346551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-34e81219-5909-45ce-8f1b-7720e1d96549 req-337a703f-7215-4e47-a9f0-6be753fb4b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd560666-40fb-4f9a-b8c3-aab8e12c0b3b", "name": "network-vif-deleted", "tag": "9e70c6c8-f45d-46ba-9492-6ce54a59025d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:07.360147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-34e81219-5909-45ce-8f1b-7720e1d96549 req-337a703f-7215-4e47-a9f0-6be753fb4b31 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:07.360603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-34e81219-5909-45ce-8f1b-7720e1d96549 req-337a703f-7215-4e47-a9f0-6be753fb4b31 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:07.373276 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-34e81219-5909-45ce-8f1b-7720e1d96549 req-337a703f-7215-4e47-a9f0-6be753fb4b31 service nova] Creating event network-vif-deleted:9e70c6c8-f45d-46ba-9492-6ce54a59025d for instance cd560666-40fb-4f9a-b8c3-aab8e12c0b3b on n-h1-764485-11 Jul 20 04:51:07.379155 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-34e81219-5909-45ce-8f1b-7720e1d96549 req-337a703f-7215-4e47-a9f0-6be753fb4b31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044249 Jul 20 04:51:07.380743 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3101/6101] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:07.698173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c4970a1c-b5dc-4250-90ba-3799a58f69c1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:07.699785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c4970a1c-b5dc-4250-90ba-3799a58f69c1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:07.714918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4970a1c-b5dc-4250-90ba-3799a58f69c1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:07.715680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4970a1c-b5dc-4250-90ba-3799a58f69c1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:07.717800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4970a1c-b5dc-4250-90ba-3799a58f69c1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:07.718569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4970a1c-b5dc-4250-90ba-3799a58f69c1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:07.801697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4970a1c-b5dc-4250-90ba-3799a58f69c1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:07.802075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4970a1c-b5dc-4250-90ba-3799a58f69c1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:07.802546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-c4970a1c-b5dc-4250-90ba-3799a58f69c1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lazy-loading 'fault' on Instance uuid cd560666-40fb-4f9a-b8c3-aab8e12c0b3b {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:51:07.887830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c4970a1c-b5dc-4250-90ba-3799a58f69c1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:07.896749 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c4970a1c-b5dc-4250-90ba-3799a58f69c1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 200 len: 1339 microversion: 2.1 time: 0.206050 Jul 20 04:51:07.898143 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3001/6102] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:07 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 1339 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:08.157374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-31f4c61c-efb1-48ba-b6ba-abef451123a4 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:08.158197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-31f4c61c-efb1-48ba-b6ba-abef451123a4 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:08.177541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31f4c61c-efb1-48ba-b6ba-abef451123a4 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:08.191794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31f4c61c-efb1-48ba-b6ba-abef451123a4 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:08.192751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31f4c61c-efb1-48ba-b6ba-abef451123a4 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:08.193287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31f4c61c-efb1-48ba-b6ba-abef451123a4 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:08.289482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-31f4c61c-efb1-48ba-b6ba-abef451123a4 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:08.298370 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-31f4c61c-efb1-48ba-b6ba-abef451123a4 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1300 microversion: 2.1 time: 0.146865 Jul 20 04:51:08.306895 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3102/6103] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:08 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1300 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:08.916519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7c38e6c-d3f9-421f-8dfe-34f5b2d9aad8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:08.918747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c7c38e6c-d3f9-421f-8dfe-34f5b2d9aad8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: cd560666-40fb-4f9a-b8c3-aab8e12c0b3b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:08.927865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7c38e6c-d3f9-421f-8dfe-34f5b2d9aad8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:08.928856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7c38e6c-d3f9-421f-8dfe-34f5b2d9aad8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:08.930070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7c38e6c-d3f9-421f-8dfe-34f5b2d9aad8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:08.930989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7c38e6c-d3f9-421f-8dfe-34f5b2d9aad8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:08.952328 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-c7c38e6c-d3f9-421f-8dfe-34f5b2d9aad8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] HTTP exception thrown: Instance cd560666-40fb-4f9a-b8c3-aab8e12c0b3b could not be found. Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7c38e6c-d3f9-421f-8dfe-34f5b2d9aad8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Request method failure captured: Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b HTTP/1.1 Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14j7g2DG9R8c47poZBwDWSz0WARq5VdRh1LFfATtyfTWE_0P4APzetD_rDciLIFAEU-qtRbmXPLhqNSWO_iBxSSP0iA3R57Z-JB5TtjkjSm66Fg-q-FuqBs4F_mZJDUQUxKgS5kb6jt83AzEV5IcLcLRmDiaRgwvr_vdlJ1Z8UKm4vA Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 141470bf62e0454bab8289b6bab0b01a Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestNetworkBasicOps-1642029803 Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/141470bf62e0454bab8289b6bab0b01a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/141470bf62e0454bab8289b6bab0b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_141470bf62e0454bab8289b6bab0b01a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/141470bf62e0454bab8289b6bab0b01a"}]}] Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestNetworkBasicOps-1642029803 Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 141470bf62e0454bab8289b6bab0b01a Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestNetworkBasicOps-1642029803 Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestNetworkBasicOps-1642029803-project Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 97323cd98ca448c097f6a1cfa4ab691a Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestNetworkBasicOps-1642029803-project Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance cd560666-40fb-4f9a-b8c3-aab8e12c0b3b could not be found. Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'cd560666-40fb-4f9a-b8c3-aab8e12c0b3b'} Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd560666-40fb-4f9a-b8c3-aab8e12c0b3b could not be found. Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd560666-40fb-4f9a-b8c3-aab8e12c0b3b could not be found. Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:08.954840 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:08.958815 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:08.958815 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:08.958815 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:08.958815 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:08.958815 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:08.958815 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd560666-40fb-4f9a-b8c3-aab8e12c0b3b could not be found. Jul 20 04:51:08.958815 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:08.961039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7c38e6c-d3f9-421f-8dfe-34f5b2d9aad8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Returning 404 to user: Instance cd560666-40fb-4f9a-b8c3-aab8e12c0b3b could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:08.962133 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c7c38e6c-d3f9-421f-8dfe-34f5b2d9aad8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b" status: 404 len: 111 microversion: 2.1 time: 0.050045 Jul 20 04:51:08.963099 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3002/6104] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:08 2022] GET /compute/v2.1/servers/cd560666-40fb-4f9a-b8c3-aab8e12c0b3b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:51:09.250914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cba00494-a3fd-4aae-8209-057c6f158764 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '.version_select at 0x7fbfa28a9e50>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:09.315278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-07f729ba-196a-468e-b03d-cbb0bd7d8ac9 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:09.317119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-07f729ba-196a-468e-b03d-cbb0bd7d8ac9 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:09.325729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-07f729ba-196a-468e-b03d-cbb0bd7d8ac9 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:09.326566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-07f729ba-196a-468e-b03d-cbb0bd7d8ac9 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:09.327585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-07f729ba-196a-468e-b03d-cbb0bd7d8ac9 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:09.328196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-07f729ba-196a-468e-b03d-cbb0bd7d8ac9 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:09.331046 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cba00494-a3fd-4aae-8209-057c6f158764 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1301290952" status: 202 len: 0 microversion: 2.1 time: 0.080205 Jul 20 04:51:09.335218 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3103/6105] 10.222.0.20 () {58 vars in 1256 bytes} [Wed Jul 20 04:51:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1301290952 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:51:09.808948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-07f729ba-196a-468e-b03d-cbb0bd7d8ac9 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:09.828759 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-07f729ba-196a-468e-b03d-cbb0bd7d8ac9 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1300 microversion: 2.1 time: 0.517458 Jul 20 04:51:09.841585 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3003/6106] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:09 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1300 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:10.846732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9cff7bf0-d332-4cab-a898-245dbb5b826f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:10.847358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9cff7bf0-d332-4cab-a898-245dbb5b826f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:10.858843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9cff7bf0-d332-4cab-a898-245dbb5b826f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:10.859310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9cff7bf0-d332-4cab-a898-245dbb5b826f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:10.860134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9cff7bf0-d332-4cab-a898-245dbb5b826f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:10.860584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9cff7bf0-d332-4cab-a898-245dbb5b826f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:11.041263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9cff7bf0-d332-4cab-a898-245dbb5b826f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:11.049704 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9cff7bf0-d332-4cab-a898-245dbb5b826f tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1300 microversion: 2.1 time: 0.206544 Jul 20 04:51:11.060150 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3104/6107] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:10 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1300 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:11.899954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8fc3cb5a-9452-494a-afea-53485e60ce98 req-58ff5fbe-bc3b-42c9-b073-148ead80a0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7058f9-3320-413b-b090-bdcc308364f9", "name": "network-vif-plugged", "status": "completed", "tag": "c0a9a2a0-aa98-45d4-af78-7fcf8c4b36e0"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:11.911356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:11.912400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:11.930479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8fc3cb5a-9452-494a-afea-53485e60ce98 req-58ff5fbe-bc3b-42c9-b073-148ead80a0cd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:11.931295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8fc3cb5a-9452-494a-afea-53485e60ce98 req-58ff5fbe-bc3b-42c9-b073-148ead80a0cd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:11.962131 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8fc3cb5a-9452-494a-afea-53485e60ce98 req-58ff5fbe-bc3b-42c9-b073-148ead80a0cd service nova] Creating event network-vif-plugged:c0a9a2a0-aa98-45d4-af78-7fcf8c4b36e0 for instance 1c7058f9-3320-413b-b090-bdcc308364f9 on n-h2-764485-11 Jul 20 04:51:11.974070 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8fc3cb5a-9452-494a-afea-53485e60ce98 req-58ff5fbe-bc3b-42c9-b073-148ead80a0cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077426 Jul 20 04:51:11.976154 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3004/6108] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:12.066626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-17b58a7c-115d-4595-b943-abab26fb5790 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:12.067263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-17b58a7c-115d-4595-b943-abab26fb5790 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:12.077436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17b58a7c-115d-4595-b943-abab26fb5790 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:12.077919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17b58a7c-115d-4595-b943-abab26fb5790 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:12.080977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17b58a7c-115d-4595-b943-abab26fb5790 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:12.081440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17b58a7c-115d-4595-b943-abab26fb5790 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:12.149050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:12.295899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-17b58a7c-115d-4595-b943-abab26fb5790 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:12.308285 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-17b58a7c-115d-4595-b943-abab26fb5790 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1300 microversion: 2.1 time: 0.245202 Jul 20 04:51:12.320470 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3105/6109] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:12 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1300 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:13.329219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6208e57b-9058-460c-955b-9f96cbffbf88 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:13.330624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6208e57b-9058-460c-955b-9f96cbffbf88 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:13.341137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6208e57b-9058-460c-955b-9f96cbffbf88 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:13.342093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6208e57b-9058-460c-955b-9f96cbffbf88 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:13.343053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6208e57b-9058-460c-955b-9f96cbffbf88 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:13.343692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6208e57b-9058-460c-955b-9f96cbffbf88 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:13.481251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6208e57b-9058-460c-955b-9f96cbffbf88 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:13.493668 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6208e57b-9058-460c-955b-9f96cbffbf88 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1300 microversion: 2.1 time: 0.169349 Jul 20 04:51:13.503946 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3005/6110] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:13 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1300 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:14.512604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09e0cfc5-c639-4789-99f7-6614c24a8539 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:14.513224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-09e0cfc5-c639-4789-99f7-6614c24a8539 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:14.541563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09e0cfc5-c639-4789-99f7-6614c24a8539 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:14.542481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09e0cfc5-c639-4789-99f7-6614c24a8539 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:14.543603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09e0cfc5-c639-4789-99f7-6614c24a8539 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:14.544202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09e0cfc5-c639-4789-99f7-6614c24a8539 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:14.710321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-09e0cfc5-c639-4789-99f7-6614c24a8539 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:14.730991 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-09e0cfc5-c639-4789-99f7-6614c24a8539 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1472 microversion: 2.1 time: 0.223202 Jul 20 04:51:14.732041 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3106/6111] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:14 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:14.749191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e011a53a-edc8-4b16-bdf8-681475e47b10 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:14.749708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e011a53a-edc8-4b16-bdf8-681475e47b10 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:14.758164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e011a53a-edc8-4b16-bdf8-681475e47b10 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:14.758622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e011a53a-edc8-4b16-bdf8-681475e47b10 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:14.759412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e011a53a-edc8-4b16-bdf8-681475e47b10 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:14.759896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e011a53a-edc8-4b16-bdf8-681475e47b10 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:14.877721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e011a53a-edc8-4b16-bdf8-681475e47b10 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:14.881350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:14.889241 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e011a53a-edc8-4b16-bdf8-681475e47b10 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1472 microversion: 2.1 time: 0.145035 Jul 20 04:51:14.890380 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3006/6112] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:14 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1472 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:14.907453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-411f9347-3ea5-4b97-9d80-eda9c56f155c tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:14.908397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-411f9347-3ea5-4b97-9d80-eda9c56f155c tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:14.915682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-411f9347-3ea5-4b97-9d80-eda9c56f155c tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:14.916502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-411f9347-3ea5-4b97-9d80-eda9c56f155c tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:14.918136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-411f9347-3ea5-4b97-9d80-eda9c56f155c tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:14.918788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-411f9347-3ea5-4b97-9d80-eda9c56f155c tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:15.027726 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-411f9347-3ea5-4b97-9d80-eda9c56f155c tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1625 microversion: 2.1 time: 0.124473 Jul 20 04:51:15.037528 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3107/6113] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:14 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1625 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:15.045646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9db52d1b-0170-4428-a589-947f1cd70124 tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:15.047094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9db52d1b-0170-4428-a589-947f1cd70124 tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:15.055158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9db52d1b-0170-4428-a589-947f1cd70124 tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:15.055950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9db52d1b-0170-4428-a589-947f1cd70124 tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:15.057314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9db52d1b-0170-4428-a589-947f1cd70124 tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:15.058605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9db52d1b-0170-4428-a589-947f1cd70124 tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:15.253020 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9db52d1b-0170-4428-a589-947f1cd70124 tempest-TestSecurityGroupsBasicOps-1913130456 tempest-TestSecurityGroupsBasicOps-1913130456-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1916 microversion: 2.1 time: 0.211356 Jul 20 04:51:15.253892 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3007/6114] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:15 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1916 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:15.353657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc28eb08-0af3-4494-9c21-59ce48c58edc tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:15.354826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc28eb08-0af3-4494-9c21-59ce48c58edc tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:15.364897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc28eb08-0af3-4494-9c21-59ce48c58edc tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:15.365355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc28eb08-0af3-4494-9c21-59ce48c58edc tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:15.366156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc28eb08-0af3-4494-9c21-59ce48c58edc tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:15.366650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc28eb08-0af3-4494-9c21-59ce48c58edc tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:15.398456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc28eb08-0af3-4494-9c21-59ce48c58edc tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:51:15.528540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cc28eb08-0af3-4494-9c21-59ce48c58edc tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 204 len: 0 microversion: 2.1 time: 0.179271 Jul 20 04:51:15.530370 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3108/6115] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:51:15 2022] DELETE /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:51:15.538871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4973747c-64f8-49d0-9b07-2dc16a646eb1 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:15.539489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4973747c-64f8-49d0-9b07-2dc16a646eb1 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:15.570409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4973747c-64f8-49d0-9b07-2dc16a646eb1 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:15.571491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4973747c-64f8-49d0-9b07-2dc16a646eb1 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:15.573118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4973747c-64f8-49d0-9b07-2dc16a646eb1 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:15.573727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4973747c-64f8-49d0-9b07-2dc16a646eb1 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:15.687473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4973747c-64f8-49d0-9b07-2dc16a646eb1 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:15.697390 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4973747c-64f8-49d0-9b07-2dc16a646eb1 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1478 microversion: 2.1 time: 0.162726 Jul 20 04:51:15.699597 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3008/6116] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:15 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1478 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:16.716064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1716430c-b8ec-49b4-82bf-477a0b596b2d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:16.717557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1716430c-b8ec-49b4-82bf-477a0b596b2d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:16.735414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1716430c-b8ec-49b4-82bf-477a0b596b2d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:16.736056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1716430c-b8ec-49b4-82bf-477a0b596b2d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:16.737930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1716430c-b8ec-49b4-82bf-477a0b596b2d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:16.738560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1716430c-b8ec-49b4-82bf-477a0b596b2d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:16.886957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1716430c-b8ec-49b4-82bf-477a0b596b2d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:16.897042 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1716430c-b8ec-49b4-82bf-477a0b596b2d tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1478 microversion: 2.1 time: 0.186398 Jul 20 04:51:16.910091 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3109/6117] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:16 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1478 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:17.812660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-29d0eb0d-f687-4b22-90df-efccd2724291 req-f7fe9755-d450-46ed-9e15-aba14d7515bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7058f9-3320-413b-b090-bdcc308364f9", "name": "network-vif-deleted", "tag": "c0a9a2a0-aa98-45d4-af78-7fcf8c4b36e0"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:17.835082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-29d0eb0d-f687-4b22-90df-efccd2724291 req-f7fe9755-d450-46ed-9e15-aba14d7515bc service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:17.838677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-29d0eb0d-f687-4b22-90df-efccd2724291 req-f7fe9755-d450-46ed-9e15-aba14d7515bc service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:17.863713 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-29d0eb0d-f687-4b22-90df-efccd2724291 req-f7fe9755-d450-46ed-9e15-aba14d7515bc service nova] Creating event network-vif-deleted:c0a9a2a0-aa98-45d4-af78-7fcf8c4b36e0 for instance 1c7058f9-3320-413b-b090-bdcc308364f9 on n-h2-764485-11 Jul 20 04:51:17.880526 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-29d0eb0d-f687-4b22-90df-efccd2724291 req-f7fe9755-d450-46ed-9e15-aba14d7515bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073908 Jul 20 04:51:17.882061 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3009/6118] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:17.924715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2daafc27-fcd9-4829-b81f-644192061f72 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:17.926061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2daafc27-fcd9-4829-b81f-644192061f72 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:17.946455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2daafc27-fcd9-4829-b81f-644192061f72 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:17.947357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2daafc27-fcd9-4829-b81f-644192061f72 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:17.948861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2daafc27-fcd9-4829-b81f-644192061f72 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:17.949521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2daafc27-fcd9-4829-b81f-644192061f72 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:18.040748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2daafc27-fcd9-4829-b81f-644192061f72 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:18.043739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2daafc27-fcd9-4829-b81f-644192061f72 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:18.046958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-2daafc27-fcd9-4829-b81f-644192061f72 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lazy-loading 'fault' on Instance uuid 1c7058f9-3320-413b-b090-bdcc308364f9 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:51:18.156039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2daafc27-fcd9-4829-b81f-644192061f72 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:18.166180 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2daafc27-fcd9-4829-b81f-644192061f72 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 200 len: 1332 microversion: 2.1 time: 0.250171 Jul 20 04:51:18.167724 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3110/6119] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:17 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 1332 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:19.188973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-041c6c9f-1d31-4f10-8920-510d28154470 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:19.190319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-041c6c9f-1d31-4f10-8920-510d28154470 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 1c7058f9-3320-413b-b090-bdcc308364f9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:19.203297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-041c6c9f-1d31-4f10-8920-510d28154470 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:19.203816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-041c6c9f-1d31-4f10-8920-510d28154470 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:19.204603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-041c6c9f-1d31-4f10-8920-510d28154470 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:19.205043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-041c6c9f-1d31-4f10-8920-510d28154470 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:19.228591 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-041c6c9f-1d31-4f10-8920-510d28154470 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] HTTP exception thrown: Instance 1c7058f9-3320-413b-b090-bdcc308364f9 could not be found. Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-041c6c9f-1d31-4f10-8920-510d28154470 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Request method failure captured: Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 HTTP/1.1 Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14k-M-eZKdBqgn7vOFHqnNDWqnCyJngoT-fSJrobdAbGHgIslynPzmRAJjOWxmU5_uRYdECaPal3IBrMqbJWWKTryJIYstlatzLnRpwPZG0z3sbVPc2Dq5s8BEAv9j_oeRvm--KFKeRwp40OiQ-xMoOPJUNLxystyKmri6q11W9-6Tc Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 82bef8770b5e43e2b9f360f6a186227f Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1496551843 Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82bef8770b5e43e2b9f360f6a186227f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82bef8770b5e43e2b9f360f6a186227f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82bef8770b5e43e2b9f360f6a186227f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82bef8770b5e43e2b9f360f6a186227f"}]}] Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1496551843 Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 82bef8770b5e43e2b9f360f6a186227f Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1496551843 Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestSecurityGroupsBasicOps-1496551843-project Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: f2d7aa07fd4545d68d9e54fa4fdba267 Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1496551843-project Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 1c7058f9-3320-413b-b090-bdcc308364f9 could not be found. Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '1c7058f9-3320-413b-b090-bdcc308364f9'} Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7058f9-3320-413b-b090-bdcc308364f9 could not be found. Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7058f9-3320-413b-b090-bdcc308364f9 could not be found. Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:19.231226 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:19.236211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:19.236211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:19.236211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:19.236211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:19.236211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:19.236211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7058f9-3320-413b-b090-bdcc308364f9 could not be found. Jul 20 04:51:19.236211 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:19.238771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-041c6c9f-1d31-4f10-8920-510d28154470 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Returning 404 to user: Instance 1c7058f9-3320-413b-b090-bdcc308364f9 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:19.256328 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-041c6c9f-1d31-4f10-8920-510d28154470 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9" status: 404 len: 111 microversion: 2.1 time: 0.074780 Jul 20 04:51:19.257477 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3010/6120] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:19 2022] GET /compute/v2.1/servers/1c7058f9-3320-413b-b090-bdcc308364f9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:51:22.047427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6fe6870b-9e5a-4e70-b2a6-6780f947bb4c tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Action: 'create', calling method: .version_select at 0x7fbf9c0a8160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1585045978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPGciIjQSMw7hvfTE/adM2HNrpW/j6y//zeGTHAUkijR9+y1pzOksNnadIlG9IerDUyOw89EwVs4yVAvTosnP1cvq8pMnt8ZSptMV50DxJob8ynE4SRJcBKfYy9Fkjzvg=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:22.056697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:22.070368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-6fe6870b-9e5a-4e70-b2a6-6780f947bb4c tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Getting quotas for project 141470bf62e0454bab8289b6bab0b01a. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:22.078359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-6fe6870b-9e5a-4e70-b2a6-6780f947bb4c tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Getting quotas for user 97323cd98ca448c097f6a1cfa4ab691a and project 141470bf62e0454bab8289b6bab0b01a. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:22.128346 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6fe6870b-9e5a-4e70-b2a6-6780f947bb4c tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.083658 Jul 20 04:51:22.131473 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3111/6121] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:51:22 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:25.142190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-148223780", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "0a44d868-2933-45d3-8cbf-15759d05091b"}], "key_name": "tempest-TestNetworkBasicOps-1585045978", "security_groups": [{"name": "tempest-secgroup-smoke-1316424875"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:25.413212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] validate_networks() for [('0a44d868-2933-45d3-8cbf-15759d05091b', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:51:25.825235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:26.365729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:51:26.366525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:51:26.367306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:51:26.367863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:51:26.368557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:51:26.382751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:26.383640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:26.384710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:26.385421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:26.408606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Getting quotas for project 141470bf62e0454bab8289b6bab0b01a. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:26.416438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Getting quotas for user 97323cd98ca448c097f6a1cfa4ab691a and project 141470bf62e0454bab8289b6bab0b01a. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:26.444732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:51:26.448188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:51:26.524328 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-92f4f221-203d-4764-bfdd-53897d39ce31 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.387139 Jul 20 04:51:26.530139 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3011/6122] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:51:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:51:26.543356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c7f06e34-eaa7-467b-90b2-6c98bb8282a4 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:26.545785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c7f06e34-eaa7-467b-90b2-6c98bb8282a4 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:26.728679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c7f06e34-eaa7-467b-90b2-6c98bb8282a4 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:26.741876 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c7f06e34-eaa7-467b-90b2-6c98bb8282a4 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1248 microversion: 2.1 time: 0.210467 Jul 20 04:51:26.753726 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3112/6123] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:26 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1248 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:27.770657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a5039f9f-f489-4c76-bc88-5a760d1649d4 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:27.771861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a5039f9f-f489-4c76-bc88-5a760d1649d4 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:27.780731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5039f9f-f489-4c76-bc88-5a760d1649d4 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:27.781441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5039f9f-f489-4c76-bc88-5a760d1649d4 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:27.782404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5039f9f-f489-4c76-bc88-5a760d1649d4 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:27.783011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5039f9f-f489-4c76-bc88-5a760d1649d4 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:27.982718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a5039f9f-f489-4c76-bc88-5a760d1649d4 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:27.999729 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a5039f9f-f489-4c76-bc88-5a760d1649d4 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1300 microversion: 2.1 time: 0.239824 Jul 20 04:51:28.001780 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3012/6124] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:27 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1300 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:28.468791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-98a28af2-4584-4637-9072-4b0537332ab6 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:28.470130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-98a28af2-4584-4637-9072-4b0537332ab6 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:28.478730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:28.488295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d65e8b94-6934-45f0-ae9d-53968e2bbdcb req-518f6d0d-8ced-4a0d-8fdf-44035044565f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ca5c80-1961-48c5-b47a-0e1786b819b5", "tag": "84204b04-8b93-408b-9a88-64de57206a1c"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:28.489067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98a28af2-4584-4637-9072-4b0537332ab6 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:28.489739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98a28af2-4584-4637-9072-4b0537332ab6 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:28.500633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98a28af2-4584-4637-9072-4b0537332ab6 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:28.501551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98a28af2-4584-4637-9072-4b0537332ab6 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:28.505915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d65e8b94-6934-45f0-ae9d-53968e2bbdcb req-518f6d0d-8ced-4a0d-8fdf-44035044565f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:28.513439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d65e8b94-6934-45f0-ae9d-53968e2bbdcb req-518f6d0d-8ced-4a0d-8fdf-44035044565f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:28.555636 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d65e8b94-6934-45f0-ae9d-53968e2bbdcb req-518f6d0d-8ced-4a0d-8fdf-44035044565f service nova] Creating event network-changed:84204b04-8b93-408b-9a88-64de57206a1c for instance 87ca5c80-1961-48c5-b47a-0e1786b819b5 on n-h1-764485-11 Jul 20 04:51:28.556768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-98a28af2-4584-4637-9072-4b0537332ab6 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:51:28.570174 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d65e8b94-6934-45f0-ae9d-53968e2bbdcb req-518f6d0d-8ced-4a0d-8fdf-44035044565f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086646 Jul 20 04:51:28.573519 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3013/6125] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:51:28.730998 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-98a28af2-4584-4637-9072-4b0537332ab6 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 204 len: 0 microversion: 2.1 time: 0.265944 Jul 20 04:51:28.732324 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3113/6126] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:51:28 2022] DELETE /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:51:28.741603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3d03ac36-978b-49b8-8984-878606b90b01 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:28.744232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3d03ac36-978b-49b8-8984-878606b90b01 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:28.751998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d03ac36-978b-49b8-8984-878606b90b01 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:28.752604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d03ac36-978b-49b8-8984-878606b90b01 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:28.753400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d03ac36-978b-49b8-8984-878606b90b01 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:28.753840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d03ac36-978b-49b8-8984-878606b90b01 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:29.018604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-953dc53d-e7c0-467e-a2ca-37cb5a7a98bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:29.019718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-953dc53d-e7c0-467e-a2ca-37cb5a7a98bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:29.027484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-953dc53d-e7c0-467e-a2ca-37cb5a7a98bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:29.027994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-953dc53d-e7c0-467e-a2ca-37cb5a7a98bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:29.028790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-953dc53d-e7c0-467e-a2ca-37cb5a7a98bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:29.029236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-953dc53d-e7c0-467e-a2ca-37cb5a7a98bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:29.268515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-953dc53d-e7c0-467e-a2ca-37cb5a7a98bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:29.280489 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-953dc53d-e7c0-467e-a2ca-37cb5a7a98bc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1306 microversion: 2.1 time: 0.266399 Jul 20 04:51:29.298665 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3114/6127] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:29 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1306 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:29.347836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3d03ac36-978b-49b8-8984-878606b90b01 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:29.368380 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3d03ac36-978b-49b8-8984-878606b90b01 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1769 microversion: 2.1 time: 0.627357 Jul 20 04:51:29.370189 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3014/6128] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:28 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1769 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:30.306169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16af2b40-3b22-4c78-b50e-8efb2d15d8f8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:30.308608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-16af2b40-3b22-4c78-b50e-8efb2d15d8f8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:30.322626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16af2b40-3b22-4c78-b50e-8efb2d15d8f8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:30.323383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16af2b40-3b22-4c78-b50e-8efb2d15d8f8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:30.324590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16af2b40-3b22-4c78-b50e-8efb2d15d8f8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:30.331115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16af2b40-3b22-4c78-b50e-8efb2d15d8f8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:30.386666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5db63ecf-3748-4b34-9002-6af693e7f256 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:30.387271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5db63ecf-3748-4b34-9002-6af693e7f256 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:30.395047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5db63ecf-3748-4b34-9002-6af693e7f256 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:30.395496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5db63ecf-3748-4b34-9002-6af693e7f256 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:30.396341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5db63ecf-3748-4b34-9002-6af693e7f256 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:30.396798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5db63ecf-3748-4b34-9002-6af693e7f256 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:31.343079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-16af2b40-3b22-4c78-b50e-8efb2d15d8f8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:31.359495 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-16af2b40-3b22-4c78-b50e-8efb2d15d8f8 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1374 microversion: 2.1 time: 1.053586 Jul 20 04:51:31.360201 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3115/6129] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:30 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1374 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:31.373216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-7b266c6f-d1bb-48c3-a397-8ec87b7f4b97 req-3179ff19-2206-4a5d-b6cd-7e8753a9f1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ca5c80-1961-48c5-b47a-0e1786b819b5", "name": "network-vif-deleted", "tag": "84204b04-8b93-408b-9a88-64de57206a1c"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:31.394350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7b266c6f-d1bb-48c3-a397-8ec87b7f4b97 req-3179ff19-2206-4a5d-b6cd-7e8753a9f1a3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:31.397309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7b266c6f-d1bb-48c3-a397-8ec87b7f4b97 req-3179ff19-2206-4a5d-b6cd-7e8753a9f1a3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:31.427644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5db63ecf-3748-4b34-9002-6af693e7f256 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d7aa07fd4545d68d9e54fa4fdba267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bef8770b5e43e2b9f360f6a186227f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:31.436932 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7b266c6f-d1bb-48c3-a397-8ec87b7f4b97 req-3179ff19-2206-4a5d-b6cd-7e8753a9f1a3 service nova] Creating event network-vif-deleted:84204b04-8b93-408b-9a88-64de57206a1c for instance 87ca5c80-1961-48c5-b47a-0e1786b819b5 on n-h1-764485-11 Jul 20 04:51:31.438670 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5db63ecf-3748-4b34-9002-6af693e7f256 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 200 len: 1769 microversion: 2.1 time: 1.054733 Jul 20 04:51:31.439345 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3015/6130] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:30 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 1769 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:31.450751 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-7b266c6f-d1bb-48c3-a397-8ec87b7f4b97 req-3179ff19-2206-4a5d-b6cd-7e8753a9f1a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080120 Jul 20 04:51:31.459720 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3116/6131] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:31.814482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c08da714-13c7-4ae9-8c3f-3d081cad536e req-bf1fb914-cd5e-47cf-b835-7db2448b6a86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b257756-b673-473f-a46d-3ab24114ffcd", "tag": "aa1ff013-dca9-4b86-885d-887a969cd7c7"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:31.838137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c08da714-13c7-4ae9-8c3f-3d081cad536e req-bf1fb914-cd5e-47cf-b835-7db2448b6a86 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:31.839726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c08da714-13c7-4ae9-8c3f-3d081cad536e req-bf1fb914-cd5e-47cf-b835-7db2448b6a86 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:31.859411 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c08da714-13c7-4ae9-8c3f-3d081cad536e req-bf1fb914-cd5e-47cf-b835-7db2448b6a86 service nova] Creating event network-changed:aa1ff013-dca9-4b86-885d-887a969cd7c7 for instance 6b257756-b673-473f-a46d-3ab24114ffcd on n-h1-764485-11 Jul 20 04:51:31.870628 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c08da714-13c7-4ae9-8c3f-3d081cad536e req-bf1fb914-cd5e-47cf-b835-7db2448b6a86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059594 Jul 20 04:51:31.871649 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3016/6132] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:32.378318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-80982342-f1ed-4153-9aa9-54748b32f48c tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:32.379801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-80982342-f1ed-4153-9aa9-54748b32f48c tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:32.387680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80982342-f1ed-4153-9aa9-54748b32f48c tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:32.388211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80982342-f1ed-4153-9aa9-54748b32f48c tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:32.388989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80982342-f1ed-4153-9aa9-54748b32f48c tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:32.389430 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80982342-f1ed-4153-9aa9-54748b32f48c tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:32.459323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b89ba10a-5842-405c-b0fc-ed1a1899b3b0 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:32.460132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b89ba10a-5842-405c-b0fc-ed1a1899b3b0 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] [instance: 87ca5c80-1961-48c5-b47a-0e1786b819b5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:32.472076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b89ba10a-5842-405c-b0fc-ed1a1899b3b0 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:32.472972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b89ba10a-5842-405c-b0fc-ed1a1899b3b0 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:32.474109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b89ba10a-5842-405c-b0fc-ed1a1899b3b0 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:32.474684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b89ba10a-5842-405c-b0fc-ed1a1899b3b0 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:32.501781 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b89ba10a-5842-405c-b0fc-ed1a1899b3b0 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] HTTP exception thrown: Instance 87ca5c80-1961-48c5-b47a-0e1786b819b5 could not be found. Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b89ba10a-5842-405c-b0fc-ed1a1899b3b0 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Request method failure captured: Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 HTTP/1.1 Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14k-M-eZKdBqgn7vOFHqnNDWqnCyJngoT-fSJrobdAbGHgIslynPzmRAJjOWxmU5_uRYdECaPal3IBrMqbJWWKTryJIYstlatzLnRpwPZG0z3sbVPc2Dq5s8BEAv9j_oeRvm--KFKeRwp40OiQ-xMoOPJUNLxystyKmri6q11W9-6Tc Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 82bef8770b5e43e2b9f360f6a186227f Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1496551843 Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82bef8770b5e43e2b9f360f6a186227f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82bef8770b5e43e2b9f360f6a186227f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82bef8770b5e43e2b9f360f6a186227f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82bef8770b5e43e2b9f360f6a186227f"}]}] Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1496551843 Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 82bef8770b5e43e2b9f360f6a186227f Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1496551843 Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestSecurityGroupsBasicOps-1496551843-project Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: f2d7aa07fd4545d68d9e54fa4fdba267 Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1496551843-project Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 87ca5c80-1961-48c5-b47a-0e1786b819b5 could not be found. Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '87ca5c80-1961-48c5-b47a-0e1786b819b5'} Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ca5c80-1961-48c5-b47a-0e1786b819b5 could not be found. Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ca5c80-1961-48c5-b47a-0e1786b819b5 could not be found. Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:32.504311 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:32.508346 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:32.508346 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:32.508346 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:32.508346 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:32.508346 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:32.508346 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ca5c80-1961-48c5-b47a-0e1786b819b5 could not be found. Jul 20 04:51:32.508346 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:32.508346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b89ba10a-5842-405c-b0fc-ed1a1899b3b0 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Returning 404 to user: Instance 87ca5c80-1961-48c5-b47a-0e1786b819b5 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:32.508346 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b89ba10a-5842-405c-b0fc-ed1a1899b3b0 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5" status: 404 len: 111 microversion: 2.1 time: 0.052948 Jul 20 04:51:32.508346 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3017/6133] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:32 2022] GET /compute/v2.1/servers/87ca5c80-1961-48c5-b47a-0e1786b819b5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:51:32.550399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-80982342-f1ed-4153-9aa9-54748b32f48c tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:32.559552 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-80982342-f1ed-4153-9aa9-54748b32f48c tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1374 microversion: 2.1 time: 0.186082 Jul 20 04:51:32.560164 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3117/6134] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:32 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:33.577131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-766c6599-6851-4b2e-bf3c-39221c258ff1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:33.577950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-766c6599-6851-4b2e-bf3c-39221c258ff1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:33.588996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-766c6599-6851-4b2e-bf3c-39221c258ff1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:33.589467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-766c6599-6851-4b2e-bf3c-39221c258ff1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:33.590500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-766c6599-6851-4b2e-bf3c-39221c258ff1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:33.590974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-766c6599-6851-4b2e-bf3c-39221c258ff1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:33.810579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-766c6599-6851-4b2e-bf3c-39221c258ff1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:33.819660 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-766c6599-6851-4b2e-bf3c-39221c258ff1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1374 microversion: 2.1 time: 0.246995 Jul 20 04:51:33.820661 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3018/6135] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:33 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1374 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:34.838837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e89c49f8-e359-4354-b549-eb299bbcd437 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:34.839606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e89c49f8-e359-4354-b549-eb299bbcd437 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:34.847281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e89c49f8-e359-4354-b549-eb299bbcd437 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:34.847845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e89c49f8-e359-4354-b549-eb299bbcd437 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:34.848768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e89c49f8-e359-4354-b549-eb299bbcd437 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:34.849348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e89c49f8-e359-4354-b549-eb299bbcd437 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:35.342368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e89c49f8-e359-4354-b549-eb299bbcd437 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:35.356783 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e89c49f8-e359-4354-b549-eb299bbcd437 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1374 microversion: 2.1 time: 0.522745 Jul 20 04:51:35.357690 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3118/6136] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:34 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1374 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:36.374425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7d04e9f8-1c38-4c4f-b73a-e51cf22baa69 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:36.375707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7d04e9f8-1c38-4c4f-b73a-e51cf22baa69 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:36.383650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d04e9f8-1c38-4c4f-b73a-e51cf22baa69 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:36.384427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d04e9f8-1c38-4c4f-b73a-e51cf22baa69 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:36.386858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d04e9f8-1c38-4c4f-b73a-e51cf22baa69 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:36.387567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d04e9f8-1c38-4c4f-b73a-e51cf22baa69 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:36.404726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:36.429392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:36.534011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7d04e9f8-1c38-4c4f-b73a-e51cf22baa69 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:36.542593 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7d04e9f8-1c38-4c4f-b73a-e51cf22baa69 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1374 microversion: 2.1 time: 0.172407 Jul 20 04:51:36.544580 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3019/6137] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:36 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:36.622885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e34ae6f6-b378-4cfc-b951-2f0c0112ca84 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] Calling method '.version_select at 0x7fbfa28df3a0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:36.644013 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e34ae6f6-b378-4cfc-b951-2f0c0112ca84 tempest-TestSecurityGroupsBasicOps-1496551843 tempest-TestSecurityGroupsBasicOps-1496551843-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2100312551" status: 202 len: 0 microversion: 2.1 time: 0.025649 Jul 20 04:51:36.644835 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3119/6138] 10.222.0.20 () {58 vars in 1277 bytes} [Wed Jul 20 04:51:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2100312551 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:51:37.562520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd5e86cf-6157-4456-a14c-1f9ecdbc782e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:37.564032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cd5e86cf-6157-4456-a14c-1f9ecdbc782e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:37.591606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd5e86cf-6157-4456-a14c-1f9ecdbc782e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:37.592669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd5e86cf-6157-4456-a14c-1f9ecdbc782e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:37.593505 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd5e86cf-6157-4456-a14c-1f9ecdbc782e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:37.593954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd5e86cf-6157-4456-a14c-1f9ecdbc782e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:37.785044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cd5e86cf-6157-4456-a14c-1f9ecdbc782e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:37.794718 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd5e86cf-6157-4456-a14c-1f9ecdbc782e tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1374 microversion: 2.1 time: 0.237957 Jul 20 04:51:37.796010 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3020/6139] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:37 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1374 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:38.809936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:38.815768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bd41c6d9-e24d-422c-93ea-eee7457c12da tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:38.816609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bd41c6d9-e24d-422c-93ea-eee7457c12da tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:38.825356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd41c6d9-e24d-422c-93ea-eee7457c12da tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:38.825820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd41c6d9-e24d-422c-93ea-eee7457c12da tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:38.826601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd41c6d9-e24d-422c-93ea-eee7457c12da tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:38.827053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd41c6d9-e24d-422c-93ea-eee7457c12da tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:39.020516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bd41c6d9-e24d-422c-93ea-eee7457c12da tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:39.030455 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bd41c6d9-e24d-422c-93ea-eee7457c12da tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1374 microversion: 2.1 time: 0.220998 Jul 20 04:51:39.032481 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3120/6140] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:38 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1374 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:39.633887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-4fbf3839-4935-4662-a57c-9c74f70f4a92 req-ae244094-7718-4b86-9171-926dc062d5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b257756-b673-473f-a46d-3ab24114ffcd", "name": "network-vif-plugged", "status": "completed", "tag": "aa1ff013-dca9-4b86-885d-887a969cd7c7"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:39.647717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4fbf3839-4935-4662-a57c-9c74f70f4a92 req-ae244094-7718-4b86-9171-926dc062d5af service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:39.648084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4fbf3839-4935-4662-a57c-9c74f70f4a92 req-ae244094-7718-4b86-9171-926dc062d5af service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:39.660578 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-4fbf3839-4935-4662-a57c-9c74f70f4a92 req-ae244094-7718-4b86-9171-926dc062d5af service nova] Creating event network-vif-plugged:aa1ff013-dca9-4b86-885d-887a969cd7c7 for instance 6b257756-b673-473f-a46d-3ab24114ffcd on n-h1-764485-11 Jul 20 04:51:39.665509 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-4fbf3839-4935-4662-a57c-9c74f70f4a92 req-ae244094-7718-4b86-9171-926dc062d5af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036026 Jul 20 04:51:39.667484 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3021/6141] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:40.048651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-424084d0-39df-432e-9fb1-f42a1debfa2a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:40.049577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-424084d0-39df-432e-9fb1-f42a1debfa2a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:40.056745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-424084d0-39df-432e-9fb1-f42a1debfa2a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:40.057457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-424084d0-39df-432e-9fb1-f42a1debfa2a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:40.058341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-424084d0-39df-432e-9fb1-f42a1debfa2a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:40.058890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-424084d0-39df-432e-9fb1-f42a1debfa2a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:40.199832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-424084d0-39df-432e-9fb1-f42a1debfa2a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:40.208334 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-424084d0-39df-432e-9fb1-f42a1debfa2a tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1374 microversion: 2.1 time: 0.163605 Jul 20 04:51:40.209023 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3121/6142] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:40 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:41.227396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a920418-a819-4e61-a509-26e2e87df848 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:41.230167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a920418-a819-4e61-a509-26e2e87df848 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:41.238346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a920418-a819-4e61-a509-26e2e87df848 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:41.239465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a920418-a819-4e61-a509-26e2e87df848 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:41.240510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a920418-a819-4e61-a509-26e2e87df848 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:41.241026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a920418-a819-4e61-a509-26e2e87df848 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:41.436145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a920418-a819-4e61-a509-26e2e87df848 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:41.444864 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a920418-a819-4e61-a509-26e2e87df848 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1374 microversion: 2.1 time: 0.221641 Jul 20 04:51:41.446052 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3022/6143] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:41 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1374 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:42.463419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2b7b46c6-dd9d-4666-b8a1-ee3e1fc917cc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:42.464241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2b7b46c6-dd9d-4666-b8a1-ee3e1fc917cc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:42.471492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b7b46c6-dd9d-4666-b8a1-ee3e1fc917cc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:42.471988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b7b46c6-dd9d-4666-b8a1-ee3e1fc917cc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:42.472796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b7b46c6-dd9d-4666-b8a1-ee3e1fc917cc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:42.473244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b7b46c6-dd9d-4666-b8a1-ee3e1fc917cc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:42.620374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2b7b46c6-dd9d-4666-b8a1-ee3e1fc917cc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:42.628521 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2b7b46c6-dd9d-4666-b8a1-ee3e1fc917cc tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1547 microversion: 2.1 time: 0.169007 Jul 20 04:51:42.629319 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3122/6144] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:42 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:42.645607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f607a757-cbda-4b93-a7ab-19c5db207bd3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:42.646359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f607a757-cbda-4b93-a7ab-19c5db207bd3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:42.654484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f607a757-cbda-4b93-a7ab-19c5db207bd3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:42.654933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f607a757-cbda-4b93-a7ab-19c5db207bd3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:42.655738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f607a757-cbda-4b93-a7ab-19c5db207bd3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:42.656182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f607a757-cbda-4b93-a7ab-19c5db207bd3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:42.803122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f607a757-cbda-4b93-a7ab-19c5db207bd3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:42.812428 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f607a757-cbda-4b93-a7ab-19c5db207bd3 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1547 microversion: 2.1 time: 0.170442 Jul 20 04:51:42.813084 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3023/6145] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:42 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:45.515164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-44ba616a-dfd6-47c5-95ea-67fc90b5db45 req-af42f468-192e-4b2c-abf1-03b0c973dbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b257756-b673-473f-a46d-3ab24114ffcd", "tag": "aa1ff013-dca9-4b86-885d-887a969cd7c7"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:45.536488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-44ba616a-dfd6-47c5-95ea-67fc90b5db45 req-af42f468-192e-4b2c-abf1-03b0c973dbe6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:45.537663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-44ba616a-dfd6-47c5-95ea-67fc90b5db45 req-af42f468-192e-4b2c-abf1-03b0c973dbe6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:45.552819 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-44ba616a-dfd6-47c5-95ea-67fc90b5db45 req-af42f468-192e-4b2c-abf1-03b0c973dbe6 service nova] Creating event network-changed:aa1ff013-dca9-4b86-885d-887a969cd7c7 for instance 6b257756-b673-473f-a46d-3ab24114ffcd on n-h1-764485-11 Jul 20 04:51:45.559447 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-44ba616a-dfd6-47c5-95ea-67fc90b5db45 req-af42f468-192e-4b2c-abf1-03b0c973dbe6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.340229 Jul 20 04:51:45.563989 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3123/6146] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:50.623681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f8c20a9d-2d89-4760-8aa7-9635d037d2e2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:50.624746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f8c20a9d-2d89-4760-8aa7-9635d037d2e2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:50.631394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8c20a9d-2d89-4760-8aa7-9635d037d2e2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:50.632098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8c20a9d-2d89-4760-8aa7-9635d037d2e2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:50.633033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8c20a9d-2d89-4760-8aa7-9635d037d2e2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:50.633752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f8c20a9d-2d89-4760-8aa7-9635d037d2e2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:50.651932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=75 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:50.664271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f8c20a9d-2d89-4760-8aa7-9635d037d2e2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:51:50.770874 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f8c20a9d-2d89-4760-8aa7-9635d037d2e2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "DELETE /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 204 len: 0 microversion: 2.1 time: 0.299333 Jul 20 04:51:50.782438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f98dc778-b1a4-4a49-9367-2761bcea03a2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:50.783696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f98dc778-b1a4-4a49-9367-2761bcea03a2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:50.793572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f98dc778-b1a4-4a49-9367-2761bcea03a2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:50.794094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f98dc778-b1a4-4a49-9367-2761bcea03a2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:50.794991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f98dc778-b1a4-4a49-9367-2761bcea03a2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:50.795442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f98dc778-b1a4-4a49-9367-2761bcea03a2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:50.799595 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3024/6147] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:51:50 2022] DELETE /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:51:50.976147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f98dc778-b1a4-4a49-9367-2761bcea03a2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:50.986445 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f98dc778-b1a4-4a49-9367-2761bcea03a2 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1733 microversion: 2.1 time: 0.209257 Jul 20 04:51:50.988032 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3124/6148] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:50 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1733 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:52.009400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-79094765-49fe-4543-b205-779f17c01fc3 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:52.011063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-79094765-49fe-4543-b205-779f17c01fc3 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:52.019161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79094765-49fe-4543-b205-779f17c01fc3 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:52.020011 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79094765-49fe-4543-b205-779f17c01fc3 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:52.021029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79094765-49fe-4543-b205-779f17c01fc3 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:52.021700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-79094765-49fe-4543-b205-779f17c01fc3 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:52.176105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-79094765-49fe-4543-b205-779f17c01fc3 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:52.186121 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-79094765-49fe-4543-b205-779f17c01fc3 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1733 microversion: 2.1 time: 0.180844 Jul 20 04:51:52.188114 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3025/6149] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:52 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:52.842312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-68453428-174e-431d-9e22-794d8418842e req-e70e31d5-d3a3-49f7-9af6-d9da55d0e764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a35e7a-e82c-4759-9737-7d99fa1310a0", "name": "network-vif-deleted", "tag": "07156b72-7558-4377-aa1e-1c96adad14e1"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:52.896682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:52.916354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-68453428-174e-431d-9e22-794d8418842e req-e70e31d5-d3a3-49f7-9af6-d9da55d0e764 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:52.916968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-68453428-174e-431d-9e22-794d8418842e req-e70e31d5-d3a3-49f7-9af6-d9da55d0e764 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:52.974957 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-68453428-174e-431d-9e22-794d8418842e req-e70e31d5-d3a3-49f7-9af6-d9da55d0e764 service nova] Creating event network-vif-deleted:07156b72-7558-4377-aa1e-1c96adad14e1 for instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 on n-h2-764485-11 Jul 20 04:51:52.981799 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-68453428-174e-431d-9e22-794d8418842e req-e70e31d5-d3a3-49f7-9af6-d9da55d0e764 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144091 Jul 20 04:51:52.985481 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3125/6150] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:53.204648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-534c30ac-73d3-4890-aced-5bab22aad70c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:53.205535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-534c30ac-73d3-4890-aced-5bab22aad70c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:53.215844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-534c30ac-73d3-4890-aced-5bab22aad70c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.216296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-534c30ac-73d3-4890-aced-5bab22aad70c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:53.217083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-534c30ac-73d3-4890-aced-5bab22aad70c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.217699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-534c30ac-73d3-4890-aced-5bab22aad70c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:53.270029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-534c30ac-73d3-4890-aced-5bab22aad70c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.270727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-534c30ac-73d3-4890-aced-5bab22aad70c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:53.271331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-534c30ac-73d3-4890-aced-5bab22aad70c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lazy-loading 'fault' on Instance uuid 43a35e7a-e82c-4759-9737-7d99fa1310a0 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:51:53.370581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-534c30ac-73d3-4890-aced-5bab22aad70c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e9fc1c48194d28a58ab64c7b9eec9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb4b22a5a24cbd801b18ce4381012d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:53.379334 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-534c30ac-73d3-4890-aced-5bab22aad70c tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 200 len: 1389 microversion: 2.1 time: 0.178562 Jul 20 04:51:53.379966 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3026/6151] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:53 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 1389 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:54.427609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1021de31-13d7-4810-b8f3-0d5dd09fbccf tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:54.427609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1021de31-13d7-4810-b8f3-0d5dd09fbccf tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:54.439256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1021de31-13d7-4810-b8f3-0d5dd09fbccf tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:54.439761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1021de31-13d7-4810-b8f3-0d5dd09fbccf tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:54.443816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1021de31-13d7-4810-b8f3-0d5dd09fbccf tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:54.444278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1021de31-13d7-4810-b8f3-0d5dd09fbccf tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:54.459959 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-1021de31-13d7-4810-b8f3-0d5dd09fbccf tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] HTTP exception thrown: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1021de31-13d7-4810-b8f3-0d5dd09fbccf tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Request method failure captured: Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 HTTP/1.1 Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14iIykS50PSIUD1bMAEwDJkNay1pqQYKWEG8PyA6JMWETipyf4yGeKPjqDBhfQWHnB0ZQtv1rtTwXm8LF6dE5me6gHk6HDXpHP7Ufb3SjYDaytzQoCY9ec5KI-F0YfUX0NIkGJfsnxSm4dKPcfioARX7WG5Rnx3z0W4ZmqlGivRzWxk Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: d4bb4b22a5a24cbd801b18ce4381012d Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestServerBasicOps-1276663150 Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4bb4b22a5a24cbd801b18ce4381012d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4bb4b22a5a24cbd801b18ce4381012d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4bb4b22a5a24cbd801b18ce4381012d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4bb4b22a5a24cbd801b18ce4381012d"}]}] Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestServerBasicOps-1276663150 Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: d4bb4b22a5a24cbd801b18ce4381012d Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestServerBasicOps-1276663150 Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestServerBasicOps-1276663150-project Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 60e9fc1c48194d28a58ab64c7b9eec9d Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestServerBasicOps-1276663150-project Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '43a35e7a-e82c-4759-9737-7d99fa1310a0'} Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:54.461683 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:54.466313 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:54.466313 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:54.466313 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:54.466313 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:54.466313 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:54.466313 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:54.466313 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:54.467541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1021de31-13d7-4810-b8f3-0d5dd09fbccf tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Returning 404 to user: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:54.468572 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1021de31-13d7-4810-b8f3-0d5dd09fbccf tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 404 len: 111 microversion: 2.1 time: 0.050212 Jul 20 04:51:54.469340 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3126/6152] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:54 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:51:54.972521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ce5ad438-49d1-43a0-ab1f-abb5837382f0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:54.973895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ce5ad438-49d1-43a0-ab1f-abb5837382f0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:54.986642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce5ad438-49d1-43a0-ab1f-abb5837382f0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:54.987106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce5ad438-49d1-43a0-ab1f-abb5837382f0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:54.988024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce5ad438-49d1-43a0-ab1f-abb5837382f0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:54.988635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce5ad438-49d1-43a0-ab1f-abb5837382f0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.006042 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-ce5ad438-49d1-43a0-ab1f-abb5837382f0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] HTTP exception thrown: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ce5ad438-49d1-43a0-ab1f-abb5837382f0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Request method failure captured: Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 HTTP/1.1 Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14iIykS50PSIUD1bMAEwDJkNay1pqQYKWEG8PyA6JMWETipyf4yGeKPjqDBhfQWHnB0ZQtv1rtTwXm8LF6dE5me6gHk6HDXpHP7Ufb3SjYDaytzQoCY9ec5KI-F0YfUX0NIkGJfsnxSm4dKPcfioARX7WG5Rnx3z0W4ZmqlGivRzWxk Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d4bb4b22a5a24cbd801b18ce4381012d Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestServerBasicOps-1276663150 Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4bb4b22a5a24cbd801b18ce4381012d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4bb4b22a5a24cbd801b18ce4381012d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4bb4b22a5a24cbd801b18ce4381012d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4bb4b22a5a24cbd801b18ce4381012d"}]}] Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestServerBasicOps-1276663150 Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d4bb4b22a5a24cbd801b18ce4381012d Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestServerBasicOps-1276663150 Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestServerBasicOps-1276663150-project Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 60e9fc1c48194d28a58ab64c7b9eec9d Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestServerBasicOps-1276663150-project Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '43a35e7a-e82c-4759-9737-7d99fa1310a0'} Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:55.008056 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ce5ad438-49d1-43a0-ab1f-abb5837382f0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Returning 404 to user: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ce5ad438-49d1-43a0-ab1f-abb5837382f0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "DELETE /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 404 len: 111 microversion: 2.1 time: 0.056188 Jul 20 04:51:55.012323 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3027/6153] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:51:54 2022] DELETE /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:51:55.019115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b2249cbc-635c-4e34-963e-aa83e9efa4c0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:55.020334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b2249cbc-635c-4e34-963e-aa83e9efa4c0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] [instance: 43a35e7a-e82c-4759-9737-7d99fa1310a0] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:55.031673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2249cbc-635c-4e34-963e-aa83e9efa4c0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.032137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2249cbc-635c-4e34-963e-aa83e9efa4c0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.032917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2249cbc-635c-4e34-963e-aa83e9efa4c0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.033407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2249cbc-635c-4e34-963e-aa83e9efa4c0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.067113 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-b2249cbc-635c-4e34-963e-aa83e9efa4c0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] HTTP exception thrown: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b2249cbc-635c-4e34-963e-aa83e9efa4c0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Request method failure captured: Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 HTTP/1.1 Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14iIykS50PSIUD1bMAEwDJkNay1pqQYKWEG8PyA6JMWETipyf4yGeKPjqDBhfQWHnB0ZQtv1rtTwXm8LF6dE5me6gHk6HDXpHP7Ufb3SjYDaytzQoCY9ec5KI-F0YfUX0NIkGJfsnxSm4dKPcfioARX7WG5Rnx3z0W4ZmqlGivRzWxk Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: d4bb4b22a5a24cbd801b18ce4381012d Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestServerBasicOps-1276663150 Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4bb4b22a5a24cbd801b18ce4381012d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4bb4b22a5a24cbd801b18ce4381012d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4bb4b22a5a24cbd801b18ce4381012d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4bb4b22a5a24cbd801b18ce4381012d"}]}] Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestServerBasicOps-1276663150 Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: d4bb4b22a5a24cbd801b18ce4381012d Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestServerBasicOps-1276663150 Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestServerBasicOps-1276663150-project Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 60e9fc1c48194d28a58ab64c7b9eec9d Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestServerBasicOps-1276663150-project Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '43a35e7a-e82c-4759-9737-7d99fa1310a0'} Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:55.069261 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.073946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:55.073946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:55.073946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:55.073946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:55.073946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:55.073946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. Jul 20 04:51:55.073946 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.073946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b2249cbc-635c-4e34-963e-aa83e9efa4c0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Returning 404 to user: Instance 43a35e7a-e82c-4759-9737-7d99fa1310a0 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:55.073946 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b2249cbc-635c-4e34-963e-aa83e9efa4c0 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0" status: 404 len: 111 microversion: 2.1 time: 0.055607 Jul 20 04:51:55.073946 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3127/6154] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:55 2022] GET /compute/v2.1/servers/43a35e7a-e82c-4759-9737-7d99fa1310a0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:51:55.306027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-15d31a57-65a2-48fd-b927-e3ead3741585 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] Calling method '.version_select at 0x7fbf9c514820>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:55.336476 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-15d31a57-65a2-48fd-b927-e3ead3741585 tempest-TestServerBasicOps-1276663150 tempest-TestServerBasicOps-1276663150-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1895092889" status: 202 len: 0 microversion: 2.1 time: 0.034344 Jul 20 04:51:55.337860 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3028/6155] 10.222.0.20 () {58 vars in 1253 bytes} [Wed Jul 20 04:51:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1895092889 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:52:18.179021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=5 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:18.180502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:18.479255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61190eb3-3aae-46c5-b99b-298b7e39a156 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:18.480491 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:52:18.480491 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 04:52:18.481995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61190eb3-3aae-46c5-b99b-298b7e39a156 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:18.482814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61190eb3-3aae-46c5-b99b-298b7e39a156 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:18.483852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61190eb3-3aae-46c5-b99b-298b7e39a156 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:18.484456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61190eb3-3aae-46c5-b99b-298b7e39a156 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:18.516010 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-61190eb3-3aae-46c5-b99b-298b7e39a156 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.350513 Jul 20 04:52:18.528333 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3128/6156] 10.222.0.20 () {58 vars in 1184 bytes} [Wed Jul 20 04:52:18 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:18.641292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-350113028", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "availability_zone": "nova:n-h1-764485-11", "networks": [{"uuid": "bfe82395-65a3-4bb9-ae2a-2b0ece74733d"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:18.648630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:18.649584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:18.715582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] validate_networks() for [('bfe82395-65a3-4bb9-ae2a-2b0ece74733d', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:52:19.132662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:52:19.133103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:52:19.133593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:52:19.134220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:52:19.135329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:52:19.144801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:19.145532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:19.146565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:19.147024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:19.170149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Getting quotas for project 7af4046c8a6748e1a3469bc3b755fbd8. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:52:19.185381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Getting quotas for user 41cd4033accc477d83c9c5e29a16ab28 and project 7af4046c8a6748e1a3469bc3b755fbd8. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:52:19.201738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:52:19.210069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:52:19.307281 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-05e8a330-befd-44b6-892c-7366ee346aad tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670280 Jul 20 04:52:19.309082 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3029/6157] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:52:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:52:19.319703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-096e6c57-20ac-43a4-a384-6f06906f8a44 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:19.319703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-096e6c57-20ac-43a4-a384-6f06906f8a44 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:19.444639 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-096e6c57-20ac-43a4-a384-6f06906f8a44 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1328 microversion: 2.1 time: 0.129470 Jul 20 04:52:19.446775 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3129/6158] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:19 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1328 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:19.661686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe6578cc-4d5b-472e-b3f3-3c304843920b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:19.663593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe6578cc-4d5b-472e-b3f3-3c304843920b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:19.681889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe6578cc-4d5b-472e-b3f3-3c304843920b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:19.682530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe6578cc-4d5b-472e-b3f3-3c304843920b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:19.683503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe6578cc-4d5b-472e-b3f3-3c304843920b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:19.684138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe6578cc-4d5b-472e-b3f3-3c304843920b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:19.754772 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe6578cc-4d5b-472e-b3f3-3c304843920b tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "POST /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd/action" status: 200 len: 24571 microversion: 2.1 time: 0.096935 Jul 20 04:52:19.755875 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3030/6159] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:52:19 2022] POST /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd/action => generated 24571 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:52:20.464311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-901d1870-45f9-4ddb-8c3c-e2c46062e18d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:20.467055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-901d1870-45f9-4ddb-8c3c-e2c46062e18d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:20.479974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-901d1870-45f9-4ddb-8c3c-e2c46062e18d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:20.480815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-901d1870-45f9-4ddb-8c3c-e2c46062e18d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:20.482091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-901d1870-45f9-4ddb-8c3c-e2c46062e18d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:20.482929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-901d1870-45f9-4ddb-8c3c-e2c46062e18d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:20.598572 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-901d1870-45f9-4ddb-8c3c-e2c46062e18d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1337 microversion: 2.1 time: 0.140034 Jul 20 04:52:20.599899 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3130/6160] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:20 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1337 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:21.618173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4059672b-1ef1-48d1-aba3-023064c229df tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:21.619148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4059672b-1ef1-48d1-aba3-023064c229df tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:21.628790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4059672b-1ef1-48d1-aba3-023064c229df tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:21.629917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4059672b-1ef1-48d1-aba3-023064c229df tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:21.631048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4059672b-1ef1-48d1-aba3-023064c229df tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:21.631922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4059672b-1ef1-48d1-aba3-023064c229df tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:21.861761 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4059672b-1ef1-48d1-aba3-023064c229df tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1465 microversion: 2.1 time: 0.248000 Jul 20 04:52:21.864812 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3031/6161] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:21 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1465 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:22.855099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-80e2077f-050b-4f0f-a1ad-7e84fb50aec8 req-81e766da-ba44-42bf-b311-e7836e9e5e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3062141-820d-485f-ae6d-bc7b25354a2d", "tag": "9fa3a9d3-6928-4039-b0b1-9a6384c026d8"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:22.869780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-80e2077f-050b-4f0f-a1ad-7e84fb50aec8 req-81e766da-ba44-42bf-b311-e7836e9e5e2d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:22.870444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-80e2077f-050b-4f0f-a1ad-7e84fb50aec8 req-81e766da-ba44-42bf-b311-e7836e9e5e2d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:22.893219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b4c3cab9-3fba-41f5-bc19-4561e539c713 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:22.893848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b4c3cab9-3fba-41f5-bc19-4561e539c713 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:22.910767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4c3cab9-3fba-41f5-bc19-4561e539c713 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:22.911442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4c3cab9-3fba-41f5-bc19-4561e539c713 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:22.912686 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-80e2077f-050b-4f0f-a1ad-7e84fb50aec8 req-81e766da-ba44-42bf-b311-e7836e9e5e2d service nova] Creating event network-changed:9fa3a9d3-6928-4039-b0b1-9a6384c026d8 for instance e3062141-820d-485f-ae6d-bc7b25354a2d on n-h1-764485-11 Jul 20 04:52:22.913090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4c3cab9-3fba-41f5-bc19-4561e539c713 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:22.913550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4c3cab9-3fba-41f5-bc19-4561e539c713 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:22.928365 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-80e2077f-050b-4f0f-a1ad-7e84fb50aec8 req-81e766da-ba44-42bf-b311-e7836e9e5e2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079968 Jul 20 04:52:22.932756 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3131/6162] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:23.642268 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b4c3cab9-3fba-41f5-bc19-4561e539c713 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1465 microversion: 2.1 time: 0.760633 Jul 20 04:52:23.643443 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3032/6163] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:22 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1465 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:24.659477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ee15821b-1d3b-4ec5-8c62-205984c87d40 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:24.660385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ee15821b-1d3b-4ec5-8c62-205984c87d40 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:24.673074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee15821b-1d3b-4ec5-8c62-205984c87d40 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:24.684102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee15821b-1d3b-4ec5-8c62-205984c87d40 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:24.685117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee15821b-1d3b-4ec5-8c62-205984c87d40 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:24.685696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee15821b-1d3b-4ec5-8c62-205984c87d40 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:24.868965 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ee15821b-1d3b-4ec5-8c62-205984c87d40 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1465 microversion: 2.1 time: 0.213314 Jul 20 04:52:24.869798 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3132/6164] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:24 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1465 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:25.890016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59bf736c-3b59-4d2b-9199-02232b6deafb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:25.890810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-59bf736c-3b59-4d2b-9199-02232b6deafb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:25.902167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59bf736c-3b59-4d2b-9199-02232b6deafb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:25.902908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59bf736c-3b59-4d2b-9199-02232b6deafb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:25.903949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59bf736c-3b59-4d2b-9199-02232b6deafb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:25.904606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59bf736c-3b59-4d2b-9199-02232b6deafb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:26.067206 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-59bf736c-3b59-4d2b-9199-02232b6deafb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1465 microversion: 2.1 time: 0.184668 Jul 20 04:52:26.067931 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3033/6165] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:25 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:27.084692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c98c6ff6-6be4-4881-95fc-0a2afcb970c0 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:27.086067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c98c6ff6-6be4-4881-95fc-0a2afcb970c0 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:27.094498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c98c6ff6-6be4-4881-95fc-0a2afcb970c0 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:27.095350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c98c6ff6-6be4-4881-95fc-0a2afcb970c0 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:27.096536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c98c6ff6-6be4-4881-95fc-0a2afcb970c0 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:27.097323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c98c6ff6-6be4-4881-95fc-0a2afcb970c0 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:27.265483 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c98c6ff6-6be4-4881-95fc-0a2afcb970c0 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1465 microversion: 2.1 time: 0.184514 Jul 20 04:52:27.267133 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3133/6166] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:27 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1465 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:28.294704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8fe95a02-acff-4649-a354-2b020dbfe53a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:28.295087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8fe95a02-acff-4649-a354-2b020dbfe53a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:28.307350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fe95a02-acff-4649-a354-2b020dbfe53a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:28.307922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fe95a02-acff-4649-a354-2b020dbfe53a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:28.308789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fe95a02-acff-4649-a354-2b020dbfe53a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:28.309307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fe95a02-acff-4649-a354-2b020dbfe53a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:28.502284 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8fe95a02-acff-4649-a354-2b020dbfe53a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1465 microversion: 2.1 time: 0.216248 Jul 20 04:52:28.513073 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3034/6167] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:28 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1465 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:29.519498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1de6dfe4-9eaf-47d2-accf-bf8727a67ae1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:29.520155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1de6dfe4-9eaf-47d2-accf-bf8727a67ae1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:29.529282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:29.532610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:29.543248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1de6dfe4-9eaf-47d2-accf-bf8727a67ae1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:29.545253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1de6dfe4-9eaf-47d2-accf-bf8727a67ae1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:29.546270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1de6dfe4-9eaf-47d2-accf-bf8727a67ae1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:29.546907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1de6dfe4-9eaf-47d2-accf-bf8727a67ae1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:29.699661 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1de6dfe4-9eaf-47d2-accf-bf8727a67ae1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1465 microversion: 2.1 time: 0.183870 Jul 20 04:52:29.710477 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3134/6168] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:29 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1465 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:29.878978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:29.880393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:30.000565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d3d85181-d424-4e6d-a50d-bdc87c78a4ee req-3e4ea756-ae79-4337-9b58-7ac8eda0e52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3062141-820d-485f-ae6d-bc7b25354a2d", "name": "network-vif-plugged", "status": "completed", "tag": "9fa3a9d3-6928-4039-b0b1-9a6384c026d8"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:30.009063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d3d85181-d424-4e6d-a50d-bdc87c78a4ee req-3e4ea756-ae79-4337-9b58-7ac8eda0e52b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.009518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d3d85181-d424-4e6d-a50d-bdc87c78a4ee req-3e4ea756-ae79-4337-9b58-7ac8eda0e52b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.021121 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d3d85181-d424-4e6d-a50d-bdc87c78a4ee req-3e4ea756-ae79-4337-9b58-7ac8eda0e52b service nova] Creating event network-vif-plugged:9fa3a9d3-6928-4039-b0b1-9a6384c026d8 for instance e3062141-820d-485f-ae6d-bc7b25354a2d on n-h1-764485-11 Jul 20 04:52:30.027388 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d3d85181-d424-4e6d-a50d-bdc87c78a4ee req-3e4ea756-ae79-4337-9b58-7ac8eda0e52b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154674 Jul 20 04:52:30.028449 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3035/6169] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:30.717827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7b42fff-f5a3-445e-a6f1-cc73cabac567 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:30.718442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a7b42fff-f5a3-445e-a6f1-cc73cabac567 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:30.725872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7b42fff-f5a3-445e-a6f1-cc73cabac567 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.726328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7b42fff-f5a3-445e-a6f1-cc73cabac567 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.727103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7b42fff-f5a3-445e-a6f1-cc73cabac567 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.727804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7b42fff-f5a3-445e-a6f1-cc73cabac567 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.889512 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a7b42fff-f5a3-445e-a6f1-cc73cabac567 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1465 microversion: 2.1 time: 0.175455 Jul 20 04:52:30.890838 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3135/6170] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:30 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1465 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:31.915402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1383e396-3c4c-4464-a7c8-770614521b21 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:31.916320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1383e396-3c4c-4464-a7c8-770614521b21 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:31.932738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1383e396-3c4c-4464-a7c8-770614521b21 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:31.933511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1383e396-3c4c-4464-a7c8-770614521b21 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:31.934662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1383e396-3c4c-4464-a7c8-770614521b21 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:31.935847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1383e396-3c4c-4464-a7c8-770614521b21 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:32.092164 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1383e396-3c4c-4464-a7c8-770614521b21 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1650 microversion: 2.1 time: 0.187078 Jul 20 04:52:32.105886 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3036/6171] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:31 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1650 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:32.122216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fc21e7b0-34a3-438f-af3d-5d8303a2fb0c tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:32.122862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fc21e7b0-34a3-438f-af3d-5d8303a2fb0c tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:32.130614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc21e7b0-34a3-438f-af3d-5d8303a2fb0c tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:32.132077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc21e7b0-34a3-438f-af3d-5d8303a2fb0c tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:32.133090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc21e7b0-34a3-438f-af3d-5d8303a2fb0c tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:32.133911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc21e7b0-34a3-438f-af3d-5d8303a2fb0c tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:32.311969 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fc21e7b0-34a3-438f-af3d-5d8303a2fb0c tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1650 microversion: 2.1 time: 0.193610 Jul 20 04:52:32.324039 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3136/6172] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:32 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1650 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:32.330270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e6661c16-b8d3-4e3e-b8cf-db1464a859c9 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:32.330902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e6661c16-b8d3-4e3e-b8cf-db1464a859c9 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:32.339744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6661c16-b8d3-4e3e-b8cf-db1464a859c9 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:32.340199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6661c16-b8d3-4e3e-b8cf-db1464a859c9 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:32.341270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6661c16-b8d3-4e3e-b8cf-db1464a859c9 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:32.341873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e6661c16-b8d3-4e3e-b8cf-db1464a859c9 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:32.546906 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e6661c16-b8d3-4e3e-b8cf-db1464a859c9 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1650 microversion: 2.1 time: 0.221132 Jul 20 04:52:32.547542 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3037/6173] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:32 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1650 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:32.705648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-751743731", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "availability_zone": "nova:n-h2-764485-11", "networks": [{"uuid": "bfe82395-65a3-4bb9-ae2a-2b0ece74733d"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:32.783826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] validate_networks() for [('bfe82395-65a3-4bb9-ae2a-2b0ece74733d', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:52:33.135193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:52:33.135859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:52:33.136127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:52:33.136544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:52:33.136992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:52:33.145999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:33.146452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:33.147252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:33.147736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:33.167049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Getting quotas for project 7af4046c8a6748e1a3469bc3b755fbd8. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:52:33.172552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Getting quotas for user 41cd4033accc477d83c9c5e29a16ab28 and project 7af4046c8a6748e1a3469bc3b755fbd8. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:52:33.186415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:52:33.188799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:52:33.234947 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2b615212-a636-4e16-b537-5a6e48a1ea70 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533630 Jul 20 04:52:33.235939 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3137/6174] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:52:33.246326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-032f2204-c12f-4dca-9678-5cbf199bb686 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:33.247616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-032f2204-c12f-4dca-9678-5cbf199bb686 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:33.323931 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-032f2204-c12f-4dca-9678-5cbf199bb686 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1328 microversion: 2.1 time: 0.082003 Jul 20 04:52:33.324547 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3038/6175] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:33 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1328 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:34.342129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4386ddf0-91af-46aa-8b9a-cc2279562c9d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:34.342771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4386ddf0-91af-46aa-8b9a-cc2279562c9d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:34.351111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4386ddf0-91af-46aa-8b9a-cc2279562c9d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:34.351864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4386ddf0-91af-46aa-8b9a-cc2279562c9d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:34.353768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4386ddf0-91af-46aa-8b9a-cc2279562c9d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:34.354388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4386ddf0-91af-46aa-8b9a-cc2279562c9d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:34.457088 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4386ddf0-91af-46aa-8b9a-cc2279562c9d tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1425 microversion: 2.1 time: 0.118788 Jul 20 04:52:34.458365 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3138/6176] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:34 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1425 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:35.479816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6534aed4-c454-4d67-b461-f99bb39df6f1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:35.481238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6534aed4-c454-4d67-b461-f99bb39df6f1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:35.490144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6534aed4-c454-4d67-b461-f99bb39df6f1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:35.494281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6534aed4-c454-4d67-b461-f99bb39df6f1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:35.498218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6534aed4-c454-4d67-b461-f99bb39df6f1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:35.498861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6534aed4-c454-4d67-b461-f99bb39df6f1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:35.669915 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6534aed4-c454-4d67-b461-f99bb39df6f1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1465 microversion: 2.1 time: 0.196168 Jul 20 04:52:35.671209 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3039/6177] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:35 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1465 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:35.714336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-021c6d20-9db8-4140-814a-ed86566737f5 req-53d27625-85be-4fb1-a374-74d4ea200f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97eafae1-3951-4efb-9357-19da5c0b5236", "tag": "8f9e0360-ace0-46cf-a22e-0c284a858324"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:35.733606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-021c6d20-9db8-4140-814a-ed86566737f5 req-53d27625-85be-4fb1-a374-74d4ea200f01 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:35.734475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-021c6d20-9db8-4140-814a-ed86566737f5 req-53d27625-85be-4fb1-a374-74d4ea200f01 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:35.752557 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-021c6d20-9db8-4140-814a-ed86566737f5 req-53d27625-85be-4fb1-a374-74d4ea200f01 service nova] Creating event network-changed:8f9e0360-ace0-46cf-a22e-0c284a858324 for instance 97eafae1-3951-4efb-9357-19da5c0b5236 on n-h2-764485-11 Jul 20 04:52:35.779324 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-021c6d20-9db8-4140-814a-ed86566737f5 req-53d27625-85be-4fb1-a374-74d4ea200f01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068878 Jul 20 04:52:35.783257 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3139/6178] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:52:36.687485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-37053107-5b70-4247-ac38-ddcc82ff11da tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:36.688022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-37053107-5b70-4247-ac38-ddcc82ff11da tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:36.694858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-37053107-5b70-4247-ac38-ddcc82ff11da tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:36.695305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-37053107-5b70-4247-ac38-ddcc82ff11da tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:36.696755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-37053107-5b70-4247-ac38-ddcc82ff11da tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:36.697188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-37053107-5b70-4247-ac38-ddcc82ff11da tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:36.825860 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-37053107-5b70-4247-ac38-ddcc82ff11da tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1465 microversion: 2.1 time: 0.142139 Jul 20 04:52:36.826450 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3040/6179] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:36 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1465 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:37.844241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7a3e859c-d350-43d3-9c24-16a14b9f48ec tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:37.844956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7a3e859c-d350-43d3-9c24-16a14b9f48ec tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:37.851149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a3e859c-d350-43d3-9c24-16a14b9f48ec tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:37.851644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a3e859c-d350-43d3-9c24-16a14b9f48ec tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:37.856973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a3e859c-d350-43d3-9c24-16a14b9f48ec tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:37.857492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7a3e859c-d350-43d3-9c24-16a14b9f48ec tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:37.990729 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7a3e859c-d350-43d3-9c24-16a14b9f48ec tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1465 microversion: 2.1 time: 0.151509 Jul 20 04:52:37.991330 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3140/6180] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:37 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1465 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:39.008074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bcd406dd-d1a8-4e9c-8c9f-bfd3e77f56f6 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:39.009858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bcd406dd-d1a8-4e9c-8c9f-bfd3e77f56f6 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:39.016366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bcd406dd-d1a8-4e9c-8c9f-bfd3e77f56f6 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:39.016810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bcd406dd-d1a8-4e9c-8c9f-bfd3e77f56f6 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:39.017588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bcd406dd-d1a8-4e9c-8c9f-bfd3e77f56f6 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:39.018034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bcd406dd-d1a8-4e9c-8c9f-bfd3e77f56f6 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:39.157618 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bcd406dd-d1a8-4e9c-8c9f-bfd3e77f56f6 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1465 microversion: 2.1 time: 0.153183 Jul 20 04:52:39.158221 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3041/6181] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:39 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:40.175655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49c4056e-7818-404c-b290-760fed786bac tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:40.176287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-49c4056e-7818-404c-b290-760fed786bac tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:40.192581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49c4056e-7818-404c-b290-760fed786bac tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:40.193030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49c4056e-7818-404c-b290-760fed786bac tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:40.194012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49c4056e-7818-404c-b290-760fed786bac tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:40.194453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-49c4056e-7818-404c-b290-760fed786bac tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:40.334367 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-49c4056e-7818-404c-b290-760fed786bac tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1465 microversion: 2.1 time: 0.162578 Jul 20 04:52:40.335715 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3141/6182] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:40 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1465 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:41.353492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee980148-8fa2-4d48-b076-06d26ec76bbb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:41.354498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ee980148-8fa2-4d48-b076-06d26ec76bbb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:41.362238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee980148-8fa2-4d48-b076-06d26ec76bbb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:41.362794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee980148-8fa2-4d48-b076-06d26ec76bbb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:41.363702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee980148-8fa2-4d48-b076-06d26ec76bbb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:41.364244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee980148-8fa2-4d48-b076-06d26ec76bbb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:41.533497 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ee980148-8fa2-4d48-b076-06d26ec76bbb tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1465 microversion: 2.1 time: 0.184593 Jul 20 04:52:41.534238 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3042/6183] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:41 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:42.297946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-70fe4ae7-374a-442d-8722-b172ef4361e0 req-f10839da-7449-480d-817c-d04dffa350ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97eafae1-3951-4efb-9357-19da5c0b5236", "name": "network-vif-plugged", "status": "completed", "tag": "8f9e0360-ace0-46cf-a22e-0c284a858324"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:42.309421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-70fe4ae7-374a-442d-8722-b172ef4361e0 req-f10839da-7449-480d-817c-d04dffa350ff service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:42.309987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-70fe4ae7-374a-442d-8722-b172ef4361e0 req-f10839da-7449-480d-817c-d04dffa350ff service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:42.325780 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-70fe4ae7-374a-442d-8722-b172ef4361e0 req-f10839da-7449-480d-817c-d04dffa350ff service nova] Creating event network-vif-plugged:8f9e0360-ace0-46cf-a22e-0c284a858324 for instance 97eafae1-3951-4efb-9357-19da5c0b5236 on n-h2-764485-11 Jul 20 04:52:42.339439 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-70fe4ae7-374a-442d-8722-b172ef4361e0 req-f10839da-7449-480d-817c-d04dffa350ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045484 Jul 20 04:52:42.340373 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3142/6184] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:42.550180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e14c2c1b-340d-4030-a45f-adc811fe353f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:42.550907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e14c2c1b-340d-4030-a45f-adc811fe353f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:42.559345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e14c2c1b-340d-4030-a45f-adc811fe353f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:42.559835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e14c2c1b-340d-4030-a45f-adc811fe353f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:42.560616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e14c2c1b-340d-4030-a45f-adc811fe353f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:42.561087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e14c2c1b-340d-4030-a45f-adc811fe353f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:42.699046 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e14c2c1b-340d-4030-a45f-adc811fe353f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1465 microversion: 2.1 time: 0.152558 Jul 20 04:52:42.699665 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3043/6185] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:42 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1465 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:43.713364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:43.714236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:43.719687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-972f3b64-2f8a-4c27-ae4e-946c5861e55f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:43.720391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-972f3b64-2f8a-4c27-ae4e-946c5861e55f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:43.728410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-972f3b64-2f8a-4c27-ae4e-946c5861e55f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:43.729113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-972f3b64-2f8a-4c27-ae4e-946c5861e55f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:43.729875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-972f3b64-2f8a-4c27-ae4e-946c5861e55f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:43.730312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-972f3b64-2f8a-4c27-ae4e-946c5861e55f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:43.868390 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-972f3b64-2f8a-4c27-ae4e-946c5861e55f tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1465 microversion: 2.1 time: 0.155294 Jul 20 04:52:43.877979 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3143/6186] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:43 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:44.886599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b4789bbc-48a6-4dd3-b387-f596ef9ee2b4 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:44.887293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b4789bbc-48a6-4dd3-b387-f596ef9ee2b4 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:44.889189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:44.895576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4789bbc-48a6-4dd3-b387-f596ef9ee2b4 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:44.896029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4789bbc-48a6-4dd3-b387-f596ef9ee2b4 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:44.896789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4789bbc-48a6-4dd3-b387-f596ef9ee2b4 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:44.897231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b4789bbc-48a6-4dd3-b387-f596ef9ee2b4 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:45.037959 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b4789bbc-48a6-4dd3-b387-f596ef9ee2b4 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1651 microversion: 2.1 time: 0.156060 Jul 20 04:52:45.039121 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3044/6187] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:44 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1651 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:45.054106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-43d694ff-6198-4d3f-a737-4b13d70ee232 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:45.054730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-43d694ff-6198-4d3f-a737-4b13d70ee232 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:45.062241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43d694ff-6198-4d3f-a737-4b13d70ee232 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:45.062704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43d694ff-6198-4d3f-a737-4b13d70ee232 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:45.063478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43d694ff-6198-4d3f-a737-4b13d70ee232 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:45.063953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-43d694ff-6198-4d3f-a737-4b13d70ee232 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:45.193424 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-43d694ff-6198-4d3f-a737-4b13d70ee232 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1651 microversion: 2.1 time: 0.142999 Jul 20 04:52:45.194154 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3144/6188] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:45 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1651 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:45.209826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0eef6937-1501-4822-9c23-f87ff21bc2d1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:45.210449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0eef6937-1501-4822-9c23-f87ff21bc2d1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:45.216744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0eef6937-1501-4822-9c23-f87ff21bc2d1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:45.217201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0eef6937-1501-4822-9c23-f87ff21bc2d1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:45.217975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0eef6937-1501-4822-9c23-f87ff21bc2d1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:45.218420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0eef6937-1501-4822-9c23-f87ff21bc2d1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:45.358558 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0eef6937-1501-4822-9c23-f87ff21bc2d1 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1651 microversion: 2.1 time: 0.152359 Jul 20 04:52:45.359165 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3045/6189] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:45 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1651 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:45.375187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2568bc0e-8a9b-4630-ac4a-e1089c59956a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:45.375904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2568bc0e-8a9b-4630-ac4a-e1089c59956a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:45.382388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2568bc0e-8a9b-4630-ac4a-e1089c59956a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:45.382841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2568bc0e-8a9b-4630-ac4a-e1089c59956a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:45.383683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2568bc0e-8a9b-4630-ac4a-e1089c59956a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:45.384308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2568bc0e-8a9b-4630-ac4a-e1089c59956a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:45.409281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2568bc0e-8a9b-4630-ac4a-e1089c59956a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:52:45.489810 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2568bc0e-8a9b-4630-ac4a-e1089c59956a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 204 len: 0 microversion: 2.1 time: 0.117977 Jul 20 04:52:45.490708 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3145/6190] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:52:45 2022] DELETE /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:52:45.499274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-89a91de3-29db-44d1-9dff-5534ea75478a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:45.499916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-89a91de3-29db-44d1-9dff-5534ea75478a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:45.506117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89a91de3-29db-44d1-9dff-5534ea75478a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:45.506635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89a91de3-29db-44d1-9dff-5534ea75478a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:45.507474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89a91de3-29db-44d1-9dff-5534ea75478a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:45.507940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89a91de3-29db-44d1-9dff-5534ea75478a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:45.640874 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-89a91de3-29db-44d1-9dff-5534ea75478a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1657 microversion: 2.1 time: 0.145282 Jul 20 04:52:45.641466 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3046/6191] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:45 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1657 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:46.658386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e479f96-1679-43f9-bce9-312139837ba8 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:46.659202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6e479f96-1679-43f9-bce9-312139837ba8 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:46.667291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e479f96-1679-43f9-bce9-312139837ba8 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:46.667783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e479f96-1679-43f9-bce9-312139837ba8 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:46.668555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e479f96-1679-43f9-bce9-312139837ba8 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:46.668995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e479f96-1679-43f9-bce9-312139837ba8 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:46.803780 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6e479f96-1679-43f9-bce9-312139837ba8 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1657 microversion: 2.1 time: 0.149401 Jul 20 04:52:46.804465 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3146/6192] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:46 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1657 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:47.492336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3d30be15-4040-4f7d-a26f-a673e517e92f req-c7bf0d01-0e34-4310-80d9-4ce04a4de34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97eafae1-3951-4efb-9357-19da5c0b5236", "name": "network-vif-deleted", "tag": "8f9e0360-ace0-46cf-a22e-0c284a858324"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:47.504001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3d30be15-4040-4f7d-a26f-a673e517e92f req-c7bf0d01-0e34-4310-80d9-4ce04a4de34a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:47.504884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3d30be15-4040-4f7d-a26f-a673e517e92f req-c7bf0d01-0e34-4310-80d9-4ce04a4de34a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:47.520430 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3d30be15-4040-4f7d-a26f-a673e517e92f req-c7bf0d01-0e34-4310-80d9-4ce04a4de34a service nova] Creating event network-vif-deleted:8f9e0360-ace0-46cf-a22e-0c284a858324 for instance 97eafae1-3951-4efb-9357-19da5c0b5236 on n-h2-764485-11 Jul 20 04:52:47.527591 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3d30be15-4040-4f7d-a26f-a673e517e92f req-c7bf0d01-0e34-4310-80d9-4ce04a4de34a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038390 Jul 20 04:52:47.531179 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3047/6193] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:47.823432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52c31d4e-8d7a-4a30-9dc1-5a8269a7d877 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:47.824102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52c31d4e-8d7a-4a30-9dc1-5a8269a7d877 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:47.831149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52c31d4e-8d7a-4a30-9dc1-5a8269a7d877 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:47.831636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52c31d4e-8d7a-4a30-9dc1-5a8269a7d877 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:47.832416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52c31d4e-8d7a-4a30-9dc1-5a8269a7d877 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:47.832857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52c31d4e-8d7a-4a30-9dc1-5a8269a7d877 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:47.837276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:47.866689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52c31d4e-8d7a-4a30-9dc1-5a8269a7d877 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:47.867149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52c31d4e-8d7a-4a30-9dc1-5a8269a7d877 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:47.868226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-52c31d4e-8d7a-4a30-9dc1-5a8269a7d877 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lazy-loading 'fault' on Instance uuid 97eafae1-3951-4efb-9357-19da5c0b5236 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:52:47.916404 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52c31d4e-8d7a-4a30-9dc1-5a8269a7d877 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 200 len: 1455 microversion: 2.1 time: 0.097892 Jul 20 04:52:47.917001 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3147/6194] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:47 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:48.934899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0946f282-2141-44e6-b92e-51c3c80078cc tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:48.935674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0946f282-2141-44e6-b92e-51c3c80078cc tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: 97eafae1-3951-4efb-9357-19da5c0b5236] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:48.937621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:48.943330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0946f282-2141-44e6-b92e-51c3c80078cc tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:48.943807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0946f282-2141-44e6-b92e-51c3c80078cc tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:48.944574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0946f282-2141-44e6-b92e-51c3c80078cc tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:48.945012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0946f282-2141-44e6-b92e-51c3c80078cc tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:48.948878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=95 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:48.960471 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-0946f282-2141-44e6-b92e-51c3c80078cc tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] HTTP exception thrown: Instance 97eafae1-3951-4efb-9357-19da5c0b5236 could not be found. Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0946f282-2141-44e6-b92e-51c3c80078cc tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Request method failure captured: Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 HTTP/1.1 Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14oCxCaF1A3CUeQdq7vsPczuoJ9BWgXNR0TnWCHU7TDnfSGvEszWJFx7W6EhkUr_Chtyo48X-VBo_uQ3XZSyGN-l-74QNYoB49J5mfdz2mCUzauP4FQ4_Mtb1tGbJvAKxri591KrZ13WH_RWfCOlW3jeTySjuYZNKh-o_kAbr5vN8sY Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7af4046c8a6748e1a3469bc3b755fbd8 Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestServerMultinode-1429766054 Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7af4046c8a6748e1a3469bc3b755fbd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7af4046c8a6748e1a3469bc3b755fbd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7af4046c8a6748e1a3469bc3b755fbd8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7af4046c8a6748e1a3469bc3b755fbd8"}]}] Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestServerMultinode-1429766054 Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7af4046c8a6748e1a3469bc3b755fbd8 Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestServerMultinode-1429766054 Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestServerMultinode-1429766054-project-admin Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 41cd4033accc477d83c9c5e29a16ab28 Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestServerMultinode-1429766054-project-admin Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 97eafae1-3951-4efb-9357-19da5c0b5236 could not be found. Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '97eafae1-3951-4efb-9357-19da5c0b5236'} Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97eafae1-3951-4efb-9357-19da5c0b5236 could not be found. Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97eafae1-3951-4efb-9357-19da5c0b5236 could not be found. Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:48.962878 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:52:48.967143 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:48.967143 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:48.967143 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:48.967143 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:48.967143 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:48.967143 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97eafae1-3951-4efb-9357-19da5c0b5236 could not be found. Jul 20 04:52:48.967143 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:52:48.967143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0946f282-2141-44e6-b92e-51c3c80078cc tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Returning 404 to user: Instance 97eafae1-3951-4efb-9357-19da5c0b5236 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:48.967143 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0946f282-2141-44e6-b92e-51c3c80078cc tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236" status: 404 len: 111 microversion: 2.1 time: 0.034721 Jul 20 04:52:48.967143 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3048/6195] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:48 2022] GET /compute/v2.1/servers/97eafae1-3951-4efb-9357-19da5c0b5236 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:52:48.972969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9f9c01d0-15aa-4483-aeec-16034450de59 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:48.973490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9f9c01d0-15aa-4483-aeec-16034450de59 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:48.976197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:48.982651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f9c01d0-15aa-4483-aeec-16034450de59 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:48.983156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f9c01d0-15aa-4483-aeec-16034450de59 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:48.984014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f9c01d0-15aa-4483-aeec-16034450de59 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:48.984460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f9c01d0-15aa-4483-aeec-16034450de59 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:49.015171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9f9c01d0-15aa-4483-aeec-16034450de59 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:52:49.097064 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9f9c01d0-15aa-4483-aeec-16034450de59 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 204 len: 0 microversion: 2.1 time: 0.127454 Jul 20 04:52:49.097688 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3148/6196] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:52:48 2022] DELETE /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:52:49.106578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-97d39993-3101-4a71-baea-26fde90d8e1a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:49.107533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-97d39993-3101-4a71-baea-26fde90d8e1a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:49.114030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97d39993-3101-4a71-baea-26fde90d8e1a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:49.114559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97d39993-3101-4a71-baea-26fde90d8e1a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:49.115390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97d39993-3101-4a71-baea-26fde90d8e1a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:49.115920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97d39993-3101-4a71-baea-26fde90d8e1a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:49.259359 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-97d39993-3101-4a71-baea-26fde90d8e1a tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1656 microversion: 2.1 time: 0.156161 Jul 20 04:52:49.259993 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3049/6197] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:49 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:50.277698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-946feb06-4429-4fd6-98fc-e8cee7b467be tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:50.278398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-946feb06-4429-4fd6-98fc-e8cee7b467be tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:50.285791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-946feb06-4429-4fd6-98fc-e8cee7b467be tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:50.286247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-946feb06-4429-4fd6-98fc-e8cee7b467be tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:50.287004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-946feb06-4429-4fd6-98fc-e8cee7b467be tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:50.287439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-946feb06-4429-4fd6-98fc-e8cee7b467be tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:50.416592 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-946feb06-4429-4fd6-98fc-e8cee7b467be tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1656 microversion: 2.1 time: 0.143308 Jul 20 04:52:50.417182 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3149/6198] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:50 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1656 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:51.436180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-219b4e87-afa6-4cf6-8acf-1d2668259247 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:51.437834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-219b4e87-afa6-4cf6-8acf-1d2668259247 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:51.448387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-219b4e87-afa6-4cf6-8acf-1d2668259247 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:51.448969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-219b4e87-afa6-4cf6-8acf-1d2668259247 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:51.449849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-219b4e87-afa6-4cf6-8acf-1d2668259247 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:51.450470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-219b4e87-afa6-4cf6-8acf-1d2668259247 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:51.633836 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-219b4e87-afa6-4cf6-8acf-1d2668259247 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 200 len: 1656 microversion: 2.1 time: 0.202699 Jul 20 04:52:51.634610 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3050/6199] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:51 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 1656 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:51.743957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-0ba182de-d81a-40b2-a793-73400162d16e req-f8a96e96-8423-4dc1-8381-d1bb4d3537e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3062141-820d-485f-ae6d-bc7b25354a2d", "name": "network-vif-deleted", "tag": "9fa3a9d3-6928-4039-b0b1-9a6384c026d8"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:51.765454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0ba182de-d81a-40b2-a793-73400162d16e req-f8a96e96-8423-4dc1-8381-d1bb4d3537e0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:51.765906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0ba182de-d81a-40b2-a793-73400162d16e req-f8a96e96-8423-4dc1-8381-d1bb4d3537e0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:51.778654 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-0ba182de-d81a-40b2-a793-73400162d16e req-f8a96e96-8423-4dc1-8381-d1bb4d3537e0 service nova] Creating event network-vif-deleted:9fa3a9d3-6928-4039-b0b1-9a6384c026d8 for instance e3062141-820d-485f-ae6d-bc7b25354a2d on n-h1-764485-11 Jul 20 04:52:51.784144 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-0ba182de-d81a-40b2-a793-73400162d16e req-f8a96e96-8423-4dc1-8381-d1bb4d3537e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047268 Jul 20 04:52:51.784798 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3150/6200] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:52.652538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9492b2db-9e3c-4c66-9cb4-782452fd0e26 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:52.653292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9492b2db-9e3c-4c66-9cb4-782452fd0e26 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] [instance: e3062141-820d-485f-ae6d-bc7b25354a2d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:52.660886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9492b2db-9e3c-4c66-9cb4-782452fd0e26 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:52.661346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9492b2db-9e3c-4c66-9cb4-782452fd0e26 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:52.662136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9492b2db-9e3c-4c66-9cb4-782452fd0e26 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:52.662579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9492b2db-9e3c-4c66-9cb4-782452fd0e26 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:52.678052 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-9492b2db-9e3c-4c66-9cb4-782452fd0e26 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] HTTP exception thrown: Instance e3062141-820d-485f-ae6d-bc7b25354a2d could not be found. Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9492b2db-9e3c-4c66-9cb4-782452fd0e26 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Request method failure captured: Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d HTTP/1.1 Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14oCxCaF1A3CUeQdq7vsPczuoJ9BWgXNR0TnWCHU7TDnfSGvEszWJFx7W6EhkUr_Chtyo48X-VBo_uQ3XZSyGN-l-74QNYoB49J5mfdz2mCUzauP4FQ4_Mtb1tGbJvAKxri591KrZ13WH_RWfCOlW3jeTySjuYZNKh-o_kAbr5vN8sY Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7af4046c8a6748e1a3469bc3b755fbd8 Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestServerMultinode-1429766054 Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7af4046c8a6748e1a3469bc3b755fbd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7af4046c8a6748e1a3469bc3b755fbd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7af4046c8a6748e1a3469bc3b755fbd8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7af4046c8a6748e1a3469bc3b755fbd8"}]}] Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestServerMultinode-1429766054 Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7af4046c8a6748e1a3469bc3b755fbd8 Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestServerMultinode-1429766054 Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestServerMultinode-1429766054-project-admin Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 41cd4033accc477d83c9c5e29a16ab28 Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestServerMultinode-1429766054-project-admin Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance e3062141-820d-485f-ae6d-bc7b25354a2d could not be found. Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'e3062141-820d-485f-ae6d-bc7b25354a2d'} Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3062141-820d-485f-ae6d-bc7b25354a2d could not be found. Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3062141-820d-485f-ae6d-bc7b25354a2d could not be found. Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:52.681257 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:52:52.686581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:52.686581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:52.686581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:52.686581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:52.686581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:52.686581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3062141-820d-485f-ae6d-bc7b25354a2d could not be found. Jul 20 04:52:52.686581 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:52:52.686581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9492b2db-9e3c-4c66-9cb4-782452fd0e26 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] Returning 404 to user: Instance e3062141-820d-485f-ae6d-bc7b25354a2d could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:52.686581 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9492b2db-9e3c-4c66-9cb4-782452fd0e26 tempest-TestServerMultinode-1429766054 tempest-TestServerMultinode-1429766054-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d" status: 404 len: 111 microversion: 2.1 time: 0.036241 Jul 20 04:52:52.686581 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3051/6201] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:52 2022] GET /compute/v2.1/servers/e3062141-820d-485f-ae6d-bc7b25354a2d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:52:58.796904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-81700918-558b-4144-9ff6-aecb25a2d556 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:58.797930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-81700918-558b-4144-9ff6-aecb25a2d556 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:58.806118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-81700918-558b-4144-9ff6-aecb25a2d556 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:58.806581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-81700918-558b-4144-9ff6-aecb25a2d556 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:58.807897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-81700918-558b-4144-9ff6-aecb25a2d556 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:58.808343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-81700918-558b-4144-9ff6-aecb25a2d556 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:58.862291 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-81700918-558b-4144-9ff6-aecb25a2d556 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "POST /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd/action" status: 200 len: 32638 microversion: 2.1 time: 0.069488 Jul 20 04:52:58.863197 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3151/6202] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:52:58 2022] POST /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd/action => generated 32638 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:53:00.215177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a03cad6e-8d88-4e9e-9156-aa4ed158d784 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:00.215840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a03cad6e-8d88-4e9e-9156-aa4ed158d784 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:00.234069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-377ff734-7664-448f-b761-152cd709a654 req-1f5f4e1b-57cd-4e16-bf1d-b81ebf584131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b257756-b673-473f-a46d-3ab24114ffcd", "tag": "aa1ff013-dca9-4b86-885d-887a969cd7c7"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:00.239082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a03cad6e-8d88-4e9e-9156-aa4ed158d784 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:00.239670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a03cad6e-8d88-4e9e-9156-aa4ed158d784 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:00.240578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a03cad6e-8d88-4e9e-9156-aa4ed158d784 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:00.241008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a03cad6e-8d88-4e9e-9156-aa4ed158d784 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:00.253112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-377ff734-7664-448f-b761-152cd709a654 req-1f5f4e1b-57cd-4e16-bf1d-b81ebf584131 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:00.259426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-377ff734-7664-448f-b761-152cd709a654 req-1f5f4e1b-57cd-4e16-bf1d-b81ebf584131 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:00.277270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a03cad6e-8d88-4e9e-9156-aa4ed158d784 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:53:00.278062 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-377ff734-7664-448f-b761-152cd709a654 req-1f5f4e1b-57cd-4e16-bf1d-b81ebf584131 service nova] Creating event network-changed:aa1ff013-dca9-4b86-885d-887a969cd7c7 for instance 6b257756-b673-473f-a46d-3ab24114ffcd on n-h1-764485-11 Jul 20 04:53:00.299233 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-377ff734-7664-448f-b761-152cd709a654 req-1f5f4e1b-57cd-4e16-bf1d-b81ebf584131 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069221 Jul 20 04:53:00.300267 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3152/6203] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:00.420893 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a03cad6e-8d88-4e9e-9156-aa4ed158d784 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 204 len: 0 microversion: 2.1 time: 0.213781 Jul 20 04:53:00.428444 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3052/6204] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:53:00 2022] DELETE /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:53:00.432928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-de111f90-cfe4-4e2e-aee3-f73ce3e18be1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:00.433778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-de111f90-cfe4-4e2e-aee3-f73ce3e18be1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:00.446500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de111f90-cfe4-4e2e-aee3-f73ce3e18be1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:00.446992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de111f90-cfe4-4e2e-aee3-f73ce3e18be1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:00.450449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de111f90-cfe4-4e2e-aee3-f73ce3e18be1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:00.450560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de111f90-cfe4-4e2e-aee3-f73ce3e18be1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:00.975393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-de111f90-cfe4-4e2e-aee3-f73ce3e18be1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:00.984108 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-de111f90-cfe4-4e2e-aee3-f73ce3e18be1 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1672 microversion: 2.1 time: 0.557095 Jul 20 04:53:00.984934 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3153/6205] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:00 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1672 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:02.002928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1cc9aa63-7773-4d31-bda2-a3fd926a0bd9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:02.004278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1cc9aa63-7773-4d31-bda2-a3fd926a0bd9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:02.011636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1cc9aa63-7773-4d31-bda2-a3fd926a0bd9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:02.012096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1cc9aa63-7773-4d31-bda2-a3fd926a0bd9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:02.013053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1cc9aa63-7773-4d31-bda2-a3fd926a0bd9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:02.013672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1cc9aa63-7773-4d31-bda2-a3fd926a0bd9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:02.165460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1cc9aa63-7773-4d31-bda2-a3fd926a0bd9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97323cd98ca448c097f6a1cfa4ab691a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141470bf62e0454bab8289b6bab0b01a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:02.178288 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1cc9aa63-7773-4d31-bda2-a3fd926a0bd9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 200 len: 1672 microversion: 2.1 time: 0.175524 Jul 20 04:53:02.178288 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3053/6206] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:01 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:02.718291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6fccaaee-1967-4464-9c07-1a15ebd9d8d4 req-01817aa3-23de-4f3c-b4f7-6ddc20f4dd30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b257756-b673-473f-a46d-3ab24114ffcd", "name": "network-vif-deleted", "tag": "aa1ff013-dca9-4b86-885d-887a969cd7c7"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:02.731971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6fccaaee-1967-4464-9c07-1a15ebd9d8d4 req-01817aa3-23de-4f3c-b4f7-6ddc20f4dd30 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:02.732956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6fccaaee-1967-4464-9c07-1a15ebd9d8d4 req-01817aa3-23de-4f3c-b4f7-6ddc20f4dd30 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:02.747970 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6fccaaee-1967-4464-9c07-1a15ebd9d8d4 req-01817aa3-23de-4f3c-b4f7-6ddc20f4dd30 service nova] Creating event network-vif-deleted:aa1ff013-dca9-4b86-885d-887a969cd7c7 for instance 6b257756-b673-473f-a46d-3ab24114ffcd on n-h1-764485-11 Jul 20 04:53:02.755285 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6fccaaee-1967-4464-9c07-1a15ebd9d8d4 req-01817aa3-23de-4f3c-b4f7-6ddc20f4dd30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040662 Jul 20 04:53:02.756878 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3154/6207] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:03.195721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-21f7ffb1-e575-4d81-8fac-0694f8b562a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:03.196399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-21f7ffb1-e575-4d81-8fac-0694f8b562a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] [instance: 6b257756-b673-473f-a46d-3ab24114ffcd] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:03.205492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21f7ffb1-e575-4d81-8fac-0694f8b562a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:03.206000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21f7ffb1-e575-4d81-8fac-0694f8b562a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:03.206893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21f7ffb1-e575-4d81-8fac-0694f8b562a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:03.207612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-21f7ffb1-e575-4d81-8fac-0694f8b562a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:03.241971 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-21f7ffb1-e575-4d81-8fac-0694f8b562a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] HTTP exception thrown: Instance 6b257756-b673-473f-a46d-3ab24114ffcd could not be found. Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-21f7ffb1-e575-4d81-8fac-0694f8b562a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Request method failure captured: Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd HTTP/1.1 Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14j7g2DG9R8c47poZBwDWSz0WARq5VdRh1LFfATtyfTWE_0P4APzetD_rDciLIFAEU-qtRbmXPLhqNSWO_iBxSSP0iA3R57Z-JB5TtjkjSm66Fg-q-FuqBs4F_mZJDUQUxKgS5kb6jt83AzEV5IcLcLRmDiaRgwvr_vdlJ1Z8UKm4vA Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 141470bf62e0454bab8289b6bab0b01a Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestNetworkBasicOps-1642029803 Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/141470bf62e0454bab8289b6bab0b01a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/141470bf62e0454bab8289b6bab0b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_141470bf62e0454bab8289b6bab0b01a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/141470bf62e0454bab8289b6bab0b01a"}]}] Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestNetworkBasicOps-1642029803 Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 141470bf62e0454bab8289b6bab0b01a Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestNetworkBasicOps-1642029803 Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestNetworkBasicOps-1642029803-project Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 97323cd98ca448c097f6a1cfa4ab691a Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestNetworkBasicOps-1642029803-project Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 6b257756-b673-473f-a46d-3ab24114ffcd could not be found. Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '6b257756-b673-473f-a46d-3ab24114ffcd'} Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b257756-b673-473f-a46d-3ab24114ffcd could not be found. Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b257756-b673-473f-a46d-3ab24114ffcd could not be found. Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:03.243632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:53:03.248110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:03.248110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:03.248110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:03.248110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:53:03.248110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:53:03.248110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b257756-b673-473f-a46d-3ab24114ffcd could not be found. Jul 20 04:53:03.248110 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:53:03.248110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-21f7ffb1-e575-4d81-8fac-0694f8b562a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Returning 404 to user: Instance 6b257756-b673-473f-a46d-3ab24114ffcd could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:53:03.248110 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-21f7ffb1-e575-4d81-8fac-0694f8b562a9 tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd" status: 404 len: 111 microversion: 2.1 time: 0.057800 Jul 20 04:53:03.248110 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3054/6208] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:03 2022] GET /compute/v2.1/servers/6b257756-b673-473f-a46d-3ab24114ffcd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:53:03.425693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-040c7435-6c99-4bc6-84cd-fe60a711fadd tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] Calling method '.version_select at 0x7fbfa28a90d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:03.465071 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-040c7435-6c99-4bc6-84cd-fe60a711fadd tempest-TestNetworkBasicOps-1642029803 tempest-TestNetworkBasicOps-1642029803-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1585045978" status: 202 len: 0 microversion: 2.1 time: 0.044734 Jul 20 04:53:03.467541 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3155/6209] 10.222.0.20 () {58 vars in 1256 bytes} [Wed Jul 20 04:53:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1585045978 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:53:24.913457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1950324847", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "708f4c19-677a-4775-a93a-694766c916ba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1e46ee9e-198e-401c-88a3-4979bd7d9aaf"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:24.926816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:24.927744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:24.983161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] validate_networks() for [('1e46ee9e-198e-401c-88a3-4979bd7d9aaf', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:53:25.407907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:53:25.408335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:53:25.408817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:53:25.409237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:53:25.409651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:53:25.421209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:25.421697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:25.422503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:25.422942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:25.446402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:53:25.452382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for user 1f70af961f624dceba390cb44ef2a792 and project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:53:25.512503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:53:25.515033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='708f4c19-677a-4775-a93a-694766c916ba',volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:53:25.665589 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b1258d59-4b98-4d84-929b-55dbe3dfc44c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757164 Jul 20 04:53:25.667024 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3055/6210] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:53:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:53:25.676059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:25.677941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:25.684272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ceed2d62-f2e6-4af9-a1db-aaef541f8b94 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:25.685200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ceed2d62-f2e6-4af9-a1db-aaef541f8b94 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:25.784760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ceed2d62-f2e6-4af9-a1db-aaef541f8b94 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:25.795414 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ceed2d62-f2e6-4af9-a1db-aaef541f8b94 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1057 microversion: 2.1 time: 0.120614 Jul 20 04:53:25.798019 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3156/6211] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:25 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1057 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:26.823352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-71f151aa-cc0e-4d45-b706-23be010327c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:26.824154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-71f151aa-cc0e-4d45-b706-23be010327c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:26.833644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71f151aa-cc0e-4d45-b706-23be010327c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:26.834552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71f151aa-cc0e-4d45-b706-23be010327c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:26.836898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71f151aa-cc0e-4d45-b706-23be010327c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:26.838463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-71f151aa-cc0e-4d45-b706-23be010327c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:26.959193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-71f151aa-cc0e-4d45-b706-23be010327c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:26.969372 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-71f151aa-cc0e-4d45-b706-23be010327c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1155 microversion: 2.1 time: 0.156549 Jul 20 04:53:26.973918 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3056/6212] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:26 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1155 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:27.997797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9f6eb11-1c54-4415-8b76-f9b78aeb178e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:28.000661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9f6eb11-1c54-4415-8b76-f9b78aeb178e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:28.028262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9f6eb11-1c54-4415-8b76-f9b78aeb178e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:28.040611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9f6eb11-1c54-4415-8b76-f9b78aeb178e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:28.045908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9f6eb11-1c54-4415-8b76-f9b78aeb178e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:28.047124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9f6eb11-1c54-4415-8b76-f9b78aeb178e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:28.894763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9f6eb11-1c54-4415-8b76-f9b78aeb178e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:28.903184 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9f6eb11-1c54-4415-8b76-f9b78aeb178e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1173 microversion: 2.1 time: 0.914181 Jul 20 04:53:28.908029 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3157/6213] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:27 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1173 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:29.839001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-58898992-5f7f-450d-97a9-3535fd404c62 req-bb898cf3-c2eb-4af4-b222-a761bc9e5831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fd4280d-4661-4ba6-bfd2-16eedcb40b3a", "tag": "fcc0db0f-8807-48c4-a456-6e30d5e2bd62"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:29.861976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-58898992-5f7f-450d-97a9-3535fd404c62 req-bb898cf3-c2eb-4af4-b222-a761bc9e5831 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:29.864821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-58898992-5f7f-450d-97a9-3535fd404c62 req-bb898cf3-c2eb-4af4-b222-a761bc9e5831 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:29.881587 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-58898992-5f7f-450d-97a9-3535fd404c62 req-bb898cf3-c2eb-4af4-b222-a761bc9e5831 service nova] Creating event network-changed:fcc0db0f-8807-48c4-a456-6e30d5e2bd62 for instance 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a on n-h2-764485-11 Jul 20 04:53:29.895055 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-58898992-5f7f-450d-97a9-3535fd404c62 req-bb898cf3-c2eb-4af4-b222-a761bc9e5831 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061180 Jul 20 04:53:29.896337 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3057/6214] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:29.926773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9bcaf41e-0ce5-4388-ae76-0dea71ba8532 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:29.927685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9bcaf41e-0ce5-4388-ae76-0dea71ba8532 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:29.943791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bcaf41e-0ce5-4388-ae76-0dea71ba8532 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:29.945165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bcaf41e-0ce5-4388-ae76-0dea71ba8532 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:29.949205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bcaf41e-0ce5-4388-ae76-0dea71ba8532 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:29.949865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bcaf41e-0ce5-4388-ae76-0dea71ba8532 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:30.168545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9bcaf41e-0ce5-4388-ae76-0dea71ba8532 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:30.182774 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9bcaf41e-0ce5-4388-ae76-0dea71ba8532 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1215 microversion: 2.1 time: 0.255995 Jul 20 04:53:30.183768 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3158/6215] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:29 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:31.201143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6d309ece-f087-4f9d-b165-4f40544c5088 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:31.202550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6d309ece-f087-4f9d-b165-4f40544c5088 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:31.212007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d309ece-f087-4f9d-b165-4f40544c5088 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:31.212557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d309ece-f087-4f9d-b165-4f40544c5088 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:31.213439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d309ece-f087-4f9d-b165-4f40544c5088 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:31.213999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6d309ece-f087-4f9d-b165-4f40544c5088 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:31.376688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6d309ece-f087-4f9d-b165-4f40544c5088 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:31.385787 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6d309ece-f087-4f9d-b165-4f40544c5088 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1215 microversion: 2.1 time: 0.189106 Jul 20 04:53:31.386522 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3058/6216] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:31 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1215 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:32.405073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-168abb79-040f-48e7-8a54-0a15f58e673a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:32.406332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-168abb79-040f-48e7-8a54-0a15f58e673a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:32.414982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-168abb79-040f-48e7-8a54-0a15f58e673a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:32.415444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-168abb79-040f-48e7-8a54-0a15f58e673a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:32.416265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-168abb79-040f-48e7-8a54-0a15f58e673a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:32.416722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-168abb79-040f-48e7-8a54-0a15f58e673a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:32.561507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-168abb79-040f-48e7-8a54-0a15f58e673a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:32.570090 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-168abb79-040f-48e7-8a54-0a15f58e673a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1215 microversion: 2.1 time: 0.170684 Jul 20 04:53:32.571078 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3159/6217] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:32 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:33.587356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-83c9f63b-ba8f-41b3-9a3c-b7d0d621ccb9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:33.588675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-83c9f63b-ba8f-41b3-9a3c-b7d0d621ccb9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:33.596590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83c9f63b-ba8f-41b3-9a3c-b7d0d621ccb9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:33.597334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83c9f63b-ba8f-41b3-9a3c-b7d0d621ccb9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:33.598344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83c9f63b-ba8f-41b3-9a3c-b7d0d621ccb9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:33.598875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-83c9f63b-ba8f-41b3-9a3c-b7d0d621ccb9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:33.761793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-83c9f63b-ba8f-41b3-9a3c-b7d0d621ccb9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:33.769671 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-83c9f63b-ba8f-41b3-9a3c-b7d0d621ccb9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1215 microversion: 2.1 time: 0.186336 Jul 20 04:53:33.770362 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3059/6218] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:33 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:34.787040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bcfcbcce-05fc-4e68-aefb-971c2d4eab79 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:34.788048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bcfcbcce-05fc-4e68-aefb-971c2d4eab79 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:34.794363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcfcbcce-05fc-4e68-aefb-971c2d4eab79 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:34.794801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcfcbcce-05fc-4e68-aefb-971c2d4eab79 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:34.795595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcfcbcce-05fc-4e68-aefb-971c2d4eab79 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:34.796035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bcfcbcce-05fc-4e68-aefb-971c2d4eab79 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:34.926774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bcfcbcce-05fc-4e68-aefb-971c2d4eab79 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:34.935733 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bcfcbcce-05fc-4e68-aefb-971c2d4eab79 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1203 microversion: 2.1 time: 0.152816 Jul 20 04:53:34.936326 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3160/6219] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:34 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:35.954748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-af643b4c-10cf-43a6-939d-1c6dbb148fc6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:35.955554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-af643b4c-10cf-43a6-939d-1c6dbb148fc6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:35.958391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:35.959065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:35.967817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af643b4c-10cf-43a6-939d-1c6dbb148fc6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:35.968272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af643b4c-10cf-43a6-939d-1c6dbb148fc6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:35.969093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af643b4c-10cf-43a6-939d-1c6dbb148fc6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:35.969536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-af643b4c-10cf-43a6-939d-1c6dbb148fc6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:36.104911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-af643b4c-10cf-43a6-939d-1c6dbb148fc6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:36.113027 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-af643b4c-10cf-43a6-939d-1c6dbb148fc6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1203 microversion: 2.1 time: 0.162167 Jul 20 04:53:36.113628 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3060/6220] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:35 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:37.130758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9657bcfa-6bf3-467f-999e-c859a1440ffc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:37.131545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9657bcfa-6bf3-467f-999e-c859a1440ffc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:37.135341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:37.141494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9657bcfa-6bf3-467f-999e-c859a1440ffc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:37.142115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9657bcfa-6bf3-467f-999e-c859a1440ffc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:37.142970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9657bcfa-6bf3-467f-999e-c859a1440ffc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:37.143643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9657bcfa-6bf3-467f-999e-c859a1440ffc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:37.286522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9657bcfa-6bf3-467f-999e-c859a1440ffc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:37.295540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9657bcfa-6bf3-467f-999e-c859a1440ffc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1203 microversion: 2.1 time: 0.168685 Jul 20 04:53:37.296172 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3161/6221] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:37 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:38.312943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-edcf12af-5b89-4990-bde6-8f325cda8aa2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:38.313677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-edcf12af-5b89-4990-bde6-8f325cda8aa2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:38.321473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edcf12af-5b89-4990-bde6-8f325cda8aa2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:38.321930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edcf12af-5b89-4990-bde6-8f325cda8aa2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:38.322735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edcf12af-5b89-4990-bde6-8f325cda8aa2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:38.323171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edcf12af-5b89-4990-bde6-8f325cda8aa2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:38.455350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-edcf12af-5b89-4990-bde6-8f325cda8aa2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:38.463354 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-edcf12af-5b89-4990-bde6-8f325cda8aa2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1203 microversion: 2.1 time: 0.154414 Jul 20 04:53:38.463965 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3061/6222] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:38 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:39.480738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-88f064b4-eb7f-40f4-961f-78de73b788c4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:39.481389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-88f064b4-eb7f-40f4-961f-78de73b788c4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:39.488237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88f064b4-eb7f-40f4-961f-78de73b788c4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:39.488693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88f064b4-eb7f-40f4-961f-78de73b788c4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:39.489468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88f064b4-eb7f-40f4-961f-78de73b788c4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:39.489914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-88f064b4-eb7f-40f4-961f-78de73b788c4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:39.625849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-88f064b4-eb7f-40f4-961f-78de73b788c4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:39.634065 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-88f064b4-eb7f-40f4-961f-78de73b788c4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1203 microversion: 2.1 time: 0.157592 Jul 20 04:53:39.634732 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3162/6223] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:39 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:40.652464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-93ea7fcc-0b73-4c95-b890-baa05c959329 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:40.653198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-93ea7fcc-0b73-4c95-b890-baa05c959329 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:40.660147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93ea7fcc-0b73-4c95-b890-baa05c959329 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:40.660594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93ea7fcc-0b73-4c95-b890-baa05c959329 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:40.661355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93ea7fcc-0b73-4c95-b890-baa05c959329 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:40.661813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93ea7fcc-0b73-4c95-b890-baa05c959329 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:40.794438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-93ea7fcc-0b73-4c95-b890-baa05c959329 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:40.802131 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-93ea7fcc-0b73-4c95-b890-baa05c959329 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1203 microversion: 2.1 time: 0.153546 Jul 20 04:53:40.802815 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3062/6224] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:40 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:41.819875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e28d28f5-1430-4f61-b002-7211c12023a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:41.820624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e28d28f5-1430-4f61-b002-7211c12023a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:41.827646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e28d28f5-1430-4f61-b002-7211c12023a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:41.828095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e28d28f5-1430-4f61-b002-7211c12023a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:41.828863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e28d28f5-1430-4f61-b002-7211c12023a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:41.829303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e28d28f5-1430-4f61-b002-7211c12023a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:41.968175 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e28d28f5-1430-4f61-b002-7211c12023a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:41.976199 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e28d28f5-1430-4f61-b002-7211c12023a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1203 microversion: 2.1 time: 0.160635 Jul 20 04:53:41.976788 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3163/6225] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:41 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:42.993751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6c8366cc-6b05-40be-b361-2dd42ad5290c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:42.994373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6c8366cc-6b05-40be-b361-2dd42ad5290c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:43.001432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c8366cc-6b05-40be-b361-2dd42ad5290c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:43.001888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c8366cc-6b05-40be-b361-2dd42ad5290c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:43.002662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c8366cc-6b05-40be-b361-2dd42ad5290c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:43.003108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c8366cc-6b05-40be-b361-2dd42ad5290c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:43.145499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6c8366cc-6b05-40be-b361-2dd42ad5290c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:43.156328 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6c8366cc-6b05-40be-b361-2dd42ad5290c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1203 microversion: 2.1 time: 0.166915 Jul 20 04:53:43.156942 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3063/6226] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:42 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:44.174197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-53a859ff-f248-4deb-8416-cb7efa2e8519 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:44.174832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-53a859ff-f248-4deb-8416-cb7efa2e8519 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:44.182199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53a859ff-f248-4deb-8416-cb7efa2e8519 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:44.182659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53a859ff-f248-4deb-8416-cb7efa2e8519 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:44.183454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53a859ff-f248-4deb-8416-cb7efa2e8519 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:44.184121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53a859ff-f248-4deb-8416-cb7efa2e8519 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:44.316122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-53a859ff-f248-4deb-8416-cb7efa2e8519 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:44.323788 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-53a859ff-f248-4deb-8416-cb7efa2e8519 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1203 microversion: 2.1 time: 0.153907 Jul 20 04:53:44.324364 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3164/6227] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:44 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:44.655495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b00b0789-db24-486f-9080-40dc2fe6f011 req-61fca741-b7ac-47d4-9e19-3e8f241eb651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd4280d-4661-4ba6-bfd2-16eedcb40b3a", "name": "network-vif-plugged", "status": "completed", "tag": "fcc0db0f-8807-48c4-a456-6e30d5e2bd62"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:44.665827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b00b0789-db24-486f-9080-40dc2fe6f011 req-61fca741-b7ac-47d4-9e19-3e8f241eb651 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:44.666284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b00b0789-db24-486f-9080-40dc2fe6f011 req-61fca741-b7ac-47d4-9e19-3e8f241eb651 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:44.680119 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b00b0789-db24-486f-9080-40dc2fe6f011 req-61fca741-b7ac-47d4-9e19-3e8f241eb651 service nova] Creating event network-vif-plugged:fcc0db0f-8807-48c4-a456-6e30d5e2bd62 for instance 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a on n-h2-764485-11 Jul 20 04:53:44.685362 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b00b0789-db24-486f-9080-40dc2fe6f011 req-61fca741-b7ac-47d4-9e19-3e8f241eb651 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033654 Jul 20 04:53:44.685824 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3064/6228] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:53:45.340630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7fe557ba-8e17-4a2c-a62a-0ce5d379b829 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:45.341334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7fe557ba-8e17-4a2c-a62a-0ce5d379b829 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:45.348835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7fe557ba-8e17-4a2c-a62a-0ce5d379b829 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.349303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7fe557ba-8e17-4a2c-a62a-0ce5d379b829 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.350089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7fe557ba-8e17-4a2c-a62a-0ce5d379b829 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.350797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7fe557ba-8e17-4a2c-a62a-0ce5d379b829 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.522372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7fe557ba-8e17-4a2c-a62a-0ce5d379b829 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:45.531047 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7fe557ba-8e17-4a2c-a62a-0ce5d379b829 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1203 microversion: 2.1 time: 0.194347 Jul 20 04:53:45.531915 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3165/6229] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:45 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1203 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:46.549918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b8c8a40c-70ec-4a70-90c1-659cfddce5fb tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:46.550736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b8c8a40c-70ec-4a70-90c1-659cfddce5fb tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:46.557706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8c8a40c-70ec-4a70-90c1-659cfddce5fb tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.558159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8c8a40c-70ec-4a70-90c1-659cfddce5fb tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.558929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8c8a40c-70ec-4a70-90c1-659cfddce5fb tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.559371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8c8a40c-70ec-4a70-90c1-659cfddce5fb tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.691541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b8c8a40c-70ec-4a70-90c1-659cfddce5fb tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:46.699822 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b8c8a40c-70ec-4a70-90c1-659cfddce5fb tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1390 microversion: 2.1 time: 0.155118 Jul 20 04:53:46.700406 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3065/6230] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:46 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:46.716757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-262939ca-d41f-45a3-93e8-fb5c881cea1f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:46.717376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-262939ca-d41f-45a3-93e8-fb5c881cea1f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:46.724739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-262939ca-d41f-45a3-93e8-fb5c881cea1f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.725509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-262939ca-d41f-45a3-93e8-fb5c881cea1f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.726633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-262939ca-d41f-45a3-93e8-fb5c881cea1f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.727080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-262939ca-d41f-45a3-93e8-fb5c881cea1f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.864417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-262939ca-d41f-45a3-93e8-fb5c881cea1f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:46.872510 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-262939ca-d41f-45a3-93e8-fb5c881cea1f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1390 microversion: 2.1 time: 0.159779 Jul 20 04:53:46.873097 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3166/6231] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:46 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:46.888799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-38366db4-1799-4036-b9ae-ba4bb7f6014b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:46.889508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-38366db4-1799-4036-b9ae-ba4bb7f6014b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:46.895971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38366db4-1799-4036-b9ae-ba4bb7f6014b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.896430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38366db4-1799-4036-b9ae-ba4bb7f6014b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.897832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38366db4-1799-4036-b9ae-ba4bb7f6014b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.898283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38366db4-1799-4036-b9ae-ba4bb7f6014b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.042588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-38366db4-1799-4036-b9ae-ba4bb7f6014b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:47.056684 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-38366db4-1799-4036-b9ae-ba4bb7f6014b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1390 microversion: 2.1 time: 0.171615 Jul 20 04:53:47.057292 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3066/6232] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:46 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:47.073399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5aa168f-4f57-449b-9d7c-1f27f567a96f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:47.074079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d5aa168f-4f57-449b-9d7c-1f27f567a96f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:47.080386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5aa168f-4f57-449b-9d7c-1f27f567a96f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:47.080914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5aa168f-4f57-449b-9d7c-1f27f567a96f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.081726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5aa168f-4f57-449b-9d7c-1f27f567a96f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:47.082167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5aa168f-4f57-449b-9d7c-1f27f567a96f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.108801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d5aa168f-4f57-449b-9d7c-1f27f567a96f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:53:47.194941 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d5aa168f-4f57-449b-9d7c-1f27f567a96f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 204 len: 0 microversion: 2.1 time: 0.125535 Jul 20 04:53:47.196088 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3167/6233] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:53:47 2022] DELETE /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:53:47.204414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b8677d4e-93a2-4f3b-9c40-d27a83cbae78 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:47.204966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b8677d4e-93a2-4f3b-9c40-d27a83cbae78 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:47.211631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8677d4e-93a2-4f3b-9c40-d27a83cbae78 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:47.212086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8677d4e-93a2-4f3b-9c40-d27a83cbae78 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.212859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8677d4e-93a2-4f3b-9c40-d27a83cbae78 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:47.213282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b8677d4e-93a2-4f3b-9c40-d27a83cbae78 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.352277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b8677d4e-93a2-4f3b-9c40-d27a83cbae78 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:47.361231 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b8677d4e-93a2-4f3b-9c40-d27a83cbae78 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1396 microversion: 2.1 time: 0.160821 Jul 20 04:53:47.361825 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3067/6234] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:47 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1396 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:48.379914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-37fd177c-d573-406a-8f60-09779937d49d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:48.380723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-37fd177c-d573-406a-8f60-09779937d49d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:48.387927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37fd177c-d573-406a-8f60-09779937d49d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.388389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37fd177c-d573-406a-8f60-09779937d49d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.389177 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37fd177c-d573-406a-8f60-09779937d49d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.389641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37fd177c-d573-406a-8f60-09779937d49d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.529580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-37fd177c-d573-406a-8f60-09779937d49d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:48.538641 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-37fd177c-d573-406a-8f60-09779937d49d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1396 microversion: 2.1 time: 0.162768 Jul 20 04:53:48.539779 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3168/6235] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:48 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1396 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:49.559123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b2616cf9-1a7d-4341-887a-5498db208c2c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:49.559849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b2616cf9-1a7d-4341-887a-5498db208c2c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:49.569837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2616cf9-1a7d-4341-887a-5498db208c2c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.571259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2616cf9-1a7d-4341-887a-5498db208c2c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.572544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2616cf9-1a7d-4341-887a-5498db208c2c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.573702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b2616cf9-1a7d-4341-887a-5498db208c2c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.600635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ea289f2c-732e-4df7-8a55-d899200cf4e1 req-b66cf7d0-b22e-4491-a7a2-a4ef964e1ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd4280d-4661-4ba6-bfd2-16eedcb40b3a", "name": "network-vif-deleted", "tag": "fcc0db0f-8807-48c4-a456-6e30d5e2bd62"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:49.610238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ea289f2c-732e-4df7-8a55-d899200cf4e1 req-b66cf7d0-b22e-4491-a7a2-a4ef964e1ef9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.610891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ea289f2c-732e-4df7-8a55-d899200cf4e1 req-b66cf7d0-b22e-4491-a7a2-a4ef964e1ef9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.628654 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ea289f2c-732e-4df7-8a55-d899200cf4e1 req-b66cf7d0-b22e-4491-a7a2-a4ef964e1ef9 service nova] Creating event network-vif-deleted:fcc0db0f-8807-48c4-a456-6e30d5e2bd62 for instance 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a on n-h2-764485-11 Jul 20 04:53:49.634858 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ea289f2c-732e-4df7-8a55-d899200cf4e1 req-b66cf7d0-b22e-4491-a7a2-a4ef964e1ef9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219870 Jul 20 04:53:49.635917 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3068/6236] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:49.681205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b2616cf9-1a7d-4341-887a-5498db208c2c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:49.689548 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b2616cf9-1a7d-4341-887a-5498db208c2c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1188 microversion: 2.1 time: 0.136440 Jul 20 04:53:49.690141 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3169/6237] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:49 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1188 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:50.707020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee98b007-5f33-47da-a5fc-78bd076a13f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:50.708399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ee98b007-5f33-47da-a5fc-78bd076a13f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:50.716581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee98b007-5f33-47da-a5fc-78bd076a13f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:50.717229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee98b007-5f33-47da-a5fc-78bd076a13f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:50.718018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee98b007-5f33-47da-a5fc-78bd076a13f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:50.718467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee98b007-5f33-47da-a5fc-78bd076a13f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:50.802594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ee98b007-5f33-47da-a5fc-78bd076a13f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:50.811132 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ee98b007-5f33-47da-a5fc-78bd076a13f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1188 microversion: 2.1 time: 0.108550 Jul 20 04:53:50.811757 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3069/6238] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:50 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1188 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:51.829187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-099f0e19-19f0-4ae6-9d1c-b55d937e56d6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:51.830597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-099f0e19-19f0-4ae6-9d1c-b55d937e56d6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:51.838752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-099f0e19-19f0-4ae6-9d1c-b55d937e56d6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:51.839211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-099f0e19-19f0-4ae6-9d1c-b55d937e56d6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:51.840025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-099f0e19-19f0-4ae6-9d1c-b55d937e56d6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:51.840472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-099f0e19-19f0-4ae6-9d1c-b55d937e56d6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:51.908993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-099f0e19-19f0-4ae6-9d1c-b55d937e56d6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:51.917693 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-099f0e19-19f0-4ae6-9d1c-b55d937e56d6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1188 microversion: 2.1 time: 0.092546 Jul 20 04:53:51.918298 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3170/6239] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:51 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:52.935097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-11fc5bfc-85ca-443f-9fe0-f0337dc48e9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:52.935910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-11fc5bfc-85ca-443f-9fe0-f0337dc48e9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:52.943582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11fc5bfc-85ca-443f-9fe0-f0337dc48e9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.945108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11fc5bfc-85ca-443f-9fe0-f0337dc48e9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.947037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11fc5bfc-85ca-443f-9fe0-f0337dc48e9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.947664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11fc5bfc-85ca-443f-9fe0-f0337dc48e9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:53.015663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-11fc5bfc-85ca-443f-9fe0-f0337dc48e9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:53.024830 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-11fc5bfc-85ca-443f-9fe0-f0337dc48e9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1188 microversion: 2.1 time: 0.093765 Jul 20 04:53:53.025629 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3070/6240] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:52 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:54.043887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-413605be-22dd-4e68-90a2-ee4490237f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:54.044893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-413605be-22dd-4e68-90a2-ee4490237f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:54.056618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-413605be-22dd-4e68-90a2-ee4490237f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:54.057408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-413605be-22dd-4e68-90a2-ee4490237f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:54.058730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-413605be-22dd-4e68-90a2-ee4490237f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:54.059485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-413605be-22dd-4e68-90a2-ee4490237f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:54.103287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-413605be-22dd-4e68-90a2-ee4490237f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:54.103777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-413605be-22dd-4e68-90a2-ee4490237f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:54.104512 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-413605be-22dd-4e68-90a2-ee4490237f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lazy-loading 'fault' on Instance uuid 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:53:54.108957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:54.157209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-413605be-22dd-4e68-90a2-ee4490237f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:54.165861 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-413605be-22dd-4e68-90a2-ee4490237f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 200 len: 1193 microversion: 2.1 time: 0.126987 Jul 20 04:53:54.175702 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3171/6241] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:54 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 1193 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:55.183779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e52fefc5-89ef-4821-9974-94db512a6658 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:55.184391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e52fefc5-89ef-4821-9974-94db512a6658 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:55.187326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:55.193190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e52fefc5-89ef-4821-9974-94db512a6658 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:55.193738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e52fefc5-89ef-4821-9974-94db512a6658 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:55.194958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e52fefc5-89ef-4821-9974-94db512a6658 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:55.195464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e52fefc5-89ef-4821-9974-94db512a6658 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:55.200743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=81 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:55.211712 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e52fefc5-89ef-4821-9974-94db512a6658 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a could not be found. Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e52fefc5-89ef-4821-9974-94db512a6658 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a HTTP/1.1 Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a could not be found. Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '1fd4280d-4661-4ba6-bfd2-16eedcb40b3a'} Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a could not be found. Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a could not be found. Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:55.213665 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:53:55.218422 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:55.218422 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:55.218422 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:55.218422 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:53:55.218422 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:53:55.218422 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a could not be found. Jul 20 04:53:55.218422 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:53:55.218422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e52fefc5-89ef-4821-9974-94db512a6658 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance 1fd4280d-4661-4ba6-bfd2-16eedcb40b3a could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:53:55.218422 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e52fefc5-89ef-4821-9974-94db512a6658 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a" status: 404 len: 111 microversion: 2.1 time: 0.035298 Jul 20 04:53:55.218422 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3071/6242] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:55 2022] GET /compute/v2.1/servers/1fd4280d-4661-4ba6-bfd2-16eedcb40b3a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:54:17.404411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2121515000", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b2f773cf-ba3e-4712-8c41-c5305df66442", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "1e46ee9e-198e-401c-88a3-4979bd7d9aaf"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:17.412933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:17.414385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:17.497417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] validate_networks() for [('1e46ee9e-198e-401c-88a3-4979bd7d9aaf', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:54:17.991225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:54:17.991940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:54:17.992781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:54:17.993302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:54:17.993723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:54:18.002901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:18.003356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:18.004179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:18.004615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:18.024580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:54:18.029425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for user 1f70af961f624dceba390cb44ef2a792 and project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:54:18.045414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:54:18.047408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b2f773cf-ba3e-4712-8c41-c5305df66442',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:54:18.122473 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-28a55a8f-f124-4bf3-82f2-8b62b449f4ac tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721918 Jul 20 04:54:18.123668 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3172/6243] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:54:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:54:18.134469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5eefb042-a537-46eb-abcd-32508e9332c7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:18.135160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5eefb042-a537-46eb-abcd-32508e9332c7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:18.137732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:18.138530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:18.203184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5eefb042-a537-46eb-abcd-32508e9332c7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:18.211321 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5eefb042-a537-46eb-abcd-32508e9332c7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1057 microversion: 2.1 time: 0.081155 Jul 20 04:54:18.211938 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3072/6244] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:18 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1057 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:19.230945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-86d331cd-a8bc-43f7-9072-d9dbd0d99b15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:19.231595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-86d331cd-a8bc-43f7-9072-d9dbd0d99b15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:19.261202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86d331cd-a8bc-43f7-9072-d9dbd0d99b15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:19.264084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86d331cd-a8bc-43f7-9072-d9dbd0d99b15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:19.265166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86d331cd-a8bc-43f7-9072-d9dbd0d99b15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:19.265808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-86d331cd-a8bc-43f7-9072-d9dbd0d99b15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:19.371566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-86d331cd-a8bc-43f7-9072-d9dbd0d99b15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:19.381885 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-86d331cd-a8bc-43f7-9072-d9dbd0d99b15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1127 microversion: 2.1 time: 0.156696 Jul 20 04:54:19.382969 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3173/6245] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:19 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1127 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:20.399970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-99d66808-5863-43e7-af75-822ee9ed9c15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:20.401656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-99d66808-5863-43e7-af75-822ee9ed9c15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:20.412850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99d66808-5863-43e7-af75-822ee9ed9c15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:20.415383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99d66808-5863-43e7-af75-822ee9ed9c15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:20.416247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99d66808-5863-43e7-af75-822ee9ed9c15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:20.416701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-99d66808-5863-43e7-af75-822ee9ed9c15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:20.659948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-99d66808-5863-43e7-af75-822ee9ed9c15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:20.670899 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-99d66808-5863-43e7-af75-822ee9ed9c15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1169 microversion: 2.1 time: 0.275144 Jul 20 04:54:20.671503 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3073/6246] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:20 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1169 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:20.724572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6934fdc1-a3af-405f-b683-25e2eee72a30 req-ee0876ad-7c9d-49c2-a8c4-1cd04d0f0b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a259359e-d7d5-4a82-a667-6716f64ecf6a", "tag": "d672e929-c019-4b25-9fad-b7cbb6cbf9ab"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:20.740211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6934fdc1-a3af-405f-b683-25e2eee72a30 req-ee0876ad-7c9d-49c2-a8c4-1cd04d0f0b38 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:20.740664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6934fdc1-a3af-405f-b683-25e2eee72a30 req-ee0876ad-7c9d-49c2-a8c4-1cd04d0f0b38 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:20.756421 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6934fdc1-a3af-405f-b683-25e2eee72a30 req-ee0876ad-7c9d-49c2-a8c4-1cd04d0f0b38 service nova] Creating event network-changed:d672e929-c019-4b25-9fad-b7cbb6cbf9ab for instance a259359e-d7d5-4a82-a667-6716f64ecf6a on n-h1-764485-11 Jul 20 04:54:20.761609 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6934fdc1-a3af-405f-b683-25e2eee72a30 req-ee0876ad-7c9d-49c2-a8c4-1cd04d0f0b38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042698 Jul 20 04:54:20.762823 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3174/6247] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:21.688434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e32b760c-ea02-441d-b996-4c14d21189d1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:21.689674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e32b760c-ea02-441d-b996-4c14d21189d1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:21.699060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e32b760c-ea02-441d-b996-4c14d21189d1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:21.699785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e32b760c-ea02-441d-b996-4c14d21189d1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:21.700781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e32b760c-ea02-441d-b996-4c14d21189d1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:21.701543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e32b760c-ea02-441d-b996-4c14d21189d1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:21.902656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e32b760c-ea02-441d-b996-4c14d21189d1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:21.916192 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e32b760c-ea02-441d-b996-4c14d21189d1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1169 microversion: 2.1 time: 0.231714 Jul 20 04:54:21.917059 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3074/6248] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:21 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1169 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:22.933609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-02d5c8e6-8e6c-4ff2-854a-be41ad5f660a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:22.934690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-02d5c8e6-8e6c-4ff2-854a-be41ad5f660a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:22.947083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02d5c8e6-8e6c-4ff2-854a-be41ad5f660a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:22.947690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02d5c8e6-8e6c-4ff2-854a-be41ad5f660a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:22.948540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02d5c8e6-8e6c-4ff2-854a-be41ad5f660a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:22.950510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-02d5c8e6-8e6c-4ff2-854a-be41ad5f660a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:23.135879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-02d5c8e6-8e6c-4ff2-854a-be41ad5f660a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:23.145712 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-02d5c8e6-8e6c-4ff2-854a-be41ad5f660a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1169 microversion: 2.1 time: 0.216426 Jul 20 04:54:23.146711 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3175/6249] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:22 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1169 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:24.166282 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-be84bbcc-0c78-4839-b259-84776878ffaf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:24.167003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-be84bbcc-0c78-4839-b259-84776878ffaf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:24.176184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be84bbcc-0c78-4839-b259-84776878ffaf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:24.176650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be84bbcc-0c78-4839-b259-84776878ffaf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:24.177725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be84bbcc-0c78-4839-b259-84776878ffaf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:24.177974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be84bbcc-0c78-4839-b259-84776878ffaf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:24.386094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-be84bbcc-0c78-4839-b259-84776878ffaf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:24.395581 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-be84bbcc-0c78-4839-b259-84776878ffaf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1169 microversion: 2.1 time: 0.234503 Jul 20 04:54:24.407292 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3075/6250] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:24 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1169 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:25.419672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-41a84120-0fb7-4fbd-a193-81925d5a667d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:25.421119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-41a84120-0fb7-4fbd-a193-81925d5a667d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:25.429010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41a84120-0fb7-4fbd-a193-81925d5a667d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.430050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41a84120-0fb7-4fbd-a193-81925d5a667d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.431018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41a84120-0fb7-4fbd-a193-81925d5a667d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.431672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41a84120-0fb7-4fbd-a193-81925d5a667d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.630773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-41a84120-0fb7-4fbd-a193-81925d5a667d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:25.639356 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-41a84120-0fb7-4fbd-a193-81925d5a667d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1169 microversion: 2.1 time: 0.224733 Jul 20 04:54:25.649918 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3176/6251] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:25 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1169 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:26.662594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3ba59d6b-3362-46c3-8a6d-1997c78fb406 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:26.664753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3ba59d6b-3362-46c3-8a6d-1997c78fb406 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:26.684979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ba59d6b-3362-46c3-8a6d-1997c78fb406 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:26.686251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ba59d6b-3362-46c3-8a6d-1997c78fb406 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:26.688892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ba59d6b-3362-46c3-8a6d-1997c78fb406 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:26.689708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3ba59d6b-3362-46c3-8a6d-1997c78fb406 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:26.871348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3ba59d6b-3362-46c3-8a6d-1997c78fb406 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:26.891189 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3ba59d6b-3362-46c3-8a6d-1997c78fb406 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1169 microversion: 2.1 time: 0.237527 Jul 20 04:54:26.892507 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3076/6252] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:26 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1169 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:27.910375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1c3cb177-d8b0-4846-9f82-e4c74aea189b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:27.911617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1c3cb177-d8b0-4846-9f82-e4c74aea189b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:27.926191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c3cb177-d8b0-4846-9f82-e4c74aea189b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.926664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c3cb177-d8b0-4846-9f82-e4c74aea189b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.927456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c3cb177-d8b0-4846-9f82-e4c74aea189b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.927936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c3cb177-d8b0-4846-9f82-e4c74aea189b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:28.012920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:28.037254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:28.150213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1c3cb177-d8b0-4846-9f82-e4c74aea189b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:28.170509 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1c3cb177-d8b0-4846-9f82-e4c74aea189b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1169 microversion: 2.1 time: 0.264651 Jul 20 04:54:28.172237 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3177/6253] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:27 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1169 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:29.194357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3656a8b2-88de-4e5a-b911-64aa3da364ca tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:29.195263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3656a8b2-88de-4e5a-b911-64aa3da364ca tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:29.199115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:29.205228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3656a8b2-88de-4e5a-b911-64aa3da364ca tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:29.205697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3656a8b2-88de-4e5a-b911-64aa3da364ca tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:29.206552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3656a8b2-88de-4e5a-b911-64aa3da364ca tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:29.207039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3656a8b2-88de-4e5a-b911-64aa3da364ca tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:29.373928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3656a8b2-88de-4e5a-b911-64aa3da364ca tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:29.382887 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3656a8b2-88de-4e5a-b911-64aa3da364ca tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1169 microversion: 2.1 time: 0.198137 Jul 20 04:54:29.383812 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3077/6254] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:29 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1169 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:30.401041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-58457f4b-b715-4010-8df4-128e9681e623 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:30.401862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-58457f4b-b715-4010-8df4-128e9681e623 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:30.419633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58457f4b-b715-4010-8df4-128e9681e623 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:30.420185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58457f4b-b715-4010-8df4-128e9681e623 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:30.421039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58457f4b-b715-4010-8df4-128e9681e623 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:30.421483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-58457f4b-b715-4010-8df4-128e9681e623 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:30.595871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-58457f4b-b715-4010-8df4-128e9681e623 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:30.605621 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-58457f4b-b715-4010-8df4-128e9681e623 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1169 microversion: 2.1 time: 0.209252 Jul 20 04:54:30.607663 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3178/6255] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:30 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1169 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:31.623452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-520a95d2-407a-46ab-8eae-b0576ca3f13f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:31.624045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-520a95d2-407a-46ab-8eae-b0576ca3f13f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:31.631330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-520a95d2-407a-46ab-8eae-b0576ca3f13f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:31.631940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-520a95d2-407a-46ab-8eae-b0576ca3f13f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:31.632917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-520a95d2-407a-46ab-8eae-b0576ca3f13f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:31.633375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-520a95d2-407a-46ab-8eae-b0576ca3f13f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:31.776742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-520a95d2-407a-46ab-8eae-b0576ca3f13f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:31.784721 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-520a95d2-407a-46ab-8eae-b0576ca3f13f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1169 microversion: 2.1 time: 0.165528 Jul 20 04:54:31.785294 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3078/6256] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:31 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1169 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:32.805048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cf5c239a-76a7-41f3-b7a2-61a4743f393d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:32.805754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cf5c239a-76a7-41f3-b7a2-61a4743f393d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:32.812232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf5c239a-76a7-41f3-b7a2-61a4743f393d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:32.812910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf5c239a-76a7-41f3-b7a2-61a4743f393d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:32.813759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf5c239a-76a7-41f3-b7a2-61a4743f393d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:32.814281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf5c239a-76a7-41f3-b7a2-61a4743f393d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:32.959104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cf5c239a-76a7-41f3-b7a2-61a4743f393d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:32.967384 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cf5c239a-76a7-41f3-b7a2-61a4743f393d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1169 microversion: 2.1 time: 0.167990 Jul 20 04:54:32.968351 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3179/6257] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:32 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1169 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:33.984567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c1da1052-fa86-4f34-a745-d2ef81549fc2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:33.985253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c1da1052-fa86-4f34-a745-d2ef81549fc2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:33.992770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1da1052-fa86-4f34-a745-d2ef81549fc2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:33.993232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1da1052-fa86-4f34-a745-d2ef81549fc2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:33.994023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1da1052-fa86-4f34-a745-d2ef81549fc2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:33.994472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1da1052-fa86-4f34-a745-d2ef81549fc2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:34.166399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c1da1052-fa86-4f34-a745-d2ef81549fc2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:34.174036 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c1da1052-fa86-4f34-a745-d2ef81549fc2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1215 microversion: 2.1 time: 0.193362 Jul 20 04:54:34.174885 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3079/6258] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:33 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:35.191216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61e92d8e-2b12-48d4-8d3b-dc10ceaaec16 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:35.191919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-61e92d8e-2b12-48d4-8d3b-dc10ceaaec16 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:35.199823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61e92d8e-2b12-48d4-8d3b-dc10ceaaec16 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:35.200287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61e92d8e-2b12-48d4-8d3b-dc10ceaaec16 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:35.201068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61e92d8e-2b12-48d4-8d3b-dc10ceaaec16 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:35.201519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-61e92d8e-2b12-48d4-8d3b-dc10ceaaec16 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:35.345824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-61e92d8e-2b12-48d4-8d3b-dc10ceaaec16 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:35.354953 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-61e92d8e-2b12-48d4-8d3b-dc10ceaaec16 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1203 microversion: 2.1 time: 0.167351 Jul 20 04:54:35.355795 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3180/6259] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:35 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:36.373076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2156607-5f7c-4124-8118-91091ea3603f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:36.373705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a2156607-5f7c-4124-8118-91091ea3603f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:36.381014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2156607-5f7c-4124-8118-91091ea3603f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:36.382006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2156607-5f7c-4124-8118-91091ea3603f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:36.382792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2156607-5f7c-4124-8118-91091ea3603f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:36.383238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2156607-5f7c-4124-8118-91091ea3603f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:36.517414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a2156607-5f7c-4124-8118-91091ea3603f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:36.525136 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2156607-5f7c-4124-8118-91091ea3603f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1203 microversion: 2.1 time: 0.155969 Jul 20 04:54:36.531712 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3080/6260] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:36 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:37.542395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f197e0df-5b94-4ce0-bb7d-673ff8be22b2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:37.543143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f197e0df-5b94-4ce0-bb7d-673ff8be22b2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:37.550403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f197e0df-5b94-4ce0-bb7d-673ff8be22b2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:37.550867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f197e0df-5b94-4ce0-bb7d-673ff8be22b2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:37.551695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f197e0df-5b94-4ce0-bb7d-673ff8be22b2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:37.552146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f197e0df-5b94-4ce0-bb7d-673ff8be22b2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:37.694649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f197e0df-5b94-4ce0-bb7d-673ff8be22b2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:37.704124 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f197e0df-5b94-4ce0-bb7d-673ff8be22b2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1203 microversion: 2.1 time: 0.165697 Jul 20 04:54:37.704757 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3181/6261] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:37 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:38.720812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-878904b8-f5b3-409c-9fcb-8e9feb260900 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:38.721417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-878904b8-f5b3-409c-9fcb-8e9feb260900 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:38.729303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-878904b8-f5b3-409c-9fcb-8e9feb260900 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:38.730035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-878904b8-f5b3-409c-9fcb-8e9feb260900 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:38.730813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-878904b8-f5b3-409c-9fcb-8e9feb260900 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:38.731255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-878904b8-f5b3-409c-9fcb-8e9feb260900 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:38.869054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-878904b8-f5b3-409c-9fcb-8e9feb260900 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:38.877555 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-878904b8-f5b3-409c-9fcb-8e9feb260900 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1203 microversion: 2.1 time: 0.160532 Jul 20 04:54:38.878151 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3081/6262] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:38 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:39.896072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a6b521dc-083b-4b5c-bd44-604ec8180524 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:39.896692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a6b521dc-083b-4b5c-bd44-604ec8180524 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:39.904304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6b521dc-083b-4b5c-bd44-604ec8180524 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:39.904762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6b521dc-083b-4b5c-bd44-604ec8180524 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:39.905534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6b521dc-083b-4b5c-bd44-604ec8180524 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:39.905994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a6b521dc-083b-4b5c-bd44-604ec8180524 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:40.045575 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a6b521dc-083b-4b5c-bd44-604ec8180524 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:40.053418 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a6b521dc-083b-4b5c-bd44-604ec8180524 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1203 microversion: 2.1 time: 0.161246 Jul 20 04:54:40.054212 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3182/6263] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:39 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:41.071492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b9d66440-a937-4f25-a44a-9d3b55401b87 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:41.072281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b9d66440-a937-4f25-a44a-9d3b55401b87 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:41.079606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9d66440-a937-4f25-a44a-9d3b55401b87 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:41.080372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9d66440-a937-4f25-a44a-9d3b55401b87 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:41.081160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9d66440-a937-4f25-a44a-9d3b55401b87 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:41.081608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b9d66440-a937-4f25-a44a-9d3b55401b87 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:41.225015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b9d66440-a937-4f25-a44a-9d3b55401b87 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:41.233316 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b9d66440-a937-4f25-a44a-9d3b55401b87 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1203 microversion: 2.1 time: 0.166944 Jul 20 04:54:41.243383 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3082/6264] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:41 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:42.250274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6bc3642f-0da1-477f-a9ef-4b43791632ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:42.250900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6bc3642f-0da1-477f-a9ef-4b43791632ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:42.259558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6bc3642f-0da1-477f-a9ef-4b43791632ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:42.260014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6bc3642f-0da1-477f-a9ef-4b43791632ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:42.260816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6bc3642f-0da1-477f-a9ef-4b43791632ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:42.261261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6bc3642f-0da1-477f-a9ef-4b43791632ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:42.419759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6bc3642f-0da1-477f-a9ef-4b43791632ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:42.428068 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6bc3642f-0da1-477f-a9ef-4b43791632ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1203 microversion: 2.1 time: 0.181669 Jul 20 04:54:42.428712 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3183/6265] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:42 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1203 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:43.445585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cfebff7e-3aed-4964-ac1c-f1072eb40226 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:43.446295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cfebff7e-3aed-4964-ac1c-f1072eb40226 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:43.453685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfebff7e-3aed-4964-ac1c-f1072eb40226 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:43.454151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfebff7e-3aed-4964-ac1c-f1072eb40226 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:43.454974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfebff7e-3aed-4964-ac1c-f1072eb40226 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:43.455421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cfebff7e-3aed-4964-ac1c-f1072eb40226 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:43.606389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cfebff7e-3aed-4964-ac1c-f1072eb40226 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:43.614031 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cfebff7e-3aed-4964-ac1c-f1072eb40226 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1203 microversion: 2.1 time: 0.173247 Jul 20 04:54:43.624026 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3083/6266] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:43 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:44.631546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-89670d2c-a780-4bb4-a5f5-616b33d410f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:44.632293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-89670d2c-a780-4bb4-a5f5-616b33d410f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:44.639530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89670d2c-a780-4bb4-a5f5-616b33d410f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:44.639999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89670d2c-a780-4bb4-a5f5-616b33d410f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:44.640788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89670d2c-a780-4bb4-a5f5-616b33d410f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:44.641234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89670d2c-a780-4bb4-a5f5-616b33d410f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:44.777737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-89670d2c-a780-4bb4-a5f5-616b33d410f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:44.785427 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-89670d2c-a780-4bb4-a5f5-616b33d410f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1203 microversion: 2.1 time: 0.157878 Jul 20 04:54:44.786003 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3184/6267] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:44 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:45.802289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8db7ce6a-061b-47c5-8b3a-4142aed59715 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:45.802905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8db7ce6a-061b-47c5-8b3a-4142aed59715 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:45.810001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8db7ce6a-061b-47c5-8b3a-4142aed59715 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:45.810450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8db7ce6a-061b-47c5-8b3a-4142aed59715 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:45.811234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8db7ce6a-061b-47c5-8b3a-4142aed59715 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:45.811697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8db7ce6a-061b-47c5-8b3a-4142aed59715 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:45.946076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8db7ce6a-061b-47c5-8b3a-4142aed59715 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:45.953912 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8db7ce6a-061b-47c5-8b3a-4142aed59715 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1203 microversion: 2.1 time: 0.155642 Jul 20 04:54:45.954598 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3084/6268] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:45 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:46.634284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-98ef7157-9ed8-4a69-acb1-0333512460b9 req-72e051fa-ae20-4e3f-a2b7-c94ab43795e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a259359e-d7d5-4a82-a667-6716f64ecf6a", "name": "network-vif-plugged", "status": "completed", "tag": "d672e929-c019-4b25-9fad-b7cbb6cbf9ab"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:46.643355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-98ef7157-9ed8-4a69-acb1-0333512460b9 req-72e051fa-ae20-4e3f-a2b7-c94ab43795e0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:46.643847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-98ef7157-9ed8-4a69-acb1-0333512460b9 req-72e051fa-ae20-4e3f-a2b7-c94ab43795e0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:46.660424 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-98ef7157-9ed8-4a69-acb1-0333512460b9 req-72e051fa-ae20-4e3f-a2b7-c94ab43795e0 service nova] Creating event network-vif-plugged:d672e929-c019-4b25-9fad-b7cbb6cbf9ab for instance a259359e-d7d5-4a82-a667-6716f64ecf6a on n-h1-764485-11 Jul 20 04:54:46.667781 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-98ef7157-9ed8-4a69-acb1-0333512460b9 req-72e051fa-ae20-4e3f-a2b7-c94ab43795e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036621 Jul 20 04:54:46.668425 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3185/6269] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:46.971691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6ef02f38-0927-443d-b2a8-b0d2f331f2a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:46.973520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6ef02f38-0927-443d-b2a8-b0d2f331f2a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:46.982689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ef02f38-0927-443d-b2a8-b0d2f331f2a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:46.983073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ef02f38-0927-443d-b2a8-b0d2f331f2a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:46.983889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ef02f38-0927-443d-b2a8-b0d2f331f2a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:46.984334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6ef02f38-0927-443d-b2a8-b0d2f331f2a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:47.117298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6ef02f38-0927-443d-b2a8-b0d2f331f2a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:47.124961 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6ef02f38-0927-443d-b2a8-b0d2f331f2a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1203 microversion: 2.1 time: 0.157266 Jul 20 04:54:47.125805 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3085/6270] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:46 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:48.144035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-47fc41e8-9f84-4ead-ab2e-df583cca4a43 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:48.144737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-47fc41e8-9f84-4ead-ab2e-df583cca4a43 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:48.146716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:48.153402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47fc41e8-9f84-4ead-ab2e-df583cca4a43 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:48.153862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47fc41e8-9f84-4ead-ab2e-df583cca4a43 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:48.154640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47fc41e8-9f84-4ead-ab2e-df583cca4a43 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:48.155084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47fc41e8-9f84-4ead-ab2e-df583cca4a43 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:48.160144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=73 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:48.310651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-47fc41e8-9f84-4ead-ab2e-df583cca4a43 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:48.318344 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-47fc41e8-9f84-4ead-ab2e-df583cca4a43 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1203 microversion: 2.1 time: 0.179635 Jul 20 04:54:48.319802 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3186/6271] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:48 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1203 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:49.335992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b2ec29ea-32d4-4995-9290-18155896599a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:49.336615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b2ec29ea-32d4-4995-9290-18155896599a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:49.341483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=31 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:49.347538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2ec29ea-32d4-4995-9290-18155896599a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:49.347987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2ec29ea-32d4-4995-9290-18155896599a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:49.348868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2ec29ea-32d4-4995-9290-18155896599a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:49.349338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2ec29ea-32d4-4995-9290-18155896599a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:49.352465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=79 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:49.488555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b2ec29ea-32d4-4995-9290-18155896599a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:49.497954 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b2ec29ea-32d4-4995-9290-18155896599a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1391 microversion: 2.1 time: 0.166327 Jul 20 04:54:49.498581 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3086/6272] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:49 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:49.514673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fbd4a2a9-2e4e-44a8-829d-5ce5963a4fe3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:49.515476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fbd4a2a9-2e4e-44a8-829d-5ce5963a4fe3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:49.522927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbd4a2a9-2e4e-44a8-829d-5ce5963a4fe3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:49.523466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbd4a2a9-2e4e-44a8-829d-5ce5963a4fe3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:49.524340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbd4a2a9-2e4e-44a8-829d-5ce5963a4fe3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:49.524888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbd4a2a9-2e4e-44a8-829d-5ce5963a4fe3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:49.664014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fbd4a2a9-2e4e-44a8-829d-5ce5963a4fe3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:49.672439 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fbd4a2a9-2e4e-44a8-829d-5ce5963a4fe3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1391 microversion: 2.1 time: 0.161739 Jul 20 04:54:49.673036 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3187/6273] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:49 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:49.688669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-36ce534c-ff26-4b4d-b935-2c11b1514c3c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:49.689290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-36ce534c-ff26-4b4d-b935-2c11b1514c3c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:49.695647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-36ce534c-ff26-4b4d-b935-2c11b1514c3c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:49.696106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-36ce534c-ff26-4b4d-b935-2c11b1514c3c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:49.696878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-36ce534c-ff26-4b4d-b935-2c11b1514c3c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:49.697320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-36ce534c-ff26-4b4d-b935-2c11b1514c3c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:49.831876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-36ce534c-ff26-4b4d-b935-2c11b1514c3c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:49.840308 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-36ce534c-ff26-4b4d-b935-2c11b1514c3c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1391 microversion: 2.1 time: 0.155455 Jul 20 04:54:49.840899 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3087/6274] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:49 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:49.910132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8dfc6ba7-b0ad-43e2-8bc4-1c88fb0e8b2d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:49.910643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8dfc6ba7-b0ad-43e2-8bc4-1c88fb0e8b2d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:49.917468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8dfc6ba7-b0ad-43e2-8bc4-1c88fb0e8b2d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:49.917927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8dfc6ba7-b0ad-43e2-8bc4-1c88fb0e8b2d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:49.918699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8dfc6ba7-b0ad-43e2-8bc4-1c88fb0e8b2d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:49.919176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8dfc6ba7-b0ad-43e2-8bc4-1c88fb0e8b2d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:49.944202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8dfc6ba7-b0ad-43e2-8bc4-1c88fb0e8b2d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:54:50.031002 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8dfc6ba7-b0ad-43e2-8bc4-1c88fb0e8b2d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 204 len: 0 microversion: 2.1 time: 0.124313 Jul 20 04:54:50.033102 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3188/6275] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:54:49 2022] DELETE /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:54:50.044092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a78c3acc-0df6-4dc8-8c03-03b0fbcb694c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:50.049303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a78c3acc-0df6-4dc8-8c03-03b0fbcb694c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:50.057769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a78c3acc-0df6-4dc8-8c03-03b0fbcb694c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:50.058219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a78c3acc-0df6-4dc8-8c03-03b0fbcb694c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:50.059002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a78c3acc-0df6-4dc8-8c03-03b0fbcb694c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:50.059447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a78c3acc-0df6-4dc8-8c03-03b0fbcb694c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:50.196565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a78c3acc-0df6-4dc8-8c03-03b0fbcb694c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:50.204626 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a78c3acc-0df6-4dc8-8c03-03b0fbcb694c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1397 microversion: 2.1 time: 0.166746 Jul 20 04:54:50.205223 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3088/6276] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:50 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1397 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:51.222749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5e2b46ea-f853-4968-b8bc-84a8b448c6a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:51.223454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5e2b46ea-f853-4968-b8bc-84a8b448c6a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:51.240323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e2b46ea-f853-4968-b8bc-84a8b448c6a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:51.241566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e2b46ea-f853-4968-b8bc-84a8b448c6a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:51.242500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e2b46ea-f853-4968-b8bc-84a8b448c6a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:51.242941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e2b46ea-f853-4968-b8bc-84a8b448c6a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:51.390893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5e2b46ea-f853-4968-b8bc-84a8b448c6a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:51.406468 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5e2b46ea-f853-4968-b8bc-84a8b448c6a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1397 microversion: 2.1 time: 0.188136 Jul 20 04:54:51.407077 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3189/6277] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:51 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1397 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:52.192391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-17a4971c-8ff1-4705-9b4f-3bace4ef13de req-1f0fedf2-16d4-4615-9262-7c248a03c853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a259359e-d7d5-4a82-a667-6716f64ecf6a", "name": "network-vif-deleted", "tag": "d672e929-c019-4b25-9fad-b7cbb6cbf9ab"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:52.214555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-17a4971c-8ff1-4705-9b4f-3bace4ef13de req-1f0fedf2-16d4-4615-9262-7c248a03c853 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:52.214894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-17a4971c-8ff1-4705-9b4f-3bace4ef13de req-1f0fedf2-16d4-4615-9262-7c248a03c853 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:52.227341 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-17a4971c-8ff1-4705-9b4f-3bace4ef13de req-1f0fedf2-16d4-4615-9262-7c248a03c853 service nova] Creating event network-vif-deleted:d672e929-c019-4b25-9fad-b7cbb6cbf9ab for instance a259359e-d7d5-4a82-a667-6716f64ecf6a on n-h1-764485-11 Jul 20 04:54:52.241286 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-17a4971c-8ff1-4705-9b4f-3bace4ef13de req-1f0fedf2-16d4-4615-9262-7c248a03c853 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056714 Jul 20 04:54:52.242711 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3089/6278] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:52.425117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f4d10707-d508-44e5-b9bf-38f36794dfa4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:52.425740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f4d10707-d508-44e5-b9bf-38f36794dfa4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:52.434726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4d10707-d508-44e5-b9bf-38f36794dfa4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:52.435239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4d10707-d508-44e5-b9bf-38f36794dfa4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:52.436450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4d10707-d508-44e5-b9bf-38f36794dfa4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:52.437306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f4d10707-d508-44e5-b9bf-38f36794dfa4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:52.535651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f4d10707-d508-44e5-b9bf-38f36794dfa4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:52.547186 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f4d10707-d508-44e5-b9bf-38f36794dfa4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1188 microversion: 2.1 time: 0.124653 Jul 20 04:54:52.548001 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3190/6279] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:52 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1188 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:53.567052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5621a1ff-e8ae-475a-adaf-069fe02a8ed5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:53.567706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5621a1ff-e8ae-475a-adaf-069fe02a8ed5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:53.576966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5621a1ff-e8ae-475a-adaf-069fe02a8ed5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:53.577523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5621a1ff-e8ae-475a-adaf-069fe02a8ed5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:53.578534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5621a1ff-e8ae-475a-adaf-069fe02a8ed5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:53.579058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5621a1ff-e8ae-475a-adaf-069fe02a8ed5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:53.675525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5621a1ff-e8ae-475a-adaf-069fe02a8ed5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:53.687942 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5621a1ff-e8ae-475a-adaf-069fe02a8ed5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1188 microversion: 2.1 time: 0.126153 Jul 20 04:54:53.688541 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3090/6280] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:53 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1188 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:54.005146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-251a4c12-1067-4a76-8181-7c64aa5068e9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'create', calling method: .version_select at 0x7fbf9dd813a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-293059032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWzSgSniFoRkS90pIi2jyXP6mDzVvdR6y3DTtT4i1iKi57kLg0LC4j2wcTf9bb0T7yGrsToQSzgtqdXA298FGkNr1fmCEYSt5m8FaRiTfCiLrlR0Eu5PFI6yh9bYCjOjw=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:54.020423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-251a4c12-1067-4a76-8181-7c64aa5068e9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:54:54.027760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-251a4c12-1067-4a76-8181-7c64aa5068e9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for user 4f38aa28db214cc689fd1b5e02a62d67 and project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:54:54.060229 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-251a4c12-1067-4a76-8181-7c64aa5068e9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.263178 Jul 20 04:54:54.060927 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3191/6281] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:54:53 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:54.705246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-12c0c107-a0bd-4328-ab2c-e56b7a9fcef8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:54.706131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-12c0c107-a0bd-4328-ab2c-e56b7a9fcef8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:54.714216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12c0c107-a0bd-4328-ab2c-e56b7a9fcef8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:54.714784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12c0c107-a0bd-4328-ab2c-e56b7a9fcef8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:54.716014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12c0c107-a0bd-4328-ab2c-e56b7a9fcef8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:54.716616 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12c0c107-a0bd-4328-ab2c-e56b7a9fcef8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:54.786689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-12c0c107-a0bd-4328-ab2c-e56b7a9fcef8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:54.795247 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-12c0c107-a0bd-4328-ab2c-e56b7a9fcef8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1188 microversion: 2.1 time: 0.093854 Jul 20 04:54:54.795937 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3091/6282] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:54 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:55.812695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b8415ca-dc64-4bcc-b52b-eadf819e1d25 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:55.813637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b8415ca-dc64-4bcc-b52b-eadf819e1d25 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:55.820546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b8415ca-dc64-4bcc-b52b-eadf819e1d25 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:55.821143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b8415ca-dc64-4bcc-b52b-eadf819e1d25 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:55.822023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b8415ca-dc64-4bcc-b52b-eadf819e1d25 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:55.822562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b8415ca-dc64-4bcc-b52b-eadf819e1d25 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:55.971420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b8415ca-dc64-4bcc-b52b-eadf819e1d25 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:55.980993 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b8415ca-dc64-4bcc-b52b-eadf819e1d25 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1188 microversion: 2.1 time: 0.173124 Jul 20 04:54:55.981734 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3192/6283] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:55 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1188 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:56.998036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-010019f8-57cf-47f5-a56f-a6ae415c38b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:56.999242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-010019f8-57cf-47f5-a56f-a6ae415c38b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:57.008289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-010019f8-57cf-47f5-a56f-a6ae415c38b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:57.009026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-010019f8-57cf-47f5-a56f-a6ae415c38b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:57.009933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-010019f8-57cf-47f5-a56f-a6ae415c38b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:57.010510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-010019f8-57cf-47f5-a56f-a6ae415c38b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:57.058420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-010019f8-57cf-47f5-a56f-a6ae415c38b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:57.059027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-010019f8-57cf-47f5-a56f-a6ae415c38b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:57.059906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-010019f8-57cf-47f5-a56f-a6ae415c38b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lazy-loading 'fault' on Instance uuid a259359e-d7d5-4a82-a667-6716f64ecf6a {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:54:57.144686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-010019f8-57cf-47f5-a56f-a6ae415c38b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:57.157679 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-010019f8-57cf-47f5-a56f-a6ae415c38b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 200 len: 1193 microversion: 2.1 time: 0.163311 Jul 20 04:54:57.171036 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3092/6284] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:56 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 1193 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:58.179398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0a335bc-8201-4265-9335-2af732f8c499 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:58.180766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b0a335bc-8201-4265-9335-2af732f8c499 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:58.194088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0a335bc-8201-4265-9335-2af732f8c499 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:58.194664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0a335bc-8201-4265-9335-2af732f8c499 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:58.196179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0a335bc-8201-4265-9335-2af732f8c499 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:58.196725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0a335bc-8201-4265-9335-2af732f8c499 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:58.218597 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-b0a335bc-8201-4265-9335-2af732f8c499 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0a335bc-8201-4265-9335-2af732f8c499 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a HTTP/1.1 Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a259359e-d7d5-4a82-a667-6716f64ecf6a'} Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:58.220800 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:54:58.233311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:58.233311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:58.233311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:58.233311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:54:58.233311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:54:58.233311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:54:58.233311 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:54:58.233311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0a335bc-8201-4265-9335-2af732f8c499 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:54:58.233311 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b0a335bc-8201-4265-9335-2af732f8c499 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 404 len: 111 microversion: 2.1 time: 0.048510 Jul 20 04:54:58.233311 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3193/6285] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:58 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:55:00.418384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d85978fd-1ffb-495a-abff-197456cda9c2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:00.419624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d85978fd-1ffb-495a-abff-197456cda9c2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:00.437792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d85978fd-1ffb-495a-abff-197456cda9c2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:00.438740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d85978fd-1ffb-495a-abff-197456cda9c2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:00.440273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d85978fd-1ffb-495a-abff-197456cda9c2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:00.440934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d85978fd-1ffb-495a-abff-197456cda9c2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:00.472124 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-d85978fd-1ffb-495a-abff-197456cda9c2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d85978fd-1ffb-495a-abff-197456cda9c2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a HTTP/1.1 Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'a259359e-d7d5-4a82-a667-6716f64ecf6a'} Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:55:00.473864 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d85978fd-1ffb-495a-abff-197456cda9c2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d85978fd-1ffb-495a-abff-197456cda9c2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 404 len: 111 microversion: 2.1 time: 0.064402 Jul 20 04:55:00.483586 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3093/6286] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:55:00 2022] DELETE /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:55:00.488674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec1e4fdc-8ef9-4299-bf1c-3dbcf42d4f12 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:00.488674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ec1e4fdc-8ef9-4299-bf1c-3dbcf42d4f12 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: a259359e-d7d5-4a82-a667-6716f64ecf6a] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:00.494228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec1e4fdc-8ef9-4299-bf1c-3dbcf42d4f12 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:00.494695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec1e4fdc-8ef9-4299-bf1c-3dbcf42d4f12 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:00.495811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec1e4fdc-8ef9-4299-bf1c-3dbcf42d4f12 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:00.496210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ec1e4fdc-8ef9-4299-bf1c-3dbcf42d4f12 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:00.512127 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-ec1e4fdc-8ef9-4299-bf1c-3dbcf42d4f12 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec1e4fdc-8ef9-4299-bf1c-3dbcf42d4f12 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a HTTP/1.1 Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'a259359e-d7d5-4a82-a667-6716f64ecf6a'} Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:55:00.513999 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:55:00.518842 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:00.518842 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:55:00.518842 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:55:00.518842 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:55:00.518842 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:55:00.518842 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. Jul 20 04:55:00.518842 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:55:00.520663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ec1e4fdc-8ef9-4299-bf1c-3dbcf42d4f12 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance a259359e-d7d5-4a82-a667-6716f64ecf6a could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:55:00.522397 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ec1e4fdc-8ef9-4299-bf1c-3dbcf42d4f12 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a" status: 404 len: 111 microversion: 2.1 time: 0.040115 Jul 20 04:55:00.529249 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3194/6287] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:00 2022] GET /compute/v2.1/servers/a259359e-d7d5-4a82-a667-6716f64ecf6a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:55:00.676117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-556723853", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "65fcf34e-eeb7-4652-9735-c488d58bf24d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-293059032", "security_groups": [{"name": "tempest-secgroup-smoke-1791249883"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:00.829827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] validate_networks() for [('65fcf34e-eeb7-4652-9735-c488d58bf24d', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:55:01.516239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:55:01.517464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:55:01.519004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:55:01.519828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:55:01.520507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:55:01.532999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:01.533942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:01.535768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:01.536503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:01.564809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:55:01.572120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for user 4f38aa28db214cc689fd1b5e02a62d67 and project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:55:01.606685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:55:01.611846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:55:01.696824 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b75da8d0-904e-4d33-a024-8859c28065f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.025091 Jul 20 04:55:01.698123 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3094/6288] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:55:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:55:01.710737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da0fbdbd-b499-49ad-ae6b-5a3d03b0c03c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:01.712088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-da0fbdbd-b499-49ad-ae6b-5a3d03b0c03c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:01.792321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-da0fbdbd-b499-49ad-ae6b-5a3d03b0c03c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:01.800914 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da0fbdbd-b499-49ad-ae6b-5a3d03b0c03c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1265 microversion: 2.1 time: 0.096276 Jul 20 04:55:01.801514 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3195/6289] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:01 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:02.824699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1c970701-53ed-4f44-808e-383430b498b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:02.825328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1c970701-53ed-4f44-808e-383430b498b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:02.840907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c970701-53ed-4f44-808e-383430b498b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:02.841368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c970701-53ed-4f44-808e-383430b498b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:02.845379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c970701-53ed-4f44-808e-383430b498b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:02.846039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1c970701-53ed-4f44-808e-383430b498b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:03.030325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1c970701-53ed-4f44-808e-383430b498b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:03.046523 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1c970701-53ed-4f44-808e-383430b498b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1325 microversion: 2.1 time: 0.231943 Jul 20 04:55:03.056284 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3095/6290] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:02 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:04.069076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16365f76-cd8b-4040-b042-d00883c2d8f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:04.070143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-16365f76-cd8b-4040-b042-d00883c2d8f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:04.087372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16365f76-cd8b-4040-b042-d00883c2d8f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:04.088745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16365f76-cd8b-4040-b042-d00883c2d8f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:04.095503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16365f76-cd8b-4040-b042-d00883c2d8f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:04.096097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16365f76-cd8b-4040-b042-d00883c2d8f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:04.358645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-16365f76-cd8b-4040-b042-d00883c2d8f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:04.368482 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-16365f76-cd8b-4040-b042-d00883c2d8f5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1391 microversion: 2.1 time: 0.304837 Jul 20 04:55:04.370072 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3196/6291] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:04 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1391 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:05.115735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f2e4636f-05e5-4e57-a1d2-ad97795a68f4 req-384b3e1d-4ad0-4135-8b67-dca2d3773638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f", "tag": "df849559-fdd4-4f00-a0c5-584f004e6356"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:05.145300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f2e4636f-05e5-4e57-a1d2-ad97795a68f4 req-384b3e1d-4ad0-4135-8b67-dca2d3773638 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:05.146038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f2e4636f-05e5-4e57-a1d2-ad97795a68f4 req-384b3e1d-4ad0-4135-8b67-dca2d3773638 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:05.177811 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f2e4636f-05e5-4e57-a1d2-ad97795a68f4 req-384b3e1d-4ad0-4135-8b67-dca2d3773638 service nova] Creating event network-changed:df849559-fdd4-4f00-a0c5-584f004e6356 for instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f on n-h1-764485-11 Jul 20 04:55:05.190303 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f2e4636f-05e5-4e57-a1d2-ad97795a68f4 req-384b3e1d-4ad0-4135-8b67-dca2d3773638 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079317 Jul 20 04:55:05.191535 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3096/6292] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:05.388933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5711d65d-10e7-4840-ad95-6f794a3fb380 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:05.389732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5711d65d-10e7-4840-ad95-6f794a3fb380 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:05.409488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5711d65d-10e7-4840-ad95-6f794a3fb380 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:05.410181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5711d65d-10e7-4840-ad95-6f794a3fb380 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:05.411193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5711d65d-10e7-4840-ad95-6f794a3fb380 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:05.411353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5711d65d-10e7-4840-ad95-6f794a3fb380 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:05.627698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5711d65d-10e7-4840-ad95-6f794a3fb380 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:05.636623 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5711d65d-10e7-4840-ad95-6f794a3fb380 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1391 microversion: 2.1 time: 0.252968 Jul 20 04:55:05.639132 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3197/6293] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:05 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1391 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:06.655648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9764a88e-2716-4b84-bdde-8a05adcd410b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:06.656353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9764a88e-2716-4b84-bdde-8a05adcd410b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:06.663535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9764a88e-2716-4b84-bdde-8a05adcd410b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:06.664130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9764a88e-2716-4b84-bdde-8a05adcd410b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:06.664912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9764a88e-2716-4b84-bdde-8a05adcd410b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:06.665364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9764a88e-2716-4b84-bdde-8a05adcd410b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:06.829831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9764a88e-2716-4b84-bdde-8a05adcd410b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:06.839056 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9764a88e-2716-4b84-bdde-8a05adcd410b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1391 microversion: 2.1 time: 0.188378 Jul 20 04:55:06.839946 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3097/6294] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:06 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1391 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:07.856250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b6bbae95-06cd-4e56-b211-2745d9756235 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:07.856847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b6bbae95-06cd-4e56-b211-2745d9756235 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:07.873922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6bbae95-06cd-4e56-b211-2745d9756235 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:07.874374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6bbae95-06cd-4e56-b211-2745d9756235 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:07.875180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6bbae95-06cd-4e56-b211-2745d9756235 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:07.875642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6bbae95-06cd-4e56-b211-2745d9756235 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:08.127763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b6bbae95-06cd-4e56-b211-2745d9756235 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:08.138731 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b6bbae95-06cd-4e56-b211-2745d9756235 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1391 microversion: 2.1 time: 0.286500 Jul 20 04:55:08.139991 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3198/6295] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:07 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1391 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:09.156409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95b44c15-8de2-48b9-8372-8d2f18eb12d6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:09.157028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95b44c15-8de2-48b9-8372-8d2f18eb12d6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:09.164275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95b44c15-8de2-48b9-8372-8d2f18eb12d6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:09.164737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95b44c15-8de2-48b9-8372-8d2f18eb12d6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:09.165517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95b44c15-8de2-48b9-8372-8d2f18eb12d6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:09.165964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95b44c15-8de2-48b9-8372-8d2f18eb12d6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:09.308419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95b44c15-8de2-48b9-8372-8d2f18eb12d6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:09.316252 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95b44c15-8de2-48b9-8372-8d2f18eb12d6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1391 microversion: 2.1 time: 0.163751 Jul 20 04:55:09.327244 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3098/6296] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:09 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:10.336470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4e214fa6-58f6-473f-8539-ea26b21a7485 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:10.337070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4e214fa6-58f6-473f-8539-ea26b21a7485 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:10.345472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e214fa6-58f6-473f-8539-ea26b21a7485 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:10.345938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e214fa6-58f6-473f-8539-ea26b21a7485 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:10.346729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e214fa6-58f6-473f-8539-ea26b21a7485 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:10.347180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e214fa6-58f6-473f-8539-ea26b21a7485 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:10.517898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4e214fa6-58f6-473f-8539-ea26b21a7485 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:10.526679 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4e214fa6-58f6-473f-8539-ea26b21a7485 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1391 microversion: 2.1 time: 0.195621 Jul 20 04:55:10.527273 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3199/6297] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:10 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1391 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:11.548973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3894e4ce-86a4-4596-acf8-fa98cbff36cb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:11.550289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3894e4ce-86a4-4596-acf8-fa98cbff36cb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:11.553846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:11.559648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3894e4ce-86a4-4596-acf8-fa98cbff36cb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:11.560107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3894e4ce-86a4-4596-acf8-fa98cbff36cb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:11.560884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3894e4ce-86a4-4596-acf8-fa98cbff36cb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:11.561515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3894e4ce-86a4-4596-acf8-fa98cbff36cb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:11.581494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:11.700568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3894e4ce-86a4-4596-acf8-fa98cbff36cb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:11.708354 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3894e4ce-86a4-4596-acf8-fa98cbff36cb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1391 microversion: 2.1 time: 0.163299 Jul 20 04:55:11.710086 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3099/6298] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:11 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:12.712135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-437ef52c-4519-4268-abb4-d32f2d5bcaab req-0c315660-d471-4720-a157-fd4213d9fa15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f", "name": "network-vif-plugged", "status": "completed", "tag": "df849559-fdd4-4f00-a0c5-584f004e6356"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:12.716592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:12.731571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-437ef52c-4519-4268-abb4-d32f2d5bcaab req-0c315660-d471-4720-a157-fd4213d9fa15 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:12.732375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-437ef52c-4519-4268-abb4-d32f2d5bcaab req-0c315660-d471-4720-a157-fd4213d9fa15 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:12.735548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5207176c-b22e-42d1-bfe4-d2e348166fa2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:12.738173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5207176c-b22e-42d1-bfe4-d2e348166fa2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:12.745168 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-437ef52c-4519-4268-abb4-d32f2d5bcaab req-0c315660-d471-4720-a157-fd4213d9fa15 service nova] Creating event network-vif-plugged:df849559-fdd4-4f00-a0c5-584f004e6356 for instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f on n-h1-764485-11 Jul 20 04:55:12.748080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5207176c-b22e-42d1-bfe4-d2e348166fa2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:12.749401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5207176c-b22e-42d1-bfe4-d2e348166fa2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:12.750571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5207176c-b22e-42d1-bfe4-d2e348166fa2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:12.751124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5207176c-b22e-42d1-bfe4-d2e348166fa2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:12.751469 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-437ef52c-4519-4268-abb4-d32f2d5bcaab req-0c315660-d471-4720-a157-fd4213d9fa15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043404 Jul 20 04:55:12.752297 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3200/6299] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:55:12.954857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5207176c-b22e-42d1-bfe4-d2e348166fa2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:12.964465 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5207176c-b22e-42d1-bfe4-d2e348166fa2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1391 microversion: 2.1 time: 0.240469 Jul 20 04:55:12.965059 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3100/6300] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:12 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:13.983121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a996e7da-3137-411d-8c38-9debd4c253d1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:13.983787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a996e7da-3137-411d-8c38-9debd4c253d1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:13.991250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a996e7da-3137-411d-8c38-9debd4c253d1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:13.991738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a996e7da-3137-411d-8c38-9debd4c253d1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:13.992798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a996e7da-3137-411d-8c38-9debd4c253d1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:13.993251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a996e7da-3137-411d-8c38-9debd4c253d1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:14.154864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a996e7da-3137-411d-8c38-9debd4c253d1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:14.163004 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a996e7da-3137-411d-8c38-9debd4c253d1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1391 microversion: 2.1 time: 0.185426 Jul 20 04:55:14.163616 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3201/6301] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:13 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:15.180211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a1a2245-76c4-4678-8e75-e5b805b8b1bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:15.180910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4a1a2245-76c4-4678-8e75-e5b805b8b1bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:15.188118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a1a2245-76c4-4678-8e75-e5b805b8b1bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:15.188582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a1a2245-76c4-4678-8e75-e5b805b8b1bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:15.189676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a1a2245-76c4-4678-8e75-e5b805b8b1bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:15.189798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a1a2245-76c4-4678-8e75-e5b805b8b1bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:15.339408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a1a2245-76c4-4678-8e75-e5b805b8b1bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:15.347575 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a1a2245-76c4-4678-8e75-e5b805b8b1bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1562 microversion: 2.1 time: 0.171493 Jul 20 04:55:15.348188 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3101/6302] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:15 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:15.367757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e146ca68-81f7-4385-9fc0-82e4b979efcd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:15.368378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e146ca68-81f7-4385-9fc0-82e4b979efcd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:15.375715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e146ca68-81f7-4385-9fc0-82e4b979efcd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:15.376176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e146ca68-81f7-4385-9fc0-82e4b979efcd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:15.376959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e146ca68-81f7-4385-9fc0-82e4b979efcd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:15.377406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e146ca68-81f7-4385-9fc0-82e4b979efcd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:15.518819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e146ca68-81f7-4385-9fc0-82e4b979efcd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:15.527271 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e146ca68-81f7-4385-9fc0-82e4b979efcd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1562 microversion: 2.1 time: 0.164440 Jul 20 04:55:15.528036 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3202/6303] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:15 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:17.261577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d6ea142f-9e84-4a60-86c5-bb637c959d56 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:17.262202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d6ea142f-9e84-4a60-86c5-bb637c959d56 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:17.265257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-5724e1f0-00c8-4626-ab0c-c5e0a0e4a764 req-5e005d38-1e29-46f6-9458-20fcd2e2e359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f", "tag": "df849559-fdd4-4f00-a0c5-584f004e6356"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:17.268797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6ea142f-9e84-4a60-86c5-bb637c959d56 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:17.269259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6ea142f-9e84-4a60-86c5-bb637c959d56 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:17.270050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6ea142f-9e84-4a60-86c5-bb637c959d56 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:17.270495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6ea142f-9e84-4a60-86c5-bb637c959d56 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:17.279072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5724e1f0-00c8-4626-ab0c-c5e0a0e4a764 req-5e005d38-1e29-46f6-9458-20fcd2e2e359 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:17.279550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-5724e1f0-00c8-4626-ab0c-c5e0a0e4a764 req-5e005d38-1e29-46f6-9458-20fcd2e2e359 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:17.302638 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-5724e1f0-00c8-4626-ab0c-c5e0a0e4a764 req-5e005d38-1e29-46f6-9458-20fcd2e2e359 service nova] Creating event network-changed:df849559-fdd4-4f00-a0c5-584f004e6356 for instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f on n-h1-764485-11 Jul 20 04:55:17.309817 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-5724e1f0-00c8-4626-ab0c-c5e0a0e4a764 req-5e005d38-1e29-46f6-9458-20fcd2e2e359 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048737 Jul 20 04:55:17.315353 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3203/6304] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:17.525561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d6ea142f-9e84-4a60-86c5-bb637c959d56 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:17.533706 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d6ea142f-9e84-4a60-86c5-bb637c959d56 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1562 microversion: 2.1 time: 0.276025 Jul 20 04:55:17.546330 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3102/6305] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:17 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1562 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:22.859348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1142465738", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5e9926d9-9a6f-4965-b3cb-de77cb24b743", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "1e46ee9e-198e-401c-88a3-4979bd7d9aaf"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:22.867503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:22.926062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] validate_networks() for [('1e46ee9e-198e-401c-88a3-4979bd7d9aaf', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:55:23.290480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:55:23.290905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:55:23.291382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:55:23.291819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:55:23.292236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:55:23.301144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:23.301594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:23.302384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:23.302913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:23.309501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:23.322117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:55:23.327976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for user 1f70af961f624dceba390cb44ef2a792 and project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:55:23.386588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:55:23.388918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e9926d9-9a6f-4965-b3cb-de77cb24b743',volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:55:23.517928 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d6eb1ae-f2c2-4ff7-8710-ab4c14171667 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664086 Jul 20 04:55:23.518625 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3204/6306] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:55:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:55:23.531091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bb26ef4b-39e4-405c-ac2b-8704ac873408 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:23.532000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bb26ef4b-39e4-405c-ac2b-8704ac873408 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:23.535895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:23.595996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bb26ef4b-39e4-405c-ac2b-8704ac873408 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:23.608100 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bb26ef4b-39e4-405c-ac2b-8704ac873408 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1071 microversion: 2.1 time: 0.078110 Jul 20 04:55:23.608729 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3103/6307] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:23 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1071 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:24.626236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8f3fc9b7-5d9c-4fc9-ad00-7d95b7f4ae3f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:24.626864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8f3fc9b7-5d9c-4fc9-ad00-7d95b7f4ae3f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:24.635338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f3fc9b7-5d9c-4fc9-ad00-7d95b7f4ae3f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:24.635847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f3fc9b7-5d9c-4fc9-ad00-7d95b7f4ae3f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:24.636646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f3fc9b7-5d9c-4fc9-ad00-7d95b7f4ae3f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:24.637100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f3fc9b7-5d9c-4fc9-ad00-7d95b7f4ae3f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:24.702185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8f3fc9b7-5d9c-4fc9-ad00-7d95b7f4ae3f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:24.712128 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8f3fc9b7-5d9c-4fc9-ad00-7d95b7f4ae3f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1187 microversion: 2.1 time: 0.090701 Jul 20 04:55:24.713055 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3205/6308] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:24 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:25.730613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-22b01bba-5ddf-4973-980c-90247fb24382 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:25.731227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-22b01bba-5ddf-4973-980c-90247fb24382 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:25.739127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22b01bba-5ddf-4973-980c-90247fb24382 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:25.739907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22b01bba-5ddf-4973-980c-90247fb24382 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:25.740699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22b01bba-5ddf-4973-980c-90247fb24382 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:25.741707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22b01bba-5ddf-4973-980c-90247fb24382 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:25.746153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=88 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:25.888423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-22b01bba-5ddf-4973-980c-90247fb24382 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:25.898026 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-22b01bba-5ddf-4973-980c-90247fb24382 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1229 microversion: 2.1 time: 0.170900 Jul 20 04:55:25.898844 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3104/6309] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:25 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1229 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:26.213693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a0cef57c-a876-47c8-b5d8-573f504693ad req-84a29333-1948-4317-9976-1562b7d927df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "108e91f7-3e52-4ddc-843d-d56ab50ede20", "tag": "3be6c483-8638-4398-909c-5ec91b24e45e"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:26.229185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a0cef57c-a876-47c8-b5d8-573f504693ad req-84a29333-1948-4317-9976-1562b7d927df service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:26.229908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a0cef57c-a876-47c8-b5d8-573f504693ad req-84a29333-1948-4317-9976-1562b7d927df service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:26.247110 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a0cef57c-a876-47c8-b5d8-573f504693ad req-84a29333-1948-4317-9976-1562b7d927df service nova] Creating event network-changed:3be6c483-8638-4398-909c-5ec91b24e45e for instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 on n-h2-764485-11 Jul 20 04:55:26.252409 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a0cef57c-a876-47c8-b5d8-573f504693ad req-84a29333-1948-4317-9976-1562b7d927df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050347 Jul 20 04:55:26.255874 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3206/6310] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:26.916045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c8296878-cdd7-4cbb-9fa7-85f858782f1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:26.917010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c8296878-cdd7-4cbb-9fa7-85f858782f1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:26.924622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8296878-cdd7-4cbb-9fa7-85f858782f1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:26.925398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8296878-cdd7-4cbb-9fa7-85f858782f1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:26.926475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8296878-cdd7-4cbb-9fa7-85f858782f1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:26.927027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c8296878-cdd7-4cbb-9fa7-85f858782f1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:27.092034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c8296878-cdd7-4cbb-9fa7-85f858782f1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:27.102614 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c8296878-cdd7-4cbb-9fa7-85f858782f1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1229 microversion: 2.1 time: 0.190409 Jul 20 04:55:27.112690 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3105/6311] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:26 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1229 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:28.121015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cee8e00f-d796-4a4d-be93-c0774056411e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:28.121641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cee8e00f-d796-4a4d-be93-c0774056411e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:28.128999 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cee8e00f-d796-4a4d-be93-c0774056411e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:28.129452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cee8e00f-d796-4a4d-be93-c0774056411e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:28.130224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cee8e00f-d796-4a4d-be93-c0774056411e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:28.130661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cee8e00f-d796-4a4d-be93-c0774056411e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:28.273594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cee8e00f-d796-4a4d-be93-c0774056411e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:28.281259 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cee8e00f-d796-4a4d-be93-c0774056411e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1229 microversion: 2.1 time: 0.165196 Jul 20 04:55:28.281842 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3207/6312] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:28 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1229 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:29.297898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e921d472-0d09-4ce2-9573-4fd4074e0b63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:29.298508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e921d472-0d09-4ce2-9573-4fd4074e0b63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:29.306239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e921d472-0d09-4ce2-9573-4fd4074e0b63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:29.306689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e921d472-0d09-4ce2-9573-4fd4074e0b63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:29.307615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e921d472-0d09-4ce2-9573-4fd4074e0b63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:29.312978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e921d472-0d09-4ce2-9573-4fd4074e0b63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:29.460184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e921d472-0d09-4ce2-9573-4fd4074e0b63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:29.468722 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e921d472-0d09-4ce2-9573-4fd4074e0b63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1229 microversion: 2.1 time: 0.174669 Jul 20 04:55:29.469307 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3106/6313] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:29 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1229 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:30.486121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ad3a4d4b-08d5-453e-9072-118cdcbcd11d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:30.486680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ad3a4d4b-08d5-453e-9072-118cdcbcd11d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:30.494544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad3a4d4b-08d5-453e-9072-118cdcbcd11d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:30.494992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad3a4d4b-08d5-453e-9072-118cdcbcd11d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:30.495777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad3a4d4b-08d5-453e-9072-118cdcbcd11d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:30.496218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad3a4d4b-08d5-453e-9072-118cdcbcd11d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:30.630919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ad3a4d4b-08d5-453e-9072-118cdcbcd11d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:30.639153 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ad3a4d4b-08d5-453e-9072-118cdcbcd11d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1217 microversion: 2.1 time: 0.157074 Jul 20 04:55:30.639758 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3208/6314] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:30 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:31.656268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-31e15b0e-a38a-4a93-b0ab-ae6e812b2165 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:31.656911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-31e15b0e-a38a-4a93-b0ab-ae6e812b2165 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:31.664475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31e15b0e-a38a-4a93-b0ab-ae6e812b2165 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:31.664925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31e15b0e-a38a-4a93-b0ab-ae6e812b2165 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:31.665685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31e15b0e-a38a-4a93-b0ab-ae6e812b2165 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:31.666121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31e15b0e-a38a-4a93-b0ab-ae6e812b2165 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:31.795468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-31e15b0e-a38a-4a93-b0ab-ae6e812b2165 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:31.803015 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-31e15b0e-a38a-4a93-b0ab-ae6e812b2165 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1217 microversion: 2.1 time: 0.150633 Jul 20 04:55:31.803636 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3107/6315] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:31 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:32.820143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-46043fb7-ce86-496b-9d12-7c9ece07e564 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:32.820770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-46043fb7-ce86-496b-9d12-7c9ece07e564 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:32.827869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46043fb7-ce86-496b-9d12-7c9ece07e564 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:32.828332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46043fb7-ce86-496b-9d12-7c9ece07e564 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:32.829104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46043fb7-ce86-496b-9d12-7c9ece07e564 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:32.829554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46043fb7-ce86-496b-9d12-7c9ece07e564 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:32.964015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-46043fb7-ce86-496b-9d12-7c9ece07e564 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:32.971456 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-46043fb7-ce86-496b-9d12-7c9ece07e564 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1217 microversion: 2.1 time: 0.155238 Jul 20 04:55:32.972064 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3209/6316] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:32 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:33.989927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5f6f4f99-9c30-468b-a046-c053f2263ed0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:33.990475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5f6f4f99-9c30-468b-a046-c053f2263ed0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:33.992934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:33.998462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f6f4f99-9c30-468b-a046-c053f2263ed0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:33.998910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f6f4f99-9c30-468b-a046-c053f2263ed0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:33.999719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f6f4f99-9c30-468b-a046-c053f2263ed0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:34.000141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f6f4f99-9c30-468b-a046-c053f2263ed0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:34.133381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5f6f4f99-9c30-468b-a046-c053f2263ed0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:34.140939 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5f6f4f99-9c30-468b-a046-c053f2263ed0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1217 microversion: 2.1 time: 0.155229 Jul 20 04:55:34.141526 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3108/6317] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:33 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:35.158200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-36af8ecd-50c1-4581-a859-f96cb02f859d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:35.158823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-36af8ecd-50c1-4581-a859-f96cb02f859d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:35.160866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:35.161543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:35.169763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36af8ecd-50c1-4581-a859-f96cb02f859d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:35.170241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36af8ecd-50c1-4581-a859-f96cb02f859d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:35.171018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36af8ecd-50c1-4581-a859-f96cb02f859d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:35.171467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36af8ecd-50c1-4581-a859-f96cb02f859d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:35.309172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-36af8ecd-50c1-4581-a859-f96cb02f859d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:35.316871 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-36af8ecd-50c1-4581-a859-f96cb02f859d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1217 microversion: 2.1 time: 0.162519 Jul 20 04:55:35.317460 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3210/6318] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:35 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:36.334288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cab5e003-8f81-47de-93e4-518b0dfbe4a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:36.334903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cab5e003-8f81-47de-93e4-518b0dfbe4a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:36.341957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cab5e003-8f81-47de-93e4-518b0dfbe4a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:36.342415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cab5e003-8f81-47de-93e4-518b0dfbe4a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:36.343178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cab5e003-8f81-47de-93e4-518b0dfbe4a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:36.343647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cab5e003-8f81-47de-93e4-518b0dfbe4a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:36.787343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cab5e003-8f81-47de-93e4-518b0dfbe4a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:36.795857 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cab5e003-8f81-47de-93e4-518b0dfbe4a0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1217 microversion: 2.1 time: 0.465467 Jul 20 04:55:36.796449 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3109/6319] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:36 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1217 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:37.813173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b05805be-10a3-45b9-a472-15989fc0ed11 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:37.813847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b05805be-10a3-45b9-a472-15989fc0ed11 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:37.820539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b05805be-10a3-45b9-a472-15989fc0ed11 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:37.821005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b05805be-10a3-45b9-a472-15989fc0ed11 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:37.821777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b05805be-10a3-45b9-a472-15989fc0ed11 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:37.822227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b05805be-10a3-45b9-a472-15989fc0ed11 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:37.952555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b05805be-10a3-45b9-a472-15989fc0ed11 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:37.960291 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b05805be-10a3-45b9-a472-15989fc0ed11 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1217 microversion: 2.1 time: 0.151084 Jul 20 04:55:37.960879 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3211/6320] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:37 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:38.978067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2b82d458-1843-48ca-ac43-5273b0c40050 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:38.978670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2b82d458-1843-48ca-ac43-5273b0c40050 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:38.987754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b82d458-1843-48ca-ac43-5273b0c40050 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:38.988204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b82d458-1843-48ca-ac43-5273b0c40050 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:38.988978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b82d458-1843-48ca-ac43-5273b0c40050 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:38.989421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2b82d458-1843-48ca-ac43-5273b0c40050 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:39.124331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2b82d458-1843-48ca-ac43-5273b0c40050 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:39.131886 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2b82d458-1843-48ca-ac43-5273b0c40050 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1217 microversion: 2.1 time: 0.158452 Jul 20 04:55:39.132475 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3110/6321] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:38 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:40.149245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bf20aaca-31fe-416f-9543-2281e31e2782 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:40.149887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bf20aaca-31fe-416f-9543-2281e31e2782 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:40.157072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf20aaca-31fe-416f-9543-2281e31e2782 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:40.157533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf20aaca-31fe-416f-9543-2281e31e2782 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:40.158313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf20aaca-31fe-416f-9543-2281e31e2782 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:40.158759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf20aaca-31fe-416f-9543-2281e31e2782 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:40.291470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bf20aaca-31fe-416f-9543-2281e31e2782 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:40.299095 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bf20aaca-31fe-416f-9543-2281e31e2782 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1217 microversion: 2.1 time: 0.153825 Jul 20 04:55:40.299775 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3212/6322] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:40 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:41.146737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c36c6d7c-304f-40b1-8904-d6c13252cd72 req-27861bcb-0708-4beb-ae55-258fc7fc9b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "108e91f7-3e52-4ddc-843d-d56ab50ede20", "name": "network-vif-plugged", "status": "completed", "tag": "3be6c483-8638-4398-909c-5ec91b24e45e"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:41.156891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c36c6d7c-304f-40b1-8904-d6c13252cd72 req-27861bcb-0708-4beb-ae55-258fc7fc9b0e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:41.157400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c36c6d7c-304f-40b1-8904-d6c13252cd72 req-27861bcb-0708-4beb-ae55-258fc7fc9b0e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:41.170845 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c36c6d7c-304f-40b1-8904-d6c13252cd72 req-27861bcb-0708-4beb-ae55-258fc7fc9b0e service nova] Creating event network-vif-plugged:3be6c483-8638-4398-909c-5ec91b24e45e for instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 on n-h2-764485-11 Jul 20 04:55:41.176050 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c36c6d7c-304f-40b1-8904-d6c13252cd72 req-27861bcb-0708-4beb-ae55-258fc7fc9b0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033080 Jul 20 04:55:41.176718 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3111/6323] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:41.317109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4b1e66cb-27b0-4104-a342-f7c484869614 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:41.317735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4b1e66cb-27b0-4104-a342-f7c484869614 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:41.325388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b1e66cb-27b0-4104-a342-f7c484869614 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:41.325857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b1e66cb-27b0-4104-a342-f7c484869614 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:41.326637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b1e66cb-27b0-4104-a342-f7c484869614 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:41.327087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b1e66cb-27b0-4104-a342-f7c484869614 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:41.458193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4b1e66cb-27b0-4104-a342-f7c484869614 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:41.465967 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4b1e66cb-27b0-4104-a342-f7c484869614 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1217 microversion: 2.1 time: 0.152775 Jul 20 04:55:41.466552 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3213/6324] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:41 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:42.483751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4421088b-47aa-4e6d-844d-8aa39c287137 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:42.484389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4421088b-47aa-4e6d-844d-8aa39c287137 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:42.491652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4421088b-47aa-4e6d-844d-8aa39c287137 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:42.492109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4421088b-47aa-4e6d-844d-8aa39c287137 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:42.492890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4421088b-47aa-4e6d-844d-8aa39c287137 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:42.493366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4421088b-47aa-4e6d-844d-8aa39c287137 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:42.626538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4421088b-47aa-4e6d-844d-8aa39c287137 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:42.634190 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4421088b-47aa-4e6d-844d-8aa39c287137 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1217 microversion: 2.1 time: 0.155052 Jul 20 04:55:42.635077 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3112/6325] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:42 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:43.651784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b7289e01-222f-4c2e-8322-60925b73d54c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:43.652604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b7289e01-222f-4c2e-8322-60925b73d54c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:43.659538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7289e01-222f-4c2e-8322-60925b73d54c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:43.660000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7289e01-222f-4c2e-8322-60925b73d54c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:43.660775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7289e01-222f-4c2e-8322-60925b73d54c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:43.661220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b7289e01-222f-4c2e-8322-60925b73d54c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:43.795601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b7289e01-222f-4c2e-8322-60925b73d54c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:43.803152 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b7289e01-222f-4c2e-8322-60925b73d54c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1405 microversion: 2.1 time: 0.156352 Jul 20 04:55:43.803765 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3214/6326] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:43 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:43.820290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-23a0c5c6-b369-4cf9-8ea4-e10c2b68ef92 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:43.820910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-23a0c5c6-b369-4cf9-8ea4-e10c2b68ef92 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:43.828573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23a0c5c6-b369-4cf9-8ea4-e10c2b68ef92 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:43.829043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23a0c5c6-b369-4cf9-8ea4-e10c2b68ef92 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:43.829833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23a0c5c6-b369-4cf9-8ea4-e10c2b68ef92 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:43.830285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-23a0c5c6-b369-4cf9-8ea4-e10c2b68ef92 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:43.964063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-23a0c5c6-b369-4cf9-8ea4-e10c2b68ef92 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:43.971603 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-23a0c5c6-b369-4cf9-8ea4-e10c2b68ef92 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1405 microversion: 2.1 time: 0.155124 Jul 20 04:55:43.972188 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3113/6327] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:43 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:43.988825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6d6b04f5-aceb-46f2-a5f6-e29b2cf91231 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1171045317"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:43.989858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6d6b04f5-aceb-46f2-a5f6-e29b2cf91231 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:43.996190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d6b04f5-aceb-46f2-a5f6-e29b2cf91231 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:43.996643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d6b04f5-aceb-46f2-a5f6-e29b2cf91231 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:43.997405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d6b04f5-aceb-46f2-a5f6-e29b2cf91231 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:43.997844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6d6b04f5-aceb-46f2-a5f6-e29b2cf91231 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:44.087707 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.compute.api [None req-6d6b04f5-aceb-46f2-a5f6-e29b2cf91231 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Attempting to quiesce instance before volume snapshot. Jul 20 04:55:44.158616 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.compute.api [None req-6d6b04f5-aceb-46f2-a5f6-e29b2cf91231 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 20 04:55:44.231464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6d6b04f5-aceb-46f2-a5f6-e29b2cf91231 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Creating snapshot from volume 5e9926d9-9a6f-4965-b3cb-de77cb24b743. {{(pid=119808) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 20 04:55:45.110493 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6d6b04f5-aceb-46f2-a5f6-e29b2cf91231 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "POST /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20/action" status: 202 len: 0 microversion: 2.1 time: 1.125537 Jul 20 04:55:45.113918 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3215/6328] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:55:43 2022] POST /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20/action => generated 0 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:55:46.262884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-812072785", "imageRef": "5c438cc8-8037-45c5-9893-e04d5b2fda5e", "flavorRef": "452", "networks": [{"uuid": "1e46ee9e-198e-401c-88a3-4979bd7d9aaf"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:46.316774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] validate_networks() for [('1e46ee9e-198e-401c-88a3-4979bd7d9aaf', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:55:46.699013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:55:46.699433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:55:46.699937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:55:46.700354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:55:46.700796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:55:46.709661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:46.710083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:46.710891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:46.711337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:46.728445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:55:46.734196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for user 1f70af961f624dceba390cb44ef2a792 and project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:55:46.746472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:55:46.748971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2b8b0e72-dcb3-4a6c-ade8-53618ba67992',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:55:46.826870 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f71a909e-8f04-47b3-9129-96abf69e2eec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568747 Jul 20 04:55:46.827717 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3114/6329] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:55:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:55:46.839490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-474c7f2d-34bb-4aae-a1cc-e54342881206 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:46.840251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-474c7f2d-34bb-4aae-a1cc-e54342881206 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:46.903789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-474c7f2d-34bb-4aae-a1cc-e54342881206 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:46.911865 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-474c7f2d-34bb-4aae-a1cc-e54342881206 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1229 microversion: 2.1 time: 0.078245 Jul 20 04:55:46.912476 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3216/6330] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:46 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1229 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:47.930654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-28a8ef9b-8434-48c2-927d-d4334c931166 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:47.931287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-28a8ef9b-8434-48c2-927d-d4334c931166 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:47.937556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28a8ef9b-8434-48c2-927d-d4334c931166 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:47.938245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28a8ef9b-8434-48c2-927d-d4334c931166 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:47.939044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28a8ef9b-8434-48c2-927d-d4334c931166 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:47.939654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28a8ef9b-8434-48c2-927d-d4334c931166 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:48.017423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-28a8ef9b-8434-48c2-927d-d4334c931166 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:48.025578 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-28a8ef9b-8434-48c2-927d-d4334c931166 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1299 microversion: 2.1 time: 0.100436 Jul 20 04:55:48.036220 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3115/6331] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:47 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:49.055774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-30de4843-1958-43b8-8c7c-cfa04387e7b7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:49.056567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-30de4843-1958-43b8-8c7c-cfa04387e7b7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:49.067407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30de4843-1958-43b8-8c7c-cfa04387e7b7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:49.070175 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30de4843-1958-43b8-8c7c-cfa04387e7b7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:49.071137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30de4843-1958-43b8-8c7c-cfa04387e7b7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:49.071755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30de4843-1958-43b8-8c7c-cfa04387e7b7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:49.344561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-30de4843-1958-43b8-8c7c-cfa04387e7b7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:49.363392 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-30de4843-1958-43b8-8c7c-cfa04387e7b7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1341 microversion: 2.1 time: 0.320158 Jul 20 04:55:49.365545 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3217/6332] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:49 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1341 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:49.367324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f2fb43d9-853a-4a44-bda1-aef3bc3c6c38 req-920ab999-709f-414b-a7bc-027ec9d1bf2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e12d92e-59c8-44d4-83d6-63fee639521e", "tag": "e5d6d336-2e24-40b9-a29f-00f03fc11a99"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:49.379482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f2fb43d9-853a-4a44-bda1-aef3bc3c6c38 req-920ab999-709f-414b-a7bc-027ec9d1bf2d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:49.380001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f2fb43d9-853a-4a44-bda1-aef3bc3c6c38 req-920ab999-709f-414b-a7bc-027ec9d1bf2d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:49.405095 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f2fb43d9-853a-4a44-bda1-aef3bc3c6c38 req-920ab999-709f-414b-a7bc-027ec9d1bf2d service nova] Creating event network-changed:e5d6d336-2e24-40b9-a29f-00f03fc11a99 for instance 3e12d92e-59c8-44d4-83d6-63fee639521e on n-h1-764485-11 Jul 20 04:55:49.419257 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f2fb43d9-853a-4a44-bda1-aef3bc3c6c38 req-920ab999-709f-414b-a7bc-027ec9d1bf2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050816 Jul 20 04:55:49.420761 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3116/6333] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:55:50.382363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-abbe633d-63f6-4006-b33b-21ce4d15cfb6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:50.383037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-abbe633d-63f6-4006-b33b-21ce4d15cfb6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:50.390826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abbe633d-63f6-4006-b33b-21ce4d15cfb6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:50.391296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abbe633d-63f6-4006-b33b-21ce4d15cfb6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:50.392181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abbe633d-63f6-4006-b33b-21ce4d15cfb6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:50.392648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abbe633d-63f6-4006-b33b-21ce4d15cfb6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:50.591814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-abbe633d-63f6-4006-b33b-21ce4d15cfb6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:50.599575 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-abbe633d-63f6-4006-b33b-21ce4d15cfb6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1341 microversion: 2.1 time: 0.221145 Jul 20 04:55:50.600254 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3218/6334] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:50 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1341 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:50.831043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-02d55e19-485a-477d-ad40-d66cce11ee42 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:50.832243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-02d55e19-485a-477d-ad40-d66cce11ee42 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:50.839591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02d55e19-485a-477d-ad40-d66cce11ee42 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:50.840109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02d55e19-485a-477d-ad40-d66cce11ee42 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:50.840885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02d55e19-485a-477d-ad40-d66cce11ee42 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:50.841323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02d55e19-485a-477d-ad40-d66cce11ee42 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:50.896884 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-02d55e19-485a-477d-ad40-d66cce11ee42 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f/action" status: 200 len: 24572 microversion: 2.1 time: 0.070755 Jul 20 04:55:50.898061 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3117/6335] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:55:50 2022] POST /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f/action => generated 24572 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:55:51.617949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04aae5d7-54cf-4ae4-ba7b-02a54c18f864 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:51.618929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-04aae5d7-54cf-4ae4-ba7b-02a54c18f864 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:51.628086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04aae5d7-54cf-4ae4-ba7b-02a54c18f864 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:51.628559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04aae5d7-54cf-4ae4-ba7b-02a54c18f864 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:51.629361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04aae5d7-54cf-4ae4-ba7b-02a54c18f864 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:51.630006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04aae5d7-54cf-4ae4-ba7b-02a54c18f864 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:51.805101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-04aae5d7-54cf-4ae4-ba7b-02a54c18f864 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:51.820686 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-04aae5d7-54cf-4ae4-ba7b-02a54c18f864 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1341 microversion: 2.1 time: 0.206721 Jul 20 04:55:51.822272 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3219/6336] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:51 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1341 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:52.841217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-df0373ba-913c-4b1a-a4a9-38b1a6b67968 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:52.843026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-df0373ba-913c-4b1a-a4a9-38b1a6b67968 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:52.860678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df0373ba-913c-4b1a-a4a9-38b1a6b67968 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:52.862915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df0373ba-913c-4b1a-a4a9-38b1a6b67968 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:52.866813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df0373ba-913c-4b1a-a4a9-38b1a6b67968 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:52.867681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df0373ba-913c-4b1a-a4a9-38b1a6b67968 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:53.122836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-df0373ba-913c-4b1a-a4a9-38b1a6b67968 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:53.140390 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-df0373ba-913c-4b1a-a4a9-38b1a6b67968 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1341 microversion: 2.1 time: 0.302410 Jul 20 04:55:53.142155 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3118/6337] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:52 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1341 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:54.162331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2e044ce2-5608-4585-8354-ec61110d888f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:54.163287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2e044ce2-5608-4585-8354-ec61110d888f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:54.167919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:54.172920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e044ce2-5608-4585-8354-ec61110d888f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:54.173450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e044ce2-5608-4585-8354-ec61110d888f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:54.174641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e044ce2-5608-4585-8354-ec61110d888f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:54.175108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e044ce2-5608-4585-8354-ec61110d888f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:54.179427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:54.361435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2e044ce2-5608-4585-8354-ec61110d888f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:54.370272 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2e044ce2-5608-4585-8354-ec61110d888f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1341 microversion: 2.1 time: 0.212351 Jul 20 04:55:54.370878 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3220/6338] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:54 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1341 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:55.389563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9aa69667-0c54-43ab-9733-16c79c73c419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:55.390831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9aa69667-0c54-43ab-9733-16c79c73c419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:55.393757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:55.402161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9aa69667-0c54-43ab-9733-16c79c73c419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:55.402916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9aa69667-0c54-43ab-9733-16c79c73c419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:55.403967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9aa69667-0c54-43ab-9733-16c79c73c419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:55.404579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9aa69667-0c54-43ab-9733-16c79c73c419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:55.555852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9aa69667-0c54-43ab-9733-16c79c73c419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:55.564522 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9aa69667-0c54-43ab-9733-16c79c73c419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1341 microversion: 2.1 time: 0.179909 Jul 20 04:55:55.565333 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3119/6339] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:55 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1341 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:56.582325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52d333c3-88ad-4f8b-99e9-d7996c22a2ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:56.582960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52d333c3-88ad-4f8b-99e9-d7996c22a2ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:56.590299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52d333c3-88ad-4f8b-99e9-d7996c22a2ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:56.590773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52d333c3-88ad-4f8b-99e9-d7996c22a2ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:56.591587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52d333c3-88ad-4f8b-99e9-d7996c22a2ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:56.592057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52d333c3-88ad-4f8b-99e9-d7996c22a2ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:56.726773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52d333c3-88ad-4f8b-99e9-d7996c22a2ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:56.734616 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52d333c3-88ad-4f8b-99e9-d7996c22a2ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1341 microversion: 2.1 time: 0.156361 Jul 20 04:55:56.735208 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3221/6340] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:56 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1341 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:57.751661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-51275133-c16c-4330-bc2a-4943d4d04638 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:57.752284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-51275133-c16c-4330-bc2a-4943d4d04638 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:57.755220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:57.755894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:57.763082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51275133-c16c-4330-bc2a-4943d4d04638 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:57.763569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51275133-c16c-4330-bc2a-4943d4d04638 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:57.764350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51275133-c16c-4330-bc2a-4943d4d04638 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:57.764788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51275133-c16c-4330-bc2a-4943d4d04638 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:57.767581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=82 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:57.965076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-51275133-c16c-4330-bc2a-4943d4d04638 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:57.972802 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-51275133-c16c-4330-bc2a-4943d4d04638 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1341 microversion: 2.1 time: 0.225037 Jul 20 04:55:57.973384 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3120/6341] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:57 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1341 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:58.990507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-79873530-7f57-4fa7-9c89-e9247df3044e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:58.991227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-79873530-7f57-4fa7-9c89-e9247df3044e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:58.993240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:59.000504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79873530-7f57-4fa7-9c89-e9247df3044e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:59.000982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79873530-7f57-4fa7-9c89-e9247df3044e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:59.001877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79873530-7f57-4fa7-9c89-e9247df3044e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:59.002361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-79873530-7f57-4fa7-9c89-e9247df3044e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:59.145647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-79873530-7f57-4fa7-9c89-e9247df3044e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:59.153693 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-79873530-7f57-4fa7-9c89-e9247df3044e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1341 microversion: 2.1 time: 0.167275 Jul 20 04:55:59.154501 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3222/6342] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:58 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:00.172323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f5779d60-b17a-4f84-93c9-bf56821cfede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:00.172985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f5779d60-b17a-4f84-93c9-bf56821cfede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:00.180532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5779d60-b17a-4f84-93c9-bf56821cfede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:00.180991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5779d60-b17a-4f84-93c9-bf56821cfede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:00.181809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5779d60-b17a-4f84-93c9-bf56821cfede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:00.182257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5779d60-b17a-4f84-93c9-bf56821cfede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:00.332494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f5779d60-b17a-4f84-93c9-bf56821cfede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:00.341821 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f5779d60-b17a-4f84-93c9-bf56821cfede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1341 microversion: 2.1 time: 0.173695 Jul 20 04:56:00.342617 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3121/6343] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:00 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:01.359345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-10b9faaf-e91d-455a-80c9-4dae36b913ec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:01.360005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-10b9faaf-e91d-455a-80c9-4dae36b913ec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:01.367107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10b9faaf-e91d-455a-80c9-4dae36b913ec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:01.367608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10b9faaf-e91d-455a-80c9-4dae36b913ec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:01.368403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10b9faaf-e91d-455a-80c9-4dae36b913ec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:01.368858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-10b9faaf-e91d-455a-80c9-4dae36b913ec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:01.507210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-10b9faaf-e91d-455a-80c9-4dae36b913ec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:01.515718 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-10b9faaf-e91d-455a-80c9-4dae36b913ec tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1341 microversion: 2.1 time: 0.160446 Jul 20 04:56:01.516327 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3223/6344] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:01 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:02.532945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7acadedb-7361-4502-92f7-963077f35601 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:02.533667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7acadedb-7361-4502-92f7-963077f35601 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:02.542455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7acadedb-7361-4502-92f7-963077f35601 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:02.542922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7acadedb-7361-4502-92f7-963077f35601 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:02.543738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7acadedb-7361-4502-92f7-963077f35601 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:02.544185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7acadedb-7361-4502-92f7-963077f35601 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:02.688375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7acadedb-7361-4502-92f7-963077f35601 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:02.699012 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7acadedb-7361-4502-92f7-963077f35601 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1387 microversion: 2.1 time: 0.170541 Jul 20 04:56:02.699658 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3122/6345] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:02 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1387 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:03.716729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f114ac85-77db-4f3e-a064-c1e3b972160c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:03.717585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f114ac85-77db-4f3e-a064-c1e3b972160c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:03.725136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f114ac85-77db-4f3e-a064-c1e3b972160c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:03.725633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f114ac85-77db-4f3e-a064-c1e3b972160c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:03.726422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f114ac85-77db-4f3e-a064-c1e3b972160c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:03.726910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f114ac85-77db-4f3e-a064-c1e3b972160c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:03.866817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f114ac85-77db-4f3e-a064-c1e3b972160c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:03.875294 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f114ac85-77db-4f3e-a064-c1e3b972160c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1375 microversion: 2.1 time: 0.162841 Jul 20 04:56:03.875905 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3224/6346] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:03 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:04.893216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8263ceae-cfb1-4558-a3be-e31fa237f54e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:04.893853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8263ceae-cfb1-4558-a3be-e31fa237f54e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:04.900539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8263ceae-cfb1-4558-a3be-e31fa237f54e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:04.901567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8263ceae-cfb1-4558-a3be-e31fa237f54e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:04.902667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8263ceae-cfb1-4558-a3be-e31fa237f54e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:04.903113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8263ceae-cfb1-4558-a3be-e31fa237f54e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:05.033611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8263ceae-cfb1-4558-a3be-e31fa237f54e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:05.042371 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8263ceae-cfb1-4558-a3be-e31fa237f54e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1375 microversion: 2.1 time: 0.152677 Jul 20 04:56:05.043042 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3123/6347] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:04 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:06.060714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39af16f4-e6c6-410b-a1cf-badaf7a162b3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:06.061452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-39af16f4-e6c6-410b-a1cf-badaf7a162b3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:06.069061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39af16f4-e6c6-410b-a1cf-badaf7a162b3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:06.069531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39af16f4-e6c6-410b-a1cf-badaf7a162b3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:06.070307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39af16f4-e6c6-410b-a1cf-badaf7a162b3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:06.070762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39af16f4-e6c6-410b-a1cf-badaf7a162b3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:06.230919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39af16f4-e6c6-410b-a1cf-badaf7a162b3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:06.239414 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39af16f4-e6c6-410b-a1cf-badaf7a162b3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1375 microversion: 2.1 time: 0.183752 Jul 20 04:56:06.240061 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3225/6348] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:06 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1375 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:07.258255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b88edfab-5baa-4881-b6e3-75dd3c843ee3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:07.259029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b88edfab-5baa-4881-b6e3-75dd3c843ee3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:07.268198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b88edfab-5baa-4881-b6e3-75dd3c843ee3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:07.268668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b88edfab-5baa-4881-b6e3-75dd3c843ee3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:07.269628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b88edfab-5baa-4881-b6e3-75dd3c843ee3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:07.270323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b88edfab-5baa-4881-b6e3-75dd3c843ee3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:07.414942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b88edfab-5baa-4881-b6e3-75dd3c843ee3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:07.423781 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b88edfab-5baa-4881-b6e3-75dd3c843ee3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1375 microversion: 2.1 time: 0.170046 Jul 20 04:56:07.424369 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3124/6349] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:07 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:08.441962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-11dd4293-5731-4746-8e76-f3750815797b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:08.442545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-11dd4293-5731-4746-8e76-f3750815797b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:08.450457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11dd4293-5731-4746-8e76-f3750815797b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:08.450926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11dd4293-5731-4746-8e76-f3750815797b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:08.452048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11dd4293-5731-4746-8e76-f3750815797b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:08.452886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-11dd4293-5731-4746-8e76-f3750815797b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:08.595758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-11dd4293-5731-4746-8e76-f3750815797b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:08.603385 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-11dd4293-5731-4746-8e76-f3750815797b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1375 microversion: 2.1 time: 0.165999 Jul 20 04:56:08.604006 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3226/6350] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:08 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:09.621671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9df25924-947b-4f34-b9d3-26d96077cc70 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:09.622276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9df25924-947b-4f34-b9d3-26d96077cc70 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:09.629552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9df25924-947b-4f34-b9d3-26d96077cc70 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:09.630000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9df25924-947b-4f34-b9d3-26d96077cc70 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:09.630766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9df25924-947b-4f34-b9d3-26d96077cc70 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:09.631201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9df25924-947b-4f34-b9d3-26d96077cc70 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:09.764742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9df25924-947b-4f34-b9d3-26d96077cc70 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:09.772930 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9df25924-947b-4f34-b9d3-26d96077cc70 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1375 microversion: 2.1 time: 0.155696 Jul 20 04:56:09.773514 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3125/6351] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:09 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:10.791244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-491b664a-2b33-4862-a0f4-511f880499f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:10.791958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-491b664a-2b33-4862-a0f4-511f880499f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:10.800052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-491b664a-2b33-4862-a0f4-511f880499f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:10.800635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-491b664a-2b33-4862-a0f4-511f880499f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:10.801427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-491b664a-2b33-4862-a0f4-511f880499f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:10.801882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-491b664a-2b33-4862-a0f4-511f880499f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:10.956278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-491b664a-2b33-4862-a0f4-511f880499f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:10.965602 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-491b664a-2b33-4862-a0f4-511f880499f2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1375 microversion: 2.1 time: 0.178060 Jul 20 04:56:10.966682 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3227/6352] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:10 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:11.984457 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b96eb472-f5b2-496b-9959-13bad4a9692e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:11.985213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b96eb472-f5b2-496b-9959-13bad4a9692e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:11.992256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b96eb472-f5b2-496b-9959-13bad4a9692e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:11.992648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b96eb472-f5b2-496b-9959-13bad4a9692e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:11.993430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b96eb472-f5b2-496b-9959-13bad4a9692e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:11.993874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b96eb472-f5b2-496b-9959-13bad4a9692e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:12.132091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b96eb472-f5b2-496b-9959-13bad4a9692e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:12.140591 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b96eb472-f5b2-496b-9959-13bad4a9692e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1375 microversion: 2.1 time: 0.160501 Jul 20 04:56:12.141227 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3126/6353] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:11 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:13.074262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-0b68130c-2c63-4cc3-ba3d-72b63f1933ef req-61149743-35b0-44ce-8259-e17066a15e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e12d92e-59c8-44d4-83d6-63fee639521e", "name": "network-vif-plugged", "status": "completed", "tag": "e5d6d336-2e24-40b9-a29f-00f03fc11a99"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:13.087335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0b68130c-2c63-4cc3-ba3d-72b63f1933ef req-61149743-35b0-44ce-8259-e17066a15e41 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:13.087844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0b68130c-2c63-4cc3-ba3d-72b63f1933ef req-61149743-35b0-44ce-8259-e17066a15e41 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:13.102943 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-0b68130c-2c63-4cc3-ba3d-72b63f1933ef req-61149743-35b0-44ce-8259-e17066a15e41 service nova] Creating event network-vif-plugged:e5d6d336-2e24-40b9-a29f-00f03fc11a99 for instance 3e12d92e-59c8-44d4-83d6-63fee639521e on n-h1-764485-11 Jul 20 04:56:13.110524 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-0b68130c-2c63-4cc3-ba3d-72b63f1933ef req-61149743-35b0-44ce-8259-e17066a15e41 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041165 Jul 20 04:56:13.111197 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3228/6354] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:13.159092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ab867462-29a0-4006-af90-8a818a0d43e1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:13.159785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ab867462-29a0-4006-af90-8a818a0d43e1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:13.166698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab867462-29a0-4006-af90-8a818a0d43e1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:13.167153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab867462-29a0-4006-af90-8a818a0d43e1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:13.167955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab867462-29a0-4006-af90-8a818a0d43e1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:13.168394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab867462-29a0-4006-af90-8a818a0d43e1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:13.392379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ab867462-29a0-4006-af90-8a818a0d43e1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:13.401188 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ab867462-29a0-4006-af90-8a818a0d43e1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1375 microversion: 2.1 time: 0.245983 Jul 20 04:56:13.401854 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3127/6355] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:13 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1375 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:14.422128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b535fbd8-9039-47ce-a477-ea6835cf1c1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:14.422977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b535fbd8-9039-47ce-a477-ea6835cf1c1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:14.431978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b535fbd8-9039-47ce-a477-ea6835cf1c1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:14.432786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b535fbd8-9039-47ce-a477-ea6835cf1c1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:14.433774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b535fbd8-9039-47ce-a477-ea6835cf1c1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:14.434388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b535fbd8-9039-47ce-a477-ea6835cf1c1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:14.581804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b535fbd8-9039-47ce-a477-ea6835cf1c1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:14.592459 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b535fbd8-9039-47ce-a477-ea6835cf1c1e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1375 microversion: 2.1 time: 0.176265 Jul 20 04:56:14.593061 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3229/6356] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:14 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:15.610682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6f0d7cc3-43b9-456c-a677-09fff31cb4a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:15.611298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6f0d7cc3-43b9-456c-a677-09fff31cb4a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:15.618329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f0d7cc3-43b9-456c-a677-09fff31cb4a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:15.618782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f0d7cc3-43b9-456c-a677-09fff31cb4a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:15.619568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f0d7cc3-43b9-456c-a677-09fff31cb4a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:15.620019 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6f0d7cc3-43b9-456c-a677-09fff31cb4a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:15.752833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6f0d7cc3-43b9-456c-a677-09fff31cb4a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:15.760526 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6f0d7cc3-43b9-456c-a677-09fff31cb4a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1562 microversion: 2.1 time: 0.154326 Jul 20 04:56:15.761105 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3128/6357] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:15 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:15.777939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e4af15af-548f-4f77-a1fe-a4c5444972c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:15.779287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e4af15af-548f-4f77-a1fe-a4c5444972c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:15.786262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e4af15af-548f-4f77-a1fe-a4c5444972c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:15.786735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e4af15af-548f-4f77-a1fe-a4c5444972c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:15.787550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e4af15af-548f-4f77-a1fe-a4c5444972c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:15.788007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e4af15af-548f-4f77-a1fe-a4c5444972c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:15.916631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e4af15af-548f-4f77-a1fe-a4c5444972c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:15.924598 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e4af15af-548f-4f77-a1fe-a4c5444972c1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1562 microversion: 2.1 time: 0.150641 Jul 20 04:56:15.925177 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3230/6358] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:15 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:15.993599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dce5d50e-eede-4dca-ae4e-07feb2722396 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:15.994134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dce5d50e-eede-4dca-ae4e-07feb2722396 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:16.000743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dce5d50e-eede-4dca-ae4e-07feb2722396 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:16.001225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dce5d50e-eede-4dca-ae4e-07feb2722396 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:16.001990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dce5d50e-eede-4dca-ae4e-07feb2722396 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:16.002434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dce5d50e-eede-4dca-ae4e-07feb2722396 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:16.028252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dce5d50e-eede-4dca-ae4e-07feb2722396 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:56:16.104408 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dce5d50e-eede-4dca-ae4e-07feb2722396 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 204 len: 0 microversion: 2.1 time: 0.114430 Jul 20 04:56:16.105016 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3129/6359] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:56:15 2022] DELETE /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:56:16.114107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3ac21341-3046-4a8c-9e12-c773fb8a908d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:16.114744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3ac21341-3046-4a8c-9e12-c773fb8a908d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:16.120957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ac21341-3046-4a8c-9e12-c773fb8a908d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:16.121370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ac21341-3046-4a8c-9e12-c773fb8a908d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:16.122159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ac21341-3046-4a8c-9e12-c773fb8a908d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:16.123182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ac21341-3046-4a8c-9e12-c773fb8a908d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:16.261334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3ac21341-3046-4a8c-9e12-c773fb8a908d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:16.270203 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3ac21341-3046-4a8c-9e12-c773fb8a908d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1568 microversion: 2.1 time: 0.160093 Jul 20 04:56:16.270804 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3231/6360] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:16 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:17.288160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7208280f-1662-4dfb-99cf-3b33ebd747da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:17.288868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7208280f-1662-4dfb-99cf-3b33ebd747da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:17.296187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7208280f-1662-4dfb-99cf-3b33ebd747da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:17.296643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7208280f-1662-4dfb-99cf-3b33ebd747da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:17.297411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7208280f-1662-4dfb-99cf-3b33ebd747da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:17.297852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7208280f-1662-4dfb-99cf-3b33ebd747da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:17.432193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7208280f-1662-4dfb-99cf-3b33ebd747da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:17.440394 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7208280f-1662-4dfb-99cf-3b33ebd747da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1568 microversion: 2.1 time: 0.156427 Jul 20 04:56:17.440912 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3130/6361] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:17 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:18.345549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-7f3a9008-bb16-4cab-99db-0396eee98c66 req-9729a1fe-8573-4208-b05f-7f1c18fabb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e12d92e-59c8-44d4-83d6-63fee639521e", "name": "network-vif-deleted", "tag": "e5d6d336-2e24-40b9-a29f-00f03fc11a99"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:18.361875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7f3a9008-bb16-4cab-99db-0396eee98c66 req-9729a1fe-8573-4208-b05f-7f1c18fabb13 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:18.362517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7f3a9008-bb16-4cab-99db-0396eee98c66 req-9729a1fe-8573-4208-b05f-7f1c18fabb13 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:18.378248 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7f3a9008-bb16-4cab-99db-0396eee98c66 req-9729a1fe-8573-4208-b05f-7f1c18fabb13 service nova] Creating event network-vif-deleted:e5d6d336-2e24-40b9-a29f-00f03fc11a99 for instance 3e12d92e-59c8-44d4-83d6-63fee639521e on n-h1-764485-11 Jul 20 04:56:18.386644 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-7f3a9008-bb16-4cab-99db-0396eee98c66 req-9729a1fe-8573-4208-b05f-7f1c18fabb13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048213 Jul 20 04:56:18.387462 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3232/6362] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:18.458056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-78a5e510-1003-495a-9952-87451211a856 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:18.458748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-78a5e510-1003-495a-9952-87451211a856 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:18.466506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78a5e510-1003-495a-9952-87451211a856 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:18.467299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78a5e510-1003-495a-9952-87451211a856 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:18.468162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78a5e510-1003-495a-9952-87451211a856 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:18.468598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78a5e510-1003-495a-9952-87451211a856 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:18.537964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-78a5e510-1003-495a-9952-87451211a856 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:18.546479 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-78a5e510-1003-495a-9952-87451211a856 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1360 microversion: 2.1 time: 0.092801 Jul 20 04:56:18.547058 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3131/6363] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:18 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1360 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:19.565449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aa6ffaa3-7c82-4fdd-b2d3-bfd73d9f70a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:19.566215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aa6ffaa3-7c82-4fdd-b2d3-bfd73d9f70a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:19.573553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa6ffaa3-7c82-4fdd-b2d3-bfd73d9f70a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:19.574029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa6ffaa3-7c82-4fdd-b2d3-bfd73d9f70a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:19.574817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa6ffaa3-7c82-4fdd-b2d3-bfd73d9f70a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:19.575862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-aa6ffaa3-7c82-4fdd-b2d3-bfd73d9f70a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:19.644372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aa6ffaa3-7c82-4fdd-b2d3-bfd73d9f70a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:19.652243 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aa6ffaa3-7c82-4fdd-b2d3-bfd73d9f70a2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1360 microversion: 2.1 time: 0.092255 Jul 20 04:56:19.652827 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3233/6364] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:19 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1360 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:20.671383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6446b2c8-b063-4a60-9976-3ad8f83d720e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:20.672028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6446b2c8-b063-4a60-9976-3ad8f83d720e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:20.679072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6446b2c8-b063-4a60-9976-3ad8f83d720e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:20.679751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6446b2c8-b063-4a60-9976-3ad8f83d720e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:20.680836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6446b2c8-b063-4a60-9976-3ad8f83d720e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:20.681273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6446b2c8-b063-4a60-9976-3ad8f83d720e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:20.749236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6446b2c8-b063-4a60-9976-3ad8f83d720e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:20.757666 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6446b2c8-b063-4a60-9976-3ad8f83d720e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1360 microversion: 2.1 time: 0.091266 Jul 20 04:56:20.758371 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3132/6365] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:20 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1360 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:21.777320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cab23e81-e029-4e7c-933b-27ef4ec3cdd9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:21.777967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cab23e81-e029-4e7c-933b-27ef4ec3cdd9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:21.786303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cab23e81-e029-4e7c-933b-27ef4ec3cdd9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:21.786769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cab23e81-e029-4e7c-933b-27ef4ec3cdd9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:21.787622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cab23e81-e029-4e7c-933b-27ef4ec3cdd9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:21.788081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cab23e81-e029-4e7c-933b-27ef4ec3cdd9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:21.860231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cab23e81-e029-4e7c-933b-27ef4ec3cdd9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:21.869595 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cab23e81-e029-4e7c-933b-27ef4ec3cdd9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1360 microversion: 2.1 time: 0.096307 Jul 20 04:56:21.870379 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3234/6366] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:21 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1360 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:22.889701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-06c7d497-2442-421b-be45-33993648544e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:22.891980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-06c7d497-2442-421b-be45-33993648544e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:22.901513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06c7d497-2442-421b-be45-33993648544e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:22.902561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06c7d497-2442-421b-be45-33993648544e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:22.904378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06c7d497-2442-421b-be45-33993648544e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:22.905055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06c7d497-2442-421b-be45-33993648544e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:22.950887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06c7d497-2442-421b-be45-33993648544e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:22.951628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-06c7d497-2442-421b-be45-33993648544e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:22.952212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-06c7d497-2442-421b-be45-33993648544e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lazy-loading 'fault' on Instance uuid 3e12d92e-59c8-44d4-83d6-63fee639521e {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:56:22.995657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-06c7d497-2442-421b-be45-33993648544e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:23.006616 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-06c7d497-2442-421b-be45-33993648544e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 200 len: 1365 microversion: 2.1 time: 0.123373 Jul 20 04:56:23.007356 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3133/6367] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:22 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:24.024406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7db2094d-5c43-4499-90f5-3b3ba25d10dc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:24.025035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7db2094d-5c43-4499-90f5-3b3ba25d10dc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:24.033212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7db2094d-5c43-4499-90f5-3b3ba25d10dc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:24.033674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7db2094d-5c43-4499-90f5-3b3ba25d10dc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:24.034460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7db2094d-5c43-4499-90f5-3b3ba25d10dc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:24.034909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7db2094d-5c43-4499-90f5-3b3ba25d10dc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:24.048355 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-7db2094d-5c43-4499-90f5-3b3ba25d10dc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7db2094d-5c43-4499-90f5-3b3ba25d10dc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e HTTP/1.1 Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '3e12d92e-59c8-44d4-83d6-63fee639521e'} Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:24.050071 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:24.055402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:24.055402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:24.055402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:24.055402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:24.055402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:24.055402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:24.055402 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:24.055402 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7db2094d-5c43-4499-90f5-3b3ba25d10dc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:24.055402 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7db2094d-5c43-4499-90f5-3b3ba25d10dc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 404 len: 111 microversion: 2.1 time: 0.031010 Jul 20 04:56:24.055402 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3235/6368] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:24 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:28.335904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1111c2f4-fd96-47d9-aba2-41cc51bdb6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:28.336415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1111c2f4-fd96-47d9-aba2-41cc51bdb6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:28.339268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:28.345049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1111c2f4-fd96-47d9-aba2-41cc51bdb6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:28.345510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1111c2f4-fd96-47d9-aba2-41cc51bdb6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:28.346294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1111c2f4-fd96-47d9-aba2-41cc51bdb6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:28.346739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1111c2f4-fd96-47d9-aba2-41cc51bdb6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:28.351488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:28.377197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1111c2f4-fd96-47d9-aba2-41cc51bdb6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:56:28.456762 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1111c2f4-fd96-47d9-aba2-41cc51bdb6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 204 len: 0 microversion: 2.1 time: 0.123821 Jul 20 04:56:28.457368 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3134/6369] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:56:28 2022] DELETE /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:56:28.465314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d49b43b5-1f28-4055-819d-e9ebffb8de63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:28.465987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d49b43b5-1f28-4055-819d-e9ebffb8de63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:28.469965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=32 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:28.474004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d49b43b5-1f28-4055-819d-e9ebffb8de63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:28.474680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d49b43b5-1f28-4055-819d-e9ebffb8de63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:28.475465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d49b43b5-1f28-4055-819d-e9ebffb8de63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:28.475972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d49b43b5-1f28-4055-819d-e9ebffb8de63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:28.478782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=84 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:28.612674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d49b43b5-1f28-4055-819d-e9ebffb8de63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:28.620292 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d49b43b5-1f28-4055-819d-e9ebffb8de63 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1411 microversion: 2.1 time: 0.158746 Jul 20 04:56:28.620879 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3236/6370] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:28 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:29.642394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-95cb6aed-8fb1-4099-8625-b0a626368bf5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:29.643118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-95cb6aed-8fb1-4099-8625-b0a626368bf5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:29.649985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95cb6aed-8fb1-4099-8625-b0a626368bf5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:29.650431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95cb6aed-8fb1-4099-8625-b0a626368bf5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:29.651190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95cb6aed-8fb1-4099-8625-b0a626368bf5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:29.651654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-95cb6aed-8fb1-4099-8625-b0a626368bf5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:29.786158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-95cb6aed-8fb1-4099-8625-b0a626368bf5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:29.793967 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-95cb6aed-8fb1-4099-8625-b0a626368bf5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1411 microversion: 2.1 time: 0.156428 Jul 20 04:56:29.794578 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3135/6371] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:29 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:30.044419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2df8f6fd-2371-45cc-8ece-bf097ba4eebc tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:30.045349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2df8f6fd-2371-45cc-8ece-bf097ba4eebc tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:30.052339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2df8f6fd-2371-45cc-8ece-bf097ba4eebc tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.052806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2df8f6fd-2371-45cc-8ece-bf097ba4eebc tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.053610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2df8f6fd-2371-45cc-8ece-bf097ba4eebc tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.054065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2df8f6fd-2371-45cc-8ece-bf097ba4eebc tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.286350 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2df8f6fd-2371-45cc-8ece-bf097ba4eebc tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1833 microversion: 2.1 time: 0.246197 Jul 20 04:56:30.286978 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3237/6372] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:30 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1833 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:30.304895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a2d4683-d080-4eee-9cb6-826cdfa3e1fc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:30.305628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a2d4683-d080-4eee-9cb6-826cdfa3e1fc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:30.312361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a2d4683-d080-4eee-9cb6-826cdfa3e1fc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.312896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a2d4683-d080-4eee-9cb6-826cdfa3e1fc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.313754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a2d4683-d080-4eee-9cb6-826cdfa3e1fc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.314272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a2d4683-d080-4eee-9cb6-826cdfa3e1fc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.455228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a2d4683-d080-4eee-9cb6-826cdfa3e1fc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:30.463782 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a2d4683-d080-4eee-9cb6-826cdfa3e1fc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1680 microversion: 2.1 time: 0.163171 Jul 20 04:56:30.464373 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3136/6373] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:30 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:30.555122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9a4ac754-0132-46cd-ad2f-5652b0a7f278 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:30.556122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9a4ac754-0132-46cd-ad2f-5652b0a7f278 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:30.562850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a4ac754-0132-46cd-ad2f-5652b0a7f278 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.563318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a4ac754-0132-46cd-ad2f-5652b0a7f278 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.564138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a4ac754-0132-46cd-ad2f-5652b0a7f278 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.564598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9a4ac754-0132-46cd-ad2f-5652b0a7f278 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.624208 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9a4ac754-0132-46cd-ad2f-5652b0a7f278 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f/action" status: 200 len: 32645 microversion: 2.1 time: 0.072930 Jul 20 04:56:30.625100 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3238/6374] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:56:30 2022] POST /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f/action => generated 32645 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:56:30.749172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-7b05c1d2-1b90-4f8d-84d3-221a67724653 req-f926715a-c657-489f-93eb-800c495fea80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "108e91f7-3e52-4ddc-843d-d56ab50ede20", "name": "network-vif-deleted", "tag": "3be6c483-8638-4398-909c-5ec91b24e45e"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:30.759098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7b05c1d2-1b90-4f8d-84d3-221a67724653 req-f926715a-c657-489f-93eb-800c495fea80 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.759566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7b05c1d2-1b90-4f8d-84d3-221a67724653 req-f926715a-c657-489f-93eb-800c495fea80 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.771407 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-7b05c1d2-1b90-4f8d-84d3-221a67724653 req-f926715a-c657-489f-93eb-800c495fea80 service nova] Creating event network-vif-deleted:3be6c483-8638-4398-909c-5ec91b24e45e for instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 on n-h2-764485-11 Jul 20 04:56:30.776786 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-7b05c1d2-1b90-4f8d-84d3-221a67724653 req-f926715a-c657-489f-93eb-800c495fea80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032205 Jul 20 04:56:30.777080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bdeda15b-32c9-4a9a-9f30-282b7c5b5205 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:30.778170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bdeda15b-32c9-4a9a-9f30-282b7c5b5205 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:30.780857 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3137/6375] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:30.786709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bdeda15b-32c9-4a9a-9f30-282b7c5b5205 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.787171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bdeda15b-32c9-4a9a-9f30-282b7c5b5205 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.788009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bdeda15b-32c9-4a9a-9f30-282b7c5b5205 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.788463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bdeda15b-32c9-4a9a-9f30-282b7c5b5205 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.813389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-20c9ec05-8390-4bcc-a5ae-2da44e11a3f7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:30.814330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-20c9ec05-8390-4bcc-a5ae-2da44e11a3f7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:30.821322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20c9ec05-8390-4bcc-a5ae-2da44e11a3f7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.821974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20c9ec05-8390-4bcc-a5ae-2da44e11a3f7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.822761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20c9ec05-8390-4bcc-a5ae-2da44e11a3f7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.823210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20c9ec05-8390-4bcc-a5ae-2da44e11a3f7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.833507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bdeda15b-32c9-4a9a-9f30-282b7c5b5205 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8962e705f3124641b257982ae85e683c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94151cf945cf4635af422f29baee5201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:30.834283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bdeda15b-32c9-4a9a-9f30-282b7c5b5205 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] flavor_id is None. Assuming migration. {{(pid=119808) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:56:30.834621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bdeda15b-32c9-4a9a-9f30-282b7c5b5205 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119808) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:56:30.898074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-20c9ec05-8390-4bcc-a5ae-2da44e11a3f7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:30.906411 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-20c9ec05-8390-4bcc-a5ae-2da44e11a3f7 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1202 microversion: 2.1 time: 0.099854 Jul 20 04:56:30.907120 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3138/6376] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:30 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:31.025838 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bdeda15b-32c9-4a9a-9f30-282b7c5b5205 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f/action" status: 202 len: 0 microversion: 2.1 time: 0.254346 Jul 20 04:56:31.031669 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3239/6377] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:56:30 2022] POST /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:56:31.036094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2a221ceb-fa41-4e81-b1c3-64a8d00c101d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:31.036729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2a221ceb-fa41-4e81-b1c3-64a8d00c101d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:31.042780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a221ceb-fa41-4e81-b1c3-64a8d00c101d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:31.043149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a221ceb-fa41-4e81-b1c3-64a8d00c101d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:31.045421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a221ceb-fa41-4e81-b1c3-64a8d00c101d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:31.045882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a221ceb-fa41-4e81-b1c3-64a8d00c101d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:31.548871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2a221ceb-fa41-4e81-b1c3-64a8d00c101d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:31.559911 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2a221ceb-fa41-4e81-b1c3-64a8d00c101d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1689 microversion: 2.1 time: 0.527755 Jul 20 04:56:31.567021 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3139/6378] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:31 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1689 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:31.923157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ef537bc7-4358-47f6-ba66-3764bed14b69 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:31.924022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ef537bc7-4358-47f6-ba66-3764bed14b69 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:31.931992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef537bc7-4358-47f6-ba66-3764bed14b69 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:31.932542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef537bc7-4358-47f6-ba66-3764bed14b69 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:31.933404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef537bc7-4358-47f6-ba66-3764bed14b69 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:31.933958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef537bc7-4358-47f6-ba66-3764bed14b69 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:32.010854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ef537bc7-4358-47f6-ba66-3764bed14b69 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:32.022218 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ef537bc7-4358-47f6-ba66-3764bed14b69 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1202 microversion: 2.1 time: 0.103265 Jul 20 04:56:32.023502 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3240/6379] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:31 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1202 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:32.577984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2d96289e-a7eb-4f80-a7f2-829c5a792822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:32.578776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2d96289e-a7eb-4f80-a7f2-829c5a792822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:32.586264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d96289e-a7eb-4f80-a7f2-829c5a792822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:32.586844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d96289e-a7eb-4f80-a7f2-829c5a792822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:32.587760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d96289e-a7eb-4f80-a7f2-829c5a792822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:32.588316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d96289e-a7eb-4f80-a7f2-829c5a792822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:32.797464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2d96289e-a7eb-4f80-a7f2-829c5a792822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:32.807022 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2d96289e-a7eb-4f80-a7f2-829c5a792822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1689 microversion: 2.1 time: 0.233193 Jul 20 04:56:32.807806 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3140/6380] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:32 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1689 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:33.040592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4ab4c989-dff0-4dce-8f33-549af3aa3745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:33.041138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4ab4c989-dff0-4dce-8f33-549af3aa3745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:33.048355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ab4c989-dff0-4dce-8f33-549af3aa3745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:33.048818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ab4c989-dff0-4dce-8f33-549af3aa3745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:33.049779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ab4c989-dff0-4dce-8f33-549af3aa3745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:33.050233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4ab4c989-dff0-4dce-8f33-549af3aa3745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:33.145451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4ab4c989-dff0-4dce-8f33-549af3aa3745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:33.153374 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4ab4c989-dff0-4dce-8f33-549af3aa3745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1202 microversion: 2.1 time: 0.116479 Jul 20 04:56:33.153977 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3241/6381] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:33 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1202 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:33.824716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-73b286bd-d070-4b34-87fa-911e46332be6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:33.825861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-73b286bd-d070-4b34-87fa-911e46332be6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:33.832436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73b286bd-d070-4b34-87fa-911e46332be6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:33.832883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73b286bd-d070-4b34-87fa-911e46332be6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:33.833641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73b286bd-d070-4b34-87fa-911e46332be6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:33.834085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-73b286bd-d070-4b34-87fa-911e46332be6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:33.967861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-73b286bd-d070-4b34-87fa-911e46332be6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:33.975599 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-73b286bd-d070-4b34-87fa-911e46332be6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1694 microversion: 2.1 time: 0.154951 Jul 20 04:56:33.976176 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3141/6382] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:33 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:34.171559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b1fc064-d7c0-4ae9-9458-1f225d4bb311 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:34.171983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b1fc064-d7c0-4ae9-9458-1f225d4bb311 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:34.179172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b1fc064-d7c0-4ae9-9458-1f225d4bb311 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:34.179630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b1fc064-d7c0-4ae9-9458-1f225d4bb311 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:34.180447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b1fc064-d7c0-4ae9-9458-1f225d4bb311 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:34.180944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3b1fc064-d7c0-4ae9-9458-1f225d4bb311 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:34.251765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b1fc064-d7c0-4ae9-9458-1f225d4bb311 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:34.259594 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b1fc064-d7c0-4ae9-9458-1f225d4bb311 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1202 microversion: 2.1 time: 0.093182 Jul 20 04:56:34.260169 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3242/6383] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:34 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:34.993717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ffc85819-5a64-4227-b47b-f81ee91a8daa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:34.994330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ffc85819-5a64-4227-b47b-f81ee91a8daa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:35.002517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffc85819-5a64-4227-b47b-f81ee91a8daa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:35.002959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffc85819-5a64-4227-b47b-f81ee91a8daa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:35.003987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffc85819-5a64-4227-b47b-f81ee91a8daa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:35.004572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ffc85819-5a64-4227-b47b-f81ee91a8daa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:35.149844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ffc85819-5a64-4227-b47b-f81ee91a8daa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:35.159298 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ffc85819-5a64-4227-b47b-f81ee91a8daa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1694 microversion: 2.1 time: 0.169324 Jul 20 04:56:35.160402 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3142/6384] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:34 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:35.277337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d9282cd-acce-4818-af5b-55bc0550e45c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:35.278788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5d9282cd-acce-4818-af5b-55bc0550e45c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:35.286110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d9282cd-acce-4818-af5b-55bc0550e45c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:35.286672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d9282cd-acce-4818-af5b-55bc0550e45c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:35.287462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d9282cd-acce-4818-af5b-55bc0550e45c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:35.287950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d9282cd-acce-4818-af5b-55bc0550e45c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:35.319120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d9282cd-acce-4818-af5b-55bc0550e45c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:35.319620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d9282cd-acce-4818-af5b-55bc0550e45c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:35.320089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-5d9282cd-acce-4818-af5b-55bc0550e45c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lazy-loading 'fault' on Instance uuid 108e91f7-3e52-4ddc-843d-d56ab50ede20 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:56:35.362772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5d9282cd-acce-4818-af5b-55bc0550e45c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:35.370640 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5d9282cd-acce-4818-af5b-55bc0550e45c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 200 len: 1207 microversion: 2.1 time: 0.097400 Jul 20 04:56:35.371219 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3243/6385] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:35 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 1207 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:36.176956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f07cb5b-287b-4514-9586-1c815336f9f9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:36.177508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0f07cb5b-287b-4514-9586-1c815336f9f9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:36.185512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f07cb5b-287b-4514-9586-1c815336f9f9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:36.186065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f07cb5b-287b-4514-9586-1c815336f9f9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:36.186761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f07cb5b-287b-4514-9586-1c815336f9f9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:36.187212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f07cb5b-287b-4514-9586-1c815336f9f9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:36.324354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0f07cb5b-287b-4514-9586-1c815336f9f9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:36.332288 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f07cb5b-287b-4514-9586-1c815336f9f9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1694 microversion: 2.1 time: 0.159489 Jul 20 04:56:36.332867 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3143/6386] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:36 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:36.388794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f16b7eca-cab4-493a-98f3-2306dc6a352b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:36.389437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f16b7eca-cab4-493a-98f3-2306dc6a352b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:36.396660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f16b7eca-cab4-493a-98f3-2306dc6a352b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:36.397160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f16b7eca-cab4-493a-98f3-2306dc6a352b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:36.397950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f16b7eca-cab4-493a-98f3-2306dc6a352b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:36.398405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f16b7eca-cab4-493a-98f3-2306dc6a352b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:36.412934 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f16b7eca-cab4-493a-98f3-2306dc6a352b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f16b7eca-cab4-493a-98f3-2306dc6a352b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 HTTP/1.1 Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '108e91f7-3e52-4ddc-843d-d56ab50ede20'} Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:36.414608 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:36.420685 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:36.420685 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:36.420685 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:36.420685 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:36.420685 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:36.420685 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:36.420685 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:36.420685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f16b7eca-cab4-493a-98f3-2306dc6a352b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:36.420685 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f16b7eca-cab4-493a-98f3-2306dc6a352b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 404 len: 111 microversion: 2.1 time: 0.031613 Jul 20 04:56:36.420685 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3244/6387] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:36 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:37.352965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a2393628-9894-4b12-a73e-4e5466b8ca0a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:37.353513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a2393628-9894-4b12-a73e-4e5466b8ca0a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:37.361427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2393628-9894-4b12-a73e-4e5466b8ca0a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:37.361882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2393628-9894-4b12-a73e-4e5466b8ca0a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:37.362664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2393628-9894-4b12-a73e-4e5466b8ca0a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:37.363106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a2393628-9894-4b12-a73e-4e5466b8ca0a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:37.499696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a2393628-9894-4b12-a73e-4e5466b8ca0a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:37.508952 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a2393628-9894-4b12-a73e-4e5466b8ca0a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1694 microversion: 2.1 time: 0.160022 Jul 20 04:56:37.509665 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3144/6388] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:37 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:38.527103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2ce465b9-e64d-4b77-ae37-9a12a06bc3db tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:38.528528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2ce465b9-e64d-4b77-ae37-9a12a06bc3db tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:38.537962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ce465b9-e64d-4b77-ae37-9a12a06bc3db tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.538437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ce465b9-e64d-4b77-ae37-9a12a06bc3db tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.539239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ce465b9-e64d-4b77-ae37-9a12a06bc3db tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.539816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ce465b9-e64d-4b77-ae37-9a12a06bc3db tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.557516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b3b2c3b3-0e42-440c-8a5c-0c950e20a1e2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:38.558057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b3b2c3b3-0e42-440c-8a5c-0c950e20a1e2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:38.565618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3b2c3b3-0e42-440c-8a5c-0c950e20a1e2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.566160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3b2c3b3-0e42-440c-8a5c-0c950e20a1e2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.567021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3b2c3b3-0e42-440c-8a5c-0c950e20a1e2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.567575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3b2c3b3-0e42-440c-8a5c-0c950e20a1e2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.582224 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b3b2c3b3-0e42-440c-8a5c-0c950e20a1e2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b3b2c3b3-0e42-440c-8a5c-0c950e20a1e2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e HTTP/1.1 Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '3e12d92e-59c8-44d4-83d6-63fee639521e'} Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:38.583973 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b3b2c3b3-0e42-440c-8a5c-0c950e20a1e2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b3b2c3b3-0e42-440c-8a5c-0c950e20a1e2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 404 len: 111 microversion: 2.1 time: 0.032133 Jul 20 04:56:38.591395 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3145/6389] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:56:38 2022] DELETE /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:38.596840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7769905c-e1f0-417d-afc0-75385ca965bd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:38.597461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7769905c-e1f0-417d-afc0-75385ca965bd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 3e12d92e-59c8-44d4-83d6-63fee639521e] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:38.604183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7769905c-e1f0-417d-afc0-75385ca965bd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.604852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7769905c-e1f0-417d-afc0-75385ca965bd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.605900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7769905c-e1f0-417d-afc0-75385ca965bd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.606954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7769905c-e1f0-417d-afc0-75385ca965bd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.626266 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-7769905c-e1f0-417d-afc0-75385ca965bd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7769905c-e1f0-417d-afc0-75385ca965bd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e HTTP/1.1 Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '3e12d92e-59c8-44d4-83d6-63fee639521e'} Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:38.627877 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.633032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:38.633032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:38.633032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:38.633032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:38.633032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:38.633032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. Jul 20 04:56:38.633032 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:38.633032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7769905c-e1f0-417d-afc0-75385ca965bd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance 3e12d92e-59c8-44d4-83d6-63fee639521e could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:38.633032 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7769905c-e1f0-417d-afc0-75385ca965bd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e" status: 404 len: 111 microversion: 2.1 time: 0.036285 Jul 20 04:56:38.633032 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3146/6390] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:38 2022] GET /compute/v2.1/servers/3e12d92e-59c8-44d4-83d6-63fee639521e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:38.685474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2ce465b9-e64d-4b77-ae37-9a12a06bc3db tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:38.693040 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2ce465b9-e64d-4b77-ae37-9a12a06bc3db tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1694 microversion: 2.1 time: 0.169985 Jul 20 04:56:38.693624 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3245/6391] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:38 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:38.999487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac87f92d-a86e-496e-9b20-6025a90481a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:39.000096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac87f92d-a86e-496e-9b20-6025a90481a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:39.006565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac87f92d-a86e-496e-9b20-6025a90481a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:39.007030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac87f92d-a86e-496e-9b20-6025a90481a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:39.007836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac87f92d-a86e-496e-9b20-6025a90481a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:39.008284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac87f92d-a86e-496e-9b20-6025a90481a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:39.022534 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-ac87f92d-a86e-496e-9b20-6025a90481a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac87f92d-a86e-496e-9b20-6025a90481a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 HTTP/1.1 Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '108e91f7-3e52-4ddc-843d-d56ab50ede20'} Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:39.024391 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac87f92d-a86e-496e-9b20-6025a90481a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ac87f92d-a86e-496e-9b20-6025a90481a6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 404 len: 111 microversion: 2.1 time: 0.030452 Jul 20 04:56:39.030131 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3147/6392] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:56:38 2022] DELETE /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:39.035443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eb3b4ce9-34ea-4d48-8b7f-f1022f332901 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:39.036112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eb3b4ce9-34ea-4d48-8b7f-f1022f332901 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: 108e91f7-3e52-4ddc-843d-d56ab50ede20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:39.042654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb3b4ce9-34ea-4d48-8b7f-f1022f332901 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:39.043127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb3b4ce9-34ea-4d48-8b7f-f1022f332901 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:39.043984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb3b4ce9-34ea-4d48-8b7f-f1022f332901 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:39.044447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb3b4ce9-34ea-4d48-8b7f-f1022f332901 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:39.059231 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-eb3b4ce9-34ea-4d48-8b7f-f1022f332901 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eb3b4ce9-34ea-4d48-8b7f-f1022f332901 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 HTTP/1.1 Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '108e91f7-3e52-4ddc-843d-d56ab50ede20'} Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:39.060994 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:39.065548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:39.065548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:39.065548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:39.065548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:39.065548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:39.065548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. Jul 20 04:56:39.065548 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 04:56:39.065548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eb3b4ce9-34ea-4d48-8b7f-f1022f332901 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance 108e91f7-3e52-4ddc-843d-d56ab50ede20 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:39.065548 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eb3b4ce9-34ea-4d48-8b7f-f1022f332901 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20" status: 404 len: 111 microversion: 2.1 time: 0.030985 Jul 20 04:56:39.065548 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3246/6393] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:39 2022] GET /compute/v2.1/servers/108e91f7-3e52-4ddc-843d-d56ab50ede20 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:39.148155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-136d0f1a-d4d6-4c44-83dc-1f91a71fe347 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Action: 'create', calling method: .version_select at 0x7fbf9c197700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1146711925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyA3fPSHTgg82A6IyY6fQNd2lucJvpb0It27X48igzhOfU5j9yK+n6C75gFHzPTwygRaNPJRyhrE7JgjiKSfZRVCg+NBPT5cvPd2yNpNIcZ0MK1vWS2lJCt6h8oqWo5MQ=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:39.162686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-136d0f1a-d4d6-4c44-83dc-1f91a71fe347 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:56:39.167815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-136d0f1a-d4d6-4c44-83dc-1f91a71fe347 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for user 1f70af961f624dceba390cb44ef2a792 and project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:56:39.181235 n-d-764485-11 devstack@n-api.service[119807]: ERROR oslo.messaging._drivers.impl_rabbit [None req-136d0f1a-d4d6-4c44-83dc-1f91a71fe347 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [bca7174f-0467-4fc3-b62f-e45d1aa4ab6a] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 04:56:39.711870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f974771f-14be-4937-9e1f-00edfd23f7bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:39.712426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f974771f-14be-4937-9e1f-00edfd23f7bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:39.719804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f974771f-14be-4937-9e1f-00edfd23f7bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:39.720272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f974771f-14be-4937-9e1f-00edfd23f7bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:39.721051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f974771f-14be-4937-9e1f-00edfd23f7bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:39.721535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f974771f-14be-4937-9e1f-00edfd23f7bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:39.858418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f974771f-14be-4937-9e1f-00edfd23f7bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:39.865984 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f974771f-14be-4937-9e1f-00edfd23f7bc tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1694 microversion: 2.1 time: 0.158217 Jul 20 04:56:39.866566 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3247/6394] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:39 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:40.190254 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [None req-136d0f1a-d4d6-4c44-83dc-1f91a71fe347 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [bca7174f-0467-4fc3-b62f-e45d1aa4ab6a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48516. Jul 20 04:56:40.205280 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-136d0f1a-d4d6-4c44-83dc-1f91a71fe347 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.061081 Jul 20 04:56:40.205898 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3148/6395] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:56:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:40.887462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39ae157e-a8b3-4c07-93b2-86682d8e1620 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:40.888813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-39ae157e-a8b3-4c07-93b2-86682d8e1620 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:40.895037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39ae157e-a8b3-4c07-93b2-86682d8e1620 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:40.895530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39ae157e-a8b3-4c07-93b2-86682d8e1620 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:40.896322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39ae157e-a8b3-4c07-93b2-86682d8e1620 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:40.896777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39ae157e-a8b3-4c07-93b2-86682d8e1620 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:41.042813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39ae157e-a8b3-4c07-93b2-86682d8e1620 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:41.051786 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39ae157e-a8b3-4c07-93b2-86682d8e1620 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1694 microversion: 2.1 time: 0.171784 Jul 20 04:56:41.052392 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3248/6396] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:40 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:42.070118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7c050db6-2dd0-4a7d-8533-ba93e316f2b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:42.072117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7c050db6-2dd0-4a7d-8533-ba93e316f2b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:42.078959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c050db6-2dd0-4a7d-8533-ba93e316f2b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:42.079501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c050db6-2dd0-4a7d-8533-ba93e316f2b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:42.080392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c050db6-2dd0-4a7d-8533-ba93e316f2b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:42.080914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7c050db6-2dd0-4a7d-8533-ba93e316f2b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:42.219976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7c050db6-2dd0-4a7d-8533-ba93e316f2b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:42.227856 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7c050db6-2dd0-4a7d-8533-ba93e316f2b4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1694 microversion: 2.1 time: 0.162868 Jul 20 04:56:42.228382 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3149/6397] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:42 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:43.245550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0ce7515a-d0c3-435c-8055-7e1ac9345ef4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:43.246314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0ce7515a-d0c3-435c-8055-7e1ac9345ef4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:43.254276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ce7515a-d0c3-435c-8055-7e1ac9345ef4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:43.254755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ce7515a-d0c3-435c-8055-7e1ac9345ef4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:43.255584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ce7515a-d0c3-435c-8055-7e1ac9345ef4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:43.256045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0ce7515a-d0c3-435c-8055-7e1ac9345ef4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:43.396685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0ce7515a-d0c3-435c-8055-7e1ac9345ef4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:43.405236 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0ce7515a-d0c3-435c-8055-7e1ac9345ef4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1694 microversion: 2.1 time: 0.163536 Jul 20 04:56:43.406034 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3249/6398] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:43 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:44.423667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3074203a-eed8-4871-9097-2b1fffa8d8c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:44.424397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3074203a-eed8-4871-9097-2b1fffa8d8c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:44.430751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3074203a-eed8-4871-9097-2b1fffa8d8c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:44.431206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3074203a-eed8-4871-9097-2b1fffa8d8c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:44.432002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3074203a-eed8-4871-9097-2b1fffa8d8c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:44.432445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3074203a-eed8-4871-9097-2b1fffa8d8c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:44.578398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3074203a-eed8-4871-9097-2b1fffa8d8c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:44.586977 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3074203a-eed8-4871-9097-2b1fffa8d8c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1694 microversion: 2.1 time: 0.168710 Jul 20 04:56:44.587780 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3150/6399] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:44 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:45.604446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e857057-b9a8-4812-86f8-90179e337478 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:45.605089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6e857057-b9a8-4812-86f8-90179e337478 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:45.613208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e857057-b9a8-4812-86f8-90179e337478 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:45.613684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e857057-b9a8-4812-86f8-90179e337478 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:45.614474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e857057-b9a8-4812-86f8-90179e337478 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:45.615140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e857057-b9a8-4812-86f8-90179e337478 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:45.787185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6e857057-b9a8-4812-86f8-90179e337478 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:45.796712 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6e857057-b9a8-4812-86f8-90179e337478 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1693 microversion: 2.1 time: 0.196202 Jul 20 04:56:45.797319 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3250/6400] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:45 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1693 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:45.844965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0eb5f910-3dd8-4164-a59b-d0c1607e9f14 req-b7145899-ad2d-4434-a239-1860f6573583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f", "name": "network-vif-unplugged", "status": "completed", "tag": "df849559-fdd4-4f00-a0c5-584f004e6356"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:45.853955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0eb5f910-3dd8-4164-a59b-d0c1607e9f14 req-b7145899-ad2d-4434-a239-1860f6573583 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:45.854404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0eb5f910-3dd8-4164-a59b-d0c1607e9f14 req-b7145899-ad2d-4434-a239-1860f6573583 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:45.868370 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0eb5f910-3dd8-4164-a59b-d0c1607e9f14 req-b7145899-ad2d-4434-a239-1860f6573583 service nova] Creating event network-vif-unplugged:df849559-fdd4-4f00-a0c5-584f004e6356 for instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f on n-h2-764485-11 Jul 20 04:56:45.876864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-0eb5f910-3dd8-4164-a59b-d0c1607e9f14 req-b7145899-ad2d-4434-a239-1860f6573583 service nova] Instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:56:45.889747 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0eb5f910-3dd8-4164-a59b-d0c1607e9f14 req-b7145899-ad2d-4434-a239-1860f6573583 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048915 Jul 20 04:56:45.890678 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3151/6401] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:46.814520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be1624ab-c2b3-4424-b440-64a5187a670d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:46.815467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-be1624ab-c2b3-4424-b440-64a5187a670d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:46.823761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be1624ab-c2b3-4424-b440-64a5187a670d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:46.824339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be1624ab-c2b3-4424-b440-64a5187a670d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:46.825847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be1624ab-c2b3-4424-b440-64a5187a670d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:46.826389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be1624ab-c2b3-4424-b440-64a5187a670d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:46.983130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-be1624ab-c2b3-4424-b440-64a5187a670d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:46.993165 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-be1624ab-c2b3-4424-b440-64a5187a670d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1693 microversion: 2.1 time: 0.182189 Jul 20 04:56:46.994349 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3251/6402] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:46 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1693 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:47.906490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1749171c-b9c3-4d32-a428-d9862f2dd607 req-a441db26-a3bb-4f57-a860-2f4b092e0c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f", "tag": "df849559-fdd4-4f00-a0c5-584f004e6356"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:47.915333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1749171c-b9c3-4d32-a428-d9862f2dd607 req-a441db26-a3bb-4f57-a860-2f4b092e0c48 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:47.915815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1749171c-b9c3-4d32-a428-d9862f2dd607 req-a441db26-a3bb-4f57-a860-2f4b092e0c48 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:47.928074 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1749171c-b9c3-4d32-a428-d9862f2dd607 req-a441db26-a3bb-4f57-a860-2f4b092e0c48 service nova] Creating event network-changed:df849559-fdd4-4f00-a0c5-584f004e6356 for instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f on n-h2-764485-11 Jul 20 04:56:47.933799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-1749171c-b9c3-4d32-a428-d9862f2dd607 req-a441db26-a3bb-4f57-a860-2f4b092e0c48 service nova] Instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:56:47.945219 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1749171c-b9c3-4d32-a428-d9862f2dd607 req-a441db26-a3bb-4f57-a860-2f4b092e0c48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043813 Jul 20 04:56:47.945842 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3152/6403] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:48.010596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-792a4fc9-c197-43cf-86de-6eb753438866 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:48.011328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-792a4fc9-c197-43cf-86de-6eb753438866 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:48.018518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-792a4fc9-c197-43cf-86de-6eb753438866 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:48.019078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-792a4fc9-c197-43cf-86de-6eb753438866 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:48.019989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-792a4fc9-c197-43cf-86de-6eb753438866 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:48.020522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-792a4fc9-c197-43cf-86de-6eb753438866 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:48.037492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:48.256172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-792a4fc9-c197-43cf-86de-6eb753438866 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:48.264742 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-792a4fc9-c197-43cf-86de-6eb753438866 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1691 microversion: 2.1 time: 0.258009 Jul 20 04:56:48.265351 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3252/6404] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:48 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1691 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:49.280745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:49.284981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7f2b02b7-8c68-4eb7-9f52-e337bbe11aa6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:49.285684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7f2b02b7-8c68-4eb7-9f52-e337bbe11aa6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:49.292373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f2b02b7-8c68-4eb7-9f52-e337bbe11aa6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:49.292822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f2b02b7-8c68-4eb7-9f52-e337bbe11aa6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:49.294184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f2b02b7-8c68-4eb7-9f52-e337bbe11aa6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:49.294622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f2b02b7-8c68-4eb7-9f52-e337bbe11aa6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:49.310374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:49.439876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7f2b02b7-8c68-4eb7-9f52-e337bbe11aa6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:49.447659 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7f2b02b7-8c68-4eb7-9f52-e337bbe11aa6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1691 microversion: 2.1 time: 0.168715 Jul 20 04:56:49.448397 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3153/6405] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:49 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:50.465005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9bf547c8-4c27-41e6-b23b-0d076fabcc60 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:50.466238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9bf547c8-4c27-41e6-b23b-0d076fabcc60 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:50.474046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bf547c8-4c27-41e6-b23b-0d076fabcc60 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:50.474517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bf547c8-4c27-41e6-b23b-0d076fabcc60 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:50.475294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bf547c8-4c27-41e6-b23b-0d076fabcc60 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:50.476017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9bf547c8-4c27-41e6-b23b-0d076fabcc60 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:50.611431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9bf547c8-4c27-41e6-b23b-0d076fabcc60 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:50.619368 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9bf547c8-4c27-41e6-b23b-0d076fabcc60 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1688 microversion: 2.1 time: 0.158314 Jul 20 04:56:50.619994 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3253/6406] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:50 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:50.636267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-139d5be5-444e-40e6-a0cd-7fd3d7e30276 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:50.636839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-139d5be5-444e-40e6-a0cd-7fd3d7e30276 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:50.652442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-139d5be5-444e-40e6-a0cd-7fd3d7e30276 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:50.653462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-139d5be5-444e-40e6-a0cd-7fd3d7e30276 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:50.654256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-139d5be5-444e-40e6-a0cd-7fd3d7e30276 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:50.654698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-139d5be5-444e-40e6-a0cd-7fd3d7e30276 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:50.818388 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-139d5be5-444e-40e6-a0cd-7fd3d7e30276 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f/action" status: 204 len: 0 microversion: 2.1 time: 0.185872 Jul 20 04:56:50.819419 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3154/6407] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:56:50 2022] POST /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f/action => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:56:50.828439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8cf880fb-97a3-4cbb-873c-a1a2db8d9aaf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:50.829088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8cf880fb-97a3-4cbb-873c-a1a2db8d9aaf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:50.835475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8cf880fb-97a3-4cbb-873c-a1a2db8d9aaf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:50.836102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8cf880fb-97a3-4cbb-873c-a1a2db8d9aaf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:50.836984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8cf880fb-97a3-4cbb-873c-a1a2db8d9aaf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:50.837627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8cf880fb-97a3-4cbb-873c-a1a2db8d9aaf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:51.125687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8cf880fb-97a3-4cbb-873c-a1a2db8d9aaf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:51.133467 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8cf880fb-97a3-4cbb-873c-a1a2db8d9aaf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1688 microversion: 2.1 time: 0.309280 Jul 20 04:56:51.134063 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3254/6408] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:50 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1688 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:52.154998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9027b780-bdd4-4b5d-b865-b27f40fc65be tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:52.155843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9027b780-bdd4-4b5d-b865-b27f40fc65be tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:52.162798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9027b780-bdd4-4b5d-b865-b27f40fc65be tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:52.163326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9027b780-bdd4-4b5d-b865-b27f40fc65be tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:52.164204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9027b780-bdd4-4b5d-b865-b27f40fc65be tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:52.164791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9027b780-bdd4-4b5d-b865-b27f40fc65be tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:52.320291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9027b780-bdd4-4b5d-b865-b27f40fc65be tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:52.328644 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9027b780-bdd4-4b5d-b865-b27f40fc65be tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1680 microversion: 2.1 time: 0.180644 Jul 20 04:56:52.329655 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3155/6409] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:52 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:53.450925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9b90da68-c7af-4a31-9d2c-b09dc4f903c0 req-37365280-4a61-41e8-a48a-74886a1e9c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f", "name": "network-vif-plugged", "status": "completed", "tag": "df849559-fdd4-4f00-a0c5-584f004e6356"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:53.476565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9b90da68-c7af-4a31-9d2c-b09dc4f903c0 req-37365280-4a61-41e8-a48a-74886a1e9c06 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:53.477032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9b90da68-c7af-4a31-9d2c-b09dc4f903c0 req-37365280-4a61-41e8-a48a-74886a1e9c06 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:53.489808 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9b90da68-c7af-4a31-9d2c-b09dc4f903c0 req-37365280-4a61-41e8-a48a-74886a1e9c06 service nova] Creating event network-vif-plugged:df849559-fdd4-4f00-a0c5-584f004e6356 for instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f on n-h2-764485-11 Jul 20 04:56:53.495205 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9b90da68-c7af-4a31-9d2c-b09dc4f903c0 req-37365280-4a61-41e8-a48a-74886a1e9c06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049228 Jul 20 04:56:53.496119 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3255/6410] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:57.451519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1417458154", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1146711925", "security_groups": [{"name": "tempest-secgroup-smoke-1902203948"}], "block_device_mapping_v2": [{"uuid": "6941b0ec-9da5-4a46-8139-594fca1d509a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1e46ee9e-198e-401c-88a3-4979bd7d9aaf"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:57.570628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] validate_networks() for [('1e46ee9e-198e-401c-88a3-4979bd7d9aaf', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:56:58.001884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:56:58.002321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:56:58.002839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:56:58.003258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:56:58.003841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:56:58.013394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:58.013878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:58.014688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:58.015133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:58.031808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:56:58.037107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for user 1f70af961f624dceba390cb44ef2a792 and project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:56:58.094719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:56:58.096869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6941b0ec-9da5-4a46-8139-594fca1d509a',volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:56:58.220923 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-212e52d4-82ed-4a39-af20-74cc6844fe4d tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.773979 Jul 20 04:56:58.221576 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3156/6411] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:56:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:56:58.234238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cbbb80a1-8224-4506-9c11-8f6321e87cd8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:58.234871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cbbb80a1-8224-4506-9c11-8f6321e87cd8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:58.290405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cbbb80a1-8224-4506-9c11-8f6321e87cd8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:58.297549 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cbbb80a1-8224-4506-9c11-8f6321e87cd8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1095 microversion: 2.1 time: 0.069324 Jul 20 04:56:58.298128 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3256/6412] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:58 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:59.315997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-245ef14d-3633-4652-8200-20899c077709 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:59.316678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-245ef14d-3633-4652-8200-20899c077709 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:59.322606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:59.324872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-245ef14d-3633-4652-8200-20899c077709 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:59.325623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-245ef14d-3633-4652-8200-20899c077709 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:59.326434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-245ef14d-3633-4652-8200-20899c077709 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:59.326885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-245ef14d-3633-4652-8200-20899c077709 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:59.408886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-245ef14d-3633-4652-8200-20899c077709 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:59.416659 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-245ef14d-3633-4652-8200-20899c077709 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1211 microversion: 2.1 time: 0.105542 Jul 20 04:56:59.417245 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3157/6413] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:59 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1211 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:00.436261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1fa89f1c-9223-423b-87ad-8b249fa320b8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:00.437848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1fa89f1c-9223-423b-87ad-8b249fa320b8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:00.451945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=48 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:00.458871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fa89f1c-9223-423b-87ad-8b249fa320b8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:00.459723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fa89f1c-9223-423b-87ad-8b249fa320b8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:00.460952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fa89f1c-9223-423b-87ad-8b249fa320b8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:00.461885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1fa89f1c-9223-423b-87ad-8b249fa320b8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:00.630702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1fa89f1c-9223-423b-87ad-8b249fa320b8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:00.642631 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1fa89f1c-9223-423b-87ad-8b249fa320b8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1279 microversion: 2.1 time: 0.212112 Jul 20 04:57:00.643942 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3257/6414] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:00 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:00.781275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-76d41613-77a7-4bb5-8046-a3d317e4ecda req-0dfe2c6a-1e8c-4086-8ef5-1d506917ea16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5", "tag": "b4c7159f-7401-4599-8eea-e1e55b223025"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:00.791809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-76d41613-77a7-4bb5-8046-a3d317e4ecda req-0dfe2c6a-1e8c-4086-8ef5-1d506917ea16 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:00.792515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-76d41613-77a7-4bb5-8046-a3d317e4ecda req-0dfe2c6a-1e8c-4086-8ef5-1d506917ea16 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:00.806133 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-76d41613-77a7-4bb5-8046-a3d317e4ecda req-0dfe2c6a-1e8c-4086-8ef5-1d506917ea16 service nova] Creating event network-changed:b4c7159f-7401-4599-8eea-e1e55b223025 for instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 on n-h2-764485-11 Jul 20 04:57:00.817094 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-76d41613-77a7-4bb5-8046-a3d317e4ecda req-0dfe2c6a-1e8c-4086-8ef5-1d506917ea16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040207 Jul 20 04:57:00.817718 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3158/6415] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:01.661959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-15ebab75-8a0c-4749-a869-415fc2b65a50 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:01.662829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-15ebab75-8a0c-4749-a869-415fc2b65a50 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:01.670580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15ebab75-8a0c-4749-a869-415fc2b65a50 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:01.671053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15ebab75-8a0c-4749-a869-415fc2b65a50 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:01.671885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15ebab75-8a0c-4749-a869-415fc2b65a50 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:01.672344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-15ebab75-8a0c-4749-a869-415fc2b65a50 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:01.816571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-15ebab75-8a0c-4749-a869-415fc2b65a50 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:01.824914 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-15ebab75-8a0c-4749-a869-415fc2b65a50 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1279 microversion: 2.1 time: 0.167327 Jul 20 04:57:01.825663 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3258/6416] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:01 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1279 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:02.843717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1dfebed5-d4a9-4123-ba51-d1daae66a831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:02.844429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1dfebed5-d4a9-4123-ba51-d1daae66a831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:02.851173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dfebed5-d4a9-4123-ba51-d1daae66a831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:02.851565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dfebed5-d4a9-4123-ba51-d1daae66a831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:02.852352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dfebed5-d4a9-4123-ba51-d1daae66a831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:02.852801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dfebed5-d4a9-4123-ba51-d1daae66a831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:02.992821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1dfebed5-d4a9-4123-ba51-d1daae66a831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:03.000623 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1dfebed5-d4a9-4123-ba51-d1daae66a831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1279 microversion: 2.1 time: 0.162810 Jul 20 04:57:03.001211 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3159/6417] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:02 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:04.018650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2590a81-2042-49dc-ae8d-6b0dc90d2343 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:04.019349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c2590a81-2042-49dc-ae8d-6b0dc90d2343 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:04.026088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2590a81-2042-49dc-ae8d-6b0dc90d2343 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:04.026564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2590a81-2042-49dc-ae8d-6b0dc90d2343 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:04.027407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2590a81-2042-49dc-ae8d-6b0dc90d2343 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:04.028087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2590a81-2042-49dc-ae8d-6b0dc90d2343 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:04.172234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c2590a81-2042-49dc-ae8d-6b0dc90d2343 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:04.180423 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c2590a81-2042-49dc-ae8d-6b0dc90d2343 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1279 microversion: 2.1 time: 0.165931 Jul 20 04:57:04.181028 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3259/6418] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:04 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1279 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:05.199541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-353ce3bc-66e5-47a4-a1e4-f146ae75e277 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:05.200305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-353ce3bc-66e5-47a4-a1e4-f146ae75e277 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:05.207014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-353ce3bc-66e5-47a4-a1e4-f146ae75e277 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:05.207473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-353ce3bc-66e5-47a4-a1e4-f146ae75e277 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:05.208271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-353ce3bc-66e5-47a4-a1e4-f146ae75e277 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:05.208716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-353ce3bc-66e5-47a4-a1e4-f146ae75e277 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:05.343194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-353ce3bc-66e5-47a4-a1e4-f146ae75e277 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:05.350745 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-353ce3bc-66e5-47a4-a1e4-f146ae75e277 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1267 microversion: 2.1 time: 0.155365 Jul 20 04:57:05.351321 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3160/6419] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:05 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:06.369466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-42a3761d-11d6-41b7-b7d5-46f1a7015e68 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:06.370097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-42a3761d-11d6-41b7-b7d5-46f1a7015e68 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:06.378035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42a3761d-11d6-41b7-b7d5-46f1a7015e68 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:06.378498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42a3761d-11d6-41b7-b7d5-46f1a7015e68 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:06.379279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42a3761d-11d6-41b7-b7d5-46f1a7015e68 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:06.379764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-42a3761d-11d6-41b7-b7d5-46f1a7015e68 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:06.512196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-42a3761d-11d6-41b7-b7d5-46f1a7015e68 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:06.521054 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-42a3761d-11d6-41b7-b7d5-46f1a7015e68 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1267 microversion: 2.1 time: 0.155537 Jul 20 04:57:06.521628 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3260/6420] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:06 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:07.537656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-14854ec4-7366-4f33-adf0-eee51f002f7a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:07.538275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-14854ec4-7366-4f33-adf0-eee51f002f7a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:07.546068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-14854ec4-7366-4f33-adf0-eee51f002f7a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:07.546515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-14854ec4-7366-4f33-adf0-eee51f002f7a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:07.547286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-14854ec4-7366-4f33-adf0-eee51f002f7a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:07.547776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-14854ec4-7366-4f33-adf0-eee51f002f7a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:07.681866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-14854ec4-7366-4f33-adf0-eee51f002f7a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:07.690207 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-14854ec4-7366-4f33-adf0-eee51f002f7a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1267 microversion: 2.1 time: 0.156484 Jul 20 04:57:07.690792 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3161/6421] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:07 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:08.707092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-20acba42-749f-4294-990b-4b668a0a41da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:08.707748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-20acba42-749f-4294-990b-4b668a0a41da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:08.710080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:08.716238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20acba42-749f-4294-990b-4b668a0a41da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:08.716893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20acba42-749f-4294-990b-4b668a0a41da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:08.717676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20acba42-749f-4294-990b-4b668a0a41da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:08.718129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20acba42-749f-4294-990b-4b668a0a41da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:08.858828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-20acba42-749f-4294-990b-4b668a0a41da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:08.866596 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-20acba42-749f-4294-990b-4b668a0a41da tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1267 microversion: 2.1 time: 0.163613 Jul 20 04:57:08.867173 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3261/6422] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:08 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:09.883873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cc437b61-ebb1-4bd8-8b4f-433f11705972 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:09.884519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cc437b61-ebb1-4bd8-8b4f-433f11705972 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:09.886546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:09.887269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:09.894586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc437b61-ebb1-4bd8-8b4f-433f11705972 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:09.895046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc437b61-ebb1-4bd8-8b4f-433f11705972 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:09.895848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc437b61-ebb1-4bd8-8b4f-433f11705972 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:09.896295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc437b61-ebb1-4bd8-8b4f-433f11705972 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:10.028699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cc437b61-ebb1-4bd8-8b4f-433f11705972 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:10.037164 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cc437b61-ebb1-4bd8-8b4f-433f11705972 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1267 microversion: 2.1 time: 0.157222 Jul 20 04:57:10.037737 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3162/6423] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:09 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:11.054455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6e5db6c-2c83-4260-a7ba-228a6f681048 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:11.055298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f6e5db6c-2c83-4260-a7ba-228a6f681048 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:11.063763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6e5db6c-2c83-4260-a7ba-228a6f681048 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:11.064236 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6e5db6c-2c83-4260-a7ba-228a6f681048 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:11.065024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6e5db6c-2c83-4260-a7ba-228a6f681048 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:11.065481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6e5db6c-2c83-4260-a7ba-228a6f681048 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:11.209104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f6e5db6c-2c83-4260-a7ba-228a6f681048 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:11.216600 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f6e5db6c-2c83-4260-a7ba-228a6f681048 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1267 microversion: 2.1 time: 0.166278 Jul 20 04:57:11.217257 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3262/6424] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:11 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:12.234574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-777c6266-d8e7-4b6c-b2ef-167075e64745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:12.235194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-777c6266-d8e7-4b6c-b2ef-167075e64745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:12.242558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-777c6266-d8e7-4b6c-b2ef-167075e64745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:12.243013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-777c6266-d8e7-4b6c-b2ef-167075e64745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:12.243824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-777c6266-d8e7-4b6c-b2ef-167075e64745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:12.244274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-777c6266-d8e7-4b6c-b2ef-167075e64745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:12.378845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-777c6266-d8e7-4b6c-b2ef-167075e64745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:12.386559 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-777c6266-d8e7-4b6c-b2ef-167075e64745 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1267 microversion: 2.1 time: 0.156532 Jul 20 04:57:12.387131 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3163/6425] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:12 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:13.405045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-64721d20-8206-4021-a8dd-0e6fb1d986b5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:13.405677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-64721d20-8206-4021-a8dd-0e6fb1d986b5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:13.412671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64721d20-8206-4021-a8dd-0e6fb1d986b5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:13.413138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64721d20-8206-4021-a8dd-0e6fb1d986b5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:13.413914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64721d20-8206-4021-a8dd-0e6fb1d986b5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:13.414369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64721d20-8206-4021-a8dd-0e6fb1d986b5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:13.555039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-64721d20-8206-4021-a8dd-0e6fb1d986b5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:13.563542 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-64721d20-8206-4021-a8dd-0e6fb1d986b5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1267 microversion: 2.1 time: 0.162602 Jul 20 04:57:13.564134 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3263/6426] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:13 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:14.580697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3131a6b2-9afe-4942-a8e1-7793f2d9ec03 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:14.581252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3131a6b2-9afe-4942-a8e1-7793f2d9ec03 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:14.588329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3131a6b2-9afe-4942-a8e1-7793f2d9ec03 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:14.588784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3131a6b2-9afe-4942-a8e1-7793f2d9ec03 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:14.589558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3131a6b2-9afe-4942-a8e1-7793f2d9ec03 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:14.590014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3131a6b2-9afe-4942-a8e1-7793f2d9ec03 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:14.722144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3131a6b2-9afe-4942-a8e1-7793f2d9ec03 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:14.730670 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3131a6b2-9afe-4942-a8e1-7793f2d9ec03 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1267 microversion: 2.1 time: 0.154116 Jul 20 04:57:14.731564 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3164/6427] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:14 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:15.588038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9a142027-e790-4256-8d05-308b1b289227 req-73caaefa-4105-42ae-ba1e-8a8efadf0a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5", "name": "network-vif-plugged", "status": "completed", "tag": "b4c7159f-7401-4599-8eea-e1e55b223025"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:15.597611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9a142027-e790-4256-8d05-308b1b289227 req-73caaefa-4105-42ae-ba1e-8a8efadf0a9a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:15.598197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9a142027-e790-4256-8d05-308b1b289227 req-73caaefa-4105-42ae-ba1e-8a8efadf0a9a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:15.610637 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9a142027-e790-4256-8d05-308b1b289227 req-73caaefa-4105-42ae-ba1e-8a8efadf0a9a service nova] Creating event network-vif-plugged:b4c7159f-7401-4599-8eea-e1e55b223025 for instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 on n-h2-764485-11 Jul 20 04:57:15.615648 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9a142027-e790-4256-8d05-308b1b289227 req-73caaefa-4105-42ae-ba1e-8a8efadf0a9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031357 Jul 20 04:57:15.616281 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3264/6428] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:15.750921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-643efa16-f268-4523-811b-dbe7ad93b373 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:15.751521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-643efa16-f268-4523-811b-dbe7ad93b373 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:15.758596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-643efa16-f268-4523-811b-dbe7ad93b373 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:15.759060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-643efa16-f268-4523-811b-dbe7ad93b373 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:15.759958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-643efa16-f268-4523-811b-dbe7ad93b373 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:15.760458 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-643efa16-f268-4523-811b-dbe7ad93b373 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:15.893578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-643efa16-f268-4523-811b-dbe7ad93b373 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:15.901110 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-643efa16-f268-4523-811b-dbe7ad93b373 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1267 microversion: 2.1 time: 0.154772 Jul 20 04:57:15.901687 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3165/6429] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:15 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:16.920645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09d2c91e-a7ec-4636-be60-a914ca6953e3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:16.921376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-09d2c91e-a7ec-4636-be60-a914ca6953e3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:16.928220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09d2c91e-a7ec-4636-be60-a914ca6953e3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:16.928689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09d2c91e-a7ec-4636-be60-a914ca6953e3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:16.929469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09d2c91e-a7ec-4636-be60-a914ca6953e3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:16.929923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-09d2c91e-a7ec-4636-be60-a914ca6953e3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:17.072627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-09d2c91e-a7ec-4636-be60-a914ca6953e3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:17.080344 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-09d2c91e-a7ec-4636-be60-a914ca6953e3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1267 microversion: 2.1 time: 0.164849 Jul 20 04:57:17.080927 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3265/6430] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:16 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:18.097416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-631f4dda-0228-450f-81a5-74e588a8cdba tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:18.098080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-631f4dda-0228-450f-81a5-74e588a8cdba tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:18.105057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-631f4dda-0228-450f-81a5-74e588a8cdba tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:18.105528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-631f4dda-0228-450f-81a5-74e588a8cdba tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:18.106557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-631f4dda-0228-450f-81a5-74e588a8cdba tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:18.106999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-631f4dda-0228-450f-81a5-74e588a8cdba tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:18.238115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-631f4dda-0228-450f-81a5-74e588a8cdba tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:18.245729 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-631f4dda-0228-450f-81a5-74e588a8cdba tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1455 microversion: 2.1 time: 0.152785 Jul 20 04:57:18.246303 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3166/6431] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:18 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:18.262377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2adcfe50-4640-440a-8920-5b19cc1fc8fd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:18.263064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2adcfe50-4640-440a-8920-5b19cc1fc8fd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:18.271076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2adcfe50-4640-440a-8920-5b19cc1fc8fd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:18.271572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2adcfe50-4640-440a-8920-5b19cc1fc8fd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:18.272376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2adcfe50-4640-440a-8920-5b19cc1fc8fd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:18.272829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2adcfe50-4640-440a-8920-5b19cc1fc8fd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:18.275549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=68 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:18.408328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2adcfe50-4640-440a-8920-5b19cc1fc8fd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:18.415967 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2adcfe50-4640-440a-8920-5b19cc1fc8fd tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1455 microversion: 2.1 time: 0.157404 Jul 20 04:57:18.416550 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3266/6432] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:18 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:20.435934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-9783bc8b-e81b-4ed7-9e71-801aa64705af req-674b03c1-8430-45ae-9094-407e3233ca79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5", "tag": "b4c7159f-7401-4599-8eea-e1e55b223025"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:20.445232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9783bc8b-e81b-4ed7-9e71-801aa64705af req-674b03c1-8430-45ae-9094-407e3233ca79 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:20.445756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9783bc8b-e81b-4ed7-9e71-801aa64705af req-674b03c1-8430-45ae-9094-407e3233ca79 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:20.449547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:20.460411 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-9783bc8b-e81b-4ed7-9e71-801aa64705af req-674b03c1-8430-45ae-9094-407e3233ca79 service nova] Creating event network-changed:b4c7159f-7401-4599-8eea-e1e55b223025 for instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 on n-h2-764485-11 Jul 20 04:57:20.466315 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-9783bc8b-e81b-4ed7-9e71-801aa64705af req-674b03c1-8430-45ae-9094-407e3233ca79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108102 Jul 20 04:57:20.466936 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3167/6433] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:24.564930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eb155e64-0b0b-49d7-a11c-81db9dbeaa46 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:24.565907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eb155e64-0b0b-49d7-a11c-81db9dbeaa46 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:24.573157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb155e64-0b0b-49d7-a11c-81db9dbeaa46 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:24.573629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb155e64-0b0b-49d7-a11c-81db9dbeaa46 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:24.574443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb155e64-0b0b-49d7-a11c-81db9dbeaa46 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:24.574891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb155e64-0b0b-49d7-a11c-81db9dbeaa46 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:24.646767 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eb155e64-0b0b-49d7-a11c-81db9dbeaa46 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f/action" status: 200 len: 24580 microversion: 2.1 time: 0.087204 Jul 20 04:57:24.647430 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3267/6434] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:57:24 2022] POST /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f/action => generated 24580 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:57:47.525027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=21 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:47.529991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2c2b9fd4-7883-41f3-8c62-430b6a1c42af tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:47.530699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2c2b9fd4-7883-41f3-8c62-430b6a1c42af tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:47.537859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c2b9fd4-7883-41f3-8c62-430b6a1c42af tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:47.538314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c2b9fd4-7883-41f3-8c62-430b6a1c42af tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:47.539081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c2b9fd4-7883-41f3-8c62-430b6a1c42af tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:47.539549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c2b9fd4-7883-41f3-8c62-430b6a1c42af tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:47.672206 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2c2b9fd4-7883-41f3-8c62-430b6a1c42af tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1833 microversion: 2.1 time: 0.149352 Jul 20 04:57:47.672823 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3168/6435] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:47 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1833 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:48.565385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-24a19114-be67-4f40-86a9-363221b5a85c req-255b1c40-d975-4142-a98a-664a7b8e479e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f", "tag": "df849559-fdd4-4f00-a0c5-584f004e6356"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:48.567935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-217c1dd7-9c4b-4d81-9c94-8cfff519d7c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:48.568558 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-217c1dd7-9c4b-4d81-9c94-8cfff519d7c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:48.572525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=21 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:48.573426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=9 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:48.576009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-24a19114-be67-4f40-86a9-363221b5a85c req-255b1c40-d975-4142-a98a-664a7b8e479e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:48.577178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-24a19114-be67-4f40-86a9-363221b5a85c req-255b1c40-d975-4142-a98a-664a7b8e479e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:48.578285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-217c1dd7-9c4b-4d81-9c94-8cfff519d7c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:48.578760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-217c1dd7-9c4b-4d81-9c94-8cfff519d7c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:48.579572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-217c1dd7-9c4b-4d81-9c94-8cfff519d7c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:48.580028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-217c1dd7-9c4b-4d81-9c94-8cfff519d7c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:48.589818 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-24a19114-be67-4f40-86a9-363221b5a85c req-255b1c40-d975-4142-a98a-664a7b8e479e service nova] Creating event network-changed:df849559-fdd4-4f00-a0c5-584f004e6356 for instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f on n-h2-764485-11 Jul 20 04:57:48.595057 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-24a19114-be67-4f40-86a9-363221b5a85c req-255b1c40-d975-4142-a98a-664a7b8e479e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033340 Jul 20 04:57:48.596660 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3169/6436] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:57:48.612958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-217c1dd7-9c4b-4d81-9c94-8cfff519d7c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:57:48.702838 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-217c1dd7-9c4b-4d81-9c94-8cfff519d7c9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 204 len: 0 microversion: 2.1 time: 0.145415 Jul 20 04:57:48.703617 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3268/6437] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:57:48 2022] DELETE /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:57:48.712607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7f0190aa-ccd2-4514-8dcb-f25473a70bb8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:48.713317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7f0190aa-ccd2-4514-8dcb-f25473a70bb8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:48.720569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f0190aa-ccd2-4514-8dcb-f25473a70bb8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:48.721292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f0190aa-ccd2-4514-8dcb-f25473a70bb8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:48.722156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f0190aa-ccd2-4514-8dcb-f25473a70bb8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:48.722667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f0190aa-ccd2-4514-8dcb-f25473a70bb8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:48.861908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7f0190aa-ccd2-4514-8dcb-f25473a70bb8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:48.869485 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7f0190aa-ccd2-4514-8dcb-f25473a70bb8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1686 microversion: 2.1 time: 0.161423 Jul 20 04:57:48.870110 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3170/6438] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:48 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:49.887364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-89fd848b-bed5-4b6b-87d2-cefd16ef89a3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:49.888096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-89fd848b-bed5-4b6b-87d2-cefd16ef89a3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:49.895463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89fd848b-bed5-4b6b-87d2-cefd16ef89a3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:49.896026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89fd848b-bed5-4b6b-87d2-cefd16ef89a3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:49.896978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89fd848b-bed5-4b6b-87d2-cefd16ef89a3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:49.897340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-89fd848b-bed5-4b6b-87d2-cefd16ef89a3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:50.038234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-89fd848b-bed5-4b6b-87d2-cefd16ef89a3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:50.046188 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-89fd848b-bed5-4b6b-87d2-cefd16ef89a3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1686 microversion: 2.1 time: 0.163848 Jul 20 04:57:50.046808 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3269/6439] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:49 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:50.824024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-82e95a3f-ddc6-40c6-8b4b-b245495f0f7a req-08139e7b-1ece-4dcc-b988-8771b886b7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f", "name": "network-vif-deleted", "tag": "df849559-fdd4-4f00-a0c5-584f004e6356"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:50.833826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-82e95a3f-ddc6-40c6-8b4b-b245495f0f7a req-08139e7b-1ece-4dcc-b988-8771b886b7a4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:50.834275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-82e95a3f-ddc6-40c6-8b4b-b245495f0f7a req-08139e7b-1ece-4dcc-b988-8771b886b7a4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:50.846512 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-82e95a3f-ddc6-40c6-8b4b-b245495f0f7a req-08139e7b-1ece-4dcc-b988-8771b886b7a4 service nova] Creating event network-vif-deleted:df849559-fdd4-4f00-a0c5-584f004e6356 for instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f on n-h2-764485-11 Jul 20 04:57:50.851844 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-82e95a3f-ddc6-40c6-8b4b-b245495f0f7a req-08139e7b-1ece-4dcc-b988-8771b886b7a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032176 Jul 20 04:57:50.852600 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3171/6440] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:51.063592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ab41137e-a0f8-4991-a88b-9e47dd3dcc58 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:51.064158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ab41137e-a0f8-4991-a88b-9e47dd3dcc58 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:51.071266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab41137e-a0f8-4991-a88b-9e47dd3dcc58 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:51.071770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab41137e-a0f8-4991-a88b-9e47dd3dcc58 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:51.072616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab41137e-a0f8-4991-a88b-9e47dd3dcc58 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:51.073777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab41137e-a0f8-4991-a88b-9e47dd3dcc58 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:51.107275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab41137e-a0f8-4991-a88b-9e47dd3dcc58 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:51.107776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ab41137e-a0f8-4991-a88b-9e47dd3dcc58 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:51.108247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-ab41137e-a0f8-4991-a88b-9e47dd3dcc58 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lazy-loading 'fault' on Instance uuid 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:57:51.157565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ab41137e-a0f8-4991-a88b-9e47dd3dcc58 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:51.165638 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ab41137e-a0f8-4991-a88b-9e47dd3dcc58 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 200 len: 1355 microversion: 2.1 time: 0.106044 Jul 20 04:57:51.166244 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3270/6441] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:51 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 1355 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:52.185518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a14ea402-cc4d-49cc-a94e-72e90410c901 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:52.186254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a14ea402-cc4d-49cc-a94e-72e90410c901 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:52.193017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a14ea402-cc4d-49cc-a94e-72e90410c901 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:52.193468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a14ea402-cc4d-49cc-a94e-72e90410c901 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:52.194240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a14ea402-cc4d-49cc-a94e-72e90410c901 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:52.194683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a14ea402-cc4d-49cc-a94e-72e90410c901 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:52.208807 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-a14ea402-cc4d-49cc-a94e-72e90410c901 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] HTTP exception thrown: Instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f could not be found. Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a14ea402-cc4d-49cc-a94e-72e90410c901 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Request method failure captured: Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f HTTP/1.1 Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14qdBDOgOgYg5zB0q-NFS0jh5lsDTaLj-U9nsFTm8jdjGqlHi0W5cg2emgaZEmvxVQ6kbGXvGI8KMmvElHEiPc36Hu2hoFkvZ5-WodujHlu0yefRGKPzNIjJu4QwHYLFjMjO2ShrBXapwPKwcCEPUdSNP8EqhhJ410t0rhba7uK9z2U Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6bb3f1bf4a2347a2b78e539c9e8f2ee3 Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1261484027 Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6bb3f1bf4a2347a2b78e539c9e8f2ee3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6bb3f1bf4a2347a2b78e539c9e8f2ee3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6bb3f1bf4a2347a2b78e539c9e8f2ee3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6bb3f1bf4a2347a2b78e539c9e8f2ee3"}]}] Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1261484027 Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6bb3f1bf4a2347a2b78e539c9e8f2ee3 Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1261484027 Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestNetworkAdvancedServerOps-1261484027-project Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 4f38aa28db214cc689fd1b5e02a62d67 Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1261484027-project Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f could not be found. Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f'} Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f could not be found. Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f could not be found. Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:57:52.210424 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:57:52.216800 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:57:52.216800 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:57:52.216800 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:57:52.216800 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:57:52.216800 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:57:52.216800 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:57:52.216800 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f could not be found. Jul 20 04:57:52.216800 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:57:52.216800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a14ea402-cc4d-49cc-a94e-72e90410c901 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Returning 404 to user: Instance 7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:57:52.216800 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a14ea402-cc4d-49cc-a94e-72e90410c901 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f" status: 404 len: 111 microversion: 2.1 time: 0.031403 Jul 20 04:57:52.216800 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3172/6442] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:52 2022] GET /compute/v2.1/servers/7d9d48a9-9a8f-41bc-b7ea-2579dbbb462f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:57:55.330026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-49fda076-4c8f-4cab-8f5e-881ad00c4409 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '.version_select at 0x7fbf9c67c8b0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:55.357697 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-49fda076-4c8f-4cab-8f5e-881ad00c4409 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-293059032" status: 202 len: 0 microversion: 2.1 time: 0.031604 Jul 20 04:57:55.358310 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3271/6443] 10.222.0.20 () {58 vars in 1280 bytes} [Wed Jul 20 04:57:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-293059032 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:57:55.388259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d0a174e1-e887-4742-9629-1ead258d16f8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'create', calling method: .version_select at 0x7fbf9c16fca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1865483855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLB7HX/mmglU8lSrLqOvT35giEaXIWB06tWX+87AYXV7VlX9x50xYIZw1c0fSYs2Qhj9KGNCFvwJGF82jBGMKqBp1BiGSArC9+bt/W6jTZaAdTxT79K90fFye/0o8H3Ypw=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:55.404583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-d0a174e1-e887-4742-9629-1ead258d16f8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:57:55.412682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-d0a174e1-e887-4742-9629-1ead258d16f8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for user 4f38aa28db214cc689fd1b5e02a62d67 and project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:57:55.439640 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d0a174e1-e887-4742-9629-1ead258d16f8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056350 Jul 20 04:57:55.440278 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3173/6444] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 04:57:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:02.039340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:02.045435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-533751680", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "c969b6b4-c50a-4c8a-ac88-4f016b1d6424"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1865483855", "security_groups": [{"name": "tempest-secgroup-smoke-2028792968"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:02.169301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] validate_networks() for [('c969b6b4-c50a-4c8a-ac88-4f016b1d6424', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:58:02.579821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:58:02.580258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:58:02.580746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:58:02.581174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:58:02.581601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:58:02.600911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:02.601792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:02.603096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:02.603926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:02.624167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:58:02.631117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for user 4f38aa28db214cc689fd1b5e02a62d67 and project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:58:02.648087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:58:02.650819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:58:02.711574 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cc23734f-d73a-400a-8bca-be7ff037c881 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.673966 Jul 20 04:58:02.712378 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3272/6445] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:58:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:58:02.723066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5fca6fe2-7a75-4fce-9a19-46cd10728384 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:02.723753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5fca6fe2-7a75-4fce-9a19-46cd10728384 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:02.733281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=19 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:02.813145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5fca6fe2-7a75-4fce-9a19-46cd10728384 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:02.821259 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5fca6fe2-7a75-4fce-9a19-46cd10728384 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1266 microversion: 2.1 time: 0.102189 Jul 20 04:58:02.822405 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3174/6446] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:02 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:03.842094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b51339a6-dbef-4ec4-8538-3015fb719194 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:03.842826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b51339a6-dbef-4ec4-8538-3015fb719194 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:03.860455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b51339a6-dbef-4ec4-8538-3015fb719194 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:03.861896 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b51339a6-dbef-4ec4-8538-3015fb719194 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:03.863693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b51339a6-dbef-4ec4-8538-3015fb719194 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:03.865025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b51339a6-dbef-4ec4-8538-3015fb719194 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:04.086701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b51339a6-dbef-4ec4-8538-3015fb719194 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:04.101859 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b51339a6-dbef-4ec4-8538-3015fb719194 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1318 microversion: 2.1 time: 0.263646 Jul 20 04:58:04.103035 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3273/6447] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:03 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:05.120459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9f322ca-4e84-4dbc-9ce9-7522bd45c3ec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:05.121751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a9f322ca-4e84-4dbc-9ce9-7522bd45c3ec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:05.129229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9f322ca-4e84-4dbc-9ce9-7522bd45c3ec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:05.129686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9f322ca-4e84-4dbc-9ce9-7522bd45c3ec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:05.130466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9f322ca-4e84-4dbc-9ce9-7522bd45c3ec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:05.130906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9f322ca-4e84-4dbc-9ce9-7522bd45c3ec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:05.343175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a9f322ca-4e84-4dbc-9ce9-7522bd45c3ec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:05.352104 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a9f322ca-4e84-4dbc-9ce9-7522bd45c3ec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1392 microversion: 2.1 time: 0.235453 Jul 20 04:58:05.353334 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3175/6448] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:05 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1392 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:05.656929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a7203174-5e8f-4aed-8a81-95ca7e683e8b req-acbda730-fcbf-4e33-98ed-9f4aa1681b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65c3591-6310-4a42-97b2-dc695ccf4c5c", "tag": "6f4351a5-7a90-4e53-b6de-b819d8ead324"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:05.702226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a7203174-5e8f-4aed-8a81-95ca7e683e8b req-acbda730-fcbf-4e33-98ed-9f4aa1681b09 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:05.704015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a7203174-5e8f-4aed-8a81-95ca7e683e8b req-acbda730-fcbf-4e33-98ed-9f4aa1681b09 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:05.719879 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a7203174-5e8f-4aed-8a81-95ca7e683e8b req-acbda730-fcbf-4e33-98ed-9f4aa1681b09 service nova] Creating event network-changed:6f4351a5-7a90-4e53-b6de-b819d8ead324 for instance b65c3591-6310-4a42-97b2-dc695ccf4c5c on n-h1-764485-11 Jul 20 04:58:05.725620 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a7203174-5e8f-4aed-8a81-95ca7e683e8b req-acbda730-fcbf-4e33-98ed-9f4aa1681b09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076451 Jul 20 04:58:05.726405 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3274/6449] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:06.371759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-14ca0ec1-1fbb-41e7-8a74-18609946b649 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:06.372384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-14ca0ec1-1fbb-41e7-8a74-18609946b649 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:06.380749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-14ca0ec1-1fbb-41e7-8a74-18609946b649 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:06.381209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-14ca0ec1-1fbb-41e7-8a74-18609946b649 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:06.381982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-14ca0ec1-1fbb-41e7-8a74-18609946b649 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:06.382430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-14ca0ec1-1fbb-41e7-8a74-18609946b649 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:06.515651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-14ca0ec1-1fbb-41e7-8a74-18609946b649 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:06.523161 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-14ca0ec1-1fbb-41e7-8a74-18609946b649 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1392 microversion: 2.1 time: 0.156760 Jul 20 04:58:06.523773 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3176/6450] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:06 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:07.545763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7b87864a-9209-4790-abf8-645c279dd1a5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:07.546412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7b87864a-9209-4790-abf8-645c279dd1a5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:07.552737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b87864a-9209-4790-abf8-645c279dd1a5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:07.553205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b87864a-9209-4790-abf8-645c279dd1a5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:07.554053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b87864a-9209-4790-abf8-645c279dd1a5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:07.554491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b87864a-9209-4790-abf8-645c279dd1a5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:07.685279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7b87864a-9209-4790-abf8-645c279dd1a5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:07.692884 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7b87864a-9209-4790-abf8-645c279dd1a5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1392 microversion: 2.1 time: 0.153020 Jul 20 04:58:07.693462 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3275/6451] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:07 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:08.710585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5e3e7d25-0b59-446f-8ae5-77f7ecdc644d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:08.711202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5e3e7d25-0b59-446f-8ae5-77f7ecdc644d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:08.718537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e3e7d25-0b59-446f-8ae5-77f7ecdc644d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:08.718990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e3e7d25-0b59-446f-8ae5-77f7ecdc644d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:08.719784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e3e7d25-0b59-446f-8ae5-77f7ecdc644d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:08.720231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e3e7d25-0b59-446f-8ae5-77f7ecdc644d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:08.856918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5e3e7d25-0b59-446f-8ae5-77f7ecdc644d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:08.864374 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5e3e7d25-0b59-446f-8ae5-77f7ecdc644d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1392 microversion: 2.1 time: 0.157662 Jul 20 04:58:08.864971 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3177/6452] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:08 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:09.881793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0d891537-6f5a-4ab5-8421-83da26d924ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:09.882421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0d891537-6f5a-4ab5-8421-83da26d924ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:09.890306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d891537-6f5a-4ab5-8421-83da26d924ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:09.890775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d891537-6f5a-4ab5-8421-83da26d924ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:09.891576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d891537-6f5a-4ab5-8421-83da26d924ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:09.892033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0d891537-6f5a-4ab5-8421-83da26d924ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:10.359385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0d891537-6f5a-4ab5-8421-83da26d924ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:10.366912 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0d891537-6f5a-4ab5-8421-83da26d924ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1392 microversion: 2.1 time: 0.489102 Jul 20 04:58:10.367533 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3276/6453] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:09 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1392 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:11.383305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f99cd72e-03a0-4f1f-9223-1f8e3f311ac6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:11.383952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f99cd72e-03a0-4f1f-9223-1f8e3f311ac6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:11.391369 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f99cd72e-03a0-4f1f-9223-1f8e3f311ac6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:11.391858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f99cd72e-03a0-4f1f-9223-1f8e3f311ac6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:11.392634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f99cd72e-03a0-4f1f-9223-1f8e3f311ac6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:11.393080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f99cd72e-03a0-4f1f-9223-1f8e3f311ac6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:11.532461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f99cd72e-03a0-4f1f-9223-1f8e3f311ac6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:11.540234 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f99cd72e-03a0-4f1f-9223-1f8e3f311ac6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1392 microversion: 2.1 time: 0.160769 Jul 20 04:58:11.540810 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3178/6454] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:11 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:11.674614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-76a1995f-3c2a-4fb6-862f-e013ad2d0926 req-e997f3f2-a17b-4eda-bdc2-ecb86b837757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65c3591-6310-4a42-97b2-dc695ccf4c5c", "name": "network-vif-plugged", "status": "completed", "tag": "6f4351a5-7a90-4e53-b6de-b819d8ead324"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:11.682798 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-76a1995f-3c2a-4fb6-862f-e013ad2d0926 req-e997f3f2-a17b-4eda-bdc2-ecb86b837757 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:11.683249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-76a1995f-3c2a-4fb6-862f-e013ad2d0926 req-e997f3f2-a17b-4eda-bdc2-ecb86b837757 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:11.694066 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-76a1995f-3c2a-4fb6-862f-e013ad2d0926 req-e997f3f2-a17b-4eda-bdc2-ecb86b837757 service nova] Creating event network-vif-plugged:6f4351a5-7a90-4e53-b6de-b819d8ead324 for instance b65c3591-6310-4a42-97b2-dc695ccf4c5c on n-h1-764485-11 Jul 20 04:58:11.699972 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-76a1995f-3c2a-4fb6-862f-e013ad2d0926 req-e997f3f2-a17b-4eda-bdc2-ecb86b837757 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135910 Jul 20 04:58:11.700974 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3277/6455] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:12.556897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ecdd05f6-e145-474b-89dd-c7df87391580 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:12.558710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ecdd05f6-e145-474b-89dd-c7df87391580 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:12.565761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ecdd05f6-e145-474b-89dd-c7df87391580 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:12.566214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ecdd05f6-e145-474b-89dd-c7df87391580 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:12.566986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ecdd05f6-e145-474b-89dd-c7df87391580 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:12.567426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ecdd05f6-e145-474b-89dd-c7df87391580 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:12.699092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ecdd05f6-e145-474b-89dd-c7df87391580 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:12.706703 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ecdd05f6-e145-474b-89dd-c7df87391580 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1392 microversion: 2.1 time: 0.153703 Jul 20 04:58:12.707283 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3179/6456] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:12 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:13.722225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:13.723045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:13.727729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a8d065ab-7006-44ce-872f-6684d51abd84 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:13.728447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a8d065ab-7006-44ce-872f-6684d51abd84 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:13.735937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8d065ab-7006-44ce-872f-6684d51abd84 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:13.736409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8d065ab-7006-44ce-872f-6684d51abd84 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:13.737191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8d065ab-7006-44ce-872f-6684d51abd84 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:13.737651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a8d065ab-7006-44ce-872f-6684d51abd84 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:13.872501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a8d065ab-7006-44ce-872f-6684d51abd84 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:13.880092 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a8d065ab-7006-44ce-872f-6684d51abd84 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1564 microversion: 2.1 time: 0.159712 Jul 20 04:58:13.880665 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3278/6457] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:13 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:13.897321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8a23289e-e113-4a07-9bbf-e9b8bb7b7921 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:13.897948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8a23289e-e113-4a07-9bbf-e9b8bb7b7921 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:13.899931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:13.906715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a23289e-e113-4a07-9bbf-e9b8bb7b7921 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:13.907174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a23289e-e113-4a07-9bbf-e9b8bb7b7921 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:13.907984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a23289e-e113-4a07-9bbf-e9b8bb7b7921 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:13.908438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8a23289e-e113-4a07-9bbf-e9b8bb7b7921 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:14.038534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8a23289e-e113-4a07-9bbf-e9b8bb7b7921 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:14.046523 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8a23289e-e113-4a07-9bbf-e9b8bb7b7921 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1564 microversion: 2.1 time: 0.153196 Jul 20 04:58:14.047101 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3180/6458] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:13 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:15.641720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-82c1ce38-4663-45b0-98e9-384b452fec92 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:15.642475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-82c1ce38-4663-45b0-98e9-384b452fec92 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:15.646056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-28307502-e7df-4bd8-8f96-4bd3d0a195f0 req-050c7856-9d03-401a-b58c-ab375ab65eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65c3591-6310-4a42-97b2-dc695ccf4c5c", "tag": "6f4351a5-7a90-4e53-b6de-b819d8ead324"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:15.649215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82c1ce38-4663-45b0-98e9-384b452fec92 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:15.649681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82c1ce38-4663-45b0-98e9-384b452fec92 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:15.650814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82c1ce38-4663-45b0-98e9-384b452fec92 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:15.652541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-82c1ce38-4663-45b0-98e9-384b452fec92 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:15.658851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-28307502-e7df-4bd8-8f96-4bd3d0a195f0 req-050c7856-9d03-401a-b58c-ab375ab65eae service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:15.659302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-28307502-e7df-4bd8-8f96-4bd3d0a195f0 req-050c7856-9d03-401a-b58c-ab375ab65eae service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:15.670896 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-28307502-e7df-4bd8-8f96-4bd3d0a195f0 req-050c7856-9d03-401a-b58c-ab375ab65eae service nova] Creating event network-changed:6f4351a5-7a90-4e53-b6de-b819d8ead324 for instance b65c3591-6310-4a42-97b2-dc695ccf4c5c on n-h1-764485-11 Jul 20 04:58:15.676465 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-28307502-e7df-4bd8-8f96-4bd3d0a195f0 req-050c7856-9d03-401a-b58c-ab375ab65eae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034474 Jul 20 04:58:15.677767 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3181/6459] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:15.879078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-82c1ce38-4663-45b0-98e9-384b452fec92 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:15.887342 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-82c1ce38-4663-45b0-98e9-384b452fec92 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1564 microversion: 2.1 time: 0.249525 Jul 20 04:58:15.887974 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3279/6460] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:15 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1564 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:51.197525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:51.198431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=38 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:51.203454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-00a77171-31de-4a52-aad0-22a7e8bf8ca4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:51.204484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-00a77171-31de-4a52-aad0-22a7e8bf8ca4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:51.212559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00a77171-31de-4a52-aad0-22a7e8bf8ca4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:51.213010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00a77171-31de-4a52-aad0-22a7e8bf8ca4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:51.213776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00a77171-31de-4a52-aad0-22a7e8bf8ca4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:51.214720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00a77171-31de-4a52-aad0-22a7e8bf8ca4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:51.266660 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-00a77171-31de-4a52-aad0-22a7e8bf8ca4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c/action" status: 200 len: 24567 microversion: 2.1 time: 0.071221 Jul 20 04:58:51.267314 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3182/6461] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:58:51 2022] POST /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c/action => generated 24567 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:59:15.579348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:15.580123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=36 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:15.682923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-758023a1-474b-4b8f-af58-7840be187853 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:15.683546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-758023a1-474b-4b8f-af58-7840be187853 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:15.690115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-758023a1-474b-4b8f-af58-7840be187853 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:15.690580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-758023a1-474b-4b8f-af58-7840be187853 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:15.691359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-758023a1-474b-4b8f-af58-7840be187853 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:15.691846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-758023a1-474b-4b8f-af58-7840be187853 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:15.716989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-758023a1-474b-4b8f-af58-7840be187853 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:59:15.792237 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-758023a1-474b-4b8f-af58-7840be187853 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 204 len: 0 microversion: 2.1 time: 0.218773 Jul 20 04:59:15.792939 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3280/6462] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 04:59:15 2022] DELETE /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:59:15.802921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-40726b71-ad1c-4026-bd9c-188146d14669 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:15.803696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-40726b71-ad1c-4026-bd9c-188146d14669 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:15.807455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:15.808136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:15.814841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40726b71-ad1c-4026-bd9c-188146d14669 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:15.815298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40726b71-ad1c-4026-bd9c-188146d14669 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:15.816101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40726b71-ad1c-4026-bd9c-188146d14669 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:15.816547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40726b71-ad1c-4026-bd9c-188146d14669 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:15.954619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-40726b71-ad1c-4026-bd9c-188146d14669 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:15.962378 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-40726b71-ad1c-4026-bd9c-188146d14669 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1579 microversion: 2.1 time: 0.164493 Jul 20 04:59:15.962956 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3183/6463] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:15 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:16.980385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4fc0624a-8680-49b5-acda-a7558104d0ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:16.981104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4fc0624a-8680-49b5-acda-a7558104d0ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:16.990267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fc0624a-8680-49b5-acda-a7558104d0ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:16.990797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fc0624a-8680-49b5-acda-a7558104d0ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:16.991813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fc0624a-8680-49b5-acda-a7558104d0ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:16.992601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fc0624a-8680-49b5-acda-a7558104d0ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:17.128127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4fc0624a-8680-49b5-acda-a7558104d0ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:17.135945 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4fc0624a-8680-49b5-acda-a7558104d0ee tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1579 microversion: 2.1 time: 0.159825 Jul 20 04:59:17.136590 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3281/6464] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:16 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:18.153762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-47ddd75f-8cfb-41b4-83c8-68d44f96f7ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:18.154366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-47ddd75f-8cfb-41b4-83c8-68d44f96f7ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:18.165587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47ddd75f-8cfb-41b4-83c8-68d44f96f7ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:18.166049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47ddd75f-8cfb-41b4-83c8-68d44f96f7ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:18.166838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47ddd75f-8cfb-41b4-83c8-68d44f96f7ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:18.167432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-47ddd75f-8cfb-41b4-83c8-68d44f96f7ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:18.600401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-47ddd75f-8cfb-41b4-83c8-68d44f96f7ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:18.608884 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-47ddd75f-8cfb-41b4-83c8-68d44f96f7ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1511 microversion: 2.1 time: 0.458863 Jul 20 04:59:18.609666 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3184/6465] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:18 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:18.832578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-90b10ffe-4b86-4a4d-a563-80ee4aed46b3 req-52d93609-62e5-45e5-8610-665c945d96ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5", "name": "network-vif-deleted", "tag": "b4c7159f-7401-4599-8eea-e1e55b223025"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:18.843250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-90b10ffe-4b86-4a4d-a563-80ee4aed46b3 req-52d93609-62e5-45e5-8610-665c945d96ce service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:18.843766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-90b10ffe-4b86-4a4d-a563-80ee4aed46b3 req-52d93609-62e5-45e5-8610-665c945d96ce service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:18.856120 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-90b10ffe-4b86-4a4d-a563-80ee4aed46b3 req-52d93609-62e5-45e5-8610-665c945d96ce service nova] Creating event network-vif-deleted:b4c7159f-7401-4599-8eea-e1e55b223025 for instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 on n-h2-764485-11 Jul 20 04:59:18.863328 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-90b10ffe-4b86-4a4d-a563-80ee4aed46b3 req-52d93609-62e5-45e5-8610-665c945d96ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034741 Jul 20 04:59:18.865040 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3282/6466] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:19.627274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-029a37c6-979a-4c86-a9ba-660f749b1b01 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:19.628180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-029a37c6-979a-4c86-a9ba-660f749b1b01 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:19.635599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-029a37c6-979a-4c86-a9ba-660f749b1b01 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:19.635994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-029a37c6-979a-4c86-a9ba-660f749b1b01 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:19.636784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-029a37c6-979a-4c86-a9ba-660f749b1b01 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:19.637229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-029a37c6-979a-4c86-a9ba-660f749b1b01 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:19.710845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-029a37c6-979a-4c86-a9ba-660f749b1b01 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:19.720456 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-029a37c6-979a-4c86-a9ba-660f749b1b01 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1226 microversion: 2.1 time: 0.098098 Jul 20 04:59:19.721432 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3185/6467] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:19 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:20.740617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-64c35144-1b13-4774-be4f-65af99c29ede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:20.741351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-64c35144-1b13-4774-be4f-65af99c29ede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:20.747860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64c35144-1b13-4774-be4f-65af99c29ede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:20.748337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64c35144-1b13-4774-be4f-65af99c29ede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:20.749133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64c35144-1b13-4774-be4f-65af99c29ede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:20.750343 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64c35144-1b13-4774-be4f-65af99c29ede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:20.817057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-64c35144-1b13-4774-be4f-65af99c29ede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:20.824875 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-64c35144-1b13-4774-be4f-65af99c29ede tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1226 microversion: 2.1 time: 0.089365 Jul 20 04:59:20.825468 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3283/6468] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:20 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:21.767857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-68f4fecc-c25a-46e0-91a6-e114f9324e6c tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:21.768480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-68f4fecc-c25a-46e0-91a6-e114f9324e6c tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:21.775459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68f4fecc-c25a-46e0-91a6-e114f9324e6c tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:21.775948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68f4fecc-c25a-46e0-91a6-e114f9324e6c tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:21.776769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68f4fecc-c25a-46e0-91a6-e114f9324e6c tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:21.777164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68f4fecc-c25a-46e0-91a6-e114f9324e6c tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:21.842238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-50ce7add-cce9-49f3-962f-ed215898e07e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:21.842875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-50ce7add-cce9-49f3-962f-ed215898e07e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:21.851582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50ce7add-cce9-49f3-962f-ed215898e07e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:21.852061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50ce7add-cce9-49f3-962f-ed215898e07e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:21.853071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50ce7add-cce9-49f3-962f-ed215898e07e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:21.853533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-50ce7add-cce9-49f3-962f-ed215898e07e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:21.916852 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-68f4fecc-c25a-46e0-91a6-e114f9324e6c tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1836 microversion: 2.1 time: 0.153343 Jul 20 04:59:21.917437 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3186/6469] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:21 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1836 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:21.926036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-50ce7add-cce9-49f3-962f-ed215898e07e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:21.934070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f80e2ab5-bc02-4ccb-838e-40c94a87e745 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:21.934494 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-50ce7add-cce9-49f3-962f-ed215898e07e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1226 microversion: 2.1 time: 0.095923 Jul 20 04:59:21.934667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f80e2ab5-bc02-4ccb-838e-40c94a87e745 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:21.935306 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3284/6470] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:21 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:21.941947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f80e2ab5-bc02-4ccb-838e-40c94a87e745 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:21.942404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f80e2ab5-bc02-4ccb-838e-40c94a87e745 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:21.943181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f80e2ab5-bc02-4ccb-838e-40c94a87e745 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:21.943652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f80e2ab5-bc02-4ccb-838e-40c94a87e745 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:22.082329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f80e2ab5-bc02-4ccb-838e-40c94a87e745 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:22.089957 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f80e2ab5-bc02-4ccb-838e-40c94a87e745 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1683 microversion: 2.1 time: 0.159775 Jul 20 04:59:22.090531 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3187/6471] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:21 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:22.180941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7ae6621e-2d56-4a52-ba09-0bc157862394 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:22.182053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7ae6621e-2d56-4a52-ba09-0bc157862394 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:22.189215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ae6621e-2d56-4a52-ba09-0bc157862394 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:22.189584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ae6621e-2d56-4a52-ba09-0bc157862394 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:22.190392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ae6621e-2d56-4a52-ba09-0bc157862394 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:22.190848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ae6621e-2d56-4a52-ba09-0bc157862394 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:22.242826 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7ae6621e-2d56-4a52-ba09-0bc157862394 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c/action" status: 200 len: 32642 microversion: 2.1 time: 0.065652 Jul 20 04:59:22.243553 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3285/6472] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:59:22 2022] POST /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c/action => generated 32642 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:59:22.459951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5cde7a92-5b8c-4490-8c5c-67593b8f06c4 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:22.460486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5cde7a92-5b8c-4490-8c5c-67593b8f06c4 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:22.466711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cde7a92-5b8c-4490-8c5c-67593b8f06c4 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:22.467171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cde7a92-5b8c-4490-8c5c-67593b8f06c4 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:22.467987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cde7a92-5b8c-4490-8c5c-67593b8f06c4 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:22.468510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cde7a92-5b8c-4490-8c5c-67593b8f06c4 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:22.509800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5cde7a92-5b8c-4490-8c5c-67593b8f06c4 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8962e705f3124641b257982ae85e683c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94151cf945cf4635af422f29baee5201', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:22.510403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5cde7a92-5b8c-4490-8c5c-67593b8f06c4 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] flavor_id is None. Assuming migration. {{(pid=119807) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:59:22.510848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5cde7a92-5b8c-4490-8c5c-67593b8f06c4 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119807) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:59:22.706848 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5cde7a92-5b8c-4490-8c5c-67593b8f06c4 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c/action" status: 202 len: 0 microversion: 2.1 time: 0.250425 Jul 20 04:59:22.711036 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3188/6473] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:59:22 2022] POST /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:59:22.716895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-184bb1c9-8209-4446-928b-0b59a990def6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:22.717612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-184bb1c9-8209-4446-928b-0b59a990def6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:22.725761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-184bb1c9-8209-4446-928b-0b59a990def6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:22.726533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-184bb1c9-8209-4446-928b-0b59a990def6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:22.727467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-184bb1c9-8209-4446-928b-0b59a990def6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:22.728003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-184bb1c9-8209-4446-928b-0b59a990def6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:22.881341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-184bb1c9-8209-4446-928b-0b59a990def6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:22.889769 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-184bb1c9-8209-4446-928b-0b59a990def6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1692 microversion: 2.1 time: 0.177063 Jul 20 04:59:22.890471 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3286/6474] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:22 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:22.952317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6a8d9913-7f0a-4499-91cf-0e1022560b00 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:22.953434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6a8d9913-7f0a-4499-91cf-0e1022560b00 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:22.961152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a8d9913-7f0a-4499-91cf-0e1022560b00 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:22.961625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a8d9913-7f0a-4499-91cf-0e1022560b00 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:22.962494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a8d9913-7f0a-4499-91cf-0e1022560b00 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:22.963039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a8d9913-7f0a-4499-91cf-0e1022560b00 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:23.041523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6a8d9913-7f0a-4499-91cf-0e1022560b00 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:23.054681 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6a8d9913-7f0a-4499-91cf-0e1022560b00 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 200 len: 1226 microversion: 2.1 time: 0.105605 Jul 20 04:59:23.055835 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3189/6475] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:22 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:23.907834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-498ea375-3fea-4035-b1dd-112dabeeef15 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:23.908473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-498ea375-3fea-4035-b1dd-112dabeeef15 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:23.916269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-498ea375-3fea-4035-b1dd-112dabeeef15 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:23.916737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-498ea375-3fea-4035-b1dd-112dabeeef15 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:23.917525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-498ea375-3fea-4035-b1dd-112dabeeef15 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:23.917985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-498ea375-3fea-4035-b1dd-112dabeeef15 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:24.056964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-498ea375-3fea-4035-b1dd-112dabeeef15 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:24.065551 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-498ea375-3fea-4035-b1dd-112dabeeef15 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1692 microversion: 2.1 time: 0.161733 Jul 20 04:59:24.066315 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3287/6476] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:23 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:24.072272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a710a9c-6491-4e04-ba5b-fbff46feb987 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:24.072918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a710a9c-6491-4e04-ba5b-fbff46feb987 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:24.080424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a710a9c-6491-4e04-ba5b-fbff46feb987 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:24.080883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a710a9c-6491-4e04-ba5b-fbff46feb987 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:24.081654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a710a9c-6491-4e04-ba5b-fbff46feb987 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:24.082095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a710a9c-6491-4e04-ba5b-fbff46feb987 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:24.095934 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-0a710a9c-6491-4e04-ba5b-fbff46feb987 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a710a9c-6491-4e04-ba5b-fbff46feb987 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 HTTP/1.1 Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5'} Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:24.097577 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:59:24.103127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:24.103127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:24.103127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:24.103127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:24.103127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:24.103127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 04:59:24.103127 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 04:59:24.103127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a710a9c-6491-4e04-ba5b-fbff46feb987 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:24.103127 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a710a9c-6491-4e04-ba5b-fbff46feb987 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 404 len: 111 microversion: 2.1 time: 0.030623 Jul 20 04:59:24.103127 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3190/6477] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:24 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:59:24.145510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2057831304", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1146711925", "security_groups": [{"name": "tempest-secgroup-smoke-1902203948"}], "block_device_mapping_v2": [{"uuid": "6941b0ec-9da5-4a46-8139-594fca1d509a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1e46ee9e-198e-401c-88a3-4979bd7d9aaf"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:24.257165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] validate_networks() for [('1e46ee9e-198e-401c-88a3-4979bd7d9aaf', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:59:24.687469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:59:24.687963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:59:24.688499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:59:24.689188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:59:24.689659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:59:24.699539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:24.700007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:24.700825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:24.701284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:24.719900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:59:24.725217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for user 1f70af961f624dceba390cb44ef2a792 and project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:59:24.783629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:59:24.785796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6941b0ec-9da5-4a46-8139-594fca1d509a',volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:59:24.911219 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-70d171ef-0667-4f90-9a73-fa52a8170d52 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.769397 Jul 20 04:59:24.912016 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3288/6478] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 04:59:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:59:24.922401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f08057b5-8c65-4503-ba5c-6a87b03440f6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:24.923012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f08057b5-8c65-4503-ba5c-6a87b03440f6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:24.978593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f08057b5-8c65-4503-ba5c-6a87b03440f6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:24.986303 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f08057b5-8c65-4503-ba5c-6a87b03440f6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1095 microversion: 2.1 time: 0.068404 Jul 20 04:59:24.986946 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3191/6479] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:24 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:25.083394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3eb615be-4345-4e8d-b3e1-0d79e4dd6ef1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:25.084060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3eb615be-4345-4e8d-b3e1-0d79e4dd6ef1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:25.091735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3eb615be-4345-4e8d-b3e1-0d79e4dd6ef1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:25.092204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3eb615be-4345-4e8d-b3e1-0d79e4dd6ef1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:25.093011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3eb615be-4345-4e8d-b3e1-0d79e4dd6ef1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:25.094786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3eb615be-4345-4e8d-b3e1-0d79e4dd6ef1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:25.255498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3eb615be-4345-4e8d-b3e1-0d79e4dd6ef1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:25.264341 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3eb615be-4345-4e8d-b3e1-0d79e4dd6ef1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1692 microversion: 2.1 time: 0.185276 Jul 20 04:59:25.266313 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3289/6480] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:25 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:26.003998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-249e564a-ad12-409c-a87b-3e68eed85f5b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:26.004638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-249e564a-ad12-409c-a87b-3e68eed85f5b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:26.012249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-249e564a-ad12-409c-a87b-3e68eed85f5b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:26.012995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-249e564a-ad12-409c-a87b-3e68eed85f5b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:26.013962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-249e564a-ad12-409c-a87b-3e68eed85f5b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:26.014583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-249e564a-ad12-409c-a87b-3e68eed85f5b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:26.094278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-249e564a-ad12-409c-a87b-3e68eed85f5b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:26.102198 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-249e564a-ad12-409c-a87b-3e68eed85f5b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1201 microversion: 2.1 time: 0.102777 Jul 20 04:59:26.102789 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3192/6481] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:25 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1201 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:26.283855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-52144e0c-06bf-44d9-bd7c-37ec0448f567 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:26.285149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-52144e0c-06bf-44d9-bd7c-37ec0448f567 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:26.294968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52144e0c-06bf-44d9-bd7c-37ec0448f567 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:26.295725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52144e0c-06bf-44d9-bd7c-37ec0448f567 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:26.296697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52144e0c-06bf-44d9-bd7c-37ec0448f567 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:26.297877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-52144e0c-06bf-44d9-bd7c-37ec0448f567 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:26.518152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-52144e0c-06bf-44d9-bd7c-37ec0448f567 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:26.528315 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-52144e0c-06bf-44d9-bd7c-37ec0448f567 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1692 microversion: 2.1 time: 0.249281 Jul 20 04:59:26.529684 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3290/6482] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:26 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1692 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:27.121545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-231426da-3326-42a7-a787-9ff639758e91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:27.122163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-231426da-3326-42a7-a787-9ff639758e91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:27.136158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-231426da-3326-42a7-a787-9ff639758e91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:27.136816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-231426da-3326-42a7-a787-9ff639758e91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:27.137807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-231426da-3326-42a7-a787-9ff639758e91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:27.148315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-231426da-3326-42a7-a787-9ff639758e91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:27.548068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-01e7b25a-670b-4835-87f6-217e723ef7c5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:27.549010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-01e7b25a-670b-4835-87f6-217e723ef7c5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:27.561388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-231426da-3326-42a7-a787-9ff639758e91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:27.571961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01e7b25a-670b-4835-87f6-217e723ef7c5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:27.572364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01e7b25a-670b-4835-87f6-217e723ef7c5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:27.573207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01e7b25a-670b-4835-87f6-217e723ef7c5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:27.574312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01e7b25a-670b-4835-87f6-217e723ef7c5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:27.575365 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-231426da-3326-42a7-a787-9ff639758e91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1279 microversion: 2.1 time: 0.458426 Jul 20 04:59:27.576174 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3193/6483] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:27 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1279 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:27.839932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-01e7b25a-670b-4835-87f6-217e723ef7c5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:27.851050 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-01e7b25a-670b-4835-87f6-217e723ef7c5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1692 microversion: 2.1 time: 0.307954 Jul 20 04:59:27.852017 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3291/6484] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:27 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1692 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:28.271836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-32920170-5210-4024-8e0b-a7d6e069109f req-ab27a93e-f2c1-40dd-ae57-d5b631be2259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f112b5d7-5d47-49a2-bf21-1573a24ba557", "tag": "4200d826-ce6a-496a-a01f-1493e33a4c0b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:28.283866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-32920170-5210-4024-8e0b-a7d6e069109f req-ab27a93e-f2c1-40dd-ae57-d5b631be2259 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:28.284715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-32920170-5210-4024-8e0b-a7d6e069109f req-ab27a93e-f2c1-40dd-ae57-d5b631be2259 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:28.298998 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-32920170-5210-4024-8e0b-a7d6e069109f req-ab27a93e-f2c1-40dd-ae57-d5b631be2259 service nova] Creating event network-changed:4200d826-ce6a-496a-a01f-1493e33a4c0b for instance f112b5d7-5d47-49a2-bf21-1573a24ba557 on n-h2-764485-11 Jul 20 04:59:28.309199 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-32920170-5210-4024-8e0b-a7d6e069109f req-ab27a93e-f2c1-40dd-ae57-d5b631be2259 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041009 Jul 20 04:59:28.310228 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3194/6485] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:28.594589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5de495a3-6927-4bcd-a5a2-3489ed794523 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:28.595367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5de495a3-6927-4bcd-a5a2-3489ed794523 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:28.602023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5de495a3-6927-4bcd-a5a2-3489ed794523 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:28.602508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5de495a3-6927-4bcd-a5a2-3489ed794523 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:28.603395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5de495a3-6927-4bcd-a5a2-3489ed794523 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:28.603777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5de495a3-6927-4bcd-a5a2-3489ed794523 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:28.870601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-80310090-c09f-4537-af33-3646c0968395 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:28.871335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-80310090-c09f-4537-af33-3646c0968395 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:28.877086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5de495a3-6927-4bcd-a5a2-3489ed794523 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:28.884675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80310090-c09f-4537-af33-3646c0968395 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:28.885148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80310090-c09f-4537-af33-3646c0968395 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:28.885948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80310090-c09f-4537-af33-3646c0968395 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:28.886397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-80310090-c09f-4537-af33-3646c0968395 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:28.897455 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5de495a3-6927-4bcd-a5a2-3489ed794523 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1279 microversion: 2.1 time: 0.307955 Jul 20 04:59:28.908662 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3292/6486] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:28 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1279 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:29.443650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-80310090-c09f-4537-af33-3646c0968395 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:29.452250 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-80310090-c09f-4537-af33-3646c0968395 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1697 microversion: 2.1 time: 0.586329 Jul 20 04:59:29.452856 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3195/6487] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:28 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1697 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:29.915478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-31f690b6-c9c1-48b7-b590-8b51adae021c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:29.916148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-31f690b6-c9c1-48b7-b590-8b51adae021c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:29.923736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31f690b6-c9c1-48b7-b590-8b51adae021c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:29.924214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31f690b6-c9c1-48b7-b590-8b51adae021c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:29.925154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31f690b6-c9c1-48b7-b590-8b51adae021c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:29.925612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-31f690b6-c9c1-48b7-b590-8b51adae021c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:30.058044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-31f690b6-c9c1-48b7-b590-8b51adae021c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:30.065712 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-31f690b6-c9c1-48b7-b590-8b51adae021c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1279 microversion: 2.1 time: 0.154179 Jul 20 04:59:30.066298 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3293/6488] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:29 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:30.471222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-330b1cc8-c91e-4176-a26e-7e26ea18ab32 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:30.472066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-330b1cc8-c91e-4176-a26e-7e26ea18ab32 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:30.479333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-330b1cc8-c91e-4176-a26e-7e26ea18ab32 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:30.479883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-330b1cc8-c91e-4176-a26e-7e26ea18ab32 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:30.480657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-330b1cc8-c91e-4176-a26e-7e26ea18ab32 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:30.481092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-330b1cc8-c91e-4176-a26e-7e26ea18ab32 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:30.620930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-330b1cc8-c91e-4176-a26e-7e26ea18ab32 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:30.629287 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-330b1cc8-c91e-4176-a26e-7e26ea18ab32 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1697 microversion: 2.1 time: 0.162487 Jul 20 04:59:30.629876 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3196/6489] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:30 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:31.082911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dc37e4a4-9230-4666-9760-ebb3c69e9e93 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:31.083963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dc37e4a4-9230-4666-9760-ebb3c69e9e93 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:31.090928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc37e4a4-9230-4666-9760-ebb3c69e9e93 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:31.091426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc37e4a4-9230-4666-9760-ebb3c69e9e93 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:31.092248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc37e4a4-9230-4666-9760-ebb3c69e9e93 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:31.092718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc37e4a4-9230-4666-9760-ebb3c69e9e93 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:31.239470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dc37e4a4-9230-4666-9760-ebb3c69e9e93 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:31.247114 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dc37e4a4-9230-4666-9760-ebb3c69e9e93 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1279 microversion: 2.1 time: 0.168320 Jul 20 04:59:31.247912 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3294/6490] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:31 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:31.647040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9e7420ea-04c9-4958-9891-f919148bad7d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:31.647801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9e7420ea-04c9-4958-9891-f919148bad7d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:31.654875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e7420ea-04c9-4958-9891-f919148bad7d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:31.655335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e7420ea-04c9-4958-9891-f919148bad7d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:31.656149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e7420ea-04c9-4958-9891-f919148bad7d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:31.656675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9e7420ea-04c9-4958-9891-f919148bad7d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:31.790322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9e7420ea-04c9-4958-9891-f919148bad7d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:31.798450 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9e7420ea-04c9-4958-9891-f919148bad7d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1697 microversion: 2.1 time: 0.155301 Jul 20 04:59:31.799039 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3197/6491] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:31 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:32.264334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9485c107-18ea-4c02-9926-00c4fca68547 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:32.264958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9485c107-18ea-4c02-9926-00c4fca68547 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:32.273065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9485c107-18ea-4c02-9926-00c4fca68547 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:32.273530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9485c107-18ea-4c02-9926-00c4fca68547 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:32.274311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9485c107-18ea-4c02-9926-00c4fca68547 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:32.274761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9485c107-18ea-4c02-9926-00c4fca68547 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:32.409981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9485c107-18ea-4c02-9926-00c4fca68547 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:32.417769 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9485c107-18ea-4c02-9926-00c4fca68547 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1267 microversion: 2.1 time: 0.157424 Jul 20 04:59:32.418350 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3295/6492] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:32 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:32.816359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-51221e46-c9b8-4b0e-98a0-a351de98fa47 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:32.817005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-51221e46-c9b8-4b0e-98a0-a351de98fa47 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:32.824099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51221e46-c9b8-4b0e-98a0-a351de98fa47 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:32.824547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51221e46-c9b8-4b0e-98a0-a351de98fa47 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:32.825304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51221e46-c9b8-4b0e-98a0-a351de98fa47 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:32.825738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51221e46-c9b8-4b0e-98a0-a351de98fa47 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:32.958868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-51221e46-c9b8-4b0e-98a0-a351de98fa47 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:32.966608 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-51221e46-c9b8-4b0e-98a0-a351de98fa47 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1697 microversion: 2.1 time: 0.154891 Jul 20 04:59:32.967189 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3198/6493] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:32 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:33.436373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-66dff4b0-826f-449f-afb0-3ca9b1803d5f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:33.436904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-66dff4b0-826f-449f-afb0-3ca9b1803d5f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:33.444554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66dff4b0-826f-449f-afb0-3ca9b1803d5f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:33.444965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66dff4b0-826f-449f-afb0-3ca9b1803d5f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:33.445741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66dff4b0-826f-449f-afb0-3ca9b1803d5f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:33.446192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-66dff4b0-826f-449f-afb0-3ca9b1803d5f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:33.467179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:33.583496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-66dff4b0-826f-449f-afb0-3ca9b1803d5f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:33.591095 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-66dff4b0-826f-449f-afb0-3ca9b1803d5f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1267 microversion: 2.1 time: 0.158667 Jul 20 04:59:33.591707 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3296/6494] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:33 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:33.984132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d1b4f5d5-5373-40b1-b2c2-88887a087277 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:33.984830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d1b4f5d5-5373-40b1-b2c2-88887a087277 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:33.991620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d1b4f5d5-5373-40b1-b2c2-88887a087277 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:33.992073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d1b4f5d5-5373-40b1-b2c2-88887a087277 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:33.992832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d1b4f5d5-5373-40b1-b2c2-88887a087277 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:33.993271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d1b4f5d5-5373-40b1-b2c2-88887a087277 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:34.130188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d1b4f5d5-5373-40b1-b2c2-88887a087277 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:34.137796 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d1b4f5d5-5373-40b1-b2c2-88887a087277 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1697 microversion: 2.1 time: 0.158138 Jul 20 04:59:34.138380 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3199/6495] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:33 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:34.609267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2a625764-794c-4e06-b77d-40354aef6b22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:34.610525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2a625764-794c-4e06-b77d-40354aef6b22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:34.617475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2a625764-794c-4e06-b77d-40354aef6b22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:34.617952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2a625764-794c-4e06-b77d-40354aef6b22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:34.618737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2a625764-794c-4e06-b77d-40354aef6b22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:34.619194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2a625764-794c-4e06-b77d-40354aef6b22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:34.708891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:34.732561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:34.750339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2a625764-794c-4e06-b77d-40354aef6b22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:34.757743 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2a625764-794c-4e06-b77d-40354aef6b22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1267 microversion: 2.1 time: 0.152869 Jul 20 04:59:34.758319 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3297/6496] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:34 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:35.155888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6054122d-4da7-441b-ad53-48b9942d4822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:35.156505 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6054122d-4da7-441b-ad53-48b9942d4822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:35.159967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:35.165656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6054122d-4da7-441b-ad53-48b9942d4822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:35.166113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6054122d-4da7-441b-ad53-48b9942d4822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:35.166884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6054122d-4da7-441b-ad53-48b9942d4822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:35.167327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6054122d-4da7-441b-ad53-48b9942d4822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:35.171237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:35.304171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6054122d-4da7-441b-ad53-48b9942d4822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:35.311669 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6054122d-4da7-441b-ad53-48b9942d4822 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1697 microversion: 2.1 time: 0.159669 Jul 20 04:59:35.312246 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3200/6497] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:35 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:35.774659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fe1f5c75-c2bc-4292-b28a-4beb9f3fc88a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:35.775303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fe1f5c75-c2bc-4292-b28a-4beb9f3fc88a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:35.782446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe1f5c75-c2bc-4292-b28a-4beb9f3fc88a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:35.782799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe1f5c75-c2bc-4292-b28a-4beb9f3fc88a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:35.783858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe1f5c75-c2bc-4292-b28a-4beb9f3fc88a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:35.784325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fe1f5c75-c2bc-4292-b28a-4beb9f3fc88a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:35.914620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fe1f5c75-c2bc-4292-b28a-4beb9f3fc88a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:35.922057 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fe1f5c75-c2bc-4292-b28a-4beb9f3fc88a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1267 microversion: 2.1 time: 0.151301 Jul 20 04:59:35.922634 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3298/6498] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:35 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:36.327856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-da703104-81ea-4b06-adde-bb9aee444401 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:36.328518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-da703104-81ea-4b06-adde-bb9aee444401 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:36.336188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da703104-81ea-4b06-adde-bb9aee444401 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:36.336650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da703104-81ea-4b06-adde-bb9aee444401 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:36.337424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da703104-81ea-4b06-adde-bb9aee444401 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:36.337870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-da703104-81ea-4b06-adde-bb9aee444401 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:36.473779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-da703104-81ea-4b06-adde-bb9aee444401 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:36.481404 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-da703104-81ea-4b06-adde-bb9aee444401 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1697 microversion: 2.1 time: 0.157500 Jul 20 04:59:36.482246 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3201/6499] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:36 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:36.939676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9370e2ac-a2f3-4be5-93ef-27c44ed11ec5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:36.940305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9370e2ac-a2f3-4be5-93ef-27c44ed11ec5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:36.947141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9370e2ac-a2f3-4be5-93ef-27c44ed11ec5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:36.947640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9370e2ac-a2f3-4be5-93ef-27c44ed11ec5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:36.948410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9370e2ac-a2f3-4be5-93ef-27c44ed11ec5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:36.948859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9370e2ac-a2f3-4be5-93ef-27c44ed11ec5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:37.081269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9370e2ac-a2f3-4be5-93ef-27c44ed11ec5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:37.088887 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9370e2ac-a2f3-4be5-93ef-27c44ed11ec5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1267 microversion: 2.1 time: 0.153144 Jul 20 04:59:37.089479 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3299/6500] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:36 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:37.499475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-954ed0cd-c433-44ab-8a85-703934f732bd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:37.500133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-954ed0cd-c433-44ab-8a85-703934f732bd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:37.507202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-954ed0cd-c433-44ab-8a85-703934f732bd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:37.507856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-954ed0cd-c433-44ab-8a85-703934f732bd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:37.508760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-954ed0cd-c433-44ab-8a85-703934f732bd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:37.509276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-954ed0cd-c433-44ab-8a85-703934f732bd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:37.644141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-954ed0cd-c433-44ab-8a85-703934f732bd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:37.652069 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-954ed0cd-c433-44ab-8a85-703934f732bd tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1697 microversion: 2.1 time: 0.156510 Jul 20 04:59:37.652676 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3202/6501] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:37 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:38.106588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fcbfc6ba-2769-43e2-9dec-3749f2def826 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:38.107461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fcbfc6ba-2769-43e2-9dec-3749f2def826 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:38.114628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fcbfc6ba-2769-43e2-9dec-3749f2def826 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.115090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fcbfc6ba-2769-43e2-9dec-3749f2def826 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.115898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fcbfc6ba-2769-43e2-9dec-3749f2def826 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.116349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fcbfc6ba-2769-43e2-9dec-3749f2def826 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.255187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fcbfc6ba-2769-43e2-9dec-3749f2def826 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:38.262782 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fcbfc6ba-2769-43e2-9dec-3749f2def826 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1267 microversion: 2.1 time: 0.160292 Jul 20 04:59:38.263359 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3300/6502] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:38 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:38.669359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e5014acc-869d-4e7e-b898-516f0dc74291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:38.670063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e5014acc-869d-4e7e-b898-516f0dc74291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:38.678151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5014acc-869d-4e7e-b898-516f0dc74291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.678613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5014acc-869d-4e7e-b898-516f0dc74291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.679387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5014acc-869d-4e7e-b898-516f0dc74291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.679858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5014acc-869d-4e7e-b898-516f0dc74291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.813919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e5014acc-869d-4e7e-b898-516f0dc74291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:38.821915 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e5014acc-869d-4e7e-b898-516f0dc74291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1697 microversion: 2.1 time: 0.156477 Jul 20 04:59:38.822506 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3203/6503] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:38 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:39.280079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2b16e7e5-7e29-4dec-8a6c-c1adf84c59ab tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:39.280710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2b16e7e5-7e29-4dec-8a6c-c1adf84c59ab tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:39.289391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b16e7e5-7e29-4dec-8a6c-c1adf84c59ab tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:39.290293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b16e7e5-7e29-4dec-8a6c-c1adf84c59ab tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:39.291906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b16e7e5-7e29-4dec-8a6c-c1adf84c59ab tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:39.292367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2b16e7e5-7e29-4dec-8a6c-c1adf84c59ab tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:39.430622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2b16e7e5-7e29-4dec-8a6c-c1adf84c59ab tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:39.438333 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2b16e7e5-7e29-4dec-8a6c-c1adf84c59ab tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1267 microversion: 2.1 time: 0.162736 Jul 20 04:59:39.440395 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3301/6504] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:39 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:39.839583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86aaa7d5-a71a-4066-8de2-cdd8a44e2d40 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:39.840206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-86aaa7d5-a71a-4066-8de2-cdd8a44e2d40 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:39.848077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86aaa7d5-a71a-4066-8de2-cdd8a44e2d40 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:39.848535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86aaa7d5-a71a-4066-8de2-cdd8a44e2d40 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:39.849315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86aaa7d5-a71a-4066-8de2-cdd8a44e2d40 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:39.849759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86aaa7d5-a71a-4066-8de2-cdd8a44e2d40 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:40.066728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-86aaa7d5-a71a-4066-8de2-cdd8a44e2d40 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:40.074417 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-86aaa7d5-a71a-4066-8de2-cdd8a44e2d40 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1696 microversion: 2.1 time: 0.238812 Jul 20 04:59:40.075151 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3204/6505] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:39 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1696 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:40.355631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-c125604f-151b-4707-aa62-40253f8ea0a3 req-9be035c1-07a8-4c68-a05e-2bb37cc9ec34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65c3591-6310-4a42-97b2-dc695ccf4c5c", "name": "network-vif-unplugged", "status": "completed", "tag": "6f4351a5-7a90-4e53-b6de-b819d8ead324"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:40.367201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c125604f-151b-4707-aa62-40253f8ea0a3 req-9be035c1-07a8-4c68-a05e-2bb37cc9ec34 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:40.367678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c125604f-151b-4707-aa62-40253f8ea0a3 req-9be035c1-07a8-4c68-a05e-2bb37cc9ec34 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:40.384298 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c125604f-151b-4707-aa62-40253f8ea0a3 req-9be035c1-07a8-4c68-a05e-2bb37cc9ec34 service nova] Creating event network-vif-unplugged:6f4351a5-7a90-4e53-b6de-b819d8ead324 for instance b65c3591-6310-4a42-97b2-dc695ccf4c5c on n-h2-764485-11 Jul 20 04:59:40.391470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-c125604f-151b-4707-aa62-40253f8ea0a3 req-9be035c1-07a8-4c68-a05e-2bb37cc9ec34 service nova] Instance b65c3591-6310-4a42-97b2-dc695ccf4c5c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:59:40.405041 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-c125604f-151b-4707-aa62-40253f8ea0a3 req-9be035c1-07a8-4c68-a05e-2bb37cc9ec34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053233 Jul 20 04:59:40.405724 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3302/6506] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:40.460539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6843f199-d709-44b1-9ee0-a2a4484f654f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:40.461154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6843f199-d709-44b1-9ee0-a2a4484f654f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:40.472954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6843f199-d709-44b1-9ee0-a2a4484f654f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:40.474128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6843f199-d709-44b1-9ee0-a2a4484f654f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:40.475446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6843f199-d709-44b1-9ee0-a2a4484f654f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:40.476145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6843f199-d709-44b1-9ee0-a2a4484f654f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:40.749474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6843f199-d709-44b1-9ee0-a2a4484f654f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:40.757867 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6843f199-d709-44b1-9ee0-a2a4484f654f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1267 microversion: 2.1 time: 0.304922 Jul 20 04:59:40.758574 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3205/6507] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:40 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:41.095013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4e90c69d-bbb9-478e-af5e-737bfe6d3e62 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:41.095901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4e90c69d-bbb9-478e-af5e-737bfe6d3e62 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:41.104873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e90c69d-bbb9-478e-af5e-737bfe6d3e62 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:41.105439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e90c69d-bbb9-478e-af5e-737bfe6d3e62 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:41.106476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e90c69d-bbb9-478e-af5e-737bfe6d3e62 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:41.107437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e90c69d-bbb9-478e-af5e-737bfe6d3e62 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:41.316351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4e90c69d-bbb9-478e-af5e-737bfe6d3e62 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:41.324397 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4e90c69d-bbb9-478e-af5e-737bfe6d3e62 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1696 microversion: 2.1 time: 0.235668 Jul 20 04:59:41.324968 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3303/6508] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:41 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1696 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:41.775631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b19470d-0ead-4caa-972a-16e6eba4722f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:41.776238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0b19470d-0ead-4caa-972a-16e6eba4722f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:41.783764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b19470d-0ead-4caa-972a-16e6eba4722f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:41.784217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b19470d-0ead-4caa-972a-16e6eba4722f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:41.785059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b19470d-0ead-4caa-972a-16e6eba4722f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:41.785446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b19470d-0ead-4caa-972a-16e6eba4722f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:41.920428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0b19470d-0ead-4caa-972a-16e6eba4722f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:41.928291 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0b19470d-0ead-4caa-972a-16e6eba4722f tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1267 microversion: 2.1 time: 0.156732 Jul 20 04:59:41.928881 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3206/6509] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:41 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:42.341728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-be1ef25e-cff8-48dc-b1a0-75d06c2c341b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:42.342335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-be1ef25e-cff8-48dc-b1a0-75d06c2c341b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:42.349284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be1ef25e-cff8-48dc-b1a0-75d06c2c341b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:42.349699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be1ef25e-cff8-48dc-b1a0-75d06c2c341b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:42.350567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be1ef25e-cff8-48dc-b1a0-75d06c2c341b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:42.351020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-be1ef25e-cff8-48dc-b1a0-75d06c2c341b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:42.401536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3caf8a9f-b319-4f8f-99a8-3f64dc179cbf req-bb1d6fda-6842-4f94-bb5c-344703ffe2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f112b5d7-5d47-49a2-bf21-1573a24ba557", "name": "network-vif-plugged", "status": "completed", "tag": "4200d826-ce6a-496a-a01f-1493e33a4c0b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:42.411054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3caf8a9f-b319-4f8f-99a8-3f64dc179cbf req-bb1d6fda-6842-4f94-bb5c-344703ffe2ac service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:42.411539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3caf8a9f-b319-4f8f-99a8-3f64dc179cbf req-bb1d6fda-6842-4f94-bb5c-344703ffe2ac service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:42.423091 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3caf8a9f-b319-4f8f-99a8-3f64dc179cbf req-bb1d6fda-6842-4f94-bb5c-344703ffe2ac service nova] Creating event network-vif-plugged:4200d826-ce6a-496a-a01f-1493e33a4c0b for instance f112b5d7-5d47-49a2-bf21-1573a24ba557 on n-h2-764485-11 Jul 20 04:59:42.428705 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3caf8a9f-b319-4f8f-99a8-3f64dc179cbf req-bb1d6fda-6842-4f94-bb5c-344703ffe2ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033774 Jul 20 04:59:42.429481 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3207/6510] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:42.434846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f7f91c58-59c1-46aa-88ba-bc2bc06ac15e req-c6cdc066-7470-4861-a3e5-d322ff56e0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65c3591-6310-4a42-97b2-dc695ccf4c5c", "tag": "6f4351a5-7a90-4e53-b6de-b819d8ead324"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:42.443947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f7f91c58-59c1-46aa-88ba-bc2bc06ac15e req-c6cdc066-7470-4861-a3e5-d322ff56e0a5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:42.444312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f7f91c58-59c1-46aa-88ba-bc2bc06ac15e req-c6cdc066-7470-4861-a3e5-d322ff56e0a5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:42.457027 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f7f91c58-59c1-46aa-88ba-bc2bc06ac15e req-c6cdc066-7470-4861-a3e5-d322ff56e0a5 service nova] Creating event network-changed:6f4351a5-7a90-4e53-b6de-b819d8ead324 for instance b65c3591-6310-4a42-97b2-dc695ccf4c5c on n-h2-764485-11 Jul 20 04:59:42.465494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-f7f91c58-59c1-46aa-88ba-bc2bc06ac15e req-c6cdc066-7470-4861-a3e5-d322ff56e0a5 service nova] Instance b65c3591-6310-4a42-97b2-dc695ccf4c5c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:59:42.479313 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f7f91c58-59c1-46aa-88ba-bc2bc06ac15e req-c6cdc066-7470-4861-a3e5-d322ff56e0a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048064 Jul 20 04:59:42.480597 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3208/6511] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:42.519240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-be1ef25e-cff8-48dc-b1a0-75d06c2c341b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:42.527102 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-be1ef25e-cff8-48dc-b1a0-75d06c2c341b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1694 microversion: 2.1 time: 0.189378 Jul 20 04:59:42.527829 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3304/6512] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:42 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:42.946905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ed6c9e41-34f6-49b7-a64b-5f8ddb45b2b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:42.947630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ed6c9e41-34f6-49b7-a64b-5f8ddb45b2b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:42.953829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed6c9e41-34f6-49b7-a64b-5f8ddb45b2b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:42.954337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed6c9e41-34f6-49b7-a64b-5f8ddb45b2b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:42.955362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed6c9e41-34f6-49b7-a64b-5f8ddb45b2b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:42.955899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed6c9e41-34f6-49b7-a64b-5f8ddb45b2b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.097541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ed6c9e41-34f6-49b7-a64b-5f8ddb45b2b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:43.105065 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ed6c9e41-34f6-49b7-a64b-5f8ddb45b2b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1267 microversion: 2.1 time: 0.163354 Jul 20 04:59:43.105877 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3209/6513] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:42 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:43.545288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4f40167b-04a3-41f0-9f9d-94cca742d713 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:43.545927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4f40167b-04a3-41f0-9f9d-94cca742d713 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:43.552944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f40167b-04a3-41f0-9f9d-94cca742d713 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.553413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f40167b-04a3-41f0-9f9d-94cca742d713 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.554212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f40167b-04a3-41f0-9f9d-94cca742d713 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.554651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f40167b-04a3-41f0-9f9d-94cca742d713 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.687720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4f40167b-04a3-41f0-9f9d-94cca742d713 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:43.696228 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4f40167b-04a3-41f0-9f9d-94cca742d713 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1694 microversion: 2.1 time: 0.154993 Jul 20 04:59:43.696815 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3305/6514] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:43 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:44.123137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59b06cac-df15-4070-9531-8569ce10d185 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:44.123811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-59b06cac-df15-4070-9531-8569ce10d185 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:44.131584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59b06cac-df15-4070-9531-8569ce10d185 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:44.132133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59b06cac-df15-4070-9531-8569ce10d185 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:44.132924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59b06cac-df15-4070-9531-8569ce10d185 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:44.133354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59b06cac-df15-4070-9531-8569ce10d185 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:44.383273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-59b06cac-df15-4070-9531-8569ce10d185 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:44.391597 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-59b06cac-df15-4070-9531-8569ce10d185 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1267 microversion: 2.1 time: 0.272296 Jul 20 04:59:44.392472 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3210/6515] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:44 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:44.713299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c59fcda9-870b-43f6-a82c-80b5fb415291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:44.713928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c59fcda9-870b-43f6-a82c-80b5fb415291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:44.721803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c59fcda9-870b-43f6-a82c-80b5fb415291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:44.722295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c59fcda9-870b-43f6-a82c-80b5fb415291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:44.723064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c59fcda9-870b-43f6-a82c-80b5fb415291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:44.723531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c59fcda9-870b-43f6-a82c-80b5fb415291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:44.906096 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c59fcda9-870b-43f6-a82c-80b5fb415291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:44.914570 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c59fcda9-870b-43f6-a82c-80b5fb415291 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1694 microversion: 2.1 time: 0.205250 Jul 20 04:59:44.915191 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3306/6516] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:44 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1694 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:45.408726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d607ac55-c5d4-48f4-a8c2-bf536c23b600 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:45.409286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d607ac55-c5d4-48f4-a8c2-bf536c23b600 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:45.416161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d607ac55-c5d4-48f4-a8c2-bf536c23b600 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:45.416617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d607ac55-c5d4-48f4-a8c2-bf536c23b600 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:45.417382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d607ac55-c5d4-48f4-a8c2-bf536c23b600 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:45.417825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d607ac55-c5d4-48f4-a8c2-bf536c23b600 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:45.600886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d607ac55-c5d4-48f4-a8c2-bf536c23b600 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:45.608896 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d607ac55-c5d4-48f4-a8c2-bf536c23b600 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1267 microversion: 2.1 time: 0.204654 Jul 20 04:59:45.609520 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3211/6517] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:45 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:45.932519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7898a890-e2c6-463f-9606-096dc7a2991a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:45.933179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7898a890-e2c6-463f-9606-096dc7a2991a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:45.936043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:45.942193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7898a890-e2c6-463f-9606-096dc7a2991a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:45.942651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7898a890-e2c6-463f-9606-096dc7a2991a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:45.943425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7898a890-e2c6-463f-9606-096dc7a2991a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:45.943902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7898a890-e2c6-463f-9606-096dc7a2991a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.079044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7898a890-e2c6-463f-9606-096dc7a2991a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:46.087450 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7898a890-e2c6-463f-9606-096dc7a2991a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1691 microversion: 2.1 time: 0.159055 Jul 20 04:59:46.088059 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3307/6518] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:45 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:46.103817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-756ff1e2-2f9c-4b59-8ca7-507cc77796a1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:46.104359 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-756ff1e2-2f9c-4b59-8ca7-507cc77796a1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:46.106299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=63 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:46.112291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-756ff1e2-2f9c-4b59-8ca7-507cc77796a1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.112739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-756ff1e2-2f9c-4b59-8ca7-507cc77796a1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.113504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-756ff1e2-2f9c-4b59-8ca7-507cc77796a1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.113942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-756ff1e2-2f9c-4b59-8ca7-507cc77796a1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.227302 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-756ff1e2-2f9c-4b59-8ca7-507cc77796a1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c/action" status: 202 len: 0 microversion: 2.1 time: 0.127151 Jul 20 04:59:46.231024 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3212/6519] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 04:59:46 2022] POST /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:59:46.240136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c67c5be-8b28-428f-ab79-120da6fd54fb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:46.240831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8c67c5be-8b28-428f-ab79-120da6fd54fb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:46.247266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c67c5be-8b28-428f-ab79-120da6fd54fb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.247816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c67c5be-8b28-428f-ab79-120da6fd54fb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.248734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c67c5be-8b28-428f-ab79-120da6fd54fb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.249267 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c67c5be-8b28-428f-ab79-120da6fd54fb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.443155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-dd8985af-a9c3-4949-a4d8-3e45811c9e79 req-7f6b9ffd-88ab-410c-9889-eb6bcb1a8472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65c3591-6310-4a42-97b2-dc695ccf4c5c", "name": "network-vif-plugged", "status": "completed", "tag": "6f4351a5-7a90-4e53-b6de-b819d8ead324"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:46.454669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dd8985af-a9c3-4949-a4d8-3e45811c9e79 req-7f6b9ffd-88ab-410c-9889-eb6bcb1a8472 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.455308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dd8985af-a9c3-4949-a4d8-3e45811c9e79 req-7f6b9ffd-88ab-410c-9889-eb6bcb1a8472 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.468410 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-dd8985af-a9c3-4949-a4d8-3e45811c9e79 req-7f6b9ffd-88ab-410c-9889-eb6bcb1a8472 service nova] Creating event network-vif-plugged:6f4351a5-7a90-4e53-b6de-b819d8ead324 for instance b65c3591-6310-4a42-97b2-dc695ccf4c5c on n-h2-764485-11 Jul 20 04:59:46.477178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-dd8985af-a9c3-4949-a4d8-3e45811c9e79 req-7f6b9ffd-88ab-410c-9889-eb6bcb1a8472 service nova] Instance b65c3591-6310-4a42-97b2-dc695ccf4c5c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:59:46.490589 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-dd8985af-a9c3-4949-a4d8-3e45811c9e79 req-7f6b9ffd-88ab-410c-9889-eb6bcb1a8472 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053689 Jul 20 04:59:46.491963 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3213/6520] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:59:46.499166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8c67c5be-8b28-428f-ab79-120da6fd54fb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:46.508323 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8c67c5be-8b28-428f-ab79-120da6fd54fb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1690 microversion: 2.1 time: 0.275192 Jul 20 04:59:46.508932 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3308/6521] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:46 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1690 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:46.627610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aa91feff-634e-4644-8697-3f8fc8e0b2d9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:46.628329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aa91feff-634e-4644-8697-3f8fc8e0b2d9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:46.634620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa91feff-634e-4644-8697-3f8fc8e0b2d9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.635074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa91feff-634e-4644-8697-3f8fc8e0b2d9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.635874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa91feff-634e-4644-8697-3f8fc8e0b2d9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.636320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa91feff-634e-4644-8697-3f8fc8e0b2d9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:47.157877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aa91feff-634e-4644-8697-3f8fc8e0b2d9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:47.165908 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aa91feff-634e-4644-8697-3f8fc8e0b2d9 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1455 microversion: 2.1 time: 0.543779 Jul 20 04:59:47.166495 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3214/6522] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:46 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1455 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:47.182143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-20f24941-8aa9-4fc8-b872-158ec614911a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:47.182906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-20f24941-8aa9-4fc8-b872-158ec614911a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:47.191195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20f24941-8aa9-4fc8-b872-158ec614911a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:47.191777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20f24941-8aa9-4fc8-b872-158ec614911a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:47.192633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20f24941-8aa9-4fc8-b872-158ec614911a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:47.193157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20f24941-8aa9-4fc8-b872-158ec614911a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:47.417411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-20f24941-8aa9-4fc8-b872-158ec614911a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:47.425210 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-20f24941-8aa9-4fc8-b872-158ec614911a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1455 microversion: 2.1 time: 0.246954 Jul 20 04:59:47.425974 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3309/6523] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:47 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1455 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:47.526112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1207b3e3-5afe-46a5-a9de-85d41946b740 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:47.527446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1207b3e3-5afe-46a5-a9de-85d41946b740 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:47.534134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1207b3e3-5afe-46a5-a9de-85d41946b740 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:47.534872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1207b3e3-5afe-46a5-a9de-85d41946b740 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:47.535915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1207b3e3-5afe-46a5-a9de-85d41946b740 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:47.536372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1207b3e3-5afe-46a5-a9de-85d41946b740 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:47.691996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1207b3e3-5afe-46a5-a9de-85d41946b740 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:47.699579 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1207b3e3-5afe-46a5-a9de-85d41946b740 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1690 microversion: 2.1 time: 0.177257 Jul 20 04:59:47.700163 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3215/6524] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:47 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:48.718059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c222378b-7f5e-46f0-a28a-c3513188d643 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:48.718844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c222378b-7f5e-46f0-a28a-c3513188d643 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:48.726187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c222378b-7f5e-46f0-a28a-c3513188d643 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:48.726779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c222378b-7f5e-46f0-a28a-c3513188d643 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:48.727676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c222378b-7f5e-46f0-a28a-c3513188d643 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:48.728228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c222378b-7f5e-46f0-a28a-c3513188d643 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:48.873891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c222378b-7f5e-46f0-a28a-c3513188d643 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:48.883013 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c222378b-7f5e-46f0-a28a-c3513188d643 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1690 microversion: 2.1 time: 0.168810 Jul 20 04:59:48.883634 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3310/6525] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:48 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:49.445119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6ebf1b9a-67cb-4aa9-a147-2ddf9ac8e075 req-acfad1b2-ad3e-4c05-9aa5-9bc6a09a571f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f112b5d7-5d47-49a2-bf21-1573a24ba557", "tag": "4200d826-ce6a-496a-a01f-1493e33a4c0b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:49.462483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6ebf1b9a-67cb-4aa9-a147-2ddf9ac8e075 req-acfad1b2-ad3e-4c05-9aa5-9bc6a09a571f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:49.463167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6ebf1b9a-67cb-4aa9-a147-2ddf9ac8e075 req-acfad1b2-ad3e-4c05-9aa5-9bc6a09a571f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:49.483031 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-6ebf1b9a-67cb-4aa9-a147-2ddf9ac8e075 req-acfad1b2-ad3e-4c05-9aa5-9bc6a09a571f service nova] Creating event network-changed:4200d826-ce6a-496a-a01f-1493e33a4c0b for instance f112b5d7-5d47-49a2-bf21-1573a24ba557 on n-h2-764485-11 Jul 20 04:59:49.488964 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6ebf1b9a-67cb-4aa9-a147-2ddf9ac8e075 req-acfad1b2-ad3e-4c05-9aa5-9bc6a09a571f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130010 Jul 20 04:59:49.489881 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3216/6526] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:49.903290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c00cc3e3-6f30-4ed2-8644-568624965d31 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:49.910800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c00cc3e3-6f30-4ed2-8644-568624965d31 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:49.919564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c00cc3e3-6f30-4ed2-8644-568624965d31 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:49.922278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c00cc3e3-6f30-4ed2-8644-568624965d31 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:49.923731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c00cc3e3-6f30-4ed2-8644-568624965d31 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:49.924538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c00cc3e3-6f30-4ed2-8644-568624965d31 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:50.325106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c00cc3e3-6f30-4ed2-8644-568624965d31 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:50.333303 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c00cc3e3-6f30-4ed2-8644-568624965d31 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1690 microversion: 2.1 time: 0.436188 Jul 20 04:59:50.342959 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3311/6527] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:49 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1690 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:50.498536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-da5ff6e0-590e-4c4b-8469-275ff567b51d req-1f47b832-adcf-467f-a4ad-079f028e6550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65c3591-6310-4a42-97b2-dc695ccf4c5c", "name": "network-vif-unplugged", "status": "completed", "tag": "6f4351a5-7a90-4e53-b6de-b819d8ead324"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:50.507990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-da5ff6e0-590e-4c4b-8469-275ff567b51d req-1f47b832-adcf-467f-a4ad-079f028e6550 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:50.508439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-da5ff6e0-590e-4c4b-8469-275ff567b51d req-1f47b832-adcf-467f-a4ad-079f028e6550 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:50.512743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:50.526505 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-da5ff6e0-590e-4c4b-8469-275ff567b51d req-1f47b832-adcf-467f-a4ad-079f028e6550 service nova] Creating event network-vif-unplugged:6f4351a5-7a90-4e53-b6de-b819d8ead324 for instance b65c3591-6310-4a42-97b2-dc695ccf4c5c on n-h1-764485-11 Jul 20 04:59:50.533547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-da5ff6e0-590e-4c4b-8469-275ff567b51d req-1f47b832-adcf-467f-a4ad-079f028e6550 service nova] Instance b65c3591-6310-4a42-97b2-dc695ccf4c5c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:59:50.546130 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-da5ff6e0-590e-4c4b-8469-275ff567b51d req-1f47b832-adcf-467f-a4ad-079f028e6550 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052404 Jul 20 04:59:50.546918 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3217/6528] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:59:51.350928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-45bc3b6f-fd9e-4e4a-b556-2ead99eed675 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:51.351579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-45bc3b6f-fd9e-4e4a-b556-2ead99eed675 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:51.359069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45bc3b6f-fd9e-4e4a-b556-2ead99eed675 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:51.359551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45bc3b6f-fd9e-4e4a-b556-2ead99eed675 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:51.361012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45bc3b6f-fd9e-4e4a-b556-2ead99eed675 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:51.361472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-45bc3b6f-fd9e-4e4a-b556-2ead99eed675 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:51.527795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-45bc3b6f-fd9e-4e4a-b556-2ead99eed675 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:51.536135 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-45bc3b6f-fd9e-4e4a-b556-2ead99eed675 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1690 microversion: 2.1 time: 0.189123 Jul 20 04:59:51.536716 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3312/6529] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:51 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1690 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:52.555419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cabd84b4-95b0-44e5-8289-972a6708bfd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:52.556285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cabd84b4-95b0-44e5-8289-972a6708bfd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:52.561807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-7649414b-bb9d-4d36-8fc8-7c30c0a8693a req-d701e7df-783c-471e-abe3-508c8a98b10d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65c3591-6310-4a42-97b2-dc695ccf4c5c", "tag": "6f4351a5-7a90-4e53-b6de-b819d8ead324"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:52.564399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cabd84b4-95b0-44e5-8289-972a6708bfd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:52.564958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cabd84b4-95b0-44e5-8289-972a6708bfd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:52.565741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cabd84b4-95b0-44e5-8289-972a6708bfd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:52.566184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cabd84b4-95b0-44e5-8289-972a6708bfd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:52.572019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7649414b-bb9d-4d36-8fc8-7c30c0a8693a req-d701e7df-783c-471e-abe3-508c8a98b10d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:52.572479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7649414b-bb9d-4d36-8fc8-7c30c0a8693a req-d701e7df-783c-471e-abe3-508c8a98b10d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:52.584758 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7649414b-bb9d-4d36-8fc8-7c30c0a8693a req-d701e7df-783c-471e-abe3-508c8a98b10d service nova] Creating event network-changed:6f4351a5-7a90-4e53-b6de-b819d8ead324 for instance b65c3591-6310-4a42-97b2-dc695ccf4c5c on n-h1-764485-11 Jul 20 04:59:52.587217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=100 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:52.591419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-7649414b-bb9d-4d36-8fc8-7c30c0a8693a req-d701e7df-783c-471e-abe3-508c8a98b10d service nova] Instance b65c3591-6310-4a42-97b2-dc695ccf4c5c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:59:52.603038 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-7649414b-bb9d-4d36-8fc8-7c30c0a8693a req-d701e7df-783c-471e-abe3-508c8a98b10d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045051 Jul 20 04:59:52.603739 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3313/6530] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:59:52.756030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cabd84b4-95b0-44e5-8289-972a6708bfd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:52.763824 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cabd84b4-95b0-44e5-8289-972a6708bfd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1690 microversion: 2.1 time: 0.213673 Jul 20 04:59:52.764416 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3218/6531] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:52 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1690 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:53.782750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-287dc940-e24d-4620-861e-6f5c4fdde3a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:53.783527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-287dc940-e24d-4620-861e-6f5c4fdde3a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:53.789809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-287dc940-e24d-4620-861e-6f5c4fdde3a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:53.790279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-287dc940-e24d-4620-861e-6f5c4fdde3a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:53.791052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-287dc940-e24d-4620-861e-6f5c4fdde3a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:53.791523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-287dc940-e24d-4620-861e-6f5c4fdde3a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:53.931802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-287dc940-e24d-4620-861e-6f5c4fdde3a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:53.940407 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-287dc940-e24d-4620-861e-6f5c4fdde3a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1690 microversion: 2.1 time: 0.163220 Jul 20 04:59:53.943787 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3314/6532] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:53 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:55.009419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-902cb683-771c-4950-b582-4e32b271e18e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:55.010173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-902cb683-771c-4950-b582-4e32b271e18e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:55.017098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-902cb683-771c-4950-b582-4e32b271e18e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:55.017591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-902cb683-771c-4950-b582-4e32b271e18e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:55.018360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-902cb683-771c-4950-b582-4e32b271e18e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:55.018801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-902cb683-771c-4950-b582-4e32b271e18e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:55.199079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-902cb683-771c-4950-b582-4e32b271e18e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:55.207550 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-902cb683-771c-4950-b582-4e32b271e18e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1683 microversion: 2.1 time: 0.254094 Jul 20 04:59:55.208139 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3219/6533] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:54 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1683 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:58.063834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a395e2df-5749-4d68-9dae-1a3e530742e7 req-87da77b8-1176-4bff-9e79-57b8b1c370af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65c3591-6310-4a42-97b2-dc695ccf4c5c", "name": "network-vif-plugged", "status": "completed", "tag": "6f4351a5-7a90-4e53-b6de-b819d8ead324"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:58.073579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a395e2df-5749-4d68-9dae-1a3e530742e7 req-87da77b8-1176-4bff-9e79-57b8b1c370af service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.074314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a395e2df-5749-4d68-9dae-1a3e530742e7 req-87da77b8-1176-4bff-9e79-57b8b1c370af service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.086956 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a395e2df-5749-4d68-9dae-1a3e530742e7 req-87da77b8-1176-4bff-9e79-57b8b1c370af service nova] Creating event network-vif-plugged:6f4351a5-7a90-4e53-b6de-b819d8ead324 for instance b65c3591-6310-4a42-97b2-dc695ccf4c5c on n-h1-764485-11 Jul 20 04:59:58.091996 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a395e2df-5749-4d68-9dae-1a3e530742e7 req-87da77b8-1176-4bff-9e79-57b8b1c370af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032083 Jul 20 04:59:58.092745 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3315/6534] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:29.442421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a5631723-b861-42b5-8352-dbd5aa83e12a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:29.443283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a5631723-b861-42b5-8352-dbd5aa83e12a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:29.445688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=19 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:29.446442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=15 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:29.452931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5631723-b861-42b5-8352-dbd5aa83e12a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:29.453395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5631723-b861-42b5-8352-dbd5aa83e12a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:29.454173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5631723-b861-42b5-8352-dbd5aa83e12a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:29.454620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5631723-b861-42b5-8352-dbd5aa83e12a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:29.510408 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a5631723-b861-42b5-8352-dbd5aa83e12a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c/action" status: 200 len: 63019 microversion: 2.1 time: 0.072025 Jul 20 05:00:29.511122 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3220/6535] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:00:29 2022] POST /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c/action => generated 63019 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:00:45.878061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=17 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:45.878898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:45.931438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-163bae83-e4c8-48be-9687-7600359bbfb3 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:45.932782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-163bae83-e4c8-48be-9687-7600359bbfb3 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:45.939018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-163bae83-e4c8-48be-9687-7600359bbfb3 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:45.939483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-163bae83-e4c8-48be-9687-7600359bbfb3 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:45.940295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-163bae83-e4c8-48be-9687-7600359bbfb3 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:45.940748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-163bae83-e4c8-48be-9687-7600359bbfb3 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:46.083015 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-163bae83-e4c8-48be-9687-7600359bbfb3 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1836 microversion: 2.1 time: 0.207209 Jul 20 05:00:46.083623 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3316/6536] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:45 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1836 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:46.971042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c0071245-983c-42ca-b181-b991acca2ed4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:46.971666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c0071245-983c-42ca-b181-b991acca2ed4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:46.973101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2dd2289b-30ab-4292-9ee3-b633ef836c0f req-3264e735-171f-4e95-a7bd-6147b248acca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65c3591-6310-4a42-97b2-dc695ccf4c5c", "tag": "6f4351a5-7a90-4e53-b6de-b819d8ead324"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:46.975561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:46.976648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:46.982913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0071245-983c-42ca-b181-b991acca2ed4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:46.983370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0071245-983c-42ca-b181-b991acca2ed4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:46.983544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2dd2289b-30ab-4292-9ee3-b633ef836c0f req-3264e735-171f-4e95-a7bd-6147b248acca service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:46.983979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2dd2289b-30ab-4292-9ee3-b633ef836c0f req-3264e735-171f-4e95-a7bd-6147b248acca service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:46.984204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0071245-983c-42ca-b181-b991acca2ed4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:46.984861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c0071245-983c-42ca-b181-b991acca2ed4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:46.995652 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2dd2289b-30ab-4292-9ee3-b633ef836c0f req-3264e735-171f-4e95-a7bd-6147b248acca service nova] Creating event network-changed:6f4351a5-7a90-4e53-b6de-b819d8ead324 for instance b65c3591-6310-4a42-97b2-dc695ccf4c5c on n-h1-764485-11 Jul 20 05:00:47.004609 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2dd2289b-30ab-4292-9ee3-b633ef836c0f req-3264e735-171f-4e95-a7bd-6147b248acca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034956 Jul 20 05:00:47.005840 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3317/6537] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:00:47.016300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c0071245-983c-42ca-b181-b991acca2ed4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:00:47.108257 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c0071245-983c-42ca-b181-b991acca2ed4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 204 len: 0 microversion: 2.1 time: 0.140018 Jul 20 05:00:47.110073 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3221/6538] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:00:46 2022] DELETE /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:00:47.118844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0562fa28-2ced-461b-8b93-01a770adf589 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:47.119975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0562fa28-2ced-461b-8b93-01a770adf589 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:47.126924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0562fa28-2ced-461b-8b93-01a770adf589 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:47.127528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0562fa28-2ced-461b-8b93-01a770adf589 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:47.128588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0562fa28-2ced-461b-8b93-01a770adf589 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:47.129192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0562fa28-2ced-461b-8b93-01a770adf589 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:47.287239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0562fa28-2ced-461b-8b93-01a770adf589 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:47.295379 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0562fa28-2ced-461b-8b93-01a770adf589 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1689 microversion: 2.1 time: 0.180869 Jul 20 05:00:47.296024 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3318/6539] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:47 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:48.313620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2c6f5b80-277d-45d7-9d89-3c7fbdc85312 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:48.314331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2c6f5b80-277d-45d7-9d89-3c7fbdc85312 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:48.322294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c6f5b80-277d-45d7-9d89-3c7fbdc85312 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:48.322746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c6f5b80-277d-45d7-9d89-3c7fbdc85312 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:48.323748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c6f5b80-277d-45d7-9d89-3c7fbdc85312 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:48.324192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c6f5b80-277d-45d7-9d89-3c7fbdc85312 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:48.519487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2c6f5b80-277d-45d7-9d89-3c7fbdc85312 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:48.528573 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2c6f5b80-277d-45d7-9d89-3c7fbdc85312 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1689 microversion: 2.1 time: 0.219172 Jul 20 05:00:48.529529 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3222/6540] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:48 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1689 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:49.093768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-149fcbe1-8b9b-4084-b6d9-8ffecafd9a63 req-768b9d6d-3873-4958-8885-dd722298378d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65c3591-6310-4a42-97b2-dc695ccf4c5c", "name": "network-vif-deleted", "tag": "6f4351a5-7a90-4e53-b6de-b819d8ead324"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:49.102863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-149fcbe1-8b9b-4084-b6d9-8ffecafd9a63 req-768b9d6d-3873-4958-8885-dd722298378d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:49.103324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-149fcbe1-8b9b-4084-b6d9-8ffecafd9a63 req-768b9d6d-3873-4958-8885-dd722298378d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:49.116396 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-149fcbe1-8b9b-4084-b6d9-8ffecafd9a63 req-768b9d6d-3873-4958-8885-dd722298378d service nova] Creating event network-vif-deleted:6f4351a5-7a90-4e53-b6de-b819d8ead324 for instance b65c3591-6310-4a42-97b2-dc695ccf4c5c on n-h1-764485-11 Jul 20 05:00:49.121235 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-149fcbe1-8b9b-4084-b6d9-8ffecafd9a63 req-768b9d6d-3873-4958-8885-dd722298378d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031166 Jul 20 05:00:49.121840 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3319/6541] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:49.546970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2e7de00f-fe20-4c19-b728-3e213fe4bffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:49.548494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2e7de00f-fe20-4c19-b728-3e213fe4bffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:49.554822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e7de00f-fe20-4c19-b728-3e213fe4bffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:49.555303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e7de00f-fe20-4c19-b728-3e213fe4bffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:49.556110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e7de00f-fe20-4c19-b728-3e213fe4bffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:49.556552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e7de00f-fe20-4c19-b728-3e213fe4bffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:49.597408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e7de00f-fe20-4c19-b728-3e213fe4bffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:49.597862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2e7de00f-fe20-4c19-b728-3e213fe4bffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:49.598307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-2e7de00f-fe20-4c19-b728-3e213fe4bffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lazy-loading 'fault' on Instance uuid b65c3591-6310-4a42-97b2-dc695ccf4c5c {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:00:49.879068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2e7de00f-fe20-4c19-b728-3e213fe4bffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:49.886722 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2e7de00f-fe20-4c19-b728-3e213fe4bffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 200 len: 1356 microversion: 2.1 time: 0.343923 Jul 20 05:00:49.887405 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3223/6542] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:49 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 1356 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:50.905474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c9ee4db-dcae-4397-9850-d129fc52a8ff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:50.906237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4c9ee4db-dcae-4397-9850-d129fc52a8ff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: b65c3591-6310-4a42-97b2-dc695ccf4c5c] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:50.912618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c9ee4db-dcae-4397-9850-d129fc52a8ff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:50.913089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c9ee4db-dcae-4397-9850-d129fc52a8ff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:50.913868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c9ee4db-dcae-4397-9850-d129fc52a8ff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:50.914324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4c9ee4db-dcae-4397-9850-d129fc52a8ff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:50.928166 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-4c9ee4db-dcae-4397-9850-d129fc52a8ff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] HTTP exception thrown: Instance b65c3591-6310-4a42-97b2-dc695ccf4c5c could not be found. Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c9ee4db-dcae-4397-9850-d129fc52a8ff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Request method failure captured: Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c HTTP/1.1 Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14qdBDOgOgYg5zB0q-NFS0jh5lsDTaLj-U9nsFTm8jdjGqlHi0W5cg2emgaZEmvxVQ6kbGXvGI8KMmvElHEiPc36Hu2hoFkvZ5-WodujHlu0yefRGKPzNIjJu4QwHYLFjMjO2ShrBXapwPKwcCEPUdSNP8EqhhJ410t0rhba7uK9z2U Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 6bb3f1bf4a2347a2b78e539c9e8f2ee3 Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1261484027 Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6bb3f1bf4a2347a2b78e539c9e8f2ee3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6bb3f1bf4a2347a2b78e539c9e8f2ee3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6bb3f1bf4a2347a2b78e539c9e8f2ee3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6bb3f1bf4a2347a2b78e539c9e8f2ee3"}]}] Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1261484027 Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 6bb3f1bf4a2347a2b78e539c9e8f2ee3 Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1261484027 Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestNetworkAdvancedServerOps-1261484027-project Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 4f38aa28db214cc689fd1b5e02a62d67 Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1261484027-project Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance b65c3591-6310-4a42-97b2-dc695ccf4c5c could not be found. Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'b65c3591-6310-4a42-97b2-dc695ccf4c5c'} Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65c3591-6310-4a42-97b2-dc695ccf4c5c could not be found. Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65c3591-6310-4a42-97b2-dc695ccf4c5c could not be found. Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:00:50.929793 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:50.936397 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:00:50.936397 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:50.936397 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:50.936397 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:50.936397 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:00:50.936397 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:00:50.936397 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65c3591-6310-4a42-97b2-dc695ccf4c5c could not be found. Jul 20 05:00:50.936397 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:00:50.936397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4c9ee4db-dcae-4397-9850-d129fc52a8ff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Returning 404 to user: Instance b65c3591-6310-4a42-97b2-dc695ccf4c5c could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:00:50.936397 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4c9ee4db-dcae-4397-9850-d129fc52a8ff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c" status: 404 len: 111 microversion: 2.1 time: 0.031024 Jul 20 05:00:50.936397 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3320/6543] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:50 2022] GET /compute/v2.1/servers/b65c3591-6310-4a42-97b2-dc695ccf4c5c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:00:54.390331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-77c00cac-b305-4b35-aca1-7a608eab244d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '.version_select at 0x7fbf9c0c7dc0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:54.418441 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-77c00cac-b305-4b35-aca1-7a608eab244d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1865483855" status: 202 len: 0 microversion: 2.1 time: 0.032245 Jul 20 05:00:54.419134 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3224/6544] 10.222.0.20 () {58 vars in 1283 bytes} [Wed Jul 20 05:00:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1865483855 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:00:54.461980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8dc58de4-feac-4196-bc36-282c13f896a4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'create', calling method: .version_select at 0x7fbfa285ca60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-759945096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvcmM9pzJvo8w8e4Ircal68MdrTpcq6qwESCgsBvRC0Gn230E9wZi9GeOASbQT0eJWjCMHA+/I44tEakPgFGk35S966lZVyVqUKT/t5WUY1XBxT6p3PTB621pUXCr2LNg=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:54.481723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-8dc58de4-feac-4196-bc36-282c13f896a4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:00:54.488285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-8dc58de4-feac-4196-bc36-282c13f896a4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for user 4f38aa28db214cc689fd1b5e02a62d67 and project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:00:54.514715 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8dc58de4-feac-4196-bc36-282c13f896a4 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056694 Jul 20 05:00:54.515776 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3321/6545] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:00:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:00.472837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:00.477467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-433749401", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "4a6dfe18-0cd5-4557-9c9c-bdcd6504d4c5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-759945096", "security_groups": [{"name": "tempest-secgroup-smoke-984541626"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:00.822690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] validate_networks() for [('4a6dfe18-0cd5-4557-9c9c-bdcd6504d4c5', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:01:01.445169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:01:01.445649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:01:01.446062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:01:01.446479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:01:01.447217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:01:01.466597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:01.467070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:01.467925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:01.469057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:01.503812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:01:01.510554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for user 4f38aa28db214cc689fd1b5e02a62d67 and project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:01:01.527142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:01:01.529875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:01:01.594967 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a39c0d69-129b-445f-b71f-9c2c3a7565e6 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.111479 Jul 20 05:01:01.598590 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3225/6546] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:01:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:01:01.610228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8cad514a-754f-4041-8c89-0372af9afeb3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:01.611486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8cad514a-754f-4041-8c89-0372af9afeb3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:01.620150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=18 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:01.824532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8cad514a-754f-4041-8c89-0372af9afeb3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:01.833678 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8cad514a-754f-4041-8c89-0372af9afeb3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1265 microversion: 2.1 time: 0.228047 Jul 20 05:01:01.834753 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3322/6547] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:01 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:02.854382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa3987b8-953b-470e-b8bb-ae6e7e0b9e81 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:02.854900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa3987b8-953b-470e-b8bb-ae6e7e0b9e81 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:02.861313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa3987b8-953b-470e-b8bb-ae6e7e0b9e81 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:02.861778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa3987b8-953b-470e-b8bb-ae6e7e0b9e81 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:02.862626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa3987b8-953b-470e-b8bb-ae6e7e0b9e81 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:02.863077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa3987b8-953b-470e-b8bb-ae6e7e0b9e81 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:02.949532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fa3987b8-953b-470e-b8bb-ae6e7e0b9e81 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:02.957593 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fa3987b8-953b-470e-b8bb-ae6e7e0b9e81 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1323 microversion: 2.1 time: 0.108697 Jul 20 05:01:02.958481 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3226/6548] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:02 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1323 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:03.976048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-518d1e02-4e98-4f7d-a405-8557abe11f14 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:03.976674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-518d1e02-4e98-4f7d-a405-8557abe11f14 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:03.985600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-518d1e02-4e98-4f7d-a405-8557abe11f14 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:03.986345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-518d1e02-4e98-4f7d-a405-8557abe11f14 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:03.988848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-518d1e02-4e98-4f7d-a405-8557abe11f14 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:03.989536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-518d1e02-4e98-4f7d-a405-8557abe11f14 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:04.207840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-90853c85-bc12-4eb7-876b-5a9d8407fa32 req-36892b6a-0999-42a3-87f7-806300d1c7ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d66b47-ae3a-47ce-942a-0bc0cfd151ba", "tag": "82c7952c-3779-4cce-966b-191cda12ab0f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:04.218710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-90853c85-bc12-4eb7-876b-5a9d8407fa32 req-36892b6a-0999-42a3-87f7-806300d1c7ad service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:04.219362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-90853c85-bc12-4eb7-876b-5a9d8407fa32 req-36892b6a-0999-42a3-87f7-806300d1c7ad service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:04.234804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-518d1e02-4e98-4f7d-a405-8557abe11f14 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:04.245807 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-518d1e02-4e98-4f7d-a405-8557abe11f14 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1390 microversion: 2.1 time: 0.272993 Jul 20 05:01:04.248550 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-90853c85-bc12-4eb7-876b-5a9d8407fa32 req-36892b6a-0999-42a3-87f7-806300d1c7ad service nova] Creating event network-changed:82c7952c-3779-4cce-966b-191cda12ab0f for instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba on n-h1-764485-11 Jul 20 05:01:04.253432 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3323/6549] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:03 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1390 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:04.263983 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-90853c85-bc12-4eb7-876b-5a9d8407fa32 req-36892b6a-0999-42a3-87f7-806300d1c7ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061661 Jul 20 05:01:04.264781 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3227/6550] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:05.264516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ae7c8017-0d69-48b7-8ea8-028f466bb18b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:05.265148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ae7c8017-0d69-48b7-8ea8-028f466bb18b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:05.272119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae7c8017-0d69-48b7-8ea8-028f466bb18b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:05.272585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae7c8017-0d69-48b7-8ea8-028f466bb18b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:05.273361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae7c8017-0d69-48b7-8ea8-028f466bb18b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:05.273816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ae7c8017-0d69-48b7-8ea8-028f466bb18b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:05.404363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ae7c8017-0d69-48b7-8ea8-028f466bb18b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:05.411902 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ae7c8017-0d69-48b7-8ea8-028f466bb18b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1390 microversion: 2.1 time: 0.152486 Jul 20 05:01:05.412485 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3324/6551] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:05 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:06.429826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-29aeed91-8244-4203-80c0-7b7b0701e9c3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:06.430544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-29aeed91-8244-4203-80c0-7b7b0701e9c3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:06.438120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29aeed91-8244-4203-80c0-7b7b0701e9c3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:06.438584 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29aeed91-8244-4203-80c0-7b7b0701e9c3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:06.439408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29aeed91-8244-4203-80c0-7b7b0701e9c3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:06.439838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29aeed91-8244-4203-80c0-7b7b0701e9c3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:06.889368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-29aeed91-8244-4203-80c0-7b7b0701e9c3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:06.897081 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-29aeed91-8244-4203-80c0-7b7b0701e9c3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1390 microversion: 2.1 time: 0.471465 Jul 20 05:01:06.897674 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3228/6552] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:06 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1390 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:07.914433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6e5b6fb-e094-4308-b491-da00610c85a0 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:07.914990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c6e5b6fb-e094-4308-b491-da00610c85a0 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:07.922136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6e5b6fb-e094-4308-b491-da00610c85a0 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:07.922602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6e5b6fb-e094-4308-b491-da00610c85a0 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:07.923367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6e5b6fb-e094-4308-b491-da00610c85a0 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:07.923845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6e5b6fb-e094-4308-b491-da00610c85a0 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:08.056879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c6e5b6fb-e094-4308-b491-da00610c85a0 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:08.064971 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c6e5b6fb-e094-4308-b491-da00610c85a0 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1390 microversion: 2.1 time: 0.154609 Jul 20 05:01:08.065894 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3325/6553] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:07 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:09.081841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-854b7c6f-f145-4aba-8e24-1acfa2456baf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:09.082483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-854b7c6f-f145-4aba-8e24-1acfa2456baf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:09.089796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-854b7c6f-f145-4aba-8e24-1acfa2456baf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:09.090245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-854b7c6f-f145-4aba-8e24-1acfa2456baf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:09.091004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-854b7c6f-f145-4aba-8e24-1acfa2456baf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:09.091442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-854b7c6f-f145-4aba-8e24-1acfa2456baf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:09.231710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-854b7c6f-f145-4aba-8e24-1acfa2456baf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:09.239894 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-854b7c6f-f145-4aba-8e24-1acfa2456baf tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1390 microversion: 2.1 time: 0.161904 Jul 20 05:01:09.240476 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3229/6554] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:09 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:10.257140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c13dbcf0-fd1e-4d97-8502-4c10ad54483f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:10.257768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c13dbcf0-fd1e-4d97-8502-4c10ad54483f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:10.264880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c13dbcf0-fd1e-4d97-8502-4c10ad54483f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:10.265347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c13dbcf0-fd1e-4d97-8502-4c10ad54483f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:10.266133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c13dbcf0-fd1e-4d97-8502-4c10ad54483f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:10.266594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c13dbcf0-fd1e-4d97-8502-4c10ad54483f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:10.401803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c13dbcf0-fd1e-4d97-8502-4c10ad54483f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:10.409654 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c13dbcf0-fd1e-4d97-8502-4c10ad54483f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1390 microversion: 2.1 time: 0.156372 Jul 20 05:01:10.410396 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3326/6555] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:10 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:10.412794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8e71cc62-04a1-48c6-aeb4-260b47db6e87 req-28df21e1-8b2e-44e2-bb66-a783b59e0970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d66b47-ae3a-47ce-942a-0bc0cfd151ba", "name": "network-vif-plugged", "status": "completed", "tag": "82c7952c-3779-4cce-966b-191cda12ab0f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:10.422895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8e71cc62-04a1-48c6-aeb4-260b47db6e87 req-28df21e1-8b2e-44e2-bb66-a783b59e0970 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:10.423346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8e71cc62-04a1-48c6-aeb4-260b47db6e87 req-28df21e1-8b2e-44e2-bb66-a783b59e0970 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:10.435690 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8e71cc62-04a1-48c6-aeb4-260b47db6e87 req-28df21e1-8b2e-44e2-bb66-a783b59e0970 service nova] Creating event network-vif-plugged:82c7952c-3779-4cce-966b-191cda12ab0f for instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba on n-h1-764485-11 Jul 20 05:01:10.440701 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8e71cc62-04a1-48c6-aeb4-260b47db6e87 req-28df21e1-8b2e-44e2-bb66-a783b59e0970 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032235 Jul 20 05:01:10.441253 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3230/6556] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:01:11.426464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7f03715-eb7e-4f5e-9965-f1d114644bd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:11.427130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a7f03715-eb7e-4f5e-9965-f1d114644bd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:11.435266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7f03715-eb7e-4f5e-9965-f1d114644bd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:11.435766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7f03715-eb7e-4f5e-9965-f1d114644bd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:11.436565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7f03715-eb7e-4f5e-9965-f1d114644bd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:11.437029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7f03715-eb7e-4f5e-9965-f1d114644bd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:11.575087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a7f03715-eb7e-4f5e-9965-f1d114644bd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:11.582770 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a7f03715-eb7e-4f5e-9965-f1d114644bd2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1390 microversion: 2.1 time: 0.160280 Jul 20 05:01:11.583390 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3327/6557] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:11 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:12.598210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:12.598982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:12.603706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc099c94-e357-4003-8aad-f296013da2ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:12.604418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc099c94-e357-4003-8aad-f296013da2ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:12.611882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc099c94-e357-4003-8aad-f296013da2ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:12.612275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc099c94-e357-4003-8aad-f296013da2ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:12.613041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc099c94-e357-4003-8aad-f296013da2ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:12.613483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc099c94-e357-4003-8aad-f296013da2ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:12.751950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fc099c94-e357-4003-8aad-f296013da2ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:12.759798 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc099c94-e357-4003-8aad-f296013da2ef tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1562 microversion: 2.1 time: 0.163226 Jul 20 05:01:12.760394 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3231/6558] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:12 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:12.776043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ac236034-c9dc-4c37-aa32-5c1323fc5b48 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:12.776679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ac236034-c9dc-4c37-aa32-5c1323fc5b48 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:12.778583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:12.785156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ac236034-c9dc-4c37-aa32-5c1323fc5b48 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:12.785621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ac236034-c9dc-4c37-aa32-5c1323fc5b48 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:12.786399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ac236034-c9dc-4c37-aa32-5c1323fc5b48 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:12.786852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ac236034-c9dc-4c37-aa32-5c1323fc5b48 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:12.922781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ac236034-c9dc-4c37-aa32-5c1323fc5b48 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:12.930249 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ac236034-c9dc-4c37-aa32-5c1323fc5b48 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1562 microversion: 2.1 time: 0.158580 Jul 20 05:01:12.930914 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3328/6559] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:12 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:14.499761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-197f8303-590e-4b1a-bbcf-fdfca5b00ffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:14.500388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-197f8303-590e-4b1a-bbcf-fdfca5b00ffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:14.501889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-dd1b5ce8-a77a-43bb-b5af-e8575d0eea4a req-f09a2ab7-39e4-4c42-8f21-acfa8bd2d203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d66b47-ae3a-47ce-942a-0bc0cfd151ba", "tag": "82c7952c-3779-4cce-966b-191cda12ab0f"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:14.511629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dd1b5ce8-a77a-43bb-b5af-e8575d0eea4a req-f09a2ab7-39e4-4c42-8f21-acfa8bd2d203 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:14.512091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dd1b5ce8-a77a-43bb-b5af-e8575d0eea4a req-f09a2ab7-39e4-4c42-8f21-acfa8bd2d203 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:14.514621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-197f8303-590e-4b1a-bbcf-fdfca5b00ffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:14.515286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-197f8303-590e-4b1a-bbcf-fdfca5b00ffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:14.516097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-197f8303-590e-4b1a-bbcf-fdfca5b00ffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:14.516731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-197f8303-590e-4b1a-bbcf-fdfca5b00ffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:14.524264 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-dd1b5ce8-a77a-43bb-b5af-e8575d0eea4a req-f09a2ab7-39e4-4c42-8f21-acfa8bd2d203 service nova] Creating event network-changed:82c7952c-3779-4cce-966b-191cda12ab0f for instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba on n-h1-764485-11 Jul 20 05:01:14.531321 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-dd1b5ce8-a77a-43bb-b5af-e8575d0eea4a req-f09a2ab7-39e4-4c42-8f21-acfa8bd2d203 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039347 Jul 20 05:01:14.535558 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3329/6560] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:14.703730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-197f8303-590e-4b1a-bbcf-fdfca5b00ffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:14.711795 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-197f8303-590e-4b1a-bbcf-fdfca5b00ffa tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1562 microversion: 2.1 time: 0.222265 Jul 20 05:01:14.717520 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3232/6561] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:14 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:27.740243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:27.741239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=38 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:27.745366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-334464371", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1146711925", "security_groups": [{"name": "tempest-secgroup-smoke-1902203948"}], "block_device_mapping_v2": [{"uuid": "43f9b59e-8467-4cb2-b7e5-a30e34ceaab1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1e46ee9e-198e-401c-88a3-4979bd7d9aaf"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:27.862323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] validate_networks() for [('1e46ee9e-198e-401c-88a3-4979bd7d9aaf', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:01:28.245799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:01:28.246237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:01:28.246727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:01:28.247153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:01:28.247657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:01:28.256564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:28.257027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:28.257866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:28.258311 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:28.275863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:01:28.281097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Getting quotas for user 1f70af961f624dceba390cb44ef2a792 and project a157c449be9441eaa953dc3bb9c0ecfc. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:01:28.340604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:01:28.342846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='43f9b59e-8467-4cb2-b7e5-a30e34ceaab1',volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:01:28.468743 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-59888c89-6571-496d-b0ef-ed65a4bafb91 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730293 Jul 20 05:01:28.469331 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3330/6562] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:01:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:01:28.480409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1c28f235-a2f3-438a-aa77-4edfc9aa89f8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:28.481080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1c28f235-a2f3-438a-aa77-4edfc9aa89f8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:28.483925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:28.484642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=36 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:28.545141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1c28f235-a2f3-438a-aa77-4edfc9aa89f8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:28.552196 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1c28f235-a2f3-438a-aa77-4edfc9aa89f8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1094 microversion: 2.1 time: 0.076625 Jul 20 05:01:28.552820 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3233/6563] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:28 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:29.571972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3b632e2f-fef6-442b-8f6c-5d367f1c46b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:29.573257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3b632e2f-fef6-442b-8f6c-5d367f1c46b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:29.630951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3b632e2f-fef6-442b-8f6c-5d367f1c46b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:29.638856 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3b632e2f-fef6-442b-8f6c-5d367f1c46b6 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1094 microversion: 2.1 time: 0.072490 Jul 20 05:01:29.639437 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3331/6564] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:29 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:30.656321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-10f6838e-0dcb-46e1-9c59-5551dff7d413 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:30.656899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-10f6838e-0dcb-46e1-9c59-5551dff7d413 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:30.709124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-10f6838e-0dcb-46e1-9c59-5551dff7d413 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:30.717859 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-10f6838e-0dcb-46e1-9c59-5551dff7d413 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1094 microversion: 2.1 time: 0.065464 Jul 20 05:01:30.718459 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3234/6565] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:30 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:31.735204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-73abc550-3fef-45d7-829a-b8d92811abe8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:31.736022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-73abc550-3fef-45d7-829a-b8d92811abe8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:31.745111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-73abc550-3fef-45d7-829a-b8d92811abe8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:31.746082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-73abc550-3fef-45d7-829a-b8d92811abe8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:31.748941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-73abc550-3fef-45d7-829a-b8d92811abe8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:31.749613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-73abc550-3fef-45d7-829a-b8d92811abe8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:31.954477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-73abc550-3fef-45d7-829a-b8d92811abe8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:31.962043 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-73abc550-3fef-45d7-829a-b8d92811abe8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1210 microversion: 2.1 time: 0.231091 Jul 20 05:01:31.962628 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3332/6566] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:31 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1210 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:32.981439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a93851a-9b42-459b-8c14-6e7f94947c61 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:32.982479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a93851a-9b42-459b-8c14-6e7f94947c61 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:32.992521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a93851a-9b42-459b-8c14-6e7f94947c61 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:32.993150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a93851a-9b42-459b-8c14-6e7f94947c61 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:32.994185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a93851a-9b42-459b-8c14-6e7f94947c61 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:32.995698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a93851a-9b42-459b-8c14-6e7f94947c61 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:33.232927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a93851a-9b42-459b-8c14-6e7f94947c61 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:33.241986 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a93851a-9b42-459b-8c14-6e7f94947c61 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1278 microversion: 2.1 time: 0.265918 Jul 20 05:01:33.252611 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3235/6567] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:32 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1278 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:01:33.334685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2e580b83-ec0c-4d81-a6b4-c877367ff5b8 req-425817c9-7f90-4ca4-bf61-ab3f4446b8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df", "tag": "d8e7cec7-d8aa-4128-be58-f82d5f69707b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:33.361299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2e580b83-ec0c-4d81-a6b4-c877367ff5b8 req-425817c9-7f90-4ca4-bf61-ab3f4446b8c5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:33.361771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2e580b83-ec0c-4d81-a6b4-c877367ff5b8 req-425817c9-7f90-4ca4-bf61-ab3f4446b8c5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:33.389965 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2e580b83-ec0c-4d81-a6b4-c877367ff5b8 req-425817c9-7f90-4ca4-bf61-ab3f4446b8c5 service nova] Creating event network-changed:d8e7cec7-d8aa-4128-be58-f82d5f69707b for instance d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df on n-h2-764485-11 Jul 20 05:01:33.397465 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2e580b83-ec0c-4d81-a6b4-c877367ff5b8 req-425817c9-7f90-4ca4-bf61-ab3f4446b8c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067320 Jul 20 05:01:33.398935 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3333/6568] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:34.261847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1ac1c586-75f8-4123-bfc5-ddd6f92c8fd8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:34.262615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1ac1c586-75f8-4123-bfc5-ddd6f92c8fd8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:34.270155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ac1c586-75f8-4123-bfc5-ddd6f92c8fd8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:34.270739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ac1c586-75f8-4123-bfc5-ddd6f92c8fd8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:34.271539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ac1c586-75f8-4123-bfc5-ddd6f92c8fd8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:34.272032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1ac1c586-75f8-4123-bfc5-ddd6f92c8fd8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:34.464425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1ac1c586-75f8-4123-bfc5-ddd6f92c8fd8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:34.472387 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1ac1c586-75f8-4123-bfc5-ddd6f92c8fd8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1278 microversion: 2.1 time: 0.215938 Jul 20 05:01:34.473106 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3236/6569] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:34 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1278 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:35.495475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2c8de2c-b96e-4116-b2ae-27b65a4a13ea tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:35.496234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c2c8de2c-b96e-4116-b2ae-27b65a4a13ea tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:35.503365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2c8de2c-b96e-4116-b2ae-27b65a4a13ea tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.503900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2c8de2c-b96e-4116-b2ae-27b65a4a13ea tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.504881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2c8de2c-b96e-4116-b2ae-27b65a4a13ea tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.505368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2c8de2c-b96e-4116-b2ae-27b65a4a13ea tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.656100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c2c8de2c-b96e-4116-b2ae-27b65a4a13ea tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:35.663981 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c2c8de2c-b96e-4116-b2ae-27b65a4a13ea tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1278 microversion: 2.1 time: 0.173343 Jul 20 05:01:35.664575 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3334/6570] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:35 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:36.681194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0ae52d76-361f-4921-a3b8-b8f401ed1fd0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:36.681938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0ae52d76-361f-4921-a3b8-b8f401ed1fd0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:36.688869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ae52d76-361f-4921-a3b8-b8f401ed1fd0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:36.689320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ae52d76-361f-4921-a3b8-b8f401ed1fd0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:36.690087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ae52d76-361f-4921-a3b8-b8f401ed1fd0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:36.690603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ae52d76-361f-4921-a3b8-b8f401ed1fd0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:36.840435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0ae52d76-361f-4921-a3b8-b8f401ed1fd0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:36.849132 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0ae52d76-361f-4921-a3b8-b8f401ed1fd0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1278 microversion: 2.1 time: 0.172355 Jul 20 05:01:36.849720 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3237/6571] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:36 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:01:37.867307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0137794d-4d18-403d-b23e-abe70f4fe831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:37.867953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0137794d-4d18-403d-b23e-abe70f4fe831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:37.874844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0137794d-4d18-403d-b23e-abe70f4fe831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:37.875313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0137794d-4d18-403d-b23e-abe70f4fe831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:37.876123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0137794d-4d18-403d-b23e-abe70f4fe831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:37.876580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0137794d-4d18-403d-b23e-abe70f4fe831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:38.012229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0137794d-4d18-403d-b23e-abe70f4fe831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:38.019650 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0137794d-4d18-403d-b23e-abe70f4fe831 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1266 microversion: 2.1 time: 0.156537 Jul 20 05:01:38.020222 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3335/6572] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:37 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:39.036758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-63497f5d-6742-470c-b2d5-9a4539580f19 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:39.037375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-63497f5d-6742-470c-b2d5-9a4539580f19 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:39.045441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-63497f5d-6742-470c-b2d5-9a4539580f19 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:39.045895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-63497f5d-6742-470c-b2d5-9a4539580f19 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:39.046655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-63497f5d-6742-470c-b2d5-9a4539580f19 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:39.047091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-63497f5d-6742-470c-b2d5-9a4539580f19 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:39.184845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-63497f5d-6742-470c-b2d5-9a4539580f19 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:39.192519 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-63497f5d-6742-470c-b2d5-9a4539580f19 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1266 microversion: 2.1 time: 0.159735 Jul 20 05:01:39.193104 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3238/6573] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:39 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:40.208905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-373c301f-8fc2-446a-9573-71eb21ab24ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:40.209535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-373c301f-8fc2-446a-9573-71eb21ab24ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:40.211485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:40.213394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:40.219258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-373c301f-8fc2-446a-9573-71eb21ab24ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:40.219756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-373c301f-8fc2-446a-9573-71eb21ab24ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:40.220569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-373c301f-8fc2-446a-9573-71eb21ab24ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:40.221021 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-373c301f-8fc2-446a-9573-71eb21ab24ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:40.351441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-373c301f-8fc2-446a-9573-71eb21ab24ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:40.359853 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-373c301f-8fc2-446a-9573-71eb21ab24ef tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1266 microversion: 2.1 time: 0.154848 Jul 20 05:01:40.360435 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3336/6574] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:40 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:41.375966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d07b29e8-2e64-413e-90ea-5b70733479f3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:41.376610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d07b29e8-2e64-413e-90ea-5b70733479f3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:41.379257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:41.385188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d07b29e8-2e64-413e-90ea-5b70733479f3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:41.385634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d07b29e8-2e64-413e-90ea-5b70733479f3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:41.386397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d07b29e8-2e64-413e-90ea-5b70733479f3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:41.386832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d07b29e8-2e64-413e-90ea-5b70733479f3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:41.521887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d07b29e8-2e64-413e-90ea-5b70733479f3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:41.530884 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d07b29e8-2e64-413e-90ea-5b70733479f3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1266 microversion: 2.1 time: 0.158517 Jul 20 05:01:41.531485 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3239/6575] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:41 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:42.547875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b1110769-7ebc-4b3f-9260-d4dbda533155 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:42.548502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b1110769-7ebc-4b3f-9260-d4dbda533155 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:42.555361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1110769-7ebc-4b3f-9260-d4dbda533155 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:42.555927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1110769-7ebc-4b3f-9260-d4dbda533155 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:42.557283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1110769-7ebc-4b3f-9260-d4dbda533155 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:42.557756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1110769-7ebc-4b3f-9260-d4dbda533155 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:42.691628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b1110769-7ebc-4b3f-9260-d4dbda533155 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:42.699650 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b1110769-7ebc-4b3f-9260-d4dbda533155 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1266 microversion: 2.1 time: 0.155693 Jul 20 05:01:42.700232 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3337/6576] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:42 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:43.716971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cc96abac-ab7d-443d-b769-34f5fadd459b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:43.717591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cc96abac-ab7d-443d-b769-34f5fadd459b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:43.724209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc96abac-ab7d-443d-b769-34f5fadd459b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:43.724668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc96abac-ab7d-443d-b769-34f5fadd459b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:43.725443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc96abac-ab7d-443d-b769-34f5fadd459b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:43.725918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc96abac-ab7d-443d-b769-34f5fadd459b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:43.858436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cc96abac-ab7d-443d-b769-34f5fadd459b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:43.866012 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cc96abac-ab7d-443d-b769-34f5fadd459b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1266 microversion: 2.1 time: 0.153425 Jul 20 05:01:43.866593 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3240/6577] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:43 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:44.883420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3ea3cd02-cdad-4635-8609-aa185c029249 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:44.884171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3ea3cd02-cdad-4635-8609-aa185c029249 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:44.891715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ea3cd02-cdad-4635-8609-aa185c029249 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:44.892184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ea3cd02-cdad-4635-8609-aa185c029249 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:44.892958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ea3cd02-cdad-4635-8609-aa185c029249 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:44.893407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ea3cd02-cdad-4635-8609-aa185c029249 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:45.030261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3ea3cd02-cdad-4635-8609-aa185c029249 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:45.038132 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3ea3cd02-cdad-4635-8609-aa185c029249 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1266 microversion: 2.1 time: 0.158922 Jul 20 05:01:45.038986 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3338/6578] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:44 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:46.056048 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8b1220e6-f087-4ca6-9461-b448dba637d2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:46.057393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8b1220e6-f087-4ca6-9461-b448dba637d2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:46.064185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b1220e6-f087-4ca6-9461-b448dba637d2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:46.064659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b1220e6-f087-4ca6-9461-b448dba637d2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:46.065418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b1220e6-f087-4ca6-9461-b448dba637d2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:46.065855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8b1220e6-f087-4ca6-9461-b448dba637d2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:46.202157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8b1220e6-f087-4ca6-9461-b448dba637d2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:46.209686 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8b1220e6-f087-4ca6-9461-b448dba637d2 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1266 microversion: 2.1 time: 0.157584 Jul 20 05:01:46.210286 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3241/6579] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:46 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:47.064141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-917982cc-b48c-48e7-8ab2-534e151c9599 req-bdfd8c48-5df2-44a6-a000-ddad95487ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df", "name": "network-vif-plugged", "status": "completed", "tag": "d8e7cec7-d8aa-4128-be58-f82d5f69707b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:47.074077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-917982cc-b48c-48e7-8ab2-534e151c9599 req-bdfd8c48-5df2-44a6-a000-ddad95487ccd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:47.074543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-917982cc-b48c-48e7-8ab2-534e151c9599 req-bdfd8c48-5df2-44a6-a000-ddad95487ccd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:47.090653 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-917982cc-b48c-48e7-8ab2-534e151c9599 req-bdfd8c48-5df2-44a6-a000-ddad95487ccd service nova] Creating event network-vif-plugged:d8e7cec7-d8aa-4128-be58-f82d5f69707b for instance d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df on n-h2-764485-11 Jul 20 05:01:47.095756 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-917982cc-b48c-48e7-8ab2-534e151c9599 req-bdfd8c48-5df2-44a6-a000-ddad95487ccd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035297 Jul 20 05:01:47.096395 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3339/6580] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:47.226937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ed8e2c18-63fa-4737-b4fa-352e45c8295b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:47.227619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ed8e2c18-63fa-4737-b4fa-352e45c8295b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:47.235344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed8e2c18-63fa-4737-b4fa-352e45c8295b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:47.235837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed8e2c18-63fa-4737-b4fa-352e45c8295b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:47.236660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed8e2c18-63fa-4737-b4fa-352e45c8295b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:47.237060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed8e2c18-63fa-4737-b4fa-352e45c8295b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:47.374916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ed8e2c18-63fa-4737-b4fa-352e45c8295b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:47.382357 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ed8e2c18-63fa-4737-b4fa-352e45c8295b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1266 microversion: 2.1 time: 0.159350 Jul 20 05:01:47.382934 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3242/6581] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:47 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:48.401418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8a7283d2-a18d-4f4c-9f86-2c1ae3674bcf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:48.402126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8a7283d2-a18d-4f4c-9f86-2c1ae3674bcf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:48.408496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8a7283d2-a18d-4f4c-9f86-2c1ae3674bcf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:48.408956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8a7283d2-a18d-4f4c-9f86-2c1ae3674bcf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:48.409755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8a7283d2-a18d-4f4c-9f86-2c1ae3674bcf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:48.410206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8a7283d2-a18d-4f4c-9f86-2c1ae3674bcf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:48.542391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8a7283d2-a18d-4f4c-9f86-2c1ae3674bcf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:48.549978 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8a7283d2-a18d-4f4c-9f86-2c1ae3674bcf tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1266 microversion: 2.1 time: 0.153970 Jul 20 05:01:48.550554 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3340/6582] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:48 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:49.567808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-46104e8c-a09a-4097-aae2-7c5f44ca602b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:49.568423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-46104e8c-a09a-4097-aae2-7c5f44ca602b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:49.576530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46104e8c-a09a-4097-aae2-7c5f44ca602b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:49.576988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46104e8c-a09a-4097-aae2-7c5f44ca602b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:49.577765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46104e8c-a09a-4097-aae2-7c5f44ca602b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:49.578208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-46104e8c-a09a-4097-aae2-7c5f44ca602b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:49.715864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-46104e8c-a09a-4097-aae2-7c5f44ca602b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:49.723477 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-46104e8c-a09a-4097-aae2-7c5f44ca602b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1454 microversion: 2.1 time: 0.159647 Jul 20 05:01:49.724094 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3243/6583] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:49 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:49.739942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ee3637c2-5452-4965-b407-ad027b5b9a9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:49.740567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ee3637c2-5452-4965-b407-ad027b5b9a9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:49.748292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee3637c2-5452-4965-b407-ad027b5b9a9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:49.748754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee3637c2-5452-4965-b407-ad027b5b9a9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:49.749524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee3637c2-5452-4965-b407-ad027b5b9a9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:49.749979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee3637c2-5452-4965-b407-ad027b5b9a9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:49.880393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee3637c2-5452-4965-b407-ad027b5b9a9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:49.888610 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ee3637c2-5452-4965-b407-ad027b5b9a9a tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1454 microversion: 2.1 time: 0.152522 Jul 20 05:01:49.889188 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3341/6584] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:49 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:50.027989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a7d2e94b-6eac-4223-8035-627fc4161356 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:50.028914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a7d2e94b-6eac-4223-8035-627fc4161356 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:50.035601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d2e94b-6eac-4223-8035-627fc4161356 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:50.036020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d2e94b-6eac-4223-8035-627fc4161356 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:50.036797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d2e94b-6eac-4223-8035-627fc4161356 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:50.037265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d2e94b-6eac-4223-8035-627fc4161356 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:50.093784 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a7d2e94b-6eac-4223-8035-627fc4161356 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba/action" status: 200 len: 24571 microversion: 2.1 time: 0.069619 Jul 20 05:01:50.094640 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3244/6585] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:01:50 2022] POST /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:01:51.757889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2975ec8b-e7be-48e6-ad9b-ee97ba52ed3f req-03989d96-2c27-4852-a860-fb4610e04dbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df", "tag": "d8e7cec7-d8aa-4128-be58-f82d5f69707b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:51.767674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2975ec8b-e7be-48e6-ad9b-ee97ba52ed3f req-03989d96-2c27-4852-a860-fb4610e04dbd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:51.768154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2975ec8b-e7be-48e6-ad9b-ee97ba52ed3f req-03989d96-2c27-4852-a860-fb4610e04dbd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:51.780550 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2975ec8b-e7be-48e6-ad9b-ee97ba52ed3f req-03989d96-2c27-4852-a860-fb4610e04dbd service nova] Creating event network-changed:d8e7cec7-d8aa-4128-be58-f82d5f69707b for instance d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df on n-h2-764485-11 Jul 20 05:01:51.785687 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2975ec8b-e7be-48e6-ad9b-ee97ba52ed3f req-03989d96-2c27-4852-a860-fb4610e04dbd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031505 Jul 20 05:01:51.786298 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3342/6586] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:20.519243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a034181-2650-4616-9724-86a234a7dbe1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:20.519983 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a034181-2650-4616-9724-86a234a7dbe1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:20.522767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=28 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:20.523625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=58 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:20.530873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a034181-2650-4616-9724-86a234a7dbe1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:20.531357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a034181-2650-4616-9724-86a234a7dbe1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:20.532166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a034181-2650-4616-9724-86a234a7dbe1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:20.533118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a034181-2650-4616-9724-86a234a7dbe1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:20.675438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a034181-2650-4616-9724-86a234a7dbe1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:20.682948 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a034181-2650-4616-9724-86a234a7dbe1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1681 microversion: 2.1 time: 0.167941 Jul 20 05:02:20.683532 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3245/6587] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:20 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:20.778814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:20.779497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=56 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:20.784468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c3386c44-250e-4e85-9732-5f6ecbb159e5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:20.785475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c3386c44-250e-4e85-9732-5f6ecbb159e5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:20.792790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3386c44-250e-4e85-9732-5f6ecbb159e5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:20.793255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3386c44-250e-4e85-9732-5f6ecbb159e5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:20.794026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3386c44-250e-4e85-9732-5f6ecbb159e5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:20.794473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3386c44-250e-4e85-9732-5f6ecbb159e5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:20.843866 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c3386c44-250e-4e85-9732-5f6ecbb159e5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba/action" status: 200 len: 32644 microversion: 2.1 time: 0.066752 Jul 20 05:02:20.844797 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3343/6588] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:02:20 2022] POST /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba/action => generated 32644 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:02:21.009779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aa4873b0-a501-463e-bf2d-389baae7c125 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:21.010414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aa4873b0-a501-463e-bf2d-389baae7c125 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:21.016986 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa4873b0-a501-463e-bf2d-389baae7c125 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.017509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa4873b0-a501-463e-bf2d-389baae7c125 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.018284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa4873b0-a501-463e-bf2d-389baae7c125 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.018742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aa4873b0-a501-463e-bf2d-389baae7c125 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.150151 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aa4873b0-a501-463e-bf2d-389baae7c125 tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1834 microversion: 2.1 time: 0.144024 Jul 20 05:02:21.150729 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3246/6589] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:21 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1834 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:21.175519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16cec11a-9978-4556-b6f3-79c959c2d87b tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:21.176781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-16cec11a-9978-4556-b6f3-79c959c2d87b tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:21.184059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16cec11a-9978-4556-b6f3-79c959c2d87b tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.184528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16cec11a-9978-4556-b6f3-79c959c2d87b tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.185319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16cec11a-9978-4556-b6f3-79c959c2d87b tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.185773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16cec11a-9978-4556-b6f3-79c959c2d87b tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.211950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-16cec11a-9978-4556-b6f3-79c959c2d87b tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lazy-loading 'flavor' on Instance uuid 52d66b47-ae3a-47ce-942a-0bc0cfd151ba {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:02:21.224848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-16cec11a-9978-4556-b6f3-79c959c2d87b tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Going to try to live migrate instance to another host {{(pid=119808) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 05:02:22.486979 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-16cec11a-9978-4556-b6f3-79c959c2d87b tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba/action" status: 202 len: 0 microversion: 2.1 time: 1.316167 Jul 20 05:02:22.488197 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3344/6590] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:02:21 2022] POST /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba/action => generated 0 bytes in 1318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:02:22.498307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a8c0a61-0b6e-473d-9b73-bf2e62f1c847 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:22.499631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4a8c0a61-0b6e-473d-9b73-bf2e62f1c847 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:22.508373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a8c0a61-0b6e-473d-9b73-bf2e62f1c847 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:22.508834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a8c0a61-0b6e-473d-9b73-bf2e62f1c847 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:22.509614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a8c0a61-0b6e-473d-9b73-bf2e62f1c847 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:22.510057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a8c0a61-0b6e-473d-9b73-bf2e62f1c847 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:22.653175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a8c0a61-0b6e-473d-9b73-bf2e62f1c847 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:22.661597 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a8c0a61-0b6e-473d-9b73-bf2e62f1c847 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1691 microversion: 2.1 time: 0.168728 Jul 20 05:02:22.662193 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3247/6591] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:22 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:23.681712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-94c71d1c-a6e9-418a-82a3-3f2f74a3de9d req-6f8748c3-c561-43a8-9f4c-d00c3a25d538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d66b47-ae3a-47ce-942a-0bc0cfd151ba", "name": "network-vif-unplugged", "status": "completed", "tag": "82c7952c-3779-4cce-966b-191cda12ab0f"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:23.698288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cb4e53dc-5a12-49c2-a12a-761a9fdfc014 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:23.702421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-94c71d1c-a6e9-418a-82a3-3f2f74a3de9d req-6f8748c3-c561-43a8-9f4c-d00c3a25d538 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:23.702796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cb4e53dc-5a12-49c2-a12a-761a9fdfc014 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:23.702942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-94c71d1c-a6e9-418a-82a3-3f2f74a3de9d req-6f8748c3-c561-43a8-9f4c-d00c3a25d538 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:23.718523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb4e53dc-5a12-49c2-a12a-761a9fdfc014 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:23.719357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb4e53dc-5a12-49c2-a12a-761a9fdfc014 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:23.721905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb4e53dc-5a12-49c2-a12a-761a9fdfc014 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:23.722652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb4e53dc-5a12-49c2-a12a-761a9fdfc014 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:23.723803 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-94c71d1c-a6e9-418a-82a3-3f2f74a3de9d req-6f8748c3-c561-43a8-9f4c-d00c3a25d538 service nova] Creating event network-vif-unplugged:82c7952c-3779-4cce-966b-191cda12ab0f for instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba on n-h1-764485-11 Jul 20 05:02:23.732054 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-94c71d1c-a6e9-418a-82a3-3f2f74a3de9d req-6f8748c3-c561-43a8-9f4c-d00c3a25d538 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132360 Jul 20 05:02:23.733810 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3345/6592] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:23.931332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cb4e53dc-5a12-49c2-a12a-761a9fdfc014 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:23.940977 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cb4e53dc-5a12-49c2-a12a-761a9fdfc014 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1691 microversion: 2.1 time: 0.265089 Jul 20 05:02:23.941719 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3248/6593] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:23 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1691 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:24.959697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1dcbf6fb-89b8-431b-8a04-ea66fbec07f2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:24.960501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1dcbf6fb-89b8-431b-8a04-ea66fbec07f2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:24.966759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dcbf6fb-89b8-431b-8a04-ea66fbec07f2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:24.967220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dcbf6fb-89b8-431b-8a04-ea66fbec07f2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:24.968019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dcbf6fb-89b8-431b-8a04-ea66fbec07f2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:24.968470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1dcbf6fb-89b8-431b-8a04-ea66fbec07f2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:25.107200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1dcbf6fb-89b8-431b-8a04-ea66fbec07f2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:25.116969 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1dcbf6fb-89b8-431b-8a04-ea66fbec07f2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1691 microversion: 2.1 time: 0.162367 Jul 20 05:02:25.117558 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3346/6594] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:24 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:25.752658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c33eef7e-9adb-4ef5-84c5-e727575d8ca1 req-90fe662a-bcc2-4efa-b4cd-631ac57a564c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d66b47-ae3a-47ce-942a-0bc0cfd151ba", "tag": "82c7952c-3779-4cce-966b-191cda12ab0f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:25.762017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c33eef7e-9adb-4ef5-84c5-e727575d8ca1 req-90fe662a-bcc2-4efa-b4cd-631ac57a564c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:25.762408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c33eef7e-9adb-4ef5-84c5-e727575d8ca1 req-90fe662a-bcc2-4efa-b4cd-631ac57a564c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:25.773778 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c33eef7e-9adb-4ef5-84c5-e727575d8ca1 req-90fe662a-bcc2-4efa-b4cd-631ac57a564c service nova] Creating event network-changed:82c7952c-3779-4cce-966b-191cda12ab0f for instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba on n-h1-764485-11 Jul 20 05:02:25.778851 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c33eef7e-9adb-4ef5-84c5-e727575d8ca1 req-90fe662a-bcc2-4efa-b4cd-631ac57a564c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030362 Jul 20 05:02:25.779449 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3249/6595] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:26.134395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a0a455f5-d5a8-4700-bf84-ddf618981a07 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:26.135028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a0a455f5-d5a8-4700-bf84-ddf618981a07 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:26.141997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0a455f5-d5a8-4700-bf84-ddf618981a07 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:26.142474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0a455f5-d5a8-4700-bf84-ddf618981a07 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:26.144107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0a455f5-d5a8-4700-bf84-ddf618981a07 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:26.144583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0a455f5-d5a8-4700-bf84-ddf618981a07 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:26.357665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a0a455f5-d5a8-4700-bf84-ddf618981a07 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:26.366180 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a0a455f5-d5a8-4700-bf84-ddf618981a07 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1691 microversion: 2.1 time: 0.235711 Jul 20 05:02:26.366778 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3347/6596] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:26 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:27.385204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d8855e02-4e52-4deb-9e88-28b27126a064 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:27.385919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d8855e02-4e52-4deb-9e88-28b27126a064 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:27.392279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8855e02-4e52-4deb-9e88-28b27126a064 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:27.393297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8855e02-4e52-4deb-9e88-28b27126a064 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:27.394244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8855e02-4e52-4deb-9e88-28b27126a064 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:27.394693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d8855e02-4e52-4deb-9e88-28b27126a064 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:27.531136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d8855e02-4e52-4deb-9e88-28b27126a064 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:27.539639 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d8855e02-4e52-4deb-9e88-28b27126a064 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1691 microversion: 2.1 time: 0.159463 Jul 20 05:02:27.540244 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3250/6597] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:27 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:28.557432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-272b696e-2f67-413b-840b-5de48c5c3142 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:28.558059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-272b696e-2f67-413b-840b-5de48c5c3142 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:28.565639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-272b696e-2f67-413b-840b-5de48c5c3142 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:28.566111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-272b696e-2f67-413b-840b-5de48c5c3142 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:28.566884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-272b696e-2f67-413b-840b-5de48c5c3142 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:28.567335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-272b696e-2f67-413b-840b-5de48c5c3142 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:28.701618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-272b696e-2f67-413b-840b-5de48c5c3142 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:28.709711 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-272b696e-2f67-413b-840b-5de48c5c3142 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1691 microversion: 2.1 time: 0.156199 Jul 20 05:02:28.710289 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3348/6598] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:28 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:29.726413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-57966984-40fd-48fa-8be0-c8801b900d10 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:29.727029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-57966984-40fd-48fa-8be0-c8801b900d10 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:29.734178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57966984-40fd-48fa-8be0-c8801b900d10 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:29.734632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57966984-40fd-48fa-8be0-c8801b900d10 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:29.735394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57966984-40fd-48fa-8be0-c8801b900d10 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:29.735861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-57966984-40fd-48fa-8be0-c8801b900d10 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:29.869928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-57966984-40fd-48fa-8be0-c8801b900d10 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:29.878635 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-57966984-40fd-48fa-8be0-c8801b900d10 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1691 microversion: 2.1 time: 0.155997 Jul 20 05:02:29.879166 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3251/6599] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:29 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:30.898657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8dfe8808-fb42-4919-a1b0-5e0524c1dc70 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:30.899226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8dfe8808-fb42-4919-a1b0-5e0524c1dc70 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:30.906251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8dfe8808-fb42-4919-a1b0-5e0524c1dc70 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:30.906719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8dfe8808-fb42-4919-a1b0-5e0524c1dc70 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:30.907495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8dfe8808-fb42-4919-a1b0-5e0524c1dc70 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:30.907976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8dfe8808-fb42-4919-a1b0-5e0524c1dc70 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:31.315727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8dfe8808-fb42-4919-a1b0-5e0524c1dc70 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:31.323254 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8dfe8808-fb42-4919-a1b0-5e0524c1dc70 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1691 microversion: 2.1 time: 0.428576 Jul 20 05:02:31.323876 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3349/6600] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:30 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1691 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:32.341748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c4ce9c48-4035-4119-a80d-174169579327 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:32.342479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c4ce9c48-4035-4119-a80d-174169579327 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:32.352741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4ce9c48-4035-4119-a80d-174169579327 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:32.353656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4ce9c48-4035-4119-a80d-174169579327 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:32.354718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4ce9c48-4035-4119-a80d-174169579327 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:32.355502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4ce9c48-4035-4119-a80d-174169579327 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:32.613761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c4ce9c48-4035-4119-a80d-174169579327 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:32.622106 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c4ce9c48-4035-4119-a80d-174169579327 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1691 microversion: 2.1 time: 0.284970 Jul 20 05:02:32.622775 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3252/6601] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:32 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1691 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:32.726743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-b1583d43-3af7-411f-82b9-41ab1d9e4f93 req-917e206a-5bee-49a0-849a-b443c2d1de2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d66b47-ae3a-47ce-942a-0bc0cfd151ba", "name": "network-vif-unplugged", "status": "completed", "tag": "82c7952c-3779-4cce-966b-191cda12ab0f"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:32.737443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b1583d43-3af7-411f-82b9-41ab1d9e4f93 req-917e206a-5bee-49a0-849a-b443c2d1de2f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:32.737984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b1583d43-3af7-411f-82b9-41ab1d9e4f93 req-917e206a-5bee-49a0-849a-b443c2d1de2f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:32.752949 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-b1583d43-3af7-411f-82b9-41ab1d9e4f93 req-917e206a-5bee-49a0-849a-b443c2d1de2f service nova] Creating event network-vif-unplugged:82c7952c-3779-4cce-966b-191cda12ab0f for instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba on n-h1-764485-11 Jul 20 05:02:32.759536 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-b1583d43-3af7-411f-82b9-41ab1d9e4f93 req-917e206a-5bee-49a0-849a-b443c2d1de2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036973 Jul 20 05:02:32.760389 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3350/6602] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:33.640474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6bcff08c-fee4-4d0a-87f3-2959f19d04a8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:33.641287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6bcff08c-fee4-4d0a-87f3-2959f19d04a8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:33.650466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6bcff08c-fee4-4d0a-87f3-2959f19d04a8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:33.650923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6bcff08c-fee4-4d0a-87f3-2959f19d04a8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:33.651867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6bcff08c-fee4-4d0a-87f3-2959f19d04a8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:33.652399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6bcff08c-fee4-4d0a-87f3-2959f19d04a8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:33.926906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6bcff08c-fee4-4d0a-87f3-2959f19d04a8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:33.934599 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6bcff08c-fee4-4d0a-87f3-2959f19d04a8 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1691 microversion: 2.1 time: 0.298956 Jul 20 05:02:33.935284 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3253/6603] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:33 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1691 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:34.953019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e7a5d728-2f48-4ede-a046-79971420c0b3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:34.954000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e7a5d728-2f48-4ede-a046-79971420c0b3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:34.962074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7a5d728-2f48-4ede-a046-79971420c0b3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:34.962574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7a5d728-2f48-4ede-a046-79971420c0b3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:34.963413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7a5d728-2f48-4ede-a046-79971420c0b3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:34.963897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7a5d728-2f48-4ede-a046-79971420c0b3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:35.113780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e7a5d728-2f48-4ede-a046-79971420c0b3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:35.121294 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e7a5d728-2f48-4ede-a046-79971420c0b3 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1681 microversion: 2.1 time: 0.172737 Jul 20 05:02:35.121868 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3351/6604] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:34 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:35.137302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2eb6cfb9-e111-49ad-af2a-47879871b9fd tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:35.137913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2eb6cfb9-e111-49ad-af2a-47879871b9fd tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:35.145448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eb6cfb9-e111-49ad-af2a-47879871b9fd tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:35.145897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eb6cfb9-e111-49ad-af2a-47879871b9fd tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:35.146656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eb6cfb9-e111-49ad-af2a-47879871b9fd tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:35.147095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2eb6cfb9-e111-49ad-af2a-47879871b9fd tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:35.274816 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2eb6cfb9-e111-49ad-af2a-47879871b9fd tempest-TestNetworkAdvancedServerOps-235233384 tempest-TestNetworkAdvancedServerOps-235233384-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1834 microversion: 2.1 time: 0.141147 Jul 20 05:02:35.275393 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3254/6605] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:35 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1834 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:35.292406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-366a80ed-1b7a-4a31-aab7-2388f2013051 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:35.293037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-366a80ed-1b7a-4a31-aab7-2388f2013051 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:35.299011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-366a80ed-1b7a-4a31-aab7-2388f2013051 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:35.299477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-366a80ed-1b7a-4a31-aab7-2388f2013051 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:35.300992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-366a80ed-1b7a-4a31-aab7-2388f2013051 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:35.301856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-366a80ed-1b7a-4a31-aab7-2388f2013051 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:35.434897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-366a80ed-1b7a-4a31-aab7-2388f2013051 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:35.442810 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-366a80ed-1b7a-4a31-aab7-2388f2013051 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1681 microversion: 2.1 time: 0.154219 Jul 20 05:02:35.443397 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3352/6606] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:35 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:35.535852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9cada522-290f-44d3-aa34-1f33518f3403 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:35.536800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9cada522-290f-44d3-aa34-1f33518f3403 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:35.543217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9cada522-290f-44d3-aa34-1f33518f3403 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:35.543712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9cada522-290f-44d3-aa34-1f33518f3403 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:35.544470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9cada522-290f-44d3-aa34-1f33518f3403 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:35.544905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9cada522-290f-44d3-aa34-1f33518f3403 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:35.609186 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9cada522-290f-44d3-aa34-1f33518f3403 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba/action" status: 200 len: 38518 microversion: 2.1 time: 0.077620 Jul 20 05:02:35.609865 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3255/6607] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:02:35 2022] POST /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba/action => generated 38518 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:02:36.598768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dff1d1e7-ba21-4e52-8f8e-ddcfd06a160e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:36.599316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dff1d1e7-ba21-4e52-8f8e-ddcfd06a160e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:36.601389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-4d8efe0a-45fd-4a6a-81e9-e61a10079406 req-c1f3f4bc-b88d-4237-b60d-adbd8ba488e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d66b47-ae3a-47ce-942a-0bc0cfd151ba", "tag": "82c7952c-3779-4cce-966b-191cda12ab0f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:36.606556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dff1d1e7-ba21-4e52-8f8e-ddcfd06a160e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:36.607091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dff1d1e7-ba21-4e52-8f8e-ddcfd06a160e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:36.608253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dff1d1e7-ba21-4e52-8f8e-ddcfd06a160e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:36.608779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dff1d1e7-ba21-4e52-8f8e-ddcfd06a160e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:36.611659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4d8efe0a-45fd-4a6a-81e9-e61a10079406 req-c1f3f4bc-b88d-4237-b60d-adbd8ba488e7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:36.612280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4d8efe0a-45fd-4a6a-81e9-e61a10079406 req-c1f3f4bc-b88d-4237-b60d-adbd8ba488e7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:36.624800 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-4d8efe0a-45fd-4a6a-81e9-e61a10079406 req-c1f3f4bc-b88d-4237-b60d-adbd8ba488e7 service nova] Creating event network-changed:82c7952c-3779-4cce-966b-191cda12ab0f for instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba on n-h2-764485-11 Jul 20 05:02:36.630532 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-4d8efe0a-45fd-4a6a-81e9-e61a10079406 req-c1f3f4bc-b88d-4237-b60d-adbd8ba488e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033093 Jul 20 05:02:36.631854 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3256/6608] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:36.638454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dff1d1e7-ba21-4e52-8f8e-ddcfd06a160e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:02:36.736214 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dff1d1e7-ba21-4e52-8f8e-ddcfd06a160e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 204 len: 0 microversion: 2.1 time: 0.141558 Jul 20 05:02:36.738585 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3353/6609] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:02:36 2022] DELETE /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:02:36.749723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5a55240b-b53e-4205-ab0e-2b44049f6f97 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:36.750716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a55240b-b53e-4205-ab0e-2b44049f6f97 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:36.759111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a55240b-b53e-4205-ab0e-2b44049f6f97 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:36.759893 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a55240b-b53e-4205-ab0e-2b44049f6f97 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:36.760693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a55240b-b53e-4205-ab0e-2b44049f6f97 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:36.761168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a55240b-b53e-4205-ab0e-2b44049f6f97 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:36.944069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a55240b-b53e-4205-ab0e-2b44049f6f97 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:36.952015 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5a55240b-b53e-4205-ab0e-2b44049f6f97 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1687 microversion: 2.1 time: 0.208714 Jul 20 05:02:36.952597 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3257/6610] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:36 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1687 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:37.970846 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2c42eaab-640b-4bf6-ba4e-9bc35a096574 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:37.971591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2c42eaab-640b-4bf6-ba4e-9bc35a096574 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:37.979569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c42eaab-640b-4bf6-ba4e-9bc35a096574 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:37.980033 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c42eaab-640b-4bf6-ba4e-9bc35a096574 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:37.980920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c42eaab-640b-4bf6-ba4e-9bc35a096574 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:37.981302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c42eaab-640b-4bf6-ba4e-9bc35a096574 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:38.072144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c42eaab-640b-4bf6-ba4e-9bc35a096574 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:38.079796 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2c42eaab-640b-4bf6-ba4e-9bc35a096574 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 200 len: 1501 microversion: 2.1 time: 0.113202 Jul 20 05:02:38.080465 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3354/6611] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:37 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 1501 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:38.645728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8628638e-6ff1-4e85-b8a8-ac7f9f1b807e req-77f5ee31-818b-4834-a5de-631343504c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d66b47-ae3a-47ce-942a-0bc0cfd151ba", "name": "network-vif-deleted", "tag": "82c7952c-3779-4cce-966b-191cda12ab0f"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:38.654539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8628638e-6ff1-4e85-b8a8-ac7f9f1b807e req-77f5ee31-818b-4834-a5de-631343504c6e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:38.654977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8628638e-6ff1-4e85-b8a8-ac7f9f1b807e req-77f5ee31-818b-4834-a5de-631343504c6e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:38.665597 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8628638e-6ff1-4e85-b8a8-ac7f9f1b807e req-77f5ee31-818b-4834-a5de-631343504c6e service nova] Creating event network-vif-deleted:82c7952c-3779-4cce-966b-191cda12ab0f for instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba on n-h2-764485-11 Jul 20 05:02:38.670383 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8628638e-6ff1-4e85-b8a8-ac7f9f1b807e req-77f5ee31-818b-4834-a5de-631343504c6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028419 Jul 20 05:02:38.670963 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3258/6612] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:02:39.096700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-96666047-6069-449f-a062-5d92502ed35b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:39.097824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-96666047-6069-449f-a062-5d92502ed35b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 52d66b47-ae3a-47ce-942a-0bc0cfd151ba] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:39.104840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96666047-6069-449f-a062-5d92502ed35b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:39.105310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96666047-6069-449f-a062-5d92502ed35b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:39.106121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96666047-6069-449f-a062-5d92502ed35b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:39.106582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96666047-6069-449f-a062-5d92502ed35b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:39.120797 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-96666047-6069-449f-a062-5d92502ed35b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] HTTP exception thrown: Instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba could not be found. Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-96666047-6069-449f-a062-5d92502ed35b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Request method failure captured: Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba HTTP/1.1 Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14qdBDOgOgYg5zB0q-NFS0jh5lsDTaLj-U9nsFTm8jdjGqlHi0W5cg2emgaZEmvxVQ6kbGXvGI8KMmvElHEiPc36Hu2hoFkvZ5-WodujHlu0yefRGKPzNIjJu4QwHYLFjMjO2ShrBXapwPKwcCEPUdSNP8EqhhJ410t0rhba7uK9z2U Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 6bb3f1bf4a2347a2b78e539c9e8f2ee3 Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1261484027 Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6bb3f1bf4a2347a2b78e539c9e8f2ee3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6bb3f1bf4a2347a2b78e539c9e8f2ee3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6bb3f1bf4a2347a2b78e539c9e8f2ee3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6bb3f1bf4a2347a2b78e539c9e8f2ee3"}]}] Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1261484027 Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 6bb3f1bf4a2347a2b78e539c9e8f2ee3 Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1261484027 Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestNetworkAdvancedServerOps-1261484027-project Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 4f38aa28db214cc689fd1b5e02a62d67 Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1261484027-project Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba could not be found. Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '52d66b47-ae3a-47ce-942a-0bc0cfd151ba'} Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba could not be found. Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba could not be found. Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:02:39.122452 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:02:39.128024 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:02:39.128024 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:39.128024 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:02:39.128024 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:02:39.128024 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:02:39.128024 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:02:39.128024 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba could not be found. Jul 20 05:02:39.128024 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:02:39.128024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-96666047-6069-449f-a062-5d92502ed35b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Returning 404 to user: Instance 52d66b47-ae3a-47ce-942a-0bc0cfd151ba could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:02:39.128024 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-96666047-6069-449f-a062-5d92502ed35b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba" status: 404 len: 111 microversion: 2.1 time: 0.031105 Jul 20 05:02:39.128024 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3355/6613] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:39 2022] GET /compute/v2.1/servers/52d66b47-ae3a-47ce-942a-0bc0cfd151ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:02:42.558876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1b360d69-7aa6-4d68-930a-50d3dc083a7e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '.version_select at 0x7fbf9c0a30d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:42.585130 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1b360d69-7aa6-4d68-930a-50d3dc083a7e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-759945096" status: 202 len: 0 microversion: 2.1 time: 0.030682 Jul 20 05:02:42.602318 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3259/6614] 10.222.0.20 () {58 vars in 1280 bytes} [Wed Jul 20 05:02:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-759945096 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:02:42.621701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0ab41160-9f3c-4eed-a4f7-99e072bf23ba tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'create', calling method: .version_select at 0x7fbf9c04af70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1321535144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVCsSnwrsf74JXD6nqv6qf3ROHcDYLVNQ3inI9qBK0q5rFQGX3YdOn1po+CXjWFv0Ff2r4Ret//NUhFA7BmkIT2guFdjcjpK/ovG6kUywoRSW568/+w0EBPdOdGsrMpSA=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:42.640838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0ab41160-9f3c-4eed-a4f7-99e072bf23ba tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:02:42.648453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-0ab41160-9f3c-4eed-a4f7-99e072bf23ba tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for user 4f38aa28db214cc689fd1b5e02a62d67 and project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:02:42.677144 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0ab41160-9f3c-4eed-a4f7-99e072bf23ba tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.060658 Jul 20 05:02:42.682605 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3356/6615] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:02:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:48.199490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-194694082", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "f7a1b612-64bc-4838-ad05-87af13355249"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1321535144", "security_groups": [{"name": "tempest-secgroup-smoke-1377954941"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:48.325677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] validate_networks() for [('f7a1b612-64bc-4838-ad05-87af13355249', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:02:48.660486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=70 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:49.099672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:02:49.100107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:02:49.100784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:02:49.101204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:02:49.101632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:02:49.111388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:49.111998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:49.113493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:49.114534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:49.137881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:02:49.143645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Getting quotas for user 4f38aa28db214cc689fd1b5e02a62d67 and project 6bb3f1bf4a2347a2b78e539c9e8f2ee3. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:02:49.157971 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:02:49.161069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:02:49.210479 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2218b09-3250-4480-86c9-6de22fd3ab6b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.014933 Jul 20 05:02:49.215982 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3260/6616] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:02:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:02:49.225504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-298072ef-ec7e-4d55-ba75-031c47706a37 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:49.226314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-298072ef-ec7e-4d55-ba75-031c47706a37 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:49.241850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:49.298459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-298072ef-ec7e-4d55-ba75-031c47706a37 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:49.307059 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-298072ef-ec7e-4d55-ba75-031c47706a37 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1266 microversion: 2.1 time: 0.088868 Jul 20 05:02:49.307880 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3357/6617] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:49 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:50.334897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ea14425d-f778-4f22-b9c1-fbd7807b1fa5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:50.335693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ea14425d-f778-4f22-b9c1-fbd7807b1fa5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:50.343497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea14425d-f778-4f22-b9c1-fbd7807b1fa5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:50.344335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea14425d-f778-4f22-b9c1-fbd7807b1fa5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:50.345750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea14425d-f778-4f22-b9c1-fbd7807b1fa5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:50.346402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ea14425d-f778-4f22-b9c1-fbd7807b1fa5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:50.477448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ea14425d-f778-4f22-b9c1-fbd7807b1fa5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:50.485739 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ea14425d-f778-4f22-b9c1-fbd7807b1fa5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1336 microversion: 2.1 time: 0.165277 Jul 20 05:02:50.486795 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3261/6618] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:50 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1336 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:51.504876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c4d21ded-04be-4971-9b5b-ff89f5fe5ca5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:51.506153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c4d21ded-04be-4971-9b5b-ff89f5fe5ca5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:51.509135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:51.515368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4d21ded-04be-4971-9b5b-ff89f5fe5ca5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:51.516624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4d21ded-04be-4971-9b5b-ff89f5fe5ca5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:51.517635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4d21ded-04be-4971-9b5b-ff89f5fe5ca5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:51.518087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4d21ded-04be-4971-9b5b-ff89f5fe5ca5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:51.768064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c4d21ded-04be-4971-9b5b-ff89f5fe5ca5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:51.785544 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c4d21ded-04be-4971-9b5b-ff89f5fe5ca5 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1392 microversion: 2.1 time: 0.280449 Jul 20 05:02:51.786472 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3358/6619] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:51 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1392 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:51.938776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-bf35e9d8-6552-4b1a-a40c-2815362aab0f req-4a4443fe-ce7d-4f43-a224-f371b051b395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ff5e29-7fd5-4545-b70e-d4ce630b7971", "tag": "d0b1485a-237e-461c-9774-bf9645557d39"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:51.946241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:51.953506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-bf35e9d8-6552-4b1a-a40c-2815362aab0f req-4a4443fe-ce7d-4f43-a224-f371b051b395 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:51.954230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-bf35e9d8-6552-4b1a-a40c-2815362aab0f req-4a4443fe-ce7d-4f43-a224-f371b051b395 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:51.968086 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-bf35e9d8-6552-4b1a-a40c-2815362aab0f req-4a4443fe-ce7d-4f43-a224-f371b051b395 service nova] Creating event network-changed:d0b1485a-237e-461c-9774-bf9645557d39 for instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 on n-h1-764485-11 Jul 20 05:02:51.974643 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-bf35e9d8-6552-4b1a-a40c-2815362aab0f req-4a4443fe-ce7d-4f43-a224-f371b051b395 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039333 Jul 20 05:02:51.976039 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3262/6620] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:52.803322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6e58291b-67e1-4f89-b587-6d3293cfcd53 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:52.803978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6e58291b-67e1-4f89-b587-6d3293cfcd53 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:52.810980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e58291b-67e1-4f89-b587-6d3293cfcd53 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:52.811442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e58291b-67e1-4f89-b587-6d3293cfcd53 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:52.812250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e58291b-67e1-4f89-b587-6d3293cfcd53 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:52.812704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6e58291b-67e1-4f89-b587-6d3293cfcd53 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:52.944129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6e58291b-67e1-4f89-b587-6d3293cfcd53 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:52.951631 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6e58291b-67e1-4f89-b587-6d3293cfcd53 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1392 microversion: 2.1 time: 0.152905 Jul 20 05:02:52.952206 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3359/6621] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:52 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:53.969651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96feee19-1c35-469d-bf10-0181bd1e271b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:53.970274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96feee19-1c35-469d-bf10-0181bd1e271b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:53.976924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96feee19-1c35-469d-bf10-0181bd1e271b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:53.977376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96feee19-1c35-469d-bf10-0181bd1e271b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:53.978134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96feee19-1c35-469d-bf10-0181bd1e271b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:53.978571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96feee19-1c35-469d-bf10-0181bd1e271b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:54.113908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-96feee19-1c35-469d-bf10-0181bd1e271b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:54.121488 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-96feee19-1c35-469d-bf10-0181bd1e271b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1392 microversion: 2.1 time: 0.157015 Jul 20 05:02:54.122066 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3263/6622] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:53 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:55.138350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0cc7e17-217c-4eea-913e-9d1cb045db7b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:55.139167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b0cc7e17-217c-4eea-913e-9d1cb045db7b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:55.148504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0cc7e17-217c-4eea-913e-9d1cb045db7b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:55.148994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0cc7e17-217c-4eea-913e-9d1cb045db7b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:55.149812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0cc7e17-217c-4eea-913e-9d1cb045db7b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:55.150257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0cc7e17-217c-4eea-913e-9d1cb045db7b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:55.285705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b0cc7e17-217c-4eea-913e-9d1cb045db7b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:55.293307 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b0cc7e17-217c-4eea-913e-9d1cb045db7b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1392 microversion: 2.1 time: 0.158895 Jul 20 05:02:55.293906 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3360/6623] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:55 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:56.310305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac33d577-dd9f-425a-824d-85b8d4e5026b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:56.311020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac33d577-dd9f-425a-824d-85b8d4e5026b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:56.318247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac33d577-dd9f-425a-824d-85b8d4e5026b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:56.318757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac33d577-dd9f-425a-824d-85b8d4e5026b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:56.319591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac33d577-dd9f-425a-824d-85b8d4e5026b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:56.320209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac33d577-dd9f-425a-824d-85b8d4e5026b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:56.456414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ac33d577-dd9f-425a-824d-85b8d4e5026b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:56.463866 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ac33d577-dd9f-425a-824d-85b8d4e5026b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1392 microversion: 2.1 time: 0.157963 Jul 20 05:02:56.464441 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3264/6624] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:56 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:57.061584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-98f669a3-f788-41e7-8a72-ea0fabd31f15 req-e96f1294-8657-49d8-9aaf-4fbbb7a17107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ff5e29-7fd5-4545-b70e-d4ce630b7971", "name": "network-vif-plugged", "status": "completed", "tag": "d0b1485a-237e-461c-9774-bf9645557d39"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:57.071653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-98f669a3-f788-41e7-8a72-ea0fabd31f15 req-e96f1294-8657-49d8-9aaf-4fbbb7a17107 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:57.072110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-98f669a3-f788-41e7-8a72-ea0fabd31f15 req-e96f1294-8657-49d8-9aaf-4fbbb7a17107 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:57.084828 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-98f669a3-f788-41e7-8a72-ea0fabd31f15 req-e96f1294-8657-49d8-9aaf-4fbbb7a17107 service nova] Creating event network-vif-plugged:d0b1485a-237e-461c-9774-bf9645557d39 for instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 on n-h1-764485-11 Jul 20 05:02:57.089920 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-98f669a3-f788-41e7-8a72-ea0fabd31f15 req-e96f1294-8657-49d8-9aaf-4fbbb7a17107 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032155 Jul 20 05:02:57.090616 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3361/6625] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:57.480644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0cddfa6-44df-4315-acb9-0254a4fbfa2e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:57.481265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b0cddfa6-44df-4315-acb9-0254a4fbfa2e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:57.489288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0cddfa6-44df-4315-acb9-0254a4fbfa2e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:57.489972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0cddfa6-44df-4315-acb9-0254a4fbfa2e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:57.490866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0cddfa6-44df-4315-acb9-0254a4fbfa2e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:57.491489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0cddfa6-44df-4315-acb9-0254a4fbfa2e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:57.622117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b0cddfa6-44df-4315-acb9-0254a4fbfa2e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:57.630830 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0cddfa6-44df-4315-acb9-0254a4fbfa2e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1392 microversion: 2.1 time: 0.154113 Jul 20 05:02:57.631409 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3265/6626] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:57 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:58.649716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-098a02c1-601e-41c7-935e-e85d0a588a3d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:58.650426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-098a02c1-601e-41c7-935e-e85d0a588a3d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:58.656757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-098a02c1-601e-41c7-935e-e85d0a588a3d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:58.657219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-098a02c1-601e-41c7-935e-e85d0a588a3d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:58.658055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-098a02c1-601e-41c7-935e-e85d0a588a3d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:58.658485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-098a02c1-601e-41c7-935e-e85d0a588a3d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:58.792527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-098a02c1-601e-41c7-935e-e85d0a588a3d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:58.800801 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-098a02c1-601e-41c7-935e-e85d0a588a3d tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1565 microversion: 2.1 time: 0.156090 Jul 20 05:02:58.801379 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3362/6627] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:58 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:58.817330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-abb65fd4-760d-41a9-aac1-e4b392b0d57c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:58.817957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-abb65fd4-760d-41a9-aac1-e4b392b0d57c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:58.824880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abb65fd4-760d-41a9-aac1-e4b392b0d57c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:58.825331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abb65fd4-760d-41a9-aac1-e4b392b0d57c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:58.826098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abb65fd4-760d-41a9-aac1-e4b392b0d57c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:58.826538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abb65fd4-760d-41a9-aac1-e4b392b0d57c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:58.960059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-abb65fd4-760d-41a9-aac1-e4b392b0d57c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:58.967650 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-abb65fd4-760d-41a9-aac1-e4b392b0d57c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1565 microversion: 2.1 time: 0.154991 Jul 20 05:02:58.968590 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3266/6628] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:58 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:00.581902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74de1eac-185f-4ea3-90dd-a8c5aee1b35c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:00.582688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74de1eac-185f-4ea3-90dd-a8c5aee1b35c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:00.584257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d39de78d-6a32-4f9a-a577-30af0d5a74c6 req-d3a713cf-8aca-4d5e-845f-77e57ba1554d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ff5e29-7fd5-4545-b70e-d4ce630b7971", "tag": "d0b1485a-237e-461c-9774-bf9645557d39"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:00.585403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:00.588459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:00.589247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:00.595352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74de1eac-185f-4ea3-90dd-a8c5aee1b35c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:00.596285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74de1eac-185f-4ea3-90dd-a8c5aee1b35c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:00.597742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74de1eac-185f-4ea3-90dd-a8c5aee1b35c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:00.598587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74de1eac-185f-4ea3-90dd-a8c5aee1b35c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:00.598726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d39de78d-6a32-4f9a-a577-30af0d5a74c6 req-d3a713cf-8aca-4d5e-845f-77e57ba1554d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:00.599670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d39de78d-6a32-4f9a-a577-30af0d5a74c6 req-d3a713cf-8aca-4d5e-845f-77e57ba1554d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:00.616548 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d39de78d-6a32-4f9a-a577-30af0d5a74c6 req-d3a713cf-8aca-4d5e-845f-77e57ba1554d service nova] Creating event network-changed:d0b1485a-237e-461c-9774-bf9645557d39 for instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 on n-h1-764485-11 Jul 20 05:03:00.621912 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d39de78d-6a32-4f9a-a577-30af0d5a74c6 req-d3a713cf-8aca-4d5e-845f-77e57ba1554d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042705 Jul 20 05:03:00.623300 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3267/6629] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:01.194800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-74de1eac-185f-4ea3-90dd-a8c5aee1b35c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:01.205330 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74de1eac-185f-4ea3-90dd-a8c5aee1b35c tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1565 microversion: 2.1 time: 0.628259 Jul 20 05:03:01.206931 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3363/6630] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:00 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1565 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:22.386728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ce20d06-9660-4870-8e4a-60a691de8ab5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:22.387322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ce20d06-9660-4870-8e4a-60a691de8ab5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:22.388435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-374bb751-d130-4a59-821a-45a60c779c02 req-945a849b-3660-4953-a4a5-1c0df3dd64fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df", "tag": "d8e7cec7-d8aa-4128-be58-f82d5f69707b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:22.390786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=11 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:22.391631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=36 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:22.393869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=11 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:22.395229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=32 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:22.397610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ce20d06-9660-4870-8e4a-60a691de8ab5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:22.398277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ce20d06-9660-4870-8e4a-60a691de8ab5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:22.399265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ce20d06-9660-4870-8e4a-60a691de8ab5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:22.399414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ce20d06-9660-4870-8e4a-60a691de8ab5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:22.399545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-374bb751-d130-4a59-821a-45a60c779c02 req-945a849b-3660-4953-a4a5-1c0df3dd64fd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:22.399996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-374bb751-d130-4a59-821a-45a60c779c02 req-945a849b-3660-4953-a4a5-1c0df3dd64fd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:22.413291 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-374bb751-d130-4a59-821a-45a60c779c02 req-945a849b-3660-4953-a4a5-1c0df3dd64fd service nova] Creating event network-changed:d8e7cec7-d8aa-4128-be58-f82d5f69707b for instance d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df on n-h2-764485-11 Jul 20 05:03:22.418974 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-374bb751-d130-4a59-821a-45a60c779c02 req-945a849b-3660-4953-a4a5-1c0df3dd64fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034421 Jul 20 05:03:22.419815 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3364/6631] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:22.427879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ce20d06-9660-4870-8e4a-60a691de8ab5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:03:22.516439 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ce20d06-9660-4870-8e4a-60a691de8ab5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 204 len: 0 microversion: 2.1 time: 0.134126 Jul 20 05:03:22.517680 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3268/6632] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:03:22 2022] DELETE /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:03:22.529973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44b33040-a1e3-4e63-84e6-9e3b321278d3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:22.530824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44b33040-a1e3-4e63-84e6-9e3b321278d3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:22.538405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44b33040-a1e3-4e63-84e6-9e3b321278d3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:22.538880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44b33040-a1e3-4e63-84e6-9e3b321278d3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:22.539796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44b33040-a1e3-4e63-84e6-9e3b321278d3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:22.540245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44b33040-a1e3-4e63-84e6-9e3b321278d3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:22.715391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44b33040-a1e3-4e63-84e6-9e3b321278d3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:22.723582 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44b33040-a1e3-4e63-84e6-9e3b321278d3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1579 microversion: 2.1 time: 0.199973 Jul 20 05:03:22.724183 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3365/6633] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:22 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1579 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:23.743298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa520f8e-1cb2-4159-abfc-3fbfbb18f6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:23.744047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa520f8e-1cb2-4159-abfc-3fbfbb18f6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:23.751111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa520f8e-1cb2-4159-abfc-3fbfbb18f6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:23.751593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa520f8e-1cb2-4159-abfc-3fbfbb18f6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:23.752370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa520f8e-1cb2-4159-abfc-3fbfbb18f6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:23.752812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa520f8e-1cb2-4159-abfc-3fbfbb18f6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:23.933357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fa520f8e-1cb2-4159-abfc-3fbfbb18f6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:23.941542 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fa520f8e-1cb2-4159-abfc-3fbfbb18f6cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1579 microversion: 2.1 time: 0.201997 Jul 20 05:03:23.942130 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3269/6634] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:23 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1579 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:24.798525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-b2f675c7-1b19-40c6-a69b-3fb85d0dd4fa req-1afbd9f7-eacf-4c02-8eaa-4775e9218a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df", "name": "network-vif-deleted", "tag": "d8e7cec7-d8aa-4128-be58-f82d5f69707b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:24.810750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b2f675c7-1b19-40c6-a69b-3fb85d0dd4fa req-1afbd9f7-eacf-4c02-8eaa-4775e9218a73 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:24.811287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b2f675c7-1b19-40c6-a69b-3fb85d0dd4fa req-1afbd9f7-eacf-4c02-8eaa-4775e9218a73 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:24.823543 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-b2f675c7-1b19-40c6-a69b-3fb85d0dd4fa req-1afbd9f7-eacf-4c02-8eaa-4775e9218a73 service nova] Creating event network-vif-deleted:d8e7cec7-d8aa-4128-be58-f82d5f69707b for instance d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df on n-h2-764485-11 Jul 20 05:03:24.828756 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-b2f675c7-1b19-40c6-a69b-3fb85d0dd4fa req-1afbd9f7-eacf-4c02-8eaa-4775e9218a73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033778 Jul 20 05:03:24.829564 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3366/6635] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:24.959176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ddf0ac6c-85d2-4f99-934c-94d5aaa23ec8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:24.959835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ddf0ac6c-85d2-4f99-934c-94d5aaa23ec8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:24.966930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddf0ac6c-85d2-4f99-934c-94d5aaa23ec8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:24.967562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddf0ac6c-85d2-4f99-934c-94d5aaa23ec8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:24.968227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddf0ac6c-85d2-4f99-934c-94d5aaa23ec8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:24.968672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ddf0ac6c-85d2-4f99-934c-94d5aaa23ec8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:25.032465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ddf0ac6c-85d2-4f99-934c-94d5aaa23ec8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:25.040698 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ddf0ac6c-85d2-4f99-934c-94d5aaa23ec8 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1225 microversion: 2.1 time: 0.086369 Jul 20 05:03:25.041287 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3270/6636] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:24 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:26.059164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-68a08e01-00f4-426f-bb9e-1a97ae309c02 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:26.059909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-68a08e01-00f4-426f-bb9e-1a97ae309c02 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:26.066291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68a08e01-00f4-426f-bb9e-1a97ae309c02 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:26.067135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68a08e01-00f4-426f-bb9e-1a97ae309c02 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:26.067953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68a08e01-00f4-426f-bb9e-1a97ae309c02 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:26.068410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68a08e01-00f4-426f-bb9e-1a97ae309c02 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:26.137905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-68a08e01-00f4-426f-bb9e-1a97ae309c02 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:26.146697 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-68a08e01-00f4-426f-bb9e-1a97ae309c02 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1225 microversion: 2.1 time: 0.092679 Jul 20 05:03:26.147284 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3367/6637] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:26 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:27.164166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3bd7702f-7df5-4853-8800-fa944f7aedb5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:27.164787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3bd7702f-7df5-4853-8800-fa944f7aedb5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:27.172306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3bd7702f-7df5-4853-8800-fa944f7aedb5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:27.172804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3bd7702f-7df5-4853-8800-fa944f7aedb5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:27.173597 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3bd7702f-7df5-4853-8800-fa944f7aedb5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:27.174078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3bd7702f-7df5-4853-8800-fa944f7aedb5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:27.255558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3bd7702f-7df5-4853-8800-fa944f7aedb5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:27.266413 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3bd7702f-7df5-4853-8800-fa944f7aedb5 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1225 microversion: 2.1 time: 0.106507 Jul 20 05:03:27.267396 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3271/6638] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:27 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:28.284560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-589215e5-7d7d-41e6-8d80-014d76190f82 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:28.285221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-589215e5-7d7d-41e6-8d80-014d76190f82 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:28.292141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-589215e5-7d7d-41e6-8d80-014d76190f82 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:28.292602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-589215e5-7d7d-41e6-8d80-014d76190f82 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:28.293373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-589215e5-7d7d-41e6-8d80-014d76190f82 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:28.293822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-589215e5-7d7d-41e6-8d80-014d76190f82 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:28.358056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-589215e5-7d7d-41e6-8d80-014d76190f82 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:28.366746 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-589215e5-7d7d-41e6-8d80-014d76190f82 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1225 microversion: 2.1 time: 0.085983 Jul 20 05:03:28.367338 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3368/6639] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:28 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:29.383864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a7d9c6fd-be16-43b0-94aa-ced1ee38f892 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:29.384483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a7d9c6fd-be16-43b0-94aa-ced1ee38f892 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:29.391400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d9c6fd-be16-43b0-94aa-ced1ee38f892 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:29.391890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d9c6fd-be16-43b0-94aa-ced1ee38f892 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:29.392663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d9c6fd-be16-43b0-94aa-ced1ee38f892 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:29.393108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d9c6fd-be16-43b0-94aa-ced1ee38f892 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:29.430564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d9c6fd-be16-43b0-94aa-ced1ee38f892 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:29.431029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d9c6fd-be16-43b0-94aa-ced1ee38f892 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:29.431490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-a7d9c6fd-be16-43b0-94aa-ced1ee38f892 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lazy-loading 'fault' on Instance uuid d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:03:29.472430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a7d9c6fd-be16-43b0-94aa-ced1ee38f892 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:29.482071 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a7d9c6fd-be16-43b0-94aa-ced1ee38f892 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 200 len: 1230 microversion: 2.1 time: 0.102204 Jul 20 05:03:29.482686 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3272/6640] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:29 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:30.501207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ce274098-45ff-4d6e-b2c7-91e8f9c92e4b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:30.501800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ce274098-45ff-4d6e-b2c7-91e8f9c92e4b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:30.509563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce274098-45ff-4d6e-b2c7-91e8f9c92e4b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:30.510032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce274098-45ff-4d6e-b2c7-91e8f9c92e4b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:30.510839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce274098-45ff-4d6e-b2c7-91e8f9c92e4b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:30.511293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce274098-45ff-4d6e-b2c7-91e8f9c92e4b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:30.524563 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-ce274098-45ff-4d6e-b2c7-91e8f9c92e4b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df could not be found. Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ce274098-45ff-4d6e-b2c7-91e8f9c92e4b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df HTTP/1.1 Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df could not be found. Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'd6b946d6-11f7-4435-8ff0-cb2d9ba7a4df'} Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df could not be found. Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df could not be found. Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:30.526258 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:30.531326 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:30.531326 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:30.531326 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:30.531326 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:03:30.531326 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:03:30.531326 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df could not be found. Jul 20 05:03:30.531326 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:30.531326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ce274098-45ff-4d6e-b2c7-91e8f9c92e4b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:03:30.531326 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ce274098-45ff-4d6e-b2c7-91e8f9c92e4b tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df" status: 404 len: 111 microversion: 2.1 time: 0.030761 Jul 20 05:03:30.531326 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3369/6641] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:30 2022] GET /compute/v2.1/servers/d6b946d6-11f7-4435-8ff0-cb2d9ba7a4df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:03:36.526580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-365cafdc-1f8f-465d-8723-a088d476fb34 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:36.527600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-365cafdc-1f8f-465d-8723-a088d476fb34 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:36.534525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-365cafdc-1f8f-465d-8723-a088d476fb34 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:36.534985 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-365cafdc-1f8f-465d-8723-a088d476fb34 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:36.535802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-365cafdc-1f8f-465d-8723-a088d476fb34 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:36.536251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-365cafdc-1f8f-465d-8723-a088d476fb34 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:36.591941 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-365cafdc-1f8f-465d-8723-a088d476fb34 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971/action" status: 200 len: 24568 microversion: 2.1 time: 0.069023 Jul 20 05:03:36.592768 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3273/6642] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:03:36 2022] POST /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971/action => generated 24568 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:03:36.737238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d95b7ff-f5fe-4d82-9adb-a2763634ac0e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:36.737764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5d95b7ff-f5fe-4d82-9adb-a2763634ac0e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:36.739613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-378a99a1-4bd0-4015-91f3-cd7e6719e2b0 req-ed778300-7342-4e9b-98ca-62d8a24488a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f112b5d7-5d47-49a2-bf21-1573a24ba557", "tag": "4200d826-ce6a-496a-a01f-1493e33a4c0b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:36.746160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d95b7ff-f5fe-4d82-9adb-a2763634ac0e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:36.746622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d95b7ff-f5fe-4d82-9adb-a2763634ac0e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:36.747404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d95b7ff-f5fe-4d82-9adb-a2763634ac0e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:36.747956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d95b7ff-f5fe-4d82-9adb-a2763634ac0e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:36.749829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-378a99a1-4bd0-4015-91f3-cd7e6719e2b0 req-ed778300-7342-4e9b-98ca-62d8a24488a6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:36.750370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-378a99a1-4bd0-4015-91f3-cd7e6719e2b0 req-ed778300-7342-4e9b-98ca-62d8a24488a6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:36.765532 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-378a99a1-4bd0-4015-91f3-cd7e6719e2b0 req-ed778300-7342-4e9b-98ca-62d8a24488a6 service nova] Creating event network-changed:4200d826-ce6a-496a-a01f-1493e33a4c0b for instance f112b5d7-5d47-49a2-bf21-1573a24ba557 on n-h2-764485-11 Jul 20 05:03:36.770707 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-378a99a1-4bd0-4015-91f3-cd7e6719e2b0 req-ed778300-7342-4e9b-98ca-62d8a24488a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035230 Jul 20 05:03:36.772523 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3274/6643] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:03:36.776587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5d95b7ff-f5fe-4d82-9adb-a2763634ac0e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:03:36.862925 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5d95b7ff-f5fe-4d82-9adb-a2763634ac0e tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 204 len: 0 microversion: 2.1 time: 0.129772 Jul 20 05:03:36.864149 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3370/6644] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:03:36 2022] DELETE /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:03:36.875489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6c9bf7c8-23c4-464c-b328-5205beda3f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:36.876594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6c9bf7c8-23c4-464c-b328-5205beda3f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:36.885736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c9bf7c8-23c4-464c-b328-5205beda3f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:36.886466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c9bf7c8-23c4-464c-b328-5205beda3f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:36.887391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c9bf7c8-23c4-464c-b328-5205beda3f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:36.887913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c9bf7c8-23c4-464c-b328-5205beda3f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:37.052837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6c9bf7c8-23c4-464c-b328-5205beda3f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:37.060829 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6c9bf7c8-23c4-464c-b328-5205beda3f22 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1580 microversion: 2.1 time: 0.192355 Jul 20 05:03:37.061414 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3275/6645] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:36 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1580 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:38.080211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-75b68653-e953-4f1b-98d7-7fb4749af419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:38.080939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-75b68653-e953-4f1b-98d7-7fb4749af419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:38.088058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75b68653-e953-4f1b-98d7-7fb4749af419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:38.088531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75b68653-e953-4f1b-98d7-7fb4749af419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:38.089324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75b68653-e953-4f1b-98d7-7fb4749af419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:38.089782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75b68653-e953-4f1b-98d7-7fb4749af419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:38.241221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-75b68653-e953-4f1b-98d7-7fb4749af419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:38.248885 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-75b68653-e953-4f1b-98d7-7fb4749af419 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1580 microversion: 2.1 time: 0.173155 Jul 20 05:03:38.249402 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3371/6646] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:38 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1580 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:39.033470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-0f97f754-93c2-48b7-bdd9-7f2ff47bd4bf req-6d76c974-5af9-40f0-a49d-6aa16e115cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f112b5d7-5d47-49a2-bf21-1573a24ba557", "name": "network-vif-deleted", "tag": "4200d826-ce6a-496a-a01f-1493e33a4c0b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:39.045878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0f97f754-93c2-48b7-bdd9-7f2ff47bd4bf req-6d76c974-5af9-40f0-a49d-6aa16e115cd6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:39.046329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-0f97f754-93c2-48b7-bdd9-7f2ff47bd4bf req-6d76c974-5af9-40f0-a49d-6aa16e115cd6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:39.059046 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-0f97f754-93c2-48b7-bdd9-7f2ff47bd4bf req-6d76c974-5af9-40f0-a49d-6aa16e115cd6 service nova] Creating event network-vif-deleted:4200d826-ce6a-496a-a01f-1493e33a4c0b for instance f112b5d7-5d47-49a2-bf21-1573a24ba557 on n-h2-764485-11 Jul 20 05:03:39.065065 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-0f97f754-93c2-48b7-bdd9-7f2ff47bd4bf req-6d76c974-5af9-40f0-a49d-6aa16e115cd6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035284 Jul 20 05:03:39.066799 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3276/6647] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:39.266325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c9f8e61-1498-408a-943e-eb53a7598d15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:39.267111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0c9f8e61-1498-408a-943e-eb53a7598d15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:39.274286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c9f8e61-1498-408a-943e-eb53a7598d15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:39.274772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c9f8e61-1498-408a-943e-eb53a7598d15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:39.275602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c9f8e61-1498-408a-943e-eb53a7598d15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:39.276065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c9f8e61-1498-408a-943e-eb53a7598d15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:39.348965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0c9f8e61-1498-408a-943e-eb53a7598d15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:39.358699 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0c9f8e61-1498-408a-943e-eb53a7598d15 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1226 microversion: 2.1 time: 0.096003 Jul 20 05:03:39.359583 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3372/6648] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:39 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:03:40.378312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bf57fc01-648d-44f9-b174-11ce465700f1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:40.379013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bf57fc01-648d-44f9-b174-11ce465700f1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:40.386072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf57fc01-648d-44f9-b174-11ce465700f1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:40.386519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf57fc01-648d-44f9-b174-11ce465700f1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:40.387280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf57fc01-648d-44f9-b174-11ce465700f1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:40.387747 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf57fc01-648d-44f9-b174-11ce465700f1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:40.451670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bf57fc01-648d-44f9-b174-11ce465700f1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:40.459975 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bf57fc01-648d-44f9-b174-11ce465700f1 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1226 microversion: 2.1 time: 0.086178 Jul 20 05:03:40.460554 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3277/6649] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:40 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:41.478245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c4b71182-bead-45b0-9060-1fdce6c4a39c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:41.478876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c4b71182-bead-45b0-9060-1fdce6c4a39c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:41.486517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b71182-bead-45b0-9060-1fdce6c4a39c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:41.486984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b71182-bead-45b0-9060-1fdce6c4a39c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:41.487820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b71182-bead-45b0-9060-1fdce6c4a39c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:41.488277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c4b71182-bead-45b0-9060-1fdce6c4a39c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:41.561408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c4b71182-bead-45b0-9060-1fdce6c4a39c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:41.570271 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c4b71182-bead-45b0-9060-1fdce6c4a39c tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1226 microversion: 2.1 time: 0.096681 Jul 20 05:03:41.570865 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3373/6650] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:41 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:42.588548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c36e702-0d0d-49da-990c-22b1a292cce3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:42.589287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4c36e702-0d0d-49da-990c-22b1a292cce3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:42.596245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c36e702-0d0d-49da-990c-22b1a292cce3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:42.596696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c36e702-0d0d-49da-990c-22b1a292cce3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:42.597480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c36e702-0d0d-49da-990c-22b1a292cce3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:42.597914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4c36e702-0d0d-49da-990c-22b1a292cce3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:42.661236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4c36e702-0d0d-49da-990c-22b1a292cce3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f70af961f624dceba390cb44ef2a792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a157c449be9441eaa953dc3bb9c0ecfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:42.669517 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4c36e702-0d0d-49da-990c-22b1a292cce3 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 200 len: 1226 microversion: 2.1 time: 0.085778 Jul 20 05:03:42.670140 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3278/6651] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:42 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:43.686138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6cb9a55a-9000-4933-907a-719b7b916481 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:43.686761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6cb9a55a-9000-4933-907a-719b7b916481 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: f112b5d7-5d47-49a2-bf21-1573a24ba557] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:43.696624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6cb9a55a-9000-4933-907a-719b7b916481 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:43.697092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6cb9a55a-9000-4933-907a-719b7b916481 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:43.697884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6cb9a55a-9000-4933-907a-719b7b916481 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:43.698361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6cb9a55a-9000-4933-907a-719b7b916481 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:43.714623 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-6cb9a55a-9000-4933-907a-719b7b916481 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance f112b5d7-5d47-49a2-bf21-1573a24ba557 could not be found. Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6cb9a55a-9000-4933-907a-719b7b916481 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 HTTP/1.1 Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance f112b5d7-5d47-49a2-bf21-1573a24ba557 could not be found. Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'f112b5d7-5d47-49a2-bf21-1573a24ba557'} Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f112b5d7-5d47-49a2-bf21-1573a24ba557 could not be found. Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f112b5d7-5d47-49a2-bf21-1573a24ba557 could not be found. Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:43.716372 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:43.721577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:43.721577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:43.721577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:43.721577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:03:43.721577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:03:43.721577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f112b5d7-5d47-49a2-bf21-1573a24ba557 could not be found. Jul 20 05:03:43.721577 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:43.721577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6cb9a55a-9000-4933-907a-719b7b916481 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance f112b5d7-5d47-49a2-bf21-1573a24ba557 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:03:43.721577 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6cb9a55a-9000-4933-907a-719b7b916481 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557" status: 404 len: 111 microversion: 2.1 time: 0.035536 Jul 20 05:03:43.721577 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3374/6652] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:43 2022] GET /compute/v2.1/servers/f112b5d7-5d47-49a2-bf21-1573a24ba557 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:03:44.176655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c96e2fc7-e768-4b57-b13f-f63e2169acc0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:44.177187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c96e2fc7-e768-4b57-b13f-f63e2169acc0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:44.184841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c96e2fc7-e768-4b57-b13f-f63e2169acc0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:44.185297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c96e2fc7-e768-4b57-b13f-f63e2169acc0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:44.186068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c96e2fc7-e768-4b57-b13f-f63e2169acc0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:44.186515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c96e2fc7-e768-4b57-b13f-f63e2169acc0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:44.200631 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-c96e2fc7-e768-4b57-b13f-f63e2169acc0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c96e2fc7-e768-4b57-b13f-f63e2169acc0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 HTTP/1.1 Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5'} Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:03:44.202325 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c96e2fc7-e768-4b57-b13f-f63e2169acc0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c96e2fc7-e768-4b57-b13f-f63e2169acc0 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 404 len: 111 microversion: 2.1 time: 0.031047 Jul 20 05:03:44.207173 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3279/6653] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:03:44 2022] DELETE /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:03:44.213338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1679007f-9d40-42cb-ade2-2dfc4e80d3cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:44.213977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1679007f-9d40-42cb-ade2-2dfc4e80d3cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] [instance: ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:44.220077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1679007f-9d40-42cb-ade2-2dfc4e80d3cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:44.220548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1679007f-9d40-42cb-ade2-2dfc4e80d3cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:44.221323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1679007f-9d40-42cb-ade2-2dfc4e80d3cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:44.221779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1679007f-9d40-42cb-ade2-2dfc4e80d3cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:44.235955 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-1679007f-9d40-42cb-ade2-2dfc4e80d3cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] HTTP exception thrown: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1679007f-9d40-42cb-ade2-2dfc4e80d3cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Request method failure captured: Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 HTTP/1.1 Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14o9k1faRiZ56FdaaoIHvPSAJRsRUd5PPYkN1zqYen_9XSq9mltOW6w-qu29kz2jbpdErmjZclNF2xCTDMCD9JcPEPAg-nO835IoPJWndeD4qxqALczyBPOdWZgEtDwFOqYPsg9DOl6bluIbdKWqvHpUYWrIl7eglYKg6EcBXTu6VHU Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a157c449be9441eaa953dc3bb9c0ecfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a157c449be9441eaa953dc3bb9c0ecfc"}]}] Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestVolumeBootPattern-164274877 Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: a157c449be9441eaa953dc3bb9c0ecfc Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestVolumeBootPattern-164274877 Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestVolumeBootPattern-164274877-project Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 1f70af961f624dceba390cb44ef2a792 Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestVolumeBootPattern-164274877-project Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5'} Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:44.237510 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:44.243427 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:44.243427 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:44.243427 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:44.243427 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:03:44.243427 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:03:44.243427 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. Jul 20 05:03:44.243427 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:03:44.243427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1679007f-9d40-42cb-ade2-2dfc4e80d3cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Returning 404 to user: Instance ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:03:44.243427 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1679007f-9d40-42cb-ade2-2dfc4e80d3cc tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5" status: 404 len: 111 microversion: 2.1 time: 0.030325 Jul 20 05:03:44.243427 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3375/6654] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:44 2022] GET /compute/v2.1/servers/ab5e77dc-f11a-48c9-98fb-4f104f3a7dd5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:03:47.652435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5dc607b2-5630-44e2-b70b-f76a843366d4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] Calling method '.version_select at 0x7fbf9c0d9ee0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:47.673648 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5dc607b2-5630-44e2-b70b-f76a843366d4 tempest-TestVolumeBootPattern-164274877 tempest-TestVolumeBootPattern-164274877-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1146711925" status: 202 len: 0 microversion: 2.1 time: 0.025337 Jul 20 05:03:47.674241 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3280/6655] 10.222.0.20 () {58 vars in 1262 bytes} [Wed Jul 20 05:03:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1146711925 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:04:15.371333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:15.372811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:15.375324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:15.376036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:15.382799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:15.383268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:15.384084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:15.384539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:15.465538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:04:15.466094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:04:15.466483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:04:15.466912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:04:15.467346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:04:15.528120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:15.534364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:15.534853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:15.535680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:15.536147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:15.565132 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-01a856fc-4b2e-4cfc-8b0e-e9f7e186cdd1 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971/action" status: 202 len: 1138 microversion: 2.1 time: 0.197737 Jul 20 05:04:15.565788 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3376/6656] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:04:15 2022] POST /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971/action => generated 1138 bytes in 199 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 05:04:15.579803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:15.580689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:15.586053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe8e65bf-c3a7-4642-b2e6-a48c0e43ceff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:15.586672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe8e65bf-c3a7-4642-b2e6-a48c0e43ceff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:15.595013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe8e65bf-c3a7-4642-b2e6-a48c0e43ceff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:15.595476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe8e65bf-c3a7-4642-b2e6-a48c0e43ceff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:15.596571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe8e65bf-c3a7-4642-b2e6-a48c0e43ceff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:15.597106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe8e65bf-c3a7-4642-b2e6-a48c0e43ceff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:15.739749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe8e65bf-c3a7-4642-b2e6-a48c0e43ceff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:15.747816 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe8e65bf-c3a7-4642-b2e6-a48c0e43ceff tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1693 microversion: 2.1 time: 0.171163 Jul 20 05:04:15.748390 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3281/6657] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:15 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:16.765498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c8a10275-b789-4699-aa1d-4127f3cc92a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:16.766124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c8a10275-b789-4699-aa1d-4127f3cc92a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:16.773758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8a10275-b789-4699-aa1d-4127f3cc92a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:16.774214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8a10275-b789-4699-aa1d-4127f3cc92a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:16.774984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8a10275-b789-4699-aa1d-4127f3cc92a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:16.775432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8a10275-b789-4699-aa1d-4127f3cc92a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:16.911630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c8a10275-b789-4699-aa1d-4127f3cc92a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:16.919765 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c8a10275-b789-4699-aa1d-4127f3cc92a2 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1693 microversion: 2.1 time: 0.158156 Jul 20 05:04:16.920346 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3377/6658] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:16 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:17.937136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-826c26db-89fd-40be-ba3b-562b8f350c06 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:17.937704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-826c26db-89fd-40be-ba3b-562b8f350c06 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:17.944639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-826c26db-89fd-40be-ba3b-562b8f350c06 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:17.945098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-826c26db-89fd-40be-ba3b-562b8f350c06 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:17.945878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-826c26db-89fd-40be-ba3b-562b8f350c06 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:17.946325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-826c26db-89fd-40be-ba3b-562b8f350c06 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:18.080794 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-826c26db-89fd-40be-ba3b-562b8f350c06 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:18.089024 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-826c26db-89fd-40be-ba3b-562b8f350c06 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1693 microversion: 2.1 time: 0.155893 Jul 20 05:04:18.089613 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3282/6659] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:17 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:19.106535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f1d6a384-02bc-43de-92fb-b0b96af9710f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:19.107157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f1d6a384-02bc-43de-92fb-b0b96af9710f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:19.114300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1d6a384-02bc-43de-92fb-b0b96af9710f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:19.114759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1d6a384-02bc-43de-92fb-b0b96af9710f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:19.115666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1d6a384-02bc-43de-92fb-b0b96af9710f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:19.116099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1d6a384-02bc-43de-92fb-b0b96af9710f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:19.249988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f1d6a384-02bc-43de-92fb-b0b96af9710f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:19.257743 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f1d6a384-02bc-43de-92fb-b0b96af9710f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1693 microversion: 2.1 time: 0.155064 Jul 20 05:04:19.258316 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3378/6660] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:19 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:20.274916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-89de3382-1abf-41bc-8b0a-e0a4493d6512 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:20.275554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-89de3382-1abf-41bc-8b0a-e0a4493d6512 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:20.282705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89de3382-1abf-41bc-8b0a-e0a4493d6512 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:20.283160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89de3382-1abf-41bc-8b0a-e0a4493d6512 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:20.283965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89de3382-1abf-41bc-8b0a-e0a4493d6512 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:20.284410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-89de3382-1abf-41bc-8b0a-e0a4493d6512 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:20.419599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-89de3382-1abf-41bc-8b0a-e0a4493d6512 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:20.427190 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-89de3382-1abf-41bc-8b0a-e0a4493d6512 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1693 microversion: 2.1 time: 0.156859 Jul 20 05:04:20.428568 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3283/6661] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:20 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:21.445922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-20450121-abd8-4ed7-aff2-e7924a3e7d8b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:21.446480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-20450121-abd8-4ed7-aff2-e7924a3e7d8b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:21.453357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20450121-abd8-4ed7-aff2-e7924a3e7d8b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:21.453817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20450121-abd8-4ed7-aff2-e7924a3e7d8b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:21.454590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20450121-abd8-4ed7-aff2-e7924a3e7d8b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:21.455042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-20450121-abd8-4ed7-aff2-e7924a3e7d8b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:21.590253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-20450121-abd8-4ed7-aff2-e7924a3e7d8b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:21.598043 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-20450121-abd8-4ed7-aff2-e7924a3e7d8b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1693 microversion: 2.1 time: 0.156982 Jul 20 05:04:21.598623 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3379/6662] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:21 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:22.615717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3fe9a1b0-5618-4703-aede-d6dd39fb6187 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:22.616341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3fe9a1b0-5618-4703-aede-d6dd39fb6187 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:22.623235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fe9a1b0-5618-4703-aede-d6dd39fb6187 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:22.623725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fe9a1b0-5618-4703-aede-d6dd39fb6187 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:22.624491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fe9a1b0-5618-4703-aede-d6dd39fb6187 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:22.624933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fe9a1b0-5618-4703-aede-d6dd39fb6187 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:22.762653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3fe9a1b0-5618-4703-aede-d6dd39fb6187 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:22.770246 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3fe9a1b0-5618-4703-aede-d6dd39fb6187 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1693 microversion: 2.1 time: 0.158618 Jul 20 05:04:22.770829 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3284/6663] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:22 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:23.788256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8aef0394-e3e7-48bd-a5fe-42c3766a3ad9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:23.788888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8aef0394-e3e7-48bd-a5fe-42c3766a3ad9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:23.796148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8aef0394-e3e7-48bd-a5fe-42c3766a3ad9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:23.796612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8aef0394-e3e7-48bd-a5fe-42c3766a3ad9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:23.797383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8aef0394-e3e7-48bd-a5fe-42c3766a3ad9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:23.797831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8aef0394-e3e7-48bd-a5fe-42c3766a3ad9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:23.929056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8aef0394-e3e7-48bd-a5fe-42c3766a3ad9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:23.936689 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8aef0394-e3e7-48bd-a5fe-42c3766a3ad9 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1693 microversion: 2.1 time: 0.153075 Jul 20 05:04:23.937200 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3380/6664] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:23 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:24.954379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-063a97d9-ccd6-42cd-8ea0-a270a5cac939 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:24.954955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-063a97d9-ccd6-42cd-8ea0-a270a5cac939 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:24.962590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-063a97d9-ccd6-42cd-8ea0-a270a5cac939 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:24.963046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-063a97d9-ccd6-42cd-8ea0-a270a5cac939 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:24.963857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-063a97d9-ccd6-42cd-8ea0-a270a5cac939 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:24.964301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-063a97d9-ccd6-42cd-8ea0-a270a5cac939 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:25.100709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-063a97d9-ccd6-42cd-8ea0-a270a5cac939 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:25.108323 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-063a97d9-ccd6-42cd-8ea0-a270a5cac939 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1693 microversion: 2.1 time: 0.157898 Jul 20 05:04:25.109175 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3285/6665] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:24 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:26.126166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d48c8e7c-37a9-4ba0-a4bc-19ff281a312b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:26.126805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d48c8e7c-37a9-4ba0-a4bc-19ff281a312b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:26.134423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d48c8e7c-37a9-4ba0-a4bc-19ff281a312b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:26.134945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d48c8e7c-37a9-4ba0-a4bc-19ff281a312b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:26.135777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d48c8e7c-37a9-4ba0-a4bc-19ff281a312b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:26.136241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d48c8e7c-37a9-4ba0-a4bc-19ff281a312b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:26.269271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d48c8e7c-37a9-4ba0-a4bc-19ff281a312b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:26.277607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d48c8e7c-37a9-4ba0-a4bc-19ff281a312b tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1693 microversion: 2.1 time: 0.155363 Jul 20 05:04:26.278188 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3381/6666] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:26 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:27.294343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa25f83c-37ec-4ac0-9f21-dc2f47839b38 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:27.294937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa25f83c-37ec-4ac0-9f21-dc2f47839b38 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:27.303978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa25f83c-37ec-4ac0-9f21-dc2f47839b38 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:27.304513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa25f83c-37ec-4ac0-9f21-dc2f47839b38 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:27.305168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa25f83c-37ec-4ac0-9f21-dc2f47839b38 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:27.305607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa25f83c-37ec-4ac0-9f21-dc2f47839b38 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:27.445800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fa25f83c-37ec-4ac0-9f21-dc2f47839b38 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:27.453575 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fa25f83c-37ec-4ac0-9f21-dc2f47839b38 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1699 microversion: 2.1 time: 0.163062 Jul 20 05:04:27.454158 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3286/6667] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:27 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1699 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:28.471626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d7d2a64-b8be-4c11-a552-5cf3d6f0f378 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:28.472190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d7d2a64-b8be-4c11-a552-5cf3d6f0f378 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:28.479182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d7d2a64-b8be-4c11-a552-5cf3d6f0f378 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:28.479684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d7d2a64-b8be-4c11-a552-5cf3d6f0f378 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:28.480452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d7d2a64-b8be-4c11-a552-5cf3d6f0f378 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:28.480907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d7d2a64-b8be-4c11-a552-5cf3d6f0f378 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:28.625273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2d7d2a64-b8be-4c11-a552-5cf3d6f0f378 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:28.633645 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d7d2a64-b8be-4c11-a552-5cf3d6f0f378 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1699 microversion: 2.1 time: 0.166068 Jul 20 05:04:28.634224 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3382/6668] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:28 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1699 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:29.650907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-64d4bbfc-9351-40b8-ace9-96d2ae03b78f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:29.651538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-64d4bbfc-9351-40b8-ace9-96d2ae03b78f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:29.658539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64d4bbfc-9351-40b8-ace9-96d2ae03b78f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:29.658991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64d4bbfc-9351-40b8-ace9-96d2ae03b78f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:29.659782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64d4bbfc-9351-40b8-ace9-96d2ae03b78f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:29.660235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64d4bbfc-9351-40b8-ace9-96d2ae03b78f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:29.793564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-64d4bbfc-9351-40b8-ace9-96d2ae03b78f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:29.801379 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-64d4bbfc-9351-40b8-ace9-96d2ae03b78f tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1699 microversion: 2.1 time: 0.154329 Jul 20 05:04:29.801971 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3287/6669] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:29 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:30.819788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4cc3335c-bdee-49cb-ad83-de2a148f2839 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:30.820428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4cc3335c-bdee-49cb-ad83-de2a148f2839 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:30.827439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cc3335c-bdee-49cb-ad83-de2a148f2839 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:30.827943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cc3335c-bdee-49cb-ad83-de2a148f2839 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:30.828728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cc3335c-bdee-49cb-ad83-de2a148f2839 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:30.829190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cc3335c-bdee-49cb-ad83-de2a148f2839 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:30.957934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4cc3335c-bdee-49cb-ad83-de2a148f2839 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:30.966053 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4cc3335c-bdee-49cb-ad83-de2a148f2839 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1699 microversion: 2.1 time: 0.150252 Jul 20 05:04:30.966634 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3383/6670] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:30 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1699 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:31.850592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ccc9a128-c2d5-44f1-ae86-5476817b2c50 req-8d3816e7-535a-42ba-aa04-00767223b513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ff5e29-7fd5-4545-b70e-d4ce630b7971", "name": "network-vif-unplugged", "status": "completed", "tag": "d0b1485a-237e-461c-9774-bf9645557d39"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:31.858595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ccc9a128-c2d5-44f1-ae86-5476817b2c50 req-8d3816e7-535a-42ba-aa04-00767223b513 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:31.859286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ccc9a128-c2d5-44f1-ae86-5476817b2c50 req-8d3816e7-535a-42ba-aa04-00767223b513 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:31.870097 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ccc9a128-c2d5-44f1-ae86-5476817b2c50 req-8d3816e7-535a-42ba-aa04-00767223b513 service nova] Creating event network-vif-unplugged:d0b1485a-237e-461c-9774-bf9645557d39 for instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 on n-h1-764485-11 Jul 20 05:04:31.875084 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ccc9a128-c2d5-44f1-ae86-5476817b2c50 req-8d3816e7-535a-42ba-aa04-00767223b513 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.246324 Jul 20 05:04:31.875697 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3288/6671] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:31.982848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-30206522-2a6a-450a-83fd-a42fe17cceec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:31.983475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-30206522-2a6a-450a-83fd-a42fe17cceec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:31.990751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30206522-2a6a-450a-83fd-a42fe17cceec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:31.991210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30206522-2a6a-450a-83fd-a42fe17cceec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:31.992015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30206522-2a6a-450a-83fd-a42fe17cceec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:31.992470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30206522-2a6a-450a-83fd-a42fe17cceec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:32.124258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-30206522-2a6a-450a-83fd-a42fe17cceec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:32.132479 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-30206522-2a6a-450a-83fd-a42fe17cceec tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1684 microversion: 2.1 time: 0.153474 Jul 20 05:04:32.133060 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3384/6672] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:31 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:33.891534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-fb8f4a35-4208-4cd6-8096-a8f61d2e22b5 req-203903a7-8ef9-4a79-bc8a-0e82ed9c6351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ff5e29-7fd5-4545-b70e-d4ce630b7971", "name": "network-vif-plugged", "status": "completed", "tag": "d0b1485a-237e-461c-9774-bf9645557d39"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:33.900538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fb8f4a35-4208-4cd6-8096-a8f61d2e22b5 req-203903a7-8ef9-4a79-bc8a-0e82ed9c6351 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:33.900988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fb8f4a35-4208-4cd6-8096-a8f61d2e22b5 req-203903a7-8ef9-4a79-bc8a-0e82ed9c6351 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:33.914791 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-fb8f4a35-4208-4cd6-8096-a8f61d2e22b5 req-203903a7-8ef9-4a79-bc8a-0e82ed9c6351 service nova] Creating event network-vif-plugged:d0b1485a-237e-461c-9774-bf9645557d39 for instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 on n-h1-764485-11 Jul 20 05:04:33.919849 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-fb8f4a35-4208-4cd6-8096-a8f61d2e22b5 req-203903a7-8ef9-4a79-bc8a-0e82ed9c6351 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033357 Jul 20 05:04:33.920537 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3289/6673] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:08.383649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=22 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:08.384422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:08.522175 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f87ab229-1f58-4ea7-bd89-f7756068502e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:08.523189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f87ab229-1f58-4ea7-bd89-f7756068502e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:08.530091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f87ab229-1f58-4ea7-bd89-f7756068502e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:08.530556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f87ab229-1f58-4ea7-bd89-f7756068502e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:08.531345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f87ab229-1f58-4ea7-bd89-f7756068502e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:08.531820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f87ab229-1f58-4ea7-bd89-f7756068502e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:08.586820 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f87ab229-1f58-4ea7-bd89-f7756068502e tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "POST /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971/action" status: 200 len: 24540 microversion: 2.1 time: 0.207995 Jul 20 05:05:08.587459 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3385/6674] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:05:08 2022] POST /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971/action => generated 24540 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:05:48.168514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=18 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:48.169797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=46 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:48.174836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:48.175297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a6fe201-52b4-4e0e-8de0-84cad7bde23a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:48.175617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:48.175778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a6fe201-52b4-4e0e-8de0-84cad7bde23a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:48.186989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a6fe201-52b4-4e0e-8de0-84cad7bde23a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:48.188756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a6fe201-52b4-4e0e-8de0-84cad7bde23a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:48.189841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a6fe201-52b4-4e0e-8de0-84cad7bde23a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:48.190292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a6fe201-52b4-4e0e-8de0-84cad7bde23a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:48.219217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a6fe201-52b4-4e0e-8de0-84cad7bde23a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:05:48.249634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-b155447e-4f47-4651-bd75-f6b9fd14f0b5 req-4e4f51a6-e9c2-4f7c-809f-4eba02a8bad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ff5e29-7fd5-4545-b70e-d4ce630b7971", "tag": "d0b1485a-237e-461c-9774-bf9645557d39"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:48.259484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b155447e-4f47-4651-bd75-f6b9fd14f0b5 req-4e4f51a6-e9c2-4f7c-809f-4eba02a8bad0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:48.260905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b155447e-4f47-4651-bd75-f6b9fd14f0b5 req-4e4f51a6-e9c2-4f7c-809f-4eba02a8bad0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:48.273238 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-b155447e-4f47-4651-bd75-f6b9fd14f0b5 req-4e4f51a6-e9c2-4f7c-809f-4eba02a8bad0 service nova] Creating event network-changed:d0b1485a-237e-461c-9774-bf9645557d39 for instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 on n-h1-764485-11 Jul 20 05:05:48.278509 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-b155447e-4f47-4651-bd75-f6b9fd14f0b5 req-4e4f51a6-e9c2-4f7c-809f-4eba02a8bad0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109612 Jul 20 05:05:48.279228 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3386/6675] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:05:48.307324 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a6fe201-52b4-4e0e-8de0-84cad7bde23a tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "DELETE /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 204 len: 0 microversion: 2.1 time: 0.141578 Jul 20 05:05:48.315588 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3290/6676] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:05:48 2022] DELETE /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:05:48.321634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-19ecab84-bb24-44dd-96a7-63069c406699 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:48.323065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-19ecab84-bb24-44dd-96a7-63069c406699 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:48.333862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ecab84-bb24-44dd-96a7-63069c406699 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:48.333862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ecab84-bb24-44dd-96a7-63069c406699 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:48.333862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ecab84-bb24-44dd-96a7-63069c406699 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:48.334818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ecab84-bb24-44dd-96a7-63069c406699 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:48.480038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-19ecab84-bb24-44dd-96a7-63069c406699 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:48.487994 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-19ecab84-bb24-44dd-96a7-63069c406699 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1690 microversion: 2.1 time: 0.170666 Jul 20 05:05:48.488661 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3387/6677] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:48 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:49.506779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b70e971-f153-4749-9d53-c6b4da4b7dfb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:49.507483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0b70e971-f153-4749-9d53-c6b4da4b7dfb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:49.515065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b70e971-f153-4749-9d53-c6b4da4b7dfb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:49.515543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b70e971-f153-4749-9d53-c6b4da4b7dfb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:49.516434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b70e971-f153-4749-9d53-c6b4da4b7dfb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:49.516873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b70e971-f153-4749-9d53-c6b4da4b7dfb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:49.719610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0b70e971-f153-4749-9d53-c6b4da4b7dfb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:49.727107 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0b70e971-f153-4749-9d53-c6b4da4b7dfb tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1690 microversion: 2.1 time: 0.224797 Jul 20 05:05:49.727728 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3291/6678] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:49 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1690 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:50.536020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-f2b0f436-0234-47cf-8642-1a87c3447092 req-31baa80d-ce71-4ff8-a6c3-371095906c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ff5e29-7fd5-4545-b70e-d4ce630b7971", "name": "network-vif-deleted", "tag": "d0b1485a-237e-461c-9774-bf9645557d39"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:50.545535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f2b0f436-0234-47cf-8642-1a87c3447092 req-31baa80d-ce71-4ff8-a6c3-371095906c90 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:50.546083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f2b0f436-0234-47cf-8642-1a87c3447092 req-31baa80d-ce71-4ff8-a6c3-371095906c90 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:50.559181 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f2b0f436-0234-47cf-8642-1a87c3447092 req-31baa80d-ce71-4ff8-a6c3-371095906c90 service nova] Creating event network-vif-deleted:d0b1485a-237e-461c-9774-bf9645557d39 for instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 on n-h1-764485-11 Jul 20 05:05:50.564719 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-f2b0f436-0234-47cf-8642-1a87c3447092 req-31baa80d-ce71-4ff8-a6c3-371095906c90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032554 Jul 20 05:05:50.565338 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3388/6679] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:50.745506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c41e053e-abac-4c1f-b80b-ad7d1e729d86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:50.746083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c41e053e-abac-4c1f-b80b-ad7d1e729d86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:50.752892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c41e053e-abac-4c1f-b80b-ad7d1e729d86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:50.753340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c41e053e-abac-4c1f-b80b-ad7d1e729d86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:50.754099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c41e053e-abac-4c1f-b80b-ad7d1e729d86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:50.754533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c41e053e-abac-4c1f-b80b-ad7d1e729d86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:50.784965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c41e053e-abac-4c1f-b80b-ad7d1e729d86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:50.785513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c41e053e-abac-4c1f-b80b-ad7d1e729d86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:50.785865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-c41e053e-abac-4c1f-b80b-ad7d1e729d86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lazy-loading 'fault' on Instance uuid 91ff5e29-7fd5-4545-b70e-d4ce630b7971 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:05:50.829442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c41e053e-abac-4c1f-b80b-ad7d1e729d86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f38aa28db214cc689fd1b5e02a62d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb3f1bf4a2347a2b78e539c9e8f2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:50.837395 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c41e053e-abac-4c1f-b80b-ad7d1e729d86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 200 len: 1356 microversion: 2.1 time: 0.096586 Jul 20 05:05:50.838591 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3292/6680] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:50 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 1356 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:51.857596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-23cf26cd-c506-4c1b-9639-9fbed380df86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:51.858315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-23cf26cd-c506-4c1b-9639-9fbed380df86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] [instance: 91ff5e29-7fd5-4545-b70e-d4ce630b7971] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:51.864940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23cf26cd-c506-4c1b-9639-9fbed380df86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:51.865406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23cf26cd-c506-4c1b-9639-9fbed380df86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:51.866184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23cf26cd-c506-4c1b-9639-9fbed380df86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:51.866660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23cf26cd-c506-4c1b-9639-9fbed380df86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:51.880244 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-23cf26cd-c506-4c1b-9639-9fbed380df86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] HTTP exception thrown: Instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 could not be found. Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-23cf26cd-c506-4c1b-9639-9fbed380df86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Request method failure captured: Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 HTTP/1.1 Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14qdBDOgOgYg5zB0q-NFS0jh5lsDTaLj-U9nsFTm8jdjGqlHi0W5cg2emgaZEmvxVQ6kbGXvGI8KMmvElHEiPc36Hu2hoFkvZ5-WodujHlu0yefRGKPzNIjJu4QwHYLFjMjO2ShrBXapwPKwcCEPUdSNP8EqhhJ410t0rhba7uK9z2U Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 6bb3f1bf4a2347a2b78e539c9e8f2ee3 Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1261484027 Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6bb3f1bf4a2347a2b78e539c9e8f2ee3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6bb3f1bf4a2347a2b78e539c9e8f2ee3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6bb3f1bf4a2347a2b78e539c9e8f2ee3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6bb3f1bf4a2347a2b78e539c9e8f2ee3"}]}] Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1261484027 Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 6bb3f1bf4a2347a2b78e539c9e8f2ee3 Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1261484027 Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestNetworkAdvancedServerOps-1261484027-project Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 4f38aa28db214cc689fd1b5e02a62d67 Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1261484027-project Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 could not be found. Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '91ff5e29-7fd5-4545-b70e-d4ce630b7971'} Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 could not be found. Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 could not be found. Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:05:51.881862 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:05:51.889057 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:05:51.889057 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:05:51.889057 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:05:51.889057 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:05:51.889057 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:05:51.889057 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:05:51.889057 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 could not be found. Jul 20 05:05:51.889057 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:05:51.889057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-23cf26cd-c506-4c1b-9639-9fbed380df86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Returning 404 to user: Instance 91ff5e29-7fd5-4545-b70e-d4ce630b7971 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:05:51.889057 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-23cf26cd-c506-4c1b-9639-9fbed380df86 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971" status: 404 len: 111 microversion: 2.1 time: 0.030972 Jul 20 05:05:51.889057 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3389/6681] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:51 2022] GET /compute/v2.1/servers/91ff5e29-7fd5-4545-b70e-d4ce630b7971 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:05:55.156816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-de657cdf-4b10-4459-ab30-a118bfc54e49 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] Calling method '.version_select at 0x7fbf9c101af0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:55.177043 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-de657cdf-4b10-4459-ab30-a118bfc54e49 tempest-TestNetworkAdvancedServerOps-1261484027 tempest-TestNetworkAdvancedServerOps-1261484027-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1321535144" status: 202 len: 0 microversion: 2.1 time: 0.024955 Jul 20 05:05:55.177638 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3293/6682] 10.222.0.20 () {58 vars in 1283 bytes} [Wed Jul 20 05:05:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1321535144 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:06:07.042354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:07.043097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=12 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:07.157365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1287185498", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:07.314940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] validate_networks() for None {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:06:07.594223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:06:07.594660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:06:07.595149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:06:07.595594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:06:07.596025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:06:07.605660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:07.606119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:07.606924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:07.607368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:07.624676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Getting quotas for project 4e5af0eb8c3e4dfa9b00a579162429bd. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:06:07.629872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Getting quotas for user f6bd87e000d64bd8b28baff0625d5eb9 and project 4e5af0eb8c3e4dfa9b00a579162429bd. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:06:07.642000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:06:07.644258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:06:07.688611 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b4f33214-2a50-4f69-ad90-218517968e1d tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651968 Jul 20 05:06:07.689263 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3390/6683] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:06:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:06:07.697310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:07.698037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:07.702982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b388a10f-c744-4cd2-95a0-ca3538dc505f tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:07.704018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b388a10f-c744-4cd2-95a0-ca3538dc505f tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:07.872036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b388a10f-c744-4cd2-95a0-ca3538dc505f tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:07.878847 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b388a10f-c744-4cd2-95a0-ca3538dc505f tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1222 microversion: 2.1 time: 0.183421 Jul 20 05:06:07.879415 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3294/6684] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:07 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:08.897931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7f155bd1-99ff-46d1-9140-5df145eb76a1 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:08.898547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7f155bd1-99ff-46d1-9140-5df145eb76a1 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:08.905949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f155bd1-99ff-46d1-9140-5df145eb76a1 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:08.906730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f155bd1-99ff-46d1-9140-5df145eb76a1 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:08.907531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f155bd1-99ff-46d1-9140-5df145eb76a1 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:08.908162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f155bd1-99ff-46d1-9140-5df145eb76a1 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:08.988503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7f155bd1-99ff-46d1-9140-5df145eb76a1 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:08.996744 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7f155bd1-99ff-46d1-9140-5df145eb76a1 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1292 microversion: 2.1 time: 0.104507 Jul 20 05:06:08.997511 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3391/6685] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:08 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:10.015008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e3d79808-3a6f-4ae7-85c3-65b83897e00a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:10.015696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e3d79808-3a6f-4ae7-85c3-65b83897e00a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:10.022604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3d79808-3a6f-4ae7-85c3-65b83897e00a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:10.023067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3d79808-3a6f-4ae7-85c3-65b83897e00a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:10.023865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3d79808-3a6f-4ae7-85c3-65b83897e00a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:10.024310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3d79808-3a6f-4ae7-85c3-65b83897e00a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:10.535726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e3d79808-3a6f-4ae7-85c3-65b83897e00a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:10.544178 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e3d79808-3a6f-4ae7-85c3-65b83897e00a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1322 microversion: 2.1 time: 0.534245 Jul 20 05:06:10.544774 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3295/6686] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:10 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:10.667845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-bccccc3f-fb8d-48b4-a874-cafbe59a2f30 req-e0c675d5-ecd7-4682-b5de-24a2caccf157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1670357b-ab7a-435d-9511-fea4983693df", "tag": "b2f2aa72-dbfb-4b39-b45c-1e473505a549"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:10.685752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-bccccc3f-fb8d-48b4-a874-cafbe59a2f30 req-e0c675d5-ecd7-4682-b5de-24a2caccf157 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:10.686462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-bccccc3f-fb8d-48b4-a874-cafbe59a2f30 req-e0c675d5-ecd7-4682-b5de-24a2caccf157 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:10.700108 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-bccccc3f-fb8d-48b4-a874-cafbe59a2f30 req-e0c675d5-ecd7-4682-b5de-24a2caccf157 service nova] Creating event network-changed:b2f2aa72-dbfb-4b39-b45c-1e473505a549 for instance 1670357b-ab7a-435d-9511-fea4983693df on n-h1-764485-11 Jul 20 05:06:10.705939 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-bccccc3f-fb8d-48b4-a874-cafbe59a2f30 req-e0c675d5-ecd7-4682-b5de-24a2caccf157 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041828 Jul 20 05:06:10.706818 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3392/6687] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:11.561837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9ccb872-3826-46e3-8188-85c66354307a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:11.562452 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a9ccb872-3826-46e3-8188-85c66354307a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:11.569456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9ccb872-3826-46e3-8188-85c66354307a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:11.569913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9ccb872-3826-46e3-8188-85c66354307a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:11.570682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9ccb872-3826-46e3-8188-85c66354307a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:11.571122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9ccb872-3826-46e3-8188-85c66354307a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:11.702739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a9ccb872-3826-46e3-8188-85c66354307a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:11.710222 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a9ccb872-3826-46e3-8188-85c66354307a tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1322 microversion: 2.1 time: 0.153030 Jul 20 05:06:11.710809 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3296/6688] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:11 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:12.728958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74d0fb97-0a21-481d-9e0b-19f2b0adfff4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:12.730768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74d0fb97-0a21-481d-9e0b-19f2b0adfff4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:12.737508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74d0fb97-0a21-481d-9e0b-19f2b0adfff4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:12.737946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74d0fb97-0a21-481d-9e0b-19f2b0adfff4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:12.738724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74d0fb97-0a21-481d-9e0b-19f2b0adfff4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:12.739182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74d0fb97-0a21-481d-9e0b-19f2b0adfff4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:12.873383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-74d0fb97-0a21-481d-9e0b-19f2b0adfff4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:12.880826 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74d0fb97-0a21-481d-9e0b-19f2b0adfff4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1322 microversion: 2.1 time: 0.157042 Jul 20 05:06:12.881396 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3393/6689] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:12 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:13.898271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6cc3f650-9899-4b95-a8dc-195fbc630171 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:13.898888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6cc3f650-9899-4b95-a8dc-195fbc630171 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:13.906430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6cc3f650-9899-4b95-a8dc-195fbc630171 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:13.906882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6cc3f650-9899-4b95-a8dc-195fbc630171 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:13.907665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6cc3f650-9899-4b95-a8dc-195fbc630171 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:13.908206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6cc3f650-9899-4b95-a8dc-195fbc630171 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:14.309886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6cc3f650-9899-4b95-a8dc-195fbc630171 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:14.317623 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6cc3f650-9899-4b95-a8dc-195fbc630171 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1322 microversion: 2.1 time: 0.423254 Jul 20 05:06:14.318201 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3297/6690] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:13 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:15.335195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-13b78bc0-5ca8-464c-9698-d224bc9162f4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:15.335874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-13b78bc0-5ca8-464c-9698-d224bc9162f4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:15.343427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13b78bc0-5ca8-464c-9698-d224bc9162f4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:15.343980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13b78bc0-5ca8-464c-9698-d224bc9162f4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:15.344757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13b78bc0-5ca8-464c-9698-d224bc9162f4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:15.345210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-13b78bc0-5ca8-464c-9698-d224bc9162f4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:15.477159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-13b78bc0-5ca8-464c-9698-d224bc9162f4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:15.485634 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-13b78bc0-5ca8-464c-9698-d224bc9162f4 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1322 microversion: 2.1 time: 0.154527 Jul 20 05:06:15.486220 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3394/6691] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:15 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:16.293775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-131a5e8b-f240-44bb-9151-7929abdeb76f req-31579a55-9b2f-4e23-b85a-2915817ec32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1670357b-ab7a-435d-9511-fea4983693df", "name": "network-vif-plugged", "status": "completed", "tag": "b2f2aa72-dbfb-4b39-b45c-1e473505a549"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:16.302368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-131a5e8b-f240-44bb-9151-7929abdeb76f req-31579a55-9b2f-4e23-b85a-2915817ec32d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:16.303466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-131a5e8b-f240-44bb-9151-7929abdeb76f req-31579a55-9b2f-4e23-b85a-2915817ec32d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:16.315332 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-131a5e8b-f240-44bb-9151-7929abdeb76f req-31579a55-9b2f-4e23-b85a-2915817ec32d service nova] Creating event network-vif-plugged:b2f2aa72-dbfb-4b39-b45c-1e473505a549 for instance 1670357b-ab7a-435d-9511-fea4983693df on n-h1-764485-11 Jul 20 05:06:16.321022 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-131a5e8b-f240-44bb-9151-7929abdeb76f req-31579a55-9b2f-4e23-b85a-2915817ec32d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030751 Jul 20 05:06:16.321775 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3298/6692] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:16.502515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-839c7605-d07d-48d3-96b5-b74a994f12a3 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:16.503379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-839c7605-d07d-48d3-96b5-b74a994f12a3 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:16.510315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-839c7605-d07d-48d3-96b5-b74a994f12a3 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:16.511303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-839c7605-d07d-48d3-96b5-b74a994f12a3 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:16.512117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-839c7605-d07d-48d3-96b5-b74a994f12a3 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:16.512573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-839c7605-d07d-48d3-96b5-b74a994f12a3 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:16.643145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-839c7605-d07d-48d3-96b5-b74a994f12a3 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:16.650682 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-839c7605-d07d-48d3-96b5-b74a994f12a3 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1322 microversion: 2.1 time: 0.152268 Jul 20 05:06:16.651254 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3395/6693] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:16 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:17.669617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-41faefb4-286c-4bf5-a977-856bd588d0da tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:17.670326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-41faefb4-286c-4bf5-a977-856bd588d0da tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:17.677595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41faefb4-286c-4bf5-a977-856bd588d0da tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:17.678061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41faefb4-286c-4bf5-a977-856bd588d0da tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:17.678829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41faefb4-286c-4bf5-a977-856bd588d0da tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:17.679273 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-41faefb4-286c-4bf5-a977-856bd588d0da tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:17.817140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-41faefb4-286c-4bf5-a977-856bd588d0da tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:17.826721 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-41faefb4-286c-4bf5-a977-856bd588d0da tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1322 microversion: 2.1 time: 0.161318 Jul 20 05:06:17.827310 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3299/6694] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:17 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:18.844629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2ebdf917-7f5a-4279-9049-3bb1d7418f4f tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:18.845372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2ebdf917-7f5a-4279-9049-3bb1d7418f4f tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:18.848080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:18.848771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:18.855205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ebdf917-7f5a-4279-9049-3bb1d7418f4f tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:18.855720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ebdf917-7f5a-4279-9049-3bb1d7418f4f tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:18.856512 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ebdf917-7f5a-4279-9049-3bb1d7418f4f tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:18.856979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2ebdf917-7f5a-4279-9049-3bb1d7418f4f tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:18.985607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2ebdf917-7f5a-4279-9049-3bb1d7418f4f tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:18.993165 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2ebdf917-7f5a-4279-9049-3bb1d7418f4f tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1472 microversion: 2.1 time: 0.152810 Jul 20 05:06:18.993740 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3396/6695] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:18 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1472 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:19.013378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:19.069378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-990833a3-a5b3-4d6d-ada2-59c45b28893d tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Calling method '.version_select at 0x7fbf9c163820>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:19.136243 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-990833a3-a5b3-4d6d-ada2-59c45b28893d tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/6e024219dfa44a898c8bf864ac6861d3" status: 200 len: 371 microversion: 2.1 time: 0.127870 Jul 20 05:06:19.136804 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3300/6696] 10.222.0.20 () {58 vars in 1241 bytes} [Wed Jul 20 05:06:19 2022] GET /compute/v2.1/os-quota-sets/6e024219dfa44a898c8bf864ac6861d3 => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:19.147074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3f1bfa91-a5ae-4746-9154-1186f2ea897a tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1535225671", "id": 119136450, "os-flavor-access:is_public": "True"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:19.148689 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 05:06:19.148689 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 05:06:19.163943 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3f1bfa91-a5ae-4746-9154-1186f2ea897a tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.020543 Jul 20 05:06:19.164524 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3397/6697] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:06:19 2022] POST /compute/v2.1/flavors => generated 435 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:19.175434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "119136450"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:19.176486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:19.183133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.183618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.184508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.184964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.272768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2b4c7e5c866849e8922481c5911a65a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e024219dfa44a898c8bf864ac6861d3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:19.279071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1535225671 {{(pid=119807) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:06:19.285490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.285958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.286731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.287168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.306792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Getting quotas for project 4e5af0eb8c3e4dfa9b00a579162429bd. Resources: {'cores', 'ram'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:06:19.312485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Getting quotas for user f6bd87e000d64bd8b28baff0625d5eb9 and project 4e5af0eb8c3e4dfa9b00a579162429bd. Resources: {'cores', 'ram'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:06:19.324722 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.compute.api [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] ram quota exceeded for 6e024219dfa44a898c8bf864ac6861d3, tried to resize instance. Jul 20 05:06:19.325249 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Request method failure captured: Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df/action HTTP/1.1 Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 38 Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi140-dnVGszmGf_G9-yEOh7vVK6iMM1Oa54td1SIlEFuSyApWmFxGe9QAFZzihkqCaTngRf6Vfi-BoN4ErUjjyGz9wHn2WQPMI1mKneCzfqnPqzH06dnbSa7NOJ5hwSlZHA9Vmje17MUryakeBXaqQta2e0OWy--tCje70YAldifBEDo Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 6e024219dfa44a898c8bf864ac6861d3 Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1557120199 Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Role: reader,member,admin Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: reader,member,admin Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e024219dfa44a898c8bf864ac6861d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e024219dfa44a898c8bf864ac6861d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e024219dfa44a898c8bf864ac6861d3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e024219dfa44a898c8bf864ac6861d3"}]}] Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1557120199 Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 6e024219dfa44a898c8bf864ac6861d3 Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1557120199 Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersAdminNegativeTestJSON-1557120199-project-admin Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 2b4c7e5c866849e8922481c5911a65a3 Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1557120199-project-admin Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: {"resize": {"flavorRef": "119136450"}} Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '1670357b-ab7a-435d-9511-fea4983693df', 'body': {'resize': {'flavorRef': '119136450'}}} Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:06:19.335446 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0ce71ba0-0057-4eef-b179-9ec4771adbde tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df/action" status: 403 len: 118 microversion: 2.1 time: 0.165335 Jul 20 05:06:19.342135 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3301/6698] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:06:19 2022] POST /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df/action => generated 118 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:06:19.346345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6a18015a-084c-4d09-b006-ad02293ad3c9 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:19.347093 n-d-764485-11 devstack@n-api.service[119808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 05:06:19.347093 n-d-764485-11 devstack@n-api.service[119808]: warnings.warn(msg) Jul 20 05:06:19.363845 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6a18015a-084c-4d09-b006-ad02293ad3c9 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/119136450" status: 202 len: 0 microversion: 2.1 time: 0.021086 Jul 20 05:06:19.364370 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3398/6699] 10.222.0.20 () {58 vars in 1157 bytes} [Wed Jul 20 05:06:19 2022] DELETE /compute/v2.1/flavors/119136450 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:06:19.373349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c64ad363-cbc8-411b-978a-246fa169e3c6 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:19.392959 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c64ad363-cbc8-411b-978a-246fa169e3c6 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024283 Jul 20 05:06:19.393511 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3302/6700] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 05:06:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:19.410254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8671885e-7666-4016-841c-49a832955e03 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Calling method '.version_select at 0x7fbf9c081280>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:19.480509 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8671885e-7666-4016-841c-49a832955e03 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/6e024219dfa44a898c8bf864ac6861d3" status: 200 len: 371 microversion: 2.1 time: 0.073215 Jul 20 05:06:19.481088 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3399/6701] 10.222.0.20 () {58 vars in 1241 bytes} [Wed Jul 20 05:06:19 2022] GET /compute/v2.1/os-quota-sets/6e024219dfa44a898c8bf864ac6861d3 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:19.491557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aefae8bc-b6b0-450a-8e51-866a4cb21307 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-718583970", "id": 1937700109, "os-flavor-access:is_public": "True"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:19.493136 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 05:06:19.493136 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 05:06:19.508760 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aefae8bc-b6b0-450a-8e51-866a4cb21307 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.020893 Jul 20 05:06:19.509339 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3303/6702] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:06:19 2022] POST /compute/v2.1/flavors => generated 436 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:06:19.522156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1937700109"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:19.523131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:19.530120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.530581 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.531354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.531898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.664663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2b4c7e5c866849e8922481c5911a65a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e024219dfa44a898c8bf864ac6861d3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:19.671735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-718583970 {{(pid=119808) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:06:19.678142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.678603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.679460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.679994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.702322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Getting quotas for project 4e5af0eb8c3e4dfa9b00a579162429bd. Resources: {'cores', 'ram'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:06:19.707438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Getting quotas for user f6bd87e000d64bd8b28baff0625d5eb9 and project 4e5af0eb8c3e4dfa9b00a579162429bd. Resources: {'cores', 'ram'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:06:19.721460 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.compute.api [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] cores quota exceeded for 6e024219dfa44a898c8bf864ac6861d3, tried to resize instance. Jul 20 05:06:19.722011 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Request method failure captured: Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df/action HTTP/1.1 Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 39 Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi140-dnVGszmGf_G9-yEOh7vVK6iMM1Oa54td1SIlEFuSyApWmFxGe9QAFZzihkqCaTngRf6Vfi-BoN4ErUjjyGz9wHn2WQPMI1mKneCzfqnPqzH06dnbSa7NOJ5hwSlZHA9Vmje17MUryakeBXaqQta2e0OWy--tCje70YAldifBEDo Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 6e024219dfa44a898c8bf864ac6861d3 Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1557120199 Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Role: reader,member,admin Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: reader,member,admin Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e024219dfa44a898c8bf864ac6861d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e024219dfa44a898c8bf864ac6861d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e024219dfa44a898c8bf864ac6861d3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e024219dfa44a898c8bf864ac6861d3"}]}] Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1557120199 Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 6e024219dfa44a898c8bf864ac6861d3 Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1557120199 Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersAdminNegativeTestJSON-1557120199-project-admin Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 2b4c7e5c866849e8922481c5911a65a3 Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1557120199-project-admin Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: {"resize": {"flavorRef": "1937700109"}} Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1670357b-ab7a-435d-9511-fea4983693df', 'body': {'resize': {'flavorRef': '1937700109'}}} Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:06:19.724091 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cd0f0e47-5799-4379-ae7c-0c847f74e263 tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df/action" status: 403 len: 113 microversion: 2.1 time: 0.207198 Jul 20 05:06:19.730055 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3400/6703] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:06:19 2022] POST /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df/action => generated 113 bytes in 208 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:06:19.735215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0be9346-9c2d-4585-b12f-864a0045b32f tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:19.736000 n-d-764485-11 devstack@n-api.service[119807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 05:06:19.736000 n-d-764485-11 devstack@n-api.service[119807]: warnings.warn(msg) Jul 20 05:06:19.752929 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e0be9346-9c2d-4585-b12f-864a0045b32f tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1937700109" status: 202 len: 0 microversion: 2.1 time: 0.021745 Jul 20 05:06:19.753520 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3304/6704] 10.222.0.20 () {58 vars in 1160 bytes} [Wed Jul 20 05:06:19 2022] DELETE /compute/v2.1/flavors/1937700109 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:06:19.761769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-002232e6-b0c3-4b1e-a7c4-6c5549b7153e tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:19.783142 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-002232e6-b0c3-4b1e-a7c4-6c5549b7153e tempest-ServersAdminNegativeTestJSON-1557120199 tempest-ServersAdminNegativeTestJSON-1557120199-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025375 Jul 20 05:06:19.783730 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3401/6705] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Jul 20 05:06:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:19.800766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e9915e69-c1a4-492c-90d1-a7b211540bee tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:19.801304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e9915e69-c1a4-492c-90d1-a7b211540bee tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:19.808122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9915e69-c1a4-492c-90d1-a7b211540bee tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.808951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9915e69-c1a4-492c-90d1-a7b211540bee tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.809737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9915e69-c1a4-492c-90d1-a7b211540bee tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.810188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e9915e69-c1a4-492c-90d1-a7b211540bee tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.838879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e9915e69-c1a4-492c-90d1-a7b211540bee tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:06:19.921429 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e9915e69-c1a4-492c-90d1-a7b211540bee tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 204 len: 0 microversion: 2.1 time: 0.124283 Jul 20 05:06:19.922045 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3305/6706] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:06:19 2022] DELETE /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:06:19.930083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-006a9f80-e9d7-42df-b1d7-e28f2f0c2636 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:19.930713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-006a9f80-e9d7-42df-b1d7-e28f2f0c2636 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:19.937754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-006a9f80-e9d7-42df-b1d7-e28f2f0c2636 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.938219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-006a9f80-e9d7-42df-b1d7-e28f2f0c2636 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.939001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-006a9f80-e9d7-42df-b1d7-e28f2f0c2636 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.939457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-006a9f80-e9d7-42df-b1d7-e28f2f0c2636 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:20.068220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-006a9f80-e9d7-42df-b1d7-e28f2f0c2636 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:20.075967 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-006a9f80-e9d7-42df-b1d7-e28f2f0c2636 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1478 microversion: 2.1 time: 0.149739 Jul 20 05:06:20.076533 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3402/6707] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:19 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1478 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:21.093786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-edc17dd0-199b-4d75-ac11-0fe8eebb9c18 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:21.094496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-edc17dd0-199b-4d75-ac11-0fe8eebb9c18 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:21.101500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edc17dd0-199b-4d75-ac11-0fe8eebb9c18 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:21.101963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edc17dd0-199b-4d75-ac11-0fe8eebb9c18 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:21.102745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edc17dd0-199b-4d75-ac11-0fe8eebb9c18 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:21.103198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-edc17dd0-199b-4d75-ac11-0fe8eebb9c18 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:21.243441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-edc17dd0-199b-4d75-ac11-0fe8eebb9c18 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:21.251738 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-edc17dd0-199b-4d75-ac11-0fe8eebb9c18 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1478 microversion: 2.1 time: 0.162296 Jul 20 05:06:21.252314 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3306/6708] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:21 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1478 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:21.972777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-e6e3fe9c-5955-405c-941b-2c9dc49d95d5 req-8231e01d-6995-420c-be14-b32d68bf034d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1670357b-ab7a-435d-9511-fea4983693df", "name": "network-vif-deleted", "tag": "b2f2aa72-dbfb-4b39-b45c-1e473505a549"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:21.987202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e6e3fe9c-5955-405c-941b-2c9dc49d95d5 req-8231e01d-6995-420c-be14-b32d68bf034d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:21.987700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-e6e3fe9c-5955-405c-941b-2c9dc49d95d5 req-8231e01d-6995-420c-be14-b32d68bf034d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:22.006431 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-e6e3fe9c-5955-405c-941b-2c9dc49d95d5 req-8231e01d-6995-420c-be14-b32d68bf034d service nova] Creating event network-vif-deleted:b2f2aa72-dbfb-4b39-b45c-1e473505a549 for instance 1670357b-ab7a-435d-9511-fea4983693df on n-h1-764485-11 Jul 20 05:06:22.013164 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-e6e3fe9c-5955-405c-941b-2c9dc49d95d5 req-8231e01d-6995-420c-be14-b32d68bf034d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044032 Jul 20 05:06:22.013791 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3403/6709] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:22.268848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7de9364e-2f78-4130-8ea7-bf14eb3e0a26 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:22.269486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7de9364e-2f78-4130-8ea7-bf14eb3e0a26 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:22.276489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7de9364e-2f78-4130-8ea7-bf14eb3e0a26 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:22.277125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7de9364e-2f78-4130-8ea7-bf14eb3e0a26 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:22.277910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7de9364e-2f78-4130-8ea7-bf14eb3e0a26 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:22.278362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7de9364e-2f78-4130-8ea7-bf14eb3e0a26 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:22.309806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7de9364e-2f78-4130-8ea7-bf14eb3e0a26 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:22.310261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7de9364e-2f78-4130-8ea7-bf14eb3e0a26 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:22.310724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-7de9364e-2f78-4130-8ea7-bf14eb3e0a26 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lazy-loading 'fault' on Instance uuid 1670357b-ab7a-435d-9511-fea4983693df {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:06:22.353665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7de9364e-2f78-4130-8ea7-bf14eb3e0a26 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd87e000d64bd8b28baff0625d5eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5af0eb8c3e4dfa9b00a579162429bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:22.362889 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7de9364e-2f78-4130-8ea7-bf14eb3e0a26 tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 200 len: 1312 microversion: 2.1 time: 0.097948 Jul 20 05:06:22.363474 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3307/6710] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:22 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:23.381981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4fbd2d3f-4a51-46a8-8315-bdf0756f8bdb tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:23.382694 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4fbd2d3f-4a51-46a8-8315-bdf0756f8bdb tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] [instance: 1670357b-ab7a-435d-9511-fea4983693df] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:23.390423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fbd2d3f-4a51-46a8-8315-bdf0756f8bdb tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:23.390886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fbd2d3f-4a51-46a8-8315-bdf0756f8bdb tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:23.391689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fbd2d3f-4a51-46a8-8315-bdf0756f8bdb tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:23.392147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fbd2d3f-4a51-46a8-8315-bdf0756f8bdb tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:23.405905 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-4fbd2d3f-4a51-46a8-8315-bdf0756f8bdb tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] HTTP exception thrown: Instance 1670357b-ab7a-435d-9511-fea4983693df could not be found. Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4fbd2d3f-4a51-46a8-8315-bdf0756f8bdb tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Request method failure captured: Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df HTTP/1.1 Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi140-uNLylia2BBJE04Y-urd9GOn6cVeX1AprKxGBXEcIWqUMNTSxBUyY70y7EnbZxlOr9UutDSLaQt9-OIB0xWr-Lm4Ypl3VwdRgK1VneQM_Hm73hyiWjAPQxKghOhIICZV8AZnKJQj7Ysi9HrZ13jTzm2RLd6sxgoDUwdUERBPj3aw Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 4e5af0eb8c3e4dfa9b00a579162429bd Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1705271856 Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e5af0eb8c3e4dfa9b00a579162429bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e5af0eb8c3e4dfa9b00a579162429bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e5af0eb8c3e4dfa9b00a579162429bd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e5af0eb8c3e4dfa9b00a579162429bd"}]}] Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1705271856 Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 4e5af0eb8c3e4dfa9b00a579162429bd Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1705271856 Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersAdminNegativeTestJSON-1705271856-project Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: f6bd87e000d64bd8b28baff0625d5eb9 Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1705271856-project Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 1670357b-ab7a-435d-9511-fea4983693df could not be found. Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1670357b-ab7a-435d-9511-fea4983693df'} Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1670357b-ab7a-435d-9511-fea4983693df could not be found. Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1670357b-ab7a-435d-9511-fea4983693df could not be found. Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:06:23.407597 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:23.412767 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:06:23.412767 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:23.412767 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:23.412767 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:23.412767 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:06:23.412767 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:06:23.412767 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1670357b-ab7a-435d-9511-fea4983693df could not be found. Jul 20 05:06:23.412767 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:06:23.412767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4fbd2d3f-4a51-46a8-8315-bdf0756f8bdb tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] Returning 404 to user: Instance 1670357b-ab7a-435d-9511-fea4983693df could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:06:23.412767 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4fbd2d3f-4a51-46a8-8315-bdf0756f8bdb tempest-ServersAdminNegativeTestJSON-1705271856 tempest-ServersAdminNegativeTestJSON-1705271856-project] 10.222.0.20 "GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df" status: 404 len: 111 microversion: 2.1 time: 0.032111 Jul 20 05:06:23.412767 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3404/6711] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:23 2022] GET /compute/v2.1/servers/1670357b-ab7a-435d-9511-fea4983693df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:06:29.339810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:29.340501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:29.473257 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1136876655", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "af0bd668-dc9c-4d3a-85eb-77bc6e55a043"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:29.527937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] validate_networks() for [('af0bd668-dc9c-4d3a-85eb-77bc6e55a043', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:06:29.997973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:06:29.997973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:06:29.997973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:06:29.997973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:06:29.997973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:06:29.997973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:29.997973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:29.997973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:29.997973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:30.000862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Getting quotas for project b78c3915560543239ab4cd15a0680c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:06:30.008214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Getting quotas for user f4d5cdc21d2b4a41b7bde9da79ab6ef2 and project b78c3915560543239ab4cd15a0680c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:06:30.026087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:06:30.028488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:06:30.077974 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ecce9bd1-f92b-472e-b576-d9268e65336d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743854 Jul 20 05:06:30.079302 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3308/6712] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:06:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:06:30.089472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-35a0bde8-94c9-4269-9334-dc6cf713a181 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:30.090377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-35a0bde8-94c9-4269-9334-dc6cf713a181 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:30.093477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:30.096134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:30.180366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-35a0bde8-94c9-4269-9334-dc6cf713a181 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:30.195548 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-35a0bde8-94c9-4269-9334-dc6cf713a181 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1215 microversion: 2.1 time: 0.110051 Jul 20 05:06:30.200815 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3405/6713] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:30 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:31.217519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2bf8f06-0204-4129-a62b-ba252c0ed1e0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:31.218284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2bf8f06-0204-4129-a62b-ba252c0ed1e0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:31.225442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2bf8f06-0204-4129-a62b-ba252c0ed1e0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:31.225981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2bf8f06-0204-4129-a62b-ba252c0ed1e0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:31.226836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2bf8f06-0204-4129-a62b-ba252c0ed1e0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:31.227288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2bf8f06-0204-4129-a62b-ba252c0ed1e0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:31.292800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c2bf8f06-0204-4129-a62b-ba252c0ed1e0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:31.300464 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2bf8f06-0204-4129-a62b-ba252c0ed1e0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1219 microversion: 2.1 time: 0.087925 Jul 20 05:06:31.301051 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3309/6714] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:31 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:32.318912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-440768bc-51aa-4466-bfd8-40833b4e22ac tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:32.320186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-440768bc-51aa-4466-bfd8-40833b4e22ac tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:32.328095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-440768bc-51aa-4466-bfd8-40833b4e22ac tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:32.328821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-440768bc-51aa-4466-bfd8-40833b4e22ac tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:32.329819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-440768bc-51aa-4466-bfd8-40833b4e22ac tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:32.330404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-440768bc-51aa-4466-bfd8-40833b4e22ac tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:32.728004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-440768bc-51aa-4466-bfd8-40833b4e22ac tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:32.735940 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-440768bc-51aa-4466-bfd8-40833b4e22ac tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1285 microversion: 2.1 time: 0.421353 Jul 20 05:06:32.736530 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3406/6715] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:32 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1285 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:33.756650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b01021d-6272-49b6-992e-cdbdbaa569cc tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:33.758248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7b01021d-6272-49b6-992e-cdbdbaa569cc tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:33.776514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b01021d-6272-49b6-992e-cdbdbaa569cc tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:33.777129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b01021d-6272-49b6-992e-cdbdbaa569cc tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:33.777989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b01021d-6272-49b6-992e-cdbdbaa569cc tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:33.782989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b01021d-6272-49b6-992e-cdbdbaa569cc tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:34.062759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-7a914a3d-00c9-4e5f-87e2-4029a2f23ab7 req-229925f3-83b2-4ee1-ab51-77a036f55bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d9bcca-0270-494c-babc-af546bdd6490", "tag": "cf08e09e-ade7-4682-91a0-439f0250276e"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:34.078722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7a914a3d-00c9-4e5f-87e2-4029a2f23ab7 req-229925f3-83b2-4ee1-ab51-77a036f55bd0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:34.079446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7a914a3d-00c9-4e5f-87e2-4029a2f23ab7 req-229925f3-83b2-4ee1-ab51-77a036f55bd0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:34.092739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7b01021d-6272-49b6-992e-cdbdbaa569cc tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:34.098028 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7a914a3d-00c9-4e5f-87e2-4029a2f23ab7 req-229925f3-83b2-4ee1-ab51-77a036f55bd0 service nova] Creating event network-changed:cf08e09e-ade7-4682-91a0-439f0250276e for instance d7d9bcca-0270-494c-babc-af546bdd6490 on n-h1-764485-11 Jul 20 05:06:34.102456 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7b01021d-6272-49b6-992e-cdbdbaa569cc tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1315 microversion: 2.1 time: 0.352571 Jul 20 05:06:34.106247 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3310/6716] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:33 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:34.107282 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-7a914a3d-00c9-4e5f-87e2-4029a2f23ab7 req-229925f3-83b2-4ee1-ab51-77a036f55bd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047001 Jul 20 05:06:34.109221 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3407/6717] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:06:35.121213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-62883a93-a5ea-4d93-a8a1-71e7b2e393ee tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:35.121838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-62883a93-a5ea-4d93-a8a1-71e7b2e393ee tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:35.128857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62883a93-a5ea-4d93-a8a1-71e7b2e393ee tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:35.129315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62883a93-a5ea-4d93-a8a1-71e7b2e393ee tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:35.130087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62883a93-a5ea-4d93-a8a1-71e7b2e393ee tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:35.130536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62883a93-a5ea-4d93-a8a1-71e7b2e393ee tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:35.273264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-62883a93-a5ea-4d93-a8a1-71e7b2e393ee tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:35.281956 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-62883a93-a5ea-4d93-a8a1-71e7b2e393ee tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1315 microversion: 2.1 time: 0.164973 Jul 20 05:06:35.282534 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3311/6718] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:35 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:36.300189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c7985eac-4969-426a-906f-ef3feafecbeb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:36.300901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c7985eac-4969-426a-906f-ef3feafecbeb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:36.307135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7985eac-4969-426a-906f-ef3feafecbeb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:36.307685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7985eac-4969-426a-906f-ef3feafecbeb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:36.308451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7985eac-4969-426a-906f-ef3feafecbeb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:36.308899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7985eac-4969-426a-906f-ef3feafecbeb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:36.440813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c7985eac-4969-426a-906f-ef3feafecbeb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:36.448987 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c7985eac-4969-426a-906f-ef3feafecbeb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1315 microversion: 2.1 time: 0.153739 Jul 20 05:06:36.449569 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3408/6719] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:36 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:37.467148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ddd8891-4870-420c-b7ed-3a47c78bf7f8 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:37.467851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ddd8891-4870-420c-b7ed-3a47c78bf7f8 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:37.474791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ddd8891-4870-420c-b7ed-3a47c78bf7f8 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:37.475247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ddd8891-4870-420c-b7ed-3a47c78bf7f8 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:37.476054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ddd8891-4870-420c-b7ed-3a47c78bf7f8 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:37.476499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ddd8891-4870-420c-b7ed-3a47c78bf7f8 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:37.609829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ddd8891-4870-420c-b7ed-3a47c78bf7f8 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:37.617467 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ddd8891-4870-420c-b7ed-3a47c78bf7f8 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1315 microversion: 2.1 time: 0.155274 Jul 20 05:06:37.617973 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3312/6720] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:37 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:38.634520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7ccf33e0-2814-4d13-a327-3bd711c93c7d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:38.635202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7ccf33e0-2814-4d13-a327-3bd711c93c7d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:38.637675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:38.643010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ccf33e0-2814-4d13-a327-3bd711c93c7d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:38.643521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ccf33e0-2814-4d13-a327-3bd711c93c7d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:38.644301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ccf33e0-2814-4d13-a327-3bd711c93c7d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:38.644757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ccf33e0-2814-4d13-a327-3bd711c93c7d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:38.649956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=72 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:38.783206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7ccf33e0-2814-4d13-a327-3bd711c93c7d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:38.790691 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7ccf33e0-2814-4d13-a327-3bd711c93c7d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1315 microversion: 2.1 time: 0.160351 Jul 20 05:06:38.791521 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3409/6721] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:38 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:39.809084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-69c6b186-be80-4e90-9505-f5f6d4c0cdd0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:39.809703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-69c6b186-be80-4e90-9505-f5f6d4c0cdd0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:39.812417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:39.817809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69c6b186-be80-4e90-9505-f5f6d4c0cdd0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:39.818264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69c6b186-be80-4e90-9505-f5f6d4c0cdd0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:39.819037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69c6b186-be80-4e90-9505-f5f6d4c0cdd0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:39.819482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-69c6b186-be80-4e90-9505-f5f6d4c0cdd0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:39.824897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:39.956354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-69c6b186-be80-4e90-9505-f5f6d4c0cdd0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:39.963901 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-69c6b186-be80-4e90-9505-f5f6d4c0cdd0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1315 microversion: 2.1 time: 0.159613 Jul 20 05:06:39.964479 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3313/6722] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:39 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:40.207201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-59c6f810-36d7-463f-84cd-373beeb569b1 req-42456f4e-470b-4570-8441-b40b398e7651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d9bcca-0270-494c-babc-af546bdd6490", "name": "network-vif-plugged", "status": "completed", "tag": "cf08e09e-ade7-4682-91a0-439f0250276e"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:40.211613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:40.218388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-59c6f810-36d7-463f-84cd-373beeb569b1 req-42456f4e-470b-4570-8441-b40b398e7651 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:40.218855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-59c6f810-36d7-463f-84cd-373beeb569b1 req-42456f4e-470b-4570-8441-b40b398e7651 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:40.231229 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-59c6f810-36d7-463f-84cd-373beeb569b1 req-42456f4e-470b-4570-8441-b40b398e7651 service nova] Creating event network-vif-plugged:cf08e09e-ade7-4682-91a0-439f0250276e for instance d7d9bcca-0270-494c-babc-af546bdd6490 on n-h1-764485-11 Jul 20 05:06:40.236688 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-59c6f810-36d7-463f-84cd-373beeb569b1 req-42456f4e-470b-4570-8441-b40b398e7651 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033190 Jul 20 05:06:40.237296 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3410/6723] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:40.981647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6a357687-ea41-4567-aae1-8e10743467d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:40.982187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6a357687-ea41-4567-aae1-8e10743467d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:40.984051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:40.985102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:40.991622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a357687-ea41-4567-aae1-8e10743467d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:40.992076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a357687-ea41-4567-aae1-8e10743467d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:40.992843 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a357687-ea41-4567-aae1-8e10743467d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:40.993284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a357687-ea41-4567-aae1-8e10743467d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:41.125633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6a357687-ea41-4567-aae1-8e10743467d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:41.133170 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6a357687-ea41-4567-aae1-8e10743467d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1315 microversion: 2.1 time: 0.156378 Jul 20 05:06:41.133758 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3314/6724] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:40 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:42.151840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-80308f7e-6d3f-47ac-ad6b-7add1ebc5a5d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:42.152461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-80308f7e-6d3f-47ac-ad6b-7add1ebc5a5d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:42.158739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80308f7e-6d3f-47ac-ad6b-7add1ebc5a5d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:42.159199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80308f7e-6d3f-47ac-ad6b-7add1ebc5a5d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:42.159995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80308f7e-6d3f-47ac-ad6b-7add1ebc5a5d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:42.160451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80308f7e-6d3f-47ac-ad6b-7add1ebc5a5d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:42.290363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-80308f7e-6d3f-47ac-ad6b-7add1ebc5a5d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:42.298414 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-80308f7e-6d3f-47ac-ad6b-7add1ebc5a5d tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1502 microversion: 2.1 time: 0.151751 Jul 20 05:06:42.298988 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3411/6725] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:42 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:42.315427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:42.316531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:42.323667 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:42.324134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:42.324920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:42.325370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:42.353163 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:42.360286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Old instance type m1.heat2, new instance type m1.heat {{(pid=119807) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:06:42.366491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:06:42.366911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:06:42.367381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:06:42.367816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:06:42.368228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:06:42.431127 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-492da35b-ad0a-4caa-ab6b-3e4603c362d9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "POST /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490/action" status: 202 len: 0 microversion: 2.1 time: 0.119212 Jul 20 05:06:42.431704 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3315/6726] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:06:42 2022] POST /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:06:42.440136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-485b0721-d636-4ec5-aa40-1184b161c9d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:42.440883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-485b0721-d636-4ec5-aa40-1184b161c9d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:42.447259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-485b0721-d636-4ec5-aa40-1184b161c9d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:42.448360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-485b0721-d636-4ec5-aa40-1184b161c9d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:42.449221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-485b0721-d636-4ec5-aa40-1184b161c9d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:42.449685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-485b0721-d636-4ec5-aa40-1184b161c9d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:42.597540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-485b0721-d636-4ec5-aa40-1184b161c9d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:42.606173 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-485b0721-d636-4ec5-aa40-1184b161c9d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1511 microversion: 2.1 time: 0.169852 Jul 20 05:06:42.606783 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3412/6727] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:42 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:43.624635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3f3168f1-16c9-4166-bab0-70669631b3dd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:43.625446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3f3168f1-16c9-4166-bab0-70669631b3dd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:43.637615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f3168f1-16c9-4166-bab0-70669631b3dd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:43.638078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f3168f1-16c9-4166-bab0-70669631b3dd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:43.638864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f3168f1-16c9-4166-bab0-70669631b3dd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:43.639317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f3168f1-16c9-4166-bab0-70669631b3dd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:43.770338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3f3168f1-16c9-4166-bab0-70669631b3dd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:43.779081 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3f3168f1-16c9-4166-bab0-70669631b3dd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1511 microversion: 2.1 time: 0.158598 Jul 20 05:06:43.779700 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3316/6728] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:43 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:44.796974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9f8bd235-c299-4fe7-9702-3ecdc1012cca tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:44.797605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9f8bd235-c299-4fe7-9702-3ecdc1012cca tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:44.804733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f8bd235-c299-4fe7-9702-3ecdc1012cca tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:44.805207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f8bd235-c299-4fe7-9702-3ecdc1012cca tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:44.805997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f8bd235-c299-4fe7-9702-3ecdc1012cca tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:44.806456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9f8bd235-c299-4fe7-9702-3ecdc1012cca tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:44.944335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9f8bd235-c299-4fe7-9702-3ecdc1012cca tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:44.951934 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9f8bd235-c299-4fe7-9702-3ecdc1012cca tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.158890 Jul 20 05:06:44.952524 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3413/6729] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:44 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:45.969513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5e189dc0-d537-426a-aff6-5d3c7cf2cec3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:45.970028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5e189dc0-d537-426a-aff6-5d3c7cf2cec3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:45.976919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e189dc0-d537-426a-aff6-5d3c7cf2cec3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:45.977371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e189dc0-d537-426a-aff6-5d3c7cf2cec3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:45.978128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e189dc0-d537-426a-aff6-5d3c7cf2cec3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:45.978565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e189dc0-d537-426a-aff6-5d3c7cf2cec3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:46.109904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5e189dc0-d537-426a-aff6-5d3c7cf2cec3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:46.117397 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5e189dc0-d537-426a-aff6-5d3c7cf2cec3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.151980 Jul 20 05:06:46.117976 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3317/6730] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:45 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:47.136153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2fa4db1f-fec9-44f4-83d6-816ed8aafffd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:47.136788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2fa4db1f-fec9-44f4-83d6-816ed8aafffd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:47.143814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fa4db1f-fec9-44f4-83d6-816ed8aafffd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:47.144284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fa4db1f-fec9-44f4-83d6-816ed8aafffd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:47.145068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fa4db1f-fec9-44f4-83d6-816ed8aafffd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:47.145525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2fa4db1f-fec9-44f4-83d6-816ed8aafffd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:47.281297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2fa4db1f-fec9-44f4-83d6-816ed8aafffd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:47.288873 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2fa4db1f-fec9-44f4-83d6-816ed8aafffd tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.157477 Jul 20 05:06:47.289451 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3414/6731] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:47 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:48.306399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0d129507-ba72-4c55-afbf-acd5ad5fdb4a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:48.307169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0d129507-ba72-4c55-afbf-acd5ad5fdb4a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:48.314169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d129507-ba72-4c55-afbf-acd5ad5fdb4a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:48.314629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d129507-ba72-4c55-afbf-acd5ad5fdb4a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:48.315406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d129507-ba72-4c55-afbf-acd5ad5fdb4a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:48.315894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d129507-ba72-4c55-afbf-acd5ad5fdb4a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:48.450087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0d129507-ba72-4c55-afbf-acd5ad5fdb4a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:48.457636 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0d129507-ba72-4c55-afbf-acd5ad5fdb4a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.155268 Jul 20 05:06:48.458208 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3318/6732] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:48 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:49.474715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6771725-0344-4cad-8c3f-e25d47fa60cf tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:49.475262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c6771725-0344-4cad-8c3f-e25d47fa60cf tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:49.483120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6771725-0344-4cad-8c3f-e25d47fa60cf tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:49.483637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6771725-0344-4cad-8c3f-e25d47fa60cf tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:49.484678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6771725-0344-4cad-8c3f-e25d47fa60cf tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:49.485117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6771725-0344-4cad-8c3f-e25d47fa60cf tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:49.616787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c6771725-0344-4cad-8c3f-e25d47fa60cf tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:49.624461 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c6771725-0344-4cad-8c3f-e25d47fa60cf tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.153769 Jul 20 05:06:49.625031 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3415/6733] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:49 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:50.641441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3f6d53ae-285b-46eb-9de3-314868bccb2c tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:50.642066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3f6d53ae-285b-46eb-9de3-314868bccb2c tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:50.649403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f6d53ae-285b-46eb-9de3-314868bccb2c tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:50.649862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f6d53ae-285b-46eb-9de3-314868bccb2c tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:50.650629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f6d53ae-285b-46eb-9de3-314868bccb2c tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:50.651611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f6d53ae-285b-46eb-9de3-314868bccb2c tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:50.787669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3f6d53ae-285b-46eb-9de3-314868bccb2c tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:50.795484 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3f6d53ae-285b-46eb-9de3-314868bccb2c tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.157998 Jul 20 05:06:50.796086 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3319/6734] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:50 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:51.812444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-17af78df-5f15-4e6b-be11-2dc46497079b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:51.813085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-17af78df-5f15-4e6b-be11-2dc46497079b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:51.820141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17af78df-5f15-4e6b-be11-2dc46497079b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:51.820612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17af78df-5f15-4e6b-be11-2dc46497079b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:51.821399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17af78df-5f15-4e6b-be11-2dc46497079b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:51.821856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17af78df-5f15-4e6b-be11-2dc46497079b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:51.954048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-17af78df-5f15-4e6b-be11-2dc46497079b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:51.961684 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-17af78df-5f15-4e6b-be11-2dc46497079b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.153207 Jul 20 05:06:51.962282 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3416/6735] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:51 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:52.979418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-864a2512-0f1d-4299-a047-5c92c978bdb5 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:52.979989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-864a2512-0f1d-4299-a047-5c92c978bdb5 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:52.987962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-864a2512-0f1d-4299-a047-5c92c978bdb5 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:52.988421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-864a2512-0f1d-4299-a047-5c92c978bdb5 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:52.989193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-864a2512-0f1d-4299-a047-5c92c978bdb5 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:52.989640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-864a2512-0f1d-4299-a047-5c92c978bdb5 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:53.123391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-864a2512-0f1d-4299-a047-5c92c978bdb5 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:53.130857 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-864a2512-0f1d-4299-a047-5c92c978bdb5 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.155550 Jul 20 05:06:53.131430 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3320/6736] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:52 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:54.148684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-531a174a-6d30-4914-8669-8b68ea2f225a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:54.149293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-531a174a-6d30-4914-8669-8b68ea2f225a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:54.157285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-531a174a-6d30-4914-8669-8b68ea2f225a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:54.157755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-531a174a-6d30-4914-8669-8b68ea2f225a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:54.158535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-531a174a-6d30-4914-8669-8b68ea2f225a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:54.158993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-531a174a-6d30-4914-8669-8b68ea2f225a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:54.292205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-531a174a-6d30-4914-8669-8b68ea2f225a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:54.299800 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-531a174a-6d30-4914-8669-8b68ea2f225a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.154978 Jul 20 05:06:54.300380 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3417/6737] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:54 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:55.317402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f6bbdb8c-b8f5-4b96-8302-99c0950fe565 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:55.318023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f6bbdb8c-b8f5-4b96-8302-99c0950fe565 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:55.325064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6bbdb8c-b8f5-4b96-8302-99c0950fe565 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:55.325702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6bbdb8c-b8f5-4b96-8302-99c0950fe565 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:55.326533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6bbdb8c-b8f5-4b96-8302-99c0950fe565 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:55.326993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f6bbdb8c-b8f5-4b96-8302-99c0950fe565 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:55.458028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f6bbdb8c-b8f5-4b96-8302-99c0950fe565 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:55.466377 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f6bbdb8c-b8f5-4b96-8302-99c0950fe565 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.152241 Jul 20 05:06:55.466958 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3321/6738] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:55 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:56.484832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6f08ae13-6e6a-4501-821e-ff082980e5c1 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:56.485389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6f08ae13-6e6a-4501-821e-ff082980e5c1 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:56.492424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f08ae13-6e6a-4501-821e-ff082980e5c1 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:56.492890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f08ae13-6e6a-4501-821e-ff082980e5c1 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:56.493668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f08ae13-6e6a-4501-821e-ff082980e5c1 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:56.494122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6f08ae13-6e6a-4501-821e-ff082980e5c1 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:56.630199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6f08ae13-6e6a-4501-821e-ff082980e5c1 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:56.638117 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6f08ae13-6e6a-4501-821e-ff082980e5c1 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.158446 Jul 20 05:06:56.638690 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3418/6739] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:56 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:57.654791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8fc7bc9c-d513-428e-96d5-3bcd886df3d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:57.655407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8fc7bc9c-d513-428e-96d5-3bcd886df3d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:57.662431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fc7bc9c-d513-428e-96d5-3bcd886df3d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:57.662886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fc7bc9c-d513-428e-96d5-3bcd886df3d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:57.663682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fc7bc9c-d513-428e-96d5-3bcd886df3d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:57.664129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8fc7bc9c-d513-428e-96d5-3bcd886df3d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:57.796437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8fc7bc9c-d513-428e-96d5-3bcd886df3d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:57.803983 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8fc7bc9c-d513-428e-96d5-3bcd886df3d2 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.153282 Jul 20 05:06:57.804567 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3322/6740] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:57 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:58.822533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c888740-3b0b-4185-954a-5964c8156702 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:58.823083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8c888740-3b0b-4185-954a-5964c8156702 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:58.830490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c888740-3b0b-4185-954a-5964c8156702 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:58.830952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c888740-3b0b-4185-954a-5964c8156702 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:58.831751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c888740-3b0b-4185-954a-5964c8156702 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:58.832197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c888740-3b0b-4185-954a-5964c8156702 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:58.962519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8c888740-3b0b-4185-954a-5964c8156702 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:58.970096 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8c888740-3b0b-4185-954a-5964c8156702 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.151663 Jul 20 05:06:58.970675 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3419/6741] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:58 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:59.987915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cf198533-5eb0-452e-853b-ed855adcef8f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:59.988547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cf198533-5eb0-452e-853b-ed855adcef8f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:59.995460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf198533-5eb0-452e-853b-ed855adcef8f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:59.995958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf198533-5eb0-452e-853b-ed855adcef8f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:59.996770 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf198533-5eb0-452e-853b-ed855adcef8f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:59.997217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cf198533-5eb0-452e-853b-ed855adcef8f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:00.129702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cf198533-5eb0-452e-853b-ed855adcef8f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:00.138330 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cf198533-5eb0-452e-853b-ed855adcef8f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.154591 Jul 20 05:07:00.138917 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3323/6742] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:59 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:01.155986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b136c388-0a89-421c-9202-a4e8d373cb07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:01.156635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b136c388-0a89-421c-9202-a4e8d373cb07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:01.163492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b136c388-0a89-421c-9202-a4e8d373cb07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:01.163974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b136c388-0a89-421c-9202-a4e8d373cb07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:01.164738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b136c388-0a89-421c-9202-a4e8d373cb07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:01.165188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b136c388-0a89-421c-9202-a4e8d373cb07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:01.298490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b136c388-0a89-421c-9202-a4e8d373cb07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:01.305965 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b136c388-0a89-421c-9202-a4e8d373cb07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.154480 Jul 20 05:07:01.306539 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3420/6743] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:01 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:02.323746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b67144d3-6ec5-4655-a9b3-8d11e7a2936a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:02.324365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b67144d3-6ec5-4655-a9b3-8d11e7a2936a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:02.332354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b67144d3-6ec5-4655-a9b3-8d11e7a2936a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:02.332806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b67144d3-6ec5-4655-a9b3-8d11e7a2936a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:02.333569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b67144d3-6ec5-4655-a9b3-8d11e7a2936a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:02.334007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b67144d3-6ec5-4655-a9b3-8d11e7a2936a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:02.468230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b67144d3-6ec5-4655-a9b3-8d11e7a2936a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:02.475891 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b67144d3-6ec5-4655-a9b3-8d11e7a2936a tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.156088 Jul 20 05:07:02.476534 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3324/6744] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:02 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:03.493515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b6315c1e-3d9a-4e70-aa7f-c9205f8f9b5f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:03.494092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b6315c1e-3d9a-4e70-aa7f-c9205f8f9b5f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:03.500840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6315c1e-3d9a-4e70-aa7f-c9205f8f9b5f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:03.501304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6315c1e-3d9a-4e70-aa7f-c9205f8f9b5f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:03.502077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6315c1e-3d9a-4e70-aa7f-c9205f8f9b5f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:03.502557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6315c1e-3d9a-4e70-aa7f-c9205f8f9b5f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:03.633444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b6315c1e-3d9a-4e70-aa7f-c9205f8f9b5f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:03.641492 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b6315c1e-3d9a-4e70-aa7f-c9205f8f9b5f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.152155 Jul 20 05:07:03.642070 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3421/6745] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:03 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:04.658645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1b38609c-4c91-4454-84a3-0358b211b3b0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:04.659312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1b38609c-4c91-4454-84a3-0358b211b3b0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:04.666546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b38609c-4c91-4454-84a3-0358b211b3b0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:04.667027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b38609c-4c91-4454-84a3-0358b211b3b0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:04.667874 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b38609c-4c91-4454-84a3-0358b211b3b0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:04.668315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1b38609c-4c91-4454-84a3-0358b211b3b0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:04.813608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1b38609c-4c91-4454-84a3-0358b211b3b0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:04.822548 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1b38609c-4c91-4454-84a3-0358b211b3b0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.167907 Jul 20 05:07:04.823476 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3325/6746] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:04 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:05.840156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-62aba296-4299-414a-8f88-82e999dbf4ef tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:05.840779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-62aba296-4299-414a-8f88-82e999dbf4ef tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:05.847761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62aba296-4299-414a-8f88-82e999dbf4ef tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:05.848223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62aba296-4299-414a-8f88-82e999dbf4ef tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:05.848989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62aba296-4299-414a-8f88-82e999dbf4ef tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:05.849434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-62aba296-4299-414a-8f88-82e999dbf4ef tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:05.981321 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-62aba296-4299-414a-8f88-82e999dbf4ef tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:05.989580 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-62aba296-4299-414a-8f88-82e999dbf4ef tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.153328 Jul 20 05:07:05.990164 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3422/6747] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:05 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:07.007391 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a5429e08-9096-4194-8e79-238920120004 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:07.008033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a5429e08-9096-4194-8e79-238920120004 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:07.015003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5429e08-9096-4194-8e79-238920120004 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:07.015449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5429e08-9096-4194-8e79-238920120004 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:07.016244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5429e08-9096-4194-8e79-238920120004 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:07.016690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5429e08-9096-4194-8e79-238920120004 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:07.146361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a5429e08-9096-4194-8e79-238920120004 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:07.154369 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a5429e08-9096-4194-8e79-238920120004 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.150438 Jul 20 05:07:07.155037 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3326/6748] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:07 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:08.172123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-08663e6c-af43-4f81-97d5-a29b1182ef32 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:08.172647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-08663e6c-af43-4f81-97d5-a29b1182ef32 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:08.179371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08663e6c-af43-4f81-97d5-a29b1182ef32 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:08.179869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08663e6c-af43-4f81-97d5-a29b1182ef32 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:08.180632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08663e6c-af43-4f81-97d5-a29b1182ef32 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:08.181081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08663e6c-af43-4f81-97d5-a29b1182ef32 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:08.574509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-08663e6c-af43-4f81-97d5-a29b1182ef32 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:08.582629 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-08663e6c-af43-4f81-97d5-a29b1182ef32 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.415075 Jul 20 05:07:08.583201 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3423/6749] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:08 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:09.600463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ff38d125-c303-4678-aa90-33bc80cf79a3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:09.601140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ff38d125-c303-4678-aa90-33bc80cf79a3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:09.609157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff38d125-c303-4678-aa90-33bc80cf79a3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:09.609868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff38d125-c303-4678-aa90-33bc80cf79a3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:09.610639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff38d125-c303-4678-aa90-33bc80cf79a3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:09.611084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff38d125-c303-4678-aa90-33bc80cf79a3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:09.742738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ff38d125-c303-4678-aa90-33bc80cf79a3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:09.750650 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ff38d125-c303-4678-aa90-33bc80cf79a3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.154200 Jul 20 05:07:09.751240 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3327/6750] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:09 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:10.768495 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-18c03527-2e23-459e-ac2b-425b12173204 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:10.769163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-18c03527-2e23-459e-ac2b-425b12173204 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:10.772015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=30 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:10.777745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18c03527-2e23-459e-ac2b-425b12173204 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:10.778207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18c03527-2e23-459e-ac2b-425b12173204 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:10.779882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18c03527-2e23-459e-ac2b-425b12173204 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:10.780407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18c03527-2e23-459e-ac2b-425b12173204 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:10.784776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=86 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:10.922973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-18c03527-2e23-459e-ac2b-425b12173204 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:10.930504 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-18c03527-2e23-459e-ac2b-425b12173204 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1516 microversion: 2.1 time: 0.165897 Jul 20 05:07:10.931069 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3424/6751] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:10 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:11.948003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c6de2b9e-f37c-4f10-a838-0b862c8a1d08 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:11.948626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c6de2b9e-f37c-4f10-a838-0b862c8a1d08 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:11.952040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=34 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:11.956087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-86549777-b32d-431b-ac2d-906ddeb9843f req-4c3cdab4-3b9e-4c7f-9800-c9078ecf16c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d9bcca-0270-494c-babc-af546bdd6490", "name": "network-vif-unplugged", "status": "completed", "tag": "cf08e09e-ade7-4682-91a0-439f0250276e"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:11.957881 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c6de2b9e-f37c-4f10-a838-0b862c8a1d08 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:11.958332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c6de2b9e-f37c-4f10-a838-0b862c8a1d08 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:11.959379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c6de2b9e-f37c-4f10-a838-0b862c8a1d08 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:11.959928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c6de2b9e-f37c-4f10-a838-0b862c8a1d08 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:11.965572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-86549777-b32d-431b-ac2d-906ddeb9843f req-4c3cdab4-3b9e-4c7f-9800-c9078ecf16c3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:11.966210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-86549777-b32d-431b-ac2d-906ddeb9843f req-4c3cdab4-3b9e-4c7f-9800-c9078ecf16c3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:11.969092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:11.980574 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-86549777-b32d-431b-ac2d-906ddeb9843f req-4c3cdab4-3b9e-4c7f-9800-c9078ecf16c3 service nova] Creating event network-vif-unplugged:cf08e09e-ade7-4682-91a0-439f0250276e for instance d7d9bcca-0270-494c-babc-af546bdd6490 on n-h2-764485-11 Jul 20 05:07:11.987014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-86549777-b32d-431b-ac2d-906ddeb9843f req-4c3cdab4-3b9e-4c7f-9800-c9078ecf16c3 service nova] Instance d7d9bcca-0270-494c-babc-af546bdd6490 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:07:11.998576 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-86549777-b32d-431b-ac2d-906ddeb9843f req-4c3cdab4-3b9e-4c7f-9800-c9078ecf16c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046952 Jul 20 05:07:11.999616 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3425/6752] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:12.219347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c6de2b9e-f37c-4f10-a838-0b862c8a1d08 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:12.227289 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c6de2b9e-f37c-4f10-a838-0b862c8a1d08 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1515 microversion: 2.1 time: 0.283305 Jul 20 05:07:12.227924 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3328/6753] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:11 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1515 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:13.247859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-94ff7695-889b-4bc9-a1ea-815ee0cd9f07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:13.248503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-94ff7695-889b-4bc9-a1ea-815ee0cd9f07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:13.254791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94ff7695-889b-4bc9-a1ea-815ee0cd9f07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:13.255259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94ff7695-889b-4bc9-a1ea-815ee0cd9f07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:13.256055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94ff7695-889b-4bc9-a1ea-815ee0cd9f07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:13.256513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94ff7695-889b-4bc9-a1ea-815ee0cd9f07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:13.393463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-94ff7695-889b-4bc9-a1ea-815ee0cd9f07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:13.401403 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-94ff7695-889b-4bc9-a1ea-815ee0cd9f07 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1513 microversion: 2.1 time: 0.158931 Jul 20 05:07:13.401988 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3426/6754] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:13 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:14.015114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-545027c8-3213-494d-9555-cdaaa1935dec req-9a1c099e-5efb-420f-80a9-47c356a2a19f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d9bcca-0270-494c-babc-af546bdd6490", "tag": "cf08e09e-ade7-4682-91a0-439f0250276e"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:14.024051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-545027c8-3213-494d-9555-cdaaa1935dec req-9a1c099e-5efb-420f-80a9-47c356a2a19f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:14.024500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-545027c8-3213-494d-9555-cdaaa1935dec req-9a1c099e-5efb-420f-80a9-47c356a2a19f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:14.036579 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-545027c8-3213-494d-9555-cdaaa1935dec req-9a1c099e-5efb-420f-80a9-47c356a2a19f service nova] Creating event network-changed:cf08e09e-ade7-4682-91a0-439f0250276e for instance d7d9bcca-0270-494c-babc-af546bdd6490 on n-h2-764485-11 Jul 20 05:07:14.042171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-545027c8-3213-494d-9555-cdaaa1935dec req-9a1c099e-5efb-420f-80a9-47c356a2a19f service nova] Instance d7d9bcca-0270-494c-babc-af546bdd6490 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:07:14.052936 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-545027c8-3213-494d-9555-cdaaa1935dec req-9a1c099e-5efb-420f-80a9-47c356a2a19f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042471 Jul 20 05:07:14.053543 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3329/6755] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:14.419777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c8ead207-2b50-4053-84ab-76971ea8abb0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:14.420565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c8ead207-2b50-4053-84ab-76971ea8abb0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:14.427729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8ead207-2b50-4053-84ab-76971ea8abb0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:14.428188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8ead207-2b50-4053-84ab-76971ea8abb0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:14.428972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8ead207-2b50-4053-84ab-76971ea8abb0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:14.429429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c8ead207-2b50-4053-84ab-76971ea8abb0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:14.618078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c8ead207-2b50-4053-84ab-76971ea8abb0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:14.625778 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c8ead207-2b50-4053-84ab-76971ea8abb0 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1513 microversion: 2.1 time: 0.210419 Jul 20 05:07:14.626361 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3427/6756] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:14 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:15.644933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-df41b4ac-c36d-44a5-873b-d898540735d3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:15.645638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-df41b4ac-c36d-44a5-873b-d898540735d3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:15.651949 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df41b4ac-c36d-44a5-873b-d898540735d3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:15.652408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df41b4ac-c36d-44a5-873b-d898540735d3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:15.653175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df41b4ac-c36d-44a5-873b-d898540735d3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:15.653661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df41b4ac-c36d-44a5-873b-d898540735d3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:15.788562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-df41b4ac-c36d-44a5-873b-d898540735d3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:15.799565 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-df41b4ac-c36d-44a5-873b-d898540735d3 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1513 microversion: 2.1 time: 0.160311 Jul 20 05:07:15.800374 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3330/6757] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:15 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:16.816590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f9b22108-57ea-4c1b-a06f-48dfcdbab43b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:16.817226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f9b22108-57ea-4c1b-a06f-48dfcdbab43b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:16.824293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9b22108-57ea-4c1b-a06f-48dfcdbab43b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:16.824766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9b22108-57ea-4c1b-a06f-48dfcdbab43b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:16.825776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9b22108-57ea-4c1b-a06f-48dfcdbab43b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:16.826110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f9b22108-57ea-4c1b-a06f-48dfcdbab43b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:16.954557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f9b22108-57ea-4c1b-a06f-48dfcdbab43b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:16.962173 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f9b22108-57ea-4c1b-a06f-48dfcdbab43b tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1510 microversion: 2.1 time: 0.149554 Jul 20 05:07:16.962750 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3428/6758] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:16 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:16.979289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d059fee5-2dd0-4e3f-b35c-5af1bc833a43 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:16.979824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d059fee5-2dd0-4e3f-b35c-5af1bc833a43 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:16.987706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d059fee5-2dd0-4e3f-b35c-5af1bc833a43 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:16.988202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d059fee5-2dd0-4e3f-b35c-5af1bc833a43 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:16.988967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d059fee5-2dd0-4e3f-b35c-5af1bc833a43 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:16.989408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d059fee5-2dd0-4e3f-b35c-5af1bc833a43 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:17.016114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d059fee5-2dd0-4e3f-b35c-5af1bc833a43 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:07:17.066412 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.compute.api [None req-d059fee5-2dd0-4e3f-b35c-5af1bc833a43 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Found an unconfirmed migration during delete, id: 16, status: finished Jul 20 05:07:18.347558 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d059fee5-2dd0-4e3f-b35c-5af1bc833a43 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 204 len: 0 microversion: 2.1 time: 1.371801 Jul 20 05:07:18.348365 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3331/6759] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:07:16 2022] DELETE /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 0 bytes in 1373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:07:18.357799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39e320a4-7a67-41ad-9196-faf2eefc9fe9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:18.358968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-39e320a4-7a67-41ad-9196-faf2eefc9fe9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:18.366353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39e320a4-7a67-41ad-9196-faf2eefc9fe9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:18.366819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39e320a4-7a67-41ad-9196-faf2eefc9fe9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:18.367685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39e320a4-7a67-41ad-9196-faf2eefc9fe9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:18.368135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39e320a4-7a67-41ad-9196-faf2eefc9fe9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:18.505148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39e320a4-7a67-41ad-9196-faf2eefc9fe9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:18.513075 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39e320a4-7a67-41ad-9196-faf2eefc9fe9 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1502 microversion: 2.1 time: 0.160378 Jul 20 05:07:18.514159 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3429/6760] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:18 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:18.697188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-87dc498b-4fe8-43ee-8240-ea9eb34dee73 req-7debec1f-2cca-4839-a886-695b63d36895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d9bcca-0270-494c-babc-af546bdd6490", "name": "network-vif-plugged", "status": "completed", "tag": "cf08e09e-ade7-4682-91a0-439f0250276e"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:18.706216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-87dc498b-4fe8-43ee-8240-ea9eb34dee73 req-7debec1f-2cca-4839-a886-695b63d36895 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:18.706663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-87dc498b-4fe8-43ee-8240-ea9eb34dee73 req-7debec1f-2cca-4839-a886-695b63d36895 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:18.717948 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-87dc498b-4fe8-43ee-8240-ea9eb34dee73 req-7debec1f-2cca-4839-a886-695b63d36895 service nova] Creating event network-vif-plugged:cf08e09e-ade7-4682-91a0-439f0250276e for instance d7d9bcca-0270-494c-babc-af546bdd6490 on n-h2-764485-11 Jul 20 05:07:18.722791 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-87dc498b-4fe8-43ee-8240-ea9eb34dee73 req-7debec1f-2cca-4839-a886-695b63d36895 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029761 Jul 20 05:07:18.723399 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3332/6761] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:19.530138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0283504d-db7f-484d-b9b7-34096439d94f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:19.530766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0283504d-db7f-484d-b9b7-34096439d94f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:19.537679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0283504d-db7f-484d-b9b7-34096439d94f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:19.538143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0283504d-db7f-484d-b9b7-34096439d94f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:19.538912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0283504d-db7f-484d-b9b7-34096439d94f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:19.539360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0283504d-db7f-484d-b9b7-34096439d94f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:19.676991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0283504d-db7f-484d-b9b7-34096439d94f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d5cdc21d2b4a41b7bde9da79ab6ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78c3915560543239ab4cd15a0680c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:19.684585 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0283504d-db7f-484d-b9b7-34096439d94f tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 200 len: 1502 microversion: 2.1 time: 0.158619 Jul 20 05:07:19.685762 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3430/6762] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:19 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:20.354406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-239ffb6c-4731-4e60-a850-3464b82f09f3 req-06e65ce5-aa13-4658-92e1-6b4c0f3f5651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d9bcca-0270-494c-babc-af546bdd6490", "name": "network-vif-deleted", "tag": "cf08e09e-ade7-4682-91a0-439f0250276e"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:20.366074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-239ffb6c-4731-4e60-a850-3464b82f09f3 req-06e65ce5-aa13-4658-92e1-6b4c0f3f5651 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:20.366524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-239ffb6c-4731-4e60-a850-3464b82f09f3 req-06e65ce5-aa13-4658-92e1-6b4c0f3f5651 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:20.390474 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-239ffb6c-4731-4e60-a850-3464b82f09f3 req-06e65ce5-aa13-4658-92e1-6b4c0f3f5651 service nova] Creating event network-vif-deleted:cf08e09e-ade7-4682-91a0-439f0250276e for instance d7d9bcca-0270-494c-babc-af546bdd6490 on n-h2-764485-11 Jul 20 05:07:20.395602 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-239ffb6c-4731-4e60-a850-3464b82f09f3 req-06e65ce5-aa13-4658-92e1-6b4c0f3f5651 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046860 Jul 20 05:07:20.396234 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3333/6763] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:20.702457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a1a75e2-8f0f-40b3-a9a2-89cb9f3c1bd6 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:20.702976 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3a1a75e2-8f0f-40b3-a9a2-89cb9f3c1bd6 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:20.709880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a1a75e2-8f0f-40b3-a9a2-89cb9f3c1bd6 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:20.710342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a1a75e2-8f0f-40b3-a9a2-89cb9f3c1bd6 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:20.711118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a1a75e2-8f0f-40b3-a9a2-89cb9f3c1bd6 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:20.711593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3a1a75e2-8f0f-40b3-a9a2-89cb9f3c1bd6 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:20.724786 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-3a1a75e2-8f0f-40b3-a9a2-89cb9f3c1bd6 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] HTTP exception thrown: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a1a75e2-8f0f-40b3-a9a2-89cb9f3c1bd6 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Request method failure captured: Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 HTTP/1.1 Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi141VVqvtVEAQLIic0Ey1Cr3AdezOvB61FhjEi6_JUG3jNpwZWUi4c6FfsPGAyFyTsSfiNV2_70tYzfy4AOWQUhCJjIvdqE1OHD1nuhhv-rKudxvUXiUABGd9pu_vZMWBaWF9N5jvccJMetCPoKEROU6fvMfZLQ64151NenB9gvyalpg Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: b78c3915560543239ab4cd15a0680c4d Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-1391262337 Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b78c3915560543239ab4cd15a0680c4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b78c3915560543239ab4cd15a0680c4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b78c3915560543239ab4cd15a0680c4d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b78c3915560543239ab4cd15a0680c4d"}]}] Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-1391262337 Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: b78c3915560543239ab4cd15a0680c4d Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-1391262337 Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-1391262337-project Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: f4d5cdc21d2b4a41b7bde9da79ab6ef2 Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-1391262337-project Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'd7d9bcca-0270-494c-babc-af546bdd6490'} Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:20.726442 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.730635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:20.730635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:20.730635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:20.730635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:07:20.730635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:07:20.730635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.730635 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.730635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3a1a75e2-8f0f-40b3-a9a2-89cb9f3c1bd6 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Returning 404 to user: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:07:20.730635 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3a1a75e2-8f0f-40b3-a9a2-89cb9f3c1bd6 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 404 len: 111 microversion: 2.1 time: 0.030163 Jul 20 05:07:20.730635 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3431/6764] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:20 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:07:20.745101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7b6792f-b394-4617-974f-15906d1171fb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:20.745701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c7b6792f-b394-4617-974f-15906d1171fb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:20.752953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7b6792f-b394-4617-974f-15906d1171fb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:20.753411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7b6792f-b394-4617-974f-15906d1171fb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:20.754194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7b6792f-b394-4617-974f-15906d1171fb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:20.754646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7b6792f-b394-4617-974f-15906d1171fb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:20.768708 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-c7b6792f-b394-4617-974f-15906d1171fb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] HTTP exception thrown: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7b6792f-b394-4617-974f-15906d1171fb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Request method failure captured: Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 HTTP/1.1 Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi141VVqvtVEAQLIic0Ey1Cr3AdezOvB61FhjEi6_JUG3jNpwZWUi4c6FfsPGAyFyTsSfiNV2_70tYzfy4AOWQUhCJjIvdqE1OHD1nuhhv-rKudxvUXiUABGd9pu_vZMWBaWF9N5jvccJMetCPoKEROU6fvMfZLQ64151NenB9gvyalpg Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: b78c3915560543239ab4cd15a0680c4d Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-DeleteServersTestJSON-1391262337 Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b78c3915560543239ab4cd15a0680c4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b78c3915560543239ab4cd15a0680c4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b78c3915560543239ab4cd15a0680c4d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b78c3915560543239ab4cd15a0680c4d"}]}] Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-DeleteServersTestJSON-1391262337 Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: b78c3915560543239ab4cd15a0680c4d Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1391262337 Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-DeleteServersTestJSON-1391262337-project Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: f4d5cdc21d2b4a41b7bde9da79ab6ef2 Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-DeleteServersTestJSON-1391262337-project Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'd7d9bcca-0270-494c-babc-af546bdd6490'} Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:07:20.770392 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7b6792f-b394-4617-974f-15906d1171fb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Returning 404 to user: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c7b6792f-b394-4617-974f-15906d1171fb tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 404 len: 111 microversion: 2.1 time: 0.030965 Jul 20 05:07:20.774238 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3334/6765] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:07:20 2022] DELETE /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:07:20.780251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e4d52b0e-1bef-4b51-84ab-f02ee525d999 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:20.780892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e4d52b0e-1bef-4b51-84ab-f02ee525d999 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] [instance: d7d9bcca-0270-494c-babc-af546bdd6490] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:20.786986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e4d52b0e-1bef-4b51-84ab-f02ee525d999 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:20.787461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e4d52b0e-1bef-4b51-84ab-f02ee525d999 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:20.788272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e4d52b0e-1bef-4b51-84ab-f02ee525d999 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:20.788732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e4d52b0e-1bef-4b51-84ab-f02ee525d999 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:20.802053 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-e4d52b0e-1bef-4b51-84ab-f02ee525d999 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] HTTP exception thrown: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e4d52b0e-1bef-4b51-84ab-f02ee525d999 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Request method failure captured: Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 HTTP/1.1 Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi141VVqvtVEAQLIic0Ey1Cr3AdezOvB61FhjEi6_JUG3jNpwZWUi4c6FfsPGAyFyTsSfiNV2_70tYzfy4AOWQUhCJjIvdqE1OHD1nuhhv-rKudxvUXiUABGd9pu_vZMWBaWF9N5jvccJMetCPoKEROU6fvMfZLQ64151NenB9gvyalpg Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: b78c3915560543239ab4cd15a0680c4d Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-DeleteServersTestJSON-1391262337 Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b78c3915560543239ab4cd15a0680c4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b78c3915560543239ab4cd15a0680c4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b78c3915560543239ab4cd15a0680c4d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b78c3915560543239ab4cd15a0680c4d"}]}] Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-DeleteServersTestJSON-1391262337 Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: b78c3915560543239ab4cd15a0680c4d Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-DeleteServersTestJSON-1391262337 Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-DeleteServersTestJSON-1391262337-project Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: f4d5cdc21d2b4a41b7bde9da79ab6ef2 Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-DeleteServersTestJSON-1391262337-project Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'd7d9bcca-0270-494c-babc-af546bdd6490'} Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:20.803621 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.811189 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:20.811189 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:20.811189 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:20.811189 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:07:20.811189 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:07:20.811189 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. Jul 20 05:07:20.811189 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:07:20.811189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e4d52b0e-1bef-4b51-84ab-f02ee525d999 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] Returning 404 to user: Instance d7d9bcca-0270-494c-babc-af546bdd6490 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:07:20.811189 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e4d52b0e-1bef-4b51-84ab-f02ee525d999 tempest-DeleteServersTestJSON-1391262337 tempest-DeleteServersTestJSON-1391262337-project] 10.222.0.20 "GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490" status: 404 len: 111 microversion: 2.1 time: 0.028646 Jul 20 05:07:20.811189 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3432/6766] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:20 2022] GET /compute/v2.1/servers/d7d9bcca-0270-494c-babc-af546bdd6490 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:07:29.329230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1850522897", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "45a0eee9-f206-45b6-a8b5-e70f2de5ff84"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:29.386795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] validate_networks() for [('45a0eee9-f206-45b6-a8b5-e70f2de5ff84', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:07:30.165709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:07:30.166143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:07:30.166840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:07:30.167263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:07:30.167918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:07:30.179201 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:30.179698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:30.180518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:30.180962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:30.202917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Getting quotas for project 3f1932f069dc4d738cfd389a2e6c0aa6. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:07:30.211364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Getting quotas for user d0fe0f8c44d7407a903b4b5f4e644c5b and project 3f1932f069dc4d738cfd389a2e6c0aa6. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:07:30.229412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:07:30.238379 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:07:30.287711 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5537974f-8a8b-4854-9a5b-191969eb799a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091031 Jul 20 05:07:30.288585 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3335/6767] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:07:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:07:30.299135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-63c8b25f-4150-4d72-8d26-0d3794e674ba tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:30.300095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-63c8b25f-4150-4d72-8d26-0d3794e674ba tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:30.357727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-63c8b25f-4150-4d72-8d26-0d3794e674ba tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:30.365697 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-63c8b25f-4150-4d72-8d26-0d3794e674ba tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1218 microversion: 2.1 time: 0.070587 Jul 20 05:07:30.366518 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3433/6768] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:30 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:31.385198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-01f6c840-556c-47bf-99a1-70f386ca4925 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:31.385817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-01f6c840-556c-47bf-99a1-70f386ca4925 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:31.394328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01f6c840-556c-47bf-99a1-70f386ca4925 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:31.394993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01f6c840-556c-47bf-99a1-70f386ca4925 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:31.395966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01f6c840-556c-47bf-99a1-70f386ca4925 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:31.396829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01f6c840-556c-47bf-99a1-70f386ca4925 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:31.494760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-01f6c840-556c-47bf-99a1-70f386ca4925 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:31.502867 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-01f6c840-556c-47bf-99a1-70f386ca4925 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1288 microversion: 2.1 time: 0.122356 Jul 20 05:07:31.503464 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3336/6769] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:31 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1288 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:32.521695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-23564986-3fce-47a0-909f-1cdc5881496b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:32.522957 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-23564986-3fce-47a0-909f-1cdc5881496b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:32.525290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=43 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:32.538699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23564986-3fce-47a0-909f-1cdc5881496b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:32.539401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23564986-3fce-47a0-909f-1cdc5881496b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:32.540662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23564986-3fce-47a0-909f-1cdc5881496b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:32.541188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-23564986-3fce-47a0-909f-1cdc5881496b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:32.838316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-23564986-3fce-47a0-909f-1cdc5881496b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:32.850786 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-23564986-3fce-47a0-909f-1cdc5881496b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1318 microversion: 2.1 time: 0.331193 Jul 20 05:07:32.851607 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3434/6770] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:32 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:33.060687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a0cc40a0-f58a-4260-b750-34cb594bc837 req-0a33ff76-b52b-49e3-ae58-d2768a0cd423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a1cea38-f807-48e1-874e-bcc8bee325b6", "tag": "a56594fe-e308-4695-94ed-c9ac5e887ffd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:33.070305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a0cc40a0-f58a-4260-b750-34cb594bc837 req-0a33ff76-b52b-49e3-ae58-d2768a0cd423 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:33.070679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a0cc40a0-f58a-4260-b750-34cb594bc837 req-0a33ff76-b52b-49e3-ae58-d2768a0cd423 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:33.084401 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a0cc40a0-f58a-4260-b750-34cb594bc837 req-0a33ff76-b52b-49e3-ae58-d2768a0cd423 service nova] Creating event network-changed:a56594fe-e308-4695-94ed-c9ac5e887ffd for instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 on n-h2-764485-11 Jul 20 05:07:33.089438 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a0cc40a0-f58a-4260-b750-34cb594bc837 req-0a33ff76-b52b-49e3-ae58-d2768a0cd423 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137428 Jul 20 05:07:33.090925 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3337/6771] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:33.869580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-de4237d8-bb25-4902-bdf3-62dfb1249557 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:33.870296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-de4237d8-bb25-4902-bdf3-62dfb1249557 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:33.878330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de4237d8-bb25-4902-bdf3-62dfb1249557 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:33.878803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de4237d8-bb25-4902-bdf3-62dfb1249557 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:33.879626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de4237d8-bb25-4902-bdf3-62dfb1249557 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:33.880087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-de4237d8-bb25-4902-bdf3-62dfb1249557 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:34.021817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-de4237d8-bb25-4902-bdf3-62dfb1249557 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:34.029449 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-de4237d8-bb25-4902-bdf3-62dfb1249557 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1318 microversion: 2.1 time: 0.164144 Jul 20 05:07:34.030283 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3435/6772] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:33 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:35.046730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bf01ff6a-f0fa-4096-96b9-e10caf4dddfd tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:35.047441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bf01ff6a-f0fa-4096-96b9-e10caf4dddfd tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:35.054260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf01ff6a-f0fa-4096-96b9-e10caf4dddfd tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:35.054719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf01ff6a-f0fa-4096-96b9-e10caf4dddfd tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:35.055494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf01ff6a-f0fa-4096-96b9-e10caf4dddfd tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:35.055963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bf01ff6a-f0fa-4096-96b9-e10caf4dddfd tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:35.187408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bf01ff6a-f0fa-4096-96b9-e10caf4dddfd tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:35.195147 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bf01ff6a-f0fa-4096-96b9-e10caf4dddfd tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1318 microversion: 2.1 time: 0.152771 Jul 20 05:07:35.195693 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3338/6773] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:35 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:36.212550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f54a2bca-fa68-41fd-9903-2029247ff940 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:36.213179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f54a2bca-fa68-41fd-9903-2029247ff940 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:36.220859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f54a2bca-fa68-41fd-9903-2029247ff940 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:36.221326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f54a2bca-fa68-41fd-9903-2029247ff940 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:36.222098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f54a2bca-fa68-41fd-9903-2029247ff940 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:36.222555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f54a2bca-fa68-41fd-9903-2029247ff940 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:36.349071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f54a2bca-fa68-41fd-9903-2029247ff940 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:36.356540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f54a2bca-fa68-41fd-9903-2029247ff940 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1318 microversion: 2.1 time: 0.147875 Jul 20 05:07:36.357103 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3436/6774] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:36 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:37.374928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7b58bd6-4126-4da8-a80b-6c6f1a15bd6a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:37.375578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c7b58bd6-4126-4da8-a80b-6c6f1a15bd6a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:37.382657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7b58bd6-4126-4da8-a80b-6c6f1a15bd6a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:37.383059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7b58bd6-4126-4da8-a80b-6c6f1a15bd6a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:37.383871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7b58bd6-4126-4da8-a80b-6c6f1a15bd6a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:37.384320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7b58bd6-4126-4da8-a80b-6c6f1a15bd6a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:37.518503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c7b58bd6-4126-4da8-a80b-6c6f1a15bd6a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:37.526163 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c7b58bd6-4126-4da8-a80b-6c6f1a15bd6a tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1318 microversion: 2.1 time: 0.156109 Jul 20 05:07:37.526755 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3339/6775] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:37 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:38.544213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f576c1a9-7d93-46bf-98e8-2c6045ca6ba0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:38.544851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f576c1a9-7d93-46bf-98e8-2c6045ca6ba0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:38.551564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f576c1a9-7d93-46bf-98e8-2c6045ca6ba0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:38.552044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f576c1a9-7d93-46bf-98e8-2c6045ca6ba0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:38.552836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f576c1a9-7d93-46bf-98e8-2c6045ca6ba0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:38.553300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f576c1a9-7d93-46bf-98e8-2c6045ca6ba0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:38.691729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f576c1a9-7d93-46bf-98e8-2c6045ca6ba0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:38.699433 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f576c1a9-7d93-46bf-98e8-2c6045ca6ba0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1318 microversion: 2.1 time: 0.159395 Jul 20 05:07:38.700295 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3437/6776] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:38 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:38.793291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8ed6cb24-2ff4-423c-bc87-5ee362fbc199 req-824241ec-50bd-40b8-99cb-03c139c0a7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a1cea38-f807-48e1-874e-bcc8bee325b6", "name": "network-vif-plugged", "status": "completed", "tag": "a56594fe-e308-4695-94ed-c9ac5e887ffd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:38.803808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8ed6cb24-2ff4-423c-bc87-5ee362fbc199 req-824241ec-50bd-40b8-99cb-03c139c0a7a4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:38.804397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8ed6cb24-2ff4-423c-bc87-5ee362fbc199 req-824241ec-50bd-40b8-99cb-03c139c0a7a4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:38.817161 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8ed6cb24-2ff4-423c-bc87-5ee362fbc199 req-824241ec-50bd-40b8-99cb-03c139c0a7a4 service nova] Creating event network-vif-plugged:a56594fe-e308-4695-94ed-c9ac5e887ffd for instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 on n-h2-764485-11 Jul 20 05:07:38.822317 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8ed6cb24-2ff4-423c-bc87-5ee362fbc199 req-824241ec-50bd-40b8-99cb-03c139c0a7a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032669 Jul 20 05:07:38.822960 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3340/6777] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:39.717459 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57cf6e52-220f-47c1-8c2f-2ed95009a82b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:39.718097 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-57cf6e52-220f-47c1-8c2f-2ed95009a82b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:39.725035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57cf6e52-220f-47c1-8c2f-2ed95009a82b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:39.725498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57cf6e52-220f-47c1-8c2f-2ed95009a82b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:39.726266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57cf6e52-220f-47c1-8c2f-2ed95009a82b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:39.726718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57cf6e52-220f-47c1-8c2f-2ed95009a82b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:39.860452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-57cf6e52-220f-47c1-8c2f-2ed95009a82b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:39.867998 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57cf6e52-220f-47c1-8c2f-2ed95009a82b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1318 microversion: 2.1 time: 0.154698 Jul 20 05:07:39.868506 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3438/6778] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:39 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:40.883474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:40.884314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:40.889304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7bc55ca5-c496-4cb2-8af5-3f6f1b9e069d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:40.889964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7bc55ca5-c496-4cb2-8af5-3f6f1b9e069d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:40.897193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bc55ca5-c496-4cb2-8af5-3f6f1b9e069d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:40.897650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bc55ca5-c496-4cb2-8af5-3f6f1b9e069d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:40.898427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bc55ca5-c496-4cb2-8af5-3f6f1b9e069d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:40.898873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bc55ca5-c496-4cb2-8af5-3f6f1b9e069d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.028883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7bc55ca5-c496-4cb2-8af5-3f6f1b9e069d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:41.037167 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7bc55ca5-c496-4cb2-8af5-3f6f1b9e069d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1509 microversion: 2.1 time: 0.155482 Jul 20 05:07:41.037741 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3341/6779] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:40 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:41.053932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dfdaa6c2-4121-4a60-ad53-eb634a2ab398 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:41.054568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dfdaa6c2-4121-4a60-ad53-eb634a2ab398 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:41.056502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:41.058296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=32 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:41.064706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dfdaa6c2-4121-4a60-ad53-eb634a2ab398 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.065124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dfdaa6c2-4121-4a60-ad53-eb634a2ab398 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.065914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dfdaa6c2-4121-4a60-ad53-eb634a2ab398 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.066375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dfdaa6c2-4121-4a60-ad53-eb634a2ab398 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.197814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dfdaa6c2-4121-4a60-ad53-eb634a2ab398 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:41.205888 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dfdaa6c2-4121-4a60-ad53-eb634a2ab398 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1509 microversion: 2.1 time: 0.155839 Jul 20 05:07:41.206468 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3439/6780] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:41 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:41.222372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-799c5fa0-2bfc-4db7-b8ff-aecd67f77592 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:41.223538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-799c5fa0-2bfc-4db7-b8ff-aecd67f77592 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:41.229723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-799c5fa0-2bfc-4db7-b8ff-aecd67f77592 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.230186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-799c5fa0-2bfc-4db7-b8ff-aecd67f77592 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.230965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-799c5fa0-2bfc-4db7-b8ff-aecd67f77592 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.231409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-799c5fa0-2bfc-4db7-b8ff-aecd67f77592 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.296782 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-799c5fa0-2bfc-4db7-b8ff-aecd67f77592 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "PUT /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1081 microversion: 2.1 time: 0.078343 Jul 20 05:07:41.297432 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3342/6781] 10.222.0.20 () {60 vars in 1255 bytes} [Wed Jul 20 05:07:41 2022] PUT /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1081 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:41.311337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-906743f4-6404-4399-a61e-5834b083a259 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:41.312029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-906743f4-6404-4399-a61e-5834b083a259 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:41.318133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-906743f4-6404-4399-a61e-5834b083a259 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.318536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-906743f4-6404-4399-a61e-5834b083a259 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.319307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-906743f4-6404-4399-a61e-5834b083a259 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.319779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-906743f4-6404-4399-a61e-5834b083a259 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.447466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-906743f4-6404-4399-a61e-5834b083a259 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:41.455930 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-906743f4-6404-4399-a61e-5834b083a259 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1507 microversion: 2.1 time: 0.148539 Jul 20 05:07:41.456508 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3440/6782] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:41 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:41.472382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e5e886e5-95a4-4d03-be2f-60c10c394fb5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:41.473006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e5e886e5-95a4-4d03-be2f-60c10c394fb5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:41.479349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5e886e5-95a4-4d03-be2f-60c10c394fb5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.479839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5e886e5-95a4-4d03-be2f-60c10c394fb5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.480618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5e886e5-95a4-4d03-be2f-60c10c394fb5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.481071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e5e886e5-95a4-4d03-be2f-60c10c394fb5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.615556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e5e886e5-95a4-4d03-be2f-60c10c394fb5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:41.624083 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e5e886e5-95a4-4d03-be2f-60c10c394fb5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1507 microversion: 2.1 time: 0.154972 Jul 20 05:07:41.625071 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3343/6783] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:41 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:41.641897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:41.642988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:41.649152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.649622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.650398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.650859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.725897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:41.731687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Old instance type m1.heat2, new instance type m1.heat {{(pid=119808) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:07:41.738639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:07:41.739086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:07:41.739612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:07:41.740051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:07:41.740485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:07:41.852919 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d2ad0efe-4349-460e-a790-7f0ba1067082 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "POST /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6/action" status: 202 len: 0 microversion: 2.1 time: 0.215893 Jul 20 05:07:41.853542 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3441/6784] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:07:41 2022] POST /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:07:41.863193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac2237ea-88aa-4177-838c-6349303e4acb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:41.863763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac2237ea-88aa-4177-838c-6349303e4acb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:41.869814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac2237ea-88aa-4177-838c-6349303e4acb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.870294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac2237ea-88aa-4177-838c-6349303e4acb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.871050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac2237ea-88aa-4177-838c-6349303e4acb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.871491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac2237ea-88aa-4177-838c-6349303e4acb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:42.009279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ac2237ea-88aa-4177-838c-6349303e4acb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:42.011763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:42.020098 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ac2237ea-88aa-4177-838c-6349303e4acb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1518 microversion: 2.1 time: 0.162342 Jul 20 05:07:42.020919 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3344/6785] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:41 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:43.038926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5af92247-94b1-400f-a5d0-45e6d5fcb848 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:43.039612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5af92247-94b1-400f-a5d0-45e6d5fcb848 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:43.046417 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5af92247-94b1-400f-a5d0-45e6d5fcb848 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:43.046893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5af92247-94b1-400f-a5d0-45e6d5fcb848 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:43.047721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5af92247-94b1-400f-a5d0-45e6d5fcb848 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:43.048188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5af92247-94b1-400f-a5d0-45e6d5fcb848 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:43.224543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5af92247-94b1-400f-a5d0-45e6d5fcb848 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:43.232296 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5af92247-94b1-400f-a5d0-45e6d5fcb848 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1518 microversion: 2.1 time: 0.198097 Jul 20 05:07:43.233119 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3442/6786] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:43 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:44.250744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5e59fcb7-1c86-49f1-bdd0-447642af98d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:44.251357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5e59fcb7-1c86-49f1-bdd0-447642af98d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:44.254022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:44.261682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e59fcb7-1c86-49f1-bdd0-447642af98d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:44.262135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e59fcb7-1c86-49f1-bdd0-447642af98d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:44.262937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e59fcb7-1c86-49f1-bdd0-447642af98d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:44.263371 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e59fcb7-1c86-49f1-bdd0-447642af98d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:44.400710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5e59fcb7-1c86-49f1-bdd0-447642af98d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:44.408537 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5e59fcb7-1c86-49f1-bdd0-447642af98d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.162353 Jul 20 05:07:44.409113 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3345/6787] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:44 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:45.425678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2084fe8a-f4fb-4409-9a40-00e7fb8ff481 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:45.426215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2084fe8a-f4fb-4409-9a40-00e7fb8ff481 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:45.433145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2084fe8a-f4fb-4409-9a40-00e7fb8ff481 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:45.433603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2084fe8a-f4fb-4409-9a40-00e7fb8ff481 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:45.434372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2084fe8a-f4fb-4409-9a40-00e7fb8ff481 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:45.434822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2084fe8a-f4fb-4409-9a40-00e7fb8ff481 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:45.568111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2084fe8a-f4fb-4409-9a40-00e7fb8ff481 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:45.575922 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2084fe8a-f4fb-4409-9a40-00e7fb8ff481 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.154170 Jul 20 05:07:45.576751 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3443/6788] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:45 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:46.593357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b449b472-12eb-4b85-99b7-65d8f1505612 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:46.593979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b449b472-12eb-4b85-99b7-65d8f1505612 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:46.601012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b449b472-12eb-4b85-99b7-65d8f1505612 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:46.601468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b449b472-12eb-4b85-99b7-65d8f1505612 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:46.602239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b449b472-12eb-4b85-99b7-65d8f1505612 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:46.602683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b449b472-12eb-4b85-99b7-65d8f1505612 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:46.737029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b449b472-12eb-4b85-99b7-65d8f1505612 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:46.744876 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b449b472-12eb-4b85-99b7-65d8f1505612 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.155426 Jul 20 05:07:46.745463 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3346/6789] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:46 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:47.761889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-46481773-b0d6-4be9-aa57-a2cd7698dfbb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:47.762569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-46481773-b0d6-4be9-aa57-a2cd7698dfbb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:47.770560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46481773-b0d6-4be9-aa57-a2cd7698dfbb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:47.771028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46481773-b0d6-4be9-aa57-a2cd7698dfbb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:47.771843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46481773-b0d6-4be9-aa57-a2cd7698dfbb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:47.772300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46481773-b0d6-4be9-aa57-a2cd7698dfbb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:47.901390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-46481773-b0d6-4be9-aa57-a2cd7698dfbb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:47.909368 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-46481773-b0d6-4be9-aa57-a2cd7698dfbb tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.151412 Jul 20 05:07:47.909948 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3444/6790] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:47 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:48.926268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a7d857dd-87b4-4141-8008-0f9408db8506 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:48.926923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a7d857dd-87b4-4141-8008-0f9408db8506 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:48.934088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d857dd-87b4-4141-8008-0f9408db8506 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:48.934557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d857dd-87b4-4141-8008-0f9408db8506 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:48.935332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d857dd-87b4-4141-8008-0f9408db8506 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:48.935810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a7d857dd-87b4-4141-8008-0f9408db8506 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:49.070858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a7d857dd-87b4-4141-8008-0f9408db8506 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:49.079143 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a7d857dd-87b4-4141-8008-0f9408db8506 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.156811 Jul 20 05:07:49.079761 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3347/6791] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:48 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:50.097098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e38eaeed-a138-4d6c-b8a6-296ef07c3f97 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:50.097657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e38eaeed-a138-4d6c-b8a6-296ef07c3f97 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:50.104633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e38eaeed-a138-4d6c-b8a6-296ef07c3f97 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:50.105105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e38eaeed-a138-4d6c-b8a6-296ef07c3f97 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:50.105890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e38eaeed-a138-4d6c-b8a6-296ef07c3f97 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:50.106356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e38eaeed-a138-4d6c-b8a6-296ef07c3f97 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:50.236469 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e38eaeed-a138-4d6c-b8a6-296ef07c3f97 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:50.244203 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e38eaeed-a138-4d6c-b8a6-296ef07c3f97 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.152007 Jul 20 05:07:50.244786 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3445/6792] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:50 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:51.261726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7f2d41f5-ff72-4975-8b23-6e0e2ad18f87 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:51.262346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7f2d41f5-ff72-4975-8b23-6e0e2ad18f87 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:51.270462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f2d41f5-ff72-4975-8b23-6e0e2ad18f87 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:51.270924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f2d41f5-ff72-4975-8b23-6e0e2ad18f87 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:51.271736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f2d41f5-ff72-4975-8b23-6e0e2ad18f87 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:51.272183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f2d41f5-ff72-4975-8b23-6e0e2ad18f87 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:51.402566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7f2d41f5-ff72-4975-8b23-6e0e2ad18f87 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:51.410302 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7f2d41f5-ff72-4975-8b23-6e0e2ad18f87 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.152589 Jul 20 05:07:51.410925 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3348/6793] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:51 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:52.426895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9be3f317-e23a-45ec-900b-57125870e6c5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:52.427452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9be3f317-e23a-45ec-900b-57125870e6c5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:52.434582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9be3f317-e23a-45ec-900b-57125870e6c5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:52.435053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9be3f317-e23a-45ec-900b-57125870e6c5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:52.435868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9be3f317-e23a-45ec-900b-57125870e6c5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:52.436332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9be3f317-e23a-45ec-900b-57125870e6c5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:52.573802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9be3f317-e23a-45ec-900b-57125870e6c5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:52.581950 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9be3f317-e23a-45ec-900b-57125870e6c5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.159054 Jul 20 05:07:52.582573 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3446/6794] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:52 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:53.600130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-24eac697-b4cb-4e9e-98cf-0dc0caed3281 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:53.600755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-24eac697-b4cb-4e9e-98cf-0dc0caed3281 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:53.607845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24eac697-b4cb-4e9e-98cf-0dc0caed3281 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:53.608301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24eac697-b4cb-4e9e-98cf-0dc0caed3281 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:53.610576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24eac697-b4cb-4e9e-98cf-0dc0caed3281 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:53.611030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24eac697-b4cb-4e9e-98cf-0dc0caed3281 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:53.742627 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-24eac697-b4cb-4e9e-98cf-0dc0caed3281 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:53.750381 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-24eac697-b4cb-4e9e-98cf-0dc0caed3281 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.154272 Jul 20 05:07:53.750966 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3349/6795] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:53 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:54.767356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f31a34e7-3dd6-46c8-8245-7e1a9b341221 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:54.768014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f31a34e7-3dd6-46c8-8245-7e1a9b341221 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:54.774968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f31a34e7-3dd6-46c8-8245-7e1a9b341221 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:54.775438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f31a34e7-3dd6-46c8-8245-7e1a9b341221 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:54.776252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f31a34e7-3dd6-46c8-8245-7e1a9b341221 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:54.776710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f31a34e7-3dd6-46c8-8245-7e1a9b341221 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:54.912463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f31a34e7-3dd6-46c8-8245-7e1a9b341221 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:54.920135 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f31a34e7-3dd6-46c8-8245-7e1a9b341221 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.156724 Jul 20 05:07:54.920718 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3447/6796] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:54 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:55.938007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8f2d7064-2110-4140-bba8-8a6494758fe5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:55.938548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8f2d7064-2110-4140-bba8-8a6494758fe5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:55.945500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f2d7064-2110-4140-bba8-8a6494758fe5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:55.945951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f2d7064-2110-4140-bba8-8a6494758fe5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:55.946714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f2d7064-2110-4140-bba8-8a6494758fe5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:55.947151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8f2d7064-2110-4140-bba8-8a6494758fe5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:56.075864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8f2d7064-2110-4140-bba8-8a6494758fe5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:56.084017 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8f2d7064-2110-4140-bba8-8a6494758fe5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.150602 Jul 20 05:07:56.084595 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3350/6797] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:55 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:57.101366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c748ddd-3d5a-4b82-ad95-a7e5f09b67aa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:57.102000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0c748ddd-3d5a-4b82-ad95-a7e5f09b67aa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:57.110146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c748ddd-3d5a-4b82-ad95-a7e5f09b67aa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:57.110620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c748ddd-3d5a-4b82-ad95-a7e5f09b67aa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:57.111522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c748ddd-3d5a-4b82-ad95-a7e5f09b67aa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:57.112282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c748ddd-3d5a-4b82-ad95-a7e5f09b67aa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:57.242282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0c748ddd-3d5a-4b82-ad95-a7e5f09b67aa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:57.250399 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0c748ddd-3d5a-4b82-ad95-a7e5f09b67aa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.152956 Jul 20 05:07:57.250991 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3448/6798] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:57 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:58.268029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dda73f3d-0ba7-4a81-aaeb-1faf13ecde11 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:58.268656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dda73f3d-0ba7-4a81-aaeb-1faf13ecde11 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:58.275803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dda73f3d-0ba7-4a81-aaeb-1faf13ecde11 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:58.276269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dda73f3d-0ba7-4a81-aaeb-1faf13ecde11 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:58.277043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dda73f3d-0ba7-4a81-aaeb-1faf13ecde11 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:58.277485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dda73f3d-0ba7-4a81-aaeb-1faf13ecde11 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:58.411537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dda73f3d-0ba7-4a81-aaeb-1faf13ecde11 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:58.419100 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dda73f3d-0ba7-4a81-aaeb-1faf13ecde11 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.155390 Jul 20 05:07:58.419704 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3351/6799] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:58 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:59.437420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ccd09580-b107-4fd7-892d-2b15e767e8d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:59.438109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ccd09580-b107-4fd7-892d-2b15e767e8d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:59.445242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ccd09580-b107-4fd7-892d-2b15e767e8d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:59.445649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ccd09580-b107-4fd7-892d-2b15e767e8d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:59.446420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ccd09580-b107-4fd7-892d-2b15e767e8d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:59.446873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ccd09580-b107-4fd7-892d-2b15e767e8d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:59.450750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:59.581810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ccd09580-b107-4fd7-892d-2b15e767e8d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:59.589425 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ccd09580-b107-4fd7-892d-2b15e767e8d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.156784 Jul 20 05:07:59.590111 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3449/6800] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:59 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:00.607128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5483b7bb-e45e-4511-be7e-4dd9e5faebae tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:00.607775 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5483b7bb-e45e-4511-be7e-4dd9e5faebae tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:00.615207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5483b7bb-e45e-4511-be7e-4dd9e5faebae tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:00.615704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5483b7bb-e45e-4511-be7e-4dd9e5faebae tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:00.616472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5483b7bb-e45e-4511-be7e-4dd9e5faebae tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:00.616912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5483b7bb-e45e-4511-be7e-4dd9e5faebae tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:00.749974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5483b7bb-e45e-4511-be7e-4dd9e5faebae tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:00.757574 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5483b7bb-e45e-4511-be7e-4dd9e5faebae tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.154323 Jul 20 05:08:00.758155 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3352/6801] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:00 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:01.774310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7c03ace5-ba2d-49ab-b8d8-d6b9b8643aba tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:01.774941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7c03ace5-ba2d-49ab-b8d8-d6b9b8643aba tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:01.782519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7c03ace5-ba2d-49ab-b8d8-d6b9b8643aba tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:01.782986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7c03ace5-ba2d-49ab-b8d8-d6b9b8643aba tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:01.783796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7c03ace5-ba2d-49ab-b8d8-d6b9b8643aba tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:01.784248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7c03ace5-ba2d-49ab-b8d8-d6b9b8643aba tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:01.915099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7c03ace5-ba2d-49ab-b8d8-d6b9b8643aba tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:01.923586 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7c03ace5-ba2d-49ab-b8d8-d6b9b8643aba tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.153287 Jul 20 05:08:01.924171 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3450/6802] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:01 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:02.941357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2ef4cf57-e51b-44b2-b015-7b64feea5072 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:02.941981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2ef4cf57-e51b-44b2-b015-7b64feea5072 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:02.949185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ef4cf57-e51b-44b2-b015-7b64feea5072 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.949641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ef4cf57-e51b-44b2-b015-7b64feea5072 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.950417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ef4cf57-e51b-44b2-b015-7b64feea5072 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.950864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2ef4cf57-e51b-44b2-b015-7b64feea5072 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:03.088773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2ef4cf57-e51b-44b2-b015-7b64feea5072 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:03.096874 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2ef4cf57-e51b-44b2-b015-7b64feea5072 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.160003 Jul 20 05:08:03.097456 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3353/6803] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:02 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:04.114429 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3cbf9829-6926-4aa0-9860-9a5fdee4c049 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:04.115059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3cbf9829-6926-4aa0-9860-9a5fdee4c049 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:04.121922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cbf9829-6926-4aa0-9860-9a5fdee4c049 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:04.122386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cbf9829-6926-4aa0-9860-9a5fdee4c049 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:04.123158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cbf9829-6926-4aa0-9860-9a5fdee4c049 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:04.123630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cbf9829-6926-4aa0-9860-9a5fdee4c049 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:04.255932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3cbf9829-6926-4aa0-9860-9a5fdee4c049 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:04.263363 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3cbf9829-6926-4aa0-9860-9a5fdee4c049 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.153158 Jul 20 05:08:04.263966 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3451/6804] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:04 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:05.282598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2caf0b65-d950-4635-a978-313cb142de3c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:05.283285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2caf0b65-d950-4635-a978-313cb142de3c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:05.289982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2caf0b65-d950-4635-a978-313cb142de3c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:05.290433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2caf0b65-d950-4635-a978-313cb142de3c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:05.291202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2caf0b65-d950-4635-a978-313cb142de3c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:05.291678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2caf0b65-d950-4635-a978-313cb142de3c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:05.423395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2caf0b65-d950-4635-a978-313cb142de3c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:05.430909 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2caf0b65-d950-4635-a978-313cb142de3c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.153624 Jul 20 05:08:05.431493 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3354/6805] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:05 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:06.449367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-448cd8e8-be0a-404b-be4f-5cd3fdbc98db tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:06.449969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-448cd8e8-be0a-404b-be4f-5cd3fdbc98db tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:06.457496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-448cd8e8-be0a-404b-be4f-5cd3fdbc98db tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:06.457985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-448cd8e8-be0a-404b-be4f-5cd3fdbc98db tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:06.458728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-448cd8e8-be0a-404b-be4f-5cd3fdbc98db tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:06.459272 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-448cd8e8-be0a-404b-be4f-5cd3fdbc98db tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:06.598030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-448cd8e8-be0a-404b-be4f-5cd3fdbc98db tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:06.605621 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-448cd8e8-be0a-404b-be4f-5cd3fdbc98db tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.160308 Jul 20 05:08:06.606200 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3452/6806] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:06 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:07.622533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0a89fb0-b537-4be2-8215-f686089323f3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:07.623141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e0a89fb0-b537-4be2-8215-f686089323f3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:07.630219 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0a89fb0-b537-4be2-8215-f686089323f3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:07.630668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0a89fb0-b537-4be2-8215-f686089323f3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:07.631428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0a89fb0-b537-4be2-8215-f686089323f3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:07.631896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0a89fb0-b537-4be2-8215-f686089323f3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:07.763448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e0a89fb0-b537-4be2-8215-f686089323f3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:07.771810 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e0a89fb0-b537-4be2-8215-f686089323f3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.153175 Jul 20 05:08:07.772400 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3355/6807] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:07 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:08.789222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d1d49c99-0a67-49c7-9870-e453396eed17 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:08.789888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d1d49c99-0a67-49c7-9870-e453396eed17 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:08.796510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1d49c99-0a67-49c7-9870-e453396eed17 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:08.796977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1d49c99-0a67-49c7-9870-e453396eed17 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:08.797758 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1d49c99-0a67-49c7-9870-e453396eed17 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:08.798216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1d49c99-0a67-49c7-9870-e453396eed17 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:08.928597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d1d49c99-0a67-49c7-9870-e453396eed17 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:08.936778 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d1d49c99-0a67-49c7-9870-e453396eed17 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.151227 Jul 20 05:08:08.937386 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3453/6808] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:08 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:09.954539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-62613221-ae40-401a-b205-ddb90b3a8bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:09.955603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-62613221-ae40-401a-b205-ddb90b3a8bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:09.963755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62613221-ae40-401a-b205-ddb90b3a8bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.964632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62613221-ae40-401a-b205-ddb90b3a8bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.965556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62613221-ae40-401a-b205-ddb90b3a8bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.966211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62613221-ae40-401a-b205-ddb90b3a8bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:10.102141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-62613221-ae40-401a-b205-ddb90b3a8bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:10.109678 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-62613221-ae40-401a-b205-ddb90b3a8bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1523 microversion: 2.1 time: 0.159209 Jul 20 05:08:10.110531 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3356/6809] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:09 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:11.126541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-19a326de-5adb-4442-bcb6-ecc6563d71f8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:11.127323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-19a326de-5adb-4442-bcb6-ecc6563d71f8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:11.130130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=34 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:11.137093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19a326de-5adb-4442-bcb6-ecc6563d71f8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:11.137608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19a326de-5adb-4442-bcb6-ecc6563d71f8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:11.138409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19a326de-5adb-4442-bcb6-ecc6563d71f8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:11.138871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19a326de-5adb-4442-bcb6-ecc6563d71f8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:11.377296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-19a326de-5adb-4442-bcb6-ecc6563d71f8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:11.386562 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-19a326de-5adb-4442-bcb6-ecc6563d71f8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1522 microversion: 2.1 time: 0.264160 Jul 20 05:08:11.387247 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3454/6810] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:11 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:11.548607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1c93cf48-6eed-47f0-a895-80f736c4a516 req-b004bd4f-4234-4d53-8697-292777f24942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a1cea38-f807-48e1-874e-bcc8bee325b6", "name": "network-vif-unplugged", "status": "completed", "tag": "a56594fe-e308-4695-94ed-c9ac5e887ffd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:11.565575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1c93cf48-6eed-47f0-a895-80f736c4a516 req-b004bd4f-4234-4d53-8697-292777f24942 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:11.566883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1c93cf48-6eed-47f0-a895-80f736c4a516 req-b004bd4f-4234-4d53-8697-292777f24942 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:11.579710 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1c93cf48-6eed-47f0-a895-80f736c4a516 req-b004bd4f-4234-4d53-8697-292777f24942 service nova] Creating event network-vif-unplugged:a56594fe-e308-4695-94ed-c9ac5e887ffd for instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 on n-h1-764485-11 Jul 20 05:08:11.586064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-1c93cf48-6eed-47f0-a895-80f736c4a516 req-b004bd4f-4234-4d53-8697-292777f24942 service nova] Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:08:11.597403 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1c93cf48-6eed-47f0-a895-80f736c4a516 req-b004bd4f-4234-4d53-8697-292777f24942 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052257 Jul 20 05:08:11.598227 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3357/6811] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:08:12.405244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3288c8ad-48ef-4ef3-8924-2016d8008a6d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:12.405897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3288c8ad-48ef-4ef3-8924-2016d8008a6d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:12.413864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3288c8ad-48ef-4ef3-8924-2016d8008a6d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:12.414325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3288c8ad-48ef-4ef3-8924-2016d8008a6d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:12.415649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3288c8ad-48ef-4ef3-8924-2016d8008a6d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:12.416105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3288c8ad-48ef-4ef3-8924-2016d8008a6d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:12.552607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3288c8ad-48ef-4ef3-8924-2016d8008a6d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:12.560265 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3288c8ad-48ef-4ef3-8924-2016d8008a6d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1520 microversion: 2.1 time: 0.159446 Jul 20 05:08:12.560847 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3455/6812] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:12 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:13.579963 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5f680a4a-2659-430c-ac9a-d8b4470bd3be tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:13.580623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5f680a4a-2659-430c-ac9a-d8b4470bd3be tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:13.587135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f680a4a-2659-430c-ac9a-d8b4470bd3be tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:13.587605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f680a4a-2659-430c-ac9a-d8b4470bd3be tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:13.588369 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f680a4a-2659-430c-ac9a-d8b4470bd3be tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:13.588805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5f680a4a-2659-430c-ac9a-d8b4470bd3be tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:13.612404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a8002e3b-25a4-4d6d-8894-0bb500bdbd89 req-ff566ca5-5bd6-4061-9523-c89dac386a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a1cea38-f807-48e1-874e-bcc8bee325b6", "tag": "a56594fe-e308-4695-94ed-c9ac5e887ffd"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:13.623073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a8002e3b-25a4-4d6d-8894-0bb500bdbd89 req-ff566ca5-5bd6-4061-9523-c89dac386a66 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:13.623819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a8002e3b-25a4-4d6d-8894-0bb500bdbd89 req-ff566ca5-5bd6-4061-9523-c89dac386a66 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:13.635438 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a8002e3b-25a4-4d6d-8894-0bb500bdbd89 req-ff566ca5-5bd6-4061-9523-c89dac386a66 service nova] Creating event network-changed:a56594fe-e308-4695-94ed-c9ac5e887ffd for instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 on n-h1-764485-11 Jul 20 05:08:13.640829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-a8002e3b-25a4-4d6d-8894-0bb500bdbd89 req-ff566ca5-5bd6-4061-9523-c89dac386a66 service nova] Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:08:13.652190 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a8002e3b-25a4-4d6d-8894-0bb500bdbd89 req-ff566ca5-5bd6-4061-9523-c89dac386a66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043713 Jul 20 05:08:13.652818 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3456/6813] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:08:14.189752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5f680a4a-2659-430c-ac9a-d8b4470bd3be tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:14.198140 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5f680a4a-2659-430c-ac9a-d8b4470bd3be tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1520 microversion: 2.1 time: 0.623590 Jul 20 05:08:14.198735 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3358/6814] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:13 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1520 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:15.216274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b91b947-d1e2-4f00-b761-c82dc70191fa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:15.216998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5b91b947-d1e2-4f00-b761-c82dc70191fa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:15.224645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b91b947-d1e2-4f00-b761-c82dc70191fa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:15.225118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b91b947-d1e2-4f00-b761-c82dc70191fa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:15.225910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b91b947-d1e2-4f00-b761-c82dc70191fa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:15.226815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b91b947-d1e2-4f00-b761-c82dc70191fa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:15.460275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b91b947-d1e2-4f00-b761-c82dc70191fa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:15.468847 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5b91b947-d1e2-4f00-b761-c82dc70191fa tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1520 microversion: 2.1 time: 0.256927 Jul 20 05:08:15.469439 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3457/6815] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:15 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:16.486792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0db8be1c-35cc-4939-93a6-f3813b9dc7b4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:16.487377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0db8be1c-35cc-4939-93a6-f3813b9dc7b4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:16.489902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=28 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:16.495353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0db8be1c-35cc-4939-93a6-f3813b9dc7b4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:16.495839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0db8be1c-35cc-4939-93a6-f3813b9dc7b4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:16.496623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0db8be1c-35cc-4939-93a6-f3813b9dc7b4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:16.497072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0db8be1c-35cc-4939-93a6-f3813b9dc7b4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:16.501241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=84 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:16.715855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0db8be1c-35cc-4939-93a6-f3813b9dc7b4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:16.723746 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0db8be1c-35cc-4939-93a6-f3813b9dc7b4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1517 microversion: 2.1 time: 0.241608 Jul 20 05:08:16.724335 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3359/6816] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:16 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:16.740735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-90de30fe-8f84-43af-b8f2-69195ef0ed23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:16.741230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-90de30fe-8f84-43af-b8f2-69195ef0ed23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:16.748590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90de30fe-8f84-43af-b8f2-69195ef0ed23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:16.749064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90de30fe-8f84-43af-b8f2-69195ef0ed23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:16.749861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90de30fe-8f84-43af-b8f2-69195ef0ed23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:16.750326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90de30fe-8f84-43af-b8f2-69195ef0ed23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:16.815473 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-90de30fe-8f84-43af-b8f2-69195ef0ed23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "POST /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6/action" status: 204 len: 0 microversion: 2.1 time: 0.078949 Jul 20 05:08:16.816186 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3458/6817] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:08:16 2022] POST /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:08:16.826380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f01a4ff9-d5b4-4174-bf07-3ed175ea0db8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:16.826754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f01a4ff9-d5b4-4174-bf07-3ed175ea0db8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:16.834392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f01a4ff9-d5b4-4174-bf07-3ed175ea0db8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:16.835039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f01a4ff9-d5b4-4174-bf07-3ed175ea0db8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:16.836315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f01a4ff9-d5b4-4174-bf07-3ed175ea0db8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:16.836914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f01a4ff9-d5b4-4174-bf07-3ed175ea0db8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:17.065217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f01a4ff9-d5b4-4174-bf07-3ed175ea0db8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:17.074616 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f01a4ff9-d5b4-4174-bf07-3ed175ea0db8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1517 microversion: 2.1 time: 0.253403 Jul 20 05:08:17.075309 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3360/6818] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:16 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:17.089945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9f3db1aa-a3e7-49df-bf3e-9acdbfd191ca req-a5c4eb0c-424c-48ef-9023-19b5e4d6e85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a1cea38-f807-48e1-874e-bcc8bee325b6", "name": "network-vif-plugged", "status": "completed", "tag": "a56594fe-e308-4695-94ed-c9ac5e887ffd"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:17.100704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9f3db1aa-a3e7-49df-bf3e-9acdbfd191ca req-a5c4eb0c-424c-48ef-9023-19b5e4d6e85c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:17.101472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9f3db1aa-a3e7-49df-bf3e-9acdbfd191ca req-a5c4eb0c-424c-48ef-9023-19b5e4d6e85c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:17.117654 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9f3db1aa-a3e7-49df-bf3e-9acdbfd191ca req-a5c4eb0c-424c-48ef-9023-19b5e4d6e85c service nova] Creating event network-vif-plugged:a56594fe-e308-4695-94ed-c9ac5e887ffd for instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 on n-h1-764485-11 Jul 20 05:08:17.125365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-9f3db1aa-a3e7-49df-bf3e-9acdbfd191ca req-a5c4eb0c-424c-48ef-9023-19b5e4d6e85c service nova] Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:08:17.140118 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9f3db1aa-a3e7-49df-bf3e-9acdbfd191ca req-a5c4eb0c-424c-48ef-9023-19b5e4d6e85c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054183 Jul 20 05:08:17.140770 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3459/6819] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:18.092322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9f69a11c-21c6-4892-ac37-c893b83e36e1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:18.093125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9f69a11c-21c6-4892-ac37-c893b83e36e1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:18.100632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f69a11c-21c6-4892-ac37-c893b83e36e1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:18.101192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f69a11c-21c6-4892-ac37-c893b83e36e1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:18.101992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f69a11c-21c6-4892-ac37-c893b83e36e1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:18.102442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9f69a11c-21c6-4892-ac37-c893b83e36e1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:18.248766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9f69a11c-21c6-4892-ac37-c893b83e36e1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:18.256868 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9f69a11c-21c6-4892-ac37-c893b83e36e1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1509 microversion: 2.1 time: 0.168545 Jul 20 05:08:18.257449 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3361/6820] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:18 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:18.274907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-504f529d-27d0-4790-a5ca-371848520500 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:18.275714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-504f529d-27d0-4790-a5ca-371848520500 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:18.281946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-504f529d-27d0-4790-a5ca-371848520500 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:18.282415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-504f529d-27d0-4790-a5ca-371848520500 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:18.283188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-504f529d-27d0-4790-a5ca-371848520500 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:18.283674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-504f529d-27d0-4790-a5ca-371848520500 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:18.498445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-504f529d-27d0-4790-a5ca-371848520500 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:18.506197 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-504f529d-27d0-4790-a5ca-371848520500 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1509 microversion: 2.1 time: 0.236970 Jul 20 05:08:18.506782 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3460/6821] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:18 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:18.526468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e33b0d96-aa03-43e0-ba93-a3abca6bb4bf tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Action: 'create', calling method: .version_select at 0x7fbf9dbba280>, body: {"keypair": {"name": "tempest-keypair-1879382401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5FvF+e4UyUupanjsiWFsL6B4FQdYE1Eomak3RlJbB1dJIl988aNhBj0rcIPlNi6ySAh380DcOjW1bPoTczgqUqqmzzIBPmVebYnw4GXkwzRjKB1XVwNi6+QTaanoPmWg=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:18.541382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e33b0d96-aa03-43e0-ba93-a3abca6bb4bf tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Getting quotas for project 3f1932f069dc4d738cfd389a2e6c0aa6. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:08:18.546519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e33b0d96-aa03-43e0-ba93-a3abca6bb4bf tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Getting quotas for user d0fe0f8c44d7407a903b4b5f4e644c5b and project 3f1932f069dc4d738cfd389a2e6c0aa6. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:08:18.571141 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e33b0d96-aa03-43e0-ba93-a3abca6bb4bf tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048621 Jul 20 05:08:18.571919 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3362/6822] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:08:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:19.785532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b6616c69-9ecf-4d94-8347-eba5648a3a1d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:19.786189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b6616c69-9ecf-4d94-8347-eba5648a3a1d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:19.793064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6616c69-9ecf-4d94-8347-eba5648a3a1d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:19.793522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6616c69-9ecf-4d94-8347-eba5648a3a1d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:19.794290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6616c69-9ecf-4d94-8347-eba5648a3a1d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:19.794738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b6616c69-9ecf-4d94-8347-eba5648a3a1d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:19.928622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b6616c69-9ecf-4d94-8347-eba5648a3a1d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:19.936517 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b6616c69-9ecf-4d94-8347-eba5648a3a1d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 200 len: 1509 microversion: 2.1 time: 0.155267 Jul 20 05:08:19.937118 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3461/6823] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:19 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:19.954382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8e21ba8b-4609-4367-a8b1-ea3986ea5818 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:19.954871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8e21ba8b-4609-4367-a8b1-ea3986ea5818 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:19.961676 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e21ba8b-4609-4367-a8b1-ea3986ea5818 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:19.962136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e21ba8b-4609-4367-a8b1-ea3986ea5818 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:19.962916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e21ba8b-4609-4367-a8b1-ea3986ea5818 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:19.963362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8e21ba8b-4609-4367-a8b1-ea3986ea5818 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:19.990183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8e21ba8b-4609-4367-a8b1-ea3986ea5818 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:08:20.068663 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8e21ba8b-4609-4367-a8b1-ea3986ea5818 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 204 len: 0 microversion: 2.1 time: 0.118826 Jul 20 05:08:20.069280 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3363/6824] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:08:19 2022] DELETE /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:08:20.127751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-795209407", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "45a0eee9-f206-45b6-a8b5-e70f2de5ff84"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:20.178887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] validate_networks() for [('45a0eee9-f206-45b6-a8b5-e70f2de5ff84', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:08:20.559642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:08:20.560100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:08:20.560603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:08:20.561037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:08:20.561477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:08:20.571130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:20.571639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:20.572468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:20.572927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:20.590298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Getting quotas for project 3f1932f069dc4d738cfd389a2e6c0aa6. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:08:20.595921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Getting quotas for user d0fe0f8c44d7407a903b4b5f4e644c5b and project 3f1932f069dc4d738cfd389a2e6c0aa6. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:08:20.610526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:08:20.612898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:08:20.658901 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9c23597-d308-44b3-9e2d-af55d738b649 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535043 Jul 20 05:08:20.659597 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3462/6825] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:08:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:08:20.670908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f8ba0c0c-f030-4bbc-b0da-4bd2340e6f70 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:20.671645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f8ba0c0c-f030-4bbc-b0da-4bd2340e6f70 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:20.726900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f8ba0c0c-f030-4bbc-b0da-4bd2340e6f70 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:20.733854 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f8ba0c0c-f030-4bbc-b0da-4bd2340e6f70 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1217 microversion: 2.1 time: 0.067158 Jul 20 05:08:20.734452 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3364/6826] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:20 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:21.752197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-56ab4007-aab8-4a07-874c-2a6a8b771f7c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:21.752842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-56ab4007-aab8-4a07-874c-2a6a8b771f7c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:21.760627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56ab4007-aab8-4a07-874c-2a6a8b771f7c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:21.761101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56ab4007-aab8-4a07-874c-2a6a8b771f7c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:21.761900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56ab4007-aab8-4a07-874c-2a6a8b771f7c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:21.762362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-56ab4007-aab8-4a07-874c-2a6a8b771f7c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:21.858482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-56ab4007-aab8-4a07-874c-2a6a8b771f7c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:21.867100 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-56ab4007-aab8-4a07-874c-2a6a8b771f7c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1275 microversion: 2.1 time: 0.119783 Jul 20 05:08:21.867719 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3463/6827] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:21 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:22.535959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-56a83c5a-b42c-415e-91a9-813393b96491 req-c04fdce0-407c-4667-b24c-fa1a0756965e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a1cea38-f807-48e1-874e-bcc8bee325b6", "name": "network-vif-deleted", "tag": "a56594fe-e308-4695-94ed-c9ac5e887ffd"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:22.549204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-56a83c5a-b42c-415e-91a9-813393b96491 req-c04fdce0-407c-4667-b24c-fa1a0756965e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:22.549982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-56a83c5a-b42c-415e-91a9-813393b96491 req-c04fdce0-407c-4667-b24c-fa1a0756965e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:22.565322 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-56a83c5a-b42c-415e-91a9-813393b96491 req-c04fdce0-407c-4667-b24c-fa1a0756965e service nova] Creating event network-vif-deleted:a56594fe-e308-4695-94ed-c9ac5e887ffd for instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 on n-h1-764485-11 Jul 20 05:08:22.572029 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-56a83c5a-b42c-415e-91a9-813393b96491 req-c04fdce0-407c-4667-b24c-fa1a0756965e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045561 Jul 20 05:08:22.572944 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3365/6828] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:08:22.885705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0cd1baee-d52e-4f84-bd66-d41464602d24 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:22.886454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0cd1baee-d52e-4f84-bd66-d41464602d24 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:22.893917 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0cd1baee-d52e-4f84-bd66-d41464602d24 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:22.895294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0cd1baee-d52e-4f84-bd66-d41464602d24 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:22.896649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0cd1baee-d52e-4f84-bd66-d41464602d24 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:22.897332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0cd1baee-d52e-4f84-bd66-d41464602d24 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:23.447526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0cd1baee-d52e-4f84-bd66-d41464602d24 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:23.454987 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0cd1baee-d52e-4f84-bd66-d41464602d24 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1317 microversion: 2.1 time: 0.573572 Jul 20 05:08:23.455588 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3464/6829] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:22 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:24.475244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-11299973-4d08-40ae-968e-8feecd8c742f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:24.476006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-11299973-4d08-40ae-968e-8feecd8c742f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:24.482321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11299973-4d08-40ae-968e-8feecd8c742f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:24.482776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11299973-4d08-40ae-968e-8feecd8c742f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:24.483604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11299973-4d08-40ae-968e-8feecd8c742f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:24.484053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-11299973-4d08-40ae-968e-8feecd8c742f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:24.591625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2c48e71c-d113-4b0c-8d2c-092a7eefb169 req-4865a4f1-9127-486d-a143-2e62974f5233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198a57e5-473f-40f3-b00e-09bd3d22be20", "tag": "d32d9863-b840-4b35-b1dd-e9235bdff8b3"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:24.601316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2c48e71c-d113-4b0c-8d2c-092a7eefb169 req-4865a4f1-9127-486d-a143-2e62974f5233 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:24.601773 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2c48e71c-d113-4b0c-8d2c-092a7eefb169 req-4865a4f1-9127-486d-a143-2e62974f5233 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:24.613427 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2c48e71c-d113-4b0c-8d2c-092a7eefb169 req-4865a4f1-9127-486d-a143-2e62974f5233 service nova] Creating event network-changed:d32d9863-b840-4b35-b1dd-e9235bdff8b3 for instance 198a57e5-473f-40f3-b00e-09bd3d22be20 on n-h2-764485-11 Jul 20 05:08:24.618317 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2c48e71c-d113-4b0c-8d2c-092a7eefb169 req-4865a4f1-9127-486d-a143-2e62974f5233 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030533 Jul 20 05:08:24.618932 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3465/6830] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:08:24.629797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-11299973-4d08-40ae-968e-8feecd8c742f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:24.637394 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-11299973-4d08-40ae-968e-8feecd8c742f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1317 microversion: 2.1 time: 0.168472 Jul 20 05:08:24.637969 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3366/6831] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:24 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:25.655953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e53e3f40-6c13-4110-93b7-de097b23472d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:25.656671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e53e3f40-6c13-4110-93b7-de097b23472d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:25.664485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e53e3f40-6c13-4110-93b7-de097b23472d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:25.664954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e53e3f40-6c13-4110-93b7-de097b23472d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:25.665743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e53e3f40-6c13-4110-93b7-de097b23472d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:25.666203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e53e3f40-6c13-4110-93b7-de097b23472d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:25.803153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e53e3f40-6c13-4110-93b7-de097b23472d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:25.805519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:25.812562 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e53e3f40-6c13-4110-93b7-de097b23472d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1317 microversion: 2.1 time: 0.161958 Jul 20 05:08:25.813142 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3466/6832] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:25 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:26.830318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0b5b4c78-5a3f-43ed-9eb1-12a994b24c7b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:26.830940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0b5b4c78-5a3f-43ed-9eb1-12a994b24c7b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:26.837957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b5b4c78-5a3f-43ed-9eb1-12a994b24c7b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:26.838420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b5b4c78-5a3f-43ed-9eb1-12a994b24c7b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:26.839202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b5b4c78-5a3f-43ed-9eb1-12a994b24c7b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:26.839677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0b5b4c78-5a3f-43ed-9eb1-12a994b24c7b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:26.977539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0b5b4c78-5a3f-43ed-9eb1-12a994b24c7b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:26.987070 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0b5b4c78-5a3f-43ed-9eb1-12a994b24c7b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1317 microversion: 2.1 time: 0.160655 Jul 20 05:08:26.988259 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3367/6833] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:26 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:28.005677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b59176f-7197-4240-b359-fa2fcb5b07e6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:28.006345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5b59176f-7197-4240-b359-fa2fcb5b07e6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:28.014871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b59176f-7197-4240-b359-fa2fcb5b07e6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:28.015338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b59176f-7197-4240-b359-fa2fcb5b07e6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:28.016165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b59176f-7197-4240-b359-fa2fcb5b07e6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:28.016643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b59176f-7197-4240-b359-fa2fcb5b07e6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:28.149544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b59176f-7197-4240-b359-fa2fcb5b07e6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:28.157082 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5b59176f-7197-4240-b359-fa2fcb5b07e6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1317 microversion: 2.1 time: 0.156067 Jul 20 05:08:28.157659 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3467/6834] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:27 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:29.043240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f612c45c-68af-427f-afa6-86742d54b420 req-ebb760e7-fe97-4525-a631-cddd1b352e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198a57e5-473f-40f3-b00e-09bd3d22be20", "name": "network-vif-plugged", "status": "completed", "tag": "d32d9863-b840-4b35-b1dd-e9235bdff8b3"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:29.053651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f612c45c-68af-427f-afa6-86742d54b420 req-ebb760e7-fe97-4525-a631-cddd1b352e47 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:29.054105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f612c45c-68af-427f-afa6-86742d54b420 req-ebb760e7-fe97-4525-a631-cddd1b352e47 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:29.065363 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f612c45c-68af-427f-afa6-86742d54b420 req-ebb760e7-fe97-4525-a631-cddd1b352e47 service nova] Creating event network-vif-plugged:d32d9863-b840-4b35-b1dd-e9235bdff8b3 for instance 198a57e5-473f-40f3-b00e-09bd3d22be20 on n-h2-764485-11 Jul 20 05:08:29.071274 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f612c45c-68af-427f-afa6-86742d54b420 req-ebb760e7-fe97-4525-a631-cddd1b352e47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031738 Jul 20 05:08:29.071925 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3368/6835] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:08:29.173863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8f9fdb20-bae2-43cf-81cb-816b5a7eb348 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:29.174500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8f9fdb20-bae2-43cf-81cb-816b5a7eb348 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:29.182142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f9fdb20-bae2-43cf-81cb-816b5a7eb348 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:29.182609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f9fdb20-bae2-43cf-81cb-816b5a7eb348 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:29.183413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f9fdb20-bae2-43cf-81cb-816b5a7eb348 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:29.183900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8f9fdb20-bae2-43cf-81cb-816b5a7eb348 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:29.349088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8f9fdb20-bae2-43cf-81cb-816b5a7eb348 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:29.356649 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8f9fdb20-bae2-43cf-81cb-816b5a7eb348 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1317 microversion: 2.1 time: 0.186842 Jul 20 05:08:29.357231 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3468/6836] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:29 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:30.375424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f313b177-665d-46b8-b489-1bda35fa977f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:30.376166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f313b177-665d-46b8-b489-1bda35fa977f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:30.382873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f313b177-665d-46b8-b489-1bda35fa977f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:30.383329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f313b177-665d-46b8-b489-1bda35fa977f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:30.384136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f313b177-665d-46b8-b489-1bda35fa977f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:30.384577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f313b177-665d-46b8-b489-1bda35fa977f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:30.522050 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f313b177-665d-46b8-b489-1bda35fa977f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:30.529706 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f313b177-665d-46b8-b489-1bda35fa977f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1317 microversion: 2.1 time: 0.159522 Jul 20 05:08:30.530289 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3369/6837] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:30 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:31.548248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-993bba1e-57ae-4e40-b38c-09963ed65467 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:31.548878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-993bba1e-57ae-4e40-b38c-09963ed65467 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:31.551573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:31.552334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:31.558351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-993bba1e-57ae-4e40-b38c-09963ed65467 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:31.558814 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-993bba1e-57ae-4e40-b38c-09963ed65467 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:31.559618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-993bba1e-57ae-4e40-b38c-09963ed65467 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:31.560073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-993bba1e-57ae-4e40-b38c-09963ed65467 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:31.693949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-993bba1e-57ae-4e40-b38c-09963ed65467 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:31.701451 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-993bba1e-57ae-4e40-b38c-09963ed65467 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1507 microversion: 2.1 time: 0.157095 Jul 20 05:08:31.702057 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3469/6838] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:31 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:31.718778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eb912a71-e646-4e78-a004-22ff073f4e98 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:31.719428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eb912a71-e646-4e78-a004-22ff073f4e98 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:31.721448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:31.728994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb912a71-e646-4e78-a004-22ff073f4e98 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:31.729453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb912a71-e646-4e78-a004-22ff073f4e98 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:31.730241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb912a71-e646-4e78-a004-22ff073f4e98 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:31.730689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb912a71-e646-4e78-a004-22ff073f4e98 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:31.862093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eb912a71-e646-4e78-a004-22ff073f4e98 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:31.870603 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eb912a71-e646-4e78-a004-22ff073f4e98 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1507 microversion: 2.1 time: 0.155753 Jul 20 05:08:31.871191 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3370/6839] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:31 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:31.887044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:31.888122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:31.894232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:31.894693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:31.896186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:31.896664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:31.926128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:31.932336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Old instance type m1.heat2, new instance type m1.heat {{(pid=119808) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:08:31.938649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:08:31.939092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:08:31.939628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:08:31.940064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:08:31.940497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:08:32.003814 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5135d8ce-4939-4f20-b3c0-24e55d7bf900 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "POST /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20/action" status: 202 len: 0 microversion: 2.1 time: 0.120936 Jul 20 05:08:32.004501 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3470/6840] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:08:31 2022] POST /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:08:32.012674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b2e8bf20-02d3-4600-9722-354ca22abf2b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:32.013293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b2e8bf20-02d3-4600-9722-354ca22abf2b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:32.019302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2e8bf20-02d3-4600-9722-354ca22abf2b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:32.019788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2e8bf20-02d3-4600-9722-354ca22abf2b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:32.021122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2e8bf20-02d3-4600-9722-354ca22abf2b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:32.021723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2e8bf20-02d3-4600-9722-354ca22abf2b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:32.168506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b2e8bf20-02d3-4600-9722-354ca22abf2b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:32.177161 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b2e8bf20-02d3-4600-9722-354ca22abf2b tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1514 microversion: 2.1 time: 0.168010 Jul 20 05:08:32.177584 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3371/6841] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:32 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:33.196310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5de6f9d0-9842-4958-918a-27f94a6222ed tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:33.196947 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5de6f9d0-9842-4958-918a-27f94a6222ed tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:33.205203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5de6f9d0-9842-4958-918a-27f94a6222ed tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:33.205751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5de6f9d0-9842-4958-918a-27f94a6222ed tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:33.206617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5de6f9d0-9842-4958-918a-27f94a6222ed tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:33.207068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5de6f9d0-9842-4958-918a-27f94a6222ed tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:33.428044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5de6f9d0-9842-4958-918a-27f94a6222ed tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:33.435601 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5de6f9d0-9842-4958-918a-27f94a6222ed tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1514 microversion: 2.1 time: 0.245611 Jul 20 05:08:33.436187 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3471/6842] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:33 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:34.454171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2cde59d0-c3bf-42f9-b5d1-dd9fff45e7d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:34.454726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2cde59d0-c3bf-42f9-b5d1-dd9fff45e7d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:34.461976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cde59d0-c3bf-42f9-b5d1-dd9fff45e7d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:34.462433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cde59d0-c3bf-42f9-b5d1-dd9fff45e7d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:34.463213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cde59d0-c3bf-42f9-b5d1-dd9fff45e7d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:34.463705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cde59d0-c3bf-42f9-b5d1-dd9fff45e7d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:34.600153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2cde59d0-c3bf-42f9-b5d1-dd9fff45e7d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:34.607701 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2cde59d0-c3bf-42f9-b5d1-dd9fff45e7d2 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.157719 Jul 20 05:08:34.608276 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3372/6843] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:34 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:35.626252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e7a6cd6-5dcd-4337-8c75-e3094097c18e tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:35.626885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3e7a6cd6-5dcd-4337-8c75-e3094097c18e tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:35.634453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e7a6cd6-5dcd-4337-8c75-e3094097c18e tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.634921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e7a6cd6-5dcd-4337-8c75-e3094097c18e tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.635723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e7a6cd6-5dcd-4337-8c75-e3094097c18e tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.636179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e7a6cd6-5dcd-4337-8c75-e3094097c18e tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.640611 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:08:35.641035 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:08:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 (ip 10.222.0.20) !!! Jul 20 05:08:35.776560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3e7a6cd6-5dcd-4337-8c75-e3094097c18e tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:35.784134 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3e7a6cd6-5dcd-4337-8c75-e3094097c18e tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.161828 Jul 20 05:08:35.784723 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3472/6844] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:35 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:36.801188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-26cd678d-4503-43dc-bce6-acb8fb29fed6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:36.802113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-26cd678d-4503-43dc-bce6-acb8fb29fed6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:36.809065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26cd678d-4503-43dc-bce6-acb8fb29fed6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:36.809524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26cd678d-4503-43dc-bce6-acb8fb29fed6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:36.810294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26cd678d-4503-43dc-bce6-acb8fb29fed6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:36.810738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-26cd678d-4503-43dc-bce6-acb8fb29fed6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:36.944347 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-26cd678d-4503-43dc-bce6-acb8fb29fed6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:36.952137 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-26cd678d-4503-43dc-bce6-acb8fb29fed6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.154968 Jul 20 05:08:36.952724 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3373/6845] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:36 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:37.969792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-22a73549-8afe-415e-90fa-d07d5376196c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:37.970435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-22a73549-8afe-415e-90fa-d07d5376196c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:37.979423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22a73549-8afe-415e-90fa-d07d5376196c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:37.979924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22a73549-8afe-415e-90fa-d07d5376196c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:37.980707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22a73549-8afe-415e-90fa-d07d5376196c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:37.981167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22a73549-8afe-415e-90fa-d07d5376196c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:38.115115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-22a73549-8afe-415e-90fa-d07d5376196c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:38.122608 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-22a73549-8afe-415e-90fa-d07d5376196c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.156924 Jul 20 05:08:38.123206 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3473/6846] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:37 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:39.140435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-51a1e2fe-3d5b-4bac-ae15-fcf2c0d5bbc3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:39.141139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-51a1e2fe-3d5b-4bac-ae15-fcf2c0d5bbc3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:39.148724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51a1e2fe-3d5b-4bac-ae15-fcf2c0d5bbc3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:39.149176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51a1e2fe-3d5b-4bac-ae15-fcf2c0d5bbc3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:39.149937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51a1e2fe-3d5b-4bac-ae15-fcf2c0d5bbc3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:39.150377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51a1e2fe-3d5b-4bac-ae15-fcf2c0d5bbc3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:39.282256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-51a1e2fe-3d5b-4bac-ae15-fcf2c0d5bbc3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:39.290655 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-51a1e2fe-3d5b-4bac-ae15-fcf2c0d5bbc3 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.154153 Jul 20 05:08:39.291234 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3374/6847] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:39 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:40.307921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2e389e52-ea9d-44c8-b332-09380cf590ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:40.308562 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2e389e52-ea9d-44c8-b332-09380cf590ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:40.315560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e389e52-ea9d-44c8-b332-09380cf590ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:40.316036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e389e52-ea9d-44c8-b332-09380cf590ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:40.317479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e389e52-ea9d-44c8-b332-09380cf590ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:40.317958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2e389e52-ea9d-44c8-b332-09380cf590ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:40.451866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2e389e52-ea9d-44c8-b332-09380cf590ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:40.460402 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2e389e52-ea9d-44c8-b332-09380cf590ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.156534 Jul 20 05:08:40.460989 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3474/6848] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:40 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:41.477803 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-91e8ff53-8f19-476c-afaa-6b1d5b9b20f1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:41.478375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-91e8ff53-8f19-476c-afaa-6b1d5b9b20f1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:41.485656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91e8ff53-8f19-476c-afaa-6b1d5b9b20f1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:41.486109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91e8ff53-8f19-476c-afaa-6b1d5b9b20f1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:41.486870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91e8ff53-8f19-476c-afaa-6b1d5b9b20f1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:41.487309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91e8ff53-8f19-476c-afaa-6b1d5b9b20f1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:41.617418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-91e8ff53-8f19-476c-afaa-6b1d5b9b20f1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:41.625047 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-91e8ff53-8f19-476c-afaa-6b1d5b9b20f1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.151280 Jul 20 05:08:41.625628 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3375/6849] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:41 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:42.642895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-908253d7-abef-47ca-8010-0ac4cb213ff4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:42.643542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-908253d7-abef-47ca-8010-0ac4cb213ff4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:42.646927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:42.652921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-908253d7-abef-47ca-8010-0ac4cb213ff4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:42.653387 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-908253d7-abef-47ca-8010-0ac4cb213ff4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:42.654178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-908253d7-abef-47ca-8010-0ac4cb213ff4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:42.654613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-908253d7-abef-47ca-8010-0ac4cb213ff4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:42.790110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-908253d7-abef-47ca-8010-0ac4cb213ff4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:42.797778 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-908253d7-abef-47ca-8010-0ac4cb213ff4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.158790 Jul 20 05:08:42.798352 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3475/6850] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:42 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:43.814905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0ff809fc-2235-4786-956c-c92c25eee853 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:43.815543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0ff809fc-2235-4786-956c-c92c25eee853 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:43.823243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ff809fc-2235-4786-956c-c92c25eee853 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:43.823730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ff809fc-2235-4786-956c-c92c25eee853 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:43.824870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ff809fc-2235-4786-956c-c92c25eee853 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:43.824968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ff809fc-2235-4786-956c-c92c25eee853 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:43.960882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0ff809fc-2235-4786-956c-c92c25eee853 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:43.968506 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0ff809fc-2235-4786-956c-c92c25eee853 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.157515 Jul 20 05:08:43.969084 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3376/6851] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:43 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:44.985951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2abec5aa-c8f7-42d7-b6e4-1273f30548f6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:44.986616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2abec5aa-c8f7-42d7-b6e4-1273f30548f6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:44.993614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2abec5aa-c8f7-42d7-b6e4-1273f30548f6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:44.994087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2abec5aa-c8f7-42d7-b6e4-1273f30548f6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:44.994875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2abec5aa-c8f7-42d7-b6e4-1273f30548f6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:44.995333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2abec5aa-c8f7-42d7-b6e4-1273f30548f6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:45.126070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2abec5aa-c8f7-42d7-b6e4-1273f30548f6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:45.134370 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2abec5aa-c8f7-42d7-b6e4-1273f30548f6 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.152644 Jul 20 05:08:45.134956 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3476/6852] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:44 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:46.152074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8cafbd10-48e0-435c-9b6d-eb03695b8138 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:46.152623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8cafbd10-48e0-435c-9b6d-eb03695b8138 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:46.159407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cafbd10-48e0-435c-9b6d-eb03695b8138 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:46.159898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cafbd10-48e0-435c-9b6d-eb03695b8138 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:46.161658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cafbd10-48e0-435c-9b6d-eb03695b8138 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:46.162109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cafbd10-48e0-435c-9b6d-eb03695b8138 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:46.177415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:46.298218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8cafbd10-48e0-435c-9b6d-eb03695b8138 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:46.305884 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8cafbd10-48e0-435c-9b6d-eb03695b8138 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.158098 Jul 20 05:08:46.306465 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3377/6853] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:46 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:47.322384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6fcd969-c362-4e7c-a278-7d191e782035 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:47.323018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f6fcd969-c362-4e7c-a278-7d191e782035 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:47.329908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6fcd969-c362-4e7c-a278-7d191e782035 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:47.330378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6fcd969-c362-4e7c-a278-7d191e782035 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:47.331157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6fcd969-c362-4e7c-a278-7d191e782035 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:47.331647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6fcd969-c362-4e7c-a278-7d191e782035 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:47.464231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f6fcd969-c362-4e7c-a278-7d191e782035 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:47.471838 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f6fcd969-c362-4e7c-a278-7d191e782035 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.153506 Jul 20 05:08:47.472426 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3477/6854] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:47 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:48.488655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a937546a-203c-4d7e-ad15-7e5fdc3848dc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:48.489194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a937546a-203c-4d7e-ad15-7e5fdc3848dc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:48.491968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:48.498753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a937546a-203c-4d7e-ad15-7e5fdc3848dc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:48.499207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a937546a-203c-4d7e-ad15-7e5fdc3848dc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:48.500026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a937546a-203c-4d7e-ad15-7e5fdc3848dc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:48.500468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a937546a-203c-4d7e-ad15-7e5fdc3848dc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:48.633156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a937546a-203c-4d7e-ad15-7e5fdc3848dc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:48.641034 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a937546a-203c-4d7e-ad15-7e5fdc3848dc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.156692 Jul 20 05:08:48.641619 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3378/6855] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:48 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:49.658855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6528e39c-8f49-4ab3-939b-4ba1583cf90c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:49.659499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6528e39c-8f49-4ab3-939b-4ba1583cf90c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:49.666964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6528e39c-8f49-4ab3-939b-4ba1583cf90c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:49.667438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6528e39c-8f49-4ab3-939b-4ba1583cf90c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:49.668261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6528e39c-8f49-4ab3-939b-4ba1583cf90c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:49.668725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6528e39c-8f49-4ab3-939b-4ba1583cf90c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:49.804413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6528e39c-8f49-4ab3-939b-4ba1583cf90c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:49.812040 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6528e39c-8f49-4ab3-939b-4ba1583cf90c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.157260 Jul 20 05:08:49.812617 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3478/6856] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:49 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:50.828932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86280e7e-6beb-4b8f-b096-652fa710ce53 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:50.829546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-86280e7e-6beb-4b8f-b096-652fa710ce53 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:50.836644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86280e7e-6beb-4b8f-b096-652fa710ce53 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:50.837092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86280e7e-6beb-4b8f-b096-652fa710ce53 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:50.837857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86280e7e-6beb-4b8f-b096-652fa710ce53 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:50.838628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86280e7e-6beb-4b8f-b096-652fa710ce53 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:50.968898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-86280e7e-6beb-4b8f-b096-652fa710ce53 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:50.976589 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-86280e7e-6beb-4b8f-b096-652fa710ce53 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.151577 Jul 20 05:08:50.977175 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3379/6857] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:50 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:51.994273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f160c94c-d5df-45b2-8fe7-d174944f3905 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:51.994905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f160c94c-d5df-45b2-8fe7-d174944f3905 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:52.001801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f160c94c-d5df-45b2-8fe7-d174944f3905 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.002266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f160c94c-d5df-45b2-8fe7-d174944f3905 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.003043 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f160c94c-d5df-45b2-8fe7-d174944f3905 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.003496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f160c94c-d5df-45b2-8fe7-d174944f3905 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.138174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f160c94c-d5df-45b2-8fe7-d174944f3905 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:52.146607 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f160c94c-d5df-45b2-8fe7-d174944f3905 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.156213 Jul 20 05:08:52.147202 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3479/6858] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:51 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:53.165155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ef07259-b5dc-4eb5-9ea7-b0c53761c194 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:53.165776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ef07259-b5dc-4eb5-9ea7-b0c53761c194 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:53.172822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ef07259-b5dc-4eb5-9ea7-b0c53761c194 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:53.173275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ef07259-b5dc-4eb5-9ea7-b0c53761c194 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:53.174052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ef07259-b5dc-4eb5-9ea7-b0c53761c194 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:53.174497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ef07259-b5dc-4eb5-9ea7-b0c53761c194 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:53.307809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ef07259-b5dc-4eb5-9ea7-b0c53761c194 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:53.315352 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ef07259-b5dc-4eb5-9ea7-b0c53761c194 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.155177 Jul 20 05:08:53.315995 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3380/6859] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:53 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:54.333719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-98652b43-49c9-4905-9816-948278fcf279 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:54.334360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-98652b43-49c9-4905-9816-948278fcf279 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:54.341884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98652b43-49c9-4905-9816-948278fcf279 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.342350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98652b43-49c9-4905-9816-948278fcf279 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.343137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98652b43-49c9-4905-9816-948278fcf279 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.343633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98652b43-49c9-4905-9816-948278fcf279 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.478767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-98652b43-49c9-4905-9816-948278fcf279 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:54.486776 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-98652b43-49c9-4905-9816-948278fcf279 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.157428 Jul 20 05:08:54.487356 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3480/6860] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:54 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:55.504237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-be29de78-456e-4b31-9b22-d56533bce4e8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:55.505545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-be29de78-456e-4b31-9b22-d56533bce4e8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:55.512634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be29de78-456e-4b31-9b22-d56533bce4e8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:55.513090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be29de78-456e-4b31-9b22-d56533bce4e8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:55.513862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be29de78-456e-4b31-9b22-d56533bce4e8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:55.514307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be29de78-456e-4b31-9b22-d56533bce4e8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:55.647922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-be29de78-456e-4b31-9b22-d56533bce4e8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:55.655491 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-be29de78-456e-4b31-9b22-d56533bce4e8 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.155247 Jul 20 05:08:55.656098 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3381/6861] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:55 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:56.673390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3163de6a-936b-43f9-bf7b-929932f3c85f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:56.674028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3163de6a-936b-43f9-bf7b-929932f3c85f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:56.682167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3163de6a-936b-43f9-bf7b-929932f3c85f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:56.682643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3163de6a-936b-43f9-bf7b-929932f3c85f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:56.683433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3163de6a-936b-43f9-bf7b-929932f3c85f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:56.683924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3163de6a-936b-43f9-bf7b-929932f3c85f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:56.815283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3163de6a-936b-43f9-bf7b-929932f3c85f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:56.823570 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3163de6a-936b-43f9-bf7b-929932f3c85f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.154143 Jul 20 05:08:56.824150 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3481/6862] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:56 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:57.840395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fc3d4f28-2041-47d3-be6c-52f6929869ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:57.841021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fc3d4f28-2041-47d3-be6c-52f6929869ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:57.848238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc3d4f28-2041-47d3-be6c-52f6929869ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:57.848699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc3d4f28-2041-47d3-be6c-52f6929869ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:57.849483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc3d4f28-2041-47d3-be6c-52f6929869ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:57.849931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fc3d4f28-2041-47d3-be6c-52f6929869ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:57.984618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fc3d4f28-2041-47d3-be6c-52f6929869ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:57.994157 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fc3d4f28-2041-47d3-be6c-52f6929869ac tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.158134 Jul 20 05:08:57.994750 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3382/6863] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:57 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:59.011804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b3797b21-67da-42ab-b34e-bda369838f5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:59.012480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b3797b21-67da-42ab-b34e-bda369838f5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:59.019905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3797b21-67da-42ab-b34e-bda369838f5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:59.020442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3797b21-67da-42ab-b34e-bda369838f5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:59.021241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3797b21-67da-42ab-b34e-bda369838f5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:59.021699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3797b21-67da-42ab-b34e-bda369838f5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:59.024346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:59.154131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b3797b21-67da-42ab-b34e-bda369838f5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:59.161735 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b3797b21-67da-42ab-b34e-bda369838f5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.153914 Jul 20 05:08:59.162317 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3482/6864] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:59 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:00.178604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e7cbcaff-2441-4de7-881c-a233913a9d5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:00.180129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e7cbcaff-2441-4de7-881c-a233913a9d5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:00.187302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7cbcaff-2441-4de7-881c-a233913a9d5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:00.187782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7cbcaff-2441-4de7-881c-a233913a9d5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:00.188547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7cbcaff-2441-4de7-881c-a233913a9d5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:00.189121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7cbcaff-2441-4de7-881c-a233913a9d5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:00.322052 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e7cbcaff-2441-4de7-881c-a233913a9d5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:00.329704 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e7cbcaff-2441-4de7-881c-a233913a9d5d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1519 microversion: 2.1 time: 0.155125 Jul 20 05:09:00.330287 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3383/6865] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:00 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:01.347878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-694c0c53-7e61-4389-b2ad-732f9ad13228 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:01.348530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-694c0c53-7e61-4389-b2ad-732f9ad13228 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:01.355722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-694c0c53-7e61-4389-b2ad-732f9ad13228 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:01.356193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-694c0c53-7e61-4389-b2ad-732f9ad13228 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:01.357000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-694c0c53-7e61-4389-b2ad-732f9ad13228 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:01.357462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-694c0c53-7e61-4389-b2ad-732f9ad13228 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:01.549837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3fc8ed9a-27eb-467b-97d3-3b3db878890a req-dc1e4f76-866c-4d9e-b9e0-1f3771678030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198a57e5-473f-40f3-b00e-09bd3d22be20", "name": "network-vif-unplugged", "status": "completed", "tag": "d32d9863-b840-4b35-b1dd-e9235bdff8b3"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:01.559118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3fc8ed9a-27eb-467b-97d3-3b3db878890a req-dc1e4f76-866c-4d9e-b9e0-1f3771678030 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:01.559771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3fc8ed9a-27eb-467b-97d3-3b3db878890a req-dc1e4f76-866c-4d9e-b9e0-1f3771678030 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:01.573605 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3fc8ed9a-27eb-467b-97d3-3b3db878890a req-dc1e4f76-866c-4d9e-b9e0-1f3771678030 service nova] Creating event network-vif-unplugged:d32d9863-b840-4b35-b1dd-e9235bdff8b3 for instance 198a57e5-473f-40f3-b00e-09bd3d22be20 on n-h1-764485-11 Jul 20 05:09:01.580509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-3fc8ed9a-27eb-467b-97d3-3b3db878890a req-dc1e4f76-866c-4d9e-b9e0-1f3771678030 service nova] Instance 198a57e5-473f-40f3-b00e-09bd3d22be20 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:09:01.593065 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3fc8ed9a-27eb-467b-97d3-3b3db878890a req-dc1e4f76-866c-4d9e-b9e0-1f3771678030 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103484 Jul 20 05:09:01.593694 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3384/6866] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:09:01.609673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-694c0c53-7e61-4389-b2ad-732f9ad13228 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:01.618680 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-694c0c53-7e61-4389-b2ad-732f9ad13228 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1518 microversion: 2.1 time: 0.274220 Jul 20 05:09:01.627129 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3483/6867] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:01 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1518 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:02.637723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ab373166-2165-40ad-96a9-8b0d12988c42 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:02.638495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ab373166-2165-40ad-96a9-8b0d12988c42 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:02.644805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab373166-2165-40ad-96a9-8b0d12988c42 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:02.645261 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab373166-2165-40ad-96a9-8b0d12988c42 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:02.646029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab373166-2165-40ad-96a9-8b0d12988c42 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:02.646471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ab373166-2165-40ad-96a9-8b0d12988c42 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:02.777520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ab373166-2165-40ad-96a9-8b0d12988c42 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:02.785313 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ab373166-2165-40ad-96a9-8b0d12988c42 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1516 microversion: 2.1 time: 0.152787 Jul 20 05:09:02.785910 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3385/6868] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:02 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:03.612059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-04be0267-cc14-42cc-bfc5-20e8741ffbd6 req-b9dc050f-83f8-4e82-94a2-29c6a957c006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198a57e5-473f-40f3-b00e-09bd3d22be20", "tag": "d32d9863-b840-4b35-b1dd-e9235bdff8b3"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:03.621109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-04be0267-cc14-42cc-bfc5-20e8741ffbd6 req-b9dc050f-83f8-4e82-94a2-29c6a957c006 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:03.621568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-04be0267-cc14-42cc-bfc5-20e8741ffbd6 req-b9dc050f-83f8-4e82-94a2-29c6a957c006 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:03.633015 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-04be0267-cc14-42cc-bfc5-20e8741ffbd6 req-b9dc050f-83f8-4e82-94a2-29c6a957c006 service nova] Creating event network-changed:d32d9863-b840-4b35-b1dd-e9235bdff8b3 for instance 198a57e5-473f-40f3-b00e-09bd3d22be20 on n-h1-764485-11 Jul 20 05:09:03.639414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-04be0267-cc14-42cc-bfc5-20e8741ffbd6 req-b9dc050f-83f8-4e82-94a2-29c6a957c006 service nova] Instance 198a57e5-473f-40f3-b00e-09bd3d22be20 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:09:03.650217 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-04be0267-cc14-42cc-bfc5-20e8741ffbd6 req-b9dc050f-83f8-4e82-94a2-29c6a957c006 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042336 Jul 20 05:09:03.650912 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3484/6869] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:03.803249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-97b613f0-9fd1-419c-8bb7-1f44892de63f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:03.803903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-97b613f0-9fd1-419c-8bb7-1f44892de63f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:03.811302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97b613f0-9fd1-419c-8bb7-1f44892de63f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:03.811798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97b613f0-9fd1-419c-8bb7-1f44892de63f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:03.812585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97b613f0-9fd1-419c-8bb7-1f44892de63f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:03.813033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-97b613f0-9fd1-419c-8bb7-1f44892de63f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:04.035149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-97b613f0-9fd1-419c-8bb7-1f44892de63f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:04.044065 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-97b613f0-9fd1-419c-8bb7-1f44892de63f tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1516 microversion: 2.1 time: 0.244733 Jul 20 05:09:04.044645 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3386/6870] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:03 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:05.063001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-34fe9744-14e4-4f02-9353-77c067fa723c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:05.063776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-34fe9744-14e4-4f02-9353-77c067fa723c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:05.070191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34fe9744-14e4-4f02-9353-77c067fa723c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:05.070919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34fe9744-14e4-4f02-9353-77c067fa723c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:05.071760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34fe9744-14e4-4f02-9353-77c067fa723c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:05.072219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-34fe9744-14e4-4f02-9353-77c067fa723c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:05.323338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-34fe9744-14e4-4f02-9353-77c067fa723c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:05.334012 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-34fe9744-14e4-4f02-9353-77c067fa723c tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1516 microversion: 2.1 time: 0.276156 Jul 20 05:09:05.334759 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3485/6871] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:05 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1516 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:06.352760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-be11b9a9-3d43-49fb-a936-c0809fa62627 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.353484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-be11b9a9-3d43-49fb-a936-c0809fa62627 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.360753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be11b9a9-3d43-49fb-a936-c0809fa62627 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.361215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be11b9a9-3d43-49fb-a936-c0809fa62627 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.361993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be11b9a9-3d43-49fb-a936-c0809fa62627 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.362438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be11b9a9-3d43-49fb-a936-c0809fa62627 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.800871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-be11b9a9-3d43-49fb-a936-c0809fa62627 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:06.808748 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-be11b9a9-3d43-49fb-a936-c0809fa62627 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1513 microversion: 2.1 time: 0.460435 Jul 20 05:09:06.809348 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3387/6872] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:06 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:06.825592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3786d598-d1ab-4ef8-a16e-02440da0e5b5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:06.826162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3786d598-d1ab-4ef8-a16e-02440da0e5b5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.833568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3786d598-d1ab-4ef8-a16e-02440da0e5b5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.834046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3786d598-d1ab-4ef8-a16e-02440da0e5b5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.834843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3786d598-d1ab-4ef8-a16e-02440da0e5b5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.835312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3786d598-d1ab-4ef8-a16e-02440da0e5b5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.893832 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3786d598-d1ab-4ef8-a16e-02440da0e5b5 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "POST /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20/action" status: 204 len: 0 microversion: 2.1 time: 0.072588 Jul 20 05:09:06.894564 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3486/6873] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:09:06 2022] POST /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:09:06.904212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-55143238-0a7a-4a79-89db-7fbc613dd657 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.904875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-55143238-0a7a-4a79-89db-7fbc613dd657 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.911095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55143238-0a7a-4a79-89db-7fbc613dd657 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.911568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55143238-0a7a-4a79-89db-7fbc613dd657 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.912356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55143238-0a7a-4a79-89db-7fbc613dd657 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.912804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-55143238-0a7a-4a79-89db-7fbc613dd657 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:07.129651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-55143238-0a7a-4a79-89db-7fbc613dd657 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:07.139001 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-55143238-0a7a-4a79-89db-7fbc613dd657 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1513 microversion: 2.1 time: 0.240020 Jul 20 05:09:07.139639 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3388/6874] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:06 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1513 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:07.396304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4e614d70-2a65-442c-975a-8c896ea4f495 req-9c1afa00-8850-4c97-b114-99021bb5b965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198a57e5-473f-40f3-b00e-09bd3d22be20", "name": "network-vif-plugged", "status": "completed", "tag": "d32d9863-b840-4b35-b1dd-e9235bdff8b3"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:07.405344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4e614d70-2a65-442c-975a-8c896ea4f495 req-9c1afa00-8850-4c97-b114-99021bb5b965 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:07.405806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4e614d70-2a65-442c-975a-8c896ea4f495 req-9c1afa00-8850-4c97-b114-99021bb5b965 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:07.418511 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4e614d70-2a65-442c-975a-8c896ea4f495 req-9c1afa00-8850-4c97-b114-99021bb5b965 service nova] Creating event network-vif-plugged:d32d9863-b840-4b35-b1dd-e9235bdff8b3 for instance 198a57e5-473f-40f3-b00e-09bd3d22be20 on n-h1-764485-11 Jul 20 05:09:07.423950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-4e614d70-2a65-442c-975a-8c896ea4f495 req-9c1afa00-8850-4c97-b114-99021bb5b965 service nova] Instance 198a57e5-473f-40f3-b00e-09bd3d22be20 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:09:07.435950 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4e614d70-2a65-442c-975a-8c896ea4f495 req-9c1afa00-8850-4c97-b114-99021bb5b965 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095321 Jul 20 05:09:07.436562 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3487/6875] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:08.159846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-90a73729-e13f-4d7b-aa4f-686971123c80 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:08.160478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-90a73729-e13f-4d7b-aa4f-686971123c80 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:08.168716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90a73729-e13f-4d7b-aa4f-686971123c80 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:08.169178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90a73729-e13f-4d7b-aa4f-686971123c80 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:08.169975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90a73729-e13f-4d7b-aa4f-686971123c80 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:08.170618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-90a73729-e13f-4d7b-aa4f-686971123c80 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:08.329559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-90a73729-e13f-4d7b-aa4f-686971123c80 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:08.339933 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-90a73729-e13f-4d7b-aa4f-686971123c80 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1513 microversion: 2.1 time: 0.187073 Jul 20 05:09:08.340555 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3389/6876] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:08 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:09.359916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ee901054-e4d4-4c35-962b-12dee51c2ffc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:09.361173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ee901054-e4d4-4c35-962b-12dee51c2ffc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:09.367146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee901054-e4d4-4c35-962b-12dee51c2ffc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:09.367682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee901054-e4d4-4c35-962b-12dee51c2ffc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:09.368627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee901054-e4d4-4c35-962b-12dee51c2ffc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:09.369081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ee901054-e4d4-4c35-962b-12dee51c2ffc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:09.511354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ee901054-e4d4-4c35-962b-12dee51c2ffc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:09.520347 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ee901054-e4d4-4c35-962b-12dee51c2ffc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1505 microversion: 2.1 time: 0.165682 Jul 20 05:09:09.520933 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3488/6877] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:09 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:09.543238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a48c628-4c6a-4e54-bc06-fd5eec1980c1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:09.543886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4a48c628-4c6a-4e54-bc06-fd5eec1980c1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:09.550866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a48c628-4c6a-4e54-bc06-fd5eec1980c1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:09.551327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a48c628-4c6a-4e54-bc06-fd5eec1980c1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:09.552130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a48c628-4c6a-4e54-bc06-fd5eec1980c1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:09.552573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a48c628-4c6a-4e54-bc06-fd5eec1980c1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:09.688321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a48c628-4c6a-4e54-bc06-fd5eec1980c1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:09.697149 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a48c628-4c6a-4e54-bc06-fd5eec1980c1 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1505 microversion: 2.1 time: 0.162674 Jul 20 05:09:09.698237 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3390/6878] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:09 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:09.714529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd6b50f8-96e4-41bb-b266-7a54712d6245 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:09.715099 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dd6b50f8-96e4-41bb-b266-7a54712d6245 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:09.721156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd6b50f8-96e4-41bb-b266-7a54712d6245 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:09.721620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd6b50f8-96e4-41bb-b266-7a54712d6245 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:09.722398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd6b50f8-96e4-41bb-b266-7a54712d6245 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:09.722852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd6b50f8-96e4-41bb-b266-7a54712d6245 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:09.856953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dd6b50f8-96e4-41bb-b266-7a54712d6245 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:09.864812 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dd6b50f8-96e4-41bb-b266-7a54712d6245 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1505 microversion: 2.1 time: 0.154947 Jul 20 05:09:09.865394 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3489/6879] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:09 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:09.881316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e7570239-c47f-453e-99e6-3994f0c3cab0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:09.881818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e7570239-c47f-453e-99e6-3994f0c3cab0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:09.888918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7570239-c47f-453e-99e6-3994f0c3cab0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:09.889374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7570239-c47f-453e-99e6-3994f0c3cab0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:09.890149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7570239-c47f-453e-99e6-3994f0c3cab0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:09.890591 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7570239-c47f-453e-99e6-3994f0c3cab0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:09.916159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e7570239-c47f-453e-99e6-3994f0c3cab0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:09:09.992526 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e7570239-c47f-453e-99e6-3994f0c3cab0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "DELETE /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 204 len: 0 microversion: 2.1 time: 0.115054 Jul 20 05:09:09.993199 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3391/6880] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:09 2022] DELETE /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:09:10.010841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b76fcb3d-865c-42f3-a524-2efab31e50d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:10.011360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b76fcb3d-865c-42f3-a524-2efab31e50d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:10.017433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b76fcb3d-865c-42f3-a524-2efab31e50d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:10.017975 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b76fcb3d-865c-42f3-a524-2efab31e50d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:10.018745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b76fcb3d-865c-42f3-a524-2efab31e50d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:10.019197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b76fcb3d-865c-42f3-a524-2efab31e50d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:10.045292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b76fcb3d-865c-42f3-a524-2efab31e50d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:09:10.091490 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.compute.api [None req-b76fcb3d-865c-42f3-a524-2efab31e50d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Instance is already in deleting state, ignoring this request Jul 20 05:09:10.092350 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b76fcb3d-865c-42f3-a524-2efab31e50d0 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "DELETE /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 204 len: 0 microversion: 2.1 time: 0.086010 Jul 20 05:09:10.092917 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3490/6881] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:10 2022] DELETE /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:09:10.101563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4f5f9ba1-4170-483c-8e1e-795b364c34f4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:10.102401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4f5f9ba1-4170-483c-8e1e-795b364c34f4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:10.108482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f5f9ba1-4170-483c-8e1e-795b364c34f4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:10.108931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f5f9ba1-4170-483c-8e1e-795b364c34f4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:10.109687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f5f9ba1-4170-483c-8e1e-795b364c34f4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:10.110120 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4f5f9ba1-4170-483c-8e1e-795b364c34f4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:10.241455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4f5f9ba1-4170-483c-8e1e-795b364c34f4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:10.244516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:10.251293 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4f5f9ba1-4170-483c-8e1e-795b364c34f4 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1511 microversion: 2.1 time: 0.154046 Jul 20 05:09:10.251902 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3392/6882] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:10 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:11.268966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fbbc56f9-b11b-48fb-adc5-75cf09aa2299 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:11.269600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fbbc56f9-b11b-48fb-adc5-75cf09aa2299 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:11.276783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbbc56f9-b11b-48fb-adc5-75cf09aa2299 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:11.277254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbbc56f9-b11b-48fb-adc5-75cf09aa2299 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:11.278038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbbc56f9-b11b-48fb-adc5-75cf09aa2299 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:11.278492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fbbc56f9-b11b-48fb-adc5-75cf09aa2299 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:11.413351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fbbc56f9-b11b-48fb-adc5-75cf09aa2299 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0fe0f8c44d7407a903b4b5f4e644c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1932f069dc4d738cfd389a2e6c0aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:11.421579 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fbbc56f9-b11b-48fb-adc5-75cf09aa2299 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 200 len: 1511 microversion: 2.1 time: 0.156554 Jul 20 05:09:11.422169 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3491/6883] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:11 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:11.942943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-4f36cb25-3ad0-4f5b-ae37-4df8903d579b req-aa0b3a09-acf2-489c-a2d7-6eb7b05ccc56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198a57e5-473f-40f3-b00e-09bd3d22be20", "name": "network-vif-deleted", "tag": "d32d9863-b840-4b35-b1dd-e9235bdff8b3"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:11.957759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4f36cb25-3ad0-4f5b-ae37-4df8903d579b req-aa0b3a09-acf2-489c-a2d7-6eb7b05ccc56 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:11.958316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4f36cb25-3ad0-4f5b-ae37-4df8903d579b req-aa0b3a09-acf2-489c-a2d7-6eb7b05ccc56 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:11.971699 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-4f36cb25-3ad0-4f5b-ae37-4df8903d579b req-aa0b3a09-acf2-489c-a2d7-6eb7b05ccc56 service nova] Creating event network-vif-deleted:d32d9863-b840-4b35-b1dd-e9235bdff8b3 for instance 198a57e5-473f-40f3-b00e-09bd3d22be20 on n-h1-764485-11 Jul 20 05:09:11.976996 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-4f36cb25-3ad0-4f5b-ae37-4df8903d579b req-aa0b3a09-acf2-489c-a2d7-6eb7b05ccc56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037709 Jul 20 05:09:11.978100 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3393/6884] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:12.438538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fc89ae08-1271-4b45-a215-219a16d9dd23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:12.439098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fc89ae08-1271-4b45-a215-219a16d9dd23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 198a57e5-473f-40f3-b00e-09bd3d22be20] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:12.447182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc89ae08-1271-4b45-a215-219a16d9dd23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:12.447688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc89ae08-1271-4b45-a215-219a16d9dd23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:12.448484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc89ae08-1271-4b45-a215-219a16d9dd23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:12.448951 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc89ae08-1271-4b45-a215-219a16d9dd23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:12.463094 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-fc89ae08-1271-4b45-a215-219a16d9dd23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] HTTP exception thrown: Instance 198a57e5-473f-40f3-b00e-09bd3d22be20 could not be found. Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fc89ae08-1271-4b45-a215-219a16d9dd23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Request method failure captured: Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 HTTP/1.1 Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi142REeVuKc_fKwXl_v31c8lJyEv3LilGOpvg1TQxP42lke-7bIHYn0ZGBLJTLv5cKQZ4g2KyKTKGpmv4b4X3mWfHLCbappHF_yX1AOuDR_rF9aKGjHOL5lFgc45OvBU62L0KmnaLws1f7LkgI3l1qQ28rwQxYivJnSsjSRVv66YXd7A Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 3f1932f069dc4d738cfd389a2e6c0aa6 Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2115472098 Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f1932f069dc4d738cfd389a2e6c0aa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f1932f069dc4d738cfd389a2e6c0aa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f1932f069dc4d738cfd389a2e6c0aa6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f1932f069dc4d738cfd389a2e6c0aa6"}]}] Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerDiskConfigTestJSON-2115472098 Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 3f1932f069dc4d738cfd389a2e6c0aa6 Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2115472098 Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerDiskConfigTestJSON-2115472098-project Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: d0fe0f8c44d7407a903b4b5f4e644c5b Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerDiskConfigTestJSON-2115472098-project Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 198a57e5-473f-40f3-b00e-09bd3d22be20 could not be found. Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '198a57e5-473f-40f3-b00e-09bd3d22be20'} Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198a57e5-473f-40f3-b00e-09bd3d22be20 could not be found. Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198a57e5-473f-40f3-b00e-09bd3d22be20 could not be found. Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:12.464888 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:09:12.468663 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:12.468663 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:12.468663 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:12.468663 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:12.468663 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:12.468663 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198a57e5-473f-40f3-b00e-09bd3d22be20 could not be found. Jul 20 05:09:12.468663 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:09:12.468663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fc89ae08-1271-4b45-a215-219a16d9dd23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Returning 404 to user: Instance 198a57e5-473f-40f3-b00e-09bd3d22be20 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:12.468663 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fc89ae08-1271-4b45-a215-219a16d9dd23 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20" status: 404 len: 111 microversion: 2.1 time: 0.031889 Jul 20 05:09:12.468663 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3492/6885] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:12 2022] GET /compute/v2.1/servers/198a57e5-473f-40f3-b00e-09bd3d22be20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:12.475902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2df9c839-0b3c-4eb5-8372-c8f9d173836d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '.version_select at 0x7fbf9c3790d0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:12.497293 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2df9c839-0b3c-4eb5-8372-c8f9d173836d tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1879382401" status: 202 len: 0 microversion: 2.1 time: 0.025737 Jul 20 05:09:12.497886 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3394/6886] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 05:09:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1879382401 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:09:13.401191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-08417dbe-87d7-42a2-8dde-12593ad30bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:13.401714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-08417dbe-87d7-42a2-8dde-12593ad30bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:13.403755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=36 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:13.409439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08417dbe-87d7-42a2-8dde-12593ad30bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:13.409914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08417dbe-87d7-42a2-8dde-12593ad30bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:13.410701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08417dbe-87d7-42a2-8dde-12593ad30bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:13.411160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-08417dbe-87d7-42a2-8dde-12593ad30bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:13.425440 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-08417dbe-87d7-42a2-8dde-12593ad30bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] HTTP exception thrown: Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 could not be found. Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-08417dbe-87d7-42a2-8dde-12593ad30bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Request method failure captured: Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 HTTP/1.1 Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi142REeVuKc_fKwXl_v31c8lJyEv3LilGOpvg1TQxP42lke-7bIHYn0ZGBLJTLv5cKQZ4g2KyKTKGpmv4b4X3mWfHLCbappHF_yX1AOuDR_rF9aKGjHOL5lFgc45OvBU62L0KmnaLws1f7LkgI3l1qQ28rwQxYivJnSsjSRVv66YXd7A Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 3f1932f069dc4d738cfd389a2e6c0aa6 Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2115472098 Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f1932f069dc4d738cfd389a2e6c0aa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f1932f069dc4d738cfd389a2e6c0aa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f1932f069dc4d738cfd389a2e6c0aa6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f1932f069dc4d738cfd389a2e6c0aa6"}]}] Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerDiskConfigTestJSON-2115472098 Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 3f1932f069dc4d738cfd389a2e6c0aa6 Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2115472098 Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerDiskConfigTestJSON-2115472098-project Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: d0fe0f8c44d7407a903b4b5f4e644c5b Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerDiskConfigTestJSON-2115472098-project Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 could not be found. Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2a1cea38-f807-48e1-874e-bcc8bee325b6'} Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 could not be found. Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:13.427055 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 could not be found. Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 could not be found. Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-08417dbe-87d7-42a2-8dde-12593ad30bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Returning 404 to user: Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-08417dbe-87d7-42a2-8dde-12593ad30bdc tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 404 len: 111 microversion: 2.1 time: 0.031996 Jul 20 05:09:13.430432 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3493/6887] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:13 2022] DELETE /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:13.437224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fd844c27-5a3c-47f9-b18e-3aa2aaa06c61 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:13.437968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fd844c27-5a3c-47f9-b18e-3aa2aaa06c61 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] [instance: 2a1cea38-f807-48e1-874e-bcc8bee325b6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:13.446239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd844c27-5a3c-47f9-b18e-3aa2aaa06c61 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:13.446999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd844c27-5a3c-47f9-b18e-3aa2aaa06c61 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:13.447806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd844c27-5a3c-47f9-b18e-3aa2aaa06c61 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:13.448254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd844c27-5a3c-47f9-b18e-3aa2aaa06c61 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:13.462260 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-fd844c27-5a3c-47f9-b18e-3aa2aaa06c61 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] HTTP exception thrown: Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 could not be found. Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fd844c27-5a3c-47f9-b18e-3aa2aaa06c61 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Request method failure captured: Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 HTTP/1.1 Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi142REeVuKc_fKwXl_v31c8lJyEv3LilGOpvg1TQxP42lke-7bIHYn0ZGBLJTLv5cKQZ4g2KyKTKGpmv4b4X3mWfHLCbappHF_yX1AOuDR_rF9aKGjHOL5lFgc45OvBU62L0KmnaLws1f7LkgI3l1qQ28rwQxYivJnSsjSRVv66YXd7A Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 3f1932f069dc4d738cfd389a2e6c0aa6 Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2115472098 Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f1932f069dc4d738cfd389a2e6c0aa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f1932f069dc4d738cfd389a2e6c0aa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f1932f069dc4d738cfd389a2e6c0aa6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f1932f069dc4d738cfd389a2e6c0aa6"}]}] Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerDiskConfigTestJSON-2115472098 Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 3f1932f069dc4d738cfd389a2e6c0aa6 Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2115472098 Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerDiskConfigTestJSON-2115472098-project Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: d0fe0f8c44d7407a903b4b5f4e644c5b Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerDiskConfigTestJSON-2115472098-project Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 could not be found. Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '2a1cea38-f807-48e1-874e-bcc8bee325b6'} Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 could not be found. Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 could not be found. Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:13.464059 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:09:13.468103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:13.468103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:13.468103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:13.468103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:13.468103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:13.468103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 could not be found. Jul 20 05:09:13.468103 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:09:13.468103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fd844c27-5a3c-47f9-b18e-3aa2aaa06c61 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] Returning 404 to user: Instance 2a1cea38-f807-48e1-874e-bcc8bee325b6 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:13.468103 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fd844c27-5a3c-47f9-b18e-3aa2aaa06c61 tempest-ServerDiskConfigTestJSON-2115472098 tempest-ServerDiskConfigTestJSON-2115472098-project] 10.222.0.20 "GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6" status: 404 len: 111 microversion: 2.1 time: 0.032207 Jul 20 05:09:13.468103 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3395/6888] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:13 2022] GET /compute/v2.1/servers/2a1cea38-f807-48e1-874e-bcc8bee325b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:21.883933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6afb46d5-eae8-48de-bf64-6a8008906b50 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'create', calling method: .version_select at 0x7fbf9c814ee0>, body: {"keypair": {"name": "tempest-keypair-1049948118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ1036ilExyBs0mAS8+htqOZH7gNsYAr0aSJpx6bo+lK0/geVwlQ9rLKTpB433bjkKORhFhz6rj1i42Rsjevb5WHtO1/gjbwYZhIc88GM8+DuNdFQ9V/nycPiHmj8AHoQ=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:21.900424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-6afb46d5-eae8-48de-bf64-6a8008906b50 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:09:21.906427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-6afb46d5-eae8-48de-bf64-6a8008906b50 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for user 515b90b9f91e47719155e3d2448cd0dd and project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:09:21.942561 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6afb46d5-eae8-48de-bf64-6a8008906b50 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194602 Jul 20 05:09:21.949183 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3494/6889] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:09:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:23.273027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-781458559", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4331169-eba0-470b-9af3-17270dc6efeb"}], "security_groups": [{"name": "tempest-securitygroup--376987174"}], "key_name": "tempest-keypair-1049948118", "user_data": "}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:23.281439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:23.383834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] validate_networks() for [('f4331169-eba0-470b-9af3-17270dc6efeb', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:09:23.453160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=5 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:23.989791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:09:23.990229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:09:23.990711 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:09:23.991126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:09:23.991568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:09:24.002221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:24.002684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:24.003482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:24.004179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:24.023343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:09:24.031714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for user 515b90b9f91e47719155e3d2448cd0dd and project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:09:24.046620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:09:24.048946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:09:24.095929 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-77982b21-5a85-4681-9e94-8b52414a5f30 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.827314 Jul 20 05:09:24.102373 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3396/6890] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:09:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:09:24.105080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:24.109912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-27b3326a-787b-4e50-a773-c16b788c3113 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:24.110811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-27b3326a-787b-4e50-a773-c16b788c3113 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:24.189491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-27b3326a-787b-4e50-a773-c16b788c3113 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:24.199911 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-27b3326a-787b-4e50-a773-c16b788c3113 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1238 microversion: 2.1 time: 0.096442 Jul 20 05:09:24.200952 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3495/6891] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:24 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:25.217998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-316c52ff-d007-42fa-a259-a4ddd9af4adb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:25.224159 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-316c52ff-d007-42fa-a259-a4ddd9af4adb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:25.245309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-316c52ff-d007-42fa-a259-a4ddd9af4adb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:25.246215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-316c52ff-d007-42fa-a259-a4ddd9af4adb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:25.247381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-316c52ff-d007-42fa-a259-a4ddd9af4adb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:25.248259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-316c52ff-d007-42fa-a259-a4ddd9af4adb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:25.331581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-316c52ff-d007-42fa-a259-a4ddd9af4adb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:25.345356 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-316c52ff-d007-42fa-a259-a4ddd9af4adb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1308 microversion: 2.1 time: 0.131550 Jul 20 05:09:25.347435 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3397/6892] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:25 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1308 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:26.364007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e893f360-7f47-4429-8f16-505f72060af1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:26.364652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e893f360-7f47-4429-8f16-505f72060af1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:26.372124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e893f360-7f47-4429-8f16-505f72060af1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:26.372596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e893f360-7f47-4429-8f16-505f72060af1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:26.373522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e893f360-7f47-4429-8f16-505f72060af1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:26.373892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e893f360-7f47-4429-8f16-505f72060af1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:26.598756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e893f360-7f47-4429-8f16-505f72060af1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:26.607158 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e893f360-7f47-4429-8f16-505f72060af1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1363 microversion: 2.1 time: 0.247382 Jul 20 05:09:26.616649 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3496/6893] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:26 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:26.731536 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ccb6b62d-2fb8-4368-8467-e2af45229237 req-799c9e63-3d4a-4dc1-a274-2afda0454ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacf1b09-efe0-412c-b646-1bf88a8d3b94", "tag": "d1310d03-46c5-4953-b35e-baea1c7adc0e"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:26.748570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ccb6b62d-2fb8-4368-8467-e2af45229237 req-799c9e63-3d4a-4dc1-a274-2afda0454ab2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:26.749030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ccb6b62d-2fb8-4368-8467-e2af45229237 req-799c9e63-3d4a-4dc1-a274-2afda0454ab2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:26.772554 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ccb6b62d-2fb8-4368-8467-e2af45229237 req-799c9e63-3d4a-4dc1-a274-2afda0454ab2 service nova] Creating event network-changed:d1310d03-46c5-4953-b35e-baea1c7adc0e for instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 on n-h2-764485-11 Jul 20 05:09:26.777948 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ccb6b62d-2fb8-4368-8467-e2af45229237 req-799c9e63-3d4a-4dc1-a274-2afda0454ab2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051155 Jul 20 05:09:26.778573 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3398/6894] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:27.624367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9038b698-f8c7-4a81-ae48-ff74fe2c3226 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:27.625008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9038b698-f8c7-4a81-ae48-ff74fe2c3226 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:27.634336 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9038b698-f8c7-4a81-ae48-ff74fe2c3226 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:27.634810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9038b698-f8c7-4a81-ae48-ff74fe2c3226 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:27.635651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9038b698-f8c7-4a81-ae48-ff74fe2c3226 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:27.636115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9038b698-f8c7-4a81-ae48-ff74fe2c3226 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:27.769756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9038b698-f8c7-4a81-ae48-ff74fe2c3226 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:27.778060 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9038b698-f8c7-4a81-ae48-ff74fe2c3226 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1363 microversion: 2.1 time: 0.157640 Jul 20 05:09:27.778589 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3497/6895] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:27 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:28.796763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-624d4670-8b83-464b-a940-8131d6ca6ea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:28.797476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-624d4670-8b83-464b-a940-8131d6ca6ea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:28.803877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-624d4670-8b83-464b-a940-8131d6ca6ea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:28.804583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-624d4670-8b83-464b-a940-8131d6ca6ea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:28.805182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-624d4670-8b83-464b-a940-8131d6ca6ea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:28.805593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-624d4670-8b83-464b-a940-8131d6ca6ea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:28.939581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-624d4670-8b83-464b-a940-8131d6ca6ea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:28.947736 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-624d4670-8b83-464b-a940-8131d6ca6ea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1363 microversion: 2.1 time: 0.156122 Jul 20 05:09:28.948323 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3399/6896] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:28 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:29.965219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2cf7a40-b546-4c4c-b705-4cc7d30216fa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:29.965866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f2cf7a40-b546-4c4c-b705-4cc7d30216fa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:29.973060 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2cf7a40-b546-4c4c-b705-4cc7d30216fa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:29.973536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2cf7a40-b546-4c4c-b705-4cc7d30216fa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:29.974360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2cf7a40-b546-4c4c-b705-4cc7d30216fa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:29.974823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2cf7a40-b546-4c4c-b705-4cc7d30216fa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:30.106054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f2cf7a40-b546-4c4c-b705-4cc7d30216fa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:30.113752 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f2cf7a40-b546-4c4c-b705-4cc7d30216fa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1363 microversion: 2.1 time: 0.153225 Jul 20 05:09:30.114330 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3498/6897] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:29 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:31.130503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eb5ba40d-d1c6-4e8e-83ad-79167f3c990b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:31.131126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eb5ba40d-d1c6-4e8e-83ad-79167f3c990b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:31.139097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb5ba40d-d1c6-4e8e-83ad-79167f3c990b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:31.139589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb5ba40d-d1c6-4e8e-83ad-79167f3c990b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:31.140375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb5ba40d-d1c6-4e8e-83ad-79167f3c990b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:31.140857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb5ba40d-d1c6-4e8e-83ad-79167f3c990b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:31.275529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eb5ba40d-d1c6-4e8e-83ad-79167f3c990b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:31.283121 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eb5ba40d-d1c6-4e8e-83ad-79167f3c990b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1363 microversion: 2.1 time: 0.156528 Jul 20 05:09:31.283728 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3400/6898] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:31 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:32.300738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2161c195-58c0-4782-89c8-c92f093602c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:32.301381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2161c195-58c0-4782-89c8-c92f093602c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:32.308810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2161c195-58c0-4782-89c8-c92f093602c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:32.309278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2161c195-58c0-4782-89c8-c92f093602c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:32.310063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2161c195-58c0-4782-89c8-c92f093602c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:32.310527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2161c195-58c0-4782-89c8-c92f093602c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:32.445807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2161c195-58c0-4782-89c8-c92f093602c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:32.453587 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2161c195-58c0-4782-89c8-c92f093602c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1363 microversion: 2.1 time: 0.156805 Jul 20 05:09:32.454191 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3499/6899] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:32 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:33.347121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-9dfb55bb-7ce9-40db-b6fa-640ad67eab05 req-083555fb-8c20-40a3-ba38-a64d68b7edf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacf1b09-efe0-412c-b646-1bf88a8d3b94", "name": "network-vif-plugged", "status": "completed", "tag": "d1310d03-46c5-4953-b35e-baea1c7adc0e"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:33.356529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9dfb55bb-7ce9-40db-b6fa-640ad67eab05 req-083555fb-8c20-40a3-ba38-a64d68b7edf9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:33.356984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9dfb55bb-7ce9-40db-b6fa-640ad67eab05 req-083555fb-8c20-40a3-ba38-a64d68b7edf9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:33.369847 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-9dfb55bb-7ce9-40db-b6fa-640ad67eab05 req-083555fb-8c20-40a3-ba38-a64d68b7edf9 service nova] Creating event network-vif-plugged:d1310d03-46c5-4953-b35e-baea1c7adc0e for instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 on n-h2-764485-11 Jul 20 05:09:33.374805 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-9dfb55bb-7ce9-40db-b6fa-640ad67eab05 req-083555fb-8c20-40a3-ba38-a64d68b7edf9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031520 Jul 20 05:09:33.375370 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3401/6900] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:33.471039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-29e14101-e0d4-4efa-8d9a-d7d2880cbb8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:33.471933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-29e14101-e0d4-4efa-8d9a-d7d2880cbb8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:33.478549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29e14101-e0d4-4efa-8d9a-d7d2880cbb8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:33.479082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29e14101-e0d4-4efa-8d9a-d7d2880cbb8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:33.480052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29e14101-e0d4-4efa-8d9a-d7d2880cbb8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:33.480609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-29e14101-e0d4-4efa-8d9a-d7d2880cbb8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:33.641850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-29e14101-e0d4-4efa-8d9a-d7d2880cbb8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:33.649704 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-29e14101-e0d4-4efa-8d9a-d7d2880cbb8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1363 microversion: 2.1 time: 0.182700 Jul 20 05:09:33.650280 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3500/6901] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:33 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:34.663488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:34.664328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:34.669413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d110e3a7-ae97-461c-b225-a41e994d0516 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:34.670126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d110e3a7-ae97-461c-b225-a41e994d0516 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:34.677321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d110e3a7-ae97-461c-b225-a41e994d0516 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:34.677783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d110e3a7-ae97-461c-b225-a41e994d0516 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:34.678555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d110e3a7-ae97-461c-b225-a41e994d0516 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:34.679002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d110e3a7-ae97-461c-b225-a41e994d0516 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:34.809882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d110e3a7-ae97-461c-b225-a41e994d0516 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:34.817556 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d110e3a7-ae97-461c-b225-a41e994d0516 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1363 microversion: 2.1 time: 0.155009 Jul 20 05:09:34.818154 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3402/6902] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:34 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:35.835079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e8662f9-4c8d-4e91-9a87-d6280c40d887 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:35.836561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3e8662f9-4c8d-4e91-9a87-d6280c40d887 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:35.838425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:35.846309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e8662f9-4c8d-4e91-9a87-d6280c40d887 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:35.846771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e8662f9-4c8d-4e91-9a87-d6280c40d887 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:35.847573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e8662f9-4c8d-4e91-9a87-d6280c40d887 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:35.848034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e8662f9-4c8d-4e91-9a87-d6280c40d887 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:35.980106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3e8662f9-4c8d-4e91-9a87-d6280c40d887 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:35.987946 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3e8662f9-4c8d-4e91-9a87-d6280c40d887 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1550 microversion: 2.1 time: 0.156732 Jul 20 05:09:35.988535 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3501/6903] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:35 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:36.006967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-00d6f8e6-19a7-4104-a43b-f2747e5fc654 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:36.007503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-00d6f8e6-19a7-4104-a43b-f2747e5fc654 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:36.014839 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00d6f8e6-19a7-4104-a43b-f2747e5fc654 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:36.015278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00d6f8e6-19a7-4104-a43b-f2747e5fc654 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:36.016118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00d6f8e6-19a7-4104-a43b-f2747e5fc654 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:36.016566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-00d6f8e6-19a7-4104-a43b-f2747e5fc654 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:36.096581 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-00d6f8e6-19a7-4104-a43b-f2747e5fc654 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093923 Jul 20 05:09:36.097226 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3403/6904] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 05:09:36 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:37.325291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-1237b242-050c-4085-9f22-35895133746a req-0cb45d2d-9da0-4e3f-8c3b-66facdad0551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacf1b09-efe0-412c-b646-1bf88a8d3b94", "tag": "d1310d03-46c5-4953-b35e-baea1c7adc0e"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:37.334546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1237b242-050c-4085-9f22-35895133746a req-0cb45d2d-9da0-4e3f-8c3b-66facdad0551 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:37.335001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1237b242-050c-4085-9f22-35895133746a req-0cb45d2d-9da0-4e3f-8c3b-66facdad0551 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:37.346326 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-1237b242-050c-4085-9f22-35895133746a req-0cb45d2d-9da0-4e3f-8c3b-66facdad0551 service nova] Creating event network-changed:d1310d03-46c5-4953-b35e-baea1c7adc0e for instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 on n-h2-764485-11 Jul 20 05:09:37.351700 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-1237b242-050c-4085-9f22-35895133746a req-0cb45d2d-9da0-4e3f-8c3b-66facdad0551 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030038 Jul 20 05:09:37.352381 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3502/6905] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:41.935805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:41.936564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=34 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:41.941389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ad181cc1-23a5-4b46-9761-9174e354aa6e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:41.942007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ad181cc1-23a5-4b46-9761-9174e354aa6e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:41.949883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad181cc1-23a5-4b46-9761-9174e354aa6e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:41.951022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad181cc1-23a5-4b46-9761-9174e354aa6e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:41.951820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad181cc1-23a5-4b46-9761-9174e354aa6e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:41.952259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ad181cc1-23a5-4b46-9761-9174e354aa6e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.092918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ad181cc1-23a5-4b46-9761-9174e354aa6e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:42.100614 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ad181cc1-23a5-4b46-9761-9174e354aa6e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1669 microversion: 2.1 time: 0.167963 Jul 20 05:10:42.101202 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3404/6906] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:41 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:42.116278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:42.118079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=38 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:42.123625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4fbc21db-d218-4067-9a9c-4eaf85089282 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:42.124472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4fbc21db-d218-4067-9a9c-4eaf85089282 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:42.132066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fbc21db-d218-4067-9a9c-4eaf85089282 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:42.132531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fbc21db-d218-4067-9a9c-4eaf85089282 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.133306 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fbc21db-d218-4067-9a9c-4eaf85089282 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:42.133756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4fbc21db-d218-4067-9a9c-4eaf85089282 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.275057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4fbc21db-d218-4067-9a9c-4eaf85089282 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:42.283134 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4fbc21db-d218-4067-9a9c-4eaf85089282 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1669 microversion: 2.1 time: 0.169937 Jul 20 05:10:42.283746 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3503/6907] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:42 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:42.299666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e93492cb-4b56-4a22-a39c-764e3371ac50 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:42.300288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e93492cb-4b56-4a22-a39c-764e3371ac50 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:42.308519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e93492cb-4b56-4a22-a39c-764e3371ac50 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:42.308977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e93492cb-4b56-4a22-a39c-764e3371ac50 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.310422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e93492cb-4b56-4a22-a39c-764e3371ac50 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:42.310884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e93492cb-4b56-4a22-a39c-764e3371ac50 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.445463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e93492cb-4b56-4a22-a39c-764e3371ac50 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:42.453186 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e93492cb-4b56-4a22-a39c-764e3371ac50 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1669 microversion: 2.1 time: 0.157408 Jul 20 05:10:42.453797 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3405/6908] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:42 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:42.470041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:42.471040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:42.479760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:42.480231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.481019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:42.482080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.518405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:42.525328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Old instance type m1.heat2, new instance type m1.heat {{(pid=119808) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:10:42.532493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:10:42.532926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:10:42.533425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:10:42.533862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:10:42.534285 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:10:42.596412 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d2ac140b-9d13-4c18-9d9b-76444d7fb852 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94/action" status: 202 len: 0 microversion: 2.1 time: 0.131030 Jul 20 05:10:42.597030 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3504/6909] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:10:42 2022] POST /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:10:42.611404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0a984495-8217-4f58-90b3-580cf9f65219 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:42.612077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0a984495-8217-4f58-90b3-580cf9f65219 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:42.618046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a984495-8217-4f58-90b3-580cf9f65219 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:42.618503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a984495-8217-4f58-90b3-580cf9f65219 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.619288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a984495-8217-4f58-90b3-580cf9f65219 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:42.619760 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0a984495-8217-4f58-90b3-580cf9f65219 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.753203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0a984495-8217-4f58-90b3-580cf9f65219 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:42.760821 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0a984495-8217-4f58-90b3-580cf9f65219 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1678 microversion: 2.1 time: 0.157255 Jul 20 05:10:42.761398 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3406/6910] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:42 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:43.778978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-40345ccd-0171-4cf7-87e3-e5f4ec4f239a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:43.779578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-40345ccd-0171-4cf7-87e3-e5f4ec4f239a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:43.786542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40345ccd-0171-4cf7-87e3-e5f4ec4f239a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:43.787004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40345ccd-0171-4cf7-87e3-e5f4ec4f239a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:43.787809 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40345ccd-0171-4cf7-87e3-e5f4ec4f239a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:43.788308 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-40345ccd-0171-4cf7-87e3-e5f4ec4f239a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:43.932748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-40345ccd-0171-4cf7-87e3-e5f4ec4f239a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:43.941250 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-40345ccd-0171-4cf7-87e3-e5f4ec4f239a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1678 microversion: 2.1 time: 0.167273 Jul 20 05:10:43.941825 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3505/6911] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:43 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:44.958615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-48088580-6153-48a5-9610-63d4dfd08e5c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:44.959225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-48088580-6153-48a5-9610-63d4dfd08e5c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:44.966576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48088580-6153-48a5-9610-63d4dfd08e5c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:44.967712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48088580-6153-48a5-9610-63d4dfd08e5c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:44.968592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48088580-6153-48a5-9610-63d4dfd08e5c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:44.969038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-48088580-6153-48a5-9610-63d4dfd08e5c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:45.099435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-48088580-6153-48a5-9610-63d4dfd08e5c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:45.107194 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-48088580-6153-48a5-9610-63d4dfd08e5c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1683 microversion: 2.1 time: 0.152503 Jul 20 05:10:45.108356 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3407/6912] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:44 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:46.127542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-93deaa56-d961-4a47-9aa4-058c4fbc079f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:46.128164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-93deaa56-d961-4a47-9aa4-058c4fbc079f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:46.135007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93deaa56-d961-4a47-9aa4-058c4fbc079f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:46.135466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93deaa56-d961-4a47-9aa4-058c4fbc079f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:46.136262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93deaa56-d961-4a47-9aa4-058c4fbc079f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:46.136710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93deaa56-d961-4a47-9aa4-058c4fbc079f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:46.274615 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-93deaa56-d961-4a47-9aa4-058c4fbc079f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:46.283180 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-93deaa56-d961-4a47-9aa4-058c4fbc079f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1683 microversion: 2.1 time: 0.161794 Jul 20 05:10:46.283786 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3506/6913] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:46 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:47.300671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5dbb4cde-2bbf-4057-a8f1-94017369eb9e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:47.301316 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5dbb4cde-2bbf-4057-a8f1-94017369eb9e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:47.307979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5dbb4cde-2bbf-4057-a8f1-94017369eb9e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:47.308429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5dbb4cde-2bbf-4057-a8f1-94017369eb9e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:47.309193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5dbb4cde-2bbf-4057-a8f1-94017369eb9e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:47.309631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5dbb4cde-2bbf-4057-a8f1-94017369eb9e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:47.439315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5dbb4cde-2bbf-4057-a8f1-94017369eb9e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:47.446861 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5dbb4cde-2bbf-4057-a8f1-94017369eb9e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1683 microversion: 2.1 time: 0.150459 Jul 20 05:10:47.447443 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3408/6914] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:47 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:48.464266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-51f388d5-b17d-4c95-aacc-3c9bbe29443e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:48.464844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-51f388d5-b17d-4c95-aacc-3c9bbe29443e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:48.472493 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51f388d5-b17d-4c95-aacc-3c9bbe29443e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:48.472967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51f388d5-b17d-4c95-aacc-3c9bbe29443e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:48.473757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51f388d5-b17d-4c95-aacc-3c9bbe29443e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:48.474216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51f388d5-b17d-4c95-aacc-3c9bbe29443e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:48.607918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-51f388d5-b17d-4c95-aacc-3c9bbe29443e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:48.615722 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-51f388d5-b17d-4c95-aacc-3c9bbe29443e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1683 microversion: 2.1 time: 0.155508 Jul 20 05:10:48.616305 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3507/6915] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:48 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:49.634226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9948d8be-afa2-4955-b9ec-61fbb2a3688d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:49.634858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9948d8be-afa2-4955-b9ec-61fbb2a3688d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:49.643300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9948d8be-afa2-4955-b9ec-61fbb2a3688d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:49.643784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9948d8be-afa2-4955-b9ec-61fbb2a3688d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:49.644566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9948d8be-afa2-4955-b9ec-61fbb2a3688d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:49.645014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9948d8be-afa2-4955-b9ec-61fbb2a3688d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:49.777099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9948d8be-afa2-4955-b9ec-61fbb2a3688d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:49.785480 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9948d8be-afa2-4955-b9ec-61fbb2a3688d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1683 microversion: 2.1 time: 0.155755 Jul 20 05:10:49.786058 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3409/6916] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:49 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:50.803261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ef7e93be-5675-48ea-b8ca-aa0f8be38fd0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:50.803928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ef7e93be-5675-48ea-b8ca-aa0f8be38fd0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:50.811094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef7e93be-5675-48ea-b8ca-aa0f8be38fd0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:50.811642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef7e93be-5675-48ea-b8ca-aa0f8be38fd0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:50.812446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef7e93be-5675-48ea-b8ca-aa0f8be38fd0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:50.812909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef7e93be-5675-48ea-b8ca-aa0f8be38fd0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:50.944168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ef7e93be-5675-48ea-b8ca-aa0f8be38fd0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:50.951701 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ef7e93be-5675-48ea-b8ca-aa0f8be38fd0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1683 microversion: 2.1 time: 0.152483 Jul 20 05:10:50.952477 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3508/6917] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:50 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:51.968028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b54db939-4d84-4fff-93ee-5cc2c19fd101 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:51.968655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b54db939-4d84-4fff-93ee-5cc2c19fd101 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:51.976326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b54db939-4d84-4fff-93ee-5cc2c19fd101 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:51.976780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b54db939-4d84-4fff-93ee-5cc2c19fd101 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:51.977541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b54db939-4d84-4fff-93ee-5cc2c19fd101 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:51.977980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b54db939-4d84-4fff-93ee-5cc2c19fd101 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:52.118164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b54db939-4d84-4fff-93ee-5cc2c19fd101 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:52.125880 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b54db939-4d84-4fff-93ee-5cc2c19fd101 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1683 microversion: 2.1 time: 0.161911 Jul 20 05:10:52.126475 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3410/6918] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:51 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:53.144185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0e55a8ca-b2df-4c3c-8c13-73fb12bc7de1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:53.144857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0e55a8ca-b2df-4c3c-8c13-73fb12bc7de1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:53.152110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e55a8ca-b2df-4c3c-8c13-73fb12bc7de1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:53.152570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e55a8ca-b2df-4c3c-8c13-73fb12bc7de1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:53.153345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e55a8ca-b2df-4c3c-8c13-73fb12bc7de1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:53.153795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e55a8ca-b2df-4c3c-8c13-73fb12bc7de1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:53.285240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0e55a8ca-b2df-4c3c-8c13-73fb12bc7de1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:53.292850 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0e55a8ca-b2df-4c3c-8c13-73fb12bc7de1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1683 microversion: 2.1 time: 0.153703 Jul 20 05:10:53.293430 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3509/6919] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:53 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:54.310950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7008ecec-4b74-4048-9f0a-fbdc8f9a45ea tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:54.311588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7008ecec-4b74-4048-9f0a-fbdc8f9a45ea tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:54.319535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7008ecec-4b74-4048-9f0a-fbdc8f9a45ea tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:54.320003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7008ecec-4b74-4048-9f0a-fbdc8f9a45ea tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:54.320777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7008ecec-4b74-4048-9f0a-fbdc8f9a45ea tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:54.321239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7008ecec-4b74-4048-9f0a-fbdc8f9a45ea tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:54.455403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7008ecec-4b74-4048-9f0a-fbdc8f9a45ea tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:54.462985 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7008ecec-4b74-4048-9f0a-fbdc8f9a45ea tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1683 microversion: 2.1 time: 0.156021 Jul 20 05:10:54.463575 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3411/6920] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:54 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:55.480675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7ea21cd6-77ba-4457-a061-7f10771c6581 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:55.481335 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7ea21cd6-77ba-4457-a061-7f10771c6581 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:55.489353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ea21cd6-77ba-4457-a061-7f10771c6581 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:55.489810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ea21cd6-77ba-4457-a061-7f10771c6581 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:55.490580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ea21cd6-77ba-4457-a061-7f10771c6581 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:55.491030 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ea21cd6-77ba-4457-a061-7f10771c6581 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:55.621253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7ea21cd6-77ba-4457-a061-7f10771c6581 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:55.628904 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7ea21cd6-77ba-4457-a061-7f10771c6581 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1683 microversion: 2.1 time: 0.152176 Jul 20 05:10:55.629481 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3510/6921] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:55 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:56.646722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4dce62b1-d2ae-496e-aa2e-c85abd412be7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:56.647338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4dce62b1-d2ae-496e-aa2e-c85abd412be7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:56.654644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4dce62b1-d2ae-496e-aa2e-c85abd412be7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:56.655102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4dce62b1-d2ae-496e-aa2e-c85abd412be7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:56.655908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4dce62b1-d2ae-496e-aa2e-c85abd412be7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:56.657520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4dce62b1-d2ae-496e-aa2e-c85abd412be7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:56.834193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4dce62b1-d2ae-496e-aa2e-c85abd412be7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:56.843071 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4dce62b1-d2ae-496e-aa2e-c85abd412be7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1683 microversion: 2.1 time: 0.200291 Jul 20 05:10:56.843682 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3412/6922] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:56 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1683 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:57.377072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-80af492f-c5ad-4ab6-896c-9cd046947f65 req-4adff05d-906b-48c6-aba5-99638ac41157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacf1b09-efe0-412c-b646-1bf88a8d3b94", "name": "network-vif-unplugged", "status": "completed", "tag": "d1310d03-46c5-4953-b35e-baea1c7adc0e"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:57.386094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-80af492f-c5ad-4ab6-896c-9cd046947f65 req-4adff05d-906b-48c6-aba5-99638ac41157 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.386563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-80af492f-c5ad-4ab6-896c-9cd046947f65 req-4adff05d-906b-48c6-aba5-99638ac41157 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:57.400455 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-80af492f-c5ad-4ab6-896c-9cd046947f65 req-4adff05d-906b-48c6-aba5-99638ac41157 service nova] Creating event network-vif-unplugged:d1310d03-46c5-4953-b35e-baea1c7adc0e for instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 on n-h1-764485-11 Jul 20 05:10:57.405449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-80af492f-c5ad-4ab6-896c-9cd046947f65 req-4adff05d-906b-48c6-aba5-99638ac41157 service nova] Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:10:57.417879 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-80af492f-c5ad-4ab6-896c-9cd046947f65 req-4adff05d-906b-48c6-aba5-99638ac41157 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044611 Jul 20 05:10:57.418505 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3511/6923] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:57.862688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5170ba7a-ed6b-4ab0-900c-db072f124d6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:57.863328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5170ba7a-ed6b-4ab0-900c-db072f124d6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:57.870957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5170ba7a-ed6b-4ab0-900c-db072f124d6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.871423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5170ba7a-ed6b-4ab0-900c-db072f124d6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:57.872250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5170ba7a-ed6b-4ab0-900c-db072f124d6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.872718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5170ba7a-ed6b-4ab0-900c-db072f124d6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:58.103012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5170ba7a-ed6b-4ab0-900c-db072f124d6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:58.111543 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5170ba7a-ed6b-4ab0-900c-db072f124d6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1682 microversion: 2.1 time: 0.253943 Jul 20 05:10:58.112137 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3413/6924] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:57 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:59.131754 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1b8e113a-bad0-422c-ac3f-b66d8aeabe78 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:59.132479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1b8e113a-bad0-422c-ac3f-b66d8aeabe78 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:59.138756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b8e113a-bad0-422c-ac3f-b66d8aeabe78 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:59.139225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b8e113a-bad0-422c-ac3f-b66d8aeabe78 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:59.140042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b8e113a-bad0-422c-ac3f-b66d8aeabe78 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:59.140524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b8e113a-bad0-422c-ac3f-b66d8aeabe78 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:59.280584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1b8e113a-bad0-422c-ac3f-b66d8aeabe78 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:59.288472 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1b8e113a-bad0-422c-ac3f-b66d8aeabe78 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1680 microversion: 2.1 time: 0.161923 Jul 20 05:10:59.289062 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3512/6925] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:59 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:59.432685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ae729f0d-465b-446a-93e0-e8d59b4f20fd req-b943b61a-29a3-4958-9c83-bad257bcde4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacf1b09-efe0-412c-b646-1bf88a8d3b94", "tag": "d1310d03-46c5-4953-b35e-baea1c7adc0e"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:59.443146 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ae729f0d-465b-446a-93e0-e8d59b4f20fd req-b943b61a-29a3-4958-9c83-bad257bcde4a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:59.443633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ae729f0d-465b-446a-93e0-e8d59b4f20fd req-b943b61a-29a3-4958-9c83-bad257bcde4a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:59.456234 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ae729f0d-465b-446a-93e0-e8d59b4f20fd req-b943b61a-29a3-4958-9c83-bad257bcde4a service nova] Creating event network-changed:d1310d03-46c5-4953-b35e-baea1c7adc0e for instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 on n-h1-764485-11 Jul 20 05:10:59.461628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-ae729f0d-465b-446a-93e0-e8d59b4f20fd req-b943b61a-29a3-4958-9c83-bad257bcde4a service nova] Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:10:59.473708 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ae729f0d-465b-446a-93e0-e8d59b4f20fd req-b943b61a-29a3-4958-9c83-bad257bcde4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044611 Jul 20 05:10:59.474358 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3414/6926] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:11:00.306629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6221b8ee-0633-4076-a106-163afc00ce3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:00.307266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6221b8ee-0633-4076-a106-163afc00ce3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:00.315491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6221b8ee-0633-4076-a106-163afc00ce3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:00.315986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6221b8ee-0633-4076-a106-163afc00ce3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:00.316772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6221b8ee-0633-4076-a106-163afc00ce3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:00.317228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6221b8ee-0633-4076-a106-163afc00ce3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:00.759355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6221b8ee-0633-4076-a106-163afc00ce3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:00.767684 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6221b8ee-0633-4076-a106-163afc00ce3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1680 microversion: 2.1 time: 0.465344 Jul 20 05:11:00.768270 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3513/6927] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:00 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1680 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:01.786915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a57b7290-0a33-49f7-a90c-211437a04e29 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:01.787762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a57b7290-0a33-49f7-a90c-211437a04e29 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:01.793928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a57b7290-0a33-49f7-a90c-211437a04e29 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:01.794375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a57b7290-0a33-49f7-a90c-211437a04e29 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:01.795138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a57b7290-0a33-49f7-a90c-211437a04e29 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:01.795596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a57b7290-0a33-49f7-a90c-211437a04e29 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:01.930338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a57b7290-0a33-49f7-a90c-211437a04e29 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:01.938618 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a57b7290-0a33-49f7-a90c-211437a04e29 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1677 microversion: 2.1 time: 0.157470 Jul 20 05:11:01.939342 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3415/6928] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:01 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:01.955970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-784ce38d-27e6-4f1d-927f-e64e1f6747dd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:01.956541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-784ce38d-27e6-4f1d-927f-e64e1f6747dd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:01.963790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-784ce38d-27e6-4f1d-927f-e64e1f6747dd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:01.964262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-784ce38d-27e6-4f1d-927f-e64e1f6747dd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:01.965937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-784ce38d-27e6-4f1d-927f-e64e1f6747dd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:01.966768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-784ce38d-27e6-4f1d-927f-e64e1f6747dd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:02.026490 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-784ce38d-27e6-4f1d-927f-e64e1f6747dd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94/action" status: 204 len: 0 microversion: 2.1 time: 0.075021 Jul 20 05:11:02.027176 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3514/6929] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:11:01 2022] POST /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:11:02.035673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-24108f81-f41e-4374-85d9-203525f750de tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:02.036298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-24108f81-f41e-4374-85d9-203525f750de tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:02.042718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24108f81-f41e-4374-85d9-203525f750de tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:02.043210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24108f81-f41e-4374-85d9-203525f750de tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:02.044168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24108f81-f41e-4374-85d9-203525f750de tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:02.044696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-24108f81-f41e-4374-85d9-203525f750de tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:02.267869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-24108f81-f41e-4374-85d9-203525f750de tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:02.276169 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-24108f81-f41e-4374-85d9-203525f750de tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1677 microversion: 2.1 time: 0.244680 Jul 20 05:11:02.277157 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3416/6930] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:02 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1677 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:03.294714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a1afbbc3-bfd8-4f66-8df2-b0835146d804 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:03.295439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a1afbbc3-bfd8-4f66-8df2-b0835146d804 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:03.303571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1afbbc3-bfd8-4f66-8df2-b0835146d804 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.304036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1afbbc3-bfd8-4f66-8df2-b0835146d804 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.304930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1afbbc3-bfd8-4f66-8df2-b0835146d804 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.305385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a1afbbc3-bfd8-4f66-8df2-b0835146d804 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.448452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a1afbbc3-bfd8-4f66-8df2-b0835146d804 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:03.456142 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a1afbbc3-bfd8-4f66-8df2-b0835146d804 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1669 microversion: 2.1 time: 0.165915 Jul 20 05:11:03.456720 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3515/6931] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:03 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:03.473287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f02eaf3d-5107-4c2e-9a0a-fb5580b08072 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:03.474000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f02eaf3d-5107-4c2e-9a0a-fb5580b08072 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:03.480956 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f02eaf3d-5107-4c2e-9a0a-fb5580b08072 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.481416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f02eaf3d-5107-4c2e-9a0a-fb5580b08072 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.482194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f02eaf3d-5107-4c2e-9a0a-fb5580b08072 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.482641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f02eaf3d-5107-4c2e-9a0a-fb5580b08072 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.615274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f02eaf3d-5107-4c2e-9a0a-fb5580b08072 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:03.622833 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f02eaf3d-5107-4c2e-9a0a-fb5580b08072 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1669 microversion: 2.1 time: 0.154213 Jul 20 05:11:03.623423 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3417/6932] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:03 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:03.638803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f8a2f995-2828-4912-b1b9-e486b36a57f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:03.639440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f8a2f995-2828-4912-b1b9-e486b36a57f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:03.645474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8a2f995-2828-4912-b1b9-e486b36a57f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.645936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8a2f995-2828-4912-b1b9-e486b36a57f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.646703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8a2f995-2828-4912-b1b9-e486b36a57f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.647154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f8a2f995-2828-4912-b1b9-e486b36a57f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.783062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f8a2f995-2828-4912-b1b9-e486b36a57f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:03.792445 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f8a2f995-2828-4912-b1b9-e486b36a57f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1669 microversion: 2.1 time: 0.157192 Jul 20 05:11:03.793296 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3516/6933] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:03 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:03.810014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fa28bfe1-6996-43cf-8221-cf44dc7b55c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:03.810519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa28bfe1-6996-43cf-8221-cf44dc7b55c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:03.817732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa28bfe1-6996-43cf-8221-cf44dc7b55c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.818478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa28bfe1-6996-43cf-8221-cf44dc7b55c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.819265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa28bfe1-6996-43cf-8221-cf44dc7b55c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.820541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fa28bfe1-6996-43cf-8221-cf44dc7b55c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.849659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fa28bfe1-6996-43cf-8221-cf44dc7b55c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:11:03.893519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-fe0e375d-5f25-4f3c-9bd1-412ac5737372 req-a4ed6fa9-359e-4ece-a172-07891b10887c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacf1b09-efe0-412c-b646-1bf88a8d3b94", "name": "network-vif-plugged", "status": "completed", "tag": "d1310d03-46c5-4953-b35e-baea1c7adc0e"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:03.902678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-fe0e375d-5f25-4f3c-9bd1-412ac5737372 req-a4ed6fa9-359e-4ece-a172-07891b10887c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.903613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-fe0e375d-5f25-4f3c-9bd1-412ac5737372 req-a4ed6fa9-359e-4ece-a172-07891b10887c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.917514 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-fe0e375d-5f25-4f3c-9bd1-412ac5737372 req-a4ed6fa9-359e-4ece-a172-07891b10887c service nova] Creating event network-vif-plugged:d1310d03-46c5-4953-b35e-baea1c7adc0e for instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 on n-h1-764485-11 Jul 20 05:11:03.924017 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-fe0e375d-5f25-4f3c-9bd1-412ac5737372 req-a4ed6fa9-359e-4ece-a172-07891b10887c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035267 Jul 20 05:11:03.924636 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3517/6934] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:11:03.941006 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fa28bfe1-6996-43cf-8221-cf44dc7b55c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 204 len: 0 microversion: 2.1 time: 0.134550 Jul 20 05:11:03.941854 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3418/6935] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:11:03 2022] DELETE /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:11:03.951330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-68009de7-18f3-42f2-ad45-2779bf6de1e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:03.952148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-68009de7-18f3-42f2-ad45-2779bf6de1e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:03.958630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68009de7-18f3-42f2-ad45-2779bf6de1e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.959102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68009de7-18f3-42f2-ad45-2779bf6de1e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.960144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68009de7-18f3-42f2-ad45-2779bf6de1e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.960607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68009de7-18f3-42f2-ad45-2779bf6de1e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.966078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:04.098349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-68009de7-18f3-42f2-ad45-2779bf6de1e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:04.106122 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-68009de7-18f3-42f2-ad45-2779bf6de1e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1675 microversion: 2.1 time: 0.159291 Jul 20 05:11:04.106699 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3518/6936] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:03 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:05.124762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5c342f84-8d7b-4284-93db-99033b2e8daa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:05.125493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5c342f84-8d7b-4284-93db-99033b2e8daa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:05.135780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c342f84-8d7b-4284-93db-99033b2e8daa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:05.136459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c342f84-8d7b-4284-93db-99033b2e8daa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:05.137414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c342f84-8d7b-4284-93db-99033b2e8daa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:05.137873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c342f84-8d7b-4284-93db-99033b2e8daa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:05.143428 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:05.272607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5c342f84-8d7b-4284-93db-99033b2e8daa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:05.280443 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5c342f84-8d7b-4284-93db-99033b2e8daa tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1675 microversion: 2.1 time: 0.159982 Jul 20 05:11:05.281523 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3419/6937] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:05 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:06.297984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-343a1553-5672-425d-b1fe-b8b1e49f810e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:06.298630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-343a1553-5672-425d-b1fe-b8b1e49f810e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:06.305647 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-343a1553-5672-425d-b1fe-b8b1e49f810e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:06.306134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-343a1553-5672-425d-b1fe-b8b1e49f810e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:06.306972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-343a1553-5672-425d-b1fe-b8b1e49f810e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:06.307427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-343a1553-5672-425d-b1fe-b8b1e49f810e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:06.403456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-343a1553-5672-425d-b1fe-b8b1e49f810e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:06.415765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-7ca2c8f5-73bd-4b03-b1cb-cf9dccd67995 req-e155ca16-1fcd-466b-9ce2-b564fba86e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacf1b09-efe0-412c-b646-1bf88a8d3b94", "name": "network-vif-deleted", "tag": "d1310d03-46c5-4953-b35e-baea1c7adc0e"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:06.419824 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-343a1553-5672-425d-b1fe-b8b1e49f810e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 200 len: 1608 microversion: 2.1 time: 0.125796 Jul 20 05:11:06.426635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7ca2c8f5-73bd-4b03-b1cb-cf9dccd67995 req-e155ca16-1fcd-466b-9ce2-b564fba86e92 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:06.427162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-7ca2c8f5-73bd-4b03-b1cb-cf9dccd67995 req-e155ca16-1fcd-466b-9ce2-b564fba86e92 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:06.431708 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3519/6938] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:06 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 1608 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:06.441013 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-7ca2c8f5-73bd-4b03-b1cb-cf9dccd67995 req-e155ca16-1fcd-466b-9ce2-b564fba86e92 service nova] Creating event network-vif-deleted:d1310d03-46c5-4953-b35e-baea1c7adc0e for instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 on n-h1-764485-11 Jul 20 05:11:06.446232 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-7ca2c8f5-73bd-4b03-b1cb-cf9dccd67995 req-e155ca16-1fcd-466b-9ce2-b564fba86e92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034545 Jul 20 05:11:06.447045 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3420/6939] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:07.437939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-18c9fa37-d3e2-4795-a730-c287d485bbe3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:07.439734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-18c9fa37-d3e2-4795-a730-c287d485bbe3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:07.446616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18c9fa37-d3e2-4795-a730-c287d485bbe3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:07.447083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18c9fa37-d3e2-4795-a730-c287d485bbe3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:07.447902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18c9fa37-d3e2-4795-a730-c287d485bbe3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:07.448360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18c9fa37-d3e2-4795-a730-c287d485bbe3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:07.462805 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-18c9fa37-d3e2-4795-a730-c287d485bbe3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-18c9fa37-d3e2-4795-a730-c287d485bbe3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 HTTP/1.1 Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'bacf1b09-efe0-412c-b646-1bf88a8d3b94'} Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:11:07.464507 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:11:07.468774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:07.468774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:11:07.468774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:11:07.468774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:11:07.468774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:11:07.468774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:11:07.468774 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:11:07.468774 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-18c9fa37-d3e2-4795-a730-c287d485bbe3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:11:07.468774 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-18c9fa37-d3e2-4795-a730-c287d485bbe3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 404 len: 111 microversion: 2.1 time: 0.031944 Jul 20 05:11:07.468774 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3520/6940] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:07 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:11:07.480632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5cfdc127-b7f1-46cf-9cd3-3b226e91a88e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:07.481377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5cfdc127-b7f1-46cf-9cd3-3b226e91a88e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:07.488471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cfdc127-b7f1-46cf-9cd3-3b226e91a88e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:07.488930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cfdc127-b7f1-46cf-9cd3-3b226e91a88e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:07.489715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cfdc127-b7f1-46cf-9cd3-3b226e91a88e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:07.490158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cfdc127-b7f1-46cf-9cd3-3b226e91a88e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:07.506417 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-5cfdc127-b7f1-46cf-9cd3-3b226e91a88e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5cfdc127-b7f1-46cf-9cd3-3b226e91a88e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 HTTP/1.1 Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'bacf1b09-efe0-412c-b646-1bf88a8d3b94'} Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:11:07.508694 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:11:07.513287 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:07.513287 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:11:07.513287 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:11:07.513287 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:11:07.513287 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:11:07.513287 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:11:07.513287 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:11:07.513287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5cfdc127-b7f1-46cf-9cd3-3b226e91a88e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:11:07.513287 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5cfdc127-b7f1-46cf-9cd3-3b226e91a88e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 404 len: 111 microversion: 2.1 time: 0.034696 Jul 20 05:11:07.513287 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3421/6941] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:07 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:11:07.559622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-109075447", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "f4331169-eba0-470b-9af3-17270dc6efeb"}], "security_groups": [{"name": "tempest-securitygroup--376987174"}], "key_name": "tempest-keypair-1049948118", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:07.664565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] validate_networks() for [('f4331169-eba0-470b-9af3-17270dc6efeb', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:11:08.192110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:11:08.192535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:11:08.193037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:11:08.193470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:11:08.193905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:11:08.206923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:08.207385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:08.208261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:08.208712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:08.232872 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:11:08.238942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for user 515b90b9f91e47719155e3d2448cd0dd and project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:11:08.252746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:11:08.255067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:11:08.303652 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-68897340-7472-4168-8ad8-43e1296c31c2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.747759 Jul 20 05:11:08.304550 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3521/6942] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:11:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:11:08.316918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4c3cca90-5ec1-4eed-8903-f4f250c5281f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:08.317948 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4c3cca90-5ec1-4eed-8903-f4f250c5281f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:08.395020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4c3cca90-5ec1-4eed-8903-f4f250c5281f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:08.404491 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4c3cca90-5ec1-4eed-8903-f4f250c5281f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1238 microversion: 2.1 time: 0.093626 Jul 20 05:11:08.405141 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3422/6943] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:08 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:09.424677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ff1c20cf-e316-4ffe-9313-db063b0215c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:09.425331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ff1c20cf-e316-4ffe-9313-db063b0215c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:09.432583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff1c20cf-e316-4ffe-9313-db063b0215c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:09.433342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff1c20cf-e316-4ffe-9313-db063b0215c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:09.434416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff1c20cf-e316-4ffe-9313-db063b0215c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:09.435077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ff1c20cf-e316-4ffe-9313-db063b0215c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:09.508630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ff1c20cf-e316-4ffe-9313-db063b0215c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:09.516824 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ff1c20cf-e316-4ffe-9313-db063b0215c7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1308 microversion: 2.1 time: 0.097842 Jul 20 05:11:09.517524 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3522/6944] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:09 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:10.535913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-979b95bf-56e8-47b2-8c21-fc9355c17e57 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:10.536740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-979b95bf-56e8-47b2-8c21-fc9355c17e57 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:10.546718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-979b95bf-56e8-47b2-8c21-fc9355c17e57 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:10.547176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-979b95bf-56e8-47b2-8c21-fc9355c17e57 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:10.549196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-979b95bf-56e8-47b2-8c21-fc9355c17e57 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:10.549655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-979b95bf-56e8-47b2-8c21-fc9355c17e57 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:10.758759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-979b95bf-56e8-47b2-8c21-fc9355c17e57 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:10.766558 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-979b95bf-56e8-47b2-8c21-fc9355c17e57 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1363 microversion: 2.1 time: 0.235921 Jul 20 05:11:10.767141 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3423/6945] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:10 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:10.871333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-72878fd0-7d86-46e0-a486-8568d04a73d6 req-fe8dd96a-3c13-450e-8f20-81692f7d320a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1602f176-9891-417a-a81a-076198fadb29", "tag": "ff218d99-2757-47c0-a182-8b308a380db5"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:10.884889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-72878fd0-7d86-46e0-a486-8568d04a73d6 req-fe8dd96a-3c13-450e-8f20-81692f7d320a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:10.885350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-72878fd0-7d86-46e0-a486-8568d04a73d6 req-fe8dd96a-3c13-450e-8f20-81692f7d320a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:10.904238 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-72878fd0-7d86-46e0-a486-8568d04a73d6 req-fe8dd96a-3c13-450e-8f20-81692f7d320a service nova] Creating event network-changed:ff218d99-2757-47c0-a182-8b308a380db5 for instance 1602f176-9891-417a-a81a-076198fadb29 on n-h2-764485-11 Jul 20 05:11:10.910792 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-72878fd0-7d86-46e0-a486-8568d04a73d6 req-fe8dd96a-3c13-450e-8f20-81692f7d320a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044568 Jul 20 05:11:10.911428 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3523/6946] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:11.784585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2bde3455-25aa-4e01-be03-94ca7d245812 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:11.785877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2bde3455-25aa-4e01-be03-94ca7d245812 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:11.793301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bde3455-25aa-4e01-be03-94ca7d245812 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:11.793844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bde3455-25aa-4e01-be03-94ca7d245812 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:11.794693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bde3455-25aa-4e01-be03-94ca7d245812 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:11.795346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2bde3455-25aa-4e01-be03-94ca7d245812 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:11.936365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2bde3455-25aa-4e01-be03-94ca7d245812 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:11.944554 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2bde3455-25aa-4e01-be03-94ca7d245812 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1363 microversion: 2.1 time: 0.164366 Jul 20 05:11:11.945143 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3424/6947] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:11 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:12.963749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-76061ba0-a092-4d32-b500-95e7dc089504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:12.964473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-76061ba0-a092-4d32-b500-95e7dc089504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:12.966456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:12.972612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76061ba0-a092-4d32-b500-95e7dc089504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:12.973081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76061ba0-a092-4d32-b500-95e7dc089504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:12.973868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76061ba0-a092-4d32-b500-95e7dc089504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:12.974328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76061ba0-a092-4d32-b500-95e7dc089504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:13.109077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-76061ba0-a092-4d32-b500-95e7dc089504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:13.117214 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-76061ba0-a092-4d32-b500-95e7dc089504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1363 microversion: 2.1 time: 0.158722 Jul 20 05:11:13.117791 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3524/6948] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:12 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:14.141786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-350995a4-ee2d-46e4-9154-1c06100d4cab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:14.142664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-350995a4-ee2d-46e4-9154-1c06100d4cab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:14.145847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:14.151221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-350995a4-ee2d-46e4-9154-1c06100d4cab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:14.151712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-350995a4-ee2d-46e4-9154-1c06100d4cab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:14.152492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-350995a4-ee2d-46e4-9154-1c06100d4cab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:14.152940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-350995a4-ee2d-46e4-9154-1c06100d4cab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:14.293466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-350995a4-ee2d-46e4-9154-1c06100d4cab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:14.301189 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-350995a4-ee2d-46e4-9154-1c06100d4cab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1363 microversion: 2.1 time: 0.163312 Jul 20 05:11:14.301789 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3425/6949] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:14 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:15.319447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d509afc2-035f-4a95-b371-557fe0f85440 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:15.320117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d509afc2-035f-4a95-b371-557fe0f85440 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:15.327073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d509afc2-035f-4a95-b371-557fe0f85440 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:15.327570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d509afc2-035f-4a95-b371-557fe0f85440 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:15.328353 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d509afc2-035f-4a95-b371-557fe0f85440 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:15.328810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d509afc2-035f-4a95-b371-557fe0f85440 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:15.457958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d509afc2-035f-4a95-b371-557fe0f85440 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:15.465488 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d509afc2-035f-4a95-b371-557fe0f85440 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1363 microversion: 2.1 time: 0.150476 Jul 20 05:11:15.466076 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3525/6950] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:15 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:16.483360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5c9819b6-8c7d-45dd-bcbf-7fa2c526f198 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:16.483930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5c9819b6-8c7d-45dd-bcbf-7fa2c526f198 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:16.491182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c9819b6-8c7d-45dd-bcbf-7fa2c526f198 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:16.491665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c9819b6-8c7d-45dd-bcbf-7fa2c526f198 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:16.492432 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c9819b6-8c7d-45dd-bcbf-7fa2c526f198 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:16.492870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5c9819b6-8c7d-45dd-bcbf-7fa2c526f198 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:16.624474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5c9819b6-8c7d-45dd-bcbf-7fa2c526f198 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:16.632639 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5c9819b6-8c7d-45dd-bcbf-7fa2c526f198 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1363 microversion: 2.1 time: 0.153333 Jul 20 05:11:16.633223 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3426/6951] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:16 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:17.652533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-755128f8-eaa2-4ba0-8752-8424000106af tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:17.653163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-755128f8-eaa2-4ba0-8752-8424000106af tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:17.660268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-755128f8-eaa2-4ba0-8752-8424000106af tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:17.660725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-755128f8-eaa2-4ba0-8752-8424000106af tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:17.661496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-755128f8-eaa2-4ba0-8752-8424000106af tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:17.661941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-755128f8-eaa2-4ba0-8752-8424000106af tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:17.802771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-755128f8-eaa2-4ba0-8752-8424000106af tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:17.810743 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-755128f8-eaa2-4ba0-8752-8424000106af tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1363 microversion: 2.1 time: 0.162126 Jul 20 05:11:17.811355 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3526/6952] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:17 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:17.852389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-97c0a7dc-b581-4feb-aa10-890c27934ea2 req-72a93386-b89d-4de3-9fd5-4af85e16071f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1602f176-9891-417a-a81a-076198fadb29", "name": "network-vif-plugged", "status": "completed", "tag": "ff218d99-2757-47c0-a182-8b308a380db5"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:17.862264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-97c0a7dc-b581-4feb-aa10-890c27934ea2 req-72a93386-b89d-4de3-9fd5-4af85e16071f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:17.862719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-97c0a7dc-b581-4feb-aa10-890c27934ea2 req-72a93386-b89d-4de3-9fd5-4af85e16071f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:17.874472 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-97c0a7dc-b581-4feb-aa10-890c27934ea2 req-72a93386-b89d-4de3-9fd5-4af85e16071f service nova] Creating event network-vif-plugged:ff218d99-2757-47c0-a182-8b308a380db5 for instance 1602f176-9891-417a-a81a-076198fadb29 on n-h2-764485-11 Jul 20 05:11:17.880213 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-97c0a7dc-b581-4feb-aa10-890c27934ea2 req-72a93386-b89d-4de3-9fd5-4af85e16071f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031652 Jul 20 05:11:17.880995 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3427/6953] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:18.829250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4267bedf-bf3d-452a-bda0-1654ab50673c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:18.830488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4267bedf-bf3d-452a-bda0-1654ab50673c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:18.832292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:18.833080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:18.840006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4267bedf-bf3d-452a-bda0-1654ab50673c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:18.840468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4267bedf-bf3d-452a-bda0-1654ab50673c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:18.841248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4267bedf-bf3d-452a-bda0-1654ab50673c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:18.841702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4267bedf-bf3d-452a-bda0-1654ab50673c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:18.976881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4267bedf-bf3d-452a-bda0-1654ab50673c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:18.984915 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4267bedf-bf3d-452a-bda0-1654ab50673c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1363 microversion: 2.1 time: 0.159188 Jul 20 05:11:18.991443 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3527/6954] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:18 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:19.999558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:20.005263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-019f9ac9-72d5-4794-a505-6c38db1b6368 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:20.005966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-019f9ac9-72d5-4794-a505-6c38db1b6368 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:20.012650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-019f9ac9-72d5-4794-a505-6c38db1b6368 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:20.013103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-019f9ac9-72d5-4794-a505-6c38db1b6368 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:20.013864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-019f9ac9-72d5-4794-a505-6c38db1b6368 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:20.014305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-019f9ac9-72d5-4794-a505-6c38db1b6368 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:20.146482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-019f9ac9-72d5-4794-a505-6c38db1b6368 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:20.154218 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-019f9ac9-72d5-4794-a505-6c38db1b6368 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1550 microversion: 2.1 time: 0.155656 Jul 20 05:11:20.154739 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3428/6955] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:19 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:20.170856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8608d751-598b-4707-b53d-ece5a59479c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:20.171403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8608d751-598b-4707-b53d-ece5a59479c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:20.178352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8608d751-598b-4707-b53d-ece5a59479c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:20.178821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8608d751-598b-4707-b53d-ece5a59479c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:20.179638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8608d751-598b-4707-b53d-ece5a59479c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:20.180102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8608d751-598b-4707-b53d-ece5a59479c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:20.269307 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8608d751-598b-4707-b53d-ece5a59479c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102309 Jul 20 05:11:20.269936 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3528/6956] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 05:11:20 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:21.514476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-2d78ab18-02d5-44a5-afe2-be92844f5e88 req-99620f9d-d43f-44a4-a63a-829033494753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1602f176-9891-417a-a81a-076198fadb29", "tag": "ff218d99-2757-47c0-a182-8b308a380db5"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:21.524847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2d78ab18-02d5-44a5-afe2-be92844f5e88 req-99620f9d-d43f-44a4-a63a-829033494753 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:21.525437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-2d78ab18-02d5-44a5-afe2-be92844f5e88 req-99620f9d-d43f-44a4-a63a-829033494753 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:21.537975 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-2d78ab18-02d5-44a5-afe2-be92844f5e88 req-99620f9d-d43f-44a4-a63a-829033494753 service nova] Creating event network-changed:ff218d99-2757-47c0-a182-8b308a380db5 for instance 1602f176-9891-417a-a81a-076198fadb29 on n-h2-764485-11 Jul 20 05:11:21.542984 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-2d78ab18-02d5-44a5-afe2-be92844f5e88 req-99620f9d-d43f-44a4-a63a-829033494753 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032228 Jul 20 05:11:21.543990 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3429/6957] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:55.660630 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:11:55.661241 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:11:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:11:56.832024 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:11:56.832530 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:11:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:11:57.265902 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:11:57.266063 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:11:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:12:33.527595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=9 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:33.528369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=51 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:33.533638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1968ac5b-d9f1-4e59-aac7-740bcb4163ab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:33.542022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1968ac5b-d9f1-4e59-aac7-740bcb4163ab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:33.542521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1968ac5b-d9f1-4e59-aac7-740bcb4163ab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:33.566974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1968ac5b-d9f1-4e59-aac7-740bcb4163ab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Going to try to stop instance {{(pid=119808) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 05:12:33.608225 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1968ac5b-d9f1-4e59-aac7-740bcb4163ab tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29/action" status: 202 len: 0 microversion: 2.1 time: 0.083499 Jul 20 05:12:33.608829 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3529/6958] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:12:33 2022] POST /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:12:33.617919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=9 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:33.618661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=42 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:33.623785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0f9c18f2-9475-43fe-adae-e2b2d500114b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:33.624586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0f9c18f2-9475-43fe-adae-e2b2d500114b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:33.634247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f9c18f2-9475-43fe-adae-e2b2d500114b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:33.634700 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f9c18f2-9475-43fe-adae-e2b2d500114b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:33.635466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f9c18f2-9475-43fe-adae-e2b2d500114b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:33.635932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0f9c18f2-9475-43fe-adae-e2b2d500114b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:33.775474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0f9c18f2-9475-43fe-adae-e2b2d500114b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:33.783756 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0f9c18f2-9475-43fe-adae-e2b2d500114b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1679 microversion: 2.1 time: 0.168650 Jul 20 05:12:33.784269 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3430/6959] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:33 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:34.802922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dbf87b40-ced0-4b71-bf7c-f4fc41025dc2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:34.803673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dbf87b40-ced0-4b71-bf7c-f4fc41025dc2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:34.810717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbf87b40-ced0-4b71-bf7c-f4fc41025dc2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:34.811184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbf87b40-ced0-4b71-bf7c-f4fc41025dc2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:34.811991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbf87b40-ced0-4b71-bf7c-f4fc41025dc2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:34.812442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dbf87b40-ced0-4b71-bf7c-f4fc41025dc2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:34.943955 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dbf87b40-ced0-4b71-bf7c-f4fc41025dc2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:34.951461 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dbf87b40-ced0-4b71-bf7c-f4fc41025dc2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1679 microversion: 2.1 time: 0.153955 Jul 20 05:12:34.952057 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3530/6960] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:34 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:35.969886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0c856dd4-a4b4-4a60-90e5-807bf6c6257c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:35.971106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0c856dd4-a4b4-4a60-90e5-807bf6c6257c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:35.978155 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c856dd4-a4b4-4a60-90e5-807bf6c6257c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:35.978605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c856dd4-a4b4-4a60-90e5-807bf6c6257c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:35.979362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c856dd4-a4b4-4a60-90e5-807bf6c6257c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:35.979835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c856dd4-a4b4-4a60-90e5-807bf6c6257c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:36.112988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0c856dd4-a4b4-4a60-90e5-807bf6c6257c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:36.120540 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0c856dd4-a4b4-4a60-90e5-807bf6c6257c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1679 microversion: 2.1 time: 0.154563 Jul 20 05:12:36.121108 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3431/6961] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:35 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:37.138303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4bf0cfe3-87ae-4d4c-8f3e-0981987604f7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:37.138940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4bf0cfe3-87ae-4d4c-8f3e-0981987604f7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:37.146962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4bf0cfe3-87ae-4d4c-8f3e-0981987604f7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:37.147427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4bf0cfe3-87ae-4d4c-8f3e-0981987604f7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:37.148269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4bf0cfe3-87ae-4d4c-8f3e-0981987604f7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:37.148727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4bf0cfe3-87ae-4d4c-8f3e-0981987604f7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:37.280784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4bf0cfe3-87ae-4d4c-8f3e-0981987604f7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:37.289355 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4bf0cfe3-87ae-4d4c-8f3e-0981987604f7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1679 microversion: 2.1 time: 0.155070 Jul 20 05:12:37.289935 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3531/6962] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:37 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:38.306605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e7b8e5f6-9791-4371-953d-626851ddbbd6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:38.307220 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e7b8e5f6-9791-4371-953d-626851ddbbd6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:38.314346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7b8e5f6-9791-4371-953d-626851ddbbd6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:38.314833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7b8e5f6-9791-4371-953d-626851ddbbd6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:38.315809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7b8e5f6-9791-4371-953d-626851ddbbd6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:38.316248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e7b8e5f6-9791-4371-953d-626851ddbbd6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:38.446524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e7b8e5f6-9791-4371-953d-626851ddbbd6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:38.454087 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e7b8e5f6-9791-4371-953d-626851ddbbd6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1679 microversion: 2.1 time: 0.151433 Jul 20 05:12:38.454729 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3432/6963] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:38 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:39.472035 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-98fdacaf-bce4-47b5-a44a-64c0915dc06e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:39.472583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-98fdacaf-bce4-47b5-a44a-64c0915dc06e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:39.479261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98fdacaf-bce4-47b5-a44a-64c0915dc06e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:39.479717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98fdacaf-bce4-47b5-a44a-64c0915dc06e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:39.480526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98fdacaf-bce4-47b5-a44a-64c0915dc06e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:39.480965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98fdacaf-bce4-47b5-a44a-64c0915dc06e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:39.618639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-98fdacaf-bce4-47b5-a44a-64c0915dc06e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:39.626851 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-98fdacaf-bce4-47b5-a44a-64c0915dc06e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1679 microversion: 2.1 time: 0.158458 Jul 20 05:12:39.627464 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3532/6964] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:39 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:40.644328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-067d584f-c456-4f2a-9d6e-3aadf488e0c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:40.644957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-067d584f-c456-4f2a-9d6e-3aadf488e0c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:40.651879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-067d584f-c456-4f2a-9d6e-3aadf488e0c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:40.652338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-067d584f-c456-4f2a-9d6e-3aadf488e0c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:40.653114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-067d584f-c456-4f2a-9d6e-3aadf488e0c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:40.653559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-067d584f-c456-4f2a-9d6e-3aadf488e0c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:40.784442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-067d584f-c456-4f2a-9d6e-3aadf488e0c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:40.792008 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-067d584f-c456-4f2a-9d6e-3aadf488e0c6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1679 microversion: 2.1 time: 0.151857 Jul 20 05:12:40.792585 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3433/6965] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:40 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:41.810158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a938c168-4402-4ab0-9c74-6449f0525a38 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:41.810786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a938c168-4402-4ab0-9c74-6449f0525a38 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:41.818680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a938c168-4402-4ab0-9c74-6449f0525a38 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:41.819127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a938c168-4402-4ab0-9c74-6449f0525a38 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:41.819919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a938c168-4402-4ab0-9c74-6449f0525a38 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:41.820373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a938c168-4402-4ab0-9c74-6449f0525a38 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:41.952437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a938c168-4402-4ab0-9c74-6449f0525a38 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:41.960128 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a938c168-4402-4ab0-9c74-6449f0525a38 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1679 microversion: 2.1 time: 0.153887 Jul 20 05:12:41.960701 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3533/6966] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:41 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:42.977498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b5545fe4-4c15-450d-af83-5886b1437896 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:42.978173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b5545fe4-4c15-450d-af83-5886b1437896 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:42.985038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5545fe4-4c15-450d-af83-5886b1437896 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:42.986132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5545fe4-4c15-450d-af83-5886b1437896 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:42.987434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5545fe4-4c15-450d-af83-5886b1437896 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:42.987906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5545fe4-4c15-450d-af83-5886b1437896 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:43.119835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b5545fe4-4c15-450d-af83-5886b1437896 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:43.127868 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b5545fe4-4c15-450d-af83-5886b1437896 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1679 microversion: 2.1 time: 0.154293 Jul 20 05:12:43.128449 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3434/6967] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:42 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:44.145333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-30844950-bdc5-460e-b8b3-19b9370e2c53 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:44.145867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-30844950-bdc5-460e-b8b3-19b9370e2c53 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:44.152844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30844950-bdc5-460e-b8b3-19b9370e2c53 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:44.153303 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30844950-bdc5-460e-b8b3-19b9370e2c53 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:44.154071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30844950-bdc5-460e-b8b3-19b9370e2c53 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:44.154518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-30844950-bdc5-460e-b8b3-19b9370e2c53 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:44.284688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-30844950-bdc5-460e-b8b3-19b9370e2c53 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:44.292153 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-30844950-bdc5-460e-b8b3-19b9370e2c53 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1656 microversion: 2.1 time: 0.151103 Jul 20 05:12:44.292732 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3534/6968] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:44 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:44.309330 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:44.310308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:44.317934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:44.318393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:44.319154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:44.319622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:44.348653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:44.354621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Old instance type m1.heat2, new instance type m1.heat {{(pid=119807) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:12:44.362232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:12:44.362661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:12:44.363145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:12:44.363600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:12:44.364024 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:12:44.427560 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f482db27-f6c5-4281-90b1-b770b4c5036d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29/action" status: 202 len: 0 microversion: 2.1 time: 0.122013 Jul 20 05:12:44.428179 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3435/6969] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:12:44 2022] POST /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:12:44.436669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0f0f25f8-a221-4c76-a94d-95f65ff7800e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:44.437305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0f0f25f8-a221-4c76-a94d-95f65ff7800e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:44.444508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f0f25f8-a221-4c76-a94d-95f65ff7800e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:44.444977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f0f25f8-a221-4c76-a94d-95f65ff7800e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:44.445792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f0f25f8-a221-4c76-a94d-95f65ff7800e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:44.446248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f0f25f8-a221-4c76-a94d-95f65ff7800e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:44.590841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0f0f25f8-a221-4c76-a94d-95f65ff7800e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:44.600002 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0f0f25f8-a221-4c76-a94d-95f65ff7800e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1679 microversion: 2.1 time: 0.167509 Jul 20 05:12:44.600627 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3535/6970] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:44 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:45.619217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d524a2b0-b8e5-4c01-aed3-88f40bd4f0d0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:45.619870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d524a2b0-b8e5-4c01-aed3-88f40bd4f0d0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:45.626077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d524a2b0-b8e5-4c01-aed3-88f40bd4f0d0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:45.626535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d524a2b0-b8e5-4c01-aed3-88f40bd4f0d0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:45.627411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d524a2b0-b8e5-4c01-aed3-88f40bd4f0d0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:45.627889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d524a2b0-b8e5-4c01-aed3-88f40bd4f0d0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:45.770390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d524a2b0-b8e5-4c01-aed3-88f40bd4f0d0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:45.778901 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d524a2b0-b8e5-4c01-aed3-88f40bd4f0d0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1679 microversion: 2.1 time: 0.164515 Jul 20 05:12:45.779592 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3436/6971] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:45 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:46.796389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1a515db6-d833-4ec7-b268-687601905fe4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:46.797054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1a515db6-d833-4ec7-b268-687601905fe4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:46.804194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a515db6-d833-4ec7-b268-687601905fe4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:46.804669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a515db6-d833-4ec7-b268-687601905fe4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:46.805450 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a515db6-d833-4ec7-b268-687601905fe4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:46.805909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a515db6-d833-4ec7-b268-687601905fe4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:46.941547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1a515db6-d833-4ec7-b268-687601905fe4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:46.948991 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1a515db6-d833-4ec7-b268-687601905fe4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1684 microversion: 2.1 time: 0.156569 Jul 20 05:12:46.949571 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3536/6972] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:46 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:47.966783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-50a8b220-0058-49ad-9bac-f28799527b35 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:47.967396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-50a8b220-0058-49ad-9bac-f28799527b35 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:47.975304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50a8b220-0058-49ad-9bac-f28799527b35 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:47.975788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50a8b220-0058-49ad-9bac-f28799527b35 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:47.976552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50a8b220-0058-49ad-9bac-f28799527b35 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:47.976990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50a8b220-0058-49ad-9bac-f28799527b35 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:48.109550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-50a8b220-0058-49ad-9bac-f28799527b35 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:48.117427 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-50a8b220-0058-49ad-9bac-f28799527b35 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1684 microversion: 2.1 time: 0.154574 Jul 20 05:12:48.118003 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3437/6973] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:47 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:48.873573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4baf46fa-120e-4c7e-b364-e4ed25ef8521 req-ac3f2190-fe86-48d3-8010-6e52a7706e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1602f176-9891-417a-a81a-076198fadb29", "name": "network-vif-unplugged", "status": "completed", "tag": "ff218d99-2757-47c0-a182-8b308a380db5"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:48.883867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4baf46fa-120e-4c7e-b364-e4ed25ef8521 req-ac3f2190-fe86-48d3-8010-6e52a7706e77 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:48.884332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4baf46fa-120e-4c7e-b364-e4ed25ef8521 req-ac3f2190-fe86-48d3-8010-6e52a7706e77 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:48.897577 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4baf46fa-120e-4c7e-b364-e4ed25ef8521 req-ac3f2190-fe86-48d3-8010-6e52a7706e77 service nova] Creating event network-vif-unplugged:ff218d99-2757-47c0-a182-8b308a380db5 for instance 1602f176-9891-417a-a81a-076198fadb29 on n-h1-764485-11 Jul 20 05:12:48.902992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-4baf46fa-120e-4c7e-b364-e4ed25ef8521 req-ac3f2190-fe86-48d3-8010-6e52a7706e77 service nova] Instance 1602f176-9891-417a-a81a-076198fadb29 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:12:48.914699 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4baf46fa-120e-4c7e-b364-e4ed25ef8521 req-ac3f2190-fe86-48d3-8010-6e52a7706e77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044921 Jul 20 05:12:48.915333 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3537/6974] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:12:49.134341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f831d3ad-c083-4e07-bf5e-6998dcf88e17 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:49.134864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f831d3ad-c083-4e07-bf5e-6998dcf88e17 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:49.141838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f831d3ad-c083-4e07-bf5e-6998dcf88e17 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:49.142296 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f831d3ad-c083-4e07-bf5e-6998dcf88e17 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:49.143064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f831d3ad-c083-4e07-bf5e-6998dcf88e17 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:49.143502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f831d3ad-c083-4e07-bf5e-6998dcf88e17 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:49.356453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f831d3ad-c083-4e07-bf5e-6998dcf88e17 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:49.365645 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f831d3ad-c083-4e07-bf5e-6998dcf88e17 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1683 microversion: 2.1 time: 0.235313 Jul 20 05:12:49.366423 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3438/6975] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:49 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1683 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:50.385413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9d4dc1ef-d099-45f8-872e-e331c3369f40 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:50.386134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9d4dc1ef-d099-45f8-872e-e331c3369f40 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:50.393047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d4dc1ef-d099-45f8-872e-e331c3369f40 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:50.393516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d4dc1ef-d099-45f8-872e-e331c3369f40 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:50.394293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d4dc1ef-d099-45f8-872e-e331c3369f40 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:50.394749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9d4dc1ef-d099-45f8-872e-e331c3369f40 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:50.523661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9d4dc1ef-d099-45f8-872e-e331c3369f40 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:50.531271 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9d4dc1ef-d099-45f8-872e-e331c3369f40 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1681 microversion: 2.1 time: 0.151005 Jul 20 05:12:50.531882 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3538/6976] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:50 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:50.930694 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-094f4a6a-637f-4881-91d9-f69d9b910a0e req-99adaf3a-22af-446d-90d3-4fb372dc4747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1602f176-9891-417a-a81a-076198fadb29", "tag": "ff218d99-2757-47c0-a182-8b308a380db5"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:50.940372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-094f4a6a-637f-4881-91d9-f69d9b910a0e req-99adaf3a-22af-446d-90d3-4fb372dc4747 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:50.940815 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-094f4a6a-637f-4881-91d9-f69d9b910a0e req-99adaf3a-22af-446d-90d3-4fb372dc4747 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:50.952365 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-094f4a6a-637f-4881-91d9-f69d9b910a0e req-99adaf3a-22af-446d-90d3-4fb372dc4747 service nova] Creating event network-changed:ff218d99-2757-47c0-a182-8b308a380db5 for instance 1602f176-9891-417a-a81a-076198fadb29 on n-h1-764485-11 Jul 20 05:12:50.957796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-094f4a6a-637f-4881-91d9-f69d9b910a0e req-99adaf3a-22af-446d-90d3-4fb372dc4747 service nova] Instance 1602f176-9891-417a-a81a-076198fadb29 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:12:50.968726 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-094f4a6a-637f-4881-91d9-f69d9b910a0e req-99adaf3a-22af-446d-90d3-4fb372dc4747 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041777 Jul 20 05:12:50.969320 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3439/6977] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:12:51.549547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-47f2663a-7bd1-4ab1-b57b-987450ce18c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:51.550173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-47f2663a-7bd1-4ab1-b57b-987450ce18c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:51.557522 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47f2663a-7bd1-4ab1-b57b-987450ce18c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:51.557989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47f2663a-7bd1-4ab1-b57b-987450ce18c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:51.558771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47f2663a-7bd1-4ab1-b57b-987450ce18c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:51.559227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-47f2663a-7bd1-4ab1-b57b-987450ce18c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:51.770371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-47f2663a-7bd1-4ab1-b57b-987450ce18c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:51.778261 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-47f2663a-7bd1-4ab1-b57b-987450ce18c0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1681 microversion: 2.1 time: 0.232713 Jul 20 05:12:51.778791 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3539/6978] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:51 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:52.796816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9dedbddc-6ed6-4e25-90ef-6e40a818e5ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:52.798301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9dedbddc-6ed6-4e25-90ef-6e40a818e5ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:52.805939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dedbddc-6ed6-4e25-90ef-6e40a818e5ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:52.806481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dedbddc-6ed6-4e25-90ef-6e40a818e5ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:52.807264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dedbddc-6ed6-4e25-90ef-6e40a818e5ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:52.807730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9dedbddc-6ed6-4e25-90ef-6e40a818e5ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:52.956103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9dedbddc-6ed6-4e25-90ef-6e40a818e5ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:52.963718 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9dedbddc-6ed6-4e25-90ef-6e40a818e5ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1677 microversion: 2.1 time: 0.172200 Jul 20 05:12:52.964304 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3440/6979] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:52 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:52.981115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-80c86ae9-38ac-40ee-bbaa-61a8a35bf16c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:52.981690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-80c86ae9-38ac-40ee-bbaa-61a8a35bf16c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:52.989478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80c86ae9-38ac-40ee-bbaa-61a8a35bf16c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:52.989974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80c86ae9-38ac-40ee-bbaa-61a8a35bf16c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:52.990821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80c86ae9-38ac-40ee-bbaa-61a8a35bf16c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:52.991274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80c86ae9-38ac-40ee-bbaa-61a8a35bf16c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:53.053568 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-80c86ae9-38ac-40ee-bbaa-61a8a35bf16c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29/action" status: 204 len: 0 microversion: 2.1 time: 0.076100 Jul 20 05:12:53.054242 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3540/6980] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:12:52 2022] POST /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:12:53.062481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f9c50f08-d906-4185-8426-6d00d15650d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:53.064109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f9c50f08-d906-4185-8426-6d00d15650d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:53.071423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9c50f08-d906-4185-8426-6d00d15650d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:53.071914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9c50f08-d906-4185-8426-6d00d15650d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:53.072695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9c50f08-d906-4185-8426-6d00d15650d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:53.073139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9c50f08-d906-4185-8426-6d00d15650d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:53.371484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f9c50f08-d906-4185-8426-6d00d15650d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:53.379949 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f9c50f08-d906-4185-8426-6d00d15650d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1677 microversion: 2.1 time: 0.321310 Jul 20 05:12:53.380549 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3441/6981] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:53 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1677 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:54.400987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-98f3a1d3-179a-4bbc-aa1d-854049a59a88 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:54.401863 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-98f3a1d3-179a-4bbc-aa1d-854049a59a88 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:54.409716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98f3a1d3-179a-4bbc-aa1d-854049a59a88 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:54.410188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98f3a1d3-179a-4bbc-aa1d-854049a59a88 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:54.410985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98f3a1d3-179a-4bbc-aa1d-854049a59a88 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:54.411443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-98f3a1d3-179a-4bbc-aa1d-854049a59a88 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:54.434570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-b4945982-0bfd-40f2-a606-9c20dfb35788 req-673e0c1c-5ecf-4276-8cdd-7e3228dfe106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1602f176-9891-417a-a81a-076198fadb29", "name": "network-vif-plugged", "status": "completed", "tag": "ff218d99-2757-47c0-a182-8b308a380db5"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:54.450552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b4945982-0bfd-40f2-a606-9c20dfb35788 req-673e0c1c-5ecf-4276-8cdd-7e3228dfe106 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:54.451004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-b4945982-0bfd-40f2-a606-9c20dfb35788 req-673e0c1c-5ecf-4276-8cdd-7e3228dfe106 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:54.478797 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-b4945982-0bfd-40f2-a606-9c20dfb35788 req-673e0c1c-5ecf-4276-8cdd-7e3228dfe106 service nova] Creating event network-vif-plugged:ff218d99-2757-47c0-a182-8b308a380db5 for instance 1602f176-9891-417a-a81a-076198fadb29 on n-h1-764485-11 Jul 20 05:12:54.483846 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-b4945982-0bfd-40f2-a606-9c20dfb35788 req-673e0c1c-5ecf-4276-8cdd-7e3228dfe106 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052961 Jul 20 05:12:54.484870 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3442/6982] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:12:54.589178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-98f3a1d3-179a-4bbc-aa1d-854049a59a88 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:54.597049 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-98f3a1d3-179a-4bbc-aa1d-854049a59a88 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1677 microversion: 2.1 time: 0.202337 Jul 20 05:12:54.598224 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3541/6983] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:54 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:55.616252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f64e74b7-3c37-44fb-99c4-0287a8fb91c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:55.616959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f64e74b7-3c37-44fb-99c4-0287a8fb91c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:55.623268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f64e74b7-3c37-44fb-99c4-0287a8fb91c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:55.623754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f64e74b7-3c37-44fb-99c4-0287a8fb91c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:55.624525 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f64e74b7-3c37-44fb-99c4-0287a8fb91c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:55.624965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f64e74b7-3c37-44fb-99c4-0287a8fb91c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:55.756392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f64e74b7-3c37-44fb-99c4-0287a8fb91c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:55.763988 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f64e74b7-3c37-44fb-99c4-0287a8fb91c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1656 microversion: 2.1 time: 0.153245 Jul 20 05:12:55.764571 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3443/6984] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:55 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:55.780076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2de40da9-ab90-4692-9e5b-f1d5701a56a5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:55.780699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2de40da9-ab90-4692-9e5b-f1d5701a56a5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:55.788136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2de40da9-ab90-4692-9e5b-f1d5701a56a5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:55.788623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2de40da9-ab90-4692-9e5b-f1d5701a56a5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:55.789391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2de40da9-ab90-4692-9e5b-f1d5701a56a5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:55.789843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2de40da9-ab90-4692-9e5b-f1d5701a56a5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:55.924803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2de40da9-ab90-4692-9e5b-f1d5701a56a5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:55.932330 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2de40da9-ab90-4692-9e5b-f1d5701a56a5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1656 microversion: 2.1 time: 0.156103 Jul 20 05:12:55.932903 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3542/6985] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:55 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:55.948906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9d6c8d56-c9b3-4f8c-b4b3-d5749fec297d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:55.955674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d6c8d56-c9b3-4f8c-b4b3-d5749fec297d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:55.956128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9d6c8d56-c9b3-4f8c-b4b3-d5749fec297d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:55.978873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9d6c8d56-c9b3-4f8c-b4b3-d5749fec297d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Going to try to start instance {{(pid=119807) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 05:12:56.019892 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9d6c8d56-c9b3-4f8c-b4b3-d5749fec297d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29/action" status: 202 len: 0 microversion: 2.1 time: 0.074682 Jul 20 05:12:56.020510 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3444/6986] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:12:55 2022] POST /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:12:56.029009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-53131ba8-0fc1-4997-8e4e-933f5a85a837 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:56.029645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-53131ba8-0fc1-4997-8e4e-933f5a85a837 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:56.037132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53131ba8-0fc1-4997-8e4e-933f5a85a837 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:56.037833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53131ba8-0fc1-4997-8e4e-933f5a85a837 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:56.038990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53131ba8-0fc1-4997-8e4e-933f5a85a837 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:56.039451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-53131ba8-0fc1-4997-8e4e-933f5a85a837 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:56.261059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-53131ba8-0fc1-4997-8e4e-933f5a85a837 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:56.263764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:56.271209 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-53131ba8-0fc1-4997-8e4e-933f5a85a837 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1665 microversion: 2.1 time: 0.246105 Jul 20 05:12:56.272030 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3543/6987] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:56 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1665 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:57.289751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fd02df9d-7d7c-4435-97fd-031cecfe19d5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:57.290491 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fd02df9d-7d7c-4435-97fd-031cecfe19d5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:57.298776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd02df9d-7d7c-4435-97fd-031cecfe19d5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:57.298776 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd02df9d-7d7c-4435-97fd-031cecfe19d5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:57.299606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd02df9d-7d7c-4435-97fd-031cecfe19d5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:57.300049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fd02df9d-7d7c-4435-97fd-031cecfe19d5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:57.304417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:57.442166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fd02df9d-7d7c-4435-97fd-031cecfe19d5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:57.449794 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fd02df9d-7d7c-4435-97fd-031cecfe19d5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1669 microversion: 2.1 time: 0.164540 Jul 20 05:12:57.450400 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3445/6988] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:57 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:57.467217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-59211fd6-3d9d-4741-bf52-159534fa1cbb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:57.467971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-59211fd6-3d9d-4741-bf52-159534fa1cbb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:57.476445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59211fd6-3d9d-4741-bf52-159534fa1cbb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:57.476944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59211fd6-3d9d-4741-bf52-159534fa1cbb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:57.477719 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59211fd6-3d9d-4741-bf52-159534fa1cbb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:57.478171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-59211fd6-3d9d-4741-bf52-159534fa1cbb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:57.504242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-59211fd6-3d9d-4741-bf52-159534fa1cbb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:12:57.579010 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-59211fd6-3d9d-4741-bf52-159534fa1cbb tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 204 len: 0 microversion: 2.1 time: 0.115951 Jul 20 05:12:57.579734 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3544/6989] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:12:57 2022] DELETE /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:12:57.587917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6083aaf8-f05a-40f1-b3ca-66ff8c7bb899 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:57.588534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6083aaf8-f05a-40f1-b3ca-66ff8c7bb899 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:57.595173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6083aaf8-f05a-40f1-b3ca-66ff8c7bb899 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:57.595606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6083aaf8-f05a-40f1-b3ca-66ff8c7bb899 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:57.596384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6083aaf8-f05a-40f1-b3ca-66ff8c7bb899 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:57.596933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6083aaf8-f05a-40f1-b3ca-66ff8c7bb899 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:57.727919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6083aaf8-f05a-40f1-b3ca-66ff8c7bb899 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:57.735725 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6083aaf8-f05a-40f1-b3ca-66ff8c7bb899 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1675 microversion: 2.1 time: 0.151738 Jul 20 05:12:57.736569 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3446/6990] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:57 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:58.754578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f84f3f48-9e30-4f43-ac9d-3a86333168c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:58.755309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f84f3f48-9e30-4f43-ac9d-3a86333168c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:58.762210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f84f3f48-9e30-4f43-ac9d-3a86333168c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:58.762680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f84f3f48-9e30-4f43-ac9d-3a86333168c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:58.763471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f84f3f48-9e30-4f43-ac9d-3a86333168c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:58.763977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f84f3f48-9e30-4f43-ac9d-3a86333168c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:58.900167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f84f3f48-9e30-4f43-ac9d-3a86333168c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:58.907663 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f84f3f48-9e30-4f43-ac9d-3a86333168c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1675 microversion: 2.1 time: 0.158027 Jul 20 05:12:58.908239 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3545/6991] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:58 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:59.859576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-71bab62d-8f30-4a1d-9763-49f94d113df4 req-aade5b2b-d966-4a83-bab9-370b9cfc8ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1602f176-9891-417a-a81a-076198fadb29", "name": "network-vif-deleted", "tag": "ff218d99-2757-47c0-a182-8b308a380db5"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:59.870162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-71bab62d-8f30-4a1d-9763-49f94d113df4 req-aade5b2b-d966-4a83-bab9-370b9cfc8ec3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:59.870629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-71bab62d-8f30-4a1d-9763-49f94d113df4 req-aade5b2b-d966-4a83-bab9-370b9cfc8ec3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:59.885361 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-71bab62d-8f30-4a1d-9763-49f94d113df4 req-aade5b2b-d966-4a83-bab9-370b9cfc8ec3 service nova] Creating event network-vif-deleted:ff218d99-2757-47c0-a182-8b308a380db5 for instance 1602f176-9891-417a-a81a-076198fadb29 on n-h1-764485-11 Jul 20 05:12:59.890449 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-71bab62d-8f30-4a1d-9763-49f94d113df4 req-aade5b2b-d966-4a83-bab9-370b9cfc8ec3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034524 Jul 20 05:12:59.891313 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3447/6992] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:12:59.925891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ed581cb3-b722-4231-a9e0-87a88e8ce38e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:59.926853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ed581cb3-b722-4231-a9e0-87a88e8ce38e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:59.933763 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed581cb3-b722-4231-a9e0-87a88e8ce38e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:59.934553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed581cb3-b722-4231-a9e0-87a88e8ce38e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:59.935540 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed581cb3-b722-4231-a9e0-87a88e8ce38e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:59.936014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed581cb3-b722-4231-a9e0-87a88e8ce38e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:59.974137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed581cb3-b722-4231-a9e0-87a88e8ce38e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:59.974608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed581cb3-b722-4231-a9e0-87a88e8ce38e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:59.975072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-ed581cb3-b722-4231-a9e0-87a88e8ce38e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lazy-loading 'fault' on Instance uuid 1602f176-9891-417a-a81a-076198fadb29 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:13:00.020828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ed581cb3-b722-4231-a9e0-87a88e8ce38e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:00.029438 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ed581cb3-b722-4231-a9e0-87a88e8ce38e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 200 len: 1328 microversion: 2.1 time: 0.108289 Jul 20 05:13:00.030030 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3546/6993] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:59 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:01.049804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-22fe3b6c-d2a2-4cba-84d4-ae62748f97f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:01.050511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-22fe3b6c-d2a2-4cba-84d4-ae62748f97f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:01.056872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22fe3b6c-d2a2-4cba-84d4-ae62748f97f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:01.057327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22fe3b6c-d2a2-4cba-84d4-ae62748f97f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:01.058094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22fe3b6c-d2a2-4cba-84d4-ae62748f97f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:01.058533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22fe3b6c-d2a2-4cba-84d4-ae62748f97f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:01.072709 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-22fe3b6c-d2a2-4cba-84d4-ae62748f97f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-22fe3b6c-d2a2-4cba-84d4-ae62748f97f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 HTTP/1.1 Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '1602f176-9891-417a-a81a-076198fadb29'} Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:13:01.074264 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:13:01.079345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:13:01.079345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:13:01.079345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:13:01.079345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:13:01.079345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:13:01.079345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:13:01.079345 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:13:01.079345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-22fe3b6c-d2a2-4cba-84d4-ae62748f97f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:13:01.079345 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-22fe3b6c-d2a2-4cba-84d4-ae62748f97f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 404 len: 111 microversion: 2.1 time: 0.031601 Jul 20 05:13:01.079345 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3448/6994] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:01 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:13:01.093456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a32e52b0-3d94-4fdf-9661-f094fcfdc71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:01.094102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a32e52b0-3d94-4fdf-9661-f094fcfdc71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:01.101437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a32e52b0-3d94-4fdf-9661-f094fcfdc71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:01.101937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a32e52b0-3d94-4fdf-9661-f094fcfdc71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:01.102725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a32e52b0-3d94-4fdf-9661-f094fcfdc71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:01.103185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a32e52b0-3d94-4fdf-9661-f094fcfdc71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:01.117322 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-a32e52b0-3d94-4fdf-9661-f094fcfdc71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a32e52b0-3d94-4fdf-9661-f094fcfdc71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 HTTP/1.1 Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1602f176-9891-417a-a81a-076198fadb29'} Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:13:01.118989 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:13:01.123349 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:13:01.123349 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:13:01.123349 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:13:01.123349 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:13:01.123349 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:13:01.123349 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:13:01.123349 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:13:01.123349 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a32e52b0-3d94-4fdf-9661-f094fcfdc71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:13:01.123349 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a32e52b0-3d94-4fdf-9661-f094fcfdc71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 404 len: 111 microversion: 2.1 time: 0.031234 Jul 20 05:13:01.123349 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3547/6995] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:01 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:13:01.166861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1354138350", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "f4331169-eba0-470b-9af3-17270dc6efeb"}], "security_groups": [{"name": "tempest-securitygroup--376987174"}], "key_name": "tempest-keypair-1049948118", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:01.271059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] validate_networks() for [('f4331169-eba0-470b-9af3-17270dc6efeb', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:13:01.635004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:13:01.635435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:13:01.635947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:13:01.636413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:13:01.636852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:13:01.646000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:01.646454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:01.647249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:01.647721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:01.667610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:13:01.673837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for user 515b90b9f91e47719155e3d2448cd0dd and project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:13:01.686018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:13:01.688915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:13:01.733825 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e01b9ba8-a1d7-4283-b038-606f71574011 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.570844 Jul 20 05:13:01.734481 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3449/6996] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:13:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:13:01.744849 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7d022bb2-224a-4274-b620-35a715edab82 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:01.745567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7d022bb2-224a-4274-b620-35a715edab82 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:01.804024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7d022bb2-224a-4274-b620-35a715edab82 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:01.810968 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7d022bb2-224a-4274-b620-35a715edab82 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1239 microversion: 2.1 time: 0.070021 Jul 20 05:13:01.812184 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3548/6997] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:01 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:02.829848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-64ce33a6-33be-4595-a23f-de73a5969931 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:02.831256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-64ce33a6-33be-4595-a23f-de73a5969931 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:02.839833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64ce33a6-33be-4595-a23f-de73a5969931 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:02.840533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64ce33a6-33be-4595-a23f-de73a5969931 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:02.841426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64ce33a6-33be-4595-a23f-de73a5969931 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:02.841869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64ce33a6-33be-4595-a23f-de73a5969931 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:02.932664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-64ce33a6-33be-4595-a23f-de73a5969931 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:02.941156 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-64ce33a6-33be-4595-a23f-de73a5969931 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1297 microversion: 2.1 time: 0.115213 Jul 20 05:13:02.941747 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3450/6998] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:02 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:03.959181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eae40646-db69-4a99-b6ea-5ff28013e38b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:03.966273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eae40646-db69-4a99-b6ea-5ff28013e38b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:03.973656 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:03.979289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eae40646-db69-4a99-b6ea-5ff28013e38b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:03.979792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eae40646-db69-4a99-b6ea-5ff28013e38b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:03.980622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eae40646-db69-4a99-b6ea-5ff28013e38b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:03.981082 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eae40646-db69-4a99-b6ea-5ff28013e38b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:04.199718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-eae40646-db69-4a99-b6ea-5ff28013e38b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:04.210540 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eae40646-db69-4a99-b6ea-5ff28013e38b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1364 microversion: 2.1 time: 0.256107 Jul 20 05:13:04.211688 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3549/6999] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:03 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:04.444185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ce4949f1-c5e3-4850-a1da-293dd296f320 req-d8604538-645d-474d-a79e-fbfdc05e7785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8b08cd-305a-4b61-9b16-2ee895f3341d", "tag": "c4004f54-721a-4cea-8a91-f1719ff26b21"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:04.454217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:04.462642 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ce4949f1-c5e3-4850-a1da-293dd296f320 req-d8604538-645d-474d-a79e-fbfdc05e7785 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:04.463550 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ce4949f1-c5e3-4850-a1da-293dd296f320 req-d8604538-645d-474d-a79e-fbfdc05e7785 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:04.484591 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ce4949f1-c5e3-4850-a1da-293dd296f320 req-d8604538-645d-474d-a79e-fbfdc05e7785 service nova] Creating event network-changed:c4004f54-721a-4cea-8a91-f1719ff26b21 for instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d on n-h1-764485-11 Jul 20 05:13:04.490277 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ce4949f1-c5e3-4850-a1da-293dd296f320 req-d8604538-645d-474d-a79e-fbfdc05e7785 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050375 Jul 20 05:13:04.491244 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3451/7000] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:13:05.228637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9076605e-ed69-4650-8bf5-fb6b909114ee tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:05.229817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9076605e-ed69-4650-8bf5-fb6b909114ee tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:05.238100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9076605e-ed69-4650-8bf5-fb6b909114ee tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:05.238561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9076605e-ed69-4650-8bf5-fb6b909114ee tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:05.239348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9076605e-ed69-4650-8bf5-fb6b909114ee tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:05.239840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9076605e-ed69-4650-8bf5-fb6b909114ee tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:05.367419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9076605e-ed69-4650-8bf5-fb6b909114ee tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:05.374849 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9076605e-ed69-4650-8bf5-fb6b909114ee tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1364 microversion: 2.1 time: 0.150261 Jul 20 05:13:05.375428 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3550/7001] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:05 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:06.394326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-68f250e5-b2ec-412b-b249-8f72fabe5584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:06.395595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-68f250e5-b2ec-412b-b249-8f72fabe5584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:06.401902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68f250e5-b2ec-412b-b249-8f72fabe5584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:06.402392 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68f250e5-b2ec-412b-b249-8f72fabe5584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:06.403161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68f250e5-b2ec-412b-b249-8f72fabe5584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:06.403628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68f250e5-b2ec-412b-b249-8f72fabe5584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:06.533321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-68f250e5-b2ec-412b-b249-8f72fabe5584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:06.542240 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-68f250e5-b2ec-412b-b249-8f72fabe5584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1364 microversion: 2.1 time: 0.153396 Jul 20 05:13:06.542818 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3452/7002] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:06 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:07.559416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-af17fed6-84ad-4b44-b86c-810a43d0ecc0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:07.560079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-af17fed6-84ad-4b44-b86c-810a43d0ecc0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:07.567697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af17fed6-84ad-4b44-b86c-810a43d0ecc0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:07.568168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af17fed6-84ad-4b44-b86c-810a43d0ecc0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:07.568959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af17fed6-84ad-4b44-b86c-810a43d0ecc0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:07.569447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-af17fed6-84ad-4b44-b86c-810a43d0ecc0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:07.704554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af17fed6-84ad-4b44-b86c-810a43d0ecc0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:07.712939 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-af17fed6-84ad-4b44-b86c-810a43d0ecc0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1364 microversion: 2.1 time: 0.157451 Jul 20 05:13:07.713512 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3551/7003] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:07 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:08.730505 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-38b54a6e-6f7a-493a-b39f-0b3be1bf16ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:08.731136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-38b54a6e-6f7a-493a-b39f-0b3be1bf16ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:08.738451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38b54a6e-6f7a-493a-b39f-0b3be1bf16ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:08.738917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38b54a6e-6f7a-493a-b39f-0b3be1bf16ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:08.739812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38b54a6e-6f7a-493a-b39f-0b3be1bf16ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:08.740266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38b54a6e-6f7a-493a-b39f-0b3be1bf16ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:08.880962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-38b54a6e-6f7a-493a-b39f-0b3be1bf16ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:08.888633 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-38b54a6e-6f7a-493a-b39f-0b3be1bf16ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1364 microversion: 2.1 time: 0.162187 Jul 20 05:13:08.889294 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3453/7004] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:08 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:09.906375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-edda4fba-4c48-4664-bc9a-89a3cd604e04 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:09.907006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-edda4fba-4c48-4664-bc9a-89a3cd604e04 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:09.915145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-edda4fba-4c48-4664-bc9a-89a3cd604e04 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:09.915651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-edda4fba-4c48-4664-bc9a-89a3cd604e04 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:09.916447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-edda4fba-4c48-4664-bc9a-89a3cd604e04 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:09.916907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-edda4fba-4c48-4664-bc9a-89a3cd604e04 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:10.051776 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-edda4fba-4c48-4664-bc9a-89a3cd604e04 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:10.059202 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-edda4fba-4c48-4664-bc9a-89a3cd604e04 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1364 microversion: 2.1 time: 0.156883 Jul 20 05:13:10.059799 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3552/7005] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:09 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:10.469540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-90d4e17c-c8c6-497a-8457-7483933e433a req-170d4268-2171-46f0-b51d-ebae183e9a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8b08cd-305a-4b61-9b16-2ee895f3341d", "name": "network-vif-plugged", "status": "completed", "tag": "c4004f54-721a-4cea-8a91-f1719ff26b21"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:10.479284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-90d4e17c-c8c6-497a-8457-7483933e433a req-170d4268-2171-46f0-b51d-ebae183e9a9a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:10.479759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-90d4e17c-c8c6-497a-8457-7483933e433a req-170d4268-2171-46f0-b51d-ebae183e9a9a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:10.491785 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-90d4e17c-c8c6-497a-8457-7483933e433a req-170d4268-2171-46f0-b51d-ebae183e9a9a service nova] Creating event network-vif-plugged:c4004f54-721a-4cea-8a91-f1719ff26b21 for instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d on n-h1-764485-11 Jul 20 05:13:10.496747 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-90d4e17c-c8c6-497a-8457-7483933e433a req-170d4268-2171-46f0-b51d-ebae183e9a9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030980 Jul 20 05:13:10.497357 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3454/7006] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:13:11.076612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5bd0ae4e-57f0-415f-9bb1-5d28fb2ce499 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:11.077249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5bd0ae4e-57f0-415f-9bb1-5d28fb2ce499 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:11.084173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5bd0ae4e-57f0-415f-9bb1-5d28fb2ce499 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:11.084678 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5bd0ae4e-57f0-415f-9bb1-5d28fb2ce499 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:11.085462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5bd0ae4e-57f0-415f-9bb1-5d28fb2ce499 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:11.085921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5bd0ae4e-57f0-415f-9bb1-5d28fb2ce499 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:11.215715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5bd0ae4e-57f0-415f-9bb1-5d28fb2ce499 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:11.223923 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5bd0ae4e-57f0-415f-9bb1-5d28fb2ce499 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1364 microversion: 2.1 time: 0.150728 Jul 20 05:13:11.224501 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3553/7007] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:11 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:12.240516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:12.241416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:12.245738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8473a34f-bd57-4f90-809f-2e657d3a89a6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:12.246443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8473a34f-bd57-4f90-809f-2e657d3a89a6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:12.254165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8473a34f-bd57-4f90-809f-2e657d3a89a6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:12.254769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8473a34f-bd57-4f90-809f-2e657d3a89a6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:12.255574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8473a34f-bd57-4f90-809f-2e657d3a89a6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:12.256013 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8473a34f-bd57-4f90-809f-2e657d3a89a6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:12.396869 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8473a34f-bd57-4f90-809f-2e657d3a89a6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:12.404674 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8473a34f-bd57-4f90-809f-2e657d3a89a6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1550 microversion: 2.1 time: 0.166915 Jul 20 05:13:12.405262 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3455/7008] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:12 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:12.423012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-da097a66-b929-465b-b25d-6df6520b28c3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:12.423662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-da097a66-b929-465b-b25d-6df6520b28c3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:12.425583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:12.431914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da097a66-b929-465b-b25d-6df6520b28c3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:12.432381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da097a66-b929-465b-b25d-6df6520b28c3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:12.433162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da097a66-b929-465b-b25d-6df6520b28c3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:12.433614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-da097a66-b929-465b-b25d-6df6520b28c3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:12.510958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-da097a66-b929-465b-b25d-6df6520b28c3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091865 Jul 20 05:13:12.511585 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3554/7009] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 05:13:12 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:13:13.531471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-36728e7a-6ac7-4161-b22f-ac0be473a37e req-a6ac123d-aad8-408e-a0a3-ac54e752294d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8b08cd-305a-4b61-9b16-2ee895f3341d", "tag": "c4004f54-721a-4cea-8a91-f1719ff26b21"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:13.544773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-36728e7a-6ac7-4161-b22f-ac0be473a37e req-a6ac123d-aad8-408e-a0a3-ac54e752294d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:13.545223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-36728e7a-6ac7-4161-b22f-ac0be473a37e req-a6ac123d-aad8-408e-a0a3-ac54e752294d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:13.557719 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-36728e7a-6ac7-4161-b22f-ac0be473a37e req-a6ac123d-aad8-408e-a0a3-ac54e752294d service nova] Creating event network-changed:c4004f54-721a-4cea-8a91-f1719ff26b21 for instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d on n-h1-764485-11 Jul 20 05:13:13.562783 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-36728e7a-6ac7-4161-b22f-ac0be473a37e req-a6ac123d-aad8-408e-a0a3-ac54e752294d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034998 Jul 20 05:13:13.563408 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3456/7010] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:13:35.695819 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:13:35.696406 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:13:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:14:25.559264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=11 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:25.560126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:25.619871 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:25.620901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:25.626878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:25.627339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:25.628140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:25.628594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:25.657926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:25.664028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Old instance type m1.heat2, new instance type m1.heat {{(pid=119808) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:14:25.670127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:14:25.670568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:14:25.671049 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:14:25.671591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:14:25.672027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:14:25.738698 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f2ab8a21-7fa0-4831-8a8b-1f18b2ce19ad tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d/action" status: 202 len: 0 microversion: 2.1 time: 0.181956 Jul 20 05:14:25.739943 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3555/7011] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:14:25 2022] POST /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:14:25.747258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=11 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:25.748223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=46 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:25.752778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a1635c6-34fd-4a8f-bced-7e237e17ff3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:25.753679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7a1635c6-34fd-4a8f-bced-7e237e17ff3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:25.762046 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a1635c6-34fd-4a8f-bced-7e237e17ff3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:25.762509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a1635c6-34fd-4a8f-bced-7e237e17ff3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:25.763286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a1635c6-34fd-4a8f-bced-7e237e17ff3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:25.763758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a1635c6-34fd-4a8f-bced-7e237e17ff3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:25.950687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7a1635c6-34fd-4a8f-bced-7e237e17ff3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:25.959185 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7a1635c6-34fd-4a8f-bced-7e237e17ff3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1678 microversion: 2.1 time: 0.214697 Jul 20 05:14:25.959812 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3457/7012] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:25 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:26.980806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2612ec68-84c0-4138-9a48-453f3fd2b71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:26.981500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2612ec68-84c0-4138-9a48-453f3fd2b71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:26.990027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2612ec68-84c0-4138-9a48-453f3fd2b71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:26.990511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2612ec68-84c0-4138-9a48-453f3fd2b71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:26.991419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2612ec68-84c0-4138-9a48-453f3fd2b71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:26.991997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2612ec68-84c0-4138-9a48-453f3fd2b71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:27.596633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2612ec68-84c0-4138-9a48-453f3fd2b71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:27.605422 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2612ec68-84c0-4138-9a48-453f3fd2b71a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1678 microversion: 2.1 time: 0.630802 Jul 20 05:14:27.606022 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3556/7013] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:26 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1678 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:28.627394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c2bc680e-823a-420d-8fbd-e69b8cfcef23 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:28.628045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c2bc680e-823a-420d-8fbd-e69b8cfcef23 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:28.634958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2bc680e-823a-420d-8fbd-e69b8cfcef23 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:28.635408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2bc680e-823a-420d-8fbd-e69b8cfcef23 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:28.636205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2bc680e-823a-420d-8fbd-e69b8cfcef23 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:28.636644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c2bc680e-823a-420d-8fbd-e69b8cfcef23 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:28.766561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c2bc680e-823a-420d-8fbd-e69b8cfcef23 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:28.774215 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c2bc680e-823a-420d-8fbd-e69b8cfcef23 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1683 microversion: 2.1 time: 0.150752 Jul 20 05:14:28.774795 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3458/7014] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:28 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:29.791977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5482fcdc-7974-410a-abf2-e7a4bba375ae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:29.792608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5482fcdc-7974-410a-abf2-e7a4bba375ae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:29.799421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5482fcdc-7974-410a-abf2-e7a4bba375ae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:29.799997 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5482fcdc-7974-410a-abf2-e7a4bba375ae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:29.800762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5482fcdc-7974-410a-abf2-e7a4bba375ae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:29.801215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5482fcdc-7974-410a-abf2-e7a4bba375ae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:29.936682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5482fcdc-7974-410a-abf2-e7a4bba375ae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:29.944227 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5482fcdc-7974-410a-abf2-e7a4bba375ae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1683 microversion: 2.1 time: 0.156268 Jul 20 05:14:29.944803 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3557/7015] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:29 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:30.962041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fe540a8e-ec3d-4509-a86f-c601ba5d650a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:30.962658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fe540a8e-ec3d-4509-a86f-c601ba5d650a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:30.969617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe540a8e-ec3d-4509-a86f-c601ba5d650a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:30.970068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe540a8e-ec3d-4509-a86f-c601ba5d650a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:30.970826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe540a8e-ec3d-4509-a86f-c601ba5d650a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:30.971266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fe540a8e-ec3d-4509-a86f-c601ba5d650a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:31.101837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fe540a8e-ec3d-4509-a86f-c601ba5d650a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:31.109703 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fe540a8e-ec3d-4509-a86f-c601ba5d650a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1683 microversion: 2.1 time: 0.152173 Jul 20 05:14:31.110365 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3459/7016] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:30 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:32.127820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5b23aca6-5425-4356-9105-946fc06ffd75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:32.128455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5b23aca6-5425-4356-9105-946fc06ffd75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:32.136065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b23aca6-5425-4356-9105-946fc06ffd75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:32.136537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b23aca6-5425-4356-9105-946fc06ffd75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:32.137327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b23aca6-5425-4356-9105-946fc06ffd75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:32.137783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5b23aca6-5425-4356-9105-946fc06ffd75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:32.277764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5b23aca6-5425-4356-9105-946fc06ffd75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:32.285268 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5b23aca6-5425-4356-9105-946fc06ffd75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1683 microversion: 2.1 time: 0.161646 Jul 20 05:14:32.286421 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3558/7017] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:32 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:33.302861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6a7493fd-ef21-4f60-ad9f-20a8faf84a8e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:33.303466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6a7493fd-ef21-4f60-ad9f-20a8faf84a8e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:33.310367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a7493fd-ef21-4f60-ad9f-20a8faf84a8e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:33.310816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a7493fd-ef21-4f60-ad9f-20a8faf84a8e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:33.311604 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a7493fd-ef21-4f60-ad9f-20a8faf84a8e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:33.312081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6a7493fd-ef21-4f60-ad9f-20a8faf84a8e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:33.444517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6a7493fd-ef21-4f60-ad9f-20a8faf84a8e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:33.452098 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6a7493fd-ef21-4f60-ad9f-20a8faf84a8e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1683 microversion: 2.1 time: 0.153702 Jul 20 05:14:33.452696 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3460/7018] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:33 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:34.469320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c03f241c-379b-453d-bbdd-8b3716d7b584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:34.469952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c03f241c-379b-453d-bbdd-8b3716d7b584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:34.476572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c03f241c-379b-453d-bbdd-8b3716d7b584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:34.477032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c03f241c-379b-453d-bbdd-8b3716d7b584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:34.477799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c03f241c-379b-453d-bbdd-8b3716d7b584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:34.478251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c03f241c-379b-453d-bbdd-8b3716d7b584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:34.608500 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c03f241c-379b-453d-bbdd-8b3716d7b584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:34.616387 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c03f241c-379b-453d-bbdd-8b3716d7b584 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1683 microversion: 2.1 time: 0.151103 Jul 20 05:14:34.616967 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3559/7019] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:34 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:14:35.633755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-62b4b86e-faa4-4c2c-824d-bfea1bf3a4ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:35.634365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-62b4b86e-faa4-4c2c-824d-bfea1bf3a4ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:35.641112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62b4b86e-faa4-4c2c-824d-bfea1bf3a4ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:35.641559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62b4b86e-faa4-4c2c-824d-bfea1bf3a4ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:35.642318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62b4b86e-faa4-4c2c-824d-bfea1bf3a4ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:35.642756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-62b4b86e-faa4-4c2c-824d-bfea1bf3a4ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:35.778573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-62b4b86e-faa4-4c2c-824d-bfea1bf3a4ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:35.786156 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-62b4b86e-faa4-4c2c-824d-bfea1bf3a4ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1683 microversion: 2.1 time: 0.156377 Jul 20 05:14:35.787596 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3461/7020] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:35 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:36.804778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4856aafc-1a73-43e1-94ca-c5e96eb80792 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:36.805416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4856aafc-1a73-43e1-94ca-c5e96eb80792 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:36.812521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4856aafc-1a73-43e1-94ca-c5e96eb80792 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:36.812988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4856aafc-1a73-43e1-94ca-c5e96eb80792 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:36.813772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4856aafc-1a73-43e1-94ca-c5e96eb80792 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:36.814226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4856aafc-1a73-43e1-94ca-c5e96eb80792 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:36.944243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4856aafc-1a73-43e1-94ca-c5e96eb80792 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:36.951891 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4856aafc-1a73-43e1-94ca-c5e96eb80792 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1683 microversion: 2.1 time: 0.151358 Jul 20 05:14:36.952469 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3560/7021] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:36 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:37.969902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5d85ff21-e585-4f12-b024-536e9688d307 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:37.970561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5d85ff21-e585-4f12-b024-536e9688d307 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:37.977573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d85ff21-e585-4f12-b024-536e9688d307 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:37.978022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d85ff21-e585-4f12-b024-536e9688d307 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:37.978832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d85ff21-e585-4f12-b024-536e9688d307 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:37.979274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d85ff21-e585-4f12-b024-536e9688d307 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:38.112502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5d85ff21-e585-4f12-b024-536e9688d307 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:38.120041 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5d85ff21-e585-4f12-b024-536e9688d307 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1683 microversion: 2.1 time: 0.155204 Jul 20 05:14:38.120617 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3462/7022] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:37 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:39.137152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fb3a3910-b179-49bb-9b5f-1dabfe87abdc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:39.137787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fb3a3910-b179-49bb-9b5f-1dabfe87abdc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:39.144510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb3a3910-b179-49bb-9b5f-1dabfe87abdc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:39.144968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb3a3910-b179-49bb-9b5f-1dabfe87abdc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:39.145744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb3a3910-b179-49bb-9b5f-1dabfe87abdc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:39.146202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb3a3910-b179-49bb-9b5f-1dabfe87abdc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:39.280156 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fb3a3910-b179-49bb-9b5f-1dabfe87abdc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:39.288407 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fb3a3910-b179-49bb-9b5f-1dabfe87abdc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1683 microversion: 2.1 time: 0.154505 Jul 20 05:14:39.289142 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3561/7023] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:39 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:40.306083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8961c315-aa5c-431a-8ba1-eb01bf654816 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:40.306837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8961c315-aa5c-431a-8ba1-eb01bf654816 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:40.314009 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8961c315-aa5c-431a-8ba1-eb01bf654816 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:40.314472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8961c315-aa5c-431a-8ba1-eb01bf654816 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:40.315259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8961c315-aa5c-431a-8ba1-eb01bf654816 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:40.315784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8961c315-aa5c-431a-8ba1-eb01bf654816 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:40.481692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-b62a367c-c1b7-4829-bb8a-cb018ba147f1 req-88a46dad-9015-4955-963d-8f27845335c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8b08cd-305a-4b61-9b16-2ee895f3341d", "name": "network-vif-unplugged", "status": "completed", "tag": "c4004f54-721a-4cea-8a91-f1719ff26b21"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:40.490017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b62a367c-c1b7-4829-bb8a-cb018ba147f1 req-88a46dad-9015-4955-963d-8f27845335c3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:40.491346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b62a367c-c1b7-4829-bb8a-cb018ba147f1 req-88a46dad-9015-4955-963d-8f27845335c3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:40.504984 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-b62a367c-c1b7-4829-bb8a-cb018ba147f1 req-88a46dad-9015-4955-963d-8f27845335c3 service nova] Creating event network-vif-unplugged:c4004f54-721a-4cea-8a91-f1719ff26b21 for instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d on n-h2-764485-11 Jul 20 05:14:40.511626 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-b62a367c-c1b7-4829-bb8a-cb018ba147f1 req-88a46dad-9015-4955-963d-8f27845335c3 service nova] Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:14:40.524088 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-b62a367c-c1b7-4829-bb8a-cb018ba147f1 req-88a46dad-9015-4955-963d-8f27845335c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117836 Jul 20 05:14:40.524972 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3562/7024] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:14:40.575613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8961c315-aa5c-431a-8ba1-eb01bf654816 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:40.585400 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8961c315-aa5c-431a-8ba1-eb01bf654816 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1682 microversion: 2.1 time: 0.282731 Jul 20 05:14:40.595700 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3463/7025] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:40 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1682 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:41.605755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-473203ac-7d81-4bcf-825d-97c62e2eca0c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:41.606554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-473203ac-7d81-4bcf-825d-97c62e2eca0c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:41.613202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-473203ac-7d81-4bcf-825d-97c62e2eca0c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:41.613670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-473203ac-7d81-4bcf-825d-97c62e2eca0c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:41.614452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-473203ac-7d81-4bcf-825d-97c62e2eca0c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:41.614907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-473203ac-7d81-4bcf-825d-97c62e2eca0c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:41.753582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-473203ac-7d81-4bcf-825d-97c62e2eca0c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:41.761702 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-473203ac-7d81-4bcf-825d-97c62e2eca0c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1680 microversion: 2.1 time: 0.162172 Jul 20 05:14:41.762276 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3563/7026] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:41 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:42.543459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3087378e-38ee-4e71-84aa-de92ec188ebb req-02c13bd6-8b9e-492c-9b19-854cd9b9b02c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8b08cd-305a-4b61-9b16-2ee895f3341d", "tag": "c4004f54-721a-4cea-8a91-f1719ff26b21"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:42.552493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3087378e-38ee-4e71-84aa-de92ec188ebb req-02c13bd6-8b9e-492c-9b19-854cd9b9b02c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:42.552947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3087378e-38ee-4e71-84aa-de92ec188ebb req-02c13bd6-8b9e-492c-9b19-854cd9b9b02c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:42.565174 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3087378e-38ee-4e71-84aa-de92ec188ebb req-02c13bd6-8b9e-492c-9b19-854cd9b9b02c service nova] Creating event network-changed:c4004f54-721a-4cea-8a91-f1719ff26b21 for instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d on n-h2-764485-11 Jul 20 05:14:42.570551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-3087378e-38ee-4e71-84aa-de92ec188ebb req-02c13bd6-8b9e-492c-9b19-854cd9b9b02c service nova] Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:14:42.582188 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3087378e-38ee-4e71-84aa-de92ec188ebb req-02c13bd6-8b9e-492c-9b19-854cd9b9b02c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042562 Jul 20 05:14:42.582840 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3464/7027] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:14:42.780590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-abb9fbc0-4b5c-43ff-a1c5-9fb408baba6d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:42.781216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-abb9fbc0-4b5c-43ff-a1c5-9fb408baba6d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:42.788898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abb9fbc0-4b5c-43ff-a1c5-9fb408baba6d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:42.789352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abb9fbc0-4b5c-43ff-a1c5-9fb408baba6d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:42.790160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abb9fbc0-4b5c-43ff-a1c5-9fb408baba6d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:42.790607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-abb9fbc0-4b5c-43ff-a1c5-9fb408baba6d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:43.002712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-abb9fbc0-4b5c-43ff-a1c5-9fb408baba6d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:43.010830 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-abb9fbc0-4b5c-43ff-a1c5-9fb408baba6d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1680 microversion: 2.1 time: 0.234112 Jul 20 05:14:43.011425 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3564/7028] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:42 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:14:44.029344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-980c7f25-5538-4512-a0b7-2862f475e0e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:44.030051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-980c7f25-5538-4512-a0b7-2862f475e0e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:44.036383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-980c7f25-5538-4512-a0b7-2862f475e0e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:44.036838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-980c7f25-5538-4512-a0b7-2862f475e0e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:44.038595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-980c7f25-5538-4512-a0b7-2862f475e0e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:44.039133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-980c7f25-5538-4512-a0b7-2862f475e0e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:44.180446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-980c7f25-5538-4512-a0b7-2862f475e0e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:44.188599 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-980c7f25-5538-4512-a0b7-2862f475e0e8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1680 microversion: 2.1 time: 0.164324 Jul 20 05:14:44.189208 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3465/7029] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:44 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:45.206458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4192f4dc-71a3-4654-9bca-62a632a602dc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:45.207091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4192f4dc-71a3-4654-9bca-62a632a602dc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:45.214680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4192f4dc-71a3-4654-9bca-62a632a602dc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:45.215044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4192f4dc-71a3-4654-9bca-62a632a602dc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:45.217245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4192f4dc-71a3-4654-9bca-62a632a602dc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:45.217720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4192f4dc-71a3-4654-9bca-62a632a602dc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:45.364159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4192f4dc-71a3-4654-9bca-62a632a602dc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:45.371934 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4192f4dc-71a3-4654-9bca-62a632a602dc tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1677 microversion: 2.1 time: 0.169446 Jul 20 05:14:45.372533 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3565/7030] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:45 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:45.388203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:45.388742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:45.395580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:45.396032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:45.397438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:45.397964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:45.438376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:45.438730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:45.439545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:45.439987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:45.460643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'cores', 'ram'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:14:45.465878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for user 515b90b9f91e47719155e3d2448cd0dd and project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'cores', 'ram'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:14:45.567322 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c7911de6-48c5-4447-8dc6-74f204199038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d/action" status: 202 len: 0 microversion: 2.1 time: 0.182727 Jul 20 05:14:45.567984 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3466/7031] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:14:45 2022] POST /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:14:45.576925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-70ea832d-e917-4b0c-ab7f-08a2d1847ba3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:45.577563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-70ea832d-e917-4b0c-ab7f-08a2d1847ba3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:45.587094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70ea832d-e917-4b0c-ab7f-08a2d1847ba3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:45.587698 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70ea832d-e917-4b0c-ab7f-08a2d1847ba3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:45.588595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70ea832d-e917-4b0c-ab7f-08a2d1847ba3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:45.589085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70ea832d-e917-4b0c-ab7f-08a2d1847ba3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:45.790555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-70ea832d-e917-4b0c-ab7f-08a2d1847ba3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:45.798189 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-70ea832d-e917-4b0c-ab7f-08a2d1847ba3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1676 microversion: 2.1 time: 0.225158 Jul 20 05:14:45.798803 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3566/7032] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:45 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:46.817415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-50d8609a-da12-4931-8858-29033333076d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:46.818681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-50d8609a-da12-4931-8858-29033333076d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:46.825081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50d8609a-da12-4931-8858-29033333076d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:46.825538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50d8609a-da12-4931-8858-29033333076d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:46.826312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50d8609a-da12-4931-8858-29033333076d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:46.826753 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50d8609a-da12-4931-8858-29033333076d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:46.964825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-50d8609a-da12-4931-8858-29033333076d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:46.972519 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-50d8609a-da12-4931-8858-29033333076d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1676 microversion: 2.1 time: 0.160343 Jul 20 05:14:46.973102 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3467/7033] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:46 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:47.992819 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e53aa585-b2cd-4710-815f-51c054af242a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:47.993455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e53aa585-b2cd-4710-815f-51c054af242a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:48.000545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e53aa585-b2cd-4710-815f-51c054af242a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:48.001014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e53aa585-b2cd-4710-815f-51c054af242a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:48.001791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e53aa585-b2cd-4710-815f-51c054af242a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:48.002247 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e53aa585-b2cd-4710-815f-51c054af242a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:48.144992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e53aa585-b2cd-4710-815f-51c054af242a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:48.153777 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e53aa585-b2cd-4710-815f-51c054af242a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1676 microversion: 2.1 time: 0.166030 Jul 20 05:14:48.154547 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3567/7034] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:47 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:49.176847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eb8a9a0f-2dac-413d-9161-5b7ebe4f329a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:49.177468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eb8a9a0f-2dac-413d-9161-5b7ebe4f329a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:49.178530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-a85f9df8-262b-4da6-b0cd-0c6ccf58f0a6 req-08070439-ed4e-4c65-b808-883d8e0ec308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8b08cd-305a-4b61-9b16-2ee895f3341d", "tag": "c4004f54-721a-4cea-8a91-f1719ff26b21"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:49.186905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb8a9a0f-2dac-413d-9161-5b7ebe4f329a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:49.187178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a85f9df8-262b-4da6-b0cd-0c6ccf58f0a6 req-08070439-ed4e-4c65-b808-883d8e0ec308 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:49.187582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-a85f9df8-262b-4da6-b0cd-0c6ccf58f0a6 req-08070439-ed4e-4c65-b808-883d8e0ec308 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:49.192017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb8a9a0f-2dac-413d-9161-5b7ebe4f329a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:49.192961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb8a9a0f-2dac-413d-9161-5b7ebe4f329a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:49.194076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eb8a9a0f-2dac-413d-9161-5b7ebe4f329a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:49.207619 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-a85f9df8-262b-4da6-b0cd-0c6ccf58f0a6 req-08070439-ed4e-4c65-b808-883d8e0ec308 service nova] Creating event network-changed:c4004f54-721a-4cea-8a91-f1719ff26b21 for instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d on n-h1-764485-11 Jul 20 05:14:49.214770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-a85f9df8-262b-4da6-b0cd-0c6ccf58f0a6 req-08070439-ed4e-4c65-b808-883d8e0ec308 service nova] Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:14:49.232270 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-a85f9df8-262b-4da6-b0cd-0c6ccf58f0a6 req-08070439-ed4e-4c65-b808-883d8e0ec308 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059715 Jul 20 05:14:49.234506 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3568/7035] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:14:49.812323 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eb8a9a0f-2dac-413d-9161-5b7ebe4f329a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:49.820595 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eb8a9a0f-2dac-413d-9161-5b7ebe4f329a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1676 microversion: 2.1 time: 0.654004 Jul 20 05:14:49.821275 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3468/7036] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:49 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1676 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:14:50.839101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-99a74d8d-b9c3-40d4-a6b7-e39d802e19c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:50.839829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-99a74d8d-b9c3-40d4-a6b7-e39d802e19c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:50.846827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99a74d8d-b9c3-40d4-a6b7-e39d802e19c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:50.847828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99a74d8d-b9c3-40d4-a6b7-e39d802e19c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:50.848618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99a74d8d-b9c3-40d4-a6b7-e39d802e19c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:50.849068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99a74d8d-b9c3-40d4-a6b7-e39d802e19c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:50.989055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-99a74d8d-b9c3-40d4-a6b7-e39d802e19c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:50.997437 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-99a74d8d-b9c3-40d4-a6b7-e39d802e19c5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1676 microversion: 2.1 time: 0.163794 Jul 20 05:14:50.998014 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3569/7037] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:50 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:52.013763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-93b6f26c-908c-49ee-933a-aa061aea370c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:52.014911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-93b6f26c-908c-49ee-933a-aa061aea370c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:52.022003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93b6f26c-908c-49ee-933a-aa061aea370c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:52.022731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93b6f26c-908c-49ee-933a-aa061aea370c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:52.023670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93b6f26c-908c-49ee-933a-aa061aea370c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:52.024118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93b6f26c-908c-49ee-933a-aa061aea370c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:52.153929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-93b6f26c-908c-49ee-933a-aa061aea370c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:52.161439 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-93b6f26c-908c-49ee-933a-aa061aea370c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1676 microversion: 2.1 time: 0.151659 Jul 20 05:14:52.162041 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3469/7038] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:52 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:53.179218 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6916a9e8-1510-4fdc-bb85-14399d7ab313 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:53.179787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6916a9e8-1510-4fdc-bb85-14399d7ab313 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:53.186502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6916a9e8-1510-4fdc-bb85-14399d7ab313 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:53.186971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6916a9e8-1510-4fdc-bb85-14399d7ab313 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:53.188215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6916a9e8-1510-4fdc-bb85-14399d7ab313 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:53.188215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6916a9e8-1510-4fdc-bb85-14399d7ab313 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:53.381833 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6916a9e8-1510-4fdc-bb85-14399d7ab313 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:53.385382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:53.390351 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6916a9e8-1510-4fdc-bb85-14399d7ab313 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1676 microversion: 2.1 time: 0.216022 Jul 20 05:14:53.390927 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3570/7039] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:53 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1676 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:54.408197 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-380907e5-5e8b-4ef8-8e55-0ec7872a5f4f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:54.408805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-380907e5-5e8b-4ef8-8e55-0ec7872a5f4f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:54.415799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-380907e5-5e8b-4ef8-8e55-0ec7872a5f4f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:54.416250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-380907e5-5e8b-4ef8-8e55-0ec7872a5f4f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:54.417017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-380907e5-5e8b-4ef8-8e55-0ec7872a5f4f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:54.417456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-380907e5-5e8b-4ef8-8e55-0ec7872a5f4f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:54.553934 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-380907e5-5e8b-4ef8-8e55-0ec7872a5f4f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:54.557620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:54.562760 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-380907e5-5e8b-4ef8-8e55-0ec7872a5f4f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1669 microversion: 2.1 time: 0.158513 Jul 20 05:14:54.563342 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3470/7040] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:54 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:54.580207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d9c5a055-b03f-4e00-8568-0e3986d1f565 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:54.580838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d9c5a055-b03f-4e00-8568-0e3986d1f565 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:54.588933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9c5a055-b03f-4e00-8568-0e3986d1f565 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:54.589406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9c5a055-b03f-4e00-8568-0e3986d1f565 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:54.590187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9c5a055-b03f-4e00-8568-0e3986d1f565 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:54.590646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d9c5a055-b03f-4e00-8568-0e3986d1f565 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:54.722931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d9c5a055-b03f-4e00-8568-0e3986d1f565 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:54.730677 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d9c5a055-b03f-4e00-8568-0e3986d1f565 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1669 microversion: 2.1 time: 0.155167 Jul 20 05:14:54.731259 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3571/7041] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:54 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:54.747069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4470531b-9d9a-4860-8afe-412fee3accc8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:54.747716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4470531b-9d9a-4860-8afe-412fee3accc8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:54.754877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4470531b-9d9a-4860-8afe-412fee3accc8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:54.755259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4470531b-9d9a-4860-8afe-412fee3accc8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:54.756630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4470531b-9d9a-4860-8afe-412fee3accc8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:54.757070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4470531b-9d9a-4860-8afe-412fee3accc8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:54.890544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4470531b-9d9a-4860-8afe-412fee3accc8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:54.898815 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4470531b-9d9a-4860-8afe-412fee3accc8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1669 microversion: 2.1 time: 0.155617 Jul 20 05:14:54.899411 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3471/7042] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:54 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:54.915203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9e9f1655-8aef-41c4-aedf-145867f3037b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:54.915742 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9e9f1655-8aef-41c4-aedf-145867f3037b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:54.922238 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e9f1655-8aef-41c4-aedf-145867f3037b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:54.922699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e9f1655-8aef-41c4-aedf-145867f3037b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:54.923471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e9f1655-8aef-41c4-aedf-145867f3037b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:54.923941 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e9f1655-8aef-41c4-aedf-145867f3037b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:54.950332 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9e9f1655-8aef-41c4-aedf-145867f3037b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:14:55.031083 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9e9f1655-8aef-41c4-aedf-145867f3037b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 204 len: 0 microversion: 2.1 time: 0.119638 Jul 20 05:14:55.031992 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3572/7043] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:14:54 2022] DELETE /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:14:55.040950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ce934b2-ae13-4d9b-85f1-f4543b2ff44f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:55.041575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ce934b2-ae13-4d9b-85f1-f4543b2ff44f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:55.048043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ce934b2-ae13-4d9b-85f1-f4543b2ff44f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:55.048556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ce934b2-ae13-4d9b-85f1-f4543b2ff44f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:55.049338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ce934b2-ae13-4d9b-85f1-f4543b2ff44f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:55.049791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ce934b2-ae13-4d9b-85f1-f4543b2ff44f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:55.150259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2b4594e1-66fe-414d-b2fd-70d057a18658 req-bcc313d1-2874-42c4-9c90-e250ac21b859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8b08cd-305a-4b61-9b16-2ee895f3341d", "name": "network-vif-plugged", "status": "completed", "tag": "c4004f54-721a-4cea-8a91-f1719ff26b21"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:55.159693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2b4594e1-66fe-414d-b2fd-70d057a18658 req-bcc313d1-2874-42c4-9c90-e250ac21b859 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:55.160153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2b4594e1-66fe-414d-b2fd-70d057a18658 req-bcc313d1-2874-42c4-9c90-e250ac21b859 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:55.172475 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2b4594e1-66fe-414d-b2fd-70d057a18658 req-bcc313d1-2874-42c4-9c90-e250ac21b859 service nova] Creating event network-vif-plugged:c4004f54-721a-4cea-8a91-f1719ff26b21 for instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d on n-h1-764485-11 Jul 20 05:14:55.178597 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2b4594e1-66fe-414d-b2fd-70d057a18658 req-bcc313d1-2874-42c4-9c90-e250ac21b859 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095104 Jul 20 05:14:55.178755 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3573/7044] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:14:55.200498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ce934b2-ae13-4d9b-85f1-f4543b2ff44f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:55.208567 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ce934b2-ae13-4d9b-85f1-f4543b2ff44f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1675 microversion: 2.1 time: 0.172361 Jul 20 05:14:55.209193 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3472/7045] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:55 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:14:56.227164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-431df1a7-20d0-4464-8c73-c9360a87a6f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:56.228183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-431df1a7-20d0-4464-8c73-c9360a87a6f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:56.230736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:56.236862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-431df1a7-20d0-4464-8c73-c9360a87a6f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:56.237597 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-431df1a7-20d0-4464-8c73-c9360a87a6f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:56.238403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-431df1a7-20d0-4464-8c73-c9360a87a6f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:56.238859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-431df1a7-20d0-4464-8c73-c9360a87a6f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:56.376780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-431df1a7-20d0-4464-8c73-c9360a87a6f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:56.385362 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-431df1a7-20d0-4464-8c73-c9360a87a6f6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1675 microversion: 2.1 time: 0.163641 Jul 20 05:14:56.385949 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3574/7046] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:56 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:14:57.329300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-c17a590f-f2a3-4bcb-b2f4-6afa9bf0a781 req-1cf58192-199f-4678-bf9e-f6af153b5648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8b08cd-305a-4b61-9b16-2ee895f3341d", "name": "network-vif-deleted", "tag": "c4004f54-721a-4cea-8a91-f1719ff26b21"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:57.333668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:57.334579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:57.341991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c17a590f-f2a3-4bcb-b2f4-6afa9bf0a781 req-1cf58192-199f-4678-bf9e-f6af153b5648 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:57.342437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-c17a590f-f2a3-4bcb-b2f4-6afa9bf0a781 req-1cf58192-199f-4678-bf9e-f6af153b5648 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:57.357110 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-c17a590f-f2a3-4bcb-b2f4-6afa9bf0a781 req-1cf58192-199f-4678-bf9e-f6af153b5648 service nova] Creating event network-vif-deleted:c4004f54-721a-4cea-8a91-f1719ff26b21 for instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d on n-h1-764485-11 Jul 20 05:14:57.362757 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-c17a590f-f2a3-4bcb-b2f4-6afa9bf0a781 req-1cf58192-199f-4678-bf9e-f6af153b5648 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036875 Jul 20 05:14:57.363427 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3473/7047] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:14:57.403111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-67623336-2abb-4981-9d51-01ee2c569044 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:57.404470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-67623336-2abb-4981-9d51-01ee2c569044 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:57.411629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67623336-2abb-4981-9d51-01ee2c569044 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:57.412309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67623336-2abb-4981-9d51-01ee2c569044 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:57.414208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67623336-2abb-4981-9d51-01ee2c569044 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:57.414822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67623336-2abb-4981-9d51-01ee2c569044 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:57.450503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67623336-2abb-4981-9d51-01ee2c569044 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:57.451320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-67623336-2abb-4981-9d51-01ee2c569044 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:57.451888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-67623336-2abb-4981-9d51-01ee2c569044 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lazy-loading 'fault' on Instance uuid 5d8b08cd-305a-4b61-9b16-2ee895f3341d {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:14:57.494685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-67623336-2abb-4981-9d51-01ee2c569044 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:57.502270 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-67623336-2abb-4981-9d51-01ee2c569044 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 200 len: 1329 microversion: 2.1 time: 0.103135 Jul 20 05:14:57.502881 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3575/7048] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:57 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 1329 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:14:58.521752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5cdd70db-3e4a-455b-ab40-2dca62e77392 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:58.523370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5cdd70db-3e4a-455b-ab40-2dca62e77392 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:58.530036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cdd70db-3e4a-455b-ab40-2dca62e77392 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:58.530487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cdd70db-3e4a-455b-ab40-2dca62e77392 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:58.531289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cdd70db-3e4a-455b-ab40-2dca62e77392 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:58.531761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5cdd70db-3e4a-455b-ab40-2dca62e77392 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:58.546735 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-5cdd70db-3e4a-455b-ab40-2dca62e77392 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5cdd70db-3e4a-455b-ab40-2dca62e77392 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d HTTP/1.1 Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '5d8b08cd-305a-4b61-9b16-2ee895f3341d'} Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:14:58.548542 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:14:58.553017 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:14:58.553017 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:14:58.553017 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:14:58.553017 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:14:58.553017 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:14:58.553017 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:14:58.553017 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:14:58.553017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5cdd70db-3e4a-455b-ab40-2dca62e77392 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:14:58.553017 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5cdd70db-3e4a-455b-ab40-2dca62e77392 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 404 len: 111 microversion: 2.1 time: 0.033360 Jul 20 05:14:58.553017 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3474/7049] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:58 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:14:58.568413 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-80cbcc52-aadf-4b75-a0ed-c6a409238dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:58.569653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-80cbcc52-aadf-4b75-a0ed-c6a409238dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:58.576179 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80cbcc52-aadf-4b75-a0ed-c6a409238dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:58.576645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80cbcc52-aadf-4b75-a0ed-c6a409238dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:58.577455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80cbcc52-aadf-4b75-a0ed-c6a409238dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:58.577908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80cbcc52-aadf-4b75-a0ed-c6a409238dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:58.593088 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-80cbcc52-aadf-4b75-a0ed-c6a409238dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-80cbcc52-aadf-4b75-a0ed-c6a409238dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d HTTP/1.1 Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '5d8b08cd-305a-4b61-9b16-2ee895f3341d'} Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:14:58.594778 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:14:58.598645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:14:58.598645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:14:58.598645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:14:58.598645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:14:58.598645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:14:58.598645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:14:58.598645 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:14:58.598645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-80cbcc52-aadf-4b75-a0ed-c6a409238dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:14:58.598645 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-80cbcc52-aadf-4b75-a0ed-c6a409238dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 404 len: 111 microversion: 2.1 time: 0.032928 Jul 20 05:14:58.598645 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3576/7050] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:58 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:14:58.644677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-666066915", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "f4331169-eba0-470b-9af3-17270dc6efeb"}], "security_groups": [{"name": "tempest-securitygroup--376987174"}], "key_name": "tempest-keypair-1049948118", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:58.749097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] validate_networks() for [('f4331169-eba0-470b-9af3-17270dc6efeb', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:14:59.157262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:14:59.157699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:14:59.158216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:14:59.158634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:14:59.159054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:14:59.168730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:59.169180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:59.169978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:59.170416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:59.187576 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:14:59.192833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for user 515b90b9f91e47719155e3d2448cd0dd and project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:14:59.205302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:14:59.207572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:14:59.253983 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-56fd2e6b-0961-4422-a47e-b4bbba43f979 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.613139 Jul 20 05:14:59.254636 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3475/7051] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:14:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:14:59.264702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-09b17a06-6192-41b7-babe-0632c16b0ac1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:59.265341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-09b17a06-6192-41b7-babe-0632c16b0ac1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:59.318769 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-09b17a06-6192-41b7-babe-0632c16b0ac1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:59.325613 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-09b17a06-6192-41b7-babe-0632c16b0ac1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1238 microversion: 2.1 time: 0.064713 Jul 20 05:14:59.326188 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3577/7052] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:59 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:00.344562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e586189a-ca2a-4fdb-8102-178f84bccda4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:00.345307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e586189a-ca2a-4fdb-8102-178f84bccda4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:00.353339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e586189a-ca2a-4fdb-8102-178f84bccda4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:00.353877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e586189a-ca2a-4fdb-8102-178f84bccda4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:00.354716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e586189a-ca2a-4fdb-8102-178f84bccda4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:00.355222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e586189a-ca2a-4fdb-8102-178f84bccda4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:00.443226 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e586189a-ca2a-4fdb-8102-178f84bccda4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:00.452298 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e586189a-ca2a-4fdb-8102-178f84bccda4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1296 microversion: 2.1 time: 0.112543 Jul 20 05:15:00.453040 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3476/7053] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:00 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1296 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:01.470364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-baee1da1-8b62-43c5-af76-9c248cc14034 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:01.471000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-baee1da1-8b62-43c5-af76-9c248cc14034 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:01.481008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-baee1da1-8b62-43c5-af76-9c248cc14034 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:01.481484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-baee1da1-8b62-43c5-af76-9c248cc14034 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:01.482291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-baee1da1-8b62-43c5-af76-9c248cc14034 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:01.482757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-baee1da1-8b62-43c5-af76-9c248cc14034 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:01.643429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e900e05f-df12-4c2b-a56c-d74b46de4296 req-fd3dac6b-3cdc-44ce-8a60-c4cfc4481ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579c5d40-093e-4a4b-a73b-cb96ce33c050", "tag": "8cc13e48-08fc-4276-83b1-90a8081ef300"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:01.665029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e900e05f-df12-4c2b-a56c-d74b46de4296 req-fd3dac6b-3cdc-44ce-8a60-c4cfc4481ff9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:01.666873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e900e05f-df12-4c2b-a56c-d74b46de4296 req-fd3dac6b-3cdc-44ce-8a60-c4cfc4481ff9 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:01.680687 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e900e05f-df12-4c2b-a56c-d74b46de4296 req-fd3dac6b-3cdc-44ce-8a60-c4cfc4481ff9 service nova] Creating event network-changed:8cc13e48-08fc-4276-83b1-90a8081ef300 for instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 on n-h1-764485-11 Jul 20 05:15:01.686577 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e900e05f-df12-4c2b-a56c-d74b46de4296 req-fd3dac6b-3cdc-44ce-8a60-c4cfc4481ff9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048426 Jul 20 05:15:01.687210 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3477/7054] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:15:01.731169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-baee1da1-8b62-43c5-af76-9c248cc14034 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:01.739473 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-baee1da1-8b62-43c5-af76-9c248cc14034 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1363 microversion: 2.1 time: 0.273204 Jul 20 05:15:01.740093 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3578/7055] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:01 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:02.759402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4e17c5af-2e6c-4bb1-bdd8-d7509ef6c504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:02.760153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4e17c5af-2e6c-4bb1-bdd8-d7509ef6c504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:02.766548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e17c5af-2e6c-4bb1-bdd8-d7509ef6c504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:02.767003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e17c5af-2e6c-4bb1-bdd8-d7509ef6c504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:02.767813 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e17c5af-2e6c-4bb1-bdd8-d7509ef6c504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:02.768253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4e17c5af-2e6c-4bb1-bdd8-d7509ef6c504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:02.898091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4e17c5af-2e6c-4bb1-bdd8-d7509ef6c504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:02.905691 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4e17c5af-2e6c-4bb1-bdd8-d7509ef6c504 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1363 microversion: 2.1 time: 0.152638 Jul 20 05:15:02.906309 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3478/7056] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:02 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:03.922745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e2671493-a93c-45e6-8070-fb4919df0ab6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:03.923388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e2671493-a93c-45e6-8070-fb4919df0ab6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:03.932157 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2671493-a93c-45e6-8070-fb4919df0ab6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:03.932625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2671493-a93c-45e6-8070-fb4919df0ab6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:03.933410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2671493-a93c-45e6-8070-fb4919df0ab6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:03.933864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2671493-a93c-45e6-8070-fb4919df0ab6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:04.069614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e2671493-a93c-45e6-8070-fb4919df0ab6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:04.077095 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e2671493-a93c-45e6-8070-fb4919df0ab6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1363 microversion: 2.1 time: 0.158418 Jul 20 05:15:04.077676 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3579/7057] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:03 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:05.095253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b5e815e5-3b7a-4a88-ad8b-e5c0d7f68003 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:05.095806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b5e815e5-3b7a-4a88-ad8b-e5c0d7f68003 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:05.102377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5e815e5-3b7a-4a88-ad8b-e5c0d7f68003 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:05.102832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5e815e5-3b7a-4a88-ad8b-e5c0d7f68003 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:05.103650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5e815e5-3b7a-4a88-ad8b-e5c0d7f68003 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:05.104092 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b5e815e5-3b7a-4a88-ad8b-e5c0d7f68003 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:05.242998 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b5e815e5-3b7a-4a88-ad8b-e5c0d7f68003 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:05.250662 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b5e815e5-3b7a-4a88-ad8b-e5c0d7f68003 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1363 microversion: 2.1 time: 0.159689 Jul 20 05:15:05.251238 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3479/7058] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:05 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:06.268969 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2c69e079-7147-4527-ab22-3063bd2a1fa6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:06.269595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2c69e079-7147-4527-ab22-3063bd2a1fa6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:06.277276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c69e079-7147-4527-ab22-3063bd2a1fa6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:06.277683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c69e079-7147-4527-ab22-3063bd2a1fa6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:06.278454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c69e079-7147-4527-ab22-3063bd2a1fa6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:06.278902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2c69e079-7147-4527-ab22-3063bd2a1fa6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:06.411602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2c69e079-7147-4527-ab22-3063bd2a1fa6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:06.419660 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2c69e079-7147-4527-ab22-3063bd2a1fa6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1363 microversion: 2.1 time: 0.154608 Jul 20 05:15:06.420233 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3580/7059] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:06 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:07.128036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-fda78b07-bcf9-4253-a6fb-7ef16612e6bb req-c73b0615-ad91-4ae5-b55b-36422053bb8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579c5d40-093e-4a4b-a73b-cb96ce33c050", "name": "network-vif-plugged", "status": "completed", "tag": "8cc13e48-08fc-4276-83b1-90a8081ef300"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:07.138253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fda78b07-bcf9-4253-a6fb-7ef16612e6bb req-c73b0615-ad91-4ae5-b55b-36422053bb8d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:07.138697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-fda78b07-bcf9-4253-a6fb-7ef16612e6bb req-c73b0615-ad91-4ae5-b55b-36422053bb8d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:07.150051 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-fda78b07-bcf9-4253-a6fb-7ef16612e6bb req-c73b0615-ad91-4ae5-b55b-36422053bb8d service nova] Creating event network-vif-plugged:8cc13e48-08fc-4276-83b1-90a8081ef300 for instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 on n-h1-764485-11 Jul 20 05:15:07.154947 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-fda78b07-bcf9-4253-a6fb-7ef16612e6bb req-c73b0615-ad91-4ae5-b55b-36422053bb8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030702 Jul 20 05:15:07.155752 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3480/7060] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:15:07.437284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-303e43f8-6050-4364-b82b-46d5f2ac639a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:07.437918 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-303e43f8-6050-4364-b82b-46d5f2ac639a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:07.445038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-303e43f8-6050-4364-b82b-46d5f2ac639a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:07.445498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-303e43f8-6050-4364-b82b-46d5f2ac639a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:07.446271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-303e43f8-6050-4364-b82b-46d5f2ac639a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:07.446720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-303e43f8-6050-4364-b82b-46d5f2ac639a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:07.577586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-303e43f8-6050-4364-b82b-46d5f2ac639a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:07.585488 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-303e43f8-6050-4364-b82b-46d5f2ac639a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1363 microversion: 2.1 time: 0.151941 Jul 20 05:15:07.586304 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3581/7061] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:07 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:08.605053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cff34521-4020-47f4-9035-b4fbc8863f62 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:08.605767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cff34521-4020-47f4-9035-b4fbc8863f62 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:08.612449 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cff34521-4020-47f4-9035-b4fbc8863f62 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:08.612911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cff34521-4020-47f4-9035-b4fbc8863f62 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:08.613677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cff34521-4020-47f4-9035-b4fbc8863f62 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:08.614113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cff34521-4020-47f4-9035-b4fbc8863f62 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:08.749429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cff34521-4020-47f4-9035-b4fbc8863f62 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:08.757587 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cff34521-4020-47f4-9035-b4fbc8863f62 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1550 microversion: 2.1 time: 0.158267 Jul 20 05:15:08.758173 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3481/7062] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:08 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:08.774622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91e43346-364a-461b-9f6e-41b1b1ee9dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:08.775142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91e43346-364a-461b-9f6e-41b1b1ee9dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:08.781852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91e43346-364a-461b-9f6e-41b1b1ee9dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:08.782314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91e43346-364a-461b-9f6e-41b1b1ee9dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:08.783088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91e43346-364a-461b-9f6e-41b1b1ee9dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:08.783563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91e43346-364a-461b-9f6e-41b1b1ee9dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:08.865177 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91e43346-364a-461b-9f6e-41b1b1ee9dae tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094940 Jul 20 05:15:08.866609 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3582/7063] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 05:15:08 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:10.146177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ec9cebc8-d145-4e00-8275-ae46ad542e9e req-e79c27e6-1510-445c-94da-e3b2e3e8732b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579c5d40-093e-4a4b-a73b-cb96ce33c050", "tag": "8cc13e48-08fc-4276-83b1-90a8081ef300"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:10.150494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:10.151336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:10.159149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ec9cebc8-d145-4e00-8275-ae46ad542e9e req-e79c27e6-1510-445c-94da-e3b2e3e8732b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:10.159644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ec9cebc8-d145-4e00-8275-ae46ad542e9e req-e79c27e6-1510-445c-94da-e3b2e3e8732b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:10.171715 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ec9cebc8-d145-4e00-8275-ae46ad542e9e req-e79c27e6-1510-445c-94da-e3b2e3e8732b service nova] Creating event network-changed:8cc13e48-08fc-4276-83b1-90a8081ef300 for instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 on n-h1-764485-11 Jul 20 05:15:10.176619 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ec9cebc8-d145-4e00-8275-ae46ad542e9e req-e79c27e6-1510-445c-94da-e3b2e3e8732b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034254 Jul 20 05:15:10.177785 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3482/7064] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:15.669187 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:15:15.670123 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:15:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:15:17.274411 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:15:17.275012 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:15:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:16:23.512924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:23.515069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=21 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:23.515750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:23.520874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-75942947-3820-4c0e-8223-c8a823a5437f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:23.521508 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-75942947-3820-4c0e-8223-c8a823a5437f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:23.529320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75942947-3820-4c0e-8223-c8a823a5437f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:23.529789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75942947-3820-4c0e-8223-c8a823a5437f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:23.530572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75942947-3820-4c0e-8223-c8a823a5437f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:23.531087 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75942947-3820-4c0e-8223-c8a823a5437f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:23.667709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-75942947-3820-4c0e-8223-c8a823a5437f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:23.675273 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-75942947-3820-4c0e-8223-c8a823a5437f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1669 microversion: 2.1 time: 0.163579 Jul 20 05:16:23.675880 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3583/7065] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:23 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:23.690548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:23.691397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=48 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:23.697007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-29bbd36a-1cc5-41cf-8b6c-13e3d991d106 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b173c639-3840-41c5-9d1d-06cf138b4524"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:23.698351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-29bbd36a-1cc5-41cf-8b6c-13e3d991d106 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:23.706035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29bbd36a-1cc5-41cf-8b6c-13e3d991d106 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:23.706485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29bbd36a-1cc5-41cf-8b6c-13e3d991d106 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:23.707253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29bbd36a-1cc5-41cf-8b6c-13e3d991d106 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:23.707723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-29bbd36a-1cc5-41cf-8b6c-13e3d991d106 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:23.942458 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-29bbd36a-1cc5-41cf-8b6c-13e3d991d106 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254282 Jul 20 05:16:23.943082 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3483/7066] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 05:16:23 2022] POST /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:35.652908 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:35.653984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:35.656554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:35.657347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:35.663607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:35.664071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:35.664841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:35.665291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:35.744890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:35.751709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Old instance type m1.heat2, new instance type m1.heat {{(pid=119808) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:16:35.758806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:16:35.759237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:16:35.759764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:16:35.760191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:16:35.760613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:16:35.821502 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [fd8a0020-f178-4067-a229-fbc387b5175a] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:16:36.828397 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [fd8a0020-f178-4067-a229-fbc387b5175a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51680. Jul 20 05:16:36.832102 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-75526812-ef1f-42e3-8512-bf0657fa858d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050/action" status: 202 len: 0 microversion: 2.1 time: 1.183254 Jul 20 05:16:36.832772 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3584/7067] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:16:35 2022] POST /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050/action => generated 0 bytes in 1184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:16:36.842624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a0e522b9-a914-4d4d-b458-df0338478b3d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:36.843606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a0e522b9-a914-4d4d-b458-df0338478b3d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:36.846406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:36.846990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:36.853228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0e522b9-a914-4d4d-b458-df0338478b3d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.853831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0e522b9-a914-4d4d-b458-df0338478b3d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.854634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0e522b9-a914-4d4d-b458-df0338478b3d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.855106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a0e522b9-a914-4d4d-b458-df0338478b3d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.364237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a0e522b9-a914-4d4d-b458-df0338478b3d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:37.372649 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a0e522b9-a914-4d4d-b458-df0338478b3d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1724 microversion: 2.1 time: 0.534806 Jul 20 05:16:37.373324 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3484/7068] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:36 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1724 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:38.392614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-19ebe689-72a0-45cc-9671-1e0364f3b9cf tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:38.393354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-19ebe689-72a0-45cc-9671-1e0364f3b9cf tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:38.400301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ebe689-72a0-45cc-9671-1e0364f3b9cf tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:38.401190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ebe689-72a0-45cc-9671-1e0364f3b9cf tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:38.401548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ebe689-72a0-45cc-9671-1e0364f3b9cf tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:38.402002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-19ebe689-72a0-45cc-9671-1e0364f3b9cf tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:38.619501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-19ebe689-72a0-45cc-9671-1e0364f3b9cf tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:38.627814 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-19ebe689-72a0-45cc-9671-1e0364f3b9cf tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1724 microversion: 2.1 time: 0.240942 Jul 20 05:16:38.628335 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3585/7069] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:38 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:39.644909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a175fb68-57c7-4c4f-827a-1c8fb445a79e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:39.645529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a175fb68-57c7-4c4f-827a-1c8fb445a79e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:39.653026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a175fb68-57c7-4c4f-827a-1c8fb445a79e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:39.653479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a175fb68-57c7-4c4f-827a-1c8fb445a79e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:39.654248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a175fb68-57c7-4c4f-827a-1c8fb445a79e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:39.654688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a175fb68-57c7-4c4f-827a-1c8fb445a79e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:39.784569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a175fb68-57c7-4c4f-827a-1c8fb445a79e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:39.792759 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a175fb68-57c7-4c4f-827a-1c8fb445a79e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1729 microversion: 2.1 time: 0.151817 Jul 20 05:16:39.793345 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3485/7070] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:39 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:40.810195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ea719945-2529-4800-855a-4b2ddbf2f709 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:40.810850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ea719945-2529-4800-855a-4b2ddbf2f709 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:40.817724 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea719945-2529-4800-855a-4b2ddbf2f709 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:40.818181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea719945-2529-4800-855a-4b2ddbf2f709 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:40.818990 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea719945-2529-4800-855a-4b2ddbf2f709 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:40.819441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ea719945-2529-4800-855a-4b2ddbf2f709 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:40.951818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ea719945-2529-4800-855a-4b2ddbf2f709 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:40.960882 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ea719945-2529-4800-855a-4b2ddbf2f709 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1729 microversion: 2.1 time: 0.154584 Jul 20 05:16:40.961623 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3586/7071] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:40 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:41.980834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33816cc3-b15d-4896-8ad0-54110f61a93b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:41.981450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-33816cc3-b15d-4896-8ad0-54110f61a93b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:41.987756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33816cc3-b15d-4896-8ad0-54110f61a93b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:41.988214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33816cc3-b15d-4896-8ad0-54110f61a93b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:41.988981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33816cc3-b15d-4896-8ad0-54110f61a93b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:41.989422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33816cc3-b15d-4896-8ad0-54110f61a93b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:42.126826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-33816cc3-b15d-4896-8ad0-54110f61a93b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:42.135285 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-33816cc3-b15d-4896-8ad0-54110f61a93b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1729 microversion: 2.1 time: 0.159878 Jul 20 05:16:42.135907 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3486/7072] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:41 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:43.154288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-238502bf-6c96-4eda-a5a7-f40d6fc1ed2c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:43.154995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-238502bf-6c96-4eda-a5a7-f40d6fc1ed2c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:43.162059 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-238502bf-6c96-4eda-a5a7-f40d6fc1ed2c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:43.162524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-238502bf-6c96-4eda-a5a7-f40d6fc1ed2c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:43.163323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-238502bf-6c96-4eda-a5a7-f40d6fc1ed2c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:43.163802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-238502bf-6c96-4eda-a5a7-f40d6fc1ed2c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:43.300837 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-238502bf-6c96-4eda-a5a7-f40d6fc1ed2c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:43.309426 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-238502bf-6c96-4eda-a5a7-f40d6fc1ed2c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1729 microversion: 2.1 time: 0.160032 Jul 20 05:16:43.310009 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3587/7073] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:43 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:44.326528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a84820c9-5867-442d-9002-f9213baa340d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:44.327069 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a84820c9-5867-442d-9002-f9213baa340d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:44.334004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a84820c9-5867-442d-9002-f9213baa340d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:44.334461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a84820c9-5867-442d-9002-f9213baa340d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:44.335762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a84820c9-5867-442d-9002-f9213baa340d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:44.336204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a84820c9-5867-442d-9002-f9213baa340d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:44.471311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a84820c9-5867-442d-9002-f9213baa340d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:44.480300 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a84820c9-5867-442d-9002-f9213baa340d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1729 microversion: 2.1 time: 0.157779 Jul 20 05:16:44.480882 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3487/7074] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:44 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:45.498684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e936d0c-cea1-4ef3-aca2-3d1a81b684b7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:45.499241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3e936d0c-cea1-4ef3-aca2-3d1a81b684b7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:45.506361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e936d0c-cea1-4ef3-aca2-3d1a81b684b7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:45.507378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e936d0c-cea1-4ef3-aca2-3d1a81b684b7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:45.508223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e936d0c-cea1-4ef3-aca2-3d1a81b684b7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:45.508683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e936d0c-cea1-4ef3-aca2-3d1a81b684b7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:45.646252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3e936d0c-cea1-4ef3-aca2-3d1a81b684b7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:45.655611 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3e936d0c-cea1-4ef3-aca2-3d1a81b684b7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1729 microversion: 2.1 time: 0.160860 Jul 20 05:16:45.656236 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3588/7075] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:45 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:46.673056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c3aef425-e6f3-4b47-82ab-d1263232c8df tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:46.673669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c3aef425-e6f3-4b47-82ab-d1263232c8df tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:46.680871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3aef425-e6f3-4b47-82ab-d1263232c8df tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:46.681332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3aef425-e6f3-4b47-82ab-d1263232c8df tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:46.682103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3aef425-e6f3-4b47-82ab-d1263232c8df tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:46.682549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3aef425-e6f3-4b47-82ab-d1263232c8df tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:46.814684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c3aef425-e6f3-4b47-82ab-d1263232c8df tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:46.823344 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c3aef425-e6f3-4b47-82ab-d1263232c8df tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1729 microversion: 2.1 time: 0.154200 Jul 20 05:16:46.823963 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3488/7076] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:46 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:47.842014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44a600e1-3509-416e-84d7-9ec0e0b87598 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:47.842689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44a600e1-3509-416e-84d7-9ec0e0b87598 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:47.849736 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44a600e1-3509-416e-84d7-9ec0e0b87598 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:47.850212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44a600e1-3509-416e-84d7-9ec0e0b87598 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:47.851120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44a600e1-3509-416e-84d7-9ec0e0b87598 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:47.851613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44a600e1-3509-416e-84d7-9ec0e0b87598 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:47.982491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44a600e1-3509-416e-84d7-9ec0e0b87598 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:47.990795 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44a600e1-3509-416e-84d7-9ec0e0b87598 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1729 microversion: 2.1 time: 0.153520 Jul 20 05:16:47.991434 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3589/7077] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:47 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:49.009378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a6531f0a-9668-484b-87da-7451f58e615b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:49.010042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a6531f0a-9668-484b-87da-7451f58e615b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:49.017067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6531f0a-9668-484b-87da-7451f58e615b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:49.017521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6531f0a-9668-484b-87da-7451f58e615b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:49.018281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6531f0a-9668-484b-87da-7451f58e615b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:49.018718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a6531f0a-9668-484b-87da-7451f58e615b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:49.150334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a6531f0a-9668-484b-87da-7451f58e615b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:49.158442 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a6531f0a-9668-484b-87da-7451f58e615b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1729 microversion: 2.1 time: 0.155017 Jul 20 05:16:49.159023 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3489/7078] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:49 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:50.176606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-211705fb-9d3b-4755-8f2f-a6ded07c71b9 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:50.177243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-211705fb-9d3b-4755-8f2f-a6ded07c71b9 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:50.184991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-211705fb-9d3b-4755-8f2f-a6ded07c71b9 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:50.185462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-211705fb-9d3b-4755-8f2f-a6ded07c71b9 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:50.186254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-211705fb-9d3b-4755-8f2f-a6ded07c71b9 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:50.186712 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-211705fb-9d3b-4755-8f2f-a6ded07c71b9 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:50.322241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-211705fb-9d3b-4755-8f2f-a6ded07c71b9 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:50.330339 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-211705fb-9d3b-4755-8f2f-a6ded07c71b9 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1729 microversion: 2.1 time: 0.157578 Jul 20 05:16:50.330878 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3590/7079] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:50 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:51.347497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f5a00f8b-6c1a-485f-a8f4-9c81a3a03a4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:51.348143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f5a00f8b-6c1a-485f-a8f4-9c81a3a03a4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:51.355685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5a00f8b-6c1a-485f-a8f4-9c81a3a03a4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:51.356139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5a00f8b-6c1a-485f-a8f4-9c81a3a03a4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:51.356915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5a00f8b-6c1a-485f-a8f4-9c81a3a03a4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:51.357360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5a00f8b-6c1a-485f-a8f4-9c81a3a03a4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:51.489865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f5a00f8b-6c1a-485f-a8f4-9c81a3a03a4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:51.502434 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f5a00f8b-6c1a-485f-a8f4-9c81a3a03a4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1729 microversion: 2.1 time: 0.158540 Jul 20 05:16:51.503024 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3490/7080] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:51 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:52.519869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b9bace0d-0477-418c-a3fb-6949ecc06cf3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:52.520501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b9bace0d-0477-418c-a3fb-6949ecc06cf3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:52.527867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9bace0d-0477-418c-a3fb-6949ecc06cf3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:52.528329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9bace0d-0477-418c-a3fb-6949ecc06cf3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:52.529112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9bace0d-0477-418c-a3fb-6949ecc06cf3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:52.529554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b9bace0d-0477-418c-a3fb-6949ecc06cf3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:52.675468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b9bace0d-0477-418c-a3fb-6949ecc06cf3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:52.684932 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b9bace0d-0477-418c-a3fb-6949ecc06cf3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1729 microversion: 2.1 time: 0.168948 Jul 20 05:16:52.685555 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3591/7081] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:52 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:53.396431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d2ca4e9e-854e-4031-af8a-1e8365d3cc68 req-4d5bf5ad-9e0c-4e1b-9bbd-ff8456cb48f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579c5d40-093e-4a4b-a73b-cb96ce33c050", "name": "network-vif-unplugged", "status": "completed", "tag": "8cc13e48-08fc-4276-83b1-90a8081ef300"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:53.405779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d2ca4e9e-854e-4031-af8a-1e8365d3cc68 req-4d5bf5ad-9e0c-4e1b-9bbd-ff8456cb48f0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:53.406238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d2ca4e9e-854e-4031-af8a-1e8365d3cc68 req-4d5bf5ad-9e0c-4e1b-9bbd-ff8456cb48f0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:53.418179 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d2ca4e9e-854e-4031-af8a-1e8365d3cc68 req-4d5bf5ad-9e0c-4e1b-9bbd-ff8456cb48f0 service nova] Creating event network-vif-unplugged:8cc13e48-08fc-4276-83b1-90a8081ef300 for instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 on n-h2-764485-11 Jul 20 05:16:53.423581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-d2ca4e9e-854e-4031-af8a-1e8365d3cc68 req-4d5bf5ad-9e0c-4e1b-9bbd-ff8456cb48f0 service nova] Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:16:53.435400 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d2ca4e9e-854e-4031-af8a-1e8365d3cc68 req-4d5bf5ad-9e0c-4e1b-9bbd-ff8456cb48f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042792 Jul 20 05:16:53.436100 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3491/7082] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:53.702767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2decd6cd-0fa1-4df9-8163-38b9696c203b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:53.703448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2decd6cd-0fa1-4df9-8163-38b9696c203b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:53.710491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2decd6cd-0fa1-4df9-8163-38b9696c203b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:53.711717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2decd6cd-0fa1-4df9-8163-38b9696c203b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:53.712406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2decd6cd-0fa1-4df9-8163-38b9696c203b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:53.712915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2decd6cd-0fa1-4df9-8163-38b9696c203b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:53.927882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2decd6cd-0fa1-4df9-8163-38b9696c203b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:53.941200 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2decd6cd-0fa1-4df9-8163-38b9696c203b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1728 microversion: 2.1 time: 0.241490 Jul 20 05:16:53.942080 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3592/7083] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:53 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:54.962114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e2c4f9a3-9e34-4f20-9f17-ca6a0a7c6f49 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:54.962699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e2c4f9a3-9e34-4f20-9f17-ca6a0a7c6f49 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:54.969236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2c4f9a3-9e34-4f20-9f17-ca6a0a7c6f49 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:54.969699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2c4f9a3-9e34-4f20-9f17-ca6a0a7c6f49 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:54.970475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2c4f9a3-9e34-4f20-9f17-ca6a0a7c6f49 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:54.970922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e2c4f9a3-9e34-4f20-9f17-ca6a0a7c6f49 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:55.113023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e2c4f9a3-9e34-4f20-9f17-ca6a0a7c6f49 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:55.121766 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e2c4f9a3-9e34-4f20-9f17-ca6a0a7c6f49 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1726 microversion: 2.1 time: 0.165491 Jul 20 05:16:55.122348 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3492/7084] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:54 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:55.452930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-404270ce-717b-488e-9689-2e565fd289fd req-6a7f5768-05ce-4271-8d45-a5b2c43d6461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579c5d40-093e-4a4b-a73b-cb96ce33c050", "tag": "8cc13e48-08fc-4276-83b1-90a8081ef300"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:55.463866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-404270ce-717b-488e-9689-2e565fd289fd req-6a7f5768-05ce-4271-8d45-a5b2c43d6461 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:55.464490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-404270ce-717b-488e-9689-2e565fd289fd req-6a7f5768-05ce-4271-8d45-a5b2c43d6461 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:55.477635 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-404270ce-717b-488e-9689-2e565fd289fd req-6a7f5768-05ce-4271-8d45-a5b2c43d6461 service nova] Creating event network-changed:8cc13e48-08fc-4276-83b1-90a8081ef300 for instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 on n-h2-764485-11 Jul 20 05:16:55.484019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-404270ce-717b-488e-9689-2e565fd289fd req-6a7f5768-05ce-4271-8d45-a5b2c43d6461 service nova] Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:16:55.499842 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-404270ce-717b-488e-9689-2e565fd289fd req-6a7f5768-05ce-4271-8d45-a5b2c43d6461 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050440 Jul 20 05:16:55.500770 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3593/7085] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:56.139577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-afaabcaf-6cad-40df-8e94-0fdcb5e260ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:56.140907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-afaabcaf-6cad-40df-8e94-0fdcb5e260ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:56.148139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-afaabcaf-6cad-40df-8e94-0fdcb5e260ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:56.148728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-afaabcaf-6cad-40df-8e94-0fdcb5e260ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:56.149521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-afaabcaf-6cad-40df-8e94-0fdcb5e260ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:56.149968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-afaabcaf-6cad-40df-8e94-0fdcb5e260ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:56.456639 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-afaabcaf-6cad-40df-8e94-0fdcb5e260ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:56.467230 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-afaabcaf-6cad-40df-8e94-0fdcb5e260ca tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1726 microversion: 2.1 time: 0.331612 Jul 20 05:16:56.477437 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3493/7086] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:56 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1726 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:57.486136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e032929b-f8c2-4308-a086-0ba790aca175 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:57.486767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e032929b-f8c2-4308-a086-0ba790aca175 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:57.494938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e032929b-f8c2-4308-a086-0ba790aca175 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:57.495400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e032929b-f8c2-4308-a086-0ba790aca175 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:57.496207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e032929b-f8c2-4308-a086-0ba790aca175 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:57.496659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e032929b-f8c2-4308-a086-0ba790aca175 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:57.641292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e032929b-f8c2-4308-a086-0ba790aca175 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:57.649906 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e032929b-f8c2-4308-a086-0ba790aca175 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1726 microversion: 2.1 time: 0.167995 Jul 20 05:16:57.650648 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3594/7087] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:57 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:58.666527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7d270bc7-a000-4bb8-9139-cc282755f384 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:58.667071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7d270bc7-a000-4bb8-9139-cc282755f384 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:58.674154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d270bc7-a000-4bb8-9139-cc282755f384 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:58.674541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d270bc7-a000-4bb8-9139-cc282755f384 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:58.675312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d270bc7-a000-4bb8-9139-cc282755f384 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:58.675783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7d270bc7-a000-4bb8-9139-cc282755f384 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:58.808313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7d270bc7-a000-4bb8-9139-cc282755f384 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:58.817401 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7d270bc7-a000-4bb8-9139-cc282755f384 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1726 microversion: 2.1 time: 0.155045 Jul 20 05:16:58.817985 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3494/7088] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:58 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:59.834822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4504f894-1300-467e-a43d-659665580bf7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:59.835454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4504f894-1300-467e-a43d-659665580bf7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:59.842663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4504f894-1300-467e-a43d-659665580bf7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:59.843130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4504f894-1300-467e-a43d-659665580bf7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:59.843944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4504f894-1300-467e-a43d-659665580bf7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:59.844403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4504f894-1300-467e-a43d-659665580bf7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:59.973687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4504f894-1300-467e-a43d-659665580bf7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:59.982175 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4504f894-1300-467e-a43d-659665580bf7 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1726 microversion: 2.1 time: 0.151341 Jul 20 05:16:59.982749 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3595/7089] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:59 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:01.000223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3b55f2b3-50df-47b0-ab40-1eee2bc3a045 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:01.000841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3b55f2b3-50df-47b0-ab40-1eee2bc3a045 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:01.008305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b55f2b3-50df-47b0-ab40-1eee2bc3a045 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:01.008779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b55f2b3-50df-47b0-ab40-1eee2bc3a045 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:01.009542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b55f2b3-50df-47b0-ab40-1eee2bc3a045 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:01.009976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b55f2b3-50df-47b0-ab40-1eee2bc3a045 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:01.145632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3b55f2b3-50df-47b0-ab40-1eee2bc3a045 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:01.154596 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3b55f2b3-50df-47b0-ab40-1eee2bc3a045 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1726 microversion: 2.1 time: 0.159072 Jul 20 05:17:01.155176 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3495/7090] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:00 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:02.171039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4a2ff1fd-8abe-4313-8187-ea80605af62f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:02.171696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4a2ff1fd-8abe-4313-8187-ea80605af62f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:02.178591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a2ff1fd-8abe-4313-8187-ea80605af62f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:02.179053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a2ff1fd-8abe-4313-8187-ea80605af62f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:02.180554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a2ff1fd-8abe-4313-8187-ea80605af62f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:02.181006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4a2ff1fd-8abe-4313-8187-ea80605af62f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:02.312548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4a2ff1fd-8abe-4313-8187-ea80605af62f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:02.321392 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4a2ff1fd-8abe-4313-8187-ea80605af62f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1726 microversion: 2.1 time: 0.154171 Jul 20 05:17:02.321970 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3596/7091] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:02 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:03.338456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c9d2eff7-7dd4-4e68-903e-a229aed49c69 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:03.339096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c9d2eff7-7dd4-4e68-903e-a229aed49c69 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:03.346160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9d2eff7-7dd4-4e68-903e-a229aed49c69 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:03.346617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9d2eff7-7dd4-4e68-903e-a229aed49c69 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:03.347395 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9d2eff7-7dd4-4e68-903e-a229aed49c69 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:03.347867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9d2eff7-7dd4-4e68-903e-a229aed49c69 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:03.483607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c9d2eff7-7dd4-4e68-903e-a229aed49c69 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:03.493021 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c9d2eff7-7dd4-4e68-903e-a229aed49c69 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1726 microversion: 2.1 time: 0.157756 Jul 20 05:17:03.493760 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3496/7092] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:03 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:04.510568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2878882b-c30f-436c-a9a0-649b9d6c3e4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:04.511192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2878882b-c30f-436c-a9a0-649b9d6c3e4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:04.518041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2878882b-c30f-436c-a9a0-649b9d6c3e4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:04.518502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2878882b-c30f-436c-a9a0-649b9d6c3e4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:04.519268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2878882b-c30f-436c-a9a0-649b9d6c3e4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:04.519745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2878882b-c30f-436c-a9a0-649b9d6c3e4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:04.652355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2878882b-c30f-436c-a9a0-649b9d6c3e4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:04.660358 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2878882b-c30f-436c-a9a0-649b9d6c3e4b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1726 microversion: 2.1 time: 0.154078 Jul 20 05:17:04.660982 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3597/7093] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:04 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:05.678156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-de4e3783-5f66-467c-ab7d-bf17af4693e2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:05.678769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-de4e3783-5f66-467c-ab7d-bf17af4693e2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:05.686263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de4e3783-5f66-467c-ab7d-bf17af4693e2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:05.686716 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de4e3783-5f66-467c-ab7d-bf17af4693e2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:05.687471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de4e3783-5f66-467c-ab7d-bf17af4693e2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:05.687931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de4e3783-5f66-467c-ab7d-bf17af4693e2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:05.826334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-de4e3783-5f66-467c-ab7d-bf17af4693e2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:05.834415 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-de4e3783-5f66-467c-ab7d-bf17af4693e2 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1726 microversion: 2.1 time: 0.160194 Jul 20 05:17:05.835000 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3497/7094] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:05 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:06.853131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f664e08b-c9e3-4dfb-9330-8fba707fe2ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:06.853762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f664e08b-c9e3-4dfb-9330-8fba707fe2ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:06.856593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=33 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:06.862075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f664e08b-c9e3-4dfb-9330-8fba707fe2ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:06.862793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f664e08b-c9e3-4dfb-9330-8fba707fe2ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:06.863604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f664e08b-c9e3-4dfb-9330-8fba707fe2ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:06.864062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f664e08b-c9e3-4dfb-9330-8fba707fe2ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:06.866808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:07.005471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f664e08b-c9e3-4dfb-9330-8fba707fe2ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:07.014241 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f664e08b-c9e3-4dfb-9330-8fba707fe2ba tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1726 microversion: 2.1 time: 0.166157 Jul 20 05:17:07.014827 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3598/7095] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:06 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:08.031133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9bf45123-674b-4a90-85c3-aa3ae119b1f8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:08.031810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9bf45123-674b-4a90-85c3-aa3ae119b1f8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:08.034818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=29 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:08.040958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9bf45123-674b-4a90-85c3-aa3ae119b1f8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:08.041408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9bf45123-674b-4a90-85c3-aa3ae119b1f8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:08.042172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9bf45123-674b-4a90-85c3-aa3ae119b1f8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:08.042607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9bf45123-674b-4a90-85c3-aa3ae119b1f8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:08.045678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=83 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:08.174820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9bf45123-674b-4a90-85c3-aa3ae119b1f8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:08.183999 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9bf45123-674b-4a90-85c3-aa3ae119b1f8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1726 microversion: 2.1 time: 0.156590 Jul 20 05:17:08.184587 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3498/7096] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:08 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:09.202370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2d4dd634-7de1-4735-9ecf-5a265b9be3d3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:09.203002 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2d4dd634-7de1-4735-9ecf-5a265b9be3d3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:09.209511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d4dd634-7de1-4735-9ecf-5a265b9be3d3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:09.209970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d4dd634-7de1-4735-9ecf-5a265b9be3d3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:09.210946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d4dd634-7de1-4735-9ecf-5a265b9be3d3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:09.211328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2d4dd634-7de1-4735-9ecf-5a265b9be3d3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:09.347697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2d4dd634-7de1-4735-9ecf-5a265b9be3d3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:09.357143 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2d4dd634-7de1-4735-9ecf-5a265b9be3d3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1723 microversion: 2.1 time: 0.158851 Jul 20 05:17:09.357723 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3599/7097] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:09 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:09.374245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:09.374784 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:09.381658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:09.382108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:09.383115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:09.383580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:09.424007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:09.424464 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:09.425255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:09.425692 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:09.446930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'cores', 'ram'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:17:09.452378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Getting quotas for user 515b90b9f91e47719155e3d2448cd0dd and project 7e53df6a2acf4cf9b808649c2cd30ca6. Resources: {'cores', 'ram'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:17:09.561403 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1f2f8351-bd7a-47f9-8516-9c62961e314b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "POST /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050/action" status: 202 len: 0 microversion: 2.1 time: 0.190809 Jul 20 05:17:09.562090 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3499/7098] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:17:09 2022] POST /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:17:09.571359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ca847cb6-fd2f-4c6b-bb0b-a45b25932855 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:09.572234 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca847cb6-fd2f-4c6b-bb0b-a45b25932855 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:09.579331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca847cb6-fd2f-4c6b-bb0b-a45b25932855 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:09.579933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca847cb6-fd2f-4c6b-bb0b-a45b25932855 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:09.580839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca847cb6-fd2f-4c6b-bb0b-a45b25932855 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:09.581340 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca847cb6-fd2f-4c6b-bb0b-a45b25932855 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:09.795727 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ca847cb6-fd2f-4c6b-bb0b-a45b25932855 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:09.804056 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ca847cb6-fd2f-4c6b-bb0b-a45b25932855 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.237371 Jul 20 05:17:09.804685 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3600/7099] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:09 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:10.822469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-349fc1e4-0c23-42e5-aa92-f2191ac47d75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:10.823182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-349fc1e4-0c23-42e5-aa92-f2191ac47d75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:10.830380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-349fc1e4-0c23-42e5-aa92-f2191ac47d75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:10.830838 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-349fc1e4-0c23-42e5-aa92-f2191ac47d75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:10.831625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-349fc1e4-0c23-42e5-aa92-f2191ac47d75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:10.832073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-349fc1e4-0c23-42e5-aa92-f2191ac47d75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:10.962440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-349fc1e4-0c23-42e5-aa92-f2191ac47d75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:10.970577 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-349fc1e4-0c23-42e5-aa92-f2191ac47d75 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.153570 Jul 20 05:17:10.971161 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3500/7100] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:10 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:11.684312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-88b005fa-d34a-4eef-b288-b9a44cd89e4f req-b1380ec3-8adb-4e81-9de3-618c769b558e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579c5d40-093e-4a4b-a73b-cb96ce33c050", "name": "network-vif-plugged", "status": "completed", "tag": "8cc13e48-08fc-4276-83b1-90a8081ef300"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:11.695129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-88b005fa-d34a-4eef-b288-b9a44cd89e4f req-b1380ec3-8adb-4e81-9de3-618c769b558e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:11.696580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-88b005fa-d34a-4eef-b288-b9a44cd89e4f req-b1380ec3-8adb-4e81-9de3-618c769b558e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:11.708618 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-88b005fa-d34a-4eef-b288-b9a44cd89e4f req-b1380ec3-8adb-4e81-9de3-618c769b558e service nova] Creating event network-vif-plugged:8cc13e48-08fc-4276-83b1-90a8081ef300 for instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 on n-h2-764485-11 Jul 20 05:17:11.714638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-88b005fa-d34a-4eef-b288-b9a44cd89e4f req-b1380ec3-8adb-4e81-9de3-618c769b558e service nova] Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:17:11.726322 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-88b005fa-d34a-4eef-b288-b9a44cd89e4f req-b1380ec3-8adb-4e81-9de3-618c769b558e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046726 Jul 20 05:17:11.727621 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3601/7101] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:11.989200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-64cf3fef-9d8a-412e-8e1d-739d6a651c3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:11.989751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-64cf3fef-9d8a-412e-8e1d-739d6a651c3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:11.997300 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64cf3fef-9d8a-412e-8e1d-739d6a651c3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:11.997756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64cf3fef-9d8a-412e-8e1d-739d6a651c3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:11.998555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64cf3fef-9d8a-412e-8e1d-739d6a651c3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:11.999001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-64cf3fef-9d8a-412e-8e1d-739d6a651c3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:12.134214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-64cf3fef-9d8a-412e-8e1d-739d6a651c3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:12.142460 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-64cf3fef-9d8a-412e-8e1d-739d6a651c3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.157531 Jul 20 05:17:12.143070 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3501/7102] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:11 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:13.162532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-17d7880a-c511-4733-8310-3db67b8a83e3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:13.163438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-17d7880a-c511-4733-8310-3db67b8a83e3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:13.173534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17d7880a-c511-4733-8310-3db67b8a83e3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:13.174316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17d7880a-c511-4733-8310-3db67b8a83e3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:13.175307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17d7880a-c511-4733-8310-3db67b8a83e3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:13.175804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17d7880a-c511-4733-8310-3db67b8a83e3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:13.331618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-17d7880a-c511-4733-8310-3db67b8a83e3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:13.341170 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-17d7880a-c511-4733-8310-3db67b8a83e3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.184482 Jul 20 05:17:13.342047 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3602/7103] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:13 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:14.358801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-40a34914-3c60-43eb-96ea-d37a6415cea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:14.359322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-40a34914-3c60-43eb-96ea-d37a6415cea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:14.366521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40a34914-3c60-43eb-96ea-d37a6415cea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:14.366973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40a34914-3c60-43eb-96ea-d37a6415cea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:14.368344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40a34914-3c60-43eb-96ea-d37a6415cea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:14.368783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-40a34914-3c60-43eb-96ea-d37a6415cea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:14.497833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-40a34914-3c60-43eb-96ea-d37a6415cea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:14.506046 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-40a34914-3c60-43eb-96ea-d37a6415cea8 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.151203 Jul 20 05:17:14.506632 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3502/7104] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:14 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:15.223945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-284ef46e-ca8e-4ec8-b9fc-a97171f70e09 req-cf50567f-c692-43b7-880f-f21372d6e3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579c5d40-093e-4a4b-a73b-cb96ce33c050", "name": "network-vif-unplugged", "status": "completed", "tag": "8cc13e48-08fc-4276-83b1-90a8081ef300"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:15.233497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-284ef46e-ca8e-4ec8-b9fc-a97171f70e09 req-cf50567f-c692-43b7-880f-f21372d6e3ac service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:15.233627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-284ef46e-ca8e-4ec8-b9fc-a97171f70e09 req-cf50567f-c692-43b7-880f-f21372d6e3ac service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:15.249094 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-284ef46e-ca8e-4ec8-b9fc-a97171f70e09 req-cf50567f-c692-43b7-880f-f21372d6e3ac service nova] Creating event network-vif-unplugged:8cc13e48-08fc-4276-83b1-90a8081ef300 for instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 on n-h1-764485-11 Jul 20 05:17:15.254670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-284ef46e-ca8e-4ec8-b9fc-a97171f70e09 req-cf50567f-c692-43b7-880f-f21372d6e3ac service nova] Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:17:15.266222 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-284ef46e-ca8e-4ec8-b9fc-a97171f70e09 req-cf50567f-c692-43b7-880f-f21372d6e3ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046275 Jul 20 05:17:15.266851 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3603/7105] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:15.524594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-51aea7e1-eade-4fca-bc42-d391417abc3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:15.525571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-51aea7e1-eade-4fca-bc42-d391417abc3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:15.532611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51aea7e1-eade-4fca-bc42-d391417abc3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:15.533144 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51aea7e1-eade-4fca-bc42-d391417abc3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:15.534116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51aea7e1-eade-4fca-bc42-d391417abc3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:15.534560 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-51aea7e1-eade-4fca-bc42-d391417abc3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:15.771128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-51aea7e1-eade-4fca-bc42-d391417abc3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:15.783597 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-51aea7e1-eade-4fca-bc42-d391417abc3b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.262966 Jul 20 05:17:15.787457 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3503/7106] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:15 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:16.803376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4aacd437-f9bb-4566-bd10-a3fa39e7fa8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:16.804276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4aacd437-f9bb-4566-bd10-a3fa39e7fa8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:16.811120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aacd437-f9bb-4566-bd10-a3fa39e7fa8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:16.811693 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aacd437-f9bb-4566-bd10-a3fa39e7fa8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:16.812479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aacd437-f9bb-4566-bd10-a3fa39e7fa8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:16.812932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aacd437-f9bb-4566-bd10-a3fa39e7fa8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:16.953592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4aacd437-f9bb-4566-bd10-a3fa39e7fa8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:16.962746 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4aacd437-f9bb-4566-bd10-a3fa39e7fa8a tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.164382 Jul 20 05:17:16.963344 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3604/7107] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:16 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:17.282513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6271f354-6acd-4dc6-909c-05b00fdcead3 req-7dc35826-b980-45ce-aed3-1c6f7816ac0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579c5d40-093e-4a4b-a73b-cb96ce33c050", "tag": "8cc13e48-08fc-4276-83b1-90a8081ef300"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:17.292377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6271f354-6acd-4dc6-909c-05b00fdcead3 req-7dc35826-b980-45ce-aed3-1c6f7816ac0e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:17.292822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6271f354-6acd-4dc6-909c-05b00fdcead3 req-7dc35826-b980-45ce-aed3-1c6f7816ac0e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:17.305531 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-6271f354-6acd-4dc6-909c-05b00fdcead3 req-7dc35826-b980-45ce-aed3-1c6f7816ac0e service nova] Creating event network-changed:8cc13e48-08fc-4276-83b1-90a8081ef300 for instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 on n-h1-764485-11 Jul 20 05:17:17.311193 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-6271f354-6acd-4dc6-909c-05b00fdcead3 req-7dc35826-b980-45ce-aed3-1c6f7816ac0e service nova] Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:17:17.323400 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6271f354-6acd-4dc6-909c-05b00fdcead3 req-7dc35826-b980-45ce-aed3-1c6f7816ac0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044774 Jul 20 05:17:17.324449 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3504/7108] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:17.981962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d4609a45-ab9b-4209-a59f-364d189a4cdd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:17.982528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d4609a45-ab9b-4209-a59f-364d189a4cdd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:17.989718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4609a45-ab9b-4209-a59f-364d189a4cdd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:17.990128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4609a45-ab9b-4209-a59f-364d189a4cdd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:17.990919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4609a45-ab9b-4209-a59f-364d189a4cdd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:17.991377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d4609a45-ab9b-4209-a59f-364d189a4cdd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:18.245128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d4609a45-ab9b-4209-a59f-364d189a4cdd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:18.253829 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d4609a45-ab9b-4209-a59f-364d189a4cdd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.277483 Jul 20 05:17:18.254570 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3605/7109] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:17 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:19.273980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5e8e8a99-e450-4943-b6b8-1b2cfc25bc15 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:19.275420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5e8e8a99-e450-4943-b6b8-1b2cfc25bc15 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:19.282730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e8e8a99-e450-4943-b6b8-1b2cfc25bc15 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:19.283184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e8e8a99-e450-4943-b6b8-1b2cfc25bc15 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:19.283981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e8e8a99-e450-4943-b6b8-1b2cfc25bc15 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:19.284424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5e8e8a99-e450-4943-b6b8-1b2cfc25bc15 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:19.435156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5e8e8a99-e450-4943-b6b8-1b2cfc25bc15 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:19.437528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:19.445279 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5e8e8a99-e450-4943-b6b8-1b2cfc25bc15 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.175909 Jul 20 05:17:19.445865 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3505/7110] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:19 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:20.463395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ebb913bf-c36d-49e9-939c-8a6e07b79b18 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:20.463983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ebb913bf-c36d-49e9-939c-8a6e07b79b18 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:20.471231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ebb913bf-c36d-49e9-939c-8a6e07b79b18 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:20.471756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ebb913bf-c36d-49e9-939c-8a6e07b79b18 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:20.472545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ebb913bf-c36d-49e9-939c-8a6e07b79b18 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:20.473005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ebb913bf-c36d-49e9-939c-8a6e07b79b18 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:20.611153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ebb913bf-c36d-49e9-939c-8a6e07b79b18 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:20.620308 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ebb913bf-c36d-49e9-939c-8a6e07b79b18 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.161676 Jul 20 05:17:20.620893 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3606/7111] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:20 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:21.637726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ed4bfaa0-074d-43c4-b187-4fa67b9b63d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:21.638335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ed4bfaa0-074d-43c4-b187-4fa67b9b63d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:21.645583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed4bfaa0-074d-43c4-b187-4fa67b9b63d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:21.646031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed4bfaa0-074d-43c4-b187-4fa67b9b63d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:21.646796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed4bfaa0-074d-43c4-b187-4fa67b9b63d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:21.647230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ed4bfaa0-074d-43c4-b187-4fa67b9b63d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:21.777139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ed4bfaa0-074d-43c4-b187-4fa67b9b63d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:21.785289 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ed4bfaa0-074d-43c4-b187-4fa67b9b63d6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.151488 Jul 20 05:17:21.785875 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3506/7112] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:21 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:22.802470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-821ab2f4-07f7-490b-8d09-adbe4a85522e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:22.803101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-821ab2f4-07f7-490b-8d09-adbe4a85522e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:22.810632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-821ab2f4-07f7-490b-8d09-adbe4a85522e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:22.811094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-821ab2f4-07f7-490b-8d09-adbe4a85522e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:22.811886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-821ab2f4-07f7-490b-8d09-adbe4a85522e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:22.812341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-821ab2f4-07f7-490b-8d09-adbe4a85522e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:22.943826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-821ab2f4-07f7-490b-8d09-adbe4a85522e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:22.952357 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-821ab2f4-07f7-490b-8d09-adbe4a85522e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.153771 Jul 20 05:17:22.952938 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3607/7113] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:22 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:23.970134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ca52a97a-1187-4b31-8725-4673e10b7f74 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:23.970745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ca52a97a-1187-4b31-8725-4673e10b7f74 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:23.978455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ca52a97a-1187-4b31-8725-4673e10b7f74 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:23.978905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ca52a97a-1187-4b31-8725-4673e10b7f74 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:23.979750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ca52a97a-1187-4b31-8725-4673e10b7f74 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:23.980187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ca52a97a-1187-4b31-8725-4673e10b7f74 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:24.110294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ca52a97a-1187-4b31-8725-4673e10b7f74 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:24.119221 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ca52a97a-1187-4b31-8725-4673e10b7f74 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.152959 Jul 20 05:17:24.119817 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3507/7114] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:23 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:25.137481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dffd7943-d20b-4027-873e-6a8ed42e94f5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:25.138072 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dffd7943-d20b-4027-873e-6a8ed42e94f5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:25.145034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dffd7943-d20b-4027-873e-6a8ed42e94f5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:25.145506 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dffd7943-d20b-4027-873e-6a8ed42e94f5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:25.146287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dffd7943-d20b-4027-873e-6a8ed42e94f5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:25.146748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dffd7943-d20b-4027-873e-6a8ed42e94f5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:25.284511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dffd7943-d20b-4027-873e-6a8ed42e94f5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:25.293267 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dffd7943-d20b-4027-873e-6a8ed42e94f5 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.160767 Jul 20 05:17:25.293852 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3608/7115] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:25 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:26.312113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2637543f-8568-4563-b34d-563ad5aa5b6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:26.312764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2637543f-8568-4563-b34d-563ad5aa5b6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:26.319705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2637543f-8568-4563-b34d-563ad5aa5b6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:26.320859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2637543f-8568-4563-b34d-563ad5aa5b6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:26.321718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2637543f-8568-4563-b34d-563ad5aa5b6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:26.322161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2637543f-8568-4563-b34d-563ad5aa5b6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:26.454133 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2637543f-8568-4563-b34d-563ad5aa5b6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:26.462547 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2637543f-8568-4563-b34d-563ad5aa5b6c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.154354 Jul 20 05:17:26.463150 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3508/7116] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:26 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:27.480644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c0cb0ab1-183c-4f44-ad75-76f567c27df6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:27.481288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c0cb0ab1-183c-4f44-ad75-76f567c27df6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:27.488965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0cb0ab1-183c-4f44-ad75-76f567c27df6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:27.489424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0cb0ab1-183c-4f44-ad75-76f567c27df6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:27.490211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0cb0ab1-183c-4f44-ad75-76f567c27df6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:27.490666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c0cb0ab1-183c-4f44-ad75-76f567c27df6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:27.629784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c0cb0ab1-183c-4f44-ad75-76f567c27df6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:27.637811 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c0cb0ab1-183c-4f44-ad75-76f567c27df6 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.161734 Jul 20 05:17:27.638389 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3609/7117] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:27 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:28.654721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f2661afd-77fe-4113-bf66-bb441ea2d196 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:28.655338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f2661afd-77fe-4113-bf66-bb441ea2d196 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:28.662531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f2661afd-77fe-4113-bf66-bb441ea2d196 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:28.663021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f2661afd-77fe-4113-bf66-bb441ea2d196 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:28.663919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f2661afd-77fe-4113-bf66-bb441ea2d196 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:28.664507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f2661afd-77fe-4113-bf66-bb441ea2d196 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:28.797806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f2661afd-77fe-4113-bf66-bb441ea2d196 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:28.806606 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f2661afd-77fe-4113-bf66-bb441ea2d196 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1722 microversion: 2.1 time: 0.155914 Jul 20 05:17:28.807184 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3509/7118] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:28 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:29.825780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b4cababc-3786-46fe-af68-bccdd69a798f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:29.826421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b4cababc-3786-46fe-af68-bccdd69a798f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:29.833981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4cababc-3786-46fe-af68-bccdd69a798f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:29.834444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4cababc-3786-46fe-af68-bccdd69a798f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:29.835237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4cababc-3786-46fe-af68-bccdd69a798f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:29.835726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b4cababc-3786-46fe-af68-bccdd69a798f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:29.975465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b4cababc-3786-46fe-af68-bccdd69a798f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:29.986088 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b4cababc-3786-46fe-af68-bccdd69a798f tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1715 microversion: 2.1 time: 0.165434 Jul 20 05:17:29.986680 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3610/7119] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:29 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:30.002911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3c09ca04-4997-4ad1-b388-6d28221cc0f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:30.003569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3c09ca04-4997-4ad1-b388-6d28221cc0f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:30.011585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c09ca04-4997-4ad1-b388-6d28221cc0f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:30.012042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c09ca04-4997-4ad1-b388-6d28221cc0f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:30.014769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c09ca04-4997-4ad1-b388-6d28221cc0f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:30.015223 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3c09ca04-4997-4ad1-b388-6d28221cc0f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:30.147979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3c09ca04-4997-4ad1-b388-6d28221cc0f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:30.156628 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3c09ca04-4997-4ad1-b388-6d28221cc0f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1715 microversion: 2.1 time: 0.157718 Jul 20 05:17:30.157514 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3510/7120] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:29 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:30.173752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f330e26c-6a99-4752-8399-d92b326a9b64 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:30.174377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f330e26c-6a99-4752-8399-d92b326a9b64 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:30.180547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f330e26c-6a99-4752-8399-d92b326a9b64 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:30.181140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f330e26c-6a99-4752-8399-d92b326a9b64 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:30.181923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f330e26c-6a99-4752-8399-d92b326a9b64 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:30.182373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f330e26c-6a99-4752-8399-d92b326a9b64 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:30.316883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f330e26c-6a99-4752-8399-d92b326a9b64 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:30.325453 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f330e26c-6a99-4752-8399-d92b326a9b64 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1715 microversion: 2.1 time: 0.155789 Jul 20 05:17:30.326037 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3611/7121] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:30 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:30.342936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-44a4ad0e-ad60-4353-b629-5e72f1270ab3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:30.343444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-44a4ad0e-ad60-4353-b629-5e72f1270ab3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:30.349652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44a4ad0e-ad60-4353-b629-5e72f1270ab3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:30.350105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44a4ad0e-ad60-4353-b629-5e72f1270ab3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:30.350872 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44a4ad0e-ad60-4353-b629-5e72f1270ab3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:30.351312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-44a4ad0e-ad60-4353-b629-5e72f1270ab3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:30.381027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-44a4ad0e-ad60-4353-b629-5e72f1270ab3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:17:30.396634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:30.464586 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-44a4ad0e-ad60-4353-b629-5e72f1270ab3 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "DELETE /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 204 len: 0 microversion: 2.1 time: 0.126118 Jul 20 05:17:30.469000 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3511/7122] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:17:30 2022] DELETE /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:17:30.473777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a7a3ffcc-5af9-4ffe-99ef-dc1d4ce7d447 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:30.474523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a7a3ffcc-5af9-4ffe-99ef-dc1d4ce7d447 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:30.481762 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7a3ffcc-5af9-4ffe-99ef-dc1d4ce7d447 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:30.482232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7a3ffcc-5af9-4ffe-99ef-dc1d4ce7d447 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:30.483019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7a3ffcc-5af9-4ffe-99ef-dc1d4ce7d447 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:30.483662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a7a3ffcc-5af9-4ffe-99ef-dc1d4ce7d447 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:30.619661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a7a3ffcc-5af9-4ffe-99ef-dc1d4ce7d447 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:30.627858 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a7a3ffcc-5af9-4ffe-99ef-dc1d4ce7d447 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1721 microversion: 2.1 time: 0.158080 Jul 20 05:17:30.628451 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3612/7123] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:30 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:31.646356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a904b38-7b02-4cb0-bbb8-23584b68384b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:31.647073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7a904b38-7b02-4cb0-bbb8-23584b68384b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:31.654043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a904b38-7b02-4cb0-bbb8-23584b68384b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:31.654499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a904b38-7b02-4cb0-bbb8-23584b68384b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:31.655283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a904b38-7b02-4cb0-bbb8-23584b68384b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:31.655761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a904b38-7b02-4cb0-bbb8-23584b68384b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:31.781675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6afeb6e6-605b-4664-aacc-edaec0a4e260 req-49f47be7-5bb6-459e-9efe-73163b03fa44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579c5d40-093e-4a4b-a73b-cb96ce33c050", "name": "network-vif-plugged", "status": "completed", "tag": "8cc13e48-08fc-4276-83b1-90a8081ef300"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:31.791726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6afeb6e6-605b-4664-aacc-edaec0a4e260 req-49f47be7-5bb6-459e-9efe-73163b03fa44 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:31.792187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6afeb6e6-605b-4664-aacc-edaec0a4e260 req-49f47be7-5bb6-459e-9efe-73163b03fa44 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:31.798047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7a904b38-7b02-4cb0-bbb8-23584b68384b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:31.805072 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6afeb6e6-605b-4664-aacc-edaec0a4e260 req-49f47be7-5bb6-459e-9efe-73163b03fa44 service nova] Creating event network-vif-plugged:8cc13e48-08fc-4276-83b1-90a8081ef300 for instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 on n-h1-764485-11 Jul 20 05:17:31.807361 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7a904b38-7b02-4cb0-bbb8-23584b68384b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1721 microversion: 2.1 time: 0.165336 Jul 20 05:17:31.808304 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3512/7124] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:31 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:31.819441 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6afeb6e6-605b-4664-aacc-edaec0a4e260 req-49f47be7-5bb6-459e-9efe-73163b03fa44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041976 Jul 20 05:17:31.820750 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3613/7125] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:32.825608 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7827fa7e-2a7b-4640-abc2-73649ae14ba4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:32.826357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7827fa7e-2a7b-4640-abc2-73649ae14ba4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:32.833173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7827fa7e-2a7b-4640-abc2-73649ae14ba4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:32.833621 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7827fa7e-2a7b-4640-abc2-73649ae14ba4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:32.834415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7827fa7e-2a7b-4640-abc2-73649ae14ba4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:32.834853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7827fa7e-2a7b-4640-abc2-73649ae14ba4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:32.919185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7827fa7e-2a7b-4640-abc2-73649ae14ba4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:32.928666 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7827fa7e-2a7b-4640-abc2-73649ae14ba4 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1654 microversion: 2.1 time: 0.106835 Jul 20 05:17:32.929529 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3513/7126] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:32 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1654 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:33.199066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-49422aef-153c-43d6-80c2-5d8a5e0d5e19 req-e9906981-ebfa-4627-869e-7952c504ec6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579c5d40-093e-4a4b-a73b-cb96ce33c050", "name": "network-vif-deleted", "tag": "8cc13e48-08fc-4276-83b1-90a8081ef300"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:33.210070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-49422aef-153c-43d6-80c2-5d8a5e0d5e19 req-e9906981-ebfa-4627-869e-7952c504ec6d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:33.210890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-49422aef-153c-43d6-80c2-5d8a5e0d5e19 req-e9906981-ebfa-4627-869e-7952c504ec6d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:33.224189 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-49422aef-153c-43d6-80c2-5d8a5e0d5e19 req-e9906981-ebfa-4627-869e-7952c504ec6d service nova] Creating event network-vif-deleted:8cc13e48-08fc-4276-83b1-90a8081ef300 for instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 on n-h1-764485-11 Jul 20 05:17:33.230028 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-49422aef-153c-43d6-80c2-5d8a5e0d5e19 req-e9906981-ebfa-4627-869e-7952c504ec6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035875 Jul 20 05:17:33.230902 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3614/7127] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:33.946900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-040731fc-0d12-4503-954e-35e57ac7f7c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:33.948548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-040731fc-0d12-4503-954e-35e57ac7f7c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:33.956075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-040731fc-0d12-4503-954e-35e57ac7f7c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:33.956841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-040731fc-0d12-4503-954e-35e57ac7f7c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:33.958206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-040731fc-0d12-4503-954e-35e57ac7f7c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:33.958863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-040731fc-0d12-4503-954e-35e57ac7f7c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:34.030920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-040731fc-0d12-4503-954e-35e57ac7f7c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:34.040637 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-040731fc-0d12-4503-954e-35e57ac7f7c1 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1369 microversion: 2.1 time: 0.098077 Jul 20 05:17:34.041257 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3514/7128] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:33 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:35.059107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cf8b4805-507e-4a47-8f22-ef844f38d745 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:35.059854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cf8b4805-507e-4a47-8f22-ef844f38d745 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:35.066180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf8b4805-507e-4a47-8f22-ef844f38d745 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:35.066669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf8b4805-507e-4a47-8f22-ef844f38d745 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:35.067439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf8b4805-507e-4a47-8f22-ef844f38d745 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:35.067925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cf8b4805-507e-4a47-8f22-ef844f38d745 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:35.130994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cf8b4805-507e-4a47-8f22-ef844f38d745 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:35.139834 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cf8b4805-507e-4a47-8f22-ef844f38d745 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1369 microversion: 2.1 time: 0.086097 Jul 20 05:17:35.140411 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3615/7129] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:35 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:36.157567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c5e428e0-41f4-487d-8369-085013b0e894 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:36.158189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c5e428e0-41f4-487d-8369-085013b0e894 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:36.165725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5e428e0-41f4-487d-8369-085013b0e894 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:36.166185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5e428e0-41f4-487d-8369-085013b0e894 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:36.166965 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5e428e0-41f4-487d-8369-085013b0e894 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:36.167410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c5e428e0-41f4-487d-8369-085013b0e894 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:36.231801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c5e428e0-41f4-487d-8369-085013b0e894 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:36.240372 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c5e428e0-41f4-487d-8369-085013b0e894 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1369 microversion: 2.1 time: 0.086662 Jul 20 05:17:36.240971 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3515/7130] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:36 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:37.259064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b5873d63-fbf4-4caf-97c2-927f92d66038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:37.259781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b5873d63-fbf4-4caf-97c2-927f92d66038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:37.262843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=36 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:37.268730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5873d63-fbf4-4caf-97c2-927f92d66038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:37.269202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5873d63-fbf4-4caf-97c2-927f92d66038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:37.270011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5873d63-fbf4-4caf-97c2-927f92d66038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:37.270470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5873d63-fbf4-4caf-97c2-927f92d66038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:37.274165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=96 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:37.340050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b5873d63-fbf4-4caf-97c2-927f92d66038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515b90b9f91e47719155e3d2448cd0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e53df6a2acf4cf9b808649c2cd30ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:37.349363 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b5873d63-fbf4-4caf-97c2-927f92d66038 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 200 len: 1369 microversion: 2.1 time: 0.094933 Jul 20 05:17:37.350368 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3616/7131] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:37 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:38.366590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ef06e073-b9ae-48cf-8517-54e3fa6fc667 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:38.367393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ef06e073-b9ae-48cf-8517-54e3fa6fc667 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:38.369950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:38.376479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef06e073-b9ae-48cf-8517-54e3fa6fc667 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:38.377020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef06e073-b9ae-48cf-8517-54e3fa6fc667 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:38.377790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef06e073-b9ae-48cf-8517-54e3fa6fc667 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:38.378230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef06e073-b9ae-48cf-8517-54e3fa6fc667 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:38.392554 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-ef06e073-b9ae-48cf-8517-54e3fa6fc667 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ef06e073-b9ae-48cf-8517-54e3fa6fc667 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 HTTP/1.1 Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '579c5d40-093e-4a4b-a73b-cb96ce33c050'} Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:38.394599 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:38.399294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:38.399294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:38.399294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:38.399294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:38.399294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:38.399294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:38.399294 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:38.399294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ef06e073-b9ae-48cf-8517-54e3fa6fc667 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:38.399294 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ef06e073-b9ae-48cf-8517-54e3fa6fc667 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 404 len: 111 microversion: 2.1 time: 0.033728 Jul 20 05:17:38.399294 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3516/7132] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:38 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:17:38.452241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f5621109-c77d-4a82-a820-5896a36e3901 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:38.453192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f5621109-c77d-4a82-a820-5896a36e3901 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:38.459721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f5621109-c77d-4a82-a820-5896a36e3901 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:38.460184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f5621109-c77d-4a82-a820-5896a36e3901 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:38.461486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f5621109-c77d-4a82-a820-5896a36e3901 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:38.462084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f5621109-c77d-4a82-a820-5896a36e3901 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:38.474908 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f5621109-c77d-4a82-a820-5896a36e3901 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f5621109-c77d-4a82-a820-5896a36e3901 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050/os-volume_attachments HTTP/1.1 Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'server_id': '579c5d40-093e-4a4b-a73b-cb96ce33c050'} Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:38.477193 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f5621109-c77d-4a82-a820-5896a36e3901 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f5621109-c77d-4a82-a820-5896a36e3901 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031075 Jul 20 05:17:38.480938 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3617/7133] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:38 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:17:41.780877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ccc9095f-a07a-4944-98fc-67418df0f5f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:41.781396 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ccc9095f-a07a-4944-98fc-67418df0f5f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:41.788600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ccc9095f-a07a-4944-98fc-67418df0f5f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.789064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ccc9095f-a07a-4944-98fc-67418df0f5f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.789846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ccc9095f-a07a-4944-98fc-67418df0f5f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.790289 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ccc9095f-a07a-4944-98fc-67418df0f5f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.804083 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-ccc9095f-a07a-4944-98fc-67418df0f5f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ccc9095f-a07a-4944-98fc-67418df0f5f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 HTTP/1.1 Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '579c5d40-093e-4a4b-a73b-cb96ce33c050'} Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:41.805705 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ccc9095f-a07a-4944-98fc-67418df0f5f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ccc9095f-a07a-4944-98fc-67418df0f5f0 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "DELETE /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 404 len: 111 microversion: 2.1 time: 0.030239 Jul 20 05:17:41.812695 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3517/7134] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:17:41 2022] DELETE /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:17:41.816092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9eb45da9-2bbb-41e0-8651-10e47d7cfe73 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:41.816729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9eb45da9-2bbb-41e0-8651-10e47d7cfe73 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 579c5d40-093e-4a4b-a73b-cb96ce33c050] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:41.824570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9eb45da9-2bbb-41e0-8651-10e47d7cfe73 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.825040 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9eb45da9-2bbb-41e0-8651-10e47d7cfe73 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.825823 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9eb45da9-2bbb-41e0-8651-10e47d7cfe73 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.826275 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9eb45da9-2bbb-41e0-8651-10e47d7cfe73 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.840403 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-9eb45da9-2bbb-41e0-8651-10e47d7cfe73 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9eb45da9-2bbb-41e0-8651-10e47d7cfe73 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 HTTP/1.1 Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '579c5d40-093e-4a4b-a73b-cb96ce33c050'} Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:41.842052 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.847998 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.847998 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:41.847998 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:41.847998 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:41.847998 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:41.847998 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. Jul 20 05:17:41.847998 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.847998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9eb45da9-2bbb-41e0-8651-10e47d7cfe73 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance 579c5d40-093e-4a4b-a73b-cb96ce33c050 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:41.847998 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9eb45da9-2bbb-41e0-8651-10e47d7cfe73 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050" status: 404 len: 111 microversion: 2.1 time: 0.031767 Jul 20 05:17:41.847998 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3618/7135] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:41 2022] GET /compute/v2.1/servers/579c5d40-093e-4a4b-a73b-cb96ce33c050 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:17:41.852406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-de86b93b-33d8-4d60-b3a9-0cda20575ccd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:41.852915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-de86b93b-33d8-4d60-b3a9-0cda20575ccd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:41.859012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de86b93b-33d8-4d60-b3a9-0cda20575ccd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.859463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de86b93b-33d8-4d60-b3a9-0cda20575ccd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.860270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de86b93b-33d8-4d60-b3a9-0cda20575ccd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.860712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de86b93b-33d8-4d60-b3a9-0cda20575ccd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.877853 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-de86b93b-33d8-4d60-b3a9-0cda20575ccd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-de86b93b-33d8-4d60-b3a9-0cda20575ccd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d HTTP/1.1 Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '5d8b08cd-305a-4b61-9b16-2ee895f3341d'} Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:41.879618 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-de86b93b-33d8-4d60-b3a9-0cda20575ccd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-de86b93b-33d8-4d60-b3a9-0cda20575ccd tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 404 len: 111 microversion: 2.1 time: 0.032836 Jul 20 05:17:41.883703 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3518/7136] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:17:41 2022] DELETE /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:17:41.890537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-63b8c11c-4280-4c83-a2ae-6a8ee4d60017 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:41.891151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-63b8c11c-4280-4c83-a2ae-6a8ee4d60017 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 5d8b08cd-305a-4b61-9b16-2ee895f3341d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:41.897265 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63b8c11c-4280-4c83-a2ae-6a8ee4d60017 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.897739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63b8c11c-4280-4c83-a2ae-6a8ee4d60017 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.899132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63b8c11c-4280-4c83-a2ae-6a8ee4d60017 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.899616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-63b8c11c-4280-4c83-a2ae-6a8ee4d60017 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.913472 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-63b8c11c-4280-4c83-a2ae-6a8ee4d60017 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-63b8c11c-4280-4c83-a2ae-6a8ee4d60017 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d HTTP/1.1 Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '5d8b08cd-305a-4b61-9b16-2ee895f3341d'} Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:41.915937 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.920740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.920740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:41.920740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:41.920740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:41.920740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:41.920740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. Jul 20 05:17:41.920740 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.920740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-63b8c11c-4280-4c83-a2ae-6a8ee4d60017 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance 5d8b08cd-305a-4b61-9b16-2ee895f3341d could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:41.920740 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-63b8c11c-4280-4c83-a2ae-6a8ee4d60017 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d" status: 404 len: 111 microversion: 2.1 time: 0.030874 Jul 20 05:17:41.920740 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3619/7137] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:41 2022] GET /compute/v2.1/servers/5d8b08cd-305a-4b61-9b16-2ee895f3341d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:17:41.927044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d9445c4d-baf4-44b6-ae71-9e2024228f4d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:41.927626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d9445c4d-baf4-44b6-ae71-9e2024228f4d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:41.934976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9445c4d-baf4-44b6-ae71-9e2024228f4d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.935421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9445c4d-baf4-44b6-ae71-9e2024228f4d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.936453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9445c4d-baf4-44b6-ae71-9e2024228f4d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.936895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d9445c4d-baf4-44b6-ae71-9e2024228f4d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.952656 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-d9445c4d-baf4-44b6-ae71-9e2024228f4d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d9445c4d-baf4-44b6-ae71-9e2024228f4d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 HTTP/1.1 Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '1602f176-9891-417a-a81a-076198fadb29'} Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:41.954255 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d9445c4d-baf4-44b6-ae71-9e2024228f4d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d9445c4d-baf4-44b6-ae71-9e2024228f4d tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 404 len: 111 microversion: 2.1 time: 0.032881 Jul 20 05:17:41.958492 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3519/7138] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:17:41 2022] DELETE /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:17:41.965899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-17f4d7dd-3803-4e3a-9e7e-dcb72fe3a27c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:41.966546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-17f4d7dd-3803-4e3a-9e7e-dcb72fe3a27c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: 1602f176-9891-417a-a81a-076198fadb29] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:41.973639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17f4d7dd-3803-4e3a-9e7e-dcb72fe3a27c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.974117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17f4d7dd-3803-4e3a-9e7e-dcb72fe3a27c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.975012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17f4d7dd-3803-4e3a-9e7e-dcb72fe3a27c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.975480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-17f4d7dd-3803-4e3a-9e7e-dcb72fe3a27c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.990333 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-17f4d7dd-3803-4e3a-9e7e-dcb72fe3a27c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-17f4d7dd-3803-4e3a-9e7e-dcb72fe3a27c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 HTTP/1.1 Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1602f176-9891-417a-a81a-076198fadb29'} Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:41.992007 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.997865 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:41.997865 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:41.997865 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:41.997865 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:41.997865 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:41.997865 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. Jul 20 05:17:41.997865 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:41.997865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-17f4d7dd-3803-4e3a-9e7e-dcb72fe3a27c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance 1602f176-9891-417a-a81a-076198fadb29 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:41.997865 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-17f4d7dd-3803-4e3a-9e7e-dcb72fe3a27c tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29" status: 404 len: 111 microversion: 2.1 time: 0.032885 Jul 20 05:17:41.997865 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3620/7139] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:41 2022] GET /compute/v2.1/servers/1602f176-9891-417a-a81a-076198fadb29 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:17:42.003894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5b598771-7338-4fe1-af22-b62fbedf659b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:42.004640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5b598771-7338-4fe1-af22-b62fbedf659b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:42.011304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b598771-7338-4fe1-af22-b62fbedf659b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:42.011797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b598771-7338-4fe1-af22-b62fbedf659b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:42.012582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b598771-7338-4fe1-af22-b62fbedf659b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:42.013026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5b598771-7338-4fe1-af22-b62fbedf659b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:42.026681 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-5b598771-7338-4fe1-af22-b62fbedf659b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5b598771-7338-4fe1-af22-b62fbedf659b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 HTTP/1.1 Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'bacf1b09-efe0-412c-b646-1bf88a8d3b94'} Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:42.028522 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5b598771-7338-4fe1-af22-b62fbedf659b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5b598771-7338-4fe1-af22-b62fbedf659b tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 404 len: 111 microversion: 2.1 time: 0.031091 Jul 20 05:17:42.032117 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3520/7140] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:17:41 2022] DELETE /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:17:42.038710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ef2fabaa-3577-4d30-a67a-9de3137ef886 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:42.039497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ef2fabaa-3577-4d30-a67a-9de3137ef886 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] [instance: bacf1b09-efe0-412c-b646-1bf88a8d3b94] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:42.045610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef2fabaa-3577-4d30-a67a-9de3137ef886 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:42.046052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef2fabaa-3577-4d30-a67a-9de3137ef886 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:42.046820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef2fabaa-3577-4d30-a67a-9de3137ef886 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:42.047276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ef2fabaa-3577-4d30-a67a-9de3137ef886 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:42.063412 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-ef2fabaa-3577-4d30-a67a-9de3137ef886 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] HTTP exception thrown: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ef2fabaa-3577-4d30-a67a-9de3137ef886 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Request method failure captured: Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 HTTP/1.1 Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi144Bk06CQWNoTgJGqiU9G1s3rQmya4IMRMkevEpcOTLasKj2mu_-TLJHcrUxvHIMvuUV7yc3q06NS9Ad8ubbOkE2QldIpGoWDyOSWUFKMAqhEqB4ifhUg05YuGEUmxnjyx2pwL5_RoXNxnKmbot7InfCyh33lHhjeoNrQZ5vkMzuJzc Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e53df6a2acf4cf9b808649c2cd30ca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e53df6a2acf4cf9b808649c2cd30ca6"}]}] Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 7e53df6a2acf4cf9b808649c2cd30ca6 Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1905122883 Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 515b90b9f91e47719155e3d2448cd0dd Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServerActionsTestJSON-1905122883-project Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'bacf1b09-efe0-412c-b646-1bf88a8d3b94'} Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:42.064985 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:42.072644 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:42.072644 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:42.072644 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:42.072644 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:42.072644 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:42.072644 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. Jul 20 05:17:42.072644 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:17:42.072644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ef2fabaa-3577-4d30-a67a-9de3137ef886 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Returning 404 to user: Instance bacf1b09-efe0-412c-b646-1bf88a8d3b94 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:42.072644 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ef2fabaa-3577-4d30-a67a-9de3137ef886 tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94" status: 404 len: 111 microversion: 2.1 time: 0.031600 Jul 20 05:17:42.072644 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3621/7141] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:42 2022] GET /compute/v2.1/servers/bacf1b09-efe0-412c-b646-1bf88a8d3b94 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:17:42.076217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3a6c3a6f-84b0-4e45-82e1-20d4da4a5d6e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] Calling method '.version_select at 0x7fbf9d15daf0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:42.098504 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3a6c3a6f-84b0-4e45-82e1-20d4da4a5d6e tempest-ServerActionsTestJSON-1905122883 tempest-ServerActionsTestJSON-1905122883-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049948118" status: 202 len: 0 microversion: 2.1 time: 0.026152 Jul 20 05:17:42.099088 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3521/7142] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Jul 20 05:17:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049948118 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:17:51.775734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2069281076", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "1eb77409-0b5f-4ff6-80c6-eb49c15a64b2"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:51.833406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] validate_networks() for [('1eb77409-0b5f-4ff6-80c6-eb49c15a64b2', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:17:52.052351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=15 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:52.262641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:17:52.263169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:17:52.263770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:17:52.264390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:17:52.265062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:17:52.278220 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:52.278874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:52.279739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:52.280201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:52.301414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Getting quotas for project 4fd2ceb878ad4078bba1afbf0d20a080. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:17:52.308972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Getting quotas for user 4d3d1ba1b85249318f84a02e2b6afdf6 and project 4fd2ceb878ad4078bba1afbf0d20a080. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:17:52.329898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:17:52.332250 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:17:52.384348 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-76fd53b1-4e3f-4a2d-9fed-547798f8a44f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735563 Jul 20 05:17:52.391282 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3622/7143] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:17:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:17:52.393592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:52.394264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:52.399603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59638765-6e6c-4018-ba8b-349f11112c33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:52.400975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-59638765-6e6c-4018-ba8b-349f11112c33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:52.479596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-59638765-6e6c-4018-ba8b-349f11112c33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:52.487095 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-59638765-6e6c-4018-ba8b-349f11112c33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1217 microversion: 2.1 time: 0.095423 Jul 20 05:17:52.488647 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3522/7144] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:52 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:53.506748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f7190376-2179-435d-8f6c-d065dc990b97 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:53.508147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f7190376-2179-435d-8f6c-d065dc990b97 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:53.514473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f7190376-2179-435d-8f6c-d065dc990b97 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:53.514986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f7190376-2179-435d-8f6c-d065dc990b97 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:53.516074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f7190376-2179-435d-8f6c-d065dc990b97 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:53.516862 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f7190376-2179-435d-8f6c-d065dc990b97 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:53.598197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f7190376-2179-435d-8f6c-d065dc990b97 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:53.612325 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f7190376-2179-435d-8f6c-d065dc990b97 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1275 microversion: 2.1 time: 0.110729 Jul 20 05:17:53.613963 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3623/7145] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:53 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:54.630590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2d036de0-29cb-4d94-a60c-cb5620004d28 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:54.632172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2d036de0-29cb-4d94-a60c-cb5620004d28 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:54.646130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d036de0-29cb-4d94-a60c-cb5620004d28 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:54.647038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d036de0-29cb-4d94-a60c-cb5620004d28 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:54.648684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d036de0-29cb-4d94-a60c-cb5620004d28 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:54.649284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2d036de0-29cb-4d94-a60c-cb5620004d28 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:54.873887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2d036de0-29cb-4d94-a60c-cb5620004d28 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:54.883101 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2d036de0-29cb-4d94-a60c-cb5620004d28 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1317 microversion: 2.1 time: 0.256635 Jul 20 05:17:54.894204 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3523/7146] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:54 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:55.251738 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-1fe21049-9382-466f-8892-176342c9cce8 req-499ecbc9-6363-4280-b284-05a5070abc97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea", "tag": "a8bb0202-17ec-4eaf-9dbb-484a4eca7dc2"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:55.261858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1fe21049-9382-466f-8892-176342c9cce8 req-499ecbc9-6363-4280-b284-05a5070abc97 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:55.262325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1fe21049-9382-466f-8892-176342c9cce8 req-499ecbc9-6363-4280-b284-05a5070abc97 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:55.274713 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-1fe21049-9382-466f-8892-176342c9cce8 req-499ecbc9-6363-4280-b284-05a5070abc97 service nova] Creating event network-changed:a8bb0202-17ec-4eaf-9dbb-484a4eca7dc2 for instance 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea on n-h2-764485-11 Jul 20 05:17:55.287474 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-1fe21049-9382-466f-8892-176342c9cce8 req-499ecbc9-6363-4280-b284-05a5070abc97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039418 Jul 20 05:17:55.288131 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3624/7147] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:55.901463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1a9b6b73-c04d-4bd5-9270-344802c3eed7 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:55.902078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1a9b6b73-c04d-4bd5-9270-344802c3eed7 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:55.909028 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a9b6b73-c04d-4bd5-9270-344802c3eed7 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:55.909481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a9b6b73-c04d-4bd5-9270-344802c3eed7 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:55.910313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a9b6b73-c04d-4bd5-9270-344802c3eed7 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:55.910759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a9b6b73-c04d-4bd5-9270-344802c3eed7 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:56.039054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1a9b6b73-c04d-4bd5-9270-344802c3eed7 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:56.046892 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1a9b6b73-c04d-4bd5-9270-344802c3eed7 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1317 microversion: 2.1 time: 0.150169 Jul 20 05:17:56.047464 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3524/7148] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:55 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:57.065083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-790357fa-ad47-449b-9adf-a2c895c84e2b tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:57.065825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-790357fa-ad47-449b-9adf-a2c895c84e2b tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:57.072806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-790357fa-ad47-449b-9adf-a2c895c84e2b tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:57.073270 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-790357fa-ad47-449b-9adf-a2c895c84e2b tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:57.074069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-790357fa-ad47-449b-9adf-a2c895c84e2b tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:57.074518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-790357fa-ad47-449b-9adf-a2c895c84e2b tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:57.208266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-790357fa-ad47-449b-9adf-a2c895c84e2b tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:57.215847 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-790357fa-ad47-449b-9adf-a2c895c84e2b tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1317 microversion: 2.1 time: 0.155820 Jul 20 05:17:57.216416 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3625/7149] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:57 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:58.233169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0ed296a2-1fa1-4de1-a734-11339987d9aa tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:58.233812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0ed296a2-1fa1-4de1-a734-11339987d9aa tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:58.242383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ed296a2-1fa1-4de1-a734-11339987d9aa tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:58.242996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ed296a2-1fa1-4de1-a734-11339987d9aa tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:58.243906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ed296a2-1fa1-4de1-a734-11339987d9aa tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:58.244346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0ed296a2-1fa1-4de1-a734-11339987d9aa tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:58.376111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0ed296a2-1fa1-4de1-a734-11339987d9aa tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:58.384149 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0ed296a2-1fa1-4de1-a734-11339987d9aa tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1317 microversion: 2.1 time: 0.154826 Jul 20 05:17:58.384726 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3525/7150] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:58 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:59.401382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0dd3de7f-b037-4961-86f1-f628a1eb0052 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:59.402018 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0dd3de7f-b037-4961-86f1-f628a1eb0052 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:59.408937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0dd3de7f-b037-4961-86f1-f628a1eb0052 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:59.409406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0dd3de7f-b037-4961-86f1-f628a1eb0052 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:59.410194 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0dd3de7f-b037-4961-86f1-f628a1eb0052 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:59.410654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0dd3de7f-b037-4961-86f1-f628a1eb0052 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:59.546251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0dd3de7f-b037-4961-86f1-f628a1eb0052 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:59.553823 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0dd3de7f-b037-4961-86f1-f628a1eb0052 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1317 microversion: 2.1 time: 0.156930 Jul 20 05:17:59.554626 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3626/7151] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:59 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:00.571485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59059f03-cbb2-404a-ae57-9eb66663a627 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:00.572242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-59059f03-cbb2-404a-ae57-9eb66663a627 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:00.580248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59059f03-cbb2-404a-ae57-9eb66663a627 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:00.580705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59059f03-cbb2-404a-ae57-9eb66663a627 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:00.581481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59059f03-cbb2-404a-ae57-9eb66663a627 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:00.581919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59059f03-cbb2-404a-ae57-9eb66663a627 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:00.715376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-59059f03-cbb2-404a-ae57-9eb66663a627 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:00.723039 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-59059f03-cbb2-404a-ae57-9eb66663a627 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1317 microversion: 2.1 time: 0.155589 Jul 20 05:18:00.723644 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3526/7152] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:00 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:01.740966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c96f33b-30d6-458a-b160-27c04045c46c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:01.741603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8c96f33b-30d6-458a-b160-27c04045c46c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:01.749014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c96f33b-30d6-458a-b160-27c04045c46c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:01.749477 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c96f33b-30d6-458a-b160-27c04045c46c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:01.750269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c96f33b-30d6-458a-b160-27c04045c46c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:01.750723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c96f33b-30d6-458a-b160-27c04045c46c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:01.883150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8c96f33b-30d6-458a-b160-27c04045c46c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:01.890671 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8c96f33b-30d6-458a-b160-27c04045c46c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1317 microversion: 2.1 time: 0.153888 Jul 20 05:18:01.891249 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3627/7153] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:01 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:02.071582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1c1dc2a4-91e4-41ad-bf6b-efc61cbbd670 req-2d2d39f1-69a0-44c2-9812-626f692644d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea", "name": "network-vif-plugged", "status": "completed", "tag": "a8bb0202-17ec-4eaf-9dbb-484a4eca7dc2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:02.081037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1c1dc2a4-91e4-41ad-bf6b-efc61cbbd670 req-2d2d39f1-69a0-44c2-9812-626f692644d7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:02.081535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1c1dc2a4-91e4-41ad-bf6b-efc61cbbd670 req-2d2d39f1-69a0-44c2-9812-626f692644d7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:02.097186 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1c1dc2a4-91e4-41ad-bf6b-efc61cbbd670 req-2d2d39f1-69a0-44c2-9812-626f692644d7 service nova] Creating event network-vif-plugged:a8bb0202-17ec-4eaf-9dbb-484a4eca7dc2 for instance 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea on n-h2-764485-11 Jul 20 05:18:02.102378 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1c1dc2a4-91e4-41ad-bf6b-efc61cbbd670 req-2d2d39f1-69a0-44c2-9812-626f692644d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035135 Jul 20 05:18:02.103010 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3527/7154] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:02.908037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d31883ad-888a-4867-983f-d9f2bff39ec1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:02.908687 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d31883ad-888a-4867-983f-d9f2bff39ec1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:02.910659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:02.911328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:02.918149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d31883ad-888a-4867-983f-d9f2bff39ec1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:02.918607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d31883ad-888a-4867-983f-d9f2bff39ec1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:02.919385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d31883ad-888a-4867-983f-d9f2bff39ec1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:02.919859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d31883ad-888a-4867-983f-d9f2bff39ec1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:03.051077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d31883ad-888a-4867-983f-d9f2bff39ec1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:03.059500 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d31883ad-888a-4867-983f-d9f2bff39ec1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1317 microversion: 2.1 time: 0.155381 Jul 20 05:18:03.060135 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3628/7155] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:02 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:04.074184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:04.079557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-02acb008-b550-4e15-955d-78d589dd00c8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:04.080259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-02acb008-b550-4e15-955d-78d589dd00c8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:04.087662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02acb008-b550-4e15-955d-78d589dd00c8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:04.088111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02acb008-b550-4e15-955d-78d589dd00c8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:04.088875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02acb008-b550-4e15-955d-78d589dd00c8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:04.089313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-02acb008-b550-4e15-955d-78d589dd00c8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:04.223882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-02acb008-b550-4e15-955d-78d589dd00c8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:04.232388 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-02acb008-b550-4e15-955d-78d589dd00c8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1505 microversion: 2.1 time: 0.159175 Jul 20 05:18:04.232979 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3528/7156] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:04 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:04.287608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1842070936", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "1eb77409-0b5f-4ff6-80c6-eb49c15a64b2"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:04.340681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] validate_networks() for [('1eb77409-0b5f-4ff6-80c6-eb49c15a64b2', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:18:04.711447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:18:04.711909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:18:04.712397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:18:04.712817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:18:04.713240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:18:04.722130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:04.722586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:04.723383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:04.723861 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:04.740616 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Getting quotas for project 4fd2ceb878ad4078bba1afbf0d20a080. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:18:04.746549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Getting quotas for user 4d3d1ba1b85249318f84a02e2b6afdf6 and project 4fd2ceb878ad4078bba1afbf0d20a080. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:18:04.759539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:18:04.761775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:18:04.806120 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ddf2130a-7391-4754-8ec2-06c2a9303e4f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522380 Jul 20 05:18:04.806771 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3629/7157] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:18:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:18:04.816614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e51f4d85-6e71-425c-9d7b-c24ceeee856f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:04.817231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e51f4d85-6e71-425c-9d7b-c24ceeee856f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:04.870229 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e51f4d85-6e71-425c-9d7b-c24ceeee856f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:04.877078 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e51f4d85-6e71-425c-9d7b-c24ceeee856f tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 200 len: 1217 microversion: 2.1 time: 0.064332 Jul 20 05:18:04.877667 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3529/7158] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:04 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:05.895440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-41b8c14b-6121-4208-8f76-717b4d96b076 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:05.896095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-41b8c14b-6121-4208-8f76-717b4d96b076 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:05.903927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41b8c14b-6121-4208-8f76-717b4d96b076 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:05.904634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41b8c14b-6121-4208-8f76-717b4d96b076 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:05.905701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41b8c14b-6121-4208-8f76-717b4d96b076 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:05.906514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41b8c14b-6121-4208-8f76-717b4d96b076 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:06.304352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-41b8c14b-6121-4208-8f76-717b4d96b076 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:06.311958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-41b8c14b-6121-4208-8f76-717b4d96b076 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 200 len: 1287 microversion: 2.1 time: 0.421468 Jul 20 05:18:06.312582 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3630/7159] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:05 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 1287 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:07.329661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6c0a1396-4538-4f91-bb4d-7139a188df6d tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:07.330900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6c0a1396-4538-4f91-bb4d-7139a188df6d tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:07.339592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c0a1396-4538-4f91-bb4d-7139a188df6d tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:07.340424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c0a1396-4538-4f91-bb4d-7139a188df6d tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:07.341216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c0a1396-4538-4f91-bb4d-7139a188df6d tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:07.341658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c0a1396-4538-4f91-bb4d-7139a188df6d tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:07.546219 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-816cfd17-ba96-4db5-9307-ffb3d2cab920 req-ed1cd2ec-7f67-45f1-a441-68e835e64b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6930a95-571d-46ff-a579-f45ac2e0257b", "tag": "0fe5f127-38e8-49cf-8b9f-0f2bc90fea3b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:07.554954 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:07.556983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-816cfd17-ba96-4db5-9307-ffb3d2cab920 req-ed1cd2ec-7f67-45f1-a441-68e835e64b93 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:07.557483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-816cfd17-ba96-4db5-9307-ffb3d2cab920 req-ed1cd2ec-7f67-45f1-a441-68e835e64b93 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:07.568104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6c0a1396-4538-4f91-bb4d-7139a188df6d tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:07.579616 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-816cfd17-ba96-4db5-9307-ffb3d2cab920 req-ed1cd2ec-7f67-45f1-a441-68e835e64b93 service nova] Creating event network-changed:0fe5f127-38e8-49cf-8b9f-0f2bc90fea3b for instance e6930a95-571d-46ff-a579-f45ac2e0257b on n-h1-764485-11 Jul 20 05:18:07.579944 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6c0a1396-4538-4f91-bb4d-7139a188df6d tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 200 len: 1317 microversion: 2.1 time: 0.253890 Jul 20 05:18:07.581079 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3530/7160] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:07 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:07.594603 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-816cfd17-ba96-4db5-9307-ffb3d2cab920 req-ed1cd2ec-7f67-45f1-a441-68e835e64b93 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052951 Jul 20 05:18:07.595247 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3631/7161] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:08.598217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-91475671-4e64-4a18-a242-4cfd7bdf03dc tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:08.598837 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-91475671-4e64-4a18-a242-4cfd7bdf03dc tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:08.605904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91475671-4e64-4a18-a242-4cfd7bdf03dc tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:08.606362 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91475671-4e64-4a18-a242-4cfd7bdf03dc tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:08.607173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91475671-4e64-4a18-a242-4cfd7bdf03dc tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:08.607647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91475671-4e64-4a18-a242-4cfd7bdf03dc tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:08.738805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-91475671-4e64-4a18-a242-4cfd7bdf03dc tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:08.746900 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-91475671-4e64-4a18-a242-4cfd7bdf03dc tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 200 len: 1317 microversion: 2.1 time: 0.152623 Jul 20 05:18:08.747477 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3531/7162] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:08 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:09.765068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c83ee28b-9647-49c4-9a48-5ccad473a388 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:09.765787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c83ee28b-9647-49c4-9a48-5ccad473a388 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:09.772142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c83ee28b-9647-49c4-9a48-5ccad473a388 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:09.772735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c83ee28b-9647-49c4-9a48-5ccad473a388 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:09.773657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c83ee28b-9647-49c4-9a48-5ccad473a388 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:09.774144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c83ee28b-9647-49c4-9a48-5ccad473a388 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:09.967936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c83ee28b-9647-49c4-9a48-5ccad473a388 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:09.977114 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c83ee28b-9647-49c4-9a48-5ccad473a388 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 200 len: 1317 microversion: 2.1 time: 0.216419 Jul 20 05:18:09.978329 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3632/7163] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:09 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:10.995482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7ff255a7-71a7-4165-b747-0b598e62fd42 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:10.996224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7ff255a7-71a7-4165-b747-0b598e62fd42 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:11.003145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ff255a7-71a7-4165-b747-0b598e62fd42 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:11.003634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ff255a7-71a7-4165-b747-0b598e62fd42 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:11.004413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ff255a7-71a7-4165-b747-0b598e62fd42 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:11.004861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ff255a7-71a7-4165-b747-0b598e62fd42 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:11.135758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7ff255a7-71a7-4165-b747-0b598e62fd42 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:11.143296 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7ff255a7-71a7-4165-b747-0b598e62fd42 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 200 len: 1317 microversion: 2.1 time: 0.152457 Jul 20 05:18:11.143926 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3532/7164] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:10 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:12.120284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-9728c5da-c659-468b-a9bd-6df8092d17d9 req-18984c04-85f9-4483-8260-fa5a2432f92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6930a95-571d-46ff-a579-f45ac2e0257b", "name": "network-vif-plugged", "status": "completed", "tag": "0fe5f127-38e8-49cf-8b9f-0f2bc90fea3b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:12.129836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9728c5da-c659-468b-a9bd-6df8092d17d9 req-18984c04-85f9-4483-8260-fa5a2432f92f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:12.130344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-9728c5da-c659-468b-a9bd-6df8092d17d9 req-18984c04-85f9-4483-8260-fa5a2432f92f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:12.143207 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-9728c5da-c659-468b-a9bd-6df8092d17d9 req-18984c04-85f9-4483-8260-fa5a2432f92f service nova] Creating event network-vif-plugged:0fe5f127-38e8-49cf-8b9f-0f2bc90fea3b for instance e6930a95-571d-46ff-a579-f45ac2e0257b on n-h1-764485-11 Jul 20 05:18:12.148297 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-9728c5da-c659-468b-a9bd-6df8092d17d9 req-18984c04-85f9-4483-8260-fa5a2432f92f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032659 Jul 20 05:18:12.148916 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3633/7165] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:12.160406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dc1e9006-bfa5-44e8-92f9-928de6dd5bf8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:12.161127 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dc1e9006-bfa5-44e8-92f9-928de6dd5bf8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:12.168680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc1e9006-bfa5-44e8-92f9-928de6dd5bf8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:12.169351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc1e9006-bfa5-44e8-92f9-928de6dd5bf8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:12.170209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc1e9006-bfa5-44e8-92f9-928de6dd5bf8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:12.170741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dc1e9006-bfa5-44e8-92f9-928de6dd5bf8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:12.367267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dc1e9006-bfa5-44e8-92f9-928de6dd5bf8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:12.375280 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dc1e9006-bfa5-44e8-92f9-928de6dd5bf8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 200 len: 1317 microversion: 2.1 time: 0.219088 Jul 20 05:18:12.375907 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3533/7166] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:12 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:13.393645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ddf821cf-a3ae-49d3-8198-c2a1118776eb tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:13.394480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ddf821cf-a3ae-49d3-8198-c2a1118776eb tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:13.401723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddf821cf-a3ae-49d3-8198-c2a1118776eb tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:13.402264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddf821cf-a3ae-49d3-8198-c2a1118776eb tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:13.403113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddf821cf-a3ae-49d3-8198-c2a1118776eb tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:13.403675 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ddf821cf-a3ae-49d3-8198-c2a1118776eb tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:13.544081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ddf821cf-a3ae-49d3-8198-c2a1118776eb tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:13.552040 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ddf821cf-a3ae-49d3-8198-c2a1118776eb tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 200 len: 1317 microversion: 2.1 time: 0.163684 Jul 20 05:18:13.552624 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3634/7167] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:13 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:14.570560 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9325ceec-1a46-47ab-9e72-e6941ec6a198 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:14.571251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9325ceec-1a46-47ab-9e72-e6941ec6a198 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:14.578260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9325ceec-1a46-47ab-9e72-e6941ec6a198 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:14.578714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9325ceec-1a46-47ab-9e72-e6941ec6a198 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:14.579487 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9325ceec-1a46-47ab-9e72-e6941ec6a198 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:14.579954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9325ceec-1a46-47ab-9e72-e6941ec6a198 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:14.718125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9325ceec-1a46-47ab-9e72-e6941ec6a198 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:14.726253 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9325ceec-1a46-47ab-9e72-e6941ec6a198 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 200 len: 1505 microversion: 2.1 time: 0.159891 Jul 20 05:18:14.726860 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3534/7168] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:14 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:14.743334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ce5dc14e-ab1a-482d-8659-97b7a60ff7dd tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:14.743870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ce5dc14e-ab1a-482d-8659-97b7a60ff7dd tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:14.746645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:14.752344 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce5dc14e-ab1a-482d-8659-97b7a60ff7dd tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:14.752813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce5dc14e-ab1a-482d-8659-97b7a60ff7dd tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:14.753596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce5dc14e-ab1a-482d-8659-97b7a60ff7dd tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:14.754053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce5dc14e-ab1a-482d-8659-97b7a60ff7dd tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:14.754503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:14.780062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ce5dc14e-ab1a-482d-8659-97b7a60ff7dd tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:18:14.858509 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ce5dc14e-ab1a-482d-8659-97b7a60ff7dd tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 204 len: 0 microversion: 2.1 time: 0.119404 Jul 20 05:18:14.859232 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3635/7169] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:18:14 2022] DELETE /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:18:14.869563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aceeb7fa-2f00-47e0-9fb6-dd91429c0ab8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:14.870172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-aceeb7fa-2f00-47e0-9fb6-dd91429c0ab8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:14.875462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:14.877329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aceeb7fa-2f00-47e0-9fb6-dd91429c0ab8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:14.877778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aceeb7fa-2f00-47e0-9fb6-dd91429c0ab8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:14.878535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aceeb7fa-2f00-47e0-9fb6-dd91429c0ab8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:14.878974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-aceeb7fa-2f00-47e0-9fb6-dd91429c0ab8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:15.007680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-aceeb7fa-2f00-47e0-9fb6-dd91429c0ab8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:15.015140 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aceeb7fa-2f00-47e0-9fb6-dd91429c0ab8 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 200 len: 1511 microversion: 2.1 time: 0.151248 Jul 20 05:18:15.015743 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3535/7170] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:14 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:16.033613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c75a1ff1-637d-413f-bba7-2321d73859da tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:16.034331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c75a1ff1-637d-413f-bba7-2321d73859da tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:16.042520 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c75a1ff1-637d-413f-bba7-2321d73859da tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:16.042988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c75a1ff1-637d-413f-bba7-2321d73859da tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:16.043796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c75a1ff1-637d-413f-bba7-2321d73859da tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:16.044312 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c75a1ff1-637d-413f-bba7-2321d73859da tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:16.190580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c75a1ff1-637d-413f-bba7-2321d73859da tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:16.198919 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c75a1ff1-637d-413f-bba7-2321d73859da tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 200 len: 1511 microversion: 2.1 time: 0.169639 Jul 20 05:18:16.199501 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3636/7171] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:16 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:16.704696 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-48ce9351-f70c-4937-99a0-7d7e1dcb2f1b req-3892eec0-50a3-4b37-bd94-92792ad301d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6930a95-571d-46ff-a579-f45ac2e0257b", "name": "network-vif-deleted", "tag": "0fe5f127-38e8-49cf-8b9f-0f2bc90fea3b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:16.715287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-48ce9351-f70c-4937-99a0-7d7e1dcb2f1b req-3892eec0-50a3-4b37-bd94-92792ad301d6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:16.715987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-48ce9351-f70c-4937-99a0-7d7e1dcb2f1b req-3892eec0-50a3-4b37-bd94-92792ad301d6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:16.745180 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-48ce9351-f70c-4937-99a0-7d7e1dcb2f1b req-3892eec0-50a3-4b37-bd94-92792ad301d6 service nova] Creating event network-vif-deleted:0fe5f127-38e8-49cf-8b9f-0f2bc90fea3b for instance e6930a95-571d-46ff-a579-f45ac2e0257b on n-h1-764485-11 Jul 20 05:18:16.750472 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-48ce9351-f70c-4937-99a0-7d7e1dcb2f1b req-3892eec0-50a3-4b37-bd94-92792ad301d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049423 Jul 20 05:18:16.751404 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3536/7172] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:17.215844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6143f6e5-56bf-4e66-8a8c-f81b00335542 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:17.216545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6143f6e5-56bf-4e66-8a8c-f81b00335542 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:17.223755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6143f6e5-56bf-4e66-8a8c-f81b00335542 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.224228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6143f6e5-56bf-4e66-8a8c-f81b00335542 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.225011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6143f6e5-56bf-4e66-8a8c-f81b00335542 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.225468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6143f6e5-56bf-4e66-8a8c-f81b00335542 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.239499 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-6143f6e5-56bf-4e66-8a8c-f81b00335542 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] HTTP exception thrown: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6143f6e5-56bf-4e66-8a8c-f81b00335542 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Request method failure captured: Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b HTTP/1.1 Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14__xIgXqm4G5x995e-0exet5eb70YuTIq0D5r8Tcf4wHGRO-4ZmDIFillEH3JOTtG2j6HyOO2tTEMgKBuprJWt-nAIyQ31shFiQh8Vvo7FP9YV1hoZ_6RoMmq4KcTM7mm8IicOTnQvFk-zxa_24o5sTZNYXH2gAFoi5XZxDxEvn8KQ Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4fd2ceb878ad4078bba1afbf0d20a080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}] Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 4d3d1ba1b85249318f84a02e2b6afdf6 Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'e6930a95-571d-46ff-a579-f45ac2e0257b'} Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:17.241210 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.246045 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:17.246045 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:17.246045 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:17.246045 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:18:17.246045 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:18:17.246045 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:17.246045 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.246045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6143f6e5-56bf-4e66-8a8c-f81b00335542 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Returning 404 to user: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:18:17.246045 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6143f6e5-56bf-4e66-8a8c-f81b00335542 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 404 len: 111 microversion: 2.1 time: 0.031497 Jul 20 05:18:17.246045 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3637/7173] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:17 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:18:17.253161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8be9ec92-74ea-427a-b23b-1491aea03568 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:17.253906 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8be9ec92-74ea-427a-b23b-1491aea03568 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:17.261370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8be9ec92-74ea-427a-b23b-1491aea03568 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.261829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8be9ec92-74ea-427a-b23b-1491aea03568 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.262603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8be9ec92-74ea-427a-b23b-1491aea03568 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.263057 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8be9ec92-74ea-427a-b23b-1491aea03568 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.396851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8be9ec92-74ea-427a-b23b-1491aea03568 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:17.404532 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8be9ec92-74ea-427a-b23b-1491aea03568 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1505 microversion: 2.1 time: 0.155659 Jul 20 05:18:17.405112 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3537/7174] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:17 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:17.421301 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-874974ad-da35-41cb-9d23-d0ccabb7236e tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:17.422292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-874974ad-da35-41cb-9d23-d0ccabb7236e tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 53d0b835-b120-43fa-8a14-c119f75fd980] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:17.427824 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-874974ad-da35-41cb-9d23-d0ccabb7236e tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] HTTP exception thrown: Instance 53d0b835-b120-43fa-8a14-c119f75fd980 could not be found. Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-874974ad-da35-41cb-9d23-d0ccabb7236e tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Request method failure captured: Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/53d0b835-b120-43fa-8a14-c119f75fd980/action HTTP/1.1 Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 32 Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14__xIgXqm4G5x995e-0exet5eb70YuTIq0D5r8Tcf4wHGRO-4ZmDIFillEH3JOTtG2j6HyOO2tTEMgKBuprJWt-nAIyQ31shFiQh8Vvo7FP9YV1hoZ_6RoMmq4KcTM7mm8IicOTnQvFk-zxa_24o5sTZNYXH2gAFoi5XZxDxEvn8KQ Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4fd2ceb878ad4078bba1afbf0d20a080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}] Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 4d3d1ba1b85249318f84a02e2b6afdf6 Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: {"resize": {"flavorRef": "452"}} Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 53d0b835-b120-43fa-8a14-c119f75fd980 could not be found. Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '53d0b835-b120-43fa-8a14-c119f75fd980', 'body': {'resize': {'flavorRef': '452'}}} Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53d0b835-b120-43fa-8a14-c119f75fd980 could not be found. Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:18:17.429950 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53d0b835-b120-43fa-8a14-c119f75fd980 could not be found. Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53d0b835-b120-43fa-8a14-c119f75fd980 could not be found. Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-874974ad-da35-41cb-9d23-d0ccabb7236e tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Returning 404 to user: Instance 53d0b835-b120-43fa-8a14-c119f75fd980 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-874974ad-da35-41cb-9d23-d0ccabb7236e tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "POST /compute/v2.1/servers/53d0b835-b120-43fa-8a14-c119f75fd980/action" status: 404 len: 111 microversion: 2.1 time: 0.014152 Jul 20 05:18:17.434363 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3638/7175] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:17 2022] POST /compute/v2.1/servers/53d0b835-b120-43fa-8a14-c119f75fd980/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:18:17.439885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a610012e-f66f-4633-b2dd-d2f5cdff858c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:17.440504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a610012e-f66f-4633-b2dd-d2f5cdff858c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:17.447321 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a610012e-f66f-4633-b2dd-d2f5cdff858c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.447808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a610012e-f66f-4633-b2dd-d2f5cdff858c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.448592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a610012e-f66f-4633-b2dd-d2f5cdff858c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.449022 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a610012e-f66f-4633-b2dd-d2f5cdff858c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.577709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a610012e-f66f-4633-b2dd-d2f5cdff858c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:17.585607 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a610012e-f66f-4633-b2dd-d2f5cdff858c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1505 microversion: 2.1 time: 0.149563 Jul 20 05:18:17.586259 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3538/7176] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:17 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:17.604555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-36f4e887-9d02-4471-9b27-612ac31268ba tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:17.605242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-36f4e887-9d02-4471-9b27-612ac31268ba tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:17.612646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36f4e887-9d02-4471-9b27-612ac31268ba tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.613366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36f4e887-9d02-4471-9b27-612ac31268ba tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.614142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36f4e887-9d02-4471-9b27-612ac31268ba tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.614596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-36f4e887-9d02-4471-9b27-612ac31268ba tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.743356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-36f4e887-9d02-4471-9b27-612ac31268ba tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:17.750896 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-36f4e887-9d02-4471-9b27-612ac31268ba tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1505 microversion: 2.1 time: 0.150946 Jul 20 05:18:17.751473 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3639/7177] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:17 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:17.767108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-45953880-4210-4588-8d96-6445620f10b0 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "68ada650-c5aa-4633-86cc-3f65c71156bf"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:17.768173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-45953880-4210-4588-8d96-6445620f10b0 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:17.775094 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45953880-4210-4588-8d96-6445620f10b0 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.775574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45953880-4210-4588-8d96-6445620f10b0 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.776345 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45953880-4210-4588-8d96-6445620f10b0 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.776845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-45953880-4210-4588-8d96-6445620f10b0 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.823135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-45953880-4210-4588-8d96-6445620f10b0 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:17.828856 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-45953880-4210-4588-8d96-6445620f10b0 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] HTTP exception thrown: Flavor 68ada650-c5aa-4633-86cc-3f65c71156bf could not be found. Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-45953880-4210-4588-8d96-6445620f10b0 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Request method failure captured: Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: request: POST /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea/action HTTP/1.1 Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 65 Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14__xIgXqm4G5x995e-0exet5eb70YuTIq0D5r8Tcf4wHGRO-4ZmDIFillEH3JOTtG2j6HyOO2tTEMgKBuprJWt-nAIyQ31shFiQh8Vvo7FP9YV1hoZ_6RoMmq4KcTM7mm8IicOTnQvFk-zxa_24o5sTZNYXH2gAFoi5XZxDxEvn8KQ Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4fd2ceb878ad4078bba1afbf0d20a080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}] Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 4d3d1ba1b85249318f84a02e2b6afdf6 Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: {"resize": {"flavorRef": "68ada650-c5aa-4633-86cc-3f65c71156bf"}} Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: exception: Flavor 68ada650-c5aa-4633-86cc-3f65c71156bf could not be found. Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea', 'body': {'resize': {'flavorRef': '68ada650-c5aa-4633-86cc-3f65c71156bf'}}} Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 05:18:17.830880 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 68ada650-c5aa-4633-86cc-3f65c71156bf could not be found. Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 68ada650-c5aa-4633-86cc-3f65c71156bf could not be found. Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 68ada650-c5aa-4633-86cc-3f65c71156bf could not be found. Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-45953880-4210-4588-8d96-6445620f10b0 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Returning 400 to user: Flavor 68ada650-c5aa-4633-86cc-3f65c71156bf could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-45953880-4210-4588-8d96-6445620f10b0 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "POST /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea/action" status: 400 len: 107 microversion: 2.1 time: 0.069328 Jul 20 05:18:17.835075 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3539/7178] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:17 2022] POST /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea/action => generated 107 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 05:18:17.841375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ce7274de-16d3-4fc0-bda5-72109f7e3aaf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:17.842151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ce7274de-16d3-4fc0-bda5-72109f7e3aaf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:17.848345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce7274de-16d3-4fc0-bda5-72109f7e3aaf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.848810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce7274de-16d3-4fc0-bda5-72109f7e3aaf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.849593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce7274de-16d3-4fc0-bda5-72109f7e3aaf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.850042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ce7274de-16d3-4fc0-bda5-72109f7e3aaf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.009147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ce7274de-16d3-4fc0-bda5-72109f7e3aaf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:18.016790 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ce7274de-16d3-4fc0-bda5-72109f7e3aaf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1505 microversion: 2.1 time: 0.179270 Jul 20 05:18:18.017376 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3640/7179] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:17 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:18.034454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f03f8735-fd45-406b-9027-640686b8b7d1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:18.035398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f03f8735-fd45-406b-9027-640686b8b7d1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:18.042691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f03f8735-fd45-406b-9027-640686b8b7d1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.043153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f03f8735-fd45-406b-9027-640686b8b7d1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.043970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f03f8735-fd45-406b-9027-640686b8b7d1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.044413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f03f8735-fd45-406b-9027-640686b8b7d1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.267211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f03f8735-fd45-406b-9027-640686b8b7d1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:18.274806 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f03f8735-fd45-406b-9027-640686b8b7d1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1505 microversion: 2.1 time: 0.244371 Jul 20 05:18:18.275420 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3540/7180] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:18 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:18.291041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e8324c1f-c9d1-4b5d-9d67-e776002077b1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e8324c1f-c9d1-4b5d-9d67-e776002077b1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Request method failure captured: Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: request: POST /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea/action HTTP/1.1 Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 29 Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14__xIgXqm4G5x995e-0exet5eb70YuTIq0D5r8Tcf4wHGRO-4ZmDIFillEH3JOTtG2j6HyOO2tTEMgKBuprJWt-nAIyQ31shFiQh8Vvo7FP9YV1hoZ_6RoMmq4KcTM7mm8IicOTnQvFk-zxa_24o5sTZNYXH2gAFoi5XZxDxEvn8KQ Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4fd2ceb878ad4078bba1afbf0d20a080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}] Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 4d3d1ba1b85249318f84a02e2b6afdf6 Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: {"resize": {"flavorRef": ""}} Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea', 'body': {'resize': {'flavorRef': ''}}} Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise error Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi '' Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:18.293362 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.297925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:18.297925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:18.297925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:18.297925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 05:18:18.297925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 05:18:18.297925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 20 05:18:18.297925 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.297925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e8324c1f-c9d1-4b5d-9d67-e776002077b1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:18:18.297925 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e8324c1f-c9d1-4b5d-9d67-e776002077b1 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "POST /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea/action" status: 400 len: 113 microversion: 2.1 time: 0.007968 Jul 20 05:18:18.297925 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3641/7181] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:18 2022] POST /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 05:18:18.303222 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ebbbb31b-3bb1-474a-9aef-661071798983 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:18.304628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ebbbb31b-3bb1-474a-9aef-661071798983 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:18.310484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ebbbb31b-3bb1-474a-9aef-661071798983 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.310935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ebbbb31b-3bb1-474a-9aef-661071798983 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.311735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ebbbb31b-3bb1-474a-9aef-661071798983 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.312177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ebbbb31b-3bb1-474a-9aef-661071798983 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.513717 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ebbbb31b-3bb1-474a-9aef-661071798983 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:18.521491 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ebbbb31b-3bb1-474a-9aef-661071798983 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1505 microversion: 2.1 time: 0.222049 Jul 20 05:18:18.522075 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3541/7182] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:18 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:18.543161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b448e0ea-429e-4500-b34e-88f52fab1b33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:18.543708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b448e0ea-429e-4500-b34e-88f52fab1b33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:18.550804 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b448e0ea-429e-4500-b34e-88f52fab1b33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.551346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b448e0ea-429e-4500-b34e-88f52fab1b33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.552147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b448e0ea-429e-4500-b34e-88f52fab1b33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.552637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b448e0ea-429e-4500-b34e-88f52fab1b33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.567161 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-b448e0ea-429e-4500-b34e-88f52fab1b33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] HTTP exception thrown: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b448e0ea-429e-4500-b34e-88f52fab1b33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Request method failure captured: Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b HTTP/1.1 Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi14__xIgXqm4G5x995e-0exet5eb70YuTIq0D5r8Tcf4wHGRO-4ZmDIFillEH3JOTtG2j6HyOO2tTEMgKBuprJWt-nAIyQ31shFiQh8Vvo7FP9YV1hoZ_6RoMmq4KcTM7mm8IicOTnQvFk-zxa_24o5sTZNYXH2gAFoi5XZxDxEvn8KQ Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4fd2ceb878ad4078bba1afbf0d20a080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}] Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 4d3d1ba1b85249318f84a02e2b6afdf6 Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'e6930a95-571d-46ff-a579-f45ac2e0257b'} Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:18:18.568787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b448e0ea-429e-4500-b34e-88f52fab1b33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Returning 404 to user: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b448e0ea-429e-4500-b34e-88f52fab1b33 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 404 len: 111 microversion: 2.1 time: 0.033321 Jul 20 05:18:18.575128 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3642/7183] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:18:18 2022] DELETE /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:18:18.580795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e3789252-63d6-409d-ae1d-7c11cb2f2b36 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:18.581489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e3789252-63d6-409d-ae1d-7c11cb2f2b36 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: e6930a95-571d-46ff-a579-f45ac2e0257b] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:18.588749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3789252-63d6-409d-ae1d-7c11cb2f2b36 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.589303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3789252-63d6-409d-ae1d-7c11cb2f2b36 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.590088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3789252-63d6-409d-ae1d-7c11cb2f2b36 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.590528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e3789252-63d6-409d-ae1d-7c11cb2f2b36 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.594766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=100 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:18.608021 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e3789252-63d6-409d-ae1d-7c11cb2f2b36 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] HTTP exception thrown: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e3789252-63d6-409d-ae1d-7c11cb2f2b36 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Request method failure captured: Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b HTTP/1.1 Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14__xIgXqm4G5x995e-0exet5eb70YuTIq0D5r8Tcf4wHGRO-4ZmDIFillEH3JOTtG2j6HyOO2tTEMgKBuprJWt-nAIyQ31shFiQh8Vvo7FP9YV1hoZ_6RoMmq4KcTM7mm8IicOTnQvFk-zxa_24o5sTZNYXH2gAFoi5XZxDxEvn8KQ Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4fd2ceb878ad4078bba1afbf0d20a080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}] Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 4d3d1ba1b85249318f84a02e2b6afdf6 Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'e6930a95-571d-46ff-a579-f45ac2e0257b'} Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:18.609585 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.613402 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:18.613402 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:18.613402 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:18.613402 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:18:18.613402 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:18:18.613402 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. Jul 20 05:18:18.613402 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:18.613402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e3789252-63d6-409d-ae1d-7c11cb2f2b36 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Returning 404 to user: Instance e6930a95-571d-46ff-a579-f45ac2e0257b could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:18:18.613402 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e3789252-63d6-409d-ae1d-7c11cb2f2b36 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b" status: 404 len: 111 microversion: 2.1 time: 0.034200 Jul 20 05:18:18.613402 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3542/7184] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:18 2022] GET /compute/v2.1/servers/e6930a95-571d-46ff-a579-f45ac2e0257b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:18:18.620463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-312e3db1-0889-48eb-bfb9-6434e35c2ddf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:18.621095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-312e3db1-0889-48eb-bfb9-6434e35c2ddf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:18.627409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-312e3db1-0889-48eb-bfb9-6434e35c2ddf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.627916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-312e3db1-0889-48eb-bfb9-6434e35c2ddf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.628703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-312e3db1-0889-48eb-bfb9-6434e35c2ddf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.629162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-312e3db1-0889-48eb-bfb9-6434e35c2ddf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.648501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:18.656844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-312e3db1-0889-48eb-bfb9-6434e35c2ddf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:18:18.732539 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-312e3db1-0889-48eb-bfb9-6434e35c2ddf tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 204 len: 0 microversion: 2.1 time: 0.116066 Jul 20 05:18:18.733052 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3643/7185] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:18:18 2022] DELETE /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:18:18.742145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f74e6d42-061d-4f0b-81dd-63167746c1d6 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:18.743075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f74e6d42-061d-4f0b-81dd-63167746c1d6 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:18.749211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f74e6d42-061d-4f0b-81dd-63167746c1d6 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.749669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f74e6d42-061d-4f0b-81dd-63167746c1d6 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.750447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f74e6d42-061d-4f0b-81dd-63167746c1d6 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.750892 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f74e6d42-061d-4f0b-81dd-63167746c1d6 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.882727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f74e6d42-061d-4f0b-81dd-63167746c1d6 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:18.890387 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f74e6d42-061d-4f0b-81dd-63167746c1d6 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1511 microversion: 2.1 time: 0.153140 Jul 20 05:18:18.890970 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3543/7186] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:18 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:19.908817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f3622d5f-a8e7-49eb-9896-ae57af58d292 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:19.909664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f3622d5f-a8e7-49eb-9896-ae57af58d292 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:19.916937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3622d5f-a8e7-49eb-9896-ae57af58d292 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:19.917403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3622d5f-a8e7-49eb-9896-ae57af58d292 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:19.918180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3622d5f-a8e7-49eb-9896-ae57af58d292 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:19.918628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f3622d5f-a8e7-49eb-9896-ae57af58d292 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:20.075845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f3622d5f-a8e7-49eb-9896-ae57af58d292 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:20.083610 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f3622d5f-a8e7-49eb-9896-ae57af58d292 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1511 microversion: 2.1 time: 0.179163 Jul 20 05:18:20.084251 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3644/7187] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:19 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:20.822840 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-cd991957-01eb-4eae-9945-f8c7db42f56a req-7d6d9ff9-b8d0-400e-a709-ed0c4da88258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea", "name": "network-vif-deleted", "tag": "a8bb0202-17ec-4eaf-9dbb-484a4eca7dc2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:20.833542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-cd991957-01eb-4eae-9945-f8c7db42f56a req-7d6d9ff9-b8d0-400e-a709-ed0c4da88258 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:20.834001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-cd991957-01eb-4eae-9945-f8c7db42f56a req-7d6d9ff9-b8d0-400e-a709-ed0c4da88258 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:20.847961 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-cd991957-01eb-4eae-9945-f8c7db42f56a req-7d6d9ff9-b8d0-400e-a709-ed0c4da88258 service nova] Creating event network-vif-deleted:a8bb0202-17ec-4eaf-9dbb-484a4eca7dc2 for instance 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea on n-h2-764485-11 Jul 20 05:18:20.854382 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-cd991957-01eb-4eae-9945-f8c7db42f56a req-7d6d9ff9-b8d0-400e-a709-ed0c4da88258 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035499 Jul 20 05:18:20.855613 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3544/7188] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:21.103879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8b7d1fe2-1b3e-45f9-913f-41bfd60d4a4c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:21.104449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8b7d1fe2-1b3e-45f9-913f-41bfd60d4a4c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:21.111337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b7d1fe2-1b3e-45f9-913f-41bfd60d4a4c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:21.111856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b7d1fe2-1b3e-45f9-913f-41bfd60d4a4c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:21.112635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b7d1fe2-1b3e-45f9-913f-41bfd60d4a4c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:21.113356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b7d1fe2-1b3e-45f9-913f-41bfd60d4a4c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:21.143834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b7d1fe2-1b3e-45f9-913f-41bfd60d4a4c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:21.144300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8b7d1fe2-1b3e-45f9-913f-41bfd60d4a4c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:21.144767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-8b7d1fe2-1b3e-45f9-913f-41bfd60d4a4c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lazy-loading 'fault' on Instance uuid 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:18:21.186020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8b7d1fe2-1b3e-45f9-913f-41bfd60d4a4c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3d1ba1b85249318f84a02e2b6afdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd2ceb878ad4078bba1afbf0d20a080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:21.193753 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8b7d1fe2-1b3e-45f9-913f-41bfd60d4a4c tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 200 len: 1307 microversion: 2.1 time: 0.094777 Jul 20 05:18:21.194386 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3645/7189] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:21 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:22.211853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b004084c-7916-4e35-86b2-a8224b95c713 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:22.212560 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b004084c-7916-4e35-86b2-a8224b95c713 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] [instance: 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:22.219728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b004084c-7916-4e35-86b2-a8224b95c713 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:22.220183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b004084c-7916-4e35-86b2-a8224b95c713 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:22.220945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b004084c-7916-4e35-86b2-a8224b95c713 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:22.221381 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b004084c-7916-4e35-86b2-a8224b95c713 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:22.235524 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b004084c-7916-4e35-86b2-a8224b95c713 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] HTTP exception thrown: Instance 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea could not be found. Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b004084c-7916-4e35-86b2-a8224b95c713 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Request method failure captured: Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea HTTP/1.1 Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi14__xIgXqm4G5x995e-0exet5eb70YuTIq0D5r8Tcf4wHGRO-4ZmDIFillEH3JOTtG2j6HyOO2tTEMgKBuprJWt-nAIyQ31shFiQh8Vvo7FP9YV1hoZ_6RoMmq4KcTM7mm8IicOTnQvFk-zxa_24o5sTZNYXH2gAFoi5XZxDxEvn8KQ Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4fd2ceb878ad4078bba1afbf0d20a080", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fd2ceb878ad4078bba1afbf0d20a080"}]}] Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 4fd2ceb878ad4078bba1afbf0d20a080 Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-856460277 Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 4d3d1ba1b85249318f84a02e2b6afdf6 Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-ServersNegativeTestJSON-856460277-project Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea could not be found. Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea'} Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea could not be found. Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea could not be found. Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:22.237182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:22.242474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:22.242474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:22.242474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:22.242474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:18:22.242474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:18:22.242474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea could not be found. Jul 20 05:18:22.242474 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:18:22.242474 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b004084c-7916-4e35-86b2-a8224b95c713 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] Returning 404 to user: Instance 0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:18:22.242474 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b004084c-7916-4e35-86b2-a8224b95c713 tempest-ServersNegativeTestJSON-856460277 tempest-ServersNegativeTestJSON-856460277-project] 10.222.0.20 "GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea" status: 404 len: 111 microversion: 2.1 time: 0.031845 Jul 20 05:18:22.242474 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3545/7190] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:22 2022] GET /compute/v2.1/servers/0df6afcb-4e4a-41e6-a8bb-0e3f0bf749ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:18:35.679090 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:18:35.679883 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:18:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:18:53.545612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:53.546392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:53.724163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-69ed9eb1-080f-4006-945f-4d5f123feda9 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Action: 'create', calling method: .version_select at 0x7fbf9c5cef70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1047644951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeedzDk/9QeCrwBisD1l1VN4YL/L7q/oPN+PWyKSh2vMYQMsFUBFrh5gEHeCwoIt6EYjyrmGToiM4WFNdpOJmkx6MCIuXuGzfpvbLtn7l2ejkSssss3BUSQbjRvSQ8W4w=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:53.739729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-69ed9eb1-080f-4006-945f-4d5f123feda9 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Getting quotas for project 9c4e2d9e82d54175adffc5f6807f3030. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:18:53.745392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-69ed9eb1-080f-4006-945f-4d5f123feda9 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Getting quotas for user 953dd7032efb41a3ba720dd68b31687e and project 9c4e2d9e82d54175adffc5f6807f3030. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:18:53.776278 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-69ed9eb1-080f-4006-945f-4d5f123feda9 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.235802 Jul 20 05:18:53.777073 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3646/7191] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:18:53 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:53.825217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1116402013", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1047644951", "networks": [{"uuid": "4f80ad55-a7e1-4c25-bf5f-7f128ad52d66"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:53.832686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=54 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:53.833981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=10 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:53.881982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] validate_networks() for [('4f80ad55-a7e1-4c25-bf5f-7f128ad52d66', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:18:54.276873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:18:54.277308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:18:54.277793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:18:54.278205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:18:54.278735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:18:54.288564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:54.289017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:54.289834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:54.290281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:54.307083 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Getting quotas for project 9c4e2d9e82d54175adffc5f6807f3030. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:18:54.312556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Getting quotas for user 953dd7032efb41a3ba720dd68b31687e and project 9c4e2d9e82d54175adffc5f6807f3030. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:18:54.326397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:18:54.328951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:18:54.376451 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cca64fe6-778b-480e-8968-29bac1ea0661 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555071 Jul 20 05:18:54.377520 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3546/7192] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:18:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:18:54.388403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ed5ae88c-7d5e-463b-97cf-5f0e60f04d9e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:54.389041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ed5ae88c-7d5e-463b-97cf-5f0e60f04d9e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:54.473135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ed5ae88c-7d5e-463b-97cf-5f0e60f04d9e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:54.480488 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ed5ae88c-7d5e-463b-97cf-5f0e60f04d9e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1263 microversion: 2.1 time: 0.096029 Jul 20 05:18:54.481079 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3647/7193] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:54 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1263 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:55.499349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-28392130-4e3c-4e0c-89fa-d9c289d412a0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:55.500743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-28392130-4e3c-4e0c-89fa-d9c289d412a0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:55.509739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28392130-4e3c-4e0c-89fa-d9c289d412a0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:55.510488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28392130-4e3c-4e0c-89fa-d9c289d412a0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:55.511413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28392130-4e3c-4e0c-89fa-d9c289d412a0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:55.512075 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-28392130-4e3c-4e0c-89fa-d9c289d412a0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:55.608370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-28392130-4e3c-4e0c-89fa-d9c289d412a0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:55.617516 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-28392130-4e3c-4e0c-89fa-d9c289d412a0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1333 microversion: 2.1 time: 0.122998 Jul 20 05:18:55.618332 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3547/7194] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:55 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1333 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:56.635746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8e2209ea-53d6-4ed1-8a9f-f7270fdb7547 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:56.637163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8e2209ea-53d6-4ed1-8a9f-f7270fdb7547 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:56.648701 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e2209ea-53d6-4ed1-8a9f-f7270fdb7547 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:56.649839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e2209ea-53d6-4ed1-8a9f-f7270fdb7547 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:56.651289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e2209ea-53d6-4ed1-8a9f-f7270fdb7547 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:56.651869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8e2209ea-53d6-4ed1-8a9f-f7270fdb7547 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:56.890048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8e2209ea-53d6-4ed1-8a9f-f7270fdb7547 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:56.911030 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8e2209ea-53d6-4ed1-8a9f-f7270fdb7547 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1363 microversion: 2.1 time: 0.280199 Jul 20 05:18:56.923620 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3648/7195] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:56 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:57.103467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-253f9a49-1932-4598-b610-64f1311b0579 req-dc1174ab-6972-4f62-9a3e-19d8690809e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d68edcdb-d3eb-4102-af22-01feec83adf6", "tag": "a1f79e2e-dd30-4998-93d0-da57a47f5491"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:57.115699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-253f9a49-1932-4598-b610-64f1311b0579 req-dc1174ab-6972-4f62-9a3e-19d8690809e1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:57.116488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-253f9a49-1932-4598-b610-64f1311b0579 req-dc1174ab-6972-4f62-9a3e-19d8690809e1 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:57.135049 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-253f9a49-1932-4598-b610-64f1311b0579 req-dc1174ab-6972-4f62-9a3e-19d8690809e1 service nova] Creating event network-changed:a1f79e2e-dd30-4998-93d0-da57a47f5491 for instance d68edcdb-d3eb-4102-af22-01feec83adf6 on n-h1-764485-11 Jul 20 05:18:57.144283 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-253f9a49-1932-4598-b610-64f1311b0579 req-dc1174ab-6972-4f62-9a3e-19d8690809e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054735 Jul 20 05:18:57.144550 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3548/7196] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:57.929440 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b40166aa-a233-425e-a418-86951f3d2fa3 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:57.930094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b40166aa-a233-425e-a418-86951f3d2fa3 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:57.937137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b40166aa-a233-425e-a418-86951f3d2fa3 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:57.937600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b40166aa-a233-425e-a418-86951f3d2fa3 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:57.938376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b40166aa-a233-425e-a418-86951f3d2fa3 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:57.938824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b40166aa-a233-425e-a418-86951f3d2fa3 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:58.070378 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b40166aa-a233-425e-a418-86951f3d2fa3 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:58.078156 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b40166aa-a233-425e-a418-86951f3d2fa3 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1363 microversion: 2.1 time: 0.152668 Jul 20 05:18:58.078762 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3649/7197] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:57 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:59.097643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6dcb6087-81a9-4271-8cc4-478104bc419b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:59.098260 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6dcb6087-81a9-4271-8cc4-478104bc419b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:59.104875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6dcb6087-81a9-4271-8cc4-478104bc419b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:59.105334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6dcb6087-81a9-4271-8cc4-478104bc419b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:59.106118 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6dcb6087-81a9-4271-8cc4-478104bc419b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:59.106562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6dcb6087-81a9-4271-8cc4-478104bc419b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:59.243109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6dcb6087-81a9-4271-8cc4-478104bc419b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:59.251459 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6dcb6087-81a9-4271-8cc4-478104bc419b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1363 microversion: 2.1 time: 0.159081 Jul 20 05:18:59.252086 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3549/7198] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:59 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:00.269418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d91892fd-faaf-43d1-9343-09c814eb8c35 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:00.270053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d91892fd-faaf-43d1-9343-09c814eb8c35 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:00.277676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d91892fd-faaf-43d1-9343-09c814eb8c35 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:00.278146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d91892fd-faaf-43d1-9343-09c814eb8c35 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:00.278983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d91892fd-faaf-43d1-9343-09c814eb8c35 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:00.279705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d91892fd-faaf-43d1-9343-09c814eb8c35 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:00.415723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d91892fd-faaf-43d1-9343-09c814eb8c35 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:00.423187 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d91892fd-faaf-43d1-9343-09c814eb8c35 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1363 microversion: 2.1 time: 0.157756 Jul 20 05:19:00.423801 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3650/7199] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:00 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:01.440903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2a0707f2-3cc5-4d02-9e3e-b3a3798f8b1e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:01.441557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2a0707f2-3cc5-4d02-9e3e-b3a3798f8b1e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:01.449186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a0707f2-3cc5-4d02-9e3e-b3a3798f8b1e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:01.449640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a0707f2-3cc5-4d02-9e3e-b3a3798f8b1e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:01.450405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a0707f2-3cc5-4d02-9e3e-b3a3798f8b1e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:01.450841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2a0707f2-3cc5-4d02-9e3e-b3a3798f8b1e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:01.581520 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2a0707f2-3cc5-4d02-9e3e-b3a3798f8b1e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:01.589403 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2a0707f2-3cc5-4d02-9e3e-b3a3798f8b1e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1363 microversion: 2.1 time: 0.152364 Jul 20 05:19:01.589992 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3550/7200] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:01 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:02.158873 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-013238e6-4f78-4e48-893c-b7a5660e1154 req-da770103-e9b3-495c-a19c-b08346eaf45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68edcdb-d3eb-4102-af22-01feec83adf6", "name": "network-vif-plugged", "status": "completed", "tag": "a1f79e2e-dd30-4998-93d0-da57a47f5491"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:02.171668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-013238e6-4f78-4e48-893c-b7a5660e1154 req-da770103-e9b3-495c-a19c-b08346eaf45d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:02.172486 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-013238e6-4f78-4e48-893c-b7a5660e1154 req-da770103-e9b3-495c-a19c-b08346eaf45d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:02.185238 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-013238e6-4f78-4e48-893c-b7a5660e1154 req-da770103-e9b3-495c-a19c-b08346eaf45d service nova] Creating event network-vif-plugged:a1f79e2e-dd30-4998-93d0-da57a47f5491 for instance d68edcdb-d3eb-4102-af22-01feec83adf6 on n-h1-764485-11 Jul 20 05:19:02.190777 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-013238e6-4f78-4e48-893c-b7a5660e1154 req-da770103-e9b3-495c-a19c-b08346eaf45d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036034 Jul 20 05:19:02.191413 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3651/7201] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:02.606596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7a83cb50-3e0e-4702-a002-bd57b80efb84 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:02.607221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7a83cb50-3e0e-4702-a002-bd57b80efb84 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:02.614595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a83cb50-3e0e-4702-a002-bd57b80efb84 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:02.615040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a83cb50-3e0e-4702-a002-bd57b80efb84 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:02.615865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a83cb50-3e0e-4702-a002-bd57b80efb84 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:02.616317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7a83cb50-3e0e-4702-a002-bd57b80efb84 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:02.750110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7a83cb50-3e0e-4702-a002-bd57b80efb84 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:02.758029 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7a83cb50-3e0e-4702-a002-bd57b80efb84 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1363 microversion: 2.1 time: 0.155350 Jul 20 05:19:02.758629 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3551/7202] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:02 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:03.775027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4cd27ccf-afa7-4d9a-ba52-2fd03d637b8a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:03.775777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4cd27ccf-afa7-4d9a-ba52-2fd03d637b8a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:03.783677 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cd27ccf-afa7-4d9a-ba52-2fd03d637b8a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:03.784180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cd27ccf-afa7-4d9a-ba52-2fd03d637b8a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:03.785074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cd27ccf-afa7-4d9a-ba52-2fd03d637b8a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:03.785771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4cd27ccf-afa7-4d9a-ba52-2fd03d637b8a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:03.925092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4cd27ccf-afa7-4d9a-ba52-2fd03d637b8a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:03.934842 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4cd27ccf-afa7-4d9a-ba52-2fd03d637b8a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1556 microversion: 2.1 time: 0.164326 Jul 20 05:19:03.935443 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3652/7203] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:03 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:03.952244 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-91b93ae8-89b7-42bd-b6f9-7b5071a4d5e0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:03.952867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-91b93ae8-89b7-42bd-b6f9-7b5071a4d5e0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:03.959719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91b93ae8-89b7-42bd-b6f9-7b5071a4d5e0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:03.960275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91b93ae8-89b7-42bd-b6f9-7b5071a4d5e0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:03.961047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91b93ae8-89b7-42bd-b6f9-7b5071a4d5e0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:03.961494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-91b93ae8-89b7-42bd-b6f9-7b5071a4d5e0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:04.091687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-91b93ae8-89b7-42bd-b6f9-7b5071a4d5e0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:04.099743 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-91b93ae8-89b7-42bd-b6f9-7b5071a4d5e0 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1556 microversion: 2.1 time: 0.150924 Jul 20 05:19:04.100372 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3552/7204] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:03 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:05.757826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f6644acb-94ef-4561-9a6d-6fc41aa1a906 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e108240-ca0f-49c8-940c-685b527c28c7"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:05.758914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f6644acb-94ef-4561-9a6d-6fc41aa1a906 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:05.760897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:05.767274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6644acb-94ef-4561-9a6d-6fc41aa1a906 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:05.767679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6644acb-94ef-4561-9a6d-6fc41aa1a906 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:05.768461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6644acb-94ef-4561-9a6d-6fc41aa1a906 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:05.768915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f6644acb-94ef-4561-9a6d-6fc41aa1a906 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:06.011347 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f6644acb-94ef-4561-9a6d-6fc41aa1a906 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "POST /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257755 Jul 20 05:19:06.012023 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3653/7205] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 05:19:05 2022] POST /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:16.672140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59f88661-4f1f-4b0d-b908-e5e59417e678 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:16.672645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-59f88661-4f1f-4b0d-b908-e5e59417e678 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:16.674560 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:16.675227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:16.676421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:16.677161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=34 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:16.684581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59f88661-4f1f-4b0d-b908-e5e59417e678 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:16.685032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59f88661-4f1f-4b0d-b908-e5e59417e678 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:16.685797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59f88661-4f1f-4b0d-b908-e5e59417e678 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:16.686234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59f88661-4f1f-4b0d-b908-e5e59417e678 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:16.765541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-59f88661-4f1f-4b0d-b908-e5e59417e678 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lazy-loading 'services' on Instance uuid d68edcdb-d3eb-4102-af22-01feec83adf6 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:19:16.840241 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-59f88661-4f1f-4b0d-b908-e5e59417e678 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments/3e108240-ca0f-49c8-940c-685b527c28c7" status: 202 len: 0 microversion: 2.1 time: 0.172081 Jul 20 05:19:16.840847 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3553/7206] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 05:19:16 2022] DELETE /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments/3e108240-ca0f-49c8-940c-685b527c28c7 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:19:16.848198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:16.849390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:16.854039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-892808ba-d5eb-49c2-9741-512ffa352824 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:16.855300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-892808ba-d5eb-49c2-9741-512ffa352824 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:16.866907 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-892808ba-d5eb-49c2-9741-512ffa352824 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:16.867382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-892808ba-d5eb-49c2-9741-512ffa352824 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:16.868202 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-892808ba-d5eb-49c2-9741-512ffa352824 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:16.868657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-892808ba-d5eb-49c2-9741-512ffa352824 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:16.902658 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-892808ba-d5eb-49c2-9741-512ffa352824 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056875 Jul 20 05:19:16.903246 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3654/7207] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:19:16 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:17.916812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b15f1131-ec81-4fc7-8b99-4bea513d6416 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:17.917831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b15f1131-ec81-4fc7-8b99-4bea513d6416 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:17.924209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b15f1131-ec81-4fc7-8b99-4bea513d6416 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:17.924665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b15f1131-ec81-4fc7-8b99-4bea513d6416 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:17.925431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b15f1131-ec81-4fc7-8b99-4bea513d6416 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:17.925871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b15f1131-ec81-4fc7-8b99-4bea513d6416 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:17.957991 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b15f1131-ec81-4fc7-8b99-4bea513d6416 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047307 Jul 20 05:19:17.959576 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3554/7208] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:19:17 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:18.970602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a817b3e-92ef-4361-b78b-3d9e5366b01f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:18.971601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a817b3e-92ef-4361-b78b-3d9e5366b01f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:18.979870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a817b3e-92ef-4361-b78b-3d9e5366b01f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:18.980320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a817b3e-92ef-4361-b78b-3d9e5366b01f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:18.981101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a817b3e-92ef-4361-b78b-3d9e5366b01f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:18.981550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a817b3e-92ef-4361-b78b-3d9e5366b01f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:19.015064 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a817b3e-92ef-4361-b78b-3d9e5366b01f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048516 Jul 20 05:19:19.015663 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3655/7209] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:19:18 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:20.026996 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-656b9847-a30a-438b-ad7d-d2101a01c1fc tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:20.027814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-656b9847-a30a-438b-ad7d-d2101a01c1fc tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:20.034723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-656b9847-a30a-438b-ad7d-d2101a01c1fc tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:20.035183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-656b9847-a30a-438b-ad7d-d2101a01c1fc tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:20.035987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-656b9847-a30a-438b-ad7d-d2101a01c1fc tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:20.037126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-656b9847-a30a-438b-ad7d-d2101a01c1fc tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:20.067349 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-656b9847-a30a-438b-ad7d-d2101a01c1fc tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044675 Jul 20 05:19:20.068299 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3555/7210] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:19:20 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:21.079337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6185824e-fde8-49a6-bd2f-8b7c9c9e6375 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:21.080373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6185824e-fde8-49a6-bd2f-8b7c9c9e6375 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:21.089224 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6185824e-fde8-49a6-bd2f-8b7c9c9e6375 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:21.089695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6185824e-fde8-49a6-bd2f-8b7c9c9e6375 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:21.090487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6185824e-fde8-49a6-bd2f-8b7c9c9e6375 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:21.090943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6185824e-fde8-49a6-bd2f-8b7c9c9e6375 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:21.125193 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6185824e-fde8-49a6-bd2f-8b7c9c9e6375 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049815 Jul 20 05:19:21.125783 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3656/7211] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:19:21 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:22.137218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-78ea4071-da88-4956-8f3c-c653dc9f22b2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:22.138152 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-78ea4071-da88-4956-8f3c-c653dc9f22b2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:22.145196 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78ea4071-da88-4956-8f3c-c653dc9f22b2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:22.146278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78ea4071-da88-4956-8f3c-c653dc9f22b2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:22.147205 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78ea4071-da88-4956-8f3c-c653dc9f22b2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:22.147677 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78ea4071-da88-4956-8f3c-c653dc9f22b2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:22.176502 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-78ea4071-da88-4956-8f3c-c653dc9f22b2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043183 Jul 20 05:19:22.177011 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3556/7212] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:19:22 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:19:22.186772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f21f9d9e-d243-40a6-b892-d86217c4fbd8 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:22.187388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f21f9d9e-d243-40a6-b892-d86217c4fbd8 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:22.194739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f21f9d9e-d243-40a6-b892-d86217c4fbd8 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:22.195198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f21f9d9e-d243-40a6-b892-d86217c4fbd8 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:22.196001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f21f9d9e-d243-40a6-b892-d86217c4fbd8 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:22.196448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f21f9d9e-d243-40a6-b892-d86217c4fbd8 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:22.274338 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-f21f9d9e-d243-40a6-b892-d86217c4fbd8 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] HTTP exception thrown: Instance d68edcdb-d3eb-4102-af22-01feec83adf6 is not attached to volume 3e108240-ca0f-49c8-940c-685b527c28c7 Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f21f9d9e-d243-40a6-b892-d86217c4fbd8 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Request method failure captured: Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments/3e108240-ca0f-49c8-940c-685b527c28c7 HTTP/1.1 Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi15A4k97twgHDz1OzGiJPO4BCE2_FRI9adBqauuzmqpl1nT-OBF9yMsPSPLzRsDNAU-cXoOvttfPrQ7JrsQbHGNJRt1KhpDrOnZhWvYnE1Eo_TWeGXJVtTOqsx71OoJ9e_Wx0SAhlAe_H1cMialCO_zCdmNI2vEEC4wylbACF-JgWBZM Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 9c4e2d9e82d54175adffc5f6807f3030 Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2063922949 Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c4e2d9e82d54175adffc5f6807f3030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c4e2d9e82d54175adffc5f6807f3030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c4e2d9e82d54175adffc5f6807f3030", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c4e2d9e82d54175adffc5f6807f3030"}]}] Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestEncryptedCinderVolumes-2063922949 Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 9c4e2d9e82d54175adffc5f6807f3030 Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2063922949 Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestEncryptedCinderVolumes-2063922949-project Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 953dd7032efb41a3ba720dd68b31687e Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestEncryptedCinderVolumes-2063922949-project Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance d68edcdb-d3eb-4102-af22-01feec83adf6 is not attached to volume 3e108240-ca0f-49c8-940c-685b527c28c7 Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'server_id': 'd68edcdb-d3eb-4102-af22-01feec83adf6', 'id': '3e108240-ca0f-49c8-940c-685b527c28c7'} Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3e108240-ca0f-49c8-940c-685b527c28c7. Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d68edcdb-d3eb-4102-af22-01feec83adf6 is not attached to volume 3e108240-ca0f-49c8-940c-685b527c28c7 Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:19:22.278449 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:19:22.282703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:19:22.282703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:19:22.282703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d68edcdb-d3eb-4102-af22-01feec83adf6 is not attached to volume 3e108240-ca0f-49c8-940c-685b527c28c7 Jul 20 05:19:22.282703 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:22.282703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f21f9d9e-d243-40a6-b892-d86217c4fbd8 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Returning 404 to user: Instance d68edcdb-d3eb-4102-af22-01feec83adf6 is not attached to volume 3e108240-ca0f-49c8-940c-685b527c28c7 {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:19:22.282703 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f21f9d9e-d243-40a6-b892-d86217c4fbd8 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments/3e108240-ca0f-49c8-940c-685b527c28c7" status: 404 len: 154 microversion: 2.1 time: 0.097150 Jul 20 05:19:22.282703 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3657/7213] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 05:19:22 2022] DELETE /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6/os-volume_attachments/3e108240-ca0f-49c8-940c-685b527c28c7 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:19:25.616200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-60e230e0-7600-4666-b18b-9fc766a2a120 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:25.616701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-60e230e0-7600-4666-b18b-9fc766a2a120 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:25.623670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60e230e0-7600-4666-b18b-9fc766a2a120 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:25.624132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60e230e0-7600-4666-b18b-9fc766a2a120 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:25.624902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60e230e0-7600-4666-b18b-9fc766a2a120 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:25.625349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60e230e0-7600-4666-b18b-9fc766a2a120 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:25.655566 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-60e230e0-7600-4666-b18b-9fc766a2a120 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:19:25.738601 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-60e230e0-7600-4666-b18b-9fc766a2a120 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 204 len: 0 microversion: 2.1 time: 0.126010 Jul 20 05:19:25.739306 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3557/7214] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:19:25 2022] DELETE /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:19:25.749333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0b66a9ed-72ca-4547-8384-7f83e6a5b76a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:25.750334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0b66a9ed-72ca-4547-8384-7f83e6a5b76a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:25.759898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b66a9ed-72ca-4547-8384-7f83e6a5b76a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:25.760366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b66a9ed-72ca-4547-8384-7f83e6a5b76a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:25.761296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b66a9ed-72ca-4547-8384-7f83e6a5b76a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:25.761750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0b66a9ed-72ca-4547-8384-7f83e6a5b76a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:26.010398 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0b66a9ed-72ca-4547-8384-7f83e6a5b76a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:26.018061 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0b66a9ed-72ca-4547-8384-7f83e6a5b76a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1562 microversion: 2.1 time: 0.273707 Jul 20 05:19:26.018642 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3658/7215] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:25 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1562 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:27.034930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-22ba6f13-36e5-4a4e-9592-16fa4cb02365 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:27.035790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-22ba6f13-36e5-4a4e-9592-16fa4cb02365 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:27.043106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22ba6f13-36e5-4a4e-9592-16fa4cb02365 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:27.043687 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22ba6f13-36e5-4a4e-9592-16fa4cb02365 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:27.044557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22ba6f13-36e5-4a4e-9592-16fa4cb02365 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:27.045479 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-22ba6f13-36e5-4a4e-9592-16fa4cb02365 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:27.277153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-22ba6f13-36e5-4a4e-9592-16fa4cb02365 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:27.284837 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-22ba6f13-36e5-4a4e-9592-16fa4cb02365 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1562 microversion: 2.1 time: 0.254324 Jul 20 05:19:27.285421 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3558/7216] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:27 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1562 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:28.075154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-3f5affc0-7a80-4dd5-81c1-cb6da4934145 req-4e664c38-fdb9-48e0-b5c2-fcdd2253843d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68edcdb-d3eb-4102-af22-01feec83adf6", "name": "network-vif-deleted", "tag": "a1f79e2e-dd30-4998-93d0-da57a47f5491"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:28.086080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3f5affc0-7a80-4dd5-81c1-cb6da4934145 req-4e664c38-fdb9-48e0-b5c2-fcdd2253843d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:28.086638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3f5affc0-7a80-4dd5-81c1-cb6da4934145 req-4e664c38-fdb9-48e0-b5c2-fcdd2253843d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:28.100082 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-3f5affc0-7a80-4dd5-81c1-cb6da4934145 req-4e664c38-fdb9-48e0-b5c2-fcdd2253843d service nova] Creating event network-vif-deleted:a1f79e2e-dd30-4998-93d0-da57a47f5491 for instance d68edcdb-d3eb-4102-af22-01feec83adf6 on n-h1-764485-11 Jul 20 05:19:28.106330 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-3f5affc0-7a80-4dd5-81c1-cb6da4934145 req-4e664c38-fdb9-48e0-b5c2-fcdd2253843d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034463 Jul 20 05:19:28.107244 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3659/7217] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:28.302859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e13f3947-8324-46ac-8fe6-3c556f7c9882 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:28.303481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e13f3947-8324-46ac-8fe6-3c556f7c9882 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:28.310645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e13f3947-8324-46ac-8fe6-3c556f7c9882 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:28.311099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e13f3947-8324-46ac-8fe6-3c556f7c9882 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:28.311902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e13f3947-8324-46ac-8fe6-3c556f7c9882 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:28.312343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e13f3947-8324-46ac-8fe6-3c556f7c9882 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:28.342842 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e13f3947-8324-46ac-8fe6-3c556f7c9882 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:28.343287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e13f3947-8324-46ac-8fe6-3c556f7c9882 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:28.343762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-e13f3947-8324-46ac-8fe6-3c556f7c9882 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lazy-loading 'fault' on Instance uuid d68edcdb-d3eb-4102-af22-01feec83adf6 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:19:28.389501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e13f3947-8324-46ac-8fe6-3c556f7c9882 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:28.397880 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e13f3947-8324-46ac-8fe6-3c556f7c9882 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 200 len: 1353 microversion: 2.1 time: 0.099592 Jul 20 05:19:28.398470 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3559/7218] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:28 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 1353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:29.416228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1e71cbd5-8399-41d1-bb30-16a072fe78e7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:29.416854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1e71cbd5-8399-41d1-bb30-16a072fe78e7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: d68edcdb-d3eb-4102-af22-01feec83adf6] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:29.423148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e71cbd5-8399-41d1-bb30-16a072fe78e7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:29.423657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e71cbd5-8399-41d1-bb30-16a072fe78e7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:29.424434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e71cbd5-8399-41d1-bb30-16a072fe78e7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:29.424888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1e71cbd5-8399-41d1-bb30-16a072fe78e7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:29.440800 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-1e71cbd5-8399-41d1-bb30-16a072fe78e7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] HTTP exception thrown: Instance d68edcdb-d3eb-4102-af22-01feec83adf6 could not be found. Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1e71cbd5-8399-41d1-bb30-16a072fe78e7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Request method failure captured: Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 HTTP/1.1 Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi15A4k97twgHDz1OzGiJPO4BCE2_FRI9adBqauuzmqpl1nT-OBF9yMsPSPLzRsDNAU-cXoOvttfPrQ7JrsQbHGNJRt1KhpDrOnZhWvYnE1Eo_TWeGXJVtTOqsx71OoJ9e_Wx0SAhlAe_H1cMialCO_zCdmNI2vEEC4wylbACF-JgWBZM Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 9c4e2d9e82d54175adffc5f6807f3030 Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2063922949 Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c4e2d9e82d54175adffc5f6807f3030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c4e2d9e82d54175adffc5f6807f3030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c4e2d9e82d54175adffc5f6807f3030", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c4e2d9e82d54175adffc5f6807f3030"}]}] Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestEncryptedCinderVolumes-2063922949 Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 9c4e2d9e82d54175adffc5f6807f3030 Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2063922949 Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestEncryptedCinderVolumes-2063922949-project Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 953dd7032efb41a3ba720dd68b31687e Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestEncryptedCinderVolumes-2063922949-project Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance d68edcdb-d3eb-4102-af22-01feec83adf6 could not be found. Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'd68edcdb-d3eb-4102-af22-01feec83adf6'} Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d68edcdb-d3eb-4102-af22-01feec83adf6 could not be found. Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d68edcdb-d3eb-4102-af22-01feec83adf6 could not be found. Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:19:29.443079 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:29.447881 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:19:29.447881 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:19:29.447881 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:19:29.447881 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:19:29.447881 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:19:29.447881 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d68edcdb-d3eb-4102-af22-01feec83adf6 could not be found. Jul 20 05:19:29.447881 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:29.447881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1e71cbd5-8399-41d1-bb30-16a072fe78e7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Returning 404 to user: Instance d68edcdb-d3eb-4102-af22-01feec83adf6 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:19:29.447881 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1e71cbd5-8399-41d1-bb30-16a072fe78e7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6" status: 404 len: 111 microversion: 2.1 time: 0.033841 Jul 20 05:19:29.447881 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3660/7219] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:29 2022] GET /compute/v2.1/servers/d68edcdb-d3eb-4102-af22-01feec83adf6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:19:29.453227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-07b077f2-cfe2-466d-91d0-ef2bcfb5e45b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '.version_select at 0x7fbf9d545f70>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:29.472506 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-07b077f2-cfe2-466d-91d0-ef2bcfb5e45b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1047644951" status: 202 len: 0 microversion: 2.1 time: 0.023068 Jul 20 05:19:29.473088 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3560/7220] 10.222.0.20 () {58 vars in 1277 bytes} [Wed Jul 20 05:19:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1047644951 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:19:29.491408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-330ad3b9-fe06-40f8-be1c-325e11e30d45 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Action: 'create', calling method: .version_select at 0x7fbf9c5d23a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-337007213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6dmkALGFl4xrtiuEiDMYxvm/evY8eFVDzbCzdru4lA+Okss5PNMspHZ7MFhEMw+mzanlNK2csn3SVtVv1Eck0cOjD5HR+rze2nH2p68R3VkPWBR5jGqCxrL77xQoIVmw=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:29.511274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-330ad3b9-fe06-40f8-be1c-325e11e30d45 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Getting quotas for project 9c4e2d9e82d54175adffc5f6807f3030. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:19:29.517001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-330ad3b9-fe06-40f8-be1c-325e11e30d45 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Getting quotas for user 953dd7032efb41a3ba720dd68b31687e and project 9c4e2d9e82d54175adffc5f6807f3030. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:19:29.540264 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-330ad3b9-fe06-40f8-be1c-325e11e30d45 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.053930 Jul 20 05:19:29.540869 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3661/7221] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:19:29 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:29.596200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1664597629", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-337007213", "networks": [{"uuid": "4f80ad55-a7e1-4c25-bf5f-7f128ad52d66"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:29.652544 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] validate_networks() for [('4f80ad55-a7e1-4c25-bf5f-7f128ad52d66', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:19:30.017972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:19:30.018440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:19:30.018994 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:19:30.019418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:19:30.019868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:19:30.029721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:30.030179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:30.030990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:30.031439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:30.048902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Getting quotas for project 9c4e2d9e82d54175adffc5f6807f3030. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:19:30.054169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Getting quotas for user 953dd7032efb41a3ba720dd68b31687e and project 9c4e2d9e82d54175adffc5f6807f3030. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:19:30.066484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:19:30.069037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:19:30.114595 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-299b5041-271a-4604-8fd3-ea56f4280771 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522390 Jul 20 05:19:30.115268 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3561/7222] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:19:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:19:30.125150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-aa3274db-45bf-4cd7-8803-36aea253854f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:30.125788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-aa3274db-45bf-4cd7-8803-36aea253854f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:30.183078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-aa3274db-45bf-4cd7-8803-36aea253854f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:30.190657 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-aa3274db-45bf-4cd7-8803-36aea253854f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1262 microversion: 2.1 time: 0.069422 Jul 20 05:19:30.191234 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3662/7223] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:30 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:31.210161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b287b4b5-1129-41b1-abae-0332e6981fee tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:31.210909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b287b4b5-1129-41b1-abae-0332e6981fee tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:31.218542 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b287b4b5-1129-41b1-abae-0332e6981fee tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:31.219041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b287b4b5-1129-41b1-abae-0332e6981fee tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:31.219854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b287b4b5-1129-41b1-abae-0332e6981fee tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:31.220299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b287b4b5-1129-41b1-abae-0332e6981fee tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:31.317295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b287b4b5-1129-41b1-abae-0332e6981fee tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:31.324985 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b287b4b5-1129-41b1-abae-0332e6981fee tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1320 microversion: 2.1 time: 0.120101 Jul 20 05:19:31.325579 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3562/7224] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:31 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1320 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:32.342418 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14bc1fc4-84ba-4877-acd6-b0264a7e4f0f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:32.343144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-14bc1fc4-84ba-4877-acd6-b0264a7e4f0f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:32.350825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14bc1fc4-84ba-4877-acd6-b0264a7e4f0f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:32.351393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14bc1fc4-84ba-4877-acd6-b0264a7e4f0f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:32.352102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14bc1fc4-84ba-4877-acd6-b0264a7e4f0f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:32.352565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14bc1fc4-84ba-4877-acd6-b0264a7e4f0f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:32.580047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-14bc1fc4-84ba-4877-acd6-b0264a7e4f0f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:32.589368 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-14bc1fc4-84ba-4877-acd6-b0264a7e4f0f tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1362 microversion: 2.1 time: 0.250877 Jul 20 05:19:32.590286 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3663/7225] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:32 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:32.727367 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-9919f6ac-2700-4ff8-aed1-a1f9722ca50b req-5646b26c-75f1-4a04-8cb6-2b84d37b8e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8656a5ec-cfb6-4ea2-a273-1a19b40d506d", "tag": "b5841091-06a4-404f-93ec-c38d8d26785b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:32.741469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9919f6ac-2700-4ff8-aed1-a1f9722ca50b req-5646b26c-75f1-4a04-8cb6-2b84d37b8e27 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:32.742071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-9919f6ac-2700-4ff8-aed1-a1f9722ca50b req-5646b26c-75f1-4a04-8cb6-2b84d37b8e27 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:32.755721 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-9919f6ac-2700-4ff8-aed1-a1f9722ca50b req-5646b26c-75f1-4a04-8cb6-2b84d37b8e27 service nova] Creating event network-changed:b5841091-06a4-404f-93ec-c38d8d26785b for instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d on n-h1-764485-11 Jul 20 05:19:32.760956 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-9919f6ac-2700-4ff8-aed1-a1f9722ca50b req-5646b26c-75f1-4a04-8cb6-2b84d37b8e27 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040484 Jul 20 05:19:32.761585 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3563/7226] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:19:33.606358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-76405aca-89dc-4799-a136-7e029c92a208 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:33.606994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-76405aca-89dc-4799-a136-7e029c92a208 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:33.614850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76405aca-89dc-4799-a136-7e029c92a208 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:33.615485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76405aca-89dc-4799-a136-7e029c92a208 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:33.616293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76405aca-89dc-4799-a136-7e029c92a208 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:33.616753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76405aca-89dc-4799-a136-7e029c92a208 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:33.747309 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-76405aca-89dc-4799-a136-7e029c92a208 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:33.755528 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-76405aca-89dc-4799-a136-7e029c92a208 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1362 microversion: 2.1 time: 0.152446 Jul 20 05:19:33.756116 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3664/7227] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:33 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:34.774598 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4eba0b78-7d8e-492e-b3c4-d387a6c33eb2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:34.775297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4eba0b78-7d8e-492e-b3c4-d387a6c33eb2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:34.781891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4eba0b78-7d8e-492e-b3c4-d387a6c33eb2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:34.782338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4eba0b78-7d8e-492e-b3c4-d387a6c33eb2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:34.783098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4eba0b78-7d8e-492e-b3c4-d387a6c33eb2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:34.783558 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4eba0b78-7d8e-492e-b3c4-d387a6c33eb2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:34.920198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4eba0b78-7d8e-492e-b3c4-d387a6c33eb2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:34.928021 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4eba0b78-7d8e-492e-b3c4-d387a6c33eb2 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1362 microversion: 2.1 time: 0.159265 Jul 20 05:19:34.928617 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3564/7228] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:34 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:35.945546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c15c4eb2-a1e7-47e2-b3e1-d7cd08871f82 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:35.946120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c15c4eb2-a1e7-47e2-b3e1-d7cd08871f82 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:35.953053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c15c4eb2-a1e7-47e2-b3e1-d7cd08871f82 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:35.953514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c15c4eb2-a1e7-47e2-b3e1-d7cd08871f82 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:35.954283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c15c4eb2-a1e7-47e2-b3e1-d7cd08871f82 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:35.954740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c15c4eb2-a1e7-47e2-b3e1-d7cd08871f82 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:36.088839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c15c4eb2-a1e7-47e2-b3e1-d7cd08871f82 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:36.096188 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c15c4eb2-a1e7-47e2-b3e1-d7cd08871f82 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1362 microversion: 2.1 time: 0.155272 Jul 20 05:19:36.096758 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3665/7229] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:35 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:37.113192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b69c6283-067b-4de0-8cb6-75487b81732b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:37.114194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b69c6283-067b-4de0-8cb6-75487b81732b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:37.121180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b69c6283-067b-4de0-8cb6-75487b81732b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:37.121641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b69c6283-067b-4de0-8cb6-75487b81732b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:37.122441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b69c6283-067b-4de0-8cb6-75487b81732b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:37.122882 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b69c6283-067b-4de0-8cb6-75487b81732b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:37.258889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b69c6283-067b-4de0-8cb6-75487b81732b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:37.266837 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b69c6283-067b-4de0-8cb6-75487b81732b tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1362 microversion: 2.1 time: 0.157551 Jul 20 05:19:37.267412 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3565/7230] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:37 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:38.283942 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9c959032-417d-408a-9838-460468df0323 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:38.284577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9c959032-417d-408a-9838-460468df0323 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:38.292352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c959032-417d-408a-9838-460468df0323 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:38.292826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c959032-417d-408a-9838-460468df0323 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:38.293611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c959032-417d-408a-9838-460468df0323 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:38.294066 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9c959032-417d-408a-9838-460468df0323 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:38.323586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-82cc4c3d-ebc5-4603-8beb-dee03188b290 req-236c9699-346b-4cba-9a1d-495b036d2c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8656a5ec-cfb6-4ea2-a273-1a19b40d506d", "name": "network-vif-plugged", "status": "completed", "tag": "b5841091-06a4-404f-93ec-c38d8d26785b"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:38.334554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-82cc4c3d-ebc5-4603-8beb-dee03188b290 req-236c9699-346b-4cba-9a1d-495b036d2c2e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:38.335010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-82cc4c3d-ebc5-4603-8beb-dee03188b290 req-236c9699-346b-4cba-9a1d-495b036d2c2e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:38.349713 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-82cc4c3d-ebc5-4603-8beb-dee03188b290 req-236c9699-346b-4cba-9a1d-495b036d2c2e service nova] Creating event network-vif-plugged:b5841091-06a4-404f-93ec-c38d8d26785b for instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d on n-h1-764485-11 Jul 20 05:19:38.354932 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-82cc4c3d-ebc5-4603-8beb-dee03188b290 req-236c9699-346b-4cba-9a1d-495b036d2c2e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035522 Jul 20 05:19:38.355763 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3566/7231] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:38.484016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9c959032-417d-408a-9838-460468df0323 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:38.493060 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9c959032-417d-408a-9838-460468df0323 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1362 microversion: 2.1 time: 0.212935 Jul 20 05:19:38.493770 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3666/7232] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:38 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:39.511590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-368c411c-2bf7-41ff-a5f0-6d78aeba2a44 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:39.513498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-368c411c-2bf7-41ff-a5f0-6d78aeba2a44 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:39.519123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-368c411c-2bf7-41ff-a5f0-6d78aeba2a44 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:39.519609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-368c411c-2bf7-41ff-a5f0-6d78aeba2a44 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:39.520580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-368c411c-2bf7-41ff-a5f0-6d78aeba2a44 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:39.521020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-368c411c-2bf7-41ff-a5f0-6d78aeba2a44 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:39.658110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-368c411c-2bf7-41ff-a5f0-6d78aeba2a44 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:39.666609 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-368c411c-2bf7-41ff-a5f0-6d78aeba2a44 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1362 microversion: 2.1 time: 0.160907 Jul 20 05:19:39.667194 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3567/7233] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:39 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:40.683993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44b7b8f5-4ef2-4ace-81fa-8d3d3d452114 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:40.684618 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44b7b8f5-4ef2-4ace-81fa-8d3d3d452114 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:40.687414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:40.693556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44b7b8f5-4ef2-4ace-81fa-8d3d3d452114 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:40.694013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44b7b8f5-4ef2-4ace-81fa-8d3d3d452114 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:40.694784 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44b7b8f5-4ef2-4ace-81fa-8d3d3d452114 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:40.695232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44b7b8f5-4ef2-4ace-81fa-8d3d3d452114 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:40.825544 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-44b7b8f5-4ef2-4ace-81fa-8d3d3d452114 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:40.832996 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44b7b8f5-4ef2-4ace-81fa-8d3d3d452114 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1555 microversion: 2.1 time: 0.152894 Jul 20 05:19:40.833686 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3667/7234] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:40 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:40.849465 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c77114e3-8cba-4b88-bb53-b7d1506ad3f7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:40.850188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c77114e3-8cba-4b88-bb53-b7d1506ad3f7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:40.852166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:40.853317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:40.860701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c77114e3-8cba-4b88-bb53-b7d1506ad3f7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:40.861140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c77114e3-8cba-4b88-bb53-b7d1506ad3f7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:40.861916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c77114e3-8cba-4b88-bb53-b7d1506ad3f7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:40.862351 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c77114e3-8cba-4b88-bb53-b7d1506ad3f7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:40.992669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c77114e3-8cba-4b88-bb53-b7d1506ad3f7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:41.000187 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c77114e3-8cba-4b88-bb53-b7d1506ad3f7 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1555 microversion: 2.1 time: 0.155152 Jul 20 05:19:41.000760 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3568/7235] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:40 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:42.464217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3828dea8-938f-46bd-b96b-39855e0c2a70 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e42eddd-a0b3-4d93-9c22-9972b496b0cc"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:42.465365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3828dea8-938f-46bd-b96b-39855e0c2a70 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:42.472328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3828dea8-938f-46bd-b96b-39855e0c2a70 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:42.472799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3828dea8-938f-46bd-b96b-39855e0c2a70 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:42.474249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3828dea8-938f-46bd-b96b-39855e0c2a70 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:42.474716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3828dea8-938f-46bd-b96b-39855e0c2a70 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:42.715651 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3828dea8-938f-46bd-b96b-39855e0c2a70 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "POST /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255304 Jul 20 05:19:42.716336 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3668/7236] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 05:19:42 2022] POST /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:53.373037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-33617c3a-5f93-428f-b1d5-a2f478dbf730 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:53.373573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-33617c3a-5f93-428f-b1d5-a2f478dbf730 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:53.375941 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:53.376725 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:53.384165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33617c3a-5f93-428f-b1d5-a2f478dbf730 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:53.384720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33617c3a-5f93-428f-b1d5-a2f478dbf730 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:53.385490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33617c3a-5f93-428f-b1d5-a2f478dbf730 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:53.385930 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-33617c3a-5f93-428f-b1d5-a2f478dbf730 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:53.470653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-33617c3a-5f93-428f-b1d5-a2f478dbf730 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lazy-loading 'services' on Instance uuid 8656a5ec-cfb6-4ea2-a273-1a19b40d506d {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:19:53.541270 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-33617c3a-5f93-428f-b1d5-a2f478dbf730 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments/9e42eddd-a0b3-4d93-9c22-9972b496b0cc" status: 202 len: 0 microversion: 2.1 time: 0.172154 Jul 20 05:19:53.541948 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3569/7237] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 05:19:53 2022] DELETE /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments/9e42eddd-a0b3-4d93-9c22-9972b496b0cc => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:19:53.551657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5011c537-8c3c-4f19-b9ab-88e02de9d775 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:53.552731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5011c537-8c3c-4f19-b9ab-88e02de9d775 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:53.555791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:53.556504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:53.563145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5011c537-8c3c-4f19-b9ab-88e02de9d775 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:53.563781 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5011c537-8c3c-4f19-b9ab-88e02de9d775 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:53.564573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5011c537-8c3c-4f19-b9ab-88e02de9d775 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:53.565024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5011c537-8c3c-4f19-b9ab-88e02de9d775 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:53.600697 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5011c537-8c3c-4f19-b9ab-88e02de9d775 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053998 Jul 20 05:19:53.601151 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3669/7238] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:19:53 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:54.614734 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b703a25-a6b1-4a49-b5eb-7a1bd889f262 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:54.615814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7b703a25-a6b1-4a49-b5eb-7a1bd889f262 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:54.622380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b703a25-a6b1-4a49-b5eb-7a1bd889f262 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:54.622848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b703a25-a6b1-4a49-b5eb-7a1bd889f262 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:54.623654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b703a25-a6b1-4a49-b5eb-7a1bd889f262 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:54.624105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b703a25-a6b1-4a49-b5eb-7a1bd889f262 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:54.656986 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7b703a25-a6b1-4a49-b5eb-7a1bd889f262 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048421 Jul 20 05:19:54.657572 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3570/7239] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:19:54 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:55.669583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b57d1d57-14ad-4973-87f0-89c2ce5a3ce4 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:55.670550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b57d1d57-14ad-4973-87f0-89c2ce5a3ce4 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:55.678812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b57d1d57-14ad-4973-87f0-89c2ce5a3ce4 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:55.679279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b57d1d57-14ad-4973-87f0-89c2ce5a3ce4 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:55.680105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b57d1d57-14ad-4973-87f0-89c2ce5a3ce4 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:55.680564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b57d1d57-14ad-4973-87f0-89c2ce5a3ce4 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:55.714250 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b57d1d57-14ad-4973-87f0-89c2ce5a3ce4 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048110 Jul 20 05:19:55.714560 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3670/7240] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:19:55 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:56.725846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4fe07427-a0d6-4b88-b7d1-45e5f3012628 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:56.726822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4fe07427-a0d6-4b88-b7d1-45e5f3012628 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:56.733848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fe07427-a0d6-4b88-b7d1-45e5f3012628 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:56.734271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fe07427-a0d6-4b88-b7d1-45e5f3012628 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:56.735032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fe07427-a0d6-4b88-b7d1-45e5f3012628 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:56.735468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4fe07427-a0d6-4b88-b7d1-45e5f3012628 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:56.765564 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4fe07427-a0d6-4b88-b7d1-45e5f3012628 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044687 Jul 20 05:19:56.766134 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3571/7241] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:19:56 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:57.777130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0440e442-6edb-48da-9589-fead3e2eba73 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:57.778100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0440e442-6edb-48da-9589-fead3e2eba73 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:57.785260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0440e442-6edb-48da-9589-fead3e2eba73 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:57.786363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0440e442-6edb-48da-9589-fead3e2eba73 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:57.787146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0440e442-6edb-48da-9589-fead3e2eba73 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:57.787628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0440e442-6edb-48da-9589-fead3e2eba73 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:57.817541 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0440e442-6edb-48da-9589-fead3e2eba73 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Jul 20 05:19:57.818120 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3671/7242] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:19:57 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:58.829309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7cf71d26-557d-4603-a07a-fff8c258aa1c tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:58.830267 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7cf71d26-557d-4603-a07a-fff8c258aa1c tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:58.837623 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7cf71d26-557d-4603-a07a-fff8c258aa1c tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:58.838078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7cf71d26-557d-4603-a07a-fff8c258aa1c tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:58.838847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7cf71d26-557d-4603-a07a-fff8c258aa1c tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:58.839292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7cf71d26-557d-4603-a07a-fff8c258aa1c tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:58.869881 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7cf71d26-557d-4603-a07a-fff8c258aa1c tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044668 Jul 20 05:19:58.870447 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3572/7243] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:19:58 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:19:58.880705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db64ae91-0bd0-4f7b-abcf-5f9b7bf14d48 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:58.881264 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-db64ae91-0bd0-4f7b-abcf-5f9b7bf14d48 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:58.888471 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db64ae91-0bd0-4f7b-abcf-5f9b7bf14d48 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:58.888930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db64ae91-0bd0-4f7b-abcf-5f9b7bf14d48 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:58.889731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db64ae91-0bd0-4f7b-abcf-5f9b7bf14d48 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:58.890176 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-db64ae91-0bd0-4f7b-abcf-5f9b7bf14d48 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:58.965516 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-db64ae91-0bd0-4f7b-abcf-5f9b7bf14d48 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] HTTP exception thrown: Instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d is not attached to volume 9e42eddd-a0b3-4d93-9c22-9972b496b0cc Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db64ae91-0bd0-4f7b-abcf-5f9b7bf14d48 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Request method failure captured: Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments/9e42eddd-a0b3-4d93-9c22-9972b496b0cc HTTP/1.1 Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi15A4k97twgHDz1OzGiJPO4BCE2_FRI9adBqauuzmqpl1nT-OBF9yMsPSPLzRsDNAU-cXoOvttfPrQ7JrsQbHGNJRt1KhpDrOnZhWvYnE1Eo_TWeGXJVtTOqsx71OoJ9e_Wx0SAhlAe_H1cMialCO_zCdmNI2vEEC4wylbACF-JgWBZM Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 9c4e2d9e82d54175adffc5f6807f3030 Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2063922949 Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c4e2d9e82d54175adffc5f6807f3030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c4e2d9e82d54175adffc5f6807f3030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c4e2d9e82d54175adffc5f6807f3030", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c4e2d9e82d54175adffc5f6807f3030"}]}] Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestEncryptedCinderVolumes-2063922949 Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 9c4e2d9e82d54175adffc5f6807f3030 Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2063922949 Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestEncryptedCinderVolumes-2063922949-project Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 953dd7032efb41a3ba720dd68b31687e Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestEncryptedCinderVolumes-2063922949-project Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d is not attached to volume 9e42eddd-a0b3-4d93-9c22-9972b496b0cc Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'server_id': '8656a5ec-cfb6-4ea2-a273-1a19b40d506d', 'id': '9e42eddd-a0b3-4d93-9c22-9972b496b0cc'} Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9e42eddd-a0b3-4d93-9c22-9972b496b0cc. Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d is not attached to volume 9e42eddd-a0b3-4d93-9c22-9972b496b0cc Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:19:58.967164 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:19:58.971373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:19:58.971373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:19:58.971373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d is not attached to volume 9e42eddd-a0b3-4d93-9c22-9972b496b0cc Jul 20 05:19:58.971373 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:19:58.971373 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-db64ae91-0bd0-4f7b-abcf-5f9b7bf14d48 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Returning 404 to user: Instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d is not attached to volume 9e42eddd-a0b3-4d93-9c22-9972b496b0cc {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:19:58.971373 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-db64ae91-0bd0-4f7b-abcf-5f9b7bf14d48 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments/9e42eddd-a0b3-4d93-9c22-9972b496b0cc" status: 404 len: 154 microversion: 2.1 time: 0.092088 Jul 20 05:19:58.971373 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3672/7244] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 05:19:58 2022] DELETE /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d/os-volume_attachments/9e42eddd-a0b3-4d93-9c22-9972b496b0cc => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:20:02.294640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b13a0974-ada2-4784-a670-d87f1d7d768e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:02.295186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b13a0974-ada2-4784-a670-d87f1d7d768e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:02.302041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b13a0974-ada2-4784-a670-d87f1d7d768e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:02.302498 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b13a0974-ada2-4784-a670-d87f1d7d768e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:02.303646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b13a0974-ada2-4784-a670-d87f1d7d768e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:02.304100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b13a0974-ada2-4784-a670-d87f1d7d768e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:02.328814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b13a0974-ada2-4784-a670-d87f1d7d768e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:20:02.414515 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b13a0974-ada2-4784-a670-d87f1d7d768e tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 204 len: 0 microversion: 2.1 time: 0.123335 Jul 20 05:20:02.415054 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3573/7245] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:20:02 2022] DELETE /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:20:02.425411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-14f85f71-9c64-4568-ba6e-a2bff44411cb tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:02.426047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-14f85f71-9c64-4568-ba6e-a2bff44411cb tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:02.435196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14f85f71-9c64-4568-ba6e-a2bff44411cb tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:02.435196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14f85f71-9c64-4568-ba6e-a2bff44411cb tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:02.435940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14f85f71-9c64-4568-ba6e-a2bff44411cb tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:02.436325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-14f85f71-9c64-4568-ba6e-a2bff44411cb tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:02.576242 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-14f85f71-9c64-4568-ba6e-a2bff44411cb tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:02.584350 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-14f85f71-9c64-4568-ba6e-a2bff44411cb tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1561 microversion: 2.1 time: 0.163865 Jul 20 05:20:02.585062 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3673/7246] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:02 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:03.603366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3af91b74-e1a1-4cb6-b220-fb8524435a03 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:03.604109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3af91b74-e1a1-4cb6-b220-fb8524435a03 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:03.610920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3af91b74-e1a1-4cb6-b220-fb8524435a03 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:03.611374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3af91b74-e1a1-4cb6-b220-fb8524435a03 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:03.612190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3af91b74-e1a1-4cb6-b220-fb8524435a03 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:03.612633 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3af91b74-e1a1-4cb6-b220-fb8524435a03 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:03.746614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3af91b74-e1a1-4cb6-b220-fb8524435a03 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:03.754355 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3af91b74-e1a1-4cb6-b220-fb8524435a03 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1561 microversion: 2.1 time: 0.155757 Jul 20 05:20:03.754941 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3574/7247] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:03 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:04.707011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-ff783a1b-f09d-46b2-8837-43164a0caf22 req-1f00a6f6-a10a-4a4b-8bcc-0fedd421b4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8656a5ec-cfb6-4ea2-a273-1a19b40d506d", "name": "network-vif-deleted", "tag": "b5841091-06a4-404f-93ec-c38d8d26785b"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:04.716607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ff783a1b-f09d-46b2-8837-43164a0caf22 req-1f00a6f6-a10a-4a4b-8bcc-0fedd421b4f8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:04.717252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-ff783a1b-f09d-46b2-8837-43164a0caf22 req-1f00a6f6-a10a-4a4b-8bcc-0fedd421b4f8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:04.736040 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-ff783a1b-f09d-46b2-8837-43164a0caf22 req-1f00a6f6-a10a-4a4b-8bcc-0fedd421b4f8 service nova] Creating event network-vif-deleted:b5841091-06a4-404f-93ec-c38d8d26785b for instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d on n-h1-764485-11 Jul 20 05:20:04.743352 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-ff783a1b-f09d-46b2-8837-43164a0caf22 req-1f00a6f6-a10a-4a4b-8bcc-0fedd421b4f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106388 Jul 20 05:20:04.744365 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3674/7248] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:20:04.772027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4760767f-8f99-477e-bebc-db1428714a3a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:04.772738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4760767f-8f99-477e-bebc-db1428714a3a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:04.781104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4760767f-8f99-477e-bebc-db1428714a3a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:04.781510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4760767f-8f99-477e-bebc-db1428714a3a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:04.782304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4760767f-8f99-477e-bebc-db1428714a3a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:04.782757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4760767f-8f99-477e-bebc-db1428714a3a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:04.814943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4760767f-8f99-477e-bebc-db1428714a3a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:04.815402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4760767f-8f99-477e-bebc-db1428714a3a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:04.815894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-4760767f-8f99-477e-bebc-db1428714a3a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lazy-loading 'fault' on Instance uuid 8656a5ec-cfb6-4ea2-a273-1a19b40d506d {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:20:04.857954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4760767f-8f99-477e-bebc-db1428714a3a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '953dd7032efb41a3ba720dd68b31687e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e2d9e82d54175adffc5f6807f3030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:04.865900 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4760767f-8f99-477e-bebc-db1428714a3a tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 200 len: 1352 microversion: 2.1 time: 0.097813 Jul 20 05:20:04.867708 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3575/7249] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:04 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:20:05.886510 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-322c0683-5f2e-48eb-b692-0775e9ff7eaf tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:05.887230 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-322c0683-5f2e-48eb-b692-0775e9ff7eaf tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] [instance: 8656a5ec-cfb6-4ea2-a273-1a19b40d506d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:05.893449 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-322c0683-5f2e-48eb-b692-0775e9ff7eaf tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:05.893915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-322c0683-5f2e-48eb-b692-0775e9ff7eaf tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:05.894692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-322c0683-5f2e-48eb-b692-0775e9ff7eaf tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:05.895149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-322c0683-5f2e-48eb-b692-0775e9ff7eaf tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:05.908466 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-322c0683-5f2e-48eb-b692-0775e9ff7eaf tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] HTTP exception thrown: Instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d could not be found. Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-322c0683-5f2e-48eb-b692-0775e9ff7eaf tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Request method failure captured: Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d HTTP/1.1 Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi15A4k97twgHDz1OzGiJPO4BCE2_FRI9adBqauuzmqpl1nT-OBF9yMsPSPLzRsDNAU-cXoOvttfPrQ7JrsQbHGNJRt1KhpDrOnZhWvYnE1Eo_TWeGXJVtTOqsx71OoJ9e_Wx0SAhlAe_H1cMialCO_zCdmNI2vEEC4wylbACF-JgWBZM Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 9c4e2d9e82d54175adffc5f6807f3030 Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2063922949 Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c4e2d9e82d54175adffc5f6807f3030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c4e2d9e82d54175adffc5f6807f3030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c4e2d9e82d54175adffc5f6807f3030", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c4e2d9e82d54175adffc5f6807f3030"}]}] Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestEncryptedCinderVolumes-2063922949 Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 9c4e2d9e82d54175adffc5f6807f3030 Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2063922949 Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestEncryptedCinderVolumes-2063922949-project Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 953dd7032efb41a3ba720dd68b31687e Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestEncryptedCinderVolumes-2063922949-project Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d could not be found. Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '8656a5ec-cfb6-4ea2-a273-1a19b40d506d'} Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d could not be found. Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d could not be found. Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:20:05.910117 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:20:05.914730 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:20:05.914730 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:20:05.914730 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:20:05.914730 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:20:05.914730 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:20:05.914730 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d could not be found. Jul 20 05:20:05.914730 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:20:05.914730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-322c0683-5f2e-48eb-b692-0775e9ff7eaf tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Returning 404 to user: Instance 8656a5ec-cfb6-4ea2-a273-1a19b40d506d could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:20:05.914730 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-322c0683-5f2e-48eb-b692-0775e9ff7eaf tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d" status: 404 len: 111 microversion: 2.1 time: 0.031000 Jul 20 05:20:05.914730 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3675/7250] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:05 2022] GET /compute/v2.1/servers/8656a5ec-cfb6-4ea2-a273-1a19b40d506d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:20:05.920678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9a38028a-9bbc-4b54-8838-bba85667a321 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] Calling method '.version_select at 0x7fbf9d67b5e0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:05.939177 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9a38028a-9bbc-4b54-8838-bba85667a321 tempest-TestEncryptedCinderVolumes-2063922949 tempest-TestEncryptedCinderVolumes-2063922949-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-337007213" status: 202 len: 0 microversion: 2.1 time: 0.022277 Jul 20 05:20:05.939792 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3576/7251] 10.222.0.20 () {58 vars in 1274 bytes} [Wed Jul 20 05:20:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-337007213 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:20:33.183857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6b88edc-8858-463c-b62e-079b43b8e548 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Action: 'create', calling method: .version_select at 0x7fbf9c5ce1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1570264385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhiZaPR2j8c11SEBx4qsE729O7PnP0CWC6y6ASxcGMfiWtX7sT5UqDRiq0VPCvn7tBHg8slSgzdUIM9ZaB5KRYP8sDOFQYysOgs3IhzVhRxiHfseg5m8MxxJnOb7WQllA=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:33.188550 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=14 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:33.189319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=34 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:33.201706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-c6b88edc-8858-463c-b62e-079b43b8e548 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Getting quotas for project 31b9732382a44ed78c931ebd599b18b5. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:20:33.206937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-c6b88edc-8858-463c-b62e-079b43b8e548 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Getting quotas for user ecbac989e7de4f80abddc8841ec4c931 and project 31b9732382a44ed78c931ebd599b18b5. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:20:33.231078 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c6b88edc-8858-463c-b62e-079b43b8e548 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051587 Jul 20 05:20:33.231712 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3676/7252] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:20:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:20:33.279675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:33.280610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:33.285890 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2136446217", "imageRef": "7386f1d1-11b4-4e72-9e95-ed0f44d8a54c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1570264385", "networks": [{"uuid": "3e7db8a5-3591-4995-82d9-d775f89d55fc"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:33.338134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] validate_networks() for [('3e7db8a5-3591-4995-82d9-d775f89d55fc', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:20:33.804647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:20:33.805084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:20:33.805571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:20:33.805997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:20:33.806422 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:20:33.815249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:33.815754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:33.816562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:33.817010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:33.838145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Getting quotas for project 31b9732382a44ed78c931ebd599b18b5. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:20:33.843478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Getting quotas for user ecbac989e7de4f80abddc8841ec4c931 and project 31b9732382a44ed78c931ebd599b18b5. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:20:33.856841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:20:33.859089 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7386f1d1-11b4-4e72-9e95-ed0f44d8a54c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:20:33.903409 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5a9a1bea-ec88-44f1-a721-c935ca53eb2a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625548 Jul 20 05:20:33.904123 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3577/7253] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:20:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:20:33.915374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0e5233df-c374-4443-808f-b5bdf1511059 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:33.916212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0e5233df-c374-4443-808f-b5bdf1511059 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:33.973535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0e5233df-c374-4443-808f-b5bdf1511059 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:33.982406 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0e5233df-c374-4443-808f-b5bdf1511059 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1259 microversion: 2.1 time: 0.071703 Jul 20 05:20:33.982973 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3677/7254] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:33 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:35.002234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cb3a771e-e9ae-4020-bd4e-8c95ccfe59d7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:35.003535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cb3a771e-e9ae-4020-bd4e-8c95ccfe59d7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:35.010281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb3a771e-e9ae-4020-bd4e-8c95ccfe59d7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:35.010992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb3a771e-e9ae-4020-bd4e-8c95ccfe59d7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:35.011962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb3a771e-e9ae-4020-bd4e-8c95ccfe59d7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:35.012571 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb3a771e-e9ae-4020-bd4e-8c95ccfe59d7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:35.090430 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cb3a771e-e9ae-4020-bd4e-8c95ccfe59d7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:35.098447 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cb3a771e-e9ae-4020-bd4e-8c95ccfe59d7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1319 microversion: 2.1 time: 0.101602 Jul 20 05:20:35.099052 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3578/7255] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:34 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1319 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:20:36.117281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e2f857df-24cb-4e45-9792-42edf79b92d1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:36.118131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e2f857df-24cb-4e45-9792-42edf79b92d1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:36.125782 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2f857df-24cb-4e45-9792-42edf79b92d1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:36.126683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2f857df-24cb-4e45-9792-42edf79b92d1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:36.127859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2f857df-24cb-4e45-9792-42edf79b92d1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:36.128978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2f857df-24cb-4e45-9792-42edf79b92d1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:36.280307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e2f857df-24cb-4e45-9792-42edf79b92d1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:36.290584 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e2f857df-24cb-4e45-9792-42edf79b92d1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.177586 Jul 20 05:20:36.291433 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3678/7256] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:36 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:37.308516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ae3285ab-0886-4f3f-af78-4c0d9af50338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:37.309275 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ae3285ab-0886-4f3f-af78-4c0d9af50338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:37.316684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae3285ab-0886-4f3f-af78-4c0d9af50338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:37.317147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae3285ab-0886-4f3f-af78-4c0d9af50338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:37.318125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae3285ab-0886-4f3f-af78-4c0d9af50338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:37.318579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ae3285ab-0886-4f3f-af78-4c0d9af50338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:37.465632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ae3285ab-0886-4f3f-af78-4c0d9af50338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:37.473459 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ae3285ab-0886-4f3f-af78-4c0d9af50338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.168799 Jul 20 05:20:37.474154 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3579/7257] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:37 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:38.491189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ed8ca379-88b9-456b-9aee-8946e5bd99be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:38.491977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ed8ca379-88b9-456b-9aee-8946e5bd99be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:38.499100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed8ca379-88b9-456b-9aee-8946e5bd99be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:38.499594 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed8ca379-88b9-456b-9aee-8946e5bd99be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:38.500497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed8ca379-88b9-456b-9aee-8946e5bd99be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:38.500989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed8ca379-88b9-456b-9aee-8946e5bd99be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:38.974715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ed8ca379-88b9-456b-9aee-8946e5bd99be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:38.983013 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ed8ca379-88b9-456b-9aee-8946e5bd99be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.496490 Jul 20 05:20:38.983607 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3679/7258] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:38 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:40.001493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c6ce7260-9bc2-498c-87be-f053041a438f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:40.002255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c6ce7260-9bc2-498c-87be-f053041a438f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:40.011068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c6ce7260-9bc2-498c-87be-f053041a438f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:40.011548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c6ce7260-9bc2-498c-87be-f053041a438f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:40.012331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c6ce7260-9bc2-498c-87be-f053041a438f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:40.012781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c6ce7260-9bc2-498c-87be-f053041a438f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:40.164673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c6ce7260-9bc2-498c-87be-f053041a438f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:40.173145 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c6ce7260-9bc2-498c-87be-f053041a438f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.176342 Jul 20 05:20:40.175080 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3580/7259] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:39 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:41.191945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d70c7445-f34b-4600-ac7a-e26e0b5d43bf tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:41.192583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d70c7445-f34b-4600-ac7a-e26e0b5d43bf tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:41.200425 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d70c7445-f34b-4600-ac7a-e26e0b5d43bf tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:41.200895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d70c7445-f34b-4600-ac7a-e26e0b5d43bf tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:41.201690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d70c7445-f34b-4600-ac7a-e26e0b5d43bf tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:41.202146 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d70c7445-f34b-4600-ac7a-e26e0b5d43bf tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:41.341922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d70c7445-f34b-4600-ac7a-e26e0b5d43bf tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:41.349929 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d70c7445-f34b-4600-ac7a-e26e0b5d43bf tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.161837 Jul 20 05:20:41.350601 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3680/7260] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:41 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:20:42.367585 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e1345d1e-41d9-4f96-8979-63af2d32fded tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:42.368204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e1345d1e-41d9-4f96-8979-63af2d32fded tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:42.376581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1345d1e-41d9-4f96-8979-63af2d32fded tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:42.377100 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1345d1e-41d9-4f96-8979-63af2d32fded tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:42.378079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1345d1e-41d9-4f96-8979-63af2d32fded tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:42.378533 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1345d1e-41d9-4f96-8979-63af2d32fded tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:42.517095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e1345d1e-41d9-4f96-8979-63af2d32fded tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:42.527896 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e1345d1e-41d9-4f96-8979-63af2d32fded tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.164737 Jul 20 05:20:42.535397 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3581/7261] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:42 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:43.545015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9888554-661b-4e64-b3dc-e2d636a477a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:43.545671 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9888554-661b-4e64-b3dc-e2d636a477a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:43.554315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9888554-661b-4e64-b3dc-e2d636a477a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:43.554795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9888554-661b-4e64-b3dc-e2d636a477a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:43.555725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9888554-661b-4e64-b3dc-e2d636a477a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:43.556524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9888554-661b-4e64-b3dc-e2d636a477a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:43.691223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9888554-661b-4e64-b3dc-e2d636a477a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:43.699073 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9888554-661b-4e64-b3dc-e2d636a477a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.158127 Jul 20 05:20:43.699668 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3681/7262] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:43 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:20:44.716578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2cf36809-3e37-431d-9aac-d78bf67be880 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:44.717147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2cf36809-3e37-431d-9aac-d78bf67be880 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:44.719817 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:44.720497 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:44.726885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cf36809-3e37-431d-9aac-d78bf67be880 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:44.727343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cf36809-3e37-431d-9aac-d78bf67be880 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:44.728148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cf36809-3e37-431d-9aac-d78bf67be880 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:44.728596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cf36809-3e37-431d-9aac-d78bf67be880 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:44.855777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2cf36809-3e37-431d-9aac-d78bf67be880 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:44.863243 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2cf36809-3e37-431d-9aac-d78bf67be880 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.150813 Jul 20 05:20:44.864129 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3582/7263] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:44 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:45.880956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-41e69a22-b710-4ffd-8604-03cce7ce5109 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:45.882239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-41e69a22-b710-4ffd-8604-03cce7ce5109 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:45.884112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:45.890362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41e69a22-b710-4ffd-8604-03cce7ce5109 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:45.890821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41e69a22-b710-4ffd-8604-03cce7ce5109 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:45.891613 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41e69a22-b710-4ffd-8604-03cce7ce5109 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:45.892065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-41e69a22-b710-4ffd-8604-03cce7ce5109 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:46.023455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-41e69a22-b710-4ffd-8604-03cce7ce5109 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:46.030993 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-41e69a22-b710-4ffd-8604-03cce7ce5109 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.154048 Jul 20 05:20:46.031583 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3682/7264] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:45 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:47.048581 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f9105b79-416d-48f6-8007-338431a8c791 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:47.049234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f9105b79-416d-48f6-8007-338431a8c791 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:47.057232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9105b79-416d-48f6-8007-338431a8c791 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:47.057688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9105b79-416d-48f6-8007-338431a8c791 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:47.058470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9105b79-416d-48f6-8007-338431a8c791 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:47.058915 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f9105b79-416d-48f6-8007-338431a8c791 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:47.294286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f9105b79-416d-48f6-8007-338431a8c791 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:47.301772 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f9105b79-416d-48f6-8007-338431a8c791 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.257279 Jul 20 05:20:47.302353 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3583/7265] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:47 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:47.460228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-f5169401-a0e9-4ad6-90b9-f98be6c7fd37 req-0ec29300-6dfe-4f89-8a5e-3c575317c0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc555c2-79db-4565-a5b1-cfa336f9d7e9", "tag": "c7a8c37a-8d8f-4f1b-b651-65c9c708bce7"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:47.486403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f5169401-a0e9-4ad6-90b9-f98be6c7fd37 req-0ec29300-6dfe-4f89-8a5e-3c575317c0c8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:47.486865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f5169401-a0e9-4ad6-90b9-f98be6c7fd37 req-0ec29300-6dfe-4f89-8a5e-3c575317c0c8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:47.501575 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f5169401-a0e9-4ad6-90b9-f98be6c7fd37 req-0ec29300-6dfe-4f89-8a5e-3c575317c0c8 service nova] Creating event network-changed:c7a8c37a-8d8f-4f1b-b651-65c9c708bce7 for instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 on n-h1-764485-11 Jul 20 05:20:47.507925 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-f5169401-a0e9-4ad6-90b9-f98be6c7fd37 req-0ec29300-6dfe-4f89-8a5e-3c575317c0c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052720 Jul 20 05:20:47.508545 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3683/7266] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:20:48.318713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-110c130b-1406-488a-a984-edd15ac83011 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:48.319372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-110c130b-1406-488a-a984-edd15ac83011 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:48.326185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-110c130b-1406-488a-a984-edd15ac83011 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:48.326641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-110c130b-1406-488a-a984-edd15ac83011 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:48.327399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-110c130b-1406-488a-a984-edd15ac83011 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:48.327864 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-110c130b-1406-488a-a984-edd15ac83011 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:48.457615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-110c130b-1406-488a-a984-edd15ac83011 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:48.465182 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-110c130b-1406-488a-a984-edd15ac83011 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.150319 Jul 20 05:20:48.465939 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3584/7267] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:48 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:49.483667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fb292fda-6253-4bb0-ba9c-ba442a7da0e9 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:49.484297 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fb292fda-6253-4bb0-ba9c-ba442a7da0e9 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:49.491470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb292fda-6253-4bb0-ba9c-ba442a7da0e9 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:49.491952 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb292fda-6253-4bb0-ba9c-ba442a7da0e9 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:49.492720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb292fda-6253-4bb0-ba9c-ba442a7da0e9 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:49.493185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fb292fda-6253-4bb0-ba9c-ba442a7da0e9 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:49.630473 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fb292fda-6253-4bb0-ba9c-ba442a7da0e9 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:49.638243 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fb292fda-6253-4bb0-ba9c-ba442a7da0e9 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.159829 Jul 20 05:20:49.638825 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3684/7268] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:49 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:50.656480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-666bc2ef-5466-40f8-a978-e9b6145a79f0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:50.657032 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-666bc2ef-5466-40f8-a978-e9b6145a79f0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:50.664215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-666bc2ef-5466-40f8-a978-e9b6145a79f0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:50.664682 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-666bc2ef-5466-40f8-a978-e9b6145a79f0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:50.665463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-666bc2ef-5466-40f8-a978-e9b6145a79f0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:50.665898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-666bc2ef-5466-40f8-a978-e9b6145a79f0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:50.806517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-666bc2ef-5466-40f8-a978-e9b6145a79f0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:50.814328 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-666bc2ef-5466-40f8-a978-e9b6145a79f0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.161921 Jul 20 05:20:50.814929 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3585/7269] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:50 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:51.832588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a46a0d78-5442-4def-a131-fb2c0cbfa85d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:51.833221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a46a0d78-5442-4def-a131-fb2c0cbfa85d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:51.841046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a46a0d78-5442-4def-a131-fb2c0cbfa85d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:51.841505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a46a0d78-5442-4def-a131-fb2c0cbfa85d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:51.842302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a46a0d78-5442-4def-a131-fb2c0cbfa85d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:51.842755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a46a0d78-5442-4def-a131-fb2c0cbfa85d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:51.976069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a46a0d78-5442-4def-a131-fb2c0cbfa85d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:51.983680 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a46a0d78-5442-4def-a131-fb2c0cbfa85d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.154951 Jul 20 05:20:51.984271 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3685/7270] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:51 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:52.798946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f999211c-bcb8-4fea-987f-c25b893841d6 req-4a7484f8-4154-42cf-bb85-33f0005fe90a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc555c2-79db-4565-a5b1-cfa336f9d7e9", "name": "network-vif-plugged", "status": "completed", "tag": "c7a8c37a-8d8f-4f1b-b651-65c9c708bce7"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:52.807999 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f999211c-bcb8-4fea-987f-c25b893841d6 req-4a7484f8-4154-42cf-bb85-33f0005fe90a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:52.808473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f999211c-bcb8-4fea-987f-c25b893841d6 req-4a7484f8-4154-42cf-bb85-33f0005fe90a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:52.820366 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f999211c-bcb8-4fea-987f-c25b893841d6 req-4a7484f8-4154-42cf-bb85-33f0005fe90a service nova] Creating event network-vif-plugged:c7a8c37a-8d8f-4f1b-b651-65c9c708bce7 for instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 on n-h1-764485-11 Jul 20 05:20:52.826794 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f999211c-bcb8-4fea-987f-c25b893841d6 req-4a7484f8-4154-42cf-bb85-33f0005fe90a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155122 Jul 20 05:20:52.827397 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3586/7271] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:20:53.001138 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2229f5be-7067-4263-ab32-c66733d2f938 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:53.001765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2229f5be-7067-4263-ab32-c66733d2f938 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:53.008901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2229f5be-7067-4263-ab32-c66733d2f938 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:53.009362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2229f5be-7067-4263-ab32-c66733d2f938 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:53.010137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2229f5be-7067-4263-ab32-c66733d2f938 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:53.010588 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2229f5be-7067-4263-ab32-c66733d2f938 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:53.145163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2229f5be-7067-4263-ab32-c66733d2f938 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:53.153769 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2229f5be-7067-4263-ab32-c66733d2f938 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.156561 Jul 20 05:20:53.154344 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3686/7272] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:52 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:54.171732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-548f365c-4f13-4ee9-91d2-f6ed129b1772 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:54.172433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-548f365c-4f13-4ee9-91d2-f6ed129b1772 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:54.180303 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-548f365c-4f13-4ee9-91d2-f6ed129b1772 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:54.180752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-548f365c-4f13-4ee9-91d2-f6ed129b1772 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:54.181523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-548f365c-4f13-4ee9-91d2-f6ed129b1772 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:54.181957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-548f365c-4f13-4ee9-91d2-f6ed129b1772 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:54.319923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-548f365c-4f13-4ee9-91d2-f6ed129b1772 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:54.327413 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-548f365c-4f13-4ee9-91d2-f6ed129b1772 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1359 microversion: 2.1 time: 0.159982 Jul 20 05:20:54.328222 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3587/7273] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:54 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:55.345365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1703f925-201d-4da1-aec5-64ba091b55ae tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:55.345915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1703f925-201d-4da1-aec5-64ba091b55ae tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:55.353689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1703f925-201d-4da1-aec5-64ba091b55ae tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:55.354155 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1703f925-201d-4da1-aec5-64ba091b55ae tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:55.354938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1703f925-201d-4da1-aec5-64ba091b55ae tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:55.355391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1703f925-201d-4da1-aec5-64ba091b55ae tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:55.487334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1703f925-201d-4da1-aec5-64ba091b55ae tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:55.495375 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1703f925-201d-4da1-aec5-64ba091b55ae tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1548 microversion: 2.1 time: 0.154020 Jul 20 05:20:55.495991 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3687/7274] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:55 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:55.511586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-266ff116-4bcf-4058-8e5e-73eb88714920 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:55.512213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-266ff116-4bcf-4058-8e5e-73eb88714920 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:55.519207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-266ff116-4bcf-4058-8e5e-73eb88714920 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:55.519701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-266ff116-4bcf-4058-8e5e-73eb88714920 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:55.520565 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-266ff116-4bcf-4058-8e5e-73eb88714920 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:55.521012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-266ff116-4bcf-4058-8e5e-73eb88714920 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:55.651025 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-266ff116-4bcf-4058-8e5e-73eb88714920 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:55.658622 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-266ff116-4bcf-4058-8e5e-73eb88714920 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1548 microversion: 2.1 time: 0.150975 Jul 20 05:20:55.659207 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3588/7275] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:55 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:55.675128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dc7fe23b-5120-4da3-839e-976fdabce480 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:55.678516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dc7fe23b-5120-4da3-839e-976fdabce480 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:55.679310 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dc7fe23b-5120-4da3-839e-976fdabce480 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Searching by: {'deleted': False, 'project_id': '31b9732382a44ed78c931ebd599b18b5'} {{(pid=119808) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 05:20:55.684905 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc7fe23b-5120-4da3-839e-976fdabce480 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:55.685364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc7fe23b-5120-4da3-839e-976fdabce480 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:55.686165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc7fe23b-5120-4da3-839e-976fdabce480 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:55.686614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc7fe23b-5120-4da3-839e-976fdabce480 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:55.711000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.multi_cell_list [None req-dc7fe23b-5120-4da3-839e-976fdabce480 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 05:20:55.737395 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dc7fe23b-5120-4da3-839e-976fdabce480 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066112 Jul 20 05:20:55.737985 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3688/7276] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 05:20:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:20:55.748649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c3f30857-fad2-4c16-9a8f-e9778566d0af tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:55.749268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c3f30857-fad2-4c16-9a8f-e9778566d0af tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:55.755377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3f30857-fad2-4c16-9a8f-e9778566d0af tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:55.755878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3f30857-fad2-4c16-9a8f-e9778566d0af tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:55.757243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3f30857-fad2-4c16-9a8f-e9778566d0af tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:55.757895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3f30857-fad2-4c16-9a8f-e9778566d0af tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:55.889745 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c3f30857-fad2-4c16-9a8f-e9778566d0af tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:55.898366 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c3f30857-fad2-4c16-9a8f-e9778566d0af tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1548 microversion: 2.1 time: 0.152701 Jul 20 05:20:55.899012 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3589/7277] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:55 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:20:57.419467 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9e965a17-ede8-4f9c-8cd1-17e6e5ecf919 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c024719-667c-4041-9bbb-48870e60bad4"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:57.420563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9e965a17-ede8-4f9c-8cd1-17e6e5ecf919 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:57.427692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e965a17-ede8-4f9c-8cd1-17e6e5ecf919 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:57.428152 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e965a17-ede8-4f9c-8cd1-17e6e5ecf919 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:57.429551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e965a17-ede8-4f9c-8cd1-17e6e5ecf919 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:57.429998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9e965a17-ede8-4f9c-8cd1-17e6e5ecf919 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:57.675795 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9e965a17-ede8-4f9c-8cd1-17e6e5ecf919 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "POST /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260020 Jul 20 05:20:57.676468 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3689/7278] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 05:20:57 2022] POST /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:21:10.653990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ef72e79e-a6c1-4427-8fbd-c3a5de1d7ce0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:10.654635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ef72e79e-a6c1-4427-8fbd-c3a5de1d7ce0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:10.657513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:10.658179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=70 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:10.665400 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef72e79e-a6c1-4427-8fbd-c3a5de1d7ce0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:10.665856 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef72e79e-a6c1-4427-8fbd-c3a5de1d7ce0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:10.666630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef72e79e-a6c1-4427-8fbd-c3a5de1d7ce0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:10.667073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ef72e79e-a6c1-4427-8fbd-c3a5de1d7ce0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:10.797727 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ef72e79e-a6c1-4427-8fbd-c3a5de1d7ce0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:10.805700 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ef72e79e-a6c1-4427-8fbd-c3a5de1d7ce0 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1594 microversion: 2.1 time: 0.155575 Jul 20 05:21:10.806277 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3590/7279] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:10 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:12.605361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6d052415-d442-4cb2-af5c-9d3242d5b858 req-db498ec2-8789-445b-bd81-c8d76cb0c023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc555c2-79db-4565-a5b1-cfa336f9d7e9", "tag": "c7a8c37a-8d8f-4f1b-b651-65c9c708bce7"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:12.621329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:12.622101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:12.622865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:12.628358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6d052415-d442-4cb2-af5c-9d3242d5b858 req-db498ec2-8789-445b-bd81-c8d76cb0c023 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:12.629022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6d052415-d442-4cb2-af5c-9d3242d5b858 req-db498ec2-8789-445b-bd81-c8d76cb0c023 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:12.645218 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6d052415-d442-4cb2-af5c-9d3242d5b858 req-db498ec2-8789-445b-bd81-c8d76cb0c023 service nova] Creating event network-changed:c7a8c37a-8d8f-4f1b-b651-65c9c708bce7 for instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 on n-h1-764485-11 Jul 20 05:21:12.651844 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6d052415-d442-4cb2-af5c-9d3242d5b858 req-db498ec2-8789-445b-bd81-c8d76cb0c023 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051806 Jul 20 05:21:12.652485 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3690/7280] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:21:13.726942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-df23d583-9a89-4d6f-b5db-56cb14609cd2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-22004195"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:13.727629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-df23d583-9a89-4d6f-b5db-56cb14609cd2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:13.735293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df23d583-9a89-4d6f-b5db-56cb14609cd2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:13.735797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df23d583-9a89-4d6f-b5db-56cb14609cd2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:13.736586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df23d583-9a89-4d6f-b5db-56cb14609cd2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:13.737215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df23d583-9a89-4d6f-b5db-56cb14609cd2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:13.951187 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.network.security_group_api [None req-df23d583-9a89-4d6f-b5db-56cb14609cd2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Adding security group 9048a8b8-c8e1-47bb-9d59-b6f964e81ab2 to port c7a8c37a-8d8f-4f1b-b651-65c9c708bce7 Jul 20 05:21:14.391293 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-df23d583-9a89-4d6f-b5db-56cb14609cd2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "POST /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/action" status: 202 len: 0 microversion: 2.1 time: 0.668156 Jul 20 05:21:14.396243 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3591/7281] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:21:13 2022] POST /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:21:14.402268 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2136b5e6-1a44-4601-b8c1-ae7f98e3c0a2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:14.402994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2136b5e6-1a44-4601-b8c1-ae7f98e3c0a2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:14.419573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2136b5e6-1a44-4601-b8c1-ae7f98e3c0a2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:14.420039 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2136b5e6-1a44-4601-b8c1-ae7f98e3c0a2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:14.420824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2136b5e6-1a44-4601-b8c1-ae7f98e3c0a2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:14.421462 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2136b5e6-1a44-4601-b8c1-ae7f98e3c0a2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:14.588538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2136b5e6-1a44-4601-b8c1-ae7f98e3c0a2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:14.598426 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2136b5e6-1a44-4601-b8c1-ae7f98e3c0a2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1757 microversion: 2.1 time: 0.201600 Jul 20 05:21:14.599284 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3691/7282] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:14 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1757 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:14.681297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-8bff7634-c0ca-4591-b9ef-74d9dbd80625 req-2cc0864b-30e7-4027-99d7-0842511fe1fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc555c2-79db-4565-a5b1-cfa336f9d7e9", "tag": "c7a8c37a-8d8f-4f1b-b651-65c9c708bce7"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:14.690113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8bff7634-c0ca-4591-b9ef-74d9dbd80625 req-2cc0864b-30e7-4027-99d7-0842511fe1fb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:14.690557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-8bff7634-c0ca-4591-b9ef-74d9dbd80625 req-2cc0864b-30e7-4027-99d7-0842511fe1fb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:14.705195 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-8bff7634-c0ca-4591-b9ef-74d9dbd80625 req-2cc0864b-30e7-4027-99d7-0842511fe1fb service nova] Creating event network-changed:c7a8c37a-8d8f-4f1b-b651-65c9c708bce7 for instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 on n-h1-764485-11 Jul 20 05:21:14.710599 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-8bff7634-c0ca-4591-b9ef-74d9dbd80625 req-2cc0864b-30e7-4027-99d7-0842511fe1fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033308 Jul 20 05:21:14.711803 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3592/7283] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:23:35.518427 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4776198a-db9f-4da8-a9d3-98de639ffb43] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:23:35.518945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:35.519826 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=8 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:35.523877 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-772f7f9f-4357-464b-9ad9-310d3fcab87f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:35.524852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-772f7f9f-4357-464b-9ad9-310d3fcab87f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:35.532528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-772f7f9f-4357-464b-9ad9-310d3fcab87f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:35.532991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-772f7f9f-4357-464b-9ad9-310d3fcab87f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:35.533759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-772f7f9f-4357-464b-9ad9-310d3fcab87f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:35.534205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-772f7f9f-4357-464b-9ad9-310d3fcab87f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:35.609704 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [None req-772f7f9f-4357-464b-9ad9-310d3fcab87f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [4fcd5773-e0ca-4a44-a2bc-a7bdeb8162d4] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:23:35.689898 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:23:35.690095 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:23:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/action (ip 10.222.0.20) !!! Jul 20 05:23:35.710436 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:23:35.710611 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:23:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/action (ip 10.222.0.20) !!! Jul 20 05:23:36.526704 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] [4776198a-db9f-4da8-a9d3-98de639ffb43] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53040. Jul 20 05:23:36.617176 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [None req-772f7f9f-4357-464b-9ad9-310d3fcab87f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [4fcd5773-e0ca-4a44-a2bc-a7bdeb8162d4] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53042. Jul 20 05:23:36.620453 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-772f7f9f-4357-464b-9ad9-310d3fcab87f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "POST /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/action" status: 202 len: 0 microversion: 2.1 time: 1.104458 Jul 20 05:23:36.621103 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3692/7284] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:23:35 2022] POST /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/action => generated 0 bytes in 1106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:23:36.628241 n-d-764485-11 devstack@n-api.service[119807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a8eca7-3df2-4c6d-a372-7fc57edb945c] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 20 05:23:36.629074 n-d-764485-11 devstack@n-api.service[119807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [86bbcd4a-2dc6-48ea-bdc8-94fb9e64045f] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:23:36.629666 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:36.630419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=12 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:36.635431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d86fb4a5-7ec5-4c1d-828d-0d149c4d6272 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:36.636174 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d86fb4a5-7ec5-4c1d-828d-0d149c4d6272 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:36.644793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d86fb4a5-7ec5-4c1d-828d-0d149c4d6272 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:36.645256 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d86fb4a5-7ec5-4c1d-828d-0d149c4d6272 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:36.646039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d86fb4a5-7ec5-4c1d-828d-0d149c4d6272 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:36.646589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d86fb4a5-7ec5-4c1d-828d-0d149c4d6272 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:36.848247 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:23:36.848247 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:23:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 (ip 10.222.0.20) !!! Jul 20 05:23:36.895811 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d86fb4a5-7ec5-4c1d-828d-0d149c4d6272 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:36.903999 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d86fb4a5-7ec5-4c1d-828d-0d149c4d6272 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1759 microversion: 2.1 time: 0.277534 Jul 20 05:23:36.904587 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3593/7285] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:36 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1759 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:37.923368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e2ce84d8-e743-4a56-a827-831d3c88edee tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:37.924117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e2ce84d8-e743-4a56-a827-831d3c88edee tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:37.930752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2ce84d8-e743-4a56-a827-831d3c88edee tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:37.931223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2ce84d8-e743-4a56-a827-831d3c88edee tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:37.932034 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2ce84d8-e743-4a56-a827-831d3c88edee tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:37.932491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e2ce84d8-e743-4a56-a827-831d3c88edee tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:38.079591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e2ce84d8-e743-4a56-a827-831d3c88edee tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:38.087591 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e2ce84d8-e743-4a56-a827-831d3c88edee tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1757 microversion: 2.1 time: 0.170408 Jul 20 05:23:38.088168 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3693/7286] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:37 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:51.135574 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:23:51.136191 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:23:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:25:17.289319 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:25:17.289917 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:25:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:25:22.060524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:22.061286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:22.066088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b11aae7a-97b2-410f-b7f0-7b4758631300 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-22004195"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:22.066628 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b11aae7a-97b2-410f-b7f0-7b4758631300 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:22.078824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b11aae7a-97b2-410f-b7f0-7b4758631300 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:22.079272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b11aae7a-97b2-410f-b7f0-7b4758631300 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:22.080064 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b11aae7a-97b2-410f-b7f0-7b4758631300 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:22.080500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b11aae7a-97b2-410f-b7f0-7b4758631300 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:22.086439 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] [86bbcd4a-2dc6-48ea-bdc8-94fb9e64045f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53100. Jul 20 05:25:22.089000 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a8eca7-3df2-4c6d-a372-7fc57edb945c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53098. Jul 20 05:25:22.296777 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.network.security_group_api [None req-b11aae7a-97b2-410f-b7f0-7b4758631300 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Removing security group 9048a8b8-c8e1-47bb-9d59-b6f964e81ab2 from port c7a8c37a-8d8f-4f1b-b651-65c9c708bce7 Jul 20 05:25:22.946507 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b11aae7a-97b2-410f-b7f0-7b4758631300 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "POST /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/action" status: 202 len: 0 microversion: 2.1 time: 0.889029 Jul 20 05:25:22.950146 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3594/7287] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:25:22 2022] POST /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/action => generated 0 bytes in 890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:25:22.961475 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:22.963337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:23.055785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-59e95858-07a4-4613-9f30-4faee6b625b6 req-83a193a0-9670-4f81-9b21-2da4ce7fb6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc555c2-79db-4565-a5b1-cfa336f9d7e9", "tag": "c7a8c37a-8d8f-4f1b-b651-65c9c708bce7"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:23.066815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-59e95858-07a4-4613-9f30-4faee6b625b6 req-83a193a0-9670-4f81-9b21-2da4ce7fb6e8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:23.068431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-59e95858-07a4-4613-9f30-4faee6b625b6 req-83a193a0-9670-4f81-9b21-2da4ce7fb6e8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:23.085280 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-59e95858-07a4-4613-9f30-4faee6b625b6 req-83a193a0-9670-4f81-9b21-2da4ce7fb6e8 service nova] Creating event network-changed:c7a8c37a-8d8f-4f1b-b651-65c9c708bce7 for instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 on n-h1-764485-11 Jul 20 05:25:23.091481 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-59e95858-07a4-4613-9f30-4faee6b625b6 req-83a193a0-9670-4f81-9b21-2da4ce7fb6e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140229 Jul 20 05:25:23.092775 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3694/7288] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:25:24.186233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b0b1909c-c8fd-4107-b9b9-34ce3b311746 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:24.186233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b0b1909c-c8fd-4107-b9b9-34ce3b311746 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:24.190242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0b1909c-c8fd-4107-b9b9-34ce3b311746 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:24.190703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0b1909c-c8fd-4107-b9b9-34ce3b311746 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:24.191476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0b1909c-c8fd-4107-b9b9-34ce3b311746 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:24.192142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b0b1909c-c8fd-4107-b9b9-34ce3b311746 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:24.293333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-448f117c-caa2-4676-8138-afdb4160c53b req-8bbb543f-2c53-4eb9-954e-ffa4e2ecc068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc555c2-79db-4565-a5b1-cfa336f9d7e9", "tag": "c7a8c37a-8d8f-4f1b-b651-65c9c708bce7"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:24.303793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-448f117c-caa2-4676-8138-afdb4160c53b req-8bbb543f-2c53-4eb9-954e-ffa4e2ecc068 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:24.304315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-448f117c-caa2-4676-8138-afdb4160c53b req-8bbb543f-2c53-4eb9-954e-ffa4e2ecc068 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:24.310646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-b0b1909c-c8fd-4107-b9b9-34ce3b311746 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lazy-loading 'services' on Instance uuid 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:25:24.320812 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-448f117c-caa2-4676-8138-afdb4160c53b req-8bbb543f-2c53-4eb9-954e-ffa4e2ecc068 service nova] Creating event network-changed:c7a8c37a-8d8f-4f1b-b651-65c9c708bce7 for instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 on n-h1-764485-11 Jul 20 05:25:24.326056 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-448f117c-caa2-4676-8138-afdb4160c53b req-8bbb543f-2c53-4eb9-954e-ffa4e2ecc068 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119829 Jul 20 05:25:24.326661 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3695/7289] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:25:24.392709 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b0b1909c-c8fd-4107-b9b9-34ce3b311746 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments/4c024719-667c-4041-9bbb-48870e60bad4" status: 202 len: 0 microversion: 2.1 time: 0.215202 Jul 20 05:25:24.393323 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3595/7290] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 05:25:24 2022] DELETE /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments/4c024719-667c-4041-9bbb-48870e60bad4 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:25:24.403140 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-698734d1-5496-4e6e-9d12-9e7c582e23a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:24.404212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-698734d1-5496-4e6e-9d12-9e7c582e23a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:24.417501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-698734d1-5496-4e6e-9d12-9e7c582e23a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:24.418249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-698734d1-5496-4e6e-9d12-9e7c582e23a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:24.419266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-698734d1-5496-4e6e-9d12-9e7c582e23a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:24.419895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-698734d1-5496-4e6e-9d12-9e7c582e23a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:24.461958 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-698734d1-5496-4e6e-9d12-9e7c582e23a1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063073 Jul 20 05:25:24.466958 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3696/7291] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:25:24 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:25.477090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-96e433b9-9ee4-40c8-a7fa-24e015b1d338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:25.478087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-96e433b9-9ee4-40c8-a7fa-24e015b1d338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:25.484570 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96e433b9-9ee4-40c8-a7fa-24e015b1d338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:25.485157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96e433b9-9ee4-40c8-a7fa-24e015b1d338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:25.485967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96e433b9-9ee4-40c8-a7fa-24e015b1d338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:25.486410 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-96e433b9-9ee4-40c8-a7fa-24e015b1d338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:25.517198 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-96e433b9-9ee4-40c8-a7fa-24e015b1d338 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046701 Jul 20 05:25:25.517789 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3596/7292] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:25:25 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:26.529901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bbc643a3-7587-49d8-bb03-3e48f12aa60a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:26.530850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bbc643a3-7587-49d8-bb03-3e48f12aa60a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:26.539816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bbc643a3-7587-49d8-bb03-3e48f12aa60a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:26.540286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bbc643a3-7587-49d8-bb03-3e48f12aa60a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:26.541088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bbc643a3-7587-49d8-bb03-3e48f12aa60a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:26.541543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bbc643a3-7587-49d8-bb03-3e48f12aa60a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:26.574917 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bbc643a3-7587-49d8-bb03-3e48f12aa60a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048944 Jul 20 05:25:26.578836 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3697/7293] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:25:26 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:27.587651 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e514f88c-a61a-4211-9b61-283ec212dbd3 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:27.588761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e514f88c-a61a-4211-9b61-283ec212dbd3 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:27.596265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e514f88c-a61a-4211-9b61-283ec212dbd3 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:27.596733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e514f88c-a61a-4211-9b61-283ec212dbd3 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:27.597529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e514f88c-a61a-4211-9b61-283ec212dbd3 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:27.598377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e514f88c-a61a-4211-9b61-283ec212dbd3 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:27.632842 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e514f88c-a61a-4211-9b61-283ec212dbd3 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050273 Jul 20 05:25:27.633673 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3597/7294] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:25:27 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:28.643984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-97d74bb3-aa8f-4a76-8225-f01579f96960 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:28.645047 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-97d74bb3-aa8f-4a76-8225-f01579f96960 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:28.652208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97d74bb3-aa8f-4a76-8225-f01579f96960 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:28.652682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97d74bb3-aa8f-4a76-8225-f01579f96960 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:28.653478 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97d74bb3-aa8f-4a76-8225-f01579f96960 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:28.653940 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97d74bb3-aa8f-4a76-8225-f01579f96960 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:28.686673 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-97d74bb3-aa8f-4a76-8225-f01579f96960 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046634 Jul 20 05:25:28.687258 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3698/7295] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:25:28 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:29.698730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-88992f62-ef60-4d6a-925b-beb0d9aad233 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:29.699733 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-88992f62-ef60-4d6a-925b-beb0d9aad233 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:29.706746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88992f62-ef60-4d6a-925b-beb0d9aad233 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:29.707199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88992f62-ef60-4d6a-925b-beb0d9aad233 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:29.708058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88992f62-ef60-4d6a-925b-beb0d9aad233 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:29.708686 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-88992f62-ef60-4d6a-925b-beb0d9aad233 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:29.736848 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-88992f62-ef60-4d6a-925b-beb0d9aad233 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042232 Jul 20 05:25:29.737417 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3598/7296] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:25:29 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:25:29.748114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4944a115-0ee3-40ca-8e96-bd59d80c3afe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:29.748680 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4944a115-0ee3-40ca-8e96-bd59d80c3afe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:29.756212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4944a115-0ee3-40ca-8e96-bd59d80c3afe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:29.756673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4944a115-0ee3-40ca-8e96-bd59d80c3afe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:29.757464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4944a115-0ee3-40ca-8e96-bd59d80c3afe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:29.757927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4944a115-0ee3-40ca-8e96-bd59d80c3afe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:29.962316 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-4944a115-0ee3-40ca-8e96-bd59d80c3afe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] HTTP exception thrown: Instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 is not attached to volume 4c024719-667c-4041-9bbb-48870e60bad4 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4944a115-0ee3-40ca-8e96-bd59d80c3afe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Request method failure captured: Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: request: DELETE /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments/4c024719-667c-4041-9bbb-48870e60bad4 HTTP/1.1 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi15CRGWjejOrrMSUna0GXpeYjd84ew1tGTTNOMWdU_oESuWHYtLH9ITbU8uD77_o1yj9LEug3SJbjxzOPb8cbu0WkIFMybqA48sa6EigOlhmuCQzN-lvx4diM70Y2hSdtCsa60Ic8YT8k-rLkM4qEGUJs-Wu5oATdOvEgdGv84Ry9xzc Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 31b9732382a44ed78c931ebd599b18b5 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestMinimumBasicScenario-1096345691 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31b9732382a44ed78c931ebd599b18b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31b9732382a44ed78c931ebd599b18b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31b9732382a44ed78c931ebd599b18b5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31b9732382a44ed78c931ebd599b18b5"}]}] Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestMinimumBasicScenario-1096345691 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 31b9732382a44ed78c931ebd599b18b5 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1096345691 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestMinimumBasicScenario-1096345691-project Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: ecbac989e7de4f80abddc8841ec4c931 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestMinimumBasicScenario-1096345691-project Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 is not attached to volume 4c024719-667c-4041-9bbb-48870e60bad4 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'server_id': '9cc555c2-79db-4565-a5b1-cfa336f9d7e9', 'id': '4c024719-667c-4041-9bbb-48870e60bad4'} Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4c024719-667c-4041-9bbb-48870e60bad4. Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 is not attached to volume 4c024719-667c-4041-9bbb-48870e60bad4 Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:25:29.963983 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:25:29.968382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:25:29.968382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:25:29.968382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 is not attached to volume 4c024719-667c-4041-9bbb-48870e60bad4 Jul 20 05:25:29.968382 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:25:29.968382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4944a115-0ee3-40ca-8e96-bd59d80c3afe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Returning 404 to user: Instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 is not attached to volume 4c024719-667c-4041-9bbb-48870e60bad4 {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:25:29.968382 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4944a115-0ee3-40ca-8e96-bd59d80c3afe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments/4c024719-667c-4041-9bbb-48870e60bad4" status: 404 len: 154 microversion: 2.1 time: 0.221551 Jul 20 05:25:29.968382 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3699/7297] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 05:25:29 2022] DELETE /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9/os-volume_attachments/4c024719-667c-4041-9bbb-48870e60bad4 => generated 154 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:25:33.200398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c3b5729e-a3fa-4cff-bd76-2de10ca12062 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:33.201508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c3b5729e-a3fa-4cff-bd76-2de10ca12062 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:33.208980 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3b5729e-a3fa-4cff-bd76-2de10ca12062 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:33.209446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3b5729e-a3fa-4cff-bd76-2de10ca12062 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:33.210241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3b5729e-a3fa-4cff-bd76-2de10ca12062 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:33.210722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c3b5729e-a3fa-4cff-bd76-2de10ca12062 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:33.240766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c3b5729e-a3fa-4cff-bd76-2de10ca12062 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:25:33.324653 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c3b5729e-a3fa-4cff-bd76-2de10ca12062 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 204 len: 0 microversion: 2.1 time: 0.127319 Jul 20 05:25:33.325369 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3599/7298] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:25:33 2022] DELETE /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:25:33.333806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8eaa18fe-831d-410e-b434-7503ed2b497a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:33.334606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8eaa18fe-831d-410e-b434-7503ed2b497a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:33.343116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8eaa18fe-831d-410e-b434-7503ed2b497a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:33.343645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8eaa18fe-831d-410e-b434-7503ed2b497a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:33.344456 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8eaa18fe-831d-410e-b434-7503ed2b497a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:33.344916 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8eaa18fe-831d-410e-b434-7503ed2b497a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:33.479996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8eaa18fe-831d-410e-b434-7503ed2b497a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:33.487743 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8eaa18fe-831d-410e-b434-7503ed2b497a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1554 microversion: 2.1 time: 0.157981 Jul 20 05:25:33.488333 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3700/7299] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:33 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:34.506973 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-75a4f394-2076-4211-8b14-cc516b854d69 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:34.507824 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-75a4f394-2076-4211-8b14-cc516b854d69 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:34.514787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75a4f394-2076-4211-8b14-cc516b854d69 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:34.515231 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75a4f394-2076-4211-8b14-cc516b854d69 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:34.516077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75a4f394-2076-4211-8b14-cc516b854d69 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:34.516463 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-75a4f394-2076-4211-8b14-cc516b854d69 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:34.651574 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-75a4f394-2076-4211-8b14-cc516b854d69 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:34.659105 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-75a4f394-2076-4211-8b14-cc516b854d69 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1554 microversion: 2.1 time: 0.157039 Jul 20 05:25:34.659704 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3600/7300] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:34 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:35.566257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-b9efe4f2-9d7d-45cc-9c70-b0180018d2dd req-03ed07fe-a096-4351-823e-ba345f936360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc555c2-79db-4565-a5b1-cfa336f9d7e9", "name": "network-vif-deleted", "tag": "c7a8c37a-8d8f-4f1b-b651-65c9c708bce7"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:35.576974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b9efe4f2-9d7d-45cc-9c70-b0180018d2dd req-03ed07fe-a096-4351-823e-ba345f936360 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:35.577913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b9efe4f2-9d7d-45cc-9c70-b0180018d2dd req-03ed07fe-a096-4351-823e-ba345f936360 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:35.590996 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-b9efe4f2-9d7d-45cc-9c70-b0180018d2dd req-03ed07fe-a096-4351-823e-ba345f936360 service nova] Creating event network-vif-deleted:c7a8c37a-8d8f-4f1b-b651-65c9c708bce7 for instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 on n-h1-764485-11 Jul 20 05:25:35.596872 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-b9efe4f2-9d7d-45cc-9c70-b0180018d2dd req-03ed07fe-a096-4351-823e-ba345f936360 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034393 Jul 20 05:25:35.597484 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3701/7301] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:35.677772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1f6d8c78-4844-45ee-8eca-90713badd5ba tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:35.678383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1f6d8c78-4844-45ee-8eca-90713badd5ba tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:35.686456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f6d8c78-4844-45ee-8eca-90713badd5ba tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:35.686909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f6d8c78-4844-45ee-8eca-90713badd5ba tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:35.687719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f6d8c78-4844-45ee-8eca-90713badd5ba tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:35.688166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f6d8c78-4844-45ee-8eca-90713badd5ba tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:35.719224 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f6d8c78-4844-45ee-8eca-90713badd5ba tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:35.719722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1f6d8c78-4844-45ee-8eca-90713badd5ba tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:35.720182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-1f6d8c78-4844-45ee-8eca-90713badd5ba tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lazy-loading 'fault' on Instance uuid 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:25:35.765003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1f6d8c78-4844-45ee-8eca-90713badd5ba tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:35.773286 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1f6d8c78-4844-45ee-8eca-90713badd5ba tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 200 len: 1349 microversion: 2.1 time: 0.100536 Jul 20 05:25:35.773810 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3601/7302] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:35 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:36.791840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fba244bf-3457-4fb4-bc5b-bd992303843d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:36.792563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fba244bf-3457-4fb4-bc5b-bd992303843d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 9cc555c2-79db-4565-a5b1-cfa336f9d7e9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:36.798812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fba244bf-3457-4fb4-bc5b-bd992303843d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:36.799274 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fba244bf-3457-4fb4-bc5b-bd992303843d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:36.800069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fba244bf-3457-4fb4-bc5b-bd992303843d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:36.800518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fba244bf-3457-4fb4-bc5b-bd992303843d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:36.813762 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-fba244bf-3457-4fb4-bc5b-bd992303843d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] HTTP exception thrown: Instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 could not be found. Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fba244bf-3457-4fb4-bc5b-bd992303843d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Request method failure captured: Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 HTTP/1.1 Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi15CRGWjejOrrMSUna0GXpeYjd84ew1tGTTNOMWdU_oESuWHYtLH9ITbU8uD77_o1yj9LEug3SJbjxzOPb8cbu0WkIFMybqA48sa6EigOlhmuCQzN-lvx4diM70Y2hSdtCsa60Ic8YT8k-rLkM4qEGUJs-Wu5oATdOvEgdGv84Ry9xzc Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 31b9732382a44ed78c931ebd599b18b5 Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestMinimumBasicScenario-1096345691 Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31b9732382a44ed78c931ebd599b18b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31b9732382a44ed78c931ebd599b18b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31b9732382a44ed78c931ebd599b18b5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31b9732382a44ed78c931ebd599b18b5"}]}] Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestMinimumBasicScenario-1096345691 Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 31b9732382a44ed78c931ebd599b18b5 Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1096345691 Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestMinimumBasicScenario-1096345691-project Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: ecbac989e7de4f80abddc8841ec4c931 Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestMinimumBasicScenario-1096345691-project Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 could not be found. Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '9cc555c2-79db-4565-a5b1-cfa336f9d7e9'} Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 could not be found. Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 could not be found. Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:25:36.815365 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:25:36.820296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:25:36.820296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:25:36.820296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:25:36.820296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:25:36.820296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:25:36.820296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 could not be found. Jul 20 05:25:36.820296 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:25:36.820296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fba244bf-3457-4fb4-bc5b-bd992303843d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Returning 404 to user: Instance 9cc555c2-79db-4565-a5b1-cfa336f9d7e9 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:25:36.820296 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fba244bf-3457-4fb4-bc5b-bd992303843d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9" status: 404 len: 111 microversion: 2.1 time: 0.030202 Jul 20 05:25:36.820296 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3702/7303] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:36 2022] GET /compute/v2.1/servers/9cc555c2-79db-4565-a5b1-cfa336f9d7e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:25:36.826058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c816ff86-982d-4719-a479-75feb5b545bb tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '.version_select at 0x7fbf9dca6af0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:36.849614 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c816ff86-982d-4719-a479-75feb5b545bb tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1570264385" status: 202 len: 0 microversion: 2.1 time: 0.027308 Jul 20 05:25:36.850195 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3602/7304] 10.222.0.20 () {58 vars in 1271 bytes} [Wed Jul 20 05:25:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1570264385 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:25:45.689197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d793af07-5e88-4ecf-b5e6-c964c8b3091c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Action: 'create', calling method: .version_select at 0x7fbf9c414a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-953566190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzqjhKigvTQ51I04o2qC5TsypB/lq6PWCQIa/RfPZ8e/SmAIiNa4eBi9zK3DFTD9nGAyLnF0uN7LbW3/tRTLaJRQsivffHR6eEj2qw4XHtrAIXoZhuSsPUl0GT3cBnBOw=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:45.704078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-d793af07-5e88-4ecf-b5e6-c964c8b3091c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Getting quotas for project 31b9732382a44ed78c931ebd599b18b5. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:25:45.710323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-d793af07-5e88-4ecf-b5e6-c964c8b3091c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Getting quotas for user ecbac989e7de4f80abddc8841ec4c931 and project 31b9732382a44ed78c931ebd599b18b5. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:25:45.737553 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d793af07-5e88-4ecf-b5e6-c964c8b3091c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051981 Jul 20 05:25:45.738537 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3703/7305] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:25:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:45.786168 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:45.790503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1258316981", "imageRef": "a44aa961-008c-4f62-83ca-cf2c85e3c726", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-953566190", "networks": [{"uuid": "3e7db8a5-3591-4995-82d9-d775f89d55fc"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:45.841015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] validate_networks() for [('3e7db8a5-3591-4995-82d9-d775f89d55fc', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:25:46.252530 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:25:46.252959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:25:46.253435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:25:46.253845 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:25:46.254262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:25:46.263264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:46.263744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:46.264539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:46.264977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:46.282023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Getting quotas for project 31b9732382a44ed78c931ebd599b18b5. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:25:46.288088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Getting quotas for user ecbac989e7de4f80abddc8841ec4c931 and project 31b9732382a44ed78c931ebd599b18b5. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:25:46.300171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:25:46.302761 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a44aa961-008c-4f62-83ca-cf2c85e3c726',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:25:46.347457 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-912697d2-8757-4c31-8642-31e19e0f0090 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563130 Jul 20 05:25:46.348736 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3603/7306] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:25:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:25:46.358731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-78999a77-5a7e-4eeb-b52c-4a5fe3cae757 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:46.359358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-78999a77-5a7e-4eeb-b52c-4a5fe3cae757 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:46.417363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-78999a77-5a7e-4eeb-b52c-4a5fe3cae757 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:46.424106 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-78999a77-5a7e-4eeb-b52c-4a5fe3cae757 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1258 microversion: 2.1 time: 0.069291 Jul 20 05:25:46.424687 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3704/7307] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:46 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:47.450235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2f705672-2c33-4f1a-924a-019d72b432f6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:47.450804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2f705672-2c33-4f1a-924a-019d72b432f6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:47.458135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f705672-2c33-4f1a-924a-019d72b432f6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:47.459459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f705672-2c33-4f1a-924a-019d72b432f6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:47.460540 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f705672-2c33-4f1a-924a-019d72b432f6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:47.461065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2f705672-2c33-4f1a-924a-019d72b432f6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:47.534849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2f705672-2c33-4f1a-924a-019d72b432f6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:47.542875 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2f705672-2c33-4f1a-924a-019d72b432f6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1328 microversion: 2.1 time: 0.098582 Jul 20 05:25:47.543468 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3604/7308] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:47 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:48.562071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d5b44e4e-7088-4a07-b194-f901d3790ba2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:48.562790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d5b44e4e-7088-4a07-b194-f901d3790ba2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:48.569977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=38 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:48.571898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5b44e4e-7088-4a07-b194-f901d3790ba2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:48.572679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5b44e4e-7088-4a07-b194-f901d3790ba2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:48.581393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5b44e4e-7088-4a07-b194-f901d3790ba2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:48.581860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d5b44e4e-7088-4a07-b194-f901d3790ba2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:48.770288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d5b44e4e-7088-4a07-b194-f901d3790ba2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:48.781462 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d5b44e4e-7088-4a07-b194-f901d3790ba2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.223317 Jul 20 05:25:48.794942 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3705/7309] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:48 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:49.805820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-713807ad-6757-4f60-836d-5dc88ff02ebd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:49.806562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-713807ad-6757-4f60-836d-5dc88ff02ebd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:49.813510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-713807ad-6757-4f60-836d-5dc88ff02ebd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:49.813931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-713807ad-6757-4f60-836d-5dc88ff02ebd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:49.814699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-713807ad-6757-4f60-836d-5dc88ff02ebd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:49.815134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-713807ad-6757-4f60-836d-5dc88ff02ebd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:49.969612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-713807ad-6757-4f60-836d-5dc88ff02ebd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:49.978126 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-713807ad-6757-4f60-836d-5dc88ff02ebd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.178258 Jul 20 05:25:49.978702 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3605/7310] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:49 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:50.997505 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-37f5b70c-4199-4884-90ca-eedc9c7b0eec tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:50.998994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-37f5b70c-4199-4884-90ca-eedc9c7b0eec tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:51.007636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37f5b70c-4199-4884-90ca-eedc9c7b0eec tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:51.008197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37f5b70c-4199-4884-90ca-eedc9c7b0eec tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:51.009080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37f5b70c-4199-4884-90ca-eedc9c7b0eec tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:51.009609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-37f5b70c-4199-4884-90ca-eedc9c7b0eec tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:51.151055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-37f5b70c-4199-4884-90ca-eedc9c7b0eec tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:51.161090 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-37f5b70c-4199-4884-90ca-eedc9c7b0eec tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.168590 Jul 20 05:25:51.162450 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3706/7311] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:50 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:52.179460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e93bddd5-14cb-49d9-9533-5fa883e30ace tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:52.180142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e93bddd5-14cb-49d9-9533-5fa883e30ace tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:52.182357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:52.188702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e93bddd5-14cb-49d9-9533-5fa883e30ace tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:52.188702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e93bddd5-14cb-49d9-9533-5fa883e30ace tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:52.189481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e93bddd5-14cb-49d9-9533-5fa883e30ace tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:52.189922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e93bddd5-14cb-49d9-9533-5fa883e30ace tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:52.325519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e93bddd5-14cb-49d9-9533-5fa883e30ace tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:52.333020 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e93bddd5-14cb-49d9-9533-5fa883e30ace tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.158189 Jul 20 05:25:52.333675 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3606/7312] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:52 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:53.350834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39b84cd4-72d4-4be0-97e1-926b3291db9f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:53.351461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-39b84cd4-72d4-4be0-97e1-926b3291db9f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:53.354108 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:53.359492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39b84cd4-72d4-4be0-97e1-926b3291db9f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:53.359986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39b84cd4-72d4-4be0-97e1-926b3291db9f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:53.360757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39b84cd4-72d4-4be0-97e1-926b3291db9f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:53.361207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39b84cd4-72d4-4be0-97e1-926b3291db9f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:53.535850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39b84cd4-72d4-4be0-97e1-926b3291db9f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:53.545877 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39b84cd4-72d4-4be0-97e1-926b3291db9f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.199570 Jul 20 05:25:53.546473 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3707/7313] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:53 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:54.563791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-225cc8aa-2bff-47f3-a0c9-eb7d3f54ab53 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:54.564468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-225cc8aa-2bff-47f3-a0c9-eb7d3f54ab53 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:54.572807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-225cc8aa-2bff-47f3-a0c9-eb7d3f54ab53 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:54.573263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-225cc8aa-2bff-47f3-a0c9-eb7d3f54ab53 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:54.574030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-225cc8aa-2bff-47f3-a0c9-eb7d3f54ab53 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:54.574470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-225cc8aa-2bff-47f3-a0c9-eb7d3f54ab53 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:54.717810 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-225cc8aa-2bff-47f3-a0c9-eb7d3f54ab53 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:54.726041 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-225cc8aa-2bff-47f3-a0c9-eb7d3f54ab53 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.166196 Jul 20 05:25:54.726935 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3607/7314] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:54 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:55.742982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-237af03d-61fb-46bc-bac6-bea988a7f99c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:55.743567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-237af03d-61fb-46bc-bac6-bea988a7f99c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:55.750927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-237af03d-61fb-46bc-bac6-bea988a7f99c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:55.751390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-237af03d-61fb-46bc-bac6-bea988a7f99c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:55.752183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-237af03d-61fb-46bc-bac6-bea988a7f99c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:55.752631 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-237af03d-61fb-46bc-bac6-bea988a7f99c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:55.887980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-237af03d-61fb-46bc-bac6-bea988a7f99c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:55.897976 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-237af03d-61fb-46bc-bac6-bea988a7f99c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.159391 Jul 20 05:25:55.907704 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3708/7315] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:55 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:56.923535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e616bf44-10a8-4a75-8382-762051a77bbe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:56.923535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e616bf44-10a8-4a75-8382-762051a77bbe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:56.923535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:56.923535 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:56.929793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e616bf44-10a8-4a75-8382-762051a77bbe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:56.930293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e616bf44-10a8-4a75-8382-762051a77bbe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:56.931202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e616bf44-10a8-4a75-8382-762051a77bbe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:56.931739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e616bf44-10a8-4a75-8382-762051a77bbe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:57.070478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e616bf44-10a8-4a75-8382-762051a77bbe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:57.078050 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e616bf44-10a8-4a75-8382-762051a77bbe tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.166678 Jul 20 05:25:57.078635 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3608/7316] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:56 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:58.095796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c06e40c5-49cf-4650-9f0c-d22c18b1dfd1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:58.096438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c06e40c5-49cf-4650-9f0c-d22c18b1dfd1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:58.098296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:58.105139 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c06e40c5-49cf-4650-9f0c-d22c18b1dfd1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:58.105609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c06e40c5-49cf-4650-9f0c-d22c18b1dfd1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:58.106396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c06e40c5-49cf-4650-9f0c-d22c18b1dfd1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:58.106857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c06e40c5-49cf-4650-9f0c-d22c18b1dfd1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:58.236460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c06e40c5-49cf-4650-9f0c-d22c18b1dfd1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:58.245148 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c06e40c5-49cf-4650-9f0c-d22c18b1dfd1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.153176 Jul 20 05:25:58.245738 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3709/7317] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:58 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:59.262634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fbf42391-8cd5-46d1-ab7d-8f9585c30185 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:59.263254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fbf42391-8cd5-46d1-ab7d-8f9585c30185 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:59.270184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbf42391-8cd5-46d1-ab7d-8f9585c30185 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:59.270635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbf42391-8cd5-46d1-ab7d-8f9585c30185 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:59.271407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbf42391-8cd5-46d1-ab7d-8f9585c30185 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:59.272548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fbf42391-8cd5-46d1-ab7d-8f9585c30185 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:59.406668 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-fbf42391-8cd5-46d1-ab7d-8f9585c30185 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:59.414128 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fbf42391-8cd5-46d1-ab7d-8f9585c30185 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.155411 Jul 20 05:25:59.414705 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3609/7318] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:59 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:00.431207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-64542cc0-6dd7-4be9-ae67-20d97283554b tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:00.431874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-64542cc0-6dd7-4be9-ae67-20d97283554b tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:00.438887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64542cc0-6dd7-4be9-ae67-20d97283554b tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:00.439368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64542cc0-6dd7-4be9-ae67-20d97283554b tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:00.440190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64542cc0-6dd7-4be9-ae67-20d97283554b tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:00.440661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-64542cc0-6dd7-4be9-ae67-20d97283554b tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:00.642470 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-64542cc0-6dd7-4be9-ae67-20d97283554b tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:00.652543 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-64542cc0-6dd7-4be9-ae67-20d97283554b tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.225999 Jul 20 05:26:00.653436 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3710/7319] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:00 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:00.876408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-df822f8b-ceef-4027-b152-cc0103e42360 req-b195840c-883d-46c3-8c71-2b674b952c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e48bf6a-e58a-4454-a74f-330a5845a1cc", "tag": "4ec39805-7bf0-4b04-aa84-4097ef525d6d"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:00.895738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-df822f8b-ceef-4027-b152-cc0103e42360 req-b195840c-883d-46c3-8c71-2b674b952c48 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:00.896812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-df822f8b-ceef-4027-b152-cc0103e42360 req-b195840c-883d-46c3-8c71-2b674b952c48 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:00.912584 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-df822f8b-ceef-4027-b152-cc0103e42360 req-b195840c-883d-46c3-8c71-2b674b952c48 service nova] Creating event network-changed:4ec39805-7bf0-4b04-aa84-4097ef525d6d for instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc on n-h2-764485-11 Jul 20 05:26:00.920215 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-df822f8b-ceef-4027-b152-cc0103e42360 req-b195840c-883d-46c3-8c71-2b674b952c48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048868 Jul 20 05:26:00.920773 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3610/7320] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:26:01.669711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-172c1092-6d25-44dd-b242-a9974a96120e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:01.670338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-172c1092-6d25-44dd-b242-a9974a96120e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:01.677382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-172c1092-6d25-44dd-b242-a9974a96120e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:01.677839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-172c1092-6d25-44dd-b242-a9974a96120e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:01.679394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-172c1092-6d25-44dd-b242-a9974a96120e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:01.679874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-172c1092-6d25-44dd-b242-a9974a96120e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:01.812227 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-172c1092-6d25-44dd-b242-a9974a96120e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:01.819651 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-172c1092-6d25-44dd-b242-a9974a96120e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.153892 Jul 20 05:26:01.820242 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3711/7321] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:01 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:02.838766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-72911a73-228d-4d8b-ac1f-0304f7934d4e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:02.839475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-72911a73-228d-4d8b-ac1f-0304f7934d4e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:02.845780 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72911a73-228d-4d8b-ac1f-0304f7934d4e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:02.846235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72911a73-228d-4d8b-ac1f-0304f7934d4e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:02.847006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72911a73-228d-4d8b-ac1f-0304f7934d4e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:02.847455 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-72911a73-228d-4d8b-ac1f-0304f7934d4e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:02.982109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-72911a73-228d-4d8b-ac1f-0304f7934d4e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:02.989668 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-72911a73-228d-4d8b-ac1f-0304f7934d4e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.156309 Jul 20 05:26:02.990265 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3611/7322] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:02 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:04.008153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7452e3a0-2cdd-4e24-aa95-d4befce28810 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:04.008788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7452e3a0-2cdd-4e24-aa95-d4befce28810 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:04.015811 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7452e3a0-2cdd-4e24-aa95-d4befce28810 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:04.016278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7452e3a0-2cdd-4e24-aa95-d4befce28810 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:04.017089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7452e3a0-2cdd-4e24-aa95-d4befce28810 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:04.017566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7452e3a0-2cdd-4e24-aa95-d4befce28810 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:04.153646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7452e3a0-2cdd-4e24-aa95-d4befce28810 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:04.161174 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7452e3a0-2cdd-4e24-aa95-d4befce28810 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.157937 Jul 20 05:26:04.161763 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3712/7323] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:04 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:05.178880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-31994486-79ad-4df2-906c-fa3f59a4505c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:05.179518 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-31994486-79ad-4df2-906c-fa3f59a4505c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:05.186654 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31994486-79ad-4df2-906c-fa3f59a4505c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:05.187122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31994486-79ad-4df2-906c-fa3f59a4505c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:05.188447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31994486-79ad-4df2-906c-fa3f59a4505c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:05.188447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-31994486-79ad-4df2-906c-fa3f59a4505c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:05.331974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-31994486-79ad-4df2-906c-fa3f59a4505c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:05.340195 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-31994486-79ad-4df2-906c-fa3f59a4505c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.165868 Jul 20 05:26:05.340780 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3612/7324] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:05 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:26:06.357223 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b08f5979-fb3e-48c5-ac9a-17bb74f13182 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:06.357876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b08f5979-fb3e-48c5-ac9a-17bb74f13182 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:06.364812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b08f5979-fb3e-48c5-ac9a-17bb74f13182 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:06.365283 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b08f5979-fb3e-48c5-ac9a-17bb74f13182 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:06.366411 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b08f5979-fb3e-48c5-ac9a-17bb74f13182 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:06.366868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b08f5979-fb3e-48c5-ac9a-17bb74f13182 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:06.499065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b08f5979-fb3e-48c5-ac9a-17bb74f13182 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:06.507674 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b08f5979-fb3e-48c5-ac9a-17bb74f13182 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.154312 Jul 20 05:26:06.508539 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3713/7325] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:06 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:06.703269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-40846abf-e556-4ae8-a38f-9cc7ddda47f5 req-3732642a-38ba-4426-b649-17953fd082ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e48bf6a-e58a-4454-a74f-330a5845a1cc", "name": "network-vif-plugged", "status": "completed", "tag": "4ec39805-7bf0-4b04-aa84-4097ef525d6d"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:06.711527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-40846abf-e556-4ae8-a38f-9cc7ddda47f5 req-3732642a-38ba-4426-b649-17953fd082ca service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:06.712171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-40846abf-e556-4ae8-a38f-9cc7ddda47f5 req-3732642a-38ba-4426-b649-17953fd082ca service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:06.727472 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-40846abf-e556-4ae8-a38f-9cc7ddda47f5 req-3732642a-38ba-4426-b649-17953fd082ca service nova] Creating event network-vif-plugged:4ec39805-7bf0-4b04-aa84-4097ef525d6d for instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc on n-h2-764485-11 Jul 20 05:26:06.732474 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-40846abf-e556-4ae8-a38f-9cc7ddda47f5 req-3732642a-38ba-4426-b649-17953fd082ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086153 Jul 20 05:26:06.733134 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3613/7326] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:26:07.525574 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3408f88b-0732-4d1b-acc9-40342045944d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:07.526209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3408f88b-0732-4d1b-acc9-40342045944d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:07.533016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3408f88b-0732-4d1b-acc9-40342045944d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:07.533481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3408f88b-0732-4d1b-acc9-40342045944d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:07.534255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3408f88b-0732-4d1b-acc9-40342045944d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:07.534705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3408f88b-0732-4d1b-acc9-40342045944d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:07.662565 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3408f88b-0732-4d1b-acc9-40342045944d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:07.670274 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3408f88b-0732-4d1b-acc9-40342045944d tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1358 microversion: 2.1 time: 0.149328 Jul 20 05:26:07.670861 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3714/7327] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:07 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:08.688916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3f2217be-0dc8-44b9-ab21-f30d798211a6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:08.689620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3f2217be-0dc8-44b9-ab21-f30d798211a6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:08.696065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f2217be-0dc8-44b9-ab21-f30d798211a6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:08.696516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f2217be-0dc8-44b9-ab21-f30d798211a6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:08.697309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f2217be-0dc8-44b9-ab21-f30d798211a6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:08.697742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3f2217be-0dc8-44b9-ab21-f30d798211a6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:08.830671 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3f2217be-0dc8-44b9-ab21-f30d798211a6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:08.839035 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3f2217be-0dc8-44b9-ab21-f30d798211a6 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1547 microversion: 2.1 time: 0.155379 Jul 20 05:26:08.839682 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3614/7328] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:08 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:08.856131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-38acd80b-1b32-4b10-88d6-835d3ad3e17f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:08.856771 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-38acd80b-1b32-4b10-88d6-835d3ad3e17f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:08.863466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38acd80b-1b32-4b10-88d6-835d3ad3e17f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:08.863972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38acd80b-1b32-4b10-88d6-835d3ad3e17f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:08.864755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38acd80b-1b32-4b10-88d6-835d3ad3e17f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:08.865217 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38acd80b-1b32-4b10-88d6-835d3ad3e17f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:08.994876 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-38acd80b-1b32-4b10-88d6-835d3ad3e17f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:09.002447 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-38acd80b-1b32-4b10-88d6-835d3ad3e17f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1547 microversion: 2.1 time: 0.150349 Jul 20 05:26:09.003026 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3715/7329] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:08 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:09.018752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e1509f61-a8d1-4424-a1fa-5167d759b4cd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:09.022737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e1509f61-a8d1-4424-a1fa-5167d759b4cd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:09.023529 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e1509f61-a8d1-4424-a1fa-5167d759b4cd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Searching by: {'deleted': False, 'project_id': '31b9732382a44ed78c931ebd599b18b5'} {{(pid=119807) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 05:26:09.028897 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1509f61-a8d1-4424-a1fa-5167d759b4cd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:09.029353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1509f61-a8d1-4424-a1fa-5167d759b4cd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:09.030160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1509f61-a8d1-4424-a1fa-5167d759b4cd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:09.030603 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1509f61-a8d1-4424-a1fa-5167d759b4cd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:09.055076 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.multi_cell_list [None req-e1509f61-a8d1-4424-a1fa-5167d759b4cd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 05:26:09.081534 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e1509f61-a8d1-4424-a1fa-5167d759b4cd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066543 Jul 20 05:26:09.082127 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3615/7330] 10.222.0.20 () {58 vars in 1124 bytes} [Wed Jul 20 05:26:09 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:26:09.092874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cd497404-8eb5-4580-b799-979dda9f7301 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:09.093593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cd497404-8eb5-4580-b799-979dda9f7301 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:09.099536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd497404-8eb5-4580-b799-979dda9f7301 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:09.100797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd497404-8eb5-4580-b799-979dda9f7301 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:09.101654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd497404-8eb5-4580-b799-979dda9f7301 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:09.102111 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cd497404-8eb5-4580-b799-979dda9f7301 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:09.233556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cd497404-8eb5-4580-b799-979dda9f7301 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:09.242166 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cd497404-8eb5-4580-b799-979dda9f7301 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1547 microversion: 2.1 time: 0.153127 Jul 20 05:26:09.242753 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3716/7331] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:09 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:10.720390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cb850bfb-581a-4a83-9346-c71aeab5667a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:10.721462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cb850bfb-581a-4a83-9346-c71aeab5667a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:10.729119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb850bfb-581a-4a83-9346-c71aeab5667a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:10.729573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb850bfb-581a-4a83-9346-c71aeab5667a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:10.730340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb850bfb-581a-4a83-9346-c71aeab5667a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:10.730783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cb850bfb-581a-4a83-9346-c71aeab5667a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:10.985594 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cb850bfb-581a-4a83-9346-c71aeab5667a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "POST /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268950 Jul 20 05:26:10.986252 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3616/7332] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Jul 20 05:26:10 2022] POST /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:26:22.745878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5fea4e05-c70a-4ed1-8e16-42394ad74058 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:22.746517 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5fea4e05-c70a-4ed1-8e16-42394ad74058 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:22.749394 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=19 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:22.750071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=72 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:22.756120 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5fea4e05-c70a-4ed1-8e16-42394ad74058 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:22.756895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5fea4e05-c70a-4ed1-8e16-42394ad74058 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:22.757443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5fea4e05-c70a-4ed1-8e16-42394ad74058 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:22.757897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5fea4e05-c70a-4ed1-8e16-42394ad74058 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:22.888007 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5fea4e05-c70a-4ed1-8e16-42394ad74058 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:22.896074 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5fea4e05-c70a-4ed1-8e16-42394ad74058 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1593 microversion: 2.1 time: 0.154054 Jul 20 05:26:22.896661 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3717/7333] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:22 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:24.870475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-bb88bf11-fbe7-482f-a0fd-916f7cec030a req-9ecce845-5975-4949-9bf0-81e58597c2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e48bf6a-e58a-4454-a74f-330a5845a1cc", "tag": "4ec39805-7bf0-4b04-aa84-4097ef525d6d"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:24.878888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:24.879960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=21 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:24.880736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:24.886214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-bb88bf11-fbe7-482f-a0fd-916f7cec030a req-9ecce845-5975-4949-9bf0-81e58597c2c3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:24.886478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-bb88bf11-fbe7-482f-a0fd-916f7cec030a req-9ecce845-5975-4949-9bf0-81e58597c2c3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:24.903526 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-bb88bf11-fbe7-482f-a0fd-916f7cec030a req-9ecce845-5975-4949-9bf0-81e58597c2c3 service nova] Creating event network-changed:4ec39805-7bf0-4b04-aa84-4097ef525d6d for instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc on n-h2-764485-11 Jul 20 05:26:24.909703 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-bb88bf11-fbe7-482f-a0fd-916f7cec030a req-9ecce845-5975-4949-9bf0-81e58597c2c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043980 Jul 20 05:26:24.910691 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3617/7334] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:26:25.890364 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-51578151-e4ca-42c4-9574-475fbb276e27 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1440748214"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:25.891102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-51578151-e4ca-42c4-9574-475fbb276e27 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:25.899322 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51578151-e4ca-42c4-9574-475fbb276e27 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:25.899888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51578151-e4ca-42c4-9574-475fbb276e27 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:25.900704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51578151-e4ca-42c4-9574-475fbb276e27 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:25.901160 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-51578151-e4ca-42c4-9574-475fbb276e27 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:26.042802 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.network.security_group_api [None req-51578151-e4ca-42c4-9574-475fbb276e27 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Adding security group df23a6bb-71aa-4ce3-97d5-b195cc4ce647 to port 4ec39805-7bf0-4b04-aa84-4097ef525d6d Jul 20 05:26:26.395353 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-51578151-e4ca-42c4-9574-475fbb276e27 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "POST /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/action" status: 202 len: 0 microversion: 2.1 time: 0.508906 Jul 20 05:26:26.399821 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3718/7335] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:26:25 2022] POST /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:26:26.407302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-81f0f30a-0381-4f0d-b29d-84c9f0222b89 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:26.408743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-81f0f30a-0381-4f0d-b29d-84c9f0222b89 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:26.417354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81f0f30a-0381-4f0d-b29d-84c9f0222b89 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:26.418167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81f0f30a-0381-4f0d-b29d-84c9f0222b89 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:26.419192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81f0f30a-0381-4f0d-b29d-84c9f0222b89 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:26.419738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-81f0f30a-0381-4f0d-b29d-84c9f0222b89 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:26.588854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-81f0f30a-0381-4f0d-b29d-84c9f0222b89 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:26.597927 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-81f0f30a-0381-4f0d-b29d-84c9f0222b89 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1759 microversion: 2.1 time: 0.196056 Jul 20 05:26:26.599949 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3618/7336] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:26 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1759 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:26.927448 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-79c4279b-0b7c-4969-9a66-625ee42161d4 req-4047f88f-f340-4410-a799-696695a644f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e48bf6a-e58a-4454-a74f-330a5845a1cc", "tag": "4ec39805-7bf0-4b04-aa84-4097ef525d6d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:26.937091 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-79c4279b-0b7c-4969-9a66-625ee42161d4 req-4047f88f-f340-4410-a799-696695a644f7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:26.937634 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-79c4279b-0b7c-4969-9a66-625ee42161d4 req-4047f88f-f340-4410-a799-696695a644f7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:26.952407 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-79c4279b-0b7c-4969-9a66-625ee42161d4 req-4047f88f-f340-4410-a799-696695a644f7 service nova] Creating event network-changed:4ec39805-7bf0-4b04-aa84-4097ef525d6d for instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc on n-h2-764485-11 Jul 20 05:26:26.957546 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-79c4279b-0b7c-4969-9a66-625ee42161d4 req-4047f88f-f340-4410-a799-696695a644f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034928 Jul 20 05:26:26.958500 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3719/7337] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:26:55.717697 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:26:55.718399 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:26:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:27:14.704324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-172d4ea4-9b08-4c22-b47d-878f8bcea69c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:27:14.705188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-172d4ea4-9b08-4c22-b47d-878f8bcea69c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:14.707383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:14.708060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=8 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:14.714922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-172d4ea4-9b08-4c22-b47d-878f8bcea69c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:14.715370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-172d4ea4-9b08-4c22-b47d-878f8bcea69c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:14.716160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-172d4ea4-9b08-4c22-b47d-878f8bcea69c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:14.716599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-172d4ea4-9b08-4c22-b47d-878f8bcea69c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:14.790929 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-172d4ea4-9b08-4c22-b47d-878f8bcea69c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "POST /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/action" status: 202 len: 0 microversion: 2.1 time: 0.090682 Jul 20 05:27:14.791663 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3619/7338] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:27:14 2022] POST /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:27:14.798318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:14.799203 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=12 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:14.803397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-22d07e93-6890-4831-a4ac-d1c4e95a1ac1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:14.804150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-22d07e93-6890-4831-a4ac-d1c4e95a1ac1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:14.811903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22d07e93-6890-4831-a4ac-d1c4e95a1ac1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:14.812374 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22d07e93-6890-4831-a4ac-d1c4e95a1ac1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:14.813165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22d07e93-6890-4831-a4ac-d1c4e95a1ac1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:14.813628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-22d07e93-6890-4831-a4ac-d1c4e95a1ac1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:15.052612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-22d07e93-6890-4831-a4ac-d1c4e95a1ac1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:15.061118 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-22d07e93-6890-4831-a4ac-d1c4e95a1ac1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1751 microversion: 2.1 time: 0.264790 Jul 20 05:27:15.061706 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3720/7339] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:14 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1751 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:16.079981 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ee1fb2e3-174e-410d-9138-441b02ec04bd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:16.080857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ee1fb2e3-174e-410d-9138-441b02ec04bd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:16.087129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee1fb2e3-174e-410d-9138-441b02ec04bd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:16.087610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee1fb2e3-174e-410d-9138-441b02ec04bd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:16.088393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee1fb2e3-174e-410d-9138-441b02ec04bd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:16.089378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ee1fb2e3-174e-410d-9138-441b02ec04bd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:16.236865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ee1fb2e3-174e-410d-9138-441b02ec04bd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:16.245711 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ee1fb2e3-174e-410d-9138-441b02ec04bd tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.170840 Jul 20 05:27:16.246443 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3620/7340] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:16 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:17.262331 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e62c6fd3-bb72-4bb3-94f2-31134baf035e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:17.262970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e62c6fd3-bb72-4bb3-94f2-31134baf035e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:17.270013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e62c6fd3-bb72-4bb3-94f2-31134baf035e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:17.270514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e62c6fd3-bb72-4bb3-94f2-31134baf035e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:17.271302 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e62c6fd3-bb72-4bb3-94f2-31134baf035e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:17.271789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e62c6fd3-bb72-4bb3-94f2-31134baf035e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:17.411688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e62c6fd3-bb72-4bb3-94f2-31134baf035e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:17.420268 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e62c6fd3-bb72-4bb3-94f2-31134baf035e tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.162027 Jul 20 05:27:17.420837 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3721/7341] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:17 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:18.438270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eac92fbc-ce66-4107-9267-ef0aa41b259a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:18.438816 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eac92fbc-ce66-4107-9267-ef0aa41b259a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:18.445672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eac92fbc-ce66-4107-9267-ef0aa41b259a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:18.446116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eac92fbc-ce66-4107-9267-ef0aa41b259a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:18.446871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eac92fbc-ce66-4107-9267-ef0aa41b259a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:18.447308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-eac92fbc-ce66-4107-9267-ef0aa41b259a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:18.589757 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eac92fbc-ce66-4107-9267-ef0aa41b259a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:18.597735 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eac92fbc-ce66-4107-9267-ef0aa41b259a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.163395 Jul 20 05:27:18.598315 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3621/7342] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:18 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:19.616435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3de973d5-b885-4382-97ae-a5593ade1593 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:19.617253 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3de973d5-b885-4382-97ae-a5593ade1593 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:19.624995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3de973d5-b885-4382-97ae-a5593ade1593 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:19.625460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3de973d5-b885-4382-97ae-a5593ade1593 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:19.626243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3de973d5-b885-4382-97ae-a5593ade1593 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:19.626695 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3de973d5-b885-4382-97ae-a5593ade1593 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:19.788842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3de973d5-b885-4382-97ae-a5593ade1593 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:19.797630 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3de973d5-b885-4382-97ae-a5593ade1593 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.185856 Jul 20 05:27:19.798201 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3722/7343] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:19 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:20.814889 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-85e2149b-3ad6-412a-857c-2cd8ef019cc2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:20.815744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-85e2149b-3ad6-412a-857c-2cd8ef019cc2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:20.822611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85e2149b-3ad6-412a-857c-2cd8ef019cc2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:20.823060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85e2149b-3ad6-412a-857c-2cd8ef019cc2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:20.824203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85e2149b-3ad6-412a-857c-2cd8ef019cc2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:20.824640 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85e2149b-3ad6-412a-857c-2cd8ef019cc2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:20.966798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-85e2149b-3ad6-412a-857c-2cd8ef019cc2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:20.975219 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-85e2149b-3ad6-412a-857c-2cd8ef019cc2 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.164237 Jul 20 05:27:20.975848 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3622/7344] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:20 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:21.993327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-69442e02-2de6-43a1-b900-c1a133f28e22 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:21.993986 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-69442e02-2de6-43a1-b900-c1a133f28e22 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:22.001320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69442e02-2de6-43a1-b900-c1a133f28e22 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:22.001800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69442e02-2de6-43a1-b900-c1a133f28e22 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:22.002590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69442e02-2de6-43a1-b900-c1a133f28e22 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:22.003050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-69442e02-2de6-43a1-b900-c1a133f28e22 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:22.150102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-69442e02-2de6-43a1-b900-c1a133f28e22 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:22.158884 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-69442e02-2de6-43a1-b900-c1a133f28e22 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.169782 Jul 20 05:27:22.159473 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3723/7345] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:21 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:23.176511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d55e1b6b-f9c8-4972-b464-b7b6cae8dfef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:23.177135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d55e1b6b-f9c8-4972-b464-b7b6cae8dfef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:23.183962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d55e1b6b-f9c8-4972-b464-b7b6cae8dfef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:23.184413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d55e1b6b-f9c8-4972-b464-b7b6cae8dfef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:23.185181 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d55e1b6b-f9c8-4972-b464-b7b6cae8dfef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:23.185622 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d55e1b6b-f9c8-4972-b464-b7b6cae8dfef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:23.330370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d55e1b6b-f9c8-4972-b464-b7b6cae8dfef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:23.338382 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d55e1b6b-f9c8-4972-b464-b7b6cae8dfef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.166072 Jul 20 05:27:23.339720 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3623/7346] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:23 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:24.355689 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0e5b7fbe-5f7f-4512-836f-1186e00ba656 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:24.356328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0e5b7fbe-5f7f-4512-836f-1186e00ba656 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:24.363294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e5b7fbe-5f7f-4512-836f-1186e00ba656 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:24.363799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e5b7fbe-5f7f-4512-836f-1186e00ba656 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:24.364595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e5b7fbe-5f7f-4512-836f-1186e00ba656 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:24.365057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0e5b7fbe-5f7f-4512-836f-1186e00ba656 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:24.519668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0e5b7fbe-5f7f-4512-836f-1186e00ba656 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:24.528691 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0e5b7fbe-5f7f-4512-836f-1186e00ba656 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.177140 Jul 20 05:27:24.529274 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3724/7347] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:24 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:25.545171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-daf439c3-7e9f-4581-974c-19d25bf5e6c4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:25.545797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-daf439c3-7e9f-4581-974c-19d25bf5e6c4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:25.553040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-daf439c3-7e9f-4581-974c-19d25bf5e6c4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:25.553490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-daf439c3-7e9f-4581-974c-19d25bf5e6c4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:25.554258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-daf439c3-7e9f-4581-974c-19d25bf5e6c4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:25.554697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-daf439c3-7e9f-4581-974c-19d25bf5e6c4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:25.699894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-daf439c3-7e9f-4581-974c-19d25bf5e6c4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:25.707962 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-daf439c3-7e9f-4581-974c-19d25bf5e6c4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.166776 Jul 20 05:27:25.708539 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3624/7348] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:25 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:26.724556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dc6dcdfc-b462-4509-bfbd-b423f89196ef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:26.725185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dc6dcdfc-b462-4509-bfbd-b423f89196ef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:26.732887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc6dcdfc-b462-4509-bfbd-b423f89196ef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:26.733390 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc6dcdfc-b462-4509-bfbd-b423f89196ef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:26.734166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc6dcdfc-b462-4509-bfbd-b423f89196ef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:26.734617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc6dcdfc-b462-4509-bfbd-b423f89196ef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:26.884129 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dc6dcdfc-b462-4509-bfbd-b423f89196ef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:26.893311 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dc6dcdfc-b462-4509-bfbd-b423f89196ef tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.172976 Jul 20 05:27:26.893896 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3725/7349] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:26 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:27.913691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5aec3dbc-84e8-4497-8b52-2dc7924f8273 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:27.914240 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5aec3dbc-84e8-4497-8b52-2dc7924f8273 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:27.922250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5aec3dbc-84e8-4497-8b52-2dc7924f8273 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:27.922709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5aec3dbc-84e8-4497-8b52-2dc7924f8273 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:27.923493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5aec3dbc-84e8-4497-8b52-2dc7924f8273 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:27.923961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5aec3dbc-84e8-4497-8b52-2dc7924f8273 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:28.076781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5aec3dbc-84e8-4497-8b52-2dc7924f8273 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:28.085148 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5aec3dbc-84e8-4497-8b52-2dc7924f8273 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.175633 Jul 20 05:27:28.085728 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3625/7350] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:27 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:29.103498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-83f7ec30-ac4d-48ae-8ef3-44d56f659ea7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:29.104657 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-83f7ec30-ac4d-48ae-8ef3-44d56f659ea7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:29.111556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83f7ec30-ac4d-48ae-8ef3-44d56f659ea7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:29.112025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83f7ec30-ac4d-48ae-8ef3-44d56f659ea7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:29.112792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83f7ec30-ac4d-48ae-8ef3-44d56f659ea7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:29.113243 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83f7ec30-ac4d-48ae-8ef3-44d56f659ea7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:29.260025 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-83f7ec30-ac4d-48ae-8ef3-44d56f659ea7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:29.269210 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-83f7ec30-ac4d-48ae-8ef3-44d56f659ea7 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.169661 Jul 20 05:27:29.269786 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3726/7351] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:29 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:30.286112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ca70cee5-5f85-4bc3-b1af-e61fb7aad8a8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:30.286726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ca70cee5-5f85-4bc3-b1af-e61fb7aad8a8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:30.293610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ca70cee5-5f85-4bc3-b1af-e61fb7aad8a8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:30.294060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ca70cee5-5f85-4bc3-b1af-e61fb7aad8a8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:30.294821 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ca70cee5-5f85-4bc3-b1af-e61fb7aad8a8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:30.295264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ca70cee5-5f85-4bc3-b1af-e61fb7aad8a8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:30.760447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ca70cee5-5f85-4bc3-b1af-e61fb7aad8a8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:30.769619 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ca70cee5-5f85-4bc3-b1af-e61fb7aad8a8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1756 microversion: 2.1 time: 0.487384 Jul 20 05:27:30.770208 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3626/7352] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:30 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1756 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:31.788229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-35d594c8-e881-4fbe-b93c-116e85bc42eb tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:31.788922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-35d594c8-e881-4fbe-b93c-116e85bc42eb tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:31.796278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35d594c8-e881-4fbe-b93c-116e85bc42eb tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:31.796746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35d594c8-e881-4fbe-b93c-116e85bc42eb tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:31.797523 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35d594c8-e881-4fbe-b93c-116e85bc42eb tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:31.797979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-35d594c8-e881-4fbe-b93c-116e85bc42eb tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:31.941485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-35d594c8-e881-4fbe-b93c-116e85bc42eb tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:31.950106 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-35d594c8-e881-4fbe-b93c-116e85bc42eb tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1759 microversion: 2.1 time: 0.165812 Jul 20 05:27:31.950675 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3727/7353] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:31 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:35.246929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=16 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:35.248153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:35.252187 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c839f43c-fe5e-421a-9f19-a0ae4d4628f8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1440748214"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:35.252724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c839f43c-fe5e-421a-9f19-a0ae4d4628f8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:35.260255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c839f43c-fe5e-421a-9f19-a0ae4d4628f8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:35.260705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c839f43c-fe5e-421a-9f19-a0ae4d4628f8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:35.262749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c839f43c-fe5e-421a-9f19-a0ae4d4628f8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:35.263186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c839f43c-fe5e-421a-9f19-a0ae4d4628f8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:35.395017 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.network.security_group_api [None req-c839f43c-fe5e-421a-9f19-a0ae4d4628f8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Removing security group df23a6bb-71aa-4ce3-97d5-b195cc4ce647 from port 4ec39805-7bf0-4b04-aa84-4097ef525d6d Jul 20 05:28:35.700524 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 20 05:28:35.701303 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:28:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:28:35.730383 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c839f43c-fe5e-421a-9f19-a0ae4d4628f8 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "POST /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/action" status: 202 len: 0 microversion: 2.1 time: 0.486066 Jul 20 05:28:35.731094 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3627/7354] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:28:35 2022] POST /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:28:35.744325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-1a4711da-dcdf-4c1b-972a-1f1e234f8fe2 req-324369fa-13fd-44fb-aec7-f03823a7efad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e48bf6a-e58a-4454-a74f-330a5845a1cc", "tag": "4ec39805-7bf0-4b04-aa84-4097ef525d6d"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:35.755731 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=16 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:35.757890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=48 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:35.762878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1a4711da-dcdf-4c1b-972a-1f1e234f8fe2 req-324369fa-13fd-44fb-aec7-f03823a7efad service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:35.764342 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-1a4711da-dcdf-4c1b-972a-1f1e234f8fe2 req-324369fa-13fd-44fb-aec7-f03823a7efad service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:35.783154 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-1a4711da-dcdf-4c1b-972a-1f1e234f8fe2 req-324369fa-13fd-44fb-aec7-f03823a7efad service nova] Creating event network-changed:4ec39805-7bf0-4b04-aa84-4097ef525d6d for instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc on n-h2-764485-11 Jul 20 05:28:35.789896 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-1a4711da-dcdf-4c1b-972a-1f1e234f8fe2 req-324369fa-13fd-44fb-aec7-f03823a7efad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051943 Jul 20 05:28:35.790699 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3728/7355] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:28:36.859059 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:28:36.859660 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:28:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:28:37.139959 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f085a148-028f-478e-9e14-d84f7bec185f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:37.140480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f085a148-028f-478e-9e14-d84f7bec185f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:37.146903 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f085a148-028f-478e-9e14-d84f7bec185f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:37.147382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f085a148-028f-478e-9e14-d84f7bec185f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:37.148190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f085a148-028f-478e-9e14-d84f7bec185f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:37.148635 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f085a148-028f-478e-9e14-d84f7bec185f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:37.232375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-f085a148-028f-478e-9e14-d84f7bec185f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lazy-loading 'services' on Instance uuid 1e48bf6a-e58a-4454-a74f-330a5845a1cc {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:28:37.296995 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:28:37.297244 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:28:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments/ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc (ip 10.222.0.20) !!! Jul 20 05:28:37.321480 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f085a148-028f-478e-9e14-d84f7bec185f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments/ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc" status: 202 len: 0 microversion: 2.1 time: 0.188385 Jul 20 05:28:37.322103 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3628/7356] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 05:28:37 2022] DELETE /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments/ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:28:37.338749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d9ff265-2bd3-4f85-9582-3926ef9379ab tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:37.340549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5d9ff265-2bd3-4f85-9582-3926ef9379ab tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:37.347905 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4776198a-db9f-4da8-a9d3-98de639ffb43] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:28:37.350333 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d9ff265-2bd3-4f85-9582-3926ef9379ab tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:37.350810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d9ff265-2bd3-4f85-9582-3926ef9379ab tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:37.351636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d9ff265-2bd3-4f85-9582-3926ef9379ab tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:37.352088 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d9ff265-2bd3-4f85-9582-3926ef9379ab tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:37.384548 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5d9ff265-2bd3-4f85-9582-3926ef9379ab tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050845 Jul 20 05:28:37.385121 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3729/7357] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:28:37 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:28:37.808901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-4b54427c-696e-465b-b430-7d61da1c2a75 req-51b57cf3-e3f2-45e1-9e0d-25d5a28d8806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e48bf6a-e58a-4454-a74f-330a5845a1cc", "tag": "4ec39805-7bf0-4b04-aa84-4097ef525d6d"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:37.817165 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4b54427c-696e-465b-b430-7d61da1c2a75 req-51b57cf3-e3f2-45e1-9e0d-25d5a28d8806 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:37.817618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4b54427c-696e-465b-b430-7d61da1c2a75 req-51b57cf3-e3f2-45e1-9e0d-25d5a28d8806 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:37.829120 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-4b54427c-696e-465b-b430-7d61da1c2a75 req-51b57cf3-e3f2-45e1-9e0d-25d5a28d8806 service nova] Creating event network-changed:4ec39805-7bf0-4b04-aa84-4097ef525d6d for instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc on n-h2-764485-11 Jul 20 05:28:37.834111 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-4b54427c-696e-465b-b430-7d61da1c2a75 req-51b57cf3-e3f2-45e1-9e0d-25d5a28d8806 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029998 Jul 20 05:28:37.834745 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3629/7358] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:28:38.396010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4f1d7edf-c65a-4ef6-b9a9-01dce333cee4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:38.396934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4f1d7edf-c65a-4ef6-b9a9-01dce333cee4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:38.405187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f1d7edf-c65a-4ef6-b9a9-01dce333cee4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:38.405654 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f1d7edf-c65a-4ef6-b9a9-01dce333cee4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:38.406446 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f1d7edf-c65a-4ef6-b9a9-01dce333cee4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:38.406895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4f1d7edf-c65a-4ef6-b9a9-01dce333cee4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:38.426196 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] [4776198a-db9f-4da8-a9d3-98de639ffb43] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53570. Jul 20 05:28:38.440001 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4f1d7edf-c65a-4ef6-b9a9-01dce333cee4 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047888 Jul 20 05:28:38.440582 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3730/7359] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:28:38 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:28:39.452944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e1d507c1-69b4-4f01-883d-29d8f8674f31 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:39.453880 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e1d507c1-69b4-4f01-883d-29d8f8674f31 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:39.460517 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1d507c1-69b4-4f01-883d-29d8f8674f31 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:39.460976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1d507c1-69b4-4f01-883d-29d8f8674f31 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:39.461763 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1d507c1-69b4-4f01-883d-29d8f8674f31 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:39.462212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e1d507c1-69b4-4f01-883d-29d8f8674f31 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:39.494445 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e1d507c1-69b4-4f01-883d-29d8f8674f31 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046846 Jul 20 05:28:39.495150 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3630/7360] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:28:39 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:28:40.507879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df30da28-f723-4c78-88e9-4db82257f23f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:40.508828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df30da28-f723-4c78-88e9-4db82257f23f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:40.516181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df30da28-f723-4c78-88e9-4db82257f23f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:40.516652 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df30da28-f723-4c78-88e9-4db82257f23f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:40.517445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df30da28-f723-4c78-88e9-4db82257f23f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:40.517906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df30da28-f723-4c78-88e9-4db82257f23f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:40.549095 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df30da28-f723-4c78-88e9-4db82257f23f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045305 Jul 20 05:28:40.549673 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3731/7361] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:28:40 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:28:41.560978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-01b6f890-fccb-4307-89a9-6b4b15e3bd63 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:41.561896 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-01b6f890-fccb-4307-89a9-6b4b15e3bd63 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:41.568825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01b6f890-fccb-4307-89a9-6b4b15e3bd63 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:41.569272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01b6f890-fccb-4307-89a9-6b4b15e3bd63 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:41.570055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01b6f890-fccb-4307-89a9-6b4b15e3bd63 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:41.570490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01b6f890-fccb-4307-89a9-6b4b15e3bd63 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:41.600178 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-01b6f890-fccb-4307-89a9-6b4b15e3bd63 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043234 Jul 20 05:28:41.600736 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3631/7362] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:28:41 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:28:42.612186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6815e595-770c-4cd4-9358-4d34f7ee561c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:42.613137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6815e595-770c-4cd4-9358-4d34f7ee561c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:42.620580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6815e595-770c-4cd4-9358-4d34f7ee561c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:42.621046 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6815e595-770c-4cd4-9358-4d34f7ee561c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:42.621832 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6815e595-770c-4cd4-9358-4d34f7ee561c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:42.622346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6815e595-770c-4cd4-9358-4d34f7ee561c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:42.653136 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6815e595-770c-4cd4-9358-4d34f7ee561c tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044895 Jul 20 05:28:42.653731 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3732/7363] 10.222.0.20 () {58 vars in 1301 bytes} [Wed Jul 20 05:28:42 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:28:42.664521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3cbcbf86-bae8-44fe-8d99-bf2049506b7a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:42.665026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3cbcbf86-bae8-44fe-8d99-bf2049506b7a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:42.673176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf86-bae8-44fe-8d99-bf2049506b7a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:42.673630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf86-bae8-44fe-8d99-bf2049506b7a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:42.674431 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf86-bae8-44fe-8d99-bf2049506b7a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:42.674871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf86-bae8-44fe-8d99-bf2049506b7a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:42.751642 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-3cbcbf86-bae8-44fe-8d99-bf2049506b7a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] HTTP exception thrown: Instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc is not attached to volume ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3cbcbf86-bae8-44fe-8d99-bf2049506b7a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Request method failure captured: Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: request: DELETE /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments/ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc HTTP/1.1 Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi15CRGWjejOrrMSUna0GXpeYjd84ew1tGTTNOMWdU_oESuWHYtLH9ITbU8uD77_o1yj9LEug3SJbjxzOPb8cbu0WkIFMybqA48sa6EigOlhmuCQzN-lvx4diM70Y2hSdtCsa60Ic8YT8k-rLkM4qEGUJs-Wu5oATdOvEgdGv84Ry9xzc Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 31b9732382a44ed78c931ebd599b18b5 Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestMinimumBasicScenario-1096345691 Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31b9732382a44ed78c931ebd599b18b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31b9732382a44ed78c931ebd599b18b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31b9732382a44ed78c931ebd599b18b5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31b9732382a44ed78c931ebd599b18b5"}]}] Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestMinimumBasicScenario-1096345691 Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 31b9732382a44ed78c931ebd599b18b5 Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1096345691 Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestMinimumBasicScenario-1096345691-project Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: ecbac989e7de4f80abddc8841ec4c931 Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestMinimumBasicScenario-1096345691-project Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc is not attached to volume ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'server_id': '1e48bf6a-e58a-4454-a74f-330a5845a1cc', 'id': 'ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc'} Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc. Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc is not attached to volume ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:28:42.753979 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:28:42.758588 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:28:42.758588 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:28:42.758588 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc is not attached to volume ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc Jul 20 05:28:42.758588 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:28:42.758588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3cbcbf86-bae8-44fe-8d99-bf2049506b7a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Returning 404 to user: Instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc is not attached to volume ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:28:42.758588 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3cbcbf86-bae8-44fe-8d99-bf2049506b7a tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments/ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc" status: 404 len: 154 microversion: 2.1 time: 0.095695 Jul 20 05:28:42.758588 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3632/7364] 10.222.0.20 () {58 vars in 1415 bytes} [Wed Jul 20 05:28:42 2022] DELETE /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc/os-volume_attachments/ea9c0d0e-024b-4b31-9b3f-2a98ff6b53cc => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:28:45.987249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-44594c93-4da1-4e15-9664-85bf488b6835 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:45.987897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44594c93-4da1-4e15-9664-85bf488b6835 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:45.996501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44594c93-4da1-4e15-9664-85bf488b6835 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:45.996992 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44594c93-4da1-4e15-9664-85bf488b6835 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:45.997800 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44594c93-4da1-4e15-9664-85bf488b6835 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:45.998927 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-44594c93-4da1-4e15-9664-85bf488b6835 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:46.024240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-44594c93-4da1-4e15-9664-85bf488b6835 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:28:46.100586 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-44594c93-4da1-4e15-9664-85bf488b6835 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 204 len: 0 microversion: 2.1 time: 0.116843 Jul 20 05:28:46.101516 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3733/7365] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:28:45 2022] DELETE /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:28:46.111990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d6e16520-5904-4874-af10-32fdedf66e48 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:46.112730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d6e16520-5904-4874-af10-32fdedf66e48 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:46.121027 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6e16520-5904-4874-af10-32fdedf66e48 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:46.121592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6e16520-5904-4874-af10-32fdedf66e48 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:46.122441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6e16520-5904-4874-af10-32fdedf66e48 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:46.122950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d6e16520-5904-4874-af10-32fdedf66e48 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:46.269599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d6e16520-5904-4874-af10-32fdedf66e48 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:46.277351 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d6e16520-5904-4874-af10-32fdedf66e48 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1553 microversion: 2.1 time: 0.170466 Jul 20 05:28:46.277920 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3633/7366] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:46 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:47.296127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6003334e-3f92-4d94-938c-e7a59ba2c6e1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:47.296839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6003334e-3f92-4d94-938c-e7a59ba2c6e1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:47.303996 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6003334e-3f92-4d94-938c-e7a59ba2c6e1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:47.304483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6003334e-3f92-4d94-938c-e7a59ba2c6e1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:47.305259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6003334e-3f92-4d94-938c-e7a59ba2c6e1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:47.305739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6003334e-3f92-4d94-938c-e7a59ba2c6e1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:47.434706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6003334e-3f92-4d94-938c-e7a59ba2c6e1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:47.442419 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6003334e-3f92-4d94-938c-e7a59ba2c6e1 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1553 microversion: 2.1 time: 0.151857 Jul 20 05:28:47.442942 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3734/7367] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:47 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:48.454015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-04e37074-da07-4d7e-94cd-51fdfda87ebd req-8b9e1246-92b5-4020-96f3-48d0990b0ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e48bf6a-e58a-4454-a74f-330a5845a1cc", "name": "network-vif-deleted", "tag": "4ec39805-7bf0-4b04-aa84-4097ef525d6d"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:48.461124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ed11ecde-6786-42e5-be4c-695b2dfaaa45 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:48.461765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ed11ecde-6786-42e5-be4c-695b2dfaaa45 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:48.464419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-04e37074-da07-4d7e-94cd-51fdfda87ebd req-8b9e1246-92b5-4020-96f3-48d0990b0ffe service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:48.465552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-04e37074-da07-4d7e-94cd-51fdfda87ebd req-8b9e1246-92b5-4020-96f3-48d0990b0ffe service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:48.468835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed11ecde-6786-42e5-be4c-695b2dfaaa45 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:48.469395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed11ecde-6786-42e5-be4c-695b2dfaaa45 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:48.470686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed11ecde-6786-42e5-be4c-695b2dfaaa45 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:48.471442 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed11ecde-6786-42e5-be4c-695b2dfaaa45 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:48.477077 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-04e37074-da07-4d7e-94cd-51fdfda87ebd req-8b9e1246-92b5-4020-96f3-48d0990b0ffe service nova] Creating event network-vif-deleted:4ec39805-7bf0-4b04-aa84-4097ef525d6d for instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc on n-h2-764485-11 Jul 20 05:28:48.482592 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-04e37074-da07-4d7e-94cd-51fdfda87ebd req-8b9e1246-92b5-4020-96f3-48d0990b0ffe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032205 Jul 20 05:28:48.483305 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3634/7368] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:28:48.538474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ed11ecde-6786-42e5-be4c-695b2dfaaa45 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbac989e7de4f80abddc8841ec4c931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b9732382a44ed78c931ebd599b18b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:48.546947 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ed11ecde-6786-42e5-be4c-695b2dfaaa45 tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 200 len: 1511 microversion: 2.1 time: 0.091491 Jul 20 05:28:48.547560 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3735/7369] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:48 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 1511 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:49.566178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b30ec82-c626-4e6f-a7a9-655b7948a3be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:49.566916 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7b30ec82-c626-4e6f-a7a9-655b7948a3be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] [instance: 1e48bf6a-e58a-4454-a74f-330a5845a1cc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:49.574148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b30ec82-c626-4e6f-a7a9-655b7948a3be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:49.574617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b30ec82-c626-4e6f-a7a9-655b7948a3be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:49.575398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b30ec82-c626-4e6f-a7a9-655b7948a3be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:49.575876 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b30ec82-c626-4e6f-a7a9-655b7948a3be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:49.589767 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-7b30ec82-c626-4e6f-a7a9-655b7948a3be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] HTTP exception thrown: Instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc could not be found. Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b30ec82-c626-4e6f-a7a9-655b7948a3be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Request method failure captured: Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc HTTP/1.1 Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi15CRGWjejOrrMSUna0GXpeYjd84ew1tGTTNOMWdU_oESuWHYtLH9ITbU8uD77_o1yj9LEug3SJbjxzOPb8cbu0WkIFMybqA48sa6EigOlhmuCQzN-lvx4diM70Y2hSdtCsa60Ic8YT8k-rLkM4qEGUJs-Wu5oATdOvEgdGv84Ry9xzc Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 31b9732382a44ed78c931ebd599b18b5 Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestMinimumBasicScenario-1096345691 Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31b9732382a44ed78c931ebd599b18b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31b9732382a44ed78c931ebd599b18b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31b9732382a44ed78c931ebd599b18b5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31b9732382a44ed78c931ebd599b18b5"}]}] Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestMinimumBasicScenario-1096345691 Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 31b9732382a44ed78c931ebd599b18b5 Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1096345691 Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestMinimumBasicScenario-1096345691-project Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: ecbac989e7de4f80abddc8841ec4c931 Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestMinimumBasicScenario-1096345691-project Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc could not be found. Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '1e48bf6a-e58a-4454-a74f-330a5845a1cc'} Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc could not be found. Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc could not be found. Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:28:49.591444 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:28:49.596182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:28:49.596182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:28:49.596182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:28:49.596182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:28:49.596182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:28:49.596182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc could not be found. Jul 20 05:28:49.596182 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:28:49.596182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b30ec82-c626-4e6f-a7a9-655b7948a3be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Returning 404 to user: Instance 1e48bf6a-e58a-4454-a74f-330a5845a1cc could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:28:49.596182 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7b30ec82-c626-4e6f-a7a9-655b7948a3be tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc" status: 404 len: 111 microversion: 2.1 time: 0.031863 Jul 20 05:28:49.596182 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3635/7370] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:49 2022] GET /compute/v2.1/servers/1e48bf6a-e58a-4454-a74f-330a5845a1cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:28:49.601729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-747f489d-430a-451f-b5e7-d42d6e15a65f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] Calling method '.version_select at 0x7fbf9c3e4ca0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:49.624483 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-747f489d-430a-451f-b5e7-d42d6e15a65f tempest-TestMinimumBasicScenario-1096345691 tempest-TestMinimumBasicScenario-1096345691-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-953566190" status: 202 len: 0 microversion: 2.1 time: 0.026520 Jul 20 05:28:49.625115 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3736/7371] 10.222.0.20 () {58 vars in 1268 bytes} [Wed Jul 20 05:28:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-953566190 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:28:58.952173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-229b6668-1f92-4dce-9bad-0d7c8b40aa42 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'create', calling method: .version_select at 0x7fbf9c512940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-345920732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzC2EtO1F9SHAOGati8o1m4awPOdZzdo8K0c069ZTGYJuZ5mpWDdTvX1TS2+hL1lyLGKSJHUAojtZDyqkxmyK7KSBxayWBKY2tkuYU0mUSvlwq+7TopBEaWbUrK5Ha80Q=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:58.966061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-229b6668-1f92-4dce-9bad-0d7c8b40aa42 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:28:58.971060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-229b6668-1f92-4dce-9bad-0d7c8b40aa42 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for user 48a1bf5634564af2af0d1ca7c59672a5 and project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:28:59.000185 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-229b6668-1f92-4dce-9bad-0d7c8b40aa42 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.212600 Jul 20 05:28:59.000796 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3636/7372] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:28:58 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:04.682519 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:04.683427 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:04.688370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1399718144", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "c9c5ae45-1cad-4c9e-86cc-2340f934d6a8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-345920732", "security_groups": [{"name": "tempest-secgroup-smoke-1269635"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:04.817589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] validate_networks() for [('c9c5ae45-1cad-4c9e-86cc-2340f934d6a8', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:29:05.293894 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:29:05.294422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:29:05.295000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:29:05.295554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:29:05.296071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:29:05.305315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:05.305868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:05.306767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:05.308158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:05.326161 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:29:05.332183 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for user 48a1bf5634564af2af0d1ca7c59672a5 and project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:29:05.346037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:29:05.348391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:29:05.400252 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-48d0af3c-b284-456f-9c59-ee9e910fde92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.720028 Jul 20 05:29:05.402186 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3737/7373] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:29:04 2022] POST /compute/v2.1/servers => generated 403 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:29:05.411613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7cd2c0e5-4fb4-4a0a-aff3-449461510042 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:05.412242 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7cd2c0e5-4fb4-4a0a-aff3-449461510042 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:05.414787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:05.418208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:05.482704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7cd2c0e5-4fb4-4a0a-aff3-449461510042 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:05.490045 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7cd2c0e5-4fb4-4a0a-aff3-449461510042 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1266 microversion: 2.1 time: 0.082382 Jul 20 05:29:05.490939 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3637/7374] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:05 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:06.509036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9d7aac2-84bc-4369-9c44-780f35b117a6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:06.509036 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9d7aac2-84bc-4369-9c44-780f35b117a6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:06.517358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9d7aac2-84bc-4369-9c44-780f35b117a6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:06.517659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9d7aac2-84bc-4369-9c44-780f35b117a6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:06.518526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9d7aac2-84bc-4369-9c44-780f35b117a6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:06.519054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9d7aac2-84bc-4369-9c44-780f35b117a6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:06.614433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9d7aac2-84bc-4369-9c44-780f35b117a6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:06.628985 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9d7aac2-84bc-4369-9c44-780f35b117a6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1318 microversion: 2.1 time: 0.125971 Jul 20 05:29:06.631166 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3738/7375] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:06 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1318 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:07.647436 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f360739f-9b6e-4183-8bbf-ff1da5ebb4a8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:07.648132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f360739f-9b6e-4183-8bbf-ff1da5ebb4a8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:07.655962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f360739f-9b6e-4183-8bbf-ff1da5ebb4a8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:07.656510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f360739f-9b6e-4183-8bbf-ff1da5ebb4a8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:07.657376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f360739f-9b6e-4183-8bbf-ff1da5ebb4a8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:07.657891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f360739f-9b6e-4183-8bbf-ff1da5ebb4a8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:07.897466 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f360739f-9b6e-4183-8bbf-ff1da5ebb4a8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:07.905872 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f360739f-9b6e-4183-8bbf-ff1da5ebb4a8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1389 microversion: 2.1 time: 0.262310 Jul 20 05:29:07.911551 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3638/7376] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:07 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1389 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:08.232215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-67efbfcf-43fb-442d-8c5f-ccc08bde762e req-c6fd7575-fcad-4916-891d-5c0edf90d1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34195ee-b834-40bb-b6b7-e8c32cd4bc7d", "tag": "f4a792fe-0bf5-4c69-aca5-0c9aebf435a3"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:08.242921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-67efbfcf-43fb-442d-8c5f-ccc08bde762e req-c6fd7575-fcad-4916-891d-5c0edf90d1fd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:08.243668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-67efbfcf-43fb-442d-8c5f-ccc08bde762e req-c6fd7575-fcad-4916-891d-5c0edf90d1fd service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:08.269574 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-67efbfcf-43fb-442d-8c5f-ccc08bde762e req-c6fd7575-fcad-4916-891d-5c0edf90d1fd service nova] Creating event network-changed:f4a792fe-0bf5-4c69-aca5-0c9aebf435a3 for instance d34195ee-b834-40bb-b6b7-e8c32cd4bc7d on n-h1-764485-11 Jul 20 05:29:08.277393 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-67efbfcf-43fb-442d-8c5f-ccc08bde762e req-c6fd7575-fcad-4916-891d-5c0edf90d1fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053897 Jul 20 05:29:08.278285 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3739/7377] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:08.923825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b17f43d-8e35-4990-8020-fd3f476d97a1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:08.925230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7b17f43d-8e35-4990-8020-fd3f476d97a1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:08.933020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b17f43d-8e35-4990-8020-fd3f476d97a1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:08.933482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b17f43d-8e35-4990-8020-fd3f476d97a1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:08.934263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b17f43d-8e35-4990-8020-fd3f476d97a1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:08.934708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b17f43d-8e35-4990-8020-fd3f476d97a1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:09.115664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7b17f43d-8e35-4990-8020-fd3f476d97a1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:09.123825 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7b17f43d-8e35-4990-8020-fd3f476d97a1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1389 microversion: 2.1 time: 0.203888 Jul 20 05:29:09.124401 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3639/7378] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:08 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1389 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:10.142561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-87695d9d-562c-42fc-8431-ef72831e82c7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:10.143208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-87695d9d-562c-42fc-8431-ef72831e82c7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:10.149619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87695d9d-562c-42fc-8431-ef72831e82c7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:10.150092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87695d9d-562c-42fc-8431-ef72831e82c7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:10.150883 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87695d9d-562c-42fc-8431-ef72831e82c7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:10.151345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-87695d9d-562c-42fc-8431-ef72831e82c7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:10.288409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-87695d9d-562c-42fc-8431-ef72831e82c7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:10.296530 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-87695d9d-562c-42fc-8431-ef72831e82c7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1389 microversion: 2.1 time: 0.159254 Jul 20 05:29:10.297112 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3740/7379] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:10 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:11.314167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7ab9c1a1-2a84-4c75-964c-644986731078 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:11.314909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7ab9c1a1-2a84-4c75-964c-644986731078 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:11.322023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ab9c1a1-2a84-4c75-964c-644986731078 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:11.323148 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ab9c1a1-2a84-4c75-964c-644986731078 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:11.323960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ab9c1a1-2a84-4c75-964c-644986731078 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:11.324413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7ab9c1a1-2a84-4c75-964c-644986731078 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:11.527122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7ab9c1a1-2a84-4c75-964c-644986731078 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:11.534493 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7ab9c1a1-2a84-4c75-964c-644986731078 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1389 microversion: 2.1 time: 0.224254 Jul 20 05:29:11.535074 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3640/7380] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:11 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1389 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:12.551898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ad933ad9-e961-4dd7-a1cd-312026384d94 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:12.552537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ad933ad9-e961-4dd7-a1cd-312026384d94 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:12.559528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad933ad9-e961-4dd7-a1cd-312026384d94 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:12.560024 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad933ad9-e961-4dd7-a1cd-312026384d94 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:12.560838 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad933ad9-e961-4dd7-a1cd-312026384d94 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:12.561296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ad933ad9-e961-4dd7-a1cd-312026384d94 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:12.705765 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ad933ad9-e961-4dd7-a1cd-312026384d94 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:12.713865 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ad933ad9-e961-4dd7-a1cd-312026384d94 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1389 microversion: 2.1 time: 0.165371 Jul 20 05:29:12.714470 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3741/7381] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:12 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:13.731350 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b648a4e-2f19-4392-9d9b-7b399eb6ed04 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:13.731979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7b648a4e-2f19-4392-9d9b-7b399eb6ed04 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:13.738884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b648a4e-2f19-4392-9d9b-7b399eb6ed04 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:13.739339 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b648a4e-2f19-4392-9d9b-7b399eb6ed04 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:13.740171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b648a4e-2f19-4392-9d9b-7b399eb6ed04 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:13.740613 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b648a4e-2f19-4392-9d9b-7b399eb6ed04 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:13.875302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7b648a4e-2f19-4392-9d9b-7b399eb6ed04 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:13.883155 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7b648a4e-2f19-4392-9d9b-7b399eb6ed04 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1389 microversion: 2.1 time: 0.156353 Jul 20 05:29:13.883771 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3641/7382] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:13 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:14.770282 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-baae7edb-d2fd-44e0-b58a-c75abdda9dd8 req-1d1205bb-5a40-4248-bcad-4f9865e69d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34195ee-b834-40bb-b6b7-e8c32cd4bc7d", "name": "network-vif-plugged", "status": "completed", "tag": "f4a792fe-0bf5-4c69-aca5-0c9aebf435a3"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:14.780989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-baae7edb-d2fd-44e0-b58a-c75abdda9dd8 req-1d1205bb-5a40-4248-bcad-4f9865e69d64 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:14.781451 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-baae7edb-d2fd-44e0-b58a-c75abdda9dd8 req-1d1205bb-5a40-4248-bcad-4f9865e69d64 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:14.793808 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-baae7edb-d2fd-44e0-b58a-c75abdda9dd8 req-1d1205bb-5a40-4248-bcad-4f9865e69d64 service nova] Creating event network-vif-plugged:f4a792fe-0bf5-4c69-aca5-0c9aebf435a3 for instance d34195ee-b834-40bb-b6b7-e8c32cd4bc7d on n-h1-764485-11 Jul 20 05:29:14.798957 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-baae7edb-d2fd-44e0-b58a-c75abdda9dd8 req-1d1205bb-5a40-4248-bcad-4f9865e69d64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032946 Jul 20 05:29:14.799599 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3742/7383] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:14.900154 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-27c1052e-cc31-4f2c-a74c-ecf687b2dc24 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:14.901446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-27c1052e-cc31-4f2c-a74c-ecf687b2dc24 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:14.908636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27c1052e-cc31-4f2c-a74c-ecf687b2dc24 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:14.909109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27c1052e-cc31-4f2c-a74c-ecf687b2dc24 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:14.909884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27c1052e-cc31-4f2c-a74c-ecf687b2dc24 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:14.910318 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27c1052e-cc31-4f2c-a74c-ecf687b2dc24 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:15.051097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-27c1052e-cc31-4f2c-a74c-ecf687b2dc24 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:15.058750 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-27c1052e-cc31-4f2c-a74c-ecf687b2dc24 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1389 microversion: 2.1 time: 0.162531 Jul 20 05:29:15.059327 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3642/7384] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:14 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:16.072136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:16.073572 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:16.078414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7b30f917-74d8-4bcf-8aaf-b5ab94cfcba4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:16.079143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7b30f917-74d8-4bcf-8aaf-b5ab94cfcba4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:16.086337 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b30f917-74d8-4bcf-8aaf-b5ab94cfcba4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:16.086813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b30f917-74d8-4bcf-8aaf-b5ab94cfcba4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:16.087617 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b30f917-74d8-4bcf-8aaf-b5ab94cfcba4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:16.088688 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7b30f917-74d8-4bcf-8aaf-b5ab94cfcba4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:16.233305 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7b30f917-74d8-4bcf-8aaf-b5ab94cfcba4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:16.242534 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7b30f917-74d8-4bcf-8aaf-b5ab94cfcba4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1389 microversion: 2.1 time: 0.170782 Jul 20 05:29:16.254258 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3743/7385] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:16 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1389 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:17.258609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-add882e3-16db-45b7-8843-ade5f874acba tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:17.259276 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-add882e3-16db-45b7-8843-ade5f874acba tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:17.261637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:17.267993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-add882e3-16db-45b7-8843-ade5f874acba tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:17.268444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-add882e3-16db-45b7-8843-ade5f874acba tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:17.269210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-add882e3-16db-45b7-8843-ade5f874acba tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:17.269652 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-add882e3-16db-45b7-8843-ade5f874acba tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:17.405541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-add882e3-16db-45b7-8843-ade5f874acba tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:17.413094 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-add882e3-16db-45b7-8843-ade5f874acba tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1560 microversion: 2.1 time: 0.158368 Jul 20 05:29:17.413674 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3643/7386] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:17 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:17.429154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9dac6609-a7d0-4427-8ca6-8c369d457aa1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:17.429775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9dac6609-a7d0-4427-8ca6-8c369d457aa1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:17.437376 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dac6609-a7d0-4427-8ca6-8c369d457aa1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:17.437835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dac6609-a7d0-4427-8ca6-8c369d457aa1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:17.438630 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dac6609-a7d0-4427-8ca6-8c369d457aa1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:17.439077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9dac6609-a7d0-4427-8ca6-8c369d457aa1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:17.569977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-9dac6609-a7d0-4427-8ca6-8c369d457aa1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:17.577645 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9dac6609-a7d0-4427-8ca6-8c369d457aa1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1560 microversion: 2.1 time: 0.152380 Jul 20 05:29:17.578219 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3744/7387] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:17 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:19.520802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-bbcc5d16-b363-4602-8602-30d3b05e21c1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:19.521415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-bbcc5d16-b363-4602-8602-30d3b05e21c1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:19.529385 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-894d8ab0-e703-4ce8-b812-b76c24fe8cee req-6cea13c5-c644-498e-9ae1-3cbc7457ffa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34195ee-b834-40bb-b6b7-e8c32cd4bc7d", "tag": "f4a792fe-0bf5-4c69-aca5-0c9aebf435a3"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:19.540617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bbcc5d16-b363-4602-8602-30d3b05e21c1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:19.541080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bbcc5d16-b363-4602-8602-30d3b05e21c1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:19.541875 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bbcc5d16-b363-4602-8602-30d3b05e21c1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:19.542329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-bbcc5d16-b363-4602-8602-30d3b05e21c1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:19.550209 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-894d8ab0-e703-4ce8-b812-b76c24fe8cee req-6cea13c5-c644-498e-9ae1-3cbc7457ffa0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:19.550949 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-894d8ab0-e703-4ce8-b812-b76c24fe8cee req-6cea13c5-c644-498e-9ae1-3cbc7457ffa0 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:19.575483 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-894d8ab0-e703-4ce8-b812-b76c24fe8cee req-6cea13c5-c644-498e-9ae1-3cbc7457ffa0 service nova] Creating event network-changed:f4a792fe-0bf5-4c69-aca5-0c9aebf435a3 for instance d34195ee-b834-40bb-b6b7-e8c32cd4bc7d on n-h1-764485-11 Jul 20 05:29:19.588760 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-894d8ab0-e703-4ce8-b812-b76c24fe8cee req-6cea13c5-c644-498e-9ae1-3cbc7457ffa0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057532 Jul 20 05:29:19.590581 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3745/7388] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:19.768106 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-bbcc5d16-b363-4602-8602-30d3b05e21c1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:19.776706 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-bbcc5d16-b363-4602-8602-30d3b05e21c1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1560 microversion: 2.1 time: 0.259707 Jul 20 05:29:19.777994 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3644/7389] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:19 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1560 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:53.067351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:53.068162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=38 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:53.072706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21a4aeff-71de-4bc9-bb7f-dfb06428308f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:53.073728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21a4aeff-71de-4bc9-bb7f-dfb06428308f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:53.081375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21a4aeff-71de-4bc9-bb7f-dfb06428308f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:53.081842 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21a4aeff-71de-4bc9-bb7f-dfb06428308f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:53.082625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21a4aeff-71de-4bc9-bb7f-dfb06428308f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:53.083084 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21a4aeff-71de-4bc9-bb7f-dfb06428308f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:53.136413 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21a4aeff-71de-4bc9-bb7f-dfb06428308f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d/action" status: 200 len: 24562 microversion: 2.1 time: 0.071450 Jul 20 05:29:53.137092 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3746/7390] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:29:53 2022] POST /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d/action => generated 24562 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:30:32.244374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=17 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:32.245130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=42 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:32.249290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5af8e0c7-1d72-4830-9000-2f2b9131c6a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:32.249825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5af8e0c7-1d72-4830-9000-2f2b9131c6a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:32.256972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5af8e0c7-1d72-4830-9000-2f2b9131c6a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:32.257424 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5af8e0c7-1d72-4830-9000-2f2b9131c6a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:32.258213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5af8e0c7-1d72-4830-9000-2f2b9131c6a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:32.258646 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5af8e0c7-1d72-4830-9000-2f2b9131c6a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:32.324713 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5af8e0c7-1d72-4830-9000-2f2b9131c6a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d/action" status: 202 len: 0 microversion: 2.1 time: 0.082327 Jul 20 05:30:32.325438 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3645/7391] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:30:32 2022] POST /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:30:32.334847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39aedb58-7117-43fb-a91f-da7a43e86d2b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:32.335638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-39aedb58-7117-43fb-a91f-da7a43e86d2b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:32.338298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:32.339109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:32.348153 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39aedb58-7117-43fb-a91f-da7a43e86d2b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:32.348621 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39aedb58-7117-43fb-a91f-da7a43e86d2b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:32.349578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39aedb58-7117-43fb-a91f-da7a43e86d2b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:32.350045 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39aedb58-7117-43fb-a91f-da7a43e86d2b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:32.604735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39aedb58-7117-43fb-a91f-da7a43e86d2b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:32.612356 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39aedb58-7117-43fb-a91f-da7a43e86d2b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1684 microversion: 2.1 time: 0.282365 Jul 20 05:30:32.612929 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3747/7392] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:32 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1684 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:33.632043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3fae18b3-d6e7-4872-a5bb-239fc7e43438 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:33.632800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3fae18b3-d6e7-4872-a5bb-239fc7e43438 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:33.639729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fae18b3-d6e7-4872-a5bb-239fc7e43438 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:33.640189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fae18b3-d6e7-4872-a5bb-239fc7e43438 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:33.640966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fae18b3-d6e7-4872-a5bb-239fc7e43438 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:33.641412 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3fae18b3-d6e7-4872-a5bb-239fc7e43438 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:33.851952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3fae18b3-d6e7-4872-a5bb-239fc7e43438 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:33.859572 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3fae18b3-d6e7-4872-a5bb-239fc7e43438 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1664 microversion: 2.1 time: 0.233067 Jul 20 05:30:33.860156 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3646/7393] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:33 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1664 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:34.947257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-9802898f-4508-40fc-b9bb-e056b1ea042a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:34.948142 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-9802898f-4508-40fc-b9bb-e056b1ea042a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:34.959226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9802898f-4508-40fc-b9bb-e056b1ea042a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:34.959720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9802898f-4508-40fc-b9bb-e056b1ea042a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:34.960502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9802898f-4508-40fc-b9bb-e056b1ea042a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:34.960959 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-9802898f-4508-40fc-b9bb-e056b1ea042a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:35.009057 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-9802898f-4508-40fc-b9bb-e056b1ea042a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d/action" status: 200 len: 32631 microversion: 2.1 time: 0.065614 Jul 20 05:30:35.009724 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3748/7394] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:30:34 2022] POST /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d/action => generated 32631 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:30:35.021572 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7068798d-229d-4665-b1d6-9c6382b4126b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:35.022150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7068798d-229d-4665-b1d6-9c6382b4126b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:35.029137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7068798d-229d-4665-b1d6-9c6382b4126b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:35.029593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7068798d-229d-4665-b1d6-9c6382b4126b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:35.030361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7068798d-229d-4665-b1d6-9c6382b4126b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:35.030800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7068798d-229d-4665-b1d6-9c6382b4126b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:35.100707 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7068798d-229d-4665-b1d6-9c6382b4126b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d/action" status: 202 len: 0 microversion: 2.1 time: 0.083941 Jul 20 05:30:35.104440 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3647/7395] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:30:35 2022] POST /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:30:35.110320 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dc31caa6-4e87-4e34-9746-4342d32064de tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:35.111038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dc31caa6-4e87-4e34-9746-4342d32064de tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:35.119409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc31caa6-4e87-4e34-9746-4342d32064de tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:35.119914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc31caa6-4e87-4e34-9746-4342d32064de tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:35.120760 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc31caa6-4e87-4e34-9746-4342d32064de tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:35.121246 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dc31caa6-4e87-4e34-9746-4342d32064de tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:35.264645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dc31caa6-4e87-4e34-9746-4342d32064de tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:35.273035 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dc31caa6-4e87-4e34-9746-4342d32064de tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1671 microversion: 2.1 time: 0.166929 Jul 20 05:30:35.273619 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3749/7396] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:35 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:36.294698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3a1ab04d-926c-446f-8a1c-e01cbd4f0b19 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:36.295389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3a1ab04d-926c-446f-8a1c-e01cbd4f0b19 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:36.302416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a1ab04d-926c-446f-8a1c-e01cbd4f0b19 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:36.302860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a1ab04d-926c-446f-8a1c-e01cbd4f0b19 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:36.303643 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a1ab04d-926c-446f-8a1c-e01cbd4f0b19 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:36.304082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3a1ab04d-926c-446f-8a1c-e01cbd4f0b19 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:36.437142 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3a1ab04d-926c-446f-8a1c-e01cbd4f0b19 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:36.445128 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3a1ab04d-926c-446f-8a1c-e01cbd4f0b19 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1679 microversion: 2.1 time: 0.155427 Jul 20 05:30:36.445637 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3648/7397] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:36 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:36.535245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-94f4a1d7-acd1-4e6d-820d-8b2e113b5253 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:36.536214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-94f4a1d7-acd1-4e6d-820d-8b2e113b5253 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:36.543900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94f4a1d7-acd1-4e6d-820d-8b2e113b5253 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:36.544367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94f4a1d7-acd1-4e6d-820d-8b2e113b5253 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:36.545147 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94f4a1d7-acd1-4e6d-820d-8b2e113b5253 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:36.545601 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94f4a1d7-acd1-4e6d-820d-8b2e113b5253 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:36.598929 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-94f4a1d7-acd1-4e6d-820d-8b2e113b5253 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d/action" status: 200 len: 38338 microversion: 2.1 time: 0.067988 Jul 20 05:30:36.599764 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3750/7398] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:30:36 2022] POST /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d/action => generated 38338 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:30:37.590683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cd1c7567-0c7f-4f0a-952f-c14bac63bb92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:37.591243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cd1c7567-0c7f-4f0a-952f-c14bac63bb92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:37.598439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd1c7567-0c7f-4f0a-952f-c14bac63bb92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:37.599105 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd1c7567-0c7f-4f0a-952f-c14bac63bb92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:37.600039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd1c7567-0c7f-4f0a-952f-c14bac63bb92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:37.600485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cd1c7567-0c7f-4f0a-952f-c14bac63bb92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:37.633783 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cd1c7567-0c7f-4f0a-952f-c14bac63bb92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:30:37.653401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-8b461141-5d6f-4c91-b4d9-2680161f440b req-cec5275f-e795-4b2e-8bf4-188104a9571e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34195ee-b834-40bb-b6b7-e8c32cd4bc7d", "tag": "f4a792fe-0bf5-4c69-aca5-0c9aebf435a3"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:37.663199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-8b461141-5d6f-4c91-b4d9-2680161f440b req-cec5275f-e795-4b2e-8bf4-188104a9571e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:37.663706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-8b461141-5d6f-4c91-b4d9-2680161f440b req-cec5275f-e795-4b2e-8bf4-188104a9571e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:37.676269 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-8b461141-5d6f-4c91-b4d9-2680161f440b req-cec5275f-e795-4b2e-8bf4-188104a9571e service nova] Creating event network-changed:f4a792fe-0bf5-4c69-aca5-0c9aebf435a3 for instance d34195ee-b834-40bb-b6b7-e8c32cd4bc7d on n-h1-764485-11 Jul 20 05:30:37.682030 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-8b461141-5d6f-4c91-b4d9-2680161f440b req-cec5275f-e795-4b2e-8bf4-188104a9571e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101078 Jul 20 05:30:37.683082 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3751/7399] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:30:37.721721 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cd1c7567-0c7f-4f0a-952f-c14bac63bb92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 204 len: 0 microversion: 2.1 time: 0.142665 Jul 20 05:30:37.724103 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3649/7400] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:30:37 2022] DELETE /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:30:37.732579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e93f2eeb-3f81-45e9-bd72-6b42b0313ab5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:37.733313 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e93f2eeb-3f81-45e9-bd72-6b42b0313ab5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:37.740910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e93f2eeb-3f81-45e9-bd72-6b42b0313ab5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:37.741530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e93f2eeb-3f81-45e9-bd72-6b42b0313ab5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:37.742973 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e93f2eeb-3f81-45e9-bd72-6b42b0313ab5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:37.743573 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e93f2eeb-3f81-45e9-bd72-6b42b0313ab5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:37.880735 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e93f2eeb-3f81-45e9-bd72-6b42b0313ab5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:37.888398 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e93f2eeb-3f81-45e9-bd72-6b42b0313ab5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1685 microversion: 2.1 time: 0.160095 Jul 20 05:30:37.889060 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3752/7401] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:37 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:38.907620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cc109e26-b41b-45fa-acb7-e2016de41755 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:38.908245 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cc109e26-b41b-45fa-acb7-e2016de41755 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:38.915475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc109e26-b41b-45fa-acb7-e2016de41755 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:38.915955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc109e26-b41b-45fa-acb7-e2016de41755 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:38.916714 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc109e26-b41b-45fa-acb7-e2016de41755 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:38.917153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc109e26-b41b-45fa-acb7-e2016de41755 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:39.052715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-cc109e26-b41b-45fa-acb7-e2016de41755 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:39.060413 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cc109e26-b41b-45fa-acb7-e2016de41755 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1685 microversion: 2.1 time: 0.157183 Jul 20 05:30:39.060995 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3650/7402] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:38 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:40.078535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-78e13c34-ec4a-4224-8dc4-0bf89f47e3b5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:40.079286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-78e13c34-ec4a-4224-8dc4-0bf89f47e3b5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:40.087135 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78e13c34-ec4a-4224-8dc4-0bf89f47e3b5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:40.087643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78e13c34-ec4a-4224-8dc4-0bf89f47e3b5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:40.088455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78e13c34-ec4a-4224-8dc4-0bf89f47e3b5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:40.088897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-78e13c34-ec4a-4224-8dc4-0bf89f47e3b5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:40.161903 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-78e13c34-ec4a-4224-8dc4-0bf89f47e3b5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:40.169868 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-78e13c34-ec4a-4224-8dc4-0bf89f47e3b5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 200 len: 1501 microversion: 2.1 time: 0.095213 Jul 20 05:30:40.170855 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3753/7403] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:40 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 1501 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:40.283596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-23641bce-72ab-4d69-860b-763452c28c23 req-46c94755-3aee-4fec-b169-6fb2948be6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34195ee-b834-40bb-b6b7-e8c32cd4bc7d", "name": "network-vif-deleted", "tag": "f4a792fe-0bf5-4c69-aca5-0c9aebf435a3"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:40.292124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-23641bce-72ab-4d69-860b-763452c28c23 req-46c94755-3aee-4fec-b169-6fb2948be6da service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:40.292567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-23641bce-72ab-4d69-860b-763452c28c23 req-46c94755-3aee-4fec-b169-6fb2948be6da service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:40.304438 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-23641bce-72ab-4d69-860b-763452c28c23 req-46c94755-3aee-4fec-b169-6fb2948be6da service nova] Creating event network-vif-deleted:f4a792fe-0bf5-4c69-aca5-0c9aebf435a3 for instance d34195ee-b834-40bb-b6b7-e8c32cd4bc7d on n-h1-764485-11 Jul 20 05:30:40.309597 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-23641bce-72ab-4d69-860b-763452c28c23 req-46c94755-3aee-4fec-b169-6fb2948be6da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090626 Jul 20 05:30:40.310262 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3651/7404] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:30:41.187622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-060c11d7-f3b6-41f2-af6f-3054359295c8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:41.188690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-060c11d7-f3b6-41f2-af6f-3054359295c8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: d34195ee-b834-40bb-b6b7-e8c32cd4bc7d] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:41.196775 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-060c11d7-f3b6-41f2-af6f-3054359295c8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:41.197237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-060c11d7-f3b6-41f2-af6f-3054359295c8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:41.198013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-060c11d7-f3b6-41f2-af6f-3054359295c8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:41.198463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-060c11d7-f3b6-41f2-af6f-3054359295c8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:41.212339 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-060c11d7-f3b6-41f2-af6f-3054359295c8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] HTTP exception thrown: Instance d34195ee-b834-40bb-b6b7-e8c32cd4bc7d could not be found. Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-060c11d7-f3b6-41f2-af6f-3054359295c8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Request method failure captured: Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d HTTP/1.1 Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi15KamC2cRSdG6cc1ZpK_W6-4pm4SSsmZr6uPX8TfqHE-OD_50sr_a7Oi5ok1Qt_YNwbNXDMsT5XuAk86tbRFGjGh8_epPTd9IQ1bBUJ3roPkWn_jJjxd5GlzLBxYNUDXktD7r9cw1LMU07SP6Pv33Fw3Zp33FJixOet7ASNRwAG65zs Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: d5022754d8de48cfb8ddf66fc6dbd3dd Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5022754d8de48cfb8ddf66fc6dbd3dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}] Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: d5022754d8de48cfb8ddf66fc6dbd3dd Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestNetworkAdvancedServerOps-1159726665-project Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 48a1bf5634564af2af0d1ca7c59672a5 Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1159726665-project Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance d34195ee-b834-40bb-b6b7-e8c32cd4bc7d could not be found. Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': 'd34195ee-b834-40bb-b6b7-e8c32cd4bc7d'} Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34195ee-b834-40bb-b6b7-e8c32cd4bc7d could not be found. Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34195ee-b834-40bb-b6b7-e8c32cd4bc7d could not be found. Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:30:41.214014 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:30:41.218787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:30:41.218787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:30:41.218787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:30:41.218787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:30:41.218787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:30:41.218787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:30:41.218787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34195ee-b834-40bb-b6b7-e8c32cd4bc7d could not be found. Jul 20 05:30:41.218787 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:30:41.218787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-060c11d7-f3b6-41f2-af6f-3054359295c8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Returning 404 to user: Instance d34195ee-b834-40bb-b6b7-e8c32cd4bc7d could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:30:41.218787 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-060c11d7-f3b6-41f2-af6f-3054359295c8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d" status: 404 len: 111 microversion: 2.1 time: 0.031718 Jul 20 05:30:41.218787 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3754/7405] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:41 2022] GET /compute/v2.1/servers/d34195ee-b834-40bb-b6b7-e8c32cd4bc7d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:30:44.208832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-14435fa8-1777-4426-b483-f7c402321d6d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '.version_select at 0x7fbf9c343a60>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:44.228671 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-14435fa8-1777-4426-b483-f7c402321d6d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-345920732" status: 202 len: 0 microversion: 2.1 time: 0.025975 Jul 20 05:30:44.233047 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3652/7406] 10.222.0.20 () {58 vars in 1280 bytes} [Wed Jul 20 05:30:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-345920732 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:30:44.257829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7ec78731-cdcf-4e84-8f40-6e7470bfc895 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'create', calling method: .version_select at 0x7fbf9c3a43a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1205009201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvtV4q21ZORemVBVpCRqpcvppw3J5t/PeKuNE6nRtI7+SjCub8pg/PBRP86ooh5gR+qU8P3ydY8onxV9TFIp5xYeKAg3uhq8A9pUDrBKjZ2PM4JKvqJvhCCarIfpduWxw=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:44.276489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-7ec78731-cdcf-4e84-8f40-6e7470bfc895 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:30:44.281599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-7ec78731-cdcf-4e84-8f40-6e7470bfc895 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for user 48a1bf5634564af2af0d1ca7c59672a5 and project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:30:44.305568 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7ec78731-cdcf-4e84-8f40-6e7470bfc895 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051680 Jul 20 05:30:44.306099 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3755/7407] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:30:44 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:30:50.162085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1933924782", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "f65e8589-038b-453b-a230-591a56c66c1b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1205009201", "security_groups": [{"name": "tempest-secgroup-smoke-449793369"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:50.286346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] validate_networks() for [('f65e8589-038b-453b-a230-591a56c66c1b', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:30:50.297578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:50.885728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:30:50.886590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:30:50.887072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:30:50.887489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:30:50.887946 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:30:50.898062 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:50.898516 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:50.899307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:50.900000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:50.919265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:30:50.924709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for user 48a1bf5634564af2af0d1ca7c59672a5 and project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:30:50.938451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:30:50.941670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:30:50.993253 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-19012c40-7e20-4a51-ac17-8eca75dd25e6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.836303 Jul 20 05:30:50.998624 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3653/7408] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:30:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:30:51.004416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8622c892-848a-4664-a62f-80fdfe47b08b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:51.005181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8622c892-848a-4664-a62f-80fdfe47b08b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:51.087490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8622c892-848a-4664-a62f-80fdfe47b08b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:51.096060 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8622c892-848a-4664-a62f-80fdfe47b08b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1267 microversion: 2.1 time: 0.095147 Jul 20 05:30:51.107872 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3756/7409] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:50 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:52.118315 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-732bc300-f817-4e78-a4f2-a418f19a5d6f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:52.119041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-732bc300-f817-4e78-a4f2-a418f19a5d6f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:52.125822 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-732bc300-f817-4e78-a4f2-a418f19a5d6f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:52.126390 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-732bc300-f817-4e78-a4f2-a418f19a5d6f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:52.127246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-732bc300-f817-4e78-a4f2-a418f19a5d6f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:52.127853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-732bc300-f817-4e78-a4f2-a418f19a5d6f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:52.212904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-732bc300-f817-4e78-a4f2-a418f19a5d6f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:52.221529 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-732bc300-f817-4e78-a4f2-a418f19a5d6f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1319 microversion: 2.1 time: 0.109671 Jul 20 05:30:52.223722 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3654/7410] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:52 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1319 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:53.240078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-93084b50-7763-4621-9ca8-1bf52a4423ca tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:53.240720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-93084b50-7763-4621-9ca8-1bf52a4423ca tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:53.246709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=36 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:53.249538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93084b50-7763-4621-9ca8-1bf52a4423ca tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:53.250277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93084b50-7763-4621-9ca8-1bf52a4423ca tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:53.251092 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93084b50-7763-4621-9ca8-1bf52a4423ca tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:53.251587 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-93084b50-7763-4621-9ca8-1bf52a4423ca tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:53.473960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-93084b50-7763-4621-9ca8-1bf52a4423ca tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:53.481815 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-93084b50-7763-4621-9ca8-1bf52a4423ca tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1392 microversion: 2.1 time: 0.245623 Jul 20 05:30:53.482390 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3757/7411] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:53 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1392 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:53.814823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-346c0b4a-14a6-4f2a-a274-8a54ae77b000 req-f0449e6d-33d3-400e-8e12-b6594af5bf74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3485c877-b6d8-4444-a53b-020a00e7ea45", "tag": "6af6f4a9-f1ac-4659-8f0b-abbf373b0389"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:53.829854 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-346c0b4a-14a6-4f2a-a274-8a54ae77b000 req-f0449e6d-33d3-400e-8e12-b6594af5bf74 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:53.830314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-346c0b4a-14a6-4f2a-a274-8a54ae77b000 req-f0449e6d-33d3-400e-8e12-b6594af5bf74 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:53.845520 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-346c0b4a-14a6-4f2a-a274-8a54ae77b000 req-f0449e6d-33d3-400e-8e12-b6594af5bf74 service nova] Creating event network-changed:6af6f4a9-f1ac-4659-8f0b-abbf373b0389 for instance 3485c877-b6d8-4444-a53b-020a00e7ea45 on n-h2-764485-11 Jul 20 05:30:53.853557 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-346c0b4a-14a6-4f2a-a274-8a54ae77b000 req-f0449e6d-33d3-400e-8e12-b6594af5bf74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046014 Jul 20 05:30:53.854538 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3655/7412] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:30:54.499651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-16814436-c979-46a8-9c28-9c1916fd0def tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:54.500284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-16814436-c979-46a8-9c28-9c1916fd0def tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:54.507545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16814436-c979-46a8-9c28-9c1916fd0def tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:54.507965 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16814436-c979-46a8-9c28-9c1916fd0def tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:54.508741 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16814436-c979-46a8-9c28-9c1916fd0def tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:54.509190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-16814436-c979-46a8-9c28-9c1916fd0def tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:54.643196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-16814436-c979-46a8-9c28-9c1916fd0def tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:54.651449 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-16814436-c979-46a8-9c28-9c1916fd0def tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1392 microversion: 2.1 time: 0.155918 Jul 20 05:30:54.652057 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3758/7413] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:54 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:55.670657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6546fb08-a8e9-4ea4-9bdf-75c4b0e02e14 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:55.671361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6546fb08-a8e9-4ea4-9bdf-75c4b0e02e14 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:55.678653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6546fb08-a8e9-4ea4-9bdf-75c4b0e02e14 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:55.679140 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6546fb08-a8e9-4ea4-9bdf-75c4b0e02e14 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:55.679961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6546fb08-a8e9-4ea4-9bdf-75c4b0e02e14 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:55.680401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6546fb08-a8e9-4ea4-9bdf-75c4b0e02e14 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:55.822306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6546fb08-a8e9-4ea4-9bdf-75c4b0e02e14 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:55.829798 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6546fb08-a8e9-4ea4-9bdf-75c4b0e02e14 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1392 microversion: 2.1 time: 0.164316 Jul 20 05:30:55.830380 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3656/7414] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:55 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:56.846345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-766d60bf-032f-46c8-ab31-0c0129e92865 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:56.847050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-766d60bf-032f-46c8-ab31-0c0129e92865 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:56.854366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-766d60bf-032f-46c8-ab31-0c0129e92865 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:56.854829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-766d60bf-032f-46c8-ab31-0c0129e92865 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:56.855620 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-766d60bf-032f-46c8-ab31-0c0129e92865 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:56.856076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-766d60bf-032f-46c8-ab31-0c0129e92865 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:56.990851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-766d60bf-032f-46c8-ab31-0c0129e92865 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:56.998654 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-766d60bf-032f-46c8-ab31-0c0129e92865 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1392 microversion: 2.1 time: 0.156147 Jul 20 05:30:56.999168 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3759/7415] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:56 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:58.015477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-68ce61eb-d732-4a79-b6c0-e4ce017d65f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:58.016136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-68ce61eb-d732-4a79-b6c0-e4ce017d65f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:58.023096 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68ce61eb-d732-4a79-b6c0-e4ce017d65f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:58.023577 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68ce61eb-d732-4a79-b6c0-e4ce017d65f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:58.024343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68ce61eb-d732-4a79-b6c0-e4ce017d65f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:58.024789 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68ce61eb-d732-4a79-b6c0-e4ce017d65f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:58.156900 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-68ce61eb-d732-4a79-b6c0-e4ce017d65f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:58.165434 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-68ce61eb-d732-4a79-b6c0-e4ce017d65f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1392 microversion: 2.1 time: 0.153799 Jul 20 05:30:58.166026 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3657/7416] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:58 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:59.182195 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6dcdc618-8172-4b83-a81d-6c36bb40a465 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:59.182824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6dcdc618-8172-4b83-a81d-6c36bb40a465 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:59.189893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dcdc618-8172-4b83-a81d-6c36bb40a465 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:59.190355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dcdc618-8172-4b83-a81d-6c36bb40a465 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:59.191919 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dcdc618-8172-4b83-a81d-6c36bb40a465 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:59.192371 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6dcdc618-8172-4b83-a81d-6c36bb40a465 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:59.329201 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6dcdc618-8172-4b83-a81d-6c36bb40a465 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:59.336991 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6dcdc618-8172-4b83-a81d-6c36bb40a465 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1392 microversion: 2.1 time: 0.158769 Jul 20 05:30:59.337587 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3760/7417] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:59 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:00.258399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-3d4c2e6f-344c-43fe-a98e-6d63d3e222a8 req-fe668e28-8ec1-424e-b9ea-05539f82a9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3485c877-b6d8-4444-a53b-020a00e7ea45", "name": "network-vif-plugged", "status": "completed", "tag": "6af6f4a9-f1ac-4659-8f0b-abbf373b0389"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:31:00.268522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3d4c2e6f-344c-43fe-a98e-6d63d3e222a8 req-fe668e28-8ec1-424e-b9ea-05539f82a9c5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:00.268987 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-3d4c2e6f-344c-43fe-a98e-6d63d3e222a8 req-fe668e28-8ec1-424e-b9ea-05539f82a9c5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:00.280909 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-3d4c2e6f-344c-43fe-a98e-6d63d3e222a8 req-fe668e28-8ec1-424e-b9ea-05539f82a9c5 service nova] Creating event network-vif-plugged:6af6f4a9-f1ac-4659-8f0b-abbf373b0389 for instance 3485c877-b6d8-4444-a53b-020a00e7ea45 on n-h2-764485-11 Jul 20 05:31:00.286674 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-3d4c2e6f-344c-43fe-a98e-6d63d3e222a8 req-fe668e28-8ec1-424e-b9ea-05539f82a9c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032039 Jul 20 05:31:00.287311 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3658/7418] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:31:00.354396 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a2c9bf94-3108-4c02-b65d-90c8ba58aa61 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:00.355205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a2c9bf94-3108-4c02-b65d-90c8ba58aa61 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:00.363802 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2c9bf94-3108-4c02-b65d-90c8ba58aa61 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:00.364504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2c9bf94-3108-4c02-b65d-90c8ba58aa61 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:00.365561 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2c9bf94-3108-4c02-b65d-90c8ba58aa61 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:00.366022 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a2c9bf94-3108-4c02-b65d-90c8ba58aa61 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:00.575766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a2c9bf94-3108-4c02-b65d-90c8ba58aa61 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:00.584151 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a2c9bf94-3108-4c02-b65d-90c8ba58aa61 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1392 microversion: 2.1 time: 0.233787 Jul 20 05:31:00.584745 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3761/7419] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:00 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:01.597710 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:01.598503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:01.604204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ac4278d2-5ebe-4d1b-a20c-d485648104b0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:01.604957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ac4278d2-5ebe-4d1b-a20c-d485648104b0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:01.612172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac4278d2-5ebe-4d1b-a20c-d485648104b0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:01.612891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac4278d2-5ebe-4d1b-a20c-d485648104b0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:01.613649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac4278d2-5ebe-4d1b-a20c-d485648104b0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:01.614091 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ac4278d2-5ebe-4d1b-a20c-d485648104b0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:01.747907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ac4278d2-5ebe-4d1b-a20c-d485648104b0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:01.756336 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ac4278d2-5ebe-4d1b-a20c-d485648104b0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1392 microversion: 2.1 time: 0.159863 Jul 20 05:31:01.757037 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3659/7420] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:01 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:02.774004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b3ddc1a7-bfe7-4dac-b349-dfc6c556d88a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:02.774663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b3ddc1a7-bfe7-4dac-b349-dfc6c556d88a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:02.776538 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:02.778019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:02.785718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3ddc1a7-bfe7-4dac-b349-dfc6c556d88a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:02.786154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3ddc1a7-bfe7-4dac-b349-dfc6c556d88a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:02.786972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3ddc1a7-bfe7-4dac-b349-dfc6c556d88a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:02.787455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b3ddc1a7-bfe7-4dac-b349-dfc6c556d88a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:02.924627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b3ddc1a7-bfe7-4dac-b349-dfc6c556d88a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:02.932577 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b3ddc1a7-bfe7-4dac-b349-dfc6c556d88a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1564 microversion: 2.1 time: 0.162492 Jul 20 05:31:02.933179 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3762/7421] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:02 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:02.949602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5d56a003-f0d9-4ec4-a072-d93bfd1ddd40 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:02.950255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5d56a003-f0d9-4ec4-a072-d93bfd1ddd40 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:02.952979 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:02.960158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d56a003-f0d9-4ec4-a072-d93bfd1ddd40 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:02.960617 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d56a003-f0d9-4ec4-a072-d93bfd1ddd40 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:02.961389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d56a003-f0d9-4ec4-a072-d93bfd1ddd40 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:02.961831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5d56a003-f0d9-4ec4-a072-d93bfd1ddd40 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:03.094334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5d56a003-f0d9-4ec4-a072-d93bfd1ddd40 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:03.102078 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5d56a003-f0d9-4ec4-a072-d93bfd1ddd40 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1564 microversion: 2.1 time: 0.156339 Jul 20 05:31:03.102656 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3660/7422] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:02 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:04.993127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-effbb3d2-ead9-4180-b1b8-b2cddb79a07c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:04.993757 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-effbb3d2-ead9-4180-b1b8-b2cddb79a07c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:04.996311 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-4dbcc878-0419-4a07-ad6d-3c2c2ad7ab20 req-c42fce79-8a91-4560-be42-75854da05f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3485c877-b6d8-4444-a53b-020a00e7ea45", "tag": "6af6f4a9-f1ac-4659-8f0b-abbf373b0389"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:31:05.002886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-effbb3d2-ead9-4180-b1b8-b2cddb79a07c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:05.002886 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-effbb3d2-ead9-4180-b1b8-b2cddb79a07c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:05.004070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-effbb3d2-ead9-4180-b1b8-b2cddb79a07c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:05.005086 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-effbb3d2-ead9-4180-b1b8-b2cddb79a07c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:05.007966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4dbcc878-0419-4a07-ad6d-3c2c2ad7ab20 req-c42fce79-8a91-4560-be42-75854da05f17 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:05.008450 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-4dbcc878-0419-4a07-ad6d-3c2c2ad7ab20 req-c42fce79-8a91-4560-be42-75854da05f17 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:05.023666 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-4dbcc878-0419-4a07-ad6d-3c2c2ad7ab20 req-c42fce79-8a91-4560-be42-75854da05f17 service nova] Creating event network-changed:6af6f4a9-f1ac-4659-8f0b-abbf373b0389 for instance 3485c877-b6d8-4444-a53b-020a00e7ea45 on n-h2-764485-11 Jul 20 05:31:05.028784 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-4dbcc878-0419-4a07-ad6d-3c2c2ad7ab20 req-c42fce79-8a91-4560-be42-75854da05f17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037280 Jul 20 05:31:05.029431 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3661/7423] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:31:05.206101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-effbb3d2-ead9-4180-b1b8-b2cddb79a07c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:05.214013 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-effbb3d2-ead9-4180-b1b8-b2cddb79a07c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1564 microversion: 2.1 time: 0.225543 Jul 20 05:31:05.214931 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3763/7424] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:04 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1564 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:38.490217 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:38.491575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=38 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:38.496255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a00a717f-2e93-434d-a9e2-197dcb55e290 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:31:38.497272 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a00a717f-2e93-434d-a9e2-197dcb55e290 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:38.504401 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a00a717f-2e93-434d-a9e2-197dcb55e290 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:38.504857 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a00a717f-2e93-434d-a9e2-197dcb55e290 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:38.505630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a00a717f-2e93-434d-a9e2-197dcb55e290 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:38.506081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a00a717f-2e93-434d-a9e2-197dcb55e290 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:38.567435 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a00a717f-2e93-434d-a9e2-197dcb55e290 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45/action" status: 200 len: 24572 microversion: 2.1 time: 0.079310 Jul 20 05:31:38.568267 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3662/7425] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:31:38 2022] POST /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45/action => generated 24572 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:31:55.728006 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:31:55.728624 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:31:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:32:09.022300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:09.023103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=42 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:09.027347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0c8b2c6c-ee75-45f6-b109-a6b3077dd02d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:09.028395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0c8b2c6c-ee75-45f6-b109-a6b3077dd02d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:09.035144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c8b2c6c-ee75-45f6-b109-a6b3077dd02d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:09.035636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c8b2c6c-ee75-45f6-b109-a6b3077dd02d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:09.036405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c8b2c6c-ee75-45f6-b109-a6b3077dd02d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:09.036853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0c8b2c6c-ee75-45f6-b109-a6b3077dd02d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:09.108462 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0c8b2c6c-ee75-45f6-b109-a6b3077dd02d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45/action" status: 202 len: 0 microversion: 2.1 time: 0.087842 Jul 20 05:32:09.109097 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3764/7426] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:32:09 2022] POST /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:32:09.119063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-32025ec4-352c-4d8d-96bb-591ffd1b59e1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:09.120176 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-32025ec4-352c-4d8d-96bb-591ffd1b59e1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:09.122992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:09.123765 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:09.130564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-32025ec4-352c-4d8d-96bb-591ffd1b59e1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:09.131016 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-32025ec4-352c-4d8d-96bb-591ffd1b59e1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:09.131814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-32025ec4-352c-4d8d-96bb-591ffd1b59e1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:09.132258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-32025ec4-352c-4d8d-96bb-591ffd1b59e1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:09.363308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-32025ec4-352c-4d8d-96bb-591ffd1b59e1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:09.372501 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-32025ec4-352c-4d8d-96bb-591ffd1b59e1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1675 microversion: 2.1 time: 0.258796 Jul 20 05:32:09.373092 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3663/7427] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:09 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1675 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:10.391499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-33923d10-bedb-49e7-9778-90d6840e711a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:10.392232 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-33923d10-bedb-49e7-9778-90d6840e711a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:10.398726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-33923d10-bedb-49e7-9778-90d6840e711a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:10.399716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-33923d10-bedb-49e7-9778-90d6840e711a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:10.400496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-33923d10-bedb-49e7-9778-90d6840e711a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:10.400980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-33923d10-bedb-49e7-9778-90d6840e711a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:10.537961 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-33923d10-bedb-49e7-9778-90d6840e711a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:10.546440 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-33923d10-bedb-49e7-9778-90d6840e711a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.160185 Jul 20 05:32:10.547024 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3765/7428] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:10 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:11.564093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1a32de5f-0dd0-441d-947c-4314c64dc902 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:11.564740 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1a32de5f-0dd0-441d-947c-4314c64dc902 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:11.572679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a32de5f-0dd0-441d-947c-4314c64dc902 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:11.573132 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a32de5f-0dd0-441d-947c-4314c64dc902 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:11.573907 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a32de5f-0dd0-441d-947c-4314c64dc902 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:11.574349 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1a32de5f-0dd0-441d-947c-4314c64dc902 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:11.709935 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1a32de5f-0dd0-441d-947c-4314c64dc902 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:11.718346 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1a32de5f-0dd0-441d-947c-4314c64dc902 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.158123 Jul 20 05:32:11.718936 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3664/7429] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:11 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:12.736132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1c04939a-7ac4-474d-804a-168b96e1d05c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:12.736761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1c04939a-7ac4-474d-804a-168b96e1d05c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:12.744843 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c04939a-7ac4-474d-804a-168b96e1d05c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:12.745367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c04939a-7ac4-474d-804a-168b96e1d05c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:12.746166 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c04939a-7ac4-474d-804a-168b96e1d05c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:12.746643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1c04939a-7ac4-474d-804a-168b96e1d05c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:12.879808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1c04939a-7ac4-474d-804a-168b96e1d05c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:12.888318 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1c04939a-7ac4-474d-804a-168b96e1d05c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.156129 Jul 20 05:32:12.888899 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3766/7430] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:12 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:13.905954 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0d3188ca-4485-41fd-bb3d-59620adb1c89 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:13.906563 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0d3188ca-4485-41fd-bb3d-59620adb1c89 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:13.913744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d3188ca-4485-41fd-bb3d-59620adb1c89 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:13.914190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d3188ca-4485-41fd-bb3d-59620adb1c89 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:13.914955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d3188ca-4485-41fd-bb3d-59620adb1c89 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:13.915384 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0d3188ca-4485-41fd-bb3d-59620adb1c89 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:14.045958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0d3188ca-4485-41fd-bb3d-59620adb1c89 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:14.053659 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0d3188ca-4485-41fd-bb3d-59620adb1c89 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.151594 Jul 20 05:32:14.054241 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3665/7431] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:13 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:15.072020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b1426c94-d402-4508-98f1-aa5919470500 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:15.072651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b1426c94-d402-4508-98f1-aa5919470500 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:15.079536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1426c94-d402-4508-98f1-aa5919470500 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:15.080014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1426c94-d402-4508-98f1-aa5919470500 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:15.080796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1426c94-d402-4508-98f1-aa5919470500 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:15.081251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b1426c94-d402-4508-98f1-aa5919470500 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:15.218167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b1426c94-d402-4508-98f1-aa5919470500 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:15.225670 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b1426c94-d402-4508-98f1-aa5919470500 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.158458 Jul 20 05:32:15.226257 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3767/7432] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:15 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:16.243788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7f23a987-e601-434f-aa56-9370722d123e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:16.244402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7f23a987-e601-434f-aa56-9370722d123e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:16.251340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f23a987-e601-434f-aa56-9370722d123e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:16.251847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f23a987-e601-434f-aa56-9370722d123e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:16.252606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f23a987-e601-434f-aa56-9370722d123e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:16.253044 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7f23a987-e601-434f-aa56-9370722d123e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:16.384506 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7f23a987-e601-434f-aa56-9370722d123e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:16.392215 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7f23a987-e601-434f-aa56-9370722d123e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.153206 Jul 20 05:32:16.392798 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3666/7433] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:16 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:17.409582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5bd40414-4bfb-49c3-b54a-3fbe6e2700aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:17.410206 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5bd40414-4bfb-49c3-b54a-3fbe6e2700aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:17.418061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5bd40414-4bfb-49c3-b54a-3fbe6e2700aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:17.418533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5bd40414-4bfb-49c3-b54a-3fbe6e2700aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:17.419316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5bd40414-4bfb-49c3-b54a-3fbe6e2700aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:17.419801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5bd40414-4bfb-49c3-b54a-3fbe6e2700aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:17.557868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5bd40414-4bfb-49c3-b54a-3fbe6e2700aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:17.565363 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5bd40414-4bfb-49c3-b54a-3fbe6e2700aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.159690 Jul 20 05:32:17.565941 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3768/7434] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:17 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:18.582078 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7bfc2590-41ef-4701-b82f-89eed06e529d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:18.582695 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7bfc2590-41ef-4701-b82f-89eed06e529d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:18.590158 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bfc2590-41ef-4701-b82f-89eed06e529d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:18.590610 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bfc2590-41ef-4701-b82f-89eed06e529d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:18.591370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bfc2590-41ef-4701-b82f-89eed06e529d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:18.591836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7bfc2590-41ef-4701-b82f-89eed06e529d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:18.725609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7bfc2590-41ef-4701-b82f-89eed06e529d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:18.733776 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7bfc2590-41ef-4701-b82f-89eed06e529d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.155558 Jul 20 05:32:18.734347 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3667/7435] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:18 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:19.750806 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d1435bea-ab3d-4b7c-ba57-7224af732f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:19.751436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d1435bea-ab3d-4b7c-ba57-7224af732f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:19.759106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1435bea-ab3d-4b7c-ba57-7224af732f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:19.759622 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1435bea-ab3d-4b7c-ba57-7224af732f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:19.760502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1435bea-ab3d-4b7c-ba57-7224af732f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:19.761004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d1435bea-ab3d-4b7c-ba57-7224af732f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:19.896668 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d1435bea-ab3d-4b7c-ba57-7224af732f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:19.904961 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d1435bea-ab3d-4b7c-ba57-7224af732f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.158089 Jul 20 05:32:19.905571 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3769/7436] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:19 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:20.922060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1bc3212c-aeaf-48fe-a35f-7c57001916c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:20.922599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1bc3212c-aeaf-48fe-a35f-7c57001916c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:20.929739 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bc3212c-aeaf-48fe-a35f-7c57001916c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:20.930732 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bc3212c-aeaf-48fe-a35f-7c57001916c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:20.931496 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bc3212c-aeaf-48fe-a35f-7c57001916c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:20.931958 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1bc3212c-aeaf-48fe-a35f-7c57001916c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:21.067706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1bc3212c-aeaf-48fe-a35f-7c57001916c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:21.075542 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1bc3212c-aeaf-48fe-a35f-7c57001916c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.157476 Jul 20 05:32:21.076132 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3668/7437] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:20 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:22.092739 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4964f553-0bc6-4624-8b42-3bc01f62340f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:22.093379 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4964f553-0bc6-4624-8b42-3bc01f62340f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:22.100361 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4964f553-0bc6-4624-8b42-3bc01f62340f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:22.100841 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4964f553-0bc6-4624-8b42-3bc01f62340f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:22.102186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4964f553-0bc6-4624-8b42-3bc01f62340f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:22.102810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4964f553-0bc6-4624-8b42-3bc01f62340f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:22.234812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4964f553-0bc6-4624-8b42-3bc01f62340f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:22.243183 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4964f553-0bc6-4624-8b42-3bc01f62340f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.153681 Jul 20 05:32:22.244024 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3770/7438] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:22 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:23.262877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-df0ff9e5-ad32-4cd7-a107-d12437a432f0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:23.263494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-df0ff9e5-ad32-4cd7-a107-d12437a432f0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:23.269631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df0ff9e5-ad32-4cd7-a107-d12437a432f0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:23.270088 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df0ff9e5-ad32-4cd7-a107-d12437a432f0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:23.270852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df0ff9e5-ad32-4cd7-a107-d12437a432f0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:23.271295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-df0ff9e5-ad32-4cd7-a107-d12437a432f0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:23.405691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-df0ff9e5-ad32-4cd7-a107-d12437a432f0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:23.413449 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-df0ff9e5-ad32-4cd7-a107-d12437a432f0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.155635 Jul 20 05:32:23.414031 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3669/7439] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:23 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:24.432016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-18ee4a18-5d62-4d12-8f72-b843dc7fb565 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:24.432672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-18ee4a18-5d62-4d12-8f72-b843dc7fb565 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:24.439700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18ee4a18-5d62-4d12-8f72-b843dc7fb565 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:24.440110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18ee4a18-5d62-4d12-8f72-b843dc7fb565 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:24.440891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18ee4a18-5d62-4d12-8f72-b843dc7fb565 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:24.441351 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-18ee4a18-5d62-4d12-8f72-b843dc7fb565 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:24.574786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-18ee4a18-5d62-4d12-8f72-b843dc7fb565 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:24.583955 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-18ee4a18-5d62-4d12-8f72-b843dc7fb565 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.157047 Jul 20 05:32:24.584686 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3771/7440] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:24 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:25.606293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-78fb29ff-d878-483c-b753-3e9e551bffd4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:25.606961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-78fb29ff-d878-483c-b753-3e9e551bffd4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:25.614137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78fb29ff-d878-483c-b753-3e9e551bffd4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:25.614594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78fb29ff-d878-483c-b753-3e9e551bffd4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:25.615377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78fb29ff-d878-483c-b753-3e9e551bffd4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:25.615849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-78fb29ff-d878-483c-b753-3e9e551bffd4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:25.759338 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-78fb29ff-d878-483c-b753-3e9e551bffd4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:25.767133 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-78fb29ff-d878-483c-b753-3e9e551bffd4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1680 microversion: 2.1 time: 0.166314 Jul 20 05:32:25.767733 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3670/7441] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:25 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:26.785003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3eb0bb34-2b25-421f-b90e-bcec0f864474 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:26.785663 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3eb0bb34-2b25-421f-b90e-bcec0f864474 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:26.794681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3eb0bb34-2b25-421f-b90e-bcec0f864474 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:26.795149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3eb0bb34-2b25-421f-b90e-bcec0f864474 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:26.795972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3eb0bb34-2b25-421f-b90e-bcec0f864474 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:26.796426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3eb0bb34-2b25-421f-b90e-bcec0f864474 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:26.937676 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3eb0bb34-2b25-421f-b90e-bcec0f864474 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:26.946056 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3eb0bb34-2b25-421f-b90e-bcec0f864474 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1683 microversion: 2.1 time: 0.164266 Jul 20 05:32:26.946654 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3772/7442] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:26 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:59.157179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-de95454b-a683-471a-8bbd-ee6ab624ddf2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:59.158122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-de95454b-a683-471a-8bbd-ee6ab624ddf2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:59.160378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=16 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:59.161192 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=48 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:59.166944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de95454b-a683-471a-8bbd-ee6ab624ddf2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:59.167405 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de95454b-a683-471a-8bbd-ee6ab624ddf2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:59.168211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de95454b-a683-471a-8bbd-ee6ab624ddf2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:59.168660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-de95454b-a683-471a-8bbd-ee6ab624ddf2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:59.233992 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-de95454b-a683-471a-8bbd-ee6ab624ddf2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45/action" status: 200 len: 69097 microversion: 2.1 time: 0.080695 Jul 20 05:32:59.235019 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3671/7443] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:32:59 2022] POST /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45/action => generated 69097 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:33:23.101532 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74ed5f99-33c5-493c-88cf-2db7eccbdb12 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:23.102075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74ed5f99-33c5-493c-88cf-2db7eccbdb12 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:23.104792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=18 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:23.104924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f473461a-3290-43f6-ab87-777e94284841 req-4e8b30dc-244d-4fb1-9312-75a28480c4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3485c877-b6d8-4444-a53b-020a00e7ea45", "tag": "6af6f4a9-f1ac-4659-8f0b-abbf373b0389"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:33:23.105995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:23.112124 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74ed5f99-33c5-493c-88cf-2db7eccbdb12 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:23.112288 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74ed5f99-33c5-493c-88cf-2db7eccbdb12 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:23.113094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74ed5f99-33c5-493c-88cf-2db7eccbdb12 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:23.113553 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74ed5f99-33c5-493c-88cf-2db7eccbdb12 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:23.113675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:23.114353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:23.117736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f473461a-3290-43f6-ab87-777e94284841 req-4e8b30dc-244d-4fb1-9312-75a28480c4b8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:23.118489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f473461a-3290-43f6-ab87-777e94284841 req-4e8b30dc-244d-4fb1-9312-75a28480c4b8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:23.133866 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f473461a-3290-43f6-ab87-777e94284841 req-4e8b30dc-244d-4fb1-9312-75a28480c4b8 service nova] Creating event network-changed:6af6f4a9-f1ac-4659-8f0b-abbf373b0389 for instance 3485c877-b6d8-4444-a53b-020a00e7ea45 on n-h2-764485-11 Jul 20 05:33:23.139699 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f473461a-3290-43f6-ab87-777e94284841 req-4e8b30dc-244d-4fb1-9312-75a28480c4b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039288 Jul 20 05:33:23.140583 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3672/7444] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:33:23.144123 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74ed5f99-33c5-493c-88cf-2db7eccbdb12 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:33:23.238473 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74ed5f99-33c5-493c-88cf-2db7eccbdb12 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 204 len: 0 microversion: 2.1 time: 0.141209 Jul 20 05:33:23.239754 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3773/7445] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:33:23 2022] DELETE /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:33:23.250218 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-98a7d12f-381a-45ce-b156-97f5d10b16bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:23.251018 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-98a7d12f-381a-45ce-b156-97f5d10b16bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:23.257615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98a7d12f-381a-45ce-b156-97f5d10b16bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:23.258919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98a7d12f-381a-45ce-b156-97f5d10b16bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:23.259831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98a7d12f-381a-45ce-b156-97f5d10b16bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:23.260352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-98a7d12f-381a-45ce-b156-97f5d10b16bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:23.397545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-98a7d12f-381a-45ce-b156-97f5d10b16bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:23.405355 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-98a7d12f-381a-45ce-b156-97f5d10b16bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1689 microversion: 2.1 time: 0.159914 Jul 20 05:33:23.405954 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3673/7446] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:23 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:33:24.424982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d6135ffd-cbb5-4c97-bfca-562c4c45fe57 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:24.425699 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d6135ffd-cbb5-4c97-bfca-562c4c45fe57 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:24.433085 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6135ffd-cbb5-4c97-bfca-562c4c45fe57 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:24.433548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6135ffd-cbb5-4c97-bfca-562c4c45fe57 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:24.434316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6135ffd-cbb5-4c97-bfca-562c4c45fe57 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:24.434766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d6135ffd-cbb5-4c97-bfca-562c4c45fe57 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:24.667363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d6135ffd-cbb5-4c97-bfca-562c4c45fe57 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:24.674953 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d6135ffd-cbb5-4c97-bfca-562c4c45fe57 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1689 microversion: 2.1 time: 0.254527 Jul 20 05:33:24.675602 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3774/7447] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:24 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1689 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:25.530512 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-ed0af49a-8c59-497b-8228-0c7456c33fe4 req-60bf23d9-aec2-4317-8922-59ca86f47dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3485c877-b6d8-4444-a53b-020a00e7ea45", "name": "network-vif-deleted", "tag": "6af6f4a9-f1ac-4659-8f0b-abbf373b0389"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:33:25.540937 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ed0af49a-8c59-497b-8228-0c7456c33fe4 req-60bf23d9-aec2-4317-8922-59ca86f47dce service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:25.541415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-ed0af49a-8c59-497b-8228-0c7456c33fe4 req-60bf23d9-aec2-4317-8922-59ca86f47dce service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:25.552907 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-ed0af49a-8c59-497b-8228-0c7456c33fe4 req-60bf23d9-aec2-4317-8922-59ca86f47dce service nova] Creating event network-vif-deleted:6af6f4a9-f1ac-4659-8f0b-abbf373b0389 for instance 3485c877-b6d8-4444-a53b-020a00e7ea45 on n-h2-764485-11 Jul 20 05:33:25.559339 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-ed0af49a-8c59-497b-8228-0c7456c33fe4 req-60bf23d9-aec2-4317-8922-59ca86f47dce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032495 Jul 20 05:33:25.562726 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3674/7448] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:33:25.693298 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4e5bfd63-a850-40ca-8ed3-2eb56c1408d5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:25.693929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4e5bfd63-a850-40ca-8ed3-2eb56c1408d5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:25.700960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e5bfd63-a850-40ca-8ed3-2eb56c1408d5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:25.701423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e5bfd63-a850-40ca-8ed3-2eb56c1408d5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:25.702199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e5bfd63-a850-40ca-8ed3-2eb56c1408d5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:25.702681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e5bfd63-a850-40ca-8ed3-2eb56c1408d5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:25.734213 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e5bfd63-a850-40ca-8ed3-2eb56c1408d5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:25.734733 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4e5bfd63-a850-40ca-8ed3-2eb56c1408d5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:25.735141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-4e5bfd63-a850-40ca-8ed3-2eb56c1408d5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lazy-loading 'fault' on Instance uuid 3485c877-b6d8-4444-a53b-020a00e7ea45 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:33:25.775770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4e5bfd63-a850-40ca-8ed3-2eb56c1408d5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:25.783072 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4e5bfd63-a850-40ca-8ed3-2eb56c1408d5 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 200 len: 1357 microversion: 2.1 time: 0.094397 Jul 20 05:33:25.783672 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3775/7449] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:25 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 1357 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:26.801701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0cd302ac-8c46-4fc8-b1ac-ea606a475793 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:26.802413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0cd302ac-8c46-4fc8-b1ac-ea606a475793 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 3485c877-b6d8-4444-a53b-020a00e7ea45] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:26.809486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0cd302ac-8c46-4fc8-b1ac-ea606a475793 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:26.809944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0cd302ac-8c46-4fc8-b1ac-ea606a475793 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:26.810966 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0cd302ac-8c46-4fc8-b1ac-ea606a475793 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:26.811415 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0cd302ac-8c46-4fc8-b1ac-ea606a475793 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:26.827279 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-0cd302ac-8c46-4fc8-b1ac-ea606a475793 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] HTTP exception thrown: Instance 3485c877-b6d8-4444-a53b-020a00e7ea45 could not be found. Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0cd302ac-8c46-4fc8-b1ac-ea606a475793 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Request method failure captured: Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 HTTP/1.1 Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi15KamC2cRSdG6cc1ZpK_W6-4pm4SSsmZr6uPX8TfqHE-OD_50sr_a7Oi5ok1Qt_YNwbNXDMsT5XuAk86tbRFGjGh8_epPTd9IQ1bBUJ3roPkWn_jJjxd5GlzLBxYNUDXktD7r9cw1LMU07SP6Pv33Fw3Zp33FJixOet7ASNRwAG65zs Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d5022754d8de48cfb8ddf66fc6dbd3dd Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5022754d8de48cfb8ddf66fc6dbd3dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}] Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d5022754d8de48cfb8ddf66fc6dbd3dd Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestNetworkAdvancedServerOps-1159726665-project Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 48a1bf5634564af2af0d1ca7c59672a5 Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1159726665-project Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 3485c877-b6d8-4444-a53b-020a00e7ea45 could not be found. Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '3485c877-b6d8-4444-a53b-020a00e7ea45'} Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3485c877-b6d8-4444-a53b-020a00e7ea45 could not be found. Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3485c877-b6d8-4444-a53b-020a00e7ea45 could not be found. Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:33:26.829040 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:33:26.834136 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:33:26.834136 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:33:26.834136 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:33:26.834136 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:33:26.834136 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:33:26.834136 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:33:26.834136 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3485c877-b6d8-4444-a53b-020a00e7ea45 could not be found. Jul 20 05:33:26.834136 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:33:26.834136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0cd302ac-8c46-4fc8-b1ac-ea606a475793 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Returning 404 to user: Instance 3485c877-b6d8-4444-a53b-020a00e7ea45 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:33:26.834136 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0cd302ac-8c46-4fc8-b1ac-ea606a475793 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45" status: 404 len: 111 microversion: 2.1 time: 0.034013 Jul 20 05:33:26.834136 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3675/7450] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:26 2022] GET /compute/v2.1/servers/3485c877-b6d8-4444-a53b-020a00e7ea45 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:33:30.168834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6a2aab17-f845-43c8-8398-c273c9176bae tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '.version_select at 0x7fbf9c0f0550>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:30.192739 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6a2aab17-f845-43c8-8398-c273c9176bae tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1205009201" status: 202 len: 0 microversion: 2.1 time: 0.027680 Jul 20 05:33:30.193642 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3776/7451] 10.222.0.20 () {58 vars in 1283 bytes} [Wed Jul 20 05:33:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1205009201 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:33:30.224545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-89aa1d18-1ddd-4051-8fe5-bbe59ff8dacc tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'create', calling method: .version_select at 0x7fbf9d0a43a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1339060199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4PGI5Qgxl00euytWcguT747zocwXVHe/18W5XPCWSBYZ4OoiFqejNrwdmQ3rEN85Wd8C8b96V04LaimuPmh4ujoT3H73twfp+9ih5bPxrPaKgeMb3K8yQUcUwiIEFirg=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:33:30.242254 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-89aa1d18-1ddd-4051-8fe5-bbe59ff8dacc tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:33:30.248586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-89aa1d18-1ddd-4051-8fe5-bbe59ff8dacc tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for user 48a1bf5634564af2af0d1ca7c59672a5 and project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:33:30.276872 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-89aa1d18-1ddd-4051-8fe5-bbe59ff8dacc tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056323 Jul 20 05:33:30.277787 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3676/7452] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:33:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:33:35.901747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:35.906633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-565014446", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "aed9b35d-df0f-4243-a882-d7000589ce5d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1339060199", "security_groups": [{"name": "tempest-secgroup-smoke-21563373"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:33:36.032436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] validate_networks() for [('aed9b35d-df0f-4243-a882-d7000589ce5d', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:33:36.458401 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:33:36.458848 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:33:36.459345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:33:36.459912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:33:36.460752 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:33:36.470604 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:36.471074 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:36.471926 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:36.472380 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:36.489700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:33:36.496057 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for user 48a1bf5634564af2af0d1ca7c59672a5 and project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:33:36.509768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:33:36.512100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:33:36.560693 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e0e8453a-b89c-434e-bb18-37c3e8045a30 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.660707 Jul 20 05:33:36.561711 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3777/7453] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:33:35 2022] POST /compute/v2.1/servers => generated 404 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:33:36.572629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-eef7f0ac-7098-4527-9652-c50540caf0b0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:36.573247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-eef7f0ac-7098-4527-9652-c50540caf0b0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:36.661726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-eef7f0ac-7098-4527-9652-c50540caf0b0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:36.671107 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-eef7f0ac-7098-4527-9652-c50540caf0b0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1266 microversion: 2.1 time: 0.103251 Jul 20 05:33:36.671743 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3677/7454] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:36 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:36.870199 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:33:36.870484 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:33:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:33:37.707151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a0549778-68c1-4d66-acdd-2c6388f8f083 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:37.712020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a0549778-68c1-4d66-acdd-2c6388f8f083 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:37.721966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0549778-68c1-4d66-acdd-2c6388f8f083 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:37.722608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0549778-68c1-4d66-acdd-2c6388f8f083 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:37.724032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0549778-68c1-4d66-acdd-2c6388f8f083 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:37.724998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a0549778-68c1-4d66-acdd-2c6388f8f083 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:37.846159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a0549778-68c1-4d66-acdd-2c6388f8f083 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:37.858381 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a0549778-68c1-4d66-acdd-2c6388f8f083 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1324 microversion: 2.1 time: 0.172671 Jul 20 05:33:37.859469 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3778/7455] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:37 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1324 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:38.878058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-297a7e82-4706-489b-9e2c-16482948133c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:38.879500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-297a7e82-4706-489b-9e2c-16482948133c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:38.895227 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=12 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:38.898749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-297a7e82-4706-489b-9e2c-16482948133c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:38.899411 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-297a7e82-4706-489b-9e2c-16482948133c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:38.900292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-297a7e82-4706-489b-9e2c-16482948133c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:38.900939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-297a7e82-4706-489b-9e2c-16482948133c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:39.133746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-297a7e82-4706-489b-9e2c-16482948133c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:39.142970 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-297a7e82-4706-489b-9e2c-16482948133c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1390 microversion: 2.1 time: 0.269432 Jul 20 05:33:39.154105 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3678/7456] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:38 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1390 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:39.281690 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-3225f751-9c4a-4bd3-8989-ca973f3b789a req-5ecf2740-0cde-48d1-9a8e-bb0c83051c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ef79fa-59eb-43f0-83f6-ea8e4c58899f", "tag": "266af517-abaa-47a7-b770-fe1b9adeffb2"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:33:39.301839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3225f751-9c4a-4bd3-8989-ca973f3b789a req-5ecf2740-0cde-48d1-9a8e-bb0c83051c1e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:39.302307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3225f751-9c4a-4bd3-8989-ca973f3b789a req-5ecf2740-0cde-48d1-9a8e-bb0c83051c1e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:39.326501 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-3225f751-9c4a-4bd3-8989-ca973f3b789a req-5ecf2740-0cde-48d1-9a8e-bb0c83051c1e service nova] Creating event network-changed:266af517-abaa-47a7-b770-fe1b9adeffb2 for instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f on n-h1-764485-11 Jul 20 05:33:39.333885 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-3225f751-9c4a-4bd3-8989-ca973f3b789a req-5ecf2740-0cde-48d1-9a8e-bb0c83051c1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055975 Jul 20 05:33:39.336266 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3779/7457] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:33:40.160846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-37f2621f-0ecf-4378-ba98-51aa0728ba0d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:40.161388 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-37f2621f-0ecf-4378-ba98-51aa0728ba0d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:40.168995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-37f2621f-0ecf-4378-ba98-51aa0728ba0d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:40.169444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-37f2621f-0ecf-4378-ba98-51aa0728ba0d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:40.170202 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-37f2621f-0ecf-4378-ba98-51aa0728ba0d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:40.170637 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-37f2621f-0ecf-4378-ba98-51aa0728ba0d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:40.302356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-37f2621f-0ecf-4378-ba98-51aa0728ba0d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:40.309994 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-37f2621f-0ecf-4378-ba98-51aa0728ba0d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1390 microversion: 2.1 time: 0.153112 Jul 20 05:33:40.310567 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3679/7458] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:40 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:41.328068 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-74006dd8-4ebb-44aa-ba1d-b794c3336ee4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:41.328783 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-74006dd8-4ebb-44aa-ba1d-b794c3336ee4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:41.335093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74006dd8-4ebb-44aa-ba1d-b794c3336ee4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:41.335582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74006dd8-4ebb-44aa-ba1d-b794c3336ee4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:41.336360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74006dd8-4ebb-44aa-ba1d-b794c3336ee4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:41.336816 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-74006dd8-4ebb-44aa-ba1d-b794c3336ee4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:41.471098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-74006dd8-4ebb-44aa-ba1d-b794c3336ee4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:41.479492 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-74006dd8-4ebb-44aa-ba1d-b794c3336ee4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1390 microversion: 2.1 time: 0.156534 Jul 20 05:33:41.480106 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3780/7459] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:41 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:42.496936 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e112e047-6b1d-4ff2-a79a-147e90e3ee8a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:42.497489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e112e047-6b1d-4ff2-a79a-147e90e3ee8a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:42.504373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e112e047-6b1d-4ff2-a79a-147e90e3ee8a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:42.504828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e112e047-6b1d-4ff2-a79a-147e90e3ee8a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:42.505596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e112e047-6b1d-4ff2-a79a-147e90e3ee8a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:42.506038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e112e047-6b1d-4ff2-a79a-147e90e3ee8a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:42.640087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e112e047-6b1d-4ff2-a79a-147e90e3ee8a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:42.648332 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e112e047-6b1d-4ff2-a79a-147e90e3ee8a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1390 microversion: 2.1 time: 0.155084 Jul 20 05:33:42.648998 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3680/7460] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:42 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:43.665987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8fd0e530-036b-48e0-9f86-edc116265f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:43.666749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8fd0e530-036b-48e0-9f86-edc116265f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:43.673829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8fd0e530-036b-48e0-9f86-edc116265f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:43.674304 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8fd0e530-036b-48e0-9f86-edc116265f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:43.675105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8fd0e530-036b-48e0-9f86-edc116265f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:43.675591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8fd0e530-036b-48e0-9f86-edc116265f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:43.808221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8fd0e530-036b-48e0-9f86-edc116265f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:43.815707 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8fd0e530-036b-48e0-9f86-edc116265f9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1390 microversion: 2.1 time: 0.153795 Jul 20 05:33:43.816281 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3781/7461] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:43 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:44.833510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ff4360d8-ced2-4042-8831-ce47b81da6d6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:44.834101 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ff4360d8-ced2-4042-8831-ce47b81da6d6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:44.842215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff4360d8-ced2-4042-8831-ce47b81da6d6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:44.842672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff4360d8-ced2-4042-8831-ce47b81da6d6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:44.843441 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff4360d8-ced2-4042-8831-ce47b81da6d6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:44.843912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ff4360d8-ced2-4042-8831-ce47b81da6d6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:44.979308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ff4360d8-ced2-4042-8831-ce47b81da6d6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:44.986763 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ff4360d8-ced2-4042-8831-ce47b81da6d6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1390 microversion: 2.1 time: 0.157152 Jul 20 05:33:44.987334 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3681/7462] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:44 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:46.004229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-72ace5f3-e016-4b8d-90b8-ce98390cf00f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:46.004853 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-72ace5f3-e016-4b8d-90b8-ce98390cf00f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:46.011721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72ace5f3-e016-4b8d-90b8-ce98390cf00f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:46.012182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72ace5f3-e016-4b8d-90b8-ce98390cf00f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:46.012963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72ace5f3-e016-4b8d-90b8-ce98390cf00f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:46.013410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-72ace5f3-e016-4b8d-90b8-ce98390cf00f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:46.152447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-72ace5f3-e016-4b8d-90b8-ce98390cf00f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:46.160200 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-72ace5f3-e016-4b8d-90b8-ce98390cf00f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1390 microversion: 2.1 time: 0.159851 Jul 20 05:33:46.160862 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3782/7463] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:45 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:46.192427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-db6857e8-d366-4b5c-badf-2c3ada21a775 req-417e9894-9239-44f7-a37c-a3318dff48ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ef79fa-59eb-43f0-83f6-ea8e4c58899f", "name": "network-vif-plugged", "status": "completed", "tag": "266af517-abaa-47a7-b770-fe1b9adeffb2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:33:46.200978 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-db6857e8-d366-4b5c-badf-2c3ada21a775 req-417e9894-9239-44f7-a37c-a3318dff48ed service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:46.201429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-db6857e8-d366-4b5c-badf-2c3ada21a775 req-417e9894-9239-44f7-a37c-a3318dff48ed service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:46.213252 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-db6857e8-d366-4b5c-badf-2c3ada21a775 req-417e9894-9239-44f7-a37c-a3318dff48ed service nova] Creating event network-vif-plugged:266af517-abaa-47a7-b770-fe1b9adeffb2 for instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f on n-h1-764485-11 Jul 20 05:33:46.218332 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-db6857e8-d366-4b5c-badf-2c3ada21a775 req-417e9894-9239-44f7-a37c-a3318dff48ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109916 Jul 20 05:33:46.218949 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3682/7464] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:33:47.178154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5ec206c7-fc9b-4602-9942-9a6d83427c7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:47.178685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5ec206c7-fc9b-4602-9942-9a6d83427c7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:47.181998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:47.182715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:47.189231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ec206c7-fc9b-4602-9942-9a6d83427c7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:47.189696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ec206c7-fc9b-4602-9942-9a6d83427c7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:47.190509 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ec206c7-fc9b-4602-9942-9a6d83427c7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:47.190960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5ec206c7-fc9b-4602-9942-9a6d83427c7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:47.326476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5ec206c7-fc9b-4602-9942-9a6d83427c7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:47.333941 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5ec206c7-fc9b-4602-9942-9a6d83427c7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1390 microversion: 2.1 time: 0.160017 Jul 20 05:33:47.334521 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3783/7465] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:47 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:48.350901 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dbbfcd91-e994-46e2-bcab-264a0c5b79d0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:48.351705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dbbfcd91-e994-46e2-bcab-264a0c5b79d0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:48.353797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:33:48.360325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbbfcd91-e994-46e2-bcab-264a0c5b79d0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:48.360782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbbfcd91-e994-46e2-bcab-264a0c5b79d0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:48.361559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbbfcd91-e994-46e2-bcab-264a0c5b79d0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:48.362000 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dbbfcd91-e994-46e2-bcab-264a0c5b79d0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:48.496309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dbbfcd91-e994-46e2-bcab-264a0c5b79d0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:48.503936 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dbbfcd91-e994-46e2-bcab-264a0c5b79d0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1562 microversion: 2.1 time: 0.157435 Jul 20 05:33:48.504516 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3683/7466] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:48 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:48.520071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-83392962-8d39-496d-bc20-921c7b5ec2b2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:48.520700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-83392962-8d39-496d-bc20-921c7b5ec2b2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:48.528187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83392962-8d39-496d-bc20-921c7b5ec2b2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:48.528683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83392962-8d39-496d-bc20-921c7b5ec2b2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:48.529468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83392962-8d39-496d-bc20-921c7b5ec2b2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:48.529931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-83392962-8d39-496d-bc20-921c7b5ec2b2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:48.667009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-83392962-8d39-496d-bc20-921c7b5ec2b2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:48.674494 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-83392962-8d39-496d-bc20-921c7b5ec2b2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1562 microversion: 2.1 time: 0.158293 Jul 20 05:33:48.675081 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3784/7467] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:48 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:33:50.549623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-f5ce51c6-fa16-4c85-92b4-16eafe6b9564 req-56d853f8-7391-4511-859c-f740bb71d872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ef79fa-59eb-43f0-83f6-ea8e4c58899f", "tag": "266af517-abaa-47a7-b770-fe1b9adeffb2"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:33:50.556982 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c4cf792d-fa31-4982-8539-d1727fdd54b4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:33:50.557605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c4cf792d-fa31-4982-8539-d1727fdd54b4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:33:50.567263 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4cf792d-fa31-4982-8539-d1727fdd54b4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:50.568001 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4cf792d-fa31-4982-8539-d1727fdd54b4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:50.568781 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4cf792d-fa31-4982-8539-d1727fdd54b4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:50.569225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c4cf792d-fa31-4982-8539-d1727fdd54b4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:50.572414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f5ce51c6-fa16-4c85-92b4-16eafe6b9564 req-56d853f8-7391-4511-859c-f740bb71d872 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:33:50.573105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f5ce51c6-fa16-4c85-92b4-16eafe6b9564 req-56d853f8-7391-4511-859c-f740bb71d872 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:33:50.584282 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f5ce51c6-fa16-4c85-92b4-16eafe6b9564 req-56d853f8-7391-4511-859c-f740bb71d872 service nova] Creating event network-changed:266af517-abaa-47a7-b770-fe1b9adeffb2 for instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f on n-h1-764485-11 Jul 20 05:33:50.590260 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-f5ce51c6-fa16-4c85-92b4-16eafe6b9564 req-56d853f8-7391-4511-859c-f740bb71d872 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043836 Jul 20 05:33:50.592949 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3785/7468] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:33:50.724250 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c4cf792d-fa31-4982-8539-d1727fdd54b4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:33:50.732786 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c4cf792d-fa31-4982-8539-d1727fdd54b4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1562 microversion: 2.1 time: 0.188962 Jul 20 05:33:50.733391 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3684/7469] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:33:50 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1562 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:24.012346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:24.013117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=42 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:24.065779 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-24dd81d7-648f-4964-a376-4cabe99f736e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:24.066827 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-24dd81d7-648f-4964-a376-4cabe99f736e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:24.074020 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24dd81d7-648f-4964-a376-4cabe99f736e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:24.074482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24dd81d7-648f-4964-a376-4cabe99f736e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:24.075262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24dd81d7-648f-4964-a376-4cabe99f736e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:24.075740 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-24dd81d7-648f-4964-a376-4cabe99f736e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:24.124352 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-24dd81d7-648f-4964-a376-4cabe99f736e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f/action" status: 200 len: 24576 microversion: 2.1 time: 0.114707 Jul 20 05:34:24.124993 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3786/7470] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:34:24 2022] POST /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f/action => generated 24576 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:34:54.361377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:54.362137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=38 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:54.366184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:54.367141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:54.375122 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:54.375615 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:54.376387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:54.376829 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:54.417825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:54.424232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Old instance type m1.heat2, new instance type m1.heat {{(pid=119807) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:34:54.430500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:34:54.431644 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:34:54.432253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:34:54.432664 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:34:54.433080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:34:54.497295 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-50d03299-e996-4087-bed2-aa6f255e62a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f/action" status: 202 len: 0 microversion: 2.1 time: 0.137745 Jul 20 05:34:54.497905 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3685/7471] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:34:54 2022] POST /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:34:54.506466 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fa08c922-2aa5-467c-afc5-494f6f53de01 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:54.507185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fa08c922-2aa5-467c-afc5-494f6f53de01 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:54.510307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:54.510933 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:54.517392 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa08c922-2aa5-467c-afc5-494f6f53de01 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:54.517867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa08c922-2aa5-467c-afc5-494f6f53de01 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:54.518635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa08c922-2aa5-467c-afc5-494f6f53de01 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:54.519090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa08c922-2aa5-467c-afc5-494f6f53de01 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:54.707180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fa08c922-2aa5-467c-afc5-494f6f53de01 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:54.716822 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fa08c922-2aa5-467c-afc5-494f6f53de01 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1690 microversion: 2.1 time: 0.214497 Jul 20 05:34:54.717407 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3787/7472] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:54 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1690 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:55.735476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5a8bf103-9979-43fa-90b0-b527f69e475d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:55.736153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5a8bf103-9979-43fa-90b0-b527f69e475d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:55.742397 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a8bf103-9979-43fa-90b0-b527f69e475d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:55.742887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a8bf103-9979-43fa-90b0-b527f69e475d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:55.744171 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a8bf103-9979-43fa-90b0-b527f69e475d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:55.744870 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5a8bf103-9979-43fa-90b0-b527f69e475d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:55.878808 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5a8bf103-9979-43fa-90b0-b527f69e475d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:55.887058 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5a8bf103-9979-43fa-90b0-b527f69e475d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1690 microversion: 2.1 time: 0.156538 Jul 20 05:34:55.887669 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3686/7473] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:55 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:34:56.905061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1b1f3ee5-6207-4318-b536-4771df7523a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:56.905612 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1b1f3ee5-6207-4318-b536-4771df7523a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:56.916167 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b1f3ee5-6207-4318-b536-4771df7523a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:56.916629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b1f3ee5-6207-4318-b536-4771df7523a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:56.917405 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b1f3ee5-6207-4318-b536-4771df7523a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:56.917858 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b1f3ee5-6207-4318-b536-4771df7523a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:57.050711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1b1f3ee5-6207-4318-b536-4771df7523a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:57.059123 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1b1f3ee5-6207-4318-b536-4771df7523a4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1695 microversion: 2.1 time: 0.157999 Jul 20 05:34:57.059761 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3788/7474] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:56 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:58.077308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59cf236d-e009-439f-b96a-e44ef965914c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:58.077919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-59cf236d-e009-439f-b96a-e44ef965914c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:58.084887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59cf236d-e009-439f-b96a-e44ef965914c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:58.085342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59cf236d-e009-439f-b96a-e44ef965914c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:58.086116 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59cf236d-e009-439f-b96a-e44ef965914c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:58.086596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59cf236d-e009-439f-b96a-e44ef965914c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:58.223164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-59cf236d-e009-439f-b96a-e44ef965914c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:58.230786 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-59cf236d-e009-439f-b96a-e44ef965914c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1695 microversion: 2.1 time: 0.158644 Jul 20 05:34:58.231364 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3687/7475] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:58 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:59.249770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0de20300-1d48-4d04-9483-d5c3a3459e2f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:59.250403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0de20300-1d48-4d04-9483-d5c3a3459e2f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:59.257316 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0de20300-1d48-4d04-9483-d5c3a3459e2f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:59.257777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0de20300-1d48-4d04-9483-d5c3a3459e2f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:59.258543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0de20300-1d48-4d04-9483-d5c3a3459e2f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:59.259012 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0de20300-1d48-4d04-9483-d5c3a3459e2f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:59.391284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0de20300-1d48-4d04-9483-d5c3a3459e2f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:59.398862 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0de20300-1d48-4d04-9483-d5c3a3459e2f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1695 microversion: 2.1 time: 0.153136 Jul 20 05:34:59.399442 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3789/7476] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:59 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:00.415665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-348454a6-a5c9-4243-a291-4408a1d49e86 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:00.416312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-348454a6-a5c9-4243-a291-4408a1d49e86 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:00.423656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-348454a6-a5c9-4243-a291-4408a1d49e86 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:00.424113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-348454a6-a5c9-4243-a291-4408a1d49e86 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:00.424898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-348454a6-a5c9-4243-a291-4408a1d49e86 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:00.425343 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-348454a6-a5c9-4243-a291-4408a1d49e86 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:00.564884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-348454a6-a5c9-4243-a291-4408a1d49e86 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:00.572509 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-348454a6-a5c9-4243-a291-4408a1d49e86 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1695 microversion: 2.1 time: 0.160776 Jul 20 05:35:00.573097 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3688/7477] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:00 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:01.594777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0a8bbec9-4286-450c-87a3-271ce62c43dd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:01.595533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0a8bbec9-4286-450c-87a3-271ce62c43dd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:01.602465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a8bbec9-4286-450c-87a3-271ce62c43dd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:01.602925 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a8bbec9-4286-450c-87a3-271ce62c43dd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:01.603734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a8bbec9-4286-450c-87a3-271ce62c43dd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:01.604180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0a8bbec9-4286-450c-87a3-271ce62c43dd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:01.738543 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0a8bbec9-4286-450c-87a3-271ce62c43dd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:01.746322 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0a8bbec9-4286-450c-87a3-271ce62c43dd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1695 microversion: 2.1 time: 0.159952 Jul 20 05:35:01.746892 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3790/7478] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:01 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:02.762885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2c27dacb-04e2-4edf-99ca-db60434a324a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:02.763494 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2c27dacb-04e2-4edf-99ca-db60434a324a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:02.770537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c27dacb-04e2-4edf-99ca-db60434a324a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:02.770991 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c27dacb-04e2-4edf-99ca-db60434a324a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:02.771786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c27dacb-04e2-4edf-99ca-db60434a324a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:02.772233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2c27dacb-04e2-4edf-99ca-db60434a324a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:02.903689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2c27dacb-04e2-4edf-99ca-db60434a324a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:02.911696 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2c27dacb-04e2-4edf-99ca-db60434a324a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1695 microversion: 2.1 time: 0.152668 Jul 20 05:35:02.912207 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3689/7479] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:02 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:03.929228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-776381b8-a721-4095-bf38-adbc2bfe9eb6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:03.929855 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-776381b8-a721-4095-bf38-adbc2bfe9eb6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:03.937261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-776381b8-a721-4095-bf38-adbc2bfe9eb6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:03.937723 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-776381b8-a721-4095-bf38-adbc2bfe9eb6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:03.938489 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-776381b8-a721-4095-bf38-adbc2bfe9eb6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:03.938935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-776381b8-a721-4095-bf38-adbc2bfe9eb6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:04.076665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-776381b8-a721-4095-bf38-adbc2bfe9eb6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:04.084185 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-776381b8-a721-4095-bf38-adbc2bfe9eb6 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1695 microversion: 2.1 time: 0.159093 Jul 20 05:35:04.084767 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3791/7480] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:03 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:05.101485 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9381e467-c069-4b9a-9221-1b77cefbf8fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:05.102095 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9381e467-c069-4b9a-9221-1b77cefbf8fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:05.109153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9381e467-c069-4b9a-9221-1b77cefbf8fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:05.109605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9381e467-c069-4b9a-9221-1b77cefbf8fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:05.110363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9381e467-c069-4b9a-9221-1b77cefbf8fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:05.110799 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9381e467-c069-4b9a-9221-1b77cefbf8fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:05.247073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9381e467-c069-4b9a-9221-1b77cefbf8fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:05.254610 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9381e467-c069-4b9a-9221-1b77cefbf8fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1695 microversion: 2.1 time: 0.157045 Jul 20 05:35:05.255188 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3690/7481] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:05 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:06.272259 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7ca90fd4-a40b-4353-b69c-570a97c721d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:06.272885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7ca90fd4-a40b-4353-b69c-570a97c721d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:06.280646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ca90fd4-a40b-4353-b69c-570a97c721d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:06.281106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ca90fd4-a40b-4353-b69c-570a97c721d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:06.281880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ca90fd4-a40b-4353-b69c-570a97c721d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:06.282329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7ca90fd4-a40b-4353-b69c-570a97c721d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:06.418571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7ca90fd4-a40b-4353-b69c-570a97c721d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:06.426717 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7ca90fd4-a40b-4353-b69c-570a97c721d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1695 microversion: 2.1 time: 0.158325 Jul 20 05:35:06.427297 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3792/7482] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:06 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:07.445153 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-03f572d2-382d-4707-b294-ba2272c4bbed tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:07.445720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-03f572d2-382d-4707-b294-ba2272c4bbed tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:07.453329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03f572d2-382d-4707-b294-ba2272c4bbed tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:07.453788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03f572d2-382d-4707-b294-ba2272c4bbed tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:07.454557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03f572d2-382d-4707-b294-ba2272c4bbed tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:07.454995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-03f572d2-382d-4707-b294-ba2272c4bbed tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:07.586902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-03f572d2-382d-4707-b294-ba2272c4bbed tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:07.595278 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-03f572d2-382d-4707-b294-ba2272c4bbed tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1695 microversion: 2.1 time: 0.154106 Jul 20 05:35:07.595889 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3691/7483] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:07 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:08.613284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fd7c63a2-1371-41b3-b1f1-9d9846e756bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:08.613900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fd7c63a2-1371-41b3-b1f1-9d9846e756bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:08.621377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fd7c63a2-1371-41b3-b1f1-9d9846e756bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:08.621875 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fd7c63a2-1371-41b3-b1f1-9d9846e756bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:08.622715 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fd7c63a2-1371-41b3-b1f1-9d9846e756bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:08.623170 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fd7c63a2-1371-41b3-b1f1-9d9846e756bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:08.761659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fd7c63a2-1371-41b3-b1f1-9d9846e756bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:08.769652 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fd7c63a2-1371-41b3-b1f1-9d9846e756bf tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1694 microversion: 2.1 time: 0.160407 Jul 20 05:35:08.770254 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3793/7484] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:08 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:08.909313 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-dcb6cfbb-60f4-4123-ad6f-4625b72b6f0e req-f69c8375-97eb-42b9-bd00-b3566cd8db34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ef79fa-59eb-43f0-83f6-ea8e4c58899f", "name": "network-vif-unplugged", "status": "completed", "tag": "266af517-abaa-47a7-b770-fe1b9adeffb2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:35:08.920484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dcb6cfbb-60f4-4123-ad6f-4625b72b6f0e req-f69c8375-97eb-42b9-bd00-b3566cd8db34 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:08.920933 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-dcb6cfbb-60f4-4123-ad6f-4625b72b6f0e req-f69c8375-97eb-42b9-bd00-b3566cd8db34 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:08.934550 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-dcb6cfbb-60f4-4123-ad6f-4625b72b6f0e req-f69c8375-97eb-42b9-bd00-b3566cd8db34 service nova] Creating event network-vif-unplugged:266af517-abaa-47a7-b770-fe1b9adeffb2 for instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f on n-h2-764485-11 Jul 20 05:35:08.940162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [req-dcb6cfbb-60f4-4123-ad6f-4625b72b6f0e req-f69c8375-97eb-42b9-bd00-b3566cd8db34 service nova] Instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:35:08.953558 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-dcb6cfbb-60f4-4123-ad6f-4625b72b6f0e req-f69c8375-97eb-42b9-bd00-b3566cd8db34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047949 Jul 20 05:35:08.954426 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3692/7485] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:35:09.787115 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4b9107f3-fb52-4aa7-8ef6-c1026cd42c62 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:09.787780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4b9107f3-fb52-4aa7-8ef6-c1026cd42c62 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:09.795113 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b9107f3-fb52-4aa7-8ef6-c1026cd42c62 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:09.795619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b9107f3-fb52-4aa7-8ef6-c1026cd42c62 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:09.796412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b9107f3-fb52-4aa7-8ef6-c1026cd42c62 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:09.796867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4b9107f3-fb52-4aa7-8ef6-c1026cd42c62 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:09.938116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4b9107f3-fb52-4aa7-8ef6-c1026cd42c62 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:09.945769 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4b9107f3-fb52-4aa7-8ef6-c1026cd42c62 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1694 microversion: 2.1 time: 0.162488 Jul 20 05:35:09.946342 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3794/7486] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:09 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:10.966417 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-12e73e0e-2c82-4684-bed4-7cc0bb445bcd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:10.967314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-12e73e0e-2c82-4684-bed4-7cc0bb445bcd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:10.972239 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6a71e6bd-ad46-430c-bc80-72c2fe05f747 req-ff3c1625-296d-4119-ad16-1c2ef5c8b972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ef79fa-59eb-43f0-83f6-ea8e4c58899f", "tag": "266af517-abaa-47a7-b770-fe1b9adeffb2"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:35:10.973793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12e73e0e-2c82-4684-bed4-7cc0bb445bcd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:10.974286 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12e73e0e-2c82-4684-bed4-7cc0bb445bcd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:10.975067 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12e73e0e-2c82-4684-bed4-7cc0bb445bcd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:10.975539 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-12e73e0e-2c82-4684-bed4-7cc0bb445bcd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:10.981492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6a71e6bd-ad46-430c-bc80-72c2fe05f747 req-ff3c1625-296d-4119-ad16-1c2ef5c8b972 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:10.981953 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6a71e6bd-ad46-430c-bc80-72c2fe05f747 req-ff3c1625-296d-4119-ad16-1c2ef5c8b972 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:10.993480 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6a71e6bd-ad46-430c-bc80-72c2fe05f747 req-ff3c1625-296d-4119-ad16-1c2ef5c8b972 service nova] Creating event network-changed:266af517-abaa-47a7-b770-fe1b9adeffb2 for instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f on n-h2-764485-11 Jul 20 05:35:10.999496 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [req-6a71e6bd-ad46-430c-bc80-72c2fe05f747 req-ff3c1625-296d-4119-ad16-1c2ef5c8b972 service nova] Instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764485-11', 'n-h2-764485-11'} {{(pid=119808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:35:11.011278 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6a71e6bd-ad46-430c-bc80-72c2fe05f747 req-ff3c1625-296d-4119-ad16-1c2ef5c8b972 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041830 Jul 20 05:35:11.012002 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3795/7487] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:35:11.110624 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-12e73e0e-2c82-4684-bed4-7cc0bb445bcd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:11.118703 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-12e73e0e-2c82-4684-bed4-7cc0bb445bcd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1692 microversion: 2.1 time: 0.158116 Jul 20 05:35:11.119368 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3693/7488] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:10 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:12.137614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-04bcb818-0555-4cf7-ab94-eb72bb4e7525 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:12.138329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-04bcb818-0555-4cf7-ab94-eb72bb4e7525 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:12.144521 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04bcb818-0555-4cf7-ab94-eb72bb4e7525 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:12.144982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04bcb818-0555-4cf7-ab94-eb72bb4e7525 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:12.145747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04bcb818-0555-4cf7-ab94-eb72bb4e7525 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:12.146204 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-04bcb818-0555-4cf7-ab94-eb72bb4e7525 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:12.281037 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-04bcb818-0555-4cf7-ab94-eb72bb4e7525 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:12.288623 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-04bcb818-0555-4cf7-ab94-eb72bb4e7525 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1692 microversion: 2.1 time: 0.156286 Jul 20 05:35:12.289197 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3796/7489] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:12 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:13.306301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4674b275-7cd7-49d8-9363-cf02061703aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:13.306918 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4674b275-7cd7-49d8-9363-cf02061703aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:13.314322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4674b275-7cd7-49d8-9363-cf02061703aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:13.314773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4674b275-7cd7-49d8-9363-cf02061703aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:13.315552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4674b275-7cd7-49d8-9363-cf02061703aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:13.315997 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4674b275-7cd7-49d8-9363-cf02061703aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:13.447609 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4674b275-7cd7-49d8-9363-cf02061703aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:13.455459 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4674b275-7cd7-49d8-9363-cf02061703aa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1689 microversion: 2.1 time: 0.153053 Jul 20 05:35:13.456061 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3694/7490] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:13 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:13.471856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5beccce2-7173-4156-9895-78bddd67159c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:35:13.472534 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5beccce2-7173-4156-9895-78bddd67159c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:13.479658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5beccce2-7173-4156-9895-78bddd67159c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:13.480137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5beccce2-7173-4156-9895-78bddd67159c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:13.480920 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5beccce2-7173-4156-9895-78bddd67159c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:13.481375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5beccce2-7173-4156-9895-78bddd67159c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:13.538755 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5beccce2-7173-4156-9895-78bddd67159c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f/action" status: 204 len: 0 microversion: 2.1 time: 0.070622 Jul 20 05:35:13.539439 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3797/7491] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:35:13 2022] POST /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:35:13.548358 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-477f4402-88cc-4ced-b671-0f78aec1301b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:13.549657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-477f4402-88cc-4ced-b671-0f78aec1301b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:13.556023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-477f4402-88cc-4ced-b671-0f78aec1301b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:13.556553 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-477f4402-88cc-4ced-b671-0f78aec1301b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:13.557292 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-477f4402-88cc-4ced-b671-0f78aec1301b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:13.557860 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-477f4402-88cc-4ced-b671-0f78aec1301b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:13.709754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-477f4402-88cc-4ced-b671-0f78aec1301b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:13.718656 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-477f4402-88cc-4ced-b671-0f78aec1301b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1689 microversion: 2.1 time: 0.174078 Jul 20 05:35:13.719412 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3695/7492] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:13 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:13.735888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-eb78b607-c1c7-40bc-8345-ccbd43552726 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:13.736609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-eb78b607-c1c7-40bc-8345-ccbd43552726 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:13.742795 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb78b607-c1c7-40bc-8345-ccbd43552726 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:13.743263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb78b607-c1c7-40bc-8345-ccbd43552726 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:13.744110 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb78b607-c1c7-40bc-8345-ccbd43552726 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:13.744966 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-eb78b607-c1c7-40bc-8345-ccbd43552726 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:13.894985 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-eb78b607-c1c7-40bc-8345-ccbd43552726 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:13.903119 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-eb78b607-c1c7-40bc-8345-ccbd43552726 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1689 microversion: 2.1 time: 0.171471 Jul 20 05:35:13.903724 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3798/7493] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:13 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:14.920625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1dae892a-1c8a-4ba9-a9b7-d5824c0c2c4d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:14.921167 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1dae892a-1c8a-4ba9-a9b7-d5824c0c2c4d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:14.928099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dae892a-1c8a-4ba9-a9b7-d5824c0c2c4d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:14.928557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dae892a-1c8a-4ba9-a9b7-d5824c0c2c4d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:14.929333 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dae892a-1c8a-4ba9-a9b7-d5824c0c2c4d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:14.929777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1dae892a-1c8a-4ba9-a9b7-d5824c0c2c4d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:15.066114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1dae892a-1c8a-4ba9-a9b7-d5824c0c2c4d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:15.074451 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1dae892a-1c8a-4ba9-a9b7-d5824c0c2c4d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1681 microversion: 2.1 time: 0.157896 Jul 20 05:35:15.075022 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3696/7494] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:14 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:15.741640 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-8effa8fa-690c-498d-b984-bf646ddf2afb req-e1dafea6-712b-43ec-99bc-7daa687bf3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ef79fa-59eb-43f0-83f6-ea8e4c58899f", "name": "network-vif-plugged", "status": "completed", "tag": "266af517-abaa-47a7-b770-fe1b9adeffb2"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:35:15.751300 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-8effa8fa-690c-498d-b984-bf646ddf2afb req-e1dafea6-712b-43ec-99bc-7daa687bf3c6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:15.751801 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-8effa8fa-690c-498d-b984-bf646ddf2afb req-e1dafea6-712b-43ec-99bc-7daa687bf3c6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:15.764243 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-8effa8fa-690c-498d-b984-bf646ddf2afb req-e1dafea6-712b-43ec-99bc-7daa687bf3c6 service nova] Creating event network-vif-plugged:266af517-abaa-47a7-b770-fe1b9adeffb2 for instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f on n-h2-764485-11 Jul 20 05:35:15.769201 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-8effa8fa-690c-498d-b984-bf646ddf2afb req-e1dafea6-712b-43ec-99bc-7daa687bf3c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031252 Jul 20 05:35:15.769805 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3799/7495] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:35:47.281408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d249638e-d892-4800-b22c-f4c3c00901fd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:35:47.282361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d249638e-d892-4800-b22c-f4c3c00901fd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:47.284823 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=28 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:35:47.285508 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:35:47.291060 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d249638e-d892-4800-b22c-f4c3c00901fd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:47.291583 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d249638e-d892-4800-b22c-f4c3c00901fd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:47.292336 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d249638e-d892-4800-b22c-f4c3c00901fd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:47.292774 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d249638e-d892-4800-b22c-f4c3c00901fd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:47.354959 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d249638e-d892-4800-b22c-f4c3c00901fd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f/action" status: 200 len: 24567 microversion: 2.1 time: 0.077336 Jul 20 05:35:47.355608 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3697/7496] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:35:47 2022] POST /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f/action => generated 24567 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:36:04.611461 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=26 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:04.612287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:04.616850 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ca314c51-b692-45d9-8e2b-23d74f6f2a93 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:04.617266 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:04.617718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca314c51-b692-45d9-8e2b-23d74f6f2a93 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:04.618274 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:04.630225 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca314c51-b692-45d9-8e2b-23d74f6f2a93 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:04.630697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca314c51-b692-45d9-8e2b-23d74f6f2a93 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:04.631755 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca314c51-b692-45d9-8e2b-23d74f6f2a93 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:04.632221 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ca314c51-b692-45d9-8e2b-23d74f6f2a93 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:04.659395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ca314c51-b692-45d9-8e2b-23d74f6f2a93 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:36:04.684021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-03ba2287-b23d-4706-b49a-024ac75c67fd req-acb3680c-4b39-400d-ba4c-33086da760fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ef79fa-59eb-43f0-83f6-ea8e4c58899f", "tag": "266af517-abaa-47a7-b770-fe1b9adeffb2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:04.694080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-03ba2287-b23d-4706-b49a-024ac75c67fd req-acb3680c-4b39-400d-ba4c-33086da760fb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:04.694532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-03ba2287-b23d-4706-b49a-024ac75c67fd req-acb3680c-4b39-400d-ba4c-33086da760fb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:04.707742 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-03ba2287-b23d-4706-b49a-024ac75c67fd req-acb3680c-4b39-400d-ba4c-33086da760fb service nova] Creating event network-changed:266af517-abaa-47a7-b770-fe1b9adeffb2 for instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f on n-h2-764485-11 Jul 20 05:36:04.713075 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-03ba2287-b23d-4706-b49a-024ac75c67fd req-acb3680c-4b39-400d-ba4c-33086da760fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101724 Jul 20 05:36:04.713851 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3698/7497] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:36:04.748504 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ca314c51-b692-45d9-8e2b-23d74f6f2a93 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 204 len: 0 microversion: 2.1 time: 0.139294 Jul 20 05:36:04.749424 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3800/7498] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:36:04 2022] DELETE /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:36:04.765004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-254272f4-afe0-48b3-89f6-4ee28e1d524c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:04.766026 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-254272f4-afe0-48b3-89f6-4ee28e1d524c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:04.777798 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-254272f4-afe0-48b3-89f6-4ee28e1d524c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:04.778373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-254272f4-afe0-48b3-89f6-4ee28e1d524c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:04.779538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-254272f4-afe0-48b3-89f6-4ee28e1d524c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:04.780081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-254272f4-afe0-48b3-89f6-4ee28e1d524c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:04.970766 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-254272f4-afe0-48b3-89f6-4ee28e1d524c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:04.979322 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-254272f4-afe0-48b3-89f6-4ee28e1d524c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1687 microversion: 2.1 time: 0.220772 Jul 20 05:36:04.980019 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3699/7499] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:04 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1687 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:05.998674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3414b9d4-47f5-479b-b57a-08daecb9598c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:05.999395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3414b9d4-47f5-479b-b57a-08daecb9598c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:06.006281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3414b9d4-47f5-479b-b57a-08daecb9598c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:06.006753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3414b9d4-47f5-479b-b57a-08daecb9598c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:06.007577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3414b9d4-47f5-479b-b57a-08daecb9598c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:06.008041 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3414b9d4-47f5-479b-b57a-08daecb9598c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:06.190504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3414b9d4-47f5-479b-b57a-08daecb9598c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:06.198971 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3414b9d4-47f5-479b-b57a-08daecb9598c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1687 microversion: 2.1 time: 0.205350 Jul 20 05:36:06.199553 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3801/7500] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:05 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1687 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:06.750435 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e54c537a-9a73-40d2-b15b-554d5586b5fe req-6dcadde1-218f-4686-a559-1b807dfc85fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ef79fa-59eb-43f0-83f6-ea8e4c58899f", "name": "network-vif-deleted", "tag": "266af517-abaa-47a7-b770-fe1b9adeffb2"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:06.760420 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e54c537a-9a73-40d2-b15b-554d5586b5fe req-6dcadde1-218f-4686-a559-1b807dfc85fb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:06.761082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e54c537a-9a73-40d2-b15b-554d5586b5fe req-6dcadde1-218f-4686-a559-1b807dfc85fb service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:06.774122 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e54c537a-9a73-40d2-b15b-554d5586b5fe req-6dcadde1-218f-4686-a559-1b807dfc85fb service nova] Creating event network-vif-deleted:266af517-abaa-47a7-b770-fe1b9adeffb2 for instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f on n-h2-764485-11 Jul 20 05:36:06.779825 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e54c537a-9a73-40d2-b15b-554d5586b5fe req-6dcadde1-218f-4686-a559-1b807dfc85fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033050 Jul 20 05:36:06.780437 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3700/7501] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:36:07.218428 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bf4afaaf-1cee-4b13-9724-a2b904bbd062 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:07.219065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bf4afaaf-1cee-4b13-9724-a2b904bbd062 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:07.226071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf4afaaf-1cee-4b13-9724-a2b904bbd062 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:07.226546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf4afaaf-1cee-4b13-9724-a2b904bbd062 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:07.227325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf4afaaf-1cee-4b13-9724-a2b904bbd062 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:07.227813 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf4afaaf-1cee-4b13-9724-a2b904bbd062 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:07.262098 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf4afaaf-1cee-4b13-9724-a2b904bbd062 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:07.262491 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bf4afaaf-1cee-4b13-9724-a2b904bbd062 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:07.262963 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-bf4afaaf-1cee-4b13-9724-a2b904bbd062 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lazy-loading 'fault' on Instance uuid c0ef79fa-59eb-43f0-83f6-ea8e4c58899f {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:36:07.309645 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bf4afaaf-1cee-4b13-9724-a2b904bbd062 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:07.316576 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bf4afaaf-1cee-4b13-9724-a2b904bbd062 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 200 len: 1356 microversion: 2.1 time: 0.102093 Jul 20 05:36:07.317152 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3802/7502] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:07 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:08.335259 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c1d43126-3bb2-4707-afeb-ba6eedb81b28 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:08.336031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c1d43126-3bb2-4707-afeb-ba6eedb81b28 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: c0ef79fa-59eb-43f0-83f6-ea8e4c58899f] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:08.342663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1d43126-3bb2-4707-afeb-ba6eedb81b28 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:08.343121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1d43126-3bb2-4707-afeb-ba6eedb81b28 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:08.343914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1d43126-3bb2-4707-afeb-ba6eedb81b28 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:08.344360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1d43126-3bb2-4707-afeb-ba6eedb81b28 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:08.358943 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-c1d43126-3bb2-4707-afeb-ba6eedb81b28 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] HTTP exception thrown: Instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f could not be found. Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c1d43126-3bb2-4707-afeb-ba6eedb81b28 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Request method failure captured: Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f HTTP/1.1 Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi15KamC2cRSdG6cc1ZpK_W6-4pm4SSsmZr6uPX8TfqHE-OD_50sr_a7Oi5ok1Qt_YNwbNXDMsT5XuAk86tbRFGjGh8_epPTd9IQ1bBUJ3roPkWn_jJjxd5GlzLBxYNUDXktD7r9cw1LMU07SP6Pv33Fw3Zp33FJixOet7ASNRwAG65zs Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d5022754d8de48cfb8ddf66fc6dbd3dd Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5022754d8de48cfb8ddf66fc6dbd3dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}] Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d5022754d8de48cfb8ddf66fc6dbd3dd Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestNetworkAdvancedServerOps-1159726665-project Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 48a1bf5634564af2af0d1ca7c59672a5 Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1159726665-project Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f could not be found. Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'c0ef79fa-59eb-43f0-83f6-ea8e4c58899f'} Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f could not be found. Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f could not be found. Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:36:08.360606 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:36:08.365578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:36:08.365578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:36:08.365578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:36:08.365578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:36:08.365578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:36:08.365578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:36:08.365578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f could not be found. Jul 20 05:36:08.365578 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:36:08.365578 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c1d43126-3bb2-4707-afeb-ba6eedb81b28 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Returning 404 to user: Instance c0ef79fa-59eb-43f0-83f6-ea8e4c58899f could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:36:08.365578 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c1d43126-3bb2-4707-afeb-ba6eedb81b28 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f" status: 404 len: 111 microversion: 2.1 time: 0.031923 Jul 20 05:36:08.365578 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3701/7503] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:08 2022] GET /compute/v2.1/servers/c0ef79fa-59eb-43f0-83f6-ea8e4c58899f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:36:11.966109 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d38753ef-57c0-44ed-b366-4041fa3d7c55 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '.version_select at 0x7fbf9c45c0d0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:11.987319 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d38753ef-57c0-44ed-b366-4041fa3d7c55 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1339060199" status: 202 len: 0 microversion: 2.1 time: 0.025700 Jul 20 05:36:11.987955 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3803/7504] 10.222.0.20 () {58 vars in 1283 bytes} [Wed Jul 20 05:36:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1339060199 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:36:12.008532 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1db9dbe4-f6fd-4a1d-9c38-78ca8ef1c83b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'create', calling method: .version_select at 0x7fbf9c0768b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1262528641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPfrCeNP/iEYcQ0h/n6f10aAJ13PfnnIEMMNkZoag/ykKX6KP9o94bKdy2miSjHtZeHT3JgqSu/x3Aw+dtPtupZbvpKOgPb6P9tAI4o1Cq1iJHJDH/ZgWl/Xw5Utt1Weg=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:12.024773 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-1db9dbe4-f6fd-4a1d-9c38-78ca8ef1c83b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:36:12.030587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-1db9dbe4-f6fd-4a1d-9c38-78ca8ef1c83b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for user 48a1bf5634564af2af0d1ca7c59672a5 and project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:36:12.054063 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1db9dbe4-f6fd-4a1d-9c38-78ca8ef1c83b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.049422 Jul 20 05:36:12.054659 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3702/7505] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:36:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:36:17.760818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:17.764901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1080947717", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "cf1ced32-5f74-494c-a4f9-4b157b4b502d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1262528641", "security_groups": [{"name": "tempest-secgroup-smoke-367219934"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:17.897545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] validate_networks() for [('cf1ced32-5f74-494c-a4f9-4b157b4b502d', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:36:18.459794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:36:18.460248 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:36:18.460831 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:36:18.461200 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:36:18.461638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:36:18.472514 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:18.473256 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:18.474260 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:18.474725 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:18.495703 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:36:18.502796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for user 48a1bf5634564af2af0d1ca7c59672a5 and project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:36:18.518163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:36:18.521052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:36:18.576029 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [fd8a0020-f178-4067-a229-fbc387b5175a] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:36:19.585331 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [fd8a0020-f178-4067-a229-fbc387b5175a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54462. Jul 20 05:36:19.592748 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-94952644-e4f3-44b1-99d7-68d728f634f7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.834766 Jul 20 05:36:19.593676 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3804/7506] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:36:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:36:19.609328 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0610852-43c2-4c17-ae17-83609ff5b464 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:19.610787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e0610852-43c2-4c17-ae17-83609ff5b464 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:19.622945 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=12 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:19.699124 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e0610852-43c2-4c17-ae17-83609ff5b464 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:19.707989 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e0610852-43c2-4c17-ae17-83609ff5b464 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1267 microversion: 2.1 time: 0.107183 Jul 20 05:36:19.709268 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3703/7507] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:19 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:20.727557 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b869f7b1-950e-412f-a32a-52109510bc9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:20.728722 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b869f7b1-950e-412f-a32a-52109510bc9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:20.741094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b869f7b1-950e-412f-a32a-52109510bc9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:20.741551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b869f7b1-950e-412f-a32a-52109510bc9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:20.742624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b869f7b1-950e-412f-a32a-52109510bc9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:20.743090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b869f7b1-950e-412f-a32a-52109510bc9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:20.811909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b869f7b1-950e-412f-a32a-52109510bc9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:20.823670 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b869f7b1-950e-412f-a32a-52109510bc9a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1337 microversion: 2.1 time: 0.099320 Jul 20 05:36:20.827665 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3805/7508] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:20 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1337 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:21.841549 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0c46b93c-05cf-4c6e-baeb-2a8bc27ce4b7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:21.842173 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0c46b93c-05cf-4c6e-baeb-2a8bc27ce4b7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:21.849557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c46b93c-05cf-4c6e-baeb-2a8bc27ce4b7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:21.850007 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c46b93c-05cf-4c6e-baeb-2a8bc27ce4b7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:21.850768 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c46b93c-05cf-4c6e-baeb-2a8bc27ce4b7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:21.851204 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0c46b93c-05cf-4c6e-baeb-2a8bc27ce4b7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:21.992107 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0c46b93c-05cf-4c6e-baeb-2a8bc27ce4b7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:22.007846 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0c46b93c-05cf-4c6e-baeb-2a8bc27ce4b7 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1392 microversion: 2.1 time: 0.170147 Jul 20 05:36:22.008451 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3704/7509] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:21 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:22.261669 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-feb533fe-6af7-484f-a578-a91d93212e05 req-8b65e4fc-3184-4e61-9813-c0f11ce19d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1", "tag": "299040a1-4213-413a-b788-2573e7003602"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:22.271231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-feb533fe-6af7-484f-a578-a91d93212e05 req-8b65e4fc-3184-4e61-9813-c0f11ce19d65 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:22.271726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-feb533fe-6af7-484f-a578-a91d93212e05 req-8b65e4fc-3184-4e61-9813-c0f11ce19d65 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:22.284577 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-feb533fe-6af7-484f-a578-a91d93212e05 req-8b65e4fc-3184-4e61-9813-c0f11ce19d65 service nova] Creating event network-changed:299040a1-4213-413a-b788-2573e7003602 for instance 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 on n-h1-764485-11 Jul 20 05:36:22.293064 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-feb533fe-6af7-484f-a578-a91d93212e05 req-8b65e4fc-3184-4e61-9813-c0f11ce19d65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105029 Jul 20 05:36:22.294447 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3806/7510] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:36:23.026855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-afb16f32-06f8-449f-9314-b6602b042e92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:23.027483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-afb16f32-06f8-449f-9314-b6602b042e92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:23.034012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-afb16f32-06f8-449f-9314-b6602b042e92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:23.034475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-afb16f32-06f8-449f-9314-b6602b042e92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:23.035251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-afb16f32-06f8-449f-9314-b6602b042e92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:23.035722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-afb16f32-06f8-449f-9314-b6602b042e92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:23.175672 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-afb16f32-06f8-449f-9314-b6602b042e92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:23.183228 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-afb16f32-06f8-449f-9314-b6602b042e92 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1392 microversion: 2.1 time: 0.161355 Jul 20 05:36:23.183833 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3705/7511] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:23 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:24.202338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2975d80e-05ae-4d20-8e31-c8b617fdf29e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:24.203154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2975d80e-05ae-4d20-8e31-c8b617fdf29e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:24.210648 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2975d80e-05ae-4d20-8e31-c8b617fdf29e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:24.211116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2975d80e-05ae-4d20-8e31-c8b617fdf29e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:24.211938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2975d80e-05ae-4d20-8e31-c8b617fdf29e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:24.212399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2975d80e-05ae-4d20-8e31-c8b617fdf29e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:24.345586 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2975d80e-05ae-4d20-8e31-c8b617fdf29e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:24.353133 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2975d80e-05ae-4d20-8e31-c8b617fdf29e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1392 microversion: 2.1 time: 0.156215 Jul 20 05:36:24.353718 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3807/7512] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:24 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:25.370614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d4084b8d-dcd5-49fe-bd99-ceaf21cf8646 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:25.371232 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d4084b8d-dcd5-49fe-bd99-ceaf21cf8646 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:25.379169 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d4084b8d-dcd5-49fe-bd99-ceaf21cf8646 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:25.379656 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d4084b8d-dcd5-49fe-bd99-ceaf21cf8646 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:25.380442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d4084b8d-dcd5-49fe-bd99-ceaf21cf8646 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:25.380883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d4084b8d-dcd5-49fe-bd99-ceaf21cf8646 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:25.523409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d4084b8d-dcd5-49fe-bd99-ceaf21cf8646 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:25.531903 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d4084b8d-dcd5-49fe-bd99-ceaf21cf8646 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1392 microversion: 2.1 time: 0.165485 Jul 20 05:36:25.532502 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3706/7513] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:25 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:26.550028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fc6ecd7a-bab2-4647-98b8-a37461a13706 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:26.550670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fc6ecd7a-bab2-4647-98b8-a37461a13706 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:26.557632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc6ecd7a-bab2-4647-98b8-a37461a13706 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:26.558094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc6ecd7a-bab2-4647-98b8-a37461a13706 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:26.559726 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc6ecd7a-bab2-4647-98b8-a37461a13706 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:26.560181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fc6ecd7a-bab2-4647-98b8-a37461a13706 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:26.701141 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fc6ecd7a-bab2-4647-98b8-a37461a13706 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:26.708676 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fc6ecd7a-bab2-4647-98b8-a37461a13706 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1392 microversion: 2.1 time: 0.163308 Jul 20 05:36:26.709262 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3808/7514] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:26 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:27.728059 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6c2e0355-ae68-42a7-a970-23554ed13663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:27.728704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6c2e0355-ae68-42a7-a970-23554ed13663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:27.735992 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c2e0355-ae68-42a7-a970-23554ed13663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:27.736446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c2e0355-ae68-42a7-a970-23554ed13663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:27.737211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c2e0355-ae68-42a7-a970-23554ed13663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:27.737759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6c2e0355-ae68-42a7-a970-23554ed13663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:27.883327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6c2e0355-ae68-42a7-a970-23554ed13663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:27.891731 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6c2e0355-ae68-42a7-a970-23554ed13663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1392 microversion: 2.1 time: 0.169360 Jul 20 05:36:27.892311 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3707/7515] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:27 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:28.841116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-c334291c-37f6-4c14-a8ff-2d94a9ea3235 req-f397b4a9-f0dd-4d47-a464-3430d1c8dab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1", "name": "network-vif-plugged", "status": "completed", "tag": "299040a1-4213-413a-b788-2573e7003602"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:28.845566 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:28.846350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:28.853498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c334291c-37f6-4c14-a8ff-2d94a9ea3235 req-f397b4a9-f0dd-4d47-a464-3430d1c8dab6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:28.853950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-c334291c-37f6-4c14-a8ff-2d94a9ea3235 req-f397b4a9-f0dd-4d47-a464-3430d1c8dab6 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:28.866166 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-c334291c-37f6-4c14-a8ff-2d94a9ea3235 req-f397b4a9-f0dd-4d47-a464-3430d1c8dab6 service nova] Creating event network-vif-plugged:299040a1-4213-413a-b788-2573e7003602 for instance 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 on n-h1-764485-11 Jul 20 05:36:28.872342 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-c334291c-37f6-4c14-a8ff-2d94a9ea3235 req-f397b4a9-f0dd-4d47-a464-3430d1c8dab6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034075 Jul 20 05:36:28.872983 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3809/7516] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:36:28.908715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b39323fe-051c-4e4a-9ce0-576ff9284db0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:28.909373 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b39323fe-051c-4e4a-9ce0-576ff9284db0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:28.924253 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b39323fe-051c-4e4a-9ce0-576ff9284db0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:28.925005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b39323fe-051c-4e4a-9ce0-576ff9284db0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:28.925828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b39323fe-051c-4e4a-9ce0-576ff9284db0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:28.926280 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b39323fe-051c-4e4a-9ce0-576ff9284db0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:29.077277 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b39323fe-051c-4e4a-9ce0-576ff9284db0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:29.084886 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b39323fe-051c-4e4a-9ce0-576ff9284db0 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1392 microversion: 2.1 time: 0.180081 Jul 20 05:36:29.085467 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3708/7517] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:28 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:30.103545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e1d117f6-49fa-4862-9fec-02ac769bc91a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:30.104276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e1d117f6-49fa-4862-9fec-02ac769bc91a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:30.111229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1d117f6-49fa-4862-9fec-02ac769bc91a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:30.111746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1d117f6-49fa-4862-9fec-02ac769bc91a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:30.112530 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1d117f6-49fa-4862-9fec-02ac769bc91a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:30.112989 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e1d117f6-49fa-4862-9fec-02ac769bc91a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:30.246708 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e1d117f6-49fa-4862-9fec-02ac769bc91a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:30.254204 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e1d117f6-49fa-4862-9fec-02ac769bc91a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1392 microversion: 2.1 time: 0.155757 Jul 20 05:36:30.254784 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3810/7518] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:30 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:31.271638 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-82ac200c-ea8c-4ede-9d61-caea645f2666 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:31.272287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-82ac200c-ea8c-4ede-9d61-caea645f2666 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:31.275236 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:31.281866 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82ac200c-ea8c-4ede-9d61-caea645f2666 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:31.282326 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82ac200c-ea8c-4ede-9d61-caea645f2666 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:31.283135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82ac200c-ea8c-4ede-9d61-caea645f2666 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:31.283612 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-82ac200c-ea8c-4ede-9d61-caea645f2666 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:31.419863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-82ac200c-ea8c-4ede-9d61-caea645f2666 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:31.427494 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-82ac200c-ea8c-4ede-9d61-caea645f2666 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1564 microversion: 2.1 time: 0.159860 Jul 20 05:36:31.428092 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3709/7519] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:31 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:31.443599 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-91d603e3-ea62-49c5-a09f-823d24df9f3e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:31.444226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-91d603e3-ea62-49c5-a09f-823d24df9f3e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:31.451089 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91d603e3-ea62-49c5-a09f-823d24df9f3e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:31.451577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91d603e3-ea62-49c5-a09f-823d24df9f3e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:31.452350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91d603e3-ea62-49c5-a09f-823d24df9f3e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:31.452797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-91d603e3-ea62-49c5-a09f-823d24df9f3e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:31.583058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-91d603e3-ea62-49c5-a09f-823d24df9f3e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:31.591566 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-91d603e3-ea62-49c5-a09f-823d24df9f3e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1564 microversion: 2.1 time: 0.151790 Jul 20 05:36:31.592151 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3811/7520] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:31 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:33.193182 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-352db7ef-9c0a-4791-9a49-c17418521209 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:33.198474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-605e6f16-33e8-4976-b53f-6f4896ab5ea4 req-18a536d0-94f4-4574-b1a7-beeebfd1547b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1", "tag": "299040a1-4213-413a-b788-2573e7003602"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:33.201040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-352db7ef-9c0a-4791-9a49-c17418521209 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:33.208556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-352db7ef-9c0a-4791-9a49-c17418521209 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:33.209246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-352db7ef-9c0a-4791-9a49-c17418521209 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:33.210215 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-352db7ef-9c0a-4791-9a49-c17418521209 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:33.210868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-352db7ef-9c0a-4791-9a49-c17418521209 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:33.212867 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-605e6f16-33e8-4976-b53f-6f4896ab5ea4 req-18a536d0-94f4-4574-b1a7-beeebfd1547b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:33.213329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-605e6f16-33e8-4976-b53f-6f4896ab5ea4 req-18a536d0-94f4-4574-b1a7-beeebfd1547b service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:33.225064 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-605e6f16-33e8-4976-b53f-6f4896ab5ea4 req-18a536d0-94f4-4574-b1a7-beeebfd1547b service nova] Creating event network-changed:299040a1-4213-413a-b788-2573e7003602 for instance 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 on n-h1-764485-11 Jul 20 05:36:33.230286 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-605e6f16-33e8-4976-b53f-6f4896ab5ea4 req-18a536d0-94f4-4574-b1a7-beeebfd1547b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035339 Jul 20 05:36:33.234838 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3812/7521] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:36:33.363547 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-352db7ef-9c0a-4791-9a49-c17418521209 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:33.372665 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-352db7ef-9c0a-4791-9a49-c17418521209 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1564 microversion: 2.1 time: 0.183646 Jul 20 05:36:33.384211 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3710/7522] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:33 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1564 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:06.692890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:06.693646 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=38 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:06.697834 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c6a40698-1273-4b77-b21d-adb34f813195 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:37:06.698836 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c6a40698-1273-4b77-b21d-adb34f813195 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:06.707375 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6a40698-1273-4b77-b21d-adb34f813195 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:06.707857 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6a40698-1273-4b77-b21d-adb34f813195 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:06.708629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6a40698-1273-4b77-b21d-adb34f813195 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:06.709077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c6a40698-1273-4b77-b21d-adb34f813195 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:06.758770 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c6a40698-1273-4b77-b21d-adb34f813195 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1/action" status: 200 len: 24565 microversion: 2.1 time: 0.067849 Jul 20 05:37:06.759410 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3813/7523] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:37:06 2022] POST /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1/action => generated 24565 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:37:37.164017 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:37.164814 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=42 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:37.169058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4ad16819-96f6-4418-9464-ca8d5df3a29a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:37:37.176620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ad16819-96f6-4418-9464-ca8d5df3a29a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:37.177077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4ad16819-96f6-4418-9464-ca8d5df3a29a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:37.201528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4ad16819-96f6-4418-9464-ca8d5df3a29a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Going to try to stop instance {{(pid=119807) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 05:37:37.243359 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4ad16819-96f6-4418-9464-ca8d5df3a29a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1/action" status: 202 len: 0 microversion: 2.1 time: 0.081052 Jul 20 05:37:37.244004 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3711/7524] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:37:37 2022] POST /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:37:37.253515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-99eebd85-7e79-41c4-902f-5c8ffba20e90 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:37.254679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-99eebd85-7e79-41c4-902f-5c8ffba20e90 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:37.258334 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:37.259016 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:37.264624 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99eebd85-7e79-41c4-902f-5c8ffba20e90 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:37.265101 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99eebd85-7e79-41c4-902f-5c8ffba20e90 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:37.265898 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99eebd85-7e79-41c4-902f-5c8ffba20e90 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:37.266357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-99eebd85-7e79-41c4-902f-5c8ffba20e90 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:37.405315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-99eebd85-7e79-41c4-902f-5c8ffba20e90 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:37.412850 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-99eebd85-7e79-41c4-902f-5c8ffba20e90 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1693 microversion: 2.1 time: 0.164124 Jul 20 05:37:37.413424 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3814/7525] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:37 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:38.432394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4a1a4d09-2390-4c5f-965e-8b84b67466c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:38.433093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4a1a4d09-2390-4c5f-965e-8b84b67466c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:38.440056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a1a4d09-2390-4c5f-965e-8b84b67466c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:38.440456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a1a4d09-2390-4c5f-965e-8b84b67466c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:38.441281 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a1a4d09-2390-4c5f-965e-8b84b67466c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:38.441721 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4a1a4d09-2390-4c5f-965e-8b84b67466c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:38.582665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4a1a4d09-2390-4c5f-965e-8b84b67466c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:38.590364 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4a1a4d09-2390-4c5f-965e-8b84b67466c4 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1693 microversion: 2.1 time: 0.163353 Jul 20 05:37:38.590939 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3712/7526] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:38 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:39.608684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f1bc90ba-fdf4-45fd-82e6-68ccc270979d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:39.609307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f1bc90ba-fdf4-45fd-82e6-68ccc270979d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:39.615603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1bc90ba-fdf4-45fd-82e6-68ccc270979d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:39.616063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1bc90ba-fdf4-45fd-82e6-68ccc270979d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:39.616828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1bc90ba-fdf4-45fd-82e6-68ccc270979d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:39.617276 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f1bc90ba-fdf4-45fd-82e6-68ccc270979d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:39.754685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f1bc90ba-fdf4-45fd-82e6-68ccc270979d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:39.762293 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f1bc90ba-fdf4-45fd-82e6-68ccc270979d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1693 microversion: 2.1 time: 0.158038 Jul 20 05:37:39.762879 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3815/7527] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:39 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:40.780383 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-556d7233-fd39-45c9-a2c8-33163ddecd9c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:40.780984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-556d7233-fd39-45c9-a2c8-33163ddecd9c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:40.788380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-556d7233-fd39-45c9-a2c8-33163ddecd9c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:40.792278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-556d7233-fd39-45c9-a2c8-33163ddecd9c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:40.793108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-556d7233-fd39-45c9-a2c8-33163ddecd9c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:40.793562 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-556d7233-fd39-45c9-a2c8-33163ddecd9c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:40.936037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-556d7233-fd39-45c9-a2c8-33163ddecd9c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:40.947112 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-556d7233-fd39-45c9-a2c8-33163ddecd9c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1693 microversion: 2.1 time: 0.170617 Jul 20 05:37:40.947654 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3713/7528] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:40 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:41.971182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-38f5f138-06f1-464c-9a8a-e012ada0faf9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:41.971866 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-38f5f138-06f1-464c-9a8a-e012ada0faf9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:41.978821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38f5f138-06f1-464c-9a8a-e012ada0faf9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:41.979291 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38f5f138-06f1-464c-9a8a-e012ada0faf9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:41.980102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38f5f138-06f1-464c-9a8a-e012ada0faf9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:41.980568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-38f5f138-06f1-464c-9a8a-e012ada0faf9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:42.115767 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-38f5f138-06f1-464c-9a8a-e012ada0faf9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:42.123503 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-38f5f138-06f1-464c-9a8a-e012ada0faf9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1693 microversion: 2.1 time: 0.157113 Jul 20 05:37:42.124169 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3816/7529] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:41 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:43.141519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5005590e-397f-47fc-a59a-d493a24578ac tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:43.142172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5005590e-397f-47fc-a59a-d493a24578ac tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:43.149285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5005590e-397f-47fc-a59a-d493a24578ac tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:43.149742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5005590e-397f-47fc-a59a-d493a24578ac tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:43.150511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5005590e-397f-47fc-a59a-d493a24578ac tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:43.150957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5005590e-397f-47fc-a59a-d493a24578ac tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:43.284005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5005590e-397f-47fc-a59a-d493a24578ac tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:43.291603 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5005590e-397f-47fc-a59a-d493a24578ac tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1693 microversion: 2.1 time: 0.154585 Jul 20 05:37:43.292190 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3714/7530] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:43 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:44.308535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-516b1577-2fc7-44e4-af48-9c641078ef80 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:44.309263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-516b1577-2fc7-44e4-af48-9c641078ef80 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:44.316326 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-516b1577-2fc7-44e4-af48-9c641078ef80 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:44.316797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-516b1577-2fc7-44e4-af48-9c641078ef80 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:44.317571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-516b1577-2fc7-44e4-af48-9c641078ef80 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:44.318028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-516b1577-2fc7-44e4-af48-9c641078ef80 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:44.451315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-516b1577-2fc7-44e4-af48-9c641078ef80 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:44.459413 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-516b1577-2fc7-44e4-af48-9c641078ef80 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1693 microversion: 2.1 time: 0.154747 Jul 20 05:37:44.460010 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3817/7531] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:44 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:45.477423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a9e1be6f-d21d-4b4e-bb27-c530f318ffd9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:45.478008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a9e1be6f-d21d-4b4e-bb27-c530f318ffd9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:45.485510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e1be6f-d21d-4b4e-bb27-c530f318ffd9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:45.485969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e1be6f-d21d-4b4e-bb27-c530f318ffd9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:45.486744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e1be6f-d21d-4b4e-bb27-c530f318ffd9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:45.487194 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a9e1be6f-d21d-4b4e-bb27-c530f318ffd9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:45.619055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a9e1be6f-d21d-4b4e-bb27-c530f318ffd9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:45.627061 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a9e1be6f-d21d-4b4e-bb27-c530f318ffd9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1693 microversion: 2.1 time: 0.153770 Jul 20 05:37:45.627666 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3715/7532] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:45 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:46.644746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-677cbff6-3b95-4336-9f0e-a739ea72f62d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:46.645366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-677cbff6-3b95-4336-9f0e-a739ea72f62d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:46.652199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-677cbff6-3b95-4336-9f0e-a739ea72f62d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:46.652662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-677cbff6-3b95-4336-9f0e-a739ea72f62d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:46.653433 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-677cbff6-3b95-4336-9f0e-a739ea72f62d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:46.653880 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-677cbff6-3b95-4336-9f0e-a739ea72f62d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:46.783432 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-677cbff6-3b95-4336-9f0e-a739ea72f62d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:46.790955 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-677cbff6-3b95-4336-9f0e-a739ea72f62d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1693 microversion: 2.1 time: 0.150092 Jul 20 05:37:46.791541 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3818/7533] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:46 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:47.808685 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b174d4b3-17ed-4315-a295-e5ce3e7a2174 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:47.809302 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b174d4b3-17ed-4315-a295-e5ce3e7a2174 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:47.817461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b174d4b3-17ed-4315-a295-e5ce3e7a2174 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:47.817922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b174d4b3-17ed-4315-a295-e5ce3e7a2174 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:47.818722 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b174d4b3-17ed-4315-a295-e5ce3e7a2174 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:47.819164 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b174d4b3-17ed-4315-a295-e5ce3e7a2174 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:47.954914 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b174d4b3-17ed-4315-a295-e5ce3e7a2174 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:47.962500 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b174d4b3-17ed-4315-a295-e5ce3e7a2174 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1670 microversion: 2.1 time: 0.157708 Jul 20 05:37:47.963073 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3716/7534] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:47 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:49.050674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3ace2ba2-b276-4e21-a7dc-747187603fdb tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:37:49.051649 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3ace2ba2-b276-4e21-a7dc-747187603fdb tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:49.058515 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ace2ba2-b276-4e21-a7dc-747187603fdb tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:49.058980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ace2ba2-b276-4e21-a7dc-747187603fdb tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:49.059789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ace2ba2-b276-4e21-a7dc-747187603fdb tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:49.060240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3ace2ba2-b276-4e21-a7dc-747187603fdb tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:49.112942 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3ace2ba2-b276-4e21-a7dc-747187603fdb tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1/action" status: 200 len: 38424 microversion: 2.1 time: 0.066178 Jul 20 05:37:49.113608 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3819/7535] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:37:49 2022] POST /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1/action => generated 38424 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:37:49.125380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7dd4dc4b-bc67-48ba-be00-ed4687566fa9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:37:49.132453 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dd4dc4b-bc67-48ba-be00-ed4687566fa9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:49.132910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dd4dc4b-bc67-48ba-be00-ed4687566fa9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:49.155134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7dd4dc4b-bc67-48ba-be00-ed4687566fa9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Going to try to start instance {{(pid=119807) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 05:37:49.199179 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7dd4dc4b-bc67-48ba-be00-ed4687566fa9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1/action" status: 202 len: 0 microversion: 2.1 time: 0.077686 Jul 20 05:37:49.199830 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3717/7536] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:37:49 2022] POST /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:37:49.210294 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7f382223-542a-4635-bd32-637f7fc67b9e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:49.211052 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7f382223-542a-4635-bd32-637f7fc67b9e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:49.218897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f382223-542a-4635-bd32-637f7fc67b9e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:49.220093 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f382223-542a-4635-bd32-637f7fc67b9e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:49.220895 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f382223-542a-4635-bd32-637f7fc67b9e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:49.221358 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7f382223-542a-4635-bd32-637f7fc67b9e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:49.374360 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-7f382223-542a-4635-bd32-637f7fc67b9e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:49.382092 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7f382223-542a-4635-bd32-637f7fc67b9e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1679 microversion: 2.1 time: 0.176087 Jul 20 05:37:49.382667 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3820/7537] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:49 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:50.401325 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1845d12e-e420-452c-9cc8-d816d0dcbbb8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:50.402033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1845d12e-e420-452c-9cc8-d816d0dcbbb8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:50.408969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1845d12e-e420-452c-9cc8-d816d0dcbbb8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:50.409421 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1845d12e-e420-452c-9cc8-d816d0dcbbb8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:50.410186 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1845d12e-e420-452c-9cc8-d816d0dcbbb8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:50.410630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1845d12e-e420-452c-9cc8-d816d0dcbbb8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:50.547443 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1845d12e-e420-452c-9cc8-d816d0dcbbb8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:50.555075 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1845d12e-e420-452c-9cc8-d816d0dcbbb8 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1683 microversion: 2.1 time: 0.158953 Jul 20 05:37:50.555686 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3718/7538] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:50 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:38:22.775946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-423f7643-7a3c-485c-84e2-d2aba321b3b9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:22.776923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-423f7643-7a3c-485c-84e2-d2aba321b3b9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:22.779664 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=14 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:22.780454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=40 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:22.790608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-423f7643-7a3c-485c-84e2-d2aba321b3b9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:22.791073 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-423f7643-7a3c-485c-84e2-d2aba321b3b9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:22.791885 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-423f7643-7a3c-485c-84e2-d2aba321b3b9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:22.792345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-423f7643-7a3c-485c-84e2-d2aba321b3b9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:22.846119 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-423f7643-7a3c-485c-84e2-d2aba321b3b9 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1/action" status: 200 len: 62983 microversion: 2.1 time: 0.074011 Jul 20 05:38:22.846824 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3821/7539] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:38:22 2022] POST /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1/action => generated 62983 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:38:35.719879 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:38:35.720642 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:38:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:38:37.318895 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:38:37.319571 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:38:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:38:46.387618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-49561103-3879-47f7-94ce-d32b0668a55d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:46.388927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-49561103-3879-47f7-94ce-d32b0668a55d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:46.390511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-4601dd98-9601-4175-8702-ff1bf7d042ff req-1534d4f5-5527-4112-ab23-029edcfccf8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1", "tag": "299040a1-4213-413a-b788-2573e7003602"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:46.391108 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=16 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:46.391793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:46.397720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49561103-3879-47f7-94ce-d32b0668a55d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:46.398100 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:46.398419 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49561103-3879-47f7-94ce-d32b0668a55d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:46.399279 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:46.399413 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49561103-3879-47f7-94ce-d32b0668a55d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:46.399868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-49561103-3879-47f7-94ce-d32b0668a55d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:46.405526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4601dd98-9601-4175-8702-ff1bf7d042ff req-1534d4f5-5527-4112-ab23-029edcfccf8e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:46.406366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-4601dd98-9601-4175-8702-ff1bf7d042ff req-1534d4f5-5527-4112-ab23-029edcfccf8e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:46.419208 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-4601dd98-9601-4175-8702-ff1bf7d042ff req-1534d4f5-5527-4112-ab23-029edcfccf8e service nova] Creating event network-changed:299040a1-4213-413a-b788-2573e7003602 for instance 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 on n-h1-764485-11 Jul 20 05:38:46.425513 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-4601dd98-9601-4175-8702-ff1bf7d042ff req-1534d4f5-5527-4112-ab23-029edcfccf8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039660 Jul 20 05:38:46.426230 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3822/7540] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:38:46.434931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-49561103-3879-47f7-94ce-d32b0668a55d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:38:46.523952 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-49561103-3879-47f7-94ce-d32b0668a55d tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 204 len: 0 microversion: 2.1 time: 0.140167 Jul 20 05:38:46.525122 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3719/7541] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:38:46 2022] DELETE /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:38:46.535293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a20f4f0c-cb39-45d8-ac72-734093662c15 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:46.536050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a20f4f0c-cb39-45d8-ac72-734093662c15 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:46.542245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a20f4f0c-cb39-45d8-ac72-734093662c15 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:46.542717 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a20f4f0c-cb39-45d8-ac72-734093662c15 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:46.543593 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a20f4f0c-cb39-45d8-ac72-734093662c15 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:46.544055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a20f4f0c-cb39-45d8-ac72-734093662c15 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:46.689852 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a20f4f0c-cb39-45d8-ac72-734093662c15 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:38:46.697418 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a20f4f0c-cb39-45d8-ac72-734093662c15 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1689 microversion: 2.1 time: 0.167382 Jul 20 05:38:46.697994 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3823/7542] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:46 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:38:47.715805 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-afece23a-e9fb-4e60-877d-6f0996a85749 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:47.716442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-afece23a-e9fb-4e60-877d-6f0996a85749 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:47.724180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-afece23a-e9fb-4e60-877d-6f0996a85749 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:47.724630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-afece23a-e9fb-4e60-877d-6f0996a85749 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:47.725394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-afece23a-e9fb-4e60-877d-6f0996a85749 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:47.725832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-afece23a-e9fb-4e60-877d-6f0996a85749 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:47.862056 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-afece23a-e9fb-4e60-877d-6f0996a85749 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:38:47.869683 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-afece23a-e9fb-4e60-877d-6f0996a85749 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1689 microversion: 2.1 time: 0.158232 Jul 20 05:38:47.870253 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3720/7543] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:47 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:38:48.708014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-7032d649-a1ab-47d7-8e26-56fbb2dec5da req-3dd8b6cd-1a55-491e-a3f8-b6476c660857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1", "name": "network-vif-deleted", "tag": "299040a1-4213-413a-b788-2573e7003602"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:48.717409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7032d649-a1ab-47d7-8e26-56fbb2dec5da req-3dd8b6cd-1a55-491e-a3f8-b6476c660857 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:48.717878 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-7032d649-a1ab-47d7-8e26-56fbb2dec5da req-3dd8b6cd-1a55-491e-a3f8-b6476c660857 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:48.730125 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-7032d649-a1ab-47d7-8e26-56fbb2dec5da req-3dd8b6cd-1a55-491e-a3f8-b6476c660857 service nova] Creating event network-vif-deleted:299040a1-4213-413a-b788-2573e7003602 for instance 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 on n-h1-764485-11 Jul 20 05:38:48.735669 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-7032d649-a1ab-47d7-8e26-56fbb2dec5da req-3dd8b6cd-1a55-491e-a3f8-b6476c660857 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031277 Jul 20 05:38:48.736270 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3824/7544] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:38:48.888255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-20133f99-0857-407f-92c4-b1fdf130f07f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:48.888796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-20133f99-0857-407f-92c4-b1fdf130f07f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:48.896320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20133f99-0857-407f-92c4-b1fdf130f07f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:48.896772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20133f99-0857-407f-92c4-b1fdf130f07f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:48.897528 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20133f99-0857-407f-92c4-b1fdf130f07f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:48.897967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20133f99-0857-407f-92c4-b1fdf130f07f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:48.928756 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20133f99-0857-407f-92c4-b1fdf130f07f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:48.929134 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20133f99-0857-407f-92c4-b1fdf130f07f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:48.929582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-20133f99-0857-407f-92c4-b1fdf130f07f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lazy-loading 'fault' on Instance uuid 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:38:48.970493 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-20133f99-0857-407f-92c4-b1fdf130f07f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:38:48.978285 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-20133f99-0857-407f-92c4-b1fdf130f07f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 200 len: 1357 microversion: 2.1 time: 0.093922 Jul 20 05:38:48.978887 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3721/7545] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:48 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 1357 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:38:49.997339 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7479b256-e5a4-44ed-8e86-0d05c4adf200 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:49.998064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-7479b256-e5a4-44ed-8e86-0d05c4adf200 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:50.005583 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7479b256-e5a4-44ed-8e86-0d05c4adf200 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:50.006050 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7479b256-e5a4-44ed-8e86-0d05c4adf200 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:50.006824 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7479b256-e5a4-44ed-8e86-0d05c4adf200 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:50.007273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-7479b256-e5a4-44ed-8e86-0d05c4adf200 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:50.021408 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-7479b256-e5a4-44ed-8e86-0d05c4adf200 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] HTTP exception thrown: Instance 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 could not be found. Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7479b256-e5a4-44ed-8e86-0d05c4adf200 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Request method failure captured: Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 HTTP/1.1 Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi15KamC2cRSdG6cc1ZpK_W6-4pm4SSsmZr6uPX8TfqHE-OD_50sr_a7Oi5ok1Qt_YNwbNXDMsT5XuAk86tbRFGjGh8_epPTd9IQ1bBUJ3roPkWn_jJjxd5GlzLBxYNUDXktD7r9cw1LMU07SP6Pv33Fw3Zp33FJixOet7ASNRwAG65zs Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: d5022754d8de48cfb8ddf66fc6dbd3dd Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5022754d8de48cfb8ddf66fc6dbd3dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}] Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: d5022754d8de48cfb8ddf66fc6dbd3dd Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestNetworkAdvancedServerOps-1159726665-project Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 48a1bf5634564af2af0d1ca7c59672a5 Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1159726665-project Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 could not be found. Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1'} Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 could not be found. Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 could not be found. Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:38:50.023032 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:38:50.028121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:38:50.028121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:38:50.028121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:38:50.028121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:38:50.028121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:38:50.028121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:38:50.028121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 could not be found. Jul 20 05:38:50.028121 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:38:50.028121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-7479b256-e5a4-44ed-8e86-0d05c4adf200 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Returning 404 to user: Instance 2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:38:50.028121 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-7479b256-e5a4-44ed-8e86-0d05c4adf200 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1" status: 404 len: 111 microversion: 2.1 time: 0.032554 Jul 20 05:38:50.028121 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3825/7546] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:49 2022] GET /compute/v2.1/servers/2f3e33d8-711b-4fb5-9ad5-5ed22bf75da1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:38:53.318569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b34972d7-078b-4e4a-af59-44d5d6bdf128 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '.version_select at 0x7fbf9c40a160>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:53.344293 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b34972d7-078b-4e4a-af59-44d5d6bdf128 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1262528641" status: 202 len: 0 microversion: 2.1 time: 0.029628 Jul 20 05:38:53.344906 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3722/7547] 10.222.0.20 () {58 vars in 1283 bytes} [Wed Jul 20 05:38:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1262528641 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:38:53.379632 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-872ead5b-fc38-47ba-a155-7403eaf27d58 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'create', calling method: .version_select at 0x7fbf9c29e940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1740099059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHfGc6Puc7ZiN06dKpIF4bfbjL4DBwZTxsz7NaKDHcJ+Tvy1CDX/3LMelPk9gpncy8cocSTaxuPqJfRgu5uKIqaHAZjajW+ZHMjdv7VCTY6LPZOVpQZGBMWUClh9K1/7g=="}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:53.397547 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-872ead5b-fc38-47ba-a155-7403eaf27d58 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:38:53.403075 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-872ead5b-fc38-47ba-a155-7403eaf27d58 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for user 48a1bf5634564af2af0d1ca7c59672a5 and project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'key_pairs'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:38:53.430723 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-872ead5b-fc38-47ba-a155-7403eaf27d58 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055888 Jul 20 05:38:53.431326 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3826/7548] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:38:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:38:59.097147 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:59.102852 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-220802873", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "networks": [{"uuid": "567e72de-e1c0-4ea2-90ff-3a076764f670"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1740099059", "security_groups": [{"name": "tempest-secgroup-smoke-1702623"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:59.236113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] validate_networks() for [('567e72de-e1c0-4ea2-90ff-3a076764f670', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:38:59.714183 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:38:59.714618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:38:59.715156 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:38:59.715731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:38:59.716191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:38:59.726471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:59.726924 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:59.727764 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:59.728203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:59.746179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:38:59.752161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Getting quotas for user 48a1bf5634564af2af0d1ca7c59672a5 and project d5022754d8de48cfb8ddf66fc6dbd3dd. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:38:59.764920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:38:59.767209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:38:59.816580 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-fb4c435d-3740-4293-8bba-f194e27e3246 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.721581 Jul 20 05:38:59.822221 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3723/7549] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:38:59 2022] POST /compute/v2.1/servers => generated 403 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:38:59.828438 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-af5a2b54-3956-436d-9617-1639d6bfb62c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:38:59.829172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-af5a2b54-3956-436d-9617-1639d6bfb62c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:59.893799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-af5a2b54-3956-436d-9617-1639d6bfb62c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:38:59.902177 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-af5a2b54-3956-436d-9617-1639d6bfb62c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1266 microversion: 2.1 time: 0.078336 Jul 20 05:38:59.902752 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3827/7550] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:38:59 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:00.919382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-20150d27-64ab-4225-8add-140c5b700c81 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:00.920951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-20150d27-64ab-4225-8add-140c5b700c81 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:00.929582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20150d27-64ab-4225-8add-140c5b700c81 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:00.930314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20150d27-64ab-4225-8add-140c5b700c81 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:00.931342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20150d27-64ab-4225-8add-140c5b700c81 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:00.931975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-20150d27-64ab-4225-8add-140c5b700c81 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:01.012301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-20150d27-64ab-4225-8add-140c5b700c81 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:01.021028 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-20150d27-64ab-4225-8add-140c5b700c81 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1336 microversion: 2.1 time: 0.105461 Jul 20 05:39:01.021642 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3724/7551] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:00 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:02.038962 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bb3c769b-f3e8-4079-973c-56d15f6fc206 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:02.040314 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bb3c769b-f3e8-4079-973c-56d15f6fc206 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:02.052829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=12 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:39:02.059641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb3c769b-f3e8-4079-973c-56d15f6fc206 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:02.060980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb3c769b-f3e8-4079-973c-56d15f6fc206 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:02.062747 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb3c769b-f3e8-4079-973c-56d15f6fc206 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:02.063410 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bb3c769b-f3e8-4079-973c-56d15f6fc206 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:02.316692 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bb3c769b-f3e8-4079-973c-56d15f6fc206 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:02.335501 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bb3c769b-f3e8-4079-973c-56d15f6fc206 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1389 microversion: 2.1 time: 0.300868 Jul 20 05:39:02.337140 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3828/7552] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:02 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1389 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:02.588387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-eb5d33c0-b7ab-46ce-88a8-9012bf3ca9df req-08b72ca1-eae4-4e78-a714-c1207ee6c082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0176fb-71bd-49a5-a619-8cd1019213aa", "tag": "0ef17a23-1dbc-4ec8-9463-f174fd76e196"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:39:02.605503 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-eb5d33c0-b7ab-46ce-88a8-9012bf3ca9df req-08b72ca1-eae4-4e78-a714-c1207ee6c082 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:02.606051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-eb5d33c0-b7ab-46ce-88a8-9012bf3ca9df req-08b72ca1-eae4-4e78-a714-c1207ee6c082 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:02.619880 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-eb5d33c0-b7ab-46ce-88a8-9012bf3ca9df req-08b72ca1-eae4-4e78-a714-c1207ee6c082 service nova] Creating event network-changed:0ef17a23-1dbc-4ec8-9463-f174fd76e196 for instance 8d0176fb-71bd-49a5-a619-8cd1019213aa on n-h2-764485-11 Jul 20 05:39:02.626369 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-eb5d33c0-b7ab-46ce-88a8-9012bf3ca9df req-08b72ca1-eae4-4e78-a714-c1207ee6c082 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043187 Jul 20 05:39:02.627407 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3725/7553] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:39:03.353319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0f3ea535-f1bf-4313-90ac-7988f5307085 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:03.353946 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0f3ea535-f1bf-4313-90ac-7988f5307085 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:03.363329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f3ea535-f1bf-4313-90ac-7988f5307085 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:03.364338 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f3ea535-f1bf-4313-90ac-7988f5307085 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:03.365653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f3ea535-f1bf-4313-90ac-7988f5307085 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:03.366105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0f3ea535-f1bf-4313-90ac-7988f5307085 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:03.501355 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0f3ea535-f1bf-4313-90ac-7988f5307085 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:03.508821 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0f3ea535-f1bf-4313-90ac-7988f5307085 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1389 microversion: 2.1 time: 0.159701 Jul 20 05:39:03.509383 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3829/7554] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:03 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:04.527683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-320af868-c71e-4986-a911-94906ddc06df tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:04.528385 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-320af868-c71e-4986-a911-94906ddc06df tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:04.535473 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-320af868-c71e-4986-a911-94906ddc06df tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:04.535955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-320af868-c71e-4986-a911-94906ddc06df tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:04.536744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-320af868-c71e-4986-a911-94906ddc06df tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:04.537188 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-320af868-c71e-4986-a911-94906ddc06df tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:04.676611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-320af868-c71e-4986-a911-94906ddc06df tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:04.684732 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-320af868-c71e-4986-a911-94906ddc06df tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1389 microversion: 2.1 time: 0.162258 Jul 20 05:39:04.685332 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3726/7555] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:04 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:05.704004 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5d233eb8-e279-4094-b182-0c6344f4dc1e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:05.704639 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5d233eb8-e279-4094-b182-0c6344f4dc1e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:05.711658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d233eb8-e279-4094-b182-0c6344f4dc1e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:05.712011 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d233eb8-e279-4094-b182-0c6344f4dc1e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:05.712792 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d233eb8-e279-4094-b182-0c6344f4dc1e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:05.713382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5d233eb8-e279-4094-b182-0c6344f4dc1e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:05.924900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5d233eb8-e279-4094-b182-0c6344f4dc1e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:05.932395 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5d233eb8-e279-4094-b182-0c6344f4dc1e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1389 microversion: 2.1 time: 0.232995 Jul 20 05:39:05.932992 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3830/7556] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:05 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1389 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:06.949588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7dfb7581-7af5-486d-9aa7-68a02a1135cd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:06.950209 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7dfb7581-7af5-486d-9aa7-68a02a1135cd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:06.957920 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dfb7581-7af5-486d-9aa7-68a02a1135cd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:06.958382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dfb7581-7af5-486d-9aa7-68a02a1135cd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:06.959151 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dfb7581-7af5-486d-9aa7-68a02a1135cd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:06.959629 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7dfb7581-7af5-486d-9aa7-68a02a1135cd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:07.094534 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7dfb7581-7af5-486d-9aa7-68a02a1135cd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:07.102012 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7dfb7581-7af5-486d-9aa7-68a02a1135cd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1389 microversion: 2.1 time: 0.156286 Jul 20 05:39:07.102586 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3727/7557] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:06 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:08.118289 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-cc1f65fb-d857-4fc2-b1e0-625dbbbe2c85 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:08.118909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-cc1f65fb-d857-4fc2-b1e0-625dbbbe2c85 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:08.126744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc1f65fb-d857-4fc2-b1e0-625dbbbe2c85 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:08.127207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc1f65fb-d857-4fc2-b1e0-625dbbbe2c85 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:08.128008 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc1f65fb-d857-4fc2-b1e0-625dbbbe2c85 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:08.128458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-cc1f65fb-d857-4fc2-b1e0-625dbbbe2c85 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:08.259199 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-cc1f65fb-d857-4fc2-b1e0-625dbbbe2c85 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:08.268195 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-cc1f65fb-d857-4fc2-b1e0-625dbbbe2c85 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1389 microversion: 2.1 time: 0.153917 Jul 20 05:39:08.268772 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3831/7558] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:08 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:09.284841 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b2212657-bce7-47eb-a076-760b7f0a89d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:09.285434 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b2212657-bce7-47eb-a076-760b7f0a89d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:09.292472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2212657-bce7-47eb-a076-760b7f0a89d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:09.292925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2212657-bce7-47eb-a076-760b7f0a89d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:09.293691 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2212657-bce7-47eb-a076-760b7f0a89d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:09.294130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2212657-bce7-47eb-a076-760b7f0a89d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:09.427366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b2212657-bce7-47eb-a076-760b7f0a89d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:09.434836 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b2212657-bce7-47eb-a076-760b7f0a89d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1389 microversion: 2.1 time: 0.153872 Jul 20 05:39:09.435415 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3728/7559] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:09 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:10.452585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b78c848c-b82f-4fb6-8540-a063785b4fda tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:10.453252 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b78c848c-b82f-4fb6-8540-a063785b4fda tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:10.455681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:39:10.461235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b78c848c-b82f-4fb6-8540-a063785b4fda tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:10.461700 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b78c848c-b82f-4fb6-8540-a063785b4fda tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:10.462479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b78c848c-b82f-4fb6-8540-a063785b4fda tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:10.462935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b78c848c-b82f-4fb6-8540-a063785b4fda tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:10.601318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b78c848c-b82f-4fb6-8540-a063785b4fda tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:10.609579 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b78c848c-b82f-4fb6-8540-a063785b4fda tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1389 microversion: 2.1 time: 0.161318 Jul 20 05:39:10.610170 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3832/7560] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:10 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:10.750409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:39:10.751178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:39:10.884719 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-1bef6011-7f9b-4859-a98a-85d9dca3b598 req-13893bd8-4401-4e71-ad36-71e5f7d8a537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0176fb-71bd-49a5-a619-8cd1019213aa", "name": "network-vif-plugged", "status": "completed", "tag": "0ef17a23-1dbc-4ec8-9463-f174fd76e196"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:39:10.893729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1bef6011-7f9b-4859-a98a-85d9dca3b598 req-13893bd8-4401-4e71-ad36-71e5f7d8a537 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:10.894102 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-1bef6011-7f9b-4859-a98a-85d9dca3b598 req-13893bd8-4401-4e71-ad36-71e5f7d8a537 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:10.905665 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-1bef6011-7f9b-4859-a98a-85d9dca3b598 req-13893bd8-4401-4e71-ad36-71e5f7d8a537 service nova] Creating event network-vif-plugged:0ef17a23-1dbc-4ec8-9463-f174fd76e196 for instance 8d0176fb-71bd-49a5-a619-8cd1019213aa on n-h2-764485-11 Jul 20 05:39:10.910731 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-1bef6011-7f9b-4859-a98a-85d9dca3b598 req-13893bd8-4401-4e71-ad36-71e5f7d8a537 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166189 Jul 20 05:39:10.911329 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3729/7561] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:39:11.626445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8391f6c0-b9d4-4b41-a631-37c81d073768 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:11.627063 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8391f6c0-b9d4-4b41-a631-37c81d073768 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:11.634003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8391f6c0-b9d4-4b41-a631-37c81d073768 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:11.634464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8391f6c0-b9d4-4b41-a631-37c81d073768 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:11.635233 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8391f6c0-b9d4-4b41-a631-37c81d073768 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:11.635714 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8391f6c0-b9d4-4b41-a631-37c81d073768 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:11.774856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8391f6c0-b9d4-4b41-a631-37c81d073768 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:11.782594 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8391f6c0-b9d4-4b41-a631-37c81d073768 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1389 microversion: 2.1 time: 0.160098 Jul 20 05:39:11.783168 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3833/7562] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:11 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:12.800887 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-77377f07-0612-4c2c-922a-93d938153c48 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:12.801595 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-77377f07-0612-4c2c-922a-93d938153c48 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:12.807908 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77377f07-0612-4c2c-922a-93d938153c48 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:12.808363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77377f07-0612-4c2c-922a-93d938153c48 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:12.809128 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77377f07-0612-4c2c-922a-93d938153c48 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:12.809573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77377f07-0612-4c2c-922a-93d938153c48 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:12.941599 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-77377f07-0612-4c2c-922a-93d938153c48 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:12.949185 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-77377f07-0612-4c2c-922a-93d938153c48 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1561 microversion: 2.1 time: 0.153487 Jul 20 05:39:12.949758 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3730/7563] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:12 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:12.965759 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a0dc334-43a0-4f46-a7ff-c37d3f516947 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:12.966389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a0dc334-43a0-4f46-a7ff-c37d3f516947 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:12.974584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a0dc334-43a0-4f46-a7ff-c37d3f516947 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:12.975055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a0dc334-43a0-4f46-a7ff-c37d3f516947 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:12.975868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a0dc334-43a0-4f46-a7ff-c37d3f516947 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:12.976325 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a0dc334-43a0-4f46-a7ff-c37d3f516947 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:13.116251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5a0dc334-43a0-4f46-a7ff-c37d3f516947 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:13.124108 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a0dc334-43a0-4f46-a7ff-c37d3f516947 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1561 microversion: 2.1 time: 0.162242 Jul 20 05:39:13.124676 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3834/7564] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:12 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:14.718865 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-1349a36d-d861-410e-975e-a4f075a2c61a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:14.719886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-1349a36d-d861-410e-975e-a4f075a2c61a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:14.720685 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-8917457b-21e1-415f-8c03-da1598676d09 req-86d40e30-34ab-49df-a29e-cba48ee95a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0176fb-71bd-49a5-a619-8cd1019213aa", "tag": "0ef17a23-1dbc-4ec8-9463-f174fd76e196"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:39:14.726932 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1349a36d-d861-410e-975e-a4f075a2c61a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:14.727394 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1349a36d-d861-410e-975e-a4f075a2c61a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:14.728216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1349a36d-d861-410e-975e-a4f075a2c61a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:14.728927 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-1349a36d-d861-410e-975e-a4f075a2c61a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:14.729749 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-8917457b-21e1-415f-8c03-da1598676d09 req-86d40e30-34ab-49df-a29e-cba48ee95a38 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:14.730434 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-8917457b-21e1-415f-8c03-da1598676d09 req-86d40e30-34ab-49df-a29e-cba48ee95a38 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:14.743249 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-8917457b-21e1-415f-8c03-da1598676d09 req-86d40e30-34ab-49df-a29e-cba48ee95a38 service nova] Creating event network-changed:0ef17a23-1dbc-4ec8-9463-f174fd76e196 for instance 8d0176fb-71bd-49a5-a619-8cd1019213aa on n-h2-764485-11 Jul 20 05:39:14.750506 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-8917457b-21e1-415f-8c03-da1598676d09 req-86d40e30-34ab-49df-a29e-cba48ee95a38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033987 Jul 20 05:39:14.751866 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3835/7565] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:39:14.957162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-1349a36d-d861-410e-975e-a4f075a2c61a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:14.965634 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-1349a36d-d861-410e-975e-a4f075a2c61a tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1561 microversion: 2.1 time: 0.251856 Jul 20 05:39:14.966531 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3731/7566] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:14 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1561 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:48.243117 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:39:48.243901 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=44 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:39:48.302915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-70f36fde-ea70-44bc-87bf-afa158b9095e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:39:48.304069 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-70f36fde-ea70-44bc-87bf-afa158b9095e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:48.310395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70f36fde-ea70-44bc-87bf-afa158b9095e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:48.310859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70f36fde-ea70-44bc-87bf-afa158b9095e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:48.312281 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70f36fde-ea70-44bc-87bf-afa158b9095e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:48.312939 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-70f36fde-ea70-44bc-87bf-afa158b9095e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:48.377356 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-70f36fde-ea70-44bc-87bf-afa158b9095e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa/action" status: 200 len: 24571 microversion: 2.1 time: 0.136306 Jul 20 05:39:48.378023 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3836/7567] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:39:48 2022] POST /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa/action => generated 24571 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:40:18.848335 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:40:18.849104 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=42 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:40:18.853748 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e53a4336-05a3-40d2-9a72-7980ed1e95f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:40:18.854294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e53a4336-05a3-40d2-9a72-7980ed1e95f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:18.862737 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e53a4336-05a3-40d2-9a72-7980ed1e95f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:18.863200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e53a4336-05a3-40d2-9a72-7980ed1e95f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:18.864012 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e53a4336-05a3-40d2-9a72-7980ed1e95f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:18.864456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e53a4336-05a3-40d2-9a72-7980ed1e95f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:18.900364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-e53a4336-05a3-40d2-9a72-7980ed1e95f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lazy-loading 'flavor' on Instance uuid 8d0176fb-71bd-49a5-a619-8cd1019213aa {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:40:18.991215 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e53a4336-05a3-40d2-9a72-7980ed1e95f1 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa/action" status: 202 len: 0 microversion: 2.1 time: 0.144614 Jul 20 05:40:18.995051 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3732/7568] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:40:18 2022] POST /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:40:19.002502 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-00b0c11f-3b03-4a56-bc30-c10be988748f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:19.003237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-00b0c11f-3b03-4a56-bc30-c10be988748f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:19.005847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:40:19.006535 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=4 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:40:19.012988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00b0c11f-3b03-4a56-bc30-c10be988748f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:19.013441 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00b0c11f-3b03-4a56-bc30-c10be988748f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:19.014636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00b0c11f-3b03-4a56-bc30-c10be988748f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:19.015013 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00b0c11f-3b03-4a56-bc30-c10be988748f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:19.162728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-00b0c11f-3b03-4a56-bc30-c10be988748f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:19.171461 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-00b0c11f-3b03-4a56-bc30-c10be988748f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1688 microversion: 2.1 time: 0.174841 Jul 20 05:40:19.172055 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3837/7569] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:18 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:40:20.191334 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2cdfd2f6-39d3-4464-8645-5d106886d27b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:20.192071 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2cdfd2f6-39d3-4464-8645-5d106886d27b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:20.198429 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cdfd2f6-39d3-4464-8645-5d106886d27b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:20.198885 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cdfd2f6-39d3-4464-8645-5d106886d27b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:20.199681 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cdfd2f6-39d3-4464-8645-5d106886d27b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:20.200126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2cdfd2f6-39d3-4464-8645-5d106886d27b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:20.340886 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2cdfd2f6-39d3-4464-8645-5d106886d27b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:20.349545 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2cdfd2f6-39d3-4464-8645-5d106886d27b tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1688 microversion: 2.1 time: 0.163430 Jul 20 05:40:20.350165 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3733/7570] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:20 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:21.367317 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-442ae93a-bb88-4041-b7a5-ac6cfd55d13e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:21.368026 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-442ae93a-bb88-4041-b7a5-ac6cfd55d13e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:21.376173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-442ae93a-bb88-4041-b7a5-ac6cfd55d13e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:21.376635 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-442ae93a-bb88-4041-b7a5-ac6cfd55d13e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:21.377404 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-442ae93a-bb88-4041-b7a5-ac6cfd55d13e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:21.377854 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-442ae93a-bb88-4041-b7a5-ac6cfd55d13e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:21.508868 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-442ae93a-bb88-4041-b7a5-ac6cfd55d13e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:21.516525 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-442ae93a-bb88-4041-b7a5-ac6cfd55d13e tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1671 microversion: 2.1 time: 0.153112 Jul 20 05:40:21.517089 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3838/7571] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:21 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:22.605891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4b010353-f108-47a6-8152-967a7562969c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:40:22.606846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4b010353-f108-47a6-8152-967a7562969c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:22.613995 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b010353-f108-47a6-8152-967a7562969c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:22.614451 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b010353-f108-47a6-8152-967a7562969c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:22.615230 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b010353-f108-47a6-8152-967a7562969c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:22.615706 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4b010353-f108-47a6-8152-967a7562969c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:22.676214 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4b010353-f108-47a6-8152-967a7562969c tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa/action" status: 200 len: 34999 microversion: 2.1 time: 0.074246 Jul 20 05:40:22.676901 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3734/7572] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:40:22 2022] POST /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa/action => generated 34999 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:40:22.691556 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c2f8b504-808c-4657-9aff-0f31b0d6effa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:40:22.692370 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c2f8b504-808c-4657-9aff-0f31b0d6effa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:22.699845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2f8b504-808c-4657-9aff-0f31b0d6effa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:22.700323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2f8b504-808c-4657-9aff-0f31b0d6effa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:22.701131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2f8b504-808c-4657-9aff-0f31b0d6effa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:22.701584 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c2f8b504-808c-4657-9aff-0f31b0d6effa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:22.785189 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c2f8b504-808c-4657-9aff-0f31b0d6effa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa/action" status: 202 len: 0 microversion: 2.1 time: 0.099073 Jul 20 05:40:22.785873 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3839/7573] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:40:22 2022] POST /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:40:22.797504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d061c57d-7eea-4e5d-9a76-ac102209acce tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:22.798301 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d061c57d-7eea-4e5d-9a76-ac102209acce tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:22.807306 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d061c57d-7eea-4e5d-9a76-ac102209acce tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:22.807809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d061c57d-7eea-4e5d-9a76-ac102209acce tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:22.808588 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d061c57d-7eea-4e5d-9a76-ac102209acce tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:22.809023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d061c57d-7eea-4e5d-9a76-ac102209acce tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:23.016724 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d061c57d-7eea-4e5d-9a76-ac102209acce tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:23.024313 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d061c57d-7eea-4e5d-9a76-ac102209acce tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1677 microversion: 2.1 time: 0.232661 Jul 20 05:40:23.035084 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3735/7574] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:22 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:24.043732 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-97bc7884-0d63-4793-975a-25c498a892d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:24.044476 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-97bc7884-0d63-4793-975a-25c498a892d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:24.050888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97bc7884-0d63-4793-975a-25c498a892d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:24.051357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97bc7884-0d63-4793-975a-25c498a892d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:24.052181 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97bc7884-0d63-4793-975a-25c498a892d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:24.052637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-97bc7884-0d63-4793-975a-25c498a892d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:24.187257 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-97bc7884-0d63-4793-975a-25c498a892d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:24.194859 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-97bc7884-0d63-4793-975a-25c498a892d2 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1677 microversion: 2.1 time: 0.156311 Jul 20 05:40:24.195430 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3840/7575] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:24 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:25.212905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-68bc8c5c-25be-4dc0-b1bd-01655f2fd663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:25.213527 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-68bc8c5c-25be-4dc0-b1bd-01655f2fd663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:25.220683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68bc8c5c-25be-4dc0-b1bd-01655f2fd663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:25.221141 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68bc8c5c-25be-4dc0-b1bd-01655f2fd663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:25.221921 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68bc8c5c-25be-4dc0-b1bd-01655f2fd663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:25.222368 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-68bc8c5c-25be-4dc0-b1bd-01655f2fd663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:25.356580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-68bc8c5c-25be-4dc0-b1bd-01655f2fd663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:25.364857 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-68bc8c5c-25be-4dc0-b1bd-01655f2fd663 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1680 microversion: 2.1 time: 0.155874 Jul 20 05:40:25.365442 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3736/7576] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:25 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:25.455178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ed637b75-1bec-4cf0-8410-adec5a209241 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:40:25.456078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ed637b75-1bec-4cf0-8410-adec5a209241 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:25.462980 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed637b75-1bec-4cf0-8410-adec5a209241 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:25.463443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed637b75-1bec-4cf0-8410-adec5a209241 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:25.464255 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed637b75-1bec-4cf0-8410-adec5a209241 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:25.464705 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ed637b75-1bec-4cf0-8410-adec5a209241 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:25.522697 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ed637b75-1bec-4cf0-8410-adec5a209241 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "POST /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa/action" status: 200 len: 34999 microversion: 2.1 time: 0.072114 Jul 20 05:40:25.523640 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3841/7577] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:40:25 2022] POST /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa/action => generated 34999 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:40:26.568149 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-01c5b940-1c9e-4035-a455-6c97f9195e7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:26.568741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-01c5b940-1c9e-4035-a455-6c97f9195e7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:26.572585 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-f8a00395-2107-40fb-877c-d28c547fdf4f req-302a7ff5-205e-4dde-813f-315c29c6b1ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0176fb-71bd-49a5-a619-8cd1019213aa", "tag": "0ef17a23-1dbc-4ec8-9463-f174fd76e196"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:40:26.575759 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01c5b940-1c9e-4035-a455-6c97f9195e7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:26.576221 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01c5b940-1c9e-4035-a455-6c97f9195e7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:26.577005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01c5b940-1c9e-4035-a455-6c97f9195e7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:26.577445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-01c5b940-1c9e-4035-a455-6c97f9195e7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:26.583899 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f8a00395-2107-40fb-877c-d28c547fdf4f req-302a7ff5-205e-4dde-813f-315c29c6b1ec service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:26.585000 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-f8a00395-2107-40fb-877c-d28c547fdf4f req-302a7ff5-205e-4dde-813f-315c29c6b1ec service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:26.598622 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-f8a00395-2107-40fb-877c-d28c547fdf4f req-302a7ff5-205e-4dde-813f-315c29c6b1ec service nova] Creating event network-changed:0ef17a23-1dbc-4ec8-9463-f174fd76e196 for instance 8d0176fb-71bd-49a5-a619-8cd1019213aa on n-h2-764485-11 Jul 20 05:40:26.604026 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-f8a00395-2107-40fb-877c-d28c547fdf4f req-302a7ff5-205e-4dde-813f-315c29c6b1ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036443 Jul 20 05:40:26.604726 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3842/7578] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:40:26.606689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-01c5b940-1c9e-4035-a455-6c97f9195e7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:40:26.702932 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-01c5b940-1c9e-4035-a455-6c97f9195e7f tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 204 len: 0 microversion: 2.1 time: 0.138212 Jul 20 05:40:26.703709 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3737/7579] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:40:26 2022] DELETE /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:40:26.713518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-ccd0d75c-6c75-4ae3-b689-6eae653d69fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:26.714258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-ccd0d75c-6c75-4ae3-b689-6eae653d69fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:26.722658 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ccd0d75c-6c75-4ae3-b689-6eae653d69fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:26.723114 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ccd0d75c-6c75-4ae3-b689-6eae653d69fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:26.723930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ccd0d75c-6c75-4ae3-b689-6eae653d69fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:26.724382 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-ccd0d75c-6c75-4ae3-b689-6eae653d69fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:26.943660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-ccd0d75c-6c75-4ae3-b689-6eae653d69fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:26.951574 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-ccd0d75c-6c75-4ae3-b689-6eae653d69fa tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1686 microversion: 2.1 time: 0.243108 Jul 20 05:40:26.952241 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3843/7580] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:26 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1686 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:27.973698 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-585ff237-6852-4a3c-997c-892ec330aadc tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:27.974309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-585ff237-6852-4a3c-997c-892ec330aadc tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:27.981191 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-585ff237-6852-4a3c-997c-892ec330aadc tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:27.981649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-585ff237-6852-4a3c-997c-892ec330aadc tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:27.983090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-585ff237-6852-4a3c-997c-892ec330aadc tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:27.983650 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-585ff237-6852-4a3c-997c-892ec330aadc tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:28.259567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-585ff237-6852-4a3c-997c-892ec330aadc tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:28.270691 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-585ff237-6852-4a3c-997c-892ec330aadc tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1686 microversion: 2.1 time: 0.301256 Jul 20 05:40:28.271759 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3738/7581] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:27 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1686 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:29.290598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b774f6be-46b7-4c0f-b5b8-22b53b25e848 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:29.291240 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b774f6be-46b7-4c0f-b5b8-22b53b25e848 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:29.292883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-877f4582-df7e-4678-91a3-395086ac034a req-b9ac2f24-8592-4d07-b056-726435c94e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0176fb-71bd-49a5-a619-8cd1019213aa", "name": "network-vif-deleted", "tag": "0ef17a23-1dbc-4ec8-9463-f174fd76e196"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:40:29.299869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b774f6be-46b7-4c0f-b5b8-22b53b25e848 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:29.300614 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b774f6be-46b7-4c0f-b5b8-22b53b25e848 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:29.301623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b774f6be-46b7-4c0f-b5b8-22b53b25e848 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:29.302545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b774f6be-46b7-4c0f-b5b8-22b53b25e848 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:29.304036 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-877f4582-df7e-4678-91a3-395086ac034a req-b9ac2f24-8592-4d07-b056-726435c94e21 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:29.304594 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-877f4582-df7e-4678-91a3-395086ac034a req-b9ac2f24-8592-4d07-b056-726435c94e21 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:29.327652 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-877f4582-df7e-4678-91a3-395086ac034a req-b9ac2f24-8592-4d07-b056-726435c94e21 service nova] Creating event network-vif-deleted:0ef17a23-1dbc-4ec8-9463-f174fd76e196 for instance 8d0176fb-71bd-49a5-a619-8cd1019213aa on n-h2-764485-11 Jul 20 05:40:29.334977 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-877f4582-df7e-4678-91a3-395086ac034a req-b9ac2f24-8592-4d07-b056-726435c94e21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045702 Jul 20 05:40:29.335878 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3739/7582] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:40:29.385397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b774f6be-46b7-4c0f-b5b8-22b53b25e848 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a1bf5634564af2af0d1ca7c59672a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5022754d8de48cfb8ddf66fc6dbd3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:29.394045 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b774f6be-46b7-4c0f-b5b8-22b53b25e848 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 200 len: 1502 microversion: 2.1 time: 0.107610 Jul 20 05:40:29.394630 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3844/7583] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:29 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 1502 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:30.412735 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0cbb4ce-3983-443d-958f-8c1c66102101 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:30.413462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e0cbb4ce-3983-443d-958f-8c1c66102101 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] [instance: 8d0176fb-71bd-49a5-a619-8cd1019213aa] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:30.420399 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0cbb4ce-3983-443d-958f-8c1c66102101 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:30.421010 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0cbb4ce-3983-443d-958f-8c1c66102101 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:30.421771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0cbb4ce-3983-443d-958f-8c1c66102101 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:30.422206 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0cbb4ce-3983-443d-958f-8c1c66102101 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:30.436125 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-e0cbb4ce-3983-443d-958f-8c1c66102101 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] HTTP exception thrown: Instance 8d0176fb-71bd-49a5-a619-8cd1019213aa could not be found. Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0cbb4ce-3983-443d-958f-8c1c66102101 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Request method failure captured: Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa HTTP/1.1 Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi15KamC2cRSdG6cc1ZpK_W6-4pm4SSsmZr6uPX8TfqHE-OD_50sr_a7Oi5ok1Qt_YNwbNXDMsT5XuAk86tbRFGjGh8_epPTd9IQ1bBUJ3roPkWn_jJjxd5GlzLBxYNUDXktD7r9cw1LMU07SP6Pv33Fw3Zp33FJixOet7ASNRwAG65zs Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: d5022754d8de48cfb8ddf66fc6dbd3dd Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5022754d8de48cfb8ddf66fc6dbd3dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5022754d8de48cfb8ddf66fc6dbd3dd"}]}] Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: d5022754d8de48cfb8ddf66fc6dbd3dd Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1159726665 Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestNetworkAdvancedServerOps-1159726665-project Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 48a1bf5634564af2af0d1ca7c59672a5 Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1159726665-project Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance 8d0176fb-71bd-49a5-a619-8cd1019213aa could not be found. Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': '8d0176fb-71bd-49a5-a619-8cd1019213aa'} Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d0176fb-71bd-49a5-a619-8cd1019213aa could not be found. Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d0176fb-71bd-49a5-a619-8cd1019213aa could not be found. Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:40:30.437720 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:40:30.442216 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:40:30.442216 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:40:30.442216 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:40:30.442216 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:40:30.442216 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:40:30.442216 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:40:30.442216 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d0176fb-71bd-49a5-a619-8cd1019213aa could not be found. Jul 20 05:40:30.442216 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:40:30.442216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0cbb4ce-3983-443d-958f-8c1c66102101 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Returning 404 to user: Instance 8d0176fb-71bd-49a5-a619-8cd1019213aa could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:40:30.442216 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e0cbb4ce-3983-443d-958f-8c1c66102101 tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa" status: 404 len: 111 microversion: 2.1 time: 0.031502 Jul 20 05:40:30.442216 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3740/7584] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:30 2022] GET /compute/v2.1/servers/8d0176fb-71bd-49a5-a619-8cd1019213aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:40:33.738545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b630136c-eb91-4324-b7eb-8685d74fddfd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] Calling method '.version_select at 0x7fbf8c6f5940>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:33.761679 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b630136c-eb91-4324-b7eb-8685d74fddfd tempest-TestNetworkAdvancedServerOps-1159726665 tempest-TestNetworkAdvancedServerOps-1159726665-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1740099059" status: 202 len: 0 microversion: 2.1 time: 0.026586 Jul 20 05:40:33.762642 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3845/7585] 10.222.0.20 () {58 vars in 1283 bytes} [Wed Jul 20 05:40:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1740099059 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:40:44.817879 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:40:44.819041 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:40:45.056082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6647c012-0977-488d-8b00-eaf6cfde3478 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Action: 'create', calling method: .version_select at 0x7fbf8ffcd4c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-663951618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcHxKrFVnlyB1gqqx+4j5hUiYDwpamzOkUIMGrawNX/605joMX7XJHKHdGFxW1m3JzJJQoadRwFJv0/6Tgcew4D9+Q5pJZbtHqHHbSz2z5orFe5nJsT6df60dLFxuRS/Q=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:40:45.071123 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-6647c012-0977-488d-8b00-eaf6cfde3478 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Getting quotas for project 1e4867d0794645a5b92fcc63bf141b83. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:40:45.076862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-6647c012-0977-488d-8b00-eaf6cfde3478 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Getting quotas for user 591f755cb7cf4eec9aca672b661cf8ff and project 1e4867d0794645a5b92fcc63bf141b83. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:40:45.102864 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6647c012-0977-488d-8b00-eaf6cfde3478 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.290841 Jul 20 05:40:45.103745 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3741/7586] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:40:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:40:46.156577 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-303362206", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-663951618", "security_groups": [{"name": "tempest-secgroup-smoke-1541022191"}], "networks": [{"uuid": "9c7664b0-aa4d-4260-b2e4-625f7cf15d26"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:40:46.165017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:40:46.165686 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:40:46.278158 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] validate_networks() for [('9c7664b0-aa4d-4260-b2e4-625f7cf15d26', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:40:46.759196 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:40:46.759665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:40:46.760164 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:40:46.760803 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:40:46.761241 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:40:46.772892 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:46.773753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:46.774592 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:46.775426 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:46.800006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Getting quotas for project 1e4867d0794645a5b92fcc63bf141b83. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:40:46.805661 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Getting quotas for user 591f755cb7cf4eec9aca672b661cf8ff and project 1e4867d0794645a5b92fcc63bf141b83. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:40:46.820198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:40:46.822552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:40:46.882141 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-525315e8-c09f-4092-bfa0-f769924c39b5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730052 Jul 20 05:40:46.882841 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3846/7587] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:40:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:40:46.894172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4718836b-9771-4a0d-83cb-028729c027f2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:46.896580 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4718836b-9771-4a0d-83cb-028729c027f2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:46.990299 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4718836b-9771-4a0d-83cb-028729c027f2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:47.002898 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4718836b-9771-4a0d-83cb-028729c027f2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1245 microversion: 2.1 time: 0.113588 Jul 20 05:40:47.003487 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3742/7588] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:46 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:40:48.020222 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6c992140-68c0-414a-9e6d-0ad01542abcd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:48.030881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6c992140-68c0-414a-9e6d-0ad01542abcd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:48.039416 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c992140-68c0-414a-9e6d-0ad01542abcd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:48.039911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c992140-68c0-414a-9e6d-0ad01542abcd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:48.040728 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c992140-68c0-414a-9e6d-0ad01542abcd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:48.041357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6c992140-68c0-414a-9e6d-0ad01542abcd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:48.110707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6c992140-68c0-414a-9e6d-0ad01542abcd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:48.117988 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6c992140-68c0-414a-9e6d-0ad01542abcd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1303 microversion: 2.1 time: 0.101784 Jul 20 05:40:48.118576 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3847/7589] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:48 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:49.137324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6e7a9eca-eb7f-47a7-b4be-bab2e05c635a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:49.138270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6e7a9eca-eb7f-47a7-b4be-bab2e05c635a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:49.146490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6e7a9eca-eb7f-47a7-b4be-bab2e05c635a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:49.146861 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6e7a9eca-eb7f-47a7-b4be-bab2e05c635a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:49.148040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6e7a9eca-eb7f-47a7-b4be-bab2e05c635a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:49.148828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6e7a9eca-eb7f-47a7-b4be-bab2e05c635a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:49.401796 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6e7a9eca-eb7f-47a7-b4be-bab2e05c635a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:49.414620 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6e7a9eca-eb7f-47a7-b4be-bab2e05c635a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1371 microversion: 2.1 time: 0.281498 Jul 20 05:40:49.417646 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3743/7590] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:49 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:40:49.659383 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-439ef5c0-ce54-48e3-8b71-0debaa85eb13 req-47e3aaea-72fb-4b63-8ce4-a26bdc152f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9d712ce-903d-4604-a9aa-98df3d168aa9", "tag": "4772971f-ccc8-4d4a-b392-3d6d75109089"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:40:49.676420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-439ef5c0-ce54-48e3-8b71-0debaa85eb13 req-47e3aaea-72fb-4b63-8ce4-a26bdc152f78 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:49.677237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-439ef5c0-ce54-48e3-8b71-0debaa85eb13 req-47e3aaea-72fb-4b63-8ce4-a26bdc152f78 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:49.700734 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-439ef5c0-ce54-48e3-8b71-0debaa85eb13 req-47e3aaea-72fb-4b63-8ce4-a26bdc152f78 service nova] Creating event network-changed:4772971f-ccc8-4d4a-b392-3d6d75109089 for instance e9d712ce-903d-4604-a9aa-98df3d168aa9 on n-h1-764485-11 Jul 20 05:40:49.708955 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-439ef5c0-ce54-48e3-8b71-0debaa85eb13 req-47e3aaea-72fb-4b63-8ce4-a26bdc152f78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054863 Jul 20 05:40:49.709783 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3848/7591] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:40:50.431944 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-799afedd-ecee-4fcf-9a5a-896ef6e5ef36 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:50.432726 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-799afedd-ecee-4fcf-9a5a-896ef6e5ef36 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:50.440786 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-799afedd-ecee-4fcf-9a5a-896ef6e5ef36 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:50.441317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-799afedd-ecee-4fcf-9a5a-896ef6e5ef36 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:50.442414 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-799afedd-ecee-4fcf-9a5a-896ef6e5ef36 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:50.442922 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-799afedd-ecee-4fcf-9a5a-896ef6e5ef36 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:50.577353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-799afedd-ecee-4fcf-9a5a-896ef6e5ef36 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:50.585253 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-799afedd-ecee-4fcf-9a5a-896ef6e5ef36 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1371 microversion: 2.1 time: 0.157008 Jul 20 05:40:50.586035 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3744/7592] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:50 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:51.605078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c44fff49-fdff-4dfa-9cb1-ba4f0d1b9cdc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:51.605793 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c44fff49-fdff-4dfa-9cb1-ba4f0d1b9cdc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:51.612145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c44fff49-fdff-4dfa-9cb1-ba4f0d1b9cdc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:51.612609 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c44fff49-fdff-4dfa-9cb1-ba4f0d1b9cdc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:51.613381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c44fff49-fdff-4dfa-9cb1-ba4f0d1b9cdc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:51.613835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c44fff49-fdff-4dfa-9cb1-ba4f0d1b9cdc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:51.744590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c44fff49-fdff-4dfa-9cb1-ba4f0d1b9cdc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:51.752658 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c44fff49-fdff-4dfa-9cb1-ba4f0d1b9cdc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1371 microversion: 2.1 time: 0.152725 Jul 20 05:40:51.753241 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3849/7593] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:51 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:52.769993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-77fe06ca-601b-4c48-875a-e579ee3d9ee9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:52.770602 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-77fe06ca-601b-4c48-875a-e579ee3d9ee9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:52.777297 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77fe06ca-601b-4c48-875a-e579ee3d9ee9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:52.777762 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77fe06ca-601b-4c48-875a-e579ee3d9ee9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:52.779072 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77fe06ca-601b-4c48-875a-e579ee3d9ee9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:52.779519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-77fe06ca-601b-4c48-875a-e579ee3d9ee9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:52.909688 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-77fe06ca-601b-4c48-875a-e579ee3d9ee9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:52.917303 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-77fe06ca-601b-4c48-875a-e579ee3d9ee9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1371 microversion: 2.1 time: 0.151389 Jul 20 05:40:52.917890 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3745/7594] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:52 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:53.934116 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-d81c6e7f-6180-467a-96a6-d2143b8b354e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:53.936536 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-d81c6e7f-6180-467a-96a6-d2143b8b354e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:53.943710 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81c6e7f-6180-467a-96a6-d2143b8b354e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:53.944286 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81c6e7f-6180-467a-96a6-d2143b8b354e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:53.945145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81c6e7f-6180-467a-96a6-d2143b8b354e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:53.945610 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-d81c6e7f-6180-467a-96a6-d2143b8b354e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:54.089346 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-d81c6e7f-6180-467a-96a6-d2143b8b354e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:54.097756 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-d81c6e7f-6180-467a-96a6-d2143b8b354e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1371 microversion: 2.1 time: 0.167603 Jul 20 05:40:54.098398 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3850/7595] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:53 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:55.114752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-0597a1ff-a6d7-4f03-8103-424ebe236460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:55.115361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-0597a1ff-a6d7-4f03-8103-424ebe236460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:55.122663 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0597a1ff-a6d7-4f03-8103-424ebe236460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:55.123112 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0597a1ff-a6d7-4f03-8103-424ebe236460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:55.123905 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0597a1ff-a6d7-4f03-8103-424ebe236460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:55.124372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-0597a1ff-a6d7-4f03-8103-424ebe236460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:55.263241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-0597a1ff-a6d7-4f03-8103-424ebe236460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:55.270950 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-0597a1ff-a6d7-4f03-8103-424ebe236460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1371 microversion: 2.1 time: 0.160140 Jul 20 05:40:55.271555 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3746/7596] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:55 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:56.042670 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-0c2d590c-1e2d-4806-80f3-cfa650712abd req-10eba4d6-2d93-4c9f-bef9-ba449e16059d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d712ce-903d-4604-a9aa-98df3d168aa9", "name": "network-vif-plugged", "status": "completed", "tag": "4772971f-ccc8-4d4a-b392-3d6d75109089"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:40:56.053507 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0c2d590c-1e2d-4806-80f3-cfa650712abd req-10eba4d6-2d93-4c9f-bef9-ba449e16059d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:56.053974 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-0c2d590c-1e2d-4806-80f3-cfa650712abd req-10eba4d6-2d93-4c9f-bef9-ba449e16059d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:56.069051 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-0c2d590c-1e2d-4806-80f3-cfa650712abd req-10eba4d6-2d93-4c9f-bef9-ba449e16059d service nova] Creating event network-vif-plugged:4772971f-ccc8-4d4a-b392-3d6d75109089 for instance e9d712ce-903d-4604-a9aa-98df3d168aa9 on n-h1-764485-11 Jul 20 05:40:56.074117 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-0c2d590c-1e2d-4806-80f3-cfa650712abd req-10eba4d6-2d93-4c9f-bef9-ba449e16059d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035178 Jul 20 05:40:56.074745 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3851/7597] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:40:56.287849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7536ad97-7397-4557-99b3-48e8e819f39f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:56.288507 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7536ad97-7397-4557-99b3-48e8e819f39f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:56.296023 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7536ad97-7397-4557-99b3-48e8e819f39f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:56.296477 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7536ad97-7397-4557-99b3-48e8e819f39f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:56.297235 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7536ad97-7397-4557-99b3-48e8e819f39f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:56.297674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7536ad97-7397-4557-99b3-48e8e819f39f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:56.437332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7536ad97-7397-4557-99b3-48e8e819f39f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:56.444932 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7536ad97-7397-4557-99b3-48e8e819f39f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1371 microversion: 2.1 time: 0.161145 Jul 20 05:40:56.445531 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3747/7598] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:56 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:57.459003 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:40:57.459748 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:40:57.465163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b5550288-3d4a-4e60-aa56-1746d1eb5921 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:57.465891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b5550288-3d4a-4e60-aa56-1746d1eb5921 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:57.473119 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5550288-3d4a-4e60-aa56-1746d1eb5921 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:57.473591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5550288-3d4a-4e60-aa56-1746d1eb5921 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:57.474372 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5550288-3d4a-4e60-aa56-1746d1eb5921 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:57.474828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b5550288-3d4a-4e60-aa56-1746d1eb5921 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:57.615249 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b5550288-3d4a-4e60-aa56-1746d1eb5921 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:57.623757 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b5550288-3d4a-4e60-aa56-1746d1eb5921 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1371 microversion: 2.1 time: 0.165765 Jul 20 05:40:57.624336 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3852/7599] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:57 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:58.641469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-34ca715d-6cca-47ec-af1c-4c38d13b7dd0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:58.642084 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-34ca715d-6cca-47ec-af1c-4c38d13b7dd0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:58.643972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:40:58.650037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34ca715d-6cca-47ec-af1c-4c38d13b7dd0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:58.650488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34ca715d-6cca-47ec-af1c-4c38d13b7dd0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:58.651255 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34ca715d-6cca-47ec-af1c-4c38d13b7dd0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:58.651728 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-34ca715d-6cca-47ec-af1c-4c38d13b7dd0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:58.796495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-34ca715d-6cca-47ec-af1c-4c38d13b7dd0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:58.804094 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-34ca715d-6cca-47ec-af1c-4c38d13b7dd0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1555 microversion: 2.1 time: 0.167154 Jul 20 05:40:58.804667 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3748/7600] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:58 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:40:58.820464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c3b3b1d2-8e9e-44f8-b15c-cd51ebb39631 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:40:58.821130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c3b3b1d2-8e9e-44f8-b15c-cd51ebb39631 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:40:58.828165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3b3b1d2-8e9e-44f8-b15c-cd51ebb39631 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:58.828638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3b3b1d2-8e9e-44f8-b15c-cd51ebb39631 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:58.829412 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3b3b1d2-8e9e-44f8-b15c-cd51ebb39631 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:40:58.829865 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c3b3b1d2-8e9e-44f8-b15c-cd51ebb39631 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:40:58.960936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c3b3b1d2-8e9e-44f8-b15c-cd51ebb39631 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:40:58.968999 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c3b3b1d2-8e9e-44f8-b15c-cd51ebb39631 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1555 microversion: 2.1 time: 0.152458 Jul 20 05:40:58.969572 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3853/7601] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:40:58 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:41:00.914703 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e6138e6c-ef91-4f33-b005-a06b9f6db295 req-cc4a8a31-c06e-437b-8f85-47f101838c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9d712ce-903d-4604-a9aa-98df3d168aa9", "tag": "4772971f-ccc8-4d4a-b392-3d6d75109089"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:41:00.924555 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e6138e6c-ef91-4f33-b005-a06b9f6db295 req-cc4a8a31-c06e-437b-8f85-47f101838c0f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:41:00.925098 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e6138e6c-ef91-4f33-b005-a06b9f6db295 req-cc4a8a31-c06e-437b-8f85-47f101838c0f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:41:00.936898 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e6138e6c-ef91-4f33-b005-a06b9f6db295 req-cc4a8a31-c06e-437b-8f85-47f101838c0f service nova] Creating event network-changed:4772971f-ccc8-4d4a-b392-3d6d75109089 for instance e9d712ce-903d-4604-a9aa-98df3d168aa9 on n-h1-764485-11 Jul 20 05:41:00.942418 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e6138e6c-ef91-4f33-b005-a06b9f6db295 req-cc4a8a31-c06e-437b-8f85-47f101838c0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031363 Jul 20 05:41:00.943025 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3749/7602] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:41:56.883667 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:41:56.884275 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:41:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:43:27.054590 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7f015b8-ffde-4af0-8b21-123d24411373] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:43:27.056171 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4776198a-db9f-4da8-a9d3-98de639ffb43] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:43:27.057188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:43:27.058399 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=36 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:43:27.063580 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-00553638-26db-4554-a0e1-314ab71030ec tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:43:27.064134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-00553638-26db-4554-a0e1-314ab71030ec tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:27.071482 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00553638-26db-4554-a0e1-314ab71030ec tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:27.071968 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00553638-26db-4554-a0e1-314ab71030ec tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:27.072746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00553638-26db-4554-a0e1-314ab71030ec tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:27.073197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00553638-26db-4554-a0e1-314ab71030ec tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:27.096967 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-00553638-26db-4554-a0e1-314ab71030ec tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lazy-loading 'flavor' on Instance uuid e9d712ce-903d-4604-a9aa-98df3d168aa9 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:43:27.507326 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-00553638-26db-4554-a0e1-314ab71030ec tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "POST /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9/action" status: 202 len: 0 microversion: 2.1 time: 0.455292 Jul 20 05:43:27.507990 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3854/7603] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:43:27 2022] POST /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:43:27.518548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-156157be-a665-442b-8c6c-e00e8ab2f2b1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:27.519460 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-156157be-a665-442b-8c6c-e00e8ab2f2b1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:27.522319 n-d-764485-11 devstack@n-api.service[119807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a8eca7-3df2-4c6d-a372-7fc57edb945c] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:43:27.523416 n-d-764485-11 devstack@n-api.service[119807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [86bbcd4a-2dc6-48ea-bdc8-94fb9e64045f] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:43:27.524115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:43:27.525086 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=38 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:43:27.533846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-156157be-a665-442b-8c6c-e00e8ab2f2b1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:27.534298 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-156157be-a665-442b-8c6c-e00e8ab2f2b1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:27.535079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-156157be-a665-442b-8c6c-e00e8ab2f2b1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:27.535541 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-156157be-a665-442b-8c6c-e00e8ab2f2b1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:27.733002 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-156157be-a665-442b-8c6c-e00e8ab2f2b1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:27.740865 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-156157be-a665-442b-8c6c-e00e8ab2f2b1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1679 microversion: 2.1 time: 0.227403 Jul 20 05:43:27.741595 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3750/7604] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:27 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1679 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:28.764777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1d6653e5-8853-446f-bbfc-00af8425446d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:28.765501 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1d6653e5-8853-446f-bbfc-00af8425446d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:28.780216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d6653e5-8853-446f-bbfc-00af8425446d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:28.780682 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d6653e5-8853-446f-bbfc-00af8425446d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:28.781463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d6653e5-8853-446f-bbfc-00af8425446d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:28.781914 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1d6653e5-8853-446f-bbfc-00af8425446d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:28.782625 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7f015b8-ffde-4af0-8b21-123d24411373] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55048. Jul 20 05:43:28.783681 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] [4776198a-db9f-4da8-a9d3-98de639ffb43] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55050. Jul 20 05:43:28.919835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1d6653e5-8853-446f-bbfc-00af8425446d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:28.927539 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1d6653e5-8853-446f-bbfc-00af8425446d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1679 microversion: 2.1 time: 0.171139 Jul 20 05:43:28.928110 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3855/7605] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:28 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:29.945658 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a70d8e6e-21f8-4741-83db-dd8bf0c8d5a6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:29.946894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a70d8e6e-21f8-4741-83db-dd8bf0c8d5a6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:29.956360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a70d8e6e-21f8-4741-83db-dd8bf0c8d5a6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:29.956818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a70d8e6e-21f8-4741-83db-dd8bf0c8d5a6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:29.957589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a70d8e6e-21f8-4741-83db-dd8bf0c8d5a6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:29.958034 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a70d8e6e-21f8-4741-83db-dd8bf0c8d5a6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:29.966322 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a8eca7-3df2-4c6d-a372-7fc57edb945c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55054. Jul 20 05:43:29.976588 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] [86bbcd4a-2dc6-48ea-bdc8-94fb9e64045f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55056. Jul 20 05:43:30.096139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a70d8e6e-21f8-4741-83db-dd8bf0c8d5a6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:30.103865 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a70d8e6e-21f8-4741-83db-dd8bf0c8d5a6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1679 microversion: 2.1 time: 0.162098 Jul 20 05:43:30.104501 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3751/7606] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:29 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:31.121479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dcf2d6c6-41ae-4513-aa4e-0d831178e918 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:31.122103 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dcf2d6c6-41ae-4513-aa4e-0d831178e918 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:31.129251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dcf2d6c6-41ae-4513-aa4e-0d831178e918 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:31.129711 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dcf2d6c6-41ae-4513-aa4e-0d831178e918 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:31.130485 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dcf2d6c6-41ae-4513-aa4e-0d831178e918 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:31.130929 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dcf2d6c6-41ae-4513-aa4e-0d831178e918 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:31.260820 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-dcf2d6c6-41ae-4513-aa4e-0d831178e918 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:31.268340 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dcf2d6c6-41ae-4513-aa4e-0d831178e918 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1679 microversion: 2.1 time: 0.150961 Jul 20 05:43:31.268900 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3856/7607] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:31 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:32.286160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-54fb8bce-0a46-4ea1-b9ee-798c0c2be91f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:32.286782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-54fb8bce-0a46-4ea1-b9ee-798c0c2be91f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:32.297047 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54fb8bce-0a46-4ea1-b9ee-798c0c2be91f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:32.297812 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54fb8bce-0a46-4ea1-b9ee-798c0c2be91f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:32.299110 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54fb8bce-0a46-4ea1-b9ee-798c0c2be91f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:32.299902 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-54fb8bce-0a46-4ea1-b9ee-798c0c2be91f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:32.441160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-54fb8bce-0a46-4ea1-b9ee-798c0c2be91f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:32.449032 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-54fb8bce-0a46-4ea1-b9ee-798c0c2be91f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1679 microversion: 2.1 time: 0.166818 Jul 20 05:43:32.449600 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3752/7608] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:32 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:33.466235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-efc31976-167a-4205-9e0a-d4fb608216a2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:33.467258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-efc31976-167a-4205-9e0a-d4fb608216a2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:33.474271 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-efc31976-167a-4205-9e0a-d4fb608216a2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:33.474737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-efc31976-167a-4205-9e0a-d4fb608216a2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:33.475537 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-efc31976-167a-4205-9e0a-d4fb608216a2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:33.475995 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-efc31976-167a-4205-9e0a-d4fb608216a2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:33.611465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-efc31976-167a-4205-9e0a-d4fb608216a2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:33.619843 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-efc31976-167a-4205-9e0a-d4fb608216a2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1679 microversion: 2.1 time: 0.157559 Jul 20 05:43:33.620432 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3857/7609] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:33 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:43:34.637459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b2837f9d-6c7c-418b-b8c6-1f3c82828048 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:34.638066 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b2837f9d-6c7c-418b-b8c6-1f3c82828048 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:34.644993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2837f9d-6c7c-418b-b8c6-1f3c82828048 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:34.645445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2837f9d-6c7c-418b-b8c6-1f3c82828048 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:34.646208 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2837f9d-6c7c-418b-b8c6-1f3c82828048 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:34.646645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b2837f9d-6c7c-418b-b8c6-1f3c82828048 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:34.781793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b2837f9d-6c7c-418b-b8c6-1f3c82828048 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:34.790194 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b2837f9d-6c7c-418b-b8c6-1f3c82828048 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1679 microversion: 2.1 time: 0.156401 Jul 20 05:43:34.790794 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3753/7610] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:34 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:35.730177 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:43:35.730788 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:43:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:43:35.744934 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:43:35.745084 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:43:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:43:35.807902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e3a411fa-10db-4208-b1e1-9d4256a65dc5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:35.808527 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e3a411fa-10db-4208-b1e1-9d4256a65dc5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:35.815993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e3a411fa-10db-4208-b1e1-9d4256a65dc5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:35.816457 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e3a411fa-10db-4208-b1e1-9d4256a65dc5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:35.817228 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e3a411fa-10db-4208-b1e1-9d4256a65dc5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:35.817679 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e3a411fa-10db-4208-b1e1-9d4256a65dc5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:35.946991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e3a411fa-10db-4208-b1e1-9d4256a65dc5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:35.954626 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e3a411fa-10db-4208-b1e1-9d4256a65dc5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1679 microversion: 2.1 time: 0.151145 Jul 20 05:43:35.955189 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3858/7611] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:35 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:36.971859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-70fe7a70-6076-46a7-904a-b3e769bf6529 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:36.972495 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-70fe7a70-6076-46a7-904a-b3e769bf6529 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:36.980082 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-70fe7a70-6076-46a7-904a-b3e769bf6529 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:36.980548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-70fe7a70-6076-46a7-904a-b3e769bf6529 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:36.981285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-70fe7a70-6076-46a7-904a-b3e769bf6529 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:36.981718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-70fe7a70-6076-46a7-904a-b3e769bf6529 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:37.114596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-70fe7a70-6076-46a7-904a-b3e769bf6529 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:37.123000 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-70fe7a70-6076-46a7-904a-b3e769bf6529 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1679 microversion: 2.1 time: 0.154790 Jul 20 05:43:37.123595 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3754/7612] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:36 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:37.328989 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:43:37.329161 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:43:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:43:38.140407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f63f4011-a2b9-47b4-bdab-23cd96b436d4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:38.141070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f63f4011-a2b9-47b4-bdab-23cd96b436d4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:38.148208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f63f4011-a2b9-47b4-bdab-23cd96b436d4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:38.148674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f63f4011-a2b9-47b4-bdab-23cd96b436d4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:38.150107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f63f4011-a2b9-47b4-bdab-23cd96b436d4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:38.150559 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f63f4011-a2b9-47b4-bdab-23cd96b436d4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:38.287753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f63f4011-a2b9-47b4-bdab-23cd96b436d4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:38.296070 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f63f4011-a2b9-47b4-bdab-23cd96b436d4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1679 microversion: 2.1 time: 0.159524 Jul 20 05:43:38.296666 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3859/7613] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:38 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:39.313567 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-56acb1de-0167-4efc-91f9-1caee55f9217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:39.314178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-56acb1de-0167-4efc-91f9-1caee55f9217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:39.321546 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56acb1de-0167-4efc-91f9-1caee55f9217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:39.322003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56acb1de-0167-4efc-91f9-1caee55f9217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:39.322771 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56acb1de-0167-4efc-91f9-1caee55f9217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:39.323212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-56acb1de-0167-4efc-91f9-1caee55f9217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:39.457500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-56acb1de-0167-4efc-91f9-1caee55f9217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:39.465620 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-56acb1de-0167-4efc-91f9-1caee55f9217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1700 microversion: 2.1 time: 0.155953 Jul 20 05:43:39.466205 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3755/7614] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:39 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:40.482977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-691d781d-9a62-43bc-8e33-a1de00830533 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:40.483568 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-691d781d-9a62-43bc-8e33-a1de00830533 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:40.490453 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-691d781d-9a62-43bc-8e33-a1de00830533 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:40.490921 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-691d781d-9a62-43bc-8e33-a1de00830533 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:40.491734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-691d781d-9a62-43bc-8e33-a1de00830533 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:40.492193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-691d781d-9a62-43bc-8e33-a1de00830533 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:40.630458 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-691d781d-9a62-43bc-8e33-a1de00830533 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:40.638556 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-691d781d-9a62-43bc-8e33-a1de00830533 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1700 microversion: 2.1 time: 0.159569 Jul 20 05:43:40.639133 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3860/7615] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:40 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:41.655957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-85b5a2b1-df55-42db-8139-012df46232b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:41.656552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-85b5a2b1-df55-42db-8139-012df46232b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:41.663456 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85b5a2b1-df55-42db-8139-012df46232b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:41.663943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85b5a2b1-df55-42db-8139-012df46232b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:41.665438 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85b5a2b1-df55-42db-8139-012df46232b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:41.665878 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-85b5a2b1-df55-42db-8139-012df46232b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:41.797161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-85b5a2b1-df55-42db-8139-012df46232b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:41.805602 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-85b5a2b1-df55-42db-8139-012df46232b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1700 microversion: 2.1 time: 0.153454 Jul 20 05:43:41.806378 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3756/7616] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:41 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1700 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:42.822464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bdd67ab6-182c-4e6d-aaf6-1d8495306970 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:42.823136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bdd67ab6-182c-4e6d-aaf6-1d8495306970 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:42.830815 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bdd67ab6-182c-4e6d-aaf6-1d8495306970 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:42.831287 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bdd67ab6-182c-4e6d-aaf6-1d8495306970 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:42.832045 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-e12db851-abca-4a1e-ae58-022ad201a625 req-245b548c-5317-4ec0-b70d-3e912beed3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d712ce-903d-4604-a9aa-98df3d168aa9", "name": "network-vif-plugged", "status": "completed", "tag": "4772971f-ccc8-4d4a-b392-3d6d75109089"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:43:42.832504 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bdd67ab6-182c-4e6d-aaf6-1d8495306970 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:42.832608 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bdd67ab6-182c-4e6d-aaf6-1d8495306970 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:42.842109 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e12db851-abca-4a1e-ae58-022ad201a625 req-245b548c-5317-4ec0-b70d-3e912beed3f8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:42.842779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-e12db851-abca-4a1e-ae58-022ad201a625 req-245b548c-5317-4ec0-b70d-3e912beed3f8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:42.856179 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-e12db851-abca-4a1e-ae58-022ad201a625 req-245b548c-5317-4ec0-b70d-3e912beed3f8 service nova] Creating event network-vif-plugged:4772971f-ccc8-4d4a-b392-3d6d75109089 for instance e9d712ce-903d-4604-a9aa-98df3d168aa9 on n-h1-764485-11 Jul 20 05:43:42.862976 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-e12db851-abca-4a1e-ae58-022ad201a625 req-245b548c-5317-4ec0-b70d-3e912beed3f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034941 Jul 20 05:43:42.863904 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3757/7617] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:43:42.970465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bdd67ab6-182c-4e6d-aaf6-1d8495306970 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:42.978900 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bdd67ab6-182c-4e6d-aaf6-1d8495306970 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1700 microversion: 2.1 time: 0.160553 Jul 20 05:43:42.979474 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3861/7618] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:42 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1700 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:43.997295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-883633bb-9011-444b-bd96-28e046210c6f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:43.998271 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-883633bb-9011-444b-bd96-28e046210c6f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:44.004828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-883633bb-9011-444b-bd96-28e046210c6f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:44.005279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-883633bb-9011-444b-bd96-28e046210c6f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:44.006058 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-883633bb-9011-444b-bd96-28e046210c6f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:44.006501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-883633bb-9011-444b-bd96-28e046210c6f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:44.155749 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-883633bb-9011-444b-bd96-28e046210c6f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:44.163967 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-883633bb-9011-444b-bd96-28e046210c6f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1695 microversion: 2.1 time: 0.172093 Jul 20 05:43:44.166052 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3758/7619] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:43 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:45.186881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e50d38f5-942d-45cd-9298-33df1a828355 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:45.187420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e50d38f5-942d-45cd-9298-33df1a828355 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:45.196499 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e50d38f5-942d-45cd-9298-33df1a828355 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:45.197171 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e50d38f5-942d-45cd-9298-33df1a828355 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:45.198455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e50d38f5-942d-45cd-9298-33df1a828355 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:45.199345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e50d38f5-942d-45cd-9298-33df1a828355 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:45.361641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e50d38f5-942d-45cd-9298-33df1a828355 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:45.376757 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e50d38f5-942d-45cd-9298-33df1a828355 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1695 microversion: 2.1 time: 0.197572 Jul 20 05:43:45.377348 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3862/7620] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:45 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1695 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:46.395683 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4763e03c-1dc4-4f38-8753-7fcc5be99be9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:46.397178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4763e03c-1dc4-4f38-8753-7fcc5be99be9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:46.405483 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4763e03c-1dc4-4f38-8753-7fcc5be99be9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:46.406037 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4763e03c-1dc4-4f38-8753-7fcc5be99be9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:46.406984 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4763e03c-1dc4-4f38-8753-7fcc5be99be9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:46.407440 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4763e03c-1dc4-4f38-8753-7fcc5be99be9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:46.592626 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4763e03c-1dc4-4f38-8753-7fcc5be99be9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:46.602610 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4763e03c-1dc4-4f38-8753-7fcc5be99be9 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1695 microversion: 2.1 time: 0.211238 Jul 20 05:43:46.603214 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3759/7621] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:46 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1695 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:47.620345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1b3aef1c-8e9c-4925-be6a-7dd8c6e5e369 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:47.621881 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1b3aef1c-8e9c-4925-be6a-7dd8c6e5e369 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:47.629720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b3aef1c-8e9c-4925-be6a-7dd8c6e5e369 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:47.630549 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b3aef1c-8e9c-4925-be6a-7dd8c6e5e369 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:47.631525 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b3aef1c-8e9c-4925-be6a-7dd8c6e5e369 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:47.631993 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1b3aef1c-8e9c-4925-be6a-7dd8c6e5e369 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:47.808529 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1b3aef1c-8e9c-4925-be6a-7dd8c6e5e369 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:47.817170 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1b3aef1c-8e9c-4925-be6a-7dd8c6e5e369 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1695 microversion: 2.1 time: 0.200845 Jul 20 05:43:47.817766 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3863/7622] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:47 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1695 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:48.838785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3942be95-5908-444a-8ca8-0bc6ab19dcff tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:48.840777 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3942be95-5908-444a-8ca8-0bc6ab19dcff tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:48.848265 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3942be95-5908-444a-8ca8-0bc6ab19dcff tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:48.848723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3942be95-5908-444a-8ca8-0bc6ab19dcff tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:48.849513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3942be95-5908-444a-8ca8-0bc6ab19dcff tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:48.850143 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3942be95-5908-444a-8ca8-0bc6ab19dcff tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:49.006314 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3942be95-5908-444a-8ca8-0bc6ab19dcff tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:49.016650 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3942be95-5908-444a-8ca8-0bc6ab19dcff tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1695 microversion: 2.1 time: 0.183407 Jul 20 05:43:49.017257 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3760/7623] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:48 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:50.034576 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c1eb2d0a-6d9f-4925-accb-c600de02624d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:50.035258 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c1eb2d0a-6d9f-4925-accb-c600de02624d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:50.042958 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1eb2d0a-6d9f-4925-accb-c600de02624d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:50.043582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1eb2d0a-6d9f-4925-accb-c600de02624d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:50.044737 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1eb2d0a-6d9f-4925-accb-c600de02624d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:50.045182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c1eb2d0a-6d9f-4925-accb-c600de02624d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:50.207797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c1eb2d0a-6d9f-4925-accb-c600de02624d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:50.221475 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c1eb2d0a-6d9f-4925-accb-c600de02624d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1695 microversion: 2.1 time: 0.190874 Jul 20 05:43:50.222426 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3864/7624] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:50 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1695 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:51.239340 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-58de7cc5-1fcf-40db-ada9-1e1b33831973 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:51.240172 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-58de7cc5-1fcf-40db-ada9-1e1b33831973 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:51.247380 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58de7cc5-1fcf-40db-ada9-1e1b33831973 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:51.248145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58de7cc5-1fcf-40db-ada9-1e1b33831973 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:51.248939 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58de7cc5-1fcf-40db-ada9-1e1b33831973 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:51.249377 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-58de7cc5-1fcf-40db-ada9-1e1b33831973 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:51.394190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-58de7cc5-1fcf-40db-ada9-1e1b33831973 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:51.403027 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-58de7cc5-1fcf-40db-ada9-1e1b33831973 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1695 microversion: 2.1 time: 0.167529 Jul 20 05:43:51.412740 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3761/7625] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:51 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:52.420791 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fa3d546b-5e9b-482c-a095-8844628bb229 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:52.421443 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fa3d546b-5e9b-482c-a095-8844628bb229 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:52.429192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa3d546b-5e9b-482c-a095-8844628bb229 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:52.430552 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa3d546b-5e9b-482c-a095-8844628bb229 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:52.431406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa3d546b-5e9b-482c-a095-8844628bb229 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:52.431897 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fa3d546b-5e9b-482c-a095-8844628bb229 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:52.606080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fa3d546b-5e9b-482c-a095-8844628bb229 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:52.614135 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fa3d546b-5e9b-482c-a095-8844628bb229 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1695 microversion: 2.1 time: 0.197434 Jul 20 05:43:52.614722 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3865/7626] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:52 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1695 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:53.632117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-94b27e8f-120b-46d8-be89-bb7b32a0c6ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:53.633269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-94b27e8f-120b-46d8-be89-bb7b32a0c6ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:53.640319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94b27e8f-120b-46d8-be89-bb7b32a0c6ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:53.640779 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94b27e8f-120b-46d8-be89-bb7b32a0c6ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:53.641556 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94b27e8f-120b-46d8-be89-bb7b32a0c6ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:53.642008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-94b27e8f-120b-46d8-be89-bb7b32a0c6ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:53.775787 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-94b27e8f-120b-46d8-be89-bb7b32a0c6ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:53.783477 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-94b27e8f-120b-46d8-be89-bb7b32a0c6ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1695 microversion: 2.1 time: 0.155222 Jul 20 05:43:53.784079 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3762/7627] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:53 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:54.801174 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-46953589-7d08-4f57-987b-d5dc9759d0cd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:54.801805 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-46953589-7d08-4f57-987b-d5dc9759d0cd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:54.809273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46953589-7d08-4f57-987b-d5dc9759d0cd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:54.809745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46953589-7d08-4f57-987b-d5dc9759d0cd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:54.810528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46953589-7d08-4f57-987b-d5dc9759d0cd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:54.810988 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46953589-7d08-4f57-987b-d5dc9759d0cd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:54.946603 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-46953589-7d08-4f57-987b-d5dc9759d0cd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:54.954287 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-46953589-7d08-4f57-987b-d5dc9759d0cd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1677 microversion: 2.1 time: 0.156943 Jul 20 05:43:54.954790 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3866/7628] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:54 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:55.971684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3972885c-09aa-49e3-a30c-57f84b97a3e7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:55.972307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3972885c-09aa-49e3-a30c-57f84b97a3e7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:55.979305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3972885c-09aa-49e3-a30c-57f84b97a3e7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:55.979792 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3972885c-09aa-49e3-a30c-57f84b97a3e7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:55.980564 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3972885c-09aa-49e3-a30c-57f84b97a3e7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:55.981006 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3972885c-09aa-49e3-a30c-57f84b97a3e7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:56.112568 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3972885c-09aa-49e3-a30c-57f84b97a3e7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:56.120997 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3972885c-09aa-49e3-a30c-57f84b97a3e7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1677 microversion: 2.1 time: 0.153222 Jul 20 05:43:56.121581 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3763/7629] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:55 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:56.892067 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6bd5e4c4-d1a0-47fd-ad62-4166b23ce650 req-b48442e3-95cf-4569-8bd9-178e89b34296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d712ce-903d-4604-a9aa-98df3d168aa9", "name": "network-vif-unplugged", "status": "completed", "tag": "4772971f-ccc8-4d4a-b392-3d6d75109089"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:43:56.903567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6bd5e4c4-d1a0-47fd-ad62-4166b23ce650 req-b48442e3-95cf-4569-8bd9-178e89b34296 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:56.904149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6bd5e4c4-d1a0-47fd-ad62-4166b23ce650 req-b48442e3-95cf-4569-8bd9-178e89b34296 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:56.916516 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.compute.server_external_events [req-6bd5e4c4-d1a0-47fd-ad62-4166b23ce650 req-b48442e3-95cf-4569-8bd9-178e89b34296 service nova] Unable to find a host for instance e9d712ce-903d-4604-a9aa-98df3d168aa9. Dropping event network-vif-unplugged {{(pid=119808) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 05:43:56.917423 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6bd5e4c4-d1a0-47fd-ad62-4166b23ce650 req-b48442e3-95cf-4569-8bd9-178e89b34296 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029543 Jul 20 05:43:56.918018 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3867/7630] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 05:43:57.138820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8ccb2a42-84fd-4fde-8368-23f7b591845f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:57.139470 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8ccb2a42-84fd-4fde-8368-23f7b591845f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:57.146439 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8ccb2a42-84fd-4fde-8368-23f7b591845f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:57.146899 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8ccb2a42-84fd-4fde-8368-23f7b591845f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:57.147713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8ccb2a42-84fd-4fde-8368-23f7b591845f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:57.148157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8ccb2a42-84fd-4fde-8368-23f7b591845f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:57.282039 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8ccb2a42-84fd-4fde-8368-23f7b591845f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:57.289727 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8ccb2a42-84fd-4fde-8368-23f7b591845f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1620 microversion: 2.1 time: 0.154829 Jul 20 05:43:57.290294 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3764/7631] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:57 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1620 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:57.306015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-21b0e03f-5f4d-4a9f-9e54-e81cebdb773a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:43:57.306681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-21b0e03f-5f4d-4a9f-9e54-e81cebdb773a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:57.308598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=29 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:43:57.314173 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21b0e03f-5f4d-4a9f-9e54-e81cebdb773a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:57.314665 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21b0e03f-5f4d-4a9f-9e54-e81cebdb773a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:57.315435 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21b0e03f-5f4d-4a9f-9e54-e81cebdb773a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:57.315912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-21b0e03f-5f4d-4a9f-9e54-e81cebdb773a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:57.319422 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:43:57.467344 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-21b0e03f-5f4d-4a9f-9e54-e81cebdb773a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "POST /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9/action" status: 202 len: 0 microversion: 2.1 time: 0.165196 Jul 20 05:43:57.467909 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3868/7632] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:43:57 2022] POST /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:43:57.476264 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8d88217a-4d2c-4f3b-a57c-519b3a84a59f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:57.477162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8d88217a-4d2c-4f3b-a57c-519b3a84a59f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:57.483515 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d88217a-4d2c-4f3b-a57c-519b3a84a59f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:57.483990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d88217a-4d2c-4f3b-a57c-519b3a84a59f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:57.484767 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d88217a-4d2c-4f3b-a57c-519b3a84a59f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:57.485214 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8d88217a-4d2c-4f3b-a57c-519b3a84a59f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:57.632150 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8d88217a-4d2c-4f3b-a57c-519b3a84a59f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:57.635093 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=91 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:43:57.642371 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8d88217a-4d2c-4f3b-a57c-519b3a84a59f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1628 microversion: 2.1 time: 0.170185 Jul 20 05:43:57.642951 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3765/7633] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:57 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1628 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:58.660660 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-2491c58c-494c-4877-9c14-c89022282217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:58.661299 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-2491c58c-494c-4877-9c14-c89022282217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:58.669363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2491c58c-494c-4877-9c14-c89022282217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:58.669835 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2491c58c-494c-4877-9c14-c89022282217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:58.670633 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2491c58c-494c-4877-9c14-c89022282217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:58.671094 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-2491c58c-494c-4877-9c14-c89022282217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:58.816591 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-2491c58c-494c-4877-9c14-c89022282217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:58.824856 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-2491c58c-494c-4877-9c14-c89022282217 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.169034 Jul 20 05:43:58.825658 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3869/7634] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:58 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:43:59.549135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6c876e98-d896-4d32-8513-9f23977a1424 req-33e07fa6-fbef-42a6-95a5-0be758f8558f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9d712ce-903d-4604-a9aa-98df3d168aa9", "tag": "4772971f-ccc8-4d4a-b392-3d6d75109089"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:43:59.552962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=33 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:43:59.559818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6c876e98-d896-4d32-8513-9f23977a1424 req-33e07fa6-fbef-42a6-95a5-0be758f8558f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:59.560262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6c876e98-d896-4d32-8513-9f23977a1424 req-33e07fa6-fbef-42a6-95a5-0be758f8558f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:59.572934 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-6c876e98-d896-4d32-8513-9f23977a1424 req-33e07fa6-fbef-42a6-95a5-0be758f8558f service nova] Creating event network-changed:4772971f-ccc8-4d4a-b392-3d6d75109089 for instance e9d712ce-903d-4604-a9aa-98df3d168aa9 on n-h2-764485-11 Jul 20 05:43:59.578460 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6c876e98-d896-4d32-8513-9f23977a1424 req-33e07fa6-fbef-42a6-95a5-0be758f8558f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091417 Jul 20 05:43:59.579083 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3766/7635] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:43:59.842778 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1a09c557-f412-4e8a-9963-2f278f14d52e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:43:59.843436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1a09c557-f412-4e8a-9963-2f278f14d52e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:43:59.850391 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a09c557-f412-4e8a-9963-2f278f14d52e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:59.850937 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a09c557-f412-4e8a-9963-2f278f14d52e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:59.852365 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a09c557-f412-4e8a-9963-2f278f14d52e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:43:59.853010 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1a09c557-f412-4e8a-9963-2f278f14d52e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:43:59.988095 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1a09c557-f412-4e8a-9963-2f278f14d52e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:43:59.997790 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1a09c557-f412-4e8a-9963-2f278f14d52e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.158520 Jul 20 05:44:00.003093 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3870/7636] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:43:59 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:01.017061 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-53dd5d33-6e4d-44d3-b6f2-8a8782c0aef8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:01.017772 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-53dd5d33-6e4d-44d3-b6f2-8a8782c0aef8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:01.024237 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53dd5d33-6e4d-44d3-b6f2-8a8782c0aef8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:01.024690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53dd5d33-6e4d-44d3-b6f2-8a8782c0aef8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:01.025461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53dd5d33-6e4d-44d3-b6f2-8a8782c0aef8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:01.025910 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53dd5d33-6e4d-44d3-b6f2-8a8782c0aef8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:01.173234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-53dd5d33-6e4d-44d3-b6f2-8a8782c0aef8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:01.181654 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-53dd5d33-6e4d-44d3-b6f2-8a8782c0aef8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.169781 Jul 20 05:44:01.182231 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3767/7637] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:01 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:02.198821 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3cbebbc4-5635-42bf-8e20-cfb6142a0fd1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:02.199653 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3cbebbc4-5635-42bf-8e20-cfb6142a0fd1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:02.207216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cbebbc4-5635-42bf-8e20-cfb6142a0fd1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:02.207978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cbebbc4-5635-42bf-8e20-cfb6142a0fd1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:02.208930 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cbebbc4-5635-42bf-8e20-cfb6142a0fd1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:02.209673 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3cbebbc4-5635-42bf-8e20-cfb6142a0fd1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:02.356641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3cbebbc4-5635-42bf-8e20-cfb6142a0fd1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:02.365099 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3cbebbc4-5635-42bf-8e20-cfb6142a0fd1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.170745 Jul 20 05:44:02.365700 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3871/7638] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:02 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:03.384270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f3c85990-aa53-4cca-841e-160d4b65d778 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:03.384884 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f3c85990-aa53-4cca-841e-160d4b65d778 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:03.391923 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3c85990-aa53-4cca-841e-160d4b65d778 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:03.392374 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3c85990-aa53-4cca-841e-160d4b65d778 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:03.393131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3c85990-aa53-4cca-841e-160d4b65d778 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:03.393573 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f3c85990-aa53-4cca-841e-160d4b65d778 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:03.544809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f3c85990-aa53-4cca-841e-160d4b65d778 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:03.552803 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f3c85990-aa53-4cca-841e-160d4b65d778 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.172727 Jul 20 05:44:03.553375 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3768/7639] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:03 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:04.575064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-131e9b90-f776-4983-86c5-4064edfbc578 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:04.576006 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-131e9b90-f776-4983-86c5-4064edfbc578 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:04.584090 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-131e9b90-f776-4983-86c5-4064edfbc578 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:04.584551 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-131e9b90-f776-4983-86c5-4064edfbc578 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:04.586207 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-131e9b90-f776-4983-86c5-4064edfbc578 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:04.586667 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-131e9b90-f776-4983-86c5-4064edfbc578 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:04.744503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-131e9b90-f776-4983-86c5-4064edfbc578 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:04.752407 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-131e9b90-f776-4983-86c5-4064edfbc578 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.182857 Jul 20 05:44:04.752993 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3872/7640] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:04 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:05.769607 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9ea3de2b-8401-4a67-a8fe-e102c38c77da tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:05.770426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9ea3de2b-8401-4a67-a8fe-e102c38c77da tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:05.778942 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ea3de2b-8401-4a67-a8fe-e102c38c77da tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:05.779341 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ea3de2b-8401-4a67-a8fe-e102c38c77da tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:05.780356 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ea3de2b-8401-4a67-a8fe-e102c38c77da tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:05.781097 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9ea3de2b-8401-4a67-a8fe-e102c38c77da tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:05.927755 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9ea3de2b-8401-4a67-a8fe-e102c38c77da tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:05.936185 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9ea3de2b-8401-4a67-a8fe-e102c38c77da tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.170476 Jul 20 05:44:05.936761 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3769/7641] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:05 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:06.954027 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f01e45f8-19c9-46e8-8cb1-761dd0ce55ea tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:06.954571 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f01e45f8-19c9-46e8-8cb1-761dd0ce55ea tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:06.962198 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f01e45f8-19c9-46e8-8cb1-761dd0ce55ea tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:06.962641 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f01e45f8-19c9-46e8-8cb1-761dd0ce55ea tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:06.963474 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f01e45f8-19c9-46e8-8cb1-761dd0ce55ea tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:06.963956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f01e45f8-19c9-46e8-8cb1-761dd0ce55ea tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:07.105642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f01e45f8-19c9-46e8-8cb1-761dd0ce55ea tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:07.113884 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f01e45f8-19c9-46e8-8cb1-761dd0ce55ea tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.163734 Jul 20 05:44:07.114443 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3873/7642] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:06 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:08.138288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f5582caa-eb82-4929-bbbd-513d25ff97d3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:08.138919 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f5582caa-eb82-4929-bbbd-513d25ff97d3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:08.146418 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5582caa-eb82-4929-bbbd-513d25ff97d3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:08.146894 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5582caa-eb82-4929-bbbd-513d25ff97d3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:08.147977 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5582caa-eb82-4929-bbbd-513d25ff97d3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:08.148198 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f5582caa-eb82-4929-bbbd-513d25ff97d3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:08.312801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f5582caa-eb82-4929-bbbd-513d25ff97d3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:08.321591 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f5582caa-eb82-4929-bbbd-513d25ff97d3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.187014 Jul 20 05:44:08.322345 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3770/7643] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:08 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:09.339415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-704ac929-68b3-408f-adb2-6468bf6a14eb tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:09.340071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-704ac929-68b3-408f-adb2-6468bf6a14eb tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:09.346923 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-704ac929-68b3-408f-adb2-6468bf6a14eb tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:09.347381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-704ac929-68b3-408f-adb2-6468bf6a14eb tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:09.348191 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-704ac929-68b3-408f-adb2-6468bf6a14eb tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:09.348637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-704ac929-68b3-408f-adb2-6468bf6a14eb tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:09.480327 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-704ac929-68b3-408f-adb2-6468bf6a14eb tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:09.487820 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-704ac929-68b3-408f-adb2-6468bf6a14eb tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.153069 Jul 20 05:44:09.488397 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3874/7644] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:09 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:10.505830 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c224fe9a-9615-47f5-b7e2-0208188aa0aa tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:10.506468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c224fe9a-9615-47f5-b7e2-0208188aa0aa tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:10.513500 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c224fe9a-9615-47f5-b7e2-0208188aa0aa tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:10.513950 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c224fe9a-9615-47f5-b7e2-0208188aa0aa tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:10.514708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c224fe9a-9615-47f5-b7e2-0208188aa0aa tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:10.515160 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c224fe9a-9615-47f5-b7e2-0208188aa0aa tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:10.653962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c224fe9a-9615-47f5-b7e2-0208188aa0aa tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:10.661557 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c224fe9a-9615-47f5-b7e2-0208188aa0aa tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.159672 Jul 20 05:44:10.662148 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3771/7645] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:10 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:11.679979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-163a5668-ba84-417e-85d8-036918509492 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:11.680600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-163a5668-ba84-417e-85d8-036918509492 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:11.687437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-163a5668-ba84-417e-85d8-036918509492 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:11.687924 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-163a5668-ba84-417e-85d8-036918509492 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:11.688691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-163a5668-ba84-417e-85d8-036918509492 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:11.689144 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-163a5668-ba84-417e-85d8-036918509492 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:11.821420 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-163a5668-ba84-417e-85d8-036918509492 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:11.829068 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-163a5668-ba84-417e-85d8-036918509492 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.153741 Jul 20 05:44:11.829650 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3875/7646] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:11 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:12.847713 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-be1f3c23-bd1e-4222-8b97-8fae1f0ea29c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:12.848511 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-be1f3c23-bd1e-4222-8b97-8fae1f0ea29c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:12.855968 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be1f3c23-bd1e-4222-8b97-8fae1f0ea29c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:12.856486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be1f3c23-bd1e-4222-8b97-8fae1f0ea29c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:12.857387 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be1f3c23-bd1e-4222-8b97-8fae1f0ea29c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:12.857970 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-be1f3c23-bd1e-4222-8b97-8fae1f0ea29c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:13.005943 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-be1f3c23-bd1e-4222-8b97-8fae1f0ea29c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:13.014102 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-be1f3c23-bd1e-4222-8b97-8fae1f0ea29c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.170609 Jul 20 05:44:13.014705 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3772/7647] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:12 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:14.031212 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-0fd66cff-6602-40c3-ae91-cef071404ebe tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:14.031882 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-0fd66cff-6602-40c3-ae91-cef071404ebe tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:14.039480 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0fd66cff-6602-40c3-ae91-cef071404ebe tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:14.039970 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0fd66cff-6602-40c3-ae91-cef071404ebe tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:14.040756 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0fd66cff-6602-40c3-ae91-cef071404ebe tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:14.041211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-0fd66cff-6602-40c3-ae91-cef071404ebe tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:14.177211 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-0fd66cff-6602-40c3-ae91-cef071404ebe tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:14.186812 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-0fd66cff-6602-40c3-ae91-cef071404ebe tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.159490 Jul 20 05:44:14.197426 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3876/7648] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:14 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:15.204993 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b7ed1e71-f9bc-4794-bc80-536ded86f85c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:15.205543 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b7ed1e71-f9bc-4794-bc80-536ded86f85c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:15.213836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b7ed1e71-f9bc-4794-bc80-536ded86f85c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:15.214279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b7ed1e71-f9bc-4794-bc80-536ded86f85c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:15.215035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b7ed1e71-f9bc-4794-bc80-536ded86f85c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:15.215467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b7ed1e71-f9bc-4794-bc80-536ded86f85c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:15.350014 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b7ed1e71-f9bc-4794-bc80-536ded86f85c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:15.357645 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b7ed1e71-f9bc-4794-bc80-536ded86f85c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.156596 Jul 20 05:44:15.358235 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3773/7649] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:15 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:16.226531 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-2b55fad3-8697-4ee5-8acb-b094224d4487 req-85282d37-4d87-473f-b281-f5e41753d98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d712ce-903d-4604-a9aa-98df3d168aa9", "name": "network-vif-plugged", "status": "completed", "tag": "4772971f-ccc8-4d4a-b392-3d6d75109089"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:44:16.240943 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2b55fad3-8697-4ee5-8acb-b094224d4487 req-85282d37-4d87-473f-b281-f5e41753d98d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:16.241772 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-2b55fad3-8697-4ee5-8acb-b094224d4487 req-85282d37-4d87-473f-b281-f5e41753d98d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:16.253803 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-2b55fad3-8697-4ee5-8acb-b094224d4487 req-85282d37-4d87-473f-b281-f5e41753d98d service nova] Creating event network-vif-plugged:4772971f-ccc8-4d4a-b392-3d6d75109089 for instance e9d712ce-903d-4604-a9aa-98df3d168aa9 on n-h2-764485-11 Jul 20 05:44:16.261911 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-2b55fad3-8697-4ee5-8acb-b094224d4487 req-85282d37-4d87-473f-b281-f5e41753d98d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104143 Jul 20 05:44:16.262505 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3877/7650] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:44:16.374426 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-93943170-8f8a-4130-aa62-bd67824256ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:16.375189 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-93943170-8f8a-4130-aa62-bd67824256ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:16.382967 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93943170-8f8a-4130-aa62-bd67824256ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:16.383448 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93943170-8f8a-4130-aa62-bd67824256ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:16.384262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93943170-8f8a-4130-aa62-bd67824256ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:16.384704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-93943170-8f8a-4130-aa62-bd67824256ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:16.526166 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-93943170-8f8a-4130-aa62-bd67824256ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:16.534102 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-93943170-8f8a-4130-aa62-bd67824256ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.163827 Jul 20 05:44:16.534685 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3774/7651] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:16 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:17.553328 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-952ca6e6-91bc-4bab-a0c1-2df50cebd702 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:17.554768 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-952ca6e6-91bc-4bab-a0c1-2df50cebd702 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:17.561354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-952ca6e6-91bc-4bab-a0c1-2df50cebd702 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:17.561822 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-952ca6e6-91bc-4bab-a0c1-2df50cebd702 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:17.562596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-952ca6e6-91bc-4bab-a0c1-2df50cebd702 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:17.563048 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-952ca6e6-91bc-4bab-a0c1-2df50cebd702 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:17.696214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-952ca6e6-91bc-4bab-a0c1-2df50cebd702 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:17.703906 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-952ca6e6-91bc-4bab-a0c1-2df50cebd702 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1686 microversion: 2.1 time: 0.155588 Jul 20 05:44:17.704528 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3878/7652] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:17 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:44:18.721308 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e8ffb3b8-1167-40b6-bfed-fd1ebc38d09c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:44:18.721947 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e8ffb3b8-1167-40b6-bfed-fd1ebc38d09c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:44:18.729020 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8ffb3b8-1167-40b6-bfed-fd1ebc38d09c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:18.729475 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8ffb3b8-1167-40b6-bfed-fd1ebc38d09c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:18.730238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8ffb3b8-1167-40b6-bfed-fd1ebc38d09c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:44:18.730674 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e8ffb3b8-1167-40b6-bfed-fd1ebc38d09c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:44:18.866175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e8ffb3b8-1167-40b6-bfed-fd1ebc38d09c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:44:18.875536 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e8ffb3b8-1167-40b6-bfed-fd1ebc38d09c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1673 microversion: 2.1 time: 0.158114 Jul 20 05:44:18.876115 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3775/7653] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:44:18 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:45:16.893862 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:45:16.894616 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:45:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:45:56.739602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e7738f55-f864-488d-9cbc-deb39c4d69ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:45:56.740151 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e7738f55-f864-488d-9cbc-deb39c4d69ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:45:56.742468 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=23 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:45:56.743261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:45:56.744225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=19 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:45:56.745660 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=57 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:45:56.751318 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7738f55-f864-488d-9cbc-deb39c4d69ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:45:56.751825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7738f55-f864-488d-9cbc-deb39c4d69ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:45:56.752787 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7738f55-f864-488d-9cbc-deb39c4d69ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:45:56.753421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e7738f55-f864-488d-9cbc-deb39c4d69ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:45:56.780844 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e7738f55-f864-488d-9cbc-deb39c4d69ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Going to try to terminate instance {{(pid=119808) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:45:56.809990 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-f9187403-6b28-46b4-af6b-ca33243c5ca3 req-0ce223f3-809e-419f-aead-f774de3a258d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9d712ce-903d-4604-a9aa-98df3d168aa9", "tag": "4772971f-ccc8-4d4a-b392-3d6d75109089"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:45:56.818538 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f9187403-6b28-46b4-af6b-ca33243c5ca3 req-0ce223f3-809e-419f-aead-f774de3a258d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:45:56.819239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-f9187403-6b28-46b4-af6b-ca33243c5ca3 req-0ce223f3-809e-419f-aead-f774de3a258d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:45:56.831288 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-f9187403-6b28-46b4-af6b-ca33243c5ca3 req-0ce223f3-809e-419f-aead-f774de3a258d service nova] Creating event network-changed:4772971f-ccc8-4d4a-b392-3d6d75109089 for instance e9d712ce-903d-4604-a9aa-98df3d168aa9 on n-h2-764485-11 Jul 20 05:45:56.838905 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-f9187403-6b28-46b4-af6b-ca33243c5ca3 req-0ce223f3-809e-419f-aead-f774de3a258d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102176 Jul 20 05:45:56.839643 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3776/7654] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:45:56.868751 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e7738f55-f864-488d-9cbc-deb39c4d69ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 204 len: 0 microversion: 2.1 time: 0.134531 Jul 20 05:45:56.869357 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3879/7655] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:45:56 2022] DELETE /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:45:56.882680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-59c4d302-afc9-465f-8e41-80aaf482837e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:45:56.883707 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-59c4d302-afc9-465f-8e41-80aaf482837e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:45:56.891951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59c4d302-afc9-465f-8e41-80aaf482837e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:45:56.892521 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59c4d302-afc9-465f-8e41-80aaf482837e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:45:56.893382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59c4d302-afc9-465f-8e41-80aaf482837e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:45:56.893912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-59c4d302-afc9-465f-8e41-80aaf482837e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:45:57.039545 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-59c4d302-afc9-465f-8e41-80aaf482837e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:45:57.047182 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-59c4d302-afc9-465f-8e41-80aaf482837e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1679 microversion: 2.1 time: 0.171757 Jul 20 05:45:57.047780 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3777/7656] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:45:56 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:45:58.065193 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-107126db-d997-4067-a670-99647b7b5c8f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:45:58.065902 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-107126db-d997-4067-a670-99647b7b5c8f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:45:58.074180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-107126db-d997-4067-a670-99647b7b5c8f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:45:58.074637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-107126db-d997-4067-a670-99647b7b5c8f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:45:58.075414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-107126db-d997-4067-a670-99647b7b5c8f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:45:58.075884 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-107126db-d997-4067-a670-99647b7b5c8f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:45:58.211187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-107126db-d997-4067-a670-99647b7b5c8f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:45:58.218815 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-107126db-d997-4067-a670-99647b7b5c8f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1679 microversion: 2.1 time: 0.157910 Jul 20 05:45:58.219388 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3880/7657] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:45:58 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:45:58.877859 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-a4b3a890-7f04-4f74-a4e9-93fc26285500 req-d4d729b8-692f-433f-b2d2-b825a965013e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d712ce-903d-4604-a9aa-98df3d168aa9", "name": "network-vif-deleted", "tag": "4772971f-ccc8-4d4a-b392-3d6d75109089"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:45:58.887649 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a4b3a890-7f04-4f74-a4e9-93fc26285500 req-d4d729b8-692f-433f-b2d2-b825a965013e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:45:58.888099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-a4b3a890-7f04-4f74-a4e9-93fc26285500 req-d4d729b8-692f-433f-b2d2-b825a965013e service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:45:58.902233 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-a4b3a890-7f04-4f74-a4e9-93fc26285500 req-d4d729b8-692f-433f-b2d2-b825a965013e service nova] Creating event network-vif-deleted:4772971f-ccc8-4d4a-b392-3d6d75109089 for instance e9d712ce-903d-4604-a9aa-98df3d168aa9 on n-h2-764485-11 Jul 20 05:45:58.907759 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-a4b3a890-7f04-4f74-a4e9-93fc26285500 req-d4d729b8-692f-433f-b2d2-b825a965013e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033582 Jul 20 05:45:58.908357 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3778/7658] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:45:59.236454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-00fbd010-5cc1-4eea-86c8-6518171301b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:45:59.237269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-00fbd010-5cc1-4eea-86c8-6518171301b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:45:59.245341 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00fbd010-5cc1-4eea-86c8-6518171301b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:45:59.245922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00fbd010-5cc1-4eea-86c8-6518171301b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:45:59.246777 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00fbd010-5cc1-4eea-86c8-6518171301b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:45:59.247455 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00fbd010-5cc1-4eea-86c8-6518171301b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:45:59.282080 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00fbd010-5cc1-4eea-86c8-6518171301b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:45:59.282548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-00fbd010-5cc1-4eea-86c8-6518171301b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:45:59.283015 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.objects.instance [None req-00fbd010-5cc1-4eea-86c8-6518171301b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lazy-loading 'fault' on Instance uuid e9d712ce-903d-4604-a9aa-98df3d168aa9 {{(pid=119808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:45:59.330702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-00fbd010-5cc1-4eea-86c8-6518171301b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:45:59.338596 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-00fbd010-5cc1-4eea-86c8-6518171301b4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 200 len: 1335 microversion: 2.1 time: 0.106242 Jul 20 05:45:59.339365 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3881/7659] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:45:59 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 1335 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:00.357825 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08d834bd-b9d5-4f00-ae78-ced6cda6c4e1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:00.358445 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-08d834bd-b9d5-4f00-ae78-ced6cda6c4e1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e9d712ce-903d-4604-a9aa-98df3d168aa9] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:00.365868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08d834bd-b9d5-4f00-ae78-ced6cda6c4e1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:00.366320 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08d834bd-b9d5-4f00-ae78-ced6cda6c4e1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:00.367085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08d834bd-b9d5-4f00-ae78-ced6cda6c4e1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:00.367551 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-08d834bd-b9d5-4f00-ae78-ced6cda6c4e1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:00.382055 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-08d834bd-b9d5-4f00-ae78-ced6cda6c4e1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] HTTP exception thrown: Instance e9d712ce-903d-4604-a9aa-98df3d168aa9 could not be found. Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08d834bd-b9d5-4f00-ae78-ced6cda6c4e1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Request method failure captured: Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 HTTP/1.1 Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi15VX1wddRluzOOYrU08zzinsG-ShifaTDJeNPhYPPBPyUL2EEqIz5XTCCVyTdtVHeFWcSwA-XeiDKyYttQSu0-1yAavNRqrW7hLC5mI9xEbddMC5f1huTV4leNCqCgL_dooBYwhBZtS0VXH30sDIz5ctDO_VITSJzsSBrpxhUGN4XHc Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1e4867d0794645a5b92fcc63bf141b83 Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestShelveInstance-25542347 Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e4867d0794645a5b92fcc63bf141b83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e4867d0794645a5b92fcc63bf141b83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e4867d0794645a5b92fcc63bf141b83", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e4867d0794645a5b92fcc63bf141b83"}]}] Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestShelveInstance-25542347 Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1e4867d0794645a5b92fcc63bf141b83 Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestShelveInstance-25542347 Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestShelveInstance-25542347-project Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 591f755cb7cf4eec9aca672b661cf8ff Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestShelveInstance-25542347-project Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance e9d712ce-903d-4604-a9aa-98df3d168aa9 could not be found. Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'e9d712ce-903d-4604-a9aa-98df3d168aa9'} Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9d712ce-903d-4604-a9aa-98df3d168aa9 could not be found. Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9d712ce-903d-4604-a9aa-98df3d168aa9 could not be found. Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:46:00.383708 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:46:00.388912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:46:00.388912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:46:00.388912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:46:00.388912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:46:00.388912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9d712ce-903d-4604-a9aa-98df3d168aa9 could not be found. Jul 20 05:46:00.388912 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:46:00.388912 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-08d834bd-b9d5-4f00-ae78-ced6cda6c4e1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Returning 404 to user: Instance e9d712ce-903d-4604-a9aa-98df3d168aa9 could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:46:00.388912 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-08d834bd-b9d5-4f00-ae78-ced6cda6c4e1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9" status: 404 len: 111 microversion: 2.1 time: 0.032475 Jul 20 05:46:00.388912 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3779/7660] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:00 2022] GET /compute/v2.1/servers/e9d712ce-903d-4604-a9aa-98df3d168aa9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:46:00.554790 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-61edb9f7-811b-4663-8920-84186222e185 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '.version_select at 0x7fbf8c650c10>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:00.580546 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-61edb9f7-811b-4663-8920-84186222e185 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-663951618" status: 202 len: 0 microversion: 2.1 time: 0.030703 Jul 20 05:46:00.581635 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3882/7661] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 05:46:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-663951618 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:46:00.605951 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f8a20766-df0a-43c1-87d8-85a9fadb07b1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Action: 'create', calling method: .version_select at 0x7fbf8ffcd550>, body: {"keypair": {"name": "tempest-TestShelveInstance-244730065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Q0QCf3pH9G/QCdlzJ1vV5g2KFgFEPlUtDgCCqisRHT0OELlwPatqL5ojDl6aE3aQi7erO3U06JNJnT3QrbZBQZLc2Jg0/JNK8GJzH+L+aVxJbn36Ku+D0yfy2QGQiQw=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:46:00.620913 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-f8a20766-df0a-43c1-87d8-85a9fadb07b1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Getting quotas for project 1e4867d0794645a5b92fcc63bf141b83. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:46:00.626408 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-f8a20766-df0a-43c1-87d8-85a9fadb07b1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Getting quotas for user 591f755cb7cf4eec9aca672b661cf8ff and project 1e4867d0794645a5b92fcc63bf141b83. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:46:00.655821 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f8a20766-df0a-43c1-87d8-85a9fadb07b1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.053726 Jul 20 05:46:00.656506 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3780/7662] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:46:00 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:46:16.743589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:46:16.744437 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:46:16.752642 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1843043214", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-244730065", "security_groups": [{"name": "tempest-secgroup-smoke-1393176694"}], "networks": [{"uuid": "9c7664b0-aa4d-4260-b2e4-625f7cf15d26"}], "block_device_mapping_v2": [{"uuid": "82262d46-caea-4ba6-ad1f-e80a6804d763", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:46:16.865936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] validate_networks() for [('9c7664b0-aa4d-4260-b2e4-625f7cf15d26', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:46:17.232464 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:46:17.232906 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:46:17.233395 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:46:17.233817 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:46:17.234237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:46:17.244163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:17.244629 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:17.245436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:17.245936 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:17.263077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Getting quotas for project 1e4867d0794645a5b92fcc63bf141b83. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:46:17.268424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Getting quotas for user 591f755cb7cf4eec9aca672b661cf8ff and project 1e4867d0794645a5b92fcc63bf141b83. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:46:17.328766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:46:17.330944 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82262d46-caea-4ba6-ad1f-e80a6804d763',volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:46:17.460759 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-dd545000-5460-4d0f-9b8e-66187f2a053f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.718994 Jul 20 05:46:17.461430 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3883/7663] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:46:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:46:17.469619 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=12 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:46:17.470484 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=4 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:46:17.471586 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:46:17.476962 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7db91601-1b1d-4c7e-8c90-8d4ee51bf32f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:17.478406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7db91601-1b1d-4c7e-8c90-8d4ee51bf32f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:17.535972 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7db91601-1b1d-4c7e-8c90-8d4ee51bf32f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:17.542830 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7db91601-1b1d-4c7e-8c90-8d4ee51bf32f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1088 microversion: 2.1 time: 0.075067 Jul 20 05:46:17.543400 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3781/7664] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:17 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:18.560625 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5a7807be-a069-47e3-88c5-7a1ffcbe7460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:18.561269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5a7807be-a069-47e3-88c5-7a1ffcbe7460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:18.570262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a7807be-a069-47e3-88c5-7a1ffcbe7460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:18.570956 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a7807be-a069-47e3-88c5-7a1ffcbe7460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:18.572655 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a7807be-a069-47e3-88c5-7a1ffcbe7460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:18.573128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5a7807be-a069-47e3-88c5-7a1ffcbe7460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:18.653028 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5a7807be-a069-47e3-88c5-7a1ffcbe7460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:18.662280 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5a7807be-a069-47e3-88c5-7a1ffcbe7460 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1204 microversion: 2.1 time: 0.105527 Jul 20 05:46:18.662879 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3884/7665] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:18 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1204 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:19.679868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-9a161ba6-b799-4b8d-8eda-bb365016a31c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:19.681138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-9a161ba6-b799-4b8d-8eda-bb365016a31c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:19.690969 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a161ba6-b799-4b8d-8eda-bb365016a31c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:19.691393 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a161ba6-b799-4b8d-8eda-bb365016a31c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:19.692416 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a161ba6-b799-4b8d-8eda-bb365016a31c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:19.692862 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-9a161ba6-b799-4b8d-8eda-bb365016a31c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:19.843461 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-9a161ba6-b799-4b8d-8eda-bb365016a31c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:19.852178 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-9a161ba6-b799-4b8d-8eda-bb365016a31c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1272 microversion: 2.1 time: 0.176837 Jul 20 05:46:19.852789 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3782/7666] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:19 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:20.165707 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-02c4fa87-c5b9-49f6-abcc-da3953e39cb9 req-eed785a7-2427-4eef-bb7c-5184ce7f824d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0977617-546a-43a5-b12c-9ded87691afc", "tag": "8c07ca59-9529-4150-b74a-0db071d22698"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:46:20.192638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-02c4fa87-c5b9-49f6-abcc-da3953e39cb9 req-eed785a7-2427-4eef-bb7c-5184ce7f824d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:20.193175 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-02c4fa87-c5b9-49f6-abcc-da3953e39cb9 req-eed785a7-2427-4eef-bb7c-5184ce7f824d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:20.208264 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-02c4fa87-c5b9-49f6-abcc-da3953e39cb9 req-eed785a7-2427-4eef-bb7c-5184ce7f824d service nova] Creating event network-changed:8c07ca59-9529-4150-b74a-0db071d22698 for instance e0977617-546a-43a5-b12c-9ded87691afc on n-h1-764485-11 Jul 20 05:46:20.217475 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-02c4fa87-c5b9-49f6-abcc-da3953e39cb9 req-eed785a7-2427-4eef-bb7c-5184ce7f824d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055783 Jul 20 05:46:20.218668 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3885/7667] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:46:20.869502 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6297d469-ada9-4b53-aaad-4116af8325b6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:20.870117 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6297d469-ada9-4b53-aaad-4116af8325b6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:20.879195 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6297d469-ada9-4b53-aaad-4116af8325b6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:20.879723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6297d469-ada9-4b53-aaad-4116af8325b6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:20.880590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6297d469-ada9-4b53-aaad-4116af8325b6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:20.881310 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6297d469-ada9-4b53-aaad-4116af8325b6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:21.026279 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6297d469-ada9-4b53-aaad-4116af8325b6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:21.035793 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6297d469-ada9-4b53-aaad-4116af8325b6 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1272 microversion: 2.1 time: 0.170319 Jul 20 05:46:21.036506 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3783/7668] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:20 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:22.054567 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fcb356f9-6e50-422a-9c5e-134581d63a28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:22.055293 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fcb356f9-6e50-422a-9c5e-134581d63a28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:22.061716 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fcb356f9-6e50-422a-9c5e-134581d63a28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:22.062186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fcb356f9-6e50-422a-9c5e-134581d63a28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:22.062971 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fcb356f9-6e50-422a-9c5e-134581d63a28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:22.063431 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fcb356f9-6e50-422a-9c5e-134581d63a28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:22.201154 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fcb356f9-6e50-422a-9c5e-134581d63a28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:22.209366 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fcb356f9-6e50-422a-9c5e-134581d63a28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1272 microversion: 2.1 time: 0.160363 Jul 20 05:46:22.209947 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3886/7669] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:22 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:23.226670 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b3a7c041-68a0-403d-9851-68aed979c0cc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:23.227294 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b3a7c041-68a0-403d-9851-68aed979c0cc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:23.234895 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3a7c041-68a0-403d-9851-68aed979c0cc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:23.235353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3a7c041-68a0-403d-9851-68aed979c0cc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:23.236207 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3a7c041-68a0-403d-9851-68aed979c0cc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:23.236655 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3a7c041-68a0-403d-9851-68aed979c0cc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:23.378471 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b3a7c041-68a0-403d-9851-68aed979c0cc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:23.386074 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b3a7c041-68a0-403d-9851-68aed979c0cc tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1272 microversion: 2.1 time: 0.164036 Jul 20 05:46:23.386595 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3784/7670] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:23 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:24.402887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-fd354ad0-daa0-4ea4-bfd2-8b38bfa8214d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:24.403526 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-fd354ad0-daa0-4ea4-bfd2-8b38bfa8214d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:24.410393 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fd354ad0-daa0-4ea4-bfd2-8b38bfa8214d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:24.410847 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fd354ad0-daa0-4ea4-bfd2-8b38bfa8214d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:24.411651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fd354ad0-daa0-4ea4-bfd2-8b38bfa8214d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:24.412133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-fd354ad0-daa0-4ea4-bfd2-8b38bfa8214d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:24.546628 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-fd354ad0-daa0-4ea4-bfd2-8b38bfa8214d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:24.554879 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-fd354ad0-daa0-4ea4-bfd2-8b38bfa8214d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1260 microversion: 2.1 time: 0.155928 Jul 20 05:46:24.555458 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3887/7671] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:24 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:25.572704 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a057d77b-dfb9-4da7-8cd3-2b2a28422bb5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:25.573319 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a057d77b-dfb9-4da7-8cd3-2b2a28422bb5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:25.580372 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a057d77b-dfb9-4da7-8cd3-2b2a28422bb5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:25.580820 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a057d77b-dfb9-4da7-8cd3-2b2a28422bb5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:25.582177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a057d77b-dfb9-4da7-8cd3-2b2a28422bb5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:25.582647 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a057d77b-dfb9-4da7-8cd3-2b2a28422bb5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:25.713252 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a057d77b-dfb9-4da7-8cd3-2b2a28422bb5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:25.720782 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a057d77b-dfb9-4da7-8cd3-2b2a28422bb5 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1260 microversion: 2.1 time: 0.152018 Jul 20 05:46:25.721508 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3785/7672] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:25 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:26.738492 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-1eabcecd-4d69-4055-9bb3-f29d6b4e3fd8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:26.739121 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-1eabcecd-4d69-4055-9bb3-f29d6b4e3fd8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:26.746102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1eabcecd-4d69-4055-9bb3-f29d6b4e3fd8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:26.746569 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1eabcecd-4d69-4055-9bb3-f29d6b4e3fd8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:26.747345 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1eabcecd-4d69-4055-9bb3-f29d6b4e3fd8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:26.747825 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-1eabcecd-4d69-4055-9bb3-f29d6b4e3fd8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:26.883539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-1eabcecd-4d69-4055-9bb3-f29d6b4e3fd8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:26.891094 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-1eabcecd-4d69-4055-9bb3-f29d6b4e3fd8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1260 microversion: 2.1 time: 0.157129 Jul 20 05:46:26.891712 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3888/7673] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:26 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:27.908490 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-ce489733-6265-44d3-b5e1-73dae6a3ce30 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:27.909331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-ce489733-6265-44d3-b5e1-73dae6a3ce30 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:27.912115 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:46:27.918031 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce489733-6265-44d3-b5e1-73dae6a3ce30 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:27.918486 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce489733-6265-44d3-b5e1-73dae6a3ce30 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:27.919285 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce489733-6265-44d3-b5e1-73dae6a3ce30 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:27.919758 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-ce489733-6265-44d3-b5e1-73dae6a3ce30 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:28.053309 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-ce489733-6265-44d3-b5e1-73dae6a3ce30 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:28.060903 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-ce489733-6265-44d3-b5e1-73dae6a3ce30 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1260 microversion: 2.1 time: 0.156321 Jul 20 05:46:28.061480 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3786/7674] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:27 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:29.078564 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e06d1754-903a-4a50-a17c-9f12516a3f1f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:29.079149 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e06d1754-903a-4a50-a17c-9f12516a3f1f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:29.081780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:46:29.082659 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:46:29.088406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e06d1754-903a-4a50-a17c-9f12516a3f1f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:29.088869 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e06d1754-903a-4a50-a17c-9f12516a3f1f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:29.089651 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e06d1754-903a-4a50-a17c-9f12516a3f1f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:29.090107 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e06d1754-903a-4a50-a17c-9f12516a3f1f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:29.220889 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e06d1754-903a-4a50-a17c-9f12516a3f1f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:29.228903 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e06d1754-903a-4a50-a17c-9f12516a3f1f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1260 microversion: 2.1 time: 0.154640 Jul 20 05:46:29.229496 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3889/7675] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:29 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:30.246233 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3294b643-f696-4e4b-8827-cc48065eed9b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:30.246871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3294b643-f696-4e4b-8827-cc48065eed9b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:30.254293 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3294b643-f696-4e4b-8827-cc48065eed9b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:30.254802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3294b643-f696-4e4b-8827-cc48065eed9b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:30.255618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3294b643-f696-4e4b-8827-cc48065eed9b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:30.256065 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3294b643-f696-4e4b-8827-cc48065eed9b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:30.723103 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3294b643-f696-4e4b-8827-cc48065eed9b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:30.731034 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3294b643-f696-4e4b-8827-cc48065eed9b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1260 microversion: 2.1 time: 0.488732 Jul 20 05:46:30.731937 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3787/7676] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:30 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1260 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:31.749354 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-df06544a-a10a-4978-b162-996c397e90a7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:31.749991 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-df06544a-a10a-4978-b162-996c397e90a7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:31.759128 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df06544a-a10a-4978-b162-996c397e90a7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:31.759627 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df06544a-a10a-4978-b162-996c397e90a7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:31.760423 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df06544a-a10a-4978-b162-996c397e90a7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:31.760879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-df06544a-a10a-4978-b162-996c397e90a7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:32.171131 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-df06544a-a10a-4978-b162-996c397e90a7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:32.179754 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-df06544a-a10a-4978-b162-996c397e90a7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1260 microversion: 2.1 time: 0.434507 Jul 20 05:46:32.180532 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3890/7677] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:31 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1260 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:33.197462 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-2babba6c-5b48-4f40-9613-adf47fa98ce0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:33.198085 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-2babba6c-5b48-4f40-9613-adf47fa98ce0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:33.204228 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2babba6c-5b48-4f40-9613-adf47fa98ce0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:33.204680 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2babba6c-5b48-4f40-9613-adf47fa98ce0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:33.205446 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2babba6c-5b48-4f40-9613-adf47fa98ce0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:33.207068 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-2babba6c-5b48-4f40-9613-adf47fa98ce0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:33.341357 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-2babba6c-5b48-4f40-9613-adf47fa98ce0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:33.349469 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-2babba6c-5b48-4f40-9613-adf47fa98ce0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1260 microversion: 2.1 time: 0.156801 Jul 20 05:46:33.350048 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3788/7678] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:33 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:33.898607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-d8ea7dcd-62a1-41ea-a865-157822043102 req-218a304c-50c4-4e72-a8a8-5a0d5a82cb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0977617-546a-43a5-b12c-9ded87691afc", "name": "network-vif-plugged", "status": "completed", "tag": "8c07ca59-9529-4150-b74a-0db071d22698"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:46:33.908460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d8ea7dcd-62a1-41ea-a865-157822043102 req-218a304c-50c4-4e72-a8a8-5a0d5a82cb6d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:33.909541 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-d8ea7dcd-62a1-41ea-a865-157822043102 req-218a304c-50c4-4e72-a8a8-5a0d5a82cb6d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:33.921126 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-d8ea7dcd-62a1-41ea-a865-157822043102 req-218a304c-50c4-4e72-a8a8-5a0d5a82cb6d service nova] Creating event network-vif-plugged:8c07ca59-9529-4150-b74a-0db071d22698 for instance e0977617-546a-43a5-b12c-9ded87691afc on n-h1-764485-11 Jul 20 05:46:33.926689 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-d8ea7dcd-62a1-41ea-a865-157822043102 req-218a304c-50c4-4e72-a8a8-5a0d5a82cb6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031943 Jul 20 05:46:33.927291 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3891/7679] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:46:34.366988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a5912201-bb60-48a7-b184-23418238e00b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:34.367898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a5912201-bb60-48a7-b184-23418238e00b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:34.376225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5912201-bb60-48a7-b184-23418238e00b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:34.376742 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5912201-bb60-48a7-b184-23418238e00b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:34.378247 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5912201-bb60-48a7-b184-23418238e00b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:34.378953 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a5912201-bb60-48a7-b184-23418238e00b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:34.794138 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a5912201-bb60-48a7-b184-23418238e00b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:34.802660 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a5912201-bb60-48a7-b184-23418238e00b tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1260 microversion: 2.1 time: 0.439546 Jul 20 05:46:34.803217 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3789/7680] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:34 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1260 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:35.821169 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f478bd26-c760-422f-aafd-63c1598a7138 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:35.821890 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f478bd26-c760-422f-aafd-63c1598a7138 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:35.828330 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f478bd26-c760-422f-aafd-63c1598a7138 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:35.828796 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f478bd26-c760-422f-aafd-63c1598a7138 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:35.829600 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f478bd26-c760-422f-aafd-63c1598a7138 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:35.830061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f478bd26-c760-422f-aafd-63c1598a7138 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:35.964078 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f478bd26-c760-422f-aafd-63c1598a7138 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:35.971598 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f478bd26-c760-422f-aafd-63c1598a7138 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1445 microversion: 2.1 time: 0.155539 Jul 20 05:46:35.972175 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3892/7681] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:35 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:35.988287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-53a9fdcd-f266-434c-a812-5cffc2aefe2e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:46:35.988940 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-53a9fdcd-f266-434c-a812-5cffc2aefe2e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:46:35.995957 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53a9fdcd-f266-434c-a812-5cffc2aefe2e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:35.996427 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53a9fdcd-f266-434c-a812-5cffc2aefe2e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:35.997199 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53a9fdcd-f266-434c-a812-5cffc2aefe2e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:35.997653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-53a9fdcd-f266-434c-a812-5cffc2aefe2e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:36.132125 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-53a9fdcd-f266-434c-a812-5cffc2aefe2e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:46:36.139734 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-53a9fdcd-f266-434c-a812-5cffc2aefe2e tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1445 microversion: 2.1 time: 0.155915 Jul 20 05:46:36.140300 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3790/7682] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:46:35 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:46:37.832362 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-22527855-fbe7-47be-adae-fafbd9afdb27 req-ace7d05f-76c8-4e6b-91a4-b8456acf0919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0977617-546a-43a5-b12c-9ded87691afc", "tag": "8c07ca59-9529-4150-b74a-0db071d22698"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:46:37.842054 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-22527855-fbe7-47be-adae-fafbd9afdb27 req-ace7d05f-76c8-4e6b-91a4-b8456acf0919 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:46:37.842605 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-22527855-fbe7-47be-adae-fafbd9afdb27 req-ace7d05f-76c8-4e6b-91a4-b8456acf0919 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:46:37.854448 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-22527855-fbe7-47be-adae-fafbd9afdb27 req-ace7d05f-76c8-4e6b-91a4-b8456acf0919 service nova] Creating event network-changed:8c07ca59-9529-4150-b74a-0db071d22698 for instance e0977617-546a-43a5-b12c-9ded87691afc on n-h1-764485-11 Jul 20 05:46:37.859746 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-22527855-fbe7-47be-adae-fafbd9afdb27 req-ace7d05f-76c8-4e6b-91a4-b8456acf0919 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032018 Jul 20 05:46:37.860460 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3893/7683] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:48:30.632384 n-d-764485-11 devstack@n-api.service[119807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [86bbcd4a-2dc6-48ea-bdc8-94fb9e64045f] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:48:30.633665 n-d-764485-11 devstack@n-api.service[119807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a8eca7-3df2-4c6d-a372-7fc57edb945c] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:48:30.634213 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=22 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:48:30.634988 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=54 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:48:30.639178 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d88bb0fb-93b5-49af-8b7b-919dafc79e8d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:48:30.639752 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d88bb0fb-93b5-49af-8b7b-919dafc79e8d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:30.646867 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d88bb0fb-93b5-49af-8b7b-919dafc79e8d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:30.647268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d88bb0fb-93b5-49af-8b7b-919dafc79e8d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:30.648079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d88bb0fb-93b5-49af-8b7b-919dafc79e8d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:30.649038 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d88bb0fb-93b5-49af-8b7b-919dafc79e8d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:30.673126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.objects.instance [None req-d88bb0fb-93b5-49af-8b7b-919dafc79e8d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lazy-loading 'flavor' on Instance uuid e0977617-546a-43a5-b12c-9ded87691afc {{(pid=119807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:48:30.753479 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d88bb0fb-93b5-49af-8b7b-919dafc79e8d tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "POST /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc/action" status: 202 len: 0 microversion: 2.1 time: 0.122660 Jul 20 05:48:30.754079 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3791/7684] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:48:30 2022] POST /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:48:30.760825 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7f015b8-ffde-4af0-8b21-123d24411373] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:48:30.761650 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4776198a-db9f-4da8-a9d3-98de639ffb43] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:48:30.762263 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:48:30.763056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=50 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:48:30.767691 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c83363e2-76ad-498f-93ee-0b6944e48aa4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:30.768424 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c83363e2-76ad-498f-93ee-0b6944e48aa4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:30.777363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c83363e2-76ad-498f-93ee-0b6944e48aa4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:30.777681 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c83363e2-76ad-498f-93ee-0b6944e48aa4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:30.778487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c83363e2-76ad-498f-93ee-0b6944e48aa4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:30.778950 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c83363e2-76ad-498f-93ee-0b6944e48aa4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:30.973190 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c83363e2-76ad-498f-93ee-0b6944e48aa4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:30.980956 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c83363e2-76ad-498f-93ee-0b6944e48aa4 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.222153 Jul 20 05:48:30.981528 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3894/7685] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:30 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:48:32.003090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f009e68f-490b-40cb-a105-4de4ca3f2c28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:32.003826 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f009e68f-490b-40cb-a105-4de4ca3f2c28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:32.011989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f009e68f-490b-40cb-a105-4de4ca3f2c28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:32.012437 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f009e68f-490b-40cb-a105-4de4ca3f2c28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:32.013203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f009e68f-490b-40cb-a105-4de4ca3f2c28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:32.013636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f009e68f-490b-40cb-a105-4de4ca3f2c28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:32.020415 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] [86bbcd4a-2dc6-48ea-bdc8-94fb9e64045f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55626. Jul 20 05:48:32.021188 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a8eca7-3df2-4c6d-a372-7fc57edb945c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55628. Jul 20 05:48:32.198378 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-f009e68f-490b-40cb-a105-4de4ca3f2c28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:32.205919 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f009e68f-490b-40cb-a105-4de4ca3f2c28 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.210760 Jul 20 05:48:32.206477 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3792/7686] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:31 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:33.224076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e5b76a9a-0b24-4fab-9ced-85045be9c4d7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:33.224718 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e5b76a9a-0b24-4fab-9ced-85045be9c4d7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:33.235981 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5b76a9a-0b24-4fab-9ced-85045be9c4d7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:33.236452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5b76a9a-0b24-4fab-9ced-85045be9c4d7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:33.237245 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5b76a9a-0b24-4fab-9ced-85045be9c4d7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:33.237702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e5b76a9a-0b24-4fab-9ced-85045be9c4d7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:33.241700 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7f015b8-ffde-4af0-8b21-123d24411373] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55634. Jul 20 05:48:33.243699 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] [4776198a-db9f-4da8-a9d3-98de639ffb43] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55636. Jul 20 05:48:33.373766 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e5b76a9a-0b24-4fab-9ced-85045be9c4d7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:33.381590 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e5b76a9a-0b24-4fab-9ced-85045be9c4d7 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.161427 Jul 20 05:48:33.382160 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3895/7687] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:33 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:34.398070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-226f136f-6d67-4abe-bc7b-cf92cab5c5f1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:34.398877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-226f136f-6d67-4abe-bc7b-cf92cab5c5f1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:34.405863 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-226f136f-6d67-4abe-bc7b-cf92cab5c5f1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:34.406312 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-226f136f-6d67-4abe-bc7b-cf92cab5c5f1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:34.407200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-226f136f-6d67-4abe-bc7b-cf92cab5c5f1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:34.407746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-226f136f-6d67-4abe-bc7b-cf92cab5c5f1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:34.538848 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-226f136f-6d67-4abe-bc7b-cf92cab5c5f1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:34.547262 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-226f136f-6d67-4abe-bc7b-cf92cab5c5f1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.153216 Jul 20 05:48:34.547860 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3793/7688] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:34 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:35.564891 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c7d44716-ddf7-4a0c-87ac-3e4ceda1eb56 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:35.565554 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c7d44716-ddf7-4a0c-87ac-3e4ceda1eb56 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:35.572780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7d44716-ddf7-4a0c-87ac-3e4ceda1eb56 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:35.573244 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7d44716-ddf7-4a0c-87ac-3e4ceda1eb56 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:35.574064 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7d44716-ddf7-4a0c-87ac-3e4ceda1eb56 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:35.574524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7d44716-ddf7-4a0c-87ac-3e4ceda1eb56 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:35.708273 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c7d44716-ddf7-4a0c-87ac-3e4ceda1eb56 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:35.715890 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c7d44716-ddf7-4a0c-87ac-3e4ceda1eb56 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.154949 Jul 20 05:48:35.716497 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3896/7689] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:35 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:35.740154 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:48:35.740361 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:48:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:48:35.754066 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 20 05:48:35.754066 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:48:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:48:36.733590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-050743ed-daf6-4a50-8ea6-7db5f4f084ab tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:36.734211 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-050743ed-daf6-4a50-8ea6-7db5f4f084ab tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:36.741073 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-050743ed-daf6-4a50-8ea6-7db5f4f084ab tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:36.741524 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-050743ed-daf6-4a50-8ea6-7db5f4f084ab tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:36.742444 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-050743ed-daf6-4a50-8ea6-7db5f4f084ab tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:36.742883 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-050743ed-daf6-4a50-8ea6-7db5f4f084ab tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:36.879729 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-050743ed-daf6-4a50-8ea6-7db5f4f084ab tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:36.888311 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-050743ed-daf6-4a50-8ea6-7db5f4f084ab tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.158663 Jul 20 05:48:36.888997 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3794/7690] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:36 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:36.902920 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:48:36.903080 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:48:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:48:37.338845 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:48:37.339076 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:48:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:48:37.905065 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-143cd9ef-798f-4951-b976-25b2735168ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:37.905706 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-143cd9ef-798f-4951-b976-25b2735168ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:37.913277 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-143cd9ef-798f-4951-b976-25b2735168ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:37.914494 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-143cd9ef-798f-4951-b976-25b2735168ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:37.915436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-143cd9ef-798f-4951-b976-25b2735168ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:37.915922 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-143cd9ef-798f-4951-b976-25b2735168ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:38.053860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-143cd9ef-798f-4951-b976-25b2735168ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:38.061696 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-143cd9ef-798f-4951-b976-25b2735168ae tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.160540 Jul 20 05:48:38.062273 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3897/7691] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:37 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:39.079295 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-87b7458e-9d92-4403-9793-7f1c42b76a88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:39.080355 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-87b7458e-9d92-4403-9793-7f1c42b76a88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:39.088054 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87b7458e-9d92-4403-9793-7f1c42b76a88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:39.088514 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87b7458e-9d92-4403-9793-7f1c42b76a88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:39.089284 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87b7458e-9d92-4403-9793-7f1c42b76a88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:39.089751 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-87b7458e-9d92-4403-9793-7f1c42b76a88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:39.222407 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-87b7458e-9d92-4403-9793-7f1c42b76a88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:39.230333 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-87b7458e-9d92-4403-9793-7f1c42b76a88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.155401 Jul 20 05:48:39.230910 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3795/7692] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:39 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:40.248269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-8c6c3988-b70f-47cd-b852-f1701ef6e01a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:40.248900 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-8c6c3988-b70f-47cd-b852-f1701ef6e01a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:40.256172 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c6c3988-b70f-47cd-b852-f1701ef6e01a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:40.256637 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c6c3988-b70f-47cd-b852-f1701ef6e01a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:40.257460 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c6c3988-b70f-47cd-b852-f1701ef6e01a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:40.258070 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-8c6c3988-b70f-47cd-b852-f1701ef6e01a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:40.390454 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-8c6c3988-b70f-47cd-b852-f1701ef6e01a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:40.398714 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-8c6c3988-b70f-47cd-b852-f1701ef6e01a tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.153879 Jul 20 05:48:40.399297 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3898/7693] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:40 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:41.416406 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b37cee67-96b2-4070-b72f-a0ec087d09f3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:41.416952 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b37cee67-96b2-4070-b72f-a0ec087d09f3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:41.424370 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b37cee67-96b2-4070-b72f-a0ec087d09f3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:41.424831 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b37cee67-96b2-4070-b72f-a0ec087d09f3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:41.425601 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b37cee67-96b2-4070-b72f-a0ec087d09f3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:41.426042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b37cee67-96b2-4070-b72f-a0ec087d09f3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:41.561746 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b37cee67-96b2-4070-b72f-a0ec087d09f3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:41.569295 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b37cee67-96b2-4070-b72f-a0ec087d09f3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.157874 Jul 20 05:48:41.570000 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3796/7694] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:41 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:42.588770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-e9431d92-1071-4a4e-b56c-816d427c0ab0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:42.589487 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-e9431d92-1071-4a4e-b56c-816d427c0ab0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:42.596465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9431d92-1071-4a4e-b56c-816d427c0ab0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:42.596928 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9431d92-1071-4a4e-b56c-816d427c0ab0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:42.597704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9431d92-1071-4a4e-b56c-816d427c0ab0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:42.598162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-e9431d92-1071-4a4e-b56c-816d427c0ab0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:42.729295 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-e9431d92-1071-4a4e-b56c-816d427c0ab0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:42.736985 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-e9431d92-1071-4a4e-b56c-816d427c0ab0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.153193 Jul 20 05:48:42.737585 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3899/7695] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:42 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:43.754689 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e0a3a143-f594-465d-8356-cdc3ff1985c1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:43.755569 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-e0a3a143-f594-465d-8356-cdc3ff1985c1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:43.764636 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0a3a143-f594-465d-8356-cdc3ff1985c1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:43.765129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0a3a143-f594-465d-8356-cdc3ff1985c1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:43.766234 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0a3a143-f594-465d-8356-cdc3ff1985c1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:43.766785 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-e0a3a143-f594-465d-8356-cdc3ff1985c1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:43.914832 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-e0a3a143-f594-465d-8356-cdc3ff1985c1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:43.922703 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e0a3a143-f594-465d-8356-cdc3ff1985c1 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.171986 Jul 20 05:48:43.923494 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3797/7696] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:43 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:44.940269 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a9a50aab-b56e-4928-83b1-f821dbb62a11 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:44.940864 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a9a50aab-b56e-4928-83b1-f821dbb62a11 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:44.948709 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9a50aab-b56e-4928-83b1-f821dbb62a11 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:44.949186 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9a50aab-b56e-4928-83b1-f821dbb62a11 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:44.949982 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9a50aab-b56e-4928-83b1-f821dbb62a11 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:44.950447 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a9a50aab-b56e-4928-83b1-f821dbb62a11 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:45.086125 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a9a50aab-b56e-4928-83b1-f821dbb62a11 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:45.094139 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a9a50aab-b56e-4928-83b1-f821dbb62a11 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1570 microversion: 2.1 time: 0.157848 Jul 20 05:48:45.094755 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3900/7697] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:44 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:45.112504 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-915c1039-9c42-4dd2-8c1a-d0260b806820 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:48:45.113077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-915c1039-9c42-4dd2-8c1a-d0260b806820 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:45.120917 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-915c1039-9c42-4dd2-8c1a-d0260b806820 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:45.121364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-915c1039-9c42-4dd2-8c1a-d0260b806820 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:45.122135 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-915c1039-9c42-4dd2-8c1a-d0260b806820 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:45.122582 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-915c1039-9c42-4dd2-8c1a-d0260b806820 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:45.255327 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-915c1039-9c42-4dd2-8c1a-d0260b806820 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "POST /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc/action" status: 202 len: 0 microversion: 2.1 time: 0.146788 Jul 20 05:48:45.255970 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3798/7698] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:48:45 2022] POST /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:48:45.264137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c372c34e-c05a-4847-b836-2bb5bad3d992 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:45.264764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c372c34e-c05a-4847-b836-2bb5bad3d992 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:45.270743 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c372c34e-c05a-4847-b836-2bb5bad3d992 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:45.271208 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c372c34e-c05a-4847-b836-2bb5bad3d992 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:45.272017 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c372c34e-c05a-4847-b836-2bb5bad3d992 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:45.272472 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c372c34e-c05a-4847-b836-2bb5bad3d992 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:45.431548 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c372c34e-c05a-4847-b836-2bb5bad3d992 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:45.439292 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c372c34e-c05a-4847-b836-2bb5bad3d992 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1518 microversion: 2.1 time: 0.179033 Jul 20 05:48:45.440178 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3901/7699] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:45 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:46.346157 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6531e8ef-1678-48e7-af66-4d673a86a854 req-cabeb9b6-d3a1-4852-a043-d271039744f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0977617-546a-43a5-b12c-9ded87691afc", "name": "network-vif-unplugged", "status": "completed", "tag": "8c07ca59-9529-4150-b74a-0db071d22698"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:48:46.357364 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6531e8ef-1678-48e7-af66-4d673a86a854 req-cabeb9b6-d3a1-4852-a043-d271039744f7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:46.357960 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6531e8ef-1678-48e7-af66-4d673a86a854 req-cabeb9b6-d3a1-4852-a043-d271039744f7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:46.370190 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.compute.server_external_events [req-6531e8ef-1678-48e7-af66-4d673a86a854 req-cabeb9b6-d3a1-4852-a043-d271039744f7 service nova] Unable to find a host for instance e0977617-546a-43a5-b12c-9ded87691afc. Dropping event network-vif-unplugged {{(pid=119807) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 05:48:46.371102 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6531e8ef-1678-48e7-af66-4d673a86a854 req-cabeb9b6-d3a1-4852-a043-d271039744f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030286 Jul 20 05:48:46.371738 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3799/7700] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 05:48:46.456786 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a63ce8c1-e8b5-493e-8c46-2622fd20f084 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:46.457421 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a63ce8c1-e8b5-493e-8c46-2622fd20f084 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:46.465143 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a63ce8c1-e8b5-493e-8c46-2622fd20f084 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:46.465619 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a63ce8c1-e8b5-493e-8c46-2622fd20f084 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:46.466403 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a63ce8c1-e8b5-493e-8c46-2622fd20f084 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:46.466860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a63ce8c1-e8b5-493e-8c46-2622fd20f084 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:46.604582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a63ce8c1-e8b5-493e-8c46-2622fd20f084 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:46.612359 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a63ce8c1-e8b5-493e-8c46-2622fd20f084 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1520 microversion: 2.1 time: 0.159577 Jul 20 05:48:46.612933 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3902/7701] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:46 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:47.630659 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-09018680-184e-4a0a-bc4c-61ba89f33714 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:47.631179 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-09018680-184e-4a0a-bc4c-61ba89f33714 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:47.639042 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-09018680-184e-4a0a-bc4c-61ba89f33714 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:47.639557 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-09018680-184e-4a0a-bc4c-61ba89f33714 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:47.640675 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-09018680-184e-4a0a-bc4c-61ba89f33714 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:47.641114 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-09018680-184e-4a0a-bc4c-61ba89f33714 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:47.777111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-09018680-184e-4a0a-bc4c-61ba89f33714 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:47.784891 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-09018680-184e-4a0a-bc4c-61ba89f33714 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1520 microversion: 2.1 time: 0.158381 Jul 20 05:48:47.785473 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3800/7702] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:47 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:48.802463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-80b76842-725c-4bf9-9824-d6d9c59a6a49 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:48.803105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-80b76842-725c-4bf9-9824-d6d9c59a6a49 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:48.811751 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80b76842-725c-4bf9-9824-d6d9c59a6a49 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:48.812229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80b76842-725c-4bf9-9824-d6d9c59a6a49 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:48.813032 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80b76842-725c-4bf9-9824-d6d9c59a6a49 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:48.813524 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-80b76842-725c-4bf9-9824-d6d9c59a6a49 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:48.977235 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-80b76842-725c-4bf9-9824-d6d9c59a6a49 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:48.985676 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-80b76842-725c-4bf9-9824-d6d9c59a6a49 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1520 microversion: 2.1 time: 0.187115 Jul 20 05:48:48.986385 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3903/7703] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:48 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:50.006005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-a94cb67d-26a9-4fc0-9f61-e52e432fe0fd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:50.006587 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-a94cb67d-26a9-4fc0-9f61-e52e432fe0fd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:50.013648 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a94cb67d-26a9-4fc0-9f61-e52e432fe0fd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:50.014113 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a94cb67d-26a9-4fc0-9f61-e52e432fe0fd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:50.014898 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a94cb67d-26a9-4fc0-9f61-e52e432fe0fd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:50.015346 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-a94cb67d-26a9-4fc0-9f61-e52e432fe0fd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:50.162442 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-a94cb67d-26a9-4fc0-9f61-e52e432fe0fd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:50.170841 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-a94cb67d-26a9-4fc0-9f61-e52e432fe0fd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1520 microversion: 2.1 time: 0.168818 Jul 20 05:48:50.171437 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3801/7704] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:50 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:51.188770 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-96bdd97c-c063-4b08-a4c7-8eff8586c8ed tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:51.189595 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-96bdd97c-c063-4b08-a4c7-8eff8586c8ed tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:51.197324 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96bdd97c-c063-4b08-a4c7-8eff8586c8ed tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:51.197807 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96bdd97c-c063-4b08-a4c7-8eff8586c8ed tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:51.198563 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96bdd97c-c063-4b08-a4c7-8eff8586c8ed tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:51.199014 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-96bdd97c-c063-4b08-a4c7-8eff8586c8ed tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:51.339122 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-96bdd97c-c063-4b08-a4c7-8eff8586c8ed tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:51.346747 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-96bdd97c-c063-4b08-a4c7-8eff8586c8ed tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1576 microversion: 2.1 time: 0.162428 Jul 20 05:48:51.347336 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3904/7705] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:51 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:48:52.363469 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b3bed628-4e8c-419a-b1ce-85a2815f7b88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:52.364130 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b3bed628-4e8c-419a-b1ce-85a2815f7b88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:52.371145 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3bed628-4e8c-419a-b1ce-85a2815f7b88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:52.371634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3bed628-4e8c-419a-b1ce-85a2815f7b88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:52.372409 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3bed628-4e8c-419a-b1ce-85a2815f7b88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:52.372849 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b3bed628-4e8c-419a-b1ce-85a2815f7b88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:52.503447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b3bed628-4e8c-419a-b1ce-85a2815f7b88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:52.511184 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b3bed628-4e8c-419a-b1ce-85a2815f7b88 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1576 microversion: 2.1 time: 0.151676 Jul 20 05:48:52.511790 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3802/7706] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:52 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:53.529023 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c7fbbb04-e36d-479b-823b-0019887763cf tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:53.529662 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c7fbbb04-e36d-479b-823b-0019887763cf tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:53.536764 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7fbbb04-e36d-479b-823b-0019887763cf tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:53.537237 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7fbbb04-e36d-479b-823b-0019887763cf tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:53.538019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7fbbb04-e36d-479b-823b-0019887763cf tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:53.538555 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c7fbbb04-e36d-479b-823b-0019887763cf tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:53.671808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c7fbbb04-e36d-479b-823b-0019887763cf tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:53.679734 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c7fbbb04-e36d-479b-823b-0019887763cf tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1576 microversion: 2.1 time: 0.154497 Jul 20 05:48:53.680312 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3905/7707] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:53 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:54.695961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-d0dc51a5-0df6-47f0-b449-a76232cf3825 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:54.697087 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-d0dc51a5-0df6-47f0-b449-a76232cf3825 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:54.703589 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d0dc51a5-0df6-47f0-b449-a76232cf3825 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:54.704049 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d0dc51a5-0df6-47f0-b449-a76232cf3825 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:54.704818 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d0dc51a5-0df6-47f0-b449-a76232cf3825 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:54.705262 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-d0dc51a5-0df6-47f0-b449-a76232cf3825 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:54.841329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-d0dc51a5-0df6-47f0-b449-a76232cf3825 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:54.848978 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-d0dc51a5-0df6-47f0-b449-a76232cf3825 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1576 microversion: 2.1 time: 0.156915 Jul 20 05:48:54.849539 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3803/7708] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:54 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:55.866192 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-90a1a53c-34f9-4cdd-bc28-a420806c2ad8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:55.866828 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-90a1a53c-34f9-4cdd-bc28-a420806c2ad8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:55.874746 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90a1a53c-34f9-4cdd-bc28-a420806c2ad8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:55.875216 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90a1a53c-34f9-4cdd-bc28-a420806c2ad8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:55.876019 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90a1a53c-34f9-4cdd-bc28-a420806c2ad8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:55.876479 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-90a1a53c-34f9-4cdd-bc28-a420806c2ad8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:56.011539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-90a1a53c-34f9-4cdd-bc28-a420806c2ad8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:56.019049 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-90a1a53c-34f9-4cdd-bc28-a420806c2ad8 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1576 microversion: 2.1 time: 0.156772 Jul 20 05:48:56.019643 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3906/7709] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:55 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:57.036251 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-338580ec-e884-4968-bcb2-45c967d15392 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:57.036873 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-338580ec-e884-4968-bcb2-45c967d15392 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:57.044331 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-338580ec-e884-4968-bcb2-45c967d15392 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:57.044788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-338580ec-e884-4968-bcb2-45c967d15392 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:57.045559 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-338580ec-e884-4968-bcb2-45c967d15392 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:57.046005 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-338580ec-e884-4968-bcb2-45c967d15392 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:57.177079 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-338580ec-e884-4968-bcb2-45c967d15392 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:57.185384 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-338580ec-e884-4968-bcb2-45c967d15392 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1576 microversion: 2.1 time: 0.153027 Jul 20 05:48:57.185975 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3804/7710] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:57 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:58.203369 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-5e940428-da70-4162-a642-ede2bf8f05bd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:58.204163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-5e940428-da70-4162-a642-ede2bf8f05bd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:58.212753 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e940428-da70-4162-a642-ede2bf8f05bd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:58.213278 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e940428-da70-4162-a642-ede2bf8f05bd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:58.214215 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e940428-da70-4162-a642-ede2bf8f05bd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:58.214730 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-5e940428-da70-4162-a642-ede2bf8f05bd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:58.372205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-5e940428-da70-4162-a642-ede2bf8f05bd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:58.380185 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-5e940428-da70-4162-a642-ede2bf8f05bd tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1576 microversion: 2.1 time: 0.181476 Jul 20 05:48:58.380764 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3907/7711] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:58 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:48:59.398243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-27d6315b-b7c2-4d14-9a45-164b72ea2cc2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:48:59.398769 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-27d6315b-b7c2-4d14-9a45-164b72ea2cc2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:48:59.406077 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27d6315b-b7c2-4d14-9a45-164b72ea2cc2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:59.406526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27d6315b-b7c2-4d14-9a45-164b72ea2cc2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:59.407288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27d6315b-b7c2-4d14-9a45-164b72ea2cc2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:48:59.407754 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-27d6315b-b7c2-4d14-9a45-164b72ea2cc2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:48:59.412177 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:48:59.544847 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-27d6315b-b7c2-4d14-9a45-164b72ea2cc2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:48:59.552553 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-27d6315b-b7c2-4d14-9a45-164b72ea2cc2 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1576 microversion: 2.1 time: 0.158322 Jul 20 05:48:59.553134 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3805/7712] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:48:59 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:49:00.570188 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-12095f04-e03d-44a2-aeb7-9968c633f0a0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:49:00.570859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-12095f04-e03d-44a2-aeb7-9968c633f0a0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:49:00.578251 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12095f04-e03d-44a2-aeb7-9968c633f0a0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:49:00.578720 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12095f04-e03d-44a2-aeb7-9968c633f0a0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:49:00.579518 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12095f04-e03d-44a2-aeb7-9968c633f0a0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:49:00.579987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-12095f04-e03d-44a2-aeb7-9968c633f0a0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:49:00.713713 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-12095f04-e03d-44a2-aeb7-9968c633f0a0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:49:00.721559 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-12095f04-e03d-44a2-aeb7-9968c633f0a0 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1576 microversion: 2.1 time: 0.155236 Jul 20 05:49:00.722097 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3908/7713] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:49:00 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:49:01.740662 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-6fb3a265-de24-4e9d-a0a6-b47be28e1285 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:49:01.741287 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-6fb3a265-de24-4e9d-a0a6-b47be28e1285 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:49:01.744365 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=33 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:49:01.750015 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6fb3a265-de24-4e9d-a0a6-b47be28e1285 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:49:01.750472 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6fb3a265-de24-4e9d-a0a6-b47be28e1285 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:49:01.751246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6fb3a265-de24-4e9d-a0a6-b47be28e1285 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:49:01.751718 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-6fb3a265-de24-4e9d-a0a6-b47be28e1285 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:49:01.889488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-6fb3a265-de24-4e9d-a0a6-b47be28e1285 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:49:01.897155 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-6fb3a265-de24-4e9d-a0a6-b47be28e1285 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1576 microversion: 2.1 time: 0.160442 Jul 20 05:49:01.897733 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3806/7714] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:49:01 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:49:02.420729 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-46f42cdc-82d8-453b-acb5-c3eaab0fc2e2 req-4299db85-c4f9-4c2f-8f63-9dfd45c7df33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0977617-546a-43a5-b12c-9ded87691afc", "name": "network-vif-plugged", "status": "completed", "tag": "8c07ca59-9529-4150-b74a-0db071d22698"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:49:02.425058 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=31 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:49:02.431389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-46f42cdc-82d8-453b-acb5-c3eaab0fc2e2 req-4299db85-c4f9-4c2f-8f63-9dfd45c7df33 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:49:02.432071 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-46f42cdc-82d8-453b-acb5-c3eaab0fc2e2 req-4299db85-c4f9-4c2f-8f63-9dfd45c7df33 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:49:02.434904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=91 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:49:02.444679 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-46f42cdc-82d8-453b-acb5-c3eaab0fc2e2 req-4299db85-c4f9-4c2f-8f63-9dfd45c7df33 service nova] Creating event network-vif-plugged:8c07ca59-9529-4150-b74a-0db071d22698 for instance e0977617-546a-43a5-b12c-9ded87691afc on n-h1-764485-11 Jul 20 05:49:02.450257 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-46f42cdc-82d8-453b-acb5-c3eaab0fc2e2 req-4299db85-c4f9-4c2f-8f63-9dfd45c7df33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033332 Jul 20 05:49:02.450971 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3909/7715] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:49:02.914324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3d52968a-56a2-4b06-be9a-e82327669f5f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:49:02.915043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3d52968a-56a2-4b06-be9a-e82327669f5f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:49:02.922139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d52968a-56a2-4b06-be9a-e82327669f5f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:49:02.922592 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d52968a-56a2-4b06-be9a-e82327669f5f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:49:02.923363 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d52968a-56a2-4b06-be9a-e82327669f5f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:49:02.923835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3d52968a-56a2-4b06-be9a-e82327669f5f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:49:03.056499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3d52968a-56a2-4b06-be9a-e82327669f5f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:49:03.064147 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3d52968a-56a2-4b06-be9a-e82327669f5f tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1576 microversion: 2.1 time: 0.153904 Jul 20 05:49:03.064723 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3807/7716] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:49:02 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:49:04.083542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a4773d2c-7f4e-48cc-b129-151be2781091 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:49:04.084266 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a4773d2c-7f4e-48cc-b129-151be2781091 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:49:04.091112 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4773d2c-7f4e-48cc-b129-151be2781091 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:49:04.091611 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4773d2c-7f4e-48cc-b129-151be2781091 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:49:04.092384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4773d2c-7f4e-48cc-b129-151be2781091 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:49:04.092839 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a4773d2c-7f4e-48cc-b129-151be2781091 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:49:04.237083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-a4773d2c-7f4e-48cc-b129-151be2781091 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:49:04.244971 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a4773d2c-7f4e-48cc-b129-151be2781091 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1563 microversion: 2.1 time: 0.166811 Jul 20 05:49:04.245570 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3910/7717] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:49:04 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:20.708871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:50:20.710407 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:50:20.710851 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=16 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:50:20.711578 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=7 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:50:20.714268 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-f207c8ae-7b8a-48f9-ad21-d06444259b06 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:20.714782 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f207c8ae-7b8a-48f9-ad21-d06444259b06 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:20.716644 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-3b2b1ed4-6fad-46e8-9249-85fbf6a1c002 req-be0b20a9-95fa-46ff-8645-09bde55cf97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0977617-546a-43a5-b12c-9ded87691afc", "tag": "8c07ca59-9529-4150-b74a-0db071d22698"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:50:20.722004 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f207c8ae-7b8a-48f9-ad21-d06444259b06 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:20.722468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f207c8ae-7b8a-48f9-ad21-d06444259b06 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:20.723976 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f207c8ae-7b8a-48f9-ad21-d06444259b06 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:20.724641 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-f207c8ae-7b8a-48f9-ad21-d06444259b06 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:20.727415 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3b2b1ed4-6fad-46e8-9249-85fbf6a1c002 req-be0b20a9-95fa-46ff-8645-09bde55cf97f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:20.727909 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3b2b1ed4-6fad-46e8-9249-85fbf6a1c002 req-be0b20a9-95fa-46ff-8645-09bde55cf97f service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:20.743211 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-3b2b1ed4-6fad-46e8-9249-85fbf6a1c002 req-be0b20a9-95fa-46ff-8645-09bde55cf97f service nova] Creating event network-changed:8c07ca59-9529-4150-b74a-0db071d22698 for instance e0977617-546a-43a5-b12c-9ded87691afc on n-h1-764485-11 Jul 20 05:50:20.750960 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-3b2b1ed4-6fad-46e8-9249-85fbf6a1c002 req-be0b20a9-95fa-46ff-8645-09bde55cf97f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042303 Jul 20 05:50:20.752125 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3911/7718] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:50:20.754243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-f207c8ae-7b8a-48f9-ad21-d06444259b06 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:50:20.848511 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-f207c8ae-7b8a-48f9-ad21-d06444259b06 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 204 len: 0 microversion: 2.1 time: 0.142593 Jul 20 05:50:20.852665 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3808/7719] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:50:20 2022] DELETE /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:50:20.861180 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-3e7a12f1-de7d-498a-b09f-438e406e20b3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:20.861904 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-3e7a12f1-de7d-498a-b09f-438e406e20b3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:20.868254 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e7a12f1-de7d-498a-b09f-438e406e20b3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:20.868721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e7a12f1-de7d-498a-b09f-438e406e20b3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:20.869506 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e7a12f1-de7d-498a-b09f-438e406e20b3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:20.870061 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-3e7a12f1-de7d-498a-b09f-438e406e20b3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:21.010185 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-3e7a12f1-de7d-498a-b09f-438e406e20b3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:21.018181 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-3e7a12f1-de7d-498a-b09f-438e406e20b3 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.161266 Jul 20 05:50:21.018757 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3912/7720] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:20 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:22.037657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-094e31f9-a3d0-4dea-80cd-195d866a4e46 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:22.038386 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-094e31f9-a3d0-4dea-80cd-195d866a4e46 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:22.045853 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-094e31f9-a3d0-4dea-80cd-195d866a4e46 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:22.046307 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-094e31f9-a3d0-4dea-80cd-195d866a4e46 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:22.047080 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-094e31f9-a3d0-4dea-80cd-195d866a4e46 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:22.048382 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-094e31f9-a3d0-4dea-80cd-195d866a4e46 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:22.183216 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-094e31f9-a3d0-4dea-80cd-195d866a4e46 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:22.191920 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-094e31f9-a3d0-4dea-80cd-195d866a4e46 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1569 microversion: 2.1 time: 0.159139 Jul 20 05:50:22.191920 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3809/7721] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:22 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:23.069150 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-6d8b5267-5188-46df-9de4-3f695c464a0b req-a69a2af7-36c5-4725-ae8d-db47806ace8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0977617-546a-43a5-b12c-9ded87691afc", "name": "network-vif-deleted", "tag": "8c07ca59-9529-4150-b74a-0db071d22698"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:50:23.077414 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6d8b5267-5188-46df-9de4-3f695c464a0b req-a69a2af7-36c5-4725-ae8d-db47806ace8d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:23.077910 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-6d8b5267-5188-46df-9de4-3f695c464a0b req-a69a2af7-36c5-4725-ae8d-db47806ace8d service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:23.089245 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-6d8b5267-5188-46df-9de4-3f695c464a0b req-a69a2af7-36c5-4725-ae8d-db47806ace8d service nova] Creating event network-vif-deleted:8c07ca59-9529-4150-b74a-0db071d22698 for instance e0977617-546a-43a5-b12c-9ded87691afc on n-h1-764485-11 Jul 20 05:50:23.094239 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-6d8b5267-5188-46df-9de4-3f695c464a0b req-a69a2af7-36c5-4725-ae8d-db47806ace8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083676 Jul 20 05:50:23.094896 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3913/7722] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:50:23.209795 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7308092d-e3b1-4ed6-b6f3-90b650ae7878 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:23.210468 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7308092d-e3b1-4ed6-b6f3-90b650ae7878 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:23.217801 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7308092d-e3b1-4ed6-b6f3-90b650ae7878 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:23.218258 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7308092d-e3b1-4ed6-b6f3-90b650ae7878 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:23.219035 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7308092d-e3b1-4ed6-b6f3-90b650ae7878 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:23.219480 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7308092d-e3b1-4ed6-b6f3-90b650ae7878 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:23.610361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7308092d-e3b1-4ed6-b6f3-90b650ae7878 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:23.618798 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7308092d-e3b1-4ed6-b6f3-90b650ae7878 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1219 microversion: 2.1 time: 0.413567 Jul 20 05:50:23.619591 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3810/7723] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:23 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1219 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:24.636744 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-948528df-ac43-4c77-9501-c32d8463e792 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:24.637481 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-948528df-ac43-4c77-9501-c32d8463e792 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:24.644367 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-948528df-ac43-4c77-9501-c32d8463e792 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:24.645106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-948528df-ac43-4c77-9501-c32d8463e792 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:24.645546 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-948528df-ac43-4c77-9501-c32d8463e792 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:24.646001 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-948528df-ac43-4c77-9501-c32d8463e792 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:24.714761 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-948528df-ac43-4c77-9501-c32d8463e792 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:24.723235 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-948528df-ac43-4c77-9501-c32d8463e792 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1219 microversion: 2.1 time: 0.091579 Jul 20 05:50:24.723849 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3914/7724] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:24 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:25.741332 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-60033bbd-b83b-49a4-8ab2-7636bdbd067c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:25.741928 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-60033bbd-b83b-49a4-8ab2-7636bdbd067c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:25.749185 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60033bbd-b83b-49a4-8ab2-7636bdbd067c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:25.749911 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60033bbd-b83b-49a4-8ab2-7636bdbd067c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:25.750690 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60033bbd-b83b-49a4-8ab2-7636bdbd067c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:25.751139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-60033bbd-b83b-49a4-8ab2-7636bdbd067c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:25.818561 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-60033bbd-b83b-49a4-8ab2-7636bdbd067c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:25.827931 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-60033bbd-b83b-49a4-8ab2-7636bdbd067c tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1219 microversion: 2.1 time: 0.091178 Jul 20 05:50:25.828524 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3811/7725] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:25 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:26.845009 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-57e43056-05ad-473e-9f2c-f441e3433040 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:26.845684 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-57e43056-05ad-473e-9f2c-f441e3433040 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:26.852829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57e43056-05ad-473e-9f2c-f441e3433040 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:26.853307 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57e43056-05ad-473e-9f2c-f441e3433040 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:26.854106 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57e43056-05ad-473e-9f2c-f441e3433040 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:26.854570 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-57e43056-05ad-473e-9f2c-f441e3433040 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:26.916978 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-57e43056-05ad-473e-9f2c-f441e3433040 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f755cb7cf4eec9aca672b661cf8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4867d0794645a5b92fcc63bf141b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:26.924648 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-57e43056-05ad-473e-9f2c-f441e3433040 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 200 len: 1219 microversion: 2.1 time: 0.083630 Jul 20 05:50:26.925261 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3915/7726] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:26 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:27.942111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b252741f-de7a-4753-9b33-496db3aa7817 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:27.942835 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b252741f-de7a-4753-9b33-496db3aa7817 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] [instance: e0977617-546a-43a5-b12c-9ded87691afc] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:27.950614 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b252741f-de7a-4753-9b33-496db3aa7817 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:27.951162 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b252741f-de7a-4753-9b33-496db3aa7817 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:27.952055 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b252741f-de7a-4753-9b33-496db3aa7817 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:27.952575 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b252741f-de7a-4753-9b33-496db3aa7817 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:27.967740 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.wsgi [None req-b252741f-de7a-4753-9b33-496db3aa7817 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] HTTP exception thrown: Instance e0977617-546a-43a5-b12c-9ded87691afc could not be found. Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b252741f-de7a-4753-9b33-496db3aa7817 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Request method failure captured: Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: request: GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc HTTP/1.1 Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: Accept: application/json Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: Accept-Encoding: identity Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: Connection: close Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: Content-Length: 0 Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: Content-Type: application/json Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: Host: 10.222.0.20 Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: Openstack-System-Scope: None Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: User-Agent: python-urllib3/1.26.9 Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Auth-Token: gAAAAABi15VX1wddRluzOOYrU08zzinsG-ShifaTDJeNPhYPPBPyUL2EEqIz5XTCCVyTdtVHeFWcSwA-XeiDKyYttQSu0-1yAavNRqrW7hLC5mI9xEbddMC5f1huTV4leNCqCgL_dooBYwhBZtS0VXH30sDIz5ctDO_VITSJzsSBrpxhUGN4XHc Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Id: None Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Domain-Name: None Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Identity-Status: Confirmed Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Is-Admin-Project: True Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Id: default Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Domain-Name: Default Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Id: 1e4867d0794645a5b92fcc63bf141b83 Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Project-Name: tempest-TestShelveInstance-25542347 Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Role: member,reader Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Roles: member,reader Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e4867d0794645a5b92fcc63bf141b83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e4867d0794645a5b92fcc63bf141b83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e4867d0794645a5b92fcc63bf141b83", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e4867d0794645a5b92fcc63bf141b83"}]}] Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant: tempest-TestShelveInstance-25542347 Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Id: 1e4867d0794645a5b92fcc63bf141b83 Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-Tenant-Name: tempest-TestShelveInstance-25542347 Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-User: tempest-TestShelveInstance-25542347-project Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Id: default Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-User-Domain-Name: Default Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-User-Id: 591f755cb7cf4eec9aca672b661cf8ff Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: X-User-Name: tempest-TestShelveInstance-25542347-project Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: method: > Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: exception: Instance e0977617-546a-43a5-b12c-9ded87691afc could not be found. Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: action_args: {'id': 'e0977617-546a-43a5-b12c-9ded87691afc'} Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0977617-546a-43a5-b12c-9ded87691afc could not be found. Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0977617-546a-43a5-b12c-9ded87691afc could not be found. Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:50:27.969519 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:50:27.975632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:50:27.975632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:50:27.975632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:50:27.975632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:50:27.975632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0977617-546a-43a5-b12c-9ded87691afc could not be found. Jul 20 05:50:27.975632 n-d-764485-11 devstack@n-api.service[119807]: ERROR nova.api.openstack.wsgi Jul 20 05:50:27.975632 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b252741f-de7a-4753-9b33-496db3aa7817 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Returning 404 to user: Instance e0977617-546a-43a5-b12c-9ded87691afc could not be found. {{(pid=119807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:50:27.975632 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b252741f-de7a-4753-9b33-496db3aa7817 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc" status: 404 len: 111 microversion: 2.1 time: 0.033282 Jul 20 05:50:27.975632 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3812/7727] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:27 2022] GET /compute/v2.1/servers/e0977617-546a-43a5-b12c-9ded87691afc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:50:28.151960 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-35186219-1d79-4ac5-99dc-202fdcfd5a69 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] Calling method '.version_select at 0x7fbf9c6f14c0>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:28.189782 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-35186219-1d79-4ac5-99dc-202fdcfd5a69 tempest-TestShelveInstance-25542347 tempest-TestShelveInstance-25542347-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-244730065" status: 202 len: 0 microversion: 2.1 time: 0.042314 Jul 20 05:50:28.195272 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3916/7728] 10.222.0.20 () {58 vars in 1250 bytes} [Wed Jul 20 05:50:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-244730065 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:50:45.835684 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:50:45.836523 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:50:46.030203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-aa2520ca-0185-4728-941c-d5493b62e4d3 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Action: 'create', calling method: .version_select at 0x7fbf9c5081f0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2117139941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2tn7Gi5l9XqL1UYwt1OlqRmmk4hS47QvMNV7q8gi/lPI/RY5j+Jh8/Gmli2g54+MU2KBe7IVNgplgn/oAAotj7dKsQO406jE96m4DnpaWJpoYVs92V2qDggtoU+rdHLw=="}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:50:46.051537 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-aa2520ca-0185-4728-941c-d5493b62e4d3 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Getting quotas for project 4a6742536c1246e0a073930295cd673a. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:50:46.053926 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-aa2520ca-0185-4728-941c-d5493b62e4d3 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Getting quotas for user 1a021dd575154e7cafbcbcbd3f292225 and project 4a6742536c1246e0a073930295cd673a. Resources: {'key_pairs'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:50:46.085804 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-aa2520ca-0185-4728-941c-d5493b62e4d3 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.256246 Jul 20 05:50:46.089097 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3813/7729] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Jul 20 05:50:45 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:50:47.297029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=22 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:50:47.298182 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:50:47.304408 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-260559424", "imageRef": "bd7de922-6028-4caa-9dbc-4c1d87dfda55", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2117139941", "security_groups": [{"name": "tempest-secgroup-smoke-1754327809"}], "networks": [{"uuid": "5e756fc2-8780-42c3-bb05-e73bef7efcbd"}]}} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:50:47.422419 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.network.neutron [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] validate_networks() for [('5e756fc2-8780-42c3-bb05-e73bef7efcbd', None, None, None, None, None)] {{(pid=119808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:50:47.918465 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Flavor limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:50:47.918915 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Image limits 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:50:47.919444 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Flavor pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:50:47.919911 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Image pref 0:0:0 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:50:47.920348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.virt.hardware [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:50:47.930163 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:47.930636 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:47.931463 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:47.931964 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:47.951038 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Getting quotas for project 4a6742536c1246e0a073930295cd673a. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:50:47.956812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.quota [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Getting quotas for user 1a021dd575154e7cafbcbcbd3f292225 and project 4a6742536c1246e0a073930295cd673a. Resources: {'cores', 'ram', 'instances'} {{(pid=119808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:50:47.969994 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Going to run 1 instances... {{(pid=119808) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:50:47.972498 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd7de922-6028-4caa-9dbc-4c1d87dfda55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:50:48.021416 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-a801a151-5d5f-4b64-b7c4-5526662efd0a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726258 Jul 20 05:50:48.022079 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3917/7730] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:50:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:50:48.032888 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4028cd70-46e7-4593-ba08-f7305e6a1396 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:48.035552 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4028cd70-46e7-4593-ba08-f7305e6a1396 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:48.114673 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4028cd70-46e7-4593-ba08-f7305e6a1396 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:48.127608 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4028cd70-46e7-4593-ba08-f7305e6a1396 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1248 microversion: 2.1 time: 0.099337 Jul 20 05:50:48.129140 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3814/7731] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:48 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1248 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:49.145859 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6167f7b6-0e77-4721-8b7e-859e29df828d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:49.147214 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6167f7b6-0e77-4721-8b7e-859e29df828d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:49.155315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6167f7b6-0e77-4721-8b7e-859e29df828d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:49.156104 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6167f7b6-0e77-4721-8b7e-859e29df828d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:49.157697 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6167f7b6-0e77-4721-8b7e-859e29df828d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:49.158445 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6167f7b6-0e77-4721-8b7e-859e29df828d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:49.267292 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6167f7b6-0e77-4721-8b7e-859e29df828d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:49.278702 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6167f7b6-0e77-4721-8b7e-859e29df828d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1318 microversion: 2.1 time: 0.136959 Jul 20 05:50:49.285323 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3918/7732] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:49 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:50.302200 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-8cf2fd2e-fb9f-4b3d-b882-7983790bfc1a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:50.302809 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-8cf2fd2e-fb9f-4b3d-b882-7983790bfc1a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:50.310425 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cf2fd2e-fb9f-4b3d-b882-7983790bfc1a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:50.311203 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cf2fd2e-fb9f-4b3d-b882-7983790bfc1a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:50.312290 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cf2fd2e-fb9f-4b3d-b882-7983790bfc1a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:50.312909 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-8cf2fd2e-fb9f-4b3d-b882-7983790bfc1a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:50.483645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-8cf2fd2e-fb9f-4b3d-b882-7983790bfc1a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:50.493152 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-8cf2fd2e-fb9f-4b3d-b882-7983790bfc1a tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1374 microversion: 2.1 time: 0.195531 Jul 20 05:50:50.494075 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3815/7733] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:50 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:50.717513 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-03d67448-a3d6-4202-904e-418348b90c53 req-336bf5eb-696b-4d5f-ab49-4e7df385524c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1e6e4e-9034-4822-81f6-918c2a7923c1", "tag": "33040443-8a9d-4951-b0b2-64bb18c3a205"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:50:50.732808 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-03d67448-a3d6-4202-904e-418348b90c53 req-336bf5eb-696b-4d5f-ab49-4e7df385524c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:50.734436 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-03d67448-a3d6-4202-904e-418348b90c53 req-336bf5eb-696b-4d5f-ab49-4e7df385524c service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:50.750306 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-03d67448-a3d6-4202-904e-418348b90c53 req-336bf5eb-696b-4d5f-ab49-4e7df385524c service nova] Creating event network-changed:33040443-8a9d-4951-b0b2-64bb18c3a205 for instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 on n-h1-764485-11 Jul 20 05:50:50.756158 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-03d67448-a3d6-4202-904e-418348b90c53 req-336bf5eb-696b-4d5f-ab49-4e7df385524c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042984 Jul 20 05:50:50.756787 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3919/7734] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:50:51.511731 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-16eeadba-4e09-4c02-bb5e-8f2a04ef96e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:51.512375 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-16eeadba-4e09-4c02-bb5e-8f2a04ef96e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:51.519605 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16eeadba-4e09-4c02-bb5e-8f2a04ef96e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:51.520074 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16eeadba-4e09-4c02-bb5e-8f2a04ef96e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:51.520855 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16eeadba-4e09-4c02-bb5e-8f2a04ef96e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:51.521305 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-16eeadba-4e09-4c02-bb5e-8f2a04ef96e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:51.655317 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-16eeadba-4e09-4c02-bb5e-8f2a04ef96e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:51.664094 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-16eeadba-4e09-4c02-bb5e-8f2a04ef96e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1374 microversion: 2.1 time: 0.156330 Jul 20 05:50:51.664669 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3816/7735] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:51 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:52.681226 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-521ef892-b119-4c72-8c66-085af85913b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:52.681945 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-521ef892-b119-4c72-8c66-085af85913b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:52.688987 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-521ef892-b119-4c72-8c66-085af85913b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:52.689452 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-521ef892-b119-4c72-8c66-085af85913b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:52.690229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-521ef892-b119-4c72-8c66-085af85913b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:52.690683 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-521ef892-b119-4c72-8c66-085af85913b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:52.823439 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-521ef892-b119-4c72-8c66-085af85913b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:52.831562 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-521ef892-b119-4c72-8c66-085af85913b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1374 microversion: 2.1 time: 0.153996 Jul 20 05:50:52.832139 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3920/7736] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:52 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:53.850243 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c1f66be9-f1ff-4234-add7-8969f476166d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:53.850850 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c1f66be9-f1ff-4234-add7-8969f476166d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:53.857833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1f66be9-f1ff-4234-add7-8969f476166d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:53.858288 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1f66be9-f1ff-4234-add7-8969f476166d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:53.859051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1f66be9-f1ff-4234-add7-8969f476166d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:53.859488 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c1f66be9-f1ff-4234-add7-8969f476166d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:53.993175 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c1f66be9-f1ff-4234-add7-8969f476166d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:54.000930 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c1f66be9-f1ff-4234-add7-8969f476166d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1374 microversion: 2.1 time: 0.156464 Jul 20 05:50:54.001502 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3817/7737] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:53 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:55.019178 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-259a8e46-e6c1-493d-bb65-335be4bd3800 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:55.019845 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-259a8e46-e6c1-493d-bb65-335be4bd3800 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:55.026704 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-259a8e46-e6c1-493d-bb65-335be4bd3800 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:55.027162 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-259a8e46-e6c1-493d-bb65-335be4bd3800 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:55.027972 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-259a8e46-e6c1-493d-bb65-335be4bd3800 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:55.028503 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-259a8e46-e6c1-493d-bb65-335be4bd3800 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:55.165977 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-259a8e46-e6c1-493d-bb65-335be4bd3800 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:55.173585 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-259a8e46-e6c1-493d-bb65-335be4bd3800 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1374 microversion: 2.1 time: 0.159255 Jul 20 05:50:55.174171 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3921/7738] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:55 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:56.190699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3b39a052-b59f-4655-a39d-7e369294739e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:56.191361 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3b39a052-b59f-4655-a39d-7e369294739e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:56.198376 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b39a052-b59f-4655-a39d-7e369294739e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:56.198828 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b39a052-b59f-4655-a39d-7e369294739e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:56.199625 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b39a052-b59f-4655-a39d-7e369294739e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:56.200070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3b39a052-b59f-4655-a39d-7e369294739e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:56.330337 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3b39a052-b59f-4655-a39d-7e369294739e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:56.338756 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3b39a052-b59f-4655-a39d-7e369294739e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1374 microversion: 2.1 time: 0.152055 Jul 20 05:50:56.339387 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3818/7739] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:56 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:57.032081 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-32c95dbc-c0c9-4d1d-930b-b4ac6a1a11b8 req-7fb81086-664d-47fb-ace7-4270ac62b7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1e6e4e-9034-4822-81f6-918c2a7923c1", "name": "network-vif-plugged", "status": "completed", "tag": "33040443-8a9d-4951-b0b2-64bb18c3a205"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:50:57.040590 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-32c95dbc-c0c9-4d1d-930b-b4ac6a1a11b8 req-7fb81086-664d-47fb-ace7-4270ac62b7a7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:57.041056 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-32c95dbc-c0c9-4d1d-930b-b4ac6a1a11b8 req-7fb81086-664d-47fb-ace7-4270ac62b7a7 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:57.052459 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-32c95dbc-c0c9-4d1d-930b-b4ac6a1a11b8 req-7fb81086-664d-47fb-ace7-4270ac62b7a7 service nova] Creating event network-vif-plugged:33040443-8a9d-4951-b0b2-64bb18c3a205 for instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 on n-h1-764485-11 Jul 20 05:50:57.057699 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-32c95dbc-c0c9-4d1d-930b-b4ac6a1a11b8 req-7fb81086-664d-47fb-ace7-4270ac62b7a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096842 Jul 20 05:50:57.058250 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3922/7740] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:50:57.356846 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-546bb28b-86ff-4a00-b4ef-e517d6dd1510 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:57.357476 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-546bb28b-86ff-4a00-b4ef-e517d6dd1510 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:57.365278 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-546bb28b-86ff-4a00-b4ef-e517d6dd1510 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:57.365743 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-546bb28b-86ff-4a00-b4ef-e517d6dd1510 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:57.366526 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-546bb28b-86ff-4a00-b4ef-e517d6dd1510 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:57.366974 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-546bb28b-86ff-4a00-b4ef-e517d6dd1510 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:57.505705 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-546bb28b-86ff-4a00-b4ef-e517d6dd1510 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:57.513313 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-546bb28b-86ff-4a00-b4ef-e517d6dd1510 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1374 microversion: 2.1 time: 0.160404 Jul 20 05:50:57.513903 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3819/7741] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:57 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:58.530912 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-b0dee711-9bdf-4e75-8ce8-4232b587fe8f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:58.531672 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-b0dee711-9bdf-4e75-8ce8-4232b587fe8f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:58.534356 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:50:58.535229 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=6 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:50:58.544005 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0dee711-9bdf-4e75-8ce8-4232b587fe8f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:58.544484 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0dee711-9bdf-4e75-8ce8-4232b587fe8f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:58.545290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0dee711-9bdf-4e75-8ce8-4232b587fe8f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:58.545750 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-b0dee711-9bdf-4e75-8ce8-4232b587fe8f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:58.682666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-b0dee711-9bdf-4e75-8ce8-4232b587fe8f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:58.690577 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-b0dee711-9bdf-4e75-8ce8-4232b587fe8f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1559 microversion: 2.1 time: 0.163984 Jul 20 05:50:58.691275 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3923/7742] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:58 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:50:58.707600 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-dab00724-47df-48c5-8f83-c6e6b7a92ee5 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:50:58.708225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-dab00724-47df-48c5-8f83-c6e6b7a92ee5 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:50:58.711137 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:50:58.716342 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dab00724-47df-48c5-8f83-c6e6b7a92ee5 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:58.716802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dab00724-47df-48c5-8f83-c6e6b7a92ee5 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:58.717630 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dab00724-47df-48c5-8f83-c6e6b7a92ee5 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:50:58.718030 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-dab00724-47df-48c5-8f83-c6e6b7a92ee5 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:50:58.856715 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-dab00724-47df-48c5-8f83-c6e6b7a92ee5 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:50:58.864530 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-dab00724-47df-48c5-8f83-c6e6b7a92ee5 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1559 microversion: 2.1 time: 0.161766 Jul 20 05:50:58.865119 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3820/7743] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:50:58 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:51:00.805623 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-56d662e8-985f-439b-a4be-4f1c2f54e06b req-beafb215-c3bd-4373-9f2f-029d24c5b1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1e6e4e-9034-4822-81f6-918c2a7923c1", "tag": "33040443-8a9d-4951-b0b2-64bb18c3a205"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:51:00.814638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-56d662e8-985f-439b-a4be-4f1c2f54e06b req-beafb215-c3bd-4373-9f2f-029d24c5b1f2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:51:00.815406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-56d662e8-985f-439b-a4be-4f1c2f54e06b req-beafb215-c3bd-4373-9f2f-029d24c5b1f2 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:51:00.826868 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-56d662e8-985f-439b-a4be-4f1c2f54e06b req-beafb215-c3bd-4373-9f2f-029d24c5b1f2 service nova] Creating event network-changed:33040443-8a9d-4951-b0b2-64bb18c3a205 for instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 on n-h1-764485-11 Jul 20 05:51:00.833374 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-56d662e8-985f-439b-a4be-4f1c2f54e06b req-beafb215-c3bd-4373-9f2f-029d24c5b1f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031425 Jul 20 05:51:00.833993 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3924/7744] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:51:56.911114 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:51:56.911706 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:53:26.531541 n-d-764485-11 devstack@n-api.service[119807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [86bbcd4a-2dc6-48ea-bdc8-94fb9e64045f] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:53:26.532510 n-d-764485-11 devstack@n-api.service[119807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a8eca7-3df2-4c6d-a372-7fc57edb945c] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:53:26.533040 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:53:26.533844 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=36 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:53:26.538354 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-993f89cb-9a10-434e-b4cd-707c7e50de57 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-123848796"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:53:26.539389 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-993f89cb-9a10-434e-b4cd-707c7e50de57 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:53:26.546989 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-993f89cb-9a10-434e-b4cd-707c7e50de57 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:26.547447 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-993f89cb-9a10-434e-b4cd-707c7e50de57 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:26.548248 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-993f89cb-9a10-434e-b4cd-707c7e50de57 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:26.548693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-993f89cb-9a10-434e-b4cd-707c7e50de57 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:26.822068 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-993f89cb-9a10-434e-b4cd-707c7e50de57 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "POST /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1/action" status: 202 len: 0 microversion: 2.1 time: 0.292415 Jul 20 05:53:26.822656 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3821/7745] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:53:26 2022] POST /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 20 05:53:33.673614 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4776198a-db9f-4da8-a9d3-98de639ffb43] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:53:33.674441 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7f015b8-ffde-4af0-8b21-123d24411373] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:53:33.675053 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:53:33.676062 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=32 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:53:33.680780 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-cf8f01b7-25b7-4ce1-a217-5c9ebc5ca600 req-9e3fc97b-59bd-437f-901a-7b04f39ed8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1e6e4e-9034-4822-81f6-918c2a7923c1", "name": "network-vif-plugged", "status": "completed", "tag": "33040443-8a9d-4951-b0b2-64bb18c3a205"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:53:33.692137 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cf8f01b7-25b7-4ce1-a217-5c9ebc5ca600 req-9e3fc97b-59bd-437f-901a-7b04f39ed8a5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:33.692606 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-cf8f01b7-25b7-4ce1-a217-5c9ebc5ca600 req-9e3fc97b-59bd-437f-901a-7b04f39ed8a5 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:33.703028 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-cf8f01b7-25b7-4ce1-a217-5c9ebc5ca600 req-9e3fc97b-59bd-437f-901a-7b04f39ed8a5 service nova] Creating event network-vif-plugged:33040443-8a9d-4951-b0b2-64bb18c3a205 for instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 on n-h1-764485-11 Jul 20 05:53:33.708868 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-cf8f01b7-25b7-4ce1-a217-5c9ebc5ca600 req-9e3fc97b-59bd-437f-901a-7b04f39ed8a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037050 Jul 20 05:53:33.709748 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3925/7746] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:53:35.751214 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:53:35.751921 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:53:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:53:35.763055 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:53:35.763227 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:53:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:53:37.350053 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 20 05:53:37.350619 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:53:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:53:46.508730 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:53:46.509697 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:53:46.514611 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1756187862", "imageRef": "6b9b28c6-d4eb-4280-b552-e9a3b134d233", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2117139941", "security_groups": [{"name": "tempest-secgroup-smoke-1754327809"}], "networks": [{"uuid": "5e756fc2-8780-42c3-bb05-e73bef7efcbd"}]}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:53:46.542628 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] [86bbcd4a-2dc6-48ea-bdc8-94fb9e64045f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56180. Jul 20 05:53:46.545287 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a8eca7-3df2-4c6d-a372-7fc57edb945c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56182. Jul 20 05:53:46.804003 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.network.neutron [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] validate_networks() for [('5e756fc2-8780-42c3-bb05-e73bef7efcbd', None, None, None, None, None)] {{(pid=119807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:53:47.228891 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Flavor limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:53:47.229402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Image limits 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:53:47.229964 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Flavor pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:53:47.230510 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Image pref 0:0:0 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:53:47.230955 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.virt.hardware [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:53:47.240344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:47.240804 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:47.241620 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:47.242070 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:47.260513 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Getting quotas for project 4a6742536c1246e0a073930295cd673a. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:53:47.266090 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.quota [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Getting quotas for user 1a021dd575154e7cafbcbcbd3f292225 and project 4a6742536c1246e0a073930295cd673a. Resources: {'cores', 'ram', 'instances'} {{(pid=119807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:53:47.279871 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Going to run 1 instances... {{(pid=119807) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:53:47.282398 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b9b28c6-d4eb-4280-b552-e9a3b134d233',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:53:47.329595 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-cc5be813-e331-464d-97cc-e33ba9759d68 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.824240 Jul 20 05:53:47.330253 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3822/7747] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Jul 20 05:53:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:53:47.339935 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:53:47.340998 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:53:47.345851 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-77048207-5f64-41b2-9401-f1ebc5f8a395 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:53:47.346797 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-77048207-5f64-41b2-9401-f1ebc5f8a395 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:53:47.365515 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] [4776198a-db9f-4da8-a9d3-98de639ffb43] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56204. Jul 20 05:53:47.366399 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7f015b8-ffde-4af0-8b21-123d24411373] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56206. Jul 20 05:53:47.466363 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-77048207-5f64-41b2-9401-f1ebc5f8a395 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:53:47.473827 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-77048207-5f64-41b2-9401-f1ebc5f8a395 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1249 microversion: 2.1 time: 0.136672 Jul 20 05:53:47.474634 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3926/7748] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:53:47 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1249 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:53:48.490661 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-abfac8fd-2288-4f09-84b8-bc2f5baace7f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:53:48.491283 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-abfac8fd-2288-4f09-84b8-bc2f5baace7f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:53:48.500180 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abfac8fd-2288-4f09-84b8-bc2f5baace7f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:48.500634 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abfac8fd-2288-4f09-84b8-bc2f5baace7f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:48.501679 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abfac8fd-2288-4f09-84b8-bc2f5baace7f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:48.502161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-abfac8fd-2288-4f09-84b8-bc2f5baace7f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:48.585858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-abfac8fd-2288-4f09-84b8-bc2f5baace7f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:53:48.594216 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-abfac8fd-2288-4f09-84b8-bc2f5baace7f tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1307 microversion: 2.1 time: 0.107582 Jul 20 05:53:48.594800 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3823/7749] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:53:48 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:53:49.611329 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-76415c56-416d-4a16-8cd6-e8ebea78a33c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:53:49.612168 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-76415c56-416d-4a16-8cd6-e8ebea78a33c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:53:49.632745 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76415c56-416d-4a16-8cd6-e8ebea78a33c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:49.633134 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76415c56-416d-4a16-8cd6-e8ebea78a33c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:49.633931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76415c56-416d-4a16-8cd6-e8ebea78a33c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:49.634386 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-76415c56-416d-4a16-8cd6-e8ebea78a33c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:49.700778 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-d158b0c3-9203-4187-8a47-514c02b7aabb req-76c52ba5-85da-4fbb-9966-30cb3f26a6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1e6e4e-9034-4822-81f6-918c2a7923c1", "name": "network-vif-unplugged", "status": "completed", "tag": "33040443-8a9d-4951-b0b2-64bb18c3a205"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:53:49.716489 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d158b0c3-9203-4187-8a47-514c02b7aabb req-76c52ba5-85da-4fbb-9966-30cb3f26a6be service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:49.716653 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-d158b0c3-9203-4187-8a47-514c02b7aabb req-76c52ba5-85da-4fbb-9966-30cb3f26a6be service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:49.737314 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-d158b0c3-9203-4187-8a47-514c02b7aabb req-76c52ba5-85da-4fbb-9966-30cb3f26a6be service nova] Creating event network-vif-unplugged:33040443-8a9d-4951-b0b2-64bb18c3a205 for instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 on n-h1-764485-11 Jul 20 05:53:49.743655 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-d158b0c3-9203-4187-8a47-514c02b7aabb req-76c52ba5-85da-4fbb-9966-30cb3f26a6be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048444 Jul 20 05:53:49.745367 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3824/7750] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:53:49.861389 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-76415c56-416d-4a16-8cd6-e8ebea78a33c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:53:49.880885 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-76415c56-416d-4a16-8cd6-e8ebea78a33c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.273287 Jul 20 05:53:49.897461 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3927/7751] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:53:49 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:53:50.911459 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7e174e9c-e6dc-43a8-8d69-83dbcdb04ad2 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:53:50.912833 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7e174e9c-e6dc-43a8-8d69-83dbcdb04ad2 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:53:50.919931 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e174e9c-e6dc-43a8-8d69-83dbcdb04ad2 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:50.920548 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e174e9c-e6dc-43a8-8d69-83dbcdb04ad2 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:50.921348 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e174e9c-e6dc-43a8-8d69-83dbcdb04ad2 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:50.921800 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7e174e9c-e6dc-43a8-8d69-83dbcdb04ad2 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:51.086596 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7e174e9c-e6dc-43a8-8d69-83dbcdb04ad2 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:53:51.094509 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7e174e9c-e6dc-43a8-8d69-83dbcdb04ad2 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.190132 Jul 20 05:53:51.095318 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3825/7752] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:53:50 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:53:52.112497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bd7bda28-fe40-4c9f-9623-b79b401a4a1d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:53:52.114184 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bd7bda28-fe40-4c9f-9623-b79b401a4a1d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:53:52.124545 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd7bda28-fe40-4c9f-9623-b79b401a4a1d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:52.125165 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd7bda28-fe40-4c9f-9623-b79b401a4a1d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:52.126579 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd7bda28-fe40-4c9f-9623-b79b401a4a1d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:52.127205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd7bda28-fe40-4c9f-9623-b79b401a4a1d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:52.277913 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-bd7bda28-fe40-4c9f-9623-b79b401a4a1d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:53:52.285886 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bd7bda28-fe40-4c9f-9623-b79b401a4a1d tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.177366 Jul 20 05:53:52.286477 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3928/7753] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:53:52 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:53:53.302522 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-4bcbb565-9db6-4d1f-a9e9-dd60374756ce tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:53:53.303184 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-4bcbb565-9db6-4d1f-a9e9-dd60374756ce tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:53:53.310499 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4bcbb565-9db6-4d1f-a9e9-dd60374756ce tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:53.310961 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4bcbb565-9db6-4d1f-a9e9-dd60374756ce tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:53.311788 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4bcbb565-9db6-4d1f-a9e9-dd60374756ce tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:53.312238 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-4bcbb565-9db6-4d1f-a9e9-dd60374756ce tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:53.465744 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-4bcbb565-9db6-4d1f-a9e9-dd60374756ce tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:53:53.467217 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-4bcbb565-9db6-4d1f-a9e9-dd60374756ce tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.168632 Jul 20 05:53:53.477197 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3826/7754] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:53:53 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:53:54.490352 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f86a47a4-cf28-4c72-a667-8bf300a9c763 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:53:54.490979 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f86a47a4-cf28-4c72-a667-8bf300a9c763 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:53:54.497127 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f86a47a4-cf28-4c72-a667-8bf300a9c763 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:54.497589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f86a47a4-cf28-4c72-a667-8bf300a9c763 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:54.498377 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f86a47a4-cf28-4c72-a667-8bf300a9c763 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:54.498829 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f86a47a4-cf28-4c72-a667-8bf300a9c763 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:54.684560 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f86a47a4-cf28-4c72-a667-8bf300a9c763 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:53:54.695278 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f86a47a4-cf28-4c72-a667-8bf300a9c763 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.212189 Jul 20 05:53:54.696864 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3929/7755] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:53:54 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:53:55.719111 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-5ef556c4-1541-4398-80ff-eb8a8af2bf50 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:53:55.719929 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-5ef556c4-1541-4398-80ff-eb8a8af2bf50 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:53:55.730402 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ef556c4-1541-4398-80ff-eb8a8af2bf50 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:55.731081 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ef556c4-1541-4398-80ff-eb8a8af2bf50 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:55.732467 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ef556c4-1541-4398-80ff-eb8a8af2bf50 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:55.733051 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-5ef556c4-1541-4398-80ff-eb8a8af2bf50 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:55.897269 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-5ef556c4-1541-4398-80ff-eb8a8af2bf50 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:53:55.905200 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-5ef556c4-1541-4398-80ff-eb8a8af2bf50 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.190843 Jul 20 05:53:55.905785 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3827/7756] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:53:55 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:53:56.922290 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-705ee5c1-6847-4bf5-b34e-34ecaaeddda7 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:53:56.922932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-705ee5c1-6847-4bf5-b34e-34ecaaeddda7 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:53:56.930483 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-705ee5c1-6847-4bf5-b34e-34ecaaeddda7 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:56.930840 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-705ee5c1-6847-4bf5-b34e-34ecaaeddda7 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:56.931643 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-705ee5c1-6847-4bf5-b34e-34ecaaeddda7 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:56.932102 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-705ee5c1-6847-4bf5-b34e-34ecaaeddda7 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:57.069602 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-705ee5c1-6847-4bf5-b34e-34ecaaeddda7 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:53:57.077166 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-705ee5c1-6847-4bf5-b34e-34ecaaeddda7 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.158885 Jul 20 05:53:57.077758 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3930/7757] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:53:56 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:53:58.094827 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-256f7e97-6ba5-4c11-8cf4-86815f9d2f47 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:53:58.095454 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-256f7e97-6ba5-4c11-8cf4-86815f9d2f47 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:53:58.098324 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:53:58.099099 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell0:SELECT=6 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:53:58.105241 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-256f7e97-6ba5-4c11-8cf4-86815f9d2f47 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:58.105699 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-256f7e97-6ba5-4c11-8cf4-86815f9d2f47 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:58.106478 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-256f7e97-6ba5-4c11-8cf4-86815f9d2f47 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:58.106925 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-256f7e97-6ba5-4c11-8cf4-86815f9d2f47 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:58.242665 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-256f7e97-6ba5-4c11-8cf4-86815f9d2f47 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:53:58.250290 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-256f7e97-6ba5-4c11-8cf4-86815f9d2f47 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.159708 Jul 20 05:53:58.251134 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3828/7758] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:53:58 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:53:59.268388 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-6696d3eb-4784-4d16-ac12-d2a3df2511dc tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:53:59.269042 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-6696d3eb-4784-4d16-ac12-d2a3df2511dc tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:53:59.271029 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell0:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:53:59.279105 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6696d3eb-4784-4d16-ac12-d2a3df2511dc tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:59.279488 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6696d3eb-4784-4d16-ac12-d2a3df2511dc tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:59.280348 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6696d3eb-4784-4d16-ac12-d2a3df2511dc tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:59.281384 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-6696d3eb-4784-4d16-ac12-d2a3df2511dc tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:59.489618 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-6ea8e451-dfe6-4f43-9138-5d043727086d req-deca1ab2-d663-4329-adff-613ab9ae08b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b446997-e19f-47d8-8871-97a01988c1de", "tag": "3ef9b3ee-a43a-4f2d-866b-712b26544774"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:53:59.498904 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6ea8e451-dfe6-4f43-9138-5d043727086d req-deca1ab2-d663-4329-adff-613ab9ae08b8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:53:59.499404 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-6ea8e451-dfe6-4f43-9138-5d043727086d req-deca1ab2-d663-4329-adff-613ab9ae08b8 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:53:59.512576 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-6ea8e451-dfe6-4f43-9138-5d043727086d req-deca1ab2-d663-4329-adff-613ab9ae08b8 service nova] Creating event network-changed:3ef9b3ee-a43a-4f2d-866b-712b26544774 for instance 9b446997-e19f-47d8-8871-97a01988c1de on n-h2-764485-11 Jul 20 05:53:59.517747 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-6ea8e451-dfe6-4f43-9138-5d043727086d req-deca1ab2-d663-4329-adff-613ab9ae08b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112047 Jul 20 05:53:59.519213 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3829/7759] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:53:59.537406 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-6696d3eb-4784-4d16-ac12-d2a3df2511dc tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:53:59.545381 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-6696d3eb-4784-4d16-ac12-d2a3df2511dc tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.280977 Jul 20 05:53:59.554934 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3931/7760] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:53:59 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:54:00.564126 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-727ef28f-6404-4750-9fe8-e6c8daba8d93 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:54:00.564858 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-727ef28f-6404-4750-9fe8-e6c8daba8d93 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:54:00.572119 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-727ef28f-6404-4750-9fe8-e6c8daba8d93 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:00.572579 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-727ef28f-6404-4750-9fe8-e6c8daba8d93 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:00.573352 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-727ef28f-6404-4750-9fe8-e6c8daba8d93 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:00.573797 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-727ef28f-6404-4750-9fe8-e6c8daba8d93 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:00.711723 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-727ef28f-6404-4750-9fe8-e6c8daba8d93 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:54:00.719232 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-727ef28f-6404-4750-9fe8-e6c8daba8d93 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.160297 Jul 20 05:54:00.719857 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3830/7761] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:54:00 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:54:01.738674 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-c89cbe85-c245-47a7-b5f5-a0b404f6a8eb tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:54:01.739319 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-c89cbe85-c245-47a7-b5f5-a0b404f6a8eb tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:54:01.746231 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c89cbe85-c245-47a7-b5f5-a0b404f6a8eb tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:01.746702 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c89cbe85-c245-47a7-b5f5-a0b404f6a8eb tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:01.747497 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c89cbe85-c245-47a7-b5f5-a0b404f6a8eb tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:01.747984 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-c89cbe85-c245-47a7-b5f5-a0b404f6a8eb tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:01.882888 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-c89cbe85-c245-47a7-b5f5-a0b404f6a8eb tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:54:01.890256 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-c89cbe85-c245-47a7-b5f5-a0b404f6a8eb tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.156573 Jul 20 05:54:01.890847 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3932/7762] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:54:01 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:54:02.906327 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7b469999-38c2-4f2d-95c2-2423d058ce6c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:54:02.907029 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7b469999-38c2-4f2d-95c2-2423d058ce6c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:54:02.915482 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b469999-38c2-4f2d-95c2-2423d058ce6c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:02.916129 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b469999-38c2-4f2d-95c2-2423d058ce6c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:02.917531 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b469999-38c2-4f2d-95c2-2423d058ce6c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:02.918043 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7b469999-38c2-4f2d-95c2-2423d058ce6c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:03.051344 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7b469999-38c2-4f2d-95c2-2423d058ce6c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:54:03.058872 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7b469999-38c2-4f2d-95c2-2423d058ce6c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.156452 Jul 20 05:54:03.059451 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3831/7763] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:54:02 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:54:04.076893 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-4aa1a620-2f7f-48be-8340-7f943887486c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:54:04.077533 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-4aa1a620-2f7f-48be-8340-7f943887486c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:54:04.085055 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aa1a620-2f7f-48be-8340-7f943887486c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:04.085528 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aa1a620-2f7f-48be-8340-7f943887486c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:04.086323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aa1a620-2f7f-48be-8340-7f943887486c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:04.086788 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-4aa1a620-2f7f-48be-8340-7f943887486c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:04.222368 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-4aa1a620-2f7f-48be-8340-7f943887486c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:54:04.230088 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-4aa1a620-2f7f-48be-8340-7f943887486c tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.157321 Jul 20 05:54:04.230667 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3933/7764] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:54:04 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:54:04.881021 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [req-5b31bb9d-a737-4f07-97a6-80d0f43fc39f req-a35a952e-1113-4df6-b776-af76c02fbc64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b446997-e19f-47d8-8871-97a01988c1de", "name": "network-vif-plugged", "status": "completed", "tag": "3ef9b3ee-a43a-4f2d-866b-712b26544774"}]} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:54:04.890738 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5b31bb9d-a737-4f07-97a6-80d0f43fc39f req-a35a952e-1113-4df6-b776-af76c02fbc64 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:04.891249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [req-5b31bb9d-a737-4f07-97a6-80d0f43fc39f req-a35a952e-1113-4df6-b776-af76c02fbc64 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:04.904344 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.compute.server_external_events [req-5b31bb9d-a737-4f07-97a6-80d0f43fc39f req-a35a952e-1113-4df6-b776-af76c02fbc64 service nova] Creating event network-vif-plugged:3ef9b3ee-a43a-4f2d-866b-712b26544774 for instance 9b446997-e19f-47d8-8871-97a01988c1de on n-h2-764485-11 Jul 20 05:54:04.910073 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [req-5b31bb9d-a737-4f07-97a6-80d0f43fc39f req-a35a952e-1113-4df6-b776-af76c02fbc64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033195 Jul 20 05:54:04.910939 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3832/7765] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:54:05.248638 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-39e1979e-fa66-4cf2-b78d-af670fd60425 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:54:05.249381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-39e1979e-fa66-4cf2-b78d-af670fd60425 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:54:05.257789 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39e1979e-fa66-4cf2-b78d-af670fd60425 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:05.258261 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39e1979e-fa66-4cf2-b78d-af670fd60425 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:05.259044 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39e1979e-fa66-4cf2-b78d-af670fd60425 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:05.259596 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-39e1979e-fa66-4cf2-b78d-af670fd60425 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:05.396696 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-39e1979e-fa66-4cf2-b78d-af670fd60425 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:54:05.404271 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-39e1979e-fa66-4cf2-b78d-af670fd60425 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.160389 Jul 20 05:54:05.404837 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3934/7766] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:54:05 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:54:06.423360 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-3aee1765-fe15-4400-846d-e8646c14ab06 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:54:06.424121 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-3aee1765-fe15-4400-846d-e8646c14ab06 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:54:06.431791 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3aee1765-fe15-4400-846d-e8646c14ab06 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:06.432249 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3aee1765-fe15-4400-846d-e8646c14ab06 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:06.433033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3aee1765-fe15-4400-846d-e8646c14ab06 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:06.433481 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-3aee1765-fe15-4400-846d-e8646c14ab06 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:06.573701 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-3aee1765-fe15-4400-846d-e8646c14ab06 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:54:06.581785 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-3aee1765-fe15-4400-846d-e8646c14ab06 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1375 microversion: 2.1 time: 0.163591 Jul 20 05:54:06.582359 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3833/7767] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:54:06 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:54:07.601083 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-46581a5b-b630-4ef5-b477-62a28adf0f86 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:54:07.601721 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-46581a5b-b630-4ef5-b477-62a28adf0f86 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:54:07.608938 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46581a5b-b630-4ef5-b477-62a28adf0f86 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:07.609409 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46581a5b-b630-4ef5-b477-62a28adf0f86 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:07.610189 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46581a5b-b630-4ef5-b477-62a28adf0f86 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:07.610650 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-46581a5b-b630-4ef5-b477-62a28adf0f86 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:07.740359 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-46581a5b-b630-4ef5-b477-62a28adf0f86 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:54:07.748123 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-46581a5b-b630-4ef5-b477-62a28adf0f86 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1561 microversion: 2.1 time: 0.151624 Jul 20 05:54:07.748701 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3935/7768] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:54:07 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:54:07.765008 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7fa70f37-5a20-4184-99b0-efad7d6b1224 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:54:07.765631 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7fa70f37-5a20-4184-99b0-efad7d6b1224 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:54:07.773139 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7fa70f37-5a20-4184-99b0-efad7d6b1224 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:07.773593 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7fa70f37-5a20-4184-99b0-efad7d6b1224 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:07.774366 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7fa70f37-5a20-4184-99b0-efad7d6b1224 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:07.774807 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7fa70f37-5a20-4184-99b0-efad7d6b1224 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:07.910554 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-7fa70f37-5a20-4184-99b0-efad7d6b1224 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:54:07.918231 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7fa70f37-5a20-4184-99b0-efad7d6b1224 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1561 microversion: 2.1 time: 0.157183 Jul 20 05:54:07.918827 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3834/7769] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:54:07 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:54:09.506511 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-45cdc036-a450-4b2e-b784-2362ae2bd972 req-7336dccc-1736-4ebf-9a7a-8549ec9b70b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b446997-e19f-47d8-8871-97a01988c1de", "tag": "3ef9b3ee-a43a-4f2d-866b-712b26544774"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:54:09.515315 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-45cdc036-a450-4b2e-b784-2362ae2bd972 req-7336dccc-1736-4ebf-9a7a-8549ec9b70b3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:54:09.515812 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-45cdc036-a450-4b2e-b784-2362ae2bd972 req-7336dccc-1736-4ebf-9a7a-8549ec9b70b3 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:54:09.527025 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-45cdc036-a450-4b2e-b784-2362ae2bd972 req-7336dccc-1736-4ebf-9a7a-8549ec9b70b3 service nova] Creating event network-changed:3ef9b3ee-a43a-4f2d-866b-712b26544774 for instance 9b446997-e19f-47d8-8871-97a01988c1de on n-h2-764485-11 Jul 20 05:54:09.532412 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-45cdc036-a450-4b2e-b784-2362ae2bd972 req-7336dccc-1736-4ebf-9a7a-8549ec9b70b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029624 Jul 20 05:54:09.533197 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3936/7770] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:56:23.056645 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:56:23.057403 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=62 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:56:23.110741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-7927fc4e-e2cb-44eb-8e17-d4b27917969e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-216724775"}} {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:56:23.111802 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-7927fc4e-e2cb-44eb-8e17-d4b27917969e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:56:23.118353 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7927fc4e-e2cb-44eb-8e17-d4b27917969e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:23.118806 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7927fc4e-e2cb-44eb-8e17-d4b27917969e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:23.119590 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7927fc4e-e2cb-44eb-8e17-d4b27917969e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:23.120033 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-7927fc4e-e2cb-44eb-8e17-d4b27917969e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:23.394387 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-7927fc4e-e2cb-44eb-8e17-d4b27917969e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "POST /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de/action" status: 202 len: 0 microversion: 2.1 time: 0.339716 Jul 20 05:56:23.395184 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3835/7771] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Jul 20 05:56:23 2022] POST /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 05:56:29.794259 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7f015b8-ffde-4af0-8b21-123d24411373] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 20 05:56:29.795353 n-d-764485-11 devstack@n-api.service[119808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4776198a-db9f-4da8-a9d3-98de639ffb43] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 20 05:56:29.796381 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=24 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:56:29.797159 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=56 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:56:29.859785 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-b7738224-10b3-47f5-810a-c2c884f4b9ed req-57126d06-b6a9-448d-9b42-2089aef26522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b446997-e19f-47d8-8871-97a01988c1de", "name": "network-vif-plugged", "status": "completed", "tag": "3ef9b3ee-a43a-4f2d-866b-712b26544774"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:56:29.869076 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b7738224-10b3-47f5-810a-c2c884f4b9ed req-57126d06-b6a9-448d-9b42-2089aef26522 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:29.869542 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-b7738224-10b3-47f5-810a-c2c884f4b9ed req-57126d06-b6a9-448d-9b42-2089aef26522 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:29.880817 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-b7738224-10b3-47f5-810a-c2c884f4b9ed req-57126d06-b6a9-448d-9b42-2089aef26522 service nova] Creating event network-vif-plugged:3ef9b3ee-a43a-4f2d-866b-712b26544774 for instance 9b446997-e19f-47d8-8871-97a01988c1de on n-h2-764485-11 Jul 20 05:56:29.885891 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-b7738224-10b3-47f5-810a-c2c884f4b9ed req-57126d06-b6a9-448d-9b42-2089aef26522 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095313 Jul 20 05:56:29.886462 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3937/7772] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:56:42.422868 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_api:SELECT=2 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:56:42.424322 n-d-764485-11 devstack@n-api.service[119807]: DEBUG dbcounter [-] [119807] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:56:42.427887 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_api:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:56:42.428810 n-d-764485-11 devstack@n-api.service[119808]: DEBUG dbcounter [-] [119808] Writing DB stats nova_cell1:SELECT=2 {{(pid=119808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:56:42.429702 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-38b156a0-e6b0-441d-8a85-8b45a2b51949 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:56:42.430304 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-38b156a0-e6b0-441d-8a85-8b45a2b51949 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:56:42.436480 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7f015b8-ffde-4af0-8b21-123d24411373] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56534. Jul 20 05:56:42.438834 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38b156a0-e6b0-441d-8a85-8b45a2b51949 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:42.439433 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38b156a0-e6b0-441d-8a85-8b45a2b51949 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:42.440239 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38b156a0-e6b0-441d-8a85-8b45a2b51949 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:42.440678 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-38b156a0-e6b0-441d-8a85-8b45a2b51949 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:42.442205 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-dac01748-5dcd-40f8-9190-7a397cbad183 req-dc36ac80-b88a-4ff3-b924-5efca6234365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b446997-e19f-47d8-8871-97a01988c1de", "tag": "3ef9b3ee-a43a-4f2d-866b-712b26544774"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:56:42.452553 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] [4776198a-db9f-4da8-a9d3-98de639ffb43] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56536. Jul 20 05:56:42.461589 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dac01748-5dcd-40f8-9190-7a397cbad183 req-dc36ac80-b88a-4ff3-b924-5efca6234365 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:42.462187 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-dac01748-5dcd-40f8-9190-7a397cbad183 req-dc36ac80-b88a-4ff3-b924-5efca6234365 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:42.469736 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-38b156a0-e6b0-441d-8a85-8b45a2b51949 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:56:42.473880 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-dac01748-5dcd-40f8-9190-7a397cbad183 req-dc36ac80-b88a-4ff3-b924-5efca6234365 service nova] Creating event network-changed:3ef9b3ee-a43a-4f2d-866b-712b26544774 for instance 9b446997-e19f-47d8-8871-97a01988c1de on n-h2-764485-11 Jul 20 05:56:42.479492 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-dac01748-5dcd-40f8-9190-7a397cbad183 req-dc36ac80-b88a-4ff3-b924-5efca6234365 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055951 Jul 20 05:56:42.480848 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3938/7773] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:56:42.557725 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-38b156a0-e6b0-441d-8a85-8b45a2b51949 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 204 len: 0 microversion: 2.1 time: 0.136583 Jul 20 05:56:42.558329 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3836/7774] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:56:42 2022] DELETE /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:56:42.570132 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-60c418f5-d2e5-419b-947a-3ef7d57caf56 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:56:42.570860 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-60c418f5-d2e5-419b-947a-3ef7d57caf56 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:56:42.578400 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-60c418f5-d2e5-419b-947a-3ef7d57caf56 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:42.578874 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-60c418f5-d2e5-419b-947a-3ef7d57caf56 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:42.579931 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-60c418f5-d2e5-419b-947a-3ef7d57caf56 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:42.580490 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-60c418f5-d2e5-419b-947a-3ef7d57caf56 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:42.721077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-60c418f5-d2e5-419b-947a-3ef7d57caf56 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:56:42.729088 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-60c418f5-d2e5-419b-947a-3ef7d57caf56 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1686 microversion: 2.1 time: 0.164524 Jul 20 05:56:42.729672 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3939/7775] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:56:42 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:56:43.747329 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-b6c94473-1c67-4843-ab4e-818db003b6b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:56:43.748053 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-b6c94473-1c67-4843-ab4e-818db003b6b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:56:43.757423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6c94473-1c67-4843-ab4e-818db003b6b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:43.757877 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6c94473-1c67-4843-ab4e-818db003b6b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:43.758657 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6c94473-1c67-4843-ab4e-818db003b6b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:43.759136 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-b6c94473-1c67-4843-ab4e-818db003b6b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:43.875197 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-acf40286-0db0-493e-bc50-8a935b455ecf req-dc622024-5dd8-4476-a8c9-0a2f5f354ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b446997-e19f-47d8-8871-97a01988c1de", "name": "network-vif-unplugged", "status": "completed", "tag": "3ef9b3ee-a43a-4f2d-866b-712b26544774"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:56:43.889734 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-acf40286-0db0-493e-bc50-8a935b455ecf req-dc622024-5dd8-4476-a8c9-0a2f5f354ec4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:43.890284 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-acf40286-0db0-493e-bc50-8a935b455ecf req-dc622024-5dd8-4476-a8c9-0a2f5f354ec4 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:43.909451 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-acf40286-0db0-493e-bc50-8a935b455ecf req-dc622024-5dd8-4476-a8c9-0a2f5f354ec4 service nova] Creating event network-vif-unplugged:3ef9b3ee-a43a-4f2d-866b-712b26544774 for instance 9b446997-e19f-47d8-8871-97a01988c1de on n-h2-764485-11 Jul 20 05:56:43.919995 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-acf40286-0db0-493e-bc50-8a935b455ecf req-dc622024-5dd8-4476-a8c9-0a2f5f354ec4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047464 Jul 20 05:56:43.921483 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3940/7776] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:56:43.972938 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-b6c94473-1c67-4843-ab4e-818db003b6b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:56:43.980659 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-b6c94473-1c67-4843-ab4e-818db003b6b8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1686 microversion: 2.1 time: 0.237571 Jul 20 05:56:43.981234 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3837/7777] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:56:43 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1686 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:56:44.893145 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-17b950d4-1bfc-4bcb-ac48-a84c080e1b62 req-1db3d9e4-5d79-4a9f-aad6-40b861ff870a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b446997-e19f-47d8-8871-97a01988c1de", "name": "network-vif-deleted", "tag": "3ef9b3ee-a43a-4f2d-866b-712b26544774"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:56:44.902133 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-17b950d4-1bfc-4bcb-ac48-a84c080e1b62 req-1db3d9e4-5d79-4a9f-aad6-40b861ff870a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:44.902598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-17b950d4-1bfc-4bcb-ac48-a84c080e1b62 req-1db3d9e4-5d79-4a9f-aad6-40b861ff870a service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:44.914670 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-17b950d4-1bfc-4bcb-ac48-a84c080e1b62 req-1db3d9e4-5d79-4a9f-aad6-40b861ff870a service nova] Creating event network-vif-deleted:3ef9b3ee-a43a-4f2d-866b-712b26544774 for instance 9b446997-e19f-47d8-8871-97a01988c1de on n-h2-764485-11 Jul 20 05:56:44.919527 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-17b950d4-1bfc-4bcb-ac48-a84c080e1b62 req-1db3d9e4-5d79-4a9f-aad6-40b861ff870a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084750 Jul 20 05:56:44.920131 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3941/7778] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:56:44.998210 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-c9887ee9-7425-44e3-892e-10abd2996d43 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:56:44.998836 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-c9887ee9-7425-44e3-892e-10abd2996d43 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:56:45.006790 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9887ee9-7425-44e3-892e-10abd2996d43 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:45.007246 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9887ee9-7425-44e3-892e-10abd2996d43 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:45.008063 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9887ee9-7425-44e3-892e-10abd2996d43 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:45.008509 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-c9887ee9-7425-44e3-892e-10abd2996d43 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:45.086501 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-c9887ee9-7425-44e3-892e-10abd2996d43 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:56:45.094543 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-c9887ee9-7425-44e3-892e-10abd2996d43 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 200 len: 1499 microversion: 2.1 time: 0.100284 Jul 20 05:56:45.095127 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3838/7779] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:56:44 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 1499 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:56:46.113934 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-28b9e4ec-b69d-45d5-a662-c106b3f6f685 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:56:46.114794 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-28b9e4ec-b69d-45d5-a662-c106b3f6f685 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 9b446997-e19f-47d8-8871-97a01988c1de] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:56:46.121126 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28b9e4ec-b69d-45d5-a662-c106b3f6f685 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:46.121582 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28b9e4ec-b69d-45d5-a662-c106b3f6f685 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:46.122347 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28b9e4ec-b69d-45d5-a662-c106b3f6f685 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:46.122799 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-28b9e4ec-b69d-45d5-a662-c106b3f6f685 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:46.136530 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-28b9e4ec-b69d-45d5-a662-c106b3f6f685 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] HTTP exception thrown: Instance 9b446997-e19f-47d8-8871-97a01988c1de could not be found. Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-28b9e4ec-b69d-45d5-a662-c106b3f6f685 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Request method failure captured: Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de HTTP/1.1 Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi15ewb8NyJSY-fVlNkcJbB0VqMEdbjXTacB7AmoBPY4D7LbFVZi0uRv_vtswntRQAXORx_2oNosYZuZZea_m0o3bzgMWL55ANa7Lh0gVhkYWnEYj1gxQgaUzVJB0lvDxE9jWfOkBruJSPwVV8bxeM9AgDXuhUgH7dwLFk9q6TwGMwszU Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 4a6742536c1246e0a073930295cd673a Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestSnapshotPattern-1036182860 Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a6742536c1246e0a073930295cd673a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a6742536c1246e0a073930295cd673a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a6742536c1246e0a073930295cd673a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a6742536c1246e0a073930295cd673a"}]}] Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestSnapshotPattern-1036182860 Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 4a6742536c1246e0a073930295cd673a Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestSnapshotPattern-1036182860 Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestSnapshotPattern-1036182860-project Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 1a021dd575154e7cafbcbcbd3f292225 Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestSnapshotPattern-1036182860-project Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 9b446997-e19f-47d8-8871-97a01988c1de could not be found. Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '9b446997-e19f-47d8-8871-97a01988c1de'} Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b446997-e19f-47d8-8871-97a01988c1de could not be found. Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b446997-e19f-47d8-8871-97a01988c1de could not be found. Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:56:46.138148 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:56:46.143323 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:56:46.143323 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:56:46.143323 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:56:46.143323 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:56:46.143323 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:56:46.143323 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b446997-e19f-47d8-8871-97a01988c1de could not be found. Jul 20 05:56:46.143323 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:56:46.143323 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-28b9e4ec-b69d-45d5-a662-c106b3f6f685 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Returning 404 to user: Instance 9b446997-e19f-47d8-8871-97a01988c1de could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:56:46.143323 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-28b9e4ec-b69d-45d5-a662-c106b3f6f685 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de" status: 404 len: 111 microversion: 2.1 time: 0.031494 Jul 20 05:56:46.143323 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3942/7780] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:56:46 2022] GET /compute/v2.1/servers/9b446997-e19f-47d8-8871-97a01988c1de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:56:47.479750 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-658d3ead-53f8-4a7a-ad43-8fd5ddcdbcd3 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:56:47.480291 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-658d3ead-53f8-4a7a-ad43-8fd5ddcdbcd3 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:56:47.481366 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-3bcf4bc3-6139-48cf-aa19-f843c5d5acfc req-fc21890d-b369-4e1f-ac49-498cf8dc6962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1e6e4e-9034-4822-81f6-918c2a7923c1", "tag": "33040443-8a9d-4951-b0b2-64bb18c3a205"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:56:47.486669 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-658d3ead-53f8-4a7a-ad43-8fd5ddcdbcd3 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:47.487161 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-658d3ead-53f8-4a7a-ad43-8fd5ddcdbcd3 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:47.487975 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-658d3ead-53f8-4a7a-ad43-8fd5ddcdbcd3 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:47.488423 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-658d3ead-53f8-4a7a-ad43-8fd5ddcdbcd3 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:47.490350 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3bcf4bc3-6139-48cf-aa19-f843c5d5acfc req-fc21890d-b369-4e1f-ac49-498cf8dc6962 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:47.490818 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-3bcf4bc3-6139-48cf-aa19-f843c5d5acfc req-fc21890d-b369-4e1f-ac49-498cf8dc6962 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:47.502543 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-3bcf4bc3-6139-48cf-aa19-f843c5d5acfc req-fc21890d-b369-4e1f-ac49-498cf8dc6962 service nova] Creating event network-changed:33040443-8a9d-4951-b0b2-64bb18c3a205 for instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 on n-h1-764485-11 Jul 20 05:56:47.509396 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-3bcf4bc3-6139-48cf-aa19-f843c5d5acfc req-fc21890d-b369-4e1f-ac49-498cf8dc6962 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031188 Jul 20 05:56:47.513754 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3943/7781] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:56:47.517793 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-658d3ead-53f8-4a7a-ad43-8fd5ddcdbcd3 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Going to try to terminate instance {{(pid=119807) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:56:47.612192 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-658d3ead-53f8-4a7a-ad43-8fd5ddcdbcd3 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 204 len: 0 microversion: 2.1 time: 0.136311 Jul 20 05:56:47.616817 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3839/7782] 10.222.0.20 () {58 vars in 1238 bytes} [Wed Jul 20 05:56:47 2022] DELETE /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:56:47.622136 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-f339024e-43e0-45f5-9e2d-f2b3bb0d37e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:56:47.622856 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-f339024e-43e0-45f5-9e2d-f2b3bb0d37e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:56:47.630357 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f339024e-43e0-45f5-9e2d-f2b3bb0d37e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:47.630830 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f339024e-43e0-45f5-9e2d-f2b3bb0d37e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:47.631666 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f339024e-43e0-45f5-9e2d-f2b3bb0d37e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:47.632118 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-f339024e-43e0-45f5-9e2d-f2b3bb0d37e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:47.781296 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.policy [None req-f339024e-43e0-45f5-9e2d-f2b3bb0d37e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119808) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:56:47.789232 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-f339024e-43e0-45f5-9e2d-f2b3bb0d37e8 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1684 microversion: 2.1 time: 0.171392 Jul 20 05:56:47.789906 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3944/7783] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:56:47 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:56:48.808131 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-86bd15c1-f4b4-4782-805a-c162ecd88195 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:56:48.808741 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.compute.api [None req-86bd15c1-f4b4-4782-805a-c162ecd88195 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119807) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:56:48.815693 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86bd15c1-f4b4-4782-805a-c162ecd88195 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:48.816225 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86bd15c1-f4b4-4782-805a-c162ecd88195 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:48.817270 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86bd15c1-f4b4-4782-805a-c162ecd88195 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:48.817712 n-d-764485-11 devstack@n-api.service[119807]: DEBUG oslo_concurrency.lockutils [None req-86bd15c1-f4b4-4782-805a-c162ecd88195 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:48.841932 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [req-04a88b42-9dde-40d8-b999-f59a48a17788 req-2e9bb0fd-730c-4008-89ef-e2925fa72e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1e6e4e-9034-4822-81f6-918c2a7923c1", "name": "network-vif-deleted", "tag": "33040443-8a9d-4951-b0b2-64bb18c3a205"}]} {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:56:48.852130 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-04a88b42-9dde-40d8-b999-f59a48a17788 req-2e9bb0fd-730c-4008-89ef-e2925fa72e05 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:48.852598 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [req-04a88b42-9dde-40d8-b999-f59a48a17788 req-2e9bb0fd-730c-4008-89ef-e2925fa72e05 service nova] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:48.865340 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.compute.server_external_events [req-04a88b42-9dde-40d8-b999-f59a48a17788 req-2e9bb0fd-730c-4008-89ef-e2925fa72e05 service nova] Creating event network-vif-deleted:33040443-8a9d-4951-b0b2-64bb18c3a205 for instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 on n-h1-764485-11 Jul 20 05:56:48.873373 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [req-04a88b42-9dde-40d8-b999-f59a48a17788 req-2e9bb0fd-730c-4008-89ef-e2925fa72e05 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034932 Jul 20 05:56:48.874006 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3945/7784] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Jul 20 05:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:56:48.904212 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.policy [None req-86bd15c1-f4b4-4782-805a-c162ecd88195 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a021dd575154e7cafbcbcbd3f292225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6742536c1246e0a073930295cd673a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119807) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:56:48.912878 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-86bd15c1-f4b4-4782-805a-c162ecd88195 tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 200 len: 1497 microversion: 2.1 time: 0.108759 Jul 20 05:56:48.922162 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3840/7785] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:56:48 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 1497 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:56:49.931539 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bd337c99-7402-49ae-91c1-0fbc734a485b tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '>' {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:56:49.932262 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.compute.api [None req-bd337c99-7402-49ae-91c1-0fbc734a485b tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [instance: 1a1e6e4e-9034-4822-81f6-918c2a7923c1] Fetching instance by UUID {{(pid=119808) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:56:49.938607 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd337c99-7402-49ae-91c1-0fbc734a485b tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:49.939077 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd337c99-7402-49ae-91c1-0fbc734a485b tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:49.939879 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd337c99-7402-49ae-91c1-0fbc734a485b tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:56:49.940397 n-d-764485-11 devstack@n-api.service[119808]: DEBUG oslo_concurrency.lockutils [None req-bd337c99-7402-49ae-91c1-0fbc734a485b tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Lock "de97e2bb-c8a2-4715-aa13-5b0025147107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:56:49.954221 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.wsgi [None req-bd337c99-7402-49ae-91c1-0fbc734a485b tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] HTTP exception thrown: Instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 could not be found. Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bd337c99-7402-49ae-91c1-0fbc734a485b tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Request method failure captured: Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: request: GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 HTTP/1.1 Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: Accept: application/json Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: Accept-Encoding: identity Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: Connection: close Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: Content-Length: 0 Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: Content-Type: application/json Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: Host: 10.222.0.20 Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: Openstack-System-Scope: None Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: User-Agent: python-urllib3/1.26.9 Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Auth-Token: gAAAAABi15ewb8NyJSY-fVlNkcJbB0VqMEdbjXTacB7AmoBPY4D7LbFVZi0uRv_vtswntRQAXORx_2oNosYZuZZea_m0o3bzgMWL55ANa7Lh0gVhkYWnEYj1gxQgaUzVJB0lvDxE9jWfOkBruJSPwVV8bxeM9AgDXuhUgH7dwLFk9q6TwGMwszU Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Id: None Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Domain-Name: None Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Identity-Status: Confirmed Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Is-Admin-Project: True Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Id: default Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Domain-Name: Default Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Id: 4a6742536c1246e0a073930295cd673a Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Project-Name: tempest-TestSnapshotPattern-1036182860 Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Role: member,reader Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Roles: member,reader Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a6742536c1246e0a073930295cd673a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a6742536c1246e0a073930295cd673a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a6742536c1246e0a073930295cd673a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a6742536c1246e0a073930295cd673a"}]}] Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant: tempest-TestSnapshotPattern-1036182860 Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Id: 4a6742536c1246e0a073930295cd673a Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-Tenant-Name: tempest-TestSnapshotPattern-1036182860 Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-User: tempest-TestSnapshotPattern-1036182860-project Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Id: default Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-User-Domain-Name: Default Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-User-Id: 1a021dd575154e7cafbcbcbd3f292225 Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: X-User-Name: tempest-TestSnapshotPattern-1036182860-project Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: method: > Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: exception: Instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 could not be found. Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: action_args: {'id': '1a1e6e4e-9034-4822-81f6-918c2a7923c1'} Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: {{(pid=119808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 could not be found. Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 could not be found. Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:56:49.956051 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:56:49.961870 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:56:49.961870 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:56:49.961870 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:56:49.961870 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:56:49.961870 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:56:49.961870 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 could not be found. Jul 20 05:56:49.961870 n-d-764485-11 devstack@n-api.service[119808]: ERROR nova.api.openstack.wsgi Jul 20 05:56:49.961870 n-d-764485-11 devstack@n-api.service[119808]: DEBUG nova.api.openstack.wsgi [None req-bd337c99-7402-49ae-91c1-0fbc734a485b tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Returning 404 to user: Instance 1a1e6e4e-9034-4822-81f6-918c2a7923c1 could not be found. {{(pid=119808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:56:49.961870 n-d-764485-11 devstack@n-api.service[119808]: INFO nova.api.openstack.requestlog [None req-bd337c99-7402-49ae-91c1-0fbc734a485b tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1" status: 404 len: 111 microversion: 2.1 time: 0.031830 Jul 20 05:56:49.961870 n-d-764485-11 devstack@n-api.service[119808]: [pid: 119808|app: 0|req: 3946/7786] 10.222.0.20 () {58 vars in 1235 bytes} [Wed Jul 20 05:56:49 2022] GET /compute/v2.1/servers/1a1e6e4e-9034-4822-81f6-918c2a7923c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:56:50.127709 n-d-764485-11 devstack@n-api.service[119807]: DEBUG nova.api.openstack.wsgi [None req-e3724d7c-2086-420c-8e4d-eae42dc22d9e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] Calling method '.version_select at 0x7fbf8ffefdc0>' {{(pid=119807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:56:50.131621 n-d-764485-11 devstack@n-api.service[119807]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e3724d7c-2086-420c-8e4d-eae42dc22d9e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [bca7174f-0467-4fc3-b62f-e45d1aa4ab6a] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:56:51.139710 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [None req-e3724d7c-2086-420c-8e4d-eae42dc22d9e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] [bca7174f-0467-4fc3-b62f-e45d1aa4ab6a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56614. Jul 20 05:56:51.158554 n-d-764485-11 devstack@n-api.service[119807]: INFO nova.api.openstack.requestlog [None req-e3724d7c-2086-420c-8e4d-eae42dc22d9e tempest-TestSnapshotPattern-1036182860 tempest-TestSnapshotPattern-1036182860-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2117139941" status: 202 len: 0 microversion: 2.1 time: 1.035039 Jul 20 05:56:51.159138 n-d-764485-11 devstack@n-api.service[119807]: [pid: 119807|app: 0|req: 3841/7787] 10.222.0.20 () {58 vars in 1256 bytes} [Wed Jul 20 05:56:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2117139941 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:56:55.760955 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:56:55.761608 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:56:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:56:55.770154 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:56:55.770348 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 05:56:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:56:56.922255 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:56:56.922822 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:56:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:58:51.177219 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:58:51.177934 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 05:58:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 06:00:15.769904 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:00:15.770504 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 06:00:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 06:00:15.778999 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:00:15.778999 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 06:00:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 06:00:16.933649 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:00:16.934288 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 06:00:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 06:01:57.364852 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:01:57.365570 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 06:01:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 06:02:11.185139 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:02:11.185838 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 06:02:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 06:02:13.012682 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:02:13.013258 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 06:02:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 06:03:35.778642 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:03:35.779376 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 06:03:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 06:03:35.786840 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:03:35.787016 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 06:03:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 06:03:36.942756 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:03:36.943299 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 06:03:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 06:05:17.374264 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:05:17.375108 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 06:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 06:05:31.193523 n-d-764485-11 devstack@n-api.service[119807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:05:31.194085 n-d-764485-11 devstack@n-api.service[119807]: Wed Jul 20 06:05:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 06:05:33.021445 n-d-764485-11 devstack@n-api.service[119808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:05:33.022064 n-d-764485-11 devstack@n-api.service[119808]: Wed Jul 20 06:05:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!